2024-09-13T18:14:13.375 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T18:14:13.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T18:14:13.539 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903979 branch: wip-rishabh-testing-20240910.100730-reef description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/journal-repair} email: null first_in_suite: false job_id: '7903979' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-rishabh-testing-20240910.100730-reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - bad backtrace on directory inode - error reading table object - Metadata damage detected - slow requests are blocked - Behind on trimming - error reading sessionmap sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.100730-reef sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6439 sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 sleep_before_teardown: 0 subset: 964/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.100730-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi044.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_journal_repair teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:42:16 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T18:14:13.540 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa; will attempt to use it 2024-09-13T18:14:13.540 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa/tasks 2024-09-13T18:14:13.541 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T18:14:13.542 INFO:teuthology.task.internal:Checking packages... 2024-09-13T18:14:13.565 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3' 2024-09-13T18:14:13.565 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T18:14:13.565 INFO:teuthology.packaging:ref: None 2024-09-13T18:14:13.565 INFO:teuthology.packaging:tag: None 2024-09-13T18:14:13.565 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:14:13.565 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:14:13.565 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:14:13.714 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-860-g6c6b083f-1focal 2024-09-13T18:14:13.716 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T18:14:13.722 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T18:14:13.722 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T18:14:13.766 INFO:teuthology.task.internal:Saving configuration 2024-09-13T18:14:13.782 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T18:14:13.791 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T18:14:13.820 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903979', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 18:08:28.098590', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-13T18:14:13.849 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903979', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 18:08:28.099706', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-13T18:14:13.849 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T18:14:13.856 INFO:teuthology.task.internal:roles: ubuntu@smithi044.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-13T18:14:13.856 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-13T18:14:13.856 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T18:14:13.941 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2215117be0>, signals=[15]) 2024-09-13T18:14:13.941 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T18:14:13.947 INFO:teuthology.task.internal:Opening connections... 2024-09-13T18:14:13.947 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:14:13.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:14:14.047 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:14:14.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:14:14.153 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T18:14:14.159 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2024-09-13T18:14:14.166 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2024-09-13T18:14:14.166 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-09-13T18:14:14.216 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="Ubuntu" 2024-09-13T18:14:14.216 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-13T18:14:14.216 INFO:teuthology.orchestra.run.smithi044.stdout:ID=ubuntu 2024-09-13T18:14:14.216 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE=debian 2024-09-13T18:14:14.216 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-13T18:14:14.216 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="20.04" 2024-09-13T18:14:14.217 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T18:14:14.217 INFO:teuthology.orchestra.run.smithi044.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T18:14:14.217 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T18:14:14.217 INFO:teuthology.orchestra.run.smithi044.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T18:14:14.217 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_CODENAME=focal 2024-09-13T18:14:14.217 INFO:teuthology.orchestra.run.smithi044.stdout:UBUNTU_CODENAME=focal 2024-09-13T18:14:14.217 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-09-13T18:14:14.246 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-09-13T18:14:14.252 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-09-13T18:14:14.253 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-09-13T18:14:14.302 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Ubuntu" 2024-09-13T18:14:14.302 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-13T18:14:14.302 INFO:teuthology.orchestra.run.smithi099.stdout:ID=ubuntu 2024-09-13T18:14:14.302 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE=debian 2024-09-13T18:14:14.303 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-13T18:14:14.303 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="20.04" 2024-09-13T18:14:14.303 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T18:14:14.303 INFO:teuthology.orchestra.run.smithi099.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T18:14:14.303 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T18:14:14.303 INFO:teuthology.orchestra.run.smithi099.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T18:14:14.303 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_CODENAME=focal 2024-09-13T18:14:14.303 INFO:teuthology.orchestra.run.smithi099.stdout:UBUNTU_CODENAME=focal 2024-09-13T18:14:14.303 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-09-13T18:14:14.346 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T18:14:14.355 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T18:14:14.374 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T18:14:14.374 DEBUG:teuthology.orchestra.run.smithi044:> test '!' -e /home/ubuntu/cephtest 2024-09-13T18:14:14.376 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2024-09-13T18:14:14.382 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T18:14:14.399 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T18:14:14.399 DEBUG:teuthology.orchestra.run.smithi044:> test -z $(ls -A /var/lib/ceph) 2024-09-13T18:14:14.401 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2024-09-13T18:14:14.526 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T18:14:14.594 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T18:14:14.608 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T18:14:14.608 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T18:14:14.609 DEBUG:teuthology.orchestra.run.smithi044:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T18:14:14.609 DEBUG:teuthology.orchestra.run.smithi099:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T18:14:14.614 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:14:14.615 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2024-09-13T18:14:14.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:14:14.616 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-09-13T18:14:14.622 INFO:teuthology.orchestra.run.smithi044.stdout:5.4.0-124-generic 2024-09-13T18:14:14.622 INFO:teuthology.task.kernel:Running kernel on smithi044: 5.4.0-124-generic 2024-09-13T18:14:14.622 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-get clean 2024-09-13T18:14:14.623 INFO:teuthology.orchestra.run.smithi099.stdout:5.4.0-124-generic 2024-09-13T18:14:14.623 INFO:teuthology.task.kernel:Running kernel on smithi099: 5.4.0-124-generic 2024-09-13T18:14:14.624 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get clean 2024-09-13T18:14:14.732 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2024-09-13T18:14:14.769 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-get update 2024-09-13T18:14:14.907 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T18:14:14.921 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-09-13T18:14:14.946 INFO:teuthology.orchestra.run.smithi044.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-09-13T18:14:14.978 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-09-13T18:14:15.014 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-09-13T18:14:15.050 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T18:14:15.132 INFO:teuthology.orchestra.run.smithi044.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-09-13T18:14:15.249 INFO:teuthology.orchestra.run.smithi044.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [812 kB] 2024-09-13T18:14:15.301 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,563 kB] 2024-09-13T18:14:15.331 INFO:teuthology.orchestra.run.smithi044.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,195 kB] 2024-09-13T18:14:15.372 INFO:teuthology.orchestra.run.smithi044.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [472 kB] 2024-09-13T18:14:15.375 INFO:teuthology.orchestra.run.smithi044.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.3 kB] 2024-09-13T18:14:15.375 INFO:teuthology.orchestra.run.smithi044.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.3 kB] 2024-09-13T18:14:15.376 INFO:teuthology.orchestra.run.smithi044.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,117 kB] 2024-09-13T18:14:15.396 INFO:teuthology.orchestra.run.smithi044.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [436 kB] 2024-09-13T18:14:15.399 INFO:teuthology.orchestra.run.smithi044.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [548 B] 2024-09-13T18:14:15.399 INFO:teuthology.orchestra.run.smithi044.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [1,011 kB] 2024-09-13T18:14:15.405 INFO:teuthology.orchestra.run.smithi044.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [681 kB] 2024-09-13T18:14:15.409 INFO:teuthology.orchestra.run.smithi044.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [213 kB] 2024-09-13T18:14:15.411 INFO:teuthology.orchestra.run.smithi044.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.2 kB] 2024-09-13T18:14:15.411 INFO:teuthology.orchestra.run.smithi044.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-09-13T18:14:15.411 INFO:teuthology.orchestra.run.smithi044.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-09-13T18:14:15.412 INFO:teuthology.orchestra.run.smithi044.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-09-13T18:14:15.424 INFO:teuthology.orchestra.run.smithi044.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-09-13T18:14:15.464 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,030 kB] 2024-09-13T18:14:15.481 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [550 kB] 2024-09-13T18:14:15.485 INFO:teuthology.orchestra.run.smithi044.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-09-13T18:14:15.485 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-09-13T18:14:15.485 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,236 kB] 2024-09-13T18:14:15.507 INFO:teuthology.orchestra.run.smithi099.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.6 kB] 2024-09-13T18:14:15.507 INFO:teuthology.orchestra.run.smithi099.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [453 kB] 2024-09-13T18:14:15.510 INFO:teuthology.orchestra.run.smithi099.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [548 B] 2024-09-13T18:14:15.510 INFO:teuthology.orchestra.run.smithi099.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [807 kB] 2024-09-13T18:14:15.516 INFO:teuthology.orchestra.run.smithi099.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,230 kB] 2024-09-13T18:14:15.526 INFO:teuthology.orchestra.run.smithi099.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [295 kB] 2024-09-13T18:14:15.528 INFO:teuthology.orchestra.run.smithi099.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [28.0 kB] 2024-09-13T18:14:15.529 INFO:teuthology.orchestra.run.smithi099.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-09-13T18:14:15.529 INFO:teuthology.orchestra.run.smithi099.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-09-13T18:14:15.534 INFO:teuthology.orchestra.run.smithi099.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-09-13T18:14:15.534 INFO:teuthology.orchestra.run.smithi099.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-09-13T18:14:15.534 INFO:teuthology.orchestra.run.smithi099.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-09-13T18:14:15.535 INFO:teuthology.orchestra.run.smithi099.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-09-13T18:14:15.551 INFO:teuthology.orchestra.run.smithi099.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-09-13T18:14:15.551 INFO:teuthology.orchestra.run.smithi099.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-09-13T18:14:15.552 INFO:teuthology.orchestra.run.smithi099.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-09-13T18:14:15.575 INFO:teuthology.orchestra.run.smithi099.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-09-13T18:14:15.626 INFO:teuthology.orchestra.run.smithi044.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,563 kB] 2024-09-13T18:14:15.648 INFO:teuthology.orchestra.run.smithi099.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [812 kB] 2024-09-13T18:14:15.983 INFO:teuthology.orchestra.run.smithi099.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,195 kB] 2024-09-13T18:14:16.009 INFO:teuthology.orchestra.run.smithi044.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,030 kB] 2024-09-13T18:14:16.037 INFO:teuthology.orchestra.run.smithi044.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [550 kB] 2024-09-13T18:14:16.051 INFO:teuthology.orchestra.run.smithi044.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-09-13T18:14:16.051 INFO:teuthology.orchestra.run.smithi044.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.6 kB] 2024-09-13T18:14:16.052 INFO:teuthology.orchestra.run.smithi044.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,236 kB] 2024-09-13T18:14:16.146 INFO:teuthology.orchestra.run.smithi044.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [453 kB] 2024-09-13T18:14:16.162 INFO:teuthology.orchestra.run.smithi044.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [548 B] 2024-09-13T18:14:16.162 INFO:teuthology.orchestra.run.smithi044.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [807 kB] 2024-09-13T18:14:16.176 INFO:teuthology.orchestra.run.smithi099.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [472 kB] 2024-09-13T18:14:16.185 INFO:teuthology.orchestra.run.smithi044.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,230 kB] 2024-09-13T18:14:16.190 INFO:teuthology.orchestra.run.smithi099.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.3 kB] 2024-09-13T18:14:16.191 INFO:teuthology.orchestra.run.smithi099.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.3 kB] 2024-09-13T18:14:16.192 INFO:teuthology.orchestra.run.smithi099.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,117 kB] 2024-09-13T18:14:16.217 INFO:teuthology.orchestra.run.smithi044.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [295 kB] 2024-09-13T18:14:16.226 INFO:teuthology.orchestra.run.smithi044.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [28.0 kB] 2024-09-13T18:14:16.227 INFO:teuthology.orchestra.run.smithi044.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-09-13T18:14:16.227 INFO:teuthology.orchestra.run.smithi044.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-09-13T18:14:16.227 INFO:teuthology.orchestra.run.smithi044.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-09-13T18:14:16.258 INFO:teuthology.orchestra.run.smithi044.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-09-13T18:14:16.258 INFO:teuthology.orchestra.run.smithi044.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-09-13T18:14:16.259 INFO:teuthology.orchestra.run.smithi044.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-09-13T18:14:16.281 INFO:teuthology.orchestra.run.smithi099.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [436 kB] 2024-09-13T18:14:16.295 INFO:teuthology.orchestra.run.smithi099.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [548 B] 2024-09-13T18:14:16.295 INFO:teuthology.orchestra.run.smithi099.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [1,011 kB] 2024-09-13T18:14:16.323 INFO:teuthology.orchestra.run.smithi099.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [681 kB] 2024-09-13T18:14:16.339 INFO:teuthology.orchestra.run.smithi044.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-09-13T18:14:16.340 INFO:teuthology.orchestra.run.smithi044.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-09-13T18:14:16.340 INFO:teuthology.orchestra.run.smithi044.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-09-13T18:14:16.341 INFO:teuthology.orchestra.run.smithi044.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-09-13T18:14:16.345 INFO:teuthology.orchestra.run.smithi099.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [213 kB] 2024-09-13T18:14:16.352 INFO:teuthology.orchestra.run.smithi099.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.2 kB] 2024-09-13T18:14:16.352 INFO:teuthology.orchestra.run.smithi099.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-09-13T18:14:16.353 INFO:teuthology.orchestra.run.smithi099.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-09-13T18:14:16.353 INFO:teuthology.orchestra.run.smithi099.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-09-13T18:14:16.426 INFO:teuthology.orchestra.run.smithi099.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-09-13T18:14:19.848 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 21.8 MB in 3s (7,166 kB/s) 2024-09-13T18:14:19.852 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 21.8 MB in 3s (7,073 kB/s) 2024-09-13T18:14:21.344 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-09-13T18:14:21.364 DEBUG:teuthology.orchestra.run.smithi044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T18:14:21.401 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-09-13T18:14:21.428 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T18:14:21.444 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-09-13T18:14:21.511 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-09-13T18:14:21.668 INFO:teuthology.orchestra.run.smithi044.stdout:Building dependency tree... 2024-09-13T18:14:21.669 INFO:teuthology.orchestra.run.smithi044.stdout:Reading state information... 2024-09-13T18:14:21.731 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-09-13T18:14:21.731 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-09-13T18:14:21.885 INFO:teuthology.orchestra.run.smithi044.stdout:The following additional packages will be installed: 2024-09-13T18:14:21.885 INFO:teuthology.orchestra.run.smithi044.stdout: linux-generic linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-13T18:14:21.885 INFO:teuthology.orchestra.run.smithi044.stdout: linux-headers-generic linux-image-5.4.0-195-generic 2024-09-13T18:14:21.886 INFO:teuthology.orchestra.run.smithi044.stdout: linux-modules-5.4.0-195-generic linux-modules-extra-5.4.0-195-generic 2024-09-13T18:14:21.887 INFO:teuthology.orchestra.run.smithi044.stdout:Suggested packages: 2024-09-13T18:14:21.887 INFO:teuthology.orchestra.run.smithi044.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-09-13T18:14:21.887 INFO:teuthology.orchestra.run.smithi044.stdout:Recommended packages: 2024-09-13T18:14:21.887 INFO:teuthology.orchestra.run.smithi044.stdout: thermald 2024-09-13T18:14:21.927 INFO:teuthology.orchestra.run.smithi099.stdout:The following additional packages will be installed: 2024-09-13T18:14:21.928 INFO:teuthology.orchestra.run.smithi099.stdout: linux-generic linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-13T18:14:21.928 INFO:teuthology.orchestra.run.smithi099.stdout: linux-headers-generic linux-image-5.4.0-195-generic 2024-09-13T18:14:21.928 INFO:teuthology.orchestra.run.smithi099.stdout: linux-modules-5.4.0-195-generic linux-modules-extra-5.4.0-195-generic 2024-09-13T18:14:21.929 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2024-09-13T18:14:21.929 INFO:teuthology.orchestra.run.smithi099.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-09-13T18:14:21.929 INFO:teuthology.orchestra.run.smithi099.stdout:Recommended packages: 2024-09-13T18:14:21.929 INFO:teuthology.orchestra.run.smithi099.stdout: thermald 2024-09-13T18:14:21.945 INFO:teuthology.orchestra.run.smithi044.stdout:The following NEW packages will be installed: 2024-09-13T18:14:21.945 INFO:teuthology.orchestra.run.smithi044.stdout: linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-13T18:14:21.945 INFO:teuthology.orchestra.run.smithi044.stdout: linux-image-5.4.0-195-generic linux-modules-5.4.0-195-generic 2024-09-13T18:14:21.946 INFO:teuthology.orchestra.run.smithi044.stdout: linux-modules-extra-5.4.0-195-generic 2024-09-13T18:14:21.947 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages will be upgraded: 2024-09-13T18:14:21.948 INFO:teuthology.orchestra.run.smithi044.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T18:14:21.982 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2024-09-13T18:14:21.982 INFO:teuthology.orchestra.run.smithi099.stdout: linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-13T18:14:21.982 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.4.0-195-generic linux-modules-5.4.0-195-generic 2024-09-13T18:14:21.983 INFO:teuthology.orchestra.run.smithi099.stdout: linux-modules-extra-5.4.0-195-generic 2024-09-13T18:14:21.984 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages will be upgraded: 2024-09-13T18:14:21.984 INFO:teuthology.orchestra.run.smithi099.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T18:14:22.149 INFO:teuthology.orchestra.run.smithi044.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-09-13T18:14:22.149 INFO:teuthology.orchestra.run.smithi044.stdout:Need to get 77.2 MB of archives. 2024-09-13T18:14:22.149 INFO:teuthology.orchestra.run.smithi044.stdout:After this operation, 381 MB of additional disk space will be used. 2024-09-13T18:14:22.149 INFO:teuthology.orchestra.run.smithi044.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-195-generic amd64 5.4.0-195.215 [15.0 MB] 2024-09-13T18:14:22.170 INFO:teuthology.orchestra.run.smithi099.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-09-13T18:14:22.170 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 77.2 MB of archives. 2024-09-13T18:14:22.170 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 381 MB of additional disk space will be used. 2024-09-13T18:14:22.170 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-195-generic amd64 5.4.0-195.215 [15.0 MB] 2024-09-13T18:14:23.297 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-195-generic amd64 5.4.0-195.215 [10.5 MB] 2024-09-13T18:14:23.308 INFO:teuthology.orchestra.run.smithi044.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-195-generic amd64 5.4.0-195.215 [10.5 MB] 2024-09-13T18:14:23.570 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-195-generic amd64 5.4.0-195.215 [39.2 MB] 2024-09-13T18:14:23.580 INFO:teuthology.orchestra.run.smithi044.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-195-generic amd64 5.4.0-195.215 [39.2 MB] 2024-09-13T18:14:24.874 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.195.193 [1,900 B] 2024-09-13T18:14:24.935 INFO:teuthology.orchestra.run.smithi044.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.195.193 [1,900 B] 2024-09-13T18:14:24.936 INFO:teuthology.orchestra.run.smithi044.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.195.193 [2,584 B] 2024-09-13T18:14:24.936 INFO:teuthology.orchestra.run.smithi044.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195 all 5.4.0-195.215 [11.0 MB] 2024-09-13T18:14:24.937 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.195.193 [2,584 B] 2024-09-13T18:14:24.940 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195 all 5.4.0-195.215 [11.0 MB] 2024-09-13T18:14:25.221 INFO:teuthology.orchestra.run.smithi044.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195-generic amd64 5.4.0-195.215 [1,386 kB] 2024-09-13T18:14:25.264 INFO:teuthology.orchestra.run.smithi044.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.195.193 [2,460 B] 2024-09-13T18:14:25.273 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195-generic amd64 5.4.0-195.215 [1,386 kB] 2024-09-13T18:14:25.291 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.195.193 [2,460 B] 2024-09-13T18:14:25.983 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 77.2 MB in 3s (23.4 MB/s) 2024-09-13T18:14:25.998 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 77.2 MB in 3s (23.3 MB/s) 2024-09-13T18:14:26.148 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-modules-5.4.0-195-generic. 2024-09-13T18:14:26.180 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package linux-modules-5.4.0-195-generic. 2024-09-13T18:14:27.840 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-09-13T18:14:27.845 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../0-linux-modules-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T18:14:27.920 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T18:14:27.929 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-09-13T18:14:27.934 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../0-linux-modules-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T18:14:28.028 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T18:14:29.821 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-image-5.4.0-195-generic. 2024-09-13T18:14:29.836 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../1-linux-image-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T18:14:29.942 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T18:14:29.987 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package linux-image-5.4.0-195-generic. 2024-09-13T18:14:30.002 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../1-linux-image-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T18:14:30.084 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T18:14:31.032 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-195-generic. 2024-09-13T18:14:31.046 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T18:14:31.099 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T18:14:31.331 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-195-generic. 2024-09-13T18:14:31.346 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T18:14:31.389 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T18:14:35.673 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../3-linux-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T18:14:35.790 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T18:14:36.115 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../3-linux-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T18:14:36.117 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T18:14:36.239 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T18:14:36.243 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-image-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T18:14:36.594 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T18:14:36.604 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-headers-5.4.0-195. 2024-09-13T18:14:36.621 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../5-linux-headers-5.4.0-195_5.4.0-195.215_all.deb ... 2024-09-13T18:14:36.663 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-13T18:14:36.718 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-image-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T18:14:37.054 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package linux-headers-5.4.0-195. 2024-09-13T18:14:37.067 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../5-linux-headers-5.4.0-195_5.4.0-195.215_all.deb ... 2024-09-13T18:14:37.104 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-13T18:14:41.881 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-headers-5.4.0-195-generic. 2024-09-13T18:14:41.903 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../6-linux-headers-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T18:14:41.947 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T18:14:42.683 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package linux-headers-5.4.0-195-generic. 2024-09-13T18:14:42.704 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../6-linux-headers-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T18:14:42.748 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T18:14:44.513 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T18:14:44.619 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T18:14:44.955 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T18:14:45.695 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T18:14:45.824 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-headers-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T18:14:46.188 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T18:14:46.191 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T18:14:47.322 INFO:teuthology.orchestra.run.smithi099.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-195-generic 2024-09-13T18:14:47.323 INFO:teuthology.orchestra.run.smithi099.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-195-generic 2024-09-13T18:14:47.451 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T18:14:47.457 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T18:14:48.620 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-13T18:14:48.746 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-image-generic (5.4.0.195.193) ... 2024-09-13T18:14:48.863 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T18:14:48.981 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-generic (5.4.0.195.193) ... 2024-09-13T18:14:49.082 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-generic (5.4.0.195.193) ... 2024-09-13T18:14:49.209 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T18:14:49.233 INFO:teuthology.orchestra.run.smithi044.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-195-generic 2024-09-13T18:14:49.233 INFO:teuthology.orchestra.run.smithi044.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-195-generic 2024-09-13T18:14:49.283 INFO:teuthology.orchestra.run.smithi099.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T18:14:49.283 INFO:teuthology.orchestra.run.smithi099.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-195-generic 2024-09-13T18:14:49.434 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T18:14:50.686 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-13T18:14:50.829 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-image-generic (5.4.0.195.193) ... 2024-09-13T18:14:50.938 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T18:14:51.064 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-headers-generic (5.4.0.195.193) ... 2024-09-13T18:14:51.190 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-generic (5.4.0.195.193) ... 2024-09-13T18:14:51.317 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T18:14:51.387 INFO:teuthology.orchestra.run.smithi044.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T18:14:51.387 INFO:teuthology.orchestra.run.smithi044.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-195-generic 2024-09-13T18:15:11.006 INFO:teuthology.orchestra.run.smithi099.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T18:15:11.006 INFO:teuthology.orchestra.run.smithi099.stdout:Sourcing file `/etc/default/grub' 2024-09-13T18:15:11.024 INFO:teuthology.orchestra.run.smithi099.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T18:15:11.034 INFO:teuthology.orchestra.run.smithi099.stdout:Generating grub configuration file ... 2024-09-13T18:15:11.360 INFO:teuthology.orchestra.run.smithi099.stdout:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-13T18:15:11.389 INFO:teuthology.orchestra.run.smithi099.stdout:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-13T18:15:11.775 INFO:teuthology.orchestra.run.smithi099.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T18:15:11.787 INFO:teuthology.orchestra.run.smithi099.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T18:15:14.162 INFO:teuthology.orchestra.run.smithi044.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T18:15:14.162 INFO:teuthology.orchestra.run.smithi044.stdout:Sourcing file `/etc/default/grub' 2024-09-13T18:15:14.181 INFO:teuthology.orchestra.run.smithi044.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T18:15:14.200 INFO:teuthology.orchestra.run.smithi044.stdout:Generating grub configuration file ... 2024-09-13T18:15:14.433 INFO:teuthology.orchestra.run.smithi099.stdout:done 2024-09-13T18:15:14.490 INFO:teuthology.orchestra.run.smithi044.stdout:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-13T18:15:14.518 INFO:teuthology.orchestra.run.smithi044.stdout:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-13T18:15:14.865 DEBUG:teuthology.orchestra.run.smithi099:> dpkg -s linux-image-generic 2024-09-13T18:15:14.903 INFO:teuthology.orchestra.run.smithi099.stdout:Package: linux-image-generic 2024-09-13T18:15:14.903 INFO:teuthology.orchestra.run.smithi099.stdout:Status: install ok installed 2024-09-13T18:15:14.903 INFO:teuthology.orchestra.run.smithi099.stdout:Priority: optional 2024-09-13T18:15:14.903 INFO:teuthology.orchestra.run.smithi099.stdout:Section: kernel 2024-09-13T18:15:14.903 INFO:teuthology.orchestra.run.smithi099.stdout:Installed-Size: 20 2024-09-13T18:15:14.903 INFO:teuthology.orchestra.run.smithi099.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T18:15:14.903 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: amd64 2024-09-13T18:15:14.903 INFO:teuthology.orchestra.run.smithi099.stdout:Source: linux-meta 2024-09-13T18:15:14.903 INFO:teuthology.orchestra.run.smithi099.stdout:Version: 5.4.0.195.193 2024-09-13T18:15:14.903 INFO:teuthology.orchestra.run.smithi099.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-13T18:15:14.903 INFO:teuthology.orchestra.run.smithi099.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T18:15:14.904 INFO:teuthology.orchestra.run.smithi099.stdout:Recommends: thermald 2024-09-13T18:15:14.904 INFO:teuthology.orchestra.run.smithi099.stdout:Description: Generic Linux kernel image 2024-09-13T18:15:14.904 INFO:teuthology.orchestra.run.smithi099.stdout: This package will always depend on the latest generic kernel image 2024-09-13T18:15:14.904 INFO:teuthology.orchestra.run.smithi099.stdout: available. 2024-09-13T18:15:14.904 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-195-generic 2024-09-13T18:15:14.904 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T18:15:14.904 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T18:15:14.905 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-13T18:15:14.905 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi099.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T18:15:14.905 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get clean 2024-09-13T18:15:14.908 INFO:teuthology.orchestra.run.smithi044.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T18:15:14.920 INFO:teuthology.orchestra.run.smithi044.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T18:15:14.976 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2024-09-13T18:15:15.105 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T18:15:15.112 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T18:15:15.114 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T18:15:15.129 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T18:15:16.956 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-09-13T18:15:16.982 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T18:15:17.052 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-09-13T18:15:17.271 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-09-13T18:15:17.271 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-09-13T18:15:17.515 INFO:teuthology.orchestra.run.smithi099.stdout:linux-image-generic is already the newest version (5.4.0.195.193). 2024-09-13T18:15:17.516 INFO:teuthology.orchestra.run.smithi099.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-09-13T18:15:17.517 DEBUG:teuthology.orchestra.run.smithi099:> dpkg -s linux-image-generic 2024-09-13T18:15:17.537 INFO:teuthology.orchestra.run.smithi099.stdout:Package: linux-image-generic 2024-09-13T18:15:17.537 INFO:teuthology.orchestra.run.smithi099.stdout:Status: install ok installed 2024-09-13T18:15:17.537 INFO:teuthology.orchestra.run.smithi099.stdout:Priority: optional 2024-09-13T18:15:17.537 INFO:teuthology.orchestra.run.smithi099.stdout:Section: kernel 2024-09-13T18:15:17.537 INFO:teuthology.orchestra.run.smithi099.stdout:Installed-Size: 20 2024-09-13T18:15:17.537 INFO:teuthology.orchestra.run.smithi099.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T18:15:17.537 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: amd64 2024-09-13T18:15:17.537 INFO:teuthology.orchestra.run.smithi099.stdout:Source: linux-meta 2024-09-13T18:15:17.537 INFO:teuthology.orchestra.run.smithi099.stdout:Version: 5.4.0.195.193 2024-09-13T18:15:17.538 INFO:teuthology.orchestra.run.smithi099.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-13T18:15:17.538 INFO:teuthology.orchestra.run.smithi099.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T18:15:17.538 INFO:teuthology.orchestra.run.smithi099.stdout:Recommends: thermald 2024-09-13T18:15:17.538 INFO:teuthology.orchestra.run.smithi099.stdout:Description: Generic Linux kernel image 2024-09-13T18:15:17.538 INFO:teuthology.orchestra.run.smithi099.stdout: This package will always depend on the latest generic kernel image 2024-09-13T18:15:17.538 INFO:teuthology.orchestra.run.smithi099.stdout: available. 2024-09-13T18:15:17.539 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-09-13T18:15:17.543 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.vH062PF8Rm 2024-09-13T18:15:17.543 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /boot/grub/grub.cfg /tmp/tmp.vH062PF8Rm 2024-09-13T18:15:17.565 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.vH062PF8Rm 2024-09-13T18:15:17.600 INFO:teuthology.orchestra.run.smithi044.stdout:done 2024-09-13T18:15:17.654 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.vH062PF8Rm is 9KB 2024-09-13T18:15:17.668 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.vH062PF8Rm 2024-09-13T18:15:17.674 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T18:15:17.730 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:15:17.730 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T18:15:17.730 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T18:15:17.758 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-195-generic 2024-09-13T18:15:17.759 DEBUG:teuthology.orchestra.run.smithi099:> sudo update-grub 2024-09-13T18:15:18.022 DEBUG:teuthology.orchestra.run.smithi044:> dpkg -s linux-image-generic 2024-09-13T18:15:18.064 INFO:teuthology.orchestra.run.smithi044.stdout:Package: linux-image-generic 2024-09-13T18:15:18.064 INFO:teuthology.orchestra.run.smithi044.stdout:Status: install ok installed 2024-09-13T18:15:18.064 INFO:teuthology.orchestra.run.smithi044.stdout:Priority: optional 2024-09-13T18:15:18.064 INFO:teuthology.orchestra.run.smithi044.stdout:Section: kernel 2024-09-13T18:15:18.064 INFO:teuthology.orchestra.run.smithi044.stdout:Installed-Size: 20 2024-09-13T18:15:18.065 INFO:teuthology.orchestra.run.smithi044.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T18:15:18.065 INFO:teuthology.orchestra.run.smithi044.stdout:Architecture: amd64 2024-09-13T18:15:18.065 INFO:teuthology.orchestra.run.smithi044.stdout:Source: linux-meta 2024-09-13T18:15:18.065 INFO:teuthology.orchestra.run.smithi044.stdout:Version: 5.4.0.195.193 2024-09-13T18:15:18.065 INFO:teuthology.orchestra.run.smithi044.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-13T18:15:18.065 INFO:teuthology.orchestra.run.smithi044.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T18:15:18.065 INFO:teuthology.orchestra.run.smithi044.stdout:Recommends: thermald 2024-09-13T18:15:18.065 INFO:teuthology.orchestra.run.smithi044.stdout:Description: Generic Linux kernel image 2024-09-13T18:15:18.065 INFO:teuthology.orchestra.run.smithi044.stdout: This package will always depend on the latest generic kernel image 2024-09-13T18:15:18.065 INFO:teuthology.orchestra.run.smithi044.stdout: available. 2024-09-13T18:15:18.066 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-195-generic 2024-09-13T18:15:18.066 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T18:15:18.066 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T18:15:18.067 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T18:15:18.067 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi044.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T18:15:18.067 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-get clean 2024-09-13T18:15:18.129 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-get update 2024-09-13T18:15:18.390 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T18:15:18.391 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T18:15:18.461 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T18:15:18.542 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T18:15:19.117 INFO:teuthology.orchestra.run.smithi099.stderr:Sourcing file `/etc/default/grub' 2024-09-13T18:15:19.122 INFO:teuthology.orchestra.run.smithi099.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T18:15:19.138 INFO:teuthology.orchestra.run.smithi099.stderr:Generating grub configuration file ... 2024-09-13T18:15:19.395 INFO:teuthology.orchestra.run.smithi099.stderr:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-13T18:15:19.407 INFO:teuthology.orchestra.run.smithi099.stderr:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-13T18:15:19.761 INFO:teuthology.orchestra.run.smithi099.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T18:15:19.773 INFO:teuthology.orchestra.run.smithi099.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T18:15:20.326 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-09-13T18:15:20.354 DEBUG:teuthology.orchestra.run.smithi044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T18:15:20.428 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-09-13T18:15:20.629 INFO:teuthology.orchestra.run.smithi044.stdout:Building dependency tree... 2024-09-13T18:15:20.630 INFO:teuthology.orchestra.run.smithi044.stdout:Reading state information... 2024-09-13T18:15:20.875 INFO:teuthology.orchestra.run.smithi044.stdout:linux-image-generic is already the newest version (5.4.0.195.193). 2024-09-13T18:15:20.875 INFO:teuthology.orchestra.run.smithi044.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-09-13T18:15:20.877 DEBUG:teuthology.orchestra.run.smithi044:> dpkg -s linux-image-generic 2024-09-13T18:15:20.901 INFO:teuthology.orchestra.run.smithi044.stdout:Package: linux-image-generic 2024-09-13T18:15:20.901 INFO:teuthology.orchestra.run.smithi044.stdout:Status: install ok installed 2024-09-13T18:15:20.901 INFO:teuthology.orchestra.run.smithi044.stdout:Priority: optional 2024-09-13T18:15:20.901 INFO:teuthology.orchestra.run.smithi044.stdout:Section: kernel 2024-09-13T18:15:20.901 INFO:teuthology.orchestra.run.smithi044.stdout:Installed-Size: 20 2024-09-13T18:15:20.901 INFO:teuthology.orchestra.run.smithi044.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T18:15:20.902 INFO:teuthology.orchestra.run.smithi044.stdout:Architecture: amd64 2024-09-13T18:15:20.902 INFO:teuthology.orchestra.run.smithi044.stdout:Source: linux-meta 2024-09-13T18:15:20.902 INFO:teuthology.orchestra.run.smithi044.stdout:Version: 5.4.0.195.193 2024-09-13T18:15:20.902 INFO:teuthology.orchestra.run.smithi044.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-13T18:15:20.902 INFO:teuthology.orchestra.run.smithi044.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T18:15:20.902 INFO:teuthology.orchestra.run.smithi044.stdout:Recommends: thermald 2024-09-13T18:15:20.902 INFO:teuthology.orchestra.run.smithi044.stdout:Description: Generic Linux kernel image 2024-09-13T18:15:20.902 INFO:teuthology.orchestra.run.smithi044.stdout: This package will always depend on the latest generic kernel image 2024-09-13T18:15:20.902 INFO:teuthology.orchestra.run.smithi044.stdout: available. 2024-09-13T18:15:20.902 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2024-09-13T18:15:20.908 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.Vue4dhW2nk 2024-09-13T18:15:20.908 DEBUG:teuthology.orchestra.run.smithi044:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Vue4dhW2nk 2024-09-13T18:15:20.920 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.Vue4dhW2nk 2024-09-13T18:15:20.955 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.Vue4dhW2nk is 9KB 2024-09-13T18:15:20.968 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.Vue4dhW2nk 2024-09-13T18:15:20.974 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T18:15:21.029 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:15:21.030 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T18:15:21.030 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T18:15:21.060 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-195-generic 2024-09-13T18:15:21.060 DEBUG:teuthology.orchestra.run.smithi044:> sudo update-grub 2024-09-13T18:15:21.465 INFO:teuthology.orchestra.run.smithi099.stderr:done 2024-09-13T18:15:21.466 DEBUG:teuthology.orchestra.run.smithi099:> sudo shutdown -r now 2024-09-13T18:15:22.471 INFO:teuthology.orchestra.run.smithi044.stderr:Sourcing file `/etc/default/grub' 2024-09-13T18:15:22.480 INFO:teuthology.orchestra.run.smithi044.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T18:15:22.532 INFO:teuthology.orchestra.run.smithi044.stderr:Generating grub configuration file ... 2024-09-13T18:15:22.861 INFO:teuthology.orchestra.run.smithi044.stderr:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-13T18:15:22.873 INFO:teuthology.orchestra.run.smithi044.stderr:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-13T18:15:23.218 INFO:teuthology.orchestra.run.smithi044.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T18:15:23.230 INFO:teuthology.orchestra.run.smithi044.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T18:15:24.931 INFO:teuthology.orchestra.run.smithi044.stderr:done 2024-09-13T18:15:24.933 DEBUG:teuthology.orchestra.run.smithi044:> sudo shutdown -r now 2024-09-13T18:15:51.490 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-13T18:15:51.491 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-13T18:15:51.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:15:54.939 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T18:15:54.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-13T18:15:54.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:16:51.558 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T18:16:54.953 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T18:17:00.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-13T18:17:00.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:17:01.051 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-09-13T18:17:01.990 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-13T18:17:01.990 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-195-generic"... 2024-09-13T18:17:01.991 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-09-13T18:17:01.997 INFO:teuthology.orchestra.run.smithi099.stdout:5.4.0-195-generic 2024-09-13T18:17:01.997 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-195-generic vs 5.4.0-195-generic 2024-09-13T18:17:01.997 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T18:17:01.997 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T18:17:02.999 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-13T18:17:02.999 DEBUG:teuthology.orchestra.run.smithi099:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T18:17:03.093 INFO:teuthology.orchestra.run.smithi099.stdout:ttyS1 2024-09-13T18:17:03.113 DEBUG:teuthology.parallel:result is None 2024-09-13T18:17:03.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-13T18:17:03.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:17:03.965 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-09-13T18:17:15.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-13T18:17:15.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:17:16.228 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-09-13T18:17:16.802 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-13T18:17:16.802 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-195-generic"... 2024-09-13T18:17:16.803 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2024-09-13T18:17:16.809 INFO:teuthology.orchestra.run.smithi044.stdout:5.4.0-195-generic 2024-09-13T18:17:16.809 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-195-generic vs 5.4.0-195-generic 2024-09-13T18:17:16.809 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T18:17:16.809 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T18:17:17.810 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T18:17:17.810 DEBUG:teuthology.orchestra.run.smithi044:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T18:17:17.908 INFO:teuthology.orchestra.run.smithi044.stdout:ttyS1 2024-09-13T18:17:17.942 DEBUG:teuthology.parallel:result is None 2024-09-13T18:17:17.942 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T18:17:17.949 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T18:17:17.949 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T18:17:17.951 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T18:17:17.959 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T18:17:17.991 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T18:17:18.016 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T18:17:18.016 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T18:17:18.018 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T18:17:18.040 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T18:17:18.046 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T18:17:18.046 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T18:17:18.077 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T18:17:18.093 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:17:18.101 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:17:18.103 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:17:18.110 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:17:18.112 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T18:17:18.119 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T18:17:18.119 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T18:17:18.122 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T18:17:18.137 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T18:17:18.145 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T18:17:18.145 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T18:17:18.148 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T18:17:18.181 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:17:18.202 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:17:18.208 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:17:18.208 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T18:17:18.234 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:17:18.241 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:17:18.248 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:17:18.248 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T18:17:18.314 DEBUG:teuthology.orchestra.run.smithi044:> sudo service rsyslog restart 2024-09-13T18:17:18.316 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2024-09-13T18:17:18.366 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T18:17:18.374 INFO:teuthology.task.internal:Starting timer... 2024-09-13T18:17:18.374 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T18:17:18.404 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T18:17:18.499 DEBUG:teuthology.task.selinux:Excluding smithi044: OS 'ubuntu' does not support SELinux 2024-09-13T18:17:18.499 DEBUG:teuthology.task.selinux:Excluding smithi099: OS 'ubuntu' does not support SELinux 2024-09-13T18:17:18.500 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T18:17:18.500 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-13T18:17:18.500 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T18:17:18.500 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T18:17:18.548 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T18:17:18.560 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T18:17:18.561 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi044.front.sepia.ceph.com,smithi099.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T18:22:57.526 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi044.front.sepia.ceph.com'), Remote(name='ubuntu@smithi099.front.sepia.ceph.com')] 2024-09-13T18:22:57.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-13T18:22:57.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:22:57.645 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-09-13T18:22:57.775 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-13T18:22:57.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-13T18:22:57.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:22:57.881 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-09-13T18:22:57.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-13T18:22:57.998 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T18:22:58.009 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T18:22:58.009 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:22:58.009 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:22:58.012 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:22:58.012 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:22:58.046 INFO:teuthology.orchestra.run.smithi044.stdout:13 Sep 18:22:58 ntpd[13633]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-13T18:22:58.046 INFO:teuthology.orchestra.run.smithi044.stdout:13 Sep 18:22:58 ntpd[13633]: Command line: ntpd -gq 2024-09-13T18:22:58.046 INFO:teuthology.orchestra.run.smithi044.stdout:13 Sep 18:22:58 ntpd[13633]: proto: precision = 0.090 usec (-23) 2024-09-13T18:22:58.047 INFO:teuthology.orchestra.run.smithi099.stdout:13 Sep 18:22:58 ntpd[13728]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-13T18:22:58.047 INFO:teuthology.orchestra.run.smithi099.stdout:13 Sep 18:22:58 ntpd[13728]: Command line: ntpd -gq 2024-09-13T18:22:58.047 INFO:teuthology.orchestra.run.smithi044.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T18:22:58.048 INFO:teuthology.orchestra.run.smithi044.stdout:13 Sep 18:22:58 ntpd[13633]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T18:22:58.048 INFO:teuthology.orchestra.run.smithi044.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T18:22:58.049 INFO:teuthology.orchestra.run.smithi044.stdout:13 Sep 18:22:58 ntpd[13633]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T18:22:58.049 INFO:teuthology.orchestra.run.smithi044.stdout:13 Sep 18:22:58 ntpd[13633]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T18:22:58.049 INFO:teuthology.orchestra.run.smithi044.stdout:13 Sep 18:22:58 ntpd[13633]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T18:22:58.049 INFO:teuthology.orchestra.run.smithi044.stdout:13 Sep 18:22:58 ntpd[13633]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T18:22:58.049 INFO:teuthology.orchestra.run.smithi044.stdout:13 Sep 18:22:58 ntpd[13633]: Listen normally on 3 ens1f0 172.21.15.44:123 2024-09-13T18:22:58.049 INFO:teuthology.orchestra.run.smithi044.stdout:13 Sep 18:22:58 ntpd[13633]: Listen normally on 4 lo [::1]:123 2024-09-13T18:22:58.050 INFO:teuthology.orchestra.run.smithi044.stdout:13 Sep 18:22:58 ntpd[13633]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1572%4]:123 2024-09-13T18:22:58.050 INFO:teuthology.orchestra.run.smithi044.stdout:13 Sep 18:22:58 ntpd[13633]: Listening on routing socket on fd #22 for interface updates 2024-09-13T18:22:58.050 INFO:teuthology.orchestra.run.smithi099.stdout:13 Sep 18:22:58 ntpd[13728]: proto: precision = 0.127 usec (-23) 2024-09-13T18:22:58.050 INFO:teuthology.orchestra.run.smithi099.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T18:22:58.051 INFO:teuthology.orchestra.run.smithi099.stdout:13 Sep 18:22:58 ntpd[13728]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T18:22:58.051 INFO:teuthology.orchestra.run.smithi099.stdout:13 Sep 18:22:58 ntpd[13728]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T18:22:58.051 INFO:teuthology.orchestra.run.smithi099.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T18:22:58.052 INFO:teuthology.orchestra.run.smithi099.stdout:13 Sep 18:22:58 ntpd[13728]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T18:22:58.052 INFO:teuthology.orchestra.run.smithi099.stdout:13 Sep 18:22:58 ntpd[13728]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T18:22:58.052 INFO:teuthology.orchestra.run.smithi099.stdout:13 Sep 18:22:58 ntpd[13728]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T18:22:58.052 INFO:teuthology.orchestra.run.smithi099.stdout:13 Sep 18:22:58 ntpd[13728]: Listen normally on 3 enp3s0f1 172.21.15.99:123 2024-09-13T18:22:58.052 INFO:teuthology.orchestra.run.smithi099.stdout:13 Sep 18:22:58 ntpd[13728]: Listen normally on 4 lo [::1]:123 2024-09-13T18:22:58.053 INFO:teuthology.orchestra.run.smithi099.stdout:13 Sep 18:22:58 ntpd[13728]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d803%5]:123 2024-09-13T18:22:58.053 INFO:teuthology.orchestra.run.smithi099.stdout:13 Sep 18:22:58 ntpd[13728]: Listening on routing socket on fd #22 for interface updates 2024-09-13T18:22:59.047 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:22:59 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:22:59.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:22:59 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:22:59.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:22:59 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:22:59.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:22:59 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:22:59.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:22:59 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:22:59.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:22:59 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:22:59.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:22:59 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:22:59.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:22:59 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:22:59.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:22:59 ntpd[13633]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:22:59.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:22:59 ntpd[13633]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:22:59.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:22:59 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:22:59.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:22:59 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:22:59.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:22:59 ntpd[13633]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:22:59.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:22:59 ntpd[13633]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:22:59.049 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:22:59 ntpd[13728]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:22:59.050 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:22:59 ntpd[13728]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:22:59.050 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:22:59 ntpd[13728]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:22:59.050 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:22:59 ntpd[13728]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:22:59.050 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:22:59 ntpd[13728]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:22:59.050 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:22:59 ntpd[13728]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:23:01.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:01 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:01.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:01 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:01.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:01 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:01.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:01 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:01.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:01 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:01.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:01 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:01.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:01 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:01.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:01 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:01.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:01 ntpd[13633]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:23:01.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:01 ntpd[13633]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:23:01.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:01 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:01.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:01 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:01.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:01 ntpd[13633]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:23:01.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:01 ntpd[13633]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:23:01.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:01 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:01.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:01 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:01.050 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:01 ntpd[13633]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:23:01.050 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:01 ntpd[13633]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:23:01.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:01 ntpd[13728]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:01.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:01 ntpd[13728]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:01.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:01 ntpd[13728]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:01.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:01 ntpd[13728]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:01.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:01 ntpd[13728]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:01.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:01 ntpd[13728]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:01.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:01 ntpd[13728]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:23:01.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:01 ntpd[13728]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:23:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:03 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:03 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:03 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:03 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:03 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:03 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:03 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:03 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:03 ntpd[13633]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:23:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:03 ntpd[13633]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:23:03.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:03 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:03.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:03 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:03.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:03 ntpd[13633]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:23:03.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:03 ntpd[13633]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:23:03.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:03 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:03.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:03 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:03.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:03 ntpd[13633]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:23:03.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:03 ntpd[13633]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:23:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:03 ntpd[13728]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:03 ntpd[13728]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:03 ntpd[13728]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:03 ntpd[13728]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:03 ntpd[13728]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:03 ntpd[13728]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:03 ntpd[13728]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:03 ntpd[13728]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:03 ntpd[13728]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:23:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:03 ntpd[13728]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:23:03.052 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:03 ntpd[13728]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:03.052 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:03 ntpd[13728]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:03.052 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:03 ntpd[13728]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:23:03.052 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:03 ntpd[13728]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:23:03.052 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:03 ntpd[13728]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:03.052 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:03 ntpd[13728]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:03.052 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:03 ntpd[13728]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:23:03.052 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:03 ntpd[13728]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:23:05.047 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:05 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:05.047 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:05 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:05.047 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:05 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:05.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:05 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:05.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:05 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:05.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:05 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:05.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:05 ntpd[13633]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:05.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:05 ntpd[13633]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:05.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:05 ntpd[13633]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:23:05.048 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:05 ntpd[13633]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:23:05.048 INFO:teuthology.orchestra.run.smithi044.stdout:13 Sep 18:23:05 ntpd[13633]: ntpd: time slew +0.001080 s 2024-09-13T18:23:05.048 INFO:teuthology.orchestra.run.smithi044.stdout:ntpd: time slew +0.001080s 2024-09-13T18:23:05.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:05 ntpd[13633]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T18:23:05.049 INFO:teuthology.orchestra.run.smithi044.stderr:13 Sep 18:23:05 ntpd[13633]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T18:23:05.050 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:05 ntpd[13728]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:05.050 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:05 ntpd[13728]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:05.050 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:05 ntpd[13728]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:05.050 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:05 ntpd[13728]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:05.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:05 ntpd[13728]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:05.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:05 ntpd[13728]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:05.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:05 ntpd[13728]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:23:05.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:05 ntpd[13728]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:23:05.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:05 ntpd[13728]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:23:05.051 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:05 ntpd[13728]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:23:05.051 INFO:teuthology.orchestra.run.smithi099.stdout:13 Sep 18:23:05 ntpd[13728]: ntpd: time slew +0.003706 s 2024-09-13T18:23:05.051 INFO:teuthology.orchestra.run.smithi099.stdout:ntpd: time slew +0.003706s 2024-09-13T18:23:05.052 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:05 ntpd[13728]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T18:23:05.052 INFO:teuthology.orchestra.run.smithi099.stderr:13 Sep 18:23:05 ntpd[13728]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T18:23:05.112 INFO:teuthology.orchestra.run.smithi044.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T18:23:05.113 INFO:teuthology.orchestra.run.smithi044.stdout:============================================================================== 2024-09-13T18:23:05.113 INFO:teuthology.orchestra.run.smithi044.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:23:05.113 INFO:teuthology.orchestra.run.smithi044.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:23:05.113 INFO:teuthology.orchestra.run.smithi044.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:23:05.113 INFO:teuthology.orchestra.run.smithi044.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:23:05.121 INFO:teuthology.orchestra.run.smithi099.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T18:23:05.121 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================== 2024-09-13T18:23:05.121 INFO:teuthology.orchestra.run.smithi099.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:23:05.121 INFO:teuthology.orchestra.run.smithi099.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:23:05.121 INFO:teuthology.orchestra.run.smithi099.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:23:05.121 INFO:teuthology.orchestra.run.smithi099.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:23:05.122 INFO:teuthology.run_tasks:Running task install... 2024-09-13T18:23:05.131 DEBUG:teuthology.task.install:project ceph 2024-09-13T18:23:05.131 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}} 2024-09-13T18:23:05.131 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T18:23:05.131 INFO:teuthology.task.install:Using flavor: default 2024-09-13T18:23:05.140 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T18:23:05.140 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T18:23:05.140 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-key list | grep Ceph 2024-09-13T18:23:05.141 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-key list | grep Ceph 2024-09-13T18:23:05.242 INFO:teuthology.orchestra.run.smithi099.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-13T18:23:05.246 INFO:teuthology.orchestra.run.smithi044.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-13T18:23:05.297 INFO:teuthology.orchestra.run.smithi099.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T18:23:05.297 INFO:teuthology.orchestra.run.smithi099.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T18:23:05.298 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-13T18:23:05.298 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-13T18:23:05.299 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:23:05.312 INFO:teuthology.orchestra.run.smithi044.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T18:23:05.312 INFO:teuthology.orchestra.run.smithi044.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T18:23:05.312 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-13T18:23:05.312 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-13T18:23:05.313 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:23:05.459 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default/ 2024-09-13T18:23:05.459 INFO:teuthology.task.install.deb:Package version is 18.2.4-860-g6c6b083f-1focal 2024-09-13T18:23:05.471 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default/ 2024-09-13T18:23:05.471 INFO:teuthology.task.install.deb:Package version is 18.2.4-860-g6c6b083f-1focal 2024-09-13T18:23:05.579 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:23:05.579 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T18:23:05.588 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:23:05.589 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T18:23:05.596 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2024-09-13T18:23:05.605 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-get update 2024-09-13T18:23:05.748 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T18:23:05.752 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T18:23:05.754 INFO:teuthology.orchestra.run.smithi044.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-09-13T18:23:05.764 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T18:23:05.798 INFO:teuthology.orchestra.run.smithi099.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal InRelease 2024-09-13T18:23:05.801 INFO:teuthology.orchestra.run.smithi044.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal InRelease 2024-09-13T18:23:05.820 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-13T18:23:05.823 INFO:teuthology.orchestra.run.smithi044.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-13T18:23:05.828 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T18:23:05.843 INFO:teuthology.orchestra.run.smithi099.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release.gpg 2024-09-13T18:23:05.846 INFO:teuthology.orchestra.run.smithi044.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release.gpg 2024-09-13T18:23:05.861 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T18:23:05.864 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-09-13T18:23:05.867 INFO:teuthology.orchestra.run.smithi044.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-09-13T18:23:05.895 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main i386 Packages [3,433 B] 2024-09-13T18:23:05.909 INFO:teuthology.orchestra.run.smithi044.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main i386 Packages [3,433 B] 2024-09-13T18:23:05.943 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-09-13T18:23:06.297 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T18:23:06.436 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 157 kB in 1s (238 kB/s) 2024-09-13T18:23:06.601 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 157 kB in 1s (187 kB/s) 2024-09-13T18:23:07.643 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-09-13T18:23:07.670 DEBUG:teuthology.orchestra.run.smithi044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-860-g6c6b083f-1focal cephadm=18.2.4-860-g6c6b083f-1focal ceph-mds=18.2.4-860-g6c6b083f-1focal ceph-mgr=18.2.4-860-g6c6b083f-1focal ceph-common=18.2.4-860-g6c6b083f-1focal ceph-fuse=18.2.4-860-g6c6b083f-1focal ceph-test=18.2.4-860-g6c6b083f-1focal ceph-volume=18.2.4-860-g6c6b083f-1focal radosgw=18.2.4-860-g6c6b083f-1focal python3-rados=18.2.4-860-g6c6b083f-1focal python3-rgw=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal python3-rbd=18.2.4-860-g6c6b083f-1focal libcephfs2=18.2.4-860-g6c6b083f-1focal libcephfs-dev=18.2.4-860-g6c6b083f-1focal librados2=18.2.4-860-g6c6b083f-1focal librbd1=18.2.4-860-g6c6b083f-1focal rbd-fuse=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal cephfs-shell=18.2.4-860-g6c6b083f-1focal cephfs-top=18.2.4-860-g6c6b083f-1focal cephfs-mirror=18.2.4-860-g6c6b083f-1focal 2024-09-13T18:23:07.746 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-09-13T18:23:07.755 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-09-13T18:23:07.782 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-860-g6c6b083f-1focal cephadm=18.2.4-860-g6c6b083f-1focal ceph-mds=18.2.4-860-g6c6b083f-1focal ceph-mgr=18.2.4-860-g6c6b083f-1focal ceph-common=18.2.4-860-g6c6b083f-1focal ceph-fuse=18.2.4-860-g6c6b083f-1focal ceph-test=18.2.4-860-g6c6b083f-1focal ceph-volume=18.2.4-860-g6c6b083f-1focal radosgw=18.2.4-860-g6c6b083f-1focal python3-rados=18.2.4-860-g6c6b083f-1focal python3-rgw=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal python3-rbd=18.2.4-860-g6c6b083f-1focal libcephfs2=18.2.4-860-g6c6b083f-1focal libcephfs-dev=18.2.4-860-g6c6b083f-1focal librados2=18.2.4-860-g6c6b083f-1focal librbd1=18.2.4-860-g6c6b083f-1focal rbd-fuse=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal cephfs-shell=18.2.4-860-g6c6b083f-1focal cephfs-top=18.2.4-860-g6c6b083f-1focal cephfs-mirror=18.2.4-860-g6c6b083f-1focal 2024-09-13T18:23:07.850 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-09-13T18:23:07.946 INFO:teuthology.orchestra.run.smithi044.stdout:Building dependency tree... 2024-09-13T18:23:07.947 INFO:teuthology.orchestra.run.smithi044.stdout:Reading state information... 2024-09-13T18:23:08.042 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-09-13T18:23:08.043 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-09-13T18:23:08.153 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:23:08.154 INFO:teuthology.orchestra.run.smithi044.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T18:23:08.154 INFO:teuthology.orchestra.run.smithi044.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:23:08.154 INFO:teuthology.orchestra.run.smithi044.stdout:The following additional packages will be installed: 2024-09-13T18:23:08.154 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T18:23:08.154 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-13T18:23:08.155 INFO:teuthology.orchestra.run.smithi044.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-13T18:23:08.155 INFO:teuthology.orchestra.run.smithi044.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-13T18:23:08.155 INFO:teuthology.orchestra.run.smithi044.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-13T18:23:08.156 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-13T18:23:08.157 INFO:teuthology.orchestra.run.smithi044.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T18:23:08.157 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T18:23:08.157 INFO:teuthology.orchestra.run.smithi044.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T18:23:08.157 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-13T18:23:08.157 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2024-09-13T18:23:08.157 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2024-09-13T18:23:08.157 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2024-09-13T18:23:08.157 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2024-09-13T18:23:08.157 INFO:teuthology.orchestra.run.smithi044.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T18:23:08.157 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-13T18:23:08.157 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2024-09-13T18:23:08.157 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T18:23:08.157 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T18:23:08.158 INFO:teuthology.orchestra.run.smithi044.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T18:23:08.158 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T18:23:08.158 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T18:23:08.158 INFO:teuthology.orchestra.run.smithi044.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T18:23:08.158 INFO:teuthology.orchestra.run.smithi044.stdout:Suggested packages: 2024-09-13T18:23:08.158 INFO:teuthology.orchestra.run.smithi044.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-13T18:23:08.158 INFO:teuthology.orchestra.run.smithi044.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-13T18:23:08.158 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-13T18:23:08.158 INFO:teuthology.orchestra.run.smithi044.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-13T18:23:08.158 INFO:teuthology.orchestra.run.smithi044.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-13T18:23:08.158 INFO:teuthology.orchestra.run.smithi044.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-13T18:23:08.158 INFO:teuthology.orchestra.run.smithi044.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-13T18:23:08.158 INFO:teuthology.orchestra.run.smithi044.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T18:23:08.158 INFO:teuthology.orchestra.run.smithi044.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-13T18:23:08.159 INFO:teuthology.orchestra.run.smithi044.stdout:Recommended packages: 2024-09-13T18:23:08.159 INFO:teuthology.orchestra.run.smithi044.stdout: btrfs-tools 2024-09-13T18:23:08.234 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:23:08.236 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T18:23:08.236 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:23:08.236 INFO:teuthology.orchestra.run.smithi099.stdout:The following additional packages will be installed: 2024-09-13T18:23:08.236 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T18:23:08.236 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-13T18:23:08.236 INFO:teuthology.orchestra.run.smithi099.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-13T18:23:08.237 INFO:teuthology.orchestra.run.smithi099.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-13T18:23:08.237 INFO:teuthology.orchestra.run.smithi099.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-13T18:23:08.238 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-13T18:23:08.238 INFO:teuthology.orchestra.run.smithi099.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T18:23:08.239 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T18:23:08.239 INFO:teuthology.orchestra.run.smithi099.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T18:23:08.239 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-13T18:23:08.239 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2024-09-13T18:23:08.239 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2024-09-13T18:23:08.239 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2024-09-13T18:23:08.239 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2024-09-13T18:23:08.239 INFO:teuthology.orchestra.run.smithi099.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T18:23:08.239 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-13T18:23:08.239 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2024-09-13T18:23:08.239 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T18:23:08.239 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T18:23:08.239 INFO:teuthology.orchestra.run.smithi099.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T18:23:08.240 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T18:23:08.240 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T18:23:08.240 INFO:teuthology.orchestra.run.smithi099.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T18:23:08.240 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2024-09-13T18:23:08.240 INFO:teuthology.orchestra.run.smithi099.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-13T18:23:08.240 INFO:teuthology.orchestra.run.smithi099.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-13T18:23:08.240 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-13T18:23:08.240 INFO:teuthology.orchestra.run.smithi099.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-13T18:23:08.240 INFO:teuthology.orchestra.run.smithi099.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-13T18:23:08.240 INFO:teuthology.orchestra.run.smithi099.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-13T18:23:08.240 INFO:teuthology.orchestra.run.smithi099.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-13T18:23:08.240 INFO:teuthology.orchestra.run.smithi099.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T18:23:08.240 INFO:teuthology.orchestra.run.smithi099.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-13T18:23:08.241 INFO:teuthology.orchestra.run.smithi099.stdout:Recommended packages: 2024-09-13T18:23:08.241 INFO:teuthology.orchestra.run.smithi099.stdout: btrfs-tools 2024-09-13T18:23:08.283 INFO:teuthology.orchestra.run.smithi044.stdout:The following NEW packages will be installed: 2024-09-13T18:23:08.284 INFO:teuthology.orchestra.run.smithi044.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T18:23:08.284 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T18:23:08.284 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T18:23:08.284 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-09-13T18:23:08.284 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-09-13T18:23:08.284 INFO:teuthology.orchestra.run.smithi044.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-09-13T18:23:08.284 INFO:teuthology.orchestra.run.smithi044.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-09-13T18:23:08.286 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-09-13T18:23:08.286 INFO:teuthology.orchestra.run.smithi044.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T18:23:08.286 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T18:23:08.286 INFO:teuthology.orchestra.run.smithi044.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T18:23:08.286 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2024-09-13T18:23:08.286 INFO:teuthology.orchestra.run.smithi044.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-09-13T18:23:08.286 INFO:teuthology.orchestra.run.smithi044.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-09-13T18:23:08.286 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-13T18:23:08.286 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-13T18:23:08.286 INFO:teuthology.orchestra.run.smithi044.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-13T18:23:08.286 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-13T18:23:08.287 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-09-13T18:23:08.287 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-09-13T18:23:08.287 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T18:23:08.287 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T18:23:08.287 INFO:teuthology.orchestra.run.smithi044.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T18:23:08.287 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T18:23:08.287 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T18:23:08.287 INFO:teuthology.orchestra.run.smithi044.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-09-13T18:23:08.287 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages will be upgraded: 2024-09-13T18:23:08.287 INFO:teuthology.orchestra.run.smithi044.stdout: librados2 librbd1 2024-09-13T18:23:08.352 INFO:teuthology.orchestra.run.smithi044.stdout:2 upgraded, 116 newly installed, 0 to remove and 295 not upgraded. 2024-09-13T18:23:08.352 INFO:teuthology.orchestra.run.smithi044.stdout:Need to get 200 MB of archives. 2024-09-13T18:23:08.352 INFO:teuthology.orchestra.run.smithi044.stdout:After this operation, 979 MB of additional disk space will be used. 2024-09-13T18:23:08.352 INFO:teuthology.orchestra.run.smithi044.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-09-13T18:23:08.360 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2024-09-13T18:23:08.360 INFO:teuthology.orchestra.run.smithi099.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T18:23:08.360 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T18:23:08.360 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T18:23:08.360 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-09-13T18:23:08.362 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-09-13T18:23:08.362 INFO:teuthology.orchestra.run.smithi099.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-09-13T18:23:08.362 INFO:teuthology.orchestra.run.smithi099.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-09-13T18:23:08.362 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-09-13T18:23:08.362 INFO:teuthology.orchestra.run.smithi099.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T18:23:08.362 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T18:23:08.362 INFO:teuthology.orchestra.run.smithi099.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T18:23:08.362 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2024-09-13T18:23:08.363 INFO:teuthology.orchestra.run.smithi099.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-09-13T18:23:08.363 INFO:teuthology.orchestra.run.smithi099.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-09-13T18:23:08.363 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-13T18:23:08.363 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-13T18:23:08.363 INFO:teuthology.orchestra.run.smithi099.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-13T18:23:08.363 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-13T18:23:08.363 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-09-13T18:23:08.363 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-09-13T18:23:08.363 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T18:23:08.363 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T18:23:08.363 INFO:teuthology.orchestra.run.smithi099.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T18:23:08.363 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T18:23:08.363 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T18:23:08.363 INFO:teuthology.orchestra.run.smithi099.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-09-13T18:23:08.364 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages will be upgraded: 2024-09-13T18:23:08.364 INFO:teuthology.orchestra.run.smithi099.stdout: librados2 librbd1 2024-09-13T18:23:08.371 INFO:teuthology.orchestra.run.smithi044.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-13T18:23:08.378 INFO:teuthology.orchestra.run.smithi044.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-09-13T18:23:08.404 INFO:teuthology.orchestra.run.smithi044.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-13T18:23:08.434 INFO:teuthology.orchestra.run.smithi044.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-13T18:23:08.436 INFO:teuthology.orchestra.run.smithi044.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.4-860-g6c6b083f-1focal [3,453 kB] 2024-09-13T18:23:08.437 INFO:teuthology.orchestra.run.smithi044.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-13T18:23:08.451 INFO:teuthology.orchestra.run.smithi044.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-13T18:23:08.494 INFO:teuthology.orchestra.run.smithi044.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-13T18:23:08.495 INFO:teuthology.orchestra.run.smithi044.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-13T18:23:08.501 INFO:teuthology.orchestra.run.smithi044.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-13T18:23:08.503 INFO:teuthology.orchestra.run.smithi044.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-13T18:23:08.504 INFO:teuthology.orchestra.run.smithi044.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-13T18:23:08.504 INFO:teuthology.orchestra.run.smithi044.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-13T18:23:08.505 INFO:teuthology.orchestra.run.smithi044.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-13T18:23:08.508 INFO:teuthology.orchestra.run.smithi044.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-13T18:23:08.508 INFO:teuthology.orchestra.run.smithi044.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-13T18:23:08.512 INFO:teuthology.orchestra.run.smithi044.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-13T18:23:08.512 INFO:teuthology.orchestra.run.smithi099.stdout:2 upgraded, 116 newly installed, 0 to remove and 295 not upgraded. 2024-09-13T18:23:08.513 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 200 MB of archives. 2024-09-13T18:23:08.513 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 979 MB of additional disk space will be used. 2024-09-13T18:23:08.513 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.4-860-g6c6b083f-1focal [3,453 kB] 2024-09-13T18:23:08.527 INFO:teuthology.orchestra.run.smithi044.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-13T18:23:08.528 INFO:teuthology.orchestra.run.smithi044.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-13T18:23:08.528 INFO:teuthology.orchestra.run.smithi044.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-13T18:23:08.530 INFO:teuthology.orchestra.run.smithi044.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T18:23:08.530 INFO:teuthology.orchestra.run.smithi044.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-13T18:23:08.531 INFO:teuthology.orchestra.run.smithi044.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-13T18:23:08.533 INFO:teuthology.orchestra.run.smithi044.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-13T18:23:08.533 INFO:teuthology.orchestra.run.smithi044.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-13T18:23:08.535 INFO:teuthology.orchestra.run.smithi044.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-13T18:23:08.545 INFO:teuthology.orchestra.run.smithi044.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-13T18:23:08.554 INFO:teuthology.orchestra.run.smithi044.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-13T18:23:08.556 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-09-13T18:23:08.561 INFO:teuthology.orchestra.run.smithi044.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-13T18:23:08.561 INFO:teuthology.orchestra.run.smithi044.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-13T18:23:08.562 INFO:teuthology.orchestra.run.smithi044.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-13T18:23:08.562 INFO:teuthology.orchestra.run.smithi044.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-13T18:23:08.563 INFO:teuthology.orchestra.run.smithi044.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-13T18:23:08.566 INFO:teuthology.orchestra.run.smithi044.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-13T18:23:08.566 INFO:teuthology.orchestra.run.smithi044.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-13T18:23:08.569 INFO:teuthology.orchestra.run.smithi044.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-13T18:23:08.579 INFO:teuthology.orchestra.run.smithi044.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-09-13T18:23:08.580 INFO:teuthology.orchestra.run.smithi044.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-13T18:23:08.581 INFO:teuthology.orchestra.run.smithi044.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-13T18:23:08.596 INFO:teuthology.orchestra.run.smithi044.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-13T18:23:08.597 INFO:teuthology.orchestra.run.smithi044.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-13T18:23:08.597 INFO:teuthology.orchestra.run.smithi044.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-13T18:23:08.599 INFO:teuthology.orchestra.run.smithi044.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-13T18:23:08.599 INFO:teuthology.orchestra.run.smithi044.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-13T18:23:08.600 INFO:teuthology.orchestra.run.smithi044.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-13T18:23:08.603 INFO:teuthology.orchestra.run.smithi044.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T18:23:08.605 INFO:teuthology.orchestra.run.smithi044.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.4-860-g6c6b083f-1focal [4,041 kB] 2024-09-13T18:23:08.613 INFO:teuthology.orchestra.run.smithi044.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-13T18:23:08.614 INFO:teuthology.orchestra.run.smithi044.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-13T18:23:08.616 INFO:teuthology.orchestra.run.smithi044.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-13T18:23:08.630 INFO:teuthology.orchestra.run.smithi044.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-13T18:23:08.631 INFO:teuthology.orchestra.run.smithi044.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-13T18:23:08.631 INFO:teuthology.orchestra.run.smithi044.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-13T18:23:08.639 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-13T18:23:08.674 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-09-13T18:23:08.681 INFO:teuthology.orchestra.run.smithi044.stdout:Get:55 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.4-860-g6c6b083f-1focal [747 kB] 2024-09-13T18:23:08.693 INFO:teuthology.orchestra.run.smithi044.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.4-860-g6c6b083f-1focal [388 kB] 2024-09-13T18:23:08.699 INFO:teuthology.orchestra.run.smithi044.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.4-860-g6c6b083f-1focal [31.9 kB] 2024-09-13T18:23:08.700 INFO:teuthology.orchestra.run.smithi044.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.4-860-g6c6b083f-1focal [200 kB] 2024-09-13T18:23:08.714 INFO:teuthology.orchestra.run.smithi044.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.4-860-g6c6b083f-1focal [62.5 kB] 2024-09-13T18:23:08.715 INFO:teuthology.orchestra.run.smithi044.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.4-860-g6c6b083f-1focal [368 kB] 2024-09-13T18:23:08.719 INFO:teuthology.orchestra.run.smithi044.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-13T18:23:08.721 INFO:teuthology.orchestra.run.smithi044.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.4-860-g6c6b083f-1focal [6,634 kB] 2024-09-13T18:23:08.799 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-13T18:23:08.804 INFO:teuthology.orchestra.run.smithi044.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-13T18:23:08.808 INFO:teuthology.orchestra.run.smithi044.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-13T18:23:08.826 INFO:teuthology.orchestra.run.smithi044.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-13T18:23:08.826 INFO:teuthology.orchestra.run.smithi044.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-13T18:23:08.827 INFO:teuthology.orchestra.run.smithi044.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-13T18:23:08.827 INFO:teuthology.orchestra.run.smithi044.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-13T18:23:08.828 INFO:teuthology.orchestra.run.smithi044.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-13T18:23:08.828 INFO:teuthology.orchestra.run.smithi044.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-13T18:23:08.829 INFO:teuthology.orchestra.run.smithi044.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-13T18:23:08.830 INFO:teuthology.orchestra.run.smithi044.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-13T18:23:08.836 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.4-860-g6c6b083f-1focal [4,041 kB] 2024-09-13T18:23:08.839 INFO:teuthology.orchestra.run.smithi044.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-13T18:23:08.847 INFO:teuthology.orchestra.run.smithi044.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-13T18:23:08.850 INFO:teuthology.orchestra.run.smithi044.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-13T18:23:08.852 INFO:teuthology.orchestra.run.smithi044.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-13T18:23:08.854 INFO:teuthology.orchestra.run.smithi044.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-13T18:23:08.855 INFO:teuthology.orchestra.run.smithi044.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-13T18:23:08.859 INFO:teuthology.orchestra.run.smithi044.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-13T18:23:08.862 INFO:teuthology.orchestra.run.smithi044.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-09-13T18:23:08.862 INFO:teuthology.orchestra.run.smithi044.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-13T18:23:08.863 INFO:teuthology.orchestra.run.smithi044.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.4-860-g6c6b083f-1focal [113 kB] 2024-09-13T18:23:08.865 INFO:teuthology.orchestra.run.smithi044.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.4-860-g6c6b083f-1focal [478 kB] 2024-09-13T18:23:08.872 INFO:teuthology.orchestra.run.smithi044.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.4-860-g6c6b083f-1focal [25.2 MB] 2024-09-13T18:23:08.879 INFO:teuthology.orchestra.run.smithi044.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-13T18:23:08.881 INFO:teuthology.orchestra.run.smithi044.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-09-13T18:23:08.883 INFO:teuthology.orchestra.run.smithi044.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-13T18:23:08.921 INFO:teuthology.orchestra.run.smithi044.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-13T18:23:08.921 INFO:teuthology.orchestra.run.smithi044.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-13T18:23:08.921 INFO:teuthology.orchestra.run.smithi044.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-13T18:23:08.922 INFO:teuthology.orchestra.run.smithi044.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-13T18:23:08.928 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-13T18:23:08.934 INFO:teuthology.orchestra.run.smithi044.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T18:23:08.934 INFO:teuthology.orchestra.run.smithi044.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-13T18:23:08.935 INFO:teuthology.orchestra.run.smithi044.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-13T18:23:08.935 INFO:teuthology.orchestra.run.smithi044.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-13T18:23:08.936 INFO:teuthology.orchestra.run.smithi044.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-13T18:23:08.944 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-13T18:23:09.005 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-13T18:23:09.067 INFO:teuthology.orchestra.run.smithi099.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.4-860-g6c6b083f-1focal [747 kB] 2024-09-13T18:23:09.126 INFO:teuthology.orchestra.run.smithi099.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.4-860-g6c6b083f-1focal [388 kB] 2024-09-13T18:23:09.133 INFO:teuthology.orchestra.run.smithi099.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.4-860-g6c6b083f-1focal [31.9 kB] 2024-09-13T18:23:09.134 INFO:teuthology.orchestra.run.smithi099.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.4-860-g6c6b083f-1focal [200 kB] 2024-09-13T18:23:09.135 INFO:teuthology.orchestra.run.smithi099.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.4-860-g6c6b083f-1focal [62.5 kB] 2024-09-13T18:23:09.136 INFO:teuthology.orchestra.run.smithi099.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.4-860-g6c6b083f-1focal [368 kB] 2024-09-13T18:23:09.191 INFO:teuthology.orchestra.run.smithi099.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.4-860-g6c6b083f-1focal [6,634 kB] 2024-09-13T18:23:09.201 INFO:teuthology.orchestra.run.smithi099.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-13T18:23:09.210 INFO:teuthology.orchestra.run.smithi099.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-13T18:23:09.236 INFO:teuthology.orchestra.run.smithi099.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-13T18:23:09.244 INFO:teuthology.orchestra.run.smithi099.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-13T18:23:09.245 INFO:teuthology.orchestra.run.smithi099.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-13T18:23:09.250 INFO:teuthology.orchestra.run.smithi099.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-13T18:23:09.251 INFO:teuthology.orchestra.run.smithi099.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-13T18:23:09.262 INFO:teuthology.orchestra.run.smithi099.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-13T18:23:09.263 INFO:teuthology.orchestra.run.smithi099.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-13T18:23:09.283 INFO:teuthology.orchestra.run.smithi099.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-13T18:23:09.351 INFO:teuthology.orchestra.run.smithi099.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-13T18:23:09.351 INFO:teuthology.orchestra.run.smithi099.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-13T18:23:09.353 INFO:teuthology.orchestra.run.smithi099.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-13T18:23:09.355 INFO:teuthology.orchestra.run.smithi099.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T18:23:09.356 INFO:teuthology.orchestra.run.smithi099.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-13T18:23:09.356 INFO:teuthology.orchestra.run.smithi099.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-13T18:23:09.359 INFO:teuthology.orchestra.run.smithi099.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-13T18:23:09.360 INFO:teuthology.orchestra.run.smithi099.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-13T18:23:09.365 INFO:teuthology.orchestra.run.smithi099.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-13T18:23:09.445 INFO:teuthology.orchestra.run.smithi099.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-13T18:23:09.446 INFO:teuthology.orchestra.run.smithi099.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-13T18:23:09.455 INFO:teuthology.orchestra.run.smithi099.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-13T18:23:09.456 INFO:teuthology.orchestra.run.smithi099.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-13T18:23:09.457 INFO:teuthology.orchestra.run.smithi099.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-13T18:23:09.458 INFO:teuthology.orchestra.run.smithi099.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-13T18:23:09.459 INFO:teuthology.orchestra.run.smithi099.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-13T18:23:09.460 INFO:teuthology.orchestra.run.smithi099.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-13T18:23:09.524 INFO:teuthology.orchestra.run.smithi044.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.4-860-g6c6b083f-1focal [9,609 kB] 2024-09-13T18:23:09.526 INFO:teuthology.orchestra.run.smithi099.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-13T18:23:09.532 INFO:teuthology.orchestra.run.smithi099.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-13T18:23:09.535 INFO:teuthology.orchestra.run.smithi099.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.4-860-g6c6b083f-1focal [113 kB] 2024-09-13T18:23:09.536 INFO:teuthology.orchestra.run.smithi099.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.4-860-g6c6b083f-1focal [478 kB] 2024-09-13T18:23:09.549 INFO:teuthology.orchestra.run.smithi099.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.4-860-g6c6b083f-1focal [25.2 MB] 2024-09-13T18:23:09.608 INFO:teuthology.orchestra.run.smithi099.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-09-13T18:23:09.612 INFO:teuthology.orchestra.run.smithi099.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-13T18:23:09.614 INFO:teuthology.orchestra.run.smithi099.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-13T18:23:09.615 INFO:teuthology.orchestra.run.smithi099.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-13T18:23:09.617 INFO:teuthology.orchestra.run.smithi099.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-13T18:23:09.618 INFO:teuthology.orchestra.run.smithi099.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-13T18:23:09.620 INFO:teuthology.orchestra.run.smithi099.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-13T18:23:09.621 INFO:teuthology.orchestra.run.smithi099.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-13T18:23:09.689 INFO:teuthology.orchestra.run.smithi099.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-13T18:23:09.692 INFO:teuthology.orchestra.run.smithi099.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T18:23:09.705 INFO:teuthology.orchestra.run.smithi044.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.4-860-g6c6b083f-1focal [238 kB] 2024-09-13T18:23:09.708 INFO:teuthology.orchestra.run.smithi044.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.4-860-g6c6b083f-1focal [147 kB] 2024-09-13T18:23:09.710 INFO:teuthology.orchestra.run.smithi044.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.4-860-g6c6b083f-1focal [1,576 kB] 2024-09-13T18:23:09.750 INFO:teuthology.orchestra.run.smithi044.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.4-860-g6c6b083f-1focal [6,641 kB] 2024-09-13T18:23:09.770 INFO:teuthology.orchestra.run.smithi099.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-13T18:23:09.773 INFO:teuthology.orchestra.run.smithi099.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-13T18:23:09.776 INFO:teuthology.orchestra.run.smithi099.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-13T18:23:09.778 INFO:teuthology.orchestra.run.smithi099.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-13T18:23:09.779 INFO:teuthology.orchestra.run.smithi099.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-13T18:23:09.780 INFO:teuthology.orchestra.run.smithi099.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-13T18:23:09.916 INFO:teuthology.orchestra.run.smithi044.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.4-860-g6c6b083f-1focal [24.5 MB] 2024-09-13T18:23:10.103 INFO:teuthology.orchestra.run.smithi099.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-13T18:23:10.132 INFO:teuthology.orchestra.run.smithi099.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-13T18:23:10.133 INFO:teuthology.orchestra.run.smithi099.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-13T18:23:10.202 INFO:teuthology.orchestra.run.smithi099.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-13T18:23:10.203 INFO:teuthology.orchestra.run.smithi099.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-13T18:23:10.203 INFO:teuthology.orchestra.run.smithi099.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-13T18:23:10.204 INFO:teuthology.orchestra.run.smithi099.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-13T18:23:10.204 INFO:teuthology.orchestra.run.smithi099.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-13T18:23:10.205 INFO:teuthology.orchestra.run.smithi099.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-13T18:23:10.206 INFO:teuthology.orchestra.run.smithi099.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-13T18:23:10.267 INFO:teuthology.orchestra.run.smithi099.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-13T18:23:10.268 INFO:teuthology.orchestra.run.smithi099.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-13T18:23:10.351 INFO:teuthology.orchestra.run.smithi099.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-13T18:23:10.356 INFO:teuthology.orchestra.run.smithi099.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-13T18:23:10.359 INFO:teuthology.orchestra.run.smithi099.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-13T18:23:10.362 INFO:teuthology.orchestra.run.smithi099.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-13T18:23:10.364 INFO:teuthology.orchestra.run.smithi099.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-13T18:23:10.367 INFO:teuthology.orchestra.run.smithi099.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-13T18:23:10.369 INFO:teuthology.orchestra.run.smithi099.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-09-13T18:23:10.369 INFO:teuthology.orchestra.run.smithi099.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-13T18:23:10.442 INFO:teuthology.orchestra.run.smithi099.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-13T18:23:10.447 INFO:teuthology.orchestra.run.smithi099.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-09-13T18:23:10.514 INFO:teuthology.orchestra.run.smithi099.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-13T18:23:10.643 INFO:teuthology.orchestra.run.smithi099.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-13T18:23:10.644 INFO:teuthology.orchestra.run.smithi099.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-13T18:23:10.697 INFO:teuthology.orchestra.run.smithi044.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.4-860-g6c6b083f-1focal [13.7 kB] 2024-09-13T18:23:10.698 INFO:teuthology.orchestra.run.smithi044.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.4-860-g6c6b083f-1focal [857 kB] 2024-09-13T18:23:10.710 INFO:teuthology.orchestra.run.smithi044.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.4-860-g6c6b083f-1focal [2,296 kB] 2024-09-13T18:23:10.713 INFO:teuthology.orchestra.run.smithi099.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-13T18:23:10.713 INFO:teuthology.orchestra.run.smithi099.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.4-860-g6c6b083f-1focal [9,609 kB] 2024-09-13T18:23:10.715 INFO:teuthology.orchestra.run.smithi099.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-13T18:23:10.728 INFO:teuthology.orchestra.run.smithi044.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.4-860-g6c6b083f-1focal [239 kB] 2024-09-13T18:23:10.730 INFO:teuthology.orchestra.run.smithi044.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.4-860-g6c6b083f-1focal [143 kB] 2024-09-13T18:23:10.731 INFO:teuthology.orchestra.run.smithi044.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.4-860-g6c6b083f-1focal [7,015 kB] 2024-09-13T18:23:10.733 INFO:teuthology.orchestra.run.smithi099.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T18:23:10.733 INFO:teuthology.orchestra.run.smithi099.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-13T18:23:10.734 INFO:teuthology.orchestra.run.smithi099.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-13T18:23:10.734 INFO:teuthology.orchestra.run.smithi099.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-13T18:23:10.735 INFO:teuthology.orchestra.run.smithi099.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-13T18:23:10.914 INFO:teuthology.orchestra.run.smithi044.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.4-860-g6c6b083f-1focal [7,894 kB] 2024-09-13T18:23:10.957 INFO:teuthology.orchestra.run.smithi099.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.4-860-g6c6b083f-1focal [238 kB] 2024-09-13T18:23:10.960 INFO:teuthology.orchestra.run.smithi099.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.4-860-g6c6b083f-1focal [147 kB] 2024-09-13T18:23:10.977 INFO:teuthology.orchestra.run.smithi099.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.4-860-g6c6b083f-1focal [1,576 kB] 2024-09-13T18:23:11.036 INFO:teuthology.orchestra.run.smithi099.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.4-860-g6c6b083f-1focal [6,641 kB] 2024-09-13T18:23:11.138 INFO:teuthology.orchestra.run.smithi044.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.4-860-g6c6b083f-1focal [13.9 kB] 2024-09-13T18:23:11.138 INFO:teuthology.orchestra.run.smithi044.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.4-860-g6c6b083f-1focal [47.1 MB] 2024-09-13T18:23:11.290 INFO:teuthology.orchestra.run.smithi099.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.4-860-g6c6b083f-1focal [24.5 MB] 2024-09-13T18:23:12.365 INFO:teuthology.orchestra.run.smithi099.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.4-860-g6c6b083f-1focal [13.7 kB] 2024-09-13T18:23:12.365 INFO:teuthology.orchestra.run.smithi099.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.4-860-g6c6b083f-1focal [857 kB] 2024-09-13T18:23:12.379 INFO:teuthology.orchestra.run.smithi099.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.4-860-g6c6b083f-1focal [2,296 kB] 2024-09-13T18:23:12.396 INFO:teuthology.orchestra.run.smithi099.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.4-860-g6c6b083f-1focal [239 kB] 2024-09-13T18:23:12.416 INFO:teuthology.orchestra.run.smithi099.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.4-860-g6c6b083f-1focal [143 kB] 2024-09-13T18:23:12.418 INFO:teuthology.orchestra.run.smithi099.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.4-860-g6c6b083f-1focal [7,015 kB] 2024-09-13T18:23:12.616 INFO:teuthology.orchestra.run.smithi099.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.4-860-g6c6b083f-1focal [7,894 kB] 2024-09-13T18:23:12.697 INFO:teuthology.orchestra.run.smithi044.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.4-860-g6c6b083f-1focal [120 kB] 2024-09-13T18:23:12.700 INFO:teuthology.orchestra.run.smithi044.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.4-860-g6c6b083f-1focal [271 kB] 2024-09-13T18:23:12.705 INFO:teuthology.orchestra.run.smithi044.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.4-860-g6c6b083f-1focal [33.0 kB] 2024-09-13T18:23:12.706 INFO:teuthology.orchestra.run.smithi044.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.4-860-g6c6b083f-1focal [22.8 kB] 2024-09-13T18:23:12.707 INFO:teuthology.orchestra.run.smithi044.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.4-860-g6c6b083f-1focal [37.4 kB] 2024-09-13T18:23:12.708 INFO:teuthology.orchestra.run.smithi044.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.4-860-g6c6b083f-1focal [13.5 MB] 2024-09-13T18:23:12.761 INFO:teuthology.orchestra.run.smithi099.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.4-860-g6c6b083f-1focal [13.9 kB] 2024-09-13T18:23:12.761 INFO:teuthology.orchestra.run.smithi099.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.4-860-g6c6b083f-1focal [47.1 MB] 2024-09-13T18:23:13.003 INFO:teuthology.orchestra.run.smithi044.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.4-860-g6c6b083f-1focal [108 kB] 2024-09-13T18:23:13.669 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 200 MB in 5s (42.4 MB/s) 2024-09-13T18:23:13.829 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-13T18:23:13.885 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141720 files and directories currently installed.) 2024-09-13T18:23:13.889 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-09-13T18:23:13.925 INFO:teuthology.orchestra.run.smithi099.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.4-860-g6c6b083f-1focal [120 kB] 2024-09-13T18:23:13.927 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-09-13T18:23:13.928 INFO:teuthology.orchestra.run.smithi099.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.4-860-g6c6b083f-1focal [271 kB] 2024-09-13T18:23:13.933 INFO:teuthology.orchestra.run.smithi099.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.4-860-g6c6b083f-1focal [33.0 kB] 2024-09-13T18:23:13.934 INFO:teuthology.orchestra.run.smithi099.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.4-860-g6c6b083f-1focal [22.8 kB] 2024-09-13T18:23:13.935 INFO:teuthology.orchestra.run.smithi099.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.4-860-g6c6b083f-1focal [37.4 kB] 2024-09-13T18:23:13.936 INFO:teuthology.orchestra.run.smithi099.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.4-860-g6c6b083f-1focal [13.5 MB] 2024-09-13T18:23:14.110 INFO:teuthology.orchestra.run.smithi099.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.4-860-g6c6b083f-1focal [108 kB] 2024-09-13T18:23:14.255 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T18:23:14.272 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-13T18:23:14.313 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T18:23:14.616 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cmd2. 2024-09-13T18:23:14.633 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-09-13T18:23:14.691 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-09-13T18:23:14.752 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 200 MB in 6s (34.8 MB/s) 2024-09-13T18:23:14.902 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-13T18:23:14.958 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141720 files and directories currently installed.) 2024-09-13T18:23:14.962 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-09-13T18:23:14.994 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-13T18:23:15.010 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-13T18:23:15.017 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-09-13T18:23:15.078 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T18:23:15.303 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T18:23:15.320 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-13T18:23:15.353 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T18:23:15.415 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T18:23:15.432 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-13T18:23:15.473 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T18:23:15.647 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cmd2. 2024-09-13T18:23:15.666 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-09-13T18:23:15.747 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-09-13T18:23:15.842 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T18:23:15.860 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-13T18:23:15.909 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T18:23:16.091 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-13T18:23:16.110 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-13T18:23:16.192 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T18:23:16.363 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T18:23:16.382 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:23:16.431 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:23:16.570 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T18:23:16.587 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-13T18:23:16.628 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T18:23:16.930 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T18:23:16.950 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:23:16.956 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T18:23:16.976 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-13T18:23:16.992 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:23:17.014 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T18:23:17.344 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T18:23:17.363 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:23:17.418 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:23:17.509 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T18:23:17.526 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:23:17.578 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:23:17.780 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-13T18:23:17.797 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-13T18:23:17.855 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T18:23:18.104 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T18:23:18.122 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:23:18.162 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:23:18.182 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../010-librbd1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:18.341 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librbd1 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T18:23:18.498 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T18:23:18.518 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:23:18.573 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:23:18.918 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-13T18:23:18.934 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-13T18:23:18.968 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T18:23:19.071 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../011-librados2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:19.229 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librados2 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T18:23:19.345 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../010-librbd1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:19.471 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librbd1 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T18:23:19.957 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T18:23:19.976 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../012-libcephfs2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:20.007 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:20.193 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../011-librados2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:20.317 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librados2 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T18:23:20.377 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rados. 2024-09-13T18:23:20.395 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../013-python3-rados_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:20.435 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:20.813 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T18:23:20.829 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:23:20.871 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:21.012 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T18:23:21.028 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../012-libcephfs2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:21.064 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:21.149 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T18:23:21.165 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../015-python3-cephfs_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:21.207 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:21.390 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rados. 2024-09-13T18:23:21.406 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../013-python3-rados_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:21.448 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:21.543 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T18:23:21.559 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:23:21.609 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:21.833 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T18:23:21.850 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:23:21.892 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:21.988 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T18:23:22.007 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2024-09-13T18:23:22.046 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-13T18:23:22.127 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T18:23:22.143 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../015-python3-cephfs_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:22.186 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:22.299 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T18:23:22.316 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../018-python3-rbd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:22.357 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:22.521 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T18:23:22.538 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:23:22.580 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:22.718 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-13T18:23:22.736 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-13T18:23:22.776 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T18:23:22.941 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T18:23:22.957 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2024-09-13T18:23:22.999 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-13T18:23:23.155 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-13T18:23:23.170 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-13T18:23:23.213 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T18:23:23.268 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T18:23:23.284 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../018-python3-rbd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:23.327 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:23.591 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T18:23:23.608 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-13T18:23:23.649 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T18:23:23.696 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-13T18:23:23.717 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-13T18:23:23.754 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T18:23:24.035 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package librgw2. 2024-09-13T18:23:24.052 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../022-librgw2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:24.093 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:24.149 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-13T18:23:24.164 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-13T18:23:24.207 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T18:23:24.768 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T18:23:24.784 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-13T18:23:24.827 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T18:23:24.979 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T18:23:24.996 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../023-python3-rgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:25.037 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:25.188 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librgw2. 2024-09-13T18:23:25.206 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../022-librgw2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:25.245 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:25.415 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package liboath0. 2024-09-13T18:23:25.432 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-13T18:23:25.473 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-13T18:23:25.810 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T18:23:25.830 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../025-libradosstriper1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:25.868 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:26.115 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T18:23:26.131 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../023-python3-rgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:26.173 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:26.509 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liboath0. 2024-09-13T18:23:26.513 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-common. 2024-09-13T18:23:26.526 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-13T18:23:26.531 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../026-ceph-common_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:26.559 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-13T18:23:26.596 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:26.853 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T18:23:26.870 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../025-libradosstriper1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:26.911 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:27.401 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-common. 2024-09-13T18:23:27.415 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../026-ceph-common_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:27.456 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:29.110 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-base. 2024-09-13T18:23:29.128 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../027-ceph-base_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:29.187 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:29.961 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-base. 2024-09-13T18:23:29.977 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../027-ceph-base_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:30.030 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:30.565 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T18:23:30.581 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-13T18:23:30.648 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-13T18:23:31.009 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T18:23:31.026 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2024-09-13T18:23:31.092 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-13T18:23:31.324 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T18:23:31.342 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-13T18:23:31.382 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-13T18:23:31.387 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T18:23:31.404 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2024-09-13T18:23:31.446 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-13T18:23:31.737 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T18:23:31.753 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2024-09-13T18:23:31.773 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T18:23:31.790 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-13T18:23:31.793 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-13T18:23:31.831 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-13T18:23:32.121 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T18:23:32.138 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2024-09-13T18:23:32.151 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-mako. 2024-09-13T18:23:32.170 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-13T18:23:32.179 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-13T18:23:32.209 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T18:23:32.507 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T18:23:32.523 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-13T18:23:32.565 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-13T18:23:32.588 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T18:23:32.604 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T18:23:32.646 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T18:23:32.851 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-mako. 2024-09-13T18:23:32.867 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-13T18:23:32.901 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T18:23:32.974 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T18:23:32.989 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-13T18:23:33.032 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T18:23:33.171 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T18:23:33.187 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T18:23:33.229 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T18:23:33.309 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-webob. 2024-09-13T18:23:33.327 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-13T18:23:33.389 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T18:23:33.574 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T18:23:33.591 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-13T18:23:33.632 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T18:23:33.712 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-13T18:23:33.729 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-13T18:23:33.771 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T18:23:33.943 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-webob. 2024-09-13T18:23:33.961 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-13T18:23:34.001 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T18:23:34.148 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-bs4. 2024-09-13T18:23:34.165 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2024-09-13T18:23:34.206 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-13T18:23:34.329 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-13T18:23:34.345 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-13T18:23:34.387 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T18:23:34.576 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T18:23:34.595 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-13T18:23:34.638 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T18:23:34.741 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-bs4. 2024-09-13T18:23:34.761 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2024-09-13T18:23:34.798 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-13T18:23:34.971 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T18:23:34.991 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2024-09-13T18:23:35.029 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-13T18:23:35.184 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T18:23:35.202 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-13T18:23:35.245 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T18:23:35.349 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-paste. 2024-09-13T18:23:35.365 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-13T18:23:35.407 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T18:23:35.579 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T18:23:35.598 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2024-09-13T18:23:35.637 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-13T18:23:35.741 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T18:23:35.759 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-13T18:23:35.799 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T18:23:35.948 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-paste. 2024-09-13T18:23:35.968 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-13T18:23:36.012 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T18:23:36.102 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T18:23:36.122 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-13T18:23:36.168 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-13T18:23:36.366 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T18:23:36.385 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-13T18:23:36.424 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T18:23:36.473 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T18:23:36.490 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2024-09-13T18:23:36.531 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-13T18:23:36.752 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T18:23:36.769 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-13T18:23:36.810 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-13T18:23:36.901 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T18:23:36.919 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-13T18:23:36.951 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T18:23:37.113 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T18:23:37.129 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2024-09-13T18:23:37.171 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-13T18:23:37.331 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T18:23:37.348 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-13T18:23:37.389 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T18:23:37.533 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T18:23:37.551 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-13T18:23:37.591 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T18:23:37.701 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T18:23:37.719 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:23:37.759 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:37.954 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T18:23:37.973 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-13T18:23:38.011 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T18:23:38.141 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T18:23:38.158 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:38.199 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:38.307 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T18:23:38.323 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:23:38.381 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:38.554 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T18:23:38.572 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../048-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-13T18:23:38.612 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T18:23:38.746 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T18:23:38.763 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:38.806 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:38.940 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cryptography. 2024-09-13T18:23:38.959 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../049-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-13T18:23:38.998 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T18:23:39.151 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T18:23:39.167 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../048-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-13T18:23:39.209 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T18:23:39.367 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T18:23:39.387 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../050-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-13T18:23:39.426 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-13T18:23:39.537 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cryptography. 2024-09-13T18:23:39.554 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../049-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-13T18:23:39.595 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T18:23:39.803 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T18:23:39.820 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../051-ceph-mgr_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:39.861 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:40.383 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T18:23:40.398 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../052-ceph-mon_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:40.440 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:40.822 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T18:23:40.839 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../050-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-13T18:23:40.880 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-13T18:23:41.225 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T18:23:41.242 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../051-ceph-mgr_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:41.283 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:41.443 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T18:23:41.463 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../053-ceph-osd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:41.501 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:41.761 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T18:23:41.779 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../052-ceph-mon_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:41.819 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:42.773 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T18:23:42.790 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../053-ceph-osd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:42.831 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:44.196 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph. 2024-09-13T18:23:44.215 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../054-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:44.254 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:44.608 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T18:23:44.624 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../055-ceph-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:44.665 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:45.043 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph. 2024-09-13T18:23:45.059 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../054-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:45.118 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T18:23:45.125 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:45.136 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../056-ceph-mds_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:45.176 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:45.378 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T18:23:45.397 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../055-ceph-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:45.436 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:45.721 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package cephadm. 2024-09-13T18:23:45.737 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../057-cephadm_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:45.779 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:45.931 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T18:23:45.947 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../056-ceph-mds_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:45.989 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:46.107 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T18:23:46.126 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../058-python3-asyncssh_1.12.2-1_all.deb ... 2024-09-13T18:23:46.157 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-09-13T18:23:46.535 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T18:23:46.552 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-13T18:23:46.559 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package cephadm. 2024-09-13T18:23:46.575 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../057-cephadm_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:23:46.593 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T18:23:46.617 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:46.920 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T18:23:46.936 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../058-python3-asyncssh_1.12.2-1_all.deb ... 2024-09-13T18:23:46.937 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T18:23:46.955 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:23:46.969 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-09-13T18:23:46.995 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:47.327 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T18:23:47.345 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-13T18:23:47.389 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T18:23:47.399 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jwt. 2024-09-13T18:23:47.416 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-13T18:23:47.457 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T18:23:47.725 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T18:23:47.742 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:23:47.783 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:47.785 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-attr. 2024-09-13T18:23:47.801 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2024-09-13T18:23:47.843 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-13T18:23:48.145 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jwt. 2024-09-13T18:23:48.165 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-13T18:23:48.203 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T18:23:48.263 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T18:23:48.280 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2024-09-13T18:23:48.321 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-13T18:23:48.547 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-attr. 2024-09-13T18:23:48.566 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2024-09-13T18:23:48.605 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-13T18:23:48.657 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-py. 2024-09-13T18:23:48.675 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-13T18:23:48.715 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T18:23:48.942 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T18:23:48.961 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2024-09-13T18:23:49.016 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-13T18:23:49.070 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-13T18:23:49.090 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-13T18:23:49.128 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T18:23:49.336 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-py. 2024-09-13T18:23:49.354 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-13T18:23:49.394 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T18:23:49.422 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-packaging. 2024-09-13T18:23:49.442 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2024-09-13T18:23:49.480 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-13T18:23:49.732 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-13T18:23:49.748 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-13T18:23:49.790 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T18:23:49.817 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T18:23:49.833 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2024-09-13T18:23:49.875 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-13T18:23:50.128 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-packaging. 2024-09-13T18:23:50.143 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2024-09-13T18:23:50.184 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-13T18:23:50.195 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T18:23:50.213 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T18:23:50.253 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T18:23:50.487 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T18:23:50.503 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2024-09-13T18:23:50.539 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libjs-underscore. 2024-09-13T18:23:50.545 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-13T18:23:50.554 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-13T18:23:50.597 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T18:23:50.890 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T18:23:50.909 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T18:23:50.916 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-13T18:23:50.933 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-13T18:23:50.948 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T18:23:50.974 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T18:23:51.217 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libjs-underscore. 2024-09-13T18:23:51.234 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-13T18:23:51.275 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T18:23:51.318 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-routes. 2024-09-13T18:23:51.335 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2024-09-13T18:23:51.377 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-13T18:23:51.553 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-13T18:23:51.568 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-13T18:23:51.611 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T18:23:51.863 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T18:23:51.880 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:23:51.921 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:51.964 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-routes. 2024-09-13T18:23:51.979 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2024-09-13T18:23:52.021 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-13T18:23:52.408 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T18:23:52.424 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:23:52.466 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:53.302 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-decorator. 2024-09-13T18:23:53.318 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-13T18:23:53.359 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T18:23:53.695 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-13T18:23:53.712 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-13T18:23:53.754 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T18:23:53.871 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-decorator. 2024-09-13T18:23:53.887 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-13T18:23:53.945 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T18:23:54.057 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-scipy. 2024-09-13T18:23:54.075 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-13T18:23:54.148 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-13T18:23:54.257 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-13T18:23:54.277 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-13T18:23:54.315 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T18:23:54.651 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-scipy. 2024-09-13T18:23:54.667 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-13T18:23:54.709 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-13T18:23:55.423 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-13T18:23:55.441 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-13T18:23:55.506 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T18:23:56.035 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T18:23:56.052 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2024-09-13T18:23:56.094 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-13T18:23:56.205 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-13T18:23:56.225 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-13T18:23:56.375 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T18:23:56.489 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T18:23:56.505 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-13T18:23:56.556 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T18:23:56.905 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T18:23:56.921 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2024-09-13T18:23:56.963 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-13T18:23:57.257 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T18:23:57.274 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:23:57.340 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:57.367 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T18:23:57.383 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-13T18:23:57.425 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T18:23:58.125 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T18:23:58.143 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:23:58.183 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:23:58.843 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T18:23:58.860 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2024-09-13T18:23:58.901 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-13T18:23:59.293 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T18:23:59.312 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-13T18:23:59.336 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T18:23:59.351 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T18:23:59.352 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2024-09-13T18:23:59.394 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-13T18:23:59.722 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T18:23:59.741 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-13T18:23:59.780 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T18:23:59.828 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T18:23:59.843 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-13T18:23:59.886 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T18:24:00.100 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T18:24:00.119 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2024-09-13T18:24:00.158 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-13T18:24:00.231 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T18:24:00.247 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-13T18:24:00.289 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T18:24:00.437 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T18:24:00.454 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2024-09-13T18:24:00.486 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-13T18:24:00.634 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T18:24:00.652 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2024-09-13T18:24:00.692 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-13T18:24:00.799 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-blinker. 2024-09-13T18:24:00.816 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-13T18:24:00.857 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T18:24:01.158 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T18:24:01.159 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2024-09-13T18:24:01.159 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-13T18:24:01.185 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-13T18:24:01.201 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-13T18:24:01.243 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T18:24:01.408 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-blinker. 2024-09-13T18:24:01.426 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-13T18:24:01.466 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T18:24:01.575 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T18:24:01.593 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-13T18:24:01.625 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T18:24:01.802 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-13T18:24:01.819 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-13T18:24:01.860 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T18:24:01.919 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T18:24:01.937 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-13T18:24:01.978 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T18:24:02.217 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T18:24:02.234 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-13T18:24:02.275 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T18:24:02.308 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T18:24:02.327 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-13T18:24:02.390 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T18:24:02.595 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T18:24:02.611 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-13T18:24:02.653 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T18:24:02.963 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T18:24:02.980 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:24:02.997 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T18:24:03.015 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-13T18:24:03.021 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:03.055 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T18:24:03.357 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T18:24:03.376 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2024-09-13T18:24:03.424 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-13T18:24:03.621 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T18:24:03.637 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:24:03.679 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:03.794 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T18:24:03.810 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:24:03.852 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:24:04.023 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T18:24:04.041 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2024-09-13T18:24:04.081 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-13T18:24:04.113 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package jq. 2024-09-13T18:24:04.132 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:24:04.196 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:24:04.434 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T18:24:04.449 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package socat. 2024-09-13T18:24:04.451 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:24:04.467 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2024-09-13T18:24:04.506 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-13T18:24:04.509 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:24:04.787 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package jq. 2024-09-13T18:24:04.804 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:24:04.835 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T18:24:04.845 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:24:04.853 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-13T18:24:04.893 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-13T18:24:05.131 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package socat. 2024-09-13T18:24:05.147 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2024-09-13T18:24:05.189 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-13T18:24:05.273 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-test. 2024-09-13T18:24:05.291 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../096-ceph-test_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:24:05.330 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:05.501 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T18:24:05.518 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-13T18:24:05.584 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-13T18:24:05.930 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-test. 2024-09-13T18:24:05.947 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../096-ceph-test_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:24:05.988 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:09.785 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T18:24:09.802 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:24:09.843 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:10.225 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-13T18:24:10.242 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:24:10.283 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:10.300 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T18:24:10.318 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:24:10.358 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:10.620 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-colorama. 2024-09-13T18:24:10.640 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2024-09-13T18:24:10.669 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-09-13T18:24:10.756 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-13T18:24:10.774 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:24:10.814 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:10.922 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package cephfs-shell. 2024-09-13T18:24:10.942 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../100-cephfs-shell_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:24:11.013 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:11.176 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-colorama. 2024-09-13T18:24:11.192 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2024-09-13T18:24:11.234 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-09-13T18:24:11.283 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package cephfs-top. 2024-09-13T18:24:11.301 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../101-cephfs-top_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:24:11.344 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:11.486 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package cephfs-shell. 2024-09-13T18:24:11.503 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../100-cephfs-shell_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:24:11.544 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:11.605 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-13T18:24:11.622 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T18:24:11.655 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:24:11.835 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package cephfs-top. 2024-09-13T18:24:11.853 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../101-cephfs-top_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:24:11.893 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:12.175 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T18:24:12.179 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-13T18:24:12.192 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:24:12.195 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T18:24:12.233 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:12.237 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:24:12.640 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T18:24:12.659 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-13T18:24:12.714 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T18:24:12.775 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T18:24:12.791 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:24:12.832 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:13.062 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T18:24:13.083 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-09-13T18:24:13.120 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-09-13T18:24:13.255 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T18:24:13.274 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-13T18:24:13.331 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T18:24:13.507 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-13T18:24:13.525 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T18:24:13.565 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:24:13.635 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T18:24:13.651 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-09-13T18:24:13.693 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-09-13T18:24:14.079 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-13T18:24:14.096 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T18:24:14.137 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:24:15.248 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-13T18:24:15.269 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-13T18:24:15.306 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-13T18:24:15.676 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-webencodings. 2024-09-13T18:24:15.694 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-13T18:24:15.734 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T18:24:15.762 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-13T18:24:15.781 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-13T18:24:15.820 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-13T18:24:16.079 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-html5lib. 2024-09-13T18:24:16.100 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2024-09-13T18:24:16.137 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-13T18:24:16.173 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-webencodings. 2024-09-13T18:24:16.191 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-13T18:24:16.232 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T18:24:16.507 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-13T18:24:16.517 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-html5lib. 2024-09-13T18:24:16.528 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-13T18:24:16.538 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2024-09-13T18:24:16.565 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T18:24:16.600 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-13T18:24:16.962 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-13T18:24:16.980 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-13T18:24:17.012 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T18:24:17.035 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T18:24:17.052 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T18:24:17.093 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T18:24:17.439 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T18:24:17.457 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-13T18:24:17.498 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T18:24:17.507 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T18:24:17.526 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T18:24:17.565 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T18:24:17.852 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T18:24:17.870 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-13T18:24:17.910 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T18:24:17.921 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T18:24:17.939 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-13T18:24:17.979 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T18:24:18.222 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T18:24:18.238 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-13T18:24:18.313 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T18:24:18.341 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T18:24:18.361 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-13T18:24:18.399 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T18:24:18.582 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T18:24:18.600 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-13T18:24:18.640 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T18:24:18.693 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T18:24:18.714 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-13T18:24:18.751 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T18:24:19.038 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T18:24:19.055 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-13T18:24:19.095 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T18:24:19.363 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package radosgw. 2024-09-13T18:24:19.380 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../116-radosgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:24:19.421 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:19.784 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package radosgw. 2024-09-13T18:24:19.803 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../116-radosgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:24:19.842 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:20.841 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T18:24:20.858 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../117-rbd-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:24:20.899 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:21.249 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-13T18:24:21.363 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T18:24:21.380 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../117-rbd-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:24:21.421 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:21.546 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T18:24:21.672 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T18:24:21.756 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-13T18:24:21.798 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T18:24:22.016 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:22.059 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T18:24:22.177 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T18:24:22.320 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T18:24:22.521 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:22.568 INFO:teuthology.orchestra.run.smithi044.stdout:Adding system user cephadm....done 2024-09-13T18:24:22.731 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:24:22.890 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T18:24:23.114 INFO:teuthology.orchestra.run.smithi099.stdout:Adding system user cephadm....done 2024-09-13T18:24:23.234 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T18:24:23.236 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:24:23.412 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T18:24:23.552 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:24:23.678 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-13T18:24:23.772 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T18:24:23.837 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T18:24:24.081 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:24:24.206 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-13T18:24:24.207 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-13T18:24:24.333 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T18:24:24.652 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T18:24:24.694 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-13T18:24:24.950 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-13T18:24:25.121 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T18:24:25.235 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-09-13T18:24:25.413 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-13T18:24:25.511 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T18:24:25.731 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-09-13T18:24:25.829 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T18:24:26.016 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T18:24:26.131 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:26.325 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T18:24:26.457 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T18:24:26.582 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-09-13T18:24:26.626 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:26.892 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-13T18:24:26.927 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T18:24:27.193 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T18:24:27.477 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T18:24:27.597 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-09-13T18:24:27.603 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T18:24:27.879 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-13T18:24:27.946 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-13T18:24:28.165 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T18:24:28.264 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T18:24:28.481 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T18:24:28.532 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T18:24:28.607 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T18:24:28.875 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T18:24:28.984 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-13T18:24:29.293 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T18:24:29.590 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T18:24:29.611 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T18:24:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-13T18:24:29.979 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T18:24:30.228 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-13T18:24:30.263 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T18:24:30.563 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T18:24:30.606 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-13T18:24:30.689 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T18:24:30.815 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T18:24:30.916 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-13T18:24:31.108 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T18:24:31.225 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T18:24:31.351 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T18:24:31.460 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T18:24:31.518 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-09-13T18:24:31.745 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T18:24:31.819 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T18:24:32.172 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-09-13T18:24:32.229 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T18:24:32.473 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T18:24:32.622 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-13T18:24:32.841 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T18:24:32.890 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:33.208 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:24:33.209 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-13T18:24:33.351 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-13T18:24:33.360 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:33.686 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T18:24:33.686 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:24:33.854 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-13T18:24:33.895 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-13T18:24:34.030 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-13T18:24:34.214 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T18:24:34.323 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T18:24:34.362 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-13T18:24:34.491 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-13T18:24:34.624 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:24:34.758 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T18:24:34.784 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T18:24:34.859 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T18:24:35.110 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:24:35.178 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T18:24:35.228 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T18:24:35.354 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T18:24:35.463 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-13T18:24:35.722 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T18:24:35.764 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T18:24:35.890 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T18:24:36.032 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-13T18:24:36.184 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-13T18:24:36.341 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T18:24:36.442 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T18:24:36.467 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T18:24:36.760 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T18:24:36.761 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-13T18:24:37.045 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T18:24:37.125 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-13T18:24:37.396 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T18:24:37.421 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-13T18:24:37.548 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T18:24:37.813 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-13T18:24:37.882 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-13T18:24:38.090 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-13T18:24:38.241 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T18:24:38.242 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T18:24:38.376 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T18:24:38.485 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T18:24:38.568 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-13T18:24:38.812 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T18:24:38.936 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T18:24:39.062 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T18:24:39.105 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-13T18:24:39.188 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T18:24:39.498 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T18:24:39.782 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-13T18:24:40.652 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:24:40.778 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-13T18:24:41.155 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-13T18:24:41.296 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:24:41.397 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-13T18:24:41.457 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-13T18:24:41.757 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-13T18:24:41.758 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:24:41.909 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-13T18:24:42.075 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-13T18:24:42.260 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T18:24:42.377 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:24:42.502 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-13T18:24:42.620 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-09-13T18:24:42.879 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T18:24:43.022 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T18:24:43.206 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-09-13T18:24:43.340 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T18:24:43.565 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T18:24:43.884 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T18:24:44.420 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T18:24:44.546 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-13T18:24:44.697 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:24:44.823 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-13T18:24:44.931 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T18:24:45.032 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-13T18:24:45.141 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T18:24:45.158 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:24:45.267 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-13T18:24:45.326 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-13T18:24:45.569 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T18:24:45.693 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T18:24:45.745 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-13T18:24:45.861 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T18:24:46.062 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T18:24:46.196 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T18:24:46.363 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T18:24:46.573 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librados2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:46.698 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T18:24:46.785 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-09-13T18:24:46.936 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:47.054 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:47.067 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librados2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:47.180 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:47.279 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-09-13T18:24:47.339 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-13T18:24:47.405 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:47.556 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:47.624 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:47.682 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:47.750 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-13T18:24:47.808 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-13T18:24:48.077 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librbd1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:48.112 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:48.226 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:48.239 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-13T18:24:48.346 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:48.531 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librbd1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:48.584 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T18:24:48.584 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T18:24:48.691 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:48.817 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:49.039 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:49.045 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T18:24:49.046 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T18:24:49.198 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:49.324 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:49.450 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T18:24:49.493 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:49.628 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:49.779 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:49.905 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T18:24:50.396 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:50.547 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:50.674 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:50.800 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:50.825 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:50.951 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:50.960 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:51.076 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:51.086 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:51.212 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:51.363 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:51.489 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:51.648 INFO:teuthology.orchestra.run.smithi044.stdout:Adding group ceph....done 2024-09-13T18:24:52.049 INFO:teuthology.orchestra.run.smithi044.stdout:Adding system user ceph....done 2024-09-13T18:24:52.067 INFO:teuthology.orchestra.run.smithi099.stdout:Adding group ceph....done 2024-09-13T18:24:52.201 INFO:teuthology.orchestra.run.smithi044.stdout:Setting system user ceph properties....done 2024-09-13T18:24:52.226 INFO:teuthology.orchestra.run.smithi044.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T18:24:52.390 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T18:24:52.435 INFO:teuthology.orchestra.run.smithi099.stdout:Adding system user ceph....done 2024-09-13T18:24:52.595 INFO:teuthology.orchestra.run.smithi099.stdout:Setting system user ceph properties....done 2024-09-13T18:24:52.620 INFO:teuthology.orchestra.run.smithi099.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T18:24:52.723 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T18:24:52.768 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T18:24:53.089 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T18:24:53.188 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:53.416 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:24:53.416 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:24:53.575 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:53.799 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:24:53.799 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:24:53.873 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:53.999 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:54.242 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:54.377 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:54.522 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:24:54.522 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:24:54.839 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:24:54.840 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:24:55.018 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:55.321 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:55.416 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T18:24:55.706 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T18:24:55.904 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:56.149 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T18:24:56.150 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T18:24:56.157 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:56.410 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T18:24:56.410 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T18:24:56.589 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:56.822 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T18:24:56.823 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T18:24:56.859 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:57.090 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T18:24:57.090 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T18:24:57.282 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:57.552 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:57.796 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T18:24:57.797 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T18:24:58.022 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T18:24:58.022 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T18:24:58.275 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:58.401 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:58.544 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:58.546 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:58.672 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:58.802 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T18:24:58.802 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T18:24:58.815 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:59.036 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T18:24:59.036 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T18:24:59.245 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:59.388 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:59.533 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:59.547 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:59.667 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:59.690 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:59.793 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:24:59.936 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:25:00.060 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T18:25:00.211 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T18:25:00.322 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T18:25:00.474 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T18:25:00.731 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T18:25:00.759 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T18:25:03.699 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-13T18:25:03.729 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-13T18:25:04.279 INFO:teuthology.orchestra.run.smithi044.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T18:25:04.282 DEBUG:teuthology.orchestra.run.smithi044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-13T18:25:04.357 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-09-13T18:25:04.372 INFO:teuthology.orchestra.run.smithi099.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T18:25:04.375 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-13T18:25:04.447 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-09-13T18:25:04.582 INFO:teuthology.orchestra.run.smithi044.stdout:Building dependency tree... 2024-09-13T18:25:04.583 INFO:teuthology.orchestra.run.smithi044.stdout:Reading state information... 2024-09-13T18:25:04.666 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-09-13T18:25:04.667 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-09-13T18:25:04.814 INFO:teuthology.orchestra.run.smithi044.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-09-13T18:25:04.814 INFO:teuthology.orchestra.run.smithi044.stdout:flex is already the newest version (2.6.4-6.2). 2024-09-13T18:25:04.814 INFO:teuthology.orchestra.run.smithi044.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-09-13T18:25:04.814 INFO:teuthology.orchestra.run.smithi044.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-09-13T18:25:04.814 INFO:teuthology.orchestra.run.smithi044.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-09-13T18:25:04.814 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:25:04.815 INFO:teuthology.orchestra.run.smithi044.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T18:25:04.815 INFO:teuthology.orchestra.run.smithi044.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:25:04.816 INFO:teuthology.orchestra.run.smithi044.stdout:The following additional packages will be installed: 2024-09-13T18:25:04.816 INFO:teuthology.orchestra.run.smithi044.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-09-13T18:25:04.816 INFO:teuthology.orchestra.run.smithi044.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2024-09-13T18:25:04.816 INFO:teuthology.orchestra.run.smithi044.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2024-09-13T18:25:04.816 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2024-09-13T18:25:04.817 INFO:teuthology.orchestra.run.smithi044.stdout: usb-modeswitch-data wpasupplicant 2024-09-13T18:25:04.818 INFO:teuthology.orchestra.run.smithi044.stdout:Suggested packages: 2024-09-13T18:25:04.818 INFO:teuthology.orchestra.run.smithi044.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2024-09-13T18:25:04.818 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2024-09-13T18:25:04.818 INFO:teuthology.orchestra.run.smithi044.stdout: libengine-pkcs11-openssl 2024-09-13T18:25:04.881 INFO:teuthology.orchestra.run.smithi044.stdout:The following NEW packages will be installed: 2024-09-13T18:25:04.882 INFO:teuthology.orchestra.run.smithi044.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-09-13T18:25:04.882 INFO:teuthology.orchestra.run.smithi044.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2024-09-13T18:25:04.882 INFO:teuthology.orchestra.run.smithi044.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-09-13T18:25:04.882 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2024-09-13T18:25:04.883 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2024-09-13T18:25:04.883 INFO:teuthology.orchestra.run.smithi044.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T18:25:04.883 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages will be upgraded: 2024-09-13T18:25:04.884 INFO:teuthology.orchestra.run.smithi044.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-09-13T18:25:04.891 INFO:teuthology.orchestra.run.smithi099.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-09-13T18:25:04.891 INFO:teuthology.orchestra.run.smithi099.stdout:flex is already the newest version (2.6.4-6.2). 2024-09-13T18:25:04.891 INFO:teuthology.orchestra.run.smithi099.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-09-13T18:25:04.891 INFO:teuthology.orchestra.run.smithi099.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-09-13T18:25:04.892 INFO:teuthology.orchestra.run.smithi099.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-09-13T18:25:04.892 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:25:04.892 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T18:25:04.892 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:25:04.893 INFO:teuthology.orchestra.run.smithi099.stdout:The following additional packages will be installed: 2024-09-13T18:25:04.893 INFO:teuthology.orchestra.run.smithi099.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-09-13T18:25:04.893 INFO:teuthology.orchestra.run.smithi099.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2024-09-13T18:25:04.894 INFO:teuthology.orchestra.run.smithi099.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2024-09-13T18:25:04.894 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2024-09-13T18:25:04.894 INFO:teuthology.orchestra.run.smithi099.stdout: usb-modeswitch-data wpasupplicant 2024-09-13T18:25:04.895 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2024-09-13T18:25:04.895 INFO:teuthology.orchestra.run.smithi099.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2024-09-13T18:25:04.895 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2024-09-13T18:25:04.895 INFO:teuthology.orchestra.run.smithi099.stdout: libengine-pkcs11-openssl 2024-09-13T18:25:04.941 INFO:teuthology.orchestra.run.smithi044.stdout:6 upgraded, 31 newly installed, 0 to remove and 289 not upgraded. 2024-09-13T18:25:04.942 INFO:teuthology.orchestra.run.smithi044.stdout:Need to get 25.4 MB of archives. 2024-09-13T18:25:04.942 INFO:teuthology.orchestra.run.smithi044.stdout:After this operation, 80.0 MB of additional disk space will be used. 2024-09-13T18:25:04.942 INFO:teuthology.orchestra.run.smithi044.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-09-13T18:25:04.958 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2024-09-13T18:25:04.959 INFO:teuthology.orchestra.run.smithi099.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-09-13T18:25:04.959 INFO:teuthology.orchestra.run.smithi099.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2024-09-13T18:25:04.959 INFO:teuthology.orchestra.run.smithi099.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-09-13T18:25:04.959 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2024-09-13T18:25:04.960 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2024-09-13T18:25:04.960 INFO:teuthology.orchestra.run.smithi099.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T18:25:04.960 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages will be upgraded: 2024-09-13T18:25:04.962 INFO:teuthology.orchestra.run.smithi099.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-09-13T18:25:05.017 INFO:teuthology.orchestra.run.smithi099.stdout:6 upgraded, 31 newly installed, 0 to remove and 289 not upgraded. 2024-09-13T18:25:05.018 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 25.4 MB of archives. 2024-09-13T18:25:05.018 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 80.0 MB of additional disk space will be used. 2024-09-13T18:25:05.018 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-09-13T18:25:05.073 INFO:teuthology.orchestra.run.smithi044.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-09-13T18:25:05.074 INFO:teuthology.orchestra.run.smithi044.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-09-13T18:25:05.074 INFO:teuthology.orchestra.run.smithi044.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-09-13T18:25:05.078 INFO:teuthology.orchestra.run.smithi044.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-09-13T18:25:05.079 INFO:teuthology.orchestra.run.smithi044.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-09-13T18:25:05.097 INFO:teuthology.orchestra.run.smithi044.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-09-13T18:25:05.098 INFO:teuthology.orchestra.run.smithi044.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-09-13T18:25:05.099 INFO:teuthology.orchestra.run.smithi044.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-09-13T18:25:05.101 INFO:teuthology.orchestra.run.smithi044.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-09-13T18:25:05.101 INFO:teuthology.orchestra.run.smithi044.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-09-13T18:25:05.106 INFO:teuthology.orchestra.run.smithi044.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-09-13T18:25:05.107 INFO:teuthology.orchestra.run.smithi044.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-09-13T18:25:05.108 INFO:teuthology.orchestra.run.smithi044.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-09-13T18:25:05.109 INFO:teuthology.orchestra.run.smithi044.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-09-13T18:25:05.124 INFO:teuthology.orchestra.run.smithi044.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-09-13T18:25:05.124 INFO:teuthology.orchestra.run.smithi044.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-09-13T18:25:05.129 INFO:teuthology.orchestra.run.smithi044.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.20-0ubuntu0.20.04.1 [117 kB] 2024-09-13T18:25:05.131 INFO:teuthology.orchestra.run.smithi044.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-09-13T18:25:05.139 INFO:teuthology.orchestra.run.smithi044.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-09-13T18:25:05.140 INFO:teuthology.orchestra.run.smithi044.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-09-13T18:25:05.151 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-09-13T18:25:05.152 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-09-13T18:25:05.153 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-09-13T18:25:05.153 INFO:teuthology.orchestra.run.smithi044.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-09-13T18:25:05.154 INFO:teuthology.orchestra.run.smithi044.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-09-13T18:25:05.159 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-09-13T18:25:05.160 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-09-13T18:25:05.161 INFO:teuthology.orchestra.run.smithi044.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-09-13T18:25:05.171 INFO:teuthology.orchestra.run.smithi044.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-09-13T18:25:05.177 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-09-13T18:25:05.177 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-09-13T18:25:05.178 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-09-13T18:25:05.180 INFO:teuthology.orchestra.run.smithi099.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-09-13T18:25:05.180 INFO:teuthology.orchestra.run.smithi099.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-09-13T18:25:05.186 INFO:teuthology.orchestra.run.smithi099.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-09-13T18:25:05.187 INFO:teuthology.orchestra.run.smithi099.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-09-13T18:25:05.187 INFO:teuthology.orchestra.run.smithi044.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-09-13T18:25:05.188 INFO:teuthology.orchestra.run.smithi099.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-09-13T18:25:05.188 INFO:teuthology.orchestra.run.smithi099.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-09-13T18:25:05.189 INFO:teuthology.orchestra.run.smithi044.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-09-13T18:25:05.190 INFO:teuthology.orchestra.run.smithi044.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-09-13T18:25:05.190 INFO:teuthology.orchestra.run.smithi044.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2024-09-13T18:25:05.191 INFO:teuthology.orchestra.run.smithi044.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.20-0ubuntu0.20.04.1 [1,055 kB] 2024-09-13T18:25:05.200 INFO:teuthology.orchestra.run.smithi044.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2024-09-13T18:25:05.202 INFO:teuthology.orchestra.run.smithi044.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.20-0ubuntu0.20.04.1 [13.5 MB] 2024-09-13T18:25:05.203 INFO:teuthology.orchestra.run.smithi099.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-09-13T18:25:05.204 INFO:teuthology.orchestra.run.smithi099.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-09-13T18:25:05.209 INFO:teuthology.orchestra.run.smithi099.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.20-0ubuntu0.20.04.1 [117 kB] 2024-09-13T18:25:05.211 INFO:teuthology.orchestra.run.smithi099.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-09-13T18:25:05.218 INFO:teuthology.orchestra.run.smithi099.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-09-13T18:25:05.218 INFO:teuthology.orchestra.run.smithi099.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-09-13T18:25:05.233 INFO:teuthology.orchestra.run.smithi099.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-09-13T18:25:05.233 INFO:teuthology.orchestra.run.smithi099.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-09-13T18:25:05.240 INFO:teuthology.orchestra.run.smithi099.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-09-13T18:25:05.251 INFO:teuthology.orchestra.run.smithi099.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-09-13T18:25:05.267 INFO:teuthology.orchestra.run.smithi099.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-09-13T18:25:05.269 INFO:teuthology.orchestra.run.smithi099.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-09-13T18:25:05.270 INFO:teuthology.orchestra.run.smithi099.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-09-13T18:25:05.270 INFO:teuthology.orchestra.run.smithi099.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2024-09-13T18:25:05.271 INFO:teuthology.orchestra.run.smithi099.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.20-0ubuntu0.20.04.1 [1,055 kB] 2024-09-13T18:25:05.280 INFO:teuthology.orchestra.run.smithi099.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2024-09-13T18:25:05.281 INFO:teuthology.orchestra.run.smithi099.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.20-0ubuntu0.20.04.1 [13.5 MB] 2024-09-13T18:25:05.311 INFO:teuthology.orchestra.run.smithi044.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2024-09-13T18:25:05.311 INFO:teuthology.orchestra.run.smithi044.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2024-09-13T18:25:05.379 INFO:teuthology.orchestra.run.smithi044.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2024-09-13T18:25:05.379 INFO:teuthology.orchestra.run.smithi044.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-09-13T18:25:05.379 INFO:teuthology.orchestra.run.smithi044.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-09-13T18:25:05.394 INFO:teuthology.orchestra.run.smithi099.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2024-09-13T18:25:05.394 INFO:teuthology.orchestra.run.smithi099.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2024-09-13T18:25:05.469 INFO:teuthology.orchestra.run.smithi099.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2024-09-13T18:25:05.469 INFO:teuthology.orchestra.run.smithi099.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-09-13T18:25:05.469 INFO:teuthology.orchestra.run.smithi099.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-09-13T18:25:05.810 INFO:teuthology.orchestra.run.smithi044.stdout:Preconfiguring packages ... 2024-09-13T18:25:05.871 INFO:teuthology.orchestra.run.smithi099.stdout:Preconfiguring packages ... 2024-09-13T18:25:06.028 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 25.4 MB in 0s (51.9 MB/s) 2024-09-13T18:25:06.073 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 25.4 MB in 1s (50.7 MB/s) 2024-09-13T18:25:06.285 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153099 files and directories currently installed.) 2024-09-13T18:25:06.289 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:25:06.347 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153099 files and directories currently installed.) 2024-09-13T18:25:06.352 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:25:06.462 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:25:06.515 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:25:07.617 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-09-13T18:25:07.682 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-09-13T18:25:09.054 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153099 files and directories currently installed.) 2024-09-13T18:25:09.059 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:25:09.122 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153099 files and directories currently installed.) 2024-09-13T18:25:09.126 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:25:09.192 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:25:09.256 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:25:09.631 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:25:09.637 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:25:09.798 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:25:09.805 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:25:10.158 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T18:25:10.167 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T18:25:10.600 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153099 files and directories currently installed.) 2024-09-13T18:25:10.605 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:25:10.619 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153099 files and directories currently installed.) 2024-09-13T18:25:10.624 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:25:10.738 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T18:25:10.765 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T18:25:11.227 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:25:11.360 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T18:25:11.810 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T18:25:11.905 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:25:11.915 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-09-13T18:25:12.037 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T18:25:12.394 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-13T18:25:12.411 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-09-13T18:25:12.452 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-09-13T18:25:12.537 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T18:25:12.676 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-09-13T18:25:12.822 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package dump. 2024-09-13T18:25:12.840 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-09-13T18:25:12.880 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking dump (0.4b46-6) ... 2024-09-13T18:25:13.142 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package indent. 2024-09-13T18:25:13.160 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:25:13.205 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-13T18:25:13.217 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T18:25:13.225 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-09-13T18:25:13.263 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-09-13T18:25:13.537 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-13T18:25:13.554 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-09-13T18:25:13.595 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T18:25:13.608 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package dump. 2024-09-13T18:25:13.626 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-09-13T18:25:13.674 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking dump (0.4b46-6) ... 2024-09-13T18:25:13.953 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package indent. 2024-09-13T18:25:13.971 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:25:14.011 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T18:25:14.100 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-13T18:25:14.117 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-09-13T18:25:14.159 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T18:25:14.348 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-13T18:25:14.365 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-09-13T18:25:14.406 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T18:25:14.453 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-13T18:25:14.471 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:25:14.511 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:25:14.734 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-13T18:25:14.753 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-09-13T18:25:14.792 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T18:25:14.873 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-13T18:25:14.891 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:25:14.931 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:25:15.095 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-13T18:25:15.116 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:25:15.154 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:25:15.209 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-13T18:25:15.227 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:25:15.267 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:25:15.549 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-13T18:25:15.566 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:25:15.607 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:25:15.620 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-13T18:25:15.639 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:25:15.678 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:25:15.903 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-13T18:25:15.924 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:25:15.968 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:25:16.085 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-13T18:25:16.100 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-09-13T18:25:16.140 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T18:25:16.254 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-13T18:25:16.273 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:25:16.304 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:25:16.476 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-13T18:25:16.497 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T18:25:16.560 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T18:25:16.657 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-13T18:25:16.677 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-09-13T18:25:16.745 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T18:25:16.929 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-13T18:25:16.947 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../14-libpq5_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:25:16.988 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:25:17.270 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-13T18:25:17.286 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T18:25:17.353 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T18:25:17.357 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-13T18:25:17.375 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:25:17.415 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:25:17.664 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-13T18:25:17.682 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../14-libpq5_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:25:17.714 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:25:17.769 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-13T18:25:17.785 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:25:17.827 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:25:18.071 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-13T18:25:18.088 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T18:25:18.100 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-13T18:25:18.118 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:25:18.129 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:25:18.159 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:25:18.520 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-13T18:25:18.537 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:25:18.578 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:25:18.633 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-13T18:25:18.649 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2024-09-13T18:25:18.691 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-09-13T18:25:18.830 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-13T18:25:18.851 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T18:25:18.880 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:25:19.111 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package modemmanager. 2024-09-13T18:25:19.128 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:25:19.180 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:25:19.392 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-13T18:25:19.410 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2024-09-13T18:25:19.451 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-09-13T18:25:19.797 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package modemmanager. 2024-09-13T18:25:19.817 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:25:19.861 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:25:20.129 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package wpasupplicant. 2024-09-13T18:25:20.148 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-09-13T18:25:20.187 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T18:25:20.502 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package wpasupplicant. 2024-09-13T18:25:20.519 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-09-13T18:25:20.585 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T18:25:20.725 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package network-manager. 2024-09-13T18:25:20.745 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T18:25:20.810 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T18:25:21.123 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package network-manager. 2024-09-13T18:25:21.142 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T18:25:21.207 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T18:25:21.574 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ppp. 2024-09-13T18:25:21.592 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-09-13T18:25:21.867 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T18:25:21.914 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ppp. 2024-09-13T18:25:21.931 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-09-13T18:25:22.200 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T18:25:22.221 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package pptp-linux. 2024-09-13T18:25:22.239 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-09-13T18:25:22.279 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-09-13T18:25:22.658 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-13T18:25:22.675 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-09-13T18:25:22.721 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package pptp-linux. 2024-09-13T18:25:22.733 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-09-13T18:25:22.741 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-09-13T18:25:22.779 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-09-13T18:25:23.036 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-13T18:25:23.053 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2024-09-13T18:25:23.094 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2024-09-13T18:25:23.158 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-13T18:25:23.177 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-09-13T18:25:23.234 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-09-13T18:25:23.424 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package postgresql-client-12. 2024-09-13T18:25:23.442 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../26-postgresql-client-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:25:23.482 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:25:23.561 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-13T18:25:23.578 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2024-09-13T18:25:23.619 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2024-09-13T18:25:23.948 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package postgresql-client-12. 2024-09-13T18:25:23.966 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../26-postgresql-client-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:25:24.006 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:25:24.095 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package postgresql-common. 2024-09-13T18:25:24.115 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2024-09-13T18:25:24.178 INFO:teuthology.orchestra.run.smithi099.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-13T18:25:24.205 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2024-09-13T18:25:24.620 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package postgresql-common. 2024-09-13T18:25:24.638 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2024-09-13T18:25:24.701 INFO:teuthology.orchestra.run.smithi044.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-13T18:25:24.752 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2024-09-13T18:25:24.938 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package postgresql-12. 2024-09-13T18:25:24.956 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../28-postgresql-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:25:24.999 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:25:25.252 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package postgresql-12. 2024-09-13T18:25:25.273 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../28-postgresql-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:25:25.313 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:25:26.616 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package postgresql. 2024-09-13T18:25:26.638 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2024-09-13T18:25:26.683 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2024-09-13T18:25:26.935 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package postgresql-client. 2024-09-13T18:25:26.948 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package postgresql. 2024-09-13T18:25:26.954 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2024-09-13T18:25:26.967 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2024-09-13T18:25:27.005 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2024-09-13T18:25:27.018 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2024-09-13T18:25:27.257 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package postgresql-client. 2024-09-13T18:25:27.262 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-13T18:25:27.277 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2024-09-13T18:25:27.279 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2024-09-13T18:25:27.315 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2024-09-13T18:25:27.320 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T18:25:27.590 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-13T18:25:27.608 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2024-09-13T18:25:27.609 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-13T18:25:27.629 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2024-09-13T18:25:27.648 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-09-13T18:25:27.667 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T18:25:27.911 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-13T18:25:27.929 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2024-09-13T18:25:27.969 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-09-13T18:25:28.018 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-13T18:25:28.038 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-09-13T18:25:28.112 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T18:25:28.381 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-13T18:25:28.399 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-09-13T18:25:28.423 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2024-09-13T18:25:28.475 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T18:25:28.682 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:25:28.785 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2024-09-13T18:25:28.992 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:25:29.037 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:25:29.118 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-09-13T18:25:29.269 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T18:25:29.372 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:25:29.396 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T18:25:29.498 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-09-13T18:25:29.624 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T18:25:29.750 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T18:25:29.792 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T18:25:29.792 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T18:25:30.161 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T18:25:30.161 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T18:25:30.382 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:25:30.637 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:25:31.263 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-13T18:25:31.380 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T18:25:31.506 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-09-13T18:25:31.544 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-13T18:25:31.632 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2024-09-13T18:25:31.659 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T18:25:31.785 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-09-13T18:25:31.894 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2024-09-13T18:25:32.695 INFO:teuthology.orchestra.run.smithi099.stdout:Adding user postgres to group ssl-cert 2024-09-13T18:25:32.953 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:32.954 INFO:teuthology.orchestra.run.smithi099.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-13T18:25:33.224 INFO:teuthology.orchestra.run.smithi099.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-13T18:25:33.224 INFO:teuthology.orchestra.run.smithi099.stdout:Removing obsolete dictionary files: 2024-09-13T18:25:33.516 INFO:teuthology.orchestra.run.smithi044.stdout:Adding user postgres to group ssl-cert 2024-09-13T18:25:33.564 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-13T18:25:33.798 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:33.798 INFO:teuthology.orchestra.run.smithi044.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-13T18:25:34.058 INFO:teuthology.orchestra.run.smithi044.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-13T18:25:34.058 INFO:teuthology.orchestra.run.smithi044.stdout:Removing obsolete dictionary files: 2024-09-13T18:25:34.320 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:25:34.400 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-13T18:25:34.446 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-09-13T18:25:34.572 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T18:25:34.723 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T18:25:35.172 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:25:35.325 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-09-13T18:25:35.450 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T18:25:35.584 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T18:25:36.028 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-09-13T18:25:36.254 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up dump (0.4b46-6) ... 2024-09-13T18:25:36.351 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-13T18:25:36.447 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:25:36.549 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-09-13T18:25:36.573 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T18:25:36.699 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T18:25:36.790 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up dump (0.4b46-6) ... 2024-09-13T18:25:36.825 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T18:25:36.887 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-13T18:25:36.952 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:25:37.035 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T18:25:37.094 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T18:25:37.161 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:25:37.212 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T18:25:37.338 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T18:25:37.532 INFO:teuthology.orchestra.run.smithi099.stdout:Creating new PostgreSQL cluster 12/main ... 2024-09-13T18:25:37.544 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2024-09-13T18:25:37.556 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T18:25:37.595 INFO:teuthology.orchestra.run.smithi099.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-13T18:25:37.595 INFO:teuthology.orchestra.run.smithi099.stdout:This user must also own the server process. 2024-09-13T18:25:37.595 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:37.595 INFO:teuthology.orchestra.run.smithi099.stdout:The database cluster will be initialized with locale "en_US". 2024-09-13T18:25:37.595 INFO:teuthology.orchestra.run.smithi099.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-13T18:25:37.595 INFO:teuthology.orchestra.run.smithi099.stdout:The default text search configuration will be set to "english". 2024-09-13T18:25:37.595 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:37.595 INFO:teuthology.orchestra.run.smithi099.stdout:Data page checksums are disabled. 2024-09-13T18:25:37.595 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:37.596 INFO:teuthology.orchestra.run.smithi099.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2024-09-13T18:25:37.596 INFO:teuthology.orchestra.run.smithi099.stdout:creating subdirectories ... ok 2024-09-13T18:25:37.596 INFO:teuthology.orchestra.run.smithi099.stdout:selecting dynamic shared memory implementation ... posix 2024-09-13T18:25:37.612 INFO:teuthology.orchestra.run.smithi099.stdout:selecting default max_connections ... 100 2024-09-13T18:25:37.632 INFO:teuthology.orchestra.run.smithi099.stdout:selecting default shared_buffers ... 128MB 2024-09-13T18:25:37.647 INFO:teuthology.orchestra.run.smithi099.stdout:selecting default time zone ... Etc/UTC 2024-09-13T18:25:37.647 INFO:teuthology.orchestra.run.smithi099.stdout:creating configuration files ... ok 2024-09-13T18:25:37.682 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:25:37.752 INFO:teuthology.orchestra.run.smithi099.stdout:running bootstrap script ... ok 2024-09-13T18:25:38.053 INFO:teuthology.orchestra.run.smithi044.stdout:Creating new PostgreSQL cluster 12/main ... 2024-09-13T18:25:38.070 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2024-09-13T18:25:38.137 INFO:teuthology.orchestra.run.smithi044.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-13T18:25:38.138 INFO:teuthology.orchestra.run.smithi044.stdout:This user must also own the server process. 2024-09-13T18:25:38.138 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:38.138 INFO:teuthology.orchestra.run.smithi044.stdout:The database cluster will be initialized with locale "en_US". 2024-09-13T18:25:38.138 INFO:teuthology.orchestra.run.smithi044.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-13T18:25:38.138 INFO:teuthology.orchestra.run.smithi044.stdout:The default text search configuration will be set to "english". 2024-09-13T18:25:38.138 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:38.138 INFO:teuthology.orchestra.run.smithi044.stdout:Data page checksums are disabled. 2024-09-13T18:25:38.138 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:38.138 INFO:teuthology.orchestra.run.smithi044.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2024-09-13T18:25:38.138 INFO:teuthology.orchestra.run.smithi044.stdout:creating subdirectories ... ok 2024-09-13T18:25:38.138 INFO:teuthology.orchestra.run.smithi044.stdout:selecting dynamic shared memory implementation ... posix 2024-09-13T18:25:38.155 INFO:teuthology.orchestra.run.smithi044.stdout:selecting default max_connections ... 100 2024-09-13T18:25:38.181 INFO:teuthology.orchestra.run.smithi044.stdout:selecting default shared_buffers ... 128MB 2024-09-13T18:25:38.188 INFO:teuthology.orchestra.run.smithi044.stdout:selecting default time zone ... Etc/UTC 2024-09-13T18:25:38.189 INFO:teuthology.orchestra.run.smithi044.stdout:creating configuration files ... ok 2024-09-13T18:25:38.297 INFO:teuthology.orchestra.run.smithi044.stdout:running bootstrap script ... ok 2024-09-13T18:25:38.319 INFO:teuthology.orchestra.run.smithi099.stdout:performing post-bootstrap initialization ... ok 2024-09-13T18:25:39.030 INFO:teuthology.orchestra.run.smithi044.stdout:performing post-bootstrap initialization ... ok 2024-09-13T18:25:39.035 INFO:teuthology.orchestra.run.smithi099.stdout:syncing data to disk ... ok 2024-09-13T18:25:39.035 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:39.035 INFO:teuthology.orchestra.run.smithi099.stdout:Success. You can now start the database server using: 2024-09-13T18:25:39.035 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:39.036 INFO:teuthology.orchestra.run.smithi099.stdout: pg_ctlcluster 12 main start 2024-09-13T18:25:39.036 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:39.359 INFO:teuthology.orchestra.run.smithi099.stdout:Ver Cluster Port Status Owner Data directory Log file 2024-09-13T18:25:39.359 INFO:teuthology.orchestra.run.smithi099.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2024-09-13T18:25:39.445 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-13T18:25:39.700 INFO:teuthology.orchestra.run.smithi044.stdout:syncing data to disk ... ok 2024-09-13T18:25:39.700 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:39.700 INFO:teuthology.orchestra.run.smithi044.stdout:Success. You can now start the database server using: 2024-09-13T18:25:39.700 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:39.701 INFO:teuthology.orchestra.run.smithi044.stdout: pg_ctlcluster 12 main start 2024-09-13T18:25:39.701 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:40.047 INFO:teuthology.orchestra.run.smithi044.stdout:Ver Cluster Port Status Owner Data directory Log file 2024-09-13T18:25:40.047 INFO:teuthology.orchestra.run.smithi044.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2024-09-13T18:25:40.132 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-13T18:25:42.510 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:25:42.627 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:25:42.753 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-09-13T18:25:42.955 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:25:43.081 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2024-09-13T18:25:43.181 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:25:43.207 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T18:25:43.308 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:25:43.458 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-09-13T18:25:43.634 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:25:43.761 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2024-09-13T18:25:43.887 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T18:25:43.935 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:43.935 INFO:teuthology.orchestra.run.smithi099.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-13T18:25:43.935 INFO:teuthology.orchestra.run.smithi099.stdout:which means they are currently configured by ifupdown: 2024-09-13T18:25:43.935 INFO:teuthology.orchestra.run.smithi099.stdout:- enp3s0f1 2024-09-13T18:25:43.935 INFO:teuthology.orchestra.run.smithi099.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-13T18:25:43.935 INFO:teuthology.orchestra.run.smithi099.stdout:remove their configuration from /etc/network/interfaces. 2024-09-13T18:25:43.935 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:44.088 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-13T18:25:44.404 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-13T18:25:44.555 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:44.556 INFO:teuthology.orchestra.run.smithi044.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-13T18:25:44.556 INFO:teuthology.orchestra.run.smithi044.stdout:which means they are currently configured by ifupdown: 2024-09-13T18:25:44.556 INFO:teuthology.orchestra.run.smithi044.stdout:- ens1f0 2024-09-13T18:25:44.556 INFO:teuthology.orchestra.run.smithi044.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-13T18:25:44.556 INFO:teuthology.orchestra.run.smithi044.stdout:remove their configuration from /etc/network/interfaces. 2024-09-13T18:25:44.556 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:44.719 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-13T18:25:44.957 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-13T18:25:45.026 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-13T18:25:45.427 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:25:45.570 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-09-13T18:25:45.570 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-13T18:25:45.738 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:25:45.864 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T18:25:45.990 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2024-09-13T18:25:46.056 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:25:46.116 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:25:46.224 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-09-13T18:25:46.250 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:25:46.367 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:25:46.401 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:25:46.493 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T18:25:46.644 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2024-09-13T18:25:46.670 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T18:25:46.670 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T18:25:46.753 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:25:46.879 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:25:47.030 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:25:47.154 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-09-13T18:25:47.255 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-13T18:25:47.324 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T18:25:47.324 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T18:25:47.406 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T18:25:47.558 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T18:25:47.843 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T18:25:47.900 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-09-13T18:25:48.001 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-13T18:25:48.127 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T18:25:48.287 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T18:25:48.613 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T18:25:55.047 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-09-13T18:25:55.155 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-09-13T18:25:56.061 INFO:teuthology.orchestra.run.smithi099.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T18:25:56.067 DEBUG:teuthology.parallel:result is None 2024-09-13T18:25:56.101 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-09-13T18:25:56.201 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-09-13T18:25:57.074 INFO:teuthology.orchestra.run.smithi044.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T18:25:57.079 DEBUG:teuthology.parallel:result is None 2024-09-13T18:25:57.080 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:25:57.238 DEBUG:teuthology.orchestra.run.smithi044:> dpkg-query -W -f '${Version}' ceph 2024-09-13T18:25:57.263 INFO:teuthology.orchestra.run.smithi044.stdout:18.2.4-860-g6c6b083f-1focal 2024-09-13T18:25:57.264 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860-g6c6b083f-1focal 2024-09-13T18:25:57.264 INFO:teuthology.task.install:The correct ceph version 18.2.4-860-g6c6b083f-1focal is installed. 2024-09-13T18:25:57.266 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:25:57.413 DEBUG:teuthology.orchestra.run.smithi099:> dpkg-query -W -f '${Version}' ceph 2024-09-13T18:25:57.437 INFO:teuthology.orchestra.run.smithi099.stdout:18.2.4-860-g6c6b083f-1focal 2024-09-13T18:25:57.437 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860-g6c6b083f-1focal 2024-09-13T18:25:57.438 INFO:teuthology.task.install:The correct ceph version 18.2.4-860-g6c6b083f-1focal is installed. 2024-09-13T18:25:57.439 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T18:25:57.440 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:25:57.440 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:25:57.457 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:25:57.457 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:25:57.474 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T18:25:57.474 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:25:57.475 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:25:57.489 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:25:57.543 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:25:57.543 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:25:57.560 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:25:57.569 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T18:25:57.570 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:25:57.570 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:25:57.586 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:25:57.596 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:25:57.596 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:25:57.610 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:25:57.667 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T18:25:57.668 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:25:57.668 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:25:57.682 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:25:57.696 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:25:57.696 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:25:57.711 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:25:57.770 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T18:25:57.845 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T18:25:57.846 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 777 /var/log/ceph 2024-09-13T18:25:57.848 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /var/log/ceph 2024-09-13T18:25:57.863 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T18:25:57.863 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T18:25:57.907 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T18:25:57.922 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T18:25:57.922 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T18:25:57.925 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T18:25:57.984 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-13T18:25:57.984 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-13T18:25:57.984 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-13T18:25:57.985 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:25:57.985 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T18:25:57.992 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T18:25:58.028 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:25:58.028 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T18:25:58.035 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T18:25:58.120 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T18:25:58.120 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'bad backtrace on directory inode', 'error reading table object', 'Metadata damage detected', 'slow requests are blocked', 'Behind on trimming', 'error reading sessionmap'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T18:25:58.120 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903979', 'branch': 'wip-rishabh-testing-20240910.100730-reef', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/journal-repair}', 'email': None, 'first_in_suite': False, 'job_id': '7903979', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240910.100730-reef'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'bad backtrace on directory inode', 'error reading table object', 'Metadata damage detected', 'slow requests are blocked', 'Behind on trimming', 'error reading sessionmap'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240910.100730-reef', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6439, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'sleep_before_teardown': 0, 'subset': '964/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240910.100730-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi044.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi099.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'bad backtrace on directory inode', 'error reading table object', 'Metadata damage detected', 'slow requests are blocked', 'Behind on trimming', 'error reading sessionmap'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_journal_repair']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_14:42:16', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T18:25:58.121 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T18:25:58.123 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T18:25:58.129 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T18:25:58.175 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T18:25:58.191 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:25:58.191 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:25:58.197 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:25:58.197 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_1 2024-09-13T18:25:58.245 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:25:58.245 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:25:58.245 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 6h/6d Inode: 360 Links: 1 2024-09-13T18:25:58.245 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:25:58.245 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-13 18:21:31.609644888 +0000 2024-09-13T18:25:58.245 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-13 18:21:31.397649765 +0000 2024-09-13T18:25:58.245 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-13 18:21:31.397649765 +0000 2024-09-13T18:25:58.245 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: - 2024-09-13T18:25:58.246 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:25:58.259 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-13T18:25:58.259 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-13T18:25:58.259 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000424808 s, 1.2 MB/s 2024-09-13T18:25:58.260 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:25:58.273 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_2 2024-09-13T18:25:58.321 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:25:58.321 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:25:58.321 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 6h/6d Inode: 367 Links: 1 2024-09-13T18:25:58.321 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:25:58.322 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-13 18:21:32.057634581 +0000 2024-09-13T18:25:58.322 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-13 18:21:31.821640009 +0000 2024-09-13T18:25:58.322 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-13 18:21:31.821640009 +0000 2024-09-13T18:25:58.322 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: - 2024-09-13T18:25:58.322 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:25:58.335 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-13T18:25:58.335 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-13T18:25:58.335 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000399458 s, 1.3 MB/s 2024-09-13T18:25:58.337 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:25:58.390 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_3 2024-09-13T18:25:58.397 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:25:58.398 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:25:58.398 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 6h/6d Inode: 373 Links: 1 2024-09-13T18:25:58.398 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:25:58.398 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-13 18:21:32.513624089 +0000 2024-09-13T18:25:58.398 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-13 18:21:32.285629335 +0000 2024-09-13T18:25:58.398 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-13 18:21:32.285629335 +0000 2024-09-13T18:25:58.398 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: - 2024-09-13T18:25:58.398 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:25:58.412 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-13T18:25:58.412 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-13T18:25:58.412 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000399692 s, 1.3 MB/s 2024-09-13T18:25:58.413 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:25:58.463 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_4 2024-09-13T18:25:58.470 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:25:58.470 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:25:58.470 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 6h/6d Inode: 377 Links: 1 2024-09-13T18:25:58.470 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:25:58.470 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-13 18:21:32.917614795 +0000 2024-09-13T18:25:58.470 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-13 18:21:32.729619119 +0000 2024-09-13T18:25:58.470 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-13 18:21:32.729619119 +0000 2024-09-13T18:25:58.470 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: - 2024-09-13T18:25:58.471 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:25:58.482 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-13T18:25:58.482 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-13T18:25:58.483 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000373839 s, 1.4 MB/s 2024-09-13T18:25:58.484 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:25:58.538 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:25:58.538 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:25:58.538 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:25:58.546 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:25:58.546 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 2024-09-13T18:25:58.553 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:25:58.553 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:25:58.553 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 6h/6d Inode: 369 Links: 1 2024-09-13T18:25:58.553 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:25:58.554 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-13 18:21:26.810327198 +0000 2024-09-13T18:25:58.554 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-13 18:21:26.618331624 +0000 2024-09-13T18:25:58.554 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-13 18:21:26.618331624 +0000 2024-09-13T18:25:58.554 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-09-13T18:25:58.554 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:25:58.565 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-13T18:25:58.565 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-13T18:25:58.565 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000426378 s, 1.2 MB/s 2024-09-13T18:25:58.566 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:25:58.573 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 2024-09-13T18:25:58.622 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:25:58.622 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:25:58.623 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 6h/6d Inode: 375 Links: 1 2024-09-13T18:25:58.623 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:25:58.623 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-13 18:21:27.266316687 +0000 2024-09-13T18:25:58.623 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-13 18:21:27.054321574 +0000 2024-09-13T18:25:58.623 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-13 18:21:27.054321574 +0000 2024-09-13T18:25:58.623 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-09-13T18:25:58.623 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:25:58.639 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-13T18:25:58.639 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-13T18:25:58.639 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000391338 s, 1.3 MB/s 2024-09-13T18:25:58.639 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:25:58.647 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 2024-09-13T18:25:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:25:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:25:58.694 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 6h/6d Inode: 384 Links: 1 2024-09-13T18:25:58.694 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:25:58.695 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-13 18:21:27.510311063 +0000 2024-09-13T18:25:58.695 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-13 18:21:27.506311156 +0000 2024-09-13T18:25:58.695 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-13 18:21:27.506311156 +0000 2024-09-13T18:25:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-09-13T18:25:58.695 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:25:58.705 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-13T18:25:58.706 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-13T18:25:58.706 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000423301 s, 1.2 MB/s 2024-09-13T18:25:58.707 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:25:58.715 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 2024-09-13T18:25:58.770 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:25:58.770 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:25:58.770 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 6h/6d Inode: 388 Links: 1 2024-09-13T18:25:58.770 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:25:58.771 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-13 18:21:28.118297049 +0000 2024-09-13T18:25:58.771 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-13 18:21:27.914301751 +0000 2024-09-13T18:25:58.771 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-13 18:21:27.914301751 +0000 2024-09-13T18:25:58.771 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-09-13T18:25:58.771 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:25:58.784 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-13T18:25:58.784 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-13T18:25:58.784 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000364155 s, 1.4 MB/s 2024-09-13T18:25:58.785 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:25:58.794 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:25:58.794 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi044.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T18:25:58.794 INFO:tasks.ceph:Generating config... 2024-09-13T18:25:58.795 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-13T18:25:58.795 INFO:tasks.ceph:[client] debug client = 20 2024-09-13T18:25:58.795 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T18:25:58.795 INFO:tasks.ceph:[client] pid file = 2024-09-13T18:25:58.796 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-13T18:25:58.796 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-13T18:25:58.796 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-13T18:25:58.796 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-13T18:25:58.796 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-13T18:25:58.796 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-13T18:25:58.796 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-13T18:25:58.796 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-13T18:25:58.796 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-13T18:25:58.796 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-13T18:25:58.796 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-13T18:25:58.796 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-13T18:25:58.796 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-13T18:25:58.797 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T18:25:58.797 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T18:25:58.797 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T18:25:58.797 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T18:25:58.797 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T18:25:58.797 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-13T18:25:58.797 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-13T18:25:58.797 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-13T18:25:58.797 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-13T18:25:58.797 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-13T18:25:58.797 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T18:25:58.797 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T18:25:58.797 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-13T18:25:58.797 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-13T18:25:58.798 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T18:25:58.798 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T18:25:58.798 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-13T18:25:58.798 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T18:25:58.798 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T18:25:58.798 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T18:25:58.798 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T18:25:58.798 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T18:25:58.798 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-13T18:25:58.798 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T18:25:58.798 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T18:25:58.840 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T18:25:58.854 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T18:25:58.895 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:25:58.953 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.44'), ('mon.b', '172.21.15.99'), ('mon.c', '[v2:172.21.15.99:3301,v1:172.21.15.99:6790]')] 2024-09-13T18:25:58.954 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.44,172.21.15.99,[v2:172.21.15.99:3301,v1:172.21.15.99:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-13T18:25:58.955 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:25:58.955 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T18:25:58.960 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.44 --add b 172.21.15.99 --addv c '[v2:172.21.15.99:3301,v1:172.21.15.99:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:25:59.048 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:25:59.048 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: generated fsid c8e1d12d-7fb9-4a33-982e-b895bb77262c 2024-09-13T18:25:59.048 INFO:teuthology.orchestra.run.smithi044.stdout:setting min_mon_release = pacific 2024-09-13T18:25:59.048 INFO:teuthology.orchestra.run.smithi044.stdout:epoch 0 2024-09-13T18:25:59.048 INFO:teuthology.orchestra.run.smithi044.stdout:fsid c8e1d12d-7fb9-4a33-982e-b895bb77262c 2024-09-13T18:25:59.048 INFO:teuthology.orchestra.run.smithi044.stdout:last_changed 2024-09-13T18:25:59.046824+0000 2024-09-13T18:25:59.048 INFO:teuthology.orchestra.run.smithi044.stdout:created 2024-09-13T18:25:59.046824+0000 2024-09-13T18:25:59.048 INFO:teuthology.orchestra.run.smithi044.stdout:min_mon_release 16 (pacific) 2024-09-13T18:25:59.049 INFO:teuthology.orchestra.run.smithi044.stdout:election_strategy: 1 2024-09-13T18:25:59.049 INFO:teuthology.orchestra.run.smithi044.stdout:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-13T18:25:59.049 INFO:teuthology.orchestra.run.smithi044.stdout:1: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.b 2024-09-13T18:25:59.049 INFO:teuthology.orchestra.run.smithi044.stdout:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-13T18:25:59.049 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-13T18:25:59.050 DEBUG:teuthology.orchestra.run.smithi044:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T18:25:59.055 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c8e1d12d-7fb9-4a33-982e-b895bb77262c... 2024-09-13T18:25:59.056 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T18:25:59.059 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T18:25:59.089 INFO:teuthology.orchestra.run.smithi044.stdout:[global] 2024-09-13T18:25:59.089 INFO:teuthology.orchestra.run.smithi044.stdout: chdir = "" 2024-09-13T18:25:59.089 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T18:25:59.089 INFO:teuthology.orchestra.run.smithi044.stdout: auth supported = cephx 2024-09-13T18:25:59.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.089 INFO:teuthology.orchestra.run.smithi044.stdout: filestore xattr use omap = true 2024-09-13T18:25:59.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: mon clock drift allowed = 1.000 2024-09-13T18:25:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: osd crush chooseleaf type = 0 2024-09-13T18:25:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: auth debug = true 2024-09-13T18:25:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on old message = true 2024-09-13T18:25:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on bug = true 2024-09-13T18:25:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T18:25:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: mon pg warn max object skew = 0 2024-09-13T18:25:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T18:25:59.090 INFO:teuthology.orchestra.run.smithi044.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T18:25:59.091 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.091 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default size = 2 2024-09-13T18:25:59.091 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.091 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow primary affinity = true 2024-09-13T18:25:59.091 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow pg remap = true 2024-09-13T18:25:59.091 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on legacy crush tunables = false 2024-09-13T18:25:59.091 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on crush straw calc version zero = false 2024-09-13T18:25:59.091 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on no sortbitwise = false 2024-09-13T18:25:59.091 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on osd down out interval zero = false 2024-09-13T18:25:59.091 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on too few osds = false 2024-09-13T18:25:59.091 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T18:25:59.091 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T18:25:59.091 INFO:teuthology.orchestra.run.smithi044.stdout: mon_allow_pool_size_one = true 2024-09-13T18:25:59.091 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.092 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T18:25:59.092 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.092 INFO:teuthology.orchestra.run.smithi044.stdout: osd default data pool replay window = 5 2024-09-13T18:25:59.092 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.092 INFO:teuthology.orchestra.run.smithi044.stdout: mon allow pool delete = true 2024-09-13T18:25:59.092 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.092 INFO:teuthology.orchestra.run.smithi044.stdout: mon cluster log file level = debug 2024-09-13T18:25:59.092 INFO:teuthology.orchestra.run.smithi044.stdout: debug asserts on shutdown = true 2024-09-13T18:25:59.092 INFO:teuthology.orchestra.run.smithi044.stdout: mon health detail to clog = false 2024-09-13T18:25:59.092 INFO:teuthology.orchestra.run.smithi044.stdout: mon host = "172.21.15.44,172.21.15.99,[v2:172.21.15.99:3301,v1:172.21.15.99:6790]" 2024-09-13T18:25:59.092 INFO:teuthology.orchestra.run.smithi044.stdout: fsid = c8e1d12d-7fb9-4a33-982e-b895bb77262c 2024-09-13T18:25:59.092 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.092 INFO:teuthology.orchestra.run.smithi044.stdout:[osd] 2024-09-13T18:25:59.093 INFO:teuthology.orchestra.run.smithi044.stdout: osd journal size = 100 2024-09-13T18:25:59.093 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.093 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub load threshold = 5.0 2024-09-13T18:25:59.093 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub max interval = 600 2024-09-13T18:25:59.093 INFO:teuthology.orchestra.run.smithi044.stdout: osd mclock profile = high_recovery_ops 2024-09-13T18:25:59.093 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.093 INFO:teuthology.orchestra.run.smithi044.stdout: osd recover clone overlap = true 2024-09-13T18:25:59.093 INFO:teuthology.orchestra.run.smithi044.stdout: osd recovery max chunk = 1048576 2024-09-13T18:25:59.093 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.093 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug shutdown = true 2024-09-13T18:25:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug op order = true 2024-09-13T18:25:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug verify stray on activate = true 2024-09-13T18:25:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: osd open classes on start = true 2024-09-13T18:25:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug pg log writeout = true 2024-09-13T18:25:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: osd deep scrub update digest min age = 30 2024-09-13T18:25:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: osd map max advance = 10 2024-09-13T18:25:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: journal zero on create = true 2024-09-13T18:25:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.094 INFO:teuthology.orchestra.run.smithi044.stdout: filestore ondisk finisher threads = 3 2024-09-13T18:25:59.095 INFO:teuthology.orchestra.run.smithi044.stdout: filestore apply finisher threads = 3 2024-09-13T18:25:59.095 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.095 INFO:teuthology.orchestra.run.smithi044.stdout: bdev debug aio = true 2024-09-13T18:25:59.095 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug misdirected ops = true 2024-09-13T18:25:59.095 INFO:teuthology.orchestra.run.smithi044.stdout: bdev async discard = True 2024-09-13T18:25:59.095 INFO:teuthology.orchestra.run.smithi044.stdout: bdev enable discard = True 2024-09-13T18:25:59.095 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore allocator = bitmap 2024-09-13T18:25:59.095 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore block size = 96636764160 2024-09-13T18:25:59.095 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore fsck on mount = True 2024-09-13T18:25:59.095 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluefs = 1/20 2024-09-13T18:25:59.095 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluestore = 1/20 2024-09-13T18:25:59.095 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-13T18:25:59.095 INFO:teuthology.orchestra.run.smithi044.stdout: debug osd = 20 2024-09-13T18:25:59.096 INFO:teuthology.orchestra.run.smithi044.stdout: debug rocksdb = 4/10 2024-09-13T18:25:59.096 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T18:25:59.096 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd full ratio = 0.9 2024-09-13T18:25:59.096 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd nearfull ratio = 0.8 2024-09-13T18:25:59.096 INFO:teuthology.orchestra.run.smithi044.stdout: osd failsafe full ratio = 0.95 2024-09-13T18:25:59.096 INFO:teuthology.orchestra.run.smithi044.stdout: osd objectstore = bluestore 2024-09-13T18:25:59.096 INFO:teuthology.orchestra.run.smithi044.stdout: osd op complaint time = 180 2024-09-13T18:25:59.096 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.096 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr] 2024-09-13T18:25:59.096 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-13T18:25:59.096 INFO:teuthology.orchestra.run.smithi044.stdout: debug mgr = 20 2024-09-13T18:25:59.096 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-09-13T18:25:59.096 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-09-13T18:25:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:25:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:25:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: mgr/telemetry/nag = false 2024-09-13T18:25:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: debug client = 20 2024-09-13T18:25:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.097 INFO:teuthology.orchestra.run.smithi044.stdout:[mon] 2024-09-13T18:25:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-13T18:25:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-09-13T18:25:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: debug paxos = 20 2024-09-13T18:25:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-09-13T18:25:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: mon data avail warn = 5 2024-09-13T18:25:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: mon mgr mkfs grace = 240 2024-09-13T18:25:59.097 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:25:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd reporter subtree level = osd 2024-09-13T18:25:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd prime pg temp = true 2024-09-13T18:25:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:25:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T18:25:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T18:25:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T18:25:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T18:25:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T18:25:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T18:25:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: # 1m isn't quite enough 2024-09-13T18:25:59.098 INFO:teuthology.orchestra.run.smithi044.stdout: mon_down_mkfs_grace = 2m 2024-09-13T18:25:59.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.099 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_filestore_osds = false 2024-09-13T18:25:59.099 INFO:teuthology.orchestra.run.smithi044.stdout: mon op complaint time = 120 2024-09-13T18:25:59.099 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on pool no app = False 2024-09-13T18:25:59.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:25:59.099 INFO:teuthology.orchestra.run.smithi044.stdout:[client] 2024-09-13T18:25:59.099 INFO:teuthology.orchestra.run.smithi044.stdout: rgw cache enabled = true 2024-09-13T18:25:59.099 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable ops log = true 2024-09-13T18:25:59.099 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable usage log = true 2024-09-13T18:25:59.099 INFO:teuthology.orchestra.run.smithi044.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T18:25:59.099 INFO:teuthology.orchestra.run.smithi044.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T18:25:59.099 INFO:teuthology.orchestra.run.smithi044.stdout: client mount timeout = 600 2024-09-13T18:25:59.099 INFO:teuthology.orchestra.run.smithi044.stdout: debug client = 20 2024-09-13T18:25:59.099 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-13T18:25:59.100 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = "" 2024-09-13T18:25:59.100 INFO:teuthology.orchestra.run.smithi044.stdout: rados mon op timeout = 900 2024-09-13T18:25:59.100 INFO:teuthology.orchestra.run.smithi044.stdout: rados osd op timeout = 900 2024-09-13T18:25:59.100 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.a] 2024-09-13T18:25:59.100 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.b] 2024-09-13T18:25:59.100 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.c] 2024-09-13T18:25:59.100 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.a] 2024-09-13T18:25:59.100 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.c] 2024-09-13T18:25:59.100 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.b] 2024-09-13T18:25:59.100 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.d] 2024-09-13T18:25:59.100 INFO:teuthology.orchestra.run.smithi044.stdout:[mds] 2024-09-13T18:25:59.100 INFO:teuthology.orchestra.run.smithi044.stdout: debug mds = 20 2024-09-13T18:25:59.100 INFO:teuthology.orchestra.run.smithi044.stdout: debug mds balancer = 20 2024-09-13T18:25:59.100 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-13T18:25:59.101 INFO:teuthology.orchestra.run.smithi044.stdout: mds debug frag = True 2024-09-13T18:25:59.101 INFO:teuthology.orchestra.run.smithi044.stdout: mds debug scatterstat = True 2024-09-13T18:25:59.101 INFO:teuthology.orchestra.run.smithi044.stdout: mds op complaint time = 180 2024-09-13T18:25:59.101 INFO:teuthology.orchestra.run.smithi044.stdout: mds verify scatter = True 2024-09-13T18:25:59.101 INFO:teuthology.orchestra.run.smithi044.stdout: osd op complaint time = 180 2024-09-13T18:25:59.101 INFO:teuthology.orchestra.run.smithi044.stdout: rados mon op timeout = 900 2024-09-13T18:25:59.101 INFO:teuthology.orchestra.run.smithi044.stdout: rados osd op timeout = 900 2024-09-13T18:25:59.102 INFO:teuthology.orchestra.run.smithi099.stdout:[global] 2024-09-13T18:25:59.102 INFO:teuthology.orchestra.run.smithi099.stdout: chdir = "" 2024-09-13T18:25:59.102 INFO:teuthology.orchestra.run.smithi099.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T18:25:59.102 INFO:teuthology.orchestra.run.smithi099.stdout: auth supported = cephx 2024-09-13T18:25:59.102 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.102 INFO:teuthology.orchestra.run.smithi099.stdout: filestore xattr use omap = true 2024-09-13T18:25:59.102 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.102 INFO:teuthology.orchestra.run.smithi099.stdout: mon clock drift allowed = 1.000 2024-09-13T18:25:59.102 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.102 INFO:teuthology.orchestra.run.smithi099.stdout: osd crush chooseleaf type = 0 2024-09-13T18:25:59.102 INFO:teuthology.orchestra.run.smithi099.stdout: auth debug = true 2024-09-13T18:25:59.102 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.103 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on old message = true 2024-09-13T18:25:59.103 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on bug = true 2024-09-13T18:25:59.103 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.103 INFO:teuthology.orchestra.run.smithi099.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T18:25:59.103 INFO:teuthology.orchestra.run.smithi099.stdout: mon pg warn max object skew = 0 2024-09-13T18:25:59.103 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.103 INFO:teuthology.orchestra.run.smithi099.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T18:25:59.103 INFO:teuthology.orchestra.run.smithi099.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T18:25:59.103 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.103 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default size = 2 2024-09-13T18:25:59.103 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.103 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow primary affinity = true 2024-09-13T18:25:59.103 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow pg remap = true 2024-09-13T18:25:59.103 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on legacy crush tunables = false 2024-09-13T18:25:59.104 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on crush straw calc version zero = false 2024-09-13T18:25:59.104 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on no sortbitwise = false 2024-09-13T18:25:59.104 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on osd down out interval zero = false 2024-09-13T18:25:59.104 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on too few osds = false 2024-09-13T18:25:59.104 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T18:25:59.104 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T18:25:59.104 INFO:teuthology.orchestra.run.smithi099.stdout: mon_allow_pool_size_one = true 2024-09-13T18:25:59.104 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.104 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T18:25:59.104 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.104 INFO:teuthology.orchestra.run.smithi099.stdout: osd default data pool replay window = 5 2024-09-13T18:25:59.104 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.104 INFO:teuthology.orchestra.run.smithi099.stdout: mon allow pool delete = true 2024-09-13T18:25:59.105 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.105 INFO:teuthology.orchestra.run.smithi099.stdout: mon cluster log file level = debug 2024-09-13T18:25:59.105 INFO:teuthology.orchestra.run.smithi099.stdout: debug asserts on shutdown = true 2024-09-13T18:25:59.105 INFO:teuthology.orchestra.run.smithi099.stdout: mon health detail to clog = false 2024-09-13T18:25:59.105 INFO:teuthology.orchestra.run.smithi099.stdout: mon host = "172.21.15.44,172.21.15.99,[v2:172.21.15.99:3301,v1:172.21.15.99:6790]" 2024-09-13T18:25:59.105 INFO:teuthology.orchestra.run.smithi099.stdout: fsid = c8e1d12d-7fb9-4a33-982e-b895bb77262c 2024-09-13T18:25:59.105 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.105 INFO:teuthology.orchestra.run.smithi099.stdout:[osd] 2024-09-13T18:25:59.105 INFO:teuthology.orchestra.run.smithi099.stdout: osd journal size = 100 2024-09-13T18:25:59.105 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.105 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub load threshold = 5.0 2024-09-13T18:25:59.105 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub max interval = 600 2024-09-13T18:25:59.105 INFO:teuthology.orchestra.run.smithi099.stdout: osd mclock profile = high_recovery_ops 2024-09-13T18:25:59.105 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.106 INFO:teuthology.orchestra.run.smithi099.stdout: osd recover clone overlap = true 2024-09-13T18:25:59.106 INFO:teuthology.orchestra.run.smithi099.stdout: osd recovery max chunk = 1048576 2024-09-13T18:25:59.106 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.106 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug shutdown = true 2024-09-13T18:25:59.106 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug op order = true 2024-09-13T18:25:59.106 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug verify stray on activate = true 2024-09-13T18:25:59.106 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.106 INFO:teuthology.orchestra.run.smithi099.stdout: osd open classes on start = true 2024-09-13T18:25:59.106 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug pg log writeout = true 2024-09-13T18:25:59.106 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.106 INFO:teuthology.orchestra.run.smithi099.stdout: osd deep scrub update digest min age = 30 2024-09-13T18:25:59.106 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.106 INFO:teuthology.orchestra.run.smithi099.stdout: osd map max advance = 10 2024-09-13T18:25:59.106 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.107 INFO:teuthology.orchestra.run.smithi099.stdout: journal zero on create = true 2024-09-13T18:25:59.107 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.107 INFO:teuthology.orchestra.run.smithi099.stdout: filestore ondisk finisher threads = 3 2024-09-13T18:25:59.107 INFO:teuthology.orchestra.run.smithi099.stdout: filestore apply finisher threads = 3 2024-09-13T18:25:59.107 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.107 INFO:teuthology.orchestra.run.smithi099.stdout: bdev debug aio = true 2024-09-13T18:25:59.107 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug misdirected ops = true 2024-09-13T18:25:59.107 INFO:teuthology.orchestra.run.smithi099.stdout: bdev async discard = True 2024-09-13T18:25:59.107 INFO:teuthology.orchestra.run.smithi099.stdout: bdev enable discard = True 2024-09-13T18:25:59.107 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore allocator = bitmap 2024-09-13T18:25:59.107 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore block size = 96636764160 2024-09-13T18:25:59.107 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore fsck on mount = True 2024-09-13T18:25:59.107 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluefs = 1/20 2024-09-13T18:25:59.107 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluestore = 1/20 2024-09-13T18:25:59.108 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-09-13T18:25:59.108 INFO:teuthology.orchestra.run.smithi099.stdout: debug osd = 20 2024-09-13T18:25:59.108 INFO:teuthology.orchestra.run.smithi099.stdout: debug rocksdb = 4/10 2024-09-13T18:25:59.108 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T18:25:59.108 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd full ratio = 0.9 2024-09-13T18:25:59.108 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd nearfull ratio = 0.8 2024-09-13T18:25:59.108 INFO:teuthology.orchestra.run.smithi099.stdout: osd failsafe full ratio = 0.95 2024-09-13T18:25:59.108 INFO:teuthology.orchestra.run.smithi099.stdout: osd objectstore = bluestore 2024-09-13T18:25:59.108 INFO:teuthology.orchestra.run.smithi099.stdout: osd op complaint time = 180 2024-09-13T18:25:59.108 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.108 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr] 2024-09-13T18:25:59.108 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-09-13T18:25:59.108 INFO:teuthology.orchestra.run.smithi099.stdout: debug mgr = 20 2024-09-13T18:25:59.108 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2024-09-13T18:25:59.109 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2024-09-13T18:25:59.109 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:25:59.109 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:25:59.109 INFO:teuthology.orchestra.run.smithi099.stdout: mgr/telemetry/nag = false 2024-09-13T18:25:59.109 INFO:teuthology.orchestra.run.smithi099.stdout: debug client = 20 2024-09-13T18:25:59.109 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.109 INFO:teuthology.orchestra.run.smithi099.stdout:[mon] 2024-09-13T18:25:59.109 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-09-13T18:25:59.109 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2024-09-13T18:25:59.109 INFO:teuthology.orchestra.run.smithi099.stdout: debug paxos = 20 2024-09-13T18:25:59.109 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2024-09-13T18:25:59.109 INFO:teuthology.orchestra.run.smithi099.stdout: mon data avail warn = 5 2024-09-13T18:25:59.109 INFO:teuthology.orchestra.run.smithi099.stdout: mon mgr mkfs grace = 240 2024-09-13T18:25:59.109 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:25:59.110 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd reporter subtree level = osd 2024-09-13T18:25:59.110 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd prime pg temp = true 2024-09-13T18:25:59.110 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:25:59.110 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.110 INFO:teuthology.orchestra.run.smithi099.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T18:25:59.110 INFO:teuthology.orchestra.run.smithi099.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T18:25:59.110 INFO:teuthology.orchestra.run.smithi099.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T18:25:59.110 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.110 INFO:teuthology.orchestra.run.smithi099.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T18:25:59.110 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T18:25:59.110 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T18:25:59.110 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.110 INFO:teuthology.orchestra.run.smithi099.stdout: # 1m isn't quite enough 2024-09-13T18:25:59.110 INFO:teuthology.orchestra.run.smithi099.stdout: mon_down_mkfs_grace = 2m 2024-09-13T18:25:59.111 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.111 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_filestore_osds = false 2024-09-13T18:25:59.111 INFO:teuthology.orchestra.run.smithi099.stdout: mon op complaint time = 120 2024-09-13T18:25:59.111 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on pool no app = False 2024-09-13T18:25:59.111 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T18:25:59.111 INFO:teuthology.orchestra.run.smithi099.stdout:[client] 2024-09-13T18:25:59.111 INFO:teuthology.orchestra.run.smithi099.stdout: rgw cache enabled = true 2024-09-13T18:25:59.111 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable ops log = true 2024-09-13T18:25:59.111 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable usage log = true 2024-09-13T18:25:59.111 INFO:teuthology.orchestra.run.smithi099.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T18:25:59.111 INFO:teuthology.orchestra.run.smithi099.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T18:25:59.111 INFO:teuthology.orchestra.run.smithi099.stdout: client mount timeout = 600 2024-09-13T18:25:59.111 INFO:teuthology.orchestra.run.smithi099.stdout: debug client = 20 2024-09-13T18:25:59.111 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-09-13T18:25:59.112 INFO:teuthology.orchestra.run.smithi099.stdout: pid file = "" 2024-09-13T18:25:59.112 INFO:teuthology.orchestra.run.smithi099.stdout: rados mon op timeout = 900 2024-09-13T18:25:59.112 INFO:teuthology.orchestra.run.smithi099.stdout: rados osd op timeout = 900 2024-09-13T18:25:59.112 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.a] 2024-09-13T18:25:59.112 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.b] 2024-09-13T18:25:59.112 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.c] 2024-09-13T18:25:59.112 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.a] 2024-09-13T18:25:59.112 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.c] 2024-09-13T18:25:59.112 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.b] 2024-09-13T18:25:59.112 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.d] 2024-09-13T18:25:59.112 INFO:teuthology.orchestra.run.smithi099.stdout:[mds] 2024-09-13T18:25:59.112 INFO:teuthology.orchestra.run.smithi099.stdout: debug mds = 20 2024-09-13T18:25:59.112 INFO:teuthology.orchestra.run.smithi099.stdout: debug mds balancer = 20 2024-09-13T18:25:59.112 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-09-13T18:25:59.113 INFO:teuthology.orchestra.run.smithi099.stdout: mds debug frag = True 2024-09-13T18:25:59.113 INFO:teuthology.orchestra.run.smithi099.stdout: mds debug scatterstat = True 2024-09-13T18:25:59.113 INFO:teuthology.orchestra.run.smithi099.stdout: mds op complaint time = 180 2024-09-13T18:25:59.113 INFO:teuthology.orchestra.run.smithi099.stdout: mds verify scatter = True 2024-09-13T18:25:59.113 INFO:teuthology.orchestra.run.smithi099.stdout: osd op complaint time = 180 2024-09-13T18:25:59.113 INFO:teuthology.orchestra.run.smithi099.stdout: rados mon op timeout = 900 2024-09-13T18:25:59.113 INFO:teuthology.orchestra.run.smithi099.stdout: rados osd op timeout = 900 2024-09-13T18:25:59.114 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T18:25:59.114 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T18:25:59.214 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T18:25:59.214 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:25:59.215 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T18:25:59.220 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:25:59.220 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T18:25:59.226 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:25:59.226 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:25:59.226 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T18:25:59.226 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:25:59.249 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:25:59.249 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:25:59.255 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:25:59.255 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:25:59.255 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T18:25:59.256 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:25:59.283 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:25:59.283 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:25:59.287 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T18:25:59.287 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T18:25:59.288 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T18:25:59.347 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T18:25:59.351 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T18:25:59.404 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T18:25:59.415 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T18:25:59.415 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T18:25:59.467 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T18:25:59.471 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-13T18:25:59.482 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T18:25:59.580 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T18:25:59.583 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-13T18:25:59.593 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T18:25:59.649 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T18:25:59.653 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-13T18:25:59.662 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T18:25:59.703 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T18:25:59.706 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-13T18:25:59.764 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T18:25:59.764 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T18:25:59.806 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T18:25:59.819 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-13T18:25:59.860 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-13T18:25:59.875 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T18:25:59.917 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-13T18:25:59.931 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-13T18:25:59.970 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-13T18:25:59.981 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T18:25:59.981 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi044.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T18:25:59.981 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T18:25:59.997 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:25:59.997 INFO:tasks.ceph:role: osd.0 2024-09-13T18:25:59.998 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:25:59.998 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T18:26:00.556 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:26:00.556 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:26:00.557 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:26:00.557 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 2024-09-13T18:26:00.557 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:26:00.557 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:26:00.557 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:26:00.557 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:26:00.557 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:26:00.557 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:26:00.559 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-09-13T18:26:00.559 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T18:26:00.637 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T18:26:00.651 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:26:00.651 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:26:00.652 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T18:26:00.663 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:26:00.663 INFO:tasks.ceph:role: osd.1 2024-09-13T18:26:00.663 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:26:00.663 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T18:26:01.178 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:26:01.178 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:26:01.178 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:26:01.178 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 2024-09-13T18:26:01.178 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:26:01.178 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:26:01.178 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:26:01.178 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:26:01.178 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:26:01.178 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:26:01.179 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-09-13T18:26:01.179 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-13T18:26:01.244 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T18:26:01.257 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:26:01.258 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:26:01.258 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T18:26:01.320 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:26:01.320 INFO:tasks.ceph:role: osd.2 2024-09-13T18:26:01.320 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:26:01.320 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T18:26:01.799 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:26:01.799 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:26:01.799 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:26:01.799 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 2024-09-13T18:26:01.799 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:26:01.799 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:26:01.799 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:26:01.799 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:26:01.800 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:26:01.800 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:26:01.801 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-09-13T18:26:01.801 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-13T18:26:01.856 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T18:26:01.870 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:26:01.870 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:26:01.871 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T18:26:01.880 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:26:01.881 INFO:tasks.ceph:role: osd.3 2024-09-13T18:26:01.881 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:26:01.881 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T18:26:02.377 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:26:02.377 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:26:02.377 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:26:02.377 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 2024-09-13T18:26:02.378 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:26:02.378 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:26:02.378 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:26:02.378 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:26:02.378 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:26:02.378 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:26:02.379 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-09-13T18:26:02.379 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-13T18:26:02.433 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T18:26:02.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:26:02.447 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:26:02.447 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:26:02.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:02.520+0000 7f049f05f880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T18:26:02.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:02.524+0000 7f049f05f880 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T18:26:02.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:02.524+0000 7f049f05f880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:26:02.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:02.528+0000 7f049f05f880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:26:02.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:02.528+0000 7f049f05f880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:26:02.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:02.528+0000 7f049f05f880 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T18:26:05.758 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T18:26:05.774 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:26:05.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:05.860+0000 7f36d5abe880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T18:26:05.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:05.860+0000 7f36d5abe880 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T18:26:05.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:05.860+0000 7f36d5abe880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:26:05.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:05.860+0000 7f36d5abe880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:26:05.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:05.860+0000 7f36d5abe880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:26:05.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:05.860+0000 7f36d5abe880 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T18:26:08.873 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T18:26:08.889 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:26:08.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:08.932+0000 7f4c2d038880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T18:26:08.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:08.936+0000 7f4c2d038880 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T18:26:08.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:08.936+0000 7f4c2d038880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:26:08.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:08.936+0000 7f4c2d038880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:26:08.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:08.936+0000 7f4c2d038880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:26:08.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:08.936+0000 7f4c2d038880 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T18:26:11.921 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T18:26:11.939 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:26:11.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:11.984+0000 7faf36825880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T18:26:11.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:11.984+0000 7faf36825880 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T18:26:11.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:11.984+0000 7faf36825880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:26:11.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:11.984+0000 7faf36825880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:26:11.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:11.984+0000 7faf36825880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:26:11.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:11.984+0000 7faf36825880 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T18:26:14.985 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T18:26:15.002 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-13T18:26:15.019 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:26:15.019 INFO:tasks.ceph:role: osd.4 2024-09-13T18:26:15.019 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:26:15.020 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T18:26:15.564 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:26:15.564 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:26:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:26:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 2024-09-13T18:26:15.565 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:26:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:26:15.565 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:26:15.565 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:26:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:26:15.565 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:26:15.567 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-09-13T18:26:15.567 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-13T18:26:15.671 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-13T18:26:15.683 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:26:15.684 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:26:15.684 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-13T18:26:15.700 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:26:15.701 INFO:tasks.ceph:role: osd.5 2024-09-13T18:26:15.701 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:26:15.701 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T18:26:16.231 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:26:16.232 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:26:16.232 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:26:16.232 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 2024-09-13T18:26:16.232 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:26:16.232 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:26:16.232 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:26:16.232 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:26:16.232 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:26:16.232 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:26:16.233 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-09-13T18:26:16.233 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-13T18:26:16.266 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-13T18:26:16.277 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:26:16.277 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:26:16.278 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-13T18:26:16.289 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:26:16.289 INFO:tasks.ceph:role: osd.6 2024-09-13T18:26:16.289 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:26:16.289 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T18:26:16.758 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:26:16.759 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:26:16.759 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:26:16.759 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 2024-09-13T18:26:16.759 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:26:16.759 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:26:16.759 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:26:16.759 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:26:16.759 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:26:16.759 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:26:16.760 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-09-13T18:26:16.760 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-13T18:26:16.830 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-13T18:26:16.841 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:26:16.842 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:26:16.842 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-13T18:26:16.899 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:26:16.899 INFO:tasks.ceph:role: osd.7 2024-09-13T18:26:16.899 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:26:16.899 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T18:26:17.390 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:26:17.390 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:26:17.390 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:26:17.390 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 2024-09-13T18:26:17.390 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:26:17.391 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:26:17.391 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:26:17.391 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:26:17.391 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:26:17.391 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:26:17.392 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-09-13T18:26:17.392 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-13T18:26:17.451 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-13T18:26:17.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:26:17.465 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:26:17.466 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:26:17.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:17.603+0000 7f801c891880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-13T18:26:17.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:17.607+0000 7f801c891880 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-13T18:26:17.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:17.607+0000 7f801c891880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:26:17.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:17.607+0000 7f801c891880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:26:17.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:17.607+0000 7f801c891880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:26:17.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:17.611+0000 7f801c891880 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-13T18:26:20.634 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T18:26:20.650 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:26:20.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:20.691+0000 7fbac990e880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-13T18:26:20.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:20.691+0000 7fbac990e880 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-13T18:26:20.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:20.691+0000 7fbac990e880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:26:20.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:20.691+0000 7fbac990e880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:26:20.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:20.691+0000 7fbac990e880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:26:20.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:20.691+0000 7fbac990e880 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-13T18:26:23.706 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T18:26:23.763 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:26:23.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:23.803+0000 7f07a322b880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-13T18:26:23.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:23.803+0000 7f07a322b880 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-13T18:26:23.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:23.803+0000 7f07a322b880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:26:23.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:23.803+0000 7f07a322b880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:26:23.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:23.803+0000 7f07a322b880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:26:23.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:23.803+0000 7f07a322b880 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-13T18:26:26.814 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-13T18:26:26.831 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:26:26.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:26.919+0000 7fae00a7b880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-13T18:26:26.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:26.919+0000 7fae00a7b880 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-13T18:26:26.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:26.919+0000 7fae00a7b880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:26:26.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:26.919+0000 7fae00a7b880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:26:26.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:26.919+0000 7fae00a7b880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:26:26.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:26.923+0000 7fae00a7b880 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-13T18:26:28.122 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:26:28.125 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:26:29.942 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-13T18:26:29.960 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T18:26:29.960 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:26:29.960 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-13T18:26:29.977 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:26:29.977 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-13T18:26:29.986 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:26:29.986 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-13T18:26:30.046 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:26:30.046 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T18:26:30.056 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:26:30.056 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T18:26:30.066 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:26:30.066 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T18:26:30.077 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:26:30.077 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T18:26:30.089 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:26:30.090 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T18:26:30.106 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:26:30.106 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-13T18:26:30.116 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:26:30.116 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-13T18:26:30.126 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:26:30.126 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-13T18:26:30.183 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:26:30.183 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-13T18:26:30.193 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:26:30.193 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-13T18:26:30.204 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:26:30.204 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-13T18:26:30.263 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:26:30.263 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T18:26:30.270 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:26:30.270 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-13T18:26:30.278 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:26:30.278 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-13T18:26:30.284 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:26:30.284 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-13T18:26:30.290 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T18:26:30.290 DEBUG:teuthology.orchestra.run.smithi044:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T18:26:30.293 DEBUG:teuthology.orchestra.run.smithi099:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T18:26:30.334 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.y] 2024-09-13T18:26:30.335 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQC3g+Rm1KSoFBAALCTzYRRxF7MPxQHL3ETGqQ== 2024-09-13T18:26:30.335 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.a] 2024-09-13T18:26:30.335 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQC3g+Rmm4/RGxAAtGPYfgzYpmE4yHhoggZJ8Q== 2024-09-13T18:26:30.335 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.c] 2024-09-13T18:26:30.335 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQC3g+Rmr/OCIhAAvBF106ILl0AZlzCZ+S990Q== 2024-09-13T18:26:30.335 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.0] 2024-09-13T18:26:30.335 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQC6g+Rmw8xKHxAArYof7SeFMvQGq5AnVMbiog== 2024-09-13T18:26:30.336 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.1] 2024-09-13T18:26:30.336 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQC9g+RmLRFsMxAAC0SXlbIRvFc3byOy742GSg== 2024-09-13T18:26:30.336 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.2] 2024-09-13T18:26:30.336 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDAg+RmvbTXNxAAyoLLo9RMD7817x8cdlYjWg== 2024-09-13T18:26:30.336 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.3] 2024-09-13T18:26:30.336 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDDg+Rm4/jKOhAAYVOXNUkd3Z9CXAzbxJw34g== 2024-09-13T18:26:30.336 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.x] 2024-09-13T18:26:30.336 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQC3g+RmBmEBGBAARTj0TQ0laAEW0n888vMZrA== 2024-09-13T18:26:30.336 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.b] 2024-09-13T18:26:30.336 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQC3g+Rm8qC+JhAAhdkL3zbxM9+GI8+khy+cSg== 2024-09-13T18:26:30.337 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.d] 2024-09-13T18:26:30.337 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQC3g+RmSHbxKRAAAGsAWnIPUDUk3Y0aYryf+w== 2024-09-13T18:26:30.337 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.4] 2024-09-13T18:26:30.337 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDJg+RmEZwhJBAAqtUZtMmRzRulAa6cnyvSmQ== 2024-09-13T18:26:30.337 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.5] 2024-09-13T18:26:30.337 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDMg+RmCqBKKRAA7oP48mScYw7mkNGahg+ptw== 2024-09-13T18:26:30.337 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.6] 2024-09-13T18:26:30.337 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDPg+RmbjDyLxAAIRb9i9TtRsDg+M9SnEegug== 2024-09-13T18:26:30.337 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.7] 2024-09-13T18:26:30.338 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDSg+RmA4v7NhAAVe6GV0DVksIWiq6KQvMgVg== 2024-09-13T18:26:30.338 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2024-09-13T18:26:30.338 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQC3g+Rm7FEGMBAAosZ34edcGJmTiY8UhPtung== 2024-09-13T18:26:30.338 INFO:teuthology.orchestra.run.smithi044.stdout:[client.2] 2024-09-13T18:26:30.338 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQC3g+Rm0xw5MxAAWu4i4+IAjW5QzQwiILs6bg== 2024-09-13T18:26:30.338 INFO:teuthology.orchestra.run.smithi044.stdout:[client.1] 2024-09-13T18:26:30.338 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQC3g+Rmpu2zNhAAc0mOfL8c/MYij8KYpvsjRw== 2024-09-13T18:26:30.338 INFO:teuthology.orchestra.run.smithi044.stdout:[client.3] 2024-09-13T18:26:30.339 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQC3g+RmZdTZORAA26aYb0Nz0g+rRBG+zAu/EQ== 2024-09-13T18:26:30.346 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr.y] 2024-09-13T18:26:30.346 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQC3g+Rm1KSoFBAALCTzYRRxF7MPxQHL3ETGqQ== 2024-09-13T18:26:30.346 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.a] 2024-09-13T18:26:30.346 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQC3g+Rmm4/RGxAAtGPYfgzYpmE4yHhoggZJ8Q== 2024-09-13T18:26:30.346 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.c] 2024-09-13T18:26:30.346 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQC3g+Rmr/OCIhAAvBF106ILl0AZlzCZ+S990Q== 2024-09-13T18:26:30.346 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.0] 2024-09-13T18:26:30.346 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQC6g+Rmw8xKHxAArYof7SeFMvQGq5AnVMbiog== 2024-09-13T18:26:30.346 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.1] 2024-09-13T18:26:30.346 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQC9g+RmLRFsMxAAC0SXlbIRvFc3byOy742GSg== 2024-09-13T18:26:30.346 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.2] 2024-09-13T18:26:30.346 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDAg+RmvbTXNxAAyoLLo9RMD7817x8cdlYjWg== 2024-09-13T18:26:30.347 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.3] 2024-09-13T18:26:30.347 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDDg+Rm4/jKOhAAYVOXNUkd3Z9CXAzbxJw34g== 2024-09-13T18:26:30.347 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr.x] 2024-09-13T18:26:30.347 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQC3g+RmBmEBGBAARTj0TQ0laAEW0n888vMZrA== 2024-09-13T18:26:30.347 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.b] 2024-09-13T18:26:30.347 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQC3g+Rm8qC+JhAAhdkL3zbxM9+GI8+khy+cSg== 2024-09-13T18:26:30.347 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.d] 2024-09-13T18:26:30.347 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQC3g+RmSHbxKRAAAGsAWnIPUDUk3Y0aYryf+w== 2024-09-13T18:26:30.347 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.4] 2024-09-13T18:26:30.347 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDJg+RmEZwhJBAAqtUZtMmRzRulAa6cnyvSmQ== 2024-09-13T18:26:30.347 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.5] 2024-09-13T18:26:30.347 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDMg+RmCqBKKRAA7oP48mScYw7mkNGahg+ptw== 2024-09-13T18:26:30.347 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.6] 2024-09-13T18:26:30.347 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDPg+RmbjDyLxAAIRb9i9TtRsDg+M9SnEegug== 2024-09-13T18:26:30.348 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.7] 2024-09-13T18:26:30.348 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDSg+RmA4v7NhAAVe6GV0DVksIWiq6KQvMgVg== 2024-09-13T18:26:30.348 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-09-13T18:26:30.348 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQC3g+Rm7FEGMBAAosZ34edcGJmTiY8UhPtung== 2024-09-13T18:26:30.348 INFO:teuthology.orchestra.run.smithi099.stdout:[client.2] 2024-09-13T18:26:30.348 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQC3g+Rm0xw5MxAAWu4i4+IAjW5QzQwiILs6bg== 2024-09-13T18:26:30.348 INFO:teuthology.orchestra.run.smithi099.stdout:[client.1] 2024-09-13T18:26:30.348 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQC3g+Rmpu2zNhAAc0mOfL8c/MYij8KYpvsjRw== 2024-09-13T18:26:30.348 INFO:teuthology.orchestra.run.smithi099.stdout:[client.3] 2024-09-13T18:26:30.348 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQC3g+RmZdTZORAA26aYb0Nz0g+rRBG+zAu/EQ== 2024-09-13T18:26:30.349 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:26:30.384 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:26:30.434 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:26:30.437 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:26:30.489 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:26:30.492 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:26:30.543 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:26:30.545 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:26:30.592 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:26:30.636 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:26:30.688 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:26:30.690 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:26:30.740 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:26:30.742 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:26:30.791 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:26:30.793 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:26:30.841 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:26:30.843 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:26:30.939 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:26:30.941 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:26:30.998 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:26:31.000 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:26:31.050 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:26:31.053 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:26:31.099 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:26:31.101 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:26:31.151 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:26:31.153 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:26:31.200 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:26:31.203 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:26:31.295 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:26:31.297 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:26:31.351 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:26:31.354 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:26:31.404 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:26:31.406 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:26:31.458 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T18:26:31.458 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T18:26:31.472 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:26:31.560 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T18:26:31.578 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-13T18:26:31.595 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:26:31.670 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-13T18:26:31.685 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-13T18:26:31.700 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:26:31.786 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-13T18:26:31.801 DEBUG:teuthology.orchestra.run.smithi044:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:26:31.803 DEBUG:teuthology.orchestra.run.smithi099:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:26:31.850 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T18:26:31.850 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T18:26:31.851 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T18:26:31.853 INFO:tasks.ceph.mon.a:Started 2024-09-13T18:26:31.853 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T18:26:31.853 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T18:26:31.855 INFO:tasks.ceph.mon.b:Started 2024-09-13T18:26:31.856 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T18:26:31.856 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T18:26:31.858 INFO:tasks.ceph.mon.c:Started 2024-09-13T18:26:31.858 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T18:26:31.858 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-13T18:26:31.858 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-13T18:26:31.860 INFO:tasks.ceph.mgr.y:Started 2024-09-13T18:26:31.860 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T18:26:31.861 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T18:26:31.863 INFO:tasks.ceph.mgr.x:Started 2024-09-13T18:26:31.863 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T18:26:31.863 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T18:26:31.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:31.964+0000 7f7b950d9700 1 Processor -- start 2024-09-13T18:26:31.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:31.964+0000 7f7b950d9700 1 -- start start 2024-09-13T18:26:31.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:31.964+0000 7f7b950d9700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7b900cd1a0 0x7f7b900cb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:31.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:31.964+0000 7f7b950d9700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b900cd610 0x7f7b9006c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:31.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:31.964+0000 7f7b950d9700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b900cbea0 con 0x7f7b900b3410 2024-09-13T18:26:31.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:31.964+0000 7f7b950d9700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b900cc460 con 0x7f7b900cd1a0 2024-09-13T18:26:31.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:31.964+0000 7f7b950d9700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b900cc180 con 0x7f7b900cd610 2024-09-13T18:26:31.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:31.964+0000 7f7b8e59c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7b900cd1a0 0x7f7b900cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:31.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:31.964+0000 7f7b8ed9d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7b900b3410 0x7f7b900b37f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49722/0 (socket says 172.21.15.44:49722) 2024-09-13T18:26:31.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:31.964+0000 7f7b8ed9d700 1 -- 172.21.15.44:0/347770282 learned_addr learned my addr 172.21.15.44:0/347770282 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:26:31.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:31.964+0000 7f7b8f59e700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b900cd610 0x7f7b9006c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:31.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:31.964+0000 7f7b8e59c700 1 -- 172.21.15.44:0/347770282 >> v2:172.21.15.44:3300/0 conn(0x7f7b900cd1a0 msgr2=0x7f7b900cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:26:31.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:31.964+0000 7f7b8e59c700 1 -- 172.21.15.44:0/347770282 >> v2:172.21.15.44:3300/0 conn(0x7f7b900cd1a0 msgr2=0x7f7b900cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:26:31.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:31.964+0000 7f7b8e59c700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.44:3300/0 conn(0x7f7b900cd1a0 0x7f7b900cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:26:31.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:31.964+0000 7f7b8e59c700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.44:3300/0 conn(0x7f7b900cd1a0 0x7f7b900cb450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:26:31.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:31.964+0000 7f7b8f59e700 1 -- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b900cd610 msgr2=0x7f7b9006c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:26:31.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:31.964+0000 7f7b8f59e700 1 -- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b900cd610 msgr2=0x7f7b9006c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:26:31.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:31.964+0000 7f7b8f59e700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b900cd610 0x7f7b9006c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:26:31.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:31.964+0000 7f7b8f59e700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b900cd610 0x7f7b9006c3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:26:32.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:32.168+0000 7f7b8e59c700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.44:3300/0 conn(0x7f7b900cd1a0 0x7f7b900cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:32.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:32.168+0000 7f7b8e59c700 1 -- 172.21.15.44:0/347770282 >> v2:172.21.15.44:3300/0 conn(0x7f7b900cd1a0 msgr2=0x7f7b900cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:26:32.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:32.168+0000 7f7b8e59c700 1 -- 172.21.15.44:0/347770282 >> v2:172.21.15.44:3300/0 conn(0x7f7b900cd1a0 msgr2=0x7f7b900cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:26:32.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:32.168+0000 7f7b8e59c700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.44:3300/0 conn(0x7f7b900cd1a0 0x7f7b900cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:26:32.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:32.168+0000 7f7b8f59e700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b900cd610 0x7f7b9006c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:32.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:32.168+0000 7f7b8e59c700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.44:3300/0 conn(0x7f7b900cd1a0 0x7f7b900cb450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:26:32.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:32.168+0000 7f7b8f59e700 1 -- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b900cd610 msgr2=0x7f7b9006c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:26:32.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:32.168+0000 7f7b8f59e700 1 -- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b900cd610 msgr2=0x7f7b9006c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:26:32.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:32.168+0000 7f7b8f59e700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b900cd610 0x7f7b9006c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:26:32.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:32.168+0000 7f7b8f59e700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b900cd610 0x7f7b9006c3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:26:32.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:32.572+0000 7f7b8e59c700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.44:3300/0 conn(0x7f7b900cd1a0 0x7f7b900cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:32.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:32.572+0000 7f7b8f59e700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b900cd610 0x7f7b9006c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:32.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:32.572+0000 7f7b8e59c700 1 -- 172.21.15.44:0/347770282 >> v2:172.21.15.44:3300/0 conn(0x7f7b900cd1a0 msgr2=0x7f7b900cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:26:32.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:32.572+0000 7f7b8e59c700 1 -- 172.21.15.44:0/347770282 >> v2:172.21.15.44:3300/0 conn(0x7f7b900cd1a0 msgr2=0x7f7b900cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:26:32.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:32.572+0000 7f7b8e59c700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.44:3300/0 conn(0x7f7b900cd1a0 0x7f7b900cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:26:32.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:32.572+0000 7f7b8e59c700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.44:3300/0 conn(0x7f7b900cd1a0 0x7f7b900cb450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:26:32.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:32.572+0000 7f7b8f59e700 1 -- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b900cd610 msgr2=0x7f7b9006c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:26:32.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:32.572+0000 7f7b8f59e700 1 -- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b900cd610 msgr2=0x7f7b9006c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:26:32.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:32.572+0000 7f7b8f59e700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b900cd610 0x7f7b9006c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:26:32.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:32.572+0000 7f7b8f59e700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b900cd610 0x7f7b9006c3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:26:33.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:33.376+0000 7f7b8e59c700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.44:3300/0 conn(0x7f7b900cd1a0 0x7f7b900cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:33.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:33.376+0000 7f7b8f59e700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b900cd610 0x7f7b9006c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:33.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:33.376+0000 7f7b8e59c700 1 -- 172.21.15.44:0/347770282 >> v2:172.21.15.44:3300/0 conn(0x7f7b900cd1a0 msgr2=0x7f7b900cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:26:33.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:33.376+0000 7f7b8e59c700 1 -- 172.21.15.44:0/347770282 >> v2:172.21.15.44:3300/0 conn(0x7f7b900cd1a0 msgr2=0x7f7b900cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:26:33.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:33.376+0000 7f7b8e59c700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.44:3300/0 conn(0x7f7b900cd1a0 0x7f7b900cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:26:33.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:33.376+0000 7f7b8f59e700 1 -- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b900cd610 msgr2=0x7f7b9006c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:26:33.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:33.376+0000 7f7b8e59c700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.44:3300/0 conn(0x7f7b900cd1a0 0x7f7b900cb450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:26:33.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:33.376+0000 7f7b8f59e700 1 -- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b900cd610 msgr2=0x7f7b9006c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:26:33.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:33.376+0000 7f7b8f59e700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b900cd610 0x7f7b9006c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:26:33.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:33.376+0000 7f7b8f59e700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b900cd610 0x7f7b9006c3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:26:34.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:34.964+0000 7f7b8cd99700 1 -- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b900cd610 msgr2=0x7f7b9006c3e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:26:34.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:34.964+0000 7f7b8cd99700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b900cd610 0x7f7b9006c3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:34.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:34.964+0000 7f7b8cd99700 1 -- 172.21.15.44:0/347770282 >> v2:172.21.15.44:3300/0 conn(0x7f7b900cd1a0 msgr2=0x7f7b900cb450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:26:34.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:34.964+0000 7f7b8cd99700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.44:3300/0 conn(0x7f7b900cd1a0 0x7f7b900cb450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:34.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:34.964+0000 7f7b8cd99700 1 -- 172.21.15.44:0/347770282 >> v1:172.21.15.44:6789/0 conn(0x7f7b900b3410 legacy=0x7f7b900b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:34.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:34.964+0000 7f7b8cd99700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.99:3300/0 conn(0x7f7b7c003740 0x7f7b7c005ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:34.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:34.964+0000 7f7b8cd99700 1 -- 172.21.15.44:0/347770282 --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b900cc9a0 con 0x7f7b7c0061f0 2024-09-13T18:26:34.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:34.964+0000 7f7b8cd99700 1 -- 172.21.15.44:0/347770282 --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b900cc460 con 0x7f7b7c003740 2024-09-13T18:26:34.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:34.964+0000 7f7b8ed9d700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.99:3300/0 conn(0x7f7b7c003740 0x7f7b7c005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:34.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:34.964+0000 7f7b8ed9d700 1 -- 172.21.15.44:0/347770282 >> v2:172.21.15.99:3300/0 conn(0x7f7b7c003740 msgr2=0x7f7b7c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:26:34.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:34.964+0000 7f7b8ed9d700 1 -- 172.21.15.44:0/347770282 >> v2:172.21.15.99:3300/0 conn(0x7f7b7c003740 msgr2=0x7f7b7c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:26:34.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:34.964+0000 7f7b8ed9d700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.99:3300/0 conn(0x7f7b7c003740 0x7f7b7c005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:26:34.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:34.964+0000 7f7b8ed9d700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.99:3300/0 conn(0x7f7b7c003740 0x7f7b7c005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:26:35.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:35.168+0000 7f7b8ed9d700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.99:3300/0 conn(0x7f7b7c003740 0x7f7b7c005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:35.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:35.168+0000 7f7b8ed9d700 1 -- 172.21.15.44:0/347770282 >> v2:172.21.15.99:3300/0 conn(0x7f7b7c003740 msgr2=0x7f7b7c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:26:35.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:35.168+0000 7f7b8ed9d700 1 -- 172.21.15.44:0/347770282 >> v2:172.21.15.99:3300/0 conn(0x7f7b7c003740 msgr2=0x7f7b7c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:26:35.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:35.168+0000 7f7b8ed9d700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.99:3300/0 conn(0x7f7b7c003740 0x7f7b7c005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:26:35.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:35.168+0000 7f7b8ed9d700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.99:3300/0 conn(0x7f7b7c003740 0x7f7b7c005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:26:35.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:35.572+0000 7f7b8ed9d700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.99:3300/0 conn(0x7f7b7c003740 0x7f7b7c005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:35.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:35.572+0000 7f7b8ed9d700 1 -- 172.21.15.44:0/347770282 >> v2:172.21.15.99:3300/0 conn(0x7f7b7c003740 msgr2=0x7f7b7c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:26:35.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:35.572+0000 7f7b8ed9d700 1 -- 172.21.15.44:0/347770282 >> v2:172.21.15.99:3300/0 conn(0x7f7b7c003740 msgr2=0x7f7b7c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:26:35.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:35.572+0000 7f7b8ed9d700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.99:3300/0 conn(0x7f7b7c003740 0x7f7b7c005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:26:35.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:35.572+0000 7f7b8ed9d700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.99:3300/0 conn(0x7f7b7c003740 0x7f7b7c005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:26:36.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:36.376+0000 7f7b8ed9d700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.99:3300/0 conn(0x7f7b7c003740 0x7f7b7c005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:36.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:36.376+0000 7f7b8ed9d700 1 -- 172.21.15.44:0/347770282 >> v2:172.21.15.99:3300/0 conn(0x7f7b7c003740 msgr2=0x7f7b7c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:26:36.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:36.376+0000 7f7b8ed9d700 1 -- 172.21.15.44:0/347770282 >> v2:172.21.15.99:3300/0 conn(0x7f7b7c003740 msgr2=0x7f7b7c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:26:36.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:36.376+0000 7f7b8ed9d700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.99:3300/0 conn(0x7f7b7c003740 0x7f7b7c005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:26:36.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:36.376+0000 7f7b8ed9d700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.99:3300/0 conn(0x7f7b7c003740 0x7f7b7c005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:26:37.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.048+0000 7f7b8dd9b700 1 -- 172.21.15.44:0/347770282 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432089477 0 0) 0x7f7b900cc9a0 con 0x7f7b7c0061f0 2024-09-13T18:26:37.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.048+0000 7f7b8dd9b700 1 -- 172.21.15.44:0/347770282 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b780057e0 con 0x7f7b7c0061f0 2024-09-13T18:26:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.048+0000 7f7b8dd9b700 1 -- 172.21.15.44:0/347770282 <== mon.1 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 527034657 0 0) 0x7f7b780057e0 con 0x7f7b7c0061f0 2024-09-13T18:26:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.048+0000 7f7b8dd9b700 1 -- 172.21.15.44:0/347770282 >> v2:172.21.15.99:3300/0 conn(0x7f7b7c003740 msgr2=0x7f7b7c005ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:26:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.048+0000 7f7b8dd9b700 1 --2- 172.21.15.44:0/347770282 >> v2:172.21.15.99:3300/0 conn(0x7f7b7c003740 0x7f7b7c005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.048+0000 7f7b8dd9b700 1 -- 172.21.15.44:0/347770282 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c00af70 con 0x7f7b7c0061f0 2024-09-13T18:26:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.048+0000 7f7b8dd9b700 1 -- 172.21.15.44:0/347770282 <== mon.1 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f7b8400c570 con 0x7f7b7c0061f0 2024-09-13T18:26:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.048+0000 7f7b8dd9b700 1 -- 172.21.15.44:0/347770282 >> v1:172.21.15.99:6789/0 conn(0x7f7b7c0061f0 legacy=0x7f7b7c0086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.048+0000 7f7b8f59e700 1 -- 172.21.15.44:0/347770282 reap_dead start 2024-09-13T18:26:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.048+0000 7f7b8dd9b700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b78005c30 0x7f7b78006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.048+0000 7f7b8dd9b700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b78006a80 0x7f7b78006f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.048+0000 7f7b8dd9b700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b78007560 0x7f7b7800dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.048+0000 7f7b8dd9b700 1 -- 172.21.15.44:0/347770282 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b900cc460 con 0x7f7b78006a80 2024-09-13T18:26:37.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.048+0000 7f7b8dd9b700 1 -- 172.21.15.44:0/347770282 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7800e4b0 con 0x7f7b78007560 2024-09-13T18:26:37.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.048+0000 7f7b8dd9b700 1 -- 172.21.15.44:0/347770282 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7800e670 con 0x7f7b78005c30 2024-09-13T18:26:37.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.048+0000 7f7b8e59c700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b78006a80 0x7f7b78006f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.048+0000 7f7b8f59e700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b78007560 0x7f7b7800dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.048+0000 7f7b8ed9d700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b78005c30 0x7f7b78006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.052+0000 7f7b8ed9d700 1 -- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b78007560 msgr2=0x7f7b7800dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:37.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.052+0000 7f7b8ed9d700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b78007560 0x7f7b7800dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.052+0000 7f7b8ed9d700 1 -- 172.21.15.44:0/347770282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b78006a80 msgr2=0x7f7b78006f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:37.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.052+0000 7f7b8ed9d700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b78006a80 0x7f7b78006f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.052+0000 7f7b8ed9d700 1 -- 172.21.15.44:0/347770282 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b780057e0 con 0x7f7b78005c30 2024-09-13T18:26:37.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.052+0000 7f7b8e59c700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b78006a80 0x7f7b78006f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:26:37.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.052+0000 7f7b8f59e700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b78007560 0x7f7b7800dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:26:37.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.052+0000 7f7b8ed9d700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b78005c30 0x7f7b78006030 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7b80007dd0 tx=0x7f7b78007ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fd1ce9d2f61cb53 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:37.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.052+0000 7f7b8dd9b700 1 -- 172.21.15.44:0/347770282 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b80016480 con 0x7f7b78005c30 2024-09-13T18:26:37.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.052+0000 7f7b8dd9b700 1 -- 172.21.15.44:0/347770282 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b80016600 con 0x7f7b78005c30 2024-09-13T18:26:37.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.052+0000 7f7b8dd9b700 1 -- 172.21.15.44:0/347770282 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b800169b0 con 0x7f7b78005c30 2024-09-13T18:26:37.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.056+0000 7f7b950d9700 1 -- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b78005c30 msgr2=0x7f7b78006030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.056+0000 7f7b950d9700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b78005c30 0x7f7b78006030 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7b80007dd0 tx=0x7f7b78007ab0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.056+0000 7f7b950d9700 1 -- 172.21.15.44:0/347770282 shutdown_connections 2024-09-13T18:26:37.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.056+0000 7f7b950d9700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b78007560 0x7f7b7800dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.056+0000 7f7b950d9700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b78006a80 0x7f7b78006f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.056+0000 7f7b950d9700 1 --2- 172.21.15.44:0/347770282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b78005c30 0x7f7b78006030 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.056+0000 7f7b950d9700 1 -- 172.21.15.44:0/347770282 >> 172.21.15.44:0/347770282 conn(0x7f7b900af5d0 msgr2=0x7f7b900af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:37.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.056+0000 7f7b950d9700 1 -- 172.21.15.44:0/347770282 shutdown_connections 2024-09-13T18:26:37.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.056+0000 7f7b950d9700 1 -- 172.21.15.44:0/347770282 wait complete. 2024-09-13T18:26:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.056+0000 7f7b950d9700 1 Processor -- start 2024-09-13T18:26:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.056+0000 7f7b950d9700 1 -- start start 2024-09-13T18:26:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b950d9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b78005c30 0x7f7b9014e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b950d9700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b78006a80 0x7f7b900adf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b950d9700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b78007560 0x7f7b900abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b950d9700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9014ec70 con 0x7f7b78005c30 2024-09-13T18:26:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b950d9700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b901e3840 con 0x7f7b78007560 2024-09-13T18:26:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b950d9700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b901e3ac0 con 0x7f7b78006a80 2024-09-13T18:26:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b8ed9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b78005c30 0x7f7b9014e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b8e59c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b78006a80 0x7f7b900adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b8ed9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b78005c30 0x7f7b9014e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46800/0 (socket says 172.21.15.44:46800) 2024-09-13T18:26:37.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b8e59c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b78006a80 0x7f7b900adf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:48906/0 (socket says 172.21.15.44:48906) 2024-09-13T18:26:37.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b8ed9d700 1 -- 172.21.15.44:0/144995245 learned_addr learned my addr 172.21.15.44:0/144995245 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:26:37.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b8f59e700 1 --2- 172.21.15.44:0/144995245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b78007560 0x7f7b900abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b8ed9d700 1 -- 172.21.15.44:0/144995245 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b78006a80 msgr2=0x7f7b900adf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b8ed9d700 1 --2- 172.21.15.44:0/144995245 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b78006a80 0x7f7b900adf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b8ed9d700 1 -- 172.21.15.44:0/144995245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b78007560 msgr2=0x7f7b900abdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b8ed9d700 1 --2- 172.21.15.44:0/144995245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b78007560 0x7f7b900abdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b8ed9d700 1 -- 172.21.15.44:0/144995245 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b901e3da0 con 0x7f7b78005c30 2024-09-13T18:26:37.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b8ed9d700 1 --2- 172.21.15.44:0/144995245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b78005c30 0x7f7b9014e730 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7b80007740 tx=0x7f7b80001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:37.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b777fe700 1 -- 172.21.15.44:0/144995245 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b80027070 con 0x7f7b78005c30 2024-09-13T18:26:37.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b777fe700 1 -- 172.21.15.44:0/144995245 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b80016480 con 0x7f7b78005c30 2024-09-13T18:26:37.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b950d9700 1 -- 172.21.15.44:0/144995245 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b901e4080 con 0x7f7b78005c30 2024-09-13T18:26:37.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b777fe700 1 -- 172.21.15.44:0/144995245 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b80007e00 con 0x7f7b78005c30 2024-09-13T18:26:37.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b950d9700 1 -- 172.21.15.44:0/144995245 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b901e4640 con 0x7f7b78005c30 2024-09-13T18:26:37.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b777fe700 1 -- 172.21.15.44:0/144995245 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f7b8002a020 con 0x7f7b78005c30 2024-09-13T18:26:37.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.060+0000 7f7b777fe700 1 -- 172.21.15.44:0/144995245 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7b800052f0 con 0x7f7b78005c30 2024-09-13T18:26:37.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.064+0000 7f7b950d9700 1 -- 172.21.15.44:0/144995245 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b901e4800 con 0x7f7b78005c30 2024-09-13T18:26:37.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.068+0000 7f7b777fe700 1 -- 172.21.15.44:0/144995245 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f7b8004ce30 con 0x7f7b78005c30 2024-09-13T18:26:37.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.144+0000 7f7b950d9700 1 -- 172.21.15.44:0/144995245 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7b900b37f0 con 0x7f7b78005c30 2024-09-13T18:26:37.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.148+0000 7f7b777fe700 1 -- 172.21.15.44:0/144995245 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7b8003b070 con 0x7f7b78005c30 2024-09-13T18:26:37.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.148+0000 7f7b950d9700 1 -- 172.21.15.44:0/144995245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b78005c30 msgr2=0x7f7b9014e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.148+0000 7f7b950d9700 1 --2- 172.21.15.44:0/144995245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b78005c30 0x7f7b9014e730 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7b80007740 tx=0x7f7b80001120 comp rx=0 tx=0).stop 2024-09-13T18:26:37.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.152+0000 7f7b950d9700 1 -- 172.21.15.44:0/144995245 shutdown_connections 2024-09-13T18:26:37.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.152+0000 7f7b950d9700 1 --2- 172.21.15.44:0/144995245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b78007560 0x7f7b900abdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.152+0000 7f7b950d9700 1 --2- 172.21.15.44:0/144995245 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b78006a80 0x7f7b900adf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.152+0000 7f7b950d9700 1 --2- 172.21.15.44:0/144995245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b78005c30 0x7f7b9014e730 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.152+0000 7f7b950d9700 1 -- 172.21.15.44:0/144995245 >> 172.21.15.44:0/144995245 conn(0x7f7b900af5d0 msgr2=0x7f7b900b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:37.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.152+0000 7f7b950d9700 1 -- 172.21.15.44:0/144995245 shutdown_connections 2024-09-13T18:26:37.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:37.152+0000 7f7b950d9700 1 -- 172.21.15.44:0/144995245 wait complete. 2024-09-13T18:26:37.155 INFO:teuthology.orchestra.run.smithi044.stderr:adjusted tunables profile to default 2024-09-13T18:26:37.171 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T18:26:37.171 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T18:26:37.171 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:26:37.171 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T18:26:37.181 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:26:37.181 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T18:26:37.194 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:26:37.194 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T18:26:37.203 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:26:37.203 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T18:26:37.250 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:37.245+0000 7f61521f32c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:26:37.260 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:26:37.260 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-13T18:26:37.277 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:26:37.277 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-13T18:26:37.334 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:26:37.334 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-13T18:26:37.347 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:26:37.347 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-13T18:26:37.356 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new abba99a8-7b72-4323-a3f9-c4272d0567dd 0 2024-09-13T18:26:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c0b3e2700 1 Processor -- start 2024-09-13T18:26:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c0b3e2700 1 -- start start 2024-09-13T18:26:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c0b3e2700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6c0406ccf0 0x7f6c04159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c0b3e2700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c040724d0 con 0x7f6c040720d0 2024-09-13T18:26:37.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c0b3e2700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c04071030 con 0x7f6c04070ba0 2024-09-13T18:26:37.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c0b3e2700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c04071310 con 0x7f6c0406ccf0 2024-09-13T18:26:37.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c09bdf700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6c04070ba0 0x7f6c0406d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:48768/0 (socket says 172.21.15.99:48768) 2024-09-13T18:26:37.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c09bdf700 1 -- 172.21.15.99:0/4076555237 learned_addr learned my addr 172.21.15.99:0/4076555237 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T18:26:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c0a3e0700 1 --2- 172.21.15.99:0/4076555237 >> v2:172.21.15.44:3300/0 conn(0x7f6c0406ccf0 0x7f6c04159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c093de700 1 -- 172.21.15.99:0/4076555237 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572375265 0 0) 0x7f6c04071030 con 0x7f6c04070ba0 2024-09-13T18:26:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c093de700 1 -- 172.21.15.99:0/4076555237 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bf00035d0 con 0x7f6c04070ba0 2024-09-13T18:26:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c093de700 1 -- 172.21.15.99:0/4076555237 <== mon.1 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3414649770 0 0) 0x7f6bf00035d0 con 0x7f6c04070ba0 2024-09-13T18:26:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c093de700 1 -- 172.21.15.99:0/4076555237 >> v2:172.21.15.44:3300/0 conn(0x7f6c0406ccf0 msgr2=0x7f6c04159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c093de700 1 --2- 172.21.15.99:0/4076555237 >> v2:172.21.15.44:3300/0 conn(0x7f6c0406ccf0 0x7f6c04159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c093de700 1 -- 172.21.15.99:0/4076555237 >> v1:172.21.15.44:6789/0 conn(0x7f6c040720d0 legacy=0x7f6c0415af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c093de700 1 -- 172.21.15.99:0/4076555237 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c040715f0 con 0x7f6c04070ba0 2024-09-13T18:26:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c093de700 1 -- 172.21.15.99:0/4076555237 <== mon.1 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f6bf4001670 con 0x7f6c04070ba0 2024-09-13T18:26:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c093de700 1 -- 172.21.15.99:0/4076555237 >> v1:172.21.15.99:6789/0 conn(0x7f6c04070ba0 legacy=0x7f6c0406d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c093de700 1 --2- 172.21.15.99:0/4076555237 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6bf0003a20 0x7f6bf0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c093de700 1 --2- 172.21.15.99:0/4076555237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bf0004870 0x7f6bf0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c093de700 1 --2- 172.21.15.99:0/4076555237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6bf0005230 0x7f6bf000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c093de700 1 -- 172.21.15.99:0/4076555237 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c04071310 con 0x7f6bf0005230 2024-09-13T18:26:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c093de700 1 -- 172.21.15.99:0/4076555237 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf000c0d0 con 0x7f6bf0004870 2024-09-13T18:26:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c093de700 1 -- 172.21.15.99:0/4076555237 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf000c290 con 0x7f6bf0003a20 2024-09-13T18:26:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c09bdf700 1 --2- 172.21.15.99:0/4076555237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bf0004870 0x7f6bf0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c0a3e0700 1 --2- 172.21.15.99:0/4076555237 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6bf0003a20 0x7f6bf0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c0abe1700 1 --2- 172.21.15.99:0/4076555237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6bf0005230 0x7f6bf000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c09bdf700 1 -- 172.21.15.99:0/4076555237 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6bf0003a20 msgr2=0x7f6bf0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c09bdf700 1 --2- 172.21.15.99:0/4076555237 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6bf0003a20 0x7f6bf0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c09bdf700 1 -- 172.21.15.99:0/4076555237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6bf0005230 msgr2=0x7f6bf000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c09bdf700 1 --2- 172.21.15.99:0/4076555237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6bf0005230 0x7f6bf000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c09bdf700 1 -- 172.21.15.99:0/4076555237 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf00035d0 con 0x7f6bf0004870 2024-09-13T18:26:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c0abe1700 1 -- 172.21.15.99:0/4076555237 reap_dead start 2024-09-13T18:26:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c09bdf700 1 --2- 172.21.15.99:0/4076555237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bf0004870 0x7f6bf0004cf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400c320 tx=0x7f6bf00058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=715093e4fcfaabac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c093de700 1 -- 172.21.15.99:0/4076555237 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4007c30 con 0x7f6bf0004870 2024-09-13T18:26:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c093de700 1 -- 172.21.15.99:0/4076555237 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf400ce60 con 0x7f6bf0004870 2024-09-13T18:26:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.509+0000 7f6c093de700 1 -- 172.21.15.99:0/4076555237 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4005bc0 con 0x7f6bf0004870 2024-09-13T18:26:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.513+0000 7f6c0b3e2700 1 -- 172.21.15.99:0/4076555237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bf0004870 msgr2=0x7f6bf0004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.513+0000 7f6c0b3e2700 1 --2- 172.21.15.99:0/4076555237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bf0004870 0x7f6bf0004cf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400c320 tx=0x7f6bf00058a0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.513+0000 7f6c0b3e2700 1 -- 172.21.15.99:0/4076555237 shutdown_connections 2024-09-13T18:26:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.513+0000 7f6c0b3e2700 1 --2- 172.21.15.99:0/4076555237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bf0004870 0x7f6bf0004cf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.513+0000 7f6c0b3e2700 1 -- 172.21.15.99:0/4076555237 >> 172.21.15.99:0/4076555237 conn(0x7f6c040cfad0 msgr2=0x7f6c040cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.513+0000 7f6c0b3e2700 1 -- 172.21.15.99:0/4076555237 shutdown_connections 2024-09-13T18:26:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.513+0000 7f6c0b3e2700 1 -- 172.21.15.99:0/4076555237 wait complete. 2024-09-13T18:26:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.513+0000 7f6c0b3e2700 1 Processor -- start 2024-09-13T18:26:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.513+0000 7f6c0b3e2700 1 -- start start 2024-09-13T18:26:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.513+0000 7f6c0b3e2700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6bf0004870 0x7f6c040aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.513+0000 7f6c0b3e2700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c04152280 0x7f6c04150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.513+0000 7f6c0b3e2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c04168200 0x7f6c04168680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.513+0000 7f6c0b3e2700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c04152700 con 0x7f6c04168200 2024-09-13T18:26:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.513+0000 7f6c0b3e2700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c040af2c0 con 0x7f6c04152280 2024-09-13T18:26:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.513+0000 7f6c0b3e2700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c040ae130 con 0x7f6bf0004870 2024-09-13T18:26:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.513+0000 7f6c0a3e0700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6bf0004870 0x7f6c040aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.513+0000 7f6c09bdf700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c04152280 0x7f6c04150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.517+0000 7f6c09bdf700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c04152280 0x7f6c04150260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33784/0 (socket says 172.21.15.99:33784) 2024-09-13T18:26:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.517+0000 7f6c09bdf700 1 -- 172.21.15.99:0/3529457697 learned_addr learned my addr 172.21.15.99:0/3529457697 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T18:26:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.517+0000 7f6c0abe1700 1 --2- 172.21.15.99:0/3529457697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c04168200 0x7f6c04168680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.517+0000 7f6c0a3e0700 1 -- 172.21.15.99:0/3529457697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c04152280 msgr2=0x7f6c04150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.517+0000 7f6c0a3e0700 1 --2- 172.21.15.99:0/3529457697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c04152280 0x7f6c04150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.517+0000 7f6c0a3e0700 1 -- 172.21.15.99:0/3529457697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c04168200 msgr2=0x7f6c04168680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.517+0000 7f6c0a3e0700 1 --2- 172.21.15.99:0/3529457697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c04168200 0x7f6c04168680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.517+0000 7f6c0a3e0700 1 -- 172.21.15.99:0/3529457697 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c040ae410 con 0x7f6bf0004870 2024-09-13T18:26:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.517+0000 7f6c0a3e0700 1 --2- 172.21.15.99:0/3529457697 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6bf0004870 0x7f6c040aece0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6c000119d0 tx=0x7f6c00011ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.517+0000 7f6bfaffd700 1 -- 172.21.15.99:0/3529457697 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c00004240 con 0x7f6bf0004870 2024-09-13T18:26:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.517+0000 7f6bfaffd700 1 -- 172.21.15.99:0/3529457697 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c000043a0 con 0x7f6bf0004870 2024-09-13T18:26:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.517+0000 7f6c0b3e2700 1 -- 172.21.15.99:0/3529457697 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c04150ce0 con 0x7f6bf0004870 2024-09-13T18:26:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.517+0000 7f6bfaffd700 1 -- 172.21.15.99:0/3529457697 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0000f730 con 0x7f6bf0004870 2024-09-13T18:26:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.517+0000 7f6c0b3e2700 1 -- 172.21.15.99:0/3529457697 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c04150980 con 0x7f6bf0004870 2024-09-13T18:26:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.517+0000 7f6bfaffd700 1 -- 172.21.15.99:0/3529457697 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6c0000fb90 con 0x7f6bf0004870 2024-09-13T18:26:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.517+0000 7f6bfaffd700 1 -- 172.21.15.99:0/3529457697 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6c0001e790 con 0x7f6bf0004870 2024-09-13T18:26:37.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.517+0000 7f6c0b3e2700 1 -- 172.21.15.99:0/3529457697 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c04167e40 con 0x7f6bf0004870 2024-09-13T18:26:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.521+0000 7f6bfaffd700 1 -- 172.21.15.99:0/3529457697 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f6c04150980 con 0x7f6bf0004870 2024-09-13T18:26:37.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.597+0000 7f6c0b3e2700 1 -- 172.21.15.99:0/3529457697 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd new", "uuid": "abba99a8-7b72-4323-a3f9-c4272d0567dd", "id": 0} v 0) v1 -- 0x7f6c040b39b0 con 0x7f6bf0004870 2024-09-13T18:26:37.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.605+0000 7f6bfaffd700 1 -- 172.21.15.99:0/3529457697 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "abba99a8-7b72-4323-a3f9-c4272d0567dd", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6c0002d0b0 con 0x7f6bf0004870 2024-09-13T18:26:37.613 INFO:teuthology.orchestra.run.smithi099.stdout:0 2024-09-13T18:26:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.609+0000 7f6c0b3e2700 1 -- 172.21.15.99:0/3529457697 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6bf0004870 msgr2=0x7f6c040aece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.609+0000 7f6c0b3e2700 1 --2- 172.21.15.99:0/3529457697 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6bf0004870 0x7f6c040aece0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6c000119d0 tx=0x7f6c00011ce0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.609+0000 7f6c0b3e2700 1 -- 172.21.15.99:0/3529457697 shutdown_connections 2024-09-13T18:26:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.609+0000 7f6c0b3e2700 1 --2- 172.21.15.99:0/3529457697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c04168200 0x7f6c04168680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.609+0000 7f6c0b3e2700 1 --2- 172.21.15.99:0/3529457697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c04152280 0x7f6c04150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.609+0000 7f6c0b3e2700 1 --2- 172.21.15.99:0/3529457697 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6bf0004870 0x7f6c040aece0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.609+0000 7f6c0b3e2700 1 -- 172.21.15.99:0/3529457697 >> 172.21.15.99:0/3529457697 conn(0x7f6c040cfad0 msgr2=0x7f6c040b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.609+0000 7f6c0b3e2700 1 -- 172.21.15.99:0/3529457697 shutdown_connections 2024-09-13T18:26:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.609+0000 7f6c0b3e2700 1 -- 172.21.15.99:0/3529457697 wait complete. 2024-09-13T18:26:37.629 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new 32427ee7-5a8f-4853-b396-051ae9d5a463 1 2024-09-13T18:26:37.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.741+0000 7f4ca4fee700 1 Processor -- start 2024-09-13T18:26:37.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.741+0000 7f4ca4fee700 1 -- start start 2024-09-13T18:26:37.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.741+0000 7f4ca4fee700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4ca015cda0 0x7f4ca006b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.741+0000 7f4ca4fee700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4ca00ceb70 0x7f4ca00b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.741+0000 7f4ca4fee700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ca006a520 0x7f4ca006a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.741+0000 7f4ca4fee700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca006be40 con 0x7f4ca00ceb70 2024-09-13T18:26:37.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.741+0000 7f4ca4fee700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca00b8430 con 0x7f4ca015cda0 2024-09-13T18:26:37.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.741+0000 7f4ca4fee700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca006ae90 con 0x7f4ca006a520 2024-09-13T18:26:37.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.741+0000 7f4c9ffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ca006a520 0x7f4ca006a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.741+0000 7f4c9f7fe700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4ca015cda0 0x7f4ca006b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.741+0000 7f4c9f7fe700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4ca015cda0 0x7f4ca006b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33800/0 (socket says 172.21.15.99:33800) 2024-09-13T18:26:37.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.741+0000 7f4c9f7fe700 1 -- 172.21.15.99:0/1009082470 learned_addr learned my addr 172.21.15.99:0/1009082470 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T18:26:37.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.741+0000 7f4c9effd700 1 --2- 172.21.15.99:0/1009082470 >> v2:172.21.15.44:3300/0 conn(0x7f4ca00ceb70 0x7f4ca00b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.741+0000 7f4c9f7fe700 1 -- 172.21.15.99:0/1009082470 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ca006a520 msgr2=0x7f4ca006a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:37.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.741+0000 7f4c9f7fe700 1 --2- 172.21.15.99:0/1009082470 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ca006a520 0x7f4ca006a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.741+0000 7f4c9f7fe700 1 -- 172.21.15.99:0/1009082470 >> v2:172.21.15.44:3300/0 conn(0x7f4ca00ceb70 msgr2=0x7f4ca00b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:37.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.741+0000 7f4c9f7fe700 1 --2- 172.21.15.99:0/1009082470 >> v2:172.21.15.44:3300/0 conn(0x7f4ca00ceb70 0x7f4ca00b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.741+0000 7f4c9f7fe700 1 -- 172.21.15.99:0/1009082470 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca00cf350 con 0x7f4ca015cda0 2024-09-13T18:26:37.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.741+0000 7f4c9ffff700 1 --2- 172.21.15.99:0/1009082470 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ca006a520 0x7f4ca006a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:26:37.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.741+0000 7f4c9f7fe700 1 --2- 172.21.15.99:0/1009082470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ca015cda0 0x7f4ca006b900 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00d0800 tx=0x7f4c98009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a05e3a9413395c78 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:37.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.741+0000 7f4c9e7fc700 1 -- 172.21.15.99:0/1009082470 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98011830 con 0x7f4ca015cda0 2024-09-13T18:26:37.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.741+0000 7f4c9e7fc700 1 -- 172.21.15.99:0/1009082470 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c98011990 con 0x7f4ca015cda0 2024-09-13T18:26:37.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.741+0000 7f4c9e7fc700 1 -- 172.21.15.99:0/1009082470 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98011d20 con 0x7f4ca015cda0 2024-09-13T18:26:37.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.745+0000 7f4ca4fee700 1 -- 172.21.15.99:0/1009082470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ca015cda0 msgr2=0x7f4ca006b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.745+0000 7f4ca4fee700 1 --2- 172.21.15.99:0/1009082470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ca015cda0 0x7f4ca006b900 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00d0800 tx=0x7f4c98009bf0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.745+0000 7f4ca4fee700 1 -- 172.21.15.99:0/1009082470 shutdown_connections 2024-09-13T18:26:37.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.745+0000 7f4ca4fee700 1 --2- 172.21.15.99:0/1009082470 >> v2:172.21.15.44:3300/0 conn(0x7f4ca00ceb70 0x7f4ca00b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.745+0000 7f4ca4fee700 1 --2- 172.21.15.99:0/1009082470 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ca006a520 0x7f4ca006a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.745+0000 7f4ca4fee700 1 --2- 172.21.15.99:0/1009082470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ca015cda0 0x7f4ca006b900 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.745+0000 7f4ca4fee700 1 -- 172.21.15.99:0/1009082470 >> 172.21.15.99:0/1009082470 conn(0x7f4ca00d2cb0 msgr2=0x7f4ca00d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:37.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.745+0000 7f4ca4fee700 1 -- 172.21.15.99:0/1009082470 shutdown_connections 2024-09-13T18:26:37.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.745+0000 7f4ca4fee700 1 -- 172.21.15.99:0/1009082470 wait complete. 2024-09-13T18:26:37.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.745+0000 7f4ca4fee700 1 Processor -- start 2024-09-13T18:26:37.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4ca4fee700 1 -- start start 2024-09-13T18:26:37.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4ca4fee700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ca006a520 0x7f4ca0150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4ca4fee700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ca00ceb70 0x7f4ca01f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4ca4fee700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ca015cda0 0x7f4ca015ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4ca4fee700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca0150660 con 0x7f4ca006a520 2024-09-13T18:26:37.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4ca4fee700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca01f3660 con 0x7f4ca00ceb70 2024-09-13T18:26:37.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4ca4fee700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca015d2e0 con 0x7f4ca015cda0 2024-09-13T18:26:37.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4c9ffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ca015cda0 0x7f4ca015ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4c9ffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ca015cda0 0x7f4ca015ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.99:37874/0 (socket says 172.21.15.99:37874) 2024-09-13T18:26:37.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4c9ffff700 1 -- 172.21.15.99:0/3433598698 learned_addr learned my addr 172.21.15.99:0/3433598698 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T18:26:37.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4c9effd700 1 --2- 172.21.15.99:0/3433598698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ca00ceb70 0x7f4ca01f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4c9f7fe700 1 --2- 172.21.15.99:0/3433598698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ca006a520 0x7f4ca0150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4c9ffff700 1 -- 172.21.15.99:0/3433598698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ca00ceb70 msgr2=0x7f4ca01f3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4c9ffff700 1 --2- 172.21.15.99:0/3433598698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ca00ceb70 0x7f4ca01f3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4c9ffff700 1 -- 172.21.15.99:0/3433598698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ca006a520 msgr2=0x7f4ca0150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4c9ffff700 1 --2- 172.21.15.99:0/3433598698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ca006a520 0x7f4ca0150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4c9ffff700 1 -- 172.21.15.99:0/3433598698 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c900094b0 con 0x7f4ca015cda0 2024-09-13T18:26:37.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4c9f7fe700 1 --2- 172.21.15.99:0/3433598698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ca006a520 0x7f4ca0150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:37.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4c9effd700 1 --2- 172.21.15.99:0/3433598698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ca00ceb70 0x7f4ca01f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:26:37.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4c9ffff700 1 --2- 172.21.15.99:0/3433598698 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ca015cda0 0x7f4ca015ecf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4c9000eb60 tx=0x7f4c9000ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:37.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4c97fff700 1 -- 172.21.15.99:0/3433598698 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c900097b0 con 0x7f4ca015cda0 2024-09-13T18:26:37.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4c97fff700 1 -- 172.21.15.99:0/3433598698 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c90004020 con 0x7f4ca015cda0 2024-09-13T18:26:37.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4ca4fee700 1 -- 172.21.15.99:0/3433598698 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c98009570 con 0x7f4ca015cda0 2024-09-13T18:26:37.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4c97fff700 1 -- 172.21.15.99:0/3433598698 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c900043b0 con 0x7f4ca015cda0 2024-09-13T18:26:37.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4ca4fee700 1 -- 172.21.15.99:0/3433598698 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca015d8a0 con 0x7f4ca015cda0 2024-09-13T18:26:37.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4c97fff700 1 -- 172.21.15.99:0/3433598698 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f4c9000cb50 con 0x7f4ca015cda0 2024-09-13T18:26:37.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.749+0000 7f4c97fff700 1 -- 172.21.15.99:0/3433598698 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f4c90013820 con 0x7f4ca015cda0 2024-09-13T18:26:37.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.753+0000 7f4ca4fee700 1 -- 172.21.15.99:0/3433598698 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca015c5a0 con 0x7f4ca015cda0 2024-09-13T18:26:37.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.753+0000 7f4c97fff700 1 -- 172.21.15.99:0/3433598698 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f4c90020060 con 0x7f4ca015cda0 2024-09-13T18:26:37.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.825+0000 7f4ca4fee700 1 -- 172.21.15.99:0/3433598698 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd new", "uuid": "32427ee7-5a8f-4853-b396-051ae9d5a463", "id": 1} v 0) v1 -- 0x7f4ca00cf000 con 0x7f4ca015cda0 2024-09-13T18:26:37.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.841+0000 7f4c97fff700 1 -- 172.21.15.99:0/3433598698 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "32427ee7-5a8f-4853-b396-051ae9d5a463", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4c90017070 con 0x7f4ca015cda0 2024-09-13T18:26:37.847 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-09-13T18:26:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.841+0000 7f4ca4fee700 1 -- 172.21.15.99:0/3433598698 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ca015cda0 msgr2=0x7f4ca015ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.841+0000 7f4ca4fee700 1 --2- 172.21.15.99:0/3433598698 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ca015cda0 0x7f4ca015ecf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4c9000eb60 tx=0x7f4c9000ee70 comp rx=0 tx=0).stop 2024-09-13T18:26:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.841+0000 7f4ca4fee700 1 -- 172.21.15.99:0/3433598698 shutdown_connections 2024-09-13T18:26:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.841+0000 7f4ca4fee700 1 --2- 172.21.15.99:0/3433598698 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ca015cda0 0x7f4ca015ecf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.841+0000 7f4ca4fee700 1 --2- 172.21.15.99:0/3433598698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ca00ceb70 0x7f4ca01f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.841+0000 7f4ca4fee700 1 --2- 172.21.15.99:0/3433598698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ca006a520 0x7f4ca0150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.841+0000 7f4ca4fee700 1 -- 172.21.15.99:0/3433598698 >> 172.21.15.99:0/3433598698 conn(0x7f4ca00d2cb0 msgr2=0x7f4ca00b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.841+0000 7f4ca4fee700 1 -- 172.21.15.99:0/3433598698 shutdown_connections 2024-09-13T18:26:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.841+0000 7f4ca4fee700 1 -- 172.21.15.99:0/3433598698 wait complete. 2024-09-13T18:26:37.863 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new 3a2dd8d4-36cd-4333-9c8a-553f72a85424 2 2024-09-13T18:26:37.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.965+0000 7fa332ca8700 1 Processor -- start 2024-09-13T18:26:37.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.965+0000 7fa332ca8700 1 -- start start 2024-09-13T18:26:37.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa332ca8700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa32c0cddd0 0x7fa32c15d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa332ca8700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa32c0ce210 0x7fa32c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa332ca8700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa32c15d4f0 con 0x7fa32c0cadd0 2024-09-13T18:26:37.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa332ca8700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa32c0ce7b0 con 0x7fa32c0ce210 2024-09-13T18:26:37.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa332ca8700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0cea90 con 0x7fa32c0cddd0 2024-09-13T18:26:37.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa3314a5700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa32c0cddd0 0x7fa32c15d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa3314a5700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa32c0cddd0 0x7fa32c15d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.99:37876/0 (socket says 172.21.15.99:37876) 2024-09-13T18:26:37.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa3314a5700 1 -- 172.21.15.99:0/2461203320 learned_addr learned my addr 172.21.15.99:0/2461203320 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T18:26:37.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa3324a7700 1 --2- 172.21.15.99:0/2461203320 >> v2:172.21.15.44:3300/0 conn(0x7fa32c0ce210 0x7fa32c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa3314a5700 1 -- 172.21.15.99:0/2461203320 >> v2:172.21.15.44:3300/0 conn(0x7fa32c0ce210 msgr2=0x7fa32c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:37.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa3314a5700 1 --2- 172.21.15.99:0/2461203320 >> v2:172.21.15.44:3300/0 conn(0x7fa32c0ce210 0x7fa32c15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa3314a5700 1 -- 172.21.15.99:0/2461203320 >> v1:172.21.15.44:6789/0 conn(0x7fa32c0cadd0 legacy=0x7fa32c0cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa3314a5700 1 -- 172.21.15.99:0/2461203320 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c0ced70 con 0x7fa32c0cddd0 2024-09-13T18:26:37.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa3314a5700 1 --2- 172.21.15.99:0/2461203320 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa32c0cddd0 0x7fa32c15d980 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa31c009910 tx=0x7fa31c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99c51b9fd01f4586 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:37.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa330ca4700 1 -- 172.21.15.99:0/2461203320 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c00ba60 con 0x7fa32c0cddd0 2024-09-13T18:26:37.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa330ca4700 1 -- 172.21.15.99:0/2461203320 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31c00bbc0 con 0x7fa32c0cddd0 2024-09-13T18:26:37.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa330ca4700 1 -- 172.21.15.99:0/2461203320 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c009e60 con 0x7fa32c0cddd0 2024-09-13T18:26:37.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa332ca8700 1 -- 172.21.15.99:0/2461203320 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa32c0cddd0 msgr2=0x7fa32c15d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa332ca8700 1 --2- 172.21.15.99:0/2461203320 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa32c0cddd0 0x7fa32c15d980 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa31c009910 tx=0x7fa31c009c20 comp rx=0 tx=0).stop 2024-09-13T18:26:37.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa332ca8700 1 -- 172.21.15.99:0/2461203320 shutdown_connections 2024-09-13T18:26:37.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa332ca8700 1 --2- 172.21.15.99:0/2461203320 >> v2:172.21.15.44:3300/0 conn(0x7fa32c0ce210 0x7fa32c15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa332ca8700 1 --2- 172.21.15.99:0/2461203320 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa32c0cddd0 0x7fa32c15d980 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa332ca8700 1 -- 172.21.15.99:0/2461203320 >> 172.21.15.99:0/2461203320 conn(0x7fa32c06a4f0 msgr2=0x7fa32c071d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:37.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa332ca8700 1 -- 172.21.15.99:0/2461203320 shutdown_connections 2024-09-13T18:26:37.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.969+0000 7fa332ca8700 1 -- 172.21.15.99:0/2461203320 wait complete. 2024-09-13T18:26:37.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.973+0000 7fa332ca8700 1 Processor -- start 2024-09-13T18:26:37.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.973+0000 7fa332ca8700 1 -- start start 2024-09-13T18:26:37.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.973+0000 7fa332ca8700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa32c0cadd0 0x7fa32c15fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.973+0000 7fa332ca8700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa32c0cddd0 0x7fa32c15c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.973+0000 7fa332ca8700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa32c0ce210 0x7fa32c0aab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.973+0000 7fa332ca8700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c160370 con 0x7fa32c0cddd0 2024-09-13T18:26:37.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.973+0000 7fa332ca8700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c15ed90 con 0x7fa32c0cadd0 2024-09-13T18:26:37.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.973+0000 7fa332ca8700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c15f070 con 0x7fa32c0ce210 2024-09-13T18:26:37.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.973+0000 7fa3324a7700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa32c0ce210 0x7fa32c0aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.973+0000 7fa3324a7700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa32c0ce210 0x7fa32c0aab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.99:37884/0 (socket says 172.21.15.99:37884) 2024-09-13T18:26:37.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.973+0000 7fa3324a7700 1 -- 172.21.15.99:0/2185302893 learned_addr learned my addr 172.21.15.99:0/2185302893 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T18:26:37.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.973+0000 7fa331ca6700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa32c0cadd0 0x7fa32c15fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.973+0000 7fa3314a5700 1 --2- 172.21.15.99:0/2185302893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa32c0cddd0 0x7fa32c15c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.973+0000 7fa3324a7700 1 -- 172.21.15.99:0/2185302893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa32c0cadd0 msgr2=0x7fa32c15fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.973+0000 7fa3324a7700 1 --2- 172.21.15.99:0/2185302893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa32c0cadd0 0x7fa32c15fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.973+0000 7fa3324a7700 1 -- 172.21.15.99:0/2185302893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa32c0cddd0 msgr2=0x7fa32c15c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.973+0000 7fa3324a7700 1 --2- 172.21.15.99:0/2185302893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa32c0cddd0 0x7fa32c15c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.973+0000 7fa3324a7700 1 -- 172.21.15.99:0/2185302893 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31c009570 con 0x7fa32c0ce210 2024-09-13T18:26:37.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.973+0000 7fa3314a5700 1 --2- 172.21.15.99:0/2185302893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa32c0cddd0 0x7fa32c15c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:37.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.977+0000 7fa3324a7700 1 --2- 172.21.15.99:0/2185302893 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa32c0ce210 0x7fa32c0aab90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa324007e60 tx=0x7fa32400e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:37.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.977+0000 7fa3227fc700 1 -- 172.21.15.99:0/2185302893 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32400ede0 con 0x7fa32c0ce210 2024-09-13T18:26:37.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.977+0000 7fa3227fc700 1 -- 172.21.15.99:0/2185302893 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa324014420 con 0x7fa32c0ce210 2024-09-13T18:26:37.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.977+0000 7fa332ca8700 1 -- 172.21.15.99:0/2185302893 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa32c15f350 con 0x7fa32c0ce210 2024-09-13T18:26:37.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.977+0000 7fa3227fc700 1 -- 172.21.15.99:0/2185302893 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3240147d0 con 0x7fa32c0ce210 2024-09-13T18:26:37.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.977+0000 7fa332ca8700 1 -- 172.21.15.99:0/2185302893 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32c15f910 con 0x7fa32c0ce210 2024-09-13T18:26:37.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.977+0000 7fa3227fc700 1 -- 172.21.15.99:0/2185302893 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fa324014c30 con 0x7fa32c0ce210 2024-09-13T18:26:37.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.977+0000 7fa3227fc700 1 -- 172.21.15.99:0/2185302893 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fa32401ed20 con 0x7fa32c0ce210 2024-09-13T18:26:37.984 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:37.977+0000 7f61521f32c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:26:37.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.981+0000 7fa332ca8700 1 -- 172.21.15.99:0/2185302893 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32c15fb00 con 0x7fa32c0ce210 2024-09-13T18:26:37.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:37.981+0000 7fa3227fc700 1 -- 172.21.15.99:0/2185302893 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fa32401e460 con 0x7fa32c0ce210 2024-09-13T18:26:38.042 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:38.037+0000 7f61521f32c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:26:38.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.057+0000 7fa332ca8700 1 -- 172.21.15.99:0/2185302893 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3a2dd8d4-36cd-4333-9c8a-553f72a85424", "id": 2} v 0) v1 -- 0x7fa32c15da00 con 0x7fa32c0ce210 2024-09-13T18:26:38.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.065+0000 7fa3227fc700 1 -- 172.21.15.99:0/2185302893 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3a2dd8d4-36cd-4333-9c8a-553f72a85424", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa32402d0b0 con 0x7fa32c0ce210 2024-09-13T18:26:38.072 INFO:teuthology.orchestra.run.smithi099.stdout:2 2024-09-13T18:26:38.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.069+0000 7fa332ca8700 1 -- 172.21.15.99:0/2185302893 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa32c0ce210 msgr2=0x7fa32c0aab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.069+0000 7fa332ca8700 1 --2- 172.21.15.99:0/2185302893 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa32c0ce210 0x7fa32c0aab90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa324007e60 tx=0x7fa32400e3c0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.069+0000 7fa332ca8700 1 -- 172.21.15.99:0/2185302893 shutdown_connections 2024-09-13T18:26:38.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.069+0000 7fa332ca8700 1 --2- 172.21.15.99:0/2185302893 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa32c0ce210 0x7fa32c0aab90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.069+0000 7fa332ca8700 1 --2- 172.21.15.99:0/2185302893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa32c0cddd0 0x7fa32c15c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.069+0000 7fa332ca8700 1 --2- 172.21.15.99:0/2185302893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa32c0cadd0 0x7fa32c15fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.069+0000 7fa332ca8700 1 -- 172.21.15.99:0/2185302893 >> 172.21.15.99:0/2185302893 conn(0x7fa32c06a4f0 msgr2=0x7fa32c0d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:38.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.069+0000 7fa332ca8700 1 -- 172.21.15.99:0/2185302893 shutdown_connections 2024-09-13T18:26:38.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.069+0000 7fa332ca8700 1 -- 172.21.15.99:0/2185302893 wait complete. 2024-09-13T18:26:38.086 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new b98b9882-0680-4773-a86d-d9af6ad2c77b 3 2024-09-13T18:26:38.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f0814c90700 1 Processor -- start 2024-09-13T18:26:38.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f0814c90700 1 -- start start 2024-09-13T18:26:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f0814c90700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f08100cc5d0 0x7f081015dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f0814c90700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f08100b1fb0 0x7f081015e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f0814c90700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08100b2ff0 con 0x7f0810071a70 2024-09-13T18:26:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f0814c90700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08100b2750 con 0x7f08100b1fb0 2024-09-13T18:26:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f0814c90700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08100b2a30 con 0x7f08100cc5d0 2024-09-13T18:26:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f080f7fe700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f08100cc5d0 0x7f081015dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f080f7fe700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f08100cc5d0 0x7f081015dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.99:37900/0 (socket says 172.21.15.99:37900) 2024-09-13T18:26:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f080f7fe700 1 -- 172.21.15.99:0/4223357275 learned_addr learned my addr 172.21.15.99:0/4223357275 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T18:26:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f080effd700 1 --2- 172.21.15.99:0/4223357275 >> v2:172.21.15.44:3300/0 conn(0x7f08100b1fb0 0x7f081015e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f080f7fe700 1 -- 172.21.15.99:0/4223357275 >> v2:172.21.15.44:3300/0 conn(0x7f08100b1fb0 msgr2=0x7f081015e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f080f7fe700 1 --2- 172.21.15.99:0/4223357275 >> v2:172.21.15.44:3300/0 conn(0x7f08100b1fb0 0x7f081015e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f080f7fe700 1 -- 172.21.15.99:0/4223357275 >> v1:172.21.15.44:6789/0 conn(0x7f0810071a70 legacy=0x7f08100cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:38.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f080f7fe700 1 -- 172.21.15.99:0/4223357275 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08100b2d10 con 0x7f08100cc5d0 2024-09-13T18:26:38.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f080f7fe700 1 --2- 172.21.15.99:0/4223357275 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f08100cc5d0 0x7f081015dbd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0800009910 tx=0x7f0800009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=284a1af0913587a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:38.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f080e7fc700 1 -- 172.21.15.99:0/4223357275 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800004230 con 0x7f08100cc5d0 2024-09-13T18:26:38.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f080e7fc700 1 -- 172.21.15.99:0/4223357275 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0800004390 con 0x7f08100cc5d0 2024-09-13T18:26:38.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f080e7fc700 1 -- 172.21.15.99:0/4223357275 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800009e60 con 0x7f08100cc5d0 2024-09-13T18:26:38.196 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-09-13T18:26:38.192+0000 7fb7952982c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:26:38.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f0814c90700 1 -- 172.21.15.99:0/4223357275 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f08100cc5d0 msgr2=0x7f081015dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f0814c90700 1 --2- 172.21.15.99:0/4223357275 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f08100cc5d0 0x7f081015dbd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0800009910 tx=0x7f0800009c20 comp rx=0 tx=0).stop 2024-09-13T18:26:38.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f0814c90700 1 -- 172.21.15.99:0/4223357275 shutdown_connections 2024-09-13T18:26:38.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f0814c90700 1 --2- 172.21.15.99:0/4223357275 >> v2:172.21.15.44:3300/0 conn(0x7f08100b1fb0 0x7f081015e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f0814c90700 1 --2- 172.21.15.99:0/4223357275 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f08100cc5d0 0x7f081015dbd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f0814c90700 1 -- 172.21.15.99:0/4223357275 >> 172.21.15.99:0/4223357275 conn(0x7f08100cf630 msgr2=0x7f0810070350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:38.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f0814c90700 1 -- 172.21.15.99:0/4223357275 shutdown_connections 2024-09-13T18:26:38.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.189+0000 7f0814c90700 1 -- 172.21.15.99:0/4223357275 wait complete. 2024-09-13T18:26:38.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f0814c90700 1 Processor -- start 2024-09-13T18:26:38.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f0814c90700 1 -- start start 2024-09-13T18:26:38.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f0814c90700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0810071a70 0x7f081014ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f0814c90700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08100b1fb0 0x7f081013e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f0814c90700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f08100cc5d0 0x7f08101534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f0814c90700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0810151c70 con 0x7f0810071a70 2024-09-13T18:26:38.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f0814c90700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0810151360 con 0x7f08100b1fb0 2024-09-13T18:26:38.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f0814c90700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081014f1a0 con 0x7f08100cc5d0 2024-09-13T18:26:38.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f080effd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08100b1fb0 0x7f081013e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f080ffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f08100cc5d0 0x7f08101534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f080effd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08100b1fb0 0x7f081013e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33830/0 (socket says 172.21.15.99:33830) 2024-09-13T18:26:38.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f080effd700 1 -- 172.21.15.99:0/2597282704 learned_addr learned my addr 172.21.15.99:0/2597282704 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T18:26:38.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f080f7fe700 1 --2- 172.21.15.99:0/2597282704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0810071a70 0x7f081014ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f080effd700 1 -- 172.21.15.99:0/2597282704 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f08100cc5d0 msgr2=0x7f08101534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f080effd700 1 --2- 172.21.15.99:0/2597282704 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f08100cc5d0 0x7f08101534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f080effd700 1 -- 172.21.15.99:0/2597282704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0810071a70 msgr2=0x7f081014ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f080effd700 1 --2- 172.21.15.99:0/2597282704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0810071a70 0x7f081014ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f080effd700 1 -- 172.21.15.99:0/2597282704 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0800009570 con 0x7f08100b1fb0 2024-09-13T18:26:38.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f080ffff700 1 --2- 172.21.15.99:0/2597282704 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f08100cc5d0 0x7f08101534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:26:38.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f080effd700 1 --2- 172.21.15.99:0/2597282704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08100b1fb0 0x7f081013e9b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f080400e7e0 tx=0x7f080400eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:38.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f07f7fff700 1 -- 172.21.15.99:0/2597282704 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0804004230 con 0x7f08100b1fb0 2024-09-13T18:26:38.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f07f7fff700 1 -- 172.21.15.99:0/2597282704 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0804004390 con 0x7f08100b1fb0 2024-09-13T18:26:38.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f07f7fff700 1 -- 172.21.15.99:0/2597282704 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08040036c0 con 0x7f08100b1fb0 2024-09-13T18:26:38.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f0814c90700 1 -- 172.21.15.99:0/2597282704 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f081015c440 con 0x7f08100b1fb0 2024-09-13T18:26:38.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f0814c90700 1 -- 172.21.15.99:0/2597282704 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0810151890 con 0x7f08100b1fb0 2024-09-13T18:26:38.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f07f7fff700 1 -- 172.21.15.99:0/2597282704 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f0804003b20 con 0x7f08100b1fb0 2024-09-13T18:26:38.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.193+0000 7f07f7fff700 1 -- 172.21.15.99:0/2597282704 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f080401dd20 con 0x7f08100b1fb0 2024-09-13T18:26:38.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.197+0000 7f0814c90700 1 -- 172.21.15.99:0/2597282704 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f081015e1f0 con 0x7f08100b1fb0 2024-09-13T18:26:38.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.201+0000 7f07f7fff700 1 -- 172.21.15.99:0/2597282704 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f080400c070 con 0x7f08100b1fb0 2024-09-13T18:26:38.221 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:38.217+0000 7f61521f32c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:26:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.277+0000 7f0814c90700 1 -- 172.21.15.99:0/2597282704 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b98b9882-0680-4773-a86d-d9af6ad2c77b", "id": 3} v 0) v1 -- 0x7f08100af280 con 0x7f08100b1fb0 2024-09-13T18:26:38.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.285+0000 7f07f7fff700 1 -- 172.21.15.99:0/2597282704 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b98b9882-0680-4773-a86d-d9af6ad2c77b", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f080400f040 con 0x7f08100b1fb0 2024-09-13T18:26:38.291 INFO:teuthology.orchestra.run.smithi099.stdout:3 2024-09-13T18:26:38.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.285+0000 7f0814c90700 1 -- 172.21.15.99:0/2597282704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08100b1fb0 msgr2=0x7f081013e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.285+0000 7f0814c90700 1 --2- 172.21.15.99:0/2597282704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08100b1fb0 0x7f081013e9b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f080400e7e0 tx=0x7f080400eaf0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.285+0000 7f0814c90700 1 -- 172.21.15.99:0/2597282704 shutdown_connections 2024-09-13T18:26:38.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.285+0000 7f0814c90700 1 --2- 172.21.15.99:0/2597282704 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f08100cc5d0 0x7f08101534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.285+0000 7f0814c90700 1 --2- 172.21.15.99:0/2597282704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08100b1fb0 0x7f081013e9b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.285+0000 7f0814c90700 1 --2- 172.21.15.99:0/2597282704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0810071a70 0x7f081014ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.285+0000 7f0814c90700 1 -- 172.21.15.99:0/2597282704 >> 172.21.15.99:0/2597282704 conn(0x7f08100cf630 msgr2=0x7f0810157710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:38.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.285+0000 7f0814c90700 1 -- 172.21.15.99:0/2597282704 shutdown_connections 2024-09-13T18:26:38.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.285+0000 7f0814c90700 1 -- 172.21.15.99:0/2597282704 wait complete. 2024-09-13T18:26:38.307 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963 4 2024-09-13T18:26:38.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.413+0000 7f4521483700 1 Processor -- start 2024-09-13T18:26:38.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.413+0000 7f4521483700 1 -- start start 2024-09-13T18:26:38.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f4521483700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f451c06a9e0 0x7f451c0cc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f4521483700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f451c0b5540 con 0x7f451c0ce9d0 2024-09-13T18:26:38.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f4521483700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f451c0cc9a0 con 0x7f451c06adc0 2024-09-13T18:26:38.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f4521483700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f451c0b5790 con 0x7f451c06a9e0 2024-09-13T18:26:38.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f451a7fc700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f451c06adc0 0x7f451c15bc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:48778/0 (socket says 172.21.15.99:48778) 2024-09-13T18:26:38.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f451a7fc700 1 -- 172.21.15.99:0/1365665314 learned_addr learned my addr 172.21.15.99:0/1365665314 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T18:26:38.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f451affd700 1 --2- 172.21.15.99:0/1365665314 >> v2:172.21.15.99:3300/0 conn(0x7f451c06a9e0 0x7f451c0cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f4519ffb700 1 -- 172.21.15.99:0/1365665314 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202705359 0 0) 0x7f451c0cc9a0 con 0x7f451c06adc0 2024-09-13T18:26:38.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f4519ffb700 1 -- 172.21.15.99:0/1365665314 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45080035d0 con 0x7f451c06adc0 2024-09-13T18:26:38.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f451affd700 1 -- 172.21.15.99:0/1365665314 >> v1:172.21.15.99:6789/0 conn(0x7f451c06adc0 legacy=0x7f451c15bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f451affd700 1 -- 172.21.15.99:0/1365665314 >> v1:172.21.15.44:6789/0 conn(0x7f451c0ce9d0 legacy=0x7f451c0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f451affd700 1 -- 172.21.15.99:0/1365665314 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c0b5a70 con 0x7f451c06a9e0 2024-09-13T18:26:38.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f451affd700 1 --2- 172.21.15.99:0/1365665314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f451c06a9e0 0x7f451c0cc460 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f450c009850 tx=0x7f450c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9497381d556fb4fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:38.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f4519ffb700 1 -- 172.21.15.99:0/1365665314 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c011830 con 0x7f451c06a9e0 2024-09-13T18:26:38.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f4519ffb700 1 -- 172.21.15.99:0/1365665314 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450c011990 con 0x7f451c06a9e0 2024-09-13T18:26:38.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f4519ffb700 1 -- 172.21.15.99:0/1365665314 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c011d40 con 0x7f451c06a9e0 2024-09-13T18:26:38.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f4521483700 1 -- 172.21.15.99:0/1365665314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f451c06a9e0 msgr2=0x7f451c0cc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f4521483700 1 --2- 172.21.15.99:0/1365665314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f451c06a9e0 0x7f451c0cc460 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f450c009850 tx=0x7f450c009b60 comp rx=0 tx=0).stop 2024-09-13T18:26:38.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f4521483700 1 -- 172.21.15.99:0/1365665314 shutdown_connections 2024-09-13T18:26:38.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f4521483700 1 --2- 172.21.15.99:0/1365665314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f451c06a9e0 0x7f451c0cc460 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f4521483700 1 -- 172.21.15.99:0/1365665314 >> 172.21.15.99:0/1365665314 conn(0x7f451c070d00 msgr2=0x7f451c071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:38.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f4521483700 1 -- 172.21.15.99:0/1365665314 shutdown_connections 2024-09-13T18:26:38.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f4521483700 1 -- 172.21.15.99:0/1365665314 wait complete. 2024-09-13T18:26:38.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f4521483700 1 Processor -- start 2024-09-13T18:26:38.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.417+0000 7f4521483700 1 -- start start 2024-09-13T18:26:38.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f4521483700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f451c06a9e0 0x7f451c0cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f4521483700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f451c06adc0 0x7f451c1e6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f4521483700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f451c0ce9d0 0x7f451c149360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f4521483700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c1e2ea0 con 0x7f451c06a9e0 2024-09-13T18:26:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f4521483700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c1e3140 con 0x7f451c0ce9d0 2024-09-13T18:26:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f4521483700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451c1e72e0 con 0x7f451c06adc0 2024-09-13T18:26:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f451b7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f451c0ce9d0 0x7f451c149360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f451b7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f451c0ce9d0 0x7f451c149360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33852/0 (socket says 172.21.15.99:33852) 2024-09-13T18:26:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f451b7fe700 1 -- 172.21.15.99:0/2853437234 learned_addr learned my addr 172.21.15.99:0/2853437234 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T18:26:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f451a7fc700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f451c06adc0 0x7f451c1e6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f451affd700 1 --2- 172.21.15.99:0/2853437234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f451c06a9e0 0x7f451c0cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f451b7fe700 1 -- 172.21.15.99:0/2853437234 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f451c06adc0 msgr2=0x7f451c1e6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f451b7fe700 1 --2- 172.21.15.99:0/2853437234 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f451c06adc0 0x7f451c1e6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f451b7fe700 1 -- 172.21.15.99:0/2853437234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f451c06a9e0 msgr2=0x7f451c0cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f451b7fe700 1 --2- 172.21.15.99:0/2853437234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f451c06a9e0 0x7f451c0cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f451b7fe700 1 -- 172.21.15.99:0/2853437234 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450c0094b0 con 0x7f451c0ce9d0 2024-09-13T18:26:38.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f451b7fe700 1 --2- 172.21.15.99:0/2853437234 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f451c0ce9d0 0x7f451c149360 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f451400cb50 tx=0x7f451400ce60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:38.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f45137fe700 1 -- 172.21.15.99:0/2853437234 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4514003c20 con 0x7f451c0ce9d0 2024-09-13T18:26:38.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f45137fe700 1 -- 172.21.15.99:0/2853437234 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4514003d80 con 0x7f451c0ce9d0 2024-09-13T18:26:38.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f45137fe700 1 -- 172.21.15.99:0/2853437234 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451400aa20 con 0x7f451c0ce9d0 2024-09-13T18:26:38.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f4521483700 1 -- 172.21.15.99:0/2853437234 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f451c1e7580 con 0x7f451c0ce9d0 2024-09-13T18:26:38.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f4521483700 1 -- 172.21.15.99:0/2853437234 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451c1e7b40 con 0x7f451c0ce9d0 2024-09-13T18:26:38.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f45137fe700 1 -- 172.21.15.99:0/2853437234 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f45140050d0 con 0x7f451c0ce9d0 2024-09-13T18:26:38.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f45137fe700 1 -- 172.21.15.99:0/2853437234 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f4514005890 con 0x7f451c0ce9d0 2024-09-13T18:26:38.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.421+0000 7f4521483700 1 -- 172.21.15.99:0/2853437234 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f451c04e7c0 con 0x7f451c0ce9d0 2024-09-13T18:26:38.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.425+0000 7f45137fe700 1 -- 172.21.15.99:0/2853437234 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f4514005380 con 0x7f451c0ce9d0 2024-09-13T18:26:38.455 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:38.449+0000 7f61521f32c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:26:38.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.497+0000 7f4521483700 1 -- 172.21.15.99:0/2853437234 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963", "id": 4} v 0) v1 -- 0x7f451c1e7d00 con 0x7f451c0ce9d0 2024-09-13T18:26:38.507 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:38.501+0000 7f61521f32c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:26:38.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.509+0000 7f45137fe700 1 -- 172.21.15.99:0/2853437234 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4514005520 con 0x7f451c0ce9d0 2024-09-13T18:26:38.513 INFO:teuthology.orchestra.run.smithi099.stdout:4 2024-09-13T18:26:38.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.509+0000 7f4521483700 1 -- 172.21.15.99:0/2853437234 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f451c0ce9d0 msgr2=0x7f451c149360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.509+0000 7f4521483700 1 --2- 172.21.15.99:0/2853437234 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f451c0ce9d0 0x7f451c149360 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f451400cb50 tx=0x7f451400ce60 comp rx=0 tx=0).stop 2024-09-13T18:26:38.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.509+0000 7f4521483700 1 -- 172.21.15.99:0/2853437234 shutdown_connections 2024-09-13T18:26:38.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.509+0000 7f4521483700 1 --2- 172.21.15.99:0/2853437234 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f451c0ce9d0 0x7f451c149360 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.509+0000 7f4521483700 1 --2- 172.21.15.99:0/2853437234 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f451c06adc0 0x7f451c1e6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.509+0000 7f4521483700 1 --2- 172.21.15.99:0/2853437234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f451c06a9e0 0x7f451c0cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.509+0000 7f4521483700 1 -- 172.21.15.99:0/2853437234 >> 172.21.15.99:0/2853437234 conn(0x7f451c070d00 msgr2=0x7f451c072020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:38.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.509+0000 7f4521483700 1 -- 172.21.15.99:0/2853437234 shutdown_connections 2024-09-13T18:26:38.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.509+0000 7f4521483700 1 -- 172.21.15.99:0/2853437234 wait complete. 2024-09-13T18:26:38.527 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new c868d3e9-dad7-47fe-8458-e3c50f82acc0 5 2024-09-13T18:26:38.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.625+0000 7fb75aee1700 1 Processor -- start 2024-09-13T18:26:38.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.625+0000 7fb75aee1700 1 -- start start 2024-09-13T18:26:38.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.625+0000 7fb75aee1700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb75406dbd0 0x7fb7540cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.625+0000 7fb75aee1700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7540b2880 0x7fb7540703b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.625+0000 7fb75aee1700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7540ce560 con 0x7fb7540ce100 2024-09-13T18:26:38.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.625+0000 7fb75aee1700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7540b2cf0 con 0x7fb75406dbd0 2024-09-13T18:26:38.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.625+0000 7fb75aee1700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75406dfb0 con 0x7fb7540b2880 2024-09-13T18:26:38.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.625+0000 7fb75a6e0700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7540b2880 0x7fb7540703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.625+0000 7fb759edf700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb75406dbd0 0x7fb7540cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.625+0000 7fb75a6e0700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7540b2880 0x7fb7540703b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.99:37936/0 (socket says 172.21.15.99:37936) 2024-09-13T18:26:38.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.625+0000 7fb75a6e0700 1 -- 172.21.15.99:0/2130699686 learned_addr learned my addr 172.21.15.99:0/2130699686 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T18:26:38.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.625+0000 7fb75a6e0700 1 -- 172.21.15.99:0/2130699686 >> v2:172.21.15.99:3300/0 conn(0x7fb75406dbd0 msgr2=0x7fb7540cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:38.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.625+0000 7fb75a6e0700 1 --2- 172.21.15.99:0/2130699686 >> v2:172.21.15.99:3300/0 conn(0x7fb75406dbd0 0x7fb7540cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.625+0000 7fb75a6e0700 1 -- 172.21.15.99:0/2130699686 >> v1:172.21.15.44:6789/0 conn(0x7fb7540ce100 legacy=0x7fb7540b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:38.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.625+0000 7fb75a6e0700 1 -- 172.21.15.99:0/2130699686 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7540b2ee0 con 0x7fb7540b2880 2024-09-13T18:26:38.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.625+0000 7fb759edf700 1 --2- 172.21.15.99:0/2130699686 >> v2:172.21.15.99:3300/0 conn(0x7fb75406dbd0 0x7fb7540cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:26:38.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.625+0000 7fb75a6e0700 1 --2- 172.21.15.99:0/2130699686 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7540b2880 0x7fb7540703b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb74c009e50 tx=0x7fb74c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fea07653b6fd8b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:38.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.625+0000 7fb758edd700 1 -- 172.21.15.99:0/2130699686 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c00e070 con 0x7fb7540b2880 2024-09-13T18:26:38.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.625+0000 7fb758edd700 1 -- 172.21.15.99:0/2130699686 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74c00b910 con 0x7fb7540b2880 2024-09-13T18:26:38.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.625+0000 7fb758edd700 1 -- 172.21.15.99:0/2130699686 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c00bcc0 con 0x7fb7540b2880 2024-09-13T18:26:38.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.625+0000 7fb75aee1700 1 -- 172.21.15.99:0/2130699686 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7540b2880 msgr2=0x7fb7540703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.625+0000 7fb75aee1700 1 --2- 172.21.15.99:0/2130699686 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7540b2880 0x7fb7540703b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb74c009e50 tx=0x7fb74c00b330 comp rx=0 tx=0).stop 2024-09-13T18:26:38.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb75aee1700 1 -- 172.21.15.99:0/2130699686 shutdown_connections 2024-09-13T18:26:38.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb75aee1700 1 --2- 172.21.15.99:0/2130699686 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7540b2880 0x7fb7540703b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb75aee1700 1 --2- 172.21.15.99:0/2130699686 >> v2:172.21.15.99:3300/0 conn(0x7fb75406dbd0 0x7fb7540cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb75aee1700 1 -- 172.21.15.99:0/2130699686 >> 172.21.15.99:0/2130699686 conn(0x7fb7540cba60 msgr2=0x7fb7540cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:38.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb75aee1700 1 -- 172.21.15.99:0/2130699686 shutdown_connections 2024-09-13T18:26:38.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb75aee1700 1 -- 172.21.15.99:0/2130699686 wait complete. 2024-09-13T18:26:38.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb75aee1700 1 Processor -- start 2024-09-13T18:26:38.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb75aee1700 1 -- start start 2024-09-13T18:26:38.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb75aee1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb75406dbd0 0x7fb75412bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb75aee1700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7540b2880 0x7fb7541410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb75aee1700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7540ce100 0x7fb7541415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb75aee1700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75406b5d0 con 0x7fb75406dbd0 2024-09-13T18:26:38.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb75aee1700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb754143fb0 con 0x7fb7540ce100 2024-09-13T18:26:38.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb75aee1700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb754144290 con 0x7fb7540b2880 2024-09-13T18:26:38.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb7596de700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7540b2880 0x7fb7541410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb75a6e0700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7540ce100 0x7fb7541415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb7596de700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7540b2880 0x7fb7541410b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.99:37948/0 (socket says 172.21.15.99:37948) 2024-09-13T18:26:38.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb7596de700 1 -- 172.21.15.99:0/2496259954 learned_addr learned my addr 172.21.15.99:0/2496259954 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T18:26:38.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb759edf700 1 --2- 172.21.15.99:0/2496259954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb75406dbd0 0x7fb75412bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb7596de700 1 -- 172.21.15.99:0/2496259954 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7540ce100 msgr2=0x7fb7541415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb7596de700 1 --2- 172.21.15.99:0/2496259954 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7540ce100 0x7fb7541415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb7596de700 1 -- 172.21.15.99:0/2496259954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb75406dbd0 msgr2=0x7fb75412bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb7596de700 1 --2- 172.21.15.99:0/2496259954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb75406dbd0 0x7fb75412bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb7596de700 1 -- 172.21.15.99:0/2496259954 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7500094b0 con 0x7fb7540b2880 2024-09-13T18:26:38.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.629+0000 7fb759edf700 1 --2- 172.21.15.99:0/2496259954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb75406dbd0 0x7fb75412bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:38.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.633+0000 7fb7596de700 1 --2- 172.21.15.99:0/2496259954 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7540b2880 0x7fb7541410b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb74400c500 tx=0x7fb74400c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:38.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.633+0000 7fb74a7fc700 1 -- 172.21.15.99:0/2496259954 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7440052d0 con 0x7fb7540b2880 2024-09-13T18:26:38.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.633+0000 7fb75aee1700 1 -- 172.21.15.99:0/2496259954 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb74c009b30 con 0x7fb7540b2880 2024-09-13T18:26:38.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.633+0000 7fb75aee1700 1 -- 172.21.15.99:0/2496259954 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75406bb00 con 0x7fb7540b2880 2024-09-13T18:26:38.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.633+0000 7fb74a7fc700 1 -- 172.21.15.99:0/2496259954 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb744005430 con 0x7fb7540b2880 2024-09-13T18:26:38.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.633+0000 7fb74a7fc700 1 -- 172.21.15.99:0/2496259954 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7440055a0 con 0x7fb7540b2880 2024-09-13T18:26:38.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.633+0000 7fb74a7fc700 1 -- 172.21.15.99:0/2496259954 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fb744003be0 con 0x7fb7540b2880 2024-09-13T18:26:38.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.633+0000 7fb74a7fc700 1 -- 172.21.15.99:0/2496259954 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fb7440129a0 con 0x7fb7540b2880 2024-09-13T18:26:38.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.633+0000 7fb75aee1700 1 -- 172.21.15.99:0/2496259954 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb73c005310 con 0x7fb7540b2880 2024-09-13T18:26:38.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.637+0000 7fb74a7fc700 1 -- 172.21.15.99:0/2496259954 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fb744017070 con 0x7fb7540b2880 2024-09-13T18:26:38.695 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:38.689+0000 7f61521f32c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:26:38.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.709+0000 7fb75aee1700 1 -- 172.21.15.99:0/2496259954 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c868d3e9-dad7-47fe-8458-e3c50f82acc0", "id": 5} v 0) v1 -- 0x7fb73c005930 con 0x7fb7540b2880 2024-09-13T18:26:38.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.717+0000 7fb74a7fc700 1 -- 172.21.15.99:0/2496259954 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c868d3e9-dad7-47fe-8458-e3c50f82acc0", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb7440011a0 con 0x7fb7540b2880 2024-09-13T18:26:38.724 INFO:teuthology.orchestra.run.smithi099.stdout:5 2024-09-13T18:26:38.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.721+0000 7fb75aee1700 1 -- 172.21.15.99:0/2496259954 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7540b2880 msgr2=0x7fb7541410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.721+0000 7fb75aee1700 1 --2- 172.21.15.99:0/2496259954 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7540b2880 0x7fb7541410b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb74400c500 tx=0x7fb74400c810 comp rx=0 tx=0).stop 2024-09-13T18:26:38.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.721+0000 7fb75aee1700 1 -- 172.21.15.99:0/2496259954 shutdown_connections 2024-09-13T18:26:38.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.721+0000 7fb75aee1700 1 --2- 172.21.15.99:0/2496259954 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7540ce100 0x7fb7541415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.721+0000 7fb75aee1700 1 --2- 172.21.15.99:0/2496259954 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7540b2880 0x7fb7541410b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.721+0000 7fb75aee1700 1 --2- 172.21.15.99:0/2496259954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb75406dbd0 0x7fb75412bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.721+0000 7fb75aee1700 1 -- 172.21.15.99:0/2496259954 >> 172.21.15.99:0/2496259954 conn(0x7fb7540cba60 msgr2=0x7fb7541403e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:38.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.721+0000 7fb75aee1700 1 -- 172.21.15.99:0/2496259954 shutdown_connections 2024-09-13T18:26:38.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.721+0000 7fb75aee1700 1 -- 172.21.15.99:0/2496259954 wait complete. 2024-09-13T18:26:38.741 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new ad63ac00-986c-42e5-b9c7-16d980cda2ec 6 2024-09-13T18:26:38.758 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:38.753+0000 7f61521f32c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:26:38.823 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:38.817+0000 7f61521f32c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:26:38.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.841+0000 7f84de102700 1 Processor -- start 2024-09-13T18:26:38.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.841+0000 7f84de102700 1 -- start start 2024-09-13T18:26:38.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84de102700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f84d815a930 0x7f84d8071d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84de102700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f84d806aba0 0x7f84d806b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84de102700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d815ad10 con 0x7f84d80722b0 2024-09-13T18:26:38.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84de102700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d80cd0a0 con 0x7f84d806aba0 2024-09-13T18:26:38.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84de102700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d806b570 con 0x7f84d815a930 2024-09-13T18:26:38.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84dd100700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f84d815a930 0x7f84d8071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84dd100700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f84d815a930 0x7f84d8071d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.99:37950/0 (socket says 172.21.15.99:37950) 2024-09-13T18:26:38.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84dd100700 1 -- 172.21.15.99:0/1153617703 learned_addr learned my addr 172.21.15.99:0/1153617703 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T18:26:38.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84dd901700 1 --2- 172.21.15.99:0/1153617703 >> v2:172.21.15.44:3300/0 conn(0x7f84d806aba0 0x7f84d806b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84dd100700 1 -- 172.21.15.99:0/1153617703 >> v2:172.21.15.44:3300/0 conn(0x7f84d806aba0 msgr2=0x7f84d806b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:38.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84dd100700 1 --2- 172.21.15.99:0/1153617703 >> v2:172.21.15.44:3300/0 conn(0x7f84d806aba0 0x7f84d806b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84dd100700 1 -- 172.21.15.99:0/1153617703 >> v1:172.21.15.44:6789/0 conn(0x7f84d80722b0 legacy=0x7f84d80cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:38.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84dd100700 1 -- 172.21.15.99:0/1153617703 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d80718e0 con 0x7f84d815a930 2024-09-13T18:26:38.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84dd100700 1 --2- 172.21.15.99:0/1153617703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f84d815a930 0x7f84d8071d70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009910 tx=0x7f84d4009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e430ef6a80ac707d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:38.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84cffff700 1 -- 172.21.15.99:0/1153617703 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d4004230 con 0x7f84d815a930 2024-09-13T18:26:38.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84cffff700 1 -- 172.21.15.99:0/1153617703 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d4004390 con 0x7f84d815a930 2024-09-13T18:26:38.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84cffff700 1 -- 172.21.15.99:0/1153617703 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d4009e60 con 0x7f84d815a930 2024-09-13T18:26:38.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84de102700 1 -- 172.21.15.99:0/1153617703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f84d815a930 msgr2=0x7f84d8071d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84de102700 1 --2- 172.21.15.99:0/1153617703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f84d815a930 0x7f84d8071d70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009910 tx=0x7f84d4009c20 comp rx=0 tx=0).stop 2024-09-13T18:26:38.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84de102700 1 -- 172.21.15.99:0/1153617703 shutdown_connections 2024-09-13T18:26:38.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84de102700 1 --2- 172.21.15.99:0/1153617703 >> v2:172.21.15.44:3300/0 conn(0x7f84d806aba0 0x7f84d806b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84de102700 1 --2- 172.21.15.99:0/1153617703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f84d815a930 0x7f84d8071d70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84de102700 1 -- 172.21.15.99:0/1153617703 >> 172.21.15.99:0/1153617703 conn(0x7f84d80b1810 msgr2=0x7f84d80b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:38.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84de102700 1 -- 172.21.15.99:0/1153617703 shutdown_connections 2024-09-13T18:26:38.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.845+0000 7f84de102700 1 -- 172.21.15.99:0/1153617703 wait complete. 2024-09-13T18:26:38.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84de102700 1 Processor -- start 2024-09-13T18:26:38.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84de102700 1 -- start start 2024-09-13T18:26:38.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84de102700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f84d806aba0 0x7f84d80abee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84de102700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84d80722b0 0x7f84d814a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84de102700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84d815a930 0x7f84d80a9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84de102700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d81570b0 con 0x7f84d815a930 2024-09-13T18:26:38.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84de102700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d814a900 con 0x7f84d80722b0 2024-09-13T18:26:38.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84de102700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d80a9350 con 0x7f84d806aba0 2024-09-13T18:26:38.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84dd100700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f84d806aba0 0x7f84d80abee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84dd100700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f84d806aba0 0x7f84d80abee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.99:37966/0 (socket says 172.21.15.99:37966) 2024-09-13T18:26:38.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84dd100700 1 -- 172.21.15.99:0/3027101178 learned_addr learned my addr 172.21.15.99:0/3027101178 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T18:26:38.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84dc8ff700 1 --2- 172.21.15.99:0/3027101178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84d80722b0 0x7f84d814a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84dd901700 1 --2- 172.21.15.99:0/3027101178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84d815a930 0x7f84d80a9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84dd100700 1 -- 172.21.15.99:0/3027101178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84d80722b0 msgr2=0x7f84d814a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84dd100700 1 --2- 172.21.15.99:0/3027101178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84d80722b0 0x7f84d814a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84dd100700 1 -- 172.21.15.99:0/3027101178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84d815a930 msgr2=0x7f84d80a9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84dd100700 1 --2- 172.21.15.99:0/3027101178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84d815a930 0x7f84d80a9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84dd100700 1 -- 172.21.15.99:0/3027101178 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d4009570 con 0x7f84d806aba0 2024-09-13T18:26:38.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84dc8ff700 1 --2- 172.21.15.99:0/3027101178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84d80722b0 0x7f84d814a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:26:38.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84dd901700 1 --2- 172.21.15.99:0/3027101178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84d815a930 0x7f84d80a9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:38.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84dd100700 1 --2- 172.21.15.99:0/3027101178 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f84d806aba0 0x7f84d80abee0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f84d4000c00 tx=0x7f84d4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:38.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84cdffb700 1 -- 172.21.15.99:0/3027101178 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d400bd00 con 0x7f84d806aba0 2024-09-13T18:26:38.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84cdffb700 1 -- 172.21.15.99:0/3027101178 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d401f070 con 0x7f84d806aba0 2024-09-13T18:26:38.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84de102700 1 -- 172.21.15.99:0/3027101178 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d8156a60 con 0x7f84d806aba0 2024-09-13T18:26:38.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84cdffb700 1 -- 172.21.15.99:0/3027101178 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d4003900 con 0x7f84d806aba0 2024-09-13T18:26:38.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84de102700 1 -- 172.21.15.99:0/3027101178 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d80aa430 con 0x7f84d806aba0 2024-09-13T18:26:38.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84cdffb700 1 -- 172.21.15.99:0/3027101178 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f84d4021030 con 0x7f84d806aba0 2024-09-13T18:26:38.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.849+0000 7f84cdffb700 1 -- 172.21.15.99:0/3027101178 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f84d400be60 con 0x7f84d806aba0 2024-09-13T18:26:38.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.853+0000 7f84de102700 1 -- 172.21.15.99:0/3027101178 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d81568c0 con 0x7f84d806aba0 2024-09-13T18:26:38.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.853+0000 7f84cdffb700 1 -- 172.21.15.99:0/3027101178 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f84d81568c0 con 0x7f84d806aba0 2024-09-13T18:26:38.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.929+0000 7f84de102700 1 -- 172.21.15.99:0/3027101178 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ad63ac00-986c-42e5-b9c7-16d980cda2ec", "id": 6} v 0) v1 -- 0x7f84d806b030 con 0x7f84d806aba0 2024-09-13T18:26:38.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.937+0000 7f84cdffb700 1 -- 172.21.15.99:0/3027101178 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ad63ac00-986c-42e5-b9c7-16d980cda2ec", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f84d4003d60 con 0x7f84d806aba0 2024-09-13T18:26:38.943 INFO:teuthology.orchestra.run.smithi099.stdout:6 2024-09-13T18:26:38.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.937+0000 7f84de102700 1 -- 172.21.15.99:0/3027101178 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f84d806aba0 msgr2=0x7f84d80abee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.937+0000 7f84de102700 1 --2- 172.21.15.99:0/3027101178 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f84d806aba0 0x7f84d80abee0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f84d4000c00 tx=0x7f84d4004770 comp rx=0 tx=0).stop 2024-09-13T18:26:38.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.937+0000 7f84de102700 1 -- 172.21.15.99:0/3027101178 shutdown_connections 2024-09-13T18:26:38.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.937+0000 7f84de102700 1 --2- 172.21.15.99:0/3027101178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84d815a930 0x7f84d80a9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.937+0000 7f84de102700 1 --2- 172.21.15.99:0/3027101178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84d80722b0 0x7f84d814a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.937+0000 7f84de102700 1 --2- 172.21.15.99:0/3027101178 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f84d806aba0 0x7f84d80abee0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.937+0000 7f84de102700 1 -- 172.21.15.99:0/3027101178 >> 172.21.15.99:0/3027101178 conn(0x7f84d80b1810 msgr2=0x7f84d80cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:38.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.937+0000 7f84de102700 1 -- 172.21.15.99:0/3027101178 shutdown_connections 2024-09-13T18:26:38.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:38.937+0000 7f84de102700 1 -- 172.21.15.99:0/3027101178 wait complete. 2024-09-13T18:26:38.957 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new f28cb076-1358-447e-962a-fbf60091be8a 7 2024-09-13T18:26:38.962 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-09-13T18:26:38.960+0000 7fb7952982c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:26:39.023 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-09-13T18:26:39.020+0000 7fb7952982c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:26:39.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb56621b700 1 Processor -- start 2024-09-13T18:26:39.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb56621b700 1 -- start start 2024-09-13T18:26:39.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb56621b700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb560159080 0x7fb5600caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb56621b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb5600ce2d0 0x7fb5600c9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb56621b700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb56015d800 con 0x7fb5600cb0d0 2024-09-13T18:26:39.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb56621b700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb56015cc10 con 0x7fb560159080 2024-09-13T18:26:39.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb56621b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56015ced0 con 0x7fb5600ce2d0 2024-09-13T18:26:39.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb565219700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb560159080 0x7fb5600caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb564a18700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb5600cb0d0 0x7fb5600cdbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:48794/0 (socket says 172.21.15.99:48794) 2024-09-13T18:26:39.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb565219700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb560159080 0x7fb5600caa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33892/0 (socket says 172.21.15.99:33892) 2024-09-13T18:26:39.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb564a18700 1 -- 172.21.15.99:0/376429572 learned_addr learned my addr 172.21.15.99:0/376429572 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T18:26:39.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb565a1a700 1 --2- 172.21.15.99:0/376429572 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb5600ce2d0 0x7fb5600c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb565219700 1 -- 172.21.15.99:0/376429572 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb5600ce2d0 msgr2=0x7fb5600c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:39.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb565219700 1 --2- 172.21.15.99:0/376429572 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb5600ce2d0 0x7fb5600c9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb565219700 1 -- 172.21.15.99:0/376429572 >> v1:172.21.15.99:6789/0 conn(0x7fb5600cb0d0 legacy=0x7fb5600cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb557fff700 1 -- 172.21.15.99:0/376429572 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096086271 0 0) 0x7fb56015d800 con 0x7fb5600cb0d0 2024-09-13T18:26:39.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb565219700 1 -- 172.21.15.99:0/376429572 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56015d1b0 con 0x7fb560159080 2024-09-13T18:26:39.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb565219700 1 --2- 172.21.15.99:0/376429572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb560159080 0x7fb5600caa00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb55c009850 tx=0x7fb55c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc27706eb1f26d57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:39.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb557fff700 1 -- 172.21.15.99:0/376429572 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c011830 con 0x7fb560159080 2024-09-13T18:26:39.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb557fff700 1 -- 172.21.15.99:0/376429572 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55c011990 con 0x7fb560159080 2024-09-13T18:26:39.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb557fff700 1 -- 172.21.15.99:0/376429572 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c011d40 con 0x7fb560159080 2024-09-13T18:26:39.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb56621b700 1 -- 172.21.15.99:0/376429572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb560159080 msgr2=0x7fb5600caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb56621b700 1 --2- 172.21.15.99:0/376429572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb560159080 0x7fb5600caa00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb55c009850 tx=0x7fb55c009b60 comp rx=0 tx=0).stop 2024-09-13T18:26:39.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb56621b700 1 -- 172.21.15.99:0/376429572 shutdown_connections 2024-09-13T18:26:39.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb56621b700 1 --2- 172.21.15.99:0/376429572 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb5600ce2d0 0x7fb5600c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb56621b700 1 --2- 172.21.15.99:0/376429572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb560159080 0x7fb5600caa00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb56621b700 1 -- 172.21.15.99:0/376429572 >> 172.21.15.99:0/376429572 conn(0x7fb5600cba60 msgr2=0x7fb5600cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:39.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb56621b700 1 -- 172.21.15.99:0/376429572 shutdown_connections 2024-09-13T18:26:39.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.057+0000 7fb56621b700 1 -- 172.21.15.99:0/376429572 wait complete. 2024-09-13T18:26:39.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb56621b700 1 Processor -- start 2024-09-13T18:26:39.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb56621b700 1 -- start start 2024-09-13T18:26:39.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb56621b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5600cb0d0 0x7fb56014ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb56621b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5600ce2d0 0x7fb5600c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb56621b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb560159080 0x7fb560154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb56621b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5601552d0 con 0x7fb5600ce2d0 2024-09-13T18:26:39.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb56621b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb560154d10 con 0x7fb5600cb0d0 2024-09-13T18:26:39.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb56621b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb560154ff0 con 0x7fb560159080 2024-09-13T18:26:39.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb565219700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5600cb0d0 0x7fb56014ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb565219700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5600cb0d0 0x7fb56014ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33896/0 (socket says 172.21.15.99:33896) 2024-09-13T18:26:39.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb565219700 1 -- 172.21.15.99:0/191449829 learned_addr learned my addr 172.21.15.99:0/191449829 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T18:26:39.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb565a1a700 1 --2- 172.21.15.99:0/191449829 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb560159080 0x7fb560154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb564a18700 1 --2- 172.21.15.99:0/191449829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5600ce2d0 0x7fb5600c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb565219700 1 -- 172.21.15.99:0/191449829 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb560159080 msgr2=0x7fb560154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb565219700 1 --2- 172.21.15.99:0/191449829 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb560159080 0x7fb560154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb565219700 1 -- 172.21.15.99:0/191449829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5600ce2d0 msgr2=0x7fb5600c9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb565219700 1 --2- 172.21.15.99:0/191449829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5600ce2d0 0x7fb5600c9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb565219700 1 -- 172.21.15.99:0/191449829 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c0094b0 con 0x7fb5600cb0d0 2024-09-13T18:26:39.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb564a18700 1 --2- 172.21.15.99:0/191449829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5600ce2d0 0x7fb5600c9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:39.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb565a1a700 1 --2- 172.21.15.99:0/191449829 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb560159080 0x7fb560154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:26:39.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb565219700 1 --2- 172.21.15.99:0/191449829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5600cb0d0 0x7fb56014ce00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb55c014040 tx=0x7fb55c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:39.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb555ffb700 1 -- 172.21.15.99:0/191449829 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c019a00 con 0x7fb5600cb0d0 2024-09-13T18:26:39.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb555ffb700 1 -- 172.21.15.99:0/191449829 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55c01e070 con 0x7fb5600cb0d0 2024-09-13T18:26:39.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb56621b700 1 -- 172.21.15.99:0/191449829 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb56014fb00 con 0x7fb5600cb0d0 2024-09-13T18:26:39.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb555ffb700 1 -- 172.21.15.99:0/191449829 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c019da0 con 0x7fb5600cb0d0 2024-09-13T18:26:39.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.061+0000 7fb56621b700 1 -- 172.21.15.99:0/191449829 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb560154970 con 0x7fb5600cb0d0 2024-09-13T18:26:39.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.065+0000 7fb56621b700 1 -- 172.21.15.99:0/191449829 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb560150020 con 0x7fb5600cb0d0 2024-09-13T18:26:39.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.065+0000 7fb555ffb700 1 -- 172.21.15.99:0/191449829 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fb55c02d750 con 0x7fb5600cb0d0 2024-09-13T18:26:39.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.065+0000 7fb555ffb700 1 -- 172.21.15.99:0/191449829 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fb55c01ad50 con 0x7fb5600cb0d0 2024-09-13T18:26:39.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.069+0000 7fb555ffb700 1 -- 172.21.15.99:0/191449829 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fb560150020 con 0x7fb5600cb0d0 2024-09-13T18:26:39.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.145+0000 7fb56621b700 1 -- 172.21.15.99:0/191449829 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f28cb076-1358-447e-962a-fbf60091be8a", "id": 7} v 0) v1 -- 0x7fb5600caa00 con 0x7fb5600cb0d0 2024-09-13T18:26:39.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.153+0000 7fb555ffb700 1 -- 172.21.15.99:0/191449829 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f28cb076-1358-447e-962a-fbf60091be8a", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb55c020070 con 0x7fb5600cb0d0 2024-09-13T18:26:39.160 INFO:teuthology.orchestra.run.smithi099.stdout:7 2024-09-13T18:26:39.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.153+0000 7fb56621b700 1 -- 172.21.15.99:0/191449829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5600cb0d0 msgr2=0x7fb56014ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.153+0000 7fb56621b700 1 --2- 172.21.15.99:0/191449829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5600cb0d0 0x7fb56014ce00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb55c014040 tx=0x7fb55c004770 comp rx=0 tx=0).stop 2024-09-13T18:26:39.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.157+0000 7fb56621b700 1 -- 172.21.15.99:0/191449829 shutdown_connections 2024-09-13T18:26:39.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.157+0000 7fb56621b700 1 --2- 172.21.15.99:0/191449829 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb560159080 0x7fb560154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.157+0000 7fb56621b700 1 --2- 172.21.15.99:0/191449829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5600ce2d0 0x7fb5600c9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.157+0000 7fb56621b700 1 --2- 172.21.15.99:0/191449829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5600cb0d0 0x7fb56014ce00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.157+0000 7fb56621b700 1 -- 172.21.15.99:0/191449829 >> 172.21.15.99:0/191449829 conn(0x7fb5600cba60 msgr2=0x7fb56006dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:39.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.157+0000 7fb56621b700 1 -- 172.21.15.99:0/191449829 shutdown_connections 2024-09-13T18:26:39.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T18:26:39.157+0000 7fb56621b700 1 -- 172.21.15.99:0/191449829 wait complete. 2024-09-13T18:26:39.173 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T18:26:39.173 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T18:26:39.175 INFO:tasks.ceph.osd.0:Started 2024-09-13T18:26:39.175 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T18:26:39.175 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T18:26:39.177 INFO:tasks.ceph.osd.1:Started 2024-09-13T18:26:39.177 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T18:26:39.178 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T18:26:39.179 INFO:tasks.ceph.osd.2:Started 2024-09-13T18:26:39.180 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T18:26:39.180 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T18:26:39.182 INFO:tasks.ceph.osd.3:Started 2024-09-13T18:26:39.182 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-13T18:26:39.182 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-13T18:26:39.184 INFO:tasks.ceph.osd.4:Started 2024-09-13T18:26:39.184 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-13T18:26:39.184 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-13T18:26:39.186 INFO:tasks.ceph.osd.5:Started 2024-09-13T18:26:39.186 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-13T18:26:39.187 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-13T18:26:39.189 INFO:tasks.ceph.osd.6:Started 2024-09-13T18:26:39.189 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-13T18:26:39.189 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-13T18:26:39.191 INFO:tasks.ceph.osd.7:Started 2024-09-13T18:26:39.192 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:26:39.207 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-09-13T18:26:39.204+0000 7fb7952982c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:26:39.262 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:39.257+0000 7f61521f32c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:26:39.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.308+0000 7f7ecd4ce700 1 Processor -- start 2024-09-13T18:26:39.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.308+0000 7f7ecd4ce700 1 -- start start 2024-09-13T18:26:39.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.308+0000 7f7ecd4ce700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7ec80cd850 0x7f7ec815bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.308+0000 7f7ecd4ce700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7ec8071990 0x7f7ec815ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.308+0000 7f7ecd4ce700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec806d470 con 0x7f7ec8071500 2024-09-13T18:26:39.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.308+0000 7f7ecd4ce700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec806a310 con 0x7f7ec80cd850 2024-09-13T18:26:39.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.308+0000 7f7ecd4ce700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec815c000 con 0x7f7ec8071990 2024-09-13T18:26:39.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.308+0000 7f7ec6ffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7ec80cd850 0x7f7ec815bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.308+0000 7f7ec6ffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7ec80cd850 0x7f7ec815bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46850/0 (socket says 172.21.15.44:46850) 2024-09-13T18:26:39.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.308+0000 7f7ec6ffd700 1 -- 172.21.15.44:0/2641480616 learned_addr learned my addr 172.21.15.44:0/2641480616 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:26:39.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.308+0000 7f7ec77fe700 1 --2- 172.21.15.44:0/2641480616 >> v2:172.21.15.99:3300/0 conn(0x7f7ec8071990 0x7f7ec815ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.308+0000 7f7ec6ffd700 1 -- 172.21.15.44:0/2641480616 >> v2:172.21.15.99:3300/0 conn(0x7f7ec8071990 msgr2=0x7f7ec815ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:39.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.308+0000 7f7ec6ffd700 1 --2- 172.21.15.44:0/2641480616 >> v2:172.21.15.99:3300/0 conn(0x7f7ec8071990 0x7f7ec815ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.308+0000 7f7ec6ffd700 1 -- 172.21.15.44:0/2641480616 >> v1:172.21.15.99:6789/0 conn(0x7f7ec8071500 legacy=0x7f7ec815e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.308+0000 7f7ec6ffd700 1 -- 172.21.15.44:0/2641480616 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec80cefd0 con 0x7f7ec80cd850 2024-09-13T18:26:39.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.308+0000 7f7ec6ffd700 1 --2- 172.21.15.44:0/2641480616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ec80cd850 0x7f7ec815bac0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8158c00 tx=0x7f7eb0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef02137b26b5eb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:39.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.308+0000 7f7ec5ffb700 1 -- 172.21.15.44:0/2641480616 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb000b8a0 con 0x7f7ec80cd850 2024-09-13T18:26:39.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.308+0000 7f7ec5ffb700 1 -- 172.21.15.44:0/2641480616 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb000ba00 con 0x7f7ec80cd850 2024-09-13T18:26:39.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.308+0000 7f7ec5ffb700 1 -- 172.21.15.44:0/2641480616 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb000bd90 con 0x7f7ec80cd850 2024-09-13T18:26:39.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.312+0000 7f7ecd4ce700 1 -- 172.21.15.44:0/2641480616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ec80cd850 msgr2=0x7f7ec815bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.312+0000 7f7ecd4ce700 1 --2- 172.21.15.44:0/2641480616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ec80cd850 0x7f7ec815bac0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8158c00 tx=0x7f7eb0009bf0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.312+0000 7f7ecd4ce700 1 -- 172.21.15.44:0/2641480616 shutdown_connections 2024-09-13T18:26:39.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.312+0000 7f7ecd4ce700 1 --2- 172.21.15.44:0/2641480616 >> v2:172.21.15.99:3300/0 conn(0x7f7ec8071990 0x7f7ec815ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.312+0000 7f7ecd4ce700 1 --2- 172.21.15.44:0/2641480616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ec80cd850 0x7f7ec815bac0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.312+0000 7f7ecd4ce700 1 -- 172.21.15.44:0/2641480616 >> 172.21.15.44:0/2641480616 conn(0x7f7ec806db40 msgr2=0x7f7ec806df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:39.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.312+0000 7f7ecd4ce700 1 -- 172.21.15.44:0/2641480616 shutdown_connections 2024-09-13T18:26:39.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.312+0000 7f7ecd4ce700 1 -- 172.21.15.44:0/2641480616 wait complete. 2024-09-13T18:26:39.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.312+0000 7f7ecd4ce700 1 Processor -- start 2024-09-13T18:26:39.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.312+0000 7f7ecd4ce700 1 -- start start 2024-09-13T18:26:39.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ecd4ce700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ec8071500 0x7f7ec8159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ecd4ce700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ec8071990 0x7f7ec815a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ecd4ce700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7ec80cd850 0x7f7ec81564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ecd4ce700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec8158080 con 0x7f7ec8071990 2024-09-13T18:26:39.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ecd4ce700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec814b980 con 0x7f7ec8071500 2024-09-13T18:26:39.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ecd4ce700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec814ae30 con 0x7f7ec80cd850 2024-09-13T18:26:39.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ec67fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ec8071990 0x7f7ec815a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ec77fe700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7ec80cd850 0x7f7ec81564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ec6ffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ec8071500 0x7f7ec8159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ec67fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ec8071990 0x7f7ec815a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46852/0 (socket says 172.21.15.44:46852) 2024-09-13T18:26:39.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ec67fc700 1 -- 172.21.15.44:0/4084929554 learned_addr learned my addr 172.21.15.44:0/4084929554 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:26:39.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ec67fc700 1 -- 172.21.15.44:0/4084929554 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7ec80cd850 msgr2=0x7f7ec81564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ec67fc700 1 --2- 172.21.15.44:0/4084929554 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7ec80cd850 0x7f7ec81564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ec67fc700 1 -- 172.21.15.44:0/4084929554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ec8071500 msgr2=0x7f7ec8159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ec67fc700 1 --2- 172.21.15.44:0/4084929554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ec8071500 0x7f7ec8159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ec67fc700 1 -- 172.21.15.44:0/4084929554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb0009570 con 0x7f7ec8071990 2024-09-13T18:26:39.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ec67fc700 1 --2- 172.21.15.44:0/4084929554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ec8071990 0x7f7ec815a2f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800cc50 tx=0x7f7eb800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ebf7fe700 1 -- 172.21.15.44:0/4084929554 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8003c20 con 0x7f7ec8071990 2024-09-13T18:26:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ebf7fe700 1 -- 172.21.15.44:0/4084929554 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb8003d80 con 0x7f7ec8071990 2024-09-13T18:26:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ecd4ce700 1 -- 172.21.15.44:0/4084929554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec81582d0 con 0x7f7ec8071990 2024-09-13T18:26:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ebf7fe700 1 -- 172.21.15.44:0/4084929554 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb800aad0 con 0x7f7ec8071990 2024-09-13T18:26:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ecd4ce700 1 -- 172.21.15.44:0/4084929554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec814b330 con 0x7f7ec8071990 2024-09-13T18:26:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ebf7fe700 1 -- 172.21.15.44:0/4084929554 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f7eb80050d0 con 0x7f7ec8071990 2024-09-13T18:26:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ebf7fe700 1 -- 172.21.15.44:0/4084929554 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7eb8012600 con 0x7f7ec8071990 2024-09-13T18:26:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.316+0000 7f7ecd4ce700 1 -- 172.21.15.44:0/4084929554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec8071dd0 con 0x7f7ec8071990 2024-09-13T18:26:39.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.320+0000 7f7ebf7fe700 1 -- 172.21.15.44:0/4084929554 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f7eb8005380 con 0x7f7ec8071990 2024-09-13T18:26:39.378 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:39.373+0000 7f61521f32c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:26:39.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.388+0000 7f7ecd4ce700 1 -- 172.21.15.44:0/4084929554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ec81585e0 con 0x7f7ec8071990 2024-09-13T18:26:39.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.388+0000 7f7ebf7fe700 1 -- 172.21.15.44:0/4084929554 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7eb8005520 con 0x7f7ec8071990 2024-09-13T18:26:39.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:26:39.393 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":10,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:26:39.150530+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:26:39.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.392+0000 7f7ecd4ce700 1 -- 172.21.15.44:0/4084929554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ec8071990 msgr2=0x7f7ec815a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.392+0000 7f7ecd4ce700 1 --2- 172.21.15.44:0/4084929554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ec8071990 0x7f7ec815a2f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800cc50 tx=0x7f7eb800cf60 comp rx=0 tx=0).stop 2024-09-13T18:26:39.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.392+0000 7f7ecd4ce700 1 -- 172.21.15.44:0/4084929554 shutdown_connections 2024-09-13T18:26:39.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.392+0000 7f7ecd4ce700 1 --2- 172.21.15.44:0/4084929554 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7ec80cd850 0x7f7ec81564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.392+0000 7f7ecd4ce700 1 --2- 172.21.15.44:0/4084929554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ec8071990 0x7f7ec815a2f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.392+0000 7f7ecd4ce700 1 --2- 172.21.15.44:0/4084929554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ec8071500 0x7f7ec8159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.392+0000 7f7ecd4ce700 1 -- 172.21.15.44:0/4084929554 >> 172.21.15.44:0/4084929554 conn(0x7f7ec806db40 msgr2=0x7f7ec80b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:39.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.392+0000 7f7ecd4ce700 1 -- 172.21.15.44:0/4084929554 shutdown_connections 2024-09-13T18:26:39.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:39.392+0000 7f7ecd4ce700 1 -- 172.21.15.44:0/4084929554 wait complete. 2024-09-13T18:26:39.411 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T18:26:39.411 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T18:26:39.475 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-09-13T18:26:39.472+0000 7fb7952982c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:26:39.531 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-09-13T18:26:39.528+0000 7fb7952982c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:26:39.534 INFO:tasks.ceph.osd.5.smithi099.stderr:2024-09-13T18:26:39.529+0000 7f30b720c880 -1 Falling back to public interface 2024-09-13T18:26:39.558 INFO:tasks.ceph.osd.6.smithi099.stderr:2024-09-13T18:26:39.553+0000 7f0843b33880 -1 Falling back to public interface 2024-09-13T18:26:39.568 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-09-13T18:26:39.564+0000 7fd37aded880 -1 Falling back to public interface 2024-09-13T18:26:39.707 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:39.701+0000 7f61521f32c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:26:39.719 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-09-13T18:26:39.716+0000 7fb7952982c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:26:39.789 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-09-13T18:26:39.784+0000 7fb7952982c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:26:39.798 INFO:tasks.ceph.osd.4.smithi099.stderr:2024-09-13T18:26:39.793+0000 7efe182b3880 -1 Falling back to public interface 2024-09-13T18:26:39.811 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-09-13T18:26:39.808+0000 7f5adc31e880 -1 Falling back to public interface 2024-09-13T18:26:39.813 INFO:tasks.ceph.osd.7.smithi099.stderr:2024-09-13T18:26:39.809+0000 7f3ea3c49880 -1 Falling back to public interface 2024-09-13T18:26:39.843 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-09-13T18:26:39.840+0000 7f9860ea7880 -1 Falling back to public interface 2024-09-13T18:26:39.844 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-09-13T18:26:39.840+0000 7f6b22fea880 -1 Falling back to public interface 2024-09-13T18:26:39.860 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-09-13T18:26:39.856+0000 7fb7952982c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:26:39.893 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:39.889+0000 7f61521f32c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:26:39.960 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:39.953+0000 7f61521f32c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:26:40.120 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:40.113+0000 7f61521f32c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:26:40.218 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:26:40.296 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-09-13T18:26:40.292+0000 7fb7952982c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:26:40.321 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.316+0000 7f3c12e5a700 1 Processor -- start 2024-09-13T18:26:40.321 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.316+0000 7f3c12e5a700 1 -- start start 2024-09-13T18:26:40.322 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c12e5a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c0c06ba30 0x7f3c0c15a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:40.323 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c12e5a700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c0c06d810 con 0x7f3c0c06dbb0 2024-09-13T18:26:40.323 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c12e5a700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c0c06a310 con 0x7f3c0c15ceb0 2024-09-13T18:26:40.323 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c12e5a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c06a560 con 0x7f3c0c06ba30 2024-09-13T18:26:40.323 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c11657700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3c0c06dbb0 0x7f3c0c06b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54330/0 (socket says 172.21.15.44:54330) 2024-09-13T18:26:40.323 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c11657700 1 -- 172.21.15.44:0/2742496512 learned_addr learned my addr 172.21.15.44:0/2742496512 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:26:40.323 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c12659700 1 --2- 172.21.15.44:0/2742496512 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c0c06ba30 0x7f3c0c15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:40.323 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c10e56700 1 -- 172.21.15.44:0/2742496512 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749854094 0 0) 0x7f3c0c06d810 con 0x7f3c0c06dbb0 2024-09-13T18:26:40.323 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c10e56700 1 -- 172.21.15.44:0/2742496512 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bf80035d0 con 0x7f3c0c06dbb0 2024-09-13T18:26:40.326 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c10e56700 1 -- 172.21.15.44:0/2742496512 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2456025134 0 0) 0x7f3bf80035d0 con 0x7f3c0c06dbb0 2024-09-13T18:26:40.326 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c10e56700 1 -- 172.21.15.44:0/2742496512 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c0c06ba30 msgr2=0x7f3c0c15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:40.326 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c10e56700 1 --2- 172.21.15.44:0/2742496512 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c0c06ba30 0x7f3c0c15a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.326 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c10e56700 1 -- 172.21.15.44:0/2742496512 >> v1:172.21.15.99:6789/0 conn(0x7f3c0c15ceb0 legacy=0x7f3c0c15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:40.326 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c10e56700 1 -- 172.21.15.44:0/2742496512 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c06a840 con 0x7f3c0c06dbb0 2024-09-13T18:26:40.326 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c10e56700 1 -- 172.21.15.44:0/2742496512 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f3bfc001670 con 0x7f3c0c06dbb0 2024-09-13T18:26:40.326 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c10e56700 1 -- 172.21.15.44:0/2742496512 >> v1:172.21.15.44:6789/0 conn(0x7f3c0c06dbb0 legacy=0x7f3c0c06b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:40.326 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c10e56700 1 --2- 172.21.15.44:0/2742496512 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c0c06ba30 0x7f3bf8003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:40.327 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c10e56700 1 --2- 172.21.15.44:0/2742496512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bf8003f90 0x7f3bf8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:40.327 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c10e56700 1 --2- 172.21.15.44:0/2742496512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf8004db0 0x7f3bf8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:40.327 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c10e56700 1 -- 172.21.15.44:0/2742496512 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c06a560 con 0x7f3bf8003f90 2024-09-13T18:26:40.327 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c10e56700 1 -- 172.21.15.44:0/2742496512 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf800bae0 con 0x7f3bf8004db0 2024-09-13T18:26:40.327 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c10e56700 1 -- 172.21.15.44:0/2742496512 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf800bc70 con 0x7f3c0c06ba30 2024-09-13T18:26:40.327 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c11657700 1 --2- 172.21.15.44:0/2742496512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bf8003f90 0x7f3bf8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:40.327 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c11e58700 1 --2- 172.21.15.44:0/2742496512 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c0c06ba30 0x7f3bf8003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:40.327 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c12659700 1 --2- 172.21.15.44:0/2742496512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf8004db0 0x7f3bf8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:40.328 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c11657700 1 -- 172.21.15.44:0/2742496512 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c0c06ba30 msgr2=0x7f3bf8003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:40.328 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c11657700 1 --2- 172.21.15.44:0/2742496512 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c0c06ba30 0x7f3bf8003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.328 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c11657700 1 -- 172.21.15.44:0/2742496512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf8004db0 msgr2=0x7f3bf8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:40.328 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c11657700 1 --2- 172.21.15.44:0/2742496512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf8004db0 0x7f3bf8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.328 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c11657700 1 -- 172.21.15.44:0/2742496512 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf80035d0 con 0x7f3bf8003f90 2024-09-13T18:26:40.328 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c12659700 1 --2- 172.21.15.44:0/2742496512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf8004db0 0x7f3bf8005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:40.328 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c11657700 1 --2- 172.21.15.44:0/2742496512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bf8003f90 0x7f3bf8004870 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc00c570 tx=0x7f3bf80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508361cc810743cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:40.328 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c10e56700 1 -- 172.21.15.44:0/2742496512 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc005b80 con 0x7f3bf8003f90 2024-09-13T18:26:40.328 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c10e56700 1 -- 172.21.15.44:0/2742496512 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bfc005ce0 con 0x7f3bf8003f90 2024-09-13T18:26:40.328 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c10e56700 1 -- 172.21.15.44:0/2742496512 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc007350 con 0x7f3bf8003f90 2024-09-13T18:26:40.328 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c12e5a700 1 -- 172.21.15.44:0/2742496512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bf8003f90 msgr2=0x7f3bf8004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:40.328 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c12e5a700 1 --2- 172.21.15.44:0/2742496512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bf8003f90 0x7f3bf8004870 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc00c570 tx=0x7f3bf80058a0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.328 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c12659700 1 -- 172.21.15.44:0/2742496512 reap_dead start 2024-09-13T18:26:40.329 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c12e5a700 1 -- 172.21.15.44:0/2742496512 shutdown_connections 2024-09-13T18:26:40.329 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c12e5a700 1 -- 172.21.15.44:0/2742496512 >> 172.21.15.44:0/2742496512 conn(0x7f3c0c0b0cd0 msgr2=0x7f3c0c0b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:40.329 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c12e5a700 1 -- 172.21.15.44:0/2742496512 shutdown_connections 2024-09-13T18:26:40.329 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.320+0000 7f3c12e5a700 1 -- 172.21.15.44:0/2742496512 wait complete. 2024-09-13T18:26:40.331 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c12e5a700 1 Processor -- start 2024-09-13T18:26:40.331 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c12e5a700 1 -- start start 2024-09-13T18:26:40.331 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c12e5a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bf8003f90 0x7f3c0c146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:40.331 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c12e5a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c0c155160 0x7f3c0c1f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:40.331 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c12e5a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c0c09c370 0x7f3c0c09c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:40.331 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c12e5a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c099e50 con 0x7f3bf8003f90 2024-09-13T18:26:40.332 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c12e5a700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c09cd30 con 0x7f3c0c09c370 2024-09-13T18:26:40.332 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c12e5a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c1f6090 con 0x7f3c0c155160 2024-09-13T18:26:40.332 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c11e58700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bf8003f90 0x7f3c0c146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:40.332 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c11e58700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bf8003f90 0x7f3c0c146bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46870/0 (socket says 172.21.15.44:46870) 2024-09-13T18:26:40.332 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c11e58700 1 -- 172.21.15.44:0/2126095358 learned_addr learned my addr 172.21.15.44:0/2126095358 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:26:40.332 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c11657700 1 --2- 172.21.15.44:0/2126095358 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c0c155160 0x7f3c0c1f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:40.332 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c12659700 1 --2- 172.21.15.44:0/2126095358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c0c09c370 0x7f3c0c09c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:40.332 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c11e58700 1 -- 172.21.15.44:0/2126095358 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c0c155160 msgr2=0x7f3c0c1f5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:40.332 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c11e58700 1 --2- 172.21.15.44:0/2126095358 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c0c155160 0x7f3c0c1f5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.332 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c11e58700 1 -- 172.21.15.44:0/2126095358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c0c09c370 msgr2=0x7f3c0c09c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:40.332 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c11e58700 1 --2- 172.21.15.44:0/2126095358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c0c09c370 0x7f3c0c09c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.332 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c11e58700 1 -- 172.21.15.44:0/2126095358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c099b00 con 0x7f3bf8003f90 2024-09-13T18:26:40.333 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c11e58700 1 --2- 172.21.15.44:0/2126095358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bf8003f90 0x7f3c0c146bb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800f8e0 tx=0x7f3c0800fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:40.333 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c027fc700 1 -- 172.21.15.44:0/2126095358 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08005320 con 0x7f3bf8003f90 2024-09-13T18:26:40.333 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c027fc700 1 -- 172.21.15.44:0/2126095358 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c080054a0 con 0x7f3bf8003f90 2024-09-13T18:26:40.333 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c12e5a700 1 -- 172.21.15.44:0/2126095358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c0c1555c0 con 0x7f3bf8003f90 2024-09-13T18:26:40.333 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c027fc700 1 -- 172.21.15.44:0/2126095358 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08006ac0 con 0x7f3bf8003f90 2024-09-13T18:26:40.333 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c12e5a700 1 -- 172.21.15.44:0/2126095358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0c1f65a0 con 0x7f3bf8003f90 2024-09-13T18:26:40.333 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c027fc700 1 -- 172.21.15.44:0/2126095358 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f3c08007050 con 0x7f3bf8003f90 2024-09-13T18:26:40.333 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.324+0000 7f3c027fc700 1 -- 172.21.15.44:0/2126095358 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3c08014450 con 0x7f3bf8003f90 2024-09-13T18:26:40.333 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.328+0000 7f3c12e5a700 1 -- 172.21.15.44:0/2126095358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0c15ac30 con 0x7f3bf8003f90 2024-09-13T18:26:40.335 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.332+0000 7f3c027fc700 1 -- 172.21.15.44:0/2126095358 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f3c0801a070 con 0x7f3bf8003f90 2024-09-13T18:26:40.400 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.396+0000 7f3c12e5a700 1 -- 172.21.15.44:0/2126095358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c0c15a840 con 0x7f3bf8003f90 2024-09-13T18:26:40.401 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.396+0000 7f3c027fc700 1 -- 172.21.15.44:0/2126095358 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3c08007490 con 0x7f3bf8003f90 2024-09-13T18:26:40.401 INFO:teuthology.misc.health.smithi044.stdout: 2024-09-13T18:26:40.401 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":10,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:26:39.150530+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:26:40.403 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.400+0000 7f3c12e5a700 1 -- 172.21.15.44:0/2126095358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bf8003f90 msgr2=0x7f3c0c146bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:40.403 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.400+0000 7f3c12e5a700 1 --2- 172.21.15.44:0/2126095358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bf8003f90 0x7f3c0c146bb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800f8e0 tx=0x7f3c0800fbf0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.403 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.400+0000 7f3c12e5a700 1 -- 172.21.15.44:0/2126095358 shutdown_connections 2024-09-13T18:26:40.403 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.400+0000 7f3c12e5a700 1 --2- 172.21.15.44:0/2126095358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c0c09c370 0x7f3c0c09c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.403 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.400+0000 7f3c12e5a700 1 --2- 172.21.15.44:0/2126095358 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c0c155160 0x7f3c0c1f5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.403 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.400+0000 7f3c12e5a700 1 --2- 172.21.15.44:0/2126095358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bf8003f90 0x7f3c0c146bb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.403 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.400+0000 7f3c12e5a700 1 -- 172.21.15.44:0/2126095358 >> 172.21.15.44:0/2126095358 conn(0x7f3c0c0b0cd0 msgr2=0x7f3c0c15c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:40.403 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.400+0000 7f3c12e5a700 1 -- 172.21.15.44:0/2126095358 shutdown_connections 2024-09-13T18:26:40.403 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:40.400+0000 7f3c12e5a700 1 -- 172.21.15.44:0/2126095358 wait complete. 2024-09-13T18:26:40.413 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T18:26:40.424 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-09-13T18:26:40.420+0000 7fb7952982c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:26:40.802 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-09-13T18:26:40.800+0000 7fb7952982c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:26:40.850 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:40.845+0000 7f61521f32c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:26:40.918 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:40.913+0000 7f61521f32c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:26:41.003 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-09-13T18:26:41.000+0000 7fb7952982c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:26:41.077 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-09-13T18:26:41.072+0000 7fb7952982c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:26:41.077 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:41.069+0000 7f61521f32c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:26:41.142 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:41.137+0000 7f61521f32c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:26:41.217 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:41.213+0000 7f61521f32c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:26:41.236 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-09-13T18:26:41.232+0000 7fb7952982c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:26:41.538 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:41.533+0000 7f61521f32c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:26:41.614 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:41.609+0000 7f61521f32c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:26:41.961 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-09-13T18:26:41.956+0000 7fb7952982c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:26:42.034 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-09-13T18:26:42.032+0000 7fb7952982c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:26:42.197 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-09-13T18:26:42.192+0000 7fb7952982c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:26:42.266 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-09-13T18:26:42.260+0000 7fb7952982c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:26:42.276 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:42.269+0000 7f61521f32c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:26:42.344 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-09-13T18:26:42.340+0000 7fb7952982c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:26:42.683 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-09-13T18:26:42.680+0000 7fb7952982c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:26:42.764 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-09-13T18:26:42.760+0000 7fb7952982c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:26:43.320 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:43.313+0000 7f6138d69700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T18:26:43.321 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T18:26:43.313+0000 7f6138d69700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T18:26:43.351 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-09-13T18:26:43.348+0000 7fd37aded880 -1 osd.0 0 log_to_monitors true 2024-09-13T18:26:43.352 INFO:tasks.ceph.osd.5.smithi099.stderr:2024-09-13T18:26:43.345+0000 7f30b720c880 -1 osd.5 0 log_to_monitors true 2024-09-13T18:26:43.435 INFO:tasks.ceph.osd.6.smithi099.stderr:2024-09-13T18:26:43.429+0000 7f0843b33880 -1 osd.6 0 log_to_monitors true 2024-09-13T18:26:43.525 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-09-13T18:26:43.520+0000 7fb7952982c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:26:43.602 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-09-13T18:26:43.600+0000 7f5adc31e880 -1 osd.3 0 log_to_monitors true 2024-09-13T18:26:43.618 INFO:tasks.ceph.osd.7.smithi099.stderr:2024-09-13T18:26:43.613+0000 7f3ea3c49880 -1 osd.7 0 log_to_monitors true 2024-09-13T18:26:43.692 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-09-13T18:26:43.688+0000 7f6b22fea880 -1 osd.1 0 log_to_monitors true 2024-09-13T18:26:43.701 INFO:tasks.ceph.osd.4.smithi099.stderr:2024-09-13T18:26:43.697+0000 7efe182b3880 -1 osd.4 0 log_to_monitors true 2024-09-13T18:26:43.720 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-09-13T18:26:43.716+0000 7f9860ea7880 -1 osd.2 0 log_to_monitors true 2024-09-13T18:26:47.221 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:26:47.370 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.368+0000 7fdea359e700 1 Processor -- start 2024-09-13T18:26:47.372 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.368+0000 7fdea359e700 1 -- start start 2024-09-13T18:26:47.373 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.368+0000 7fdea359e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdea4146260 0x7fdea406e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.373 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.368+0000 7fdea359e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdea40b2750 0x7fdea40b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.373 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.368+0000 7fdea359e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdea4070c60 0x7fdea40710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.374 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.368+0000 7fdea359e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea4071620 con 0x7fdea40b2750 2024-09-13T18:26:47.374 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.368+0000 7fdea359e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea40b19b0 con 0x7fdea4070c60 2024-09-13T18:26:47.374 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.368+0000 7fdea359e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea40b3dd0 con 0x7fdea4146260 2024-09-13T18:26:47.374 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.368+0000 7fdea1d9b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdea40b2750 0x7fdea40b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.374 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.368+0000 7fdea259c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdea4146260 0x7fdea406e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.374 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.368+0000 7fdea259c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdea4146260 0x7fdea406e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:43216/0 (socket says 172.21.15.44:43216) 2024-09-13T18:26:47.374 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.368+0000 7fdea1d9b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdea40b2750 0x7fdea40b3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57262/0 (socket says 172.21.15.44:57262) 2024-09-13T18:26:47.374 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.368+0000 7fdea259c700 1 -- 172.21.15.44:0/501500614 learned_addr learned my addr 172.21.15.44:0/501500614 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:26:47.374 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.368+0000 7fdea2d9d700 1 --2- 172.21.15.44:0/501500614 >> v2:172.21.15.99:3300/0 conn(0x7fdea4070c60 0x7fdea40710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.374 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.368+0000 7fdea1d9b700 1 -- 172.21.15.44:0/501500614 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdea4146260 msgr2=0x7fdea406e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:47.374 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.368+0000 7fdea1d9b700 1 --2- 172.21.15.44:0/501500614 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdea4146260 0x7fdea406e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.374 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.368+0000 7fdea1d9b700 1 -- 172.21.15.44:0/501500614 >> v2:172.21.15.99:3300/0 conn(0x7fdea4070c60 msgr2=0x7fdea40710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:47.374 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.368+0000 7fdea1d9b700 1 --2- 172.21.15.44:0/501500614 >> v2:172.21.15.99:3300/0 conn(0x7fdea4070c60 0x7fdea40710e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.375 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.368+0000 7fdea1d9b700 1 -- 172.21.15.44:0/501500614 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea40b1c70 con 0x7fdea40b2750 2024-09-13T18:26:47.375 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.368+0000 7fdea1d9b700 1 --2- 172.21.15.44:0/501500614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdea40b2750 0x7fdea40b3560 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdea40ae3c0 tx=0x7fde9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31730140251dcdb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:47.375 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.368+0000 7fdea159a700 1 -- 172.21.15.44:0/501500614 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c00bd20 con 0x7fdea40b2750 2024-09-13T18:26:47.375 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.368+0000 7fdea159a700 1 -- 172.21.15.44:0/501500614 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9c00be80 con 0x7fdea40b2750 2024-09-13T18:26:47.375 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.368+0000 7fdea159a700 1 -- 172.21.15.44:0/501500614 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c014b10 con 0x7fdea40b2750 2024-09-13T18:26:47.375 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.372+0000 7fdea359e700 1 -- 172.21.15.44:0/501500614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdea40b2750 msgr2=0x7fdea40b3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.375 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.372+0000 7fdea359e700 1 --2- 172.21.15.44:0/501500614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdea40b2750 0x7fdea40b3560 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdea40ae3c0 tx=0x7fde9c00b330 comp rx=0 tx=0).stop 2024-09-13T18:26:47.378 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.376+0000 7fdea359e700 1 -- 172.21.15.44:0/501500614 shutdown_connections 2024-09-13T18:26:47.378 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.376+0000 7fdea359e700 1 --2- 172.21.15.44:0/501500614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdea40b2750 0x7fdea40b3560 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.378 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.376+0000 7fdea359e700 1 --2- 172.21.15.44:0/501500614 >> v2:172.21.15.99:3300/0 conn(0x7fdea4070c60 0x7fdea40710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.378 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.376+0000 7fdea359e700 1 --2- 172.21.15.44:0/501500614 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdea4146260 0x7fdea406e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.378 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.376+0000 7fdea359e700 1 -- 172.21.15.44:0/501500614 >> 172.21.15.44:0/501500614 conn(0x7fdea40b06b0 msgr2=0x7fdea40b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:47.378 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.376+0000 7fdea359e700 1 -- 172.21.15.44:0/501500614 shutdown_connections 2024-09-13T18:26:47.378 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.376+0000 7fdea359e700 1 -- 172.21.15.44:0/501500614 wait complete. 2024-09-13T18:26:47.380 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.376+0000 7fdea359e700 1 Processor -- start 2024-09-13T18:26:47.380 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.376+0000 7fdea359e700 1 -- start start 2024-09-13T18:26:47.382 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.376+0000 7fdea359e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdea4070c60 0x7fdea413fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.382 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.376+0000 7fdea359e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdea40b2750 0x7fdea415c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.382 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.376+0000 7fdea359e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdea4146260 0x7fdea413e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.382 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.376+0000 7fdea359e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea413f890 con 0x7fdea4146260 2024-09-13T18:26:47.382 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.376+0000 7fdea359e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea415c960 con 0x7fdea4070c60 2024-09-13T18:26:47.382 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.376+0000 7fdea359e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea413ec80 con 0x7fdea40b2750 2024-09-13T18:26:47.383 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.376+0000 7fdea2d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdea4146260 0x7fdea413e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.383 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.376+0000 7fdea2d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdea4146260 0x7fdea413e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57270/0 (socket says 172.21.15.44:57270) 2024-09-13T18:26:47.383 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.376+0000 7fdea2d9d700 1 -- 172.21.15.44:0/3197270422 learned_addr learned my addr 172.21.15.44:0/3197270422 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:26:47.383 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.376+0000 7fdea1d9b700 1 --2- 172.21.15.44:0/3197270422 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdea40b2750 0x7fdea415c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.383 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.376+0000 7fdea259c700 1 --2- 172.21.15.44:0/3197270422 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdea4070c60 0x7fdea413fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.383 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.380+0000 7fdea2d9d700 1 -- 172.21.15.44:0/3197270422 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdea40b2750 msgr2=0x7fdea415c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.383 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.380+0000 7fdea2d9d700 1 --2- 172.21.15.44:0/3197270422 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdea40b2750 0x7fdea415c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.383 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.380+0000 7fdea2d9d700 1 -- 172.21.15.44:0/3197270422 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdea4070c60 msgr2=0x7fdea413fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.383 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.380+0000 7fdea2d9d700 1 --2- 172.21.15.44:0/3197270422 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdea4070c60 0x7fdea413fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.383 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.380+0000 7fdea2d9d700 1 -- 172.21.15.44:0/3197270422 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9c009a70 con 0x7fdea4146260 2024-09-13T18:26:47.383 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.380+0000 7fdea2d9d700 1 --2- 172.21.15.44:0/3197270422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdea4146260 0x7fdea413e3c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fde9400e840 tx=0x7fde9400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:47.384 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.380+0000 7fde92ffd700 1 -- 172.21.15.44:0/3197270422 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9400c070 con 0x7fdea4146260 2024-09-13T18:26:47.384 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.380+0000 7fde92ffd700 1 -- 172.21.15.44:0/3197270422 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde94013650 con 0x7fdea4146260 2024-09-13T18:26:47.384 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.380+0000 7fde92ffd700 1 -- 172.21.15.44:0/3197270422 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde94013a00 con 0x7fdea4146260 2024-09-13T18:26:47.384 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.380+0000 7fdea359e700 1 -- 172.21.15.44:0/3197270422 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea413ef60 con 0x7fdea4146260 2024-09-13T18:26:47.384 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.380+0000 7fdea359e700 1 -- 172.21.15.44:0/3197270422 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea413f520 con 0x7fdea4146260 2024-09-13T18:26:47.387 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.384+0000 7fde92ffd700 1 -- 172.21.15.44:0/3197270422 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7fde94013b60 con 0x7fdea4146260 2024-09-13T18:26:47.387 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.384+0000 7fdea359e700 1 -- 172.21.15.44:0/3197270422 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea413fa40 con 0x7fdea4146260 2024-09-13T18:26:47.387 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.384+0000 7fde92ffd700 1 --2- 172.21.15.44:0/3197270422 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fde840666d0 0x7fde84068b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.387 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.384+0000 7fde92ffd700 1 -- 172.21.15.44:0/3197270422 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fde94082bc0 con 0x7fdea4146260 2024-09-13T18:26:47.394 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.392+0000 7fdea259c700 1 --2- 172.21.15.44:0/3197270422 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fde840666d0 0x7fde84068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.395 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.392+0000 7fde92ffd700 1 -- 172.21.15.44:0/3197270422 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdea413fa40 con 0x7fdea4146260 2024-09-13T18:26:47.405 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.392+0000 7fdea259c700 1 --2- 172.21.15.44:0/3197270422 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fde840666d0 0x7fde84068b90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fde98009ad0 tx=0x7fde980092e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:47.505 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-09-13T18:26:47.500+0000 7f5ad793a700 -1 osd.3 0 waiting for initial osdmap 2024-09-13T18:26:47.511 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-09-13T18:26:47.508+0000 7f6b1e606700 -1 osd.1 0 waiting for initial osdmap 2024-09-13T18:26:47.511 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-09-13T18:26:47.508+0000 7f5acfc0f700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:26:47.513 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-09-13T18:26:47.508+0000 7fd376409700 -1 osd.0 0 waiting for initial osdmap 2024-09-13T18:26:47.514 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-09-13T18:26:47.512+0000 7f985de6e700 -1 osd.2 0 waiting for initial osdmap 2024-09-13T18:26:47.514 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-09-13T18:26:47.512+0000 7f6b168db700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:26:47.518 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-09-13T18:26:47.516+0000 7f9854798700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:26:47.521 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-09-13T18:26:47.516+0000 7fd36e6de700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:26:47.553 INFO:tasks.ceph.osd.5.smithi099.stderr:2024-09-13T18:26:47.548+0000 7f30b41d3700 -1 osd.5 0 waiting for initial osdmap 2024-09-13T18:26:47.562 INFO:tasks.ceph.osd.5.smithi099.stderr:2024-09-13T18:26:47.556+0000 7f30aaafd700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:26:47.564 INFO:tasks.ceph.osd.7.smithi099.stderr:2024-09-13T18:26:47.556+0000 7f3ea0c10700 -1 osd.7 0 waiting for initial osdmap 2024-09-13T18:26:47.569 INFO:tasks.ceph.osd.4.smithi099.stderr:2024-09-13T18:26:47.560+0000 7efe138cf700 -1 osd.4 0 waiting for initial osdmap 2024-09-13T18:26:47.569 INFO:tasks.ceph.osd.7.smithi099.stderr:2024-09-13T18:26:47.560+0000 7f3e9753a700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:26:47.576 INFO:tasks.ceph.osd.4.smithi099.stderr:2024-09-13T18:26:47.568+0000 7efe0bba4700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:26:47.586 INFO:tasks.ceph.osd.6.smithi099.stderr:2024-09-13T18:26:47.580+0000 7f0840afa700 -1 osd.6 0 waiting for initial osdmap 2024-09-13T18:26:47.592 INFO:tasks.ceph.osd.6.smithi099.stderr:2024-09-13T18:26:47.584+0000 7f0837424700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:26:47.614 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.612+0000 7fdea359e700 1 -- 172.21.15.44:0/3197270422 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdea413fa40 con 0x7fdea4146260 2024-09-13T18:26:47.615 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.612+0000 7fde92ffd700 1 -- 172.21.15.44:0/3197270422 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fdea413fa40 con 0x7fdea4146260 2024-09-13T18:26:47.615 INFO:teuthology.misc.health.smithi044.stdout: 2024-09-13T18:26:47.615 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":12,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:26:45.312249+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:26:47.618 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.612+0000 7fdea359e700 1 -- 172.21.15.44:0/3197270422 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fde840666d0 msgr2=0x7fde84068b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.618 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.612+0000 7fdea359e700 1 --2- 172.21.15.44:0/3197270422 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fde840666d0 0x7fde84068b90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fde98009ad0 tx=0x7fde980092e0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.618 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.612+0000 7fdea359e700 1 -- 172.21.15.44:0/3197270422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdea4146260 msgr2=0x7fdea413e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.618 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.612+0000 7fdea359e700 1 --2- 172.21.15.44:0/3197270422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdea4146260 0x7fdea413e3c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fde9400e840 tx=0x7fde9400eb50 comp rx=0 tx=0).stop 2024-09-13T18:26:47.618 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.612+0000 7fdea359e700 1 -- 172.21.15.44:0/3197270422 shutdown_connections 2024-09-13T18:26:47.618 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.612+0000 7fdea359e700 1 --2- 172.21.15.44:0/3197270422 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fde840666d0 0x7fde84068b90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.618 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.612+0000 7fdea359e700 1 --2- 172.21.15.44:0/3197270422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdea4146260 0x7fdea413e3c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.618 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.612+0000 7fdea359e700 1 --2- 172.21.15.44:0/3197270422 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdea40b2750 0x7fdea415c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.618 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.612+0000 7fdea359e700 1 --2- 172.21.15.44:0/3197270422 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdea4070c60 0x7fdea413fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.618 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.612+0000 7fdea359e700 1 -- 172.21.15.44:0/3197270422 >> 172.21.15.44:0/3197270422 conn(0x7fdea40b06b0 msgr2=0x7fdea415f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:47.618 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.612+0000 7fdea359e700 1 -- 172.21.15.44:0/3197270422 shutdown_connections 2024-09-13T18:26:47.618 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:47.616+0000 7fdea359e700 1 -- 172.21.15.44:0/3197270422 wait complete. 2024-09-13T18:26:47.628 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T18:26:54.434 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:26:54.547 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa743198700 1 Processor -- start 2024-09-13T18:26:54.547 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa743198700 1 -- start start 2024-09-13T18:26:54.548 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa743198700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa73c159a60 0x7fa73c0b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:54.548 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa743198700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa73c06bb30 0x7fa73c15b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:54.548 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa743198700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c06d320 con 0x7fa73c06e3c0 2024-09-13T18:26:54.548 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa743198700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c06d600 con 0x7fa73c159a60 2024-09-13T18:26:54.548 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa743198700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c06d8e0 con 0x7fa73c06bb30 2024-09-13T18:26:54.548 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa73bfff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa73c06e3c0 0x7fa73c06b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59064/0 (socket says 172.21.15.44:59064) 2024-09-13T18:26:54.548 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa73bfff700 1 -- 172.21.15.44:0/2649778030 learned_addr learned my addr 172.21.15.44:0/2649778030 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:26:54.549 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa740f34700 1 --2- 172.21.15.44:0/2649778030 >> v2:172.21.15.99:3300/0 conn(0x7fa73c159a60 0x7fa73c0b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:54.549 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa741735700 1 --2- 172.21.15.44:0/2649778030 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa73c06bb30 0x7fa73c15b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:54.550 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa73b7fe700 1 -- 172.21.15.44:0/2649778030 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819526374 0 0) 0x7fa73c06d320 con 0x7fa73c06e3c0 2024-09-13T18:26:54.550 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa73b7fe700 1 -- 172.21.15.44:0/2649778030 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7280057e0 con 0x7fa73c06e3c0 2024-09-13T18:26:54.550 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa73b7fe700 1 -- 172.21.15.44:0/2649778030 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1650349005 0 0) 0x7fa7280057e0 con 0x7fa73c06e3c0 2024-09-13T18:26:54.550 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa73b7fe700 1 -- 172.21.15.44:0/2649778030 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa73c06bb30 msgr2=0x7fa73c15b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:54.550 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa73b7fe700 1 --2- 172.21.15.44:0/2649778030 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa73c06bb30 0x7fa73c15b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.550 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa73b7fe700 1 -- 172.21.15.44:0/2649778030 >> v2:172.21.15.99:3300/0 conn(0x7fa73c159a60 msgr2=0x7fa73c0b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:54.550 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa73b7fe700 1 --2- 172.21.15.44:0/2649778030 >> v2:172.21.15.99:3300/0 conn(0x7fa73c159a60 0x7fa73c0b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.550 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa73b7fe700 1 -- 172.21.15.44:0/2649778030 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c06dbc0 con 0x7fa73c06e3c0 2024-09-13T18:26:54.550 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa73b7fe700 1 -- 172.21.15.44:0/2649778030 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7fa72c0019f0 con 0x7fa73c06e3c0 2024-09-13T18:26:54.550 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa73b7fe700 1 -- 172.21.15.44:0/2649778030 >> v1:172.21.15.44:6789/0 conn(0x7fa73c06e3c0 legacy=0x7fa73c06b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:54.550 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa73b7fe700 1 --2- 172.21.15.44:0/2649778030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa728005c30 0x7fa728006050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:54.550 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa73b7fe700 1 --2- 172.21.15.44:0/2649778030 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa73c06bb30 0x7fa728006a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:54.551 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa73b7fe700 1 --2- 172.21.15.44:0/2649778030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa728006fc0 0x7fa728007440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:54.551 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa73b7fe700 1 -- 172.21.15.44:0/2649778030 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c06d600 con 0x7fa728006fc0 2024-09-13T18:26:54.551 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa73b7fe700 1 -- 172.21.15.44:0/2649778030 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c06d8e0 con 0x7fa728005c30 2024-09-13T18:26:54.551 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa73b7fe700 1 -- 172.21.15.44:0/2649778030 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72800dc70 con 0x7fa73c06bb30 2024-09-13T18:26:54.551 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa741735700 1 --2- 172.21.15.44:0/2649778030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa728006fc0 0x7fa728007440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:54.551 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa740f34700 1 --2- 172.21.15.44:0/2649778030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa728005c30 0x7fa728006050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:54.551 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa73bfff700 1 --2- 172.21.15.44:0/2649778030 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa73c06bb30 0x7fa728006a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:54.551 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa741735700 1 -- 172.21.15.44:0/2649778030 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa73c06bb30 msgr2=0x7fa728006a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:54.551 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa741735700 1 --2- 172.21.15.44:0/2649778030 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa73c06bb30 0x7fa728006a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.551 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa741735700 1 -- 172.21.15.44:0/2649778030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa728005c30 msgr2=0x7fa728006050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:54.551 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa741735700 1 --2- 172.21.15.44:0/2649778030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa728005c30 0x7fa728006050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.551 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.543+0000 7fa741735700 1 -- 172.21.15.44:0/2649778030 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7280057e0 con 0x7fa728006fc0 2024-09-13T18:26:54.552 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.547+0000 7fa741735700 1 --2- 172.21.15.44:0/2649778030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa728006fc0 0x7fa728007440 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa734009b40 tx=0x7fa728007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2d8902fe47d906 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:54.552 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.547+0000 7fa73b7fe700 1 -- 172.21.15.44:0/2649778030 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73400e6c0 con 0x7fa728006fc0 2024-09-13T18:26:54.553 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.547+0000 7fa73b7fe700 1 -- 172.21.15.44:0/2649778030 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73400e820 con 0x7fa728006fc0 2024-09-13T18:26:54.553 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.547+0000 7fa73b7fe700 1 -- 172.21.15.44:0/2649778030 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73400eb90 con 0x7fa728006fc0 2024-09-13T18:26:54.553 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.547+0000 7fa743198700 1 -- 172.21.15.44:0/2649778030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa728006fc0 msgr2=0x7fa728007440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:54.553 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.547+0000 7fa743198700 1 --2- 172.21.15.44:0/2649778030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa728006fc0 0x7fa728007440 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa734009b40 tx=0x7fa728007ab0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.553 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.547+0000 7fa741735700 1 -- 172.21.15.44:0/2649778030 reap_dead start 2024-09-13T18:26:54.553 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.547+0000 7fa743198700 1 -- 172.21.15.44:0/2649778030 shutdown_connections 2024-09-13T18:26:54.553 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.547+0000 7fa743198700 1 -- 172.21.15.44:0/2649778030 >> 172.21.15.44:0/2649778030 conn(0x7fa73c0cfaf0 msgr2=0x7fa73c0cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:54.553 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.547+0000 7fa743198700 1 -- 172.21.15.44:0/2649778030 shutdown_connections 2024-09-13T18:26:54.553 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.547+0000 7fa743198700 1 -- 172.21.15.44:0/2649778030 wait complete. 2024-09-13T18:26:54.554 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.547+0000 7fa743198700 1 Processor -- start 2024-09-13T18:26:54.554 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.547+0000 7fa743198700 1 -- start start 2024-09-13T18:26:54.555 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa743198700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa73c13b610 0x7fa73c1519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:54.555 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa743198700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa73c13b9f0 0x7fa73c151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:54.555 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa743198700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa73c153e20 0x7fa73c1542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:54.555 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa743198700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c153440 con 0x7fa73c153e20 2024-09-13T18:26:54.555 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa743198700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c153a00 con 0x7fa73c13b9f0 2024-09-13T18:26:54.555 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa743198700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c147aa0 con 0x7fa73c13b610 2024-09-13T18:26:54.555 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa741735700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa73c153e20 0x7fa73c1542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:54.555 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa741735700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa73c153e20 0x7fa73c1542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45818/0 (socket says 172.21.15.44:45818) 2024-09-13T18:26:54.555 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa741735700 1 -- 172.21.15.44:0/1748552417 learned_addr learned my addr 172.21.15.44:0/1748552417 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:26:54.556 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa73bfff700 1 --2- 172.21.15.44:0/1748552417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa73c13b9f0 0x7fa73c151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:54.556 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa740f34700 1 --2- 172.21.15.44:0/1748552417 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa73c13b610 0x7fa73c1519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:54.557 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa741735700 1 -- 172.21.15.44:0/1748552417 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa73c13b610 msgr2=0x7fa73c1519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:54.557 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa741735700 1 --2- 172.21.15.44:0/1748552417 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa73c13b610 0x7fa73c1519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.557 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa741735700 1 -- 172.21.15.44:0/1748552417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa73c13b9f0 msgr2=0x7fa73c151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:54.557 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa741735700 1 --2- 172.21.15.44:0/1748552417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa73c13b9f0 0x7fa73c151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.557 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa741735700 1 -- 172.21.15.44:0/1748552417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c1525f0 con 0x7fa73c153e20 2024-09-13T18:26:54.557 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa73bfff700 1 --2- 172.21.15.44:0/1748552417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa73c13b9f0 0x7fa73c151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:54.557 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa740f34700 1 --2- 172.21.15.44:0/1748552417 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa73c13b610 0x7fa73c1519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:54.558 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa741735700 1 --2- 172.21.15.44:0/1748552417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa73c153e20 0x7fa73c1542b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa728006990 tx=0x7fa7340047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:54.558 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa7397fa700 1 -- 172.21.15.44:0/1748552417 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73400e6c0 con 0x7fa73c153e20 2024-09-13T18:26:54.558 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa7397fa700 1 -- 172.21.15.44:0/1748552417 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa734004480 con 0x7fa73c153e20 2024-09-13T18:26:54.558 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa743198700 1 -- 172.21.15.44:0/1748552417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c1528d0 con 0x7fa73c153e20 2024-09-13T18:26:54.558 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa7397fa700 1 -- 172.21.15.44:0/1748552417 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734013b40 con 0x7fa73c153e20 2024-09-13T18:26:54.558 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.551+0000 7fa743198700 1 -- 172.21.15.44:0/1748552417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c1547f0 con 0x7fa73c153e20 2024-09-13T18:26:54.558 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.555+0000 7fa743198700 1 -- 172.21.15.44:0/1748552417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73c153b40 con 0x7fa73c153e20 2024-09-13T18:26:54.558 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.555+0000 7fa7397fa700 1 -- 172.21.15.44:0/1748552417 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7fa734013ca0 con 0x7fa73c153e20 2024-09-13T18:26:54.559 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.555+0000 7fa7397fa700 1 --2- 172.21.15.44:0/1748552417 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa71c0666a0 0x7fa71c068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:54.559 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.555+0000 7fa7397fa700 1 -- 172.21.15.44:0/1748552417 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa734000e40 con 0x7fa73c153e20 2024-09-13T18:26:54.560 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.555+0000 7fa740f34700 1 --2- 172.21.15.44:0/1748552417 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa71c0666a0 0x7fa71c068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:54.560 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.555+0000 7fa740f34700 1 --2- 172.21.15.44:0/1748552417 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa71c0666a0 0x7fa71c068b60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0af7b0 tx=0x7fa724008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:54.569 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.563+0000 7fa7397fa700 1 -- 172.21.15.44:0/1748552417 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa73c153b40 con 0x7fa73c153e20 2024-09-13T18:26:54.741 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.735+0000 7fa743198700 1 -- 172.21.15.44:0/1748552417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa73c153b40 con 0x7fa73c153e20 2024-09-13T18:26:54.742 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.739+0000 7fa7397fa700 1 -- 172.21.15.44:0/1748552417 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12790 (secure 0 0 0) 0x7fa73c153b40 con 0x7fa73c153e20 2024-09-13T18:26:54.742 INFO:teuthology.misc.health.smithi044.stdout: 2024-09-13T18:26:54.742 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":17,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:26:52.651994+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:26:54.746 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.743+0000 7fa7397fa700 1 -- 172.21.15.44:0/1748552417 <== mon.0 v2:172.21.15.44:3300/0 8 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa734052bf0 con 0x7fa73c153e20 2024-09-13T18:26:54.747 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.743+0000 7fa743198700 1 -- 172.21.15.44:0/1748552417 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa71c0666a0 msgr2=0x7fa71c068b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:54.747 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.743+0000 7fa743198700 1 --2- 172.21.15.44:0/1748552417 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa71c0666a0 0x7fa71c068b60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0af7b0 tx=0x7fa724008040 comp rx=0 tx=0).stop 2024-09-13T18:26:54.747 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.743+0000 7fa743198700 1 -- 172.21.15.44:0/1748552417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa73c153e20 msgr2=0x7fa73c1542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:54.747 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.743+0000 7fa743198700 1 --2- 172.21.15.44:0/1748552417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa73c153e20 0x7fa73c1542b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa728006990 tx=0x7fa7340047e0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.748 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.743+0000 7fa743198700 1 -- 172.21.15.44:0/1748552417 shutdown_connections 2024-09-13T18:26:54.748 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.743+0000 7fa743198700 1 --2- 172.21.15.44:0/1748552417 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa71c0666a0 0x7fa71c068b60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.748 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.743+0000 7fa743198700 1 --2- 172.21.15.44:0/1748552417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa73c153e20 0x7fa73c1542b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.748 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.743+0000 7fa743198700 1 --2- 172.21.15.44:0/1748552417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa73c13b9f0 0x7fa73c151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.748 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.743+0000 7fa743198700 1 --2- 172.21.15.44:0/1748552417 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa73c13b610 0x7fa73c1519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.748 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.743+0000 7fa743198700 1 -- 172.21.15.44:0/1748552417 >> 172.21.15.44:0/1748552417 conn(0x7fa73c0cfaf0 msgr2=0x7fa73c0cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:54.749 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.743+0000 7fa743198700 1 -- 172.21.15.44:0/1748552417 shutdown_connections 2024-09-13T18:26:54.749 INFO:teuthology.misc.health.smithi044.stderr:2024-09-13T18:26:54.743+0000 7fa743198700 1 -- 172.21.15.44:0/1748552417 wait complete. 2024-09-13T18:26:54.760 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-13T18:26:54.760 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T18:26:54.760 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:26:54.760 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:26:54.762 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:26:54.763 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:26:54.763 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:26:54.765 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:26:54.765 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:26:54.765 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:26:54.767 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:26:54.767 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:26:54.767 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:26:54.769 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:26:54.769 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-13T18:26:54.770 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:26:54.844 INFO:tasks.ceph.mds.b.smithi099.stdout:starting mds.b at 2024-09-13T18:26:54.845 INFO:tasks.ceph.mds.d.smithi099.stdout:starting mds.d at 2024-09-13T18:26:54.852 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-13T18:26:54.857 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-13T18:26:54.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.867+0000 7f1c19364700 1 Processor -- start 2024-09-13T18:26:54.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.867+0000 7f1c19364700 1 -- start start 2024-09-13T18:26:54.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.867+0000 7f1c19364700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c1406bcc0 0x7f1c1415a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:54.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.867+0000 7f1c19364700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1c1406b040 0x7f1c14070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:54.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.867+0000 7f1c19364700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c14071f10 con 0x7f1c140cb2a0 2024-09-13T18:26:54.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.867+0000 7f1c19364700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1406a310 con 0x7f1c1406b040 2024-09-13T18:26:54.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.867+0000 7f1c19364700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1406abb0 con 0x7f1c1406bcc0 2024-09-13T18:26:54.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.867+0000 7f1c137fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1c140cb2a0 0x7f1c1406c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59092/0 (socket says 172.21.15.44:59092) 2024-09-13T18:26:54.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.867+0000 7f1c137fe700 1 -- 172.21.15.44:0/3209443898 learned_addr learned my addr 172.21.15.44:0/3209443898 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:26:54.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.867+0000 7f1c13fff700 1 --2- 172.21.15.44:0/3209443898 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c1406bcc0 0x7f1c1415a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:54.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.867+0000 7f1c18b63700 1 --2- 172.21.15.44:0/3209443898 >> v2:172.21.15.99:3300/0 conn(0x7f1c1406b040 0x7f1c14070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:54.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.867+0000 7f1c12ffd700 1 -- 172.21.15.44:0/3209443898 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100820510 0 0) 0x7f1c14071f10 con 0x7f1c140cb2a0 2024-09-13T18:26:54.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.867+0000 7f1c12ffd700 1 -- 172.21.15.44:0/3209443898 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bfc0035d0 con 0x7f1c140cb2a0 2024-09-13T18:26:54.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.867+0000 7f1c13fff700 1 -- 172.21.15.44:0/3209443898 >> v2:172.21.15.99:3300/0 conn(0x7f1c1406b040 msgr2=0x7f1c14070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:54.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.867+0000 7f1c13fff700 1 --2- 172.21.15.44:0/3209443898 >> v2:172.21.15.99:3300/0 conn(0x7f1c1406b040 0x7f1c14070320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.867+0000 7f1c13fff700 1 -- 172.21.15.44:0/3209443898 >> v1:172.21.15.44:6789/0 conn(0x7f1c140cb2a0 legacy=0x7f1c1406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:54.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.867+0000 7f1c13fff700 1 -- 172.21.15.44:0/3209443898 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c140cba10 con 0x7f1c1406bcc0 2024-09-13T18:26:54.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.867+0000 7f1c13fff700 1 --2- 172.21.15.44:0/3209443898 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c1406bcc0 0x7f1c1415a850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1c04009850 tx=0x7f1c04009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5982cf98500c6dff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:54.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.867+0000 7f1c12ffd700 1 -- 172.21.15.44:0/3209443898 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04011830 con 0x7f1c1406bcc0 2024-09-13T18:26:54.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.867+0000 7f1c12ffd700 1 -- 172.21.15.44:0/3209443898 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c04011990 con 0x7f1c1406bcc0 2024-09-13T18:26:54.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.867+0000 7f1c12ffd700 1 -- 172.21.15.44:0/3209443898 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04011d40 con 0x7f1c1406bcc0 2024-09-13T18:26:54.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.867+0000 7f1c19364700 1 -- 172.21.15.44:0/3209443898 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c1406bcc0 msgr2=0x7f1c1415a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:54.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.867+0000 7f1c19364700 1 --2- 172.21.15.44:0/3209443898 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c1406bcc0 0x7f1c1415a850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1c04009850 tx=0x7f1c04009b60 comp rx=0 tx=0).stop 2024-09-13T18:26:54.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c19364700 1 -- 172.21.15.44:0/3209443898 shutdown_connections 2024-09-13T18:26:54.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c19364700 1 --2- 172.21.15.44:0/3209443898 >> v2:172.21.15.99:3300/0 conn(0x7f1c1406b040 0x7f1c14070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c19364700 1 --2- 172.21.15.44:0/3209443898 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c1406bcc0 0x7f1c1415a850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c19364700 1 -- 172.21.15.44:0/3209443898 >> 172.21.15.44:0/3209443898 conn(0x7f1c1406d900 msgr2=0x7f1c1406dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:54.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c19364700 1 -- 172.21.15.44:0/3209443898 shutdown_connections 2024-09-13T18:26:54.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c19364700 1 -- 172.21.15.44:0/3209443898 wait complete. 2024-09-13T18:26:54.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c19364700 1 Processor -- start 2024-09-13T18:26:54.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c19364700 1 -- start start 2024-09-13T18:26:54.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c19364700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c1406b040 0x7f1c1414dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:54.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c19364700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c1406bcc0 0x7f1c14155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:54.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c19364700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c141562c0 0x7f1c14154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:54.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c19364700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c14156770 con 0x7f1c141562c0 2024-09-13T18:26:54.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c19364700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1414ed80 con 0x7f1c1406b040 2024-09-13T18:26:54.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c19364700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1414eff0 con 0x7f1c1406bcc0 2024-09-13T18:26:54.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c13fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c1406b040 0x7f1c1414dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:54.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c18b63700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c141562c0 0x7f1c14154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:54.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c13fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c1406b040 0x7f1c1414dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:51956/0 (socket says 172.21.15.44:51956) 2024-09-13T18:26:54.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c13fff700 1 -- 172.21.15.44:0/748091808 learned_addr learned my addr 172.21.15.44:0/748091808 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:26:54.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c137fe700 1 --2- 172.21.15.44:0/748091808 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c1406bcc0 0x7f1c14155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:54.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c18b63700 1 -- 172.21.15.44:0/748091808 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c1406bcc0 msgr2=0x7f1c14155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:54.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c18b63700 1 --2- 172.21.15.44:0/748091808 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c1406bcc0 0x7f1c14155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c18b63700 1 -- 172.21.15.44:0/748091808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c1406b040 msgr2=0x7f1c1414dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:54.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c18b63700 1 --2- 172.21.15.44:0/748091808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c1406b040 0x7f1c1414dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c18b63700 1 -- 172.21.15.44:0/748091808 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c040094b0 con 0x7f1c141562c0 2024-09-13T18:26:54.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c137fe700 1 --2- 172.21.15.44:0/748091808 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c1406bcc0 0x7f1c14155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:54.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c18b63700 1 --2- 172.21.15.44:0/748091808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c141562c0 0x7f1c14154a00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009ce0 tx=0x7f1c0c00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:54.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c10ff9700 1 -- 172.21.15.44:0/748091808 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c00cb80 con 0x7f1c141562c0 2024-09-13T18:26:54.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c10ff9700 1 -- 172.21.15.44:0/748091808 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0c00f040 con 0x7f1c141562c0 2024-09-13T18:26:54.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c10ff9700 1 -- 172.21.15.44:0/748091808 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c014480 con 0x7f1c141562c0 2024-09-13T18:26:54.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c19364700 1 -- 172.21.15.44:0/748091808 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1414f2d0 con 0x7f1c141562c0 2024-09-13T18:26:54.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.871+0000 7f1c19364700 1 -- 172.21.15.44:0/748091808 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1414f890 con 0x7f1c141562c0 2024-09-13T18:26:54.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.875+0000 7f1c19364700 1 -- 172.21.15.44:0/748091808 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1414fab0 con 0x7f1c141562c0 2024-09-13T18:26:54.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.875+0000 7f1c10ff9700 1 -- 172.21.15.44:0/748091808 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c0c0145e0 con 0x7f1c141562c0 2024-09-13T18:26:54.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.875+0000 7f1c10ff9700 1 --2- 172.21.15.44:0/748091808 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c00066730 0x7f1c00068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:54.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.875+0000 7f1c10ff9700 1 -- 172.21.15.44:0/748091808 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1c0c0849a0 con 0x7f1c141562c0 2024-09-13T18:26:54.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.875+0000 7f1c13fff700 1 --2- 172.21.15.44:0/748091808 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c00066730 0x7f1c00068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:54.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.875+0000 7f1c13fff700 1 --2- 172.21.15.44:0/748091808 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c00066730 0x7f1c00068bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1c04000c00 tx=0x7f1c04008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:54.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:54.883+0000 7f1c10ff9700 1 -- 172.21.15.44:0/748091808 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1c0c051fe0 con 0x7f1c141562c0 2024-09-13T18:26:55.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.055+0000 7f1c19364700 1 -- 172.21.15.44:0/748091808 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c141575b0 con 0x7f1c141562c0 2024-09-13T18:26:55.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.055+0000 7f1c10ff9700 1 -- 172.21.15.44:0/748091808 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12790 (secure 0 0 0) 0x7f1c0c018090 con 0x7f1c141562c0 2024-09-13T18:26:55.062 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:26:55.062 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":17,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:26:52.651994+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:26:55.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.059+0000 7f1c19364700 1 -- 172.21.15.44:0/748091808 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c00066730 msgr2=0x7f1c00068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.059+0000 7f1c19364700 1 --2- 172.21.15.44:0/748091808 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c00066730 0x7f1c00068bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1c04000c00 tx=0x7f1c04008030 comp rx=0 tx=0).stop 2024-09-13T18:26:55.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.059+0000 7f1c19364700 1 -- 172.21.15.44:0/748091808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c141562c0 msgr2=0x7f1c14154a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.059+0000 7f1c19364700 1 --2- 172.21.15.44:0/748091808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c141562c0 0x7f1c14154a00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009ce0 tx=0x7f1c0c00c0c0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.059+0000 7f1c19364700 1 -- 172.21.15.44:0/748091808 shutdown_connections 2024-09-13T18:26:55.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.059+0000 7f1c19364700 1 --2- 172.21.15.44:0/748091808 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c00066730 0x7f1c00068bf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.059+0000 7f1c19364700 1 --2- 172.21.15.44:0/748091808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c141562c0 0x7f1c14154a00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.059+0000 7f1c19364700 1 --2- 172.21.15.44:0/748091808 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c1406bcc0 0x7f1c14155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.059+0000 7f1c19364700 1 --2- 172.21.15.44:0/748091808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c1406b040 0x7f1c1414dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.059+0000 7f1c19364700 1 -- 172.21.15.44:0/748091808 >> 172.21.15.44:0/748091808 conn(0x7f1c1406d900 msgr2=0x7f1c140aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:55.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.059+0000 7f1c19364700 1 -- 172.21.15.44:0/748091808 shutdown_connections 2024-09-13T18:26:55.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.059+0000 7f1c19364700 1 -- 172.21.15.44:0/748091808 wait complete. 2024-09-13T18:26:55.080 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:26:55.081 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:26:55.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.195+0000 7f1e6215b700 1 Processor -- start 2024-09-13T18:26:55.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.195+0000 7f1e6215b700 1 -- start start 2024-09-13T18:26:55.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.195+0000 7f1e6215b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1e5c070a30 0x7f1e5c0c8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.195+0000 7f1e6215b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1e5c0c8950 0x7f1e5c0c9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.195+0000 7f1e6215b700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e5c0cdbc0 con 0x7f1e5c0b4880 2024-09-13T18:26:55.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.195+0000 7f1e6215b700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e5c0cde60 con 0x7f1e5c0c8950 2024-09-13T18:26:55.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.195+0000 7f1e6215b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c0ce140 con 0x7f1e5c070a30 2024-09-13T18:26:55.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.195+0000 7f1e6195a700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1e5c0c8950 0x7f1e5c0c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.195+0000 7f1e6195a700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1e5c0c8950 0x7f1e5c0c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45870/0 (socket says 172.21.15.44:45870) 2024-09-13T18:26:55.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.195+0000 7f1e6195a700 1 -- 172.21.15.44:0/3581432230 learned_addr learned my addr 172.21.15.44:0/3581432230 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:26:55.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.195+0000 7f1e60958700 1 --2- 172.21.15.44:0/3581432230 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1e5c070a30 0x7f1e5c0c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.199+0000 7f1e6195a700 1 -- 172.21.15.44:0/3581432230 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1e5c070a30 msgr2=0x7f1e5c0c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:55.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.199+0000 7f1e6195a700 1 --2- 172.21.15.44:0/3581432230 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1e5c070a30 0x7f1e5c0c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.199+0000 7f1e6195a700 1 -- 172.21.15.44:0/3581432230 >> v1:172.21.15.99:6789/0 conn(0x7f1e5c0b4880 legacy=0x7f1e5c070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:55.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.199+0000 7f1e6195a700 1 -- 172.21.15.44:0/3581432230 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5c0ce420 con 0x7f1e5c0c8950 2024-09-13T18:26:55.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.199+0000 7f1e6195a700 1 --2- 172.21.15.44:0/3581432230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e5c0c8950 0x7f1e5c0c9630 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1e54009e50 tx=0x7f1e5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbde08178c68fa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:55.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.199+0000 7f1e53fff700 1 -- 172.21.15.44:0/3581432230 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5400e070 con 0x7f1e5c0c8950 2024-09-13T18:26:55.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.199+0000 7f1e53fff700 1 -- 172.21.15.44:0/3581432230 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e54003a40 con 0x7f1e5c0c8950 2024-09-13T18:26:55.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.199+0000 7f1e53fff700 1 -- 172.21.15.44:0/3581432230 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e54003df0 con 0x7f1e5c0c8950 2024-09-13T18:26:55.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.199+0000 7f1e6215b700 1 -- 172.21.15.44:0/3581432230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e5c0c8950 msgr2=0x7f1e5c0c9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.199+0000 7f1e6215b700 1 --2- 172.21.15.44:0/3581432230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e5c0c8950 0x7f1e5c0c9630 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1e54009e50 tx=0x7f1e5400b330 comp rx=0 tx=0).stop 2024-09-13T18:26:55.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.199+0000 7f1e6215b700 1 -- 172.21.15.44:0/3581432230 shutdown_connections 2024-09-13T18:26:55.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.199+0000 7f1e6215b700 1 --2- 172.21.15.44:0/3581432230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e5c0c8950 0x7f1e5c0c9630 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.199+0000 7f1e6215b700 1 --2- 172.21.15.44:0/3581432230 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1e5c070a30 0x7f1e5c0c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.199+0000 7f1e6215b700 1 -- 172.21.15.44:0/3581432230 >> 172.21.15.44:0/3581432230 conn(0x7f1e5c0cba60 msgr2=0x7f1e5c0cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:55.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.199+0000 7f1e6215b700 1 -- 172.21.15.44:0/3581432230 shutdown_connections 2024-09-13T18:26:55.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.199+0000 7f1e6215b700 1 -- 172.21.15.44:0/3581432230 wait complete. 2024-09-13T18:26:55.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.199+0000 7f1e6215b700 1 Processor -- start 2024-09-13T18:26:55.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.203+0000 7f1e6215b700 1 -- start start 2024-09-13T18:26:55.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.203+0000 7f1e6215b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e5c070a30 0x7f1e5c06b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.203+0000 7f1e6215b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e5c0b4880 0x7f1e5c158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.203+0000 7f1e6215b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1e5c0c8950 0x7f1e5c1587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.203+0000 7f1e6215b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c06bcb0 con 0x7f1e5c0b4880 2024-09-13T18:26:55.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.203+0000 7f1e6215b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c06cf20 con 0x7f1e5c070a30 2024-09-13T18:26:55.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.203+0000 7f1e6215b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c06b730 con 0x7f1e5c0c8950 2024-09-13T18:26:55.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.203+0000 7f1e61159700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e5c070a30 0x7f1e5c06b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.203+0000 7f1e60958700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e5c0b4880 0x7f1e5c158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.203+0000 7f1e61159700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e5c070a30 0x7f1e5c06b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:51966/0 (socket says 172.21.15.44:51966) 2024-09-13T18:26:55.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.203+0000 7f1e61159700 1 -- 172.21.15.44:0/4067047860 learned_addr learned my addr 172.21.15.44:0/4067047860 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:26:55.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.203+0000 7f1e6195a700 1 --2- 172.21.15.44:0/4067047860 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1e5c0c8950 0x7f1e5c1587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.203+0000 7f1e61159700 1 -- 172.21.15.44:0/4067047860 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1e5c0c8950 msgr2=0x7f1e5c1587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.203+0000 7f1e61159700 1 --2- 172.21.15.44:0/4067047860 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1e5c0c8950 0x7f1e5c1587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.203+0000 7f1e61159700 1 -- 172.21.15.44:0/4067047860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e5c0b4880 msgr2=0x7f1e5c158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.203+0000 7f1e61159700 1 --2- 172.21.15.44:0/4067047860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e5c0b4880 0x7f1e5c158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.203+0000 7f1e61159700 1 -- 172.21.15.44:0/4067047860 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e54009b30 con 0x7f1e5c070a30 2024-09-13T18:26:55.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.203+0000 7f1e61159700 1 --2- 172.21.15.44:0/4067047860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e5c070a30 0x7f1e5c06b1f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00c4e0 tx=0x7f1e4c00c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:55.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.203+0000 7f1e51ffb700 1 -- 172.21.15.44:0/4067047860 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c011790 con 0x7f1e5c070a30 2024-09-13T18:26:55.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.203+0000 7f1e51ffb700 1 -- 172.21.15.44:0/4067047860 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4c011910 con 0x7f1e5c070a30 2024-09-13T18:26:55.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.203+0000 7f1e6215b700 1 -- 172.21.15.44:0/4067047860 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e5c0b4de0 con 0x7f1e5c070a30 2024-09-13T18:26:55.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.203+0000 7f1e51ffb700 1 -- 172.21.15.44:0/4067047860 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c011cc0 con 0x7f1e5c070a30 2024-09-13T18:26:55.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.207+0000 7f1e6215b700 1 -- 172.21.15.44:0/4067047860 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e5c06c8d0 con 0x7f1e5c070a30 2024-09-13T18:26:55.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.207+0000 7f1e6215b700 1 -- 172.21.15.44:0/4067047860 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e5c0c8410 con 0x7f1e5c070a30 2024-09-13T18:26:55.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.207+0000 7f1e51ffb700 1 -- 172.21.15.44:0/4067047860 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1e4c01c460 con 0x7f1e5c070a30 2024-09-13T18:26:55.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.207+0000 7f1e51ffb700 1 --2- 172.21.15.44:0/4067047860 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1e48066730 0x7f1e48068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.207+0000 7f1e51ffb700 1 -- 172.21.15.44:0/4067047860 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1e4c083b10 con 0x7f1e5c070a30 2024-09-13T18:26:55.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.207+0000 7f1e60958700 1 --2- 172.21.15.44:0/4067047860 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1e48066730 0x7f1e48068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.211+0000 7f1e60958700 1 --2- 172.21.15.44:0/4067047860 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1e48066730 0x7f1e48068bf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c1f3580 tx=0x7f1e58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:55.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.219+0000 7f1e51ffb700 1 -- 172.21.15.44:0/4067047860 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1e4c0511c0 con 0x7f1e5c070a30 2024-09-13T18:26:55.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.391+0000 7f1e6215b700 1 -- 172.21.15.44:0/4067047860 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1e5c074560 con 0x7f1e5c070a30 2024-09-13T18:26:55.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.395+0000 7f1e51ffb700 1 -- 172.21.15.44:0/4067047860 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1e4c0547e0 con 0x7f1e5c070a30 2024-09-13T18:26:55.399 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:26:55.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.395+0000 7f1e6215b700 1 -- 172.21.15.44:0/4067047860 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1e48066730 msgr2=0x7f1e48068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.395+0000 7f1e6215b700 1 --2- 172.21.15.44:0/4067047860 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1e48066730 0x7f1e48068bf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c1f3580 tx=0x7f1e58008040 comp rx=0 tx=0).stop 2024-09-13T18:26:55.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.395+0000 7f1e6215b700 1 -- 172.21.15.44:0/4067047860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e5c070a30 msgr2=0x7f1e5c06b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.395+0000 7f1e6215b700 1 --2- 172.21.15.44:0/4067047860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e5c070a30 0x7f1e5c06b1f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00c4e0 tx=0x7f1e4c00c7f0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.395+0000 7f1e6215b700 1 -- 172.21.15.44:0/4067047860 shutdown_connections 2024-09-13T18:26:55.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.395+0000 7f1e6215b700 1 --2- 172.21.15.44:0/4067047860 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1e48066730 0x7f1e48068bf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.395+0000 7f1e6215b700 1 --2- 172.21.15.44:0/4067047860 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1e5c0c8950 0x7f1e5c1587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.395+0000 7f1e6215b700 1 --2- 172.21.15.44:0/4067047860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e5c0b4880 0x7f1e5c158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.395+0000 7f1e6215b700 1 --2- 172.21.15.44:0/4067047860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e5c070a30 0x7f1e5c06b1f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.395+0000 7f1e6215b700 1 -- 172.21.15.44:0/4067047860 >> 172.21.15.44:0/4067047860 conn(0x7f1e5c0cba60 msgr2=0x7f1e5c0b2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:55.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.395+0000 7f1e6215b700 1 -- 172.21.15.44:0/4067047860 shutdown_connections 2024-09-13T18:26:55.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.395+0000 7f1e6215b700 1 -- 172.21.15.44:0/4067047860 wait complete. 2024-09-13T18:26:55.413 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:26:55.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.527+0000 7f1549576700 1 Processor -- start 2024-09-13T18:26:55.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.527+0000 7f1549576700 1 -- start start 2024-09-13T18:26:55.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.527+0000 7f1549576700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f15440b3ae0 0x7f1544165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.527+0000 7f1549576700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1544161290 0x7f15441616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.527+0000 7f1549576700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1544071f30 con 0x7f1544160eb0 2024-09-13T18:26:55.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.527+0000 7f1549576700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15441622e0 con 0x7f15440b3ae0 2024-09-13T18:26:55.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.527+0000 7f1549576700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1544162000 con 0x7f1544161290 2024-09-13T18:26:55.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.527+0000 7f15437fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f15440b3ae0 0x7f1544165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.527+0000 7f15437fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f15440b3ae0 0x7f1544165590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45892/0 (socket says 172.21.15.44:45892) 2024-09-13T18:26:55.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.527+0000 7f15437fe700 1 -- 172.21.15.44:0/858872018 learned_addr learned my addr 172.21.15.44:0/858872018 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:26:55.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.527+0000 7f1543fff700 1 --1- 172.21.15.44:0/858872018 >> v1:172.21.15.44:6789/0 conn(0x7f1544160eb0 0x7f15440b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59106/0 (socket says 172.21.15.44:59106) 2024-09-13T18:26:55.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.527+0000 7f1548d75700 1 --2- 172.21.15.44:0/858872018 >> v2:172.21.15.99:3300/0 conn(0x7f1544161290 0x7f15441616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.527+0000 7f15437fe700 1 -- 172.21.15.44:0/858872018 >> v2:172.21.15.99:3300/0 conn(0x7f1544161290 msgr2=0x7f15441616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:55.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.527+0000 7f15437fe700 1 --2- 172.21.15.44:0/858872018 >> v2:172.21.15.99:3300/0 conn(0x7f1544161290 0x7f15441616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.527+0000 7f15437fe700 1 -- 172.21.15.44:0/858872018 >> v1:172.21.15.44:6789/0 conn(0x7f1544160eb0 legacy=0x7f15440b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.527+0000 7f15437fe700 1 -- 172.21.15.44:0/858872018 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1544164ab0 con 0x7f15440b3ae0 2024-09-13T18:26:55.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.527+0000 7f15437fe700 1 --2- 172.21.15.44:0/858872018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15440b3ae0 0x7f1544165590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f15440cd640 tx=0x7f152c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6bfef4b8b2356d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:55.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.527+0000 7f1542ffd700 1 -- 172.21.15.44:0/858872018 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c00b8a0 con 0x7f15440b3ae0 2024-09-13T18:26:55.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.531+0000 7f1542ffd700 1 -- 172.21.15.44:0/858872018 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152c00ba00 con 0x7f15440b3ae0 2024-09-13T18:26:55.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.531+0000 7f1542ffd700 1 -- 172.21.15.44:0/858872018 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c00bd90 con 0x7f15440b3ae0 2024-09-13T18:26:55.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.531+0000 7f1549576700 1 -- 172.21.15.44:0/858872018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15440b3ae0 msgr2=0x7f1544165590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.531+0000 7f1549576700 1 --2- 172.21.15.44:0/858872018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15440b3ae0 0x7f1544165590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f15440cd640 tx=0x7f152c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.531+0000 7f1549576700 1 -- 172.21.15.44:0/858872018 shutdown_connections 2024-09-13T18:26:55.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.531+0000 7f1549576700 1 --2- 172.21.15.44:0/858872018 >> v2:172.21.15.99:3300/0 conn(0x7f1544161290 0x7f15441616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.531+0000 7f1549576700 1 --2- 172.21.15.44:0/858872018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15440b3ae0 0x7f1544165590 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.531+0000 7f1549576700 1 -- 172.21.15.44:0/858872018 >> 172.21.15.44:0/858872018 conn(0x7f15440b0f00 msgr2=0x7f15440b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:55.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.531+0000 7f1549576700 1 -- 172.21.15.44:0/858872018 shutdown_connections 2024-09-13T18:26:55.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.531+0000 7f1549576700 1 -- 172.21.15.44:0/858872018 wait complete. 2024-09-13T18:26:55.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.531+0000 7f1549576700 1 Processor -- start 2024-09-13T18:26:55.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.531+0000 7f1549576700 1 -- start start 2024-09-13T18:26:55.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.535+0000 7f1549576700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15440b3ae0 0x7f15440ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.535+0000 7f1549576700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1544160eb0 0x7f1544156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.535+0000 7f1549576700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1544161290 0x7f154415baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.535+0000 7f1549576700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15441f6d90 con 0x7f1544161290 2024-09-13T18:26:55.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.535+0000 7f1549576700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154415d780 con 0x7f15440b3ae0 2024-09-13T18:26:55.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.535+0000 7f1549576700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15440ade40 con 0x7f1544160eb0 2024-09-13T18:26:55.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.535+0000 7f1548d75700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1544161290 0x7f154415baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.535+0000 7f1548d75700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1544161290 0x7f154415baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45896/0 (socket says 172.21.15.44:45896) 2024-09-13T18:26:55.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.535+0000 7f1548d75700 1 -- 172.21.15.44:0/547480353 learned_addr learned my addr 172.21.15.44:0/547480353 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:26:55.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.535+0000 7f1543fff700 1 --2- 172.21.15.44:0/547480353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15440b3ae0 0x7f15440ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.535+0000 7f15437fe700 1 --2- 172.21.15.44:0/547480353 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1544160eb0 0x7f1544156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.535+0000 7f1548d75700 1 -- 172.21.15.44:0/547480353 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1544160eb0 msgr2=0x7f1544156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.535+0000 7f1548d75700 1 --2- 172.21.15.44:0/547480353 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1544160eb0 0x7f1544156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.535+0000 7f1548d75700 1 -- 172.21.15.44:0/547480353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15440b3ae0 msgr2=0x7f15440ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.535+0000 7f1548d75700 1 --2- 172.21.15.44:0/547480353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15440b3ae0 0x7f15440ad7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.535+0000 7f1548d75700 1 -- 172.21.15.44:0/547480353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c009570 con 0x7f1544161290 2024-09-13T18:26:55.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.535+0000 7f1548d75700 1 --2- 172.21.15.44:0/547480353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1544161290 0x7f154415baf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f153400d800 tx=0x7f153400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:55.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.535+0000 7f1540ff9700 1 -- 172.21.15.44:0/547480353 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15340125f0 con 0x7f1544161290 2024-09-13T18:26:55.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.535+0000 7f1540ff9700 1 -- 172.21.15.44:0/547480353 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1534012790 con 0x7f1544161290 2024-09-13T18:26:55.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.535+0000 7f1549576700 1 -- 172.21.15.44:0/547480353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15440ae120 con 0x7f1544161290 2024-09-13T18:26:55.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.535+0000 7f1540ff9700 1 -- 172.21.15.44:0/547480353 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1534012b40 con 0x7f1544161290 2024-09-13T18:26:55.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.535+0000 7f1549576700 1 -- 172.21.15.44:0/547480353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1544160650 con 0x7f1544161290 2024-09-13T18:26:55.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.535+0000 7f1549576700 1 -- 172.21.15.44:0/547480353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f154415d270 con 0x7f1544161290 2024-09-13T18:26:55.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.539+0000 7f1540ff9700 1 -- 172.21.15.44:0/547480353 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1534012ca0 con 0x7f1544161290 2024-09-13T18:26:55.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.539+0000 7f1540ff9700 1 --2- 172.21.15.44:0/547480353 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1528066730 0x7f1528068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.539+0000 7f1540ff9700 1 -- 172.21.15.44:0/547480353 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1534083dc0 con 0x7f1544161290 2024-09-13T18:26:55.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.539+0000 7f1543fff700 1 --2- 172.21.15.44:0/547480353 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1528066730 0x7f1528068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.539+0000 7f1543fff700 1 --2- 172.21.15.44:0/547480353 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1528066730 0x7f1528068bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f154415a080 tx=0x7f153c001af0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:55.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.543+0000 7f1540ff9700 1 -- 172.21.15.44:0/547480353 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f154415d270 con 0x7f1544161290 2024-09-13T18:26:55.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.755+0000 7f1549576700 1 -- 172.21.15.44:0/547480353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f154415d270 con 0x7f1544161290 2024-09-13T18:26:55.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.755+0000 7f1540ff9700 1 -- 172.21.15.44:0/547480353 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7f154415d270 con 0x7f1544161290 2024-09-13T18:26:55.761 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:26:55.761 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2616086834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2616086834},{"type":"v1","addr":"172.21.15.99:6835","nonce":2616086834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T18:26:55.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.759+0000 7f1549576700 1 -- 172.21.15.44:0/547480353 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1528066730 msgr2=0x7f1528068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.759+0000 7f1549576700 1 --2- 172.21.15.44:0/547480353 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1528066730 0x7f1528068bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f154415a080 tx=0x7f153c001af0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.759+0000 7f1549576700 1 -- 172.21.15.44:0/547480353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1544161290 msgr2=0x7f154415baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.759+0000 7f1549576700 1 --2- 172.21.15.44:0/547480353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1544161290 0x7f154415baf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f153400d800 tx=0x7f153400db10 comp rx=0 tx=0).stop 2024-09-13T18:26:55.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.759+0000 7f1549576700 1 -- 172.21.15.44:0/547480353 shutdown_connections 2024-09-13T18:26:55.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.759+0000 7f1549576700 1 --2- 172.21.15.44:0/547480353 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1528066730 0x7f1528068bf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.759+0000 7f1549576700 1 --2- 172.21.15.44:0/547480353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1544161290 0x7f154415baf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.759+0000 7f1549576700 1 --2- 172.21.15.44:0/547480353 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1544160eb0 0x7f1544156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.759+0000 7f1549576700 1 --2- 172.21.15.44:0/547480353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15440b3ae0 0x7f15440ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.759+0000 7f1549576700 1 -- 172.21.15.44:0/547480353 >> 172.21.15.44:0/547480353 conn(0x7f15440b0f00 msgr2=0x7f15440af920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:55.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.759+0000 7f1549576700 1 -- 172.21.15.44:0/547480353 shutdown_connections 2024-09-13T18:26:55.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:55.759+0000 7f1549576700 1 -- 172.21.15.44:0/547480353 wait complete. 2024-09-13T18:26:55.767 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 2 2024-09-13T18:26:57.781 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:26:57.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.899+0000 7f6d717dc700 1 Processor -- start 2024-09-13T18:26:57.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.899+0000 7f6d717dc700 1 -- start start 2024-09-13T18:26:57.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.899+0000 7f6d717dc700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6d6c0b3ae0 0x7f6d6c06a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:57.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.899+0000 7f6d717dc700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6d6c06aaf0 0x7f6d6c15e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:57.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.899+0000 7f6d717dc700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6c13dcb0 con 0x7f6d6c06bbf0 2024-09-13T18:26:57.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.899+0000 7f6d717dc700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6c15be60 con 0x7f6d6c0b3ae0 2024-09-13T18:26:57.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.899+0000 7f6d717dc700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c13ffd0 con 0x7f6d6c06aaf0 2024-09-13T18:26:57.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.899+0000 7f6d6bfff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f6d6c06bbf0 0x7f6d6c0b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59108/0 (socket says 172.21.15.44:59108) 2024-09-13T18:26:57.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.899+0000 7f6d6bfff700 1 -- 172.21.15.44:0/4236672276 learned_addr learned my addr 172.21.15.44:0/4236672276 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:26:57.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.899+0000 7f6d70fdb700 1 --2- 172.21.15.44:0/4236672276 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6d6c06aaf0 0x7f6d6c15e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:57.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.899+0000 7f6d6b7fe700 1 --2- 172.21.15.44:0/4236672276 >> v2:172.21.15.99:3300/0 conn(0x7f6d6c0b3ae0 0x7f6d6c06a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:57.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.899+0000 7f6d6affd700 1 -- 172.21.15.44:0/4236672276 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751060689 0 0) 0x7f6d6c13dcb0 con 0x7f6d6c06bbf0 2024-09-13T18:26:57.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.899+0000 7f6d6affd700 1 -- 172.21.15.44:0/4236672276 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d540035d0 con 0x7f6d6c06bbf0 2024-09-13T18:26:57.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.903+0000 7f6d6affd700 1 -- 172.21.15.44:0/4236672276 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1657402187 0 0) 0x7f6d540035d0 con 0x7f6d6c06bbf0 2024-09-13T18:26:57.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.903+0000 7f6d70fdb700 1 -- 172.21.15.44:0/4236672276 >> v2:172.21.15.99:3300/0 conn(0x7f6d6c0b3ae0 msgr2=0x7f6d6c06a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:57.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.903+0000 7f6d70fdb700 1 --2- 172.21.15.44:0/4236672276 >> v2:172.21.15.99:3300/0 conn(0x7f6d6c0b3ae0 0x7f6d6c06a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:57.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.903+0000 7f6d70fdb700 1 -- 172.21.15.44:0/4236672276 >> v1:172.21.15.44:6789/0 conn(0x7f6d6c06bbf0 legacy=0x7f6d6c0b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:57.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.903+0000 7f6d70fdb700 1 -- 172.21.15.44:0/4236672276 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c140220 con 0x7f6d6c06aaf0 2024-09-13T18:26:57.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.903+0000 7f6d70fdb700 1 --2- 172.21.15.44:0/4236672276 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6d6c06aaf0 0x7f6d6c15e440 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009d90 tx=0x7f6d6400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68d5d036b75bc708 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:57.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.903+0000 7f6d6affd700 1 -- 172.21.15.44:0/4236672276 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6400e070 con 0x7f6d6c06aaf0 2024-09-13T18:26:57.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.903+0000 7f6d6affd700 1 -- 172.21.15.44:0/4236672276 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d64003a40 con 0x7f6d6c06aaf0 2024-09-13T18:26:57.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.903+0000 7f6d6affd700 1 -- 172.21.15.44:0/4236672276 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d60001670 con 0x7f6d6c06aaf0 2024-09-13T18:26:57.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.903+0000 7f6d717dc700 1 -- 172.21.15.44:0/4236672276 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6d6c06aaf0 msgr2=0x7f6d6c15e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:57.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.903+0000 7f6d717dc700 1 --2- 172.21.15.44:0/4236672276 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6d6c06aaf0 0x7f6d6c15e440 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009d90 tx=0x7f6d6400b330 comp rx=0 tx=0).stop 2024-09-13T18:26:57.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.903+0000 7f6d717dc700 1 -- 172.21.15.44:0/4236672276 shutdown_connections 2024-09-13T18:26:57.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.903+0000 7f6d717dc700 1 --2- 172.21.15.44:0/4236672276 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6d6c06aaf0 0x7f6d6c15e440 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:57.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.903+0000 7f6d717dc700 1 --2- 172.21.15.44:0/4236672276 >> v2:172.21.15.99:3300/0 conn(0x7f6d6c0b3ae0 0x7f6d6c06a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:57.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.903+0000 7f6d717dc700 1 -- 172.21.15.44:0/4236672276 >> 172.21.15.44:0/4236672276 conn(0x7f6d6c0b0f00 msgr2=0x7f6d6c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:57.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.903+0000 7f6d717dc700 1 -- 172.21.15.44:0/4236672276 shutdown_connections 2024-09-13T18:26:57.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.903+0000 7f6d717dc700 1 -- 172.21.15.44:0/4236672276 wait complete. 2024-09-13T18:26:57.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.907+0000 7f6d717dc700 1 Processor -- start 2024-09-13T18:26:57.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.907+0000 7f6d717dc700 1 -- start start 2024-09-13T18:26:57.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.907+0000 7f6d717dc700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d6c06aaf0 0x7f6d6c151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:57.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.907+0000 7f6d717dc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d6c06bbf0 0x7f6d6c13d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:57.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.907+0000 7f6d717dc700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6d6c0b3ae0 0x7f6d6c153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:57.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.907+0000 7f6d717dc700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c13f7d0 con 0x7f6d6c06bbf0 2024-09-13T18:26:57.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.907+0000 7f6d717dc700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c1524b0 con 0x7f6d6c06aaf0 2024-09-13T18:26:57.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.907+0000 7f6d717dc700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c15cdc0 con 0x7f6d6c0b3ae0 2024-09-13T18:26:57.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.907+0000 7f6d6b7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d6c06bbf0 0x7f6d6c13d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:57.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.911+0000 7f6d70fdb700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6d6c0b3ae0 0x7f6d6c153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:57.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.911+0000 7f6d6bfff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d6c06aaf0 0x7f6d6c151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:57.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.911+0000 7f6d70fdb700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6d6c0b3ae0 0x7f6d6c153940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:38042/0 (socket says 172.21.15.44:38042) 2024-09-13T18:26:57.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.911+0000 7f6d6b7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d6c06bbf0 0x7f6d6c13d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45912/0 (socket says 172.21.15.44:45912) 2024-09-13T18:26:57.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.911+0000 7f6d70fdb700 1 -- 172.21.15.44:0/111797106 learned_addr learned my addr 172.21.15.44:0/111797106 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:26:57.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.911+0000 7f6d6b7fe700 1 -- 172.21.15.44:0/111797106 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6d6c0b3ae0 msgr2=0x7f6d6c153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:57.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.911+0000 7f6d6b7fe700 1 --2- 172.21.15.44:0/111797106 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6d6c0b3ae0 0x7f6d6c153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:57.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.911+0000 7f6d6b7fe700 1 -- 172.21.15.44:0/111797106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d6c06aaf0 msgr2=0x7f6d6c151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:57.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.911+0000 7f6d6b7fe700 1 --2- 172.21.15.44:0/111797106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d6c06aaf0 0x7f6d6c151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:57.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.911+0000 7f6d6b7fe700 1 -- 172.21.15.44:0/111797106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d64009a70 con 0x7f6d6c06bbf0 2024-09-13T18:26:57.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.911+0000 7f6d70fdb700 1 --2- 172.21.15.44:0/111797106 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6d6c0b3ae0 0x7f6d6c153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:26:57.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.911+0000 7f6d6b7fe700 1 --2- 172.21.15.44:0/111797106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d6c06bbf0 0x7f6d6c13d1d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00e900 tx=0x7f6d5c00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:57.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.911+0000 7f6d68ff9700 1 -- 172.21.15.44:0/111797106 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c013680 con 0x7f6d6c06bbf0 2024-09-13T18:26:57.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.911+0000 7f6d68ff9700 1 -- 172.21.15.44:0/111797106 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5c0137e0 con 0x7f6d6c06bbf0 2024-09-13T18:26:57.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.911+0000 7f6d717dc700 1 -- 172.21.15.44:0/111797106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d6c13fa20 con 0x7f6d6c06bbf0 2024-09-13T18:26:57.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.911+0000 7f6d68ff9700 1 -- 172.21.15.44:0/111797106 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c013b50 con 0x7f6d6c06bbf0 2024-09-13T18:26:57.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.911+0000 7f6d717dc700 1 -- 172.21.15.44:0/111797106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d6c13db20 con 0x7f6d6c06bbf0 2024-09-13T18:26:57.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.911+0000 7f6d717dc700 1 -- 172.21.15.44:0/111797106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d6c06af80 con 0x7f6d6c06bbf0 2024-09-13T18:26:57.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.911+0000 7f6d68ff9700 1 -- 172.21.15.44:0/111797106 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6d5c013cb0 con 0x7f6d6c06bbf0 2024-09-13T18:26:57.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.911+0000 7f6d68ff9700 1 --2- 172.21.15.44:0/111797106 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6d58066730 0x7f6d58068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:57.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.915+0000 7f6d68ff9700 1 -- 172.21.15.44:0/111797106 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6d5c083d00 con 0x7f6d6c06bbf0 2024-09-13T18:26:57.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.915+0000 7f6d6bfff700 1 --2- 172.21.15.44:0/111797106 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6d58066730 0x7f6d58068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:57.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.915+0000 7f6d6bfff700 1 --2- 172.21.15.44:0/111797106 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6d58066730 0x7f6d58068bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6d60001eb0 tx=0x7f6d60001e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:57.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:57.923+0000 7f6d68ff9700 1 -- 172.21.15.44:0/111797106 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6d5c0513d0 con 0x7f6d6c06bbf0 2024-09-13T18:26:58.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.127+0000 7f6d717dc700 1 -- 172.21.15.44:0/111797106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d6c0663f0 con 0x7f6d6c06bbf0 2024-09-13T18:26:58.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.127+0000 7f6d68ff9700 1 -- 172.21.15.44:0/111797106 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3521 (secure 0 0 0) 0x7f6d5c017de0 con 0x7f6d6c06bbf0 2024-09-13T18:26:58.132 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:26:58.133 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2616086834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2616086834},{"type":"v1","addr":"172.21.15.99:6835","nonce":2616086834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/2083799524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2083799524},{"type":"v1","addr":"172.21.15.99:6837","nonce":2083799524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/369871675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":369871675},{"type":"v1","addr":"172.21.15.44:6833","nonce":369871675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1402693416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1402693416},{"type":"v1","addr":"172.21.15.44:6835","nonce":1402693416}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T18:26:58.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.131+0000 7f6d717dc700 1 -- 172.21.15.44:0/111797106 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6d58066730 msgr2=0x7f6d58068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:58.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.131+0000 7f6d717dc700 1 --2- 172.21.15.44:0/111797106 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6d58066730 0x7f6d58068bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6d60001eb0 tx=0x7f6d60001e40 comp rx=0 tx=0).stop 2024-09-13T18:26:58.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.131+0000 7f6d717dc700 1 -- 172.21.15.44:0/111797106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d6c06bbf0 msgr2=0x7f6d6c13d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:58.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.131+0000 7f6d717dc700 1 --2- 172.21.15.44:0/111797106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d6c06bbf0 0x7f6d6c13d1d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00e900 tx=0x7f6d5c00ec10 comp rx=0 tx=0).stop 2024-09-13T18:26:58.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.131+0000 7f6d717dc700 1 -- 172.21.15.44:0/111797106 shutdown_connections 2024-09-13T18:26:58.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.131+0000 7f6d717dc700 1 --2- 172.21.15.44:0/111797106 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6d58066730 0x7f6d58068bf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.131+0000 7f6d717dc700 1 --2- 172.21.15.44:0/111797106 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6d6c0b3ae0 0x7f6d6c153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.131+0000 7f6d717dc700 1 --2- 172.21.15.44:0/111797106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d6c06bbf0 0x7f6d6c13d1d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.131+0000 7f6d717dc700 1 --2- 172.21.15.44:0/111797106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d6c06aaf0 0x7f6d6c151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.131+0000 7f6d717dc700 1 -- 172.21.15.44:0/111797106 >> 172.21.15.44:0/111797106 conn(0x7f6d6c0b0f00 msgr2=0x7f6d6c0aca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:58.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.131+0000 7f6d717dc700 1 -- 172.21.15.44:0/111797106 shutdown_connections 2024-09-13T18:26:58.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.131+0000 7f6d717dc700 1 -- 172.21.15.44:0/111797106 wait complete. 2024-09-13T18:26:58.136 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 3 2024-09-13T18:26:58.147 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:26:58.216 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:26:58.219 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:26:58.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.259+0000 7f1f45b65700 1 Processor -- start 2024-09-13T18:26:58.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.259+0000 7f1f45b65700 1 -- start start 2024-09-13T18:26:58.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.259+0000 7f1f45b65700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1f40158360 0x7f1f40070b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.259+0000 7f1f45b65700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f4015c060 0x7f1f4006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.259+0000 7f1f45b65700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f40071360 con 0x7f1f4015bb20 2024-09-13T18:26:58.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.259+0000 7f1f45b65700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4006cd60 con 0x7f1f40158360 2024-09-13T18:26:58.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.259+0000 7f1f45b65700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4006d040 con 0x7f1f4015c060 2024-09-13T18:26:58.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.259+0000 7f1f45364700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1f4015bb20 0x7f1f4006d840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59112/0 (socket says 172.21.15.44:59112) 2024-09-13T18:26:58.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.259+0000 7f1f45364700 1 -- 172.21.15.44:0/4118285894 learned_addr learned my addr 172.21.15.44:0/4118285894 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:26:58.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.259+0000 7f1f3ffff700 1 --2- 172.21.15.44:0/4118285894 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f4015c060 0x7f1f4006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.259+0000 7f1f44b63700 1 --2- 172.21.15.44:0/4118285894 >> v2:172.21.15.99:3300/0 conn(0x7f1f40158360 0x7f1f40070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.259+0000 7f1f3f7fe700 1 -- 172.21.15.44:0/4118285894 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609731226 0 0) 0x7f1f40071360 con 0x7f1f4015bb20 2024-09-13T18:26:58.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.259+0000 7f1f3f7fe700 1 -- 172.21.15.44:0/4118285894 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f2c0035d0 con 0x7f1f4015bb20 2024-09-13T18:26:58.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.259+0000 7f1f3ffff700 1 -- 172.21.15.44:0/4118285894 >> v2:172.21.15.99:3300/0 conn(0x7f1f40158360 msgr2=0x7f1f40070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:58.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.259+0000 7f1f3ffff700 1 --2- 172.21.15.44:0/4118285894 >> v2:172.21.15.99:3300/0 conn(0x7f1f40158360 0x7f1f40070b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.259+0000 7f1f3ffff700 1 -- 172.21.15.44:0/4118285894 >> v1:172.21.15.44:6789/0 conn(0x7f1f4015bb20 legacy=0x7f1f4006d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:58.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.259+0000 7f1f3ffff700 1 -- 172.21.15.44:0/4118285894 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4006d320 con 0x7f1f4015c060 2024-09-13T18:26:58.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.259+0000 7f1f3ffff700 1 --2- 172.21.15.44:0/4118285894 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f4015c060 0x7f1f4006aba0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009d90 tx=0x7f1f3800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee26c89cafe1d928 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:58.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.259+0000 7f1f3f7fe700 1 -- 172.21.15.44:0/4118285894 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3800e070 con 0x7f1f4015c060 2024-09-13T18:26:58.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.259+0000 7f1f3f7fe700 1 -- 172.21.15.44:0/4118285894 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3800bb20 con 0x7f1f4015c060 2024-09-13T18:26:58.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.259+0000 7f1f3f7fe700 1 -- 172.21.15.44:0/4118285894 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3800be90 con 0x7f1f4015c060 2024-09-13T18:26:58.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.263+0000 7f1f45b65700 1 -- 172.21.15.44:0/4118285894 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f4015c060 msgr2=0x7f1f4006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:58.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.263+0000 7f1f45b65700 1 --2- 172.21.15.44:0/4118285894 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f4015c060 0x7f1f4006aba0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009d90 tx=0x7f1f3800b330 comp rx=0 tx=0).stop 2024-09-13T18:26:58.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.263+0000 7f1f45b65700 1 -- 172.21.15.44:0/4118285894 shutdown_connections 2024-09-13T18:26:58.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.263+0000 7f1f45b65700 1 --2- 172.21.15.44:0/4118285894 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f4015c060 0x7f1f4006aba0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.263+0000 7f1f45b65700 1 --2- 172.21.15.44:0/4118285894 >> v2:172.21.15.99:3300/0 conn(0x7f1f40158360 0x7f1f40070b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.263+0000 7f1f45b65700 1 -- 172.21.15.44:0/4118285894 >> 172.21.15.44:0/4118285894 conn(0x7f1f400b16a0 msgr2=0x7f1f400b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:58.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.263+0000 7f1f45b65700 1 -- 172.21.15.44:0/4118285894 shutdown_connections 2024-09-13T18:26:58.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.263+0000 7f1f45b65700 1 -- 172.21.15.44:0/4118285894 wait complete. 2024-09-13T18:26:58.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.263+0000 7f1f45b65700 1 Processor -- start 2024-09-13T18:26:58.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.263+0000 7f1f45b65700 1 -- start start 2024-09-13T18:26:58.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f45b65700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f40158360 0x7f1f40142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f45b65700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f4015bb20 0x7f1f40142660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f45b65700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f4015c060 0x7f1f40153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f45b65700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4014e560 con 0x7f1f4015c060 2024-09-13T18:26:58.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f45b65700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f40151990 con 0x7f1f4015bb20 2024-09-13T18:26:58.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f45b65700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f40151410 con 0x7f1f40158360 2024-09-13T18:26:58.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f45364700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f4015c060 0x7f1f40153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f3ffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f4015bb20 0x7f1f40142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f44b63700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f40158360 0x7f1f40142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f3ffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f4015bb20 0x7f1f40142660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:52014/0 (socket says 172.21.15.44:52014) 2024-09-13T18:26:58.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f3ffff700 1 -- 172.21.15.44:0/1106967516 learned_addr learned my addr 172.21.15.44:0/1106967516 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:26:58.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f44b63700 1 -- 172.21.15.44:0/1106967516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f4015bb20 msgr2=0x7f1f40142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:58.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f44b63700 1 --2- 172.21.15.44:0/1106967516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f4015bb20 0x7f1f40142660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f44b63700 1 -- 172.21.15.44:0/1106967516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f4015c060 msgr2=0x7f1f40153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:58.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f44b63700 1 --2- 172.21.15.44:0/1106967516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f4015c060 0x7f1f40153150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f44b63700 1 -- 172.21.15.44:0/1106967516 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f38009a70 con 0x7f1f40158360 2024-09-13T18:26:58.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f3ffff700 1 --2- 172.21.15.44:0/1106967516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f4015bb20 0x7f1f40142660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:26:58.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f45364700 1 --2- 172.21.15.44:0/1106967516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f4015c060 0x7f1f40153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:26:58.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f44b63700 1 --2- 172.21.15.44:0/1106967516 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f40158360 0x7f1f40142120 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800e8a0 tx=0x7f1f2800ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:58.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f3d7fa700 1 -- 172.21.15.44:0/1106967516 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f28013680 con 0x7f1f40158360 2024-09-13T18:26:58.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f45b65700 1 -- 172.21.15.44:0/1106967516 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f401516b0 con 0x7f1f40158360 2024-09-13T18:26:58.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f3d7fa700 1 -- 172.21.15.44:0/1106967516 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f280137e0 con 0x7f1f40158360 2024-09-13T18:26:58.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f3d7fa700 1 -- 172.21.15.44:0/1106967516 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f28013b70 con 0x7f1f40158360 2024-09-13T18:26:58.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.267+0000 7f1f45b65700 1 -- 172.21.15.44:0/1106967516 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4014ea20 con 0x7f1f40158360 2024-09-13T18:26:58.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.271+0000 7f1f45b65700 1 -- 172.21.15.44:0/1106967516 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f40070b30 con 0x7f1f40158360 2024-09-13T18:26:58.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.271+0000 7f1f3d7fa700 1 -- 172.21.15.44:0/1106967516 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1f28013cd0 con 0x7f1f40158360 2024-09-13T18:26:58.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.271+0000 7f1f3d7fa700 1 --2- 172.21.15.44:0/1106967516 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1f20066760 0x7f1f20068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.271+0000 7f1f3d7fa700 1 -- 172.21.15.44:0/1106967516 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1f28083b70 con 0x7f1f40158360 2024-09-13T18:26:58.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.271+0000 7f1f3ffff700 1 --2- 172.21.15.44:0/1106967516 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1f20066760 0x7f1f20068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.271+0000 7f1f3ffff700 1 --2- 172.21.15.44:0/1106967516 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1f20066760 0x7f1f20068c20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009fd0 tx=0x7f1f38011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:58.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.279+0000 7f1f3d7fa700 1 -- 172.21.15.44:0/1106967516 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1f28051240 con 0x7f1f40158360 2024-09-13T18:26:58.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.455+0000 7f1f45b65700 1 -- 172.21.15.44:0/1106967516 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f40071ff0 con 0x7f1f40158360 2024-09-13T18:26:58.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.455+0000 7f1f3d7fa700 1 -- 172.21.15.44:0/1106967516 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12790 (secure 0 0 0) 0x7f1f28054860 con 0x7f1f40158360 2024-09-13T18:26:58.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:26:58.462 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":17,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:26:52.651994+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:26:58.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.459+0000 7f1f45b65700 1 -- 172.21.15.44:0/1106967516 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1f20066760 msgr2=0x7f1f20068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:58.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.459+0000 7f1f45b65700 1 --2- 172.21.15.44:0/1106967516 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1f20066760 0x7f1f20068c20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009fd0 tx=0x7f1f38011000 comp rx=0 tx=0).stop 2024-09-13T18:26:58.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.459+0000 7f1f45b65700 1 -- 172.21.15.44:0/1106967516 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f40158360 msgr2=0x7f1f40142120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:58.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.459+0000 7f1f45b65700 1 --2- 172.21.15.44:0/1106967516 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f40158360 0x7f1f40142120 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800e8a0 tx=0x7f1f2800ebb0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.459+0000 7f1f45b65700 1 -- 172.21.15.44:0/1106967516 shutdown_connections 2024-09-13T18:26:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.459+0000 7f1f45b65700 1 --2- 172.21.15.44:0/1106967516 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1f20066760 0x7f1f20068c20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.459+0000 7f1f45b65700 1 --2- 172.21.15.44:0/1106967516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f4015c060 0x7f1f40153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.459+0000 7f1f45b65700 1 --2- 172.21.15.44:0/1106967516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f4015bb20 0x7f1f40142660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.459+0000 7f1f45b65700 1 --2- 172.21.15.44:0/1106967516 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f40158360 0x7f1f40142120 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.459+0000 7f1f45b65700 1 -- 172.21.15.44:0/1106967516 >> 172.21.15.44:0/1106967516 conn(0x7f1f400b16a0 msgr2=0x7f1f400b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.459+0000 7f1f45b65700 1 -- 172.21.15.44:0/1106967516 shutdown_connections 2024-09-13T18:26:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.459+0000 7f1f45b65700 1 -- 172.21.15.44:0/1106967516 wait complete. 2024-09-13T18:26:58.477 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:26:58.477 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:26:58.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.595+0000 7f345b59e700 1 Processor -- start 2024-09-13T18:26:58.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.595+0000 7f345b59e700 1 -- start start 2024-09-13T18:26:58.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.595+0000 7f345b59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f345c1573e0 0x7f345c070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.595+0000 7f345b59e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f345c0710e0 0x7f345c159f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.595+0000 7f345b59e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f345c071540 con 0x7f345c15a460 2024-09-13T18:26:58.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.595+0000 7f345b59e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f345c0cc1b0 con 0x7f345c0710e0 2024-09-13T18:26:58.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.595+0000 7f345b59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345c15ac50 con 0x7f345c1573e0 2024-09-13T18:26:58.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.595+0000 7f3459d9b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f345c0710e0 0x7f345c159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.595+0000 7f3459d9b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f345c0710e0 0x7f345c159f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45936/0 (socket says 172.21.15.44:45936) 2024-09-13T18:26:58.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.595+0000 7f3459d9b700 1 -- 172.21.15.44:0/3165661317 learned_addr learned my addr 172.21.15.44:0/3165661317 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:26:58.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.595+0000 7f345a59c700 1 --2- 172.21.15.44:0/3165661317 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f345c1573e0 0x7f345c070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.595+0000 7f3459d9b700 1 -- 172.21.15.44:0/3165661317 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f345c1573e0 msgr2=0x7f345c070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:58.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.595+0000 7f3459d9b700 1 --2- 172.21.15.44:0/3165661317 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f345c1573e0 0x7f345c070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.595+0000 7f3459d9b700 1 -- 172.21.15.44:0/3165661317 >> v1:172.21.15.99:6789/0 conn(0x7f345c15a460 legacy=0x7f345c15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:58.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.595+0000 7f3459d9b700 1 -- 172.21.15.44:0/3165661317 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345c0cb3f0 con 0x7f345c0710e0 2024-09-13T18:26:58.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.599+0000 7f3459d9b700 1 --2- 172.21.15.44:0/3165661317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f345c0710e0 0x7f345c159f20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f344c00bbe0 tx=0x7f344c00bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef59f38237c5e6e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:58.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.599+0000 7f345959a700 1 -- 172.21.15.44:0/3165661317 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c00dda0 con 0x7f345c0710e0 2024-09-13T18:26:58.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.599+0000 7f345959a700 1 -- 172.21.15.44:0/3165661317 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344c010470 con 0x7f345c0710e0 2024-09-13T18:26:58.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.599+0000 7f345959a700 1 -- 172.21.15.44:0/3165661317 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c010800 con 0x7f345c0710e0 2024-09-13T18:26:58.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.599+0000 7f345b59e700 1 -- 172.21.15.44:0/3165661317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f345c0710e0 msgr2=0x7f345c159f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:58.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.599+0000 7f345b59e700 1 --2- 172.21.15.44:0/3165661317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f345c0710e0 0x7f345c159f20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f344c00bbe0 tx=0x7f344c00bef0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.599+0000 7f345b59e700 1 -- 172.21.15.44:0/3165661317 shutdown_connections 2024-09-13T18:26:58.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.599+0000 7f345b59e700 1 --2- 172.21.15.44:0/3165661317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f345c0710e0 0x7f345c159f20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.599+0000 7f345b59e700 1 --2- 172.21.15.44:0/3165661317 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f345c1573e0 0x7f345c070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.599+0000 7f345b59e700 1 -- 172.21.15.44:0/3165661317 >> 172.21.15.44:0/3165661317 conn(0x7f345c0b0e10 msgr2=0x7f345c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:58.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.599+0000 7f345b59e700 1 -- 172.21.15.44:0/3165661317 shutdown_connections 2024-09-13T18:26:58.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.599+0000 7f345b59e700 1 -- 172.21.15.44:0/3165661317 wait complete. 2024-09-13T18:26:58.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.599+0000 7f345b59e700 1 Processor -- start 2024-09-13T18:26:58.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.599+0000 7f345b59e700 1 -- start start 2024-09-13T18:26:58.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.603+0000 7f345b59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f345c1573e0 0x7f345c154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.603+0000 7f345b59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f345c15a460 0x7f345c06fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.603+0000 7f345b59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f345c06ffd0 0x7f345c152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.603+0000 7f345b59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c070480 con 0x7f345c15a460 2024-09-13T18:26:58.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.603+0000 7f345b59e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c154750 con 0x7f345c1573e0 2024-09-13T18:26:58.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.603+0000 7f345b59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345c1f16e0 con 0x7f345c06ffd0 2024-09-13T18:26:58.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.603+0000 7f3459d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f345c15a460 0x7f345c06fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.603+0000 7f3459d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f345c15a460 0x7f345c06fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45940/0 (socket says 172.21.15.44:45940) 2024-09-13T18:26:58.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.603+0000 7f3459d9b700 1 -- 172.21.15.44:0/1808949123 learned_addr learned my addr 172.21.15.44:0/1808949123 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:26:58.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.603+0000 7f345ad9d700 1 --2- 172.21.15.44:0/1808949123 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f345c06ffd0 0x7f345c152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.603+0000 7f345a59c700 1 --2- 172.21.15.44:0/1808949123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f345c1573e0 0x7f345c154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.603+0000 7f3459d9b700 1 -- 172.21.15.44:0/1808949123 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f345c06ffd0 msgr2=0x7f345c152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:58.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.603+0000 7f3459d9b700 1 --2- 172.21.15.44:0/1808949123 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f345c06ffd0 0x7f345c152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.603+0000 7f3459d9b700 1 -- 172.21.15.44:0/1808949123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f345c1573e0 msgr2=0x7f345c154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:58.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.603+0000 7f3459d9b700 1 --2- 172.21.15.44:0/1808949123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f345c1573e0 0x7f345c154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.603+0000 7f3459d9b700 1 -- 172.21.15.44:0/1808949123 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344c00b810 con 0x7f345c15a460 2024-09-13T18:26:58.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.603+0000 7f3459d9b700 1 --2- 172.21.15.44:0/1808949123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f345c15a460 0x7f345c06fa90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f344c015000 tx=0x7f344c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:58.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.603+0000 7f3452ffd700 1 -- 172.21.15.44:0/1808949123 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c01f070 con 0x7f345c15a460 2024-09-13T18:26:58.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.603+0000 7f3452ffd700 1 -- 172.21.15.44:0/1808949123 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344c0038d0 con 0x7f345c15a460 2024-09-13T18:26:58.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.603+0000 7f345b59e700 1 -- 172.21.15.44:0/1808949123 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345c1f19c0 con 0x7f345c15a460 2024-09-13T18:26:58.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.603+0000 7f3452ffd700 1 -- 172.21.15.44:0/1808949123 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c003c40 con 0x7f345c15a460 2024-09-13T18:26:58.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.603+0000 7f345b59e700 1 -- 172.21.15.44:0/1808949123 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345c1f1f80 con 0x7f345c15a460 2024-09-13T18:26:58.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.607+0000 7f345b59e700 1 -- 172.21.15.44:0/1808949123 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f345c159f20 con 0x7f345c15a460 2024-09-13T18:26:58.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.607+0000 7f3452ffd700 1 -- 172.21.15.44:0/1808949123 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f344c019400 con 0x7f345c15a460 2024-09-13T18:26:58.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.607+0000 7f3452ffd700 1 --2- 172.21.15.44:0/1808949123 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3440066730 0x7f3440068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.607+0000 7f3452ffd700 1 -- 172.21.15.44:0/1808949123 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f344c087490 con 0x7f345c15a460 2024-09-13T18:26:58.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.607+0000 7f345a59c700 1 --2- 172.21.15.44:0/1808949123 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3440066730 0x7f3440068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.607+0000 7f345a59c700 1 --2- 172.21.15.44:0/1808949123 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3440066730 0x7f3440068bf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f345c1ef310 tx=0x7f3444003a60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:58.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.615+0000 7f3452ffd700 1 -- 172.21.15.44:0/1808949123 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f344c054c80 con 0x7f345c15a460 2024-09-13T18:26:58.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.787+0000 7f345b59e700 1 -- 172.21.15.44:0/1808949123 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f345c1f2110 con 0x7f345c15a460 2024-09-13T18:26:58.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.787+0000 7f3452ffd700 1 -- 172.21.15.44:0/1808949123 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f344c0290a0 con 0x7f345c15a460 2024-09-13T18:26:58.793 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:26:58.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.791+0000 7f345b59e700 1 -- 172.21.15.44:0/1808949123 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3440066730 msgr2=0x7f3440068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:58.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.791+0000 7f345b59e700 1 --2- 172.21.15.44:0/1808949123 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3440066730 0x7f3440068bf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f345c1ef310 tx=0x7f3444003a60 comp rx=0 tx=0).stop 2024-09-13T18:26:58.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.791+0000 7f345b59e700 1 -- 172.21.15.44:0/1808949123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f345c15a460 msgr2=0x7f345c06fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:58.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.791+0000 7f345b59e700 1 --2- 172.21.15.44:0/1808949123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f345c15a460 0x7f345c06fa90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f344c015000 tx=0x7f344c004770 comp rx=0 tx=0).stop 2024-09-13T18:26:58.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.791+0000 7f345b59e700 1 -- 172.21.15.44:0/1808949123 shutdown_connections 2024-09-13T18:26:58.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.791+0000 7f345b59e700 1 --2- 172.21.15.44:0/1808949123 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3440066730 0x7f3440068bf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.791+0000 7f345b59e700 1 --2- 172.21.15.44:0/1808949123 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f345c06ffd0 0x7f345c152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.791+0000 7f345b59e700 1 --2- 172.21.15.44:0/1808949123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f345c15a460 0x7f345c06fa90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.791+0000 7f345b59e700 1 --2- 172.21.15.44:0/1808949123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f345c1573e0 0x7f345c154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.791+0000 7f345b59e700 1 -- 172.21.15.44:0/1808949123 >> 172.21.15.44:0/1808949123 conn(0x7f345c0b0e10 msgr2=0x7f345c0b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:58.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.791+0000 7f345b59e700 1 -- 172.21.15.44:0/1808949123 shutdown_connections 2024-09-13T18:26:58.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.791+0000 7f345b59e700 1 -- 172.21.15.44:0/1808949123 wait complete. 2024-09-13T18:26:58.807 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:26:58.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e3c9ab700 1 Processor -- start 2024-09-13T18:26:58.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e3c9ab700 1 -- start start 2024-09-13T18:26:58.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e3c9ab700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9e38159720 0x7f9e3806cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e3c9ab700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9e3806aa90 0x7f9e380b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e3c9ab700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3806af00 con 0x7f9e380b3910 2024-09-13T18:26:58.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e3c9ab700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e380b3da0 con 0x7f9e3806aa90 2024-09-13T18:26:58.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e3c9ab700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3806d690 con 0x7f9e38159720 2024-09-13T18:26:58.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e3659c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9e3806aa90 0x7f9e380b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e3659c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9e3806aa90 0x7f9e380b33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45950/0 (socket says 172.21.15.44:45950) 2024-09-13T18:26:58.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e3659c700 1 -- 172.21.15.44:0/2760261277 learned_addr learned my addr 172.21.15.44:0/2760261277 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:26:58.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e36d9d700 1 --2- 172.21.15.44:0/2760261277 >> v2:172.21.15.99:3300/0 conn(0x7f9e38159720 0x7f9e3806cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e3659c700 1 -- 172.21.15.44:0/2760261277 >> v2:172.21.15.99:3300/0 conn(0x7f9e38159720 msgr2=0x7f9e3806cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:58.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e3659c700 1 --2- 172.21.15.44:0/2760261277 >> v2:172.21.15.99:3300/0 conn(0x7f9e38159720 0x7f9e3806cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e3659c700 1 -- 172.21.15.44:0/2760261277 >> v1:172.21.15.99:6789/0 conn(0x7f9e380b3910 legacy=0x7f9e38070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:58.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e3659c700 1 -- 172.21.15.44:0/2760261277 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e380cbfe0 con 0x7f9e3806aa90 2024-09-13T18:26:58.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e3659c700 1 --2- 172.21.15.44:0/2760261277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e3806aa90 0x7f9e380b33d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9e38071cb0 tx=0x7f9e20009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9666c8c21274fc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:58.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e35d9b700 1 -- 172.21.15.44:0/2760261277 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e20004230 con 0x7f9e3806aa90 2024-09-13T18:26:58.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e35d9b700 1 -- 172.21.15.44:0/2760261277 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e20004390 con 0x7f9e3806aa90 2024-09-13T18:26:58.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e35d9b700 1 -- 172.21.15.44:0/2760261277 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e200036c0 con 0x7f9e3806aa90 2024-09-13T18:26:58.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e3c9ab700 1 -- 172.21.15.44:0/2760261277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e3806aa90 msgr2=0x7f9e380b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:58.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e3c9ab700 1 --2- 172.21.15.44:0/2760261277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e3806aa90 0x7f9e380b33d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9e38071cb0 tx=0x7f9e20009bf0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e3c9ab700 1 -- 172.21.15.44:0/2760261277 shutdown_connections 2024-09-13T18:26:58.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e3c9ab700 1 --2- 172.21.15.44:0/2760261277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e3806aa90 0x7f9e380b33d0 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9e38071cb0 tx=0x7f9e20009bf0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e3c9ab700 1 --2- 172.21.15.44:0/2760261277 >> v2:172.21.15.99:3300/0 conn(0x7f9e38159720 0x7f9e3806cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e3c9ab700 1 -- 172.21.15.44:0/2760261277 >> 172.21.15.44:0/2760261277 conn(0x7f9e380b0f00 msgr2=0x7f9e380b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:58.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.919+0000 7f9e3c9ab700 1 -- 172.21.15.44:0/2760261277 shutdown_connections 2024-09-13T18:26:58.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.923+0000 7f9e3c9ab700 1 -- 172.21.15.44:0/2760261277 wait complete. 2024-09-13T18:26:58.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.923+0000 7f9e3c9ab700 1 Processor -- start 2024-09-13T18:26:58.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.923+0000 7f9e3c9ab700 1 -- start start 2024-09-13T18:26:58.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.923+0000 7f9e3c9ab700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e380b3910 0x7f9e38145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.923+0000 7f9e3c9ab700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9e38159720 0x7f9e3815b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.923+0000 7f9e3c9ab700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e380af380 0x7f9e3814a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.923+0000 7f9e3c9ab700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3815a690 con 0x7f9e380af380 2024-09-13T18:26:58.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.923+0000 7f9e3c9ab700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e38145a20 con 0x7f9e380b3910 2024-09-13T18:26:58.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.923+0000 7f9e3c9ab700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3815a8e0 con 0x7f9e38159720 2024-09-13T18:26:58.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.923+0000 7f9e3759e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e380af380 0x7f9e3814a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.923+0000 7f9e3759e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e380af380 0x7f9e3814a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45956/0 (socket says 172.21.15.44:45956) 2024-09-13T18:26:58.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.923+0000 7f9e3759e700 1 -- 172.21.15.44:0/511960787 learned_addr learned my addr 172.21.15.44:0/511960787 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:26:58.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.923+0000 7f9e36d9d700 1 --2- 172.21.15.44:0/511960787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e380b3910 0x7f9e38145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.923+0000 7f9e3659c700 1 --2- 172.21.15.44:0/511960787 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9e38159720 0x7f9e3815b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.923+0000 7f9e3759e700 1 -- 172.21.15.44:0/511960787 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9e38159720 msgr2=0x7f9e3815b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:58.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.923+0000 7f9e3759e700 1 --2- 172.21.15.44:0/511960787 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9e38159720 0x7f9e3815b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.923+0000 7f9e3759e700 1 -- 172.21.15.44:0/511960787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e380b3910 msgr2=0x7f9e38145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:58.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.923+0000 7f9e3759e700 1 --2- 172.21.15.44:0/511960787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e380b3910 0x7f9e38145090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.923+0000 7f9e3759e700 1 -- 172.21.15.44:0/511960787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e20009570 con 0x7f9e380af380 2024-09-13T18:26:58.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.923+0000 7f9e3759e700 1 --2- 172.21.15.44:0/511960787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e380af380 0x7f9e3814a570 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000cc10 tx=0x7f9e3000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:58.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.927+0000 7f9e2f7fe700 1 -- 172.21.15.44:0/511960787 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3000aa60 con 0x7f9e380af380 2024-09-13T18:26:58.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.927+0000 7f9e2f7fe700 1 -- 172.21.15.44:0/511960787 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3000abc0 con 0x7f9e380af380 2024-09-13T18:26:58.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.927+0000 7f9e3c9ab700 1 -- 172.21.15.44:0/511960787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3815abc0 con 0x7f9e380af380 2024-09-13T18:26:58.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.927+0000 7f9e2f7fe700 1 -- 172.21.15.44:0/511960787 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e30012420 con 0x7f9e380af380 2024-09-13T18:26:58.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.927+0000 7f9e3c9ab700 1 -- 172.21.15.44:0/511960787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3815b180 con 0x7f9e380af380 2024-09-13T18:26:58.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.927+0000 7f9e3c9ab700 1 -- 172.21.15.44:0/511960787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e380b33d0 con 0x7f9e380af380 2024-09-13T18:26:58.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.927+0000 7f9e2f7fe700 1 -- 172.21.15.44:0/511960787 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9e30012580 con 0x7f9e380af380 2024-09-13T18:26:58.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.927+0000 7f9e2f7fe700 1 --2- 172.21.15.44:0/511960787 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9e1c066730 0x7f9e1c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.927+0000 7f9e2f7fe700 1 -- 172.21.15.44:0/511960787 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9e30084110 con 0x7f9e380af380 2024-09-13T18:26:58.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.927+0000 7f9e36d9d700 1 --2- 172.21.15.44:0/511960787 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9e1c066730 0x7f9e1c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.931+0000 7f9e36d9d700 1 --2- 172.21.15.44:0/511960787 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9e1c066730 0x7f9e1c068bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9e28007a60 tx=0x7f9e28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:58.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:58.935+0000 7f9e2f7fe700 1 -- 172.21.15.44:0/511960787 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9e30051750 con 0x7f9e380af380 2024-09-13T18:26:59.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.111+0000 7f9e3c9ab700 1 -- 172.21.15.44:0/511960787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9e38167250 con 0x7f9e380af380 2024-09-13T18:26:59.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.111+0000 7f9e2f7fe700 1 -- 172.21.15.44:0/511960787 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9e30054d70 con 0x7f9e380af380 2024-09-13T18:26:59.117 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:26:59.117 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-09-13T18:26:59.117 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:26:59.118 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2024-09-13T18:26:59.118 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2024-09-13T18:26:59.118 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:26:59.118 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-09-13T18:26:59.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.111+0000 7f9e3c9ab700 1 -- 172.21.15.44:0/511960787 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9e1c066730 msgr2=0x7f9e1c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.111+0000 7f9e3c9ab700 1 --2- 172.21.15.44:0/511960787 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9e1c066730 0x7f9e1c068bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9e28007a60 tx=0x7f9e28008040 comp rx=0 tx=0).stop 2024-09-13T18:26:59.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.111+0000 7f9e3c9ab700 1 -- 172.21.15.44:0/511960787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e380af380 msgr2=0x7f9e3814a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.111+0000 7f9e3c9ab700 1 --2- 172.21.15.44:0/511960787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e380af380 0x7f9e3814a570 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000cc10 tx=0x7f9e3000cf20 comp rx=0 tx=0).stop 2024-09-13T18:26:59.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.111+0000 7f9e3c9ab700 1 -- 172.21.15.44:0/511960787 shutdown_connections 2024-09-13T18:26:59.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.111+0000 7f9e3c9ab700 1 --2- 172.21.15.44:0/511960787 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9e1c066730 0x7f9e1c068bf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.111+0000 7f9e3c9ab700 1 --2- 172.21.15.44:0/511960787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e380af380 0x7f9e3814a570 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.111+0000 7f9e3c9ab700 1 --2- 172.21.15.44:0/511960787 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9e38159720 0x7f9e3815b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.111+0000 7f9e3c9ab700 1 --2- 172.21.15.44:0/511960787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e380b3910 0x7f9e38145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.111+0000 7f9e3c9ab700 1 -- 172.21.15.44:0/511960787 >> 172.21.15.44:0/511960787 conn(0x7f9e380b0f00 msgr2=0x7f9e380714e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:59.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.111+0000 7f9e3c9ab700 1 -- 172.21.15.44:0/511960787 shutdown_connections 2024-09-13T18:26:59.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.115+0000 7f9e3c9ab700 1 -- 172.21.15.44:0/511960787 wait complete. 2024-09-13T18:26:59.130 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:26:59.130 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:26:59.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.243+0000 7f1f0bfd1700 1 Processor -- start 2024-09-13T18:26:59.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.243+0000 7f1f0bfd1700 1 -- start start 2024-09-13T18:26:59.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.247+0000 7f1f0bfd1700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1f04160880 0x7f1f04160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.247+0000 7f1f0bfd1700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f041611e0 con 0x7f1f040d1c90 2024-09-13T18:26:59.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.247+0000 7f1f0bfd1700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f040d0c10 con 0x7f1f0415cf30 2024-09-13T18:26:59.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.247+0000 7f1f0bfd1700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f040d0ed0 con 0x7f1f04160880 2024-09-13T18:26:59.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.247+0000 7f1f0a56e700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1f040d1c90 0x7f1f040b7c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59124/0 (socket says 172.21.15.44:59124) 2024-09-13T18:26:59.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.247+0000 7f1f0a56e700 1 -- 172.21.15.44:0/1639702316 learned_addr learned my addr 172.21.15.44:0/1639702316 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:26:59.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.247+0000 7f1f0956c700 1 --2- 172.21.15.44:0/1639702316 >> v2:172.21.15.99:3300/0 conn(0x7f1f04160880 0x7f1f04160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.247+0000 7f1f08d6b700 1 -- 172.21.15.44:0/1639702316 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2903817574 0 0) 0x7f1f041611e0 con 0x7f1f040d1c90 2024-09-13T18:26:59.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.247+0000 7f1f08d6b700 1 -- 172.21.15.44:0/1639702316 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ef00035d0 con 0x7f1f040d1c90 2024-09-13T18:26:59.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.247+0000 7f1f0956c700 1 -- 172.21.15.44:0/1639702316 >> v1:172.21.15.99:6789/0 conn(0x7f1f0415cf30 legacy=0x7f1f040b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.247+0000 7f1f0956c700 1 -- 172.21.15.44:0/1639702316 >> v1:172.21.15.44:6789/0 conn(0x7f1f040d1c90 legacy=0x7f1f040b7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.247+0000 7f1f0956c700 1 -- 172.21.15.44:0/1639702316 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f040d11b0 con 0x7f1f04160880 2024-09-13T18:26:59.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.247+0000 7f1f0956c700 1 --2- 172.21.15.44:0/1639702316 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f04160880 0x7f1f04160ca0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009850 tx=0x7f1f00009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2835fe7b410e9e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:59.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.247+0000 7f1f08d6b700 1 -- 172.21.15.44:0/1639702316 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f00011830 con 0x7f1f04160880 2024-09-13T18:26:59.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.247+0000 7f1f08d6b700 1 -- 172.21.15.44:0/1639702316 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f00011990 con 0x7f1f04160880 2024-09-13T18:26:59.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.247+0000 7f1f08d6b700 1 -- 172.21.15.44:0/1639702316 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f00011d00 con 0x7f1f04160880 2024-09-13T18:26:59.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.247+0000 7f1f0bfd1700 1 -- 172.21.15.44:0/1639702316 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f04160880 msgr2=0x7f1f04160ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.247+0000 7f1f0bfd1700 1 --2- 172.21.15.44:0/1639702316 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f04160880 0x7f1f04160ca0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009850 tx=0x7f1f00009b60 comp rx=0 tx=0).stop 2024-09-13T18:26:59.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.247+0000 7f1f0bfd1700 1 -- 172.21.15.44:0/1639702316 shutdown_connections 2024-09-13T18:26:59.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.247+0000 7f1f0bfd1700 1 --2- 172.21.15.44:0/1639702316 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f04160880 0x7f1f04160ca0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.247+0000 7f1f0bfd1700 1 -- 172.21.15.44:0/1639702316 >> 172.21.15.44:0/1639702316 conn(0x7f1f040d30d0 msgr2=0x7f1f040d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:59.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.247+0000 7f1f0bfd1700 1 -- 172.21.15.44:0/1639702316 shutdown_connections 2024-09-13T18:26:59.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.247+0000 7f1f0bfd1700 1 -- 172.21.15.44:0/1639702316 wait complete. 2024-09-13T18:26:59.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1f0bfd1700 1 Processor -- start 2024-09-13T18:26:59.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1f0bfd1700 1 -- start start 2024-09-13T18:26:59.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1f0bfd1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f040d1c90 0x7f1f041519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1f0bfd1700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f0415cf30 0x7f1f0406adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1f0bfd1700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f04160880 0x7f1f0406b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1f0bfd1700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f04155540 con 0x7f1f040d1c90 2024-09-13T18:26:59.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1f0bfd1700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f04151ee0 con 0x7f1f0415cf30 2024-09-13T18:26:59.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1f0bfd1700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f04154f80 con 0x7f1f04160880 2024-09-13T18:26:59.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1f09d6d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f040d1c90 0x7f1f041519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1f09d6d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f040d1c90 0x7f1f041519a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45958/0 (socket says 172.21.15.44:45958) 2024-09-13T18:26:59.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1f09d6d700 1 -- 172.21.15.44:0/443772506 learned_addr learned my addr 172.21.15.44:0/443772506 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:26:59.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1f0a56e700 1 --2- 172.21.15.44:0/443772506 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f04160880 0x7f1f0406b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1f0956c700 1 --2- 172.21.15.44:0/443772506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f0415cf30 0x7f1f0406adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1f09d6d700 1 -- 172.21.15.44:0/443772506 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f04160880 msgr2=0x7f1f0406b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1f09d6d700 1 --2- 172.21.15.44:0/443772506 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f04160880 0x7f1f0406b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1f09d6d700 1 -- 172.21.15.44:0/443772506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f0415cf30 msgr2=0x7f1f0406adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1f09d6d700 1 --2- 172.21.15.44:0/443772506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f0415cf30 0x7f1f0406adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1f09d6d700 1 -- 172.21.15.44:0/443772506 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f000094b0 con 0x7f1f040d1c90 2024-09-13T18:26:59.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1f0956c700 1 --2- 172.21.15.44:0/443772506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f0415cf30 0x7f1f0406adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:59.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1f09d6d700 1 --2- 172.21.15.44:0/443772506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f040d1c90 0x7f1f041519a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1ef400c500 tx=0x7f1ef400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:59.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1efa7fc700 1 -- 172.21.15.44:0/443772506 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef40052d0 con 0x7f1f040d1c90 2024-09-13T18:26:59.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1efa7fc700 1 -- 172.21.15.44:0/443772506 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef4005430 con 0x7f1f040d1c90 2024-09-13T18:26:59.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1efa7fc700 1 -- 172.21.15.44:0/443772506 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef40055a0 con 0x7f1f040d1c90 2024-09-13T18:26:59.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1f0bfd1700 1 -- 172.21.15.44:0/443772506 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f04155260 con 0x7f1f040d1c90 2024-09-13T18:26:59.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.251+0000 7f1f0bfd1700 1 -- 172.21.15.44:0/443772506 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f040ca190 con 0x7f1f040d1c90 2024-09-13T18:26:59.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.255+0000 7f1f0bfd1700 1 -- 172.21.15.44:0/443772506 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f04160ca0 con 0x7f1f040d1c90 2024-09-13T18:26:59.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.255+0000 7f1efa7fc700 1 -- 172.21.15.44:0/443772506 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1ef40036a0 con 0x7f1f040d1c90 2024-09-13T18:26:59.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.255+0000 7f1efa7fc700 1 --2- 172.21.15.44:0/443772506 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1ee8066730 0x7f1ee8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.255+0000 7f1efa7fc700 1 -- 172.21.15.44:0/443772506 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1ef4083100 con 0x7f1f040d1c90 2024-09-13T18:26:59.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.255+0000 7f1f0956c700 1 --2- 172.21.15.44:0/443772506 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1ee8066730 0x7f1ee8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.259+0000 7f1f0956c700 1 --2- 172.21.15.44:0/443772506 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1ee8066730 0x7f1ee8068bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1f000090b0 tx=0x7f1f0001c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:59.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.263+0000 7f1efa7fc700 1 -- 172.21.15.44:0/443772506 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1ef4050740 con 0x7f1f040d1c90 2024-09-13T18:26:59.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.435+0000 7f1f0bfd1700 1 -- 172.21.15.44:0/443772506 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1f0406a8d0 con 0x7f1f040d1c90 2024-09-13T18:26:59.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.879+0000 7f1efa7fc700 1 -- 172.21.15.44:0/443772506 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1ef4053d60 con 0x7f1f040d1c90 2024-09-13T18:26:59.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.887+0000 7f1f0bfd1700 1 -- 172.21.15.44:0/443772506 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1ee8066730 msgr2=0x7f1ee8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.887+0000 7f1f0bfd1700 1 --2- 172.21.15.44:0/443772506 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1ee8066730 0x7f1ee8068bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1f000090b0 tx=0x7f1f0001c040 comp rx=0 tx=0).stop 2024-09-13T18:26:59.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.887+0000 7f1f0bfd1700 1 -- 172.21.15.44:0/443772506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f040d1c90 msgr2=0x7f1f041519a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.887+0000 7f1f0bfd1700 1 --2- 172.21.15.44:0/443772506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f040d1c90 0x7f1f041519a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1ef400c500 tx=0x7f1ef400c810 comp rx=0 tx=0).stop 2024-09-13T18:26:59.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.887+0000 7f1f0bfd1700 1 -- 172.21.15.44:0/443772506 shutdown_connections 2024-09-13T18:26:59.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.887+0000 7f1f0bfd1700 1 --2- 172.21.15.44:0/443772506 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1ee8066730 0x7f1ee8068bf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.887+0000 7f1f0bfd1700 1 --2- 172.21.15.44:0/443772506 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f04160880 0x7f1f0406b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.887+0000 7f1f0bfd1700 1 --2- 172.21.15.44:0/443772506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f0415cf30 0x7f1f0406adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.887+0000 7f1f0bfd1700 1 --2- 172.21.15.44:0/443772506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f040d1c90 0x7f1f041519a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.887+0000 7f1f0bfd1700 1 -- 172.21.15.44:0/443772506 >> 172.21.15.44:0/443772506 conn(0x7f1f040d30d0 msgr2=0x7f1f040b39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:59.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.887+0000 7f1f0bfd1700 1 -- 172.21.15.44:0/443772506 shutdown_connections 2024-09-13T18:26:59.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:26:59.887+0000 7f1f0bfd1700 1 -- 172.21.15.44:0/443772506 wait complete. 2024-09-13T18:26:59.892 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2024-09-13T18:26:59.908 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:27:00.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.023+0000 7fb7bc4d5700 1 Processor -- start 2024-09-13T18:27:00.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.023+0000 7fb7bc4d5700 1 -- start start 2024-09-13T18:27:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.023+0000 7fb7bc4d5700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb7b40cf690 0x7fb7b40ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.023+0000 7fb7bc4d5700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb7b40d08a0 0x7fb7b415b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.023+0000 7fb7bc4d5700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b40d1910 con 0x7fb7b40b5c70 2024-09-13T18:27:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.023+0000 7fb7bc4d5700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b4151e90 con 0x7fb7b40d08a0 2024-09-13T18:27:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.023+0000 7fb7bc4d5700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b40d0d90 con 0x7fb7b40cf690 2024-09-13T18:27:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.027+0000 7fb7b9a70700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb7b40d08a0 0x7fb7b415b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.027+0000 7fb7b9a70700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb7b40d08a0 0x7fb7b415b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45962/0 (socket says 172.21.15.44:45962) 2024-09-13T18:27:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.027+0000 7fb7b9a70700 1 -- 172.21.15.44:0/1081814724 learned_addr learned my addr 172.21.15.44:0/1081814724 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.027+0000 7fb7ba271700 1 --2- 172.21.15.44:0/1081814724 >> v2:172.21.15.99:3300/0 conn(0x7fb7b40cf690 0x7fb7b40ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.027+0000 7fb7b9a70700 1 -- 172.21.15.44:0/1081814724 >> v2:172.21.15.99:3300/0 conn(0x7fb7b40cf690 msgr2=0x7fb7b40ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.027+0000 7fb7b9a70700 1 --2- 172.21.15.44:0/1081814724 >> v2:172.21.15.99:3300/0 conn(0x7fb7b40cf690 0x7fb7b40ce7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.027+0000 7fb7b9a70700 1 -- 172.21.15.44:0/1081814724 >> v1:172.21.15.99:6789/0 conn(0x7fb7b40b5c70 legacy=0x7fb7b40cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.027+0000 7fb7b9a70700 1 -- 172.21.15.44:0/1081814724 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b40d1070 con 0x7fb7b40d08a0 2024-09-13T18:27:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.027+0000 7fb7b9a70700 1 --2- 172.21.15.44:0/1081814724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b40d08a0 0x7fb7b415b9b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4070e70 tx=0x7fb7a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231681c6a8eabe2b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:00.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.027+0000 7fb7b926f700 1 -- 172.21.15.44:0/1081814724 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a800e070 con 0x7fb7b40d08a0 2024-09-13T18:27:00.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.027+0000 7fb7b926f700 1 -- 172.21.15.44:0/1081814724 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a800b910 con 0x7fb7b40d08a0 2024-09-13T18:27:00.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.027+0000 7fb7b926f700 1 -- 172.21.15.44:0/1081814724 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a800bcc0 con 0x7fb7b40d08a0 2024-09-13T18:27:00.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.027+0000 7fb7bc4d5700 1 -- 172.21.15.44:0/1081814724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b40d08a0 msgr2=0x7fb7b415b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.027+0000 7fb7bc4d5700 1 --2- 172.21.15.44:0/1081814724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b40d08a0 0x7fb7b415b9b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4070e70 tx=0x7fb7a800b330 comp rx=0 tx=0).stop 2024-09-13T18:27:00.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.027+0000 7fb7bc4d5700 1 -- 172.21.15.44:0/1081814724 shutdown_connections 2024-09-13T18:27:00.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.027+0000 7fb7bc4d5700 1 --2- 172.21.15.44:0/1081814724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b40d08a0 0x7fb7b415b9b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.027+0000 7fb7bc4d5700 1 --2- 172.21.15.44:0/1081814724 >> v2:172.21.15.99:3300/0 conn(0x7fb7b40cf690 0x7fb7b40ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.027+0000 7fb7bc4d5700 1 -- 172.21.15.44:0/1081814724 >> 172.21.15.44:0/1081814724 conn(0x7fb7b4071da0 msgr2=0x7fb7b4072180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:00.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.027+0000 7fb7bc4d5700 1 -- 172.21.15.44:0/1081814724 shutdown_connections 2024-09-13T18:27:00.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.027+0000 7fb7bc4d5700 1 -- 172.21.15.44:0/1081814724 wait complete. 2024-09-13T18:27:00.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7bc4d5700 1 Processor -- start 2024-09-13T18:27:00.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7bc4d5700 1 -- start start 2024-09-13T18:27:00.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7bc4d5700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7b40b5c70 0x7fb7b4141550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:00.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7bc4d5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b40cf690 0x7fb7b415a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:00.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7bc4d5700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7b40d08a0 0x7fb7b4158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:00.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7bc4d5700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b4141a90 con 0x7fb7b40cf690 2024-09-13T18:27:00.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7bc4d5700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b41549d0 con 0x7fb7b40b5c70 2024-09-13T18:27:00.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7bc4d5700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b415a930 con 0x7fb7b40d08a0 2024-09-13T18:27:00.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7b9a70700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b40cf690 0x7fb7b415a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:00.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7b9a70700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b40cf690 0x7fb7b415a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45970/0 (socket says 172.21.15.44:45970) 2024-09-13T18:27:00.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7b9a70700 1 -- 172.21.15.44:0/3900979164 learned_addr learned my addr 172.21.15.44:0/3900979164 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:00.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7ba271700 1 --2- 172.21.15.44:0/3900979164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7b40b5c70 0x7fb7b4141550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:00.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7baa72700 1 --2- 172.21.15.44:0/3900979164 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7b40d08a0 0x7fb7b4158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:00.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7b9a70700 1 -- 172.21.15.44:0/3900979164 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7b40d08a0 msgr2=0x7fb7b4158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7b9a70700 1 --2- 172.21.15.44:0/3900979164 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7b40d08a0 0x7fb7b4158340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7b9a70700 1 -- 172.21.15.44:0/3900979164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7b40b5c70 msgr2=0x7fb7b4141550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7b9a70700 1 --2- 172.21.15.44:0/3900979164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7b40b5c70 0x7fb7b4141550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7b9a70700 1 -- 172.21.15.44:0/3900979164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a8009b30 con 0x7fb7b40cf690 2024-09-13T18:27:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7baa72700 1 --2- 172.21.15.44:0/3900979164 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7b40d08a0 0x7fb7b4158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7b9a70700 1 --2- 172.21.15.44:0/3900979164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b40cf690 0x7fb7b415a3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb7b40d1b50 tx=0x7fb7a8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7b2ffd700 1 -- 172.21.15.44:0/3900979164 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a80099b0 con 0x7fb7b40cf690 2024-09-13T18:27:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7b2ffd700 1 -- 172.21.15.44:0/3900979164 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a80092e0 con 0x7fb7b40cf690 2024-09-13T18:27:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7bc4d5700 1 -- 172.21.15.44:0/3900979164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b4153e50 con 0x7fb7b40cf690 2024-09-13T18:27:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7b2ffd700 1 -- 172.21.15.44:0/3900979164 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a801c630 con 0x7fb7b40cf690 2024-09-13T18:27:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.031+0000 7fb7bc4d5700 1 -- 172.21.15.44:0/3900979164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b4154410 con 0x7fb7b40cf690 2024-09-13T18:27:00.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.035+0000 7fb7b2ffd700 1 -- 172.21.15.44:0/3900979164 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb7a801c790 con 0x7fb7b40cf690 2024-09-13T18:27:00.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.035+0000 7fb7bc4d5700 1 -- 172.21.15.44:0/3900979164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b40ce7d0 con 0x7fb7b40cf690 2024-09-13T18:27:00.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.035+0000 7fb7b2ffd700 1 --2- 172.21.15.44:0/3900979164 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb7a0066730 0x7fb7a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:00.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.035+0000 7fb7b2ffd700 1 -- 172.21.15.44:0/3900979164 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fb7a8085c40 con 0x7fb7b40cf690 2024-09-13T18:27:00.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.035+0000 7fb7ba271700 1 --2- 172.21.15.44:0/3900979164 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb7a0066730 0x7fb7a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:00.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.035+0000 7fb7ba271700 1 --2- 172.21.15.44:0/3900979164 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb7a0066730 0x7fb7a0068bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009b80 tx=0x7fb7ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:00.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.043+0000 7fb7b2ffd700 1 -- 172.21.15.44:0/3900979164 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb7a8053220 con 0x7fb7b40cf690 2024-09-13T18:27:00.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.219+0000 7fb7bc4d5700 1 -- 172.21.15.44:0/3900979164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb7b40ce7d0 con 0x7fb7b40cf690 2024-09-13T18:27:00.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.891+0000 7fb7b2ffd700 1 -- 172.21.15.44:0/3900979164 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb7a8056840 con 0x7fb7b40cf690 2024-09-13T18:27:00.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.915+0000 7fb7bc4d5700 1 -- 172.21.15.44:0/3900979164 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb7a0066730 msgr2=0x7fb7a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.915+0000 7fb7bc4d5700 1 --2- 172.21.15.44:0/3900979164 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb7a0066730 0x7fb7a0068bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009b80 tx=0x7fb7ac008040 comp rx=0 tx=0).stop 2024-09-13T18:27:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.915+0000 7fb7bc4d5700 1 -- 172.21.15.44:0/3900979164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b40cf690 msgr2=0x7fb7b415a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.915+0000 7fb7bc4d5700 1 --2- 172.21.15.44:0/3900979164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b40cf690 0x7fb7b415a3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb7b40d1b50 tx=0x7fb7a8004af0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.915+0000 7fb7bc4d5700 1 -- 172.21.15.44:0/3900979164 shutdown_connections 2024-09-13T18:27:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.915+0000 7fb7bc4d5700 1 --2- 172.21.15.44:0/3900979164 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb7a0066730 0x7fb7a0068bf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.915+0000 7fb7bc4d5700 1 --2- 172.21.15.44:0/3900979164 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7b40d08a0 0x7fb7b4158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.915+0000 7fb7bc4d5700 1 --2- 172.21.15.44:0/3900979164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b40cf690 0x7fb7b415a3f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.915+0000 7fb7bc4d5700 1 --2- 172.21.15.44:0/3900979164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7b40b5c70 0x7fb7b4141550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.915+0000 7fb7bc4d5700 1 -- 172.21.15.44:0/3900979164 >> 172.21.15.44:0/3900979164 conn(0x7fb7b4071da0 msgr2=0x7fb7b415e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.915+0000 7fb7bc4d5700 1 -- 172.21.15.44:0/3900979164 shutdown_connections 2024-09-13T18:27:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:00.915+0000 7fb7bc4d5700 1 -- 172.21.15.44:0/3900979164 wait complete. 2024-09-13T18:27:00.920 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2024-09-13T18:27:00.931 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:27:01.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.043+0000 7f360b59e700 1 Processor -- start 2024-09-13T18:27:01.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.043+0000 7f360b59e700 1 -- start start 2024-09-13T18:27:01.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.043+0000 7f360b59e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f360c15cda0 0x7f360c06b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.043+0000 7f360b59e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f360c0ceb70 0x7f360c0b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.043+0000 7f360b59e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f360c0b8430 con 0x7f360c06a520 2024-09-13T18:27:01.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.043+0000 7f360b59e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f360c06be40 con 0x7f360c0ceb70 2024-09-13T18:27:01.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.043+0000 7f360b59e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f360c0cf350 con 0x7f360c15cda0 2024-09-13T18:27:01.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.043+0000 7f3609d9b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f360c0ceb70 0x7f360c0b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.043+0000 7f360ad9d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f360c06a520 0x7f360c06a930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59136/0 (socket says 172.21.15.44:59136) 2024-09-13T18:27:01.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.043+0000 7f360ad9d700 1 -- 172.21.15.44:0/3669747024 learned_addr learned my addr 172.21.15.44:0/3669747024 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:01.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.047+0000 7f360a59c700 1 --2- 172.21.15.44:0/3669747024 >> v2:172.21.15.99:3300/0 conn(0x7f360c15cda0 0x7f360c06b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.047+0000 7f3609d9b700 1 -- 172.21.15.44:0/3669747024 >> v2:172.21.15.99:3300/0 conn(0x7f360c15cda0 msgr2=0x7f360c06b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:01.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.047+0000 7f3609d9b700 1 --2- 172.21.15.44:0/3669747024 >> v2:172.21.15.99:3300/0 conn(0x7f360c15cda0 0x7f360c06b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.047+0000 7f3609d9b700 1 -- 172.21.15.44:0/3669747024 >> v1:172.21.15.44:6789/0 conn(0x7f360c06a520 legacy=0x7f360c06a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.047+0000 7f360959a700 1 -- 172.21.15.44:0/3669747024 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047266247 0 0) 0x7f360c0b8430 con 0x7f360c06a520 2024-09-13T18:27:01.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.047+0000 7f3609d9b700 1 -- 172.21.15.44:0/3669747024 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c0d0880 con 0x7f360c0ceb70 2024-09-13T18:27:01.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.047+0000 7f3609d9b700 1 --2- 172.21.15.44:0/3669747024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f360c0ceb70 0x7f360c0b5de0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f360c0d0800 tx=0x7f35fc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab00545519429c2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:01.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.047+0000 7f360959a700 1 -- 172.21.15.44:0/3669747024 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc011830 con 0x7f360c0ceb70 2024-09-13T18:27:01.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.047+0000 7f360959a700 1 -- 172.21.15.44:0/3669747024 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35fc011990 con 0x7f360c0ceb70 2024-09-13T18:27:01.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.047+0000 7f360959a700 1 -- 172.21.15.44:0/3669747024 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc011d20 con 0x7f360c0ceb70 2024-09-13T18:27:01.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.047+0000 7f360b59e700 1 -- 172.21.15.44:0/3669747024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f360c0ceb70 msgr2=0x7f360c0b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.047+0000 7f360b59e700 1 --2- 172.21.15.44:0/3669747024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f360c0ceb70 0x7f360c0b5de0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f360c0d0800 tx=0x7f35fc009b30 comp rx=0 tx=0).stop 2024-09-13T18:27:01.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.047+0000 7f360b59e700 1 -- 172.21.15.44:0/3669747024 shutdown_connections 2024-09-13T18:27:01.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.047+0000 7f360b59e700 1 --2- 172.21.15.44:0/3669747024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f360c0ceb70 0x7f360c0b5de0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.047+0000 7f360b59e700 1 --2- 172.21.15.44:0/3669747024 >> v2:172.21.15.99:3300/0 conn(0x7f360c15cda0 0x7f360c06b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.047+0000 7f360b59e700 1 -- 172.21.15.44:0/3669747024 >> 172.21.15.44:0/3669747024 conn(0x7f360c0d2cb0 msgr2=0x7f360c0d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:01.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.047+0000 7f360b59e700 1 -- 172.21.15.44:0/3669747024 shutdown_connections 2024-09-13T18:27:01.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.047+0000 7f360b59e700 1 -- 172.21.15.44:0/3669747024 wait complete. 2024-09-13T18:27:01.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.051+0000 7f360b59e700 1 Processor -- start 2024-09-13T18:27:01.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.051+0000 7f360b59e700 1 -- start start 2024-09-13T18:27:01.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.051+0000 7f360b59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f360c06a520 0x7f360c151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.051+0000 7f360b59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f360c0ceb70 0x7f360c1e76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.051+0000 7f360b59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f360c15cda0 0x7f360c15d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.051+0000 7f360b59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c1e81b0 con 0x7f360c15cda0 2024-09-13T18:27:01.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.051+0000 7f360b59e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c1e8490 con 0x7f360c06a520 2024-09-13T18:27:01.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.051+0000 7f360b59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360c1e8770 con 0x7f360c0ceb70 2024-09-13T18:27:01.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.051+0000 7f360ad9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f360c15cda0 0x7f360c15d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.051+0000 7f360ad9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f360c15cda0 0x7f360c15d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45994/0 (socket says 172.21.15.44:45994) 2024-09-13T18:27:01.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.051+0000 7f360ad9d700 1 -- 172.21.15.44:0/3052353896 learned_addr learned my addr 172.21.15.44:0/3052353896 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:01.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.051+0000 7f360a59c700 1 --2- 172.21.15.44:0/3052353896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f360c06a520 0x7f360c151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.051+0000 7f3609d9b700 1 --2- 172.21.15.44:0/3052353896 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f360c0ceb70 0x7f360c1e76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.051+0000 7f360ad9d700 1 -- 172.21.15.44:0/3052353896 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f360c0ceb70 msgr2=0x7f360c1e76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.051+0000 7f360ad9d700 1 --2- 172.21.15.44:0/3052353896 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f360c0ceb70 0x7f360c1e76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.051+0000 7f360ad9d700 1 -- 172.21.15.44:0/3052353896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f360c06a520 msgr2=0x7f360c151900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.051+0000 7f360ad9d700 1 --2- 172.21.15.44:0/3052353896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f360c06a520 0x7f360c151900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.051+0000 7f360ad9d700 1 -- 172.21.15.44:0/3052353896 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc0094b0 con 0x7f360c15cda0 2024-09-13T18:27:01.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.051+0000 7f360a59c700 1 --2- 172.21.15.44:0/3052353896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f360c06a520 0x7f360c151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:01.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.051+0000 7f3609d9b700 1 --2- 172.21.15.44:0/3052353896 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f360c0ceb70 0x7f360c1e76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:01.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.055+0000 7f360ad9d700 1 --2- 172.21.15.44:0/3052353896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f360c15cda0 0x7f360c15d230 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f360400cb60 tx=0x7f360400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:01.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.055+0000 7f3602ffd700 1 -- 172.21.15.44:0/3052353896 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360400ab50 con 0x7f360c15cda0 2024-09-13T18:27:01.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.055+0000 7f3602ffd700 1 -- 172.21.15.44:0/3052353896 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360400acb0 con 0x7f360c15cda0 2024-09-13T18:27:01.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.055+0000 7f360b59e700 1 -- 172.21.15.44:0/3052353896 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f360c1e8a50 con 0x7f360c15cda0 2024-09-13T18:27:01.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.055+0000 7f3602ffd700 1 -- 172.21.15.44:0/3052353896 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3604007310 con 0x7f360c15cda0 2024-09-13T18:27:01.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.055+0000 7f360b59e700 1 -- 172.21.15.44:0/3052353896 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f360c1e7c30 con 0x7f360c15cda0 2024-09-13T18:27:01.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.055+0000 7f360b59e700 1 -- 172.21.15.44:0/3052353896 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f360c1e8f70 con 0x7f360c15cda0 2024-09-13T18:27:01.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.055+0000 7f3602ffd700 1 -- 172.21.15.44:0/3052353896 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3604007470 con 0x7f360c15cda0 2024-09-13T18:27:01.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.055+0000 7f3602ffd700 1 --2- 172.21.15.44:0/3052353896 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f35ec066730 0x7f35ec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.055+0000 7f3602ffd700 1 -- 172.21.15.44:0/3052353896 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f3604083ef0 con 0x7f360c15cda0 2024-09-13T18:27:01.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.059+0000 7f360a59c700 1 --2- 172.21.15.44:0/3052353896 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f35ec066730 0x7f35ec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.059+0000 7f360a59c700 1 --2- 172.21.15.44:0/3052353896 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f35ec066730 0x7f35ec068bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009c40 tx=0x7f35f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:01.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.067+0000 7f3602ffd700 1 -- 172.21.15.44:0/3052353896 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f360c1e8f70 con 0x7f360c15cda0 2024-09-13T18:27:01.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.271+0000 7f360b59e700 1 -- 172.21.15.44:0/3052353896 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f360c1e8f70 con 0x7f360c15cda0 2024-09-13T18:27:01.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.291+0000 7f3602ffd700 1 -- 172.21.15.44:0/3052353896 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f360c1e8f70 con 0x7f360c15cda0 2024-09-13T18:27:01.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.299+0000 7f360b59e700 1 -- 172.21.15.44:0/3052353896 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f35ec066730 msgr2=0x7f35ec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.299+0000 7f360b59e700 1 --2- 172.21.15.44:0/3052353896 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f35ec066730 0x7f35ec068bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009c40 tx=0x7f35f4008040 comp rx=0 tx=0).stop 2024-09-13T18:27:01.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.299+0000 7f360b59e700 1 -- 172.21.15.44:0/3052353896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f360c15cda0 msgr2=0x7f360c15d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.299+0000 7f360b59e700 1 --2- 172.21.15.44:0/3052353896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f360c15cda0 0x7f360c15d230 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f360400cb60 tx=0x7f360400cf20 comp rx=0 tx=0).stop 2024-09-13T18:27:01.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.299+0000 7f360b59e700 1 -- 172.21.15.44:0/3052353896 shutdown_connections 2024-09-13T18:27:01.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.299+0000 7f360b59e700 1 --2- 172.21.15.44:0/3052353896 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f35ec066730 0x7f35ec068bf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.303+0000 7f360b59e700 1 --2- 172.21.15.44:0/3052353896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f360c15cda0 0x7f360c15d230 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.303+0000 7f360b59e700 1 --2- 172.21.15.44:0/3052353896 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f360c0ceb70 0x7f360c1e76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.303+0000 7f360b59e700 1 --2- 172.21.15.44:0/3052353896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f360c06a520 0x7f360c151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.303+0000 7f360b59e700 1 -- 172.21.15.44:0/3052353896 >> 172.21.15.44:0/3052353896 conn(0x7f360c0d2cb0 msgr2=0x7f360c0b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:01.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.303+0000 7f360b59e700 1 -- 172.21.15.44:0/3052353896 shutdown_connections 2024-09-13T18:27:01.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.303+0000 7f360b59e700 1 -- 172.21.15.44:0/3052353896 wait complete. 2024-09-13T18:27:01.310 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T18:27:01.322 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:01.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.419+0000 7f810905b700 1 Processor -- start 2024-09-13T18:27:01.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.419+0000 7f810905b700 1 -- start start 2024-09-13T18:27:01.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.419+0000 7f810905b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f810406fb30 0x7f81040adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.419+0000 7f810905b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f810406bb90 0x7f81040cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.419+0000 7f810905b700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810406a780 con 0x7f810406d150 2024-09-13T18:27:01.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.419+0000 7f810905b700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810406cd30 con 0x7f810406bb90 2024-09-13T18:27:01.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.419+0000 7f810905b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8104159470 con 0x7f810406fb30 2024-09-13T18:27:01.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.419+0000 7f81037fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f810406bb90 0x7f81040cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.419+0000 7f810885a700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f810406d150 0x7f810406d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59138/0 (socket says 172.21.15.44:59138) 2024-09-13T18:27:01.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.419+0000 7f810885a700 1 -- 172.21.15.44:0/402613630 learned_addr learned my addr 172.21.15.44:0/402613630 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:01.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.419+0000 7f8103fff700 1 --2- 172.21.15.44:0/402613630 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f810406fb30 0x7f81040adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.419+0000 7f81037fe700 1 -- 172.21.15.44:0/402613630 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f810406fb30 msgr2=0x7f81040adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:01.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.419+0000 7f81037fe700 1 --2- 172.21.15.44:0/402613630 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f810406fb30 0x7f81040adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.419+0000 7f81037fe700 1 -- 172.21.15.44:0/402613630 >> v1:172.21.15.44:6789/0 conn(0x7f810406d150 legacy=0x7f810406d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.419+0000 7f8102ffd700 1 -- 172.21.15.44:0/402613630 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215442707 0 0) 0x7f810406a780 con 0x7f810406d150 2024-09-13T18:27:01.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.419+0000 7f81037fe700 1 -- 172.21.15.44:0/402613630 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810406c0b0 con 0x7f810406bb90 2024-09-13T18:27:01.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.419+0000 7f81037fe700 1 --2- 172.21.15.44:0/402613630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f810406bb90 0x7f81040cbf00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f80f4009850 tx=0x7f80f4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef24089090e7ca6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:01.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.419+0000 7f8102ffd700 1 -- 172.21.15.44:0/402613630 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f4011830 con 0x7f810406bb90 2024-09-13T18:27:01.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.423+0000 7f8102ffd700 1 -- 172.21.15.44:0/402613630 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f4011990 con 0x7f810406bb90 2024-09-13T18:27:01.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.423+0000 7f8102ffd700 1 -- 172.21.15.44:0/402613630 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f4011d40 con 0x7f810406bb90 2024-09-13T18:27:01.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.423+0000 7f810905b700 1 -- 172.21.15.44:0/402613630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f810406bb90 msgr2=0x7f81040cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.423+0000 7f810905b700 1 --2- 172.21.15.44:0/402613630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f810406bb90 0x7f81040cbf00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f80f4009850 tx=0x7f80f4009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:01.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.423+0000 7f810905b700 1 -- 172.21.15.44:0/402613630 shutdown_connections 2024-09-13T18:27:01.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.423+0000 7f810905b700 1 --2- 172.21.15.44:0/402613630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f810406bb90 0x7f81040cbf00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.423+0000 7f810905b700 1 --2- 172.21.15.44:0/402613630 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f810406fb30 0x7f81040adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.423+0000 7f810905b700 1 -- 172.21.15.44:0/402613630 >> 172.21.15.44:0/402613630 conn(0x7f81040b0f00 msgr2=0x7f81040b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:01.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.423+0000 7f810905b700 1 -- 172.21.15.44:0/402613630 shutdown_connections 2024-09-13T18:27:01.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.423+0000 7f810905b700 1 -- 172.21.15.44:0/402613630 wait complete. 2024-09-13T18:27:01.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.423+0000 7f810905b700 1 Processor -- start 2024-09-13T18:27:01.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.423+0000 7f810905b700 1 -- start start 2024-09-13T18:27:01.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.427+0000 7f810905b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f810406bb90 0x7f810414e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.427+0000 7f810905b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f810406d150 0x7f8104144e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.427+0000 7f810905b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f810406fb30 0x7f81041558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.427+0000 7f810905b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810414f330 con 0x7f810406bb90 2024-09-13T18:27:01.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.427+0000 7f810905b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810414ff60 con 0x7f810406fb30 2024-09-13T18:27:01.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.427+0000 7f810905b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8104150240 con 0x7f810406d150 2024-09-13T18:27:01.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.427+0000 7f8103fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f810406bb90 0x7f810414e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.427+0000 7f8103fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f810406bb90 0x7f810414e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46024/0 (socket says 172.21.15.44:46024) 2024-09-13T18:27:01.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.427+0000 7f8103fff700 1 -- 172.21.15.44:0/702280069 learned_addr learned my addr 172.21.15.44:0/702280069 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:01.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.427+0000 7f810885a700 1 --2- 172.21.15.44:0/702280069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f810406fb30 0x7f81041558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.427+0000 7f81037fe700 1 --2- 172.21.15.44:0/702280069 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f810406d150 0x7f8104144e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.427+0000 7f8103fff700 1 -- 172.21.15.44:0/702280069 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f810406d150 msgr2=0x7f8104144e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.427+0000 7f8103fff700 1 --2- 172.21.15.44:0/702280069 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f810406d150 0x7f8104144e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.427+0000 7f8103fff700 1 -- 172.21.15.44:0/702280069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f810406fb30 msgr2=0x7f81041558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.427+0000 7f8103fff700 1 --2- 172.21.15.44:0/702280069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f810406fb30 0x7f81041558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.427+0000 7f8103fff700 1 -- 172.21.15.44:0/702280069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f40094b0 con 0x7f810406bb90 2024-09-13T18:27:01.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.427+0000 7f81037fe700 1 --2- 172.21.15.44:0/702280069 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f810406d150 0x7f8104144e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:01.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.427+0000 7f8103fff700 1 --2- 172.21.15.44:0/702280069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f810406bb90 0x7f810414e750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f80f800e8a0 tx=0x7f80f800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:01.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.427+0000 7f8100ff9700 1 -- 172.21.15.44:0/702280069 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f80095c0 con 0x7f810406bb90 2024-09-13T18:27:01.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.427+0000 7f8100ff9700 1 -- 172.21.15.44:0/702280069 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f800eea0 con 0x7f810406bb90 2024-09-13T18:27:01.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.427+0000 7f810905b700 1 -- 172.21.15.44:0/702280069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810414ec90 con 0x7f810406bb90 2024-09-13T18:27:01.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.427+0000 7f8100ff9700 1 -- 172.21.15.44:0/702280069 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f800ca70 con 0x7f810406bb90 2024-09-13T18:27:01.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.427+0000 7f810905b700 1 -- 172.21.15.44:0/702280069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810414f860 con 0x7f810406bb90 2024-09-13T18:27:01.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.431+0000 7f810905b700 1 -- 172.21.15.44:0/702280069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81040adbd0 con 0x7f810406bb90 2024-09-13T18:27:01.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.431+0000 7f8100ff9700 1 -- 172.21.15.44:0/702280069 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f80f800cc10 con 0x7f810406bb90 2024-09-13T18:27:01.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.431+0000 7f8100ff9700 1 --2- 172.21.15.44:0/702280069 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f80f0066730 0x7f80f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.431+0000 7f8100ff9700 1 -- 172.21.15.44:0/702280069 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80f80844a0 con 0x7f810406bb90 2024-09-13T18:27:01.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.431+0000 7f81037fe700 1 --2- 172.21.15.44:0/702280069 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f80f0066730 0x7f80f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.431+0000 7f81037fe700 1 --2- 172.21.15.44:0/702280069 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f80f0066730 0x7f80f0068bf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8104156db0 tx=0x7f80f4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:01.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.439+0000 7f8100ff9700 1 -- 172.21.15.44:0/702280069 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f80f80518a0 con 0x7f810406bb90 2024-09-13T18:27:01.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.615+0000 7f810905b700 1 -- 172.21.15.44:0/702280069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f810406b810 con 0x7f810406bb90 2024-09-13T18:27:01.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.619+0000 7f8100ff9700 1 -- 172.21.15.44:0/702280069 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16458 (secure 0 0 0) 0x7f810406b810 con 0x7f810406bb90 2024-09-13T18:27:01.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:01.624 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":20,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:01.276505+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:01.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.623+0000 7f810905b700 1 -- 172.21.15.44:0/702280069 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f80f0066730 msgr2=0x7f80f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.623+0000 7f810905b700 1 --2- 172.21.15.44:0/702280069 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f80f0066730 0x7f80f0068bf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8104156db0 tx=0x7f80f4008030 comp rx=0 tx=0).stop 2024-09-13T18:27:01.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.623+0000 7f810905b700 1 -- 172.21.15.44:0/702280069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f810406bb90 msgr2=0x7f810414e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.623+0000 7f810905b700 1 --2- 172.21.15.44:0/702280069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f810406bb90 0x7f810414e750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f80f800e8a0 tx=0x7f80f800ec60 comp rx=0 tx=0).stop 2024-09-13T18:27:01.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.623+0000 7f810905b700 1 -- 172.21.15.44:0/702280069 shutdown_connections 2024-09-13T18:27:01.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.623+0000 7f810905b700 1 --2- 172.21.15.44:0/702280069 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f80f0066730 0x7f80f0068bf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.623+0000 7f810905b700 1 --2- 172.21.15.44:0/702280069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f810406fb30 0x7f81041558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.623+0000 7f810905b700 1 --2- 172.21.15.44:0/702280069 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f810406d150 0x7f8104144e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.623+0000 7f810905b700 1 --2- 172.21.15.44:0/702280069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f810406bb90 0x7f810414e750 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.623+0000 7f810905b700 1 -- 172.21.15.44:0/702280069 >> 172.21.15.44:0/702280069 conn(0x7f81040b0f00 msgr2=0x7f81040ae590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:01.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.623+0000 7f810905b700 1 -- 172.21.15.44:0/702280069 shutdown_connections 2024-09-13T18:27:01.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.623+0000 7f810905b700 1 -- 172.21.15.44:0/702280069 wait complete. 2024-09-13T18:27:01.643 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:01.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.751+0000 7fe09089b700 1 Processor -- start 2024-09-13T18:27:01.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.751+0000 7fe09089b700 1 -- start start 2024-09-13T18:27:01.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.751+0000 7fe09089b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe08c159060 0x7fe08c15d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.751+0000 7fe09089b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe08c06b5b0 0x7fe08c0b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.751+0000 7fe09089b700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe08c15a630 con 0x7fe08c0b3700 2024-09-13T18:27:01.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.751+0000 7fe09089b700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe08c0b3bb0 con 0x7fe08c159060 2024-09-13T18:27:01.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.751+0000 7fe09089b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c06bd30 con 0x7fe08c06b5b0 2024-09-13T18:27:01.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.751+0000 7fe08b7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe08c159060 0x7fe08c15d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.751+0000 7fe08bfff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe08c0b3700 0x7fe08c159440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59144/0 (socket says 172.21.15.44:59144) 2024-09-13T18:27:01.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.751+0000 7fe08bfff700 1 -- 172.21.15.44:0/2479890900 learned_addr learned my addr 172.21.15.44:0/2479890900 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:01.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.751+0000 7fe082ffd700 1 --2- 172.21.15.44:0/2479890900 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe08c06b5b0 0x7fe08c0b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.751+0000 7fe08b7fe700 1 -- 172.21.15.44:0/2479890900 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe08c06b5b0 msgr2=0x7fe08c0b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:01.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.751+0000 7fe08b7fe700 1 --2- 172.21.15.44:0/2479890900 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe08c06b5b0 0x7fe08c0b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.751+0000 7fe08b7fe700 1 -- 172.21.15.44:0/2479890900 >> v1:172.21.15.44:6789/0 conn(0x7fe08c0b3700 legacy=0x7fe08c159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:01.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.751+0000 7fe08b7fe700 1 -- 172.21.15.44:0/2479890900 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08c06c010 con 0x7fe08c159060 2024-09-13T18:27:01.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.751+0000 7fe08b7fe700 1 --2- 172.21.15.44:0/2479890900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08c159060 0x7fe08c15d5b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009880 tx=0x7fe07c009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd43473222e43b6d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:01.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.755+0000 7fe08affd700 1 -- 172.21.15.44:0/2479890900 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c011830 con 0x7fe08c159060 2024-09-13T18:27:01.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.755+0000 7fe08affd700 1 -- 172.21.15.44:0/2479890900 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07c011990 con 0x7fe08c159060 2024-09-13T18:27:01.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.755+0000 7fe08affd700 1 -- 172.21.15.44:0/2479890900 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c011d20 con 0x7fe08c159060 2024-09-13T18:27:01.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.755+0000 7fe09089b700 1 -- 172.21.15.44:0/2479890900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08c159060 msgr2=0x7fe08c15d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.755+0000 7fe09089b700 1 --2- 172.21.15.44:0/2479890900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08c159060 0x7fe08c15d5b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009880 tx=0x7fe07c009b90 comp rx=0 tx=0).stop 2024-09-13T18:27:01.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.755+0000 7fe09089b700 1 -- 172.21.15.44:0/2479890900 shutdown_connections 2024-09-13T18:27:01.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.755+0000 7fe09089b700 1 --2- 172.21.15.44:0/2479890900 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe08c06b5b0 0x7fe08c0b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.755+0000 7fe09089b700 1 --2- 172.21.15.44:0/2479890900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08c159060 0x7fe08c15d5b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.755+0000 7fe09089b700 1 -- 172.21.15.44:0/2479890900 >> 172.21.15.44:0/2479890900 conn(0x7fe08c06d900 msgr2=0x7fe08c06dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:01.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.755+0000 7fe09089b700 1 -- 172.21.15.44:0/2479890900 shutdown_connections 2024-09-13T18:27:01.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.755+0000 7fe09089b700 1 -- 172.21.15.44:0/2479890900 wait complete. 2024-09-13T18:27:01.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.755+0000 7fe09089b700 1 Processor -- start 2024-09-13T18:27:01.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.755+0000 7fe09089b700 1 -- start start 2024-09-13T18:27:01.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe09089b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe08c06b5b0 0x7fe08c149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe09089b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe08c0b3700 0x7fe08c1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe09089b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08c159060 0x7fe08c152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe09089b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c0cbc40 con 0x7fe08c159060 2024-09-13T18:27:01.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe09089b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c149d60 con 0x7fe08c0b3700 2024-09-13T18:27:01.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe09089b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c156570 con 0x7fe08c06b5b0 2024-09-13T18:27:01.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe08bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08c159060 0x7fe08c152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe08b7fe700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe08c06b5b0 0x7fe08c149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe08b7fe700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe08c06b5b0 0x7fe08c149820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:38178/0 (socket says 172.21.15.44:38178) 2024-09-13T18:27:01.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe082ffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe08c0b3700 0x7fe08c1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe08bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08c159060 0x7fe08c152180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46044/0 (socket says 172.21.15.44:46044) 2024-09-13T18:27:01.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe08b7fe700 1 -- 172.21.15.44:0/1178765867 learned_addr learned my addr 172.21.15.44:0/1178765867 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:01.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe08bfff700 1 -- 172.21.15.44:0/1178765867 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe08c06b5b0 msgr2=0x7fe08c149820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe08bfff700 1 --2- 172.21.15.44:0/1178765867 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe08c06b5b0 0x7fe08c149820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe08bfff700 1 -- 172.21.15.44:0/1178765867 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe08c0b3700 msgr2=0x7fe08c1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe08bfff700 1 --2- 172.21.15.44:0/1178765867 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe08c0b3700 0x7fe08c1554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe08bfff700 1 -- 172.21.15.44:0/1178765867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c0094b0 con 0x7fe08c159060 2024-09-13T18:27:01.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe08b7fe700 1 --2- 172.21.15.44:0/1178765867 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe08c06b5b0 0x7fe08c149820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:01.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe08bfff700 1 --2- 172.21.15.44:0/1178765867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08c159060 0x7fe08c152180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe084011c50 tx=0x7fe084011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:01.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe088ff9700 1 -- 172.21.15.44:0/1178765867 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08400d040 con 0x7fe08c159060 2024-09-13T18:27:01.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe088ff9700 1 -- 172.21.15.44:0/1178765867 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08400fc30 con 0x7fe08c159060 2024-09-13T18:27:01.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe088ff9700 1 -- 172.21.15.44:0/1178765867 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084015460 con 0x7fe08c159060 2024-09-13T18:27:01.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe09089b700 1 -- 172.21.15.44:0/1178765867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe08c156850 con 0x7fe08c159060 2024-09-13T18:27:01.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe09089b700 1 -- 172.21.15.44:0/1178765867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe08c155a20 con 0x7fe08c159060 2024-09-13T18:27:01.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.759+0000 7fe09089b700 1 -- 172.21.15.44:0/1178765867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe08c156d70 con 0x7fe08c159060 2024-09-13T18:27:01.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.763+0000 7fe088ff9700 1 -- 172.21.15.44:0/1178765867 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe0840155c0 con 0x7fe08c159060 2024-09-13T18:27:01.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.763+0000 7fe088ff9700 1 --2- 172.21.15.44:0/1178765867 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe06c066730 0x7fe06c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.763+0000 7fe088ff9700 1 -- 172.21.15.44:0/1178765867 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe08400c070 con 0x7fe08c159060 2024-09-13T18:27:01.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.763+0000 7fe08b7fe700 1 --2- 172.21.15.44:0/1178765867 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe06c066730 0x7fe06c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.763+0000 7fe08b7fe700 1 --2- 172.21.15.44:0/1178765867 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe06c066730 0x7fe06c068bf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009fd0 tx=0x7fe07c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:01.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.771+0000 7fe088ff9700 1 -- 172.21.15.44:0/1178765867 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe08c156d70 con 0x7fe08c159060 2024-09-13T18:27:01.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.947+0000 7fe09089b700 1 -- 172.21.15.44:0/1178765867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe08c156d70 con 0x7fe08c159060 2024-09-13T18:27:01.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.947+0000 7fe088ff9700 1 -- 172.21.15.44:0/1178765867 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16458 (secure 0 0 0) 0x7fe08c156d70 con 0x7fe08c159060 2024-09-13T18:27:01.953 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:01.953 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":20,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:01.276505+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:01.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.951+0000 7fe09089b700 1 -- 172.21.15.44:0/1178765867 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe06c066730 msgr2=0x7fe06c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.951+0000 7fe09089b700 1 --2- 172.21.15.44:0/1178765867 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe06c066730 0x7fe06c068bf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009fd0 tx=0x7fe07c008030 comp rx=0 tx=0).stop 2024-09-13T18:27:01.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.951+0000 7fe09089b700 1 -- 172.21.15.44:0/1178765867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08c159060 msgr2=0x7fe08c152180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.951+0000 7fe09089b700 1 --2- 172.21.15.44:0/1178765867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08c159060 0x7fe08c152180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe084011c50 tx=0x7fe084011f60 comp rx=0 tx=0).stop 2024-09-13T18:27:01.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.951+0000 7fe09089b700 1 -- 172.21.15.44:0/1178765867 shutdown_connections 2024-09-13T18:27:01.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.951+0000 7fe09089b700 1 --2- 172.21.15.44:0/1178765867 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe06c066730 0x7fe06c068bf0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.951+0000 7fe09089b700 1 --2- 172.21.15.44:0/1178765867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08c159060 0x7fe08c152180 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.951+0000 7fe09089b700 1 --2- 172.21.15.44:0/1178765867 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe08c0b3700 0x7fe08c1554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.951+0000 7fe09089b700 1 --2- 172.21.15.44:0/1178765867 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe08c06b5b0 0x7fe08c149820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.951+0000 7fe09089b700 1 -- 172.21.15.44:0/1178765867 >> 172.21.15.44:0/1178765867 conn(0x7fe08c06d900 msgr2=0x7fe08c0afde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:01.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.951+0000 7fe09089b700 1 -- 172.21.15.44:0/1178765867 shutdown_connections 2024-09-13T18:27:01.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:01.951+0000 7fe09089b700 1 -- 172.21.15.44:0/1178765867 wait complete. 2024-09-13T18:27:01.973 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:27:02.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.091+0000 7f391187f700 1 Processor -- start 2024-09-13T18:27:02.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.091+0000 7f391187f700 1 -- start start 2024-09-13T18:27:02.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.091+0000 7f391187f700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f390c06b900 0x7f390c0b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.091+0000 7f391187f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f390c06a520 0x7f390c06a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.091+0000 7f391187f700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390c0b8430 con 0x7f390c15cda0 2024-09-13T18:27:02.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.091+0000 7f391187f700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f390c06ae90 con 0x7f390c06b900 2024-09-13T18:27:02.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.091+0000 7f391187f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c06bd60 con 0x7f390c06a520 2024-09-13T18:27:02.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.091+0000 7f390bfff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f390c06b900 0x7f390c0b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.095+0000 7f390bfff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f390c06b900 0x7f390c0b5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38572/0 (socket says 172.21.15.44:38572) 2024-09-13T18:27:02.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.095+0000 7f390bfff700 1 -- 172.21.15.44:0/2560189191 learned_addr learned my addr 172.21.15.44:0/2560189191 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:02.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.095+0000 7f391107e700 1 --2- 172.21.15.44:0/2560189191 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f390c06a520 0x7f390c06a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.095+0000 7f390bfff700 1 -- 172.21.15.44:0/2560189191 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f390c06a520 msgr2=0x7f390c06a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:02.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.095+0000 7f390bfff700 1 --2- 172.21.15.44:0/2560189191 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f390c06a520 0x7f390c06a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.095+0000 7f390bfff700 1 -- 172.21.15.44:0/2560189191 >> v1:172.21.15.99:6789/0 conn(0x7f390c15cda0 legacy=0x7f390c0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.095+0000 7f390bfff700 1 -- 172.21.15.44:0/2560189191 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c0cf350 con 0x7f390c06b900 2024-09-13T18:27:02.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.095+0000 7f390bfff700 1 --2- 172.21.15.44:0/2560189191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f390c06b900 0x7f390c0b5de0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f38fc009910 tx=0x7f38fc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8b5575a30535bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:02.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.095+0000 7f390b7fe700 1 -- 172.21.15.44:0/2560189191 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc011830 con 0x7f390c06b900 2024-09-13T18:27:02.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.095+0000 7f390b7fe700 1 -- 172.21.15.44:0/2560189191 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38fc011990 con 0x7f390c06b900 2024-09-13T18:27:02.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.095+0000 7f390b7fe700 1 -- 172.21.15.44:0/2560189191 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc011d40 con 0x7f390c06b900 2024-09-13T18:27:02.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.095+0000 7f391187f700 1 -- 172.21.15.44:0/2560189191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f390c06b900 msgr2=0x7f390c0b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.095+0000 7f391187f700 1 --2- 172.21.15.44:0/2560189191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f390c06b900 0x7f390c0b5de0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f38fc009910 tx=0x7f38fc009c20 comp rx=0 tx=0).stop 2024-09-13T18:27:02.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.095+0000 7f391187f700 1 -- 172.21.15.44:0/2560189191 shutdown_connections 2024-09-13T18:27:02.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.095+0000 7f391187f700 1 --2- 172.21.15.44:0/2560189191 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f390c06a520 0x7f390c06a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.095+0000 7f391187f700 1 --2- 172.21.15.44:0/2560189191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f390c06b900 0x7f390c0b5de0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.095+0000 7f391187f700 1 -- 172.21.15.44:0/2560189191 >> 172.21.15.44:0/2560189191 conn(0x7f390c0d2cb0 msgr2=0x7f390c0d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:02.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.095+0000 7f391187f700 1 -- 172.21.15.44:0/2560189191 shutdown_connections 2024-09-13T18:27:02.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.095+0000 7f391187f700 1 -- 172.21.15.44:0/2560189191 wait complete. 2024-09-13T18:27:02.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.099+0000 7f391187f700 1 Processor -- start 2024-09-13T18:27:02.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.099+0000 7f391187f700 1 -- start start 2024-09-13T18:27:02.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.099+0000 7f391187f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f390c06a520 0x7f390c0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.099+0000 7f391187f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f390c06b900 0x7f390c1f36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.099+0000 7f391187f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f390c15cda0 0x7f390c0c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.099+0000 7f391187f700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c0c8390 con 0x7f390c06b900 2024-09-13T18:27:02.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.099+0000 7f391187f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c15ab00 con 0x7f390c06a520 2024-09-13T18:27:02.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.099+0000 7f391187f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c1f24f0 con 0x7f390c15cda0 2024-09-13T18:27:02.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.099+0000 7f390bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f390c06b900 0x7f390c1f36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.099+0000 7f390bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f390c06b900 0x7f390c1f36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38582/0 (socket says 172.21.15.44:38582) 2024-09-13T18:27:02.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.099+0000 7f391107e700 1 --2- 172.21.15.44:0/1181240336 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f390c15cda0 0x7f390c0c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.099+0000 7f390bfff700 1 -- 172.21.15.44:0/1181240336 learned_addr learned my addr 172.21.15.44:0/1181240336 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:02.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.099+0000 7f391087d700 1 --2- 172.21.15.44:0/1181240336 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f390c06a520 0x7f390c0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.103+0000 7f390bfff700 1 -- 172.21.15.44:0/1181240336 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f390c15cda0 msgr2=0x7f390c0c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.103+0000 7f390bfff700 1 --2- 172.21.15.44:0/1181240336 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f390c15cda0 0x7f390c0c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.103+0000 7f390bfff700 1 -- 172.21.15.44:0/1181240336 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f390c06a520 msgr2=0x7f390c0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.103+0000 7f390bfff700 1 --2- 172.21.15.44:0/1181240336 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f390c06a520 0x7f390c0cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.103+0000 7f390bfff700 1 -- 172.21.15.44:0/1181240336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38fc009570 con 0x7f390c06b900 2024-09-13T18:27:02.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.103+0000 7f391107e700 1 --2- 172.21.15.44:0/1181240336 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f390c15cda0 0x7f390c0c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:02.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.103+0000 7f390bfff700 1 --2- 172.21.15.44:0/1181240336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f390c06b900 0x7f390c1f36e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f38fc000c00 tx=0x7f38fc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:02.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.103+0000 7f39097fa700 1 -- 172.21.15.44:0/1181240336 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc004510 con 0x7f390c06b900 2024-09-13T18:27:02.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.103+0000 7f39097fa700 1 -- 172.21.15.44:0/1181240336 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38fc0036c0 con 0x7f390c06b900 2024-09-13T18:27:02.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.103+0000 7f391187f700 1 -- 172.21.15.44:0/1181240336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390c0c6c30 con 0x7f390c06b900 2024-09-13T18:27:02.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.103+0000 7f39097fa700 1 -- 172.21.15.44:0/1181240336 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc003a70 con 0x7f390c06b900 2024-09-13T18:27:02.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.103+0000 7f391187f700 1 -- 172.21.15.44:0/1181240336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390c0c71f0 con 0x7f390c06b900 2024-09-13T18:27:02.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.103+0000 7f391187f700 1 -- 172.21.15.44:0/1181240336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390c1f26e0 con 0x7f390c06b900 2024-09-13T18:27:02.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.107+0000 7f39097fa700 1 -- 172.21.15.44:0/1181240336 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f38fc003bd0 con 0x7f390c06b900 2024-09-13T18:27:02.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.107+0000 7f39097fa700 1 --2- 172.21.15.44:0/1181240336 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f38ec066730 0x7f38ec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.107+0000 7f39097fa700 1 -- 172.21.15.44:0/1181240336 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38fc021030 con 0x7f390c06b900 2024-09-13T18:27:02.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.107+0000 7f391087d700 1 --2- 172.21.15.44:0/1181240336 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f38ec066730 0x7f38ec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.107+0000 7f391087d700 1 --2- 172.21.15.44:0/1181240336 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f38ec066730 0x7f38ec068bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f38f4000f60 tx=0x7f38f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:02.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.115+0000 7f39097fa700 1 -- 172.21.15.44:0/1181240336 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f38fc052b10 con 0x7f390c06b900 2024-09-13T18:27:02.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:02.319+0000 7f391187f700 1 -- 172.21.15.44:0/1181240336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f390c06a950 con 0x7f390c06b900 2024-09-13T18:27:03.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.295+0000 7f39097fa700 1 -- 172.21.15.44:0/1181240336 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f38fc0150b0 con 0x7f390c06b900 2024-09-13T18:27:03.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.299+0000 7f391187f700 1 -- 172.21.15.44:0/1181240336 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f38ec066730 msgr2=0x7f38ec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:03.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.299+0000 7f391187f700 1 --2- 172.21.15.44:0/1181240336 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f38ec066730 0x7f38ec068bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f38f4000f60 tx=0x7f38f4009040 comp rx=0 tx=0).stop 2024-09-13T18:27:03.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.299+0000 7f391187f700 1 -- 172.21.15.44:0/1181240336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f390c06b900 msgr2=0x7f390c1f36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:03.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.299+0000 7f391187f700 1 --2- 172.21.15.44:0/1181240336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f390c06b900 0x7f390c1f36e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f38fc000c00 tx=0x7f38fc004770 comp rx=0 tx=0).stop 2024-09-13T18:27:03.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.299+0000 7f391187f700 1 -- 172.21.15.44:0/1181240336 shutdown_connections 2024-09-13T18:27:03.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.299+0000 7f391187f700 1 --2- 172.21.15.44:0/1181240336 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f38ec066730 0x7f38ec068bf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.299+0000 7f391187f700 1 --2- 172.21.15.44:0/1181240336 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f390c15cda0 0x7f390c0c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.299+0000 7f391187f700 1 --2- 172.21.15.44:0/1181240336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f390c06b900 0x7f390c1f36e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.299+0000 7f391187f700 1 --2- 172.21.15.44:0/1181240336 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f390c06a520 0x7f390c0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.299+0000 7f391187f700 1 -- 172.21.15.44:0/1181240336 >> 172.21.15.44:0/1181240336 conn(0x7f390c0d2cb0 msgr2=0x7f390c0b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:03.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.299+0000 7f391187f700 1 -- 172.21.15.44:0/1181240336 shutdown_connections 2024-09-13T18:27:03.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.299+0000 7f391187f700 1 -- 172.21.15.44:0/1181240336 wait complete. 2024-09-13T18:27:03.320 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:27:03.320 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:27:03.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.443+0000 7f3c32f6a700 1 Processor -- start 2024-09-13T18:27:03.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.443+0000 7f3c32f6a700 1 -- start start 2024-09-13T18:27:03.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.443+0000 7f3c32f6a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c2c06b900 0x7f3c2c0b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.443+0000 7f3c32f6a700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3c2c06a520 0x7f3c2c06a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.443+0000 7f3c32f6a700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c2c06aeb0 con 0x7f3c2c15cda0 2024-09-13T18:27:03.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.443+0000 7f3c32f6a700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c2c0b8430 con 0x7f3c2c06a520 2024-09-13T18:27:03.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.443+0000 7f3c32f6a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c06bd60 con 0x7f3c2c06b900 2024-09-13T18:27:03.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.443+0000 7f3c31f68700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3c2c15cda0 0x7f3c2c0ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52510/0 (socket says 172.21.15.44:52510) 2024-09-13T18:27:03.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.443+0000 7f3c31f68700 1 -- 172.21.15.44:0/3388345960 learned_addr learned my addr 172.21.15.44:0/3388345960 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:03.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.443+0000 7f3c32769700 1 --2- 172.21.15.44:0/3388345960 >> v2:172.21.15.99:3300/0 conn(0x7f3c2c06a520 0x7f3c2c06a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.443+0000 7f3c31767700 1 --2- 172.21.15.44:0/3388345960 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c2c06b900 0x7f3c2c0b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.443+0000 7f3c30f66700 1 -- 172.21.15.44:0/3388345960 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309083290 0 0) 0x7f3c20001110 con 0x7f3c2c15cda0 2024-09-13T18:27:03.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.443+0000 7f3c30f66700 1 -- 172.21.15.44:0/3388345960 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c180035d0 con 0x7f3c2c15cda0 2024-09-13T18:27:03.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.443+0000 7f3c32769700 1 -- 172.21.15.44:0/3388345960 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c2c06b900 msgr2=0x7f3c2c0b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:03.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.443+0000 7f3c32769700 1 --2- 172.21.15.44:0/3388345960 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c2c06b900 0x7f3c2c0b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.443+0000 7f3c32769700 1 -- 172.21.15.44:0/3388345960 >> v1:172.21.15.44:6789/0 conn(0x7f3c2c15cda0 legacy=0x7f3c2c0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:03.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.443+0000 7f3c30f66700 1 -- 172.21.15.44:0/3388345960 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1118144615 0 0) 0x7f3c180035d0 con 0x7f3c2c15cda0 2024-09-13T18:27:03.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.443+0000 7f3c32769700 1 -- 172.21.15.44:0/3388345960 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2c0cf350 con 0x7f3c2c06a520 2024-09-13T18:27:03.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.447+0000 7f3c32769700 1 --2- 172.21.15.44:0/3388345960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c2c06a520 0x7f3c2c06a970 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3c24009d90 tx=0x7f3c2400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cacd42dfa891139e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:03.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.447+0000 7f3c30f66700 1 -- 172.21.15.44:0/3388345960 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2400e070 con 0x7f3c2c06a520 2024-09-13T18:27:03.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.447+0000 7f3c30f66700 1 -- 172.21.15.44:0/3388345960 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c24003a40 con 0x7f3c2c06a520 2024-09-13T18:27:03.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.447+0000 7f3c30f66700 1 -- 172.21.15.44:0/3388345960 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c20001800 con 0x7f3c2c06a520 2024-09-13T18:27:03.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.447+0000 7f3c32f6a700 1 -- 172.21.15.44:0/3388345960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c2c06a520 msgr2=0x7f3c2c06a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:03.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.447+0000 7f3c32f6a700 1 --2- 172.21.15.44:0/3388345960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c2c06a520 0x7f3c2c06a970 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3c24009d90 tx=0x7f3c2400b330 comp rx=0 tx=0).stop 2024-09-13T18:27:03.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.447+0000 7f3c32f6a700 1 -- 172.21.15.44:0/3388345960 shutdown_connections 2024-09-13T18:27:03.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.447+0000 7f3c32f6a700 1 --2- 172.21.15.44:0/3388345960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c2c06a520 0x7f3c2c06a970 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.447+0000 7f3c32f6a700 1 --2- 172.21.15.44:0/3388345960 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c2c06b900 0x7f3c2c0b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.447+0000 7f3c32f6a700 1 -- 172.21.15.44:0/3388345960 >> 172.21.15.44:0/3388345960 conn(0x7f3c2c0d2cb0 msgr2=0x7f3c2c0d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:03.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.447+0000 7f3c32f6a700 1 -- 172.21.15.44:0/3388345960 shutdown_connections 2024-09-13T18:27:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.447+0000 7f3c32f6a700 1 -- 172.21.15.44:0/3388345960 wait complete. 2024-09-13T18:27:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.447+0000 7f3c32f6a700 1 Processor -- start 2024-09-13T18:27:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.451+0000 7f3c32f6a700 1 -- start start 2024-09-13T18:27:03.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.451+0000 7f3c32f6a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c2c06a520 0x7f3c2c1551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.451+0000 7f3c32f6a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c2c06b900 0x7f3c2c15e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.451+0000 7f3c32f6a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c2c15cda0 0x7f3c2c0b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.451+0000 7f3c32f6a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c0c6d60 con 0x7f3c2c06a520 2024-09-13T18:27:03.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.451+0000 7f3c32f6a700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c15eac0 con 0x7f3c2c06b900 2024-09-13T18:27:03.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.451+0000 7f3c32f6a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c1f2670 con 0x7f3c2c15cda0 2024-09-13T18:27:03.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.451+0000 7f3c31f68700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c2c06a520 0x7f3c2c1551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.451+0000 7f3c31767700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c2c06b900 0x7f3c2c15e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.451+0000 7f3c31f68700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c2c06a520 0x7f3c2c1551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38598/0 (socket says 172.21.15.44:38598) 2024-09-13T18:27:03.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.451+0000 7f3c31f68700 1 -- 172.21.15.44:0/804910132 learned_addr learned my addr 172.21.15.44:0/804910132 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:03.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.451+0000 7f3c32769700 1 --2- 172.21.15.44:0/804910132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c2c15cda0 0x7f3c2c0b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.451+0000 7f3c31f68700 1 -- 172.21.15.44:0/804910132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c2c15cda0 msgr2=0x7f3c2c0b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:03.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.451+0000 7f3c31f68700 1 --2- 172.21.15.44:0/804910132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c2c15cda0 0x7f3c2c0b63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.451+0000 7f3c31f68700 1 -- 172.21.15.44:0/804910132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c2c06b900 msgr2=0x7f3c2c15e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:03.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.451+0000 7f3c31f68700 1 --2- 172.21.15.44:0/804910132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c2c06b900 0x7f3c2c15e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.451+0000 7f3c31f68700 1 -- 172.21.15.44:0/804910132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c24009a70 con 0x7f3c2c06a520 2024-09-13T18:27:03.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.451+0000 7f3c31f68700 1 --2- 172.21.15.44:0/804910132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c2c06a520 0x7f3c2c1551e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000c750 tx=0x7f3c2000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:03.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.451+0000 7f3c1e7fc700 1 -- 172.21.15.44:0/804910132 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c20004ca0 con 0x7f3c2c06a520 2024-09-13T18:27:03.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.451+0000 7f3c1e7fc700 1 -- 172.21.15.44:0/804910132 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c20004e00 con 0x7f3c2c06a520 2024-09-13T18:27:03.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.451+0000 7f3c1e7fc700 1 -- 172.21.15.44:0/804910132 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c200072d0 con 0x7f3c2c06a520 2024-09-13T18:27:03.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.451+0000 7f3c32f6a700 1 -- 172.21.15.44:0/804910132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2c0c9ad0 con 0x7f3c2c06a520 2024-09-13T18:27:03.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.451+0000 7f3c32f6a700 1 -- 172.21.15.44:0/804910132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2c0c97f0 con 0x7f3c2c06a520 2024-09-13T18:27:03.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.455+0000 7f3c32f6a700 1 -- 172.21.15.44:0/804910132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c2c06a970 con 0x7f3c2c06a520 2024-09-13T18:27:03.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.455+0000 7f3c1e7fc700 1 -- 172.21.15.44:0/804910132 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3c20007430 con 0x7f3c2c06a520 2024-09-13T18:27:03.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.455+0000 7f3c1e7fc700 1 --2- 172.21.15.44:0/804910132 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3c10066730 0x7f3c10068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.455+0000 7f3c1e7fc700 1 -- 172.21.15.44:0/804910132 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c20083c30 con 0x7f3c2c06a520 2024-09-13T18:27:03.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.455+0000 7f3c31767700 1 --2- 172.21.15.44:0/804910132 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3c10066730 0x7f3c10068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.455+0000 7f3c31767700 1 --2- 172.21.15.44:0/804910132 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3c10066730 0x7f3c10068bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0b7cb0 tx=0x7f3c28009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:03.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.463+0000 7f3c1e7fc700 1 -- 172.21.15.44:0/804910132 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3c20051030 con 0x7f3c2c06a520 2024-09-13T18:27:03.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:03.671+0000 7f3c32f6a700 1 -- 172.21.15.44:0/804910132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3c2c06aeb0 con 0x7f3c2c06a520 2024-09-13T18:27:04.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.295+0000 7f3c1e7fc700 1 -- 172.21.15.44:0/804910132 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3c2c06aeb0 con 0x7f3c2c06a520 2024-09-13T18:27:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.303+0000 7f3c32f6a700 1 -- 172.21.15.44:0/804910132 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3c10066730 msgr2=0x7f3c10068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.303+0000 7f3c32f6a700 1 --2- 172.21.15.44:0/804910132 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3c10066730 0x7f3c10068bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0b7cb0 tx=0x7f3c28009240 comp rx=0 tx=0).stop 2024-09-13T18:27:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.303+0000 7f3c32f6a700 1 -- 172.21.15.44:0/804910132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c2c06a520 msgr2=0x7f3c2c1551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.303+0000 7f3c32f6a700 1 --2- 172.21.15.44:0/804910132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c2c06a520 0x7f3c2c1551e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000c750 tx=0x7f3c2000ca60 comp rx=0 tx=0).stop 2024-09-13T18:27:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.303+0000 7f3c32f6a700 1 -- 172.21.15.44:0/804910132 shutdown_connections 2024-09-13T18:27:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.303+0000 7f3c32f6a700 1 --2- 172.21.15.44:0/804910132 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3c10066730 0x7f3c10068bf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.303+0000 7f3c32f6a700 1 --2- 172.21.15.44:0/804910132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c2c15cda0 0x7f3c2c0b63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.303+0000 7f3c32f6a700 1 --2- 172.21.15.44:0/804910132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c2c06b900 0x7f3c2c15e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.303+0000 7f3c32f6a700 1 --2- 172.21.15.44:0/804910132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c2c06a520 0x7f3c2c1551e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.303+0000 7f3c32f6a700 1 -- 172.21.15.44:0/804910132 >> 172.21.15.44:0/804910132 conn(0x7f3c2c0d2cb0 msgr2=0x7f3c2c0d1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:04.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.303+0000 7f3c32f6a700 1 -- 172.21.15.44:0/804910132 shutdown_connections 2024-09-13T18:27:04.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.303+0000 7f3c32f6a700 1 -- 172.21.15.44:0/804910132 wait complete. 2024-09-13T18:27:04.323 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:27:04.323 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:27:04.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.439+0000 7fe7095f0700 1 Processor -- start 2024-09-13T18:27:04.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.439+0000 7fe7095f0700 1 -- start start 2024-09-13T18:27:04.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.439+0000 7fe7095f0700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe7040711d0 0x7fe704071640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.439+0000 7fe7095f0700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7040b4120 con 0x7fe7040ad160 2024-09-13T18:27:04.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.439+0000 7fe7095f0700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7040b3680 con 0x7fe70415cc40 2024-09-13T18:27:04.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.439+0000 7fe7095f0700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7040acd40 con 0x7fe7040711d0 2024-09-13T18:27:04.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.439+0000 7fe708def700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe7040ad160 0x7fe7040ad5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52512/0 (socket says 172.21.15.44:52512) 2024-09-13T18:27:04.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.439+0000 7fe708def700 1 -- 172.21.15.44:0/874930379 learned_addr learned my addr 172.21.15.44:0/874930379 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:04.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.443+0000 7fe7037fe700 1 --2- 172.21.15.44:0/874930379 >> v2:172.21.15.99:3300/0 conn(0x7fe7040711d0 0x7fe704071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.443+0000 7fe702ffd700 1 -- 172.21.15.44:0/874930379 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947144788 0 0) 0x7fe7040b4120 con 0x7fe7040ad160 2024-09-13T18:27:04.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.443+0000 7fe702ffd700 1 -- 172.21.15.44:0/874930379 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f00035d0 con 0x7fe7040ad160 2024-09-13T18:27:04.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.443+0000 7fe702ffd700 1 -- 172.21.15.44:0/874930379 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316238077 0 0) 0x7fe7040b3680 con 0x7fe70415cc40 2024-09-13T18:27:04.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.443+0000 7fe702ffd700 1 -- 172.21.15.44:0/874930379 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7040b4120 con 0x7fe70415cc40 2024-09-13T18:27:04.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.443+0000 7fe702ffd700 1 -- 172.21.15.44:0/874930379 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 216252930 0 0) 0x7fe6f00035d0 con 0x7fe7040ad160 2024-09-13T18:27:04.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.443+0000 7fe7037fe700 1 -- 172.21.15.44:0/874930379 >> v1:172.21.15.99:6789/0 conn(0x7fe70415cc40 legacy=0x7fe70415dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.443+0000 7fe7037fe700 1 -- 172.21.15.44:0/874930379 >> v1:172.21.15.44:6789/0 conn(0x7fe7040ad160 legacy=0x7fe7040ad5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.443+0000 7fe7037fe700 1 -- 172.21.15.44:0/874930379 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7040b3960 con 0x7fe7040711d0 2024-09-13T18:27:04.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.443+0000 7fe7037fe700 1 --2- 172.21.15.44:0/874930379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7040711d0 0x7fe704071640 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4009850 tx=0x7fe6f4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3bddfe01e7622e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:04.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.443+0000 7fe702ffd700 1 -- 172.21.15.44:0/874930379 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc0019f0 con 0x7fe7040711d0 2024-09-13T18:27:04.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.443+0000 7fe702ffd700 1 -- 172.21.15.44:0/874930379 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f4004030 con 0x7fe7040711d0 2024-09-13T18:27:04.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.443+0000 7fe702ffd700 1 -- 172.21.15.44:0/874930379 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f40043c0 con 0x7fe7040711d0 2024-09-13T18:27:04.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.443+0000 7fe7095f0700 1 -- 172.21.15.44:0/874930379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7040711d0 msgr2=0x7fe704071640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.443+0000 7fe7095f0700 1 --2- 172.21.15.44:0/874930379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7040711d0 0x7fe704071640 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4009850 tx=0x7fe6f4009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:04.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.443+0000 7fe7095f0700 1 -- 172.21.15.44:0/874930379 shutdown_connections 2024-09-13T18:27:04.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.443+0000 7fe7095f0700 1 --2- 172.21.15.44:0/874930379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7040711d0 0x7fe704071640 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.443+0000 7fe7095f0700 1 -- 172.21.15.44:0/874930379 >> 172.21.15.44:0/874930379 conn(0x7fe7040cf170 msgr2=0x7fe7040cf580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:04.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.443+0000 7fe7095f0700 1 -- 172.21.15.44:0/874930379 shutdown_connections 2024-09-13T18:27:04.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.443+0000 7fe7095f0700 1 -- 172.21.15.44:0/874930379 wait complete. 2024-09-13T18:27:04.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe7095f0700 1 Processor -- start 2024-09-13T18:27:04.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe7095f0700 1 -- start start 2024-09-13T18:27:04.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe7095f0700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7040711d0 0x7fe70414a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe7095f0700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe7040ad160 0x7fe7041564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe7095f0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe70415cc40 0x7fe7041569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe7095f0700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040ccfa0 con 0x7fe70415cc40 2024-09-13T18:27:04.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe7095f0700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040ccc70 con 0x7fe7040711d0 2024-09-13T18:27:04.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe7095f0700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe704144aa0 con 0x7fe7040ad160 2024-09-13T18:27:04.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe708def700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe70415cc40 0x7fe7041569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe7037fe700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe7040ad160 0x7fe7041564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe703fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7040711d0 0x7fe70414a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe708def700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe70415cc40 0x7fe7041569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38606/0 (socket says 172.21.15.44:38606) 2024-09-13T18:27:04.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe708def700 1 -- 172.21.15.44:0/187631200 learned_addr learned my addr 172.21.15.44:0/187631200 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:04.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe708def700 1 -- 172.21.15.44:0/187631200 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe7040ad160 msgr2=0x7fe7041564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe708def700 1 --2- 172.21.15.44:0/187631200 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe7040ad160 0x7fe7041564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe708def700 1 -- 172.21.15.44:0/187631200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7040711d0 msgr2=0x7fe70414a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe708def700 1 --2- 172.21.15.44:0/187631200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7040711d0 0x7fe70414a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe708def700 1 -- 172.21.15.44:0/187631200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f40094b0 con 0x7fe70415cc40 2024-09-13T18:27:04.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe708def700 1 --2- 172.21.15.44:0/187631200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe70415cc40 0x7fe7041569f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00cc10 tx=0x7fe6fc00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:04.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe700ff9700 1 -- 172.21.15.44:0/187631200 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc00aaa0 con 0x7fe70415cc40 2024-09-13T18:27:04.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe700ff9700 1 -- 172.21.15.44:0/187631200 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6fc00ac00 con 0x7fe70415cc40 2024-09-13T18:27:04.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe7095f0700 1 -- 172.21.15.44:0/187631200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7041591f0 con 0x7fe70415cc40 2024-09-13T18:27:04.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe700ff9700 1 -- 172.21.15.44:0/187631200 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc0070d0 con 0x7fe70415cc40 2024-09-13T18:27:04.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.447+0000 7fe7095f0700 1 -- 172.21.15.44:0/187631200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7041597b0 con 0x7fe70415cc40 2024-09-13T18:27:04.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.451+0000 7fe7095f0700 1 -- 172.21.15.44:0/187631200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7040cd110 con 0x7fe70415cc40 2024-09-13T18:27:04.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.451+0000 7fe700ff9700 1 -- 172.21.15.44:0/187631200 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe6fc007230 con 0x7fe70415cc40 2024-09-13T18:27:04.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.451+0000 7fe700ff9700 1 --2- 172.21.15.44:0/187631200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe6e4066730 0x7fe6e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.451+0000 7fe700ff9700 1 -- 172.21.15.44:0/187631200 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6fc084030 con 0x7fe70415cc40 2024-09-13T18:27:04.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.451+0000 7fe703fff700 1 --2- 172.21.15.44:0/187631200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe6e4066730 0x7fe6e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.455+0000 7fe703fff700 1 --2- 172.21.15.44:0/187631200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe6e4066730 0x7fe6e4068bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0011e0 tx=0x7fe6ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:04.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.459+0000 7fe700ff9700 1 -- 172.21.15.44:0/187631200 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe6fc0513a0 con 0x7fe70415cc40 2024-09-13T18:27:04.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.663+0000 7fe7095f0700 1 -- 172.21.15.44:0/187631200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7040cff40 con 0x7fe70415cc40 2024-09-13T18:27:04.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.663+0000 7fe700ff9700 1 -- 172.21.15.44:0/187631200 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4725 (secure 0 0 0) 0x7fe7040cff40 con 0x7fe70415cc40 2024-09-13T18:27:04.668 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:04.668 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2616086834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2616086834},{"type":"v1","addr":"172.21.15.99:6835","nonce":2616086834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/2083799524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2083799524},{"type":"v1","addr":"172.21.15.99:6837","nonce":2083799524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/369871675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":369871675},{"type":"v1","addr":"172.21.15.44:6833","nonce":369871675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:27:01.277463+0000","modified":"2024-09-13T18:27:04.292778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/1402693416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1402693416},{"type":"v1","addr":"172.21.15.44:6835","nonce":1402693416}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:27:04.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.667+0000 7fe7095f0700 1 -- 172.21.15.44:0/187631200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe6e4066730 msgr2=0x7fe6e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.667+0000 7fe7095f0700 1 --2- 172.21.15.44:0/187631200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe6e4066730 0x7fe6e4068bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0011e0 tx=0x7fe6ec009040 comp rx=0 tx=0).stop 2024-09-13T18:27:04.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.667+0000 7fe7095f0700 1 -- 172.21.15.44:0/187631200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe70415cc40 msgr2=0x7fe7041569f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.667+0000 7fe7095f0700 1 --2- 172.21.15.44:0/187631200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe70415cc40 0x7fe7041569f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00cc10 tx=0x7fe6fc00cf20 comp rx=0 tx=0).stop 2024-09-13T18:27:04.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.667+0000 7fe7095f0700 1 -- 172.21.15.44:0/187631200 shutdown_connections 2024-09-13T18:27:04.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.667+0000 7fe7095f0700 1 --2- 172.21.15.44:0/187631200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe6e4066730 0x7fe6e4068bf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.667+0000 7fe7095f0700 1 --2- 172.21.15.44:0/187631200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe70415cc40 0x7fe7041569f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.667+0000 7fe7095f0700 1 --2- 172.21.15.44:0/187631200 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe7040ad160 0x7fe7041564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.667+0000 7fe7095f0700 1 --2- 172.21.15.44:0/187631200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7040711d0 0x7fe70414a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.667+0000 7fe7095f0700 1 -- 172.21.15.44:0/187631200 >> 172.21.15.44:0/187631200 conn(0x7fe7040cf170 msgr2=0x7fe7040adce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:04.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.667+0000 7fe7095f0700 1 -- 172.21.15.44:0/187631200 shutdown_connections 2024-09-13T18:27:04.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.667+0000 7fe7095f0700 1 -- 172.21.15.44:0/187631200 wait complete. 2024-09-13T18:27:04.674 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 7 2024-09-13T18:27:04.689 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:04.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.799+0000 7f414d5e1700 1 Processor -- start 2024-09-13T18:27:04.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.799+0000 7f414d5e1700 1 -- start start 2024-09-13T18:27:04.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.799+0000 7f414d5e1700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f414806b3c0 0x7f414806b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.799+0000 7f414d5e1700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414806b200 con 0x7f41480b3440 2024-09-13T18:27:04.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.799+0000 7f414d5e1700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414806bd70 con 0x7f414815adf0 2024-09-13T18:27:04.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.799+0000 7f414d5e1700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4148071690 con 0x7f414806b3c0 2024-09-13T18:27:04.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.799+0000 7f4147fff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f41480b3440 0x7f41480b3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52524/0 (socket says 172.21.15.44:52524) 2024-09-13T18:27:04.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.799+0000 7f4147fff700 1 -- 172.21.15.44:0/3134765838 learned_addr learned my addr 172.21.15.44:0/3134765838 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:04.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.799+0000 7f41477fe700 1 --2- 172.21.15.44:0/3134765838 >> v2:172.21.15.99:3300/0 conn(0x7f414806b3c0 0x7f414806b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.799+0000 7f4146ffd700 1 -- 172.21.15.44:0/3134765838 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022008969 0 0) 0x7f414806b200 con 0x7f41480b3440 2024-09-13T18:27:04.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.799+0000 7f4146ffd700 1 -- 172.21.15.44:0/3134765838 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41300035d0 con 0x7f41480b3440 2024-09-13T18:27:04.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.799+0000 7f4146ffd700 1 -- 172.21.15.44:0/3134765838 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2386480654 0 0) 0x7f414806bd70 con 0x7f414815adf0 2024-09-13T18:27:04.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.799+0000 7f4146ffd700 1 -- 172.21.15.44:0/3134765838 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f414806b200 con 0x7f414815adf0 2024-09-13T18:27:04.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.799+0000 7f41477fe700 1 -- 172.21.15.44:0/3134765838 >> v1:172.21.15.99:6789/0 conn(0x7f414815adf0 legacy=0x7f414815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.799+0000 7f41477fe700 1 -- 172.21.15.44:0/3134765838 >> v1:172.21.15.44:6789/0 conn(0x7f41480b3440 legacy=0x7f41480b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.799+0000 7f41477fe700 1 -- 172.21.15.44:0/3134765838 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414815c000 con 0x7f414806b3c0 2024-09-13T18:27:04.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.803+0000 7f41477fe700 1 --2- 172.21.15.44:0/3134765838 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f414806b3c0 0x7f414806b830 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4138009d90 tx=0x7f413800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d50bfaa2b6bb4724 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:04.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.803+0000 7f4146ffd700 1 -- 172.21.15.44:0/3134765838 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413800e070 con 0x7f414806b3c0 2024-09-13T18:27:04.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.803+0000 7f4146ffd700 1 -- 172.21.15.44:0/3134765838 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413800bb20 con 0x7f414806b3c0 2024-09-13T18:27:04.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.803+0000 7f4146ffd700 1 -- 172.21.15.44:0/3134765838 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413800be90 con 0x7f414806b3c0 2024-09-13T18:27:04.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.803+0000 7f414d5e1700 1 -- 172.21.15.44:0/3134765838 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f414806b3c0 msgr2=0x7f414806b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.803+0000 7f414d5e1700 1 --2- 172.21.15.44:0/3134765838 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f414806b3c0 0x7f414806b830 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4138009d90 tx=0x7f413800b330 comp rx=0 tx=0).stop 2024-09-13T18:27:04.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.803+0000 7f414d5e1700 1 -- 172.21.15.44:0/3134765838 shutdown_connections 2024-09-13T18:27:04.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.803+0000 7f414d5e1700 1 --2- 172.21.15.44:0/3134765838 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f414806b3c0 0x7f414806b830 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.803+0000 7f414d5e1700 1 -- 172.21.15.44:0/3134765838 >> 172.21.15.44:0/3134765838 conn(0x7f41480b0f00 msgr2=0x7f41480b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:04.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.803+0000 7f414d5e1700 1 -- 172.21.15.44:0/3134765838 shutdown_connections 2024-09-13T18:27:04.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.803+0000 7f414d5e1700 1 -- 172.21.15.44:0/3134765838 wait complete. 2024-09-13T18:27:04.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.803+0000 7f414d5e1700 1 Processor -- start 2024-09-13T18:27:04.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.803+0000 7f414d5e1700 1 -- start start 2024-09-13T18:27:04.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f414d5e1700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f414806b3c0 0x7f4148155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f414d5e1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41480b3440 0x7f4148157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f414d5e1700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f414815adf0 0x7f41481f26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f414d5e1700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4148141540 con 0x7f41480b3440 2024-09-13T18:27:04.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f414d5e1700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4148142090 con 0x7f414806b3c0 2024-09-13T18:27:04.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f414d5e1700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4148142370 con 0x7f414815adf0 2024-09-13T18:27:04.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f41477fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41480b3440 0x7f4148157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f41477fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41480b3440 0x7f4148157c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38616/0 (socket says 172.21.15.44:38616) 2024-09-13T18:27:04.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f41477fe700 1 -- 172.21.15.44:0/1013440733 learned_addr learned my addr 172.21.15.44:0/1013440733 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:04.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f414cde0700 1 --2- 172.21.15.44:0/1013440733 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f414815adf0 0x7f41481f26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f4147fff700 1 --2- 172.21.15.44:0/1013440733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f414806b3c0 0x7f4148155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f41477fe700 1 -- 172.21.15.44:0/1013440733 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f414815adf0 msgr2=0x7f41481f26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f41477fe700 1 --2- 172.21.15.44:0/1013440733 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f414815adf0 0x7f41481f26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f41477fe700 1 -- 172.21.15.44:0/1013440733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f414806b3c0 msgr2=0x7f4148155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f41477fe700 1 --2- 172.21.15.44:0/1013440733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f414806b3c0 0x7f4148155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f41477fe700 1 -- 172.21.15.44:0/1013440733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4138009a70 con 0x7f41480b3440 2024-09-13T18:27:04.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f414cde0700 1 --2- 172.21.15.44:0/1013440733 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f414815adf0 0x7f41481f26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:04.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f4147fff700 1 --2- 172.21.15.44:0/1013440733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f414806b3c0 0x7f4148155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:04.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f41477fe700 1 --2- 172.21.15.44:0/1013440733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41480b3440 0x7f4148157c80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4138000f80 tx=0x7f4138004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:04.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f4144ff9700 1 -- 172.21.15.44:0/1013440733 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4138007000 con 0x7f41480b3440 2024-09-13T18:27:04.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f4144ff9700 1 -- 172.21.15.44:0/1013440733 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413801f070 con 0x7f41480b3440 2024-09-13T18:27:04.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f414d5e1700 1 -- 172.21.15.44:0/1013440733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4148142650 con 0x7f41480b3440 2024-09-13T18:27:04.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f4144ff9700 1 -- 172.21.15.44:0/1013440733 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4138025640 con 0x7f41480b3440 2024-09-13T18:27:04.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.807+0000 7f414d5e1700 1 -- 172.21.15.44:0/1013440733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41481429e0 con 0x7f41480b3440 2024-09-13T18:27:04.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.811+0000 7f414d5e1700 1 -- 172.21.15.44:0/1013440733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414806c010 con 0x7f41480b3440 2024-09-13T18:27:04.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.811+0000 7f4144ff9700 1 -- 172.21.15.44:0/1013440733 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f413801b3f0 con 0x7f41480b3440 2024-09-13T18:27:04.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.811+0000 7f4144ff9700 1 --2- 172.21.15.44:0/1013440733 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4134066730 0x7f4134068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.811+0000 7f4144ff9700 1 -- 172.21.15.44:0/1013440733 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4138085840 con 0x7f41480b3440 2024-09-13T18:27:04.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.811+0000 7f4147fff700 1 --2- 172.21.15.44:0/1013440733 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4134066730 0x7f4134068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.811+0000 7f4147fff700 1 --2- 172.21.15.44:0/1013440733 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4134066730 0x7f4134068bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f413c000f60 tx=0x7f413c007e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:04.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.819+0000 7f4144ff9700 1 -- 172.21.15.44:0/1013440733 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f41380566d0 con 0x7f41480b3440 2024-09-13T18:27:05.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.999+0000 7f414d5e1700 1 -- 172.21.15.44:0/1013440733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41480b1b30 con 0x7f41480b3440 2024-09-13T18:27:05.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:04.999+0000 7f4144ff9700 1 -- 172.21.15.44:0/1013440733 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f4138056260 con 0x7f41480b3440 2024-09-13T18:27:05.005 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:05.005 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:02.280221+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:05.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.003+0000 7f414d5e1700 1 -- 172.21.15.44:0/1013440733 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4134066730 msgr2=0x7f4134068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.003+0000 7f414d5e1700 1 --2- 172.21.15.44:0/1013440733 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4134066730 0x7f4134068bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f413c000f60 tx=0x7f413c007e00 comp rx=0 tx=0).stop 2024-09-13T18:27:05.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.003+0000 7f414d5e1700 1 -- 172.21.15.44:0/1013440733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41480b3440 msgr2=0x7f4148157c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.003+0000 7f414d5e1700 1 --2- 172.21.15.44:0/1013440733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41480b3440 0x7f4148157c80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4138000f80 tx=0x7f4138004af0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.003+0000 7f414d5e1700 1 -- 172.21.15.44:0/1013440733 shutdown_connections 2024-09-13T18:27:05.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.003+0000 7f414d5e1700 1 --2- 172.21.15.44:0/1013440733 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4134066730 0x7f4134068bf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.003+0000 7f414d5e1700 1 --2- 172.21.15.44:0/1013440733 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f414815adf0 0x7f41481f26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.003+0000 7f414d5e1700 1 --2- 172.21.15.44:0/1013440733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41480b3440 0x7f4148157c80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.003+0000 7f414d5e1700 1 --2- 172.21.15.44:0/1013440733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f414806b3c0 0x7f4148155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.003+0000 7f414d5e1700 1 -- 172.21.15.44:0/1013440733 >> 172.21.15.44:0/1013440733 conn(0x7f41480b0f00 msgr2=0x7f414806d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:05.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.003+0000 7f414d5e1700 1 -- 172.21.15.44:0/1013440733 shutdown_connections 2024-09-13T18:27:05.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.003+0000 7f414d5e1700 1 -- 172.21.15.44:0/1013440733 wait complete. 2024-09-13T18:27:05.020 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:27:05.021 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:27:05.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.131+0000 7f0e099e0700 1 Processor -- start 2024-09-13T18:27:05.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.131+0000 7f0e099e0700 1 -- start start 2024-09-13T18:27:05.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.131+0000 7f0e099e0700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0e040b3ae0 0x7f0e0406a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.131+0000 7f0e099e0700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0e0406aaf0 0x7f0e0415e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.131+0000 7f0e099e0700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e0413dcb0 con 0x7f0e0406bbf0 2024-09-13T18:27:05.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.131+0000 7f0e099e0700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e0415be60 con 0x7f0e040b3ae0 2024-09-13T18:27:05.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.131+0000 7f0e099e0700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0413ffd0 con 0x7f0e0406aaf0 2024-09-13T18:27:05.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.131+0000 7f0e089de700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0e0406bbf0 0x7f0e040b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52534/0 (socket says 172.21.15.44:52534) 2024-09-13T18:27:05.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.131+0000 7f0e089de700 1 -- 172.21.15.44:0/3588814297 learned_addr learned my addr 172.21.15.44:0/3588814297 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:05.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.131+0000 7f0e03fff700 1 --2- 172.21.15.44:0/3588814297 >> v2:172.21.15.99:3300/0 conn(0x7f0e040b3ae0 0x7f0e0406a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.135+0000 7f0e091df700 1 --2- 172.21.15.44:0/3588814297 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0e0406aaf0 0x7f0e0415e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.135+0000 7f0e091df700 1 -- 172.21.15.44:0/3588814297 >> v2:172.21.15.99:3300/0 conn(0x7f0e040b3ae0 msgr2=0x7f0e0406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:05.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.135+0000 7f0e091df700 1 --2- 172.21.15.44:0/3588814297 >> v2:172.21.15.99:3300/0 conn(0x7f0e040b3ae0 0x7f0e0406a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.135+0000 7f0e091df700 1 -- 172.21.15.44:0/3588814297 >> v1:172.21.15.44:6789/0 conn(0x7f0e0406bbf0 legacy=0x7f0e040b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.135+0000 7f0e091df700 1 -- 172.21.15.44:0/3588814297 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e04140220 con 0x7f0e0406aaf0 2024-09-13T18:27:05.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.135+0000 7f0e091df700 1 --2- 172.21.15.44:0/3588814297 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0e0406aaf0 0x7f0e0415e440 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc009d90 tx=0x7f0dfc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26b006d4c26161e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:05.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.135+0000 7f0e037fe700 1 -- 172.21.15.44:0/3588814297 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc00e070 con 0x7f0e0406aaf0 2024-09-13T18:27:05.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.135+0000 7f0e037fe700 1 -- 172.21.15.44:0/3588814297 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dfc00bb20 con 0x7f0e0406aaf0 2024-09-13T18:27:05.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.135+0000 7f0e037fe700 1 -- 172.21.15.44:0/3588814297 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc012430 con 0x7f0e0406aaf0 2024-09-13T18:27:05.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.135+0000 7f0e099e0700 1 -- 172.21.15.44:0/3588814297 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0e0406aaf0 msgr2=0x7f0e0415e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.135+0000 7f0e099e0700 1 --2- 172.21.15.44:0/3588814297 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0e0406aaf0 0x7f0e0415e440 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc009d90 tx=0x7f0dfc00b330 comp rx=0 tx=0).stop 2024-09-13T18:27:05.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.135+0000 7f0e099e0700 1 -- 172.21.15.44:0/3588814297 shutdown_connections 2024-09-13T18:27:05.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.135+0000 7f0e099e0700 1 --2- 172.21.15.44:0/3588814297 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0e0406aaf0 0x7f0e0415e440 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.135+0000 7f0e099e0700 1 --2- 172.21.15.44:0/3588814297 >> v2:172.21.15.99:3300/0 conn(0x7f0e040b3ae0 0x7f0e0406a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.135+0000 7f0e099e0700 1 -- 172.21.15.44:0/3588814297 >> 172.21.15.44:0/3588814297 conn(0x7f0e040b0f00 msgr2=0x7f0e040b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:05.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.135+0000 7f0e099e0700 1 -- 172.21.15.44:0/3588814297 shutdown_connections 2024-09-13T18:27:05.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.135+0000 7f0e099e0700 1 -- 172.21.15.44:0/3588814297 wait complete. 2024-09-13T18:27:05.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.139+0000 7f0e099e0700 1 Processor -- start 2024-09-13T18:27:05.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.139+0000 7f0e099e0700 1 -- start start 2024-09-13T18:27:05.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.139+0000 7f0e099e0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e0406aaf0 0x7f0e0413c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.139+0000 7f0e099e0700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0e0406bbf0 0x7f0e041551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.139+0000 7f0e099e0700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e040b3ae0 0x7f0e0413c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.139+0000 7f0e099e0700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e041f3e50 con 0x7f0e0406aaf0 2024-09-13T18:27:05.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.139+0000 7f0e099e0700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0413c800 con 0x7f0e040b3ae0 2024-09-13T18:27:05.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.139+0000 7f0e099e0700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e041585d0 con 0x7f0e0406bbf0 2024-09-13T18:27:05.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.139+0000 7f0e089de700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e0406aaf0 0x7f0e0413c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.139+0000 7f0e089de700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e0406aaf0 0x7f0e0413c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38618/0 (socket says 172.21.15.44:38618) 2024-09-13T18:27:05.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.139+0000 7f0e089de700 1 -- 172.21.15.44:0/2317666068 learned_addr learned my addr 172.21.15.44:0/2317666068 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:05.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.139+0000 7f0e03fff700 1 --2- 172.21.15.44:0/2317666068 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0e0406bbf0 0x7f0e041551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.139+0000 7f0e091df700 1 --2- 172.21.15.44:0/2317666068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e040b3ae0 0x7f0e0413c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.139+0000 7f0e03fff700 1 -- 172.21.15.44:0/2317666068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e040b3ae0 msgr2=0x7f0e0413c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.139+0000 7f0e03fff700 1 --2- 172.21.15.44:0/2317666068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e040b3ae0 0x7f0e0413c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.139+0000 7f0e03fff700 1 -- 172.21.15.44:0/2317666068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e0406aaf0 msgr2=0x7f0e0413c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.139+0000 7f0e03fff700 1 --2- 172.21.15.44:0/2317666068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e0406aaf0 0x7f0e0413c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.139+0000 7f0e03fff700 1 -- 172.21.15.44:0/2317666068 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc009a70 con 0x7f0e0406bbf0 2024-09-13T18:27:05.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.139+0000 7f0e089de700 1 --2- 172.21.15.44:0/2317666068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e0406aaf0 0x7f0e0413c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:05.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.139+0000 7f0e03fff700 1 --2- 172.21.15.44:0/2317666068 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0e0406bbf0 0x7f0e041551d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0df000e900 tx=0x7f0df000ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:05.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.143+0000 7f0e017fa700 1 -- 172.21.15.44:0/2317666068 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df0013680 con 0x7f0e0406bbf0 2024-09-13T18:27:05.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.143+0000 7f0e017fa700 1 -- 172.21.15.44:0/2317666068 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df00137e0 con 0x7f0e0406bbf0 2024-09-13T18:27:05.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.143+0000 7f0e099e0700 1 -- 172.21.15.44:0/2317666068 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e04157d30 con 0x7f0e0406bbf0 2024-09-13T18:27:05.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.143+0000 7f0e017fa700 1 -- 172.21.15.44:0/2317666068 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df0013b50 con 0x7f0e0406bbf0 2024-09-13T18:27:05.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.143+0000 7f0e099e0700 1 -- 172.21.15.44:0/2317666068 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e041582f0 con 0x7f0e0406bbf0 2024-09-13T18:27:05.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.143+0000 7f0e099e0700 1 -- 172.21.15.44:0/2317666068 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e0406af80 con 0x7f0e0406bbf0 2024-09-13T18:27:05.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.143+0000 7f0e017fa700 1 -- 172.21.15.44:0/2317666068 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0df0013cb0 con 0x7f0e0406bbf0 2024-09-13T18:27:05.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.143+0000 7f0e017fa700 1 --2- 172.21.15.44:0/2317666068 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0de8066730 0x7f0de8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.143+0000 7f0e017fa700 1 -- 172.21.15.44:0/2317666068 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0df0084480 con 0x7f0e0406bbf0 2024-09-13T18:27:05.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.143+0000 7f0e089de700 1 --2- 172.21.15.44:0/2317666068 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0de8066730 0x7f0de8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.147+0000 7f0e089de700 1 --2- 172.21.15.44:0/2317666068 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0de8066730 0x7f0de8068bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0df8005930 tx=0x7f0df8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:05.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.155+0000 7f0e017fa700 1 -- 172.21.15.44:0/2317666068 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0df0051860 con 0x7f0e0406bbf0 2024-09-13T18:27:05.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.323+0000 7f0e099e0700 1 -- 172.21.15.44:0/2317666068 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0e04140ac0 con 0x7f0de8066730 2024-09-13T18:27:05.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.335+0000 7f0e017fa700 1 -- 172.21.15.44:0/2317666068 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249663 (secure 0 0 0) 0x7f0df800fa80 con 0x7f0de8066730 2024-09-13T18:27:05.344 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:05.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.339+0000 7f0e099e0700 1 -- 172.21.15.44:0/2317666068 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0de8066730 msgr2=0x7f0de8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.339+0000 7f0e099e0700 1 --2- 172.21.15.44:0/2317666068 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0de8066730 0x7f0de8068bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0df8005930 tx=0x7f0df8009040 comp rx=0 tx=0).stop 2024-09-13T18:27:05.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.339+0000 7f0e099e0700 1 -- 172.21.15.44:0/2317666068 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0e0406bbf0 msgr2=0x7f0e041551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.339+0000 7f0e099e0700 1 --2- 172.21.15.44:0/2317666068 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0e0406bbf0 0x7f0e041551d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0df000e900 tx=0x7f0df000ec10 comp rx=0 tx=0).stop 2024-09-13T18:27:05.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.339+0000 7f0e099e0700 1 -- 172.21.15.44:0/2317666068 shutdown_connections 2024-09-13T18:27:05.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.343+0000 7f0e099e0700 1 --2- 172.21.15.44:0/2317666068 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0de8066730 0x7f0de8068bf0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.343+0000 7f0e099e0700 1 --2- 172.21.15.44:0/2317666068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e040b3ae0 0x7f0e0413c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.343+0000 7f0e099e0700 1 --2- 172.21.15.44:0/2317666068 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0e0406bbf0 0x7f0e041551d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.343+0000 7f0e099e0700 1 --2- 172.21.15.44:0/2317666068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e0406aaf0 0x7f0e0413c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.343+0000 7f0e099e0700 1 -- 172.21.15.44:0/2317666068 >> 172.21.15.44:0/2317666068 conn(0x7f0e040b0f00 msgr2=0x7f0e04070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:05.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.343+0000 7f0e099e0700 1 -- 172.21.15.44:0/2317666068 shutdown_connections 2024-09-13T18:27:05.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.343+0000 7f0e099e0700 1 -- 172.21.15.44:0/2317666068 wait complete. 2024-09-13T18:27:05.348 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:27:05.360 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-13T18:27:04.317243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":218824,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755896,"statfs":{"total":773094113280,"available":772870037504,"internally_reserved":0,"allocated":2531328,"data_stored":1583952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.436889"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":160,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T18:26:53.993997+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:26:53.993997+0000","last_peered":"2024-09-13T18:26:53.993997+0000","last_clean":"2024-09-13T18:26:53.993997+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:26:53.993997+0000","last_undegraded":"2024-09-13T18:26:53.993997+0000","last_fullsized":"2024-09-13T18:26:53.993997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":761856,"data_stored":640770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.47}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.524}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":761856,"data_stored":640770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:27:05.365 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:27:05.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f91173ff700 1 Processor -- start 2024-09-13T18:27:05.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f91173ff700 1 -- start start 2024-09-13T18:27:05.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f91173ff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f911015ac40 0x7f911006ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f91173ff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91100adba0 0x7f911015ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f91173ff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f911015b020 con 0x7f91100ad710 2024-09-13T18:27:05.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f91173ff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91100b31e0 con 0x7f911015ac40 2024-09-13T18:27:05.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f91173ff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91100b3df0 con 0x7f91100adba0 2024-09-13T18:27:05.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f911519b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f911015ac40 0x7f911006ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f911519b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f911015ac40 0x7f911006ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38634/0 (socket says 172.21.15.44:38634) 2024-09-13T18:27:05.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f911519b700 1 -- 172.21.15.44:0/981067208 learned_addr learned my addr 172.21.15.44:0/981067208 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:05.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f911599c700 1 --2- 172.21.15.44:0/981067208 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91100adba0 0x7f911015ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f911519b700 1 -- 172.21.15.44:0/981067208 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91100adba0 msgr2=0x7f911015ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:05.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f911519b700 1 --2- 172.21.15.44:0/981067208 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91100adba0 0x7f911015ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f911519b700 1 -- 172.21.15.44:0/981067208 >> v1:172.21.15.99:6789/0 conn(0x7f91100ad710 legacy=0x7f911015e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f911519b700 1 -- 172.21.15.44:0/981067208 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911006a6f0 con 0x7f911015ac40 2024-09-13T18:27:05.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f911519b700 1 --2- 172.21.15.44:0/981067208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f911015ac40 0x7f911006ad00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9104009910 tx=0x7f9104009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810ed981e79a73db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:05.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f9103fff700 1 -- 172.21.15.44:0/981067208 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9104011830 con 0x7f911015ac40 2024-09-13T18:27:05.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f9103fff700 1 -- 172.21.15.44:0/981067208 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9104011990 con 0x7f911015ac40 2024-09-13T18:27:05.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f9103fff700 1 -- 172.21.15.44:0/981067208 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9104011d40 con 0x7f911015ac40 2024-09-13T18:27:05.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f91173ff700 1 -- 172.21.15.44:0/981067208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f911015ac40 msgr2=0x7f911006ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f91173ff700 1 --2- 172.21.15.44:0/981067208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f911015ac40 0x7f911006ad00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9104009910 tx=0x7f9104009c20 comp rx=0 tx=0).stop 2024-09-13T18:27:05.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f91173ff700 1 -- 172.21.15.44:0/981067208 shutdown_connections 2024-09-13T18:27:05.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f91173ff700 1 --2- 172.21.15.44:0/981067208 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91100adba0 0x7f911015ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f91173ff700 1 --2- 172.21.15.44:0/981067208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f911015ac40 0x7f911006ad00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.479+0000 7f91173ff700 1 -- 172.21.15.44:0/981067208 >> 172.21.15.44:0/981067208 conn(0x7f91100ce980 msgr2=0x7f91100ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:05.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.483+0000 7f91173ff700 1 -- 172.21.15.44:0/981067208 shutdown_connections 2024-09-13T18:27:05.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.483+0000 7f91173ff700 1 -- 172.21.15.44:0/981067208 wait complete. 2024-09-13T18:27:05.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.483+0000 7f91173ff700 1 Processor -- start 2024-09-13T18:27:05.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.483+0000 7f91173ff700 1 -- start start 2024-09-13T18:27:05.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f91173ff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91100ad710 0x7f911014c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f91173ff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91100adba0 0x7f9110143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f91173ff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f911015ac40 0x7f91100aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f91173ff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91100ad580 con 0x7f911015ac40 2024-09-13T18:27:05.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f91173ff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911015d950 con 0x7f91100ad710 2024-09-13T18:27:05.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f91173ff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91100acfc0 con 0x7f91100adba0 2024-09-13T18:27:05.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f911599c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f911015ac40 0x7f91100aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f911519b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91100ad710 0x7f911014c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f911499a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91100adba0 0x7f9110143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f911599c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f911015ac40 0x7f91100aeb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38642/0 (socket says 172.21.15.44:38642) 2024-09-13T18:27:05.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f911519b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91100ad710 0x7f911014c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:58814/0 (socket says 172.21.15.44:58814) 2024-09-13T18:27:05.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f911599c700 1 -- 172.21.15.44:0/4285032569 learned_addr learned my addr 172.21.15.44:0/4285032569 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:05.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f911599c700 1 -- 172.21.15.44:0/4285032569 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91100adba0 msgr2=0x7f9110143b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f911599c700 1 --2- 172.21.15.44:0/4285032569 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91100adba0 0x7f9110143b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f911599c700 1 -- 172.21.15.44:0/4285032569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91100ad710 msgr2=0x7f911014c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f911599c700 1 --2- 172.21.15.44:0/4285032569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91100ad710 0x7f911014c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f911599c700 1 -- 172.21.15.44:0/4285032569 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9104009570 con 0x7f911015ac40 2024-09-13T18:27:05.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f911519b700 1 --2- 172.21.15.44:0/4285032569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91100ad710 0x7f911014c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:05.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f911499a700 1 --2- 172.21.15.44:0/4285032569 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91100adba0 0x7f9110143b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:05.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f911599c700 1 --2- 172.21.15.44:0/4285032569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f911015ac40 0x7f91100aeb90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9108009d30 tx=0x7f910800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:05.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f9101ffb700 1 -- 172.21.15.44:0/4285032569 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910800cc90 con 0x7f911015ac40 2024-09-13T18:27:05.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f9101ffb700 1 -- 172.21.15.44:0/4285032569 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910800f040 con 0x7f911015ac40 2024-09-13T18:27:05.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f91173ff700 1 -- 172.21.15.44:0/4285032569 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91100ad2a0 con 0x7f911015ac40 2024-09-13T18:27:05.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f9101ffb700 1 -- 172.21.15.44:0/4285032569 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9108009e80 con 0x7f911015ac40 2024-09-13T18:27:05.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.487+0000 7f91173ff700 1 -- 172.21.15.44:0/4285032569 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91101446a0 con 0x7f911015ac40 2024-09-13T18:27:05.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.491+0000 7f91173ff700 1 -- 172.21.15.44:0/4285032569 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f911006fcd0 con 0x7f911015ac40 2024-09-13T18:27:05.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.491+0000 7f9101ffb700 1 -- 172.21.15.44:0/4285032569 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9108014480 con 0x7f911015ac40 2024-09-13T18:27:05.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.491+0000 7f9101ffb700 1 --2- 172.21.15.44:0/4285032569 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f90f4066730 0x7f90f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.491+0000 7f9101ffb700 1 -- 172.21.15.44:0/4285032569 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9108084890 con 0x7f911015ac40 2024-09-13T18:27:05.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.491+0000 7f911519b700 1 --2- 172.21.15.44:0/4285032569 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f90f4066730 0x7f90f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.491+0000 7f911519b700 1 --2- 172.21.15.44:0/4285032569 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f90f4066730 0x7f90f4068bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9104000c00 tx=0x7f9104008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:05.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.503+0000 7f9101ffb700 1 -- 172.21.15.44:0/4285032569 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f911006fcd0 con 0x7f911015ac40 2024-09-13T18:27:05.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.667+0000 7f91173ff700 1 -- 172.21.15.44:0/4285032569 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f911006d670 con 0x7f90f4066730 2024-09-13T18:27:05.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.683+0000 7f9101ffb700 1 -- 172.21.15.44:0/4285032569 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249663 (secure 0 0 0) 0x7f9104011b80 con 0x7f90f4066730 2024-09-13T18:27:05.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:05.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.687+0000 7f91173ff700 1 -- 172.21.15.44:0/4285032569 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f90f4066730 msgr2=0x7f90f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.687+0000 7f91173ff700 1 --2- 172.21.15.44:0/4285032569 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f90f4066730 0x7f90f4068bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9104000c00 tx=0x7f9104008030 comp rx=0 tx=0).stop 2024-09-13T18:27:05.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.687+0000 7f91173ff700 1 -- 172.21.15.44:0/4285032569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f911015ac40 msgr2=0x7f91100aeb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.687+0000 7f91173ff700 1 --2- 172.21.15.44:0/4285032569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f911015ac40 0x7f91100aeb90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9108009d30 tx=0x7f910800c3a0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.687+0000 7f91173ff700 1 -- 172.21.15.44:0/4285032569 shutdown_connections 2024-09-13T18:27:05.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.687+0000 7f91173ff700 1 --2- 172.21.15.44:0/4285032569 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f90f4066730 0x7f90f4068bf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.687+0000 7f91173ff700 1 --2- 172.21.15.44:0/4285032569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f911015ac40 0x7f91100aeb90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.687+0000 7f91173ff700 1 --2- 172.21.15.44:0/4285032569 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91100adba0 0x7f9110143b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.687+0000 7f91173ff700 1 --2- 172.21.15.44:0/4285032569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91100ad710 0x7f911014c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.687+0000 7f91173ff700 1 -- 172.21.15.44:0/4285032569 >> 172.21.15.44:0/4285032569 conn(0x7f91100ce980 msgr2=0x7f91100ccdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:05.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.691+0000 7f91173ff700 1 -- 172.21.15.44:0/4285032569 shutdown_connections 2024-09-13T18:27:05.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.691+0000 7f91173ff700 1 -- 172.21.15.44:0/4285032569 wait complete. 2024-09-13T18:27:05.695 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:27:05.710 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-13T18:27:04.317243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":218824,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755896,"statfs":{"total":773094113280,"available":772870037504,"internally_reserved":0,"allocated":2531328,"data_stored":1583952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.436889"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":160,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T18:26:53.993997+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:26:53.993997+0000","last_peered":"2024-09-13T18:26:53.993997+0000","last_clean":"2024-09-13T18:26:53.993997+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:26:53.993997+0000","last_undegraded":"2024-09-13T18:26:53.993997+0000","last_fullsized":"2024-09-13T18:26:53.993997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":761856,"data_stored":640770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.47}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.524}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":761856,"data_stored":640770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:27:05.714 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:27:05.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1ee84c700 1 Processor -- start 2024-09-13T18:27:05.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1ee84c700 1 -- start start 2024-09-13T18:27:05.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1ee84c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa1e81540b0 0x7fa1e815bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1ee84c700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa1e815dd10 0x7fa1e806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1ee84c700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1e8154490 con 0x7fa1e815c090 2024-09-13T18:27:05.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1ee84c700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1e815c530 con 0x7fa1e81540b0 2024-09-13T18:27:05.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1ee84c700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1e815c810 con 0x7fa1e815dd10 2024-09-13T18:27:05.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1e7fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa1e81540b0 0x7fa1e815bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1df7fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa1e815c090 0x7fa1e815d600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52544/0 (socket says 172.21.15.44:52544) 2024-09-13T18:27:05.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1df7fe700 1 -- 172.21.15.44:0/2854496334 learned_addr learned my addr 172.21.15.44:0/2854496334 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:05.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1ecde9700 1 --2- 172.21.15.44:0/2854496334 >> v2:172.21.15.99:3300/0 conn(0x7fa1e815dd10 0x7fa1e806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1e7fff700 1 -- 172.21.15.44:0/2854496334 >> v2:172.21.15.99:3300/0 conn(0x7fa1e815dd10 msgr2=0x7fa1e806fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:05.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1e7fff700 1 --2- 172.21.15.44:0/2854496334 >> v2:172.21.15.99:3300/0 conn(0x7fa1e815dd10 0x7fa1e806fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1e7fff700 1 -- 172.21.15.44:0/2854496334 >> v1:172.21.15.44:6789/0 conn(0x7fa1e815c090 legacy=0x7fa1e815d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1e7fff700 1 -- 172.21.15.44:0/2854496334 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e815caf0 con 0x7fa1e81540b0 2024-09-13T18:27:05.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1ecde9700 1 --2- 172.21.15.44:0/2854496334 >> v2:172.21.15.99:3300/0 conn(0x7fa1e815dd10 0x7fa1e806fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:05.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1e7fff700 1 --2- 172.21.15.44:0/2854496334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1e81540b0 0x7fa1e815bb50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa1e806b270 tx=0x7fa1d8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba7479af8015e99 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:05.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1e77fe700 1 -- 172.21.15.44:0/2854496334 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8011830 con 0x7fa1e81540b0 2024-09-13T18:27:05.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1e77fe700 1 -- 172.21.15.44:0/2854496334 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d8011990 con 0x7fa1e81540b0 2024-09-13T18:27:05.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1e77fe700 1 -- 172.21.15.44:0/2854496334 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8011d40 con 0x7fa1e81540b0 2024-09-13T18:27:05.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1ee84c700 1 -- 172.21.15.44:0/2854496334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1e81540b0 msgr2=0x7fa1e815bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1ee84c700 1 --2- 172.21.15.44:0/2854496334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1e81540b0 0x7fa1e815bb50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa1e806b270 tx=0x7fa1d8009b30 comp rx=0 tx=0).stop 2024-09-13T18:27:05.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1ee84c700 1 -- 172.21.15.44:0/2854496334 shutdown_connections 2024-09-13T18:27:05.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1ee84c700 1 --2- 172.21.15.44:0/2854496334 >> v2:172.21.15.99:3300/0 conn(0x7fa1e815dd10 0x7fa1e806fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1ee84c700 1 --2- 172.21.15.44:0/2854496334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1e81540b0 0x7fa1e815bb50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1ee84c700 1 -- 172.21.15.44:0/2854496334 >> 172.21.15.44:0/2854496334 conn(0x7fa1e80ce980 msgr2=0x7fa1e80ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:05.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1ee84c700 1 -- 172.21.15.44:0/2854496334 shutdown_connections 2024-09-13T18:27:05.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.827+0000 7fa1ee84c700 1 -- 172.21.15.44:0/2854496334 wait complete. 2024-09-13T18:27:05.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.831+0000 7fa1ee84c700 1 Processor -- start 2024-09-13T18:27:05.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.831+0000 7fa1ee84c700 1 -- start start 2024-09-13T18:27:05.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.835+0000 7fa1ee84c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa1e81540b0 0x7fa1e8140a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.835+0000 7fa1ee84c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1e815c090 0x7fa1e8145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.835+0000 7fa1ee84c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1e815dd10 0x7fa1e80b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.835+0000 7fa1ee84c700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e8146d90 con 0x7fa1e815c090 2024-09-13T18:27:05.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.835+0000 7fa1ee84c700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e8140f60 con 0x7fa1e815dd10 2024-09-13T18:27:05.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.835+0000 7fa1ee84c700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e814bd20 con 0x7fa1e81540b0 2024-09-13T18:27:05.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.835+0000 7fa1df7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1e815c090 0x7fa1e8145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.835+0000 7fa1df7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1e815c090 0x7fa1e8145400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38662/0 (socket says 172.21.15.44:38662) 2024-09-13T18:27:05.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.835+0000 7fa1df7fe700 1 -- 172.21.15.44:0/3913856280 learned_addr learned my addr 172.21.15.44:0/3913856280 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:05.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.835+0000 7fa1e7fff700 1 --2- 172.21.15.44:0/3913856280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa1e81540b0 0x7fa1e8140a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.835+0000 7fa1ecde9700 1 --2- 172.21.15.44:0/3913856280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1e815dd10 0x7fa1e80b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.835+0000 7fa1df7fe700 1 -- 172.21.15.44:0/3913856280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa1e81540b0 msgr2=0x7fa1e8140a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.835+0000 7fa1df7fe700 1 --2- 172.21.15.44:0/3913856280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa1e81540b0 0x7fa1e8140a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.835+0000 7fa1df7fe700 1 -- 172.21.15.44:0/3913856280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1e815dd10 msgr2=0x7fa1e80b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.835+0000 7fa1df7fe700 1 --2- 172.21.15.44:0/3913856280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1e815dd10 0x7fa1e80b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.835+0000 7fa1df7fe700 1 -- 172.21.15.44:0/3913856280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d80094b0 con 0x7fa1e815c090 2024-09-13T18:27:05.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.835+0000 7fa1df7fe700 1 --2- 172.21.15.44:0/3913856280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1e815c090 0x7fa1e8145400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000c520 tx=0x7fa1d000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:05.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.835+0000 7fa1e57fa700 1 -- 172.21.15.44:0/3913856280 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0005d90 con 0x7fa1e815c090 2024-09-13T18:27:05.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.835+0000 7fa1e57fa700 1 -- 172.21.15.44:0/3913856280 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d00070d0 con 0x7fa1e815c090 2024-09-13T18:27:05.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.835+0000 7fa1ee84c700 1 -- 172.21.15.44:0/3913856280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e814c000 con 0x7fa1e815c090 2024-09-13T18:27:05.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.835+0000 7fa1e57fa700 1 -- 172.21.15.44:0/3913856280 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0007440 con 0x7fa1e815c090 2024-09-13T18:27:05.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.835+0000 7fa1ee84c700 1 -- 172.21.15.44:0/3913856280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e81472a0 con 0x7fa1e815c090 2024-09-13T18:27:05.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.839+0000 7fa1ee84c700 1 -- 172.21.15.44:0/3913856280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1e8147490 con 0x7fa1e815c090 2024-09-13T18:27:05.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.839+0000 7fa1e57fa700 1 -- 172.21.15.44:0/3913856280 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa1d00075a0 con 0x7fa1e815c090 2024-09-13T18:27:05.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.839+0000 7fa1e57fa700 1 --2- 172.21.15.44:0/3913856280 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa1c8066730 0x7fa1c8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.839+0000 7fa1e57fa700 1 -- 172.21.15.44:0/3913856280 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1d0083400 con 0x7fa1e815c090 2024-09-13T18:27:05.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.839+0000 7fa1e7fff700 1 --2- 172.21.15.44:0/3913856280 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa1c8066730 0x7fa1c8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.839+0000 7fa1e7fff700 1 --2- 172.21.15.44:0/3913856280 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa1c8066730 0x7fa1c8068bf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80090b0 tx=0x7fa1d8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:05.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:05.843+0000 7fa1e57fa700 1 -- 172.21.15.44:0/3913856280 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa1d0050820 con 0x7fa1e815c090 2024-09-13T18:27:05.869 INFO:tasks.ceph.mds.c.smithi044.stderr:2024-09-13T18:27:05.863+0000 7fb5f3ed5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:27:06.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.011+0000 7fa1ee84c700 1 -- 172.21.15.44:0/3913856280 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1e815d0b0 con 0x7fa1c8066730 2024-09-13T18:27:06.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.027+0000 7fa1e57fa700 1 -- 172.21.15.44:0/3913856280 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249663 (secure 0 0 0) 0x7fa1d8011c00 con 0x7fa1c8066730 2024-09-13T18:27:06.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:06.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.035+0000 7fa1ee84c700 1 -- 172.21.15.44:0/3913856280 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa1c8066730 msgr2=0x7fa1c8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.035+0000 7fa1ee84c700 1 --2- 172.21.15.44:0/3913856280 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa1c8066730 0x7fa1c8068bf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80090b0 tx=0x7fa1d8008030 comp rx=0 tx=0).stop 2024-09-13T18:27:06.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.035+0000 7fa1ee84c700 1 -- 172.21.15.44:0/3913856280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1e815c090 msgr2=0x7fa1e8145400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.035+0000 7fa1ee84c700 1 --2- 172.21.15.44:0/3913856280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1e815c090 0x7fa1e8145400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000c520 tx=0x7fa1d000c830 comp rx=0 tx=0).stop 2024-09-13T18:27:06.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.035+0000 7fa1ee84c700 1 -- 172.21.15.44:0/3913856280 shutdown_connections 2024-09-13T18:27:06.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.035+0000 7fa1ee84c700 1 --2- 172.21.15.44:0/3913856280 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa1c8066730 0x7fa1c8068bf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.035+0000 7fa1ee84c700 1 --2- 172.21.15.44:0/3913856280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1e815dd10 0x7fa1e80b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.035+0000 7fa1ee84c700 1 --2- 172.21.15.44:0/3913856280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1e815c090 0x7fa1e8145400 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.035+0000 7fa1ee84c700 1 --2- 172.21.15.44:0/3913856280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa1e81540b0 0x7fa1e8140a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.035+0000 7fa1ee84c700 1 -- 172.21.15.44:0/3913856280 >> 172.21.15.44:0/3913856280 conn(0x7fa1e80ce980 msgr2=0x7fa1e8164a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:06.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.035+0000 7fa1ee84c700 1 -- 172.21.15.44:0/3913856280 shutdown_connections 2024-09-13T18:27:06.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.035+0000 7fa1ee84c700 1 -- 172.21.15.44:0/3913856280 wait complete. 2024-09-13T18:27:06.039 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:27:06.055 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-13T18:27:04.317243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":218824,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755896,"statfs":{"total":773094113280,"available":772870037504,"internally_reserved":0,"allocated":2531328,"data_stored":1583952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.436889"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":160,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T18:26:53.993997+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:26:53.993997+0000","last_peered":"2024-09-13T18:26:53.993997+0000","last_clean":"2024-09-13T18:26:53.993997+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:26:53.993997+0000","last_undegraded":"2024-09-13T18:26:53.993997+0000","last_fullsized":"2024-09-13T18:26:53.993997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:27:00.879049+0000","last_change":"2024-09-13T18:27:00.879049+0000","last_active":"2024-09-13T18:27:00.879049+0000","last_peered":"2024-09-13T18:27:00.879049+0000","last_clean":"2024-09-13T18:27:00.879049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:27:00.879049+0000","last_undegraded":"2024-09-13T18:27:00.879049+0000","last_fullsized":"2024-09-13T18:27:00.879049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:59.869061+0000","last_change":"2024-09-13T18:26:59.869061+0000","last_active":"2024-09-13T18:26:59.869061+0000","last_peered":"2024-09-13T18:26:59.869061+0000","last_clean":"2024-09-13T18:26:59.869061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:59.869061+0000","last_undegraded":"2024-09-13T18:26:59.869061+0000","last_fullsized":"2024-09-13T18:26:59.869061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":761856,"data_stored":640770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.47}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.524}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":761856,"data_stored":640770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:27:06.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2024-09-13T18:27:06.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2024-09-13T18:27:06.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2024-09-13T18:27:06.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2024-09-13T18:27:06.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2024-09-13T18:27:06.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2024-09-13T18:27:06.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2024-09-13T18:27:06.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2024-09-13T18:27:06.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2024-09-13T18:27:06.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2024-09-13T18:27:06.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2024-09-13T18:27:06.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2024-09-13T18:27:06.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2024-09-13T18:27:06.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2024-09-13T18:27:06.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2024-09-13T18:27:06.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2024-09-13T18:27:06.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2024-09-13T18:27:06.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2024-09-13T18:27:06.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2024-09-13T18:27:06.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2024-09-13T18:27:06.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2024-09-13T18:27:06.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2024-09-13T18:27:06.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2024-09-13T18:27:06.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2024-09-13T18:27:06.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2024-09-13T18:27:06.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2024-09-13T18:27:06.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2024-09-13T18:27:06.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2024-09-13T18:27:06.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2024-09-13T18:27:06.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2024-09-13T18:27:06.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2024-09-13T18:27:06.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2024-09-13T18:27:06.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-09-13T18:27:06.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1b is not active+clean 2024-09-13T18:27:06.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-09-13T18:27:06.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2024-09-13T18:27:06.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.19 is not active+clean 2024-09-13T18:27:06.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-09-13T18:27:06.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.18 is not active+clean 2024-09-13T18:27:06.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-09-13T18:27:06.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2024-09-13T18:27:06.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-09-13T18:27:06.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.16 is not active+clean 2024-09-13T18:27:06.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-09-13T18:27:06.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.15 is not active+clean 2024-09-13T18:27:06.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-09-13T18:27:06.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2024-09-13T18:27:06.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-09-13T18:27:06.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.13 is not active+clean 2024-09-13T18:27:06.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-09-13T18:27:06.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.12 is not active+clean 2024-09-13T18:27:06.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-09-13T18:27:06.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2024-09-13T18:27:06.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-09-13T18:27:06.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.10 is not active+clean 2024-09-13T18:27:06.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-09-13T18:27:06.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.f is not active+clean 2024-09-13T18:27:06.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-09-13T18:27:06.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.e is not active+clean 2024-09-13T18:27:06.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-09-13T18:27:06.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.d is not active+clean 2024-09-13T18:27:06.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-09-13T18:27:06.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.c is not active+clean 2024-09-13T18:27:06.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-09-13T18:27:06.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.3 is not active+clean 2024-09-13T18:27:06.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-09-13T18:27:06.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2024-09-13T18:27:06.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-09-13T18:27:06.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1 is not active+clean 2024-09-13T18:27:06.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-09-13T18:27:06.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.2 is not active+clean 2024-09-13T18:27:06.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-09-13T18:27:06.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.4 is not active+clean 2024-09-13T18:27:06.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-09-13T18:27:06.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2024-09-13T18:27:06.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-09-13T18:27:06.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.6 is not active+clean 2024-09-13T18:27:06.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-09-13T18:27:06.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2024-09-13T18:27:06.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-09-13T18:27:06.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2024-09-13T18:27:06.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-09-13T18:27:06.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.9 is not active+clean 2024-09-13T18:27:06.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-09-13T18:27:06.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.a is not active+clean 2024-09-13T18:27:06.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-09-13T18:27:06.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2024-09-13T18:27:06.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-09-13T18:27:06.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-09-13T18:27:06.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2024-09-13T18:27:06.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-09-13T18:27:06.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2024-09-13T18:27:06.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-09-13T18:27:06.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1e is not active+clean 2024-09-13T18:27:06.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-09-13T18:27:06.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:27:00.879049+0000', 'last_change': '2024-09-13T18:27:00.879049+0000', 'last_active': '2024-09-13T18:27:00.879049+0000', 'last_peered': '2024-09-13T18:27:00.879049+0000', 'last_clean': '2024-09-13T18:27:00.879049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:27:00.879049+0000', 'last_undegraded': '2024-09-13T18:27:00.879049+0000', 'last_fullsized': '2024-09-13T18:27:00.879049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'last_clean_scrub_stamp': '2024-09-13T18:27:00.879049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2024-09-13T18:27:06.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:26:59.869061+0000', 'last_change': '2024-09-13T18:26:59.869061+0000', 'last_active': '2024-09-13T18:26:59.869061+0000', 'last_peered': '2024-09-13T18:26:59.869061+0000', 'last_clean': '2024-09-13T18:26:59.869061+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:26:59.869061+0000', 'last_undegraded': '2024-09-13T18:26:59.869061+0000', 'last_fullsized': '2024-09-13T18:26:59.869061+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'last_clean_scrub_stamp': '2024-09-13T18:26:59.869061+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:27:06.076 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:27:06.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.187+0000 7f652a809700 1 Processor -- start 2024-09-13T18:27:06.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.187+0000 7f652a809700 1 -- start start 2024-09-13T18:27:06.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.191+0000 7f652a809700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f65240ae6c0 0x7f65240b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.191+0000 7f652a809700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65240b4360 con 0x7f65240722c0 2024-09-13T18:27:06.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.191+0000 7f652a809700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65240b4640 con 0x7f6524160d90 2024-09-13T18:27:06.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.191+0000 7f652a809700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65240b29a0 con 0x7f65240ae6c0 2024-09-13T18:27:06.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.191+0000 7f652a008700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f65240ae6c0 0x7f65240b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.191+0000 7f6529006700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f65240722c0 0x7f6524161170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52546/0 (socket says 172.21.15.44:52546) 2024-09-13T18:27:06.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.191+0000 7f6529006700 1 -- 172.21.15.44:0/3403755024 learned_addr learned my addr 172.21.15.44:0/3403755024 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:06.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.191+0000 7f652a008700 1 -- 172.21.15.44:0/3403755024 >> v1:172.21.15.99:6789/0 conn(0x7f6524160d90 legacy=0x7f6524071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.191+0000 7f652a008700 1 -- 172.21.15.44:0/3403755024 >> v1:172.21.15.44:6789/0 conn(0x7f65240722c0 legacy=0x7f6524161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.191+0000 7f652a008700 1 -- 172.21.15.44:0/3403755024 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65240b2bb0 con 0x7f65240ae6c0 2024-09-13T18:27:06.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.191+0000 7f6528805700 1 -- 172.21.15.44:0/3403755024 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006302913 0 0) 0x7f65240b4360 con 0x7f65240722c0 2024-09-13T18:27:06.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.191+0000 7f652a008700 1 --2- 172.21.15.44:0/3403755024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65240ae6c0 0x7f65240b3690 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f651c009850 tx=0x7f651c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa52d39f3e3f9d83 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:06.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.191+0000 7f6528805700 1 -- 172.21.15.44:0/3403755024 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c011830 con 0x7f65240ae6c0 2024-09-13T18:27:06.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.191+0000 7f6528805700 1 -- 172.21.15.44:0/3403755024 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651c011990 con 0x7f65240ae6c0 2024-09-13T18:27:06.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.191+0000 7f6528805700 1 -- 172.21.15.44:0/3403755024 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c011d20 con 0x7f65240ae6c0 2024-09-13T18:27:06.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.191+0000 7f652a809700 1 -- 172.21.15.44:0/3403755024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65240ae6c0 msgr2=0x7f65240b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.191+0000 7f652a809700 1 --2- 172.21.15.44:0/3403755024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65240ae6c0 0x7f65240b3690 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f651c009850 tx=0x7f651c009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:06.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.191+0000 7f652a809700 1 -- 172.21.15.44:0/3403755024 shutdown_connections 2024-09-13T18:27:06.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.191+0000 7f652a809700 1 --2- 172.21.15.44:0/3403755024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65240ae6c0 0x7f65240b3690 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.191+0000 7f652a809700 1 -- 172.21.15.44:0/3403755024 >> 172.21.15.44:0/3403755024 conn(0x7f65240cf910 msgr2=0x7f65240cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:06.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.191+0000 7f652a809700 1 -- 172.21.15.44:0/3403755024 shutdown_connections 2024-09-13T18:27:06.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.191+0000 7f652a809700 1 -- 172.21.15.44:0/3403755024 wait complete. 2024-09-13T18:27:06.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.195+0000 7f652a809700 1 Processor -- start 2024-09-13T18:27:06.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.195+0000 7f652a809700 1 -- start start 2024-09-13T18:27:06.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.195+0000 7f652a809700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65240722c0 0x7f6524150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.195+0000 7f652a809700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65240ae6c0 0x7f6524163bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.195+0000 7f652a809700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6524160d90 0x7f65241fae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.195+0000 7f652a809700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6524151980 con 0x7f6524160d90 2024-09-13T18:27:06.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.195+0000 7f652a809700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65241513c0 con 0x7f65240ae6c0 2024-09-13T18:27:06.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.195+0000 7f652a809700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65241516a0 con 0x7f65240722c0 2024-09-13T18:27:06.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.195+0000 7f652a008700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6524160d90 0x7f65241fae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.195+0000 7f652a008700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6524160d90 0x7f65241fae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38672/0 (socket says 172.21.15.44:38672) 2024-09-13T18:27:06.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.195+0000 7f652a008700 1 -- 172.21.15.44:0/1154574135 learned_addr learned my addr 172.21.15.44:0/1154574135 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:06.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.195+0000 7f6529006700 1 --2- 172.21.15.44:0/1154574135 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65240ae6c0 0x7f6524163bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.199+0000 7f6529807700 1 --2- 172.21.15.44:0/1154574135 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65240722c0 0x7f6524150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.199+0000 7f652a008700 1 -- 172.21.15.44:0/1154574135 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65240722c0 msgr2=0x7f6524150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.199+0000 7f652a008700 1 --2- 172.21.15.44:0/1154574135 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65240722c0 0x7f6524150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.199+0000 7f652a008700 1 -- 172.21.15.44:0/1154574135 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65240ae6c0 msgr2=0x7f6524163bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.199+0000 7f652a008700 1 --2- 172.21.15.44:0/1154574135 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65240ae6c0 0x7f6524163bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.199+0000 7f652a008700 1 -- 172.21.15.44:0/1154574135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651c0094b0 con 0x7f6524160d90 2024-09-13T18:27:06.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.199+0000 7f652a008700 1 --2- 172.21.15.44:0/1154574135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6524160d90 0x7f65241fae50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f651c009ba0 tx=0x7f651c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:06.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.199+0000 7f651a7fc700 1 -- 172.21.15.44:0/1154574135 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c004400 con 0x7f6524160d90 2024-09-13T18:27:06.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.199+0000 7f651a7fc700 1 -- 172.21.15.44:0/1154574135 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651c01f070 con 0x7f6524160d90 2024-09-13T18:27:06.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.199+0000 7f652a809700 1 -- 172.21.15.44:0/1154574135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65241fa670 con 0x7f6524160d90 2024-09-13T18:27:06.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.199+0000 7f651a7fc700 1 -- 172.21.15.44:0/1154574135 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c0036c0 con 0x7f6524160d90 2024-09-13T18:27:06.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.199+0000 7f652a809700 1 -- 172.21.15.44:0/1154574135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65241fb390 con 0x7f6524160d90 2024-09-13T18:27:06.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.199+0000 7f652a809700 1 -- 172.21.15.44:0/1154574135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f652415fe00 con 0x7f6524160d90 2024-09-13T18:27:06.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.203+0000 7f651a7fc700 1 -- 172.21.15.44:0/1154574135 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f651c021030 con 0x7f6524160d90 2024-09-13T18:27:06.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.203+0000 7f651a7fc700 1 --2- 172.21.15.44:0/1154574135 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6510066730 0x7f6510068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.203+0000 7f651a7fc700 1 -- 172.21.15.44:0/1154574135 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f651c0854a0 con 0x7f6524160d90 2024-09-13T18:27:06.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.203+0000 7f6529807700 1 --2- 172.21.15.44:0/1154574135 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6510066730 0x7f6510068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.203+0000 7f6529807700 1 --2- 172.21.15.44:0/1154574135 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6510066730 0x7f6510068bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6514000f60 tx=0x7f6514009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:06.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.211+0000 7f651a7fc700 1 -- 172.21.15.44:0/1154574135 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f651c052820 con 0x7f6524160d90 2024-09-13T18:27:06.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.443+0000 7f652a809700 1 -- 172.21.15.44:0/1154574135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f65240b3690 con 0x7f6524160d90 2024-09-13T18:27:06.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.443+0000 7f651a7fc700 1 -- 172.21.15.44:0/1154574135 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1020 (secure 0 0 0) 0x7f651c055e40 con 0x7f6524160d90 2024-09-13T18:27:06.449 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:06.449 INFO:teuthology.orchestra.run.smithi044.stdout:{"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1726252008,"num_in_osds":8,"osd_in_since":1726251999,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":224075776,"bytes_avail":772870037504,"bytes_total":773094113280,"unknown_pgs_ratio":0.98969072103500366},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":4278}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-13T18:26:37.030163+0000","services":{}},"progress_events":{}} 2024-09-13T18:27:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.447+0000 7f652a809700 1 -- 172.21.15.44:0/1154574135 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6510066730 msgr2=0x7f6510068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.447+0000 7f652a809700 1 --2- 172.21.15.44:0/1154574135 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6510066730 0x7f6510068bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6514000f60 tx=0x7f6514009040 comp rx=0 tx=0).stop 2024-09-13T18:27:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.447+0000 7f652a809700 1 -- 172.21.15.44:0/1154574135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6524160d90 msgr2=0x7f65241fae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.447+0000 7f652a809700 1 --2- 172.21.15.44:0/1154574135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6524160d90 0x7f65241fae50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f651c009ba0 tx=0x7f651c004770 comp rx=0 tx=0).stop 2024-09-13T18:27:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.447+0000 7f652a809700 1 -- 172.21.15.44:0/1154574135 shutdown_connections 2024-09-13T18:27:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.447+0000 7f652a809700 1 --2- 172.21.15.44:0/1154574135 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6510066730 0x7f6510068bf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.447+0000 7f652a809700 1 --2- 172.21.15.44:0/1154574135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6524160d90 0x7f65241fae50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.447+0000 7f652a809700 1 --2- 172.21.15.44:0/1154574135 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65240ae6c0 0x7f6524163bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.447+0000 7f652a809700 1 --2- 172.21.15.44:0/1154574135 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65240722c0 0x7f6524150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.447+0000 7f652a809700 1 -- 172.21.15.44:0/1154574135 >> 172.21.15.44:0/1154574135 conn(0x7f65240cf910 msgr2=0x7f652415f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.447+0000 7f652a809700 1 -- 172.21.15.44:0/1154574135 shutdown_connections 2024-09-13T18:27:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.447+0000 7f652a809700 1 -- 172.21.15.44:0/1154574135 wait complete. 2024-09-13T18:27:06.464 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T18:27:06.464 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:27:06.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f5988b96700 1 Processor -- start 2024-09-13T18:27:06.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f5988b96700 1 -- start start 2024-09-13T18:27:06.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f5988b96700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5984165590 0x7f59841619a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f5988b96700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5984071f30 con 0x7f5984160eb0 2024-09-13T18:27:06.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f5988b96700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59841622e0 con 0x7f59840b3ae0 2024-09-13T18:27:06.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f5988b96700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5984162000 con 0x7f5984165590 2024-09-13T18:27:06.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f59837fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5984160eb0 0x7f59840b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52554/0 (socket says 172.21.15.44:52554) 2024-09-13T18:27:06.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f59837fe700 1 -- 172.21.15.44:0/1388935115 learned_addr learned my addr 172.21.15.44:0/1388935115 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:06.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f5983fff700 1 --2- 172.21.15.44:0/1388935115 >> v2:172.21.15.99:3300/0 conn(0x7f5984165590 0x7f59841619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f59827fc700 1 -- 172.21.15.44:0/1388935115 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 337178106 0 0) 0x7f5984071f30 con 0x7f5984160eb0 2024-09-13T18:27:06.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f59827fc700 1 -- 172.21.15.44:0/1388935115 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59640035d0 con 0x7f5984160eb0 2024-09-13T18:27:06.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f59827fc700 1 -- 172.21.15.44:0/1388935115 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285462540 0 0) 0x7f59841622e0 con 0x7f59840b3ae0 2024-09-13T18:27:06.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f59827fc700 1 -- 172.21.15.44:0/1388935115 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5984071f30 con 0x7f59840b3ae0 2024-09-13T18:27:06.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f59827fc700 1 -- 172.21.15.44:0/1388935115 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3627283529 0 0) 0x7f59640035d0 con 0x7f5984160eb0 2024-09-13T18:27:06.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f59827fc700 1 -- 172.21.15.44:0/1388935115 >> v2:172.21.15.99:3300/0 conn(0x7f5984165590 msgr2=0x7f59841619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:06.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f59827fc700 1 --2- 172.21.15.44:0/1388935115 >> v2:172.21.15.99:3300/0 conn(0x7f5984165590 0x7f59841619a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f59827fc700 1 -- 172.21.15.44:0/1388935115 >> v1:172.21.15.99:6789/0 conn(0x7f59840b3ae0 legacy=0x7f5984161290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f59827fc700 1 -- 172.21.15.44:0/1388935115 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5984164ab0 con 0x7f5984160eb0 2024-09-13T18:27:06.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f59827fc700 1 -- 172.21.15.44:0/1388935115 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f596c001670 con 0x7f5984160eb0 2024-09-13T18:27:06.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f59827fc700 1 -- 172.21.15.44:0/1388935115 >> v1:172.21.15.44:6789/0 conn(0x7f5984160eb0 legacy=0x7f59840b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f59827fc700 1 --2- 172.21.15.44:0/1388935115 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5964003bb0 0x7f5964003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f59827fc700 1 --2- 172.21.15.44:0/1388935115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5964004870 0x7f5964004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f59827fc700 1 --2- 172.21.15.44:0/1388935115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5964005230 0x7f596400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f59827fc700 1 -- 172.21.15.44:0/1388935115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5984162000 con 0x7f5964005230 2024-09-13T18:27:06.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f59827fc700 1 -- 172.21.15.44:0/1388935115 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596400c0b0 con 0x7f5964004870 2024-09-13T18:27:06.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f59827fc700 1 -- 172.21.15.44:0/1388935115 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596400c270 con 0x7f5964003bb0 2024-09-13T18:27:06.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f5983fff700 1 --2- 172.21.15.44:0/1388935115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5964005230 0x7f596400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f5982ffd700 1 --2- 172.21.15.44:0/1388935115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5964004870 0x7f5964004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f59837fe700 1 --2- 172.21.15.44:0/1388935115 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5964003bb0 0x7f5964003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f5983fff700 1 -- 172.21.15.44:0/1388935115 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5964003bb0 msgr2=0x7f5964003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:06.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.575+0000 7f5983fff700 1 --2- 172.21.15.44:0/1388935115 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5964003bb0 0x7f5964003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.579+0000 7f5983fff700 1 -- 172.21.15.44:0/1388935115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5964004870 msgr2=0x7f5964004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:06.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.579+0000 7f5983fff700 1 --2- 172.21.15.44:0/1388935115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5964004870 0x7f5964004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.579+0000 7f5983fff700 1 -- 172.21.15.44:0/1388935115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59640035d0 con 0x7f5964005230 2024-09-13T18:27:06.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.579+0000 7f59837fe700 1 --2- 172.21.15.44:0/1388935115 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5964003bb0 0x7f5964003fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:06.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.579+0000 7f5983fff700 1 -- 172.21.15.44:0/1388935115 reap_dead start 2024-09-13T18:27:06.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.579+0000 7f5983fff700 1 --2- 172.21.15.44:0/1388935115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5964005230 0x7f596400ba30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5974009b70 tx=0x7f59640058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce19bf51c05b65f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:06.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.579+0000 7f59827fc700 1 -- 172.21.15.44:0/1388935115 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5974004020 con 0x7f5964005230 2024-09-13T18:27:06.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.579+0000 7f59827fc700 1 -- 172.21.15.44:0/1388935115 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5974004180 con 0x7f5964005230 2024-09-13T18:27:06.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.579+0000 7f59827fc700 1 -- 172.21.15.44:0/1388935115 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59740044f0 con 0x7f5964005230 2024-09-13T18:27:06.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.579+0000 7f5988b96700 1 -- 172.21.15.44:0/1388935115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5964005230 msgr2=0x7f596400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.579+0000 7f5988b96700 1 --2- 172.21.15.44:0/1388935115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5964005230 0x7f596400ba30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5974009b70 tx=0x7f59640058a0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.579+0000 7f5988b96700 1 -- 172.21.15.44:0/1388935115 shutdown_connections 2024-09-13T18:27:06.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.579+0000 7f5988b96700 1 --2- 172.21.15.44:0/1388935115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5964005230 0x7f596400ba30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.579+0000 7f5988b96700 1 -- 172.21.15.44:0/1388935115 >> 172.21.15.44:0/1388935115 conn(0x7f59840b0f00 msgr2=0x7f59840b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:06.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.579+0000 7f5988b96700 1 -- 172.21.15.44:0/1388935115 shutdown_connections 2024-09-13T18:27:06.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.579+0000 7f5988b96700 1 -- 172.21.15.44:0/1388935115 wait complete. 2024-09-13T18:27:06.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.579+0000 7f5988b96700 1 Processor -- start 2024-09-13T18:27:06.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.579+0000 7f5988b96700 1 -- start start 2024-09-13T18:27:06.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.583+0000 7f5988b96700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5964005230 0x7f5984145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.583+0000 7f5988b96700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5984158420 0x7f5984159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.583+0000 7f5988b96700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5984144ad0 0x7f598415acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.583+0000 7f5988b96700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5984159c10 con 0x7f5984144ad0 2024-09-13T18:27:06.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.583+0000 7f5988b96700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5984159ef0 con 0x7f5964005230 2024-09-13T18:27:06.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.583+0000 7f5988b96700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598415a1d0 con 0x7f5984158420 2024-09-13T18:27:06.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.583+0000 7f59837fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5964005230 0x7f5984145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.583+0000 7f5982ffd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5984158420 0x7f5984159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.583+0000 7f59837fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5964005230 0x7f5984145390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:58868/0 (socket says 172.21.15.44:58868) 2024-09-13T18:27:06.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.583+0000 7f59837fe700 1 -- 172.21.15.44:0/1794504314 learned_addr learned my addr 172.21.15.44:0/1794504314 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:06.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.583+0000 7f5983fff700 1 --2- 172.21.15.44:0/1794504314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5984144ad0 0x7f598415acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.583+0000 7f5983fff700 1 -- 172.21.15.44:0/1794504314 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5984158420 msgr2=0x7f5984159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.583+0000 7f5983fff700 1 --2- 172.21.15.44:0/1794504314 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5984158420 0x7f5984159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.583+0000 7f5983fff700 1 -- 172.21.15.44:0/1794504314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5964005230 msgr2=0x7f5984145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.583+0000 7f5983fff700 1 --2- 172.21.15.44:0/1794504314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5964005230 0x7f5984145390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.583+0000 7f5983fff700 1 -- 172.21.15.44:0/1794504314 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598415a4b0 con 0x7f5984144ad0 2024-09-13T18:27:06.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.583+0000 7f59837fe700 1 --2- 172.21.15.44:0/1794504314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5964005230 0x7f5984145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:06.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.583+0000 7f5983fff700 1 --2- 172.21.15.44:0/1794504314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5984144ad0 0x7f598415acb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5984165970 tx=0x7f59740047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:06.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.583+0000 7f597bfff700 1 -- 172.21.15.44:0/1794504314 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59740038c0 con 0x7f5984144ad0 2024-09-13T18:27:06.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.583+0000 7f597bfff700 1 -- 172.21.15.44:0/1794504314 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5974003a40 con 0x7f5984144ad0 2024-09-13T18:27:06.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.583+0000 7f5988b96700 1 -- 172.21.15.44:0/1794504314 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f598415a790 con 0x7f5984144ad0 2024-09-13T18:27:06.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.583+0000 7f597bfff700 1 -- 172.21.15.44:0/1794504314 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5974003df0 con 0x7f5984144ad0 2024-09-13T18:27:06.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.583+0000 7f5988b96700 1 -- 172.21.15.44:0/1794504314 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5984144f50 con 0x7f5984144ad0 2024-09-13T18:27:06.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.587+0000 7f5988b96700 1 -- 172.21.15.44:0/1794504314 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5984161290 con 0x7f5984144ad0 2024-09-13T18:27:06.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.587+0000 7f597bfff700 1 -- 172.21.15.44:0/1794504314 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5974013470 con 0x7f5984144ad0 2024-09-13T18:27:06.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.587+0000 7f597bfff700 1 --2- 172.21.15.44:0/1794504314 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5968066760 0x7f5968068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.587+0000 7f597bfff700 1 -- 172.21.15.44:0/1794504314 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5974084ab0 con 0x7f5984144ad0 2024-09-13T18:27:06.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.587+0000 7f59837fe700 1 --2- 172.21.15.44:0/1794504314 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5968066760 0x7f5968068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.587+0000 7f59837fe700 1 --2- 172.21.15.44:0/1794504314 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5968066760 0x7f5968068c20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f596c000c00 tx=0x7f596c007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:06.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.595+0000 7f597bfff700 1 -- 172.21.15.44:0/1794504314 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5974051f30 con 0x7f5984144ad0 2024-09-13T18:27:06.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.763+0000 7f5988b96700 1 -- 172.21.15.44:0/1794504314 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f598415a060 con 0x7f5968066760 2024-09-13T18:27:06.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.775+0000 7f597bfff700 1 -- 172.21.15.44:0/1794504314 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264552 (secure 0 0 0) 0x7f598415a060 con 0x7f5968066760 2024-09-13T18:27:06.784 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:06.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.779+0000 7f5988b96700 1 -- 172.21.15.44:0/1794504314 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5968066760 msgr2=0x7f5968068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.779+0000 7f5988b96700 1 --2- 172.21.15.44:0/1794504314 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5968066760 0x7f5968068c20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f596c000c00 tx=0x7f596c007040 comp rx=0 tx=0).stop 2024-09-13T18:27:06.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.779+0000 7f5988b96700 1 -- 172.21.15.44:0/1794504314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5984144ad0 msgr2=0x7f598415acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.779+0000 7f5988b96700 1 --2- 172.21.15.44:0/1794504314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5984144ad0 0x7f598415acb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5984165970 tx=0x7f59740047e0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.779+0000 7f5988b96700 1 -- 172.21.15.44:0/1794504314 shutdown_connections 2024-09-13T18:27:06.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.779+0000 7f5988b96700 1 --2- 172.21.15.44:0/1794504314 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5968066760 0x7f5968068c20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.779+0000 7f5988b96700 1 --2- 172.21.15.44:0/1794504314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5984144ad0 0x7f598415acb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.779+0000 7f5988b96700 1 --2- 172.21.15.44:0/1794504314 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5984158420 0x7f5984159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.779+0000 7f5988b96700 1 --2- 172.21.15.44:0/1794504314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5964005230 0x7f5984145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.779+0000 7f5988b96700 1 -- 172.21.15.44:0/1794504314 >> 172.21.15.44:0/1794504314 conn(0x7f59840b0f00 msgr2=0x7f59840b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:06.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.779+0000 7f5988b96700 1 -- 172.21.15.44:0/1794504314 shutdown_connections 2024-09-13T18:27:06.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:06.779+0000 7f5988b96700 1 -- 172.21.15.44:0/1794504314 wait complete. 2024-09-13T18:27:06.787 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:27:06.798 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-13T18:27:06.317841+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219096,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755624,"statfs":{"total":773094113280,"available":772869758976,"internally_reserved":0,"allocated":2990080,"data_stored":1790012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001562"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563137+0000","last_change":"2024-09-13T18:27:01.305887+0000","last_active":"2024-09-13T18:27:02.563137+0000","last_peered":"2024-09-13T18:27:02.563137+0000","last_clean":"2024-09-13T18:27:02.563137+0000","last_became_active":"2024-09-13T18:27:01.305625+0000","last_became_peered":"2024-09-13T18:27:01.305625+0000","last_unstale":"2024-09-13T18:27:02.563137+0000","last_undegraded":"2024-09-13T18:27:02.563137+0000","last_fullsized":"2024-09-13T18:27:02.563137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:07.409290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288134+0000","last_change":"2024-09-13T18:27:01.304009+0000","last_active":"2024-09-13T18:27:02.288134+0000","last_peered":"2024-09-13T18:27:02.288134+0000","last_clean":"2024-09-13T18:27:02.288134+0000","last_became_active":"2024-09-13T18:27:01.303652+0000","last_became_peered":"2024-09-13T18:27:01.303652+0000","last_unstale":"2024-09-13T18:27:02.288134+0000","last_undegraded":"2024-09-13T18:27:02.288134+0000","last_fullsized":"2024-09-13T18:27:02.288134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562791+0000","last_change":"2024-09-13T18:27:01.306439+0000","last_active":"2024-09-13T18:27:02.562791+0000","last_peered":"2024-09-13T18:27:02.562791+0000","last_clean":"2024-09-13T18:27:02.562791+0000","last_became_active":"2024-09-13T18:27:01.306181+0000","last_became_peered":"2024-09-13T18:27:01.306181+0000","last_unstale":"2024-09-13T18:27:02.562791+0000","last_undegraded":"2024-09-13T18:27:02.562791+0000","last_fullsized":"2024-09-13T18:27:02.562791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:25.136745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286635+0000","last_change":"2024-09-13T18:27:01.303323+0000","last_active":"2024-09-13T18:27:02.286635+0000","last_peered":"2024-09-13T18:27:02.286635+0000","last_clean":"2024-09-13T18:27:02.286635+0000","last_became_active":"2024-09-13T18:27:01.302581+0000","last_became_peered":"2024-09-13T18:27:01.302581+0000","last_unstale":"2024-09-13T18:27:02.286635+0000","last_undegraded":"2024-09-13T18:27:02.286635+0000","last_fullsized":"2024-09-13T18:27:02.286635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:38.650324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561988+0000","last_change":"2024-09-13T18:27:01.300462+0000","last_active":"2024-09-13T18:27:02.561988+0000","last_peered":"2024-09-13T18:27:02.561988+0000","last_clean":"2024-09-13T18:27:02.561988+0000","last_became_active":"2024-09-13T18:27:01.300188+0000","last_became_peered":"2024-09-13T18:27:01.300188+0000","last_unstale":"2024-09-13T18:27:02.561988+0000","last_undegraded":"2024-09-13T18:27:02.561988+0000","last_fullsized":"2024-09-13T18:27:02.561988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:40.378467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286541+0000","last_change":"2024-09-13T18:27:01.299781+0000","last_active":"2024-09-13T18:27:02.286541+0000","last_peered":"2024-09-13T18:27:02.286541+0000","last_clean":"2024-09-13T18:27:02.286541+0000","last_became_active":"2024-09-13T18:27:01.299516+0000","last_became_peered":"2024-09-13T18:27:01.299516+0000","last_unstale":"2024-09-13T18:27:02.286541+0000","last_undegraded":"2024-09-13T18:27:02.286541+0000","last_fullsized":"2024-09-13T18:27:02.286541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:07.409290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.560812+0000","last_change":"2024-09-13T18:27:01.305664+0000","last_active":"2024-09-13T18:27:02.560812+0000","last_peered":"2024-09-13T18:27:02.560812+0000","last_clean":"2024-09-13T18:27:02.560812+0000","last_became_active":"2024-09-13T18:27:01.305343+0000","last_became_peered":"2024-09-13T18:27:01.305343+0000","last_unstale":"2024-09-13T18:27:02.560812+0000","last_undegraded":"2024-09-13T18:27:02.560812+0000","last_fullsized":"2024-09-13T18:27:02.560812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:40.223464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288405+0000","last_change":"2024-09-13T18:27:01.301564+0000","last_active":"2024-09-13T18:27:02.288405+0000","last_peered":"2024-09-13T18:27:02.288405+0000","last_clean":"2024-09-13T18:27:02.288405+0000","last_became_active":"2024-09-13T18:27:01.301286+0000","last_became_peered":"2024-09-13T18:27:01.301286+0000","last_unstale":"2024-09-13T18:27:02.288405+0000","last_undegraded":"2024-09-13T18:27:02.288405+0000","last_fullsized":"2024-09-13T18:27:02.288405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:40.223464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563309+0000","last_change":"2024-09-13T18:27:01.308981+0000","last_active":"2024-09-13T18:27:02.563309+0000","last_peered":"2024-09-13T18:27:02.563309+0000","last_clean":"2024-09-13T18:27:02.563309+0000","last_became_active":"2024-09-13T18:27:01.308748+0000","last_became_peered":"2024-09-13T18:27:01.308748+0000","last_unstale":"2024-09-13T18:27:02.563309+0000","last_undegraded":"2024-09-13T18:27:02.563309+0000","last_fullsized":"2024-09-13T18:27:02.563309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:08.287280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562011+0000","last_change":"2024-09-13T18:27:01.299859+0000","last_active":"2024-09-13T18:27:02.562011+0000","last_peered":"2024-09-13T18:27:02.562011+0000","last_clean":"2024-09-13T18:27:02.562011+0000","last_became_active":"2024-09-13T18:27:01.299580+0000","last_became_peered":"2024-09-13T18:27:01.299580+0000","last_unstale":"2024-09-13T18:27:02.562011+0000","last_undegraded":"2024-09-13T18:27:02.562011+0000","last_fullsized":"2024-09-13T18:27:02.562011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562374+0000","last_change":"2024-09-13T18:27:01.299858+0000","last_active":"2024-09-13T18:27:02.562374+0000","last_peered":"2024-09-13T18:27:02.562374+0000","last_clean":"2024-09-13T18:27:02.562374+0000","last_became_active":"2024-09-13T18:27:01.299507+0000","last_became_peered":"2024-09-13T18:27:01.299507+0000","last_unstale":"2024-09-13T18:27:02.562374+0000","last_undegraded":"2024-09-13T18:27:02.562374+0000","last_fullsized":"2024-09-13T18:27:02.562374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:32.698886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562231+0000","last_change":"2024-09-13T18:27:01.308216+0000","last_active":"2024-09-13T18:27:02.562231+0000","last_peered":"2024-09-13T18:27:02.562231+0000","last_clean":"2024-09-13T18:27:02.562231+0000","last_became_active":"2024-09-13T18:27:01.307955+0000","last_became_peered":"2024-09-13T18:27:01.307955+0000","last_unstale":"2024-09-13T18:27:02.562231+0000","last_undegraded":"2024-09-13T18:27:02.562231+0000","last_fullsized":"2024-09-13T18:27:02.562231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:17.243480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289436+0000","last_change":"2024-09-13T18:27:01.299496+0000","last_active":"2024-09-13T18:27:02.289436+0000","last_peered":"2024-09-13T18:27:02.289436+0000","last_clean":"2024-09-13T18:27:02.289436+0000","last_became_active":"2024-09-13T18:27:01.299251+0000","last_became_peered":"2024-09-13T18:27:01.299251+0000","last_unstale":"2024-09-13T18:27:02.289436+0000","last_undegraded":"2024-09-13T18:27:02.289436+0000","last_fullsized":"2024-09-13T18:27:02.289436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562502+0000","last_change":"2024-09-13T18:27:01.305015+0000","last_active":"2024-09-13T18:27:02.562502+0000","last_peered":"2024-09-13T18:27:02.562502+0000","last_clean":"2024-09-13T18:27:02.562502+0000","last_became_active":"2024-09-13T18:27:01.304762+0000","last_became_peered":"2024-09-13T18:27:01.304762+0000","last_unstale":"2024-09-13T18:27:02.562502+0000","last_undegraded":"2024-09-13T18:27:02.562502+0000","last_fullsized":"2024-09-13T18:27:02.562502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:39.455167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287647+0000","last_change":"2024-09-13T18:27:01.304368+0000","last_active":"2024-09-13T18:27:02.287647+0000","last_peered":"2024-09-13T18:27:02.287647+0000","last_clean":"2024-09-13T18:27:02.287647+0000","last_became_active":"2024-09-13T18:27:01.304126+0000","last_became_peered":"2024-09-13T18:27:01.304126+0000","last_unstale":"2024-09-13T18:27:02.287647+0000","last_undegraded":"2024-09-13T18:27:02.287647+0000","last_fullsized":"2024-09-13T18:27:02.287647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:36.752876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286091+0000","last_change":"2024-09-13T18:27:01.305236+0000","last_active":"2024-09-13T18:27:02.286091+0000","last_peered":"2024-09-13T18:27:02.286091+0000","last_clean":"2024-09-13T18:27:02.286091+0000","last_became_active":"2024-09-13T18:27:01.302486+0000","last_became_peered":"2024-09-13T18:27:01.302486+0000","last_unstale":"2024-09-13T18:27:02.286091+0000","last_undegraded":"2024-09-13T18:27:02.286091+0000","last_fullsized":"2024-09-13T18:27:02.286091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:08.287280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288208+0000","last_change":"2024-09-13T18:27:01.301131+0000","last_active":"2024-09-13T18:27:02.288208+0000","last_peered":"2024-09-13T18:27:02.288208+0000","last_clean":"2024-09-13T18:27:02.288208+0000","last_became_active":"2024-09-13T18:27:01.300871+0000","last_became_peered":"2024-09-13T18:27:01.300871+0000","last_unstale":"2024-09-13T18:27:02.288208+0000","last_undegraded":"2024-09-13T18:27:02.288208+0000","last_fullsized":"2024-09-13T18:27:02.288208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:58.545057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562414+0000","last_change":"2024-09-13T18:27:01.299631+0000","last_active":"2024-09-13T18:27:02.562414+0000","last_peered":"2024-09-13T18:27:02.562414+0000","last_clean":"2024-09-13T18:27:02.562414+0000","last_became_active":"2024-09-13T18:27:01.299370+0000","last_became_peered":"2024-09-13T18:27:01.299370+0000","last_unstale":"2024-09-13T18:27:02.562414+0000","last_undegraded":"2024-09-13T18:27:02.562414+0000","last_fullsized":"2024-09-13T18:27:02.562414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:04.793190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563485+0000","last_change":"2024-09-13T18:27:01.309339+0000","last_active":"2024-09-13T18:27:02.563485+0000","last_peered":"2024-09-13T18:27:02.563485+0000","last_clean":"2024-09-13T18:27:02.563485+0000","last_became_active":"2024-09-13T18:27:01.308841+0000","last_became_peered":"2024-09-13T18:27:01.308841+0000","last_unstale":"2024-09-13T18:27:02.563485+0000","last_undegraded":"2024-09-13T18:27:02.563485+0000","last_fullsized":"2024-09-13T18:27:02.563485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:17.918955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561983+0000","last_change":"2024-09-13T18:27:01.308696+0000","last_active":"2024-09-13T18:27:02.561983+0000","last_peered":"2024-09-13T18:27:02.561983+0000","last_clean":"2024-09-13T18:27:02.561983+0000","last_became_active":"2024-09-13T18:27:01.308095+0000","last_became_peered":"2024-09-13T18:27:01.308095+0000","last_unstale":"2024-09-13T18:27:02.561983+0000","last_undegraded":"2024-09-13T18:27:02.561983+0000","last_fullsized":"2024-09-13T18:27:02.561983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562445+0000","last_change":"2024-09-13T18:27:01.310681+0000","last_active":"2024-09-13T18:27:02.562445+0000","last_peered":"2024-09-13T18:27:02.562445+0000","last_clean":"2024-09-13T18:27:02.562445+0000","last_became_active":"2024-09-13T18:27:01.310423+0000","last_became_peered":"2024-09-13T18:27:01.310423+0000","last_unstale":"2024-09-13T18:27:02.562445+0000","last_undegraded":"2024-09-13T18:27:02.562445+0000","last_fullsized":"2024-09-13T18:27:02.562445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286784+0000","last_change":"2024-09-13T18:27:01.303954+0000","last_active":"2024-09-13T18:27:02.286784+0000","last_peered":"2024-09-13T18:27:02.286784+0000","last_clean":"2024-09-13T18:27:02.286784+0000","last_became_active":"2024-09-13T18:27:01.303227+0000","last_became_peered":"2024-09-13T18:27:01.303227+0000","last_unstale":"2024-09-13T18:27:02.286784+0000","last_undegraded":"2024-09-13T18:27:02.286784+0000","last_fullsized":"2024-09-13T18:27:02.286784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288715+0000","last_change":"2024-09-13T18:27:01.296775+0000","last_active":"2024-09-13T18:27:02.288715+0000","last_peered":"2024-09-13T18:27:02.288715+0000","last_clean":"2024-09-13T18:27:02.288715+0000","last_became_active":"2024-09-13T18:27:01.296521+0000","last_became_peered":"2024-09-13T18:27:01.296521+0000","last_unstale":"2024-09-13T18:27:02.288715+0000","last_undegraded":"2024-09-13T18:27:02.288715+0000","last_fullsized":"2024-09-13T18:27:02.288715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:26.451272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286251+0000","last_change":"2024-09-13T18:27:01.302747+0000","last_active":"2024-09-13T18:27:02.286251+0000","last_peered":"2024-09-13T18:27:02.286251+0000","last_clean":"2024-09-13T18:27:02.286251+0000","last_became_active":"2024-09-13T18:27:01.302084+0000","last_became_peered":"2024-09-13T18:27:01.302084+0000","last_unstale":"2024-09-13T18:27:02.286251+0000","last_undegraded":"2024-09-13T18:27:02.286251+0000","last_fullsized":"2024-09-13T18:27:02.286251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:40.223464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289687+0000","last_change":"2024-09-13T18:27:01.296882+0000","last_active":"2024-09-13T18:27:02.289687+0000","last_peered":"2024-09-13T18:27:02.289687+0000","last_clean":"2024-09-13T18:27:02.289687+0000","last_became_active":"2024-09-13T18:27:01.296629+0000","last_became_peered":"2024-09-13T18:27:01.296629+0000","last_unstale":"2024-09-13T18:27:02.289687+0000","last_undegraded":"2024-09-13T18:27:02.289687+0000","last_fullsized":"2024-09-13T18:27:02.289687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:26.095535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562232+0000","last_change":"2024-09-13T18:27:01.301327+0000","last_active":"2024-09-13T18:27:02.562232+0000","last_peered":"2024-09-13T18:27:02.562232+0000","last_clean":"2024-09-13T18:27:02.562232+0000","last_became_active":"2024-09-13T18:27:01.301036+0000","last_became_peered":"2024-09-13T18:27:01.301036+0000","last_unstale":"2024-09-13T18:27:02.562232+0000","last_undegraded":"2024-09-13T18:27:02.562232+0000","last_fullsized":"2024-09-13T18:27:02.562232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:26.451272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288168+0000","last_change":"2024-09-13T18:27:01.303654+0000","last_active":"2024-09-13T18:27:02.288168+0000","last_peered":"2024-09-13T18:27:02.288168+0000","last_clean":"2024-09-13T18:27:02.288168+0000","last_became_active":"2024-09-13T18:27:01.303423+0000","last_became_peered":"2024-09-13T18:27:01.303423+0000","last_unstale":"2024-09-13T18:27:02.288168+0000","last_undegraded":"2024-09-13T18:27:02.288168+0000","last_fullsized":"2024-09-13T18:27:02.288168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:58.545057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289581+0000","last_change":"2024-09-13T18:27:01.306805+0000","last_active":"2024-09-13T18:27:02.289581+0000","last_peered":"2024-09-13T18:27:02.289581+0000","last_clean":"2024-09-13T18:27:02.289581+0000","last_became_active":"2024-09-13T18:27:01.306437+0000","last_became_peered":"2024-09-13T18:27:01.306437+0000","last_unstale":"2024-09-13T18:27:02.289581+0000","last_undegraded":"2024-09-13T18:27:02.289581+0000","last_fullsized":"2024-09-13T18:27:02.289581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:30.479538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562688+0000","last_change":"2024-09-13T18:27:01.304058+0000","last_active":"2024-09-13T18:27:02.562688+0000","last_peered":"2024-09-13T18:27:02.562688+0000","last_clean":"2024-09-13T18:27:02.562688+0000","last_became_active":"2024-09-13T18:27:01.303629+0000","last_became_peered":"2024-09-13T18:27:01.303629+0000","last_unstale":"2024-09-13T18:27:02.562688+0000","last_undegraded":"2024-09-13T18:27:02.562688+0000","last_fullsized":"2024-09-13T18:27:02.562688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:22.491328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287025+0000","last_change":"2024-09-13T18:27:01.304393+0000","last_active":"2024-09-13T18:27:02.287025+0000","last_peered":"2024-09-13T18:27:02.287025+0000","last_clean":"2024-09-13T18:27:02.287025+0000","last_became_active":"2024-09-13T18:27:01.304135+0000","last_became_peered":"2024-09-13T18:27:01.304135+0000","last_unstale":"2024-09-13T18:27:02.287025+0000","last_undegraded":"2024-09-13T18:27:02.287025+0000","last_fullsized":"2024-09-13T18:27:02.287025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:40.378467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562959+0000","last_change":"2024-09-13T18:27:01.302991+0000","last_active":"2024-09-13T18:27:02.562959+0000","last_peered":"2024-09-13T18:27:02.562959+0000","last_clean":"2024-09-13T18:27:02.562959+0000","last_became_active":"2024-09-13T18:27:01.302746+0000","last_became_peered":"2024-09-13T18:27:01.302746+0000","last_unstale":"2024-09-13T18:27:02.562959+0000","last_undegraded":"2024-09-13T18:27:02.562959+0000","last_fullsized":"2024-09-13T18:27:02.562959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:17.243480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.560846+0000","last_change":"2024-09-13T18:27:01.306888+0000","last_active":"2024-09-13T18:27:02.560846+0000","last_peered":"2024-09-13T18:27:02.560846+0000","last_clean":"2024-09-13T18:27:02.560846+0000","last_became_active":"2024-09-13T18:27:01.306593+0000","last_became_peered":"2024-09-13T18:27:01.306593+0000","last_unstale":"2024-09-13T18:27:02.560846+0000","last_undegraded":"2024-09-13T18:27:02.560846+0000","last_fullsized":"2024-09-13T18:27:02.560846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:26.095535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561343+0000","last_change":"2024-09-13T18:27:01.306267+0000","last_active":"2024-09-13T18:27:02.561343+0000","last_peered":"2024-09-13T18:27:02.561343+0000","last_clean":"2024-09-13T18:27:02.561343+0000","last_became_active":"2024-09-13T18:27:01.306016+0000","last_became_peered":"2024-09-13T18:27:01.306016+0000","last_unstale":"2024-09-13T18:27:02.561343+0000","last_undegraded":"2024-09-13T18:27:02.561343+0000","last_fullsized":"2024-09-13T18:27:02.561343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:59.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289534+0000","last_change":"2024-09-13T18:27:00.911539+0000","last_active":"2024-09-13T18:27:02.289534+0000","last_peered":"2024-09-13T18:27:02.289534+0000","last_clean":"2024-09-13T18:27:02.289534+0000","last_became_active":"2024-09-13T18:27:00.910841+0000","last_became_peered":"2024-09-13T18:27:00.910841+0000","last_unstale":"2024-09-13T18:27:02.289534+0000","last_undegraded":"2024-09-13T18:27:02.289534+0000","last_fullsized":"2024-09-13T18:27:02.289534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:53.385777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562937+0000","last_change":"2024-09-13T18:27:01.305382+0000","last_active":"2024-09-13T18:27:02.562937+0000","last_peered":"2024-09-13T18:27:02.562937+0000","last_clean":"2024-09-13T18:27:02.562937+0000","last_became_active":"2024-09-13T18:27:01.305139+0000","last_became_peered":"2024-09-13T18:27:01.305139+0000","last_unstale":"2024-09-13T18:27:02.562937+0000","last_undegraded":"2024-09-13T18:27:02.562937+0000","last_fullsized":"2024-09-13T18:27:02.562937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561575+0000","last_change":"2024-09-13T18:27:00.913328+0000","last_active":"2024-09-13T18:27:02.561575+0000","last_peered":"2024-09-13T18:27:02.561575+0000","last_clean":"2024-09-13T18:27:02.561575+0000","last_became_active":"2024-09-13T18:27:00.913086+0000","last_became_peered":"2024-09-13T18:27:00.913086+0000","last_unstale":"2024-09-13T18:27:02.561575+0000","last_undegraded":"2024-09-13T18:27:02.561575+0000","last_fullsized":"2024-09-13T18:27:02.561575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:53.385777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288807+0000","last_change":"2024-09-13T18:27:00.911854+0000","last_active":"2024-09-13T18:27:02.288807+0000","last_peered":"2024-09-13T18:27:02.288807+0000","last_clean":"2024-09-13T18:27:02.288807+0000","last_became_active":"2024-09-13T18:27:00.911591+0000","last_became_peered":"2024-09-13T18:27:00.911591+0000","last_unstale":"2024-09-13T18:27:02.288807+0000","last_undegraded":"2024-09-13T18:27:02.288807+0000","last_fullsized":"2024-09-13T18:27:02.288807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:06.968005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288348+0000","last_change":"2024-09-13T18:27:01.302897+0000","last_active":"2024-09-13T18:27:02.288348+0000","last_peered":"2024-09-13T18:27:02.288348+0000","last_clean":"2024-09-13T18:27:02.288348+0000","last_became_active":"2024-09-13T18:27:01.302678+0000","last_became_peered":"2024-09-13T18:27:01.302678+0000","last_unstale":"2024-09-13T18:27:02.288348+0000","last_undegraded":"2024-09-13T18:27:02.288348+0000","last_fullsized":"2024-09-13T18:27:02.288348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286340+0000","last_change":"2024-09-13T18:27:00.912605+0000","last_active":"2024-09-13T18:27:02.286340+0000","last_peered":"2024-09-13T18:27:02.286340+0000","last_clean":"2024-09-13T18:27:02.286340+0000","last_became_active":"2024-09-13T18:27:00.912293+0000","last_became_peered":"2024-09-13T18:27:00.912293+0000","last_unstale":"2024-09-13T18:27:02.286340+0000","last_undegraded":"2024-09-13T18:27:02.286340+0000","last_fullsized":"2024-09-13T18:27:02.286340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:15.665610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287553+0000","last_change":"2024-09-13T18:27:01.294866+0000","last_active":"2024-09-13T18:27:02.287553+0000","last_peered":"2024-09-13T18:27:02.287553+0000","last_clean":"2024-09-13T18:27:02.287553+0000","last_became_active":"2024-09-13T18:27:01.294614+0000","last_became_peered":"2024-09-13T18:27:01.294614+0000","last_unstale":"2024-09-13T18:27:02.287553+0000","last_undegraded":"2024-09-13T18:27:02.287553+0000","last_fullsized":"2024-09-13T18:27:02.287553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562622+0000","last_change":"2024-09-13T18:27:00.910126+0000","last_active":"2024-09-13T18:27:02.562622+0000","last_peered":"2024-09-13T18:27:02.562622+0000","last_clean":"2024-09-13T18:27:02.562622+0000","last_became_active":"2024-09-13T18:27:00.909845+0000","last_became_peered":"2024-09-13T18:27:00.909845+0000","last_unstale":"2024-09-13T18:27:02.562622+0000","last_undegraded":"2024-09-13T18:27:02.562622+0000","last_fullsized":"2024-09-13T18:27:02.562622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.933818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287706+0000","last_change":"2024-09-13T18:27:01.304023+0000","last_active":"2024-09-13T18:27:02.287706+0000","last_peered":"2024-09-13T18:27:02.287706+0000","last_clean":"2024-09-13T18:27:02.287706+0000","last_became_active":"2024-09-13T18:27:01.303683+0000","last_became_peered":"2024-09-13T18:27:01.303683+0000","last_unstale":"2024-09-13T18:27:02.287706+0000","last_undegraded":"2024-09-13T18:27:02.287706+0000","last_fullsized":"2024-09-13T18:27:02.287706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287684+0000","last_change":"2024-09-13T18:27:00.911226+0000","last_active":"2024-09-13T18:27:02.287684+0000","last_peered":"2024-09-13T18:27:02.287684+0000","last_clean":"2024-09-13T18:27:02.287684+0000","last_became_active":"2024-09-13T18:27:00.910878+0000","last_became_peered":"2024-09-13T18:27:00.910878+0000","last_unstale":"2024-09-13T18:27:02.287684+0000","last_undegraded":"2024-09-13T18:27:02.287684+0000","last_fullsized":"2024-09-13T18:27:02.287684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:58.428945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563113+0000","last_change":"2024-09-13T18:27:01.302430+0000","last_active":"2024-09-13T18:27:02.563113+0000","last_peered":"2024-09-13T18:27:02.563113+0000","last_clean":"2024-09-13T18:27:02.563113+0000","last_became_active":"2024-09-13T18:27:01.301355+0000","last_became_peered":"2024-09-13T18:27:01.301355+0000","last_unstale":"2024-09-13T18:27:02.563113+0000","last_undegraded":"2024-09-13T18:27:02.563113+0000","last_fullsized":"2024-09-13T18:27:02.563113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:26.095535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288349+0000","last_change":"2024-09-13T18:27:00.906914+0000","last_active":"2024-09-13T18:27:02.288349+0000","last_peered":"2024-09-13T18:27:02.288349+0000","last_clean":"2024-09-13T18:27:02.288349+0000","last_became_active":"2024-09-13T18:27:00.905751+0000","last_became_peered":"2024-09-13T18:27:00.905751+0000","last_unstale":"2024-09-13T18:27:02.288349+0000","last_undegraded":"2024-09-13T18:27:02.288349+0000","last_fullsized":"2024-09-13T18:27:02.288349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:13.103035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562471+0000","last_change":"2024-09-13T18:27:01.311919+0000","last_active":"2024-09-13T18:27:02.562471+0000","last_peered":"2024-09-13T18:27:02.562471+0000","last_clean":"2024-09-13T18:27:02.562471+0000","last_became_active":"2024-09-13T18:27:01.311087+0000","last_became_peered":"2024-09-13T18:27:01.311087+0000","last_unstale":"2024-09-13T18:27:02.562471+0000","last_undegraded":"2024-09-13T18:27:02.562471+0000","last_fullsized":"2024-09-13T18:27:02.562471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:14.113024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562110+0000","last_change":"2024-09-13T18:27:00.909802+0000","last_active":"2024-09-13T18:27:02.562110+0000","last_peered":"2024-09-13T18:27:02.562110+0000","last_clean":"2024-09-13T18:27:02.562110+0000","last_became_active":"2024-09-13T18:27:00.909547+0000","last_became_peered":"2024-09-13T18:27:00.909547+0000","last_unstale":"2024-09-13T18:27:02.562110+0000","last_undegraded":"2024-09-13T18:27:02.562110+0000","last_fullsized":"2024-09-13T18:27:02.562110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:13.103035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563137+0000","last_change":"2024-09-13T18:27:01.312609+0000","last_active":"2024-09-13T18:27:02.563137+0000","last_peered":"2024-09-13T18:27:02.563137+0000","last_clean":"2024-09-13T18:27:02.563137+0000","last_became_active":"2024-09-13T18:27:01.312314+0000","last_became_peered":"2024-09-13T18:27:01.312314+0000","last_unstale":"2024-09-13T18:27:02.563137+0000","last_undegraded":"2024-09-13T18:27:02.563137+0000","last_fullsized":"2024-09-13T18:27:02.563137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:38.650324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563169+0000","last_change":"2024-09-13T18:27:00.916915+0000","last_active":"2024-09-13T18:27:02.563169+0000","last_peered":"2024-09-13T18:27:02.563169+0000","last_clean":"2024-09-13T18:27:02.563169+0000","last_became_active":"2024-09-13T18:27:00.916632+0000","last_became_peered":"2024-09-13T18:27:00.916632+0000","last_unstale":"2024-09-13T18:27:02.563169+0000","last_undegraded":"2024-09-13T18:27:02.563169+0000","last_fullsized":"2024-09-13T18:27:02.563169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:50.705752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562755+0000","last_change":"2024-09-13T18:27:01.303166+0000","last_active":"2024-09-13T18:27:02.562755+0000","last_peered":"2024-09-13T18:27:02.562755+0000","last_clean":"2024-09-13T18:27:02.562755+0000","last_became_active":"2024-09-13T18:27:01.302924+0000","last_became_peered":"2024-09-13T18:27:01.302924+0000","last_unstale":"2024-09-13T18:27:02.562755+0000","last_undegraded":"2024-09-13T18:27:02.562755+0000","last_fullsized":"2024-09-13T18:27:02.562755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:04.793190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287214+0000","last_change":"2024-09-13T18:27:00.907398+0000","last_active":"2024-09-13T18:27:02.287214+0000","last_peered":"2024-09-13T18:27:02.287214+0000","last_clean":"2024-09-13T18:27:02.287214+0000","last_became_active":"2024-09-13T18:27:00.906944+0000","last_became_peered":"2024-09-13T18:27:00.906944+0000","last_unstale":"2024-09-13T18:27:02.287214+0000","last_undegraded":"2024-09-13T18:27:02.287214+0000","last_fullsized":"2024-09-13T18:27:02.287214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:06.968005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562208+0000","last_change":"2024-09-13T18:27:01.315035+0000","last_active":"2024-09-13T18:27:02.562208+0000","last_peered":"2024-09-13T18:27:02.562208+0000","last_clean":"2024-09-13T18:27:02.562208+0000","last_became_active":"2024-09-13T18:27:01.314681+0000","last_became_peered":"2024-09-13T18:27:01.314681+0000","last_unstale":"2024-09-13T18:27:02.562208+0000","last_undegraded":"2024-09-13T18:27:02.562208+0000","last_fullsized":"2024-09-13T18:27:02.562208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:36.178176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561303+0000","last_change":"2024-09-13T18:27:00.912840+0000","last_active":"2024-09-13T18:27:02.561303+0000","last_peered":"2024-09-13T18:27:02.561303+0000","last_clean":"2024-09-13T18:27:02.561303+0000","last_became_active":"2024-09-13T18:27:00.912602+0000","last_became_peered":"2024-09-13T18:27:00.912602+0000","last_unstale":"2024-09-13T18:27:02.561303+0000","last_undegraded":"2024-09-13T18:27:02.561303+0000","last_fullsized":"2024-09-13T18:27:02.561303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:15.665610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561087+0000","last_change":"2024-09-13T18:27:01.306616+0000","last_active":"2024-09-13T18:27:02.561087+0000","last_peered":"2024-09-13T18:27:02.561087+0000","last_clean":"2024-09-13T18:27:02.561087+0000","last_became_active":"2024-09-13T18:27:01.306284+0000","last_became_peered":"2024-09-13T18:27:01.306284+0000","last_unstale":"2024-09-13T18:27:02.561087+0000","last_undegraded":"2024-09-13T18:27:02.561087+0000","last_fullsized":"2024-09-13T18:27:02.561087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:30.479538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562519+0000","last_change":"2024-09-13T18:27:00.908275+0000","last_active":"2024-09-13T18:27:02.562519+0000","last_peered":"2024-09-13T18:27:02.562519+0000","last_clean":"2024-09-13T18:27:02.562519+0000","last_became_active":"2024-09-13T18:27:00.907829+0000","last_became_peered":"2024-09-13T18:27:00.907829+0000","last_unstale":"2024-09-13T18:27:02.562519+0000","last_undegraded":"2024-09-13T18:27:02.562519+0000","last_fullsized":"2024-09-13T18:27:02.562519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:25.457724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.560866+0000","last_change":"2024-09-13T18:27:01.314976+0000","last_active":"2024-09-13T18:27:02.560866+0000","last_peered":"2024-09-13T18:27:02.560866+0000","last_clean":"2024-09-13T18:27:02.560866+0000","last_became_active":"2024-09-13T18:27:01.314657+0000","last_became_peered":"2024-09-13T18:27:01.314657+0000","last_unstale":"2024-09-13T18:27:02.560866+0000","last_undegraded":"2024-09-13T18:27:02.560866+0000","last_fullsized":"2024-09-13T18:27:02.560866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562777+0000","last_change":"2024-09-13T18:27:00.912307+0000","last_active":"2024-09-13T18:27:02.562777+0000","last_peered":"2024-09-13T18:27:02.562777+0000","last_clean":"2024-09-13T18:27:02.562777+0000","last_became_active":"2024-09-13T18:27:00.911774+0000","last_became_peered":"2024-09-13T18:27:00.911774+0000","last_unstale":"2024-09-13T18:27:02.562777+0000","last_undegraded":"2024-09-13T18:27:02.562777+0000","last_fullsized":"2024-09-13T18:27:02.562777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:55.668790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563559+0000","last_change":"2024-09-13T18:27:01.315067+0000","last_active":"2024-09-13T18:27:02.563559+0000","last_peered":"2024-09-13T18:27:02.563559+0000","last_clean":"2024-09-13T18:27:02.563559+0000","last_became_active":"2024-09-13T18:27:01.314778+0000","last_became_peered":"2024-09-13T18:27:01.314778+0000","last_unstale":"2024-09-13T18:27:02.563559+0000","last_undegraded":"2024-09-13T18:27:02.563559+0000","last_fullsized":"2024-09-13T18:27:02.563559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562656+0000","last_change":"2024-09-13T18:27:00.911992+0000","last_active":"2024-09-13T18:27:02.562656+0000","last_peered":"2024-09-13T18:27:02.562656+0000","last_clean":"2024-09-13T18:27:02.562656+0000","last_became_active":"2024-09-13T18:27:00.911708+0000","last_became_peered":"2024-09-13T18:27:00.911708+0000","last_unstale":"2024-09-13T18:27:02.562656+0000","last_undegraded":"2024-09-13T18:27:02.562656+0000","last_fullsized":"2024-09-13T18:27:02.562656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:06.968005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563446+0000","last_change":"2024-09-13T18:27:01.314993+0000","last_active":"2024-09-13T18:27:02.563446+0000","last_peered":"2024-09-13T18:27:02.563446+0000","last_clean":"2024-09-13T18:27:02.563446+0000","last_became_active":"2024-09-13T18:27:01.314728+0000","last_became_peered":"2024-09-13T18:27:01.314728+0000","last_unstale":"2024-09-13T18:27:02.563446+0000","last_undegraded":"2024-09-13T18:27:02.563446+0000","last_fullsized":"2024-09-13T18:27:02.563446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:17.450610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288495+0000","last_change":"2024-09-13T18:27:00.904591+0000","last_active":"2024-09-13T18:27:02.288495+0000","last_peered":"2024-09-13T18:27:02.288495+0000","last_clean":"2024-09-13T18:27:02.288495+0000","last_became_active":"2024-09-13T18:27:00.904193+0000","last_became_peered":"2024-09-13T18:27:00.904193+0000","last_unstale":"2024-09-13T18:27:02.288495+0000","last_undegraded":"2024-09-13T18:27:02.288495+0000","last_fullsized":"2024-09-13T18:27:02.288495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.933818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287084+0000","last_change":"2024-09-13T18:27:01.303085+0000","last_active":"2024-09-13T18:27:02.287084+0000","last_peered":"2024-09-13T18:27:02.287084+0000","last_clean":"2024-09-13T18:27:02.287084+0000","last_became_active":"2024-09-13T18:27:01.302208+0000","last_became_peered":"2024-09-13T18:27:01.302208+0000","last_unstale":"2024-09-13T18:27:02.287084+0000","last_undegraded":"2024-09-13T18:27:02.287084+0000","last_fullsized":"2024-09-13T18:27:02.287084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:36.178176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563635+0000","last_change":"2024-09-13T18:27:00.913872+0000","last_active":"2024-09-13T18:27:02.563635+0000","last_peered":"2024-09-13T18:27:02.563635+0000","last_clean":"2024-09-13T18:27:02.563635+0000","last_became_active":"2024-09-13T18:27:00.913253+0000","last_became_peered":"2024-09-13T18:27:00.913253+0000","last_unstale":"2024-09-13T18:27:02.563635+0000","last_undegraded":"2024-09-13T18:27:02.563635+0000","last_fullsized":"2024-09-13T18:27:02.563635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:15.665610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563701+0000","last_change":"2024-09-13T18:27:01.309496+0000","last_active":"2024-09-13T18:27:02.563701+0000","last_peered":"2024-09-13T18:27:02.563701+0000","last_clean":"2024-09-13T18:27:02.563701+0000","last_became_active":"2024-09-13T18:27:01.309222+0000","last_became_peered":"2024-09-13T18:27:01.309222+0000","last_unstale":"2024-09-13T18:27:02.563701+0000","last_undegraded":"2024-09-13T18:27:02.563701+0000","last_fullsized":"2024-09-13T18:27:02.563701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:01.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:27:01.294854+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:27:01.294854+0000","last_peered":"2024-09-13T18:27:01.294854+0000","last_clean":"2024-09-13T18:27:01.294854+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:27:01.294854+0000","last_undegraded":"2024-09-13T18:27:01.294854+0000","last_fullsized":"2024-09-13T18:27:01.294854+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286187+0000","last_change":"2024-09-13T18:27:00.908757+0000","last_active":"2024-09-13T18:27:02.286187+0000","last_peered":"2024-09-13T18:27:02.286187+0000","last_clean":"2024-09-13T18:27:02.286187+0000","last_became_active":"2024-09-13T18:27:00.908473+0000","last_became_peered":"2024-09-13T18:27:00.908473+0000","last_unstale":"2024-09-13T18:27:02.286187+0000","last_undegraded":"2024-09-13T18:27:02.286187+0000","last_fullsized":"2024-09-13T18:27:02.286187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:13.103035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289057+0000","last_change":"2024-09-13T18:27:01.301499+0000","last_active":"2024-09-13T18:27:02.289057+0000","last_peered":"2024-09-13T18:27:02.289057+0000","last_clean":"2024-09-13T18:27:02.289057+0000","last_became_active":"2024-09-13T18:27:01.301225+0000","last_became_peered":"2024-09-13T18:27:01.301225+0000","last_unstale":"2024-09-13T18:27:02.289057+0000","last_undegraded":"2024-09-13T18:27:02.289057+0000","last_fullsized":"2024-09-13T18:27:02.289057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:17.918955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.560941+0000","last_change":"2024-09-13T18:27:00.913941+0000","last_active":"2024-09-13T18:27:02.560941+0000","last_peered":"2024-09-13T18:27:02.560941+0000","last_clean":"2024-09-13T18:27:02.560941+0000","last_became_active":"2024-09-13T18:27:00.913635+0000","last_became_peered":"2024-09-13T18:27:00.913635+0000","last_unstale":"2024-09-13T18:27:02.560941+0000","last_undegraded":"2024-09-13T18:27:02.560941+0000","last_fullsized":"2024-09-13T18:27:02.560941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:16.233492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562003+0000","last_change":"2024-09-13T18:27:01.305523+0000","last_active":"2024-09-13T18:27:02.562003+0000","last_peered":"2024-09-13T18:27:02.562003+0000","last_clean":"2024-09-13T18:27:02.562003+0000","last_became_active":"2024-09-13T18:27:01.305262+0000","last_became_peered":"2024-09-13T18:27:01.305262+0000","last_unstale":"2024-09-13T18:27:02.562003+0000","last_undegraded":"2024-09-13T18:27:02.562003+0000","last_fullsized":"2024-09-13T18:27:02.562003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:58.545057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563149+0000","last_change":"2024-09-13T18:27:00.908133+0000","last_active":"2024-09-13T18:27:02.563149+0000","last_peered":"2024-09-13T18:27:02.563149+0000","last_clean":"2024-09-13T18:27:02.563149+0000","last_became_active":"2024-09-13T18:27:00.907408+0000","last_became_peered":"2024-09-13T18:27:00.907408+0000","last_unstale":"2024-09-13T18:27:02.563149+0000","last_undegraded":"2024-09-13T18:27:02.563149+0000","last_fullsized":"2024-09-13T18:27:02.563149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:53.385777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287467+0000","last_change":"2024-09-13T18:27:01.302404+0000","last_active":"2024-09-13T18:27:02.287467+0000","last_peered":"2024-09-13T18:27:02.287467+0000","last_clean":"2024-09-13T18:27:02.287467+0000","last_became_active":"2024-09-13T18:27:01.302118+0000","last_became_peered":"2024-09-13T18:27:01.302118+0000","last_unstale":"2024-09-13T18:27:02.287467+0000","last_undegraded":"2024-09-13T18:27:02.287467+0000","last_fullsized":"2024-09-13T18:27:02.287467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:26.095535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287402+0000","last_change":"2024-09-13T18:27:00.904991+0000","last_active":"2024-09-13T18:27:02.287402+0000","last_peered":"2024-09-13T18:27:02.287402+0000","last_clean":"2024-09-13T18:27:02.287402+0000","last_became_active":"2024-09-13T18:27:00.903940+0000","last_became_peered":"2024-09-13T18:27:00.903940+0000","last_unstale":"2024-09-13T18:27:02.287402+0000","last_undegraded":"2024-09-13T18:27:02.287402+0000","last_fullsized":"2024-09-13T18:27:02.287402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:53.385777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561995+0000","last_change":"2024-09-13T18:27:01.303896+0000","last_active":"2024-09-13T18:27:02.561995+0000","last_peered":"2024-09-13T18:27:02.561995+0000","last_clean":"2024-09-13T18:27:02.561995+0000","last_became_active":"2024-09-13T18:27:01.303570+0000","last_became_peered":"2024-09-13T18:27:01.303570+0000","last_unstale":"2024-09-13T18:27:02.561995+0000","last_undegraded":"2024-09-13T18:27:02.561995+0000","last_fullsized":"2024-09-13T18:27:02.561995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:47.943806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288178+0000","last_change":"2024-09-13T18:27:00.911270+0000","last_active":"2024-09-13T18:27:02.288178+0000","last_peered":"2024-09-13T18:27:02.288178+0000","last_clean":"2024-09-13T18:27:02.288178+0000","last_became_active":"2024-09-13T18:27:00.910972+0000","last_became_peered":"2024-09-13T18:27:00.910972+0000","last_unstale":"2024-09-13T18:27:02.288178+0000","last_undegraded":"2024-09-13T18:27:02.288178+0000","last_fullsized":"2024-09-13T18:27:02.288178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:47.877280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286988+0000","last_change":"2024-09-13T18:27:01.301470+0000","last_active":"2024-09-13T18:27:02.286988+0000","last_peered":"2024-09-13T18:27:02.286988+0000","last_clean":"2024-09-13T18:27:02.286988+0000","last_became_active":"2024-09-13T18:27:01.301207+0000","last_became_peered":"2024-09-13T18:27:01.301207+0000","last_unstale":"2024-09-13T18:27:02.286988+0000","last_undegraded":"2024-09-13T18:27:02.286988+0000","last_fullsized":"2024-09-13T18:27:02.286988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:17.918955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563596+0000","last_change":"2024-09-13T18:27:00.912131+0000","last_active":"2024-09-13T18:27:02.563596+0000","last_peered":"2024-09-13T18:27:02.563596+0000","last_clean":"2024-09-13T18:27:02.563596+0000","last_became_active":"2024-09-13T18:27:00.911544+0000","last_became_peered":"2024-09-13T18:27:00.911544+0000","last_unstale":"2024-09-13T18:27:02.563596+0000","last_undegraded":"2024-09-13T18:27:02.563596+0000","last_fullsized":"2024-09-13T18:27:02.563596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:13.103035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287996+0000","last_change":"2024-09-13T18:27:01.300408+0000","last_active":"2024-09-13T18:27:02.287996+0000","last_peered":"2024-09-13T18:27:02.287996+0000","last_clean":"2024-09-13T18:27:02.287996+0000","last_became_active":"2024-09-13T18:27:01.300091+0000","last_became_peered":"2024-09-13T18:27:01.300091+0000","last_unstale":"2024-09-13T18:27:02.287996+0000","last_undegraded":"2024-09-13T18:27:02.287996+0000","last_fullsized":"2024-09-13T18:27:02.287996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:26.451272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288219+0000","last_change":"2024-09-13T18:27:00.912212+0000","last_active":"2024-09-13T18:27:02.288219+0000","last_peered":"2024-09-13T18:27:02.288219+0000","last_clean":"2024-09-13T18:27:02.288219+0000","last_became_active":"2024-09-13T18:27:00.911910+0000","last_became_peered":"2024-09-13T18:27:00.911910+0000","last_unstale":"2024-09-13T18:27:02.288219+0000","last_undegraded":"2024-09-13T18:27:02.288219+0000","last_fullsized":"2024-09-13T18:27:02.288219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:16.233492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289875+0000","last_change":"2024-09-13T18:27:01.312352+0000","last_active":"2024-09-13T18:27:02.289875+0000","last_peered":"2024-09-13T18:27:02.289875+0000","last_clean":"2024-09-13T18:27:02.289875+0000","last_became_active":"2024-09-13T18:27:01.311778+0000","last_became_peered":"2024-09-13T18:27:01.311778+0000","last_unstale":"2024-09-13T18:27:02.289875+0000","last_undegraded":"2024-09-13T18:27:02.289875+0000","last_fullsized":"2024-09-13T18:27:02.289875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:40.378467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562667+0000","last_change":"2024-09-13T18:27:00.911809+0000","last_active":"2024-09-13T18:27:02.562667+0000","last_peered":"2024-09-13T18:27:02.562667+0000","last_clean":"2024-09-13T18:27:02.562667+0000","last_became_active":"2024-09-13T18:27:00.911539+0000","last_became_peered":"2024-09-13T18:27:00.911539+0000","last_unstale":"2024-09-13T18:27:02.562667+0000","last_undegraded":"2024-09-13T18:27:02.562667+0000","last_fullsized":"2024-09-13T18:27:02.562667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:58.428945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563157+0000","last_change":"2024-09-13T18:27:01.307882+0000","last_active":"2024-09-13T18:27:02.563157+0000","last_peered":"2024-09-13T18:27:02.563157+0000","last_clean":"2024-09-13T18:27:02.563157+0000","last_became_active":"2024-09-13T18:27:01.307639+0000","last_became_peered":"2024-09-13T18:27:01.307639+0000","last_unstale":"2024-09-13T18:27:02.563157+0000","last_undegraded":"2024-09-13T18:27:02.563157+0000","last_fullsized":"2024-09-13T18:27:02.563157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:30.479538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.560713+0000","last_change":"2024-09-13T18:27:00.912694+0000","last_active":"2024-09-13T18:27:02.560713+0000","last_peered":"2024-09-13T18:27:02.560713+0000","last_clean":"2024-09-13T18:27:02.560713+0000","last_became_active":"2024-09-13T18:27:00.912437+0000","last_became_peered":"2024-09-13T18:27:00.912437+0000","last_unstale":"2024-09-13T18:27:02.560713+0000","last_undegraded":"2024-09-13T18:27:02.560713+0000","last_fullsized":"2024-09-13T18:27:02.560713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:03.783202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561673+0000","last_change":"2024-09-13T18:27:01.298321+0000","last_active":"2024-09-13T18:27:02.561673+0000","last_peered":"2024-09-13T18:27:02.561673+0000","last_clean":"2024-09-13T18:27:02.561673+0000","last_became_active":"2024-09-13T18:27:01.298027+0000","last_became_peered":"2024-09-13T18:27:01.298027+0000","last_unstale":"2024-09-13T18:27:02.561673+0000","last_undegraded":"2024-09-13T18:27:02.561673+0000","last_fullsized":"2024-09-13T18:27:02.561673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:04.793190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287769+0000","last_change":"2024-09-13T18:27:00.910495+0000","last_active":"2024-09-13T18:27:02.287769+0000","last_peered":"2024-09-13T18:27:02.287769+0000","last_clean":"2024-09-13T18:27:02.287769+0000","last_became_active":"2024-09-13T18:27:00.910212+0000","last_became_peered":"2024-09-13T18:27:00.910212+0000","last_unstale":"2024-09-13T18:27:02.287769+0000","last_undegraded":"2024-09-13T18:27:02.287769+0000","last_fullsized":"2024-09-13T18:27:02.287769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:03.783202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288669+0000","last_change":"2024-09-13T18:27:01.292715+0000","last_active":"2024-09-13T18:27:02.288669+0000","last_peered":"2024-09-13T18:27:02.288669+0000","last_clean":"2024-09-13T18:27:02.288669+0000","last_became_active":"2024-09-13T18:27:01.292437+0000","last_became_peered":"2024-09-13T18:27:01.292437+0000","last_unstale":"2024-09-13T18:27:02.288669+0000","last_undegraded":"2024-09-13T18:27:02.288669+0000","last_fullsized":"2024-09-13T18:27:02.288669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:58.545057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288228+0000","last_change":"2024-09-13T18:27:00.907866+0000","last_active":"2024-09-13T18:27:02.288228+0000","last_peered":"2024-09-13T18:27:02.288228+0000","last_clean":"2024-09-13T18:27:02.288228+0000","last_became_active":"2024-09-13T18:27:00.907562+0000","last_became_peered":"2024-09-13T18:27:00.907562+0000","last_unstale":"2024-09-13T18:27:02.288228+0000","last_undegraded":"2024-09-13T18:27:02.288228+0000","last_fullsized":"2024-09-13T18:27:02.288228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:58.428945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289387+0000","last_change":"2024-09-13T18:27:01.302235+0000","last_active":"2024-09-13T18:27:02.289387+0000","last_peered":"2024-09-13T18:27:02.289387+0000","last_clean":"2024-09-13T18:27:02.289387+0000","last_became_active":"2024-09-13T18:27:01.301993+0000","last_became_peered":"2024-09-13T18:27:01.301993+0000","last_unstale":"2024-09-13T18:27:02.289387+0000","last_undegraded":"2024-09-13T18:27:02.289387+0000","last_fullsized":"2024-09-13T18:27:02.289387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:36.752876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562564+0000","last_change":"2024-09-13T18:27:00.917608+0000","last_active":"2024-09-13T18:27:02.562564+0000","last_peered":"2024-09-13T18:27:02.562564+0000","last_clean":"2024-09-13T18:27:02.562564+0000","last_became_active":"2024-09-13T18:27:00.917334+0000","last_became_peered":"2024-09-13T18:27:00.917334+0000","last_unstale":"2024-09-13T18:27:02.562564+0000","last_undegraded":"2024-09-13T18:27:02.562564+0000","last_fullsized":"2024-09-13T18:27:02.562564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:53.385777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561361+0000","last_change":"2024-09-13T18:27:01.303769+0000","last_active":"2024-09-13T18:27:02.561361+0000","last_peered":"2024-09-13T18:27:02.561361+0000","last_clean":"2024-09-13T18:27:02.561361+0000","last_became_active":"2024-09-13T18:27:01.303409+0000","last_became_peered":"2024-09-13T18:27:01.303409+0000","last_unstale":"2024-09-13T18:27:02.561361+0000","last_undegraded":"2024-09-13T18:27:02.561361+0000","last_fullsized":"2024-09-13T18:27:02.561361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:58.545057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286775+0000","last_change":"2024-09-13T18:27:01.298238+0000","last_active":"2024-09-13T18:27:02.286775+0000","last_peered":"2024-09-13T18:27:02.286775+0000","last_clean":"2024-09-13T18:27:02.286775+0000","last_became_active":"2024-09-13T18:27:01.297937+0000","last_became_peered":"2024-09-13T18:27:01.297937+0000","last_unstale":"2024-09-13T18:27:02.286775+0000","last_undegraded":"2024-09-13T18:27:02.286775+0000","last_fullsized":"2024-09-13T18:27:02.286775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:36.752876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563094+0000","last_change":"2024-09-13T18:27:00.914839+0000","last_active":"2024-09-13T18:27:02.563094+0000","last_peered":"2024-09-13T18:27:02.563094+0000","last_clean":"2024-09-13T18:27:02.563094+0000","last_became_active":"2024-09-13T18:27:00.914550+0000","last_became_peered":"2024-09-13T18:27:00.914550+0000","last_unstale":"2024-09-13T18:27:02.563094+0000","last_undegraded":"2024-09-13T18:27:02.563094+0000","last_fullsized":"2024-09-13T18:27:02.563094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.933818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286874+0000","last_change":"2024-09-13T18:27:01.302873+0000","last_active":"2024-09-13T18:27:02.286874+0000","last_peered":"2024-09-13T18:27:02.286874+0000","last_clean":"2024-09-13T18:27:02.286874+0000","last_became_active":"2024-09-13T18:27:01.301780+0000","last_became_peered":"2024-09-13T18:27:01.301780+0000","last_unstale":"2024-09-13T18:27:02.286874+0000","last_undegraded":"2024-09-13T18:27:02.286874+0000","last_fullsized":"2024-09-13T18:27:02.286874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:17.450610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563342+0000","last_change":"2024-09-13T18:27:00.912304+0000","last_active":"2024-09-13T18:27:02.563342+0000","last_peered":"2024-09-13T18:27:02.563342+0000","last_clean":"2024-09-13T18:27:02.563342+0000","last_became_active":"2024-09-13T18:27:00.911868+0000","last_became_peered":"2024-09-13T18:27:00.911868+0000","last_unstale":"2024-09-13T18:27:02.563342+0000","last_undegraded":"2024-09-13T18:27:02.563342+0000","last_fullsized":"2024-09-13T18:27:02.563342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:58.428945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562947+0000","last_change":"2024-09-13T18:27:01.302701+0000","last_active":"2024-09-13T18:27:02.562947+0000","last_peered":"2024-09-13T18:27:02.562947+0000","last_clean":"2024-09-13T18:27:02.562947+0000","last_became_active":"2024-09-13T18:27:01.301626+0000","last_became_peered":"2024-09-13T18:27:01.301626+0000","last_unstale":"2024-09-13T18:27:02.562947+0000","last_undegraded":"2024-09-13T18:27:02.562947+0000","last_fullsized":"2024-09-13T18:27:02.562947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:26.451272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289813+0000","last_change":"2024-09-13T18:27:00.913872+0000","last_active":"2024-09-13T18:27:02.289813+0000","last_peered":"2024-09-13T18:27:02.289813+0000","last_clean":"2024-09-13T18:27:02.289813+0000","last_became_active":"2024-09-13T18:27:00.913585+0000","last_became_peered":"2024-09-13T18:27:00.913585+0000","last_unstale":"2024-09-13T18:27:02.289813+0000","last_undegraded":"2024-09-13T18:27:02.289813+0000","last_fullsized":"2024-09-13T18:27:02.289813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:15.665610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289768+0000","last_change":"2024-09-13T18:27:01.301513+0000","last_active":"2024-09-13T18:27:02.289768+0000","last_peered":"2024-09-13T18:27:02.289768+0000","last_clean":"2024-09-13T18:27:02.289768+0000","last_became_active":"2024-09-13T18:27:01.301080+0000","last_became_peered":"2024-09-13T18:27:01.301080+0000","last_unstale":"2024-09-13T18:27:02.289768+0000","last_undegraded":"2024-09-13T18:27:02.289768+0000","last_fullsized":"2024-09-13T18:27:02.289768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:07.409290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563285+0000","last_change":"2024-09-13T18:27:00.913198+0000","last_active":"2024-09-13T18:27:02.563285+0000","last_peered":"2024-09-13T18:27:02.563285+0000","last_clean":"2024-09-13T18:27:02.563285+0000","last_became_active":"2024-09-13T18:27:00.912840+0000","last_became_peered":"2024-09-13T18:27:00.912840+0000","last_unstale":"2024-09-13T18:27:02.563285+0000","last_undegraded":"2024-09-13T18:27:02.563285+0000","last_fullsized":"2024-09-13T18:27:02.563285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:25.457724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6870000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":823296,"data_stored":666575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:27:09.804 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:27:09.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.923+0000 7ff438dd6700 1 Processor -- start 2024-09-13T18:27:09.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.923+0000 7ff438dd6700 1 -- start start 2024-09-13T18:27:09.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.923+0000 7ff438dd6700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff4340d0a10 0x7ff4340d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:09.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.923+0000 7ff438dd6700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4340b5050 con 0x7ff4340cb5c0 2024-09-13T18:27:09.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.923+0000 7ff438dd6700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff43415f3d0 con 0x7ff4340cb150 2024-09-13T18:27:09.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.923+0000 7ff438dd6700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff43415b3e0 con 0x7ff4340d0a10 2024-09-13T18:27:09.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.923+0000 7ff433fff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff4340cb5c0 0x7ff43415ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52558/0 (socket says 172.21.15.44:52558) 2024-09-13T18:27:09.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.923+0000 7ff433fff700 1 -- 172.21.15.44:0/2423931188 learned_addr learned my addr 172.21.15.44:0/2423931188 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:09.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.923+0000 7ff4337fe700 1 --2- 172.21.15.44:0/2423931188 >> v2:172.21.15.99:3300/0 conn(0x7ff4340d0a10 0x7ff4340d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:09.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.923+0000 7ff4327fc700 1 -- 172.21.15.44:0/2423931188 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567825255 0 0) 0x7ff4340b5050 con 0x7ff4340cb5c0 2024-09-13T18:27:09.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.923+0000 7ff4327fc700 1 -- 172.21.15.44:0/2423931188 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4140035d0 con 0x7ff4340cb5c0 2024-09-13T18:27:09.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.923+0000 7ff4337fe700 1 -- 172.21.15.44:0/2423931188 >> v1:172.21.15.99:6789/0 conn(0x7ff4340cb150 legacy=0x7ff43415e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:09.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.923+0000 7ff4327fc700 1 -- 172.21.15.44:0/2423931188 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3806863094 0 0) 0x7ff43415f3d0 con 0x7ff4340cb150 2024-09-13T18:27:09.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.923+0000 7ff4337fe700 1 -- 172.21.15.44:0/2423931188 >> v1:172.21.15.44:6789/0 conn(0x7ff4340cb5c0 legacy=0x7ff43415ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:09.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.923+0000 7ff4337fe700 1 -- 172.21.15.44:0/2423931188 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4340ce3f0 con 0x7ff4340d0a10 2024-09-13T18:27:09.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.923+0000 7ff4337fe700 1 --2- 172.21.15.44:0/2423931188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4340d0a10 0x7ff4340d0df0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff424009880 tx=0x7ff424009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc56db2b8345ff2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:09.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.927+0000 7ff4327fc700 1 -- 172.21.15.44:0/2423931188 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff424011830 con 0x7ff4340d0a10 2024-09-13T18:27:09.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.927+0000 7ff4327fc700 1 -- 172.21.15.44:0/2423931188 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff424011990 con 0x7ff4340d0a10 2024-09-13T18:27:09.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.927+0000 7ff4327fc700 1 -- 172.21.15.44:0/2423931188 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff424011d20 con 0x7ff4340d0a10 2024-09-13T18:27:09.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.927+0000 7ff438dd6700 1 -- 172.21.15.44:0/2423931188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4340d0a10 msgr2=0x7ff4340d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:09.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.927+0000 7ff438dd6700 1 --2- 172.21.15.44:0/2423931188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4340d0a10 0x7ff4340d0df0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff424009880 tx=0x7ff424009b90 comp rx=0 tx=0).stop 2024-09-13T18:27:09.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.927+0000 7ff438dd6700 1 -- 172.21.15.44:0/2423931188 shutdown_connections 2024-09-13T18:27:09.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.927+0000 7ff438dd6700 1 --2- 172.21.15.44:0/2423931188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4340d0a10 0x7ff4340d0df0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:09.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.927+0000 7ff438dd6700 1 -- 172.21.15.44:0/2423931188 >> 172.21.15.44:0/2423931188 conn(0x7ff434071ee0 msgr2=0x7ff4340722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:09.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.927+0000 7ff438dd6700 1 -- 172.21.15.44:0/2423931188 shutdown_connections 2024-09-13T18:27:09.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.927+0000 7ff438dd6700 1 -- 172.21.15.44:0/2423931188 wait complete. 2024-09-13T18:27:09.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.927+0000 7ff438dd6700 1 Processor -- start 2024-09-13T18:27:09.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.927+0000 7ff438dd6700 1 -- start start 2024-09-13T18:27:09.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff438dd6700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff4340cb150 0x7ff434154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:09.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff438dd6700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4340cb5c0 0x7ff43406bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:09.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff438dd6700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4340d0a10 0x7ff4340ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:09.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff438dd6700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff434154960 con 0x7ff4340d0a10 2024-09-13T18:27:09.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff438dd6700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43415f330 con 0x7ff4340cb5c0 2024-09-13T18:27:09.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff438dd6700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff434154070 con 0x7ff4340cb150 2024-09-13T18:27:09.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff433fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4340d0a10 0x7ff4340ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:09.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff433fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4340d0a10 0x7ff4340ca0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38698/0 (socket says 172.21.15.44:38698) 2024-09-13T18:27:09.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff433fff700 1 -- 172.21.15.44:0/4242721416 learned_addr learned my addr 172.21.15.44:0/4242721416 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:09.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff4337fe700 1 --2- 172.21.15.44:0/4242721416 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff4340cb150 0x7ff434154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:09.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff432ffd700 1 --2- 172.21.15.44:0/4242721416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4340cb5c0 0x7ff43406bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:09.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff433fff700 1 -- 172.21.15.44:0/4242721416 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff4340cb150 msgr2=0x7ff434154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:09.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff433fff700 1 --2- 172.21.15.44:0/4242721416 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff4340cb150 0x7ff434154df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:09.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff433fff700 1 -- 172.21.15.44:0/4242721416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4340cb5c0 msgr2=0x7ff43406bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:09.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff433fff700 1 --2- 172.21.15.44:0/4242721416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4340cb5c0 0x7ff43406bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:09.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff433fff700 1 -- 172.21.15.44:0/4242721416 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4240094b0 con 0x7ff4340d0a10 2024-09-13T18:27:09.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff4337fe700 1 --2- 172.21.15.44:0/4242721416 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff4340cb150 0x7ff434154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:09.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff433fff700 1 --2- 172.21.15.44:0/4242721416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4340d0a10 0x7ff4340ca0e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00cb40 tx=0x7ff42c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:09.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff42bfff700 1 -- 172.21.15.44:0/4242721416 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c00a7b0 con 0x7ff4340d0a10 2024-09-13T18:27:09.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff42bfff700 1 -- 172.21.15.44:0/4242721416 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42c00a910 con 0x7ff4340d0a10 2024-09-13T18:27:09.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff438dd6700 1 -- 172.21.15.44:0/4242721416 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff434154310 con 0x7ff4340d0a10 2024-09-13T18:27:09.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff42bfff700 1 -- 172.21.15.44:0/4242721416 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c00ac80 con 0x7ff4340d0a10 2024-09-13T18:27:09.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff438dd6700 1 -- 172.21.15.44:0/4242721416 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43415ef70 con 0x7ff4340d0a10 2024-09-13T18:27:09.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.931+0000 7ff438dd6700 1 -- 172.21.15.44:0/4242721416 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff434154ad0 con 0x7ff4340d0a10 2024-09-13T18:27:09.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.935+0000 7ff42bfff700 1 -- 172.21.15.44:0/4242721416 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff42c01b3b0 con 0x7ff4340d0a10 2024-09-13T18:27:09.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.935+0000 7ff42bfff700 1 --2- 172.21.15.44:0/4242721416 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff418066760 0x7ff418068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:09.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.935+0000 7ff42bfff700 1 -- 172.21.15.44:0/4242721416 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff42c083a10 con 0x7ff4340d0a10 2024-09-13T18:27:09.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.935+0000 7ff4337fe700 1 --2- 172.21.15.44:0/4242721416 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff418066760 0x7ff418068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:09.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.935+0000 7ff4337fe700 1 --2- 172.21.15.44:0/4242721416 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff418066760 0x7ff418068c20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff4240090b0 tx=0x7ff424008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:09.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:09.947+0000 7ff42bfff700 1 -- 172.21.15.44:0/4242721416 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff42c050e20 con 0x7ff4340d0a10 2024-09-13T18:27:10.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.115+0000 7ff438dd6700 1 -- 172.21.15.44:0/4242721416 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff4340cc040 con 0x7ff418066760 2024-09-13T18:27:10.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.131+0000 7ff42bfff700 1 -- 172.21.15.44:0/4242721416 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264552 (secure 0 0 0) 0x7ff4240117d0 con 0x7ff418066760 2024-09-13T18:27:10.141 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:10.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.139+0000 7ff438dd6700 1 -- 172.21.15.44:0/4242721416 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff418066760 msgr2=0x7ff418068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:10.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.139+0000 7ff438dd6700 1 --2- 172.21.15.44:0/4242721416 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff418066760 0x7ff418068c20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff4240090b0 tx=0x7ff424008030 comp rx=0 tx=0).stop 2024-09-13T18:27:10.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.139+0000 7ff438dd6700 1 -- 172.21.15.44:0/4242721416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4340d0a10 msgr2=0x7ff4340ca0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:10.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.139+0000 7ff438dd6700 1 --2- 172.21.15.44:0/4242721416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4340d0a10 0x7ff4340ca0e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00cb40 tx=0x7ff42c00cb70 comp rx=0 tx=0).stop 2024-09-13T18:27:10.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.139+0000 7ff438dd6700 1 -- 172.21.15.44:0/4242721416 shutdown_connections 2024-09-13T18:27:10.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.139+0000 7ff438dd6700 1 --2- 172.21.15.44:0/4242721416 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff418066760 0x7ff418068c20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.139+0000 7ff438dd6700 1 --2- 172.21.15.44:0/4242721416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4340d0a10 0x7ff4340ca0e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.139+0000 7ff438dd6700 1 --2- 172.21.15.44:0/4242721416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4340cb5c0 0x7ff43406bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.139+0000 7ff438dd6700 1 --2- 172.21.15.44:0/4242721416 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff4340cb150 0x7ff434154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.139+0000 7ff438dd6700 1 -- 172.21.15.44:0/4242721416 >> 172.21.15.44:0/4242721416 conn(0x7ff434071ee0 msgr2=0x7ff4340722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:10.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.139+0000 7ff438dd6700 1 -- 172.21.15.44:0/4242721416 shutdown_connections 2024-09-13T18:27:10.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.139+0000 7ff438dd6700 1 -- 172.21.15.44:0/4242721416 wait complete. 2024-09-13T18:27:10.145 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:27:10.157 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-13T18:27:08.318613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219096,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755624,"statfs":{"total":773094113280,"available":772869758976,"internally_reserved":0,"allocated":2990080,"data_stored":1790012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.429947"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563137+0000","last_change":"2024-09-13T18:27:01.305887+0000","last_active":"2024-09-13T18:27:02.563137+0000","last_peered":"2024-09-13T18:27:02.563137+0000","last_clean":"2024-09-13T18:27:02.563137+0000","last_became_active":"2024-09-13T18:27:01.305625+0000","last_became_peered":"2024-09-13T18:27:01.305625+0000","last_unstale":"2024-09-13T18:27:02.563137+0000","last_undegraded":"2024-09-13T18:27:02.563137+0000","last_fullsized":"2024-09-13T18:27:02.563137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:07.409290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288134+0000","last_change":"2024-09-13T18:27:01.304009+0000","last_active":"2024-09-13T18:27:02.288134+0000","last_peered":"2024-09-13T18:27:02.288134+0000","last_clean":"2024-09-13T18:27:02.288134+0000","last_became_active":"2024-09-13T18:27:01.303652+0000","last_became_peered":"2024-09-13T18:27:01.303652+0000","last_unstale":"2024-09-13T18:27:02.288134+0000","last_undegraded":"2024-09-13T18:27:02.288134+0000","last_fullsized":"2024-09-13T18:27:02.288134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562791+0000","last_change":"2024-09-13T18:27:01.306439+0000","last_active":"2024-09-13T18:27:02.562791+0000","last_peered":"2024-09-13T18:27:02.562791+0000","last_clean":"2024-09-13T18:27:02.562791+0000","last_became_active":"2024-09-13T18:27:01.306181+0000","last_became_peered":"2024-09-13T18:27:01.306181+0000","last_unstale":"2024-09-13T18:27:02.562791+0000","last_undegraded":"2024-09-13T18:27:02.562791+0000","last_fullsized":"2024-09-13T18:27:02.562791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:25.136745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286635+0000","last_change":"2024-09-13T18:27:01.303323+0000","last_active":"2024-09-13T18:27:02.286635+0000","last_peered":"2024-09-13T18:27:02.286635+0000","last_clean":"2024-09-13T18:27:02.286635+0000","last_became_active":"2024-09-13T18:27:01.302581+0000","last_became_peered":"2024-09-13T18:27:01.302581+0000","last_unstale":"2024-09-13T18:27:02.286635+0000","last_undegraded":"2024-09-13T18:27:02.286635+0000","last_fullsized":"2024-09-13T18:27:02.286635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:38.650324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561988+0000","last_change":"2024-09-13T18:27:01.300462+0000","last_active":"2024-09-13T18:27:02.561988+0000","last_peered":"2024-09-13T18:27:02.561988+0000","last_clean":"2024-09-13T18:27:02.561988+0000","last_became_active":"2024-09-13T18:27:01.300188+0000","last_became_peered":"2024-09-13T18:27:01.300188+0000","last_unstale":"2024-09-13T18:27:02.561988+0000","last_undegraded":"2024-09-13T18:27:02.561988+0000","last_fullsized":"2024-09-13T18:27:02.561988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:40.378467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286541+0000","last_change":"2024-09-13T18:27:01.299781+0000","last_active":"2024-09-13T18:27:02.286541+0000","last_peered":"2024-09-13T18:27:02.286541+0000","last_clean":"2024-09-13T18:27:02.286541+0000","last_became_active":"2024-09-13T18:27:01.299516+0000","last_became_peered":"2024-09-13T18:27:01.299516+0000","last_unstale":"2024-09-13T18:27:02.286541+0000","last_undegraded":"2024-09-13T18:27:02.286541+0000","last_fullsized":"2024-09-13T18:27:02.286541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:07.409290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.560812+0000","last_change":"2024-09-13T18:27:01.305664+0000","last_active":"2024-09-13T18:27:02.560812+0000","last_peered":"2024-09-13T18:27:02.560812+0000","last_clean":"2024-09-13T18:27:02.560812+0000","last_became_active":"2024-09-13T18:27:01.305343+0000","last_became_peered":"2024-09-13T18:27:01.305343+0000","last_unstale":"2024-09-13T18:27:02.560812+0000","last_undegraded":"2024-09-13T18:27:02.560812+0000","last_fullsized":"2024-09-13T18:27:02.560812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:40.223464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288405+0000","last_change":"2024-09-13T18:27:01.301564+0000","last_active":"2024-09-13T18:27:02.288405+0000","last_peered":"2024-09-13T18:27:02.288405+0000","last_clean":"2024-09-13T18:27:02.288405+0000","last_became_active":"2024-09-13T18:27:01.301286+0000","last_became_peered":"2024-09-13T18:27:01.301286+0000","last_unstale":"2024-09-13T18:27:02.288405+0000","last_undegraded":"2024-09-13T18:27:02.288405+0000","last_fullsized":"2024-09-13T18:27:02.288405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:40.223464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563309+0000","last_change":"2024-09-13T18:27:01.308981+0000","last_active":"2024-09-13T18:27:02.563309+0000","last_peered":"2024-09-13T18:27:02.563309+0000","last_clean":"2024-09-13T18:27:02.563309+0000","last_became_active":"2024-09-13T18:27:01.308748+0000","last_became_peered":"2024-09-13T18:27:01.308748+0000","last_unstale":"2024-09-13T18:27:02.563309+0000","last_undegraded":"2024-09-13T18:27:02.563309+0000","last_fullsized":"2024-09-13T18:27:02.563309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:08.287280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562011+0000","last_change":"2024-09-13T18:27:01.299859+0000","last_active":"2024-09-13T18:27:02.562011+0000","last_peered":"2024-09-13T18:27:02.562011+0000","last_clean":"2024-09-13T18:27:02.562011+0000","last_became_active":"2024-09-13T18:27:01.299580+0000","last_became_peered":"2024-09-13T18:27:01.299580+0000","last_unstale":"2024-09-13T18:27:02.562011+0000","last_undegraded":"2024-09-13T18:27:02.562011+0000","last_fullsized":"2024-09-13T18:27:02.562011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562374+0000","last_change":"2024-09-13T18:27:01.299858+0000","last_active":"2024-09-13T18:27:02.562374+0000","last_peered":"2024-09-13T18:27:02.562374+0000","last_clean":"2024-09-13T18:27:02.562374+0000","last_became_active":"2024-09-13T18:27:01.299507+0000","last_became_peered":"2024-09-13T18:27:01.299507+0000","last_unstale":"2024-09-13T18:27:02.562374+0000","last_undegraded":"2024-09-13T18:27:02.562374+0000","last_fullsized":"2024-09-13T18:27:02.562374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:32.698886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562231+0000","last_change":"2024-09-13T18:27:01.308216+0000","last_active":"2024-09-13T18:27:02.562231+0000","last_peered":"2024-09-13T18:27:02.562231+0000","last_clean":"2024-09-13T18:27:02.562231+0000","last_became_active":"2024-09-13T18:27:01.307955+0000","last_became_peered":"2024-09-13T18:27:01.307955+0000","last_unstale":"2024-09-13T18:27:02.562231+0000","last_undegraded":"2024-09-13T18:27:02.562231+0000","last_fullsized":"2024-09-13T18:27:02.562231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:17.243480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289436+0000","last_change":"2024-09-13T18:27:01.299496+0000","last_active":"2024-09-13T18:27:02.289436+0000","last_peered":"2024-09-13T18:27:02.289436+0000","last_clean":"2024-09-13T18:27:02.289436+0000","last_became_active":"2024-09-13T18:27:01.299251+0000","last_became_peered":"2024-09-13T18:27:01.299251+0000","last_unstale":"2024-09-13T18:27:02.289436+0000","last_undegraded":"2024-09-13T18:27:02.289436+0000","last_fullsized":"2024-09-13T18:27:02.289436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562502+0000","last_change":"2024-09-13T18:27:01.305015+0000","last_active":"2024-09-13T18:27:02.562502+0000","last_peered":"2024-09-13T18:27:02.562502+0000","last_clean":"2024-09-13T18:27:02.562502+0000","last_became_active":"2024-09-13T18:27:01.304762+0000","last_became_peered":"2024-09-13T18:27:01.304762+0000","last_unstale":"2024-09-13T18:27:02.562502+0000","last_undegraded":"2024-09-13T18:27:02.562502+0000","last_fullsized":"2024-09-13T18:27:02.562502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:39.455167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287647+0000","last_change":"2024-09-13T18:27:01.304368+0000","last_active":"2024-09-13T18:27:02.287647+0000","last_peered":"2024-09-13T18:27:02.287647+0000","last_clean":"2024-09-13T18:27:02.287647+0000","last_became_active":"2024-09-13T18:27:01.304126+0000","last_became_peered":"2024-09-13T18:27:01.304126+0000","last_unstale":"2024-09-13T18:27:02.287647+0000","last_undegraded":"2024-09-13T18:27:02.287647+0000","last_fullsized":"2024-09-13T18:27:02.287647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:36.752876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286091+0000","last_change":"2024-09-13T18:27:01.305236+0000","last_active":"2024-09-13T18:27:02.286091+0000","last_peered":"2024-09-13T18:27:02.286091+0000","last_clean":"2024-09-13T18:27:02.286091+0000","last_became_active":"2024-09-13T18:27:01.302486+0000","last_became_peered":"2024-09-13T18:27:01.302486+0000","last_unstale":"2024-09-13T18:27:02.286091+0000","last_undegraded":"2024-09-13T18:27:02.286091+0000","last_fullsized":"2024-09-13T18:27:02.286091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:08.287280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288208+0000","last_change":"2024-09-13T18:27:01.301131+0000","last_active":"2024-09-13T18:27:02.288208+0000","last_peered":"2024-09-13T18:27:02.288208+0000","last_clean":"2024-09-13T18:27:02.288208+0000","last_became_active":"2024-09-13T18:27:01.300871+0000","last_became_peered":"2024-09-13T18:27:01.300871+0000","last_unstale":"2024-09-13T18:27:02.288208+0000","last_undegraded":"2024-09-13T18:27:02.288208+0000","last_fullsized":"2024-09-13T18:27:02.288208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:58.545057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562414+0000","last_change":"2024-09-13T18:27:01.299631+0000","last_active":"2024-09-13T18:27:02.562414+0000","last_peered":"2024-09-13T18:27:02.562414+0000","last_clean":"2024-09-13T18:27:02.562414+0000","last_became_active":"2024-09-13T18:27:01.299370+0000","last_became_peered":"2024-09-13T18:27:01.299370+0000","last_unstale":"2024-09-13T18:27:02.562414+0000","last_undegraded":"2024-09-13T18:27:02.562414+0000","last_fullsized":"2024-09-13T18:27:02.562414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:04.793190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563485+0000","last_change":"2024-09-13T18:27:01.309339+0000","last_active":"2024-09-13T18:27:02.563485+0000","last_peered":"2024-09-13T18:27:02.563485+0000","last_clean":"2024-09-13T18:27:02.563485+0000","last_became_active":"2024-09-13T18:27:01.308841+0000","last_became_peered":"2024-09-13T18:27:01.308841+0000","last_unstale":"2024-09-13T18:27:02.563485+0000","last_undegraded":"2024-09-13T18:27:02.563485+0000","last_fullsized":"2024-09-13T18:27:02.563485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:17.918955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561983+0000","last_change":"2024-09-13T18:27:01.308696+0000","last_active":"2024-09-13T18:27:02.561983+0000","last_peered":"2024-09-13T18:27:02.561983+0000","last_clean":"2024-09-13T18:27:02.561983+0000","last_became_active":"2024-09-13T18:27:01.308095+0000","last_became_peered":"2024-09-13T18:27:01.308095+0000","last_unstale":"2024-09-13T18:27:02.561983+0000","last_undegraded":"2024-09-13T18:27:02.561983+0000","last_fullsized":"2024-09-13T18:27:02.561983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562445+0000","last_change":"2024-09-13T18:27:01.310681+0000","last_active":"2024-09-13T18:27:02.562445+0000","last_peered":"2024-09-13T18:27:02.562445+0000","last_clean":"2024-09-13T18:27:02.562445+0000","last_became_active":"2024-09-13T18:27:01.310423+0000","last_became_peered":"2024-09-13T18:27:01.310423+0000","last_unstale":"2024-09-13T18:27:02.562445+0000","last_undegraded":"2024-09-13T18:27:02.562445+0000","last_fullsized":"2024-09-13T18:27:02.562445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286784+0000","last_change":"2024-09-13T18:27:01.303954+0000","last_active":"2024-09-13T18:27:02.286784+0000","last_peered":"2024-09-13T18:27:02.286784+0000","last_clean":"2024-09-13T18:27:02.286784+0000","last_became_active":"2024-09-13T18:27:01.303227+0000","last_became_peered":"2024-09-13T18:27:01.303227+0000","last_unstale":"2024-09-13T18:27:02.286784+0000","last_undegraded":"2024-09-13T18:27:02.286784+0000","last_fullsized":"2024-09-13T18:27:02.286784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288715+0000","last_change":"2024-09-13T18:27:01.296775+0000","last_active":"2024-09-13T18:27:02.288715+0000","last_peered":"2024-09-13T18:27:02.288715+0000","last_clean":"2024-09-13T18:27:02.288715+0000","last_became_active":"2024-09-13T18:27:01.296521+0000","last_became_peered":"2024-09-13T18:27:01.296521+0000","last_unstale":"2024-09-13T18:27:02.288715+0000","last_undegraded":"2024-09-13T18:27:02.288715+0000","last_fullsized":"2024-09-13T18:27:02.288715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:26.451272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286251+0000","last_change":"2024-09-13T18:27:01.302747+0000","last_active":"2024-09-13T18:27:02.286251+0000","last_peered":"2024-09-13T18:27:02.286251+0000","last_clean":"2024-09-13T18:27:02.286251+0000","last_became_active":"2024-09-13T18:27:01.302084+0000","last_became_peered":"2024-09-13T18:27:01.302084+0000","last_unstale":"2024-09-13T18:27:02.286251+0000","last_undegraded":"2024-09-13T18:27:02.286251+0000","last_fullsized":"2024-09-13T18:27:02.286251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:40.223464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289687+0000","last_change":"2024-09-13T18:27:01.296882+0000","last_active":"2024-09-13T18:27:02.289687+0000","last_peered":"2024-09-13T18:27:02.289687+0000","last_clean":"2024-09-13T18:27:02.289687+0000","last_became_active":"2024-09-13T18:27:01.296629+0000","last_became_peered":"2024-09-13T18:27:01.296629+0000","last_unstale":"2024-09-13T18:27:02.289687+0000","last_undegraded":"2024-09-13T18:27:02.289687+0000","last_fullsized":"2024-09-13T18:27:02.289687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:26.095535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562232+0000","last_change":"2024-09-13T18:27:01.301327+0000","last_active":"2024-09-13T18:27:02.562232+0000","last_peered":"2024-09-13T18:27:02.562232+0000","last_clean":"2024-09-13T18:27:02.562232+0000","last_became_active":"2024-09-13T18:27:01.301036+0000","last_became_peered":"2024-09-13T18:27:01.301036+0000","last_unstale":"2024-09-13T18:27:02.562232+0000","last_undegraded":"2024-09-13T18:27:02.562232+0000","last_fullsized":"2024-09-13T18:27:02.562232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:26.451272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288168+0000","last_change":"2024-09-13T18:27:01.303654+0000","last_active":"2024-09-13T18:27:02.288168+0000","last_peered":"2024-09-13T18:27:02.288168+0000","last_clean":"2024-09-13T18:27:02.288168+0000","last_became_active":"2024-09-13T18:27:01.303423+0000","last_became_peered":"2024-09-13T18:27:01.303423+0000","last_unstale":"2024-09-13T18:27:02.288168+0000","last_undegraded":"2024-09-13T18:27:02.288168+0000","last_fullsized":"2024-09-13T18:27:02.288168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:58.545057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289581+0000","last_change":"2024-09-13T18:27:01.306805+0000","last_active":"2024-09-13T18:27:02.289581+0000","last_peered":"2024-09-13T18:27:02.289581+0000","last_clean":"2024-09-13T18:27:02.289581+0000","last_became_active":"2024-09-13T18:27:01.306437+0000","last_became_peered":"2024-09-13T18:27:01.306437+0000","last_unstale":"2024-09-13T18:27:02.289581+0000","last_undegraded":"2024-09-13T18:27:02.289581+0000","last_fullsized":"2024-09-13T18:27:02.289581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:30.479538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562688+0000","last_change":"2024-09-13T18:27:01.304058+0000","last_active":"2024-09-13T18:27:02.562688+0000","last_peered":"2024-09-13T18:27:02.562688+0000","last_clean":"2024-09-13T18:27:02.562688+0000","last_became_active":"2024-09-13T18:27:01.303629+0000","last_became_peered":"2024-09-13T18:27:01.303629+0000","last_unstale":"2024-09-13T18:27:02.562688+0000","last_undegraded":"2024-09-13T18:27:02.562688+0000","last_fullsized":"2024-09-13T18:27:02.562688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:22.491328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287025+0000","last_change":"2024-09-13T18:27:01.304393+0000","last_active":"2024-09-13T18:27:02.287025+0000","last_peered":"2024-09-13T18:27:02.287025+0000","last_clean":"2024-09-13T18:27:02.287025+0000","last_became_active":"2024-09-13T18:27:01.304135+0000","last_became_peered":"2024-09-13T18:27:01.304135+0000","last_unstale":"2024-09-13T18:27:02.287025+0000","last_undegraded":"2024-09-13T18:27:02.287025+0000","last_fullsized":"2024-09-13T18:27:02.287025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:40.378467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562959+0000","last_change":"2024-09-13T18:27:01.302991+0000","last_active":"2024-09-13T18:27:02.562959+0000","last_peered":"2024-09-13T18:27:02.562959+0000","last_clean":"2024-09-13T18:27:02.562959+0000","last_became_active":"2024-09-13T18:27:01.302746+0000","last_became_peered":"2024-09-13T18:27:01.302746+0000","last_unstale":"2024-09-13T18:27:02.562959+0000","last_undegraded":"2024-09-13T18:27:02.562959+0000","last_fullsized":"2024-09-13T18:27:02.562959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:17.243480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.560846+0000","last_change":"2024-09-13T18:27:01.306888+0000","last_active":"2024-09-13T18:27:02.560846+0000","last_peered":"2024-09-13T18:27:02.560846+0000","last_clean":"2024-09-13T18:27:02.560846+0000","last_became_active":"2024-09-13T18:27:01.306593+0000","last_became_peered":"2024-09-13T18:27:01.306593+0000","last_unstale":"2024-09-13T18:27:02.560846+0000","last_undegraded":"2024-09-13T18:27:02.560846+0000","last_fullsized":"2024-09-13T18:27:02.560846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:26.095535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561343+0000","last_change":"2024-09-13T18:27:01.306267+0000","last_active":"2024-09-13T18:27:02.561343+0000","last_peered":"2024-09-13T18:27:02.561343+0000","last_clean":"2024-09-13T18:27:02.561343+0000","last_became_active":"2024-09-13T18:27:01.306016+0000","last_became_peered":"2024-09-13T18:27:01.306016+0000","last_unstale":"2024-09-13T18:27:02.561343+0000","last_undegraded":"2024-09-13T18:27:02.561343+0000","last_fullsized":"2024-09-13T18:27:02.561343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:59.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289534+0000","last_change":"2024-09-13T18:27:00.911539+0000","last_active":"2024-09-13T18:27:02.289534+0000","last_peered":"2024-09-13T18:27:02.289534+0000","last_clean":"2024-09-13T18:27:02.289534+0000","last_became_active":"2024-09-13T18:27:00.910841+0000","last_became_peered":"2024-09-13T18:27:00.910841+0000","last_unstale":"2024-09-13T18:27:02.289534+0000","last_undegraded":"2024-09-13T18:27:02.289534+0000","last_fullsized":"2024-09-13T18:27:02.289534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:53.385777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562937+0000","last_change":"2024-09-13T18:27:01.305382+0000","last_active":"2024-09-13T18:27:02.562937+0000","last_peered":"2024-09-13T18:27:02.562937+0000","last_clean":"2024-09-13T18:27:02.562937+0000","last_became_active":"2024-09-13T18:27:01.305139+0000","last_became_peered":"2024-09-13T18:27:01.305139+0000","last_unstale":"2024-09-13T18:27:02.562937+0000","last_undegraded":"2024-09-13T18:27:02.562937+0000","last_fullsized":"2024-09-13T18:27:02.562937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561575+0000","last_change":"2024-09-13T18:27:00.913328+0000","last_active":"2024-09-13T18:27:02.561575+0000","last_peered":"2024-09-13T18:27:02.561575+0000","last_clean":"2024-09-13T18:27:02.561575+0000","last_became_active":"2024-09-13T18:27:00.913086+0000","last_became_peered":"2024-09-13T18:27:00.913086+0000","last_unstale":"2024-09-13T18:27:02.561575+0000","last_undegraded":"2024-09-13T18:27:02.561575+0000","last_fullsized":"2024-09-13T18:27:02.561575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:53.385777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288807+0000","last_change":"2024-09-13T18:27:00.911854+0000","last_active":"2024-09-13T18:27:02.288807+0000","last_peered":"2024-09-13T18:27:02.288807+0000","last_clean":"2024-09-13T18:27:02.288807+0000","last_became_active":"2024-09-13T18:27:00.911591+0000","last_became_peered":"2024-09-13T18:27:00.911591+0000","last_unstale":"2024-09-13T18:27:02.288807+0000","last_undegraded":"2024-09-13T18:27:02.288807+0000","last_fullsized":"2024-09-13T18:27:02.288807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:06.968005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288348+0000","last_change":"2024-09-13T18:27:01.302897+0000","last_active":"2024-09-13T18:27:02.288348+0000","last_peered":"2024-09-13T18:27:02.288348+0000","last_clean":"2024-09-13T18:27:02.288348+0000","last_became_active":"2024-09-13T18:27:01.302678+0000","last_became_peered":"2024-09-13T18:27:01.302678+0000","last_unstale":"2024-09-13T18:27:02.288348+0000","last_undegraded":"2024-09-13T18:27:02.288348+0000","last_fullsized":"2024-09-13T18:27:02.288348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286340+0000","last_change":"2024-09-13T18:27:00.912605+0000","last_active":"2024-09-13T18:27:02.286340+0000","last_peered":"2024-09-13T18:27:02.286340+0000","last_clean":"2024-09-13T18:27:02.286340+0000","last_became_active":"2024-09-13T18:27:00.912293+0000","last_became_peered":"2024-09-13T18:27:00.912293+0000","last_unstale":"2024-09-13T18:27:02.286340+0000","last_undegraded":"2024-09-13T18:27:02.286340+0000","last_fullsized":"2024-09-13T18:27:02.286340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:15.665610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287553+0000","last_change":"2024-09-13T18:27:01.294866+0000","last_active":"2024-09-13T18:27:02.287553+0000","last_peered":"2024-09-13T18:27:02.287553+0000","last_clean":"2024-09-13T18:27:02.287553+0000","last_became_active":"2024-09-13T18:27:01.294614+0000","last_became_peered":"2024-09-13T18:27:01.294614+0000","last_unstale":"2024-09-13T18:27:02.287553+0000","last_undegraded":"2024-09-13T18:27:02.287553+0000","last_fullsized":"2024-09-13T18:27:02.287553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562622+0000","last_change":"2024-09-13T18:27:00.910126+0000","last_active":"2024-09-13T18:27:02.562622+0000","last_peered":"2024-09-13T18:27:02.562622+0000","last_clean":"2024-09-13T18:27:02.562622+0000","last_became_active":"2024-09-13T18:27:00.909845+0000","last_became_peered":"2024-09-13T18:27:00.909845+0000","last_unstale":"2024-09-13T18:27:02.562622+0000","last_undegraded":"2024-09-13T18:27:02.562622+0000","last_fullsized":"2024-09-13T18:27:02.562622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.933818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287706+0000","last_change":"2024-09-13T18:27:01.304023+0000","last_active":"2024-09-13T18:27:02.287706+0000","last_peered":"2024-09-13T18:27:02.287706+0000","last_clean":"2024-09-13T18:27:02.287706+0000","last_became_active":"2024-09-13T18:27:01.303683+0000","last_became_peered":"2024-09-13T18:27:01.303683+0000","last_unstale":"2024-09-13T18:27:02.287706+0000","last_undegraded":"2024-09-13T18:27:02.287706+0000","last_fullsized":"2024-09-13T18:27:02.287706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287684+0000","last_change":"2024-09-13T18:27:00.911226+0000","last_active":"2024-09-13T18:27:02.287684+0000","last_peered":"2024-09-13T18:27:02.287684+0000","last_clean":"2024-09-13T18:27:02.287684+0000","last_became_active":"2024-09-13T18:27:00.910878+0000","last_became_peered":"2024-09-13T18:27:00.910878+0000","last_unstale":"2024-09-13T18:27:02.287684+0000","last_undegraded":"2024-09-13T18:27:02.287684+0000","last_fullsized":"2024-09-13T18:27:02.287684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:58.428945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563113+0000","last_change":"2024-09-13T18:27:01.302430+0000","last_active":"2024-09-13T18:27:02.563113+0000","last_peered":"2024-09-13T18:27:02.563113+0000","last_clean":"2024-09-13T18:27:02.563113+0000","last_became_active":"2024-09-13T18:27:01.301355+0000","last_became_peered":"2024-09-13T18:27:01.301355+0000","last_unstale":"2024-09-13T18:27:02.563113+0000","last_undegraded":"2024-09-13T18:27:02.563113+0000","last_fullsized":"2024-09-13T18:27:02.563113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:26.095535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288349+0000","last_change":"2024-09-13T18:27:00.906914+0000","last_active":"2024-09-13T18:27:02.288349+0000","last_peered":"2024-09-13T18:27:02.288349+0000","last_clean":"2024-09-13T18:27:02.288349+0000","last_became_active":"2024-09-13T18:27:00.905751+0000","last_became_peered":"2024-09-13T18:27:00.905751+0000","last_unstale":"2024-09-13T18:27:02.288349+0000","last_undegraded":"2024-09-13T18:27:02.288349+0000","last_fullsized":"2024-09-13T18:27:02.288349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:13.103035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562471+0000","last_change":"2024-09-13T18:27:01.311919+0000","last_active":"2024-09-13T18:27:02.562471+0000","last_peered":"2024-09-13T18:27:02.562471+0000","last_clean":"2024-09-13T18:27:02.562471+0000","last_became_active":"2024-09-13T18:27:01.311087+0000","last_became_peered":"2024-09-13T18:27:01.311087+0000","last_unstale":"2024-09-13T18:27:02.562471+0000","last_undegraded":"2024-09-13T18:27:02.562471+0000","last_fullsized":"2024-09-13T18:27:02.562471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:14.113024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562110+0000","last_change":"2024-09-13T18:27:00.909802+0000","last_active":"2024-09-13T18:27:02.562110+0000","last_peered":"2024-09-13T18:27:02.562110+0000","last_clean":"2024-09-13T18:27:02.562110+0000","last_became_active":"2024-09-13T18:27:00.909547+0000","last_became_peered":"2024-09-13T18:27:00.909547+0000","last_unstale":"2024-09-13T18:27:02.562110+0000","last_undegraded":"2024-09-13T18:27:02.562110+0000","last_fullsized":"2024-09-13T18:27:02.562110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:13.103035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563137+0000","last_change":"2024-09-13T18:27:01.312609+0000","last_active":"2024-09-13T18:27:02.563137+0000","last_peered":"2024-09-13T18:27:02.563137+0000","last_clean":"2024-09-13T18:27:02.563137+0000","last_became_active":"2024-09-13T18:27:01.312314+0000","last_became_peered":"2024-09-13T18:27:01.312314+0000","last_unstale":"2024-09-13T18:27:02.563137+0000","last_undegraded":"2024-09-13T18:27:02.563137+0000","last_fullsized":"2024-09-13T18:27:02.563137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:38.650324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563169+0000","last_change":"2024-09-13T18:27:00.916915+0000","last_active":"2024-09-13T18:27:02.563169+0000","last_peered":"2024-09-13T18:27:02.563169+0000","last_clean":"2024-09-13T18:27:02.563169+0000","last_became_active":"2024-09-13T18:27:00.916632+0000","last_became_peered":"2024-09-13T18:27:00.916632+0000","last_unstale":"2024-09-13T18:27:02.563169+0000","last_undegraded":"2024-09-13T18:27:02.563169+0000","last_fullsized":"2024-09-13T18:27:02.563169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:50.705752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562755+0000","last_change":"2024-09-13T18:27:01.303166+0000","last_active":"2024-09-13T18:27:02.562755+0000","last_peered":"2024-09-13T18:27:02.562755+0000","last_clean":"2024-09-13T18:27:02.562755+0000","last_became_active":"2024-09-13T18:27:01.302924+0000","last_became_peered":"2024-09-13T18:27:01.302924+0000","last_unstale":"2024-09-13T18:27:02.562755+0000","last_undegraded":"2024-09-13T18:27:02.562755+0000","last_fullsized":"2024-09-13T18:27:02.562755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:04.793190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287214+0000","last_change":"2024-09-13T18:27:00.907398+0000","last_active":"2024-09-13T18:27:02.287214+0000","last_peered":"2024-09-13T18:27:02.287214+0000","last_clean":"2024-09-13T18:27:02.287214+0000","last_became_active":"2024-09-13T18:27:00.906944+0000","last_became_peered":"2024-09-13T18:27:00.906944+0000","last_unstale":"2024-09-13T18:27:02.287214+0000","last_undegraded":"2024-09-13T18:27:02.287214+0000","last_fullsized":"2024-09-13T18:27:02.287214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:06.968005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562208+0000","last_change":"2024-09-13T18:27:01.315035+0000","last_active":"2024-09-13T18:27:02.562208+0000","last_peered":"2024-09-13T18:27:02.562208+0000","last_clean":"2024-09-13T18:27:02.562208+0000","last_became_active":"2024-09-13T18:27:01.314681+0000","last_became_peered":"2024-09-13T18:27:01.314681+0000","last_unstale":"2024-09-13T18:27:02.562208+0000","last_undegraded":"2024-09-13T18:27:02.562208+0000","last_fullsized":"2024-09-13T18:27:02.562208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:36.178176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561303+0000","last_change":"2024-09-13T18:27:00.912840+0000","last_active":"2024-09-13T18:27:02.561303+0000","last_peered":"2024-09-13T18:27:02.561303+0000","last_clean":"2024-09-13T18:27:02.561303+0000","last_became_active":"2024-09-13T18:27:00.912602+0000","last_became_peered":"2024-09-13T18:27:00.912602+0000","last_unstale":"2024-09-13T18:27:02.561303+0000","last_undegraded":"2024-09-13T18:27:02.561303+0000","last_fullsized":"2024-09-13T18:27:02.561303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:15.665610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561087+0000","last_change":"2024-09-13T18:27:01.306616+0000","last_active":"2024-09-13T18:27:02.561087+0000","last_peered":"2024-09-13T18:27:02.561087+0000","last_clean":"2024-09-13T18:27:02.561087+0000","last_became_active":"2024-09-13T18:27:01.306284+0000","last_became_peered":"2024-09-13T18:27:01.306284+0000","last_unstale":"2024-09-13T18:27:02.561087+0000","last_undegraded":"2024-09-13T18:27:02.561087+0000","last_fullsized":"2024-09-13T18:27:02.561087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:30.479538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562519+0000","last_change":"2024-09-13T18:27:00.908275+0000","last_active":"2024-09-13T18:27:02.562519+0000","last_peered":"2024-09-13T18:27:02.562519+0000","last_clean":"2024-09-13T18:27:02.562519+0000","last_became_active":"2024-09-13T18:27:00.907829+0000","last_became_peered":"2024-09-13T18:27:00.907829+0000","last_unstale":"2024-09-13T18:27:02.562519+0000","last_undegraded":"2024-09-13T18:27:02.562519+0000","last_fullsized":"2024-09-13T18:27:02.562519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:25.457724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.560866+0000","last_change":"2024-09-13T18:27:01.314976+0000","last_active":"2024-09-13T18:27:02.560866+0000","last_peered":"2024-09-13T18:27:02.560866+0000","last_clean":"2024-09-13T18:27:02.560866+0000","last_became_active":"2024-09-13T18:27:01.314657+0000","last_became_peered":"2024-09-13T18:27:01.314657+0000","last_unstale":"2024-09-13T18:27:02.560866+0000","last_undegraded":"2024-09-13T18:27:02.560866+0000","last_fullsized":"2024-09-13T18:27:02.560866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562777+0000","last_change":"2024-09-13T18:27:00.912307+0000","last_active":"2024-09-13T18:27:02.562777+0000","last_peered":"2024-09-13T18:27:02.562777+0000","last_clean":"2024-09-13T18:27:02.562777+0000","last_became_active":"2024-09-13T18:27:00.911774+0000","last_became_peered":"2024-09-13T18:27:00.911774+0000","last_unstale":"2024-09-13T18:27:02.562777+0000","last_undegraded":"2024-09-13T18:27:02.562777+0000","last_fullsized":"2024-09-13T18:27:02.562777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:55.668790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563559+0000","last_change":"2024-09-13T18:27:01.315067+0000","last_active":"2024-09-13T18:27:02.563559+0000","last_peered":"2024-09-13T18:27:02.563559+0000","last_clean":"2024-09-13T18:27:02.563559+0000","last_became_active":"2024-09-13T18:27:01.314778+0000","last_became_peered":"2024-09-13T18:27:01.314778+0000","last_unstale":"2024-09-13T18:27:02.563559+0000","last_undegraded":"2024-09-13T18:27:02.563559+0000","last_fullsized":"2024-09-13T18:27:02.563559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562656+0000","last_change":"2024-09-13T18:27:00.911992+0000","last_active":"2024-09-13T18:27:02.562656+0000","last_peered":"2024-09-13T18:27:02.562656+0000","last_clean":"2024-09-13T18:27:02.562656+0000","last_became_active":"2024-09-13T18:27:00.911708+0000","last_became_peered":"2024-09-13T18:27:00.911708+0000","last_unstale":"2024-09-13T18:27:02.562656+0000","last_undegraded":"2024-09-13T18:27:02.562656+0000","last_fullsized":"2024-09-13T18:27:02.562656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:06.968005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563446+0000","last_change":"2024-09-13T18:27:01.314993+0000","last_active":"2024-09-13T18:27:02.563446+0000","last_peered":"2024-09-13T18:27:02.563446+0000","last_clean":"2024-09-13T18:27:02.563446+0000","last_became_active":"2024-09-13T18:27:01.314728+0000","last_became_peered":"2024-09-13T18:27:01.314728+0000","last_unstale":"2024-09-13T18:27:02.563446+0000","last_undegraded":"2024-09-13T18:27:02.563446+0000","last_fullsized":"2024-09-13T18:27:02.563446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:17.450610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288495+0000","last_change":"2024-09-13T18:27:00.904591+0000","last_active":"2024-09-13T18:27:02.288495+0000","last_peered":"2024-09-13T18:27:02.288495+0000","last_clean":"2024-09-13T18:27:02.288495+0000","last_became_active":"2024-09-13T18:27:00.904193+0000","last_became_peered":"2024-09-13T18:27:00.904193+0000","last_unstale":"2024-09-13T18:27:02.288495+0000","last_undegraded":"2024-09-13T18:27:02.288495+0000","last_fullsized":"2024-09-13T18:27:02.288495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.933818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287084+0000","last_change":"2024-09-13T18:27:01.303085+0000","last_active":"2024-09-13T18:27:02.287084+0000","last_peered":"2024-09-13T18:27:02.287084+0000","last_clean":"2024-09-13T18:27:02.287084+0000","last_became_active":"2024-09-13T18:27:01.302208+0000","last_became_peered":"2024-09-13T18:27:01.302208+0000","last_unstale":"2024-09-13T18:27:02.287084+0000","last_undegraded":"2024-09-13T18:27:02.287084+0000","last_fullsized":"2024-09-13T18:27:02.287084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:36.178176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563635+0000","last_change":"2024-09-13T18:27:00.913872+0000","last_active":"2024-09-13T18:27:02.563635+0000","last_peered":"2024-09-13T18:27:02.563635+0000","last_clean":"2024-09-13T18:27:02.563635+0000","last_became_active":"2024-09-13T18:27:00.913253+0000","last_became_peered":"2024-09-13T18:27:00.913253+0000","last_unstale":"2024-09-13T18:27:02.563635+0000","last_undegraded":"2024-09-13T18:27:02.563635+0000","last_fullsized":"2024-09-13T18:27:02.563635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:15.665610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563701+0000","last_change":"2024-09-13T18:27:01.309496+0000","last_active":"2024-09-13T18:27:02.563701+0000","last_peered":"2024-09-13T18:27:02.563701+0000","last_clean":"2024-09-13T18:27:02.563701+0000","last_became_active":"2024-09-13T18:27:01.309222+0000","last_became_peered":"2024-09-13T18:27:01.309222+0000","last_unstale":"2024-09-13T18:27:02.563701+0000","last_undegraded":"2024-09-13T18:27:02.563701+0000","last_fullsized":"2024-09-13T18:27:02.563701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:01.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:27:01.294854+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:27:01.294854+0000","last_peered":"2024-09-13T18:27:01.294854+0000","last_clean":"2024-09-13T18:27:01.294854+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:27:01.294854+0000","last_undegraded":"2024-09-13T18:27:01.294854+0000","last_fullsized":"2024-09-13T18:27:01.294854+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286187+0000","last_change":"2024-09-13T18:27:00.908757+0000","last_active":"2024-09-13T18:27:02.286187+0000","last_peered":"2024-09-13T18:27:02.286187+0000","last_clean":"2024-09-13T18:27:02.286187+0000","last_became_active":"2024-09-13T18:27:00.908473+0000","last_became_peered":"2024-09-13T18:27:00.908473+0000","last_unstale":"2024-09-13T18:27:02.286187+0000","last_undegraded":"2024-09-13T18:27:02.286187+0000","last_fullsized":"2024-09-13T18:27:02.286187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:13.103035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289057+0000","last_change":"2024-09-13T18:27:01.301499+0000","last_active":"2024-09-13T18:27:02.289057+0000","last_peered":"2024-09-13T18:27:02.289057+0000","last_clean":"2024-09-13T18:27:02.289057+0000","last_became_active":"2024-09-13T18:27:01.301225+0000","last_became_peered":"2024-09-13T18:27:01.301225+0000","last_unstale":"2024-09-13T18:27:02.289057+0000","last_undegraded":"2024-09-13T18:27:02.289057+0000","last_fullsized":"2024-09-13T18:27:02.289057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:17.918955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.560941+0000","last_change":"2024-09-13T18:27:00.913941+0000","last_active":"2024-09-13T18:27:02.560941+0000","last_peered":"2024-09-13T18:27:02.560941+0000","last_clean":"2024-09-13T18:27:02.560941+0000","last_became_active":"2024-09-13T18:27:00.913635+0000","last_became_peered":"2024-09-13T18:27:00.913635+0000","last_unstale":"2024-09-13T18:27:02.560941+0000","last_undegraded":"2024-09-13T18:27:02.560941+0000","last_fullsized":"2024-09-13T18:27:02.560941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:16.233492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562003+0000","last_change":"2024-09-13T18:27:01.305523+0000","last_active":"2024-09-13T18:27:02.562003+0000","last_peered":"2024-09-13T18:27:02.562003+0000","last_clean":"2024-09-13T18:27:02.562003+0000","last_became_active":"2024-09-13T18:27:01.305262+0000","last_became_peered":"2024-09-13T18:27:01.305262+0000","last_unstale":"2024-09-13T18:27:02.562003+0000","last_undegraded":"2024-09-13T18:27:02.562003+0000","last_fullsized":"2024-09-13T18:27:02.562003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:58.545057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563149+0000","last_change":"2024-09-13T18:27:00.908133+0000","last_active":"2024-09-13T18:27:02.563149+0000","last_peered":"2024-09-13T18:27:02.563149+0000","last_clean":"2024-09-13T18:27:02.563149+0000","last_became_active":"2024-09-13T18:27:00.907408+0000","last_became_peered":"2024-09-13T18:27:00.907408+0000","last_unstale":"2024-09-13T18:27:02.563149+0000","last_undegraded":"2024-09-13T18:27:02.563149+0000","last_fullsized":"2024-09-13T18:27:02.563149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:53.385777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287467+0000","last_change":"2024-09-13T18:27:01.302404+0000","last_active":"2024-09-13T18:27:02.287467+0000","last_peered":"2024-09-13T18:27:02.287467+0000","last_clean":"2024-09-13T18:27:02.287467+0000","last_became_active":"2024-09-13T18:27:01.302118+0000","last_became_peered":"2024-09-13T18:27:01.302118+0000","last_unstale":"2024-09-13T18:27:02.287467+0000","last_undegraded":"2024-09-13T18:27:02.287467+0000","last_fullsized":"2024-09-13T18:27:02.287467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:26.095535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287402+0000","last_change":"2024-09-13T18:27:00.904991+0000","last_active":"2024-09-13T18:27:02.287402+0000","last_peered":"2024-09-13T18:27:02.287402+0000","last_clean":"2024-09-13T18:27:02.287402+0000","last_became_active":"2024-09-13T18:27:00.903940+0000","last_became_peered":"2024-09-13T18:27:00.903940+0000","last_unstale":"2024-09-13T18:27:02.287402+0000","last_undegraded":"2024-09-13T18:27:02.287402+0000","last_fullsized":"2024-09-13T18:27:02.287402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:53.385777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561995+0000","last_change":"2024-09-13T18:27:01.303896+0000","last_active":"2024-09-13T18:27:02.561995+0000","last_peered":"2024-09-13T18:27:02.561995+0000","last_clean":"2024-09-13T18:27:02.561995+0000","last_became_active":"2024-09-13T18:27:01.303570+0000","last_became_peered":"2024-09-13T18:27:01.303570+0000","last_unstale":"2024-09-13T18:27:02.561995+0000","last_undegraded":"2024-09-13T18:27:02.561995+0000","last_fullsized":"2024-09-13T18:27:02.561995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:47.943806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288178+0000","last_change":"2024-09-13T18:27:00.911270+0000","last_active":"2024-09-13T18:27:02.288178+0000","last_peered":"2024-09-13T18:27:02.288178+0000","last_clean":"2024-09-13T18:27:02.288178+0000","last_became_active":"2024-09-13T18:27:00.910972+0000","last_became_peered":"2024-09-13T18:27:00.910972+0000","last_unstale":"2024-09-13T18:27:02.288178+0000","last_undegraded":"2024-09-13T18:27:02.288178+0000","last_fullsized":"2024-09-13T18:27:02.288178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:47.877280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286988+0000","last_change":"2024-09-13T18:27:01.301470+0000","last_active":"2024-09-13T18:27:02.286988+0000","last_peered":"2024-09-13T18:27:02.286988+0000","last_clean":"2024-09-13T18:27:02.286988+0000","last_became_active":"2024-09-13T18:27:01.301207+0000","last_became_peered":"2024-09-13T18:27:01.301207+0000","last_unstale":"2024-09-13T18:27:02.286988+0000","last_undegraded":"2024-09-13T18:27:02.286988+0000","last_fullsized":"2024-09-13T18:27:02.286988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:17.918955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563596+0000","last_change":"2024-09-13T18:27:00.912131+0000","last_active":"2024-09-13T18:27:02.563596+0000","last_peered":"2024-09-13T18:27:02.563596+0000","last_clean":"2024-09-13T18:27:02.563596+0000","last_became_active":"2024-09-13T18:27:00.911544+0000","last_became_peered":"2024-09-13T18:27:00.911544+0000","last_unstale":"2024-09-13T18:27:02.563596+0000","last_undegraded":"2024-09-13T18:27:02.563596+0000","last_fullsized":"2024-09-13T18:27:02.563596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:13.103035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287996+0000","last_change":"2024-09-13T18:27:01.300408+0000","last_active":"2024-09-13T18:27:02.287996+0000","last_peered":"2024-09-13T18:27:02.287996+0000","last_clean":"2024-09-13T18:27:02.287996+0000","last_became_active":"2024-09-13T18:27:01.300091+0000","last_became_peered":"2024-09-13T18:27:01.300091+0000","last_unstale":"2024-09-13T18:27:02.287996+0000","last_undegraded":"2024-09-13T18:27:02.287996+0000","last_fullsized":"2024-09-13T18:27:02.287996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:26.451272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288219+0000","last_change":"2024-09-13T18:27:00.912212+0000","last_active":"2024-09-13T18:27:02.288219+0000","last_peered":"2024-09-13T18:27:02.288219+0000","last_clean":"2024-09-13T18:27:02.288219+0000","last_became_active":"2024-09-13T18:27:00.911910+0000","last_became_peered":"2024-09-13T18:27:00.911910+0000","last_unstale":"2024-09-13T18:27:02.288219+0000","last_undegraded":"2024-09-13T18:27:02.288219+0000","last_fullsized":"2024-09-13T18:27:02.288219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:16.233492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289875+0000","last_change":"2024-09-13T18:27:01.312352+0000","last_active":"2024-09-13T18:27:02.289875+0000","last_peered":"2024-09-13T18:27:02.289875+0000","last_clean":"2024-09-13T18:27:02.289875+0000","last_became_active":"2024-09-13T18:27:01.311778+0000","last_became_peered":"2024-09-13T18:27:01.311778+0000","last_unstale":"2024-09-13T18:27:02.289875+0000","last_undegraded":"2024-09-13T18:27:02.289875+0000","last_fullsized":"2024-09-13T18:27:02.289875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:40.378467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562667+0000","last_change":"2024-09-13T18:27:00.911809+0000","last_active":"2024-09-13T18:27:02.562667+0000","last_peered":"2024-09-13T18:27:02.562667+0000","last_clean":"2024-09-13T18:27:02.562667+0000","last_became_active":"2024-09-13T18:27:00.911539+0000","last_became_peered":"2024-09-13T18:27:00.911539+0000","last_unstale":"2024-09-13T18:27:02.562667+0000","last_undegraded":"2024-09-13T18:27:02.562667+0000","last_fullsized":"2024-09-13T18:27:02.562667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:58.428945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563157+0000","last_change":"2024-09-13T18:27:01.307882+0000","last_active":"2024-09-13T18:27:02.563157+0000","last_peered":"2024-09-13T18:27:02.563157+0000","last_clean":"2024-09-13T18:27:02.563157+0000","last_became_active":"2024-09-13T18:27:01.307639+0000","last_became_peered":"2024-09-13T18:27:01.307639+0000","last_unstale":"2024-09-13T18:27:02.563157+0000","last_undegraded":"2024-09-13T18:27:02.563157+0000","last_fullsized":"2024-09-13T18:27:02.563157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:30.479538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.560713+0000","last_change":"2024-09-13T18:27:00.912694+0000","last_active":"2024-09-13T18:27:02.560713+0000","last_peered":"2024-09-13T18:27:02.560713+0000","last_clean":"2024-09-13T18:27:02.560713+0000","last_became_active":"2024-09-13T18:27:00.912437+0000","last_became_peered":"2024-09-13T18:27:00.912437+0000","last_unstale":"2024-09-13T18:27:02.560713+0000","last_undegraded":"2024-09-13T18:27:02.560713+0000","last_fullsized":"2024-09-13T18:27:02.560713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:03.783202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561673+0000","last_change":"2024-09-13T18:27:01.298321+0000","last_active":"2024-09-13T18:27:02.561673+0000","last_peered":"2024-09-13T18:27:02.561673+0000","last_clean":"2024-09-13T18:27:02.561673+0000","last_became_active":"2024-09-13T18:27:01.298027+0000","last_became_peered":"2024-09-13T18:27:01.298027+0000","last_unstale":"2024-09-13T18:27:02.561673+0000","last_undegraded":"2024-09-13T18:27:02.561673+0000","last_fullsized":"2024-09-13T18:27:02.561673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:04.793190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287769+0000","last_change":"2024-09-13T18:27:00.910495+0000","last_active":"2024-09-13T18:27:02.287769+0000","last_peered":"2024-09-13T18:27:02.287769+0000","last_clean":"2024-09-13T18:27:02.287769+0000","last_became_active":"2024-09-13T18:27:00.910212+0000","last_became_peered":"2024-09-13T18:27:00.910212+0000","last_unstale":"2024-09-13T18:27:02.287769+0000","last_undegraded":"2024-09-13T18:27:02.287769+0000","last_fullsized":"2024-09-13T18:27:02.287769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:03.783202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288669+0000","last_change":"2024-09-13T18:27:01.292715+0000","last_active":"2024-09-13T18:27:02.288669+0000","last_peered":"2024-09-13T18:27:02.288669+0000","last_clean":"2024-09-13T18:27:02.288669+0000","last_became_active":"2024-09-13T18:27:01.292437+0000","last_became_peered":"2024-09-13T18:27:01.292437+0000","last_unstale":"2024-09-13T18:27:02.288669+0000","last_undegraded":"2024-09-13T18:27:02.288669+0000","last_fullsized":"2024-09-13T18:27:02.288669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:58.545057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288228+0000","last_change":"2024-09-13T18:27:00.907866+0000","last_active":"2024-09-13T18:27:02.288228+0000","last_peered":"2024-09-13T18:27:02.288228+0000","last_clean":"2024-09-13T18:27:02.288228+0000","last_became_active":"2024-09-13T18:27:00.907562+0000","last_became_peered":"2024-09-13T18:27:00.907562+0000","last_unstale":"2024-09-13T18:27:02.288228+0000","last_undegraded":"2024-09-13T18:27:02.288228+0000","last_fullsized":"2024-09-13T18:27:02.288228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:58.428945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289387+0000","last_change":"2024-09-13T18:27:01.302235+0000","last_active":"2024-09-13T18:27:02.289387+0000","last_peered":"2024-09-13T18:27:02.289387+0000","last_clean":"2024-09-13T18:27:02.289387+0000","last_became_active":"2024-09-13T18:27:01.301993+0000","last_became_peered":"2024-09-13T18:27:01.301993+0000","last_unstale":"2024-09-13T18:27:02.289387+0000","last_undegraded":"2024-09-13T18:27:02.289387+0000","last_fullsized":"2024-09-13T18:27:02.289387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:36.752876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562564+0000","last_change":"2024-09-13T18:27:00.917608+0000","last_active":"2024-09-13T18:27:02.562564+0000","last_peered":"2024-09-13T18:27:02.562564+0000","last_clean":"2024-09-13T18:27:02.562564+0000","last_became_active":"2024-09-13T18:27:00.917334+0000","last_became_peered":"2024-09-13T18:27:00.917334+0000","last_unstale":"2024-09-13T18:27:02.562564+0000","last_undegraded":"2024-09-13T18:27:02.562564+0000","last_fullsized":"2024-09-13T18:27:02.562564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:53.385777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561361+0000","last_change":"2024-09-13T18:27:01.303769+0000","last_active":"2024-09-13T18:27:02.561361+0000","last_peered":"2024-09-13T18:27:02.561361+0000","last_clean":"2024-09-13T18:27:02.561361+0000","last_became_active":"2024-09-13T18:27:01.303409+0000","last_became_peered":"2024-09-13T18:27:01.303409+0000","last_unstale":"2024-09-13T18:27:02.561361+0000","last_undegraded":"2024-09-13T18:27:02.561361+0000","last_fullsized":"2024-09-13T18:27:02.561361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:58.545057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286775+0000","last_change":"2024-09-13T18:27:01.298238+0000","last_active":"2024-09-13T18:27:02.286775+0000","last_peered":"2024-09-13T18:27:02.286775+0000","last_clean":"2024-09-13T18:27:02.286775+0000","last_became_active":"2024-09-13T18:27:01.297937+0000","last_became_peered":"2024-09-13T18:27:01.297937+0000","last_unstale":"2024-09-13T18:27:02.286775+0000","last_undegraded":"2024-09-13T18:27:02.286775+0000","last_fullsized":"2024-09-13T18:27:02.286775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:36.752876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563094+0000","last_change":"2024-09-13T18:27:00.914839+0000","last_active":"2024-09-13T18:27:02.563094+0000","last_peered":"2024-09-13T18:27:02.563094+0000","last_clean":"2024-09-13T18:27:02.563094+0000","last_became_active":"2024-09-13T18:27:00.914550+0000","last_became_peered":"2024-09-13T18:27:00.914550+0000","last_unstale":"2024-09-13T18:27:02.563094+0000","last_undegraded":"2024-09-13T18:27:02.563094+0000","last_fullsized":"2024-09-13T18:27:02.563094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.933818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286874+0000","last_change":"2024-09-13T18:27:01.302873+0000","last_active":"2024-09-13T18:27:02.286874+0000","last_peered":"2024-09-13T18:27:02.286874+0000","last_clean":"2024-09-13T18:27:02.286874+0000","last_became_active":"2024-09-13T18:27:01.301780+0000","last_became_peered":"2024-09-13T18:27:01.301780+0000","last_unstale":"2024-09-13T18:27:02.286874+0000","last_undegraded":"2024-09-13T18:27:02.286874+0000","last_fullsized":"2024-09-13T18:27:02.286874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:17.450610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563342+0000","last_change":"2024-09-13T18:27:00.912304+0000","last_active":"2024-09-13T18:27:02.563342+0000","last_peered":"2024-09-13T18:27:02.563342+0000","last_clean":"2024-09-13T18:27:02.563342+0000","last_became_active":"2024-09-13T18:27:00.911868+0000","last_became_peered":"2024-09-13T18:27:00.911868+0000","last_unstale":"2024-09-13T18:27:02.563342+0000","last_undegraded":"2024-09-13T18:27:02.563342+0000","last_fullsized":"2024-09-13T18:27:02.563342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:58.428945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562947+0000","last_change":"2024-09-13T18:27:01.302701+0000","last_active":"2024-09-13T18:27:02.562947+0000","last_peered":"2024-09-13T18:27:02.562947+0000","last_clean":"2024-09-13T18:27:02.562947+0000","last_became_active":"2024-09-13T18:27:01.301626+0000","last_became_peered":"2024-09-13T18:27:01.301626+0000","last_unstale":"2024-09-13T18:27:02.562947+0000","last_undegraded":"2024-09-13T18:27:02.562947+0000","last_fullsized":"2024-09-13T18:27:02.562947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:26.451272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289813+0000","last_change":"2024-09-13T18:27:00.913872+0000","last_active":"2024-09-13T18:27:02.289813+0000","last_peered":"2024-09-13T18:27:02.289813+0000","last_clean":"2024-09-13T18:27:02.289813+0000","last_became_active":"2024-09-13T18:27:00.913585+0000","last_became_peered":"2024-09-13T18:27:00.913585+0000","last_unstale":"2024-09-13T18:27:02.289813+0000","last_undegraded":"2024-09-13T18:27:02.289813+0000","last_fullsized":"2024-09-13T18:27:02.289813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:15.665610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289768+0000","last_change":"2024-09-13T18:27:01.301513+0000","last_active":"2024-09-13T18:27:02.289768+0000","last_peered":"2024-09-13T18:27:02.289768+0000","last_clean":"2024-09-13T18:27:02.289768+0000","last_became_active":"2024-09-13T18:27:01.301080+0000","last_became_peered":"2024-09-13T18:27:01.301080+0000","last_unstale":"2024-09-13T18:27:02.289768+0000","last_undegraded":"2024-09-13T18:27:02.289768+0000","last_fullsized":"2024-09-13T18:27:02.289768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:07.409290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563285+0000","last_change":"2024-09-13T18:27:00.913198+0000","last_active":"2024-09-13T18:27:02.563285+0000","last_peered":"2024-09-13T18:27:02.563285+0000","last_clean":"2024-09-13T18:27:02.563285+0000","last_became_active":"2024-09-13T18:27:00.912840+0000","last_became_peered":"2024-09-13T18:27:00.912840+0000","last_unstale":"2024-09-13T18:27:02.563285+0000","last_undegraded":"2024-09-13T18:27:02.563285+0000","last_fullsized":"2024-09-13T18:27:02.563285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:25.457724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6870000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":823296,"data_stored":666575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:27:10.161 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:27:10.162 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T18:27:10.162 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T18:27:10.162 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T18:27:10.162 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T18:27:10.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f438b59e700 1 Processor -- start 2024-09-13T18:27:10.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f438b59e700 1 -- start start 2024-09-13T18:27:10.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f438b59e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f438c06cfb0 0x7f438c161e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:10.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f438b59e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438c06a310 con 0x7f438c0b38d0 2024-09-13T18:27:10.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f438b59e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438c06a5b0 con 0x7f438c160f70 2024-09-13T18:27:10.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f438b59e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f438c06a890 con 0x7f438c06cfb0 2024-09-13T18:27:10.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f4389d9b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f438c06cfb0 0x7f438c161e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:10.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f438ad9d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f438c0b38d0 0x7f438c1623d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52560/0 (socket says 172.21.15.44:52560) 2024-09-13T18:27:10.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f438ad9d700 1 -- 172.21.15.44:0/1982312527 learned_addr learned my addr 172.21.15.44:0/1982312527 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:10.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f4389d9b700 1 -- 172.21.15.44:0/1982312527 >> v1:172.21.15.99:6789/0 conn(0x7f438c160f70 legacy=0x7f438c0b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:10.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f438959a700 1 -- 172.21.15.44:0/1982312527 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485496896 0 0) 0x7f438c06a310 con 0x7f438c0b38d0 2024-09-13T18:27:10.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f4389d9b700 1 -- 172.21.15.44:0/1982312527 >> v1:172.21.15.44:6789/0 conn(0x7f438c0b38d0 legacy=0x7f438c1623d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:10.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f4389d9b700 1 -- 172.21.15.44:0/1982312527 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c06ab70 con 0x7f438c06cfb0 2024-09-13T18:27:10.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f4389d9b700 1 --2- 172.21.15.44:0/1982312527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f438c06cfb0 0x7f438c161e90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f43800097d0 tx=0x7f4380009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a3b7397e172302 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:10.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f438959a700 1 -- 172.21.15.44:0/1982312527 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4380004230 con 0x7f438c06cfb0 2024-09-13T18:27:10.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f438959a700 1 -- 172.21.15.44:0/1982312527 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4380004390 con 0x7f438c06cfb0 2024-09-13T18:27:10.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f438959a700 1 -- 172.21.15.44:0/1982312527 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43800036c0 con 0x7f438c06cfb0 2024-09-13T18:27:10.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f438b59e700 1 -- 172.21.15.44:0/1982312527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f438c06cfb0 msgr2=0x7f438c161e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:10.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f438b59e700 1 --2- 172.21.15.44:0/1982312527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f438c06cfb0 0x7f438c161e90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f43800097d0 tx=0x7f4380009ae0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f438b59e700 1 -- 172.21.15.44:0/1982312527 shutdown_connections 2024-09-13T18:27:10.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f438b59e700 1 --2- 172.21.15.44:0/1982312527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f438c06cfb0 0x7f438c161e90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f438b59e700 1 -- 172.21.15.44:0/1982312527 >> 172.21.15.44:0/1982312527 conn(0x7f438c06d900 msgr2=0x7f438c06dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:10.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f438b59e700 1 -- 172.21.15.44:0/1982312527 shutdown_connections 2024-09-13T18:27:10.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.275+0000 7f438b59e700 1 -- 172.21.15.44:0/1982312527 wait complete. 2024-09-13T18:27:10.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.279+0000 7f438b59e700 1 Processor -- start 2024-09-13T18:27:10.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.279+0000 7f438b59e700 1 -- start start 2024-09-13T18:27:10.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.279+0000 7f438b59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f438c06cfb0 0x7f438c154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:10.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.279+0000 7f438b59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f438c0b38d0 0x7f438c159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:10.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.279+0000 7f438b59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f438c160f70 0x7f438c0afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:10.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.279+0000 7f438b59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c0cd980 con 0x7f438c06cfb0 2024-09-13T18:27:10.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.279+0000 7f438b59e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c070320 con 0x7f438c0b38d0 2024-09-13T18:27:10.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.279+0000 7f438b59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438c154d30 con 0x7f438c160f70 2024-09-13T18:27:10.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.279+0000 7f438a59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f438c06cfb0 0x7f438c154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:10.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.279+0000 7f438a59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f438c06cfb0 0x7f438c154680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38718/0 (socket says 172.21.15.44:38718) 2024-09-13T18:27:10.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.279+0000 7f438a59c700 1 -- 172.21.15.44:0/2941309002 learned_addr learned my addr 172.21.15.44:0/2941309002 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:10.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.279+0000 7f438ad9d700 1 --2- 172.21.15.44:0/2941309002 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f438c160f70 0x7f438c0afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:10.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.279+0000 7f4389d9b700 1 --2- 172.21.15.44:0/2941309002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f438c0b38d0 0x7f438c159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:10.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.279+0000 7f438a59c700 1 -- 172.21.15.44:0/2941309002 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f438c160f70 msgr2=0x7f438c0afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:10.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.279+0000 7f438a59c700 1 --2- 172.21.15.44:0/2941309002 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f438c160f70 0x7f438c0afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.279+0000 7f438a59c700 1 -- 172.21.15.44:0/2941309002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f438c0b38d0 msgr2=0x7f438c159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:10.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.279+0000 7f438a59c700 1 --2- 172.21.15.44:0/2941309002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f438c0b38d0 0x7f438c159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.279+0000 7f438a59c700 1 -- 172.21.15.44:0/2941309002 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43800094b0 con 0x7f438c06cfb0 2024-09-13T18:27:10.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.283+0000 7f438a59c700 1 --2- 172.21.15.44:0/2941309002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f438c06cfb0 0x7f438c154680 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f437c00c780 tx=0x7f437c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:10.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.283+0000 7f437affd700 1 -- 172.21.15.44:0/2941309002 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c0054e0 con 0x7f438c06cfb0 2024-09-13T18:27:10.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.283+0000 7f437affd700 1 -- 172.21.15.44:0/2941309002 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437c0036a0 con 0x7f438c06cfb0 2024-09-13T18:27:10.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.283+0000 7f438b59e700 1 -- 172.21.15.44:0/2941309002 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438c0cdbd0 con 0x7f438c06cfb0 2024-09-13T18:27:10.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.283+0000 7f437affd700 1 -- 172.21.15.44:0/2941309002 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c003a50 con 0x7f438c06cfb0 2024-09-13T18:27:10.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.283+0000 7f438b59e700 1 -- 172.21.15.44:0/2941309002 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438c0ce190 con 0x7f438c06cfb0 2024-09-13T18:27:10.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.283+0000 7f438b59e700 1 -- 172.21.15.44:0/2941309002 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438c0b31c0 con 0x7f438c06cfb0 2024-09-13T18:27:10.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.283+0000 7f437affd700 1 -- 172.21.15.44:0/2941309002 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f437c003bb0 con 0x7f438c06cfb0 2024-09-13T18:27:10.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.283+0000 7f437affd700 1 --2- 172.21.15.44:0/2941309002 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f436c066760 0x7f436c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:10.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.283+0000 7f437affd700 1 -- 172.21.15.44:0/2941309002 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f437c0835a0 con 0x7f438c06cfb0 2024-09-13T18:27:10.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.283+0000 7f4389d9b700 1 --2- 172.21.15.44:0/2941309002 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f436c066760 0x7f436c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:10.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.287+0000 7f4389d9b700 1 --2- 172.21.15.44:0/2941309002 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f436c066760 0x7f436c068c20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f43800097d0 tx=0x7f4380010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:10.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.291+0000 7f437affd700 1 -- 172.21.15.44:0/2941309002 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f437c050900 con 0x7f438c06cfb0 2024-09-13T18:27:10.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.503+0000 7f438b59e700 1 -- 172.21.15.44:0/2941309002 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f438c1615a0 con 0x7f438c06cfb0 2024-09-13T18:27:10.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.511+0000 7f437affd700 1 -- 172.21.15.44:0/2941309002 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164899 (secure 0 0 0) 0x7f437c003e60 con 0x7f438c06cfb0 2024-09-13T18:27:10.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:10.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.515+0000 7f438b59e700 1 -- 172.21.15.44:0/2941309002 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f436c066760 msgr2=0x7f436c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:10.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.515+0000 7f438b59e700 1 --2- 172.21.15.44:0/2941309002 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f436c066760 0x7f436c068c20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f43800097d0 tx=0x7f4380010000 comp rx=0 tx=0).stop 2024-09-13T18:27:10.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.515+0000 7f438b59e700 1 -- 172.21.15.44:0/2941309002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f438c06cfb0 msgr2=0x7f438c154680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:10.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.515+0000 7f438b59e700 1 --2- 172.21.15.44:0/2941309002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f438c06cfb0 0x7f438c154680 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f437c00c780 tx=0x7f437c00ca90 comp rx=0 tx=0).stop 2024-09-13T18:27:10.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.515+0000 7f438b59e700 1 -- 172.21.15.44:0/2941309002 shutdown_connections 2024-09-13T18:27:10.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.515+0000 7f438b59e700 1 --2- 172.21.15.44:0/2941309002 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f436c066760 0x7f436c068c20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.515+0000 7f438b59e700 1 --2- 172.21.15.44:0/2941309002 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f438c160f70 0x7f438c0afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.515+0000 7f438b59e700 1 --2- 172.21.15.44:0/2941309002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f438c0b38d0 0x7f438c159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.515+0000 7f438b59e700 1 --2- 172.21.15.44:0/2941309002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f438c06cfb0 0x7f438c154680 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.515+0000 7f438b59e700 1 -- 172.21.15.44:0/2941309002 >> 172.21.15.44:0/2941309002 conn(0x7f438c06d900 msgr2=0x7f438c161e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:10.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.515+0000 7f438b59e700 1 -- 172.21.15.44:0/2941309002 shutdown_connections 2024-09-13T18:27:10.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.515+0000 7f438b59e700 1 -- 172.21.15.44:0/2941309002 wait complete. 2024-09-13T18:27:10.535 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2817469501},{"type":"v1","addr":"172.21.15.99:6833","nonce":2817469501}]},"active_addr":"172.21.15.99:6833/2817469501","active_change":"2024-09-13T18:26:42.299722+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4129,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":1771282429}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":1648665226}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":3835287205}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":448011349}]}]} 2024-09-13T18:27:10.538 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T18:27:10.539 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T18:27:10.539 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:10.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.647+0000 7fb59b26f700 1 Processor -- start 2024-09-13T18:27:10.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.647+0000 7fb59b26f700 1 -- start start 2024-09-13T18:27:10.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59b26f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb594165590 0x7fb5941619a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:10.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59b26f700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb594071f30 con 0x7fb594160eb0 2024-09-13T18:27:10.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59b26f700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5941622e0 con 0x7fb5940b3ae0 2024-09-13T18:27:10.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59b26f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb594162000 con 0x7fb594165590 2024-09-13T18:27:10.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59a26d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb594160eb0 0x7fb5940b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52570/0 (socket says 172.21.15.44:52570) 2024-09-13T18:27:10.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59a26d700 1 -- 172.21.15.44:0/3926820688 learned_addr learned my addr 172.21.15.44:0/3926820688 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:10.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59aa6e700 1 --2- 172.21.15.44:0/3926820688 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb594165590 0x7fb5941619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:10.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59926b700 1 -- 172.21.15.44:0/3926820688 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270840485 0 0) 0x7fb594071f30 con 0x7fb594160eb0 2024-09-13T18:27:10.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59926b700 1 -- 172.21.15.44:0/3926820688 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5800035d0 con 0x7fb594160eb0 2024-09-13T18:27:10.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59926b700 1 -- 172.21.15.44:0/3926820688 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1471791486 0 0) 0x7fb5941622e0 con 0x7fb5940b3ae0 2024-09-13T18:27:10.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59926b700 1 -- 172.21.15.44:0/3926820688 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb594071f30 con 0x7fb5940b3ae0 2024-09-13T18:27:10.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59aa6e700 1 -- 172.21.15.44:0/3926820688 >> v1:172.21.15.99:6789/0 conn(0x7fb5940b3ae0 legacy=0x7fb594161290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:10.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59aa6e700 1 -- 172.21.15.44:0/3926820688 >> v1:172.21.15.44:6789/0 conn(0x7fb594160eb0 legacy=0x7fb5940b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:10.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59aa6e700 1 -- 172.21.15.44:0/3926820688 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb594164ab0 con 0x7fb594165590 2024-09-13T18:27:10.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59aa6e700 1 --2- 172.21.15.44:0/3926820688 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb594165590 0x7fb5941619a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb58c009dc0 tx=0x7fb58c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9040011673113383 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:10.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59926b700 1 -- 172.21.15.44:0/3926820688 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c00e070 con 0x7fb594165590 2024-09-13T18:27:10.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59926b700 1 -- 172.21.15.44:0/3926820688 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c00bb20 con 0x7fb594165590 2024-09-13T18:27:10.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59926b700 1 -- 172.21.15.44:0/3926820688 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c012430 con 0x7fb594165590 2024-09-13T18:27:10.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59b26f700 1 -- 172.21.15.44:0/3926820688 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb594165590 msgr2=0x7fb5941619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:10.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59b26f700 1 --2- 172.21.15.44:0/3926820688 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb594165590 0x7fb5941619a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb58c009dc0 tx=0x7fb58c00b330 comp rx=0 tx=0).stop 2024-09-13T18:27:10.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59b26f700 1 -- 172.21.15.44:0/3926820688 shutdown_connections 2024-09-13T18:27:10.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59b26f700 1 --2- 172.21.15.44:0/3926820688 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb594165590 0x7fb5941619a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59b26f700 1 -- 172.21.15.44:0/3926820688 >> 172.21.15.44:0/3926820688 conn(0x7fb5940b0f00 msgr2=0x7fb5940b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:10.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59b26f700 1 -- 172.21.15.44:0/3926820688 shutdown_connections 2024-09-13T18:27:10.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.651+0000 7fb59b26f700 1 -- 172.21.15.44:0/3926820688 wait complete. 2024-09-13T18:27:10.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.655+0000 7fb59b26f700 1 Processor -- start 2024-09-13T18:27:10.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.655+0000 7fb59b26f700 1 -- start start 2024-09-13T18:27:10.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.655+0000 7fb59b26f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5940b3ae0 0x7fb594151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:10.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.655+0000 7fb59b26f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb594160eb0 0x7fb5940ab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:10.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.655+0000 7fb59b26f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb594165590 0x7fb5941636b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:10.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.655+0000 7fb59b26f700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5940a9510 con 0x7fb594165590 2024-09-13T18:27:10.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.655+0000 7fb59b26f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5940a88d0 con 0x7fb5940b3ae0 2024-09-13T18:27:10.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.655+0000 7fb59b26f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb594151ec0 con 0x7fb594160eb0 2024-09-13T18:27:10.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.655+0000 7fb59aa6e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb594165590 0x7fb5941636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:10.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.655+0000 7fb59a26d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5940b3ae0 0x7fb594151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:10.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.655+0000 7fb599a6c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb594160eb0 0x7fb5940ab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:10.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.655+0000 7fb59aa6e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb594165590 0x7fb5941636b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38724/0 (socket says 172.21.15.44:38724) 2024-09-13T18:27:10.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.655+0000 7fb59aa6e700 1 -- 172.21.15.44:0/3965765590 learned_addr learned my addr 172.21.15.44:0/3965765590 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:10.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.655+0000 7fb59aa6e700 1 -- 172.21.15.44:0/3965765590 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb594160eb0 msgr2=0x7fb5940ab5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:10.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.655+0000 7fb59aa6e700 1 --2- 172.21.15.44:0/3965765590 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb594160eb0 0x7fb5940ab5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.655+0000 7fb59aa6e700 1 -- 172.21.15.44:0/3965765590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5940b3ae0 msgr2=0x7fb594151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:10.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.655+0000 7fb59aa6e700 1 --2- 172.21.15.44:0/3965765590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5940b3ae0 0x7fb594151980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.655+0000 7fb59aa6e700 1 -- 172.21.15.44:0/3965765590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58c009a70 con 0x7fb594165590 2024-09-13T18:27:10.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.655+0000 7fb599a6c700 1 --2- 172.21.15.44:0/3965765590 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb594160eb0 0x7fb5940ab5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:10.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.655+0000 7fb59a26d700 1 --2- 172.21.15.44:0/3965765590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5940b3ae0 0x7fb594151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:10.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.655+0000 7fb59aa6e700 1 --2- 172.21.15.44:0/3965765590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb594165590 0x7fb5941636b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb58c00b370 tx=0x7fb58c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:10.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.659+0000 7fb58affd700 1 -- 172.21.15.44:0/3965765590 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c012430 con 0x7fb594165590 2024-09-13T18:27:10.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.659+0000 7fb58affd700 1 -- 172.21.15.44:0/3965765590 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c020070 con 0x7fb594165590 2024-09-13T18:27:10.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.659+0000 7fb59b26f700 1 -- 172.21.15.44:0/3965765590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5940a8b70 con 0x7fb594165590 2024-09-13T18:27:10.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.659+0000 7fb58affd700 1 -- 172.21.15.44:0/3965765590 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c01ba50 con 0x7fb594165590 2024-09-13T18:27:10.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.659+0000 7fb59b26f700 1 -- 172.21.15.44:0/3965765590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5940a9130 con 0x7fb594165590 2024-09-13T18:27:10.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.659+0000 7fb59b26f700 1 -- 172.21.15.44:0/3965765590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5940a9650 con 0x7fb594165590 2024-09-13T18:27:10.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.659+0000 7fb58affd700 1 -- 172.21.15.44:0/3965765590 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb58c01bbb0 con 0x7fb594165590 2024-09-13T18:27:10.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.663+0000 7fb58affd700 1 --2- 172.21.15.44:0/3965765590 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb578066730 0x7fb578068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:10.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.663+0000 7fb58affd700 1 -- 172.21.15.44:0/3965765590 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb58c022070 con 0x7fb594165590 2024-09-13T18:27:10.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.663+0000 7fb59a26d700 1 --2- 172.21.15.44:0/3965765590 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb578066730 0x7fb578068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:10.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.663+0000 7fb59a26d700 1 --2- 172.21.15.44:0/3965765590 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb578066730 0x7fb578068bf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb590000f60 tx=0x7fb590007e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:10.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.671+0000 7fb58affd700 1 -- 172.21.15.44:0/3965765590 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb5940a9650 con 0x7fb594165590 2024-09-13T18:27:10.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.847+0000 7fb59b26f700 1 -- 172.21.15.44:0/3965765590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5940a9650 con 0x7fb594165590 2024-09-13T18:27:10.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.851+0000 7fb58affd700 1 -- 172.21.15.44:0/3965765590 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fb5940a9650 con 0x7fb594165590 2024-09-13T18:27:10.856 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:10.856 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:02.280221+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.851+0000 7fb59b26f700 1 -- 172.21.15.44:0/3965765590 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb578066730 msgr2=0x7fb578068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.851+0000 7fb59b26f700 1 --2- 172.21.15.44:0/3965765590 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb578066730 0x7fb578068bf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb590000f60 tx=0x7fb590007e00 comp rx=0 tx=0).stop 2024-09-13T18:27:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.851+0000 7fb59b26f700 1 -- 172.21.15.44:0/3965765590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb594165590 msgr2=0x7fb5941636b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:10.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.851+0000 7fb59b26f700 1 --2- 172.21.15.44:0/3965765590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb594165590 0x7fb5941636b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb58c00b370 tx=0x7fb58c004af0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.855+0000 7fb59b26f700 1 -- 172.21.15.44:0/3965765590 shutdown_connections 2024-09-13T18:27:10.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.855+0000 7fb59b26f700 1 --2- 172.21.15.44:0/3965765590 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb578066730 0x7fb578068bf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.855+0000 7fb59b26f700 1 --2- 172.21.15.44:0/3965765590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb594165590 0x7fb5941636b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.855+0000 7fb59b26f700 1 --2- 172.21.15.44:0/3965765590 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb594160eb0 0x7fb5940ab5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.855+0000 7fb59b26f700 1 --2- 172.21.15.44:0/3965765590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5940b3ae0 0x7fb594151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.855+0000 7fb59b26f700 1 -- 172.21.15.44:0/3965765590 >> 172.21.15.44:0/3965765590 conn(0x7fb5940b0f00 msgr2=0x7fb5940b2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:10.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.855+0000 7fb59b26f700 1 -- 172.21.15.44:0/3965765590 shutdown_connections 2024-09-13T18:27:10.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.855+0000 7fb59b26f700 1 -- 172.21.15.44:0/3965765590 wait complete. 2024-09-13T18:27:10.870 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T18:27:10.870 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:10.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.983+0000 7fe5c3591700 1 Processor -- start 2024-09-13T18:27:10.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.983+0000 7fe5c3591700 1 -- start start 2024-09-13T18:27:10.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.983+0000 7fe5c3591700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe5bc06bbf0 0x7fe5bc0b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:10.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.983+0000 7fe5c3591700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe5bc06acc0 0x7fe5bc15e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:10.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c3591700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5bc13dcb0 con 0x7fe5bc0b3910 2024-09-13T18:27:10.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c3591700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5bc15be60 con 0x7fe5bc06bbf0 2024-09-13T18:27:10.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c3591700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc13ffd0 con 0x7fe5bc06acc0 2024-09-13T18:27:10.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c258f700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe5bc06bbf0 0x7fe5bc0b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:10.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c1d8e700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe5bc0b3910 0x7fe5bc06a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52576/0 (socket says 172.21.15.44:52576) 2024-09-13T18:27:10.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c1d8e700 1 -- 172.21.15.44:0/3357184892 learned_addr learned my addr 172.21.15.44:0/3357184892 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:10.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c2d90700 1 --2- 172.21.15.44:0/3357184892 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe5bc06acc0 0x7fe5bc15e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:10.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c158d700 1 -- 172.21.15.44:0/3357184892 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2524414551 0 0) 0x7fe5bc13dcb0 con 0x7fe5bc0b3910 2024-09-13T18:27:10.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c158d700 1 -- 172.21.15.44:0/3357184892 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5a80035d0 con 0x7fe5bc0b3910 2024-09-13T18:27:10.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c158d700 1 -- 172.21.15.44:0/3357184892 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4134191519 0 0) 0x7fe5a80035d0 con 0x7fe5bc0b3910 2024-09-13T18:27:10.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c258f700 1 -- 172.21.15.44:0/3357184892 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe5bc06acc0 msgr2=0x7fe5bc15e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:10.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c258f700 1 --2- 172.21.15.44:0/3357184892 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe5bc06acc0 0x7fe5bc15e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c258f700 1 -- 172.21.15.44:0/3357184892 >> v1:172.21.15.44:6789/0 conn(0x7fe5bc0b3910 legacy=0x7fe5bc06a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:10.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c258f700 1 -- 172.21.15.44:0/3357184892 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc0b3d70 con 0x7fe5bc06bbf0 2024-09-13T18:27:10.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c258f700 1 --2- 172.21.15.44:0/3357184892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5bc06bbf0 0x7fe5bc0b33d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009850 tx=0x7fe5b8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539bf898fb50142 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:10.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c158d700 1 -- 172.21.15.44:0/3357184892 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac001670 con 0x7fe5bc06bbf0 2024-09-13T18:27:10.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c158d700 1 -- 172.21.15.44:0/3357184892 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b8004030 con 0x7fe5bc06bbf0 2024-09-13T18:27:10.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c158d700 1 -- 172.21.15.44:0/3357184892 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b80043e0 con 0x7fe5bc06bbf0 2024-09-13T18:27:10.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c3591700 1 -- 172.21.15.44:0/3357184892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5bc06bbf0 msgr2=0x7fe5bc0b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:10.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c3591700 1 --2- 172.21.15.44:0/3357184892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5bc06bbf0 0x7fe5bc0b33d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009850 tx=0x7fe5b8009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:10.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c3591700 1 -- 172.21.15.44:0/3357184892 shutdown_connections 2024-09-13T18:27:10.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c3591700 1 --2- 172.21.15.44:0/3357184892 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe5bc06acc0 0x7fe5bc15e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c3591700 1 --2- 172.21.15.44:0/3357184892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5bc06bbf0 0x7fe5bc0b33d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c3591700 1 -- 172.21.15.44:0/3357184892 >> 172.21.15.44:0/3357184892 conn(0x7fe5bc0b0f00 msgr2=0x7fe5bc0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:10.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c3591700 1 -- 172.21.15.44:0/3357184892 shutdown_connections 2024-09-13T18:27:10.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.987+0000 7fe5c3591700 1 -- 172.21.15.44:0/3357184892 wait complete. 2024-09-13T18:27:10.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5c3591700 1 Processor -- start 2024-09-13T18:27:10.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5c3591700 1 -- start start 2024-09-13T18:27:10.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5c3591700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5bc06acc0 0x7fe5bc1410c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:10.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5c3591700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe5bc06bbf0 0x7fe5bc13d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:10.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5c3591700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5bc0b3910 0x7fe5bc1596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:10.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5c3591700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc142520 con 0x7fe5bc0b3910 2024-09-13T18:27:10.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5c3591700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc141910 con 0x7fe5bc06acc0 2024-09-13T18:27:10.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5c3591700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc141bf0 con 0x7fe5bc06bbf0 2024-09-13T18:27:10.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5c2d90700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5bc0b3910 0x7fe5bc1596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:10.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5c2d90700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5bc0b3910 0x7fe5bc1596d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38742/0 (socket says 172.21.15.44:38742) 2024-09-13T18:27:10.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5c2d90700 1 -- 172.21.15.44:0/927508084 learned_addr learned my addr 172.21.15.44:0/927508084 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:10.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5c1d8e700 1 --2- 172.21.15.44:0/927508084 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe5bc06bbf0 0x7fe5bc13d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:10.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5c258f700 1 --2- 172.21.15.44:0/927508084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5bc06acc0 0x7fe5bc1410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:10.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5c2d90700 1 -- 172.21.15.44:0/927508084 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe5bc06bbf0 msgr2=0x7fe5bc13d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:10.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5c2d90700 1 --2- 172.21.15.44:0/927508084 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe5bc06bbf0 0x7fe5bc13d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5c2d90700 1 -- 172.21.15.44:0/927508084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5bc06acc0 msgr2=0x7fe5bc1410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:10.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5c2d90700 1 --2- 172.21.15.44:0/927508084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5bc06acc0 0x7fe5bc1410c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:10.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5c2d90700 1 -- 172.21.15.44:0/927508084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b80094b0 con 0x7fe5bc0b3910 2024-09-13T18:27:10.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5c2d90700 1 --2- 172.21.15.44:0/927508084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5bc0b3910 0x7fe5bc1596d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400efc0 tx=0x7fe5b400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:10.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5b2ffd700 1 -- 172.21.15.44:0/927508084 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b400cd40 con 0x7fe5bc0b3910 2024-09-13T18:27:10.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5b2ffd700 1 -- 172.21.15.44:0/927508084 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b400f040 con 0x7fe5bc0b3910 2024-09-13T18:27:10.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5b2ffd700 1 -- 172.21.15.44:0/927508084 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b40146c0 con 0x7fe5bc0b3910 2024-09-13T18:27:10.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5c3591700 1 -- 172.21.15.44:0/927508084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5bc141ed0 con 0x7fe5bc0b3910 2024-09-13T18:27:10.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5c3591700 1 -- 172.21.15.44:0/927508084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5bc141600 con 0x7fe5bc0b3910 2024-09-13T18:27:10.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.991+0000 7fe5c3591700 1 -- 172.21.15.44:0/927508084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5bc1426d0 con 0x7fe5bc0b3910 2024-09-13T18:27:10.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.995+0000 7fe5b2ffd700 1 -- 172.21.15.44:0/927508084 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe5b4014820 con 0x7fe5bc0b3910 2024-09-13T18:27:10.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.995+0000 7fe5b2ffd700 1 --2- 172.21.15.44:0/927508084 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe5a0066730 0x7fe5a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.995+0000 7fe5b2ffd700 1 -- 172.21.15.44:0/927508084 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5b4084e40 con 0x7fe5bc0b3910 2024-09-13T18:27:11.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.995+0000 7fe5c258f700 1 --2- 172.21.15.44:0/927508084 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe5a0066730 0x7fe5a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:10.995+0000 7fe5c258f700 1 --2- 172.21.15.44:0/927508084 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe5a0066730 0x7fe5a0068bf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80090b0 tx=0x7fe5b8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.003+0000 7fe5b2ffd700 1 -- 172.21.15.44:0/927508084 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe5bc1426d0 con 0x7fe5bc0b3910 2024-09-13T18:27:11.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.175+0000 7fe5c3591700 1 -- 172.21.15.44:0/927508084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5bc06bfd0 con 0x7fe5bc0b3910 2024-09-13T18:27:11.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.175+0000 7fe5b2ffd700 1 -- 172.21.15.44:0/927508084 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fe5b4055bc0 con 0x7fe5bc0b3910 2024-09-13T18:27:11.181 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:11.181 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:02.280221+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:11.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.179+0000 7fe5c3591700 1 -- 172.21.15.44:0/927508084 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe5a0066730 msgr2=0x7fe5a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.179+0000 7fe5c3591700 1 --2- 172.21.15.44:0/927508084 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe5a0066730 0x7fe5a0068bf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80090b0 tx=0x7fe5b8008030 comp rx=0 tx=0).stop 2024-09-13T18:27:11.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.179+0000 7fe5c3591700 1 -- 172.21.15.44:0/927508084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5bc0b3910 msgr2=0x7fe5bc1596d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.179+0000 7fe5c3591700 1 --2- 172.21.15.44:0/927508084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5bc0b3910 0x7fe5bc1596d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400efc0 tx=0x7fe5b400c3a0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.179+0000 7fe5c3591700 1 -- 172.21.15.44:0/927508084 shutdown_connections 2024-09-13T18:27:11.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.179+0000 7fe5c3591700 1 --2- 172.21.15.44:0/927508084 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe5a0066730 0x7fe5a0068bf0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.179+0000 7fe5c3591700 1 --2- 172.21.15.44:0/927508084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5bc0b3910 0x7fe5bc1596d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.179+0000 7fe5c3591700 1 --2- 172.21.15.44:0/927508084 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe5bc06bbf0 0x7fe5bc13d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.179+0000 7fe5c3591700 1 --2- 172.21.15.44:0/927508084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5bc06acc0 0x7fe5bc1410c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.179+0000 7fe5c3591700 1 -- 172.21.15.44:0/927508084 >> 172.21.15.44:0/927508084 conn(0x7fe5bc0b0f00 msgr2=0x7fe5bc06d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.179+0000 7fe5c3591700 1 -- 172.21.15.44:0/927508084 shutdown_connections 2024-09-13T18:27:11.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.179+0000 7fe5c3591700 1 -- 172.21.15.44:0/927508084 wait complete. 2024-09-13T18:27:11.197 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T18:27:11.197 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T18:27:11.198 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T18:27:11.200 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T18:27:11.200 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T18:27:11.200 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T18:27:11.201 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-13T18:27:11.201 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-13T18:27:11.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f9404e10700 1 Processor -- start 2024-09-13T18:27:11.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f0e631de700 1 Processor -- start 2024-09-13T18:27:11.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f0e631de700 1 -- start start 2024-09-13T18:27:11.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f9404e10700 1 -- start start 2024-09-13T18:27:11.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f43f3c0a700 1 Processor -- start 2024-09-13T18:27:11.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f43f3c0a700 1 -- start start 2024-09-13T18:27:11.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f0e631de700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0e5c146480 0x7f0e5c0704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f0e631de700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0e5c0cc810 0x7f0e5c0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f0e631de700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e5c070e80 con 0x7f0e5c15dd90 2024-09-13T18:27:11.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f0e631de700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e5c071160 con 0x7f0e5c0cc810 2024-09-13T18:27:11.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f0e631de700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e5c071440 con 0x7f0e5c146480 2024-09-13T18:27:11.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f7bec7ea700 1 Processor -- start 2024-09-13T18:27:11.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f7bec7ea700 1 -- start start 2024-09-13T18:27:11.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f9404e10700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f940006d8c0 0x7f9400164a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f9404e10700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9400070bd0 0x7f9400163280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f9404e10700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9400162570 con 0x7f9400164f90 2024-09-13T18:27:11.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f9404e10700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9400162e60 con 0x7f940006d8c0 2024-09-13T18:27:11.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f9404e10700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9400071060 con 0x7f9400070bd0 2024-09-13T18:27:11.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f0e629dd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0e5c0cc810 0x7f0e5c0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f93ff7fe700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f940006d8c0 0x7f9400164a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f0e621dc700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0e5c146480 0x7f0e5c0704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f0e629dd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0e5c0cc810 0x7f0e5c0ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38752/0 (socket says 172.21.15.44:38752) 2024-09-13T18:27:11.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f0e619db700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0e5c15dd90 0x7f0e5c0cc100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:39978/0 (socket says 172.21.15.44:39978) 2024-09-13T18:27:11.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f0e619db700 1 -- 172.21.15.44:0/428896293 learned_addr learned my addr 172.21.15.44:0/428896293 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:11.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f43f3c0a700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f43ec0ccd50 0x7f43ec0b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f43f3c0a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f43ec0b4a00 0x7f43ec06c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f43f3c0a700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ec0b3f50 con 0x7f43ec1436c0 2024-09-13T18:27:11.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f43f3c0a700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ec0b4230 con 0x7f43ec0ccd50 2024-09-13T18:27:11.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f43f3c0a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec0b4e90 con 0x7f43ec0b4a00 2024-09-13T18:27:11.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f93ff7fe700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f940006d8c0 0x7f9400164a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:58910/0 (socket says 172.21.15.44:58910) 2024-09-13T18:27:11.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f93ff7fe700 1 -- 172.21.15.44:0/1562452053 learned_addr learned my addr 172.21.15.44:0/1562452053 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f93fffff700 1 --2- 172.21.15.44:0/1562452053 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9400070bd0 0x7f9400163280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f43f19a6700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f43ec1436c0 0x7f43ec0b3490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52580/0 (socket says 172.21.15.44:52580) 2024-09-13T18:27:11.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f43f19a6700 1 -- 172.21.15.44:0/6330368 learned_addr learned my addr 172.21.15.44:0/6330368 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:11.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f43f11a5700 1 --2- 172.21.15.44:0/6330368 >> v2:172.21.15.44:3300/0 conn(0x7f43ec0ccd50 0x7f43ec0b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f43f21a7700 1 --2- 172.21.15.44:0/6330368 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f43ec0b4a00 0x7f43ec06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f93fffff700 1 -- 172.21.15.44:0/1562452053 >> v2:172.21.15.99:3300/0 conn(0x7f940006d8c0 msgr2=0x7f9400164a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f93fffff700 1 --2- 172.21.15.44:0/1562452053 >> v2:172.21.15.99:3300/0 conn(0x7f940006d8c0 0x7f9400164a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f93fffff700 1 -- 172.21.15.44:0/1562452053 >> v1:172.21.15.99:6789/0 conn(0x7f9400164f90 legacy=0x7f94000704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f93fffff700 1 -- 172.21.15.44:0/1562452053 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9400071240 con 0x7f9400070bd0 2024-09-13T18:27:11.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f7bec7ea700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7be413e580 0x7f7be40b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f7bec7ea700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be40b3840 con 0x7f7be40b30c0 2024-09-13T18:27:11.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f7bec7ea700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be40b3b20 con 0x7f7be413e1a0 2024-09-13T18:27:11.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f7bec7ea700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be40b3e00 con 0x7f7be413e580 2024-09-13T18:27:11.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f7bead87700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7be40b30c0 0x7f7be413c250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52594/0 (socket says 172.21.15.44:52594) 2024-09-13T18:27:11.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f7bead87700 1 -- 172.21.15.44:0/2778767638 learned_addr learned my addr 172.21.15.44:0/2778767638 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:11.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f0e611da700 1 -- 172.21.15.44:0/428896293 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987220078 0 0) 0x7f0e5c070e80 con 0x7f0e5c15dd90 2024-09-13T18:27:11.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f0e611da700 1 -- 172.21.15.44:0/428896293 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e480035d0 con 0x7f0e5c15dd90 2024-09-13T18:27:11.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f43f09a4700 1 -- 172.21.15.44:0/6330368 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75307706 0 0) 0x7f43ec0b3f50 con 0x7f43ec1436c0 2024-09-13T18:27:11.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f43f09a4700 1 -- 172.21.15.44:0/6330368 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43d80035d0 con 0x7f43ec1436c0 2024-09-13T18:27:11.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f43f11a5700 1 -- 172.21.15.44:0/6330368 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f43ec0b4a00 msgr2=0x7f43ec06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f43f11a5700 1 --2- 172.21.15.44:0/6330368 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f43ec0b4a00 0x7f43ec06c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f43f11a5700 1 -- 172.21.15.44:0/6330368 >> v1:172.21.15.44:6789/0 conn(0x7f43ec1436c0 legacy=0x7f43ec0b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f0e629dd700 1 -- 172.21.15.44:0/428896293 >> v2:172.21.15.99:3300/0 conn(0x7f0e5c146480 msgr2=0x7f0e5c0704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f0e629dd700 1 --2- 172.21.15.44:0/428896293 >> v2:172.21.15.99:3300/0 conn(0x7f0e5c146480 0x7f0e5c0704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f0e629dd700 1 -- 172.21.15.44:0/428896293 >> v1:172.21.15.99:6789/0 conn(0x7f0e5c15dd90 legacy=0x7f0e5c0cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f0e629dd700 1 -- 172.21.15.44:0/428896293 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5c071720 con 0x7f0e5c0cc810 2024-09-13T18:27:11.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f8f6f59e700 1 Processor -- start 2024-09-13T18:27:11.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f93fffff700 1 --2- 172.21.15.44:0/1562452053 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9400070bd0 0x7f9400163280 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009850 tx=0x7f93f4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=295fcb337aacc520 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f7be9584700 1 -- 172.21.15.44:0/2778767638 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865936405 0 0) 0x7f7be40b3840 con 0x7f7be40b30c0 2024-09-13T18:27:11.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f7be9584700 1 -- 172.21.15.44:0/2778767638 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bd00035d0 con 0x7f7be40b30c0 2024-09-13T18:27:11.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f43f11a5700 1 -- 172.21.15.44:0/6330368 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ec06bbb0 con 0x7f43ec0ccd50 2024-09-13T18:27:11.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f8f6f59e700 1 -- start start 2024-09-13T18:27:11.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f43f11a5700 1 --2- 172.21.15.44:0/6330368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43ec0ccd50 0x7f43ec0b44c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009850 tx=0x7f43dc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e0b803f91f432f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f93fe7fc700 1 -- 172.21.15.44:0/1562452053 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f4011830 con 0x7f9400070bd0 2024-09-13T18:27:11.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f93fe7fc700 1 -- 172.21.15.44:0/1562452053 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f4011990 con 0x7f9400070bd0 2024-09-13T18:27:11.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f93fe7fc700 1 -- 172.21.15.44:0/1562452053 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f4011d40 con 0x7f9400070bd0 2024-09-13T18:27:11.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f0e629dd700 1 --2- 172.21.15.44:0/428896293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e5c0cc810 0x7f0e5c0ac8c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c0b3f10 tx=0x7f0e4c009d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657299ebf7e5f286 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f0e611da700 1 -- 172.21.15.44:0/428896293 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c00b850 con 0x7f0e5c0cc810 2024-09-13T18:27:11.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f0e611da700 1 -- 172.21.15.44:0/428896293 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4c00b9b0 con 0x7f0e5c0cc810 2024-09-13T18:27:11.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f0e611da700 1 -- 172.21.15.44:0/428896293 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c00bd40 con 0x7f0e5c0cc810 2024-09-13T18:27:11.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f43f09a4700 1 -- 172.21.15.44:0/6330368 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc011830 con 0x7f43ec0ccd50 2024-09-13T18:27:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.355+0000 7f7be9d85700 1 --2- 172.21.15.44:0/2778767638 >> v2:172.21.15.99:3300/0 conn(0x7f7be413e580 0x7f7be40b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7be9584700 1 -- 172.21.15.44:0/2778767638 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3636368909 0 0) 0x7f7bd00035d0 con 0x7f7be40b30c0 2024-09-13T18:27:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7be9584700 1 -- 172.21.15.44:0/2778767638 >> v2:172.21.15.99:3300/0 conn(0x7f7be413e580 msgr2=0x7f7be40b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7be9584700 1 --2- 172.21.15.44:0/2778767638 >> v2:172.21.15.99:3300/0 conn(0x7f7be413e580 0x7f7be40b2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7be9584700 1 -- 172.21.15.44:0/2778767638 >> v1:172.21.15.99:6789/0 conn(0x7f7be413e1a0 legacy=0x7f7be413b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7be9584700 1 -- 172.21.15.44:0/2778767638 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be40b40e0 con 0x7f7be40b30c0 2024-09-13T18:27:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7be9584700 1 -- 172.21.15.44:0/2778767638 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f7be0004d60 con 0x7f7be40b30c0 2024-09-13T18:27:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7be9584700 1 -- 172.21.15.44:0/2778767638 >> v1:172.21.15.44:6789/0 conn(0x7f7be40b30c0 legacy=0x7f7be413c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7be9584700 1 --2- 172.21.15.44:0/2778767638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bd0003a20 0x7f7bd0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7be9584700 1 --2- 172.21.15.44:0/2778767638 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7bd0004870 0x7f7bd0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7be9584700 1 --2- 172.21.15.44:0/2778767638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bd0009a20 0x7f7bd00052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7be9584700 1 -- 172.21.15.44:0/2778767638 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be40b3e00 con 0x7f7bd0009a20 2024-09-13T18:27:11.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7be9584700 1 -- 172.21.15.44:0/2778767638 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd0014980 con 0x7f7bd0003a20 2024-09-13T18:27:11.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7be9584700 1 -- 172.21.15.44:0/2778767638 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd0009e90 con 0x7f7bd0004870 2024-09-13T18:27:11.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7be9d85700 1 --2- 172.21.15.44:0/2778767638 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7bd0004870 0x7f7bd0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f43f09a4700 1 -- 172.21.15.44:0/6330368 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc011990 con 0x7f43ec0ccd50 2024-09-13T18:27:11.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f43f09a4700 1 -- 172.21.15.44:0/6330368 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc011d40 con 0x7f43ec0ccd50 2024-09-13T18:27:11.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f9404e10700 1 -- 172.21.15.44:0/1562452053 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9400070bd0 msgr2=0x7f9400163280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f9404e10700 1 --2- 172.21.15.44:0/1562452053 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9400070bd0 0x7f9400163280 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009850 tx=0x7f93f4009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:11.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6f59e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8f700b3980 0x7f8f70142c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6f59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8f7015dff0 0x7f8f70159d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6f59e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f7015ab40 con 0x7f8f701428b0 2024-09-13T18:27:11.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6f59e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f7015d510 con 0x7f8f700b3980 2024-09-13T18:27:11.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6f59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7015d7f0 con 0x7f8f7015dff0 2024-09-13T18:27:11.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7bead87700 1 --2- 172.21.15.44:0/2778767638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bd0009a20 0x7f7bd00052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6ed9d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8f7015dff0 0x7f8f70159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7be9d85700 1 -- 172.21.15.44:0/2778767638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bd0003a20 msgr2=0x7f7bd0003e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:27:11.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7be9d85700 1 --2- 172.21.15.44:0/2778767638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bd0003a20 0x7f7bd0003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7be9d85700 1 -- 172.21.15.44:0/2778767638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bd0009a20 msgr2=0x7f7bd00052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7be9d85700 1 --2- 172.21.15.44:0/2778767638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bd0009a20 0x7f7bd00052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7be9d85700 1 -- 172.21.15.44:0/2778767638 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be40b40e0 con 0x7f7bd0004870 2024-09-13T18:27:11.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7bead87700 1 -- 172.21.15.44:0/2778767638 reap_dead start 2024-09-13T18:27:11.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6e59c700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8f701428b0 0x7f8f700b3270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52598/0 (socket says 172.21.15.44:52598) 2024-09-13T18:27:11.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6e59c700 1 -- 172.21.15.44:0/2939741928 learned_addr learned my addr 172.21.15.44:0/2939741928 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:11.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7be9d85700 1 --2- 172.21.15.44:0/2778767638 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7bd0004870 0x7f7bd0004cf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00a4e0 tx=0x7f7bd00058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99e5683260a45f80 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6d59a700 1 -- 172.21.15.44:0/2939741928 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3395383369 0 0) 0x7f8f7015ab40 con 0x7f8f701428b0 2024-09-13T18:27:11.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6d59a700 1 -- 172.21.15.44:0/2939741928 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f580035d0 con 0x7f8f701428b0 2024-09-13T18:27:11.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7be9584700 1 -- 172.21.15.44:0/2778767638 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc010070 con 0x7f7bd0004870 2024-09-13T18:27:11.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f0e631de700 1 -- 172.21.15.44:0/428896293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e5c0cc810 msgr2=0x7f0e5c0ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f0e631de700 1 --2- 172.21.15.44:0/428896293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e5c0cc810 0x7f0e5c0ac8c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c0b3f10 tx=0x7f0e4c009d90 comp rx=0 tx=0).stop 2024-09-13T18:27:11.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6d59a700 1 -- 172.21.15.44:0/2939741928 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3309746239 0 0) 0x7f8f580035d0 con 0x7f8f701428b0 2024-09-13T18:27:11.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6d59a700 1 -- 172.21.15.44:0/2939741928 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8f7015dff0 msgr2=0x7f8f70159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6d59a700 1 --2- 172.21.15.44:0/2939741928 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8f7015dff0 0x7f8f70159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6d59a700 1 -- 172.21.15.44:0/2939741928 >> v2:172.21.15.99:3300/0 conn(0x7f8f700b3980 msgr2=0x7f8f70142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6d59a700 1 --2- 172.21.15.44:0/2939741928 >> v2:172.21.15.99:3300/0 conn(0x7f8f700b3980 0x7f8f70142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6d59a700 1 -- 172.21.15.44:0/2939741928 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7015dad0 con 0x7f8f701428b0 2024-09-13T18:27:11.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6d59a700 1 -- 172.21.15.44:0/2939741928 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f8f60001670 con 0x7f8f701428b0 2024-09-13T18:27:11.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f43f3c0a700 1 -- 172.21.15.44:0/6330368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43ec0ccd50 msgr2=0x7f43ec0b44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f43f3c0a700 1 --2- 172.21.15.44:0/6330368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43ec0ccd50 0x7f43ec0b44c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009850 tx=0x7f43dc009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:11.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f9404e10700 1 -- 172.21.15.44:0/1562452053 shutdown_connections 2024-09-13T18:27:11.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f9404e10700 1 --2- 172.21.15.44:0/1562452053 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9400070bd0 0x7f9400163280 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f9404e10700 1 --2- 172.21.15.44:0/1562452053 >> v2:172.21.15.99:3300/0 conn(0x7f940006d8c0 0x7f9400164a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f9404e10700 1 -- 172.21.15.44:0/1562452053 >> 172.21.15.44:0/1562452053 conn(0x7f94000b0e10 msgr2=0x7f94000b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6d59a700 1 -- 172.21.15.44:0/2939741928 >> v1:172.21.15.44:6789/0 conn(0x7f8f701428b0 legacy=0x7f8f700b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6d59a700 1 --2- 172.21.15.44:0/2939741928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f58003a20 0x7f8f58003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6d59a700 1 --2- 172.21.15.44:0/2939741928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f58004870 0x7f8f58004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6d59a700 1 --2- 172.21.15.44:0/2939741928 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8f58005230 0x7f8f5800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6d59a700 1 -- 172.21.15.44:0/2939741928 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7015d510 con 0x7f8f58004870 2024-09-13T18:27:11.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6d59a700 1 -- 172.21.15.44:0/2939741928 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7015d7f0 con 0x7f8f58003a20 2024-09-13T18:27:11.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6d59a700 1 -- 172.21.15.44:0/2939741928 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5800c0a0 con 0x7f8f58005230 2024-09-13T18:27:11.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7be9584700 1 -- 172.21.15.44:0/2778767638 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bdc00ada0 con 0x7f7bd0004870 2024-09-13T18:27:11.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7be9584700 1 -- 172.21.15.44:0/2778767638 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc015670 con 0x7f7bd0004870 2024-09-13T18:27:11.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f43f3c0a700 1 -- 172.21.15.44:0/6330368 shutdown_connections 2024-09-13T18:27:11.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f43f3c0a700 1 --2- 172.21.15.44:0/6330368 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f43ec0b4a00 0x7f43ec06c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f43f3c0a700 1 --2- 172.21.15.44:0/6330368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43ec0ccd50 0x7f43ec0b44c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f43f3c0a700 1 -- 172.21.15.44:0/6330368 >> 172.21.15.44:0/6330368 conn(0x7f43ec070d00 msgr2=0x7f43ec071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6dd9b700 1 --2- 172.21.15.44:0/2939741928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f58004870 0x7f8f58004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f43f3c0a700 1 -- 172.21.15.44:0/6330368 shutdown_connections 2024-09-13T18:27:11.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f9404e10700 1 -- 172.21.15.44:0/1562452053 shutdown_connections 2024-09-13T18:27:11.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f43f3c0a700 1 -- 172.21.15.44:0/6330368 wait complete. 2024-09-13T18:27:11.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f9404e10700 1 -- 172.21.15.44:0/1562452053 wait complete. 2024-09-13T18:27:11.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6ed9d700 1 --2- 172.21.15.44:0/2939741928 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8f58005230 0x7f8f5800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6dd9b700 1 -- 172.21.15.44:0/2939741928 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8f58005230 msgr2=0x7f8f5800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6dd9b700 1 --2- 172.21.15.44:0/2939741928 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8f58005230 0x7f8f5800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6dd9b700 1 -- 172.21.15.44:0/2939741928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f58003a20 msgr2=0x7f8f58003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:27:11.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6dd9b700 1 --2- 172.21.15.44:0/2939741928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f58003a20 0x7f8f58003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6dd9b700 1 -- 172.21.15.44:0/2939741928 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7015dad0 con 0x7f8f58004870 2024-09-13T18:27:11.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6dd9b700 1 --2- 172.21.15.44:0/2939741928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f58004870 0x7f8f58004cf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8f68009e40 tx=0x7f8f580058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af71e85480d32714 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6d59a700 1 -- 172.21.15.44:0/2939741928 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f680098b0 con 0x7f8f58004870 2024-09-13T18:27:11.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7bec7ea700 1 -- 172.21.15.44:0/2778767638 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7bd0004870 msgr2=0x7f7bd0004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7bec7ea700 1 --2- 172.21.15.44:0/2778767638 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7bd0004870 0x7f7bd0004cf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00a4e0 tx=0x7f7bd00058a0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6d59a700 1 -- 172.21.15.44:0/2939741928 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6800baa0 con 0x7f8f58004870 2024-09-13T18:27:11.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f8f6d59a700 1 -- 172.21.15.44:0/2939741928 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6800be50 con 0x7f8f58004870 2024-09-13T18:27:11.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7bec7ea700 1 -- 172.21.15.44:0/2778767638 shutdown_connections 2024-09-13T18:27:11.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7bec7ea700 1 --2- 172.21.15.44:0/2778767638 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7bd0004870 0x7f7bd0004cf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.359+0000 7f7bec7ea700 1 -- 172.21.15.44:0/2778767638 >> 172.21.15.44:0/2778767638 conn(0x7f7be40af620 msgr2=0x7f7be40afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f9404e10700 1 Processor -- start 2024-09-13T18:27:11.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f9404e10700 1 -- start start 2024-09-13T18:27:11.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fc744919700 1 Processor -- start 2024-09-13T18:27:11.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fe198e23700 1 Processor -- start 2024-09-13T18:27:11.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fe198e23700 1 -- start start 2024-09-13T18:27:11.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f43f3c0a700 1 Processor -- start 2024-09-13T18:27:11.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f43f3c0a700 1 -- start start 2024-09-13T18:27:11.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f7bec7ea700 1 -- 172.21.15.44:0/2778767638 shutdown_connections 2024-09-13T18:27:11.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f8f6f59e700 1 -- 172.21.15.44:0/2939741928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f58004870 msgr2=0x7f8f58004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f8f6f59e700 1 --2- 172.21.15.44:0/2939741928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f58004870 0x7f8f58004cf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8f68009e40 tx=0x7f8f580058a0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f8f6ed9d700 1 -- 172.21.15.44:0/2939741928 reap_dead start 2024-09-13T18:27:11.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f8f6f59e700 1 -- 172.21.15.44:0/2939741928 shutdown_connections 2024-09-13T18:27:11.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f8f6f59e700 1 -- 172.21.15.44:0/2939741928 >> 172.21.15.44:0/2939741928 conn(0x7f8f700b0e10 msgr2=0x7f8f700b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f8f6f59e700 1 -- 172.21.15.44:0/2939741928 shutdown_connections 2024-09-13T18:27:11.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f8f6f59e700 1 -- 172.21.15.44:0/2939741928 wait complete. 2024-09-13T18:27:11.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fc744919700 1 -- start start 2024-09-13T18:27:11.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f9404e10700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f940006d8c0 0x7f94001eaad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f9404e10700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9400070bd0 0x7f94001552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f9404e10700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9400164f90 0x7f9400158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f9404e10700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9400159c80 con 0x7f9400164f90 2024-09-13T18:27:11.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f9404e10700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94001eb400 con 0x7f9400070bd0 2024-09-13T18:27:11.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f9404e10700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9400155810 con 0x7f940006d8c0 2024-09-13T18:27:11.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fc744919700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc7400b0090 0x7fc740070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fc744919700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc7400710e0 0x7fc74006fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fc744919700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc74006ffd0 0x7fc740070480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fc744919700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74006a5d0 con 0x7fc74006ffd0 2024-09-13T18:27:11.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fc744919700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74006bd20 con 0x7fc7400b0090 2024-09-13T18:27:11.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fc744919700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7400709c0 con 0x7fc7400710e0 2024-09-13T18:27:11.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f43f3c0a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43ec0b4a00 0x7f43ec139670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f43f3c0a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f43ec0ccd50 0x7f43ec13bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f43f3c0a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43ec1436c0 0x7f43ec13c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f43f3c0a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec136d50 con 0x7f43ec0b4a00 2024-09-13T18:27:11.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f43f3c0a700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec137310 con 0x7f43ec1436c0 2024-09-13T18:27:11.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f43f3c0a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec13cd70 con 0x7f43ec0ccd50 2024-09-13T18:27:11.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fe198e23700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe19406fa90 0x7fe1940cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fe198e23700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe1940ccd40 0x7fe1940cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fe198e23700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe1940b0090 0x7fe19406fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fe198e23700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe19406a5d0 con 0x7fe1940b0090 2024-09-13T18:27:11.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fe198e23700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe19406bd20 con 0x7fe1940ccd40 2024-09-13T18:27:11.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fe198e23700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1940cb760 con 0x7fe19406fa90 2024-09-13T18:27:11.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fe193fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe1940b0090 0x7fe19406fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fe193fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe1940b0090 0x7fe19406fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38798/0 (socket says 172.21.15.44:38798) 2024-09-13T18:27:11.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fe193fff700 1 -- 172.21.15.44:0/596954309 learned_addr learned my addr 172.21.15.44:0/596954309 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fe1937fe700 1 --2- 172.21.15.44:0/596954309 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe19406fa90 0x7fe1940cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f43f11a5700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f43ec0ccd50 0x7f43ec13bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f43f11a5700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f43ec0ccd50 0x7f43ec13bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:39628/0 (socket says 172.21.15.44:39628) 2024-09-13T18:27:11.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f43f11a5700 1 -- 172.21.15.44:0/373186744 learned_addr learned my addr 172.21.15.44:0/373186744 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f93fffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9400164f90 0x7f9400158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f93fffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9400164f90 0x7f9400158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38814/0 (socket says 172.21.15.44:38814) 2024-09-13T18:27:11.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f93fffff700 1 -- 172.21.15.44:0/3553097960 learned_addr learned my addr 172.21.15.44:0/3553097960 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fe192ffd700 1 --2- 172.21.15.44:0/596954309 >> v2:172.21.15.99:3300/0 conn(0x7fe1940ccd40 0x7fe1940cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f43f21a7700 1 --2- 172.21.15.44:0/373186744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43ec1436c0 0x7f43ec13c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fc73f59e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc74006ffd0 0x7fc740070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fc73f59e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc74006ffd0 0x7fc740070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38794/0 (socket says 172.21.15.44:38794) 2024-09-13T18:27:11.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fc73f59e700 1 -- 172.21.15.44:0/796602522 learned_addr learned my addr 172.21.15.44:0/796602522 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fc73ed9d700 1 --2- 172.21.15.44:0/796602522 >> v2:172.21.15.99:3300/0 conn(0x7fc7400b0090 0x7fc740070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fc73e59c700 1 --2- 172.21.15.44:0/796602522 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc7400710e0 0x7fc74006fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f8f6f59e700 1 Processor -- start 2024-09-13T18:27:11.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f93ff7fe700 1 --2- 172.21.15.44:0/3553097960 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f940006d8c0 0x7f94001eaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f0e631de700 1 -- 172.21.15.44:0/428896293 shutdown_connections 2024-09-13T18:27:11.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f0e631de700 1 --2- 172.21.15.44:0/428896293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e5c0cc810 0x7f0e5c0ac8c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f0e631de700 1 --2- 172.21.15.44:0/428896293 >> v2:172.21.15.99:3300/0 conn(0x7f0e5c146480 0x7f0e5c0704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f0e631de700 1 -- 172.21.15.44:0/428896293 >> 172.21.15.44:0/428896293 conn(0x7f0e5c0ae590 msgr2=0x7f0e5c0ae970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fc73f59e700 1 -- 172.21.15.44:0/796602522 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc7400710e0 msgr2=0x7fc74006fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fc73f59e700 1 --2- 172.21.15.44:0/796602522 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc7400710e0 0x7fc74006fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fc73f59e700 1 -- 172.21.15.44:0/796602522 >> v2:172.21.15.99:3300/0 conn(0x7fc7400b0090 msgr2=0x7fc740070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fc73f59e700 1 --2- 172.21.15.44:0/796602522 >> v2:172.21.15.99:3300/0 conn(0x7fc7400b0090 0x7fc740070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fc73f59e700 1 -- 172.21.15.44:0/796602522 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7400cb760 con 0x7fc74006ffd0 2024-09-13T18:27:11.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f8f6f59e700 1 -- start start 2024-09-13T18:27:11.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f0e631de700 1 -- 172.21.15.44:0/428896293 shutdown_connections 2024-09-13T18:27:11.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f93fffff700 1 -- 172.21.15.44:0/3553097960 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f940006d8c0 msgr2=0x7f94001eaad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f93fffff700 1 --2- 172.21.15.44:0/3553097960 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f940006d8c0 0x7f94001eaad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f93fffff700 1 -- 172.21.15.44:0/3553097960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9400070bd0 msgr2=0x7f94001552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f93fffff700 1 --2- 172.21.15.44:0/3553097960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9400070bd0 0x7f94001552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f93fffff700 1 -- 172.21.15.44:0/3553097960 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f40094b0 con 0x7f9400164f90 2024-09-13T18:27:11.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fc73f59e700 1 --2- 172.21.15.44:0/796602522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc74006ffd0 0x7fc740070480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc7400b1650 tx=0x7fc73800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79bf6b58a54557db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fe193fff700 1 -- 172.21.15.44:0/596954309 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe19406fa90 msgr2=0x7fe1940cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fe193fff700 1 --2- 172.21.15.44:0/596954309 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe19406fa90 0x7fe1940cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fe193fff700 1 -- 172.21.15.44:0/596954309 >> v2:172.21.15.99:3300/0 conn(0x7fe1940ccd40 msgr2=0x7fe1940cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fe193fff700 1 --2- 172.21.15.44:0/596954309 >> v2:172.21.15.99:3300/0 conn(0x7fe1940ccd40 0x7fe1940cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fe193fff700 1 -- 172.21.15.44:0/596954309 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1940cba40 con 0x7fe1940b0090 2024-09-13T18:27:11.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fe193fff700 1 --2- 172.21.15.44:0/596954309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1940b0090 0x7fe19406fe70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe1940718a0 tx=0x7fe18c014ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6839374267d2b3e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f43f11a5700 1 -- 172.21.15.44:0/373186744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43ec1436c0 msgr2=0x7f43ec13c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f43f11a5700 1 --2- 172.21.15.44:0/373186744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43ec1436c0 0x7f43ec13c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f43f11a5700 1 -- 172.21.15.44:0/373186744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43ec0b4a00 msgr2=0x7f43ec139670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f43f11a5700 1 --2- 172.21.15.44:0/373186744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43ec0b4a00 0x7f43ec139670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f43f11a5700 1 -- 172.21.15.44:0/373186744 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc0094b0 con 0x7f43ec0ccd50 2024-09-13T18:27:11.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fe1927fc700 1 -- 172.21.15.44:0/596954309 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c014e70 con 0x7fe1940b0090 2024-09-13T18:27:11.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fe1927fc700 1 -- 172.21.15.44:0/596954309 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18c013af0 con 0x7fe1940b0090 2024-09-13T18:27:11.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fe1927fc700 1 -- 172.21.15.44:0/596954309 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c013ea0 con 0x7fe1940b0090 2024-09-13T18:27:11.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f43f11a5700 1 --2- 172.21.15.44:0/373186744 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f43ec0ccd50 0x7f43ec13bff0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f43ec067130 tx=0x7f43dc004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f7bec7ea700 1 -- 172.21.15.44:0/2778767638 wait complete. 2024-09-13T18:27:11.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f7bec7ea700 1 Processor -- start 2024-09-13T18:27:11.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f8f6f59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f58004870 0x7f8f700a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f8f6f59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f7015c650 0x7f8f701592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f8f6f59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8f700a9be0 0x7f8f7015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f8f6f59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f701597f0 con 0x7f8f7015c650 2024-09-13T18:27:11.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f8f6f59e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f700a8b40 con 0x7f8f58004870 2024-09-13T18:27:11.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f8f6f59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f700a8e20 con 0x7f8f700a9be0 2024-09-13T18:27:11.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f7bec7ea700 1 -- start start 2024-09-13T18:27:11.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f8f6dd9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f7015c650 0x7f8f701592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f8f6dd9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f7015c650 0x7f8f701592b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38820/0 (socket says 172.21.15.44:38820) 2024-09-13T18:27:11.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f8f6dd9b700 1 -- 172.21.15.44:0/832044507 learned_addr learned my addr 172.21.15.44:0/832044507 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f43e27fc700 1 -- 172.21.15.44:0/373186744 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc004510 con 0x7f43ec0ccd50 2024-09-13T18:27:11.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f43e27fc700 1 -- 172.21.15.44:0/373186744 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc01f070 con 0x7f43ec0ccd50 2024-09-13T18:27:11.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f43e27fc700 1 -- 172.21.15.44:0/373186744 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc003900 con 0x7f43ec0ccd50 2024-09-13T18:27:11.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f43f3c0a700 1 -- 172.21.15.44:0/373186744 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ec13d050 con 0x7f43ec0ccd50 2024-09-13T18:27:11.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fc73dd9b700 1 -- 172.21.15.44:0/796602522 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73800e070 con 0x7fc74006ffd0 2024-09-13T18:27:11.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fc73dd9b700 1 -- 172.21.15.44:0/796602522 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73800b910 con 0x7fc74006ffd0 2024-09-13T18:27:11.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7fc73dd9b700 1 -- 172.21.15.44:0/796602522 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73800bcc0 con 0x7fc74006ffd0 2024-09-13T18:27:11.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7fc744919700 1 -- 172.21.15.44:0/796602522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc74006ffd0 msgr2=0x7fc740070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7fc744919700 1 --2- 172.21.15.44:0/796602522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc74006ffd0 0x7fc740070480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc7400b1650 tx=0x7fc73800b330 comp rx=0 tx=0).stop 2024-09-13T18:27:11.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f8f6e59c700 1 --2- 172.21.15.44:0/832044507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f58004870 0x7f8f700a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f43f3c0a700 1 -- 172.21.15.44:0/373186744 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ec13ca70 con 0x7f43ec0ccd50 2024-09-13T18:27:11.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f8f6ed9d700 1 --2- 172.21.15.44:0/832044507 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8f700a9be0 0x7f8f7015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f93fffff700 1 --2- 172.21.15.44:0/3553097960 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9400164f90 0x7f9400158580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009eb0 tx=0x7f93f4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.363+0000 7f0e631de700 1 -- 172.21.15.44:0/428896293 wait complete. 2024-09-13T18:27:11.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f0e631de700 1 Processor -- start 2024-09-13T18:27:11.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f0e631de700 1 -- start start 2024-09-13T18:27:11.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7fc744919700 1 -- 172.21.15.44:0/796602522 shutdown_connections 2024-09-13T18:27:11.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7fc744919700 1 --2- 172.21.15.44:0/796602522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc74006ffd0 0x7fc740070480 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7fc744919700 1 --2- 172.21.15.44:0/796602522 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc7400710e0 0x7fc74006fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7fe198e23700 1 -- 172.21.15.44:0/596954309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1940b0090 msgr2=0x7fe19406fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7fc744919700 1 --2- 172.21.15.44:0/796602522 >> v2:172.21.15.99:3300/0 conn(0x7fc7400b0090 0x7fc740070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7fc744919700 1 -- 172.21.15.44:0/796602522 >> 172.21.15.44:0/796602522 conn(0x7fc7400ae590 msgr2=0x7fc7400ae970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f43f3c0a700 1 -- 172.21.15.44:0/373186744 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f43ec0b0350 con 0x7f43ec0ccd50 2024-09-13T18:27:11.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f8f6dd9b700 1 -- 172.21.15.44:0/832044507 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8f700a9be0 msgr2=0x7f8f7015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7fc744919700 1 -- 172.21.15.44:0/796602522 shutdown_connections 2024-09-13T18:27:11.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f93e7fff700 1 -- 172.21.15.44:0/3553097960 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f4004480 con 0x7f9400164f90 2024-09-13T18:27:11.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f93e7fff700 1 -- 172.21.15.44:0/3553097960 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f401f070 con 0x7f9400164f90 2024-09-13T18:27:11.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f9404e10700 1 -- 172.21.15.44:0/3553097960 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9400155a90 con 0x7f9400164f90 2024-09-13T18:27:11.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f9404e10700 1 -- 172.21.15.44:0/3553097960 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9400156050 con 0x7f9400164f90 2024-09-13T18:27:11.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f93e7fff700 1 -- 172.21.15.44:0/3553097960 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f4003900 con 0x7f9400164f90 2024-09-13T18:27:11.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f8f6dd9b700 1 --2- 172.21.15.44:0/832044507 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8f700a9be0 0x7f8f7015b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f8f6dd9b700 1 -- 172.21.15.44:0/832044507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f58004870 msgr2=0x7f8f700a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f8f6dd9b700 1 --2- 172.21.15.44:0/832044507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f58004870 0x7f8f700a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f8f6dd9b700 1 -- 172.21.15.44:0/832044507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f700a9100 con 0x7f8f7015c650 2024-09-13T18:27:11.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f8f6e59c700 1 --2- 172.21.15.44:0/832044507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f58004870 0x7f8f700a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:11.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7fe198e23700 1 --2- 172.21.15.44:0/596954309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1940b0090 0x7fe19406fe70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe1940718a0 tx=0x7fe18c014ce0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7fc744919700 1 -- 172.21.15.44:0/796602522 wait complete. 2024-09-13T18:27:11.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f7bec7ea700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bd0004870 0x7f7be412d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f7bec7ea700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7be41edd20 0x7f7be412de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f0e631de700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e5c0cc810 0x7f0e5c138e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f0e631de700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e5c146480 0x7f0e5c137f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f0e631de700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0e5c15dd90 0x7f0e5c1ffa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f0e631de700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c139350 con 0x7f0e5c0cc810 2024-09-13T18:27:11.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f0e631de700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c202fa0 con 0x7f0e5c146480 2024-09-13T18:27:11.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f0e631de700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c203280 con 0x7f0e5c15dd90 2024-09-13T18:27:11.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f7bec7ea700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7be4159bd0 0x7f7be415a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f7bec7ea700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be40ab7d0 con 0x7f7bd0004870 2024-09-13T18:27:11.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f7bec7ea700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be40a8ba0 con 0x7f7be4159bd0 2024-09-13T18:27:11.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f7bec7ea700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be415a590 con 0x7f7be41edd20 2024-09-13T18:27:11.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f7be9d85700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7be41edd20 0x7f7be412de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f0e619db700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e5c146480 0x7f0e5c137f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f0e619db700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e5c146480 0x7f0e5c137f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:59002/0 (socket says 172.21.15.44:59002) 2024-09-13T18:27:11.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f0e619db700 1 -- 172.21.15.44:0/2992957440 learned_addr learned my addr 172.21.15.44:0/2992957440 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f7be9d85700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7be41edd20 0x7f7be412de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:39674/0 (socket says 172.21.15.44:39674) 2024-09-13T18:27:11.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f7be9d85700 1 -- 172.21.15.44:0/176183054 learned_addr learned my addr 172.21.15.44:0/176183054 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f0e629dd700 1 --2- 172.21.15.44:0/2992957440 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0e5c15dd90 0x7f0e5c1ffa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f9404e10700 1 -- 172.21.15.44:0/3553097960 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f93e0000fc0 con 0x7f9400164f90 2024-09-13T18:27:11.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f7bead87700 1 --2- 172.21.15.44:0/176183054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7be4159bd0 0x7f7be415a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7fe198e23700 1 -- 172.21.15.44:0/596954309 shutdown_connections 2024-09-13T18:27:11.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7fe198e23700 1 --2- 172.21.15.44:0/596954309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1940b0090 0x7fe19406fe70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7fe198e23700 1 --2- 172.21.15.44:0/596954309 >> v2:172.21.15.99:3300/0 conn(0x7fe1940ccd40 0x7fe1940cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7fe198e23700 1 --2- 172.21.15.44:0/596954309 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe19406fa90 0x7fe1940cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7fe198e23700 1 -- 172.21.15.44:0/596954309 >> 172.21.15.44:0/596954309 conn(0x7fe1940ae590 msgr2=0x7fe1940ae970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f7be9d85700 1 -- 172.21.15.44:0/176183054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7be4159bd0 msgr2=0x7f7be415a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f7be9d85700 1 --2- 172.21.15.44:0/176183054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7be4159bd0 0x7f7be415a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f7be9d85700 1 -- 172.21.15.44:0/176183054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bd0004870 msgr2=0x7f7be412d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f7be9d85700 1 --2- 172.21.15.44:0/176183054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bd0004870 0x7f7be412d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f7be9d85700 1 -- 172.21.15.44:0/176183054 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be415a850 con 0x7f7be41edd20 2024-09-13T18:27:11.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f43e27fc700 1 -- 172.21.15.44:0/373186744 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f43dc003a60 con 0x7f43ec0ccd50 2024-09-13T18:27:11.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f0e619db700 1 -- 172.21.15.44:0/2992957440 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0e5c15dd90 msgr2=0x7f0e5c1ffa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f0e619db700 1 --2- 172.21.15.44:0/2992957440 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0e5c15dd90 0x7f0e5c1ffa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f0e619db700 1 -- 172.21.15.44:0/2992957440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e5c0cc810 msgr2=0x7f0e5c138e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f0e619db700 1 --2- 172.21.15.44:0/2992957440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e5c0cc810 0x7f0e5c138e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f0e619db700 1 -- 172.21.15.44:0/2992957440 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c0094b0 con 0x7f0e5c146480 2024-09-13T18:27:11.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7fe198e23700 1 -- 172.21.15.44:0/596954309 shutdown_connections 2024-09-13T18:27:11.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f43e27fc700 1 --2- 172.21.15.44:0/373186744 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f43d0066760 0x7f43d0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f0e619db700 1 --2- 172.21.15.44:0/2992957440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e5c146480 0x7f0e5c137f70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0e5400cbc0 tx=0x7f0e5400cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f7be9d85700 1 --2- 172.21.15.44:0/176183054 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7be41edd20 0x7f7be412de60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000a020 tx=0x7f7bdc004b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f43e27fc700 1 -- 172.21.15.44:0/373186744 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43dc021070 con 0x7f43ec0ccd50 2024-09-13T18:27:11.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f623a778700 1 Processor -- start 2024-09-13T18:27:11.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.367+0000 7f623a778700 1 -- start start 2024-09-13T18:27:11.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f93e7fff700 1 -- 172.21.15.44:0/3553097960 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f93f4021030 con 0x7f9400164f90 2024-09-13T18:27:11.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc744919700 1 Processor -- start 2024-09-13T18:27:11.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f43f19a6700 1 --2- 172.21.15.44:0/373186744 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f43d0066760 0x7f43d0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f43e27fc700 1 --2- 172.21.15.44:0/373186744 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f43d006e900 0x7f43d0070d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f43e27fc700 1 -- 172.21.15.44:0/373186744 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f43d00713d0 con 0x7f43d006e900 2024-09-13T18:27:11.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f43e27fc700 1 -- 172.21.15.44:0/373186744 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43dc0860d0 con 0x7f43ec0ccd50 2024-09-13T18:27:11.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f7bdaffd700 1 -- 172.21.15.44:0/176183054 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc007000 con 0x7f7be41edd20 2024-09-13T18:27:11.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f7bdaffd700 1 -- 172.21.15.44:0/176183054 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bdc020850 con 0x7f7be41edd20 2024-09-13T18:27:11.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f7bdaffd700 1 -- 172.21.15.44:0/176183054 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc020be0 con 0x7f7be41edd20 2024-09-13T18:27:11.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f0e52ffd700 1 -- 172.21.15.44:0/2992957440 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5400a9e0 con 0x7f0e5c146480 2024-09-13T18:27:11.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f0e52ffd700 1 -- 172.21.15.44:0/2992957440 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5400ab40 con 0x7f0e5c146480 2024-09-13T18:27:11.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f0e631de700 1 -- 172.21.15.44:0/2992957440 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e5c203560 con 0x7f0e5c146480 2024-09-13T18:27:11.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f0e52ffd700 1 -- 172.21.15.44:0/2992957440 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5400ce80 con 0x7f0e5c146480 2024-09-13T18:27:11.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f0e631de700 1 -- 172.21.15.44:0/2992957440 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5c1ff550 con 0x7f0e5c146480 2024-09-13T18:27:11.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f43f21a7700 1 --2- 172.21.15.44:0/373186744 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f43d006e900 0x7f43d0070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f43f19a6700 1 --2- 172.21.15.44:0/373186744 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f43d0066760 0x7f43d0068c20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f43e8007fd0 tx=0x7f43e8007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fe198e23700 1 -- 172.21.15.44:0/596954309 wait complete. 2024-09-13T18:27:11.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f7bec7ea700 1 -- 172.21.15.44:0/176183054 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be40a8550 con 0x7f7be41edd20 2024-09-13T18:27:11.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc744919700 1 -- start start 2024-09-13T18:27:11.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc744919700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc74006ffd0 0x7fc74014fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f7bec7ea700 1 -- 172.21.15.44:0/176183054 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be415ab30 con 0x7f7be41edd20 2024-09-13T18:27:11.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc744919700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7400710e0 0x7fc740157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f43f21a7700 1 --2- 172.21.15.44:0/373186744 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f43d006e900 0x7f43d0070d20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f8f6dd9b700 1 --2- 172.21.15.44:0/832044507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f7015c650 0x7f8f701592b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8f68017040 tx=0x7f8f68004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc744919700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7400b0090 0x7fc740157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc73e59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7400710e0 0x7fc740157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc73e59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7400710e0 0x7fc740157220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38836/0 (socket says 172.21.15.44:38836) 2024-09-13T18:27:11.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc73ed9d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc74006ffd0 0x7fc74014fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc744919700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7400ac9c0 con 0x7fc7400710e0 2024-09-13T18:27:11.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc744919700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc740157e00 con 0x7fc7400b0090 2024-09-13T18:27:11.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc744919700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7401580e0 con 0x7fc74006ffd0 2024-09-13T18:27:11.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc73ed9d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc74006ffd0 0x7fc74014fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:39688/0 (socket says 172.21.15.44:39688) 2024-09-13T18:27:11.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc73e59c700 1 -- 172.21.15.44:0/1591570632 learned_addr learned my addr 172.21.15.44:0/1591570632 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f8f5effd700 1 -- 172.21.15.44:0/832044507 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f68004250 con 0x7f8f7015c650 2024-09-13T18:27:11.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f8f6f59e700 1 -- 172.21.15.44:0/832044507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f700a93e0 con 0x7f8f7015c650 2024-09-13T18:27:11.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc73e59c700 1 -- 172.21.15.44:0/1591570632 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc74006ffd0 msgr2=0x7fc74014fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc73e59c700 1 --2- 172.21.15.44:0/1591570632 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc74006ffd0 0x7fc74014fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc73e59c700 1 -- 172.21.15.44:0/1591570632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7400b0090 msgr2=0x7fc740157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc73e59c700 1 --2- 172.21.15.44:0/1591570632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7400b0090 0x7fc740157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc73e59c700 1 -- 172.21.15.44:0/1591570632 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc738009b30 con 0x7fc7400710e0 2024-09-13T18:27:11.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc73e59c700 1 --2- 172.21.15.44:0/1591570632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7400710e0 0x7fc740157220 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc73400e9a0 tx=0x7fc73400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc7277fe700 1 -- 172.21.15.44:0/1591570632 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734009720 con 0x7fc7400710e0 2024-09-13T18:27:11.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc7277fe700 1 -- 172.21.15.44:0/1591570632 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73400c850 con 0x7fc7400710e0 2024-09-13T18:27:11.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc744919700 1 -- 172.21.15.44:0/1591570632 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7400c90f0 con 0x7fc7400710e0 2024-09-13T18:27:11.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc744919700 1 -- 172.21.15.44:0/1591570632 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7401583c0 con 0x7fc7400710e0 2024-09-13T18:27:11.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fc7277fe700 1 -- 172.21.15.44:0/1591570632 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73400cbc0 con 0x7fc7400710e0 2024-09-13T18:27:11.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fc744919700 1 -- 172.21.15.44:0/1591570632 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc720000fc0 con 0x7fc7400710e0 2024-09-13T18:27:11.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f7bec7ea700 1 -- 172.21.15.44:0/176183054 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7be40a8a10 con 0x7f7be41edd20 2024-09-13T18:27:11.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f7bdaffd700 1 -- 172.21.15.44:0/176183054 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7bdc01c040 con 0x7f7be41edd20 2024-09-13T18:27:11.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f7bdaffd700 1 --2- 172.21.15.44:0/176183054 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7bc8066830 0x7f7bc8068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f7bdaffd700 1 -- 172.21.15.44:0/176183054 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7bdc085e70 con 0x7f7be41edd20 2024-09-13T18:27:11.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f7bdaffd700 1 --2- 172.21.15.44:0/176183054 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7f7bc806ea50 0x7f7bc8070e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f7bdaffd700 1 -- 172.21.15.44:0/176183054 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7bc8071520 con 0x7f7bc806ea50 2024-09-13T18:27:11.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f7bdaffd700 1 -- 172.21.15.44:0/176183054 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bdc088490 con 0x7f7be41edd20 2024-09-13T18:27:11.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f7bea586700 1 --2- 172.21.15.44:0/176183054 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7bc8066830 0x7f7bc8068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f7bead87700 1 --2- 172.21.15.44:0/176183054 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7f7bc806ea50 0x7f7bc8070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f8f6f59e700 1 -- 172.21.15.44:0/832044507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f7015cab0 con 0x7f8f7015c650 2024-09-13T18:27:11.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f8f5effd700 1 -- 172.21.15.44:0/832044507 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f680043b0 con 0x7f8f7015c650 2024-09-13T18:27:11.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f8f5effd700 1 -- 172.21.15.44:0/832044507 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f68004760 con 0x7f8f7015c650 2024-09-13T18:27:11.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f8f6f59e700 1 -- 172.21.15.44:0/832044507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8f54000fc0 con 0x7f8f7015c650 2024-09-13T18:27:11.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f8f5effd700 1 -- 172.21.15.44:0/832044507 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8f68021470 con 0x7f8f7015c650 2024-09-13T18:27:11.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f8f5effd700 1 --2- 172.21.15.44:0/832044507 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8f50066730 0x7f8f50068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f8f5effd700 1 -- 172.21.15.44:0/832044507 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f68011070 con 0x7f8f7015c650 2024-09-13T18:27:11.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f8f5effd700 1 --2- 172.21.15.44:0/832044507 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x7f8f5006e8d0 0x7f8f50070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f8f5effd700 1 -- 172.21.15.44:0/832044507 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8f500713a0 con 0x7f8f5006e8d0 2024-09-13T18:27:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f8f5effd700 1 -- 172.21.15.44:0/832044507 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f680869c0 con 0x7f8f7015c650 2024-09-13T18:27:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f8f6ed9d700 1 --2- 172.21.15.44:0/832044507 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x7f8f5006e8d0 0x7f8f50070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f8f6e59c700 1 --2- 172.21.15.44:0/832044507 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8f50066730 0x7f8f50068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fe198e23700 1 Processor -- start 2024-09-13T18:27:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7fe198e23700 1 -- start start 2024-09-13T18:27:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fe198e23700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe19406fa90 0x7fe19415a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fe198e23700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1940b0090 0x7fe1941eebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fe198e23700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1940ccd40 0x7fe1941ed950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fe198e23700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1941ef100 con 0x7fe1940ccd40 2024-09-13T18:27:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fe198e23700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19415a800 con 0x7fe1940b0090 2024-09-13T18:27:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fe198e23700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19415aae0 con 0x7fe19406fa90 2024-09-13T18:27:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fe1937fe700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe19406fa90 0x7fe19415a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fe1937fe700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe19406fa90 0x7fe19415a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:39706/0 (socket says 172.21.15.44:39706) 2024-09-13T18:27:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fe1937fe700 1 -- 172.21.15.44:0/402031547 learned_addr learned my addr 172.21.15.44:0/402031547 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fe193fff700 1 --2- 172.21.15.44:0/402031547 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1940ccd40 0x7fe1941ed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fe192ffd700 1 --2- 172.21.15.44:0/402031547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1940b0090 0x7fe1941eebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f43e27fc700 1 -- 172.21.15.44:0/373186744 <== osd.4 v2:172.21.15.99:6816/2515272044 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f43d00713d0 con 0x7f43d006e900 2024-09-13T18:27:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f623a778700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f62340ce080 0x7f62341446e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f623a778700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6234161fb0 0x7f623415b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f623a778700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62340b3550 con 0x7f6234146770 2024-09-13T18:27:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f623a778700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62340ce4e0 con 0x7f6234161fb0 2024-09-13T18:27:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f623a778700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62340ce770 con 0x7f62340ce080 2024-09-13T18:27:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f6233fff700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6234146770 0x7f6234146b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:40018/0 (socket says 172.21.15.44:40018) 2024-09-13T18:27:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f6233fff700 1 -- 172.21.15.44:0/785268340 learned_addr learned my addr 172.21.15.44:0/785268340 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f6238d15700 1 --2- 172.21.15.44:0/785268340 >> v2:172.21.15.99:3300/0 conn(0x7f6234161fb0 0x7f623415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f6238d15700 1 -- 172.21.15.44:0/785268340 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f62340ce080 msgr2=0x7f62341446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f6238d15700 1 --2- 172.21.15.44:0/785268340 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f62340ce080 0x7f62341446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f6238d15700 1 -- 172.21.15.44:0/785268340 >> v1:172.21.15.99:6789/0 conn(0x7f6234146770 legacy=0x7f6234146b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f6238d15700 1 -- 172.21.15.44:0/785268340 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62340b2c20 con 0x7f6234161fb0 2024-09-13T18:27:11.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f6238d15700 1 --2- 172.21.15.44:0/785268340 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6234161fb0 0x7f623415b070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6228009850 tx=0x7f6228009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9a6a615d12cc484 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f93e7fff700 1 --2- 172.21.15.44:0/3553097960 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f93ec066800 0x7f93ec068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f93e7fff700 1 -- 172.21.15.44:0/3553097960 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93f4085560 con 0x7f9400164f90 2024-09-13T18:27:11.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f93e7fff700 1 --2- 172.21.15.44:0/3553097960 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f93ec06ea20 0x7f93ec070e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f93e7fff700 1 -- 172.21.15.44:0/3553097960 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f93ec0714f0 con 0x7f93ec06ea20 2024-09-13T18:27:11.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f93e7fff700 1 -- 172.21.15.44:0/3553097960 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93f4087b80 con 0x7f9400164f90 2024-09-13T18:27:11.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f93feffd700 1 --2- 172.21.15.44:0/3553097960 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f93ec06ea20 0x7f93ec070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f93ff7fe700 1 --2- 172.21.15.44:0/3553097960 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f93ec066800 0x7f93ec068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f93feffd700 1 --2- 172.21.15.44:0/3553097960 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f93ec06ea20 0x7f93ec070e40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f93ff7fe700 1 --2- 172.21.15.44:0/3553097960 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f93ec066800 0x7f93ec068cc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f94001ea9f0 tx=0x7f93f00092e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f93e7fff700 1 -- 172.21.15.44:0/3553097960 <== osd.6 v2:172.21.15.99:6808/2907584318 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f93ec0714f0 con 0x7f93ec06ea20 2024-09-13T18:27:11.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f0e631de700 1 -- 172.21.15.44:0/2992957440 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0e5c071f20 con 0x7f0e5c146480 2024-09-13T18:27:11.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f0e52ffd700 1 -- 172.21.15.44:0/2992957440 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0e5401b3b0 con 0x7f0e5c146480 2024-09-13T18:27:11.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.371+0000 7f0e52ffd700 1 --2- 172.21.15.44:0/2992957440 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0e40066730 0x7f0e40068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f0e52ffd700 1 -- 172.21.15.44:0/2992957440 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e54083d10 con 0x7f0e5c146480 2024-09-13T18:27:11.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f0e52ffd700 1 --2- 172.21.15.44:0/2992957440 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f0e4006e950 0x7f0e40070d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f0e52ffd700 1 -- 172.21.15.44:0/2992957440 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0e40071420 con 0x7f0e4006e950 2024-09-13T18:27:11.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f0e52ffd700 1 -- 172.21.15.44:0/2992957440 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e54089300 con 0x7f0e5c146480 2024-09-13T18:27:11.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f0e621dc700 1 --2- 172.21.15.44:0/2992957440 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0e40066730 0x7f0e40068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fe1937fe700 1 -- 172.21.15.44:0/402031547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1940b0090 msgr2=0x7fe1941eebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fe1937fe700 1 --2- 172.21.15.44:0/402031547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1940b0090 0x7fe1941eebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fe1937fe700 1 -- 172.21.15.44:0/402031547 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1940ccd40 msgr2=0x7fe1941ed950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fe1937fe700 1 --2- 172.21.15.44:0/402031547 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1940ccd40 0x7fe1941ed950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fe1937fe700 1 -- 172.21.15.44:0/402031547 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c014660 con 0x7fe19406fa90 2024-09-13T18:27:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f7bea586700 1 --2- 172.21.15.44:0/176183054 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7bc8066830 0x7f7bc8068cf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7be413cae0 tx=0x7f7bd4007a60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f8f6e59c700 1 --2- 172.21.15.44:0/832044507 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8f50066730 0x7f8f50068bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8f60001eb0 tx=0x7f8f60001ae0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f6232ffd700 1 -- 172.21.15.44:0/785268340 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6228004230 con 0x7f6234161fb0 2024-09-13T18:27:11.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f7bead87700 1 --2- 172.21.15.44:0/176183054 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7f7bc806ea50 0x7f7bc8070e70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f6232ffd700 1 -- 172.21.15.44:0/785268340 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6228004390 con 0x7f6234161fb0 2024-09-13T18:27:11.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f0e621dc700 1 --2- 172.21.15.44:0/2992957440 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0e40066730 0x7f0e40068bf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0e58006b40 tx=0x7f0e58006ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f0e629dd700 1 --2- 172.21.15.44:0/2992957440 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f0e4006e950 0x7f0e40070d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fe1937fe700 1 --2- 172.21.15.44:0/402031547 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe19406fa90 0x7fe19415a140 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe18400e840 tx=0x7fe18400eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fe183fff700 1 -- 172.21.15.44:0/402031547 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1840095a0 con 0x7fe19406fa90 2024-09-13T18:27:11.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fe183fff700 1 -- 172.21.15.44:0/402031547 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe184013680 con 0x7fe19406fa90 2024-09-13T18:27:11.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fe183fff700 1 -- 172.21.15.44:0/402031547 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1840139f0 con 0x7fe19406fa90 2024-09-13T18:27:11.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f0e629dd700 1 --2- 172.21.15.44:0/2992957440 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f0e4006e950 0x7f0e40070d70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f6232ffd700 1 -- 172.21.15.44:0/785268340 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62280036c0 con 0x7f6234161fb0 2024-09-13T18:27:11.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fc7277fe700 1 -- 172.21.15.44:0/1591570632 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc73400cd20 con 0x7fc7400710e0 2024-09-13T18:27:11.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fc7277fe700 1 --2- 172.21.15.44:0/1591570632 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc72c066780 0x7fc72c068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fc7277fe700 1 -- 172.21.15.44:0/1591570632 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7340843d0 con 0x7fc7400710e0 2024-09-13T18:27:11.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fc7277fe700 1 --2- 172.21.15.44:0/1591570632 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7fc72c06e9a0 0x7fc72c070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fc7277fe700 1 -- 172.21.15.44:0/1591570632 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc72c071470 con 0x7fc72c06e9a0 2024-09-13T18:27:11.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fc7277fe700 1 -- 172.21.15.44:0/1591570632 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc734084870 con 0x7fc7400710e0 2024-09-13T18:27:11.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fc73ed9d700 1 --2- 172.21.15.44:0/1591570632 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc72c066780 0x7fc72c068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fc73f59e700 1 --2- 172.21.15.44:0/1591570632 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7fc72c06e9a0 0x7fc72c070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7f7bdaffd700 1 -- 172.21.15.44:0/176183054 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7bc8071520 con 0x7f7bc806ea50 2024-09-13T18:27:11.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fe198e23700 1 -- 172.21.15.44:0/402031547 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe19415adc0 con 0x7fe19406fa90 2024-09-13T18:27:11.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.375+0000 7fe198e23700 1 -- 172.21.15.44:0/402031547 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19415b380 con 0x7fe19406fa90 2024-09-13T18:27:11.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.379+0000 7f8f6ed9d700 1 --2- 172.21.15.44:0/832044507 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x7f8f5006e8d0 0x7f8f50070cf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.379+0000 7fe198e23700 1 -- 172.21.15.44:0/402031547 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe194071c70 con 0x7fe19406fa90 2024-09-13T18:27:11.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.379+0000 7f0e52ffd700 1 -- 172.21.15.44:0/2992957440 <== osd.7 v2:172.21.15.99:6824/2245335901 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0e40071420 con 0x7f0e4006e950 2024-09-13T18:27:11.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.379+0000 7fe183fff700 1 -- 172.21.15.44:0/402031547 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe184013b50 con 0x7fe19406fa90 2024-09-13T18:27:11.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.379+0000 7fe183fff700 1 --2- 172.21.15.44:0/402031547 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe178066730 0x7fe178068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.379+0000 7fe192ffd700 1 --2- 172.21.15.44:0/402031547 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe178066730 0x7fe178068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.379+0000 7fe192ffd700 1 --2- 172.21.15.44:0/402031547 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe178066730 0x7fe178068bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe1940add40 tx=0x7fe188009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.383+0000 7f623a778700 1 -- 172.21.15.44:0/785268340 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6234161fb0 msgr2=0x7f623415b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.383+0000 7f623a778700 1 --2- 172.21.15.44:0/785268340 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6234161fb0 0x7f623415b070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6228009850 tx=0x7f6228009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:11.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.379+0000 7fc73f59e700 1 --2- 172.21.15.44:0/1591570632 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7fc72c06e9a0 0x7fc72c070dc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.379+0000 7fc73ed9d700 1 --2- 172.21.15.44:0/1591570632 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc72c066780 0x7fc72c068c40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc730009b70 tx=0x7fc730009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.379+0000 7fc7277fe700 1 -- 172.21.15.44:0/1591570632 <== osd.0 v2:172.21.15.44:6800/2647753462 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc72c071470 con 0x7fc72c06e9a0 2024-09-13T18:27:11.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.383+0000 7f623a778700 1 -- 172.21.15.44:0/785268340 shutdown_connections 2024-09-13T18:27:11.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.383+0000 7f623a778700 1 --2- 172.21.15.44:0/785268340 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6234161fb0 0x7f623415b070 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.383+0000 7f623a778700 1 --2- 172.21.15.44:0/785268340 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f62340ce080 0x7f62341446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.383+0000 7f623a778700 1 -- 172.21.15.44:0/785268340 >> 172.21.15.44:0/785268340 conn(0x7f62340af5d0 msgr2=0x7f62340af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.383+0000 7f623a778700 1 -- 172.21.15.44:0/785268340 shutdown_connections 2024-09-13T18:27:11.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.383+0000 7f623a778700 1 -- 172.21.15.44:0/785268340 wait complete. 2024-09-13T18:27:11.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.383+0000 7f623a778700 1 Processor -- start 2024-09-13T18:27:11.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.383+0000 7f623a778700 1 -- start start 2024-09-13T18:27:11.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.383+0000 7f623a778700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f62340ce080 0x7f623415a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.383+0000 7f623a778700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6234146770 0x7f623413cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.383+0000 7f623a778700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6234161fb0 0x7f623413d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.383+0000 7f623a778700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623406cb40 con 0x7f6234146770 2024-09-13T18:27:11.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.383+0000 7f623a778700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623406bf30 con 0x7f6234161fb0 2024-09-13T18:27:11.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.383+0000 7f623a778700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623406c210 con 0x7f62340ce080 2024-09-13T18:27:11.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.387+0000 7f62337fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6234146770 0x7f623413cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.387+0000 7f62337fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6234146770 0x7f623413cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38858/0 (socket says 172.21.15.44:38858) 2024-09-13T18:27:11.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.387+0000 7f6233fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f62340ce080 0x7f623415a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.387+0000 7f62337fe700 1 -- 172.21.15.44:0/1072036041 learned_addr learned my addr 172.21.15.44:0/1072036041 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.387+0000 7f6238d15700 1 --2- 172.21.15.44:0/1072036041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6234161fb0 0x7f623413d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.387+0000 7f62337fe700 1 -- 172.21.15.44:0/1072036041 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f62340ce080 msgr2=0x7f623415a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.387+0000 7f62337fe700 1 --2- 172.21.15.44:0/1072036041 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f62340ce080 0x7f623415a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.387+0000 7f62337fe700 1 -- 172.21.15.44:0/1072036041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6234161fb0 msgr2=0x7f623413d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.387+0000 7f62337fe700 1 --2- 172.21.15.44:0/1072036041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6234161fb0 0x7f623413d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.387+0000 7f62337fe700 1 -- 172.21.15.44:0/1072036041 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62280094b0 con 0x7f6234146770 2024-09-13T18:27:11.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.387+0000 7f6238d15700 1 --2- 172.21.15.44:0/1072036041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6234161fb0 0x7f623413d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:11.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.387+0000 7f62337fe700 1 --2- 172.21.15.44:0/1072036041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6234146770 0x7f623413cd30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f622400b480 tx=0x7f622400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.387+0000 7f6230ff9700 1 -- 172.21.15.44:0/1072036041 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6224011830 con 0x7f6234146770 2024-09-13T18:27:11.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.387+0000 7f6230ff9700 1 -- 172.21.15.44:0/1072036041 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62240119b0 con 0x7f6234146770 2024-09-13T18:27:11.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.387+0000 7f6230ff9700 1 -- 172.21.15.44:0/1072036041 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6224011d60 con 0x7f6234146770 2024-09-13T18:27:11.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.387+0000 7f623a778700 1 -- 172.21.15.44:0/1072036041 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623406c4f0 con 0x7f6234146770 2024-09-13T18:27:11.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.387+0000 7f623a778700 1 -- 172.21.15.44:0/1072036041 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623406bbc0 con 0x7f6234146770 2024-09-13T18:27:11.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.387+0000 7f6230ff9700 1 -- 172.21.15.44:0/1072036041 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f622401a400 con 0x7f6234146770 2024-09-13T18:27:11.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.387+0000 7f6230ff9700 1 --2- 172.21.15.44:0/1072036041 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6220066730 0x7f6220068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.387+0000 7f6230ff9700 1 -- 172.21.15.44:0/1072036041 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62240841c0 con 0x7f6234146770 2024-09-13T18:27:11.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.387+0000 7f6233fff700 1 --2- 172.21.15.44:0/1072036041 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6220066730 0x7f6220068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.387+0000 7f6233fff700 1 --2- 172.21.15.44:0/1072036041 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6220066730 0x7f6220068bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f623406d9b0 tx=0x7f622c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.391+0000 7fe183fff700 1 -- 172.21.15.44:0/402031547 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe184055af0 con 0x7fe19406fa90 2024-09-13T18:27:11.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.391+0000 7fe183fff700 1 --2- 172.21.15.44:0/402031547 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x7fe17806e8d0 0x7fe178070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.391+0000 7fe183fff700 1 -- 172.21.15.44:0/402031547 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1780713a0 con 0x7fe17806e8d0 2024-09-13T18:27:11.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.391+0000 7fe183fff700 1 -- 172.21.15.44:0/402031547 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe184051730 con 0x7fe19406fa90 2024-09-13T18:27:11.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.391+0000 7fe193fff700 1 --2- 172.21.15.44:0/402031547 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x7fe17806e8d0 0x7fe178070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.391+0000 7fe193fff700 1 --2- 172.21.15.44:0/402031547 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x7fe17806e8d0 0x7fe178070cf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.391+0000 7fe183fff700 1 -- 172.21.15.44:0/402031547 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe1780713a0 con 0x7fe17806e8d0 2024-09-13T18:27:11.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.395+0000 7f8f5effd700 1 -- 172.21.15.44:0/832044507 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8f500713a0 con 0x7f8f5006e8d0 2024-09-13T18:27:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.399+0000 7f623a778700 1 --2- 172.21.15.44:0/1072036041 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f62140015e0 0x7f6214003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.399+0000 7f623a778700 1 -- 172.21.15.44:0/1072036041 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6214006bf0 con 0x7f62140015e0 2024-09-13T18:27:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.399+0000 7f6238d15700 1 --2- 172.21.15.44:0/1072036041 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f62140015e0 0x7f6214003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.399+0000 7f6238d15700 1 --2- 172.21.15.44:0/1072036041 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f62140015e0 0x7f6214003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.399+0000 7f6230ff9700 1 -- 172.21.15.44:0/1072036041 <== osd.5 v2:172.21.15.99:6800/827163121 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f6214006bf0 con 0x7f62140015e0 2024-09-13T18:27:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7fc744919700 1 -- 172.21.15.44:0/1591570632 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc720002d90 con 0x7fc72c06e9a0 2024-09-13T18:27:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f9404e10700 1 -- 172.21.15.44:0/3553097960 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f93e0002d60 con 0x7f93ec06ea20 2024-09-13T18:27:11.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7fc7277fe700 1 -- 172.21.15.44:0/1591570632 <== osd.0 v2:172.21.15.44:6800/2647753462 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc720002d90 con 0x7fc72c06e9a0 2024-09-13T18:27:11.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f7bec7ea700 1 -- 172.21.15.44:0/176183054 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7be40b34c0 con 0x7f7bc806ea50 2024-09-13T18:27:11.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f0e631de700 1 -- 172.21.15.44:0/2992957440 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0e5c0b2810 con 0x7f0e4006e950 2024-09-13T18:27:11.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f93e7fff700 1 -- 172.21.15.44:0/3553097960 <== osd.6 v2:172.21.15.99:6808/2907584318 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f93e0002d60 con 0x7f93ec06ea20 2024-09-13T18:27:11.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f7bdaffd700 1 -- 172.21.15.44:0/176183054 <== osd.1 v2:172.21.15.44:6816/2250405239 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7be00019a0 con 0x7f7bc806ea50 2024-09-13T18:27:11.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7fc744919700 1 -- 172.21.15.44:0/1591570632 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7fc72c06e9a0 msgr2=0x7fc72c070dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7fc744919700 1 --2- 172.21.15.44:0/1591570632 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7fc72c06e9a0 0x7fc72c070dc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7fc744919700 1 -- 172.21.15.44:0/1591570632 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc72c066780 msgr2=0x7fc72c068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7fc744919700 1 --2- 172.21.15.44:0/1591570632 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc72c066780 0x7fc72c068c40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc730009b70 tx=0x7fc730009240 comp rx=0 tx=0).stop 2024-09-13T18:27:11.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7fc744919700 1 -- 172.21.15.44:0/1591570632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7400710e0 msgr2=0x7fc740157220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7fc744919700 1 --2- 172.21.15.44:0/1591570632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7400710e0 0x7fc740157220 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc73400e9a0 tx=0x7fc73400ecb0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f0e52ffd700 1 -- 172.21.15.44:0/2992957440 <== osd.7 v2:172.21.15.99:6824/2245335901 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0e5c0b2810 con 0x7f0e4006e950 2024-09-13T18:27:11.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7fc73f59e700 1 -- 172.21.15.44:0/1591570632 reap_dead start 2024-09-13T18:27:11.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7fc744919700 1 -- 172.21.15.44:0/1591570632 shutdown_connections 2024-09-13T18:27:11.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7fc744919700 1 -- 172.21.15.44:0/1591570632 >> 172.21.15.44:0/1591570632 conn(0x7fc7400ae590 msgr2=0x7fc74006be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f9404e10700 1 -- 172.21.15.44:0/3553097960 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f93ec06ea20 msgr2=0x7f93ec070e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f9404e10700 1 --2- 172.21.15.44:0/3553097960 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f93ec06ea20 0x7f93ec070e40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7fc744919700 1 -- 172.21.15.44:0/1591570632 shutdown_connections 2024-09-13T18:27:11.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7fc744919700 1 -- 172.21.15.44:0/1591570632 wait complete. 2024-09-13T18:27:11.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f9404e10700 1 -- 172.21.15.44:0/3553097960 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f93ec066800 msgr2=0x7f93ec068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f9404e10700 1 --2- 172.21.15.44:0/3553097960 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f93ec066800 0x7f93ec068cc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f94001ea9f0 tx=0x7f93f00092e0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f43f3c0a700 1 -- 172.21.15.44:0/373186744 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f43ec0b0350 con 0x7f43d006e900 2024-09-13T18:27:11.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f9404e10700 1 -- 172.21.15.44:0/3553097960 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9400164f90 msgr2=0x7f9400158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f9404e10700 1 --2- 172.21.15.44:0/3553097960 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9400164f90 0x7f9400158580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009eb0 tx=0x7f93f4004770 comp rx=0 tx=0).stop 2024-09-13T18:27:11.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f93fffff700 1 -- 172.21.15.44:0/3553097960 reap_dead start 2024-09-13T18:27:11.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f7bec7ea700 1 -- 172.21.15.44:0/176183054 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7f7bc806ea50 msgr2=0x7f7bc8070e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f7bec7ea700 1 --2- 172.21.15.44:0/176183054 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7f7bc806ea50 0x7f7bc8070e70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f9404e10700 1 -- 172.21.15.44:0/3553097960 shutdown_connections 2024-09-13T18:27:11.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f9404e10700 1 -- 172.21.15.44:0/3553097960 >> 172.21.15.44:0/3553097960 conn(0x7f94000b0e10 msgr2=0x7f94000aee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f9404e10700 1 -- 172.21.15.44:0/3553097960 shutdown_connections 2024-09-13T18:27:11.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f9404e10700 1 -- 172.21.15.44:0/3553097960 wait complete. 2024-09-13T18:27:11.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f43e27fc700 1 -- 172.21.15.44:0/373186744 <== osd.4 v2:172.21.15.99:6816/2515272044 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f43ec0b0350 con 0x7f43d006e900 2024-09-13T18:27:11.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f7bec7ea700 1 -- 172.21.15.44:0/176183054 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7bc8066830 msgr2=0x7f7bc8068cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f7bec7ea700 1 --2- 172.21.15.44:0/176183054 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7bc8066830 0x7f7bc8068cf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7be413cae0 tx=0x7f7bd4007a60 comp rx=0 tx=0).stop 2024-09-13T18:27:11.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f7bec7ea700 1 -- 172.21.15.44:0/176183054 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7be41edd20 msgr2=0x7f7be412de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f7bec7ea700 1 --2- 172.21.15.44:0/176183054 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7be41edd20 0x7f7be412de60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000a020 tx=0x7f7bdc004b60 comp rx=0 tx=0).stop 2024-09-13T18:27:11.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f7bead87700 1 -- 172.21.15.44:0/176183054 reap_dead start 2024-09-13T18:27:11.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f7bec7ea700 1 -- 172.21.15.44:0/176183054 shutdown_connections 2024-09-13T18:27:11.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f7bec7ea700 1 -- 172.21.15.44:0/176183054 >> 172.21.15.44:0/176183054 conn(0x7f7be40af620 msgr2=0x7f7be406cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f7bec7ea700 1 -- 172.21.15.44:0/176183054 shutdown_connections 2024-09-13T18:27:11.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.407+0000 7f7bec7ea700 1 -- 172.21.15.44:0/176183054 wait complete. 2024-09-13T18:27:11.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.415+0000 7f43f3c0a700 1 -- 172.21.15.44:0/373186744 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f43d006e900 msgr2=0x7f43d0070d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.415+0000 7f43f3c0a700 1 --2- 172.21.15.44:0/373186744 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f43d006e900 0x7f43d0070d20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.415+0000 7f43f3c0a700 1 -- 172.21.15.44:0/373186744 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f43d0066760 msgr2=0x7f43d0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.415+0000 7f43f3c0a700 1 --2- 172.21.15.44:0/373186744 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f43d0066760 0x7f43d0068c20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f43e8007fd0 tx=0x7f43e8007980 comp rx=0 tx=0).stop 2024-09-13T18:27:11.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.415+0000 7f43f3c0a700 1 -- 172.21.15.44:0/373186744 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f43ec0ccd50 msgr2=0x7f43ec13bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.415+0000 7f43f3c0a700 1 --2- 172.21.15.44:0/373186744 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f43ec0ccd50 0x7f43ec13bff0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f43ec067130 tx=0x7f43dc004770 comp rx=0 tx=0).stop 2024-09-13T18:27:11.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.415+0000 7f43f21a7700 1 -- 172.21.15.44:0/373186744 reap_dead start 2024-09-13T18:27:11.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.415+0000 7f43f3c0a700 1 -- 172.21.15.44:0/373186744 shutdown_connections 2024-09-13T18:27:11.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.415+0000 7f43f3c0a700 1 -- 172.21.15.44:0/373186744 >> 172.21.15.44:0/373186744 conn(0x7f43ec070d00 msgr2=0x7f43ec0af660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.415+0000 7f43f3c0a700 1 -- 172.21.15.44:0/373186744 shutdown_connections 2024-09-13T18:27:11.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.415+0000 7f43f3c0a700 1 -- 172.21.15.44:0/373186744 wait complete. 2024-09-13T18:27:11.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.415+0000 7f0e631de700 1 -- 172.21.15.44:0/2992957440 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f0e4006e950 msgr2=0x7f0e40070d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.415+0000 7f0e631de700 1 --2- 172.21.15.44:0/2992957440 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f0e4006e950 0x7f0e40070d70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.415+0000 7f0e631de700 1 -- 172.21.15.44:0/2992957440 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0e40066730 msgr2=0x7f0e40068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.415+0000 7f0e631de700 1 --2- 172.21.15.44:0/2992957440 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0e40066730 0x7f0e40068bf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0e58006b40 tx=0x7f0e58006ad0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.415+0000 7f0e631de700 1 -- 172.21.15.44:0/2992957440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e5c146480 msgr2=0x7f0e5c137f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.415+0000 7f0e631de700 1 --2- 172.21.15.44:0/2992957440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e5c146480 0x7f0e5c137f70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0e5400cbc0 tx=0x7f0e5400cca0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.415+0000 7f0e629dd700 1 -- 172.21.15.44:0/2992957440 reap_dead start 2024-09-13T18:27:11.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.415+0000 7f0e631de700 1 -- 172.21.15.44:0/2992957440 shutdown_connections 2024-09-13T18:27:11.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.415+0000 7f0e631de700 1 -- 172.21.15.44:0/2992957440 >> 172.21.15.44:0/2992957440 conn(0x7f0e5c0ae590 msgr2=0x7f0e5c0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.415+0000 7f0e631de700 1 -- 172.21.15.44:0/2992957440 shutdown_connections 2024-09-13T18:27:11.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.415+0000 7f0e631de700 1 -- 172.21.15.44:0/2992957440 wait complete. 2024-09-13T18:27:11.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.419+0000 7fe198e23700 1 -- 172.21.15.44:0/402031547 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe194071c70 con 0x7fe17806e8d0 2024-09-13T18:27:11.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.419+0000 7fe183fff700 1 -- 172.21.15.44:0/402031547 <== osd.3 v2:172.21.15.44:6808/771281770 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe194071c70 con 0x7fe17806e8d0 2024-09-13T18:27:11.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7f8f6f59e700 1 -- 172.21.15.44:0/832044507 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8f54002d60 con 0x7f8f5006e8d0 2024-09-13T18:27:11.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7fe198e23700 1 -- 172.21.15.44:0/402031547 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x7fe17806e8d0 msgr2=0x7fe178070cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7fe198e23700 1 --2- 172.21.15.44:0/402031547 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x7fe17806e8d0 0x7fe178070cf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7fe198e23700 1 -- 172.21.15.44:0/402031547 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe178066730 msgr2=0x7fe178068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7f8f5effd700 1 -- 172.21.15.44:0/832044507 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8f54002d60 con 0x7f8f5006e8d0 2024-09-13T18:27:11.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7fe198e23700 1 --2- 172.21.15.44:0/402031547 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe178066730 0x7fe178068bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe1940add40 tx=0x7fe188009240 comp rx=0 tx=0).stop 2024-09-13T18:27:11.462 INFO:teuthology.orchestra.run.smithi044.stdout:55834574856 2024-09-13T18:27:11.463 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:27:11.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7fe198e23700 1 -- 172.21.15.44:0/402031547 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe19406fa90 msgr2=0x7fe19415a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7fe198e23700 1 --2- 172.21.15.44:0/402031547 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe19406fa90 0x7fe19415a140 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe18400e840 tx=0x7fe18400eb50 comp rx=0 tx=0).stop 2024-09-13T18:27:11.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7fe193fff700 1 -- 172.21.15.44:0/402031547 reap_dead start 2024-09-13T18:27:11.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7fe198e23700 1 -- 172.21.15.44:0/402031547 shutdown_connections 2024-09-13T18:27:11.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7fe198e23700 1 -- 172.21.15.44:0/402031547 >> 172.21.15.44:0/402031547 conn(0x7fe1940ae590 msgr2=0x7fe19406bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7fe198e23700 1 -- 172.21.15.44:0/402031547 shutdown_connections 2024-09-13T18:27:11.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7f8f6f59e700 1 -- 172.21.15.44:0/832044507 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x7f8f5006e8d0 msgr2=0x7f8f50070cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7f8f6f59e700 1 --2- 172.21.15.44:0/832044507 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x7f8f5006e8d0 0x7f8f50070cf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7fe198e23700 1 -- 172.21.15.44:0/402031547 wait complete. 2024-09-13T18:27:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7f8f6f59e700 1 -- 172.21.15.44:0/832044507 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8f50066730 msgr2=0x7f8f50068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7f8f6f59e700 1 --2- 172.21.15.44:0/832044507 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8f50066730 0x7f8f50068bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8f60001eb0 tx=0x7f8f60001ae0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7f8f6f59e700 1 -- 172.21.15.44:0/832044507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f7015c650 msgr2=0x7f8f701592b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7f8f6f59e700 1 --2- 172.21.15.44:0/832044507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f7015c650 0x7f8f701592b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8f68017040 tx=0x7f8f68004c00 comp rx=0 tx=0).stop 2024-09-13T18:27:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7f8f6ed9d700 1 -- 172.21.15.44:0/832044507 reap_dead start 2024-09-13T18:27:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7f8f6f59e700 1 -- 172.21.15.44:0/832044507 shutdown_connections 2024-09-13T18:27:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7f8f6f59e700 1 -- 172.21.15.44:0/832044507 >> 172.21.15.44:0/832044507 conn(0x7f8f700b0e10 msgr2=0x7f8f70140170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7f8f6f59e700 1 -- 172.21.15.44:0/832044507 shutdown_connections 2024-09-13T18:27:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.423+0000 7f8f6f59e700 1 -- 172.21.15.44:0/832044507 wait complete. 2024-09-13T18:27:11.467 INFO:teuthology.orchestra.run.smithi044.stdout:55834574856 2024-09-13T18:27:11.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.427+0000 7f623a778700 1 -- 172.21.15.44:0/1072036041 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6214005c70 con 0x7f62140015e0 2024-09-13T18:27:11.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.427+0000 7f6230ff9700 1 -- 172.21.15.44:0/1072036041 <== osd.5 v2:172.21.15.99:6800/827163121 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6214005c70 con 0x7f62140015e0 2024-09-13T18:27:11.468 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:27:11.468 INFO:teuthology.orchestra.run.smithi044.stdout:55834574857 2024-09-13T18:27:11.469 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T18:27:11.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.431+0000 7f623a778700 1 -- 172.21.15.44:0/1072036041 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f62140015e0 msgr2=0x7f6214003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.431+0000 7f623a778700 1 --2- 172.21.15.44:0/1072036041 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f62140015e0 0x7f6214003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.431+0000 7f623a778700 1 -- 172.21.15.44:0/1072036041 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6220066730 msgr2=0x7f6220068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.431+0000 7f623a778700 1 --2- 172.21.15.44:0/1072036041 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6220066730 0x7f6220068bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f623406d9b0 tx=0x7f622c009040 comp rx=0 tx=0).stop 2024-09-13T18:27:11.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.431+0000 7f623a778700 1 -- 172.21.15.44:0/1072036041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6234146770 msgr2=0x7f623413cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.431+0000 7f623a778700 1 --2- 172.21.15.44:0/1072036041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6234146770 0x7f623413cd30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f622400b480 tx=0x7f622400b840 comp rx=0 tx=0).stop 2024-09-13T18:27:11.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.431+0000 7f6238d15700 1 -- 172.21.15.44:0/1072036041 reap_dead start 2024-09-13T18:27:11.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.431+0000 7f623a778700 1 -- 172.21.15.44:0/1072036041 shutdown_connections 2024-09-13T18:27:11.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.431+0000 7f623a778700 1 -- 172.21.15.44:0/1072036041 >> 172.21.15.44:0/1072036041 conn(0x7f62340af5d0 msgr2=0x7f62340af9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.431+0000 7f623a778700 1 -- 172.21.15.44:0/1072036041 shutdown_connections 2024-09-13T18:27:11.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.431+0000 7f623a778700 1 -- 172.21.15.44:0/1072036041 wait complete. 2024-09-13T18:27:11.471 INFO:teuthology.orchestra.run.smithi044.stdout:55834574855 2024-09-13T18:27:11.471 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T18:27:11.472 INFO:teuthology.orchestra.run.smithi044.stdout:55834574855 2024-09-13T18:27:11.472 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T18:27:11.473 INFO:teuthology.orchestra.run.smithi044.stdout:55834574858 2024-09-13T18:27:11.473 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:27:11.474 INFO:teuthology.orchestra.run.smithi044.stdout:55834574856 2024-09-13T18:27:11.474 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:27:11.475 INFO:teuthology.orchestra.run.smithi044.stdout:55834574855 2024-09-13T18:27:11.476 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T18:27:11.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc9939700 1 Processor -- start 2024-09-13T18:27:11.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc9939700 1 -- start start 2024-09-13T18:27:11.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7fb47616a700 1 Processor -- start 2024-09-13T18:27:11.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7f4d81c4a700 1 Processor -- start 2024-09-13T18:27:11.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7fb47616a700 1 -- start start 2024-09-13T18:27:11.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc9939700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7febc40cdc90 0x7febc4165790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc9939700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc415adb0 con 0x7febc415bac0 2024-09-13T18:27:11.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc9939700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc415b630 con 0x7febc41583f0 2024-09-13T18:27:11.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc9939700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc406c6e0 con 0x7febc40cdc90 2024-09-13T18:27:11.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc27fc700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7febc415bac0 0x7febc40cd580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52602/0 (socket says 172.21.15.44:52602) 2024-09-13T18:27:11.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc27fc700 1 -- 172.21.15.44:0/2092906590 learned_addr learned my addr 172.21.15.44:0/2092906590 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:11.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7f4d81c4a700 1 -- start start 2024-09-13T18:27:11.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc37fe700 1 --2- 172.21.15.44:0/2092906590 >> v2:172.21.15.99:3300/0 conn(0x7febc40cdc90 0x7febc4165790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc1ffb700 1 -- 172.21.15.44:0/2092906590 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277016318 0 0) 0x7febc415adb0 con 0x7febc415bac0 2024-09-13T18:27:11.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc1ffb700 1 -- 172.21.15.44:0/2092906590 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febac0035d0 con 0x7febc415bac0 2024-09-13T18:27:11.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc1ffb700 1 -- 172.21.15.44:0/2092906590 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692703531 0 0) 0x7febc415b630 con 0x7febc41583f0 2024-09-13T18:27:11.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc1ffb700 1 -- 172.21.15.44:0/2092906590 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febc415adb0 con 0x7febc41583f0 2024-09-13T18:27:11.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc1ffb700 1 -- 172.21.15.44:0/2092906590 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2413277533 0 0) 0x7febac0035d0 con 0x7febc415bac0 2024-09-13T18:27:11.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc1ffb700 1 -- 172.21.15.44:0/2092906590 >> v2:172.21.15.99:3300/0 conn(0x7febc40cdc90 msgr2=0x7febc4165790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc1ffb700 1 --2- 172.21.15.44:0/2092906590 >> v2:172.21.15.99:3300/0 conn(0x7febc40cdc90 0x7febc4165790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7fb47616a700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb47015bac0 0x7fb4700cd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7fb47616a700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb4700cdac0 0x7fb47006fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc1ffb700 1 -- 172.21.15.44:0/2092906590 >> v1:172.21.15.99:6789/0 conn(0x7febc41583f0 legacy=0x7febc406b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc1ffb700 1 -- 172.21.15.44:0/2092906590 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc41587d0 con 0x7febc415bac0 2024-09-13T18:27:11.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc1ffb700 1 -- 172.21.15.44:0/2092906590 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7febb4001670 con 0x7febc415bac0 2024-09-13T18:27:11.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc1ffb700 1 -- 172.21.15.44:0/2092906590 >> v1:172.21.15.44:6789/0 conn(0x7febc415bac0 legacy=0x7febc40cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc1ffb700 1 --2- 172.21.15.44:0/2092906590 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febac003bb0 0x7febac003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7fb47616a700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4700cdf10 con 0x7fb4701583f0 2024-09-13T18:27:11.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7fb47616a700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb47015adb0 con 0x7fb47015bac0 2024-09-13T18:27:11.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7fb47616a700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb47015b630 con 0x7fb4700cdac0 2024-09-13T18:27:11.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc1ffb700 1 --2- 172.21.15.44:0/2092906590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febac004870 0x7febac004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc1ffb700 1 --2- 172.21.15.44:0/2092906590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7febac005230 0x7febac00fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc1ffb700 1 -- 172.21.15.44:0/2092906590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc406c6e0 con 0x7febac005230 2024-09-13T18:27:11.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc1ffb700 1 -- 172.21.15.44:0/2092906590 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac010460 con 0x7febac004870 2024-09-13T18:27:11.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc1ffb700 1 -- 172.21.15.44:0/2092906590 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac010620 con 0x7febac003bb0 2024-09-13T18:27:11.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc2ffd700 1 --2- 172.21.15.44:0/2092906590 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febac003bb0 0x7febac003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7f4d81c4a700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4d7c0b3270 0x7f4d7c0b3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7f4d81c4a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d7c06b510 0x7f4d7c06b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7f4d81c4a700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7c0cd720 con 0x7f4d7c071160 2024-09-13T18:27:11.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7f4d81c4a700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d7c0b3b90 con 0x7f4d7c0b3270 2024-09-13T18:27:11.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7f4d81c4a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0cd9c0 con 0x7f4d7c06b510 2024-09-13T18:27:11.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7fb46effd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb47015bac0 0x7fb4700cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7fb46effd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb47015bac0 0x7fb4700cd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38872/0 (socket says 172.21.15.44:38872) 2024-09-13T18:27:11.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7fb46effd700 1 -- 172.21.15.44:0/2610625336 learned_addr learned my addr 172.21.15.44:0/2610625336 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7febc37fe700 1 --2- 172.21.15.44:0/2092906590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7febac005230 0x7febac00fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7febc27fc700 1 --2- 172.21.15.44:0/2092906590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febac004870 0x7febac004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.655+0000 7f4d7b7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4d7c0b3270 0x7f4d7c0b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7f4d7b7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4d7c0b3270 0x7f4d7c0b3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38886/0 (socket says 172.21.15.44:38886) 2024-09-13T18:27:11.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7f4d7b7fe700 1 -- 172.21.15.44:0/1909227377 learned_addr learned my addr 172.21.15.44:0/1909227377 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7f4d7affd700 1 --2- 172.21.15.44:0/1909227377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d7c06b510 0x7f4d7c06b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb46ffff700 1 --2- 172.21.15.44:0/2610625336 >> v2:172.21.15.99:3300/0 conn(0x7fb4700cdac0 0x7fb47006fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb46effd700 1 -- 172.21.15.44:0/2610625336 >> v2:172.21.15.99:3300/0 conn(0x7fb4700cdac0 msgr2=0x7fb47006fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb46effd700 1 --2- 172.21.15.44:0/2610625336 >> v2:172.21.15.99:3300/0 conn(0x7fb4700cdac0 0x7fb47006fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb46effd700 1 -- 172.21.15.44:0/2610625336 >> v1:172.21.15.99:6789/0 conn(0x7fb4701583f0 legacy=0x7fb47006b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb46effd700 1 -- 172.21.15.44:0/2610625336 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47006c6e0 con 0x7fb47015bac0 2024-09-13T18:27:11.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb6f39b1700 1 Processor -- start 2024-09-13T18:27:11.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb6f39b1700 1 -- start start 2024-09-13T18:27:11.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7febc2ffd700 1 -- 172.21.15.44:0/2092906590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febac004870 msgr2=0x7febac004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7febc2ffd700 1 --2- 172.21.15.44:0/2092906590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febac004870 0x7febac004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7febc2ffd700 1 -- 172.21.15.44:0/2092906590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7febac005230 msgr2=0x7febac00fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7febc2ffd700 1 --2- 172.21.15.44:0/2092906590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7febac005230 0x7febac00fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7febc2ffd700 1 -- 172.21.15.44:0/2092906590 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc41587d0 con 0x7febac003bb0 2024-09-13T18:27:11.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7febc37fe700 1 -- 172.21.15.44:0/2092906590 reap_dead start 2024-09-13T18:27:11.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7febc2ffd700 1 --2- 172.21.15.44:0/2092906590 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febac003bb0 0x7febac003fb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7febbc00c2f0 tx=0x7febac0058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=902c6b9567e6f925 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7f4d7b7fe700 1 -- 172.21.15.44:0/1909227377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d7c06b510 msgr2=0x7f4d7c06b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7f4d7b7fe700 1 --2- 172.21.15.44:0/1909227377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d7c06b510 0x7f4d7c06b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7f4d7b7fe700 1 -- 172.21.15.44:0/1909227377 >> v1:172.21.15.99:6789/0 conn(0x7f4d7c071160 legacy=0x7f4d7c0715f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7f4d7b7fe700 1 -- 172.21.15.44:0/1909227377 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c0cdca0 con 0x7f4d7c0b3270 2024-09-13T18:27:11.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7f4d7b7fe700 1 --2- 172.21.15.44:0/1909227377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d7c0b3270 0x7f4d7c0b3650 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4d74009ed0 tx=0x7f4d7400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9dac7322d2f37ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb46effd700 1 --2- 172.21.15.44:0/2610625336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb47015bac0 0x7fb4700cd580 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb4700cb090 tx=0x7fb464009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c5d1e63999112c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb46e7fc700 1 -- 172.21.15.44:0/2610625336 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46400b8a0 con 0x7fb47015bac0 2024-09-13T18:27:11.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb46e7fc700 1 -- 172.21.15.44:0/2610625336 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46400ba00 con 0x7fb47015bac0 2024-09-13T18:27:11.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb46e7fc700 1 -- 172.21.15.44:0/2610625336 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46400bd70 con 0x7fb47015bac0 2024-09-13T18:27:11.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7febc1ffb700 1 -- 172.21.15.44:0/2092906590 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc001f30 con 0x7febac003bb0 2024-09-13T18:27:11.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7febc1ffb700 1 -- 172.21.15.44:0/2092906590 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc00ce90 con 0x7febac003bb0 2024-09-13T18:27:11.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7febc9939700 1 -- 172.21.15.44:0/2092906590 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febac003bb0 msgr2=0x7febac003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7febc9939700 1 --2- 172.21.15.44:0/2092906590 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febac003bb0 0x7febac003fb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7febbc00c2f0 tx=0x7febac0058a0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7febc9939700 1 -- 172.21.15.44:0/2092906590 shutdown_connections 2024-09-13T18:27:11.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7f4d7a7fc700 1 -- 172.21.15.44:0/1909227377 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d740090d0 con 0x7f4d7c0b3270 2024-09-13T18:27:11.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7f4d7a7fc700 1 -- 172.21.15.44:0/1909227377 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d74009230 con 0x7f4d7c0b3270 2024-09-13T18:27:11.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7f4d7a7fc700 1 -- 172.21.15.44:0/1909227377 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d74003c80 con 0x7f4d7c0b3270 2024-09-13T18:27:11.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7f4d81c4a700 1 -- 172.21.15.44:0/1909227377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d7c0b3270 msgr2=0x7f4d7c0b3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7f4d81c4a700 1 --2- 172.21.15.44:0/1909227377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d7c0b3270 0x7f4d7c0b3650 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4d74009ed0 tx=0x7f4d7400f740 comp rx=0 tx=0).stop 2024-09-13T18:27:11.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb47616a700 1 -- 172.21.15.44:0/2610625336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb47015bac0 msgr2=0x7fb4700cd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb47616a700 1 --2- 172.21.15.44:0/2610625336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb47015bac0 0x7fb4700cd580 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb4700cb090 tx=0x7fb464009bf0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7febc9939700 1 --2- 172.21.15.44:0/2092906590 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febac003bb0 0x7febac003fb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7febc9939700 1 -- 172.21.15.44:0/2092906590 >> 172.21.15.44:0/2092906590 conn(0x7febc40ae590 msgr2=0x7febc40ae970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7febc9939700 1 -- 172.21.15.44:0/2092906590 shutdown_connections 2024-09-13T18:27:11.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb6f39b1700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb6ec144340 0x7fb6ec06d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb6f39b1700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb6ec06bdb0 0x7fb6ec0cd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb6f39b1700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ec144720 con 0x7fb6ec15f140 2024-09-13T18:27:11.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb6f39b1700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ec06dd40 con 0x7fb6ec144340 2024-09-13T18:27:11.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb6f39b1700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec06da60 con 0x7fb6ec06bdb0 2024-09-13T18:27:11.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7f4d81c4a700 1 -- 172.21.15.44:0/1909227377 shutdown_connections 2024-09-13T18:27:11.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7f4d81c4a700 1 --2- 172.21.15.44:0/1909227377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d7c06b510 0x7f4d7c06b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7f4d81c4a700 1 --2- 172.21.15.44:0/1909227377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d7c0b3270 0x7f4d7c0b3650 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7f4d81c4a700 1 -- 172.21.15.44:0/1909227377 >> 172.21.15.44:0/1909227377 conn(0x7f4d7c0b0e10 msgr2=0x7f4d7c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb47616a700 1 -- 172.21.15.44:0/2610625336 shutdown_connections 2024-09-13T18:27:11.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb47616a700 1 --2- 172.21.15.44:0/2610625336 >> v2:172.21.15.99:3300/0 conn(0x7fb4700cdac0 0x7fb47006fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb47616a700 1 --2- 172.21.15.44:0/2610625336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb47015bac0 0x7fb4700cd580 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb47616a700 1 -- 172.21.15.44:0/2610625336 >> 172.21.15.44:0/2610625336 conn(0x7fb4700ae590 msgr2=0x7fb4700ae970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7f4d81c4a700 1 -- 172.21.15.44:0/1909227377 shutdown_connections 2024-09-13T18:27:11.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb6f174d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb6ec144340 0x7fb6ec06d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb6f174d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb6ec144340 0x7fb6ec06d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38898/0 (socket says 172.21.15.44:38898) 2024-09-13T18:27:11.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb6f174d700 1 -- 172.21.15.44:0/450155280 learned_addr learned my addr 172.21.15.44:0/450155280 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb6f0f4c700 1 --2- 172.21.15.44:0/450155280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb6ec06bdb0 0x7fb6ec0cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7f4d81c4a700 1 -- 172.21.15.44:0/1909227377 wait complete. 2024-09-13T18:27:11.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7febc9939700 1 -- 172.21.15.44:0/2092906590 wait complete. 2024-09-13T18:27:11.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb6f0f4c700 1 -- 172.21.15.44:0/450155280 >> v2:172.21.15.44:3300/0 conn(0x7fb6ec144340 msgr2=0x7fb6ec06d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb6f0f4c700 1 --2- 172.21.15.44:0/450155280 >> v2:172.21.15.44:3300/0 conn(0x7fb6ec144340 0x7fb6ec06d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb47616a700 1 -- 172.21.15.44:0/2610625336 shutdown_connections 2024-09-13T18:27:11.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb6f0f4c700 1 -- 172.21.15.44:0/450155280 >> v1:172.21.15.44:6789/0 conn(0x7fb6ec15f140 legacy=0x7fb6ec070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb47616a700 1 -- 172.21.15.44:0/2610625336 wait complete. 2024-09-13T18:27:11.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb6f0f4c700 1 -- 172.21.15.44:0/450155280 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ec15e660 con 0x7fb6ec06bdb0 2024-09-13T18:27:11.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7fb6f174d700 1 --2- 172.21.15.44:0/450155280 >> v2:172.21.15.44:3300/0 conn(0x7fb6ec144340 0x7fb6ec06d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:11.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.659+0000 7febc9939700 1 Processor -- start 2024-09-13T18:27:11.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb6f0f4c700 1 --2- 172.21.15.44:0/450155280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb6ec06bdb0 0x7fb6ec0cd580 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8009850 tx=0x7fb6e8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1acb736bdb36ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d81c4a700 1 Processor -- start 2024-09-13T18:27:11.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7febc9939700 1 -- start start 2024-09-13T18:27:11.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d81c4a700 1 -- start start 2024-09-13T18:27:11.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb6e3fff700 1 -- 172.21.15.44:0/450155280 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e8004230 con 0x7fb6ec06bdb0 2024-09-13T18:27:11.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb6e3fff700 1 -- 172.21.15.44:0/450155280 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e8004390 con 0x7fb6ec06bdb0 2024-09-13T18:27:11.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb6e3fff700 1 -- 172.21.15.44:0/450155280 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e80036c0 con 0x7fb6ec06bdb0 2024-09-13T18:27:11.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb47616a700 1 Processor -- start 2024-09-13T18:27:11.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb47616a700 1 -- start start 2024-09-13T18:27:11.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7febc9939700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febac003bb0 0x7febc4148840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d81c4a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d7c06b510 0x7f4d7c139d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7febc9939700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febc415cc90 0x7febc40cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7febc9939700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7febc415d110 0x7febc40ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb6f39b1700 1 -- 172.21.15.44:0/450155280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb6ec06bdb0 msgr2=0x7fb6ec0cd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb6f39b1700 1 --2- 172.21.15.44:0/450155280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb6ec06bdb0 0x7fb6ec0cd580 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8009850 tx=0x7fb6e8009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:11.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb6f39b1700 1 -- 172.21.15.44:0/450155280 shutdown_connections 2024-09-13T18:27:11.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb6f39b1700 1 --2- 172.21.15.44:0/450155280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb6ec06bdb0 0x7fb6ec0cd580 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8009850 tx=0x7fb6e8009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:11.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb6f39b1700 1 --2- 172.21.15.44:0/450155280 >> v2:172.21.15.44:3300/0 conn(0x7fb6ec144340 0x7fb6ec06d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb6f39b1700 1 -- 172.21.15.44:0/450155280 >> 172.21.15.44:0/450155280 conn(0x7fb6ec0b0e10 msgr2=0x7fb6ec0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7febc9939700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc4155f60 con 0x7febc415d110 2024-09-13T18:27:11.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7febc9939700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc4156240 con 0x7febac003bb0 2024-09-13T18:27:11.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7febc9939700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc4156520 con 0x7febc415cc90 2024-09-13T18:27:11.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d81c4a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d7c071160 0x7f4d7c1f9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d81c4a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d7c0b3270 0x7f4d7c13a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d81c4a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c138aa0 con 0x7f4d7c071160 2024-09-13T18:27:11.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d81c4a700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c137640 con 0x7f4d7c0b3270 2024-09-13T18:27:11.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d81c4a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c137920 con 0x7f4d7c06b510 2024-09-13T18:27:11.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d7affd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d7c071160 0x7f4d7c1f9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d7affd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d7c071160 0x7f4d7c1f9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38912/0 (socket says 172.21.15.44:38912) 2024-09-13T18:27:11.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d7affd700 1 -- 172.21.15.44:0/2211918103 learned_addr learned my addr 172.21.15.44:0/2211918103 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7febc37fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7febc415d110 0x7febc40ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7febc37fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7febc415d110 0x7febc40ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38918/0 (socket says 172.21.15.44:38918) 2024-09-13T18:27:11.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7febc37fe700 1 -- 172.21.15.44:0/1562136255 learned_addr learned my addr 172.21.15.44:0/1562136255 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d7b7fe700 1 --2- 172.21.15.44:0/2211918103 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d7c06b510 0x7f4d7c139d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7febc27fc700 1 --2- 172.21.15.44:0/1562136255 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febc415cc90 0x7febc40cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7febc2ffd700 1 --2- 172.21.15.44:0/1562136255 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febac003bb0 0x7febc4148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d7bfff700 1 --2- 172.21.15.44:0/2211918103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d7c0b3270 0x7f4d7c13a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d7affd700 1 -- 172.21.15.44:0/2211918103 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d7c06b510 msgr2=0x7f4d7c139d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d7affd700 1 --2- 172.21.15.44:0/2211918103 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d7c06b510 0x7f4d7c139d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d7affd700 1 -- 172.21.15.44:0/2211918103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d7c0b3270 msgr2=0x7f4d7c13a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d7affd700 1 --2- 172.21.15.44:0/2211918103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d7c0b3270 0x7f4d7c13a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d7affd700 1 -- 172.21.15.44:0/2211918103 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d74009b30 con 0x7f4d7c071160 2024-09-13T18:27:11.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d7bfff700 1 --2- 172.21.15.44:0/2211918103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d7c0b3270 0x7f4d7c13a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:11.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7febc37fe700 1 -- 172.21.15.44:0/1562136255 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febc415cc90 msgr2=0x7febc40cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7febc37fe700 1 --2- 172.21.15.44:0/1562136255 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febc415cc90 0x7febc40cc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7febc37fe700 1 -- 172.21.15.44:0/1562136255 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febac003bb0 msgr2=0x7febc4148840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7febc37fe700 1 --2- 172.21.15.44:0/1562136255 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febac003bb0 0x7febc4148840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7febc37fe700 1 -- 172.21.15.44:0/1562136255 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc4156800 con 0x7febc415d110 2024-09-13T18:27:11.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb6f39b1700 1 -- 172.21.15.44:0/450155280 shutdown_connections 2024-09-13T18:27:11.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d7affd700 1 --2- 172.21.15.44:0/2211918103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d7c071160 0x7f4d7c1f9bf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c00e9d0 tx=0x7f4d6c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb47616a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb4700cdac0 0x7fb470152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb47616a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4701583f0 0x7fb4701f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb47616a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb47015bac0 0x7fb4701f9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb47616a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4701f9f60 con 0x7fb47015bac0 2024-09-13T18:27:11.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb47616a700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47015c780 con 0x7fb4701583f0 2024-09-13T18:27:11.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb47616a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47015ca60 con 0x7fb4700cdac0 2024-09-13T18:27:11.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb46ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb47015bac0 0x7fb4701f9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb46ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb47015bac0 0x7fb4701f9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38930/0 (socket says 172.21.15.44:38930) 2024-09-13T18:27:11.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb46ffff700 1 -- 172.21.15.44:0/2252950280 learned_addr learned my addr 172.21.15.44:0/2252950280 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb6f39b1700 1 -- 172.21.15.44:0/450155280 wait complete. 2024-09-13T18:27:11.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb46effd700 1 --2- 172.21.15.44:0/2252950280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4701583f0 0x7fb4701f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7febc37fe700 1 --2- 172.21.15.44:0/1562136255 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7febc415d110 0x7febc40ccf10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7febc406cab0 tx=0x7febb8011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7febabfff700 1 -- 172.21.15.44:0/1562136255 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb8004240 con 0x7febc415d110 2024-09-13T18:27:11.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7febabfff700 1 -- 172.21.15.44:0/1562136255 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb80043c0 con 0x7febc415d110 2024-09-13T18:27:11.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7febabfff700 1 -- 172.21.15.44:0/1562136255 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb80036c0 con 0x7febc415d110 2024-09-13T18:27:11.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d63fff700 1 -- 172.21.15.44:0/2211918103 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c009720 con 0x7f4d7c071160 2024-09-13T18:27:11.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d63fff700 1 -- 172.21.15.44:0/2211918103 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6c00c850 con 0x7f4d7c071160 2024-09-13T18:27:11.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d63fff700 1 -- 172.21.15.44:0/2211918103 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c00cbc0 con 0x7f4d7c071160 2024-09-13T18:27:11.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7febc9939700 1 -- 172.21.15.44:0/1562136255 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc4156ae0 con 0x7febc415d110 2024-09-13T18:27:11.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7febc9939700 1 -- 172.21.15.44:0/1562136255 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc4155b80 con 0x7febc415d110 2024-09-13T18:27:11.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d81c4a700 1 -- 172.21.15.44:0/2211918103 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7c138ec0 con 0x7f4d7c071160 2024-09-13T18:27:11.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7f4d81c4a700 1 -- 172.21.15.44:0/2211918103 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7c0cc280 con 0x7f4d7c071160 2024-09-13T18:27:11.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb46ffff700 1 -- 172.21.15.44:0/2252950280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb4700cdac0 msgr2=0x7fb470152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb46ffff700 1 --2- 172.21.15.44:0/2252950280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb4700cdac0 0x7fb470152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb46ffff700 1 -- 172.21.15.44:0/2252950280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4701583f0 msgr2=0x7fb4701f6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb46ffff700 1 --2- 172.21.15.44:0/2252950280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4701583f0 0x7fb4701f6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb46ffff700 1 -- 172.21.15.44:0/2252950280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb464009570 con 0x7fb47015bac0 2024-09-13T18:27:11.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb46ffff700 1 --2- 172.21.15.44:0/2252950280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb47015bac0 0x7fb4701f9a20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb46000d800 tx=0x7fb46000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb45ffff700 1 -- 172.21.15.44:0/2252950280 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4600125f0 con 0x7fb47015bac0 2024-09-13T18:27:11.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb6f39b1700 1 Processor -- start 2024-09-13T18:27:11.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb47616a700 1 -- 172.21.15.44:0/2252950280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb47015cd40 con 0x7fb47015bac0 2024-09-13T18:27:11.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb47616a700 1 -- 172.21.15.44:0/2252950280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb47015d300 con 0x7fb47015bac0 2024-09-13T18:27:11.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.663+0000 7fb45ffff700 1 -- 172.21.15.44:0/2252950280 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb460012750 con 0x7fb47015bac0 2024-09-13T18:27:11.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb45ffff700 1 -- 172.21.15.44:0/2252950280 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb460012b00 con 0x7fb47015bac0 2024-09-13T18:27:11.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb47616a700 1 -- 172.21.15.44:0/2252950280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44c005310 con 0x7fb47015bac0 2024-09-13T18:27:11.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb6f39b1700 1 -- start start 2024-09-13T18:27:11.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7f4d61ffb700 1 -- 172.21.15.44:0/2211918103 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d7c138810 con 0x7f4d7c071160 2024-09-13T18:27:11.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7febc9939700 1 -- 172.21.15.44:0/1562136255 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc406b990 con 0x7febc415d110 2024-09-13T18:27:11.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7f4d63fff700 1 -- 172.21.15.44:0/2211918103 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4d6c00cd20 con 0x7f4d7c071160 2024-09-13T18:27:11.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb45ffff700 1 -- 172.21.15.44:0/2252950280 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb460012c60 con 0x7fb47015bac0 2024-09-13T18:27:11.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7f4d63fff700 1 --2- 172.21.15.44:0/2211918103 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4d68066780 0x7f4d68068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb45ffff700 1 --2- 172.21.15.44:0/2252950280 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb454066800 0x7fb454068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7f4d63fff700 1 -- 172.21.15.44:0/2211918103 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d6c0841b0 con 0x7f4d7c071160 2024-09-13T18:27:11.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb6f39b1700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6ec144340 0x7fb6ec0ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb6f39b1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6ec15f140 0x7fb6ec155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb45ffff700 1 -- 172.21.15.44:0/2252950280 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4600841a0 con 0x7fb47015bac0 2024-09-13T18:27:11.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb6f39b1700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb6ec159c70 0x7fb6ec155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb6f39b1700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec15cd20 con 0x7fb6ec15f140 2024-09-13T18:27:11.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb6f39b1700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec15a100 con 0x7fb6ec144340 2024-09-13T18:27:11.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb6f39b1700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec15a3e0 con 0x7fb6ec159c70 2024-09-13T18:27:11.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb6f174d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6ec144340 0x7fb6ec0ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb6f174d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6ec144340 0x7fb6ec0ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:59082/0 (socket says 172.21.15.44:59082) 2024-09-13T18:27:11.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb6f174d700 1 -- 172.21.15.44:0/1579470119 learned_addr learned my addr 172.21.15.44:0/1579470119 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7febabfff700 1 -- 172.21.15.44:0/1562136255 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7febb8003820 con 0x7febc415d110 2024-09-13T18:27:11.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb46f7fe700 1 --2- 172.21.15.44:0/2252950280 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb454066800 0x7fb454068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7f4d7b7fe700 1 --2- 172.21.15.44:0/2211918103 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4d68066780 0x7f4d68068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7febabfff700 1 --2- 172.21.15.44:0/1562136255 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7febb0066760 0x7febb0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7febabfff700 1 -- 172.21.15.44:0/1562136255 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febb80841b0 con 0x7febc415d110 2024-09-13T18:27:11.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb6f1f4e700 1 --2- 172.21.15.44:0/1579470119 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb6ec159c70 0x7fb6ec155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb6f0f4c700 1 --2- 172.21.15.44:0/1579470119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6ec15f140 0x7fb6ec155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb6f0f4c700 1 -- 172.21.15.44:0/1579470119 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb6ec159c70 msgr2=0x7fb6ec155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb6f0f4c700 1 --2- 172.21.15.44:0/1579470119 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb6ec159c70 0x7fb6ec155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb6f0f4c700 1 -- 172.21.15.44:0/1579470119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6ec144340 msgr2=0x7fb6ec0ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb6f0f4c700 1 --2- 172.21.15.44:0/1579470119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6ec144340 0x7fb6ec0ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb6f0f4c700 1 -- 172.21.15.44:0/1579470119 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e80094b0 con 0x7fb6ec15f140 2024-09-13T18:27:11.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fb6f174d700 1 --2- 172.21.15.44:0/1579470119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6ec144340 0x7fb6ec0ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:11.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7fb6f0f4c700 1 --2- 172.21.15.44:0/1579470119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6ec15f140 0x7fb6ec155150 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8013000 tx=0x7fb6e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.667+0000 7fe2d10e1700 1 Processor -- start 2024-09-13T18:27:11.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7fe2d10e1700 1 -- start start 2024-09-13T18:27:11.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7f0a37fff700 1 Processor -- start 2024-09-13T18:27:11.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7fb46f7fe700 1 --2- 172.21.15.44:0/2252950280 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb454066800 0x7fb454068cc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb4680012e0 tx=0x7fb468001780 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7f0a37fff700 1 -- start start 2024-09-13T18:27:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7febc2ffd700 1 --2- 172.21.15.44:0/1562136255 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7febb0066760 0x7febb0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7f4d7b7fe700 1 --2- 172.21.15.44:0/2211918103 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4d68066780 0x7f4d68068c40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4d74000f80 tx=0x7f4d74014000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7febc2ffd700 1 --2- 172.21.15.44:0/1562136255 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7febb0066760 0x7febb0068c20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7febbc015040 tx=0x7febbc00a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7fe2d10e1700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe2cc06d8c0 0x7fe2cc164a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7fe2d10e1700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2cc070bd0 0x7fe2cc163280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7fe2d10e1700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2cc162570 con 0x7fe2cc164f90 2024-09-13T18:27:11.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7fe2d10e1700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2cc162e60 con 0x7fe2cc06d8c0 2024-09-13T18:27:11.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7fe2d10e1700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc071060 con 0x7fe2cc070bd0 2024-09-13T18:27:11.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7fe2cbfff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe2cc06d8c0 0x7fe2cc164a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7fe2cbfff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe2cc06d8c0 0x7fe2cc164a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38944/0 (socket says 172.21.15.44:38944) 2024-09-13T18:27:11.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7fe2cbfff700 1 -- 172.21.15.44:0/2621031921 learned_addr learned my addr 172.21.15.44:0/2621031921 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7f0a37fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a38146480 0x7f0a380704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7f0a37fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0a380cc810 0x7f0a380ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7f0a37fff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a38070e80 con 0x7f0a3815dd90 2024-09-13T18:27:11.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7f0a37fff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a38071160 con 0x7f0a380cc810 2024-09-13T18:27:11.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7f0a37fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a38071440 con 0x7f0a38146480 2024-09-13T18:27:11.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7fe2d08e0700 1 --2- 172.21.15.44:0/2621031921 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2cc070bd0 0x7fe2cc163280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7fe2cbfff700 1 -- 172.21.15.44:0/2621031921 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2cc070bd0 msgr2=0x7fe2cc163280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7fe2cbfff700 1 --2- 172.21.15.44:0/2621031921 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2cc070bd0 0x7fe2cc163280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7fe2cbfff700 1 -- 172.21.15.44:0/2621031921 >> v1:172.21.15.99:6789/0 conn(0x7fe2cc164f90 legacy=0x7fe2cc0704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7fe2cbfff700 1 -- 172.21.15.44:0/2621031921 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc071240 con 0x7fe2cc06d8c0 2024-09-13T18:27:11.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7f0a36ffd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a38146480 0x7f0a380704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7f0a36ffd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a38146480 0x7f0a380704f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:39794/0 (socket says 172.21.15.44:39794) 2024-09-13T18:27:11.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7f0a36ffd700 1 -- 172.21.15.44:0/4275530056 learned_addr learned my addr 172.21.15.44:0/4275530056 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7fe2cbfff700 1 --2- 172.21.15.44:0/2621031921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2cc06d8c0 0x7fe2cc164a50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4009e50 tx=0x7fe2c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b7a6d8c97a637b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7f0a377fe700 1 --2- 172.21.15.44:0/4275530056 >> v2:172.21.15.99:3300/0 conn(0x7f0a380cc810 0x7f0a380ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7f0a36ffd700 1 -- 172.21.15.44:0/4275530056 >> v2:172.21.15.99:3300/0 conn(0x7f0a380cc810 msgr2=0x7f0a380ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7f0a36ffd700 1 --2- 172.21.15.44:0/4275530056 >> v2:172.21.15.99:3300/0 conn(0x7f0a380cc810 0x7f0a380ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7f0a36ffd700 1 -- 172.21.15.44:0/4275530056 >> v1:172.21.15.99:6789/0 conn(0x7f0a3815dd90 legacy=0x7f0a380cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7f0a36ffd700 1 -- 172.21.15.44:0/4275530056 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a38071720 con 0x7f0a38146480 2024-09-13T18:27:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7f0a377fe700 1 --2- 172.21.15.44:0/4275530056 >> v2:172.21.15.99:3300/0 conn(0x7f0a380cc810 0x7f0a380ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7f0a36ffd700 1 --2- 172.21.15.44:0/4275530056 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a38146480 0x7f0a380704f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c009910 tx=0x7f0a2c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5200d2a9a00afc35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7f0a35ffb700 1 -- 172.21.15.44:0/4275530056 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c011830 con 0x7f0a38146480 2024-09-13T18:27:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7f0a35ffb700 1 -- 172.21.15.44:0/4275530056 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c011990 con 0x7f0a38146480 2024-09-13T18:27:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.671+0000 7f0a35ffb700 1 -- 172.21.15.44:0/4275530056 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c011d40 con 0x7f0a38146480 2024-09-13T18:27:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f0a37fff700 1 -- 172.21.15.44:0/4275530056 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a38146480 msgr2=0x7f0a380704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f0a37fff700 1 --2- 172.21.15.44:0/4275530056 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a38146480 0x7f0a380704f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c009910 tx=0x7f0a2c009c20 comp rx=0 tx=0).stop 2024-09-13T18:27:11.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f0a37fff700 1 -- 172.21.15.44:0/4275530056 shutdown_connections 2024-09-13T18:27:11.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f0a37fff700 1 --2- 172.21.15.44:0/4275530056 >> v2:172.21.15.99:3300/0 conn(0x7f0a380cc810 0x7f0a380ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f0a37fff700 1 --2- 172.21.15.44:0/4275530056 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a38146480 0x7f0a380704f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f0a37fff700 1 -- 172.21.15.44:0/4275530056 >> 172.21.15.44:0/4275530056 conn(0x7f0a380ae590 msgr2=0x7f0a380ae970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f0a37fff700 1 -- 172.21.15.44:0/4275530056 shutdown_connections 2024-09-13T18:27:11.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f0a37fff700 1 -- 172.21.15.44:0/4275530056 wait complete. 2024-09-13T18:27:11.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7fc3922d4700 1 Processor -- start 2024-09-13T18:27:11.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7fc3922d4700 1 -- start start 2024-09-13T18:27:11.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f7e768e2700 1 Processor -- start 2024-09-13T18:27:11.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f7e768e2700 1 -- start start 2024-09-13T18:27:11.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7fc3922d4700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc38c0ce270 0x7fc38c15caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7fc3922d4700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc38c15d030 0x7fc38c06baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f7e768e2700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7e700cdd50 0x7f7e700ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f7e768e2700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e700b3a70 0x7f7e700b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7fc3922d4700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc38c06dad0 con 0x7fc38c06d6f0 2024-09-13T18:27:11.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f0a37fff700 1 Processor -- start 2024-09-13T18:27:11.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7fc3922d4700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc38c15d4c0 con 0x7fc38c0ce270 2024-09-13T18:27:11.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7fc3922d4700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c0ae3c0 con 0x7fc38c15d030 2024-09-13T18:27:11.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f7e768e2700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7015d7f0 con 0x7f7e70145ca0 2024-09-13T18:27:11.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f7e768e2700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e700ce700 con 0x7f7e700cdd50 2024-09-13T18:27:11.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f7e768e2700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e700cd590 con 0x7f7e700b3a70 2024-09-13T18:27:11.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f0a37fff700 1 -- start start 2024-09-13T18:27:11.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f7e6ffff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7e70145ca0 0x7f7e7015d0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52606/0 (socket says 172.21.15.44:52606) 2024-09-13T18:27:11.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f7e6ffff700 1 -- 172.21.15.44:0/663207787 learned_addr learned my addr 172.21.15.44:0/663207787 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:11.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f7e74e7f700 1 --2- 172.21.15.44:0/663207787 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e700b3a70 0x7f7e700b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f7e6f7fe700 1 --2- 172.21.15.44:0/663207787 >> v2:172.21.15.44:3300/0 conn(0x7f7e700cdd50 0x7f7e700ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f4d63fff700 1 -- 172.21.15.44:0/2211918103 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4d6c051600 con 0x7f4d7c071160 2024-09-13T18:27:11.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7fc391ad3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc38c15d030 0x7fc38c06baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7fc391ad3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc38c15d030 0x7fc38c06baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:39804/0 (socket says 172.21.15.44:39804) 2024-09-13T18:27:11.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7fc391ad3700 1 -- 172.21.15.44:0/1606429938 learned_addr learned my addr 172.21.15.44:0/1606429938 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7fc390ad1700 1 --2- 172.21.15.44:0/1606429938 >> v2:172.21.15.99:3300/0 conn(0x7fc38c0ce270 0x7fc38c15caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f7e6f7fe700 1 -- 172.21.15.44:0/663207787 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e700b3a70 msgr2=0x7f7e700b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f7e6f7fe700 1 --2- 172.21.15.44:0/663207787 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e700b3a70 0x7f7e700b3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f7e6f7fe700 1 -- 172.21.15.44:0/663207787 >> v1:172.21.15.44:6789/0 conn(0x7f7e70145ca0 legacy=0x7f7e7015d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f7e6f7fe700 1 -- 172.21.15.44:0/663207787 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e700b2cb0 con 0x7f7e700cdd50 2024-09-13T18:27:11.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7fc390ad1700 1 -- 172.21.15.44:0/1606429938 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc38c15d030 msgr2=0x7fc38c06baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:11.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7fc390ad1700 1 --2- 172.21.15.44:0/1606429938 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc38c15d030 0x7fc38c06baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7fc390ad1700 1 -- 172.21.15.44:0/1606429938 >> v1:172.21.15.99:6789/0 conn(0x7fc38c06d6f0 legacy=0x7fc38c0adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7fc390ad1700 1 -- 172.21.15.44:0/1606429938 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38c0705b0 con 0x7fc38c0ce270 2024-09-13T18:27:11.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f7e6f7fe700 1 --2- 172.21.15.44:0/663207787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e700cdd50 0x7f7e700ce1c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7e60009850 tx=0x7f7e60009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bba2563e4f1ab0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7fc390ad1700 1 --2- 172.21.15.44:0/1606429938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc38c0ce270 0x7fc38c15caf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc384009dc0 tx=0x7fc38400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=454d0e30f68a7ad9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f0a37fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a380cc810 0x7f0a3806af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f0a37fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a38146480 0x7f0a38138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f0a37fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a3815dd90 0x7f0a380a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f0a37fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3806c220 con 0x7f0a3815dd90 2024-09-13T18:27:11.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f0a37fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3813fa00 con 0x7f0a38146480 2024-09-13T18:27:11.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f0a37fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a38139510 con 0x7f0a380cc810 2024-09-13T18:27:11.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7fc383fff700 1 -- 172.21.15.44:0/1606429938 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38400e070 con 0x7fc38c0ce270 2024-09-13T18:27:11.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f0a377fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a3815dd90 0x7f0a380a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f0a377fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a3815dd90 0x7f0a380a84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38948/0 (socket says 172.21.15.44:38948) 2024-09-13T18:27:11.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f0a377fe700 1 -- 172.21.15.44:0/492184358 learned_addr learned my addr 172.21.15.44:0/492184358 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7fc383fff700 1 -- 172.21.15.44:0/1606429938 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38400bae0 con 0x7fc38c0ce270 2024-09-13T18:27:11.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7fc383fff700 1 -- 172.21.15.44:0/1606429938 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38400be90 con 0x7fc38c0ce270 2024-09-13T18:27:11.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f0a36ffd700 1 --2- 172.21.15.44:0/492184358 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a380cc810 0x7f0a3806af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.675+0000 7f0a367fc700 1 --2- 172.21.15.44:0/492184358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a38146480 0x7f0a38138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7f0a377fe700 1 -- 172.21.15.44:0/492184358 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a380cc810 msgr2=0x7f0a3806af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7f0a377fe700 1 --2- 172.21.15.44:0/492184358 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a380cc810 0x7f0a3806af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7f0a377fe700 1 -- 172.21.15.44:0/492184358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a38146480 msgr2=0x7f0a38138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7f0a377fe700 1 --2- 172.21.15.44:0/492184358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a38146480 0x7f0a38138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7f0a377fe700 1 -- 172.21.15.44:0/492184358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a30009a70 con 0x7f0a3815dd90 2024-09-13T18:27:11.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7f0a377fe700 1 --2- 172.21.15.44:0/492184358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a3815dd90 0x7f0a380a84b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000ef90 tx=0x7f0a3000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc3922d4700 1 -- 172.21.15.44:0/1606429938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc38c0ce270 msgr2=0x7fc38c15caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc3922d4700 1 --2- 172.21.15.44:0/1606429938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc38c0ce270 0x7fc38c15caf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc384009dc0 tx=0x7fc38400b330 comp rx=0 tx=0).stop 2024-09-13T18:27:11.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc3922d4700 1 -- 172.21.15.44:0/1606429938 shutdown_connections 2024-09-13T18:27:11.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc3922d4700 1 --2- 172.21.15.44:0/1606429938 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc38c15d030 0x7fc38c06baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc3922d4700 1 --2- 172.21.15.44:0/1606429938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc38c0ce270 0x7fc38c15caf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc3922d4700 1 -- 172.21.15.44:0/1606429938 >> 172.21.15.44:0/1606429938 conn(0x7fc38c0b0e10 msgr2=0x7fc38c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc3922d4700 1 -- 172.21.15.44:0/1606429938 shutdown_connections 2024-09-13T18:27:11.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc3922d4700 1 -- 172.21.15.44:0/1606429938 wait complete. 2024-09-13T18:27:11.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc3922d4700 1 Processor -- start 2024-09-13T18:27:11.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc3922d4700 1 -- start start 2024-09-13T18:27:11.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc3922d4700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc38c06d6f0 0x7fc38c0ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc3922d4700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc38c0ce270 0x7fc38c1461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc3922d4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc38c15d030 0x7fc38c1549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc3922d4700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c0cb8a0 con 0x7fc38c15d030 2024-09-13T18:27:11.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc3922d4700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c0cbb80 con 0x7fc38c0ce270 2024-09-13T18:27:11.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc3922d4700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c0cbe60 con 0x7fc38c06d6f0 2024-09-13T18:27:11.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc391ad3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc38c15d030 0x7fc38c1549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc391ad3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc38c15d030 0x7fc38c1549f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38964/0 (socket says 172.21.15.44:38964) 2024-09-13T18:27:11.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc391ad3700 1 -- 172.21.15.44:0/232380581 learned_addr learned my addr 172.21.15.44:0/232380581 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc390ad1700 1 --2- 172.21.15.44:0/232380581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc38c0ce270 0x7fc38c1461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc3912d2700 1 --2- 172.21.15.44:0/232380581 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc38c06d6f0 0x7fc38c0ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc391ad3700 1 -- 172.21.15.44:0/232380581 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc38c06d6f0 msgr2=0x7fc38c0ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc391ad3700 1 --2- 172.21.15.44:0/232380581 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc38c06d6f0 0x7fc38c0ccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc391ad3700 1 -- 172.21.15.44:0/232380581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc38c0ce270 msgr2=0x7fc38c1461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc391ad3700 1 --2- 172.21.15.44:0/232380581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc38c0ce270 0x7fc38c1461d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc391ad3700 1 -- 172.21.15.44:0/232380581 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc384009a70 con 0x7fc38c15d030 2024-09-13T18:27:11.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc390ad1700 1 --2- 172.21.15.44:0/232380581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc38c0ce270 0x7fc38c1461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:11.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc3912d2700 1 --2- 172.21.15.44:0/232380581 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc38c06d6f0 0x7fc38c0ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:11.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7fc391ad3700 1 --2- 172.21.15.44:0/232380581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc38c15d030 0x7fc38c1549f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00e840 tx=0x7fc37c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.679+0000 7febabfff700 1 -- 172.21.15.44:0/1562136255 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7febb8051520 con 0x7febc415d110 2024-09-13T18:27:11.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.683+0000 7fb6e1ffb700 1 -- 172.21.15.44:0/1579470119 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e80036c0 con 0x7fb6ec15f140 2024-09-13T18:27:11.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.683+0000 7fb6e1ffb700 1 -- 172.21.15.44:0/1579470119 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e8003840 con 0x7fb6ec15f140 2024-09-13T18:27:11.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.683+0000 7fb6e1ffb700 1 -- 172.21.15.44:0/1579470119 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e8003bf0 con 0x7fb6ec15f140 2024-09-13T18:27:11.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.683+0000 7fe2caffd700 1 -- 172.21.15.44:0/2621031921 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c400e070 con 0x7fe2cc06d8c0 2024-09-13T18:27:11.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.683+0000 7fe2caffd700 1 -- 172.21.15.44:0/2621031921 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c400b9c0 con 0x7fe2cc06d8c0 2024-09-13T18:27:11.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.683+0000 7fe2caffd700 1 -- 172.21.15.44:0/2621031921 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c400bd70 con 0x7fe2cc06d8c0 2024-09-13T18:27:11.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.683+0000 7fb6f39b1700 1 -- 172.21.15.44:0/1579470119 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ec15c9b0 con 0x7fb6ec15f140 2024-09-13T18:27:11.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.683+0000 7fb45ffff700 1 -- 172.21.15.44:0/2252950280 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb4600514f0 con 0x7fb47015bac0 2024-09-13T18:27:11.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.683+0000 7fc381ffb700 1 -- 172.21.15.44:0/232380581 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c00c690 con 0x7fc38c15d030 2024-09-13T18:27:11.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.683+0000 7fc381ffb700 1 -- 172.21.15.44:0/232380581 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37c00c810 con 0x7fc38c15d030 2024-09-13T18:27:11.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.683+0000 7fc381ffb700 1 -- 172.21.15.44:0/232380581 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c00cbc0 con 0x7fc38c15d030 2024-09-13T18:27:11.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.683+0000 7f7e6effd700 1 -- 172.21.15.44:0/663207787 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e60011830 con 0x7f7e700cdd50 2024-09-13T18:27:11.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.683+0000 7f7e6effd700 1 -- 172.21.15.44:0/663207787 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e60011990 con 0x7f7e700cdd50 2024-09-13T18:27:11.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.683+0000 7f7e6effd700 1 -- 172.21.15.44:0/663207787 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e60011d00 con 0x7f7e700cdd50 2024-09-13T18:27:11.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7f0a1ffff700 1 -- 172.21.15.44:0/492184358 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3000cc90 con 0x7f0a3815dd90 2024-09-13T18:27:11.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7f0a1ffff700 1 -- 172.21.15.44:0/492184358 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3000f040 con 0x7f0a3815dd90 2024-09-13T18:27:11.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7f0a1ffff700 1 -- 172.21.15.44:0/492184358 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a300146c0 con 0x7f0a3815dd90 2024-09-13T18:27:11.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7f0a37fff700 1 -- 172.21.15.44:0/492184358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a2c009570 con 0x7f0a3815dd90 2024-09-13T18:27:11.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7f0a37fff700 1 -- 172.21.15.44:0/492184358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3806b8f0 con 0x7f0a3815dd90 2024-09-13T18:27:11.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.683+0000 7fb6f39b1700 1 -- 172.21.15.44:0/1579470119 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ec0cd3e0 con 0x7fb6ec15f140 2024-09-13T18:27:11.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7fb6e1ffb700 1 -- 172.21.15.44:0/1579470119 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb6e8028070 con 0x7fb6ec15f140 2024-09-13T18:27:11.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7f0a37fff700 1 -- 172.21.15.44:0/492184358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a18005310 con 0x7f0a3815dd90 2024-09-13T18:27:11.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7f7e768e2700 1 -- 172.21.15.44:0/663207787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e700cdd50 msgr2=0x7f7e700ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7f7e768e2700 1 --2- 172.21.15.44:0/663207787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e700cdd50 0x7f7e700ce1c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7e60009850 tx=0x7f7e60009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:11.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7f7e768e2700 1 -- 172.21.15.44:0/663207787 shutdown_connections 2024-09-13T18:27:11.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7f7e768e2700 1 --2- 172.21.15.44:0/663207787 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e700b3a70 0x7f7e700b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7f7e768e2700 1 --2- 172.21.15.44:0/663207787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e700cdd50 0x7f7e700ce1c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7f7e768e2700 1 -- 172.21.15.44:0/663207787 >> 172.21.15.44:0/663207787 conn(0x7f7e700af5d0 msgr2=0x7f7e700af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7f7e768e2700 1 -- 172.21.15.44:0/663207787 shutdown_connections 2024-09-13T18:27:11.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7f7e768e2700 1 -- 172.21.15.44:0/663207787 wait complete. 2024-09-13T18:27:11.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7fb6f39b1700 1 -- 172.21.15.44:0/1579470119 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ec06d480 con 0x7fb6ec15f140 2024-09-13T18:27:11.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7fb6e1ffb700 1 --2- 172.21.15.44:0/1579470119 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb6d0066730 0x7fb6d0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7fe2d10e1700 1 -- 172.21.15.44:0/2621031921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2cc06d8c0 msgr2=0x7fe2cc164a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7fe2d10e1700 1 --2- 172.21.15.44:0/2621031921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2cc06d8c0 0x7fe2cc164a50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4009e50 tx=0x7fe2c400b330 comp rx=0 tx=0).stop 2024-09-13T18:27:11.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7fe2d10e1700 1 -- 172.21.15.44:0/2621031921 shutdown_connections 2024-09-13T18:27:11.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7fe2d10e1700 1 --2- 172.21.15.44:0/2621031921 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2cc070bd0 0x7fe2cc163280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7fe2d10e1700 1 --2- 172.21.15.44:0/2621031921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2cc06d8c0 0x7fe2cc164a50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7fe2d10e1700 1 -- 172.21.15.44:0/2621031921 >> 172.21.15.44:0/2621031921 conn(0x7fe2cc0b0e10 msgr2=0x7fe2cc0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7fb6e1ffb700 1 -- 172.21.15.44:0/1579470119 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6e808c820 con 0x7fb6ec15f140 2024-09-13T18:27:11.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7fb6f174d700 1 --2- 172.21.15.44:0/1579470119 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb6d0066730 0x7fb6d0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7f7e768e2700 1 Processor -- start 2024-09-13T18:27:11.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7f7e768e2700 1 -- start start 2024-09-13T18:27:11.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.687+0000 7fb6f174d700 1 --2- 172.21.15.44:0/1579470119 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb6d0066730 0x7fb6d0068bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc004150 tx=0x7fb6dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.691+0000 7f7e768e2700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e700b3a70 0x7f7e701fefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.691+0000 7f7e768e2700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e700cdd50 0x7f7e7015dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.691+0000 7f7e768e2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e70145ca0 0x7f7e7006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.691+0000 7f7e768e2700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7006b360 con 0x7f7e70145ca0 2024-09-13T18:27:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.691+0000 7f7e768e2700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e701ff880 con 0x7f7e700cdd50 2024-09-13T18:27:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.691+0000 7f7e768e2700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e701ffb60 con 0x7f7e700b3a70 2024-09-13T18:27:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.691+0000 7f7e74e7f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e70145ca0 0x7f7e7006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.691+0000 7f7e74e7f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e70145ca0 0x7f7e7006ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38972/0 (socket says 172.21.15.44:38972) 2024-09-13T18:27:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.691+0000 7f7e74e7f700 1 -- 172.21.15.44:0/1536144929 learned_addr learned my addr 172.21.15.44:0/1536144929 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.691+0000 7f7e6ffff700 1 --2- 172.21.15.44:0/1536144929 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e700b3a70 0x7f7e701fefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.691+0000 7f7e6f7fe700 1 --2- 172.21.15.44:0/1536144929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e700cdd50 0x7f7e7015dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.691+0000 7f7e74e7f700 1 -- 172.21.15.44:0/1536144929 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e700b3a70 msgr2=0x7f7e701fefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.691+0000 7f7e74e7f700 1 --2- 172.21.15.44:0/1536144929 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e700b3a70 0x7f7e701fefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.691+0000 7f7e74e7f700 1 -- 172.21.15.44:0/1536144929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e700cdd50 msgr2=0x7f7e7015dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.691+0000 7f7e74e7f700 1 --2- 172.21.15.44:0/1536144929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e700cdd50 0x7f7e7015dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.691+0000 7f7e74e7f700 1 -- 172.21.15.44:0/1536144929 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e600094b0 con 0x7f7e70145ca0 2024-09-13T18:27:11.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.691+0000 7f7e74e7f700 1 --2- 172.21.15.44:0/1536144929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e70145ca0 0x7f7e7006ca40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800efc0 tx=0x7f7e6800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.691+0000 7fc3922d4700 1 -- 172.21.15.44:0/232380581 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc38c0cc140 con 0x7fc38c15d030 2024-09-13T18:27:11.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.691+0000 7fc3922d4700 1 -- 172.21.15.44:0/232380581 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc38c1ee040 con 0x7fc38c15d030 2024-09-13T18:27:11.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7fe2d10e1700 1 -- 172.21.15.44:0/2621031921 shutdown_connections 2024-09-13T18:27:11.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7fe2d10e1700 1 -- 172.21.15.44:0/2621031921 wait complete. 2024-09-13T18:27:11.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7f0a1ffff700 1 -- 172.21.15.44:0/492184358 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0a30014820 con 0x7f0a3815dd90 2024-09-13T18:27:11.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7f0a1ffff700 1 --2- 172.21.15.44:0/492184358 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0a24066780 0x7f0a24068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7f0a1ffff700 1 -- 172.21.15.44:0/492184358 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a30085130 con 0x7f0a3815dd90 2024-09-13T18:27:11.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7fe2d10e1700 1 Processor -- start 2024-09-13T18:27:11.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7fe2d10e1700 1 -- start start 2024-09-13T18:27:11.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7f0a36ffd700 1 --2- 172.21.15.44:0/492184358 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0a24066780 0x7f0a24068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7fe2d10e1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2cc06d8c0 0x7fe2cc145a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7fe2d10e1700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2cc070bd0 0x7fe2cc15a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7fe2d10e1700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2cc164f90 0x7fe2cc15c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7fe2d10e1700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc15bbb0 con 0x7fe2cc06d8c0 2024-09-13T18:27:11.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7fe2d10e1700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc15ab20 con 0x7fe2cc070bd0 2024-09-13T18:27:11.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7fe2d10e1700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc15ae00 con 0x7fe2cc164f90 2024-09-13T18:27:11.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7fe2cbfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2cc06d8c0 0x7fe2cc145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7fe2cbfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2cc06d8c0 0x7fe2cc145a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38974/0 (socket says 172.21.15.44:38974) 2024-09-13T18:27:11.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7fe2cbfff700 1 -- 172.21.15.44:0/1849916772 learned_addr learned my addr 172.21.15.44:0/1849916772 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:11.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7fe2cb7fe700 1 --2- 172.21.15.44:0/1849916772 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2cc070bd0 0x7fe2cc15a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7fe2d08e0700 1 --2- 172.21.15.44:0/1849916772 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2cc164f90 0x7fe2cc15c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7fe2cbfff700 1 -- 172.21.15.44:0/1849916772 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2cc164f90 msgr2=0x7fe2cc15c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7fe2cbfff700 1 --2- 172.21.15.44:0/1849916772 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2cc164f90 0x7fe2cc15c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7fe2cbfff700 1 -- 172.21.15.44:0/1849916772 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2cc070bd0 msgr2=0x7fe2cc15a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7fe2cbfff700 1 --2- 172.21.15.44:0/1849916772 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2cc070bd0 0x7fe2cc15a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7fe2cbfff700 1 -- 172.21.15.44:0/1849916772 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c4009b30 con 0x7fe2cc06d8c0 2024-09-13T18:27:11.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7fe2cb7fe700 1 --2- 172.21.15.44:0/1849916772 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2cc070bd0 0x7fe2cc15a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:11.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7fe2cbfff700 1 --2- 172.21.15.44:0/1849916772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2cc06d8c0 0x7fe2cc145a50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400b370 tx=0x7fe2c4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.695+0000 7f0a36ffd700 1 --2- 172.21.15.44:0/492184358 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0a24066780 0x7f0a24068c40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c009c60 tx=0x7f0a2c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.699+0000 7fc3922d4700 1 -- 172.21.15.44:0/232380581 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc38c1532e0 con 0x7fc38c15d030 2024-09-13T18:27:11.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.699+0000 7fb6e1ffb700 1 -- 172.21.15.44:0/1579470119 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb6e805d770 con 0x7fb6ec15f140 2024-09-13T18:27:11.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.707+0000 7f0a1ffff700 1 -- 172.21.15.44:0/492184358 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0a30052590 con 0x7f0a3815dd90 2024-09-13T18:27:11.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.707+0000 7f7e6cff9700 1 -- 172.21.15.44:0/1536144929 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6800cd40 con 0x7f7e70145ca0 2024-09-13T18:27:11.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.707+0000 7fe2c8ff9700 1 -- 172.21.15.44:0/1849916772 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4004960 con 0x7fe2cc06d8c0 2024-09-13T18:27:11.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.707+0000 7f7e768e2700 1 -- 172.21.15.44:0/1536144929 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e701ffe40 con 0x7f7e70145ca0 2024-09-13T18:27:11.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.707+0000 7f7e768e2700 1 -- 172.21.15.44:0/1536144929 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e701ff500 con 0x7f7e70145ca0 2024-09-13T18:27:11.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.707+0000 7f7e6cff9700 1 -- 172.21.15.44:0/1536144929 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6800f040 con 0x7f7e70145ca0 2024-09-13T18:27:11.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.707+0000 7f7e6cff9700 1 -- 172.21.15.44:0/1536144929 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68014680 con 0x7f7e70145ca0 2024-09-13T18:27:11.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.707+0000 7fe2c8ff9700 1 -- 172.21.15.44:0/1849916772 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c40092e0 con 0x7fe2cc06d8c0 2024-09-13T18:27:11.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.707+0000 7fe2c8ff9700 1 -- 172.21.15.44:0/1849916772 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c401b690 con 0x7fe2cc06d8c0 2024-09-13T18:27:11.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.707+0000 7fe2d10e1700 1 -- 172.21.15.44:0/1849916772 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2cc15b0e0 con 0x7fe2cc06d8c0 2024-09-13T18:27:11.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.707+0000 7fe2d10e1700 1 -- 172.21.15.44:0/1849916772 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2cc1530b0 con 0x7fe2cc06d8c0 2024-09-13T18:27:11.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.711+0000 7f7e768e2700 1 -- 172.21.15.44:0/1536144929 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e50005310 con 0x7f7e70145ca0 2024-09-13T18:27:11.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.711+0000 7fe2d10e1700 1 -- 172.21.15.44:0/1849916772 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ac005310 con 0x7fe2cc06d8c0 2024-09-13T18:27:11.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.711+0000 7fc381ffb700 1 -- 172.21.15.44:0/232380581 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc37c00cd20 con 0x7fc38c15d030 2024-09-13T18:27:11.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.711+0000 7fc381ffb700 1 --2- 172.21.15.44:0/232380581 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc370066800 0x7fc370068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.711+0000 7fc381ffb700 1 -- 172.21.15.44:0/232380581 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc37c0847d0 con 0x7fc38c15d030 2024-09-13T18:27:11.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.711+0000 7fc3912d2700 1 --2- 172.21.15.44:0/232380581 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc370066800 0x7fc370068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.711+0000 7fc3912d2700 1 --2- 172.21.15.44:0/232380581 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc370066800 0x7fc370068cc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc388000f60 tx=0x7fc388009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.715+0000 7fc381ffb700 1 -- 172.21.15.44:0/232380581 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc37c051b20 con 0x7fc38c15d030 2024-09-13T18:27:11.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.719+0000 7fe2c8ff9700 1 -- 172.21.15.44:0/1849916772 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe2c401b7f0 con 0x7fe2cc06d8c0 2024-09-13T18:27:11.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.719+0000 7fe2c8ff9700 1 --2- 172.21.15.44:0/1849916772 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe2b8066730 0x7fe2b8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.719+0000 7fe2c8ff9700 1 -- 172.21.15.44:0/1849916772 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2c4023e90 con 0x7fe2cc06d8c0 2024-09-13T18:27:11.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.719+0000 7fe2cb7fe700 1 --2- 172.21.15.44:0/1849916772 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe2b8066730 0x7fe2b8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.719+0000 7fe2cb7fe700 1 --2- 172.21.15.44:0/1849916772 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe2b8066730 0x7fe2b8068bf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc152e30 tx=0x7fe2c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.719+0000 7f7e6cff9700 1 -- 172.21.15.44:0/1536144929 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7e680147e0 con 0x7f7e70145ca0 2024-09-13T18:27:11.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.719+0000 7f7e6cff9700 1 --2- 172.21.15.44:0/1536144929 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e5c066730 0x7f7e5c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:11.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.719+0000 7f7e6cff9700 1 -- 172.21.15.44:0/1536144929 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e68056ce0 con 0x7f7e70145ca0 2024-09-13T18:27:11.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.723+0000 7f7e6ffff700 1 --2- 172.21.15.44:0/1536144929 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e5c066730 0x7f7e5c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:11.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.723+0000 7f7e6ffff700 1 --2- 172.21.15.44:0/1536144929 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e5c066730 0x7f7e5c068bf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7e64000f60 tx=0x7f7e64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:11.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.727+0000 7f7e6cff9700 1 -- 172.21.15.44:0/1536144929 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7e68052920 con 0x7f7e70145ca0 2024-09-13T18:27:11.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.735+0000 7fe2c8ff9700 1 -- 172.21.15.44:0/1849916772 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe2c4053300 con 0x7fe2cc06d8c0 2024-09-13T18:27:11.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.983+0000 7febc9939700 1 -- 172.21.15.44:0/1562136255 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7febc40cb0e0 con 0x7febc415d110 2024-09-13T18:27:11.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.983+0000 7febabfff700 1 -- 172.21.15.44:0/1562136255 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7febb8054b40 con 0x7febc415d110 2024-09-13T18:27:11.991 INFO:teuthology.orchestra.run.smithi044.stdout:55834574855 2024-09-13T18:27:11.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.991+0000 7feba9ffb700 1 -- 172.21.15.44:0/1562136255 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7febb0066760 msgr2=0x7febb0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.991+0000 7feba9ffb700 1 --2- 172.21.15.44:0/1562136255 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7febb0066760 0x7febb0068c20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7febbc015040 tx=0x7febbc00a000 comp rx=0 tx=0).stop 2024-09-13T18:27:11.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.991+0000 7feba9ffb700 1 -- 172.21.15.44:0/1562136255 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7febc415d110 msgr2=0x7febc40ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:11.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.991+0000 7feba9ffb700 1 --2- 172.21.15.44:0/1562136255 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7febc415d110 0x7febc40ccf10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7febc406cab0 tx=0x7febb8011ad0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.991+0000 7feba9ffb700 1 -- 172.21.15.44:0/1562136255 shutdown_connections 2024-09-13T18:27:11.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.991+0000 7feba9ffb700 1 --2- 172.21.15.44:0/1562136255 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7febb0066760 0x7febb0068c20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.991+0000 7feba9ffb700 1 --2- 172.21.15.44:0/1562136255 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7febc415d110 0x7febc40ccf10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.991+0000 7feba9ffb700 1 --2- 172.21.15.44:0/1562136255 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febc415cc90 0x7febc40cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.991+0000 7feba9ffb700 1 --2- 172.21.15.44:0/1562136255 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febac003bb0 0x7febc4148840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:11.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.991+0000 7feba9ffb700 1 -- 172.21.15.44:0/1562136255 >> 172.21.15.44:0/1562136255 conn(0x7febc40ae590 msgr2=0x7febc40714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:11.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.991+0000 7feba9ffb700 1 -- 172.21.15.44:0/1562136255 shutdown_connections 2024-09-13T18:27:11.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:11.991+0000 7feba9ffb700 1 -- 172.21.15.44:0/1562136255 wait complete. 2024-09-13T18:27:12.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.003+0000 7f4d61ffb700 1 -- 172.21.15.44:0/2211918103 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4d7c144460 con 0x7f4d7c071160 2024-09-13T18:27:12.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.003+0000 7f4d63fff700 1 -- 172.21.15.44:0/2211918103 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4d6c054c20 con 0x7f4d7c071160 2024-09-13T18:27:12.010 INFO:teuthology.orchestra.run.smithi044.stdout:55834574856 2024-09-13T18:27:12.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2024-09-13T18:27:12.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.007+0000 7f4d81c4a700 1 -- 172.21.15.44:0/2211918103 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4d68066780 msgr2=0x7f4d68068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:12.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.007+0000 7f4d81c4a700 1 --2- 172.21.15.44:0/2211918103 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4d68066780 0x7f4d68068c40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4d74000f80 tx=0x7f4d74014000 comp rx=0 tx=0).stop 2024-09-13T18:27:12.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.007+0000 7f4d81c4a700 1 -- 172.21.15.44:0/2211918103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d7c071160 msgr2=0x7f4d7c1f9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:12.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.007+0000 7f4d81c4a700 1 --2- 172.21.15.44:0/2211918103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d7c071160 0x7f4d7c1f9bf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c00e9d0 tx=0x7f4d6c00ed90 comp rx=0 tx=0).stop 2024-09-13T18:27:12.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.007+0000 7f4d81c4a700 1 -- 172.21.15.44:0/2211918103 shutdown_connections 2024-09-13T18:27:12.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.007+0000 7f4d81c4a700 1 --2- 172.21.15.44:0/2211918103 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4d68066780 0x7f4d68068c40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.007+0000 7f4d81c4a700 1 --2- 172.21.15.44:0/2211918103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d7c0b3270 0x7f4d7c13a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.007+0000 7f4d81c4a700 1 --2- 172.21.15.44:0/2211918103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d7c071160 0x7f4d7c1f9bf0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.007+0000 7f4d81c4a700 1 --2- 172.21.15.44:0/2211918103 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d7c06b510 0x7f4d7c139d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.007+0000 7f4d81c4a700 1 -- 172.21.15.44:0/2211918103 >> 172.21.15.44:0/2211918103 conn(0x7f4d7c0b0e10 msgr2=0x7f4d7c142d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:12.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.007+0000 7f4d81c4a700 1 -- 172.21.15.44:0/2211918103 shutdown_connections 2024-09-13T18:27:12.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.007+0000 7f4d81c4a700 1 -- 172.21.15.44:0/2211918103 wait complete. 2024-09-13T18:27:12.026 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2024-09-13T18:27:12.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.023+0000 7fb47616a700 1 -- 172.21.15.44:0/2252950280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb44c0055c0 con 0x7fb47015bac0 2024-09-13T18:27:12.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.023+0000 7fb45ffff700 1 -- 172.21.15.44:0/2252950280 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb460054b10 con 0x7fb47015bac0 2024-09-13T18:27:12.027 INFO:teuthology.orchestra.run.smithi044.stdout:55834574857 2024-09-13T18:27:12.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.023+0000 7fb47616a700 1 -- 172.21.15.44:0/2252950280 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb454066800 msgr2=0x7fb454068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:12.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.023+0000 7fb47616a700 1 --2- 172.21.15.44:0/2252950280 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb454066800 0x7fb454068cc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb4680012e0 tx=0x7fb468001780 comp rx=0 tx=0).stop 2024-09-13T18:27:12.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.023+0000 7fb47616a700 1 -- 172.21.15.44:0/2252950280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb47015bac0 msgr2=0x7fb4701f9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:12.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.023+0000 7fb47616a700 1 --2- 172.21.15.44:0/2252950280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb47015bac0 0x7fb4701f9a20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb46000d800 tx=0x7fb46000db10 comp rx=0 tx=0).stop 2024-09-13T18:27:12.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.023+0000 7fb47616a700 1 -- 172.21.15.44:0/2252950280 shutdown_connections 2024-09-13T18:27:12.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.023+0000 7fb47616a700 1 --2- 172.21.15.44:0/2252950280 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb454066800 0x7fb454068cc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.023+0000 7fb47616a700 1 --2- 172.21.15.44:0/2252950280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb47015bac0 0x7fb4701f9a20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.023+0000 7fb47616a700 1 --2- 172.21.15.44:0/2252950280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4701583f0 0x7fb4701f6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.023+0000 7fb47616a700 1 --2- 172.21.15.44:0/2252950280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb4700cdac0 0x7fb470152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.023+0000 7fb47616a700 1 -- 172.21.15.44:0/2252950280 >> 172.21.15.44:0/2252950280 conn(0x7fb4700ae590 msgr2=0x7fb47014f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:12.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.023+0000 7fb47616a700 1 -- 172.21.15.44:0/2252950280 shutdown_connections 2024-09-13T18:27:12.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.023+0000 7fb47616a700 1 -- 172.21.15.44:0/2252950280 wait complete. 2024-09-13T18:27:12.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.035+0000 7fe2d10e1700 1 -- 172.21.15.44:0/1849916772 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe2ac005890 con 0x7fe2cc06d8c0 2024-09-13T18:27:12.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.035+0000 7fe2c8ff9700 1 -- 172.21.15.44:0/1849916772 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe2c4056920 con 0x7fe2cc06d8c0 2024-09-13T18:27:12.040 INFO:teuthology.orchestra.run.smithi044.stdout:55834574854 2024-09-13T18:27:12.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.039+0000 7fe2d10e1700 1 -- 172.21.15.44:0/1849916772 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe2b8066730 msgr2=0x7fe2b8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:12.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.039+0000 7fe2d10e1700 1 --2- 172.21.15.44:0/1849916772 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe2b8066730 0x7fe2b8068bf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc152e30 tx=0x7fe2c0009040 comp rx=0 tx=0).stop 2024-09-13T18:27:12.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.039+0000 7fe2d10e1700 1 -- 172.21.15.44:0/1849916772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2cc06d8c0 msgr2=0x7fe2cc145a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:12.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.039+0000 7fe2d10e1700 1 --2- 172.21.15.44:0/1849916772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2cc06d8c0 0x7fe2cc145a50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400b370 tx=0x7fe2c4004af0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.039+0000 7fe2d10e1700 1 -- 172.21.15.44:0/1849916772 shutdown_connections 2024-09-13T18:27:12.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.039+0000 7fe2d10e1700 1 --2- 172.21.15.44:0/1849916772 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe2b8066730 0x7fe2b8068bf0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.039+0000 7fe2d10e1700 1 --2- 172.21.15.44:0/1849916772 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2cc164f90 0x7fe2cc15c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.039+0000 7fe2d10e1700 1 --2- 172.21.15.44:0/1849916772 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2cc070bd0 0x7fe2cc15a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.039+0000 7fe2d10e1700 1 --2- 172.21.15.44:0/1849916772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2cc06d8c0 0x7fe2cc145a50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.039+0000 7fe2d10e1700 1 -- 172.21.15.44:0/1849916772 >> 172.21.15.44:0/1849916772 conn(0x7fe2cc0b0e10 msgr2=0x7fe2cc160210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:12.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.039+0000 7fe2d10e1700 1 -- 172.21.15.44:0/1849916772 shutdown_connections 2024-09-13T18:27:12.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.039+0000 7fe2d10e1700 1 -- 172.21.15.44:0/1849916772 wait complete. 2024-09-13T18:27:12.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2024-09-13T18:27:12.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.039+0000 7f0a37fff700 1 -- 172.21.15.44:0/492184358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0a18005890 con 0x7f0a3815dd90 2024-09-13T18:27:12.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.039+0000 7f7e768e2700 1 -- 172.21.15.44:0/1536144929 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7e50005890 con 0x7f7e70145ca0 2024-09-13T18:27:12.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.039+0000 7f0a1ffff700 1 -- 172.21.15.44:0/492184358 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0a30018020 con 0x7f0a3815dd90 2024-09-13T18:27:12.045 INFO:teuthology.orchestra.run.smithi044.stdout:55834574854 2024-09-13T18:27:12.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.039+0000 7f7e6cff9700 1 -- 172.21.15.44:0/1536144929 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7e6800cea0 con 0x7f7e70145ca0 2024-09-13T18:27:12.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.039+0000 7fb6f39b1700 1 -- 172.21.15.44:0/1579470119 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb6ec067a90 con 0x7fb6ec15f140 2024-09-13T18:27:12.046 INFO:teuthology.orchestra.run.smithi044.stdout:55834574855 2024-09-13T18:27:12.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.039+0000 7fb6e1ffb700 1 -- 172.21.15.44:0/1579470119 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb6e8016020 con 0x7fb6ec15f140 2024-09-13T18:27:12.046 INFO:teuthology.orchestra.run.smithi044.stdout:55834574855 2024-09-13T18:27:12.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f7e768e2700 1 -- 172.21.15.44:0/1536144929 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e5c066730 msgr2=0x7f7e5c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:12.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f7e768e2700 1 --2- 172.21.15.44:0/1536144929 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e5c066730 0x7f7e5c068bf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7e64000f60 tx=0x7f7e64009040 comp rx=0 tx=0).stop 2024-09-13T18:27:12.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f7e768e2700 1 -- 172.21.15.44:0/1536144929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e70145ca0 msgr2=0x7f7e7006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:12.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f7e768e2700 1 --2- 172.21.15.44:0/1536144929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e70145ca0 0x7f7e7006ca40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800efc0 tx=0x7f7e6800c3a0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7fb6f39b1700 1 -- 172.21.15.44:0/1579470119 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb6d0066730 msgr2=0x7fb6d0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:12.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7fb6f39b1700 1 --2- 172.21.15.44:0/1579470119 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb6d0066730 0x7fb6d0068bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc004150 tx=0x7fb6dc008040 comp rx=0 tx=0).stop 2024-09-13T18:27:12.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7fb6f39b1700 1 -- 172.21.15.44:0/1579470119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6ec15f140 msgr2=0x7fb6ec155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:12.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7fb6f39b1700 1 --2- 172.21.15.44:0/1579470119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6ec15f140 0x7fb6ec155150 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8013000 tx=0x7fb6e8004770 comp rx=0 tx=0).stop 2024-09-13T18:27:12.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f7e768e2700 1 -- 172.21.15.44:0/1536144929 shutdown_connections 2024-09-13T18:27:12.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f7e768e2700 1 --2- 172.21.15.44:0/1536144929 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e5c066730 0x7f7e5c068bf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f7e768e2700 1 --2- 172.21.15.44:0/1536144929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e70145ca0 0x7f7e7006ca40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f7e768e2700 1 --2- 172.21.15.44:0/1536144929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e700cdd50 0x7f7e7015dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f7e768e2700 1 --2- 172.21.15.44:0/1536144929 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e700b3a70 0x7f7e701fefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f7e768e2700 1 -- 172.21.15.44:0/1536144929 >> 172.21.15.44:0/1536144929 conn(0x7f7e700af5d0 msgr2=0x7f7e70071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:12.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7fb6f39b1700 1 -- 172.21.15.44:0/1579470119 shutdown_connections 2024-09-13T18:27:12.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7fb6f39b1700 1 --2- 172.21.15.44:0/1579470119 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb6d0066730 0x7fb6d0068bf0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7fb6f39b1700 1 --2- 172.21.15.44:0/1579470119 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb6ec159c70 0x7fb6ec155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7fb6f39b1700 1 --2- 172.21.15.44:0/1579470119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6ec15f140 0x7fb6ec155150 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7fb6f39b1700 1 --2- 172.21.15.44:0/1579470119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6ec144340 0x7fb6ec0ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7fb6f39b1700 1 -- 172.21.15.44:0/1579470119 >> 172.21.15.44:0/1579470119 conn(0x7fb6ec0b0e10 msgr2=0x7fb6ec138110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:12.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7fb6f39b1700 1 -- 172.21.15.44:0/1579470119 shutdown_connections 2024-09-13T18:27:12.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f7e768e2700 1 -- 172.21.15.44:0/1536144929 shutdown_connections 2024-09-13T18:27:12.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7fb6f39b1700 1 -- 172.21.15.44:0/1579470119 wait complete. 2024-09-13T18:27:12.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f7e768e2700 1 -- 172.21.15.44:0/1536144929 wait complete. 2024-09-13T18:27:12.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f0a37fff700 1 -- 172.21.15.44:0/492184358 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0a24066780 msgr2=0x7f0a24068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:12.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f0a37fff700 1 --2- 172.21.15.44:0/492184358 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0a24066780 0x7f0a24068c40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c009c60 tx=0x7f0a2c008030 comp rx=0 tx=0).stop 2024-09-13T18:27:12.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f0a37fff700 1 -- 172.21.15.44:0/492184358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a3815dd90 msgr2=0x7f0a380a84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:12.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f0a37fff700 1 --2- 172.21.15.44:0/492184358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a3815dd90 0x7f0a380a84b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000ef90 tx=0x7f0a3000c3a0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f0a37fff700 1 -- 172.21.15.44:0/492184358 shutdown_connections 2024-09-13T18:27:12.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f0a37fff700 1 --2- 172.21.15.44:0/492184358 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0a24066780 0x7f0a24068c40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f0a37fff700 1 --2- 172.21.15.44:0/492184358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a3815dd90 0x7f0a380a84b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f0a37fff700 1 --2- 172.21.15.44:0/492184358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a38146480 0x7f0a38138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f0a37fff700 1 --2- 172.21.15.44:0/492184358 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a380cc810 0x7f0a3806af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f0a37fff700 1 -- 172.21.15.44:0/492184358 >> 172.21.15.44:0/492184358 conn(0x7f0a380ae590 msgr2=0x7f0a380cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:12.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f0a37fff700 1 -- 172.21.15.44:0/492184358 shutdown_connections 2024-09-13T18:27:12.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.043+0000 7f0a37fff700 1 -- 172.21.15.44:0/492184358 wait complete. 2024-09-13T18:27:12.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.047+0000 7fc3922d4700 1 -- 172.21.15.44:0/232380581 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc38c1532e0 con 0x7fc38c15d030 2024-09-13T18:27:12.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.047+0000 7fc381ffb700 1 -- 172.21.15.44:0/232380581 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc38c1532e0 con 0x7fc38c15d030 2024-09-13T18:27:12.052 INFO:teuthology.orchestra.run.smithi044.stdout:55834574854 2024-09-13T18:27:12.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.047+0000 7fc3922d4700 1 -- 172.21.15.44:0/232380581 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc370066800 msgr2=0x7fc370068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:12.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.047+0000 7fc3922d4700 1 --2- 172.21.15.44:0/232380581 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc370066800 0x7fc370068cc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc388000f60 tx=0x7fc388009040 comp rx=0 tx=0).stop 2024-09-13T18:27:12.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.047+0000 7fc3922d4700 1 -- 172.21.15.44:0/232380581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc38c15d030 msgr2=0x7fc38c1549f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:12.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.047+0000 7fc3922d4700 1 --2- 172.21.15.44:0/232380581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc38c15d030 0x7fc38c1549f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00e840 tx=0x7fc37c00ec00 comp rx=0 tx=0).stop 2024-09-13T18:27:12.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.051+0000 7fc3922d4700 1 -- 172.21.15.44:0/232380581 shutdown_connections 2024-09-13T18:27:12.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.051+0000 7fc3922d4700 1 --2- 172.21.15.44:0/232380581 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc370066800 0x7fc370068cc0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.051+0000 7fc3922d4700 1 --2- 172.21.15.44:0/232380581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc38c15d030 0x7fc38c1549f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.051+0000 7fc3922d4700 1 --2- 172.21.15.44:0/232380581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc38c0ce270 0x7fc38c1461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.051+0000 7fc3922d4700 1 --2- 172.21.15.44:0/232380581 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc38c06d6f0 0x7fc38c0ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:12.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.051+0000 7fc3922d4700 1 -- 172.21.15.44:0/232380581 >> 172.21.15.44:0/232380581 conn(0x7fc38c0b0e10 msgr2=0x7fc38c1566f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:12.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.051+0000 7fc3922d4700 1 -- 172.21.15.44:0/232380581 shutdown_connections 2024-09-13T18:27:12.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:12.051+0000 7fc3922d4700 1 -- 172.21.15.44:0/232380581 wait complete. 2024-09-13T18:27:12.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2024-09-13T18:27:12.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-09-13T18:27:12.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2024-09-13T18:27:12.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2024-09-13T18:27:12.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2024-09-13T18:27:13.011 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:27:13.027 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T18:27:13.044 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:27:13.057 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T18:27:13.060 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T18:27:13.063 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:27:13.066 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:27:13.066 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T18:27:13.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.155+0000 7fd596d20700 1 Processor -- start 2024-09-13T18:27:13.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.155+0000 7fd596d20700 1 -- start start 2024-09-13T18:27:13.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.155+0000 7fd596d20700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd5900cd620 0x7fd590163670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.155+0000 7fd596d20700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd59006a5d0 con 0x7fd590070e80 2024-09-13T18:27:13.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.155+0000 7fd596d20700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd59006bd20 con 0x7fd59006fa90 2024-09-13T18:27:13.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.155+0000 7fd596d20700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5900cda90 con 0x7fd5900cd620 2024-09-13T18:27:13.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.155+0000 7fd58ffff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd590070e80 0x7fd5900ccf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44756/0 (socket says 172.21.15.44:44756) 2024-09-13T18:27:13.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.155+0000 7fd5952bd700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd5900cd620 0x7fd590163670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.155+0000 7fd594abc700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fd59006fa90 0x7fd5900cc800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:36070/0 (socket says 172.21.15.44:36070) 2024-09-13T18:27:13.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.155+0000 7fd594abc700 1 -- 172.21.15.44:0/1807564175 learned_addr learned my addr 172.21.15.44:0/1807564175 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:13.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.159+0000 7fd5952bd700 1 -- 172.21.15.44:0/1807564175 >> v1:172.21.15.99:6789/0 conn(0x7fd59006fa90 legacy=0x7fd5900cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.159+0000 7fd5952bd700 1 -- 172.21.15.44:0/1807564175 >> v1:172.21.15.44:6789/0 conn(0x7fd590070e80 legacy=0x7fd5900ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.159+0000 7fd5952bd700 1 -- 172.21.15.44:0/1807564175 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5900cb760 con 0x7fd5900cd620 2024-09-13T18:27:13.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.159+0000 7fd5952bd700 1 --2- 172.21.15.44:0/1807564175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5900cd620 0x7fd590163670 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd5800097d0 tx=0x7fd580009ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b5dcafb27fd25fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.159+0000 7fd58f7fe700 1 -- 172.21.15.44:0/1807564175 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd580004230 con 0x7fd5900cd620 2024-09-13T18:27:13.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.159+0000 7fd58f7fe700 1 -- 172.21.15.44:0/1807564175 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd580004390 con 0x7fd5900cd620 2024-09-13T18:27:13.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.159+0000 7fd596d20700 1 -- 172.21.15.44:0/1807564175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5900cd620 msgr2=0x7fd590163670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.159+0000 7fd596d20700 1 --2- 172.21.15.44:0/1807564175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5900cd620 0x7fd590163670 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd5800097d0 tx=0x7fd580009ae0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.159+0000 7fd596d20700 1 -- 172.21.15.44:0/1807564175 shutdown_connections 2024-09-13T18:27:13.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.159+0000 7fd596d20700 1 --2- 172.21.15.44:0/1807564175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5900cd620 0x7fd590163670 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.159+0000 7fd596d20700 1 -- 172.21.15.44:0/1807564175 >> 172.21.15.44:0/1807564175 conn(0x7fd5900ae590 msgr2=0x7fd5900ae970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:13.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.159+0000 7fd596d20700 1 -- 172.21.15.44:0/1807564175 shutdown_connections 2024-09-13T18:27:13.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.159+0000 7fd596d20700 1 -- 172.21.15.44:0/1807564175 wait complete. 2024-09-13T18:27:13.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.163+0000 7fd596d20700 1 Processor -- start 2024-09-13T18:27:13.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.163+0000 7fd596d20700 1 -- start start 2024-09-13T18:27:13.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.163+0000 7fd596d20700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd59006fa90 0x7fd5901fca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.163+0000 7fd596d20700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd590070e80 0x7fd590139510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.163+0000 7fd596d20700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5900cd620 0x7fd590139a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.163+0000 7fd594abc700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd59006fa90 0x7fd5901fca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.163+0000 7fd594abc700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd59006fa90 0x7fd5901fca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:57686/0 (socket says 172.21.15.44:57686) 2024-09-13T18:27:13.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.163+0000 7fd5952bd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5900cd620 0x7fd590139a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.163+0000 7fd5952bd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5900cd620 0x7fd590139a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41482/0 (socket says 172.21.15.44:41482) 2024-09-13T18:27:13.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.163+0000 7fd594abc700 1 -- 172.21.15.44:0/655932768 learned_addr learned my addr 172.21.15.44:0/655932768 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:13.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.163+0000 7fd596d20700 1 -- 172.21.15.44:0/655932768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd590137700 con 0x7fd5900cd620 2024-09-13T18:27:13.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.163+0000 7fd596d20700 1 -- 172.21.15.44:0/655932768 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5901379a0 con 0x7fd590070e80 2024-09-13T18:27:13.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.163+0000 7fd596d20700 1 -- 172.21.15.44:0/655932768 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd590137c80 con 0x7fd59006fa90 2024-09-13T18:27:13.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.167+0000 7fd5952bd700 1 -- 172.21.15.44:0/655932768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd59006fa90 msgr2=0x7fd5901fca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.167+0000 7fd5952bd700 1 --2- 172.21.15.44:0/655932768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd59006fa90 0x7fd5901fca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.167+0000 7fd5952bd700 1 -- 172.21.15.44:0/655932768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd590070e80 msgr2=0x7fd590139510 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:27:13.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.167+0000 7fd5952bd700 1 --2- 172.21.15.44:0/655932768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd590070e80 0x7fd590139510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.167+0000 7fd5952bd700 1 -- 172.21.15.44:0/655932768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5800094b0 con 0x7fd5900cd620 2024-09-13T18:27:13.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.167+0000 7fd5952bd700 1 --2- 172.21.15.44:0/655932768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5900cd620 0x7fd590139a50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd580013000 tx=0x7fd580004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.167+0000 7fd58d7fa700 1 -- 172.21.15.44:0/655932768 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd580004230 con 0x7fd5900cd620 2024-09-13T18:27:13.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.167+0000 7fd58d7fa700 1 -- 172.21.15.44:0/655932768 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd580011840 con 0x7fd5900cd620 2024-09-13T18:27:13.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.167+0000 7fd58d7fa700 1 -- 172.21.15.44:0/655932768 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd580011bf0 con 0x7fd5900cd620 2024-09-13T18:27:13.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.167+0000 7fd596d20700 1 -- 172.21.15.44:0/655932768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd590137f60 con 0x7fd5900cd620 2024-09-13T18:27:13.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.167+0000 7fd596d20700 1 -- 172.21.15.44:0/655932768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd590138760 con 0x7fd5900cd620 2024-09-13T18:27:13.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.171+0000 7fd58d7fa700 1 -- 172.21.15.44:0/655932768 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd580011d50 con 0x7fd5900cd620 2024-09-13T18:27:13.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.171+0000 7fd58d7fa700 1 --2- 172.21.15.44:0/655932768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd5780669e0 0x7fd578068ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.171+0000 7fd58d7fa700 1 -- 172.21.15.44:0/655932768 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd580084fa0 con 0x7fd5900cd620 2024-09-13T18:27:13.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.171+0000 7fd594abc700 1 --2- 172.21.15.44:0/655932768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd5780669e0 0x7fd578068ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.171+0000 7fd596d20700 1 -- 172.21.15.44:0/655932768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd570005310 con 0x7fd5900cd620 2024-09-13T18:27:13.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.171+0000 7fd594abc700 1 --2- 172.21.15.44:0/655932768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd5780669e0 0x7fd578068ea0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd588002230 tx=0x7fd588001e10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.179+0000 7fd58d7fa700 1 -- 172.21.15.44:0/655932768 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd5800524a0 con 0x7fd5900cd620 2024-09-13T18:27:13.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.207+0000 7ff5a0c43700 1 Processor -- start 2024-09-13T18:27:13.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.207+0000 7ff5a0c43700 1 -- start start 2024-09-13T18:27:13.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.207+0000 7ff5a0c43700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff59c0ce380 0x7ff59c0704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.207+0000 7ff5a0c43700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff59c070a10 0x7ff59c06c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.207+0000 7ff5a0c43700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff59c06ba90 con 0x7ff59c16ca90 2024-09-13T18:27:13.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.207+0000 7ff5a0c43700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff59c071220 con 0x7ff59c0ce380 2024-09-13T18:27:13.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.207+0000 7ff5a0c43700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff59c06bd00 con 0x7ff59c070a10 2024-09-13T18:27:13.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.207+0000 7ff59affd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff59c0ce380 0x7ff59c0704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.207+0000 7ff59affd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff59c0ce380 0x7ff59c0704d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41492/0 (socket says 172.21.15.44:41492) 2024-09-13T18:27:13.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.207+0000 7ff59b7fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff59c16ca90 0x7ff59c0cdc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44760/0 (socket says 172.21.15.44:44760) 2024-09-13T18:27:13.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.207+0000 7ff59affd700 1 -- 172.21.15.44:0/2961532710 learned_addr learned my addr 172.21.15.44:0/2961532710 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:13.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.207+0000 7ff59bfff700 1 --2- 172.21.15.44:0/2961532710 >> v2:172.21.15.99:3300/0 conn(0x7ff59c070a10 0x7ff59c06c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7ff59affd700 1 -- 172.21.15.44:0/2961532710 >> v2:172.21.15.99:3300/0 conn(0x7ff59c070a10 msgr2=0x7ff59c06c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:13.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7ff59affd700 1 --2- 172.21.15.44:0/2961532710 >> v2:172.21.15.99:3300/0 conn(0x7ff59c070a10 0x7ff59c06c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7ff59affd700 1 -- 172.21.15.44:0/2961532710 >> v1:172.21.15.44:6789/0 conn(0x7ff59c16ca90 legacy=0x7ff59c0cdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7ff59affd700 1 -- 172.21.15.44:0/2961532710 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c06bfe0 con 0x7ff59c0ce380 2024-09-13T18:27:13.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7fb610fed700 1 Processor -- start 2024-09-13T18:27:13.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7ff59affd700 1 --2- 172.21.15.44:0/2961532710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff59c0ce380 0x7ff59c0704d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff59c06a310 tx=0x7ff59400c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b17be97fb70c79 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7fb610fed700 1 -- start start 2024-09-13T18:27:13.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7ff59a7fc700 1 -- 172.21.15.44:0/2961532710 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59400cd60 con 0x7ff59c0ce380 2024-09-13T18:27:13.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7ff59a7fc700 1 -- 172.21.15.44:0/2961532710 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59400cec0 con 0x7ff59c0ce380 2024-09-13T18:27:13.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7ff59a7fc700 1 -- 172.21.15.44:0/2961532710 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594008250 con 0x7ff59c0ce380 2024-09-13T18:27:13.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7fb610fed700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb60c070e80 0x7fb60c0ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7fb610fed700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb60c0cd450 0x7fb60c162660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7fb610fed700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb60c06a5d0 con 0x7fb60c06fa90 2024-09-13T18:27:13.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7fb610fed700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb60c06bd20 con 0x7fb60c070e80 2024-09-13T18:27:13.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7fb610fed700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb60c0cb760 con 0x7fb60c0cd450 2024-09-13T18:27:13.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7fb60affd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb60c070e80 0x7fb60c0ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7fb60affd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb60c070e80 0x7fb60c0ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41508/0 (socket says 172.21.15.44:41508) 2024-09-13T18:27:13.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7fb60affd700 1 -- 172.21.15.44:0/3347324484 learned_addr learned my addr 172.21.15.44:0/3347324484 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:13.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7fa989b13700 1 Processor -- start 2024-09-13T18:27:13.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7fa989b13700 1 -- start start 2024-09-13T18:27:13.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7fb60bfff700 1 --2- 172.21.15.44:0/3347324484 >> v2:172.21.15.99:3300/0 conn(0x7fb60c0cd450 0x7fb60c162660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7ff5a0c43700 1 -- 172.21.15.44:0/2961532710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff59c0ce380 msgr2=0x7ff59c0704d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7ff5a0c43700 1 --2- 172.21.15.44:0/2961532710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff59c0ce380 0x7ff59c0704d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff59c06a310 tx=0x7ff59400c470 comp rx=0 tx=0).stop 2024-09-13T18:27:13.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7ff5a0c43700 1 -- 172.21.15.44:0/2961532710 shutdown_connections 2024-09-13T18:27:13.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7ff5a0c43700 1 --2- 172.21.15.44:0/2961532710 >> v2:172.21.15.99:3300/0 conn(0x7ff59c070a10 0x7ff59c06c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7ff5a0c43700 1 --2- 172.21.15.44:0/2961532710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff59c0ce380 0x7ff59c0704d0 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff59c06a310 tx=0x7ff59400c470 comp rx=0 tx=0).stop 2024-09-13T18:27:13.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7ff5a0c43700 1 -- 172.21.15.44:0/2961532710 >> 172.21.15.44:0/2961532710 conn(0x7ff59c0ae590 msgr2=0x7ff59c0ae970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:13.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7fb60affd700 1 -- 172.21.15.44:0/3347324484 >> v2:172.21.15.99:3300/0 conn(0x7fb60c0cd450 msgr2=0x7fb60c162660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:13.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7fbcff500700 1 Processor -- start 2024-09-13T18:27:13.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7fbcff500700 1 -- start start 2024-09-13T18:27:13.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7fb60affd700 1 --2- 172.21.15.44:0/3347324484 >> v2:172.21.15.99:3300/0 conn(0x7fb60c0cd450 0x7fb60c162660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7fb60affd700 1 -- 172.21.15.44:0/3347324484 >> v1:172.21.15.99:6789/0 conn(0x7fb60c06fa90 legacy=0x7fb60c0cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7fb60affd700 1 -- 172.21.15.44:0/3347324484 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c0cba40 con 0x7fb60c070e80 2024-09-13T18:27:13.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7fb60affd700 1 --2- 172.21.15.44:0/3347324484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb60c070e80 0x7fb60c0ccf10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb60c071db0 tx=0x7fb60400d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ac508bfb08ae71 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7fb60a7fc700 1 -- 172.21.15.44:0/3347324484 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb604007d30 con 0x7fb60c070e80 2024-09-13T18:27:13.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7fb60a7fc700 1 -- 172.21.15.44:0/3347324484 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb604007e90 con 0x7fb60c070e80 2024-09-13T18:27:13.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.211+0000 7ff5a0c43700 1 -- 172.21.15.44:0/2961532710 shutdown_connections 2024-09-13T18:27:13.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fb60a7fc700 1 -- 172.21.15.44:0/3347324484 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6040126f0 con 0x7fb60c070e80 2024-09-13T18:27:13.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7ff5a0c43700 1 -- 172.21.15.44:0/2961532710 wait complete. 2024-09-13T18:27:13.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7f26c2139700 1 Processor -- start 2024-09-13T18:27:13.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7f26c2139700 1 -- start start 2024-09-13T18:27:13.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fa989b13700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa984146480 0x7fa9840704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fa989b13700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa9840cc810 0x7fa9840ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fbcff500700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbcf80cdde0 0x7fbcf815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fbcff500700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbcf806ddb0 0x7fbcf8158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fa989312700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa9840cc810 0x7fa9840ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fa988b11700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa984146480 0x7fa9840704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fa988b11700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa984146480 0x7fa9840704f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:57702/0 (socket says 172.21.15.44:57702) 2024-09-13T18:27:13.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fa989312700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa9840cc810 0x7fa9840ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41518/0 (socket says 172.21.15.44:41518) 2024-09-13T18:27:13.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fa988b11700 1 -- 172.21.15.44:0/307580890 learned_addr learned my addr 172.21.15.44:0/307580890 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:13.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fa989b13700 1 -- 172.21.15.44:0/307580890 --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa984070e80 con 0x7fa98415dd90 2024-09-13T18:27:13.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fa989b13700 1 -- 172.21.15.44:0/307580890 --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa984071160 con 0x7fa9840cc810 2024-09-13T18:27:13.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fa989b13700 1 -- 172.21.15.44:0/307580890 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa984071440 con 0x7fa984146480 2024-09-13T18:27:13.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fbcff500700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf806e520 con 0x7fbcf8158570 2024-09-13T18:27:13.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fbcff500700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf815bf40 con 0x7fbcf806ddb0 2024-09-13T18:27:13.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fbcff500700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf80b2b80 con 0x7fbcf80cdde0 2024-09-13T18:27:13.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fbcfd29c700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fbcf8158570 0x7fbcf80cd6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44778/0 (socket says 172.21.15.44:44778) 2024-09-13T18:27:13.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fbcfd29c700 1 -- 172.21.15.44:0/1994656563 learned_addr learned my addr 172.21.15.44:0/1994656563 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:13.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7f26c2139700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f26bc146480 0x7f26bc0704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7f26c2139700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26bc0cc810 0x7f26bc0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7f26c2139700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26bc070e80 con 0x7f26bc15dd90 2024-09-13T18:27:13.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7f26c2139700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26bc071160 con 0x7f26bc146480 2024-09-13T18:27:13.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7f26c2139700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc071440 con 0x7f26bc0cc810 2024-09-13T18:27:13.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fa988b11700 1 -- 172.21.15.44:0/307580890 >> v2:172.21.15.44:3300/0 conn(0x7fa9840cc810 msgr2=0x7fa9840ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:13.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fa988b11700 1 --2- 172.21.15.44:0/307580890 >> v2:172.21.15.44:3300/0 conn(0x7fa9840cc810 0x7fa9840ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fa988b11700 1 -- 172.21.15.44:0/307580890 >> v1:172.21.15.44:6789/0 conn(0x7fa98415dd90 legacy=0x7fa9840cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fa988b11700 1 -- 172.21.15.44:0/307580890 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa984071720 con 0x7fa984146480 2024-09-13T18:27:13.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7f26bb7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f26bc146480 0x7f26bc0704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7f26bb7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f26bc146480 0x7f26bc0704f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41526/0 (socket says 172.21.15.44:41526) 2024-09-13T18:27:13.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7f26bb7fe700 1 -- 172.21.15.44:0/1459764908 learned_addr learned my addr 172.21.15.44:0/1459764908 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:13.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7ff5a0c43700 1 Processor -- start 2024-09-13T18:27:13.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fbcfca9b700 1 --2- 172.21.15.44:0/1994656563 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbcf80cdde0 0x7fbcf815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fbcfda9d700 1 --2- 172.21.15.44:0/1994656563 >> v2:172.21.15.99:3300/0 conn(0x7fbcf806ddb0 0x7fbcf8158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7f26bbfff700 1 --2- 172.21.15.44:0/1459764908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26bc0cc810 0x7f26bc0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fa988b11700 1 --2- 172.21.15.44:0/307580890 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa984146480 0x7fa9840704f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009e50 tx=0x7fa97c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ada4bd8a7e9f68d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fbceffff700 1 -- 172.21.15.44:0/1994656563 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073656365 0 0) 0x7fbcf806e520 con 0x7fbcf8158570 2024-09-13T18:27:13.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7f26bb7fe700 1 -- 172.21.15.44:0/1459764908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26bc0cc810 msgr2=0x7f26bc0ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:13.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7f26bb7fe700 1 --2- 172.21.15.44:0/1459764908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26bc0cc810 0x7f26bc0ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7f26bb7fe700 1 -- 172.21.15.44:0/1459764908 >> v1:172.21.15.99:6789/0 conn(0x7f26bc15dd90 legacy=0x7f26bc0cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:13.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7f26bb7fe700 1 -- 172.21.15.44:0/1459764908 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26bc071720 con 0x7f26bc146480 2024-09-13T18:27:13.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fbceffff700 1 -- 172.21.15.44:0/1994656563 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbce40035d0 con 0x7fbcf8158570 2024-09-13T18:27:13.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fa9837fe700 1 -- 172.21.15.44:0/307580890 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c00e070 con 0x7fa984146480 2024-09-13T18:27:13.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fbcfda9d700 1 -- 172.21.15.44:0/1994656563 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbcf80cdde0 msgr2=0x7fbcf815ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:13.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fbcfda9d700 1 --2- 172.21.15.44:0/1994656563 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbcf80cdde0 0x7fbcf815ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fbcfda9d700 1 -- 172.21.15.44:0/1994656563 >> v1:172.21.15.44:6789/0 conn(0x7fbcf8158570 legacy=0x7fbcf80cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fbcfda9d700 1 -- 172.21.15.44:0/1994656563 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf80b2e60 con 0x7fbcf806ddb0 2024-09-13T18:27:13.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fa9837fe700 1 -- 172.21.15.44:0/307580890 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97c00b910 con 0x7fa984146480 2024-09-13T18:27:13.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fa9837fe700 1 -- 172.21.15.44:0/307580890 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c00bcc0 con 0x7fa984146480 2024-09-13T18:27:13.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7f26bb7fe700 1 --2- 172.21.15.44:0/1459764908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26bc146480 0x7f26bc0704f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009910 tx=0x7f26ac009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e464fa92b16d2242 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fb610fed700 1 -- 172.21.15.44:0/3347324484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb60c070e80 msgr2=0x7fb60c0ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fb610fed700 1 --2- 172.21.15.44:0/3347324484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb60c070e80 0x7fb60c0ccf10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb60c071db0 tx=0x7fb60400d650 comp rx=0 tx=0).stop 2024-09-13T18:27:13.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fb610fed700 1 -- 172.21.15.44:0/3347324484 shutdown_connections 2024-09-13T18:27:13.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fb610fed700 1 --2- 172.21.15.44:0/3347324484 >> v2:172.21.15.99:3300/0 conn(0x7fb60c0cd450 0x7fb60c162660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fbcfda9d700 1 --2- 172.21.15.44:0/1994656563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf806ddb0 0x7fbcf8158bc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbcf815c080 tx=0x7fbce8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa70d8aa2381b3d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fb610fed700 1 --2- 172.21.15.44:0/3347324484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb60c070e80 0x7fb60c0ccf10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7ff5a0c43700 1 -- start start 2024-09-13T18:27:13.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7ff5a0c43700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff59c070a10 0x7ff59c15f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7ff5a0c43700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff59c16ca90 0x7ff59c0accc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7ff5a0c43700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff59c0ad200 0x7ff59c164510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7ff5a0c43700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c16b050 con 0x7ff59c0ad200 2024-09-13T18:27:13.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7ff5a0c43700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c16a440 con 0x7ff59c16ca90 2024-09-13T18:27:13.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7ff5a0c43700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c16a720 con 0x7ff59c070a10 2024-09-13T18:27:13.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fb610fed700 1 -- 172.21.15.44:0/3347324484 >> 172.21.15.44:0/3347324484 conn(0x7fb60c0ae590 msgr2=0x7fb60c0ae970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:13.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fb610fed700 1 -- 172.21.15.44:0/3347324484 shutdown_connections 2024-09-13T18:27:13.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fb610fed700 1 -- 172.21.15.44:0/3347324484 wait complete. 2024-09-13T18:27:13.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fbceffff700 1 -- 172.21.15.44:0/1994656563 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce8004020 con 0x7fbcf806ddb0 2024-09-13T18:27:13.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7ff59bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff59c0ad200 0x7ff59c164510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7ff59bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff59c0ad200 0x7ff59c164510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41528/0 (socket says 172.21.15.44:41528) 2024-09-13T18:27:13.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7ff59bfff700 1 -- 172.21.15.44:0/995178363 learned_addr learned my addr 172.21.15.44:0/995178363 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:13.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7ff59affd700 1 --2- 172.21.15.44:0/995178363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff59c16ca90 0x7ff59c0accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7ff59bfff700 1 -- 172.21.15.44:0/995178363 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff59c070a10 msgr2=0x7ff59c15f500 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:27:13.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7ff59bfff700 1 --2- 172.21.15.44:0/995178363 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff59c070a10 0x7ff59c15f500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7ff59bfff700 1 -- 172.21.15.44:0/995178363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff59c16ca90 msgr2=0x7ff59c0accc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7ff59bfff700 1 --2- 172.21.15.44:0/995178363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff59c16ca90 0x7ff59c0accc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7ff59bfff700 1 -- 172.21.15.44:0/995178363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff594008b20 con 0x7ff59c0ad200 2024-09-13T18:27:13.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fbceffff700 1 -- 172.21.15.44:0/1994656563 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce8004180 con 0x7fbcf806ddb0 2024-09-13T18:27:13.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.215+0000 7fbceffff700 1 -- 172.21.15.44:0/1994656563 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce80044f0 con 0x7fbcf806ddb0 2024-09-13T18:27:13.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7ff59bfff700 1 --2- 172.21.15.44:0/995178363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff59c0ad200 0x7ff59c164510 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff590012f00 tx=0x7ff5900103a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7f26ba7fc700 1 -- 172.21.15.44:0/1459764908 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac004230 con 0x7f26bc146480 2024-09-13T18:27:13.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7f26ba7fc700 1 -- 172.21.15.44:0/1459764908 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ac004390 con 0x7f26bc146480 2024-09-13T18:27:13.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7f26ba7fc700 1 -- 172.21.15.44:0/1459764908 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac009e60 con 0x7f26bc146480 2024-09-13T18:27:13.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fbcff500700 1 -- 172.21.15.44:0/1994656563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf806ddb0 msgr2=0x7fbcf8158bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fbcff500700 1 --2- 172.21.15.44:0/1994656563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf806ddb0 0x7fbcf8158bc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbcf815c080 tx=0x7fbce8009b30 comp rx=0 tx=0).stop 2024-09-13T18:27:13.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fa989b13700 1 -- 172.21.15.44:0/307580890 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa984146480 msgr2=0x7fa9840704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fa989b13700 1 --2- 172.21.15.44:0/307580890 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa984146480 0x7fa9840704f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009e50 tx=0x7fa97c00b330 comp rx=0 tx=0).stop 2024-09-13T18:27:13.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fa989b13700 1 -- 172.21.15.44:0/307580890 shutdown_connections 2024-09-13T18:27:13.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fa989b13700 1 --2- 172.21.15.44:0/307580890 >> v2:172.21.15.44:3300/0 conn(0x7fa9840cc810 0x7fa9840ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fa989b13700 1 --2- 172.21.15.44:0/307580890 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa984146480 0x7fa9840704f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fa989b13700 1 -- 172.21.15.44:0/307580890 >> 172.21.15.44:0/307580890 conn(0x7fa9840ae590 msgr2=0x7fa9840ae970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:13.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fb610fed700 1 Processor -- start 2024-09-13T18:27:13.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fa989b13700 1 -- 172.21.15.44:0/307580890 shutdown_connections 2024-09-13T18:27:13.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fb610fed700 1 -- start start 2024-09-13T18:27:13.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fa989b13700 1 -- 172.21.15.44:0/307580890 wait complete. 2024-09-13T18:27:13.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7f26c2139700 1 -- 172.21.15.44:0/1459764908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26bc146480 msgr2=0x7f26bc0704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7f26c2139700 1 --2- 172.21.15.44:0/1459764908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26bc146480 0x7f26bc0704f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009910 tx=0x7f26ac009c20 comp rx=0 tx=0).stop 2024-09-13T18:27:13.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fb610fed700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb60c06fa90 0x7fb60c1f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fb610fed700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb60c070e80 0x7fb60c1ed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fb610fed700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb60c0cd450 0x7fb60c0ab570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fb610fed700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c0a9250 con 0x7fb60c0cd450 2024-09-13T18:27:13.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fb610fed700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c1f24e0 con 0x7fb60c070e80 2024-09-13T18:27:13.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fb610fed700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c0a8c90 con 0x7fb60c06fa90 2024-09-13T18:27:13.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7ff583fff700 1 -- 172.21.15.44:0/995178363 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590010a50 con 0x7ff59c0ad200 2024-09-13T18:27:13.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fbcff500700 1 -- 172.21.15.44:0/1994656563 shutdown_connections 2024-09-13T18:27:13.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fbcff500700 1 --2- 172.21.15.44:0/1994656563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf806ddb0 0x7fbcf8158bc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fbcff500700 1 --2- 172.21.15.44:0/1994656563 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbcf80cdde0 0x7fbcf815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7ff583fff700 1 -- 172.21.15.44:0/995178363 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff590013040 con 0x7ff59c0ad200 2024-09-13T18:27:13.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fbcff500700 1 -- 172.21.15.44:0/1994656563 >> 172.21.15.44:0/1994656563 conn(0x7fbcf80af5d0 msgr2=0x7fbcf80af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:13.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7ff5a0c43700 1 -- 172.21.15.44:0/995178363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59c16aa00 con 0x7ff59c0ad200 2024-09-13T18:27:13.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fbcff500700 1 -- 172.21.15.44:0/1994656563 shutdown_connections 2024-09-13T18:27:13.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fbcff500700 1 -- 172.21.15.44:0/1994656563 wait complete. 2024-09-13T18:27:13.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7f26c2139700 1 -- 172.21.15.44:0/1459764908 shutdown_connections 2024-09-13T18:27:13.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7f26c2139700 1 --2- 172.21.15.44:0/1459764908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26bc0cc810 0x7f26bc0ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7f26c2139700 1 --2- 172.21.15.44:0/1459764908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26bc146480 0x7f26bc0704f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7f26c2139700 1 -- 172.21.15.44:0/1459764908 >> 172.21.15.44:0/1459764908 conn(0x7f26bc0ae590 msgr2=0x7f26bc0ae970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:13.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7ff583fff700 1 -- 172.21.15.44:0/995178363 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590010dd0 con 0x7ff59c0ad200 2024-09-13T18:27:13.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7ff5a0c43700 1 -- 172.21.15.44:0/995178363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff59c16a080 con 0x7ff59c0ad200 2024-09-13T18:27:13.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fa989b13700 1 Processor -- start 2024-09-13T18:27:13.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7f26c2139700 1 -- 172.21.15.44:0/1459764908 shutdown_connections 2024-09-13T18:27:13.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7f26c2139700 1 -- 172.21.15.44:0/1459764908 wait complete. 2024-09-13T18:27:13.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7f174f59e700 1 Processor -- start 2024-09-13T18:27:13.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7f174f59e700 1 -- start start 2024-09-13T18:27:13.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fb60bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb60c0cd450 0x7fb60c0ab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fb60bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb60c0cd450 0x7fb60c0ab570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41532/0 (socket says 172.21.15.44:41532) 2024-09-13T18:27:13.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fb60bfff700 1 -- 172.21.15.44:0/3534046919 learned_addr learned my addr 172.21.15.44:0/3534046919 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:13.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fb60b7fe700 1 --2- 172.21.15.44:0/3534046919 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb60c06fa90 0x7fb60c1f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fb60affd700 1 --2- 172.21.15.44:0/3534046919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb60c070e80 0x7fb60c1ed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fb60bfff700 1 -- 172.21.15.44:0/3534046919 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb60c06fa90 msgr2=0x7fb60c1f1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fb60bfff700 1 --2- 172.21.15.44:0/3534046919 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb60c06fa90 0x7fb60c1f1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fb60bfff700 1 -- 172.21.15.44:0/3534046919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb60c070e80 msgr2=0x7fb60c1ed7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fb60bfff700 1 --2- 172.21.15.44:0/3534046919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb60c070e80 0x7fb60c1ed7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fb60bfff700 1 -- 172.21.15.44:0/3534046919 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60400d050 con 0x7fb60c0cd450 2024-09-13T18:27:13.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fb60bfff700 1 --2- 172.21.15.44:0/3534046919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb60c0cd450 0x7fb60c0ab570 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00eb60 tx=0x7fb5fc00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7ff583fff700 1 -- 172.21.15.44:0/995178363 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff5900070d0 con 0x7ff59c0ad200 2024-09-13T18:27:13.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7ff581ffb700 1 -- 172.21.15.44:0/995178363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff59c0b31b0 con 0x7ff59c0ad200 2024-09-13T18:27:13.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7ff583fff700 1 --2- 172.21.15.44:0/995178363 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff5880667b0 0x7ff588068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fa989b13700 1 -- start start 2024-09-13T18:27:13.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fa989b13700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9840cc810 0x7fa9841f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fa989b13700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa984146480 0x7fa98415f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fa989b13700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa98415dd90 0x7fa9841ef9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fa989b13700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98415ca50 con 0x7fa9840cc810 2024-09-13T18:27:13.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7ff583fff700 1 -- 172.21.15.44:0/995178363 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5900888f0 con 0x7ff59c0ad200 2024-09-13T18:27:13.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f174f59e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f175015dd90 0x7f17500cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f174f59e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f17500cc640 0x7f17500ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f174f59e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1750070e80 con 0x7f1750146480 2024-09-13T18:27:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f174f59e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17500ccaf0 con 0x7f175015dd90 2024-09-13T18:27:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f174f59e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1750071160 con 0x7f17500cc640 2024-09-13T18:27:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.219+0000 7fbcff500700 1 Processor -- start 2024-09-13T18:27:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fa988b11700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9840cc810 0x7fa9841f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fa988b11700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9840cc810 0x7fa9841f3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41540/0 (socket says 172.21.15.44:41540) 2024-09-13T18:27:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fa988b11700 1 -- 172.21.15.44:0/4200162638 learned_addr learned my addr 172.21.15.44:0/4200162638 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fa989312700 1 --2- 172.21.15.44:0/4200162638 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa98415dd90 0x7fa9841ef9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fa983fff700 1 --2- 172.21.15.44:0/4200162638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa984146480 0x7fa98415f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7ff59b7fe700 1 --2- 172.21.15.44:0/995178363 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff5880667b0 0x7ff588068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fa989b13700 1 -- 172.21.15.44:0/4200162638 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9841f35d0 con 0x7fa984146480 2024-09-13T18:27:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fa989b13700 1 -- 172.21.15.44:0/4200162638 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98415e5f0 con 0x7fa98415dd90 2024-09-13T18:27:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f174e59c700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1750146480 0x7f17500704f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44784/0 (socket says 172.21.15.44:44784) 2024-09-13T18:27:13.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f174e59c700 1 -- 172.21.15.44:0/1466416358 learned_addr learned my addr 172.21.15.44:0/1466416358 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:13.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f26c2139700 1 Processor -- start 2024-09-13T18:27:13.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fbcff500700 1 -- start start 2024-09-13T18:27:13.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f26c2139700 1 -- start start 2024-09-13T18:27:13.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fa989312700 1 -- 172.21.15.44:0/4200162638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa984146480 msgr2=0x7fa98415f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fa989312700 1 --2- 172.21.15.44:0/4200162638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa984146480 0x7fa98415f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fa989312700 1 -- 172.21.15.44:0/4200162638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9840cc810 msgr2=0x7fa9841f3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fa989312700 1 --2- 172.21.15.44:0/4200162638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9840cc810 0x7fa9841f3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fa989312700 1 -- 172.21.15.44:0/4200162638 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97c009b30 con 0x7fa98415dd90 2024-09-13T18:27:13.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fa989312700 1 --2- 172.21.15.44:0/4200162638 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa98415dd90 0x7fa9841ef9d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa97400e890 tx=0x7fa97400eba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fbcff500700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf806ddb0 0x7fbcf8141f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f26c2139700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26bc0cc810 0x7f26bc15c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f26c2139700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26bc146480 0x7f26bc13cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f26c2139700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26bc15dd90 0x7f26bc13aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f26c2139700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc15c930 con 0x7f26bc0cc810 2024-09-13T18:27:13.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f26c2139700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc13d5a0 con 0x7f26bc146480 2024-09-13T18:27:13.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f26c2139700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc13d880 con 0x7f26bc15dd90 2024-09-13T18:27:13.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fbcff500700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcf80cdde0 0x7fbcf81544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fbcff500700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbcf8158570 0x7fbcf81549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fbcff500700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf80ac9f0 con 0x7fbcf80cdde0 2024-09-13T18:27:13.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fbcff500700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf8142460 con 0x7fbcf806ddb0 2024-09-13T18:27:13.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fbcff500700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf80ccb80 con 0x7fbcf8158570 2024-09-13T18:27:13.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f174ed9d700 1 --2- 172.21.15.44:0/1466416358 >> v2:172.21.15.99:3300/0 conn(0x7f17500cc640 0x7f17500ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f26bb7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26bc0cc810 0x7f26bc15c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f26bb7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26bc0cc810 0x7f26bc15c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41562/0 (socket says 172.21.15.44:41562) 2024-09-13T18:27:13.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f26bb7fe700 1 -- 172.21.15.44:0/676201369 learned_addr learned my addr 172.21.15.44:0/676201369 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:13.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fbcfd29c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf806ddb0 0x7fbcf8141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f174dd9b700 1 --2- 172.21.15.44:0/1466416358 >> v2:172.21.15.44:3300/0 conn(0x7f175015dd90 0x7f17500cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fbcfd29c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf806ddb0 0x7fbcf8141f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:38986/0 (socket says 172.21.15.44:38986) 2024-09-13T18:27:13.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fbcfca9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcf80cdde0 0x7fbcf81544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fbcfd29c700 1 -- 172.21.15.44:0/1379530725 learned_addr learned my addr 172.21.15.44:0/1379530725 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:13.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f26bbfff700 1 --2- 172.21.15.44:0/676201369 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26bc15dd90 0x7f26bc13aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f26baffd700 1 --2- 172.21.15.44:0/676201369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26bc146480 0x7f26bc13cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f174ed9d700 1 -- 172.21.15.44:0/1466416358 >> v2:172.21.15.44:3300/0 conn(0x7f175015dd90 msgr2=0x7f17500cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:13.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fbcfda9d700 1 --2- 172.21.15.44:0/1379530725 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbcf8158570 0x7fbcf81549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fa9817fa700 1 -- 172.21.15.44:0/4200162638 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974013680 con 0x7fa98415dd90 2024-09-13T18:27:13.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fa9817fa700 1 -- 172.21.15.44:0/4200162638 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9740137e0 con 0x7fa98415dd90 2024-09-13T18:27:13.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fa9817fa700 1 -- 172.21.15.44:0/4200162638 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974013b50 con 0x7fa98415dd90 2024-09-13T18:27:13.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fa989b13700 1 -- 172.21.15.44:0/4200162638 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98415e8d0 con 0x7fa98415dd90 2024-09-13T18:27:13.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f174ed9d700 1 --2- 172.21.15.44:0/1466416358 >> v2:172.21.15.44:3300/0 conn(0x7f175015dd90 0x7f17500cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f174ed9d700 1 -- 172.21.15.44:0/1466416358 >> v1:172.21.15.44:6789/0 conn(0x7f1750146480 legacy=0x7f17500704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f174ed9d700 1 -- 172.21.15.44:0/1466416358 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1750071440 con 0x7f17500cc640 2024-09-13T18:27:13.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f26bb7fe700 1 -- 172.21.15.44:0/676201369 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26bc15dd90 msgr2=0x7f26bc13aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f26bb7fe700 1 --2- 172.21.15.44:0/676201369 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26bc15dd90 0x7f26bc13aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f26bb7fe700 1 -- 172.21.15.44:0/676201369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26bc146480 msgr2=0x7f26bc13cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f26bb7fe700 1 --2- 172.21.15.44:0/676201369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26bc146480 0x7f26bc13cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f26bb7fe700 1 -- 172.21.15.44:0/676201369 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ac009570 con 0x7f26bc0cc810 2024-09-13T18:27:13.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f26bbfff700 1 --2- 172.21.15.44:0/676201369 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26bc15dd90 0x7f26bc13aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:13.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fbcfca9b700 1 -- 172.21.15.44:0/1379530725 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbcf8158570 msgr2=0x7fbcf81549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fbcfca9b700 1 --2- 172.21.15.44:0/1379530725 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbcf8158570 0x7fbcf81549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fbcfca9b700 1 -- 172.21.15.44:0/1379530725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf806ddb0 msgr2=0x7fbcf8141f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fbcfca9b700 1 --2- 172.21.15.44:0/1379530725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf806ddb0 0x7fbcf8141f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fbcfca9b700 1 -- 172.21.15.44:0/1379530725 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce80094b0 con 0x7fbcf80cdde0 2024-09-13T18:27:13.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fa989b13700 1 -- 172.21.15.44:0/4200162638 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98415ee90 con 0x7fa98415dd90 2024-09-13T18:27:13.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f26bb7fe700 1 --2- 172.21.15.44:0/676201369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26bc0cc810 0x7f26bc15c3f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f26ac004000 tx=0x7f26ac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7f174ed9d700 1 --2- 172.21.15.44:0/1466416358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17500cc640 0x7f17500ac8c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f17500ce7f0 tx=0x7f174800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=392cd540f816a5bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fbcfca9b700 1 --2- 172.21.15.44:0/1379530725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcf80cdde0 0x7fbcf81544a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000efc0 tx=0x7fbcf000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7ff59b7fe700 1 --2- 172.21.15.44:0/995178363 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff5880667b0 0x7ff588068c70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff59c16c460 tx=0x7ff58c007a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fb5f3fff700 1 -- 172.21.15.44:0/3534046919 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc00c850 con 0x7fb60c0cd450 2024-09-13T18:27:13.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fb5f3fff700 1 -- 172.21.15.44:0/3534046919 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5fc00c9b0 con 0x7fb60c0cd450 2024-09-13T18:27:13.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fb610fed700 1 -- 172.21.15.44:0/3534046919 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60c0a8f70 con 0x7fb60c0cd450 2024-09-13T18:27:13.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fb610fed700 1 -- 172.21.15.44:0/3534046919 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60c15a550 con 0x7fb60c0cd450 2024-09-13T18:27:13.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fb5f3fff700 1 -- 172.21.15.44:0/3534046919 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc00cd20 con 0x7fb60c0cd450 2024-09-13T18:27:13.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.223+0000 7fb610fed700 1 -- 172.21.15.44:0/3534046919 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ec005310 con 0x7fb60c0cd450 2024-09-13T18:27:13.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7f174d59a700 1 -- 172.21.15.44:0/1466416358 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174800e070 con 0x7f17500cc640 2024-09-13T18:27:13.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7f174d59a700 1 -- 172.21.15.44:0/1466416358 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174800bbd0 con 0x7f17500cc640 2024-09-13T18:27:13.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7f174d59a700 1 -- 172.21.15.44:0/1466416358 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748012430 con 0x7f17500cc640 2024-09-13T18:27:13.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7f174f59e700 1 -- 172.21.15.44:0/1466416358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17500cc640 msgr2=0x7f17500ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7f174f59e700 1 --2- 172.21.15.44:0/1466416358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17500cc640 0x7f17500ac8c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f17500ce7f0 tx=0x7f174800b330 comp rx=0 tx=0).stop 2024-09-13T18:27:13.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7f174f59e700 1 -- 172.21.15.44:0/1466416358 shutdown_connections 2024-09-13T18:27:13.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7f174f59e700 1 --2- 172.21.15.44:0/1466416358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17500cc640 0x7f17500ac8c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7f174f59e700 1 --2- 172.21.15.44:0/1466416358 >> v2:172.21.15.44:3300/0 conn(0x7f175015dd90 0x7f17500cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7f174f59e700 1 -- 172.21.15.44:0/1466416358 >> 172.21.15.44:0/1466416358 conn(0x7f17500ae590 msgr2=0x7f17500ae970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:13.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7f174f59e700 1 -- 172.21.15.44:0/1466416358 shutdown_connections 2024-09-13T18:27:13.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7fa989b13700 1 -- 172.21.15.44:0/4200162638 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa964005310 con 0x7fa98415dd90 2024-09-13T18:27:13.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7f174f59e700 1 -- 172.21.15.44:0/1466416358 wait complete. 2024-09-13T18:27:13.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7fa9817fa700 1 -- 172.21.15.44:0/4200162638 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa974013cb0 con 0x7fa98415dd90 2024-09-13T18:27:13.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7fa9817fa700 1 --2- 172.21.15.44:0/4200162638 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa96c0668c0 0x7fa96c068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7fa9817fa700 1 -- 172.21.15.44:0/4200162638 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa974083f00 con 0x7fa98415dd90 2024-09-13T18:27:13.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7fbf0359e700 1 Processor -- start 2024-09-13T18:27:13.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7fbf0359e700 1 -- start start 2024-09-13T18:27:13.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7fa988b11700 1 --2- 172.21.15.44:0/4200162638 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa96c0668c0 0x7fa96c068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7f174f59e700 1 Processor -- start 2024-09-13T18:27:13.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7f174f59e700 1 -- start start 2024-09-13T18:27:13.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7fa988b11700 1 --2- 172.21.15.44:0/4200162638 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa96c0668c0 0x7fa96c068d80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009850 tx=0x7fa97c009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7fbf0359e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbf04159950 0x7fbf040ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7fbf0359e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbf04071b40 0x7fbf0406ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7fbf0359e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf040ce000 con 0x7fbf040cc3c0 2024-09-13T18:27:13.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7fbf0359e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf040cd3f0 con 0x7fbf04159950 2024-09-13T18:27:13.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7fbf0359e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf040cd6d0 con 0x7fbf04071b40 2024-09-13T18:27:13.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7fbf0259c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbf04159950 0x7fbf040ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7fbf0259c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbf04159950 0x7fbf040ccd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41592/0 (socket says 172.21.15.44:41592) 2024-09-13T18:27:13.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7fbf0259c700 1 -- 172.21.15.44:0/3067666049 learned_addr learned my addr 172.21.15.44:0/3067666049 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:13.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7fbf02d9d700 1 --2- 172.21.15.44:0/3067666049 >> v2:172.21.15.99:3300/0 conn(0x7fbf04071b40 0x7fbf0406ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7ff583fff700 1 -- 172.21.15.44:0/995178363 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff590055d40 con 0x7ff59c0ad200 2024-09-13T18:27:13.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7fbf02d9d700 1 -- 172.21.15.44:0/3067666049 >> v2:172.21.15.44:3300/0 conn(0x7fbf04159950 msgr2=0x7fbf040ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:13.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7fbf02d9d700 1 --2- 172.21.15.44:0/3067666049 >> v2:172.21.15.44:3300/0 conn(0x7fbf04159950 0x7fbf040ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7fbf02d9d700 1 -- 172.21.15.44:0/3067666049 >> v1:172.21.15.44:6789/0 conn(0x7fbf040cc3c0 legacy=0x7fbf04071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7fbf02d9d700 1 -- 172.21.15.44:0/3067666049 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf040cd9b0 con 0x7fbf04071b40 2024-09-13T18:27:13.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7fbf0259c700 1 --2- 172.21.15.44:0/3067666049 >> v2:172.21.15.44:3300/0 conn(0x7fbf04159950 0x7fbf040ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:13.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.227+0000 7fbcedffb700 1 -- 172.21.15.44:0/1379530725 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf000cd10 con 0x7fbcf80cdde0 2024-09-13T18:27:13.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7fbcedffb700 1 -- 172.21.15.44:0/1379530725 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf000f040 con 0x7fbcf80cdde0 2024-09-13T18:27:13.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7fb5f3fff700 1 -- 172.21.15.44:0/3534046919 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb5fc013470 con 0x7fb60c0cd450 2024-09-13T18:27:13.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7fbf02d9d700 1 --2- 172.21.15.44:0/3067666049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf04071b40 0x7fbf0406ca00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbf0406fc40 tx=0x7fbef4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55150d305dd6ff64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7f174f59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f17500cc640 0x7f175013b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7f174f59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1750146480 0x7f175015bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7f174f59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f175015dd90 0x7f175013d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7f174f59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175013cac0 con 0x7f175015dd90 2024-09-13T18:27:13.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7f174f59e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175013b4f0 con 0x7f1750146480 2024-09-13T18:27:13.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7f174f59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175013be40 con 0x7f17500cc640 2024-09-13T18:27:13.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7f174dd9b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1750146480 0x7f175015bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7f174dd9b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1750146480 0x7f175015bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:39012/0 (socket says 172.21.15.44:39012) 2024-09-13T18:27:13.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7f174dd9b700 1 -- 172.21.15.44:0/3990474073 learned_addr learned my addr 172.21.15.44:0/3990474073 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:13.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7f174e59c700 1 --2- 172.21.15.44:0/3990474073 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f17500cc640 0x7f175013b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7fbcedffb700 1 -- 172.21.15.44:0/1379530725 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf00146a0 con 0x7fbcf80cdde0 2024-09-13T18:27:13.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7fbcff500700 1 -- 172.21.15.44:0/1379530725 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf80cce60 con 0x7fbcf80cdde0 2024-09-13T18:27:13.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7fbcff500700 1 -- 172.21.15.44:0/1379530725 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf80cd420 con 0x7fbcf80cdde0 2024-09-13T18:27:13.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7f174e59c700 1 -- 172.21.15.44:0/3990474073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1750146480 msgr2=0x7f175015bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7f174e59c700 1 --2- 172.21.15.44:0/3990474073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1750146480 0x7f175015bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7f174e59c700 1 -- 172.21.15.44:0/3990474073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f175015dd90 msgr2=0x7f175013d240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:27:13.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7f174e59c700 1 --2- 172.21.15.44:0/3990474073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f175015dd90 0x7f175013d240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7f174e59c700 1 -- 172.21.15.44:0/3990474073 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1748009a70 con 0x7f17500cc640 2024-09-13T18:27:13.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7fb5f3fff700 1 --2- 172.21.15.44:0/3534046919 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb5f8066780 0x7fb5f8068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7fb5f3fff700 1 -- 172.21.15.44:0/3534046919 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5fc0848d0 con 0x7fb60c0cd450 2024-09-13T18:27:13.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7f174e59c700 1 --2- 172.21.15.44:0/3990474073 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f17500cc640 0x7f175013b7b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1740000f60 tx=0x7f174000c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7fb60b7fe700 1 --2- 172.21.15.44:0/3534046919 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb5f8066780 0x7fb5f8068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7fb60b7fe700 1 --2- 172.21.15.44:0/3534046919 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb5f8066780 0x7fb5f8068c40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb600000f60 tx=0x7fb600009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.231+0000 7fbcff500700 1 -- 172.21.15.44:0/1379530725 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf80acb30 con 0x7fbcf80cdde0 2024-09-13T18:27:13.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.235+0000 7f26a3fff700 1 -- 172.21.15.44:0/676201369 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac00bdb0 con 0x7f26bc0cc810 2024-09-13T18:27:13.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.235+0000 7f26a3fff700 1 -- 172.21.15.44:0/676201369 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ac01f070 con 0x7f26bc0cc810 2024-09-13T18:27:13.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.235+0000 7f26c2139700 1 -- 172.21.15.44:0/676201369 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26bc13db60 con 0x7f26bc0cc810 2024-09-13T18:27:13.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.235+0000 7f26a3fff700 1 -- 172.21.15.44:0/676201369 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac003900 con 0x7f26bc0cc810 2024-09-13T18:27:13.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.235+0000 7f26c2139700 1 -- 172.21.15.44:0/676201369 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26bc138330 con 0x7f26bc0cc810 2024-09-13T18:27:13.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.235+0000 7f26c2139700 1 -- 172.21.15.44:0/676201369 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26bc1384c0 con 0x7f26bc0cc810 2024-09-13T18:27:13.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.235+0000 7fb5f3fff700 1 -- 172.21.15.44:0/3534046919 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb5fc051db0 con 0x7fb60c0cd450 2024-09-13T18:27:13.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.235+0000 7fbcedffb700 1 -- 172.21.15.44:0/1379530725 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbcf0014800 con 0x7fbcf80cdde0 2024-09-13T18:27:13.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.235+0000 7fbcedffb700 1 --2- 172.21.15.44:0/1379530725 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbcdc066760 0x7fbcdc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.235+0000 7fbcedffb700 1 -- 172.21.15.44:0/1379530725 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbcf0084fc0 con 0x7fbcf80cdde0 2024-09-13T18:27:13.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.235+0000 7fa9817fa700 1 -- 172.21.15.44:0/4200162638 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa9740513e0 con 0x7fa98415dd90 2024-09-13T18:27:13.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.235+0000 7fbcfd29c700 1 --2- 172.21.15.44:0/1379530725 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbcdc066760 0x7fbcdc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.239+0000 7f26a3fff700 1 -- 172.21.15.44:0/676201369 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f26ac021030 con 0x7f26bc0cc810 2024-09-13T18:27:13.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.239+0000 7f26a3fff700 1 --2- 172.21.15.44:0/676201369 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f26a8066800 0x7f26a8068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.239+0000 7fbcfd29c700 1 --2- 172.21.15.44:0/1379530725 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbcdc066760 0x7fbcdc068c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4005930 tx=0x7fbcf4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.239+0000 7f26a3fff700 1 -- 172.21.15.44:0/676201369 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26ac085b30 con 0x7f26bc0cc810 2024-09-13T18:27:13.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.239+0000 7f26baffd700 1 --2- 172.21.15.44:0/676201369 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f26a8066800 0x7f26a8068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.239+0000 7f26baffd700 1 --2- 172.21.15.44:0/676201369 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f26a8066800 0x7f26a8068cc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f26bc160060 tx=0x7f26b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.243+0000 7f173effd700 1 -- 172.21.15.44:0/3990474073 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740005d90 con 0x7f17500cc640 2024-09-13T18:27:13.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.239+0000 7fbf0159a700 1 -- 172.21.15.44:0/3067666049 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef4011830 con 0x7fbf04071b40 2024-09-13T18:27:13.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.239+0000 7fbf0159a700 1 -- 172.21.15.44:0/3067666049 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef4011990 con 0x7fbf04071b40 2024-09-13T18:27:13.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.239+0000 7fbf0159a700 1 -- 172.21.15.44:0/3067666049 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef4011d20 con 0x7fbf04071b40 2024-09-13T18:27:13.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.243+0000 7f173effd700 1 -- 172.21.15.44:0/3990474073 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174000ce90 con 0x7f17500cc640 2024-09-13T18:27:13.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.243+0000 7fbcedffb700 1 -- 172.21.15.44:0/1379530725 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbcf00523c0 con 0x7fbcf80cdde0 2024-09-13T18:27:13.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.243+0000 7f173effd700 1 -- 172.21.15.44:0/3990474073 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17400072d0 con 0x7f17500cc640 2024-09-13T18:27:13.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.243+0000 7f174f59e700 1 -- 172.21.15.44:0/3990474073 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175013c120 con 0x7f17500cc640 2024-09-13T18:27:13.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.243+0000 7f174f59e700 1 -- 172.21.15.44:0/3990474073 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175013c6e0 con 0x7f17500cc640 2024-09-13T18:27:13.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.243+0000 7fbf0359e700 1 -- 172.21.15.44:0/3067666049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf04071b40 msgr2=0x7fbf0406ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.243+0000 7fbf0359e700 1 --2- 172.21.15.44:0/3067666049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf04071b40 0x7fbf0406ca00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbf0406fc40 tx=0x7fbef4009b30 comp rx=0 tx=0).stop 2024-09-13T18:27:13.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.243+0000 7fbf0359e700 1 -- 172.21.15.44:0/3067666049 shutdown_connections 2024-09-13T18:27:13.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.243+0000 7fbf0359e700 1 --2- 172.21.15.44:0/3067666049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf04071b40 0x7fbf0406ca00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.243+0000 7fbf0359e700 1 --2- 172.21.15.44:0/3067666049 >> v2:172.21.15.44:3300/0 conn(0x7fbf04159950 0x7fbf040ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.243+0000 7fbf0359e700 1 -- 172.21.15.44:0/3067666049 >> 172.21.15.44:0/3067666049 conn(0x7fbf040ae590 msgr2=0x7fbf040ae970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:13.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.243+0000 7f26a3fff700 1 -- 172.21.15.44:0/676201369 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f26ac053030 con 0x7f26bc0cc810 2024-09-13T18:27:13.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.243+0000 7fbf0359e700 1 -- 172.21.15.44:0/3067666049 shutdown_connections 2024-09-13T18:27:13.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.247+0000 7f174f59e700 1 -- 172.21.15.44:0/3990474073 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f175013cc00 con 0x7f17500cc640 2024-09-13T18:27:13.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.243+0000 7fbf0359e700 1 -- 172.21.15.44:0/3067666049 wait complete. 2024-09-13T18:27:13.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.247+0000 7fbf0359e700 1 Processor -- start 2024-09-13T18:27:13.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.247+0000 7fbf0359e700 1 -- start start 2024-09-13T18:27:13.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.247+0000 7fbf0359e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf04071b40 0x7fbf04158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.247+0000 7f173effd700 1 -- 172.21.15.44:0/3990474073 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1740007430 con 0x7f17500cc640 2024-09-13T18:27:13.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.247+0000 7fbf0359e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf040cc3c0 0x7fbf0415c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.247+0000 7fbf0359e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf04159950 0x7fbf0414cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.247+0000 7fbf0359e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf04157700 con 0x7fbf04071b40 2024-09-13T18:27:13.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.247+0000 7fbf0359e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0414d1b0 con 0x7fbf04159950 2024-09-13T18:27:13.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.247+0000 7fbf0359e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0414fb30 con 0x7fbf040cc3c0 2024-09-13T18:27:13.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.247+0000 7fbf0259c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf04071b40 0x7fbf04158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.247+0000 7fbf0259c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf04071b40 0x7fbf04158430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41600/0 (socket says 172.21.15.44:41600) 2024-09-13T18:27:13.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.247+0000 7fbf0259c700 1 -- 172.21.15.44:0/540574105 learned_addr learned my addr 172.21.15.44:0/540574105 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:13.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.247+0000 7fbf02d9d700 1 --2- 172.21.15.44:0/540574105 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf04159950 0x7fbf0414cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.247+0000 7fbf0259c700 1 -- 172.21.15.44:0/540574105 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf040cc3c0 msgr2=0x7fbf0415c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.247+0000 7fbf0259c700 1 --2- 172.21.15.44:0/540574105 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf040cc3c0 0x7fbf0415c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.247+0000 7fbf0259c700 1 -- 172.21.15.44:0/540574105 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf04159950 msgr2=0x7fbf0414cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.247+0000 7fbf0259c700 1 --2- 172.21.15.44:0/540574105 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf04159950 0x7fbf0414cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.247+0000 7fbf0259c700 1 -- 172.21.15.44:0/540574105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc009b30 con 0x7fbf04071b40 2024-09-13T18:27:13.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.247+0000 7fbf0259c700 1 --2- 172.21.15.44:0/540574105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf04071b40 0x7fbf04158430 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00b330 tx=0x7fbefc00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.251+0000 7f173effd700 1 --2- 172.21.15.44:0/3990474073 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1730066800 0x7f1730068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.251+0000 7f173effd700 1 -- 172.21.15.44:0/3990474073 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1740083960 con 0x7f17500cc640 2024-09-13T18:27:13.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.251+0000 7f174dd9b700 1 --2- 172.21.15.44:0/3990474073 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1730066800 0x7f1730068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.251+0000 7f174dd9b700 1 --2- 172.21.15.44:0/3990474073 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1730066800 0x7f1730068cc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f174400bb90 tx=0x7f1744008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.255+0000 7f173effd700 1 -- 172.21.15.44:0/3990474073 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1740050df0 con 0x7f17500cc640 2024-09-13T18:27:13.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.259+0000 7fbef2ffd700 1 -- 172.21.15.44:0/540574105 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc015070 con 0x7fbf04071b40 2024-09-13T18:27:13.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.259+0000 7fbf0359e700 1 -- 172.21.15.44:0/540574105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef40094b0 con 0x7fbf04071b40 2024-09-13T18:27:13.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.259+0000 7fbf0359e700 1 -- 172.21.15.44:0/540574105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf040ce610 con 0x7fbf04071b40 2024-09-13T18:27:13.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.259+0000 7fbef2ffd700 1 -- 172.21.15.44:0/540574105 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbefc00bc80 con 0x7fbf04071b40 2024-09-13T18:27:13.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.259+0000 7fbef2ffd700 1 -- 172.21.15.44:0/540574105 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc003a40 con 0x7fbf04071b40 2024-09-13T18:27:13.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.263+0000 7fbef2ffd700 1 -- 172.21.15.44:0/540574105 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbefc003ba0 con 0x7fbf04071b40 2024-09-13T18:27:13.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.263+0000 7fbef2ffd700 1 --2- 172.21.15.44:0/540574105 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbee4066800 0x7fbee4068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.263+0000 7fbef2ffd700 1 -- 172.21.15.44:0/540574105 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbefc087d80 con 0x7fbf04071b40 2024-09-13T18:27:13.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.263+0000 7fbf01d9b700 1 --2- 172.21.15.44:0/540574105 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbee4066800 0x7fbee4068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.263+0000 7fbf0359e700 1 -- 172.21.15.44:0/540574105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee8005310 con 0x7fbf04071b40 2024-09-13T18:27:13.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.263+0000 7fbf01d9b700 1 --2- 172.21.15.44:0/540574105 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbee4066800 0x7fbee4068cc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbef8000f60 tx=0x7fbef8007a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.271+0000 7fbef2ffd700 1 -- 172.21.15.44:0/540574105 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbefc0550d0 con 0x7fbf04071b40 2024-09-13T18:27:13.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.495+0000 7fd596d20700 1 -- 172.21.15.44:0/655932768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd5700055c0 con 0x7fd5900cd620 2024-09-13T18:27:13.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.495+0000 7fd58d7fa700 1 -- 172.21.15.44:0/655932768 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd580016020 con 0x7fd5900cd620 2024-09-13T18:27:13.501 INFO:teuthology.orchestra.run.smithi044.stdout:55834574856 2024-09-13T18:27:13.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.499+0000 7fd576ffd700 1 -- 172.21.15.44:0/655932768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd5780669e0 msgr2=0x7fd578068ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.499+0000 7fd576ffd700 1 --2- 172.21.15.44:0/655932768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd5780669e0 0x7fd578068ea0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd588002230 tx=0x7fd588001e10 comp rx=0 tx=0).stop 2024-09-13T18:27:13.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.499+0000 7fd576ffd700 1 -- 172.21.15.44:0/655932768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5900cd620 msgr2=0x7fd590139a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.499+0000 7fd576ffd700 1 --2- 172.21.15.44:0/655932768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5900cd620 0x7fd590139a50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd580013000 tx=0x7fd580004770 comp rx=0 tx=0).stop 2024-09-13T18:27:13.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.499+0000 7fd576ffd700 1 -- 172.21.15.44:0/655932768 shutdown_connections 2024-09-13T18:27:13.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.499+0000 7fd576ffd700 1 --2- 172.21.15.44:0/655932768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd5780669e0 0x7fd578068ea0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.499+0000 7fd576ffd700 1 --2- 172.21.15.44:0/655932768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5900cd620 0x7fd590139a50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.499+0000 7fd576ffd700 1 --2- 172.21.15.44:0/655932768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd590070e80 0x7fd590139510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.499+0000 7fd576ffd700 1 --2- 172.21.15.44:0/655932768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd59006fa90 0x7fd5901fca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.499+0000 7fd576ffd700 1 -- 172.21.15.44:0/655932768 >> 172.21.15.44:0/655932768 conn(0x7fd5900ae590 msgr2=0x7fd5900b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:13.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.499+0000 7fd576ffd700 1 -- 172.21.15.44:0/655932768 shutdown_connections 2024-09-13T18:27:13.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.499+0000 7fd576ffd700 1 -- 172.21.15.44:0/655932768 wait complete. 2024-09-13T18:27:13.518 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2024-09-13T18:27:13.518 DEBUG:teuthology.parallel:result is None 2024-09-13T18:27:13.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.539+0000 7fb610fed700 1 -- 172.21.15.44:0/3534046919 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb5ec005890 con 0x7fb60c0cd450 2024-09-13T18:27:13.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.539+0000 7fb5f3fff700 1 -- 172.21.15.44:0/3534046919 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb5fc017090 con 0x7fb60c0cd450 2024-09-13T18:27:13.545 INFO:teuthology.orchestra.run.smithi044.stdout:55834574855 2024-09-13T18:27:13.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.543+0000 7fb610fed700 1 -- 172.21.15.44:0/3534046919 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb5f8066780 msgr2=0x7fb5f8068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.543+0000 7fb610fed700 1 --2- 172.21.15.44:0/3534046919 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb5f8066780 0x7fb5f8068c40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb600000f60 tx=0x7fb600009040 comp rx=0 tx=0).stop 2024-09-13T18:27:13.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.543+0000 7fb610fed700 1 -- 172.21.15.44:0/3534046919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb60c0cd450 msgr2=0x7fb60c0ab570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.543+0000 7fb610fed700 1 --2- 172.21.15.44:0/3534046919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb60c0cd450 0x7fb60c0ab570 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00eb60 tx=0x7fb5fc00ef20 comp rx=0 tx=0).stop 2024-09-13T18:27:13.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.543+0000 7fb610fed700 1 -- 172.21.15.44:0/3534046919 shutdown_connections 2024-09-13T18:27:13.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.543+0000 7fb610fed700 1 --2- 172.21.15.44:0/3534046919 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb5f8066780 0x7fb5f8068c40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.543+0000 7fb610fed700 1 --2- 172.21.15.44:0/3534046919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb60c0cd450 0x7fb60c0ab570 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.543+0000 7fb610fed700 1 --2- 172.21.15.44:0/3534046919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb60c070e80 0x7fb60c1ed7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.543+0000 7fb610fed700 1 --2- 172.21.15.44:0/3534046919 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb60c06fa90 0x7fb60c1f1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.543+0000 7fb610fed700 1 -- 172.21.15.44:0/3534046919 >> 172.21.15.44:0/3534046919 conn(0x7fb60c0ae590 msgr2=0x7fb60c0b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:13.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.543+0000 7fb610fed700 1 -- 172.21.15.44:0/3534046919 shutdown_connections 2024-09-13T18:27:13.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.543+0000 7fb610fed700 1 -- 172.21.15.44:0/3534046919 wait complete. 2024-09-13T18:27:13.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.547+0000 7ff581ffb700 1 -- 172.21.15.44:0/995178363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff59c16b190 con 0x7ff59c0ad200 2024-09-13T18:27:13.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.547+0000 7ff583fff700 1 -- 172.21.15.44:0/995178363 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff590059360 con 0x7ff59c0ad200 2024-09-13T18:27:13.550 INFO:teuthology.orchestra.run.smithi044.stdout:55834574855 2024-09-13T18:27:13.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.547+0000 7ff581ffb700 1 -- 172.21.15.44:0/995178363 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff5880667b0 msgr2=0x7ff588068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.551+0000 7ff581ffb700 1 --2- 172.21.15.44:0/995178363 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff5880667b0 0x7ff588068c70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff59c16c460 tx=0x7ff58c007a50 comp rx=0 tx=0).stop 2024-09-13T18:27:13.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.551+0000 7ff581ffb700 1 -- 172.21.15.44:0/995178363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff59c0ad200 msgr2=0x7ff59c164510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.551+0000 7ff581ffb700 1 --2- 172.21.15.44:0/995178363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff59c0ad200 0x7ff59c164510 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff590012f00 tx=0x7ff5900103a0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.551+0000 7ff581ffb700 1 -- 172.21.15.44:0/995178363 shutdown_connections 2024-09-13T18:27:13.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.551+0000 7ff581ffb700 1 --2- 172.21.15.44:0/995178363 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff5880667b0 0x7ff588068c70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.551+0000 7ff581ffb700 1 --2- 172.21.15.44:0/995178363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff59c0ad200 0x7ff59c164510 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.551+0000 7ff581ffb700 1 --2- 172.21.15.44:0/995178363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff59c16ca90 0x7ff59c0accc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.551+0000 7ff581ffb700 1 --2- 172.21.15.44:0/995178363 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff59c070a10 0x7ff59c15f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.551+0000 7ff581ffb700 1 -- 172.21.15.44:0/995178363 >> 172.21.15.44:0/995178363 conn(0x7ff59c0ae590 msgr2=0x7ff59c06cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:13.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.551+0000 7ff581ffb700 1 -- 172.21.15.44:0/995178363 shutdown_connections 2024-09-13T18:27:13.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.551+0000 7ff581ffb700 1 -- 172.21.15.44:0/995178363 wait complete. 2024-09-13T18:27:13.558 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-09-13T18:27:13.558 DEBUG:teuthology.parallel:result is None 2024-09-13T18:27:13.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-09-13T18:27:13.569 DEBUG:teuthology.parallel:result is None 2024-09-13T18:27:13.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.567+0000 7fa989b13700 1 -- 172.21.15.44:0/4200162638 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa964005890 con 0x7fa98415dd90 2024-09-13T18:27:13.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.567+0000 7fbcff500700 1 -- 172.21.15.44:0/1379530725 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbcf80acb30 con 0x7fbcf80cdde0 2024-09-13T18:27:13.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.567+0000 7fa9817fa700 1 -- 172.21.15.44:0/4200162638 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa974017090 con 0x7fa98415dd90 2024-09-13T18:27:13.572 INFO:teuthology.orchestra.run.smithi044.stdout:55834574855 2024-09-13T18:27:13.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.567+0000 7fbcedffb700 1 -- 172.21.15.44:0/1379530725 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbcf80acb30 con 0x7fbcf80cdde0 2024-09-13T18:27:13.573 INFO:teuthology.orchestra.run.smithi044.stdout:55834574858 2024-09-13T18:27:13.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fa989b13700 1 -- 172.21.15.44:0/4200162638 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa96c0668c0 msgr2=0x7fa96c068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fa989b13700 1 --2- 172.21.15.44:0/4200162638 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa96c0668c0 0x7fa96c068d80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009850 tx=0x7fa97c009000 comp rx=0 tx=0).stop 2024-09-13T18:27:13.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fa989b13700 1 -- 172.21.15.44:0/4200162638 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa98415dd90 msgr2=0x7fa9841ef9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fa989b13700 1 --2- 172.21.15.44:0/4200162638 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa98415dd90 0x7fa9841ef9d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa97400e890 tx=0x7fa97400eba0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fa989b13700 1 -- 172.21.15.44:0/4200162638 shutdown_connections 2024-09-13T18:27:13.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fa989b13700 1 --2- 172.21.15.44:0/4200162638 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa96c0668c0 0x7fa96c068d80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fa989b13700 1 --2- 172.21.15.44:0/4200162638 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa98415dd90 0x7fa9841ef9d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fa989b13700 1 --2- 172.21.15.44:0/4200162638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa984146480 0x7fa98415f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fa989b13700 1 --2- 172.21.15.44:0/4200162638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9840cc810 0x7fa9841f3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fa989b13700 1 -- 172.21.15.44:0/4200162638 >> 172.21.15.44:0/4200162638 conn(0x7fa9840ae590 msgr2=0x7fa984140fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:13.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fbcff500700 1 -- 172.21.15.44:0/1379530725 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbcdc066760 msgr2=0x7fbcdc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fbcff500700 1 --2- 172.21.15.44:0/1379530725 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbcdc066760 0x7fbcdc068c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4005930 tx=0x7fbcf4009040 comp rx=0 tx=0).stop 2024-09-13T18:27:13.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fbcff500700 1 -- 172.21.15.44:0/1379530725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcf80cdde0 msgr2=0x7fbcf81544a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fbcff500700 1 --2- 172.21.15.44:0/1379530725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcf80cdde0 0x7fbcf81544a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000efc0 tx=0x7fbcf000c3a0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fa989b13700 1 -- 172.21.15.44:0/4200162638 shutdown_connections 2024-09-13T18:27:13.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fa989b13700 1 -- 172.21.15.44:0/4200162638 wait complete. 2024-09-13T18:27:13.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fbcff500700 1 -- 172.21.15.44:0/1379530725 shutdown_connections 2024-09-13T18:27:13.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fbcff500700 1 --2- 172.21.15.44:0/1379530725 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbcdc066760 0x7fbcdc068c20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fbcff500700 1 --2- 172.21.15.44:0/1379530725 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbcf8158570 0x7fbcf81549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fbcff500700 1 --2- 172.21.15.44:0/1379530725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcf80cdde0 0x7fbcf81544a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fbcff500700 1 --2- 172.21.15.44:0/1379530725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf806ddb0 0x7fbcf8141f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fbcff500700 1 -- 172.21.15.44:0/1379530725 >> 172.21.15.44:0/1379530725 conn(0x7fbcf80af5d0 msgr2=0x7fbcf80712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:13.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fbcff500700 1 -- 172.21.15.44:0/1379530725 shutdown_connections 2024-09-13T18:27:13.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.571+0000 7fbcff500700 1 -- 172.21.15.44:0/1379530725 wait complete. 2024-09-13T18:27:13.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.579+0000 7f26c2139700 1 -- 172.21.15.44:0/676201369 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f26bc1384c0 con 0x7f26bc0cc810 2024-09-13T18:27:13.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.579+0000 7f26a3fff700 1 -- 172.21.15.44:0/676201369 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f26ac056650 con 0x7f26bc0cc810 2024-09-13T18:27:13.585 INFO:teuthology.orchestra.run.smithi044.stdout:55834574856 2024-09-13T18:27:13.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.583+0000 7f174f59e700 1 -- 172.21.15.44:0/3990474073 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f175013cc00 con 0x7f17500cc640 2024-09-13T18:27:13.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.583+0000 7f26c2139700 1 -- 172.21.15.44:0/676201369 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f26a8066800 msgr2=0x7f26a8068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.583+0000 7f26c2139700 1 --2- 172.21.15.44:0/676201369 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f26a8066800 0x7f26a8068cc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f26bc160060 tx=0x7f26b0008040 comp rx=0 tx=0).stop 2024-09-13T18:27:13.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.583+0000 7f26c2139700 1 -- 172.21.15.44:0/676201369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26bc0cc810 msgr2=0x7f26bc15c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.583+0000 7f26c2139700 1 --2- 172.21.15.44:0/676201369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26bc0cc810 0x7f26bc15c3f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f26ac004000 tx=0x7f26ac004770 comp rx=0 tx=0).stop 2024-09-13T18:27:13.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.583+0000 7f26c2139700 1 -- 172.21.15.44:0/676201369 shutdown_connections 2024-09-13T18:27:13.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.583+0000 7f26c2139700 1 --2- 172.21.15.44:0/676201369 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f26a8066800 0x7f26a8068cc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.583+0000 7f26c2139700 1 --2- 172.21.15.44:0/676201369 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26bc15dd90 0x7f26bc13aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.583+0000 7f26c2139700 1 --2- 172.21.15.44:0/676201369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26bc146480 0x7f26bc13cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.583+0000 7f26c2139700 1 --2- 172.21.15.44:0/676201369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26bc0cc810 0x7f26bc15c3f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.583+0000 7f26c2139700 1 -- 172.21.15.44:0/676201369 >> 172.21.15.44:0/676201369 conn(0x7f26bc0ae590 msgr2=0x7f26bc0cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:13.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.583+0000 7f26c2139700 1 -- 172.21.15.44:0/676201369 shutdown_connections 2024-09-13T18:27:13.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.583+0000 7f26c2139700 1 -- 172.21.15.44:0/676201369 wait complete. 2024-09-13T18:27:13.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.583+0000 7f173effd700 1 -- 172.21.15.44:0/3990474073 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1740021020 con 0x7f17500cc640 2024-09-13T18:27:13.590 INFO:teuthology.orchestra.run.smithi044.stdout:55834574857 2024-09-13T18:27:13.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.583+0000 7fbf0359e700 1 -- 172.21.15.44:0/540574105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbee80055c0 con 0x7fbf04071b40 2024-09-13T18:27:13.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7fbef2ffd700 1 -- 172.21.15.44:0/540574105 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbefc0586f0 con 0x7fbf04071b40 2024-09-13T18:27:13.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-09-13T18:27:13.591 DEBUG:teuthology.parallel:result is None 2024-09-13T18:27:13.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2024-09-13T18:27:13.592 INFO:teuthology.orchestra.run.smithi044.stdout:55834574856 2024-09-13T18:27:13.592 DEBUG:teuthology.parallel:result is None 2024-09-13T18:27:13.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7f174f59e700 1 -- 172.21.15.44:0/3990474073 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1730066800 msgr2=0x7f1730068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7f174f59e700 1 --2- 172.21.15.44:0/3990474073 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1730066800 0x7f1730068cc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f174400bb90 tx=0x7f1744008040 comp rx=0 tx=0).stop 2024-09-13T18:27:13.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7f174f59e700 1 -- 172.21.15.44:0/3990474073 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f17500cc640 msgr2=0x7f175013b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7f174f59e700 1 --2- 172.21.15.44:0/3990474073 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f17500cc640 0x7f175013b7b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1740000f60 tx=0x7f174000c6e0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7f174f59e700 1 -- 172.21.15.44:0/3990474073 shutdown_connections 2024-09-13T18:27:13.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7f174f59e700 1 --2- 172.21.15.44:0/3990474073 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1730066800 0x7f1730068cc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7f174f59e700 1 --2- 172.21.15.44:0/3990474073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f175015dd90 0x7f175013d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7f174f59e700 1 --2- 172.21.15.44:0/3990474073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1750146480 0x7f175015bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7f174f59e700 1 --2- 172.21.15.44:0/3990474073 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f17500cc640 0x7f175013b7b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7f174f59e700 1 -- 172.21.15.44:0/3990474073 >> 172.21.15.44:0/3990474073 conn(0x7f17500ae590 msgr2=0x7f175015d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:13.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7f174f59e700 1 -- 172.21.15.44:0/3990474073 shutdown_connections 2024-09-13T18:27:13.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7f174f59e700 1 -- 172.21.15.44:0/3990474073 wait complete. 2024-09-13T18:27:13.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7fbf0359e700 1 -- 172.21.15.44:0/540574105 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbee4066800 msgr2=0x7fbee4068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7fbf0359e700 1 --2- 172.21.15.44:0/540574105 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbee4066800 0x7fbee4068cc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbef8000f60 tx=0x7fbef8007a80 comp rx=0 tx=0).stop 2024-09-13T18:27:13.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7fbf0359e700 1 -- 172.21.15.44:0/540574105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf04071b40 msgr2=0x7fbf04158430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7fbf0359e700 1 --2- 172.21.15.44:0/540574105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf04071b40 0x7fbf04158430 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00b330 tx=0x7fbefc00b6f0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7fbf0359e700 1 -- 172.21.15.44:0/540574105 shutdown_connections 2024-09-13T18:27:13.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7fbf0359e700 1 --2- 172.21.15.44:0/540574105 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbee4066800 0x7fbee4068cc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7fbf0359e700 1 --2- 172.21.15.44:0/540574105 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf04159950 0x7fbf0414cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7fbf0359e700 1 --2- 172.21.15.44:0/540574105 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf040cc3c0 0x7fbf0415c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7fbf0359e700 1 --2- 172.21.15.44:0/540574105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf04071b40 0x7fbf04158430 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7fbf0359e700 1 -- 172.21.15.44:0/540574105 >> 172.21.15.44:0/540574105 conn(0x7fbf040ae590 msgr2=0x7fbf040cb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:13.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7fbf0359e700 1 -- 172.21.15.44:0/540574105 shutdown_connections 2024-09-13T18:27:13.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.587+0000 7fbf0359e700 1 -- 172.21.15.44:0/540574105 wait complete. 2024-09-13T18:27:13.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2024-09-13T18:27:13.601 DEBUG:teuthology.parallel:result is None 2024-09-13T18:27:13.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2024-09-13T18:27:13.602 DEBUG:teuthology.parallel:result is None 2024-09-13T18:27:13.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2024-09-13T18:27:13.604 DEBUG:teuthology.parallel:result is None 2024-09-13T18:27:13.604 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T18:27:13.605 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:27:13.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef3ab91700 1 Processor -- start 2024-09-13T18:27:13.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef3ab91700 1 -- start start 2024-09-13T18:27:13.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef3ab91700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fef34151900 0x7fef340b2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef3ab91700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef340b4e30 0x7fef34071a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef3ab91700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3415b340 con 0x7fef340b26a0 2024-09-13T18:27:13.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef3ab91700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef3415b620 con 0x7fef34151900 2024-09-13T18:27:13.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef3ab91700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3415b900 con 0x7fef340b4e30 2024-09-13T18:27:13.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef39b8f700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fef34151900 0x7fef340b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef3938e700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fef340b26a0 0x7fef340b4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44806/0 (socket says 172.21.15.44:44806) 2024-09-13T18:27:13.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef3938e700 1 -- 172.21.15.44:0/4209457189 learned_addr learned my addr 172.21.15.44:0/4209457189 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:13.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef3a390700 1 --2- 172.21.15.44:0/4209457189 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef340b4e30 0x7fef34071a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef39b8f700 1 -- 172.21.15.44:0/4209457189 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef340b4e30 msgr2=0x7fef34071a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:13.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef39b8f700 1 --2- 172.21.15.44:0/4209457189 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef340b4e30 0x7fef34071a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef39b8f700 1 -- 172.21.15.44:0/4209457189 >> v1:172.21.15.44:6789/0 conn(0x7fef340b26a0 legacy=0x7fef340b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef38b8d700 1 -- 172.21.15.44:0/4209457189 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2361059027 0 0) 0x7fef3415b340 con 0x7fef340b26a0 2024-09-13T18:27:13.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef39b8f700 1 -- 172.21.15.44:0/4209457189 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3415bbe0 con 0x7fef34151900 2024-09-13T18:27:13.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef39b8f700 1 --2- 172.21.15.44:0/4209457189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef34151900 0x7fef340b2160 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fef28009850 tx=0x7fef28009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b9a987ff6dfd69 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef38b8d700 1 -- 172.21.15.44:0/4209457189 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef28011830 con 0x7fef34151900 2024-09-13T18:27:13.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef38b8d700 1 -- 172.21.15.44:0/4209457189 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef28011990 con 0x7fef34151900 2024-09-13T18:27:13.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef38b8d700 1 -- 172.21.15.44:0/4209457189 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef28011d20 con 0x7fef34151900 2024-09-13T18:27:13.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef3ab91700 1 -- 172.21.15.44:0/4209457189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef34151900 msgr2=0x7fef340b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef3ab91700 1 --2- 172.21.15.44:0/4209457189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef34151900 0x7fef340b2160 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fef28009850 tx=0x7fef28009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:13.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef3ab91700 1 -- 172.21.15.44:0/4209457189 shutdown_connections 2024-09-13T18:27:13.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef3ab91700 1 --2- 172.21.15.44:0/4209457189 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef340b4e30 0x7fef34071a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef3ab91700 1 --2- 172.21.15.44:0/4209457189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef34151900 0x7fef340b2160 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fef28009850 tx=0x7fef28009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:13.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.755+0000 7fef3ab91700 1 -- 172.21.15.44:0/4209457189 >> 172.21.15.44:0/4209457189 conn(0x7fef340cbb60 msgr2=0x7fef340cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:13.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.759+0000 7fef3ab91700 1 -- 172.21.15.44:0/4209457189 shutdown_connections 2024-09-13T18:27:13.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.759+0000 7fef3ab91700 1 -- 172.21.15.44:0/4209457189 wait complete. 2024-09-13T18:27:13.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.759+0000 7fef3ab91700 1 Processor -- start 2024-09-13T18:27:13.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.759+0000 7fef3ab91700 1 -- start start 2024-09-13T18:27:13.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.759+0000 7fef3ab91700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef340b26a0 0x7fef3414f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.759+0000 7fef3ab91700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef340b4e30 0x7fef341f1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.759+0000 7fef3ab91700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef3406c260 0x7fef3406b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.759+0000 7fef3ab91700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef341552e0 con 0x7fef340b4e30 2024-09-13T18:27:13.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.759+0000 7fef3ab91700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef340c4020 con 0x7fef340b26a0 2024-09-13T18:27:13.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.759+0000 7fef3ab91700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef340c42e0 con 0x7fef3406c260 2024-09-13T18:27:13.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.759+0000 7fef3938e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef340b4e30 0x7fef341f1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.759+0000 7fef3938e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef340b4e30 0x7fef341f1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41628/0 (socket says 172.21.15.44:41628) 2024-09-13T18:27:13.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.759+0000 7fef3938e700 1 -- 172.21.15.44:0/3206794409 learned_addr learned my addr 172.21.15.44:0/3206794409 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:13.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.759+0000 7fef39b8f700 1 --2- 172.21.15.44:0/3206794409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef340b26a0 0x7fef3414f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.759+0000 7fef3a390700 1 --2- 172.21.15.44:0/3206794409 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef3406c260 0x7fef3406b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.759+0000 7fef3938e700 1 -- 172.21.15.44:0/3206794409 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef3406c260 msgr2=0x7fef3406b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.759+0000 7fef3938e700 1 --2- 172.21.15.44:0/3206794409 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef3406c260 0x7fef3406b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.759+0000 7fef3938e700 1 -- 172.21.15.44:0/3206794409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef340b26a0 msgr2=0x7fef3414f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.759+0000 7fef3938e700 1 --2- 172.21.15.44:0/3206794409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef340b26a0 0x7fef3414f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.759+0000 7fef3938e700 1 -- 172.21.15.44:0/3206794409 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef280094b0 con 0x7fef340b4e30 2024-09-13T18:27:13.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.759+0000 7fef3938e700 1 --2- 172.21.15.44:0/3206794409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef340b4e30 0x7fef341f1020 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00cbf0 tx=0x7fef2c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.763+0000 7fef267fc700 1 -- 172.21.15.44:0/3206794409 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c00ac20 con 0x7fef340b4e30 2024-09-13T18:27:13.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.763+0000 7fef267fc700 1 -- 172.21.15.44:0/3206794409 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2c00ada0 con 0x7fef340b4e30 2024-09-13T18:27:13.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.763+0000 7fef3ab91700 1 -- 172.21.15.44:0/3206794409 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef340c45c0 con 0x7fef340b4e30 2024-09-13T18:27:13.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.763+0000 7fef267fc700 1 -- 172.21.15.44:0/3206794409 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c007310 con 0x7fef340b4e30 2024-09-13T18:27:13.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.763+0000 7fef3ab91700 1 -- 172.21.15.44:0/3206794409 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef341f1a40 con 0x7fef340b4e30 2024-09-13T18:27:13.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.763+0000 7fef3ab91700 1 -- 172.21.15.44:0/3206794409 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef341f1c60 con 0x7fef340b4e30 2024-09-13T18:27:13.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.763+0000 7fef267fc700 1 -- 172.21.15.44:0/3206794409 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fef2c007470 con 0x7fef340b4e30 2024-09-13T18:27:13.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.763+0000 7fef267fc700 1 --2- 172.21.15.44:0/3206794409 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef18066730 0x7fef18068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.763+0000 7fef267fc700 1 -- 172.21.15.44:0/3206794409 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef2c083fd0 con 0x7fef340b4e30 2024-09-13T18:27:13.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.763+0000 7fef39b8f700 1 --2- 172.21.15.44:0/3206794409 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef18066730 0x7fef18068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.767+0000 7fef39b8f700 1 --2- 172.21.15.44:0/3206794409 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef18066730 0x7fef18068bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fef340cba50 tx=0x7fef28008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.771+0000 7fef267fc700 1 -- 172.21.15.44:0/3206794409 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fef2c051340 con 0x7fef340b4e30 2024-09-13T18:27:13.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.931+0000 7fef3ab91700 1 -- 172.21.15.44:0/3206794409 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fef340cccb0 con 0x7fef18066730 2024-09-13T18:27:13.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.947+0000 7fef267fc700 1 -- 172.21.15.44:0/3206794409 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264534 (secure 0 0 0) 0x7fef28011c80 con 0x7fef18066730 2024-09-13T18:27:13.956 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:13.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.951+0000 7fef3ab91700 1 -- 172.21.15.44:0/3206794409 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef18066730 msgr2=0x7fef18068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.951+0000 7fef3ab91700 1 --2- 172.21.15.44:0/3206794409 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef18066730 0x7fef18068bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fef340cba50 tx=0x7fef28008030 comp rx=0 tx=0).stop 2024-09-13T18:27:13.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.951+0000 7fef3ab91700 1 -- 172.21.15.44:0/3206794409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef340b4e30 msgr2=0x7fef341f1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.951+0000 7fef3ab91700 1 --2- 172.21.15.44:0/3206794409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef340b4e30 0x7fef341f1020 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00cbf0 tx=0x7fef2c00a060 comp rx=0 tx=0).stop 2024-09-13T18:27:13.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.951+0000 7fef3ab91700 1 -- 172.21.15.44:0/3206794409 shutdown_connections 2024-09-13T18:27:13.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.951+0000 7fef3ab91700 1 --2- 172.21.15.44:0/3206794409 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef18066730 0x7fef18068bf0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.951+0000 7fef3ab91700 1 --2- 172.21.15.44:0/3206794409 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef3406c260 0x7fef3406b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.951+0000 7fef3ab91700 1 --2- 172.21.15.44:0/3206794409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef340b4e30 0x7fef341f1020 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.951+0000 7fef3ab91700 1 --2- 172.21.15.44:0/3206794409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef340b26a0 0x7fef3414f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.951+0000 7fef3ab91700 1 -- 172.21.15.44:0/3206794409 >> 172.21.15.44:0/3206794409 conn(0x7fef340cbb60 msgr2=0x7fef3414faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:13.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.951+0000 7fef3ab91700 1 -- 172.21.15.44:0/3206794409 shutdown_connections 2024-09-13T18:27:13.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:13.951+0000 7fef3ab91700 1 -- 172.21.15.44:0/3206794409 wait complete. 2024-09-13T18:27:13.960 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:27:13.970 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-13T18:27:12.320118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219096,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755624,"statfs":{"total":773094113280,"available":772869758976,"internally_reserved":0,"allocated":2990080,"data_stored":1790012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.037075"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563137+0000","last_change":"2024-09-13T18:27:01.305887+0000","last_active":"2024-09-13T18:27:02.563137+0000","last_peered":"2024-09-13T18:27:02.563137+0000","last_clean":"2024-09-13T18:27:02.563137+0000","last_became_active":"2024-09-13T18:27:01.305625+0000","last_became_peered":"2024-09-13T18:27:01.305625+0000","last_unstale":"2024-09-13T18:27:02.563137+0000","last_undegraded":"2024-09-13T18:27:02.563137+0000","last_fullsized":"2024-09-13T18:27:02.563137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:07.409290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288134+0000","last_change":"2024-09-13T18:27:01.304009+0000","last_active":"2024-09-13T18:27:02.288134+0000","last_peered":"2024-09-13T18:27:02.288134+0000","last_clean":"2024-09-13T18:27:02.288134+0000","last_became_active":"2024-09-13T18:27:01.303652+0000","last_became_peered":"2024-09-13T18:27:01.303652+0000","last_unstale":"2024-09-13T18:27:02.288134+0000","last_undegraded":"2024-09-13T18:27:02.288134+0000","last_fullsized":"2024-09-13T18:27:02.288134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562791+0000","last_change":"2024-09-13T18:27:01.306439+0000","last_active":"2024-09-13T18:27:02.562791+0000","last_peered":"2024-09-13T18:27:02.562791+0000","last_clean":"2024-09-13T18:27:02.562791+0000","last_became_active":"2024-09-13T18:27:01.306181+0000","last_became_peered":"2024-09-13T18:27:01.306181+0000","last_unstale":"2024-09-13T18:27:02.562791+0000","last_undegraded":"2024-09-13T18:27:02.562791+0000","last_fullsized":"2024-09-13T18:27:02.562791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:25.136745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286635+0000","last_change":"2024-09-13T18:27:01.303323+0000","last_active":"2024-09-13T18:27:02.286635+0000","last_peered":"2024-09-13T18:27:02.286635+0000","last_clean":"2024-09-13T18:27:02.286635+0000","last_became_active":"2024-09-13T18:27:01.302581+0000","last_became_peered":"2024-09-13T18:27:01.302581+0000","last_unstale":"2024-09-13T18:27:02.286635+0000","last_undegraded":"2024-09-13T18:27:02.286635+0000","last_fullsized":"2024-09-13T18:27:02.286635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:38.650324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561988+0000","last_change":"2024-09-13T18:27:01.300462+0000","last_active":"2024-09-13T18:27:02.561988+0000","last_peered":"2024-09-13T18:27:02.561988+0000","last_clean":"2024-09-13T18:27:02.561988+0000","last_became_active":"2024-09-13T18:27:01.300188+0000","last_became_peered":"2024-09-13T18:27:01.300188+0000","last_unstale":"2024-09-13T18:27:02.561988+0000","last_undegraded":"2024-09-13T18:27:02.561988+0000","last_fullsized":"2024-09-13T18:27:02.561988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:40.378467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286541+0000","last_change":"2024-09-13T18:27:01.299781+0000","last_active":"2024-09-13T18:27:02.286541+0000","last_peered":"2024-09-13T18:27:02.286541+0000","last_clean":"2024-09-13T18:27:02.286541+0000","last_became_active":"2024-09-13T18:27:01.299516+0000","last_became_peered":"2024-09-13T18:27:01.299516+0000","last_unstale":"2024-09-13T18:27:02.286541+0000","last_undegraded":"2024-09-13T18:27:02.286541+0000","last_fullsized":"2024-09-13T18:27:02.286541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:07.409290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.560812+0000","last_change":"2024-09-13T18:27:01.305664+0000","last_active":"2024-09-13T18:27:02.560812+0000","last_peered":"2024-09-13T18:27:02.560812+0000","last_clean":"2024-09-13T18:27:02.560812+0000","last_became_active":"2024-09-13T18:27:01.305343+0000","last_became_peered":"2024-09-13T18:27:01.305343+0000","last_unstale":"2024-09-13T18:27:02.560812+0000","last_undegraded":"2024-09-13T18:27:02.560812+0000","last_fullsized":"2024-09-13T18:27:02.560812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:40.223464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288405+0000","last_change":"2024-09-13T18:27:01.301564+0000","last_active":"2024-09-13T18:27:02.288405+0000","last_peered":"2024-09-13T18:27:02.288405+0000","last_clean":"2024-09-13T18:27:02.288405+0000","last_became_active":"2024-09-13T18:27:01.301286+0000","last_became_peered":"2024-09-13T18:27:01.301286+0000","last_unstale":"2024-09-13T18:27:02.288405+0000","last_undegraded":"2024-09-13T18:27:02.288405+0000","last_fullsized":"2024-09-13T18:27:02.288405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:40.223464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563309+0000","last_change":"2024-09-13T18:27:01.308981+0000","last_active":"2024-09-13T18:27:02.563309+0000","last_peered":"2024-09-13T18:27:02.563309+0000","last_clean":"2024-09-13T18:27:02.563309+0000","last_became_active":"2024-09-13T18:27:01.308748+0000","last_became_peered":"2024-09-13T18:27:01.308748+0000","last_unstale":"2024-09-13T18:27:02.563309+0000","last_undegraded":"2024-09-13T18:27:02.563309+0000","last_fullsized":"2024-09-13T18:27:02.563309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:08.287280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562011+0000","last_change":"2024-09-13T18:27:01.299859+0000","last_active":"2024-09-13T18:27:02.562011+0000","last_peered":"2024-09-13T18:27:02.562011+0000","last_clean":"2024-09-13T18:27:02.562011+0000","last_became_active":"2024-09-13T18:27:01.299580+0000","last_became_peered":"2024-09-13T18:27:01.299580+0000","last_unstale":"2024-09-13T18:27:02.562011+0000","last_undegraded":"2024-09-13T18:27:02.562011+0000","last_fullsized":"2024-09-13T18:27:02.562011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562374+0000","last_change":"2024-09-13T18:27:01.299858+0000","last_active":"2024-09-13T18:27:02.562374+0000","last_peered":"2024-09-13T18:27:02.562374+0000","last_clean":"2024-09-13T18:27:02.562374+0000","last_became_active":"2024-09-13T18:27:01.299507+0000","last_became_peered":"2024-09-13T18:27:01.299507+0000","last_unstale":"2024-09-13T18:27:02.562374+0000","last_undegraded":"2024-09-13T18:27:02.562374+0000","last_fullsized":"2024-09-13T18:27:02.562374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:32.698886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562231+0000","last_change":"2024-09-13T18:27:01.308216+0000","last_active":"2024-09-13T18:27:02.562231+0000","last_peered":"2024-09-13T18:27:02.562231+0000","last_clean":"2024-09-13T18:27:02.562231+0000","last_became_active":"2024-09-13T18:27:01.307955+0000","last_became_peered":"2024-09-13T18:27:01.307955+0000","last_unstale":"2024-09-13T18:27:02.562231+0000","last_undegraded":"2024-09-13T18:27:02.562231+0000","last_fullsized":"2024-09-13T18:27:02.562231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:17.243480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289436+0000","last_change":"2024-09-13T18:27:01.299496+0000","last_active":"2024-09-13T18:27:02.289436+0000","last_peered":"2024-09-13T18:27:02.289436+0000","last_clean":"2024-09-13T18:27:02.289436+0000","last_became_active":"2024-09-13T18:27:01.299251+0000","last_became_peered":"2024-09-13T18:27:01.299251+0000","last_unstale":"2024-09-13T18:27:02.289436+0000","last_undegraded":"2024-09-13T18:27:02.289436+0000","last_fullsized":"2024-09-13T18:27:02.289436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562502+0000","last_change":"2024-09-13T18:27:01.305015+0000","last_active":"2024-09-13T18:27:02.562502+0000","last_peered":"2024-09-13T18:27:02.562502+0000","last_clean":"2024-09-13T18:27:02.562502+0000","last_became_active":"2024-09-13T18:27:01.304762+0000","last_became_peered":"2024-09-13T18:27:01.304762+0000","last_unstale":"2024-09-13T18:27:02.562502+0000","last_undegraded":"2024-09-13T18:27:02.562502+0000","last_fullsized":"2024-09-13T18:27:02.562502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:39.455167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287647+0000","last_change":"2024-09-13T18:27:01.304368+0000","last_active":"2024-09-13T18:27:02.287647+0000","last_peered":"2024-09-13T18:27:02.287647+0000","last_clean":"2024-09-13T18:27:02.287647+0000","last_became_active":"2024-09-13T18:27:01.304126+0000","last_became_peered":"2024-09-13T18:27:01.304126+0000","last_unstale":"2024-09-13T18:27:02.287647+0000","last_undegraded":"2024-09-13T18:27:02.287647+0000","last_fullsized":"2024-09-13T18:27:02.287647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:36.752876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286091+0000","last_change":"2024-09-13T18:27:01.305236+0000","last_active":"2024-09-13T18:27:02.286091+0000","last_peered":"2024-09-13T18:27:02.286091+0000","last_clean":"2024-09-13T18:27:02.286091+0000","last_became_active":"2024-09-13T18:27:01.302486+0000","last_became_peered":"2024-09-13T18:27:01.302486+0000","last_unstale":"2024-09-13T18:27:02.286091+0000","last_undegraded":"2024-09-13T18:27:02.286091+0000","last_fullsized":"2024-09-13T18:27:02.286091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:08.287280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288208+0000","last_change":"2024-09-13T18:27:01.301131+0000","last_active":"2024-09-13T18:27:02.288208+0000","last_peered":"2024-09-13T18:27:02.288208+0000","last_clean":"2024-09-13T18:27:02.288208+0000","last_became_active":"2024-09-13T18:27:01.300871+0000","last_became_peered":"2024-09-13T18:27:01.300871+0000","last_unstale":"2024-09-13T18:27:02.288208+0000","last_undegraded":"2024-09-13T18:27:02.288208+0000","last_fullsized":"2024-09-13T18:27:02.288208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:58.545057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562414+0000","last_change":"2024-09-13T18:27:01.299631+0000","last_active":"2024-09-13T18:27:02.562414+0000","last_peered":"2024-09-13T18:27:02.562414+0000","last_clean":"2024-09-13T18:27:02.562414+0000","last_became_active":"2024-09-13T18:27:01.299370+0000","last_became_peered":"2024-09-13T18:27:01.299370+0000","last_unstale":"2024-09-13T18:27:02.562414+0000","last_undegraded":"2024-09-13T18:27:02.562414+0000","last_fullsized":"2024-09-13T18:27:02.562414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:04.793190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563485+0000","last_change":"2024-09-13T18:27:01.309339+0000","last_active":"2024-09-13T18:27:02.563485+0000","last_peered":"2024-09-13T18:27:02.563485+0000","last_clean":"2024-09-13T18:27:02.563485+0000","last_became_active":"2024-09-13T18:27:01.308841+0000","last_became_peered":"2024-09-13T18:27:01.308841+0000","last_unstale":"2024-09-13T18:27:02.563485+0000","last_undegraded":"2024-09-13T18:27:02.563485+0000","last_fullsized":"2024-09-13T18:27:02.563485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:17.918955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561983+0000","last_change":"2024-09-13T18:27:01.308696+0000","last_active":"2024-09-13T18:27:02.561983+0000","last_peered":"2024-09-13T18:27:02.561983+0000","last_clean":"2024-09-13T18:27:02.561983+0000","last_became_active":"2024-09-13T18:27:01.308095+0000","last_became_peered":"2024-09-13T18:27:01.308095+0000","last_unstale":"2024-09-13T18:27:02.561983+0000","last_undegraded":"2024-09-13T18:27:02.561983+0000","last_fullsized":"2024-09-13T18:27:02.561983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562445+0000","last_change":"2024-09-13T18:27:01.310681+0000","last_active":"2024-09-13T18:27:02.562445+0000","last_peered":"2024-09-13T18:27:02.562445+0000","last_clean":"2024-09-13T18:27:02.562445+0000","last_became_active":"2024-09-13T18:27:01.310423+0000","last_became_peered":"2024-09-13T18:27:01.310423+0000","last_unstale":"2024-09-13T18:27:02.562445+0000","last_undegraded":"2024-09-13T18:27:02.562445+0000","last_fullsized":"2024-09-13T18:27:02.562445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286784+0000","last_change":"2024-09-13T18:27:01.303954+0000","last_active":"2024-09-13T18:27:02.286784+0000","last_peered":"2024-09-13T18:27:02.286784+0000","last_clean":"2024-09-13T18:27:02.286784+0000","last_became_active":"2024-09-13T18:27:01.303227+0000","last_became_peered":"2024-09-13T18:27:01.303227+0000","last_unstale":"2024-09-13T18:27:02.286784+0000","last_undegraded":"2024-09-13T18:27:02.286784+0000","last_fullsized":"2024-09-13T18:27:02.286784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288715+0000","last_change":"2024-09-13T18:27:01.296775+0000","last_active":"2024-09-13T18:27:02.288715+0000","last_peered":"2024-09-13T18:27:02.288715+0000","last_clean":"2024-09-13T18:27:02.288715+0000","last_became_active":"2024-09-13T18:27:01.296521+0000","last_became_peered":"2024-09-13T18:27:01.296521+0000","last_unstale":"2024-09-13T18:27:02.288715+0000","last_undegraded":"2024-09-13T18:27:02.288715+0000","last_fullsized":"2024-09-13T18:27:02.288715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:26.451272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286251+0000","last_change":"2024-09-13T18:27:01.302747+0000","last_active":"2024-09-13T18:27:02.286251+0000","last_peered":"2024-09-13T18:27:02.286251+0000","last_clean":"2024-09-13T18:27:02.286251+0000","last_became_active":"2024-09-13T18:27:01.302084+0000","last_became_peered":"2024-09-13T18:27:01.302084+0000","last_unstale":"2024-09-13T18:27:02.286251+0000","last_undegraded":"2024-09-13T18:27:02.286251+0000","last_fullsized":"2024-09-13T18:27:02.286251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:40.223464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289687+0000","last_change":"2024-09-13T18:27:01.296882+0000","last_active":"2024-09-13T18:27:02.289687+0000","last_peered":"2024-09-13T18:27:02.289687+0000","last_clean":"2024-09-13T18:27:02.289687+0000","last_became_active":"2024-09-13T18:27:01.296629+0000","last_became_peered":"2024-09-13T18:27:01.296629+0000","last_unstale":"2024-09-13T18:27:02.289687+0000","last_undegraded":"2024-09-13T18:27:02.289687+0000","last_fullsized":"2024-09-13T18:27:02.289687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:26.095535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562232+0000","last_change":"2024-09-13T18:27:01.301327+0000","last_active":"2024-09-13T18:27:02.562232+0000","last_peered":"2024-09-13T18:27:02.562232+0000","last_clean":"2024-09-13T18:27:02.562232+0000","last_became_active":"2024-09-13T18:27:01.301036+0000","last_became_peered":"2024-09-13T18:27:01.301036+0000","last_unstale":"2024-09-13T18:27:02.562232+0000","last_undegraded":"2024-09-13T18:27:02.562232+0000","last_fullsized":"2024-09-13T18:27:02.562232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:26.451272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288168+0000","last_change":"2024-09-13T18:27:01.303654+0000","last_active":"2024-09-13T18:27:02.288168+0000","last_peered":"2024-09-13T18:27:02.288168+0000","last_clean":"2024-09-13T18:27:02.288168+0000","last_became_active":"2024-09-13T18:27:01.303423+0000","last_became_peered":"2024-09-13T18:27:01.303423+0000","last_unstale":"2024-09-13T18:27:02.288168+0000","last_undegraded":"2024-09-13T18:27:02.288168+0000","last_fullsized":"2024-09-13T18:27:02.288168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:58.545057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289581+0000","last_change":"2024-09-13T18:27:01.306805+0000","last_active":"2024-09-13T18:27:02.289581+0000","last_peered":"2024-09-13T18:27:02.289581+0000","last_clean":"2024-09-13T18:27:02.289581+0000","last_became_active":"2024-09-13T18:27:01.306437+0000","last_became_peered":"2024-09-13T18:27:01.306437+0000","last_unstale":"2024-09-13T18:27:02.289581+0000","last_undegraded":"2024-09-13T18:27:02.289581+0000","last_fullsized":"2024-09-13T18:27:02.289581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:30.479538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562688+0000","last_change":"2024-09-13T18:27:01.304058+0000","last_active":"2024-09-13T18:27:02.562688+0000","last_peered":"2024-09-13T18:27:02.562688+0000","last_clean":"2024-09-13T18:27:02.562688+0000","last_became_active":"2024-09-13T18:27:01.303629+0000","last_became_peered":"2024-09-13T18:27:01.303629+0000","last_unstale":"2024-09-13T18:27:02.562688+0000","last_undegraded":"2024-09-13T18:27:02.562688+0000","last_fullsized":"2024-09-13T18:27:02.562688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:22.491328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287025+0000","last_change":"2024-09-13T18:27:01.304393+0000","last_active":"2024-09-13T18:27:02.287025+0000","last_peered":"2024-09-13T18:27:02.287025+0000","last_clean":"2024-09-13T18:27:02.287025+0000","last_became_active":"2024-09-13T18:27:01.304135+0000","last_became_peered":"2024-09-13T18:27:01.304135+0000","last_unstale":"2024-09-13T18:27:02.287025+0000","last_undegraded":"2024-09-13T18:27:02.287025+0000","last_fullsized":"2024-09-13T18:27:02.287025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:40.378467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562959+0000","last_change":"2024-09-13T18:27:01.302991+0000","last_active":"2024-09-13T18:27:02.562959+0000","last_peered":"2024-09-13T18:27:02.562959+0000","last_clean":"2024-09-13T18:27:02.562959+0000","last_became_active":"2024-09-13T18:27:01.302746+0000","last_became_peered":"2024-09-13T18:27:01.302746+0000","last_unstale":"2024-09-13T18:27:02.562959+0000","last_undegraded":"2024-09-13T18:27:02.562959+0000","last_fullsized":"2024-09-13T18:27:02.562959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:17.243480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.560846+0000","last_change":"2024-09-13T18:27:01.306888+0000","last_active":"2024-09-13T18:27:02.560846+0000","last_peered":"2024-09-13T18:27:02.560846+0000","last_clean":"2024-09-13T18:27:02.560846+0000","last_became_active":"2024-09-13T18:27:01.306593+0000","last_became_peered":"2024-09-13T18:27:01.306593+0000","last_unstale":"2024-09-13T18:27:02.560846+0000","last_undegraded":"2024-09-13T18:27:02.560846+0000","last_fullsized":"2024-09-13T18:27:02.560846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:26.095535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561343+0000","last_change":"2024-09-13T18:27:01.306267+0000","last_active":"2024-09-13T18:27:02.561343+0000","last_peered":"2024-09-13T18:27:02.561343+0000","last_clean":"2024-09-13T18:27:02.561343+0000","last_became_active":"2024-09-13T18:27:01.306016+0000","last_became_peered":"2024-09-13T18:27:01.306016+0000","last_unstale":"2024-09-13T18:27:02.561343+0000","last_undegraded":"2024-09-13T18:27:02.561343+0000","last_fullsized":"2024-09-13T18:27:02.561343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:59.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289534+0000","last_change":"2024-09-13T18:27:00.911539+0000","last_active":"2024-09-13T18:27:02.289534+0000","last_peered":"2024-09-13T18:27:02.289534+0000","last_clean":"2024-09-13T18:27:02.289534+0000","last_became_active":"2024-09-13T18:27:00.910841+0000","last_became_peered":"2024-09-13T18:27:00.910841+0000","last_unstale":"2024-09-13T18:27:02.289534+0000","last_undegraded":"2024-09-13T18:27:02.289534+0000","last_fullsized":"2024-09-13T18:27:02.289534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:53.385777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562937+0000","last_change":"2024-09-13T18:27:01.305382+0000","last_active":"2024-09-13T18:27:02.562937+0000","last_peered":"2024-09-13T18:27:02.562937+0000","last_clean":"2024-09-13T18:27:02.562937+0000","last_became_active":"2024-09-13T18:27:01.305139+0000","last_became_peered":"2024-09-13T18:27:01.305139+0000","last_unstale":"2024-09-13T18:27:02.562937+0000","last_undegraded":"2024-09-13T18:27:02.562937+0000","last_fullsized":"2024-09-13T18:27:02.562937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561575+0000","last_change":"2024-09-13T18:27:00.913328+0000","last_active":"2024-09-13T18:27:02.561575+0000","last_peered":"2024-09-13T18:27:02.561575+0000","last_clean":"2024-09-13T18:27:02.561575+0000","last_became_active":"2024-09-13T18:27:00.913086+0000","last_became_peered":"2024-09-13T18:27:00.913086+0000","last_unstale":"2024-09-13T18:27:02.561575+0000","last_undegraded":"2024-09-13T18:27:02.561575+0000","last_fullsized":"2024-09-13T18:27:02.561575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:53.385777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288807+0000","last_change":"2024-09-13T18:27:00.911854+0000","last_active":"2024-09-13T18:27:02.288807+0000","last_peered":"2024-09-13T18:27:02.288807+0000","last_clean":"2024-09-13T18:27:02.288807+0000","last_became_active":"2024-09-13T18:27:00.911591+0000","last_became_peered":"2024-09-13T18:27:00.911591+0000","last_unstale":"2024-09-13T18:27:02.288807+0000","last_undegraded":"2024-09-13T18:27:02.288807+0000","last_fullsized":"2024-09-13T18:27:02.288807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:06.968005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288348+0000","last_change":"2024-09-13T18:27:01.302897+0000","last_active":"2024-09-13T18:27:02.288348+0000","last_peered":"2024-09-13T18:27:02.288348+0000","last_clean":"2024-09-13T18:27:02.288348+0000","last_became_active":"2024-09-13T18:27:01.302678+0000","last_became_peered":"2024-09-13T18:27:01.302678+0000","last_unstale":"2024-09-13T18:27:02.288348+0000","last_undegraded":"2024-09-13T18:27:02.288348+0000","last_fullsized":"2024-09-13T18:27:02.288348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286340+0000","last_change":"2024-09-13T18:27:00.912605+0000","last_active":"2024-09-13T18:27:02.286340+0000","last_peered":"2024-09-13T18:27:02.286340+0000","last_clean":"2024-09-13T18:27:02.286340+0000","last_became_active":"2024-09-13T18:27:00.912293+0000","last_became_peered":"2024-09-13T18:27:00.912293+0000","last_unstale":"2024-09-13T18:27:02.286340+0000","last_undegraded":"2024-09-13T18:27:02.286340+0000","last_fullsized":"2024-09-13T18:27:02.286340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:15.665610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287553+0000","last_change":"2024-09-13T18:27:01.294866+0000","last_active":"2024-09-13T18:27:02.287553+0000","last_peered":"2024-09-13T18:27:02.287553+0000","last_clean":"2024-09-13T18:27:02.287553+0000","last_became_active":"2024-09-13T18:27:01.294614+0000","last_became_peered":"2024-09-13T18:27:01.294614+0000","last_unstale":"2024-09-13T18:27:02.287553+0000","last_undegraded":"2024-09-13T18:27:02.287553+0000","last_fullsized":"2024-09-13T18:27:02.287553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562622+0000","last_change":"2024-09-13T18:27:00.910126+0000","last_active":"2024-09-13T18:27:02.562622+0000","last_peered":"2024-09-13T18:27:02.562622+0000","last_clean":"2024-09-13T18:27:02.562622+0000","last_became_active":"2024-09-13T18:27:00.909845+0000","last_became_peered":"2024-09-13T18:27:00.909845+0000","last_unstale":"2024-09-13T18:27:02.562622+0000","last_undegraded":"2024-09-13T18:27:02.562622+0000","last_fullsized":"2024-09-13T18:27:02.562622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.933818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287706+0000","last_change":"2024-09-13T18:27:01.304023+0000","last_active":"2024-09-13T18:27:02.287706+0000","last_peered":"2024-09-13T18:27:02.287706+0000","last_clean":"2024-09-13T18:27:02.287706+0000","last_became_active":"2024-09-13T18:27:01.303683+0000","last_became_peered":"2024-09-13T18:27:01.303683+0000","last_unstale":"2024-09-13T18:27:02.287706+0000","last_undegraded":"2024-09-13T18:27:02.287706+0000","last_fullsized":"2024-09-13T18:27:02.287706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287684+0000","last_change":"2024-09-13T18:27:00.911226+0000","last_active":"2024-09-13T18:27:02.287684+0000","last_peered":"2024-09-13T18:27:02.287684+0000","last_clean":"2024-09-13T18:27:02.287684+0000","last_became_active":"2024-09-13T18:27:00.910878+0000","last_became_peered":"2024-09-13T18:27:00.910878+0000","last_unstale":"2024-09-13T18:27:02.287684+0000","last_undegraded":"2024-09-13T18:27:02.287684+0000","last_fullsized":"2024-09-13T18:27:02.287684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:58.428945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563113+0000","last_change":"2024-09-13T18:27:01.302430+0000","last_active":"2024-09-13T18:27:02.563113+0000","last_peered":"2024-09-13T18:27:02.563113+0000","last_clean":"2024-09-13T18:27:02.563113+0000","last_became_active":"2024-09-13T18:27:01.301355+0000","last_became_peered":"2024-09-13T18:27:01.301355+0000","last_unstale":"2024-09-13T18:27:02.563113+0000","last_undegraded":"2024-09-13T18:27:02.563113+0000","last_fullsized":"2024-09-13T18:27:02.563113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:26.095535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288349+0000","last_change":"2024-09-13T18:27:00.906914+0000","last_active":"2024-09-13T18:27:02.288349+0000","last_peered":"2024-09-13T18:27:02.288349+0000","last_clean":"2024-09-13T18:27:02.288349+0000","last_became_active":"2024-09-13T18:27:00.905751+0000","last_became_peered":"2024-09-13T18:27:00.905751+0000","last_unstale":"2024-09-13T18:27:02.288349+0000","last_undegraded":"2024-09-13T18:27:02.288349+0000","last_fullsized":"2024-09-13T18:27:02.288349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:13.103035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562471+0000","last_change":"2024-09-13T18:27:01.311919+0000","last_active":"2024-09-13T18:27:02.562471+0000","last_peered":"2024-09-13T18:27:02.562471+0000","last_clean":"2024-09-13T18:27:02.562471+0000","last_became_active":"2024-09-13T18:27:01.311087+0000","last_became_peered":"2024-09-13T18:27:01.311087+0000","last_unstale":"2024-09-13T18:27:02.562471+0000","last_undegraded":"2024-09-13T18:27:02.562471+0000","last_fullsized":"2024-09-13T18:27:02.562471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:14.113024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562110+0000","last_change":"2024-09-13T18:27:00.909802+0000","last_active":"2024-09-13T18:27:02.562110+0000","last_peered":"2024-09-13T18:27:02.562110+0000","last_clean":"2024-09-13T18:27:02.562110+0000","last_became_active":"2024-09-13T18:27:00.909547+0000","last_became_peered":"2024-09-13T18:27:00.909547+0000","last_unstale":"2024-09-13T18:27:02.562110+0000","last_undegraded":"2024-09-13T18:27:02.562110+0000","last_fullsized":"2024-09-13T18:27:02.562110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:13.103035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563137+0000","last_change":"2024-09-13T18:27:01.312609+0000","last_active":"2024-09-13T18:27:02.563137+0000","last_peered":"2024-09-13T18:27:02.563137+0000","last_clean":"2024-09-13T18:27:02.563137+0000","last_became_active":"2024-09-13T18:27:01.312314+0000","last_became_peered":"2024-09-13T18:27:01.312314+0000","last_unstale":"2024-09-13T18:27:02.563137+0000","last_undegraded":"2024-09-13T18:27:02.563137+0000","last_fullsized":"2024-09-13T18:27:02.563137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:38.650324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563169+0000","last_change":"2024-09-13T18:27:00.916915+0000","last_active":"2024-09-13T18:27:02.563169+0000","last_peered":"2024-09-13T18:27:02.563169+0000","last_clean":"2024-09-13T18:27:02.563169+0000","last_became_active":"2024-09-13T18:27:00.916632+0000","last_became_peered":"2024-09-13T18:27:00.916632+0000","last_unstale":"2024-09-13T18:27:02.563169+0000","last_undegraded":"2024-09-13T18:27:02.563169+0000","last_fullsized":"2024-09-13T18:27:02.563169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:50.705752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562755+0000","last_change":"2024-09-13T18:27:01.303166+0000","last_active":"2024-09-13T18:27:02.562755+0000","last_peered":"2024-09-13T18:27:02.562755+0000","last_clean":"2024-09-13T18:27:02.562755+0000","last_became_active":"2024-09-13T18:27:01.302924+0000","last_became_peered":"2024-09-13T18:27:01.302924+0000","last_unstale":"2024-09-13T18:27:02.562755+0000","last_undegraded":"2024-09-13T18:27:02.562755+0000","last_fullsized":"2024-09-13T18:27:02.562755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:04.793190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287214+0000","last_change":"2024-09-13T18:27:00.907398+0000","last_active":"2024-09-13T18:27:02.287214+0000","last_peered":"2024-09-13T18:27:02.287214+0000","last_clean":"2024-09-13T18:27:02.287214+0000","last_became_active":"2024-09-13T18:27:00.906944+0000","last_became_peered":"2024-09-13T18:27:00.906944+0000","last_unstale":"2024-09-13T18:27:02.287214+0000","last_undegraded":"2024-09-13T18:27:02.287214+0000","last_fullsized":"2024-09-13T18:27:02.287214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:06.968005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562208+0000","last_change":"2024-09-13T18:27:01.315035+0000","last_active":"2024-09-13T18:27:02.562208+0000","last_peered":"2024-09-13T18:27:02.562208+0000","last_clean":"2024-09-13T18:27:02.562208+0000","last_became_active":"2024-09-13T18:27:01.314681+0000","last_became_peered":"2024-09-13T18:27:01.314681+0000","last_unstale":"2024-09-13T18:27:02.562208+0000","last_undegraded":"2024-09-13T18:27:02.562208+0000","last_fullsized":"2024-09-13T18:27:02.562208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:36.178176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561303+0000","last_change":"2024-09-13T18:27:00.912840+0000","last_active":"2024-09-13T18:27:02.561303+0000","last_peered":"2024-09-13T18:27:02.561303+0000","last_clean":"2024-09-13T18:27:02.561303+0000","last_became_active":"2024-09-13T18:27:00.912602+0000","last_became_peered":"2024-09-13T18:27:00.912602+0000","last_unstale":"2024-09-13T18:27:02.561303+0000","last_undegraded":"2024-09-13T18:27:02.561303+0000","last_fullsized":"2024-09-13T18:27:02.561303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:15.665610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561087+0000","last_change":"2024-09-13T18:27:01.306616+0000","last_active":"2024-09-13T18:27:02.561087+0000","last_peered":"2024-09-13T18:27:02.561087+0000","last_clean":"2024-09-13T18:27:02.561087+0000","last_became_active":"2024-09-13T18:27:01.306284+0000","last_became_peered":"2024-09-13T18:27:01.306284+0000","last_unstale":"2024-09-13T18:27:02.561087+0000","last_undegraded":"2024-09-13T18:27:02.561087+0000","last_fullsized":"2024-09-13T18:27:02.561087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:30.479538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562519+0000","last_change":"2024-09-13T18:27:00.908275+0000","last_active":"2024-09-13T18:27:02.562519+0000","last_peered":"2024-09-13T18:27:02.562519+0000","last_clean":"2024-09-13T18:27:02.562519+0000","last_became_active":"2024-09-13T18:27:00.907829+0000","last_became_peered":"2024-09-13T18:27:00.907829+0000","last_unstale":"2024-09-13T18:27:02.562519+0000","last_undegraded":"2024-09-13T18:27:02.562519+0000","last_fullsized":"2024-09-13T18:27:02.562519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:25.457724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.560866+0000","last_change":"2024-09-13T18:27:01.314976+0000","last_active":"2024-09-13T18:27:02.560866+0000","last_peered":"2024-09-13T18:27:02.560866+0000","last_clean":"2024-09-13T18:27:02.560866+0000","last_became_active":"2024-09-13T18:27:01.314657+0000","last_became_peered":"2024-09-13T18:27:01.314657+0000","last_unstale":"2024-09-13T18:27:02.560866+0000","last_undegraded":"2024-09-13T18:27:02.560866+0000","last_fullsized":"2024-09-13T18:27:02.560866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562777+0000","last_change":"2024-09-13T18:27:00.912307+0000","last_active":"2024-09-13T18:27:02.562777+0000","last_peered":"2024-09-13T18:27:02.562777+0000","last_clean":"2024-09-13T18:27:02.562777+0000","last_became_active":"2024-09-13T18:27:00.911774+0000","last_became_peered":"2024-09-13T18:27:00.911774+0000","last_unstale":"2024-09-13T18:27:02.562777+0000","last_undegraded":"2024-09-13T18:27:02.562777+0000","last_fullsized":"2024-09-13T18:27:02.562777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:55.668790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563559+0000","last_change":"2024-09-13T18:27:01.315067+0000","last_active":"2024-09-13T18:27:02.563559+0000","last_peered":"2024-09-13T18:27:02.563559+0000","last_clean":"2024-09-13T18:27:02.563559+0000","last_became_active":"2024-09-13T18:27:01.314778+0000","last_became_peered":"2024-09-13T18:27:01.314778+0000","last_unstale":"2024-09-13T18:27:02.563559+0000","last_undegraded":"2024-09-13T18:27:02.563559+0000","last_fullsized":"2024-09-13T18:27:02.563559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562656+0000","last_change":"2024-09-13T18:27:00.911992+0000","last_active":"2024-09-13T18:27:02.562656+0000","last_peered":"2024-09-13T18:27:02.562656+0000","last_clean":"2024-09-13T18:27:02.562656+0000","last_became_active":"2024-09-13T18:27:00.911708+0000","last_became_peered":"2024-09-13T18:27:00.911708+0000","last_unstale":"2024-09-13T18:27:02.562656+0000","last_undegraded":"2024-09-13T18:27:02.562656+0000","last_fullsized":"2024-09-13T18:27:02.562656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:06.968005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563446+0000","last_change":"2024-09-13T18:27:01.314993+0000","last_active":"2024-09-13T18:27:02.563446+0000","last_peered":"2024-09-13T18:27:02.563446+0000","last_clean":"2024-09-13T18:27:02.563446+0000","last_became_active":"2024-09-13T18:27:01.314728+0000","last_became_peered":"2024-09-13T18:27:01.314728+0000","last_unstale":"2024-09-13T18:27:02.563446+0000","last_undegraded":"2024-09-13T18:27:02.563446+0000","last_fullsized":"2024-09-13T18:27:02.563446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:17.450610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288495+0000","last_change":"2024-09-13T18:27:00.904591+0000","last_active":"2024-09-13T18:27:02.288495+0000","last_peered":"2024-09-13T18:27:02.288495+0000","last_clean":"2024-09-13T18:27:02.288495+0000","last_became_active":"2024-09-13T18:27:00.904193+0000","last_became_peered":"2024-09-13T18:27:00.904193+0000","last_unstale":"2024-09-13T18:27:02.288495+0000","last_undegraded":"2024-09-13T18:27:02.288495+0000","last_fullsized":"2024-09-13T18:27:02.288495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.933818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287084+0000","last_change":"2024-09-13T18:27:01.303085+0000","last_active":"2024-09-13T18:27:02.287084+0000","last_peered":"2024-09-13T18:27:02.287084+0000","last_clean":"2024-09-13T18:27:02.287084+0000","last_became_active":"2024-09-13T18:27:01.302208+0000","last_became_peered":"2024-09-13T18:27:01.302208+0000","last_unstale":"2024-09-13T18:27:02.287084+0000","last_undegraded":"2024-09-13T18:27:02.287084+0000","last_fullsized":"2024-09-13T18:27:02.287084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:36.178176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563635+0000","last_change":"2024-09-13T18:27:00.913872+0000","last_active":"2024-09-13T18:27:02.563635+0000","last_peered":"2024-09-13T18:27:02.563635+0000","last_clean":"2024-09-13T18:27:02.563635+0000","last_became_active":"2024-09-13T18:27:00.913253+0000","last_became_peered":"2024-09-13T18:27:00.913253+0000","last_unstale":"2024-09-13T18:27:02.563635+0000","last_undegraded":"2024-09-13T18:27:02.563635+0000","last_fullsized":"2024-09-13T18:27:02.563635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:15.665610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563701+0000","last_change":"2024-09-13T18:27:01.309496+0000","last_active":"2024-09-13T18:27:02.563701+0000","last_peered":"2024-09-13T18:27:02.563701+0000","last_clean":"2024-09-13T18:27:02.563701+0000","last_became_active":"2024-09-13T18:27:01.309222+0000","last_became_peered":"2024-09-13T18:27:01.309222+0000","last_unstale":"2024-09-13T18:27:02.563701+0000","last_undegraded":"2024-09-13T18:27:02.563701+0000","last_fullsized":"2024-09-13T18:27:02.563701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:01.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:27:01.294854+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:27:01.294854+0000","last_peered":"2024-09-13T18:27:01.294854+0000","last_clean":"2024-09-13T18:27:01.294854+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:27:01.294854+0000","last_undegraded":"2024-09-13T18:27:01.294854+0000","last_fullsized":"2024-09-13T18:27:01.294854+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286187+0000","last_change":"2024-09-13T18:27:00.908757+0000","last_active":"2024-09-13T18:27:02.286187+0000","last_peered":"2024-09-13T18:27:02.286187+0000","last_clean":"2024-09-13T18:27:02.286187+0000","last_became_active":"2024-09-13T18:27:00.908473+0000","last_became_peered":"2024-09-13T18:27:00.908473+0000","last_unstale":"2024-09-13T18:27:02.286187+0000","last_undegraded":"2024-09-13T18:27:02.286187+0000","last_fullsized":"2024-09-13T18:27:02.286187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:13.103035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289057+0000","last_change":"2024-09-13T18:27:01.301499+0000","last_active":"2024-09-13T18:27:02.289057+0000","last_peered":"2024-09-13T18:27:02.289057+0000","last_clean":"2024-09-13T18:27:02.289057+0000","last_became_active":"2024-09-13T18:27:01.301225+0000","last_became_peered":"2024-09-13T18:27:01.301225+0000","last_unstale":"2024-09-13T18:27:02.289057+0000","last_undegraded":"2024-09-13T18:27:02.289057+0000","last_fullsized":"2024-09-13T18:27:02.289057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:17.918955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.560941+0000","last_change":"2024-09-13T18:27:00.913941+0000","last_active":"2024-09-13T18:27:02.560941+0000","last_peered":"2024-09-13T18:27:02.560941+0000","last_clean":"2024-09-13T18:27:02.560941+0000","last_became_active":"2024-09-13T18:27:00.913635+0000","last_became_peered":"2024-09-13T18:27:00.913635+0000","last_unstale":"2024-09-13T18:27:02.560941+0000","last_undegraded":"2024-09-13T18:27:02.560941+0000","last_fullsized":"2024-09-13T18:27:02.560941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:16.233492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562003+0000","last_change":"2024-09-13T18:27:01.305523+0000","last_active":"2024-09-13T18:27:02.562003+0000","last_peered":"2024-09-13T18:27:02.562003+0000","last_clean":"2024-09-13T18:27:02.562003+0000","last_became_active":"2024-09-13T18:27:01.305262+0000","last_became_peered":"2024-09-13T18:27:01.305262+0000","last_unstale":"2024-09-13T18:27:02.562003+0000","last_undegraded":"2024-09-13T18:27:02.562003+0000","last_fullsized":"2024-09-13T18:27:02.562003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:58.545057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563149+0000","last_change":"2024-09-13T18:27:00.908133+0000","last_active":"2024-09-13T18:27:02.563149+0000","last_peered":"2024-09-13T18:27:02.563149+0000","last_clean":"2024-09-13T18:27:02.563149+0000","last_became_active":"2024-09-13T18:27:00.907408+0000","last_became_peered":"2024-09-13T18:27:00.907408+0000","last_unstale":"2024-09-13T18:27:02.563149+0000","last_undegraded":"2024-09-13T18:27:02.563149+0000","last_fullsized":"2024-09-13T18:27:02.563149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:53.385777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287467+0000","last_change":"2024-09-13T18:27:01.302404+0000","last_active":"2024-09-13T18:27:02.287467+0000","last_peered":"2024-09-13T18:27:02.287467+0000","last_clean":"2024-09-13T18:27:02.287467+0000","last_became_active":"2024-09-13T18:27:01.302118+0000","last_became_peered":"2024-09-13T18:27:01.302118+0000","last_unstale":"2024-09-13T18:27:02.287467+0000","last_undegraded":"2024-09-13T18:27:02.287467+0000","last_fullsized":"2024-09-13T18:27:02.287467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:26.095535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287402+0000","last_change":"2024-09-13T18:27:00.904991+0000","last_active":"2024-09-13T18:27:02.287402+0000","last_peered":"2024-09-13T18:27:02.287402+0000","last_clean":"2024-09-13T18:27:02.287402+0000","last_became_active":"2024-09-13T18:27:00.903940+0000","last_became_peered":"2024-09-13T18:27:00.903940+0000","last_unstale":"2024-09-13T18:27:02.287402+0000","last_undegraded":"2024-09-13T18:27:02.287402+0000","last_fullsized":"2024-09-13T18:27:02.287402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:53.385777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561995+0000","last_change":"2024-09-13T18:27:01.303896+0000","last_active":"2024-09-13T18:27:02.561995+0000","last_peered":"2024-09-13T18:27:02.561995+0000","last_clean":"2024-09-13T18:27:02.561995+0000","last_became_active":"2024-09-13T18:27:01.303570+0000","last_became_peered":"2024-09-13T18:27:01.303570+0000","last_unstale":"2024-09-13T18:27:02.561995+0000","last_undegraded":"2024-09-13T18:27:02.561995+0000","last_fullsized":"2024-09-13T18:27:02.561995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:47.943806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288178+0000","last_change":"2024-09-13T18:27:00.911270+0000","last_active":"2024-09-13T18:27:02.288178+0000","last_peered":"2024-09-13T18:27:02.288178+0000","last_clean":"2024-09-13T18:27:02.288178+0000","last_became_active":"2024-09-13T18:27:00.910972+0000","last_became_peered":"2024-09-13T18:27:00.910972+0000","last_unstale":"2024-09-13T18:27:02.288178+0000","last_undegraded":"2024-09-13T18:27:02.288178+0000","last_fullsized":"2024-09-13T18:27:02.288178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:47.877280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286988+0000","last_change":"2024-09-13T18:27:01.301470+0000","last_active":"2024-09-13T18:27:02.286988+0000","last_peered":"2024-09-13T18:27:02.286988+0000","last_clean":"2024-09-13T18:27:02.286988+0000","last_became_active":"2024-09-13T18:27:01.301207+0000","last_became_peered":"2024-09-13T18:27:01.301207+0000","last_unstale":"2024-09-13T18:27:02.286988+0000","last_undegraded":"2024-09-13T18:27:02.286988+0000","last_fullsized":"2024-09-13T18:27:02.286988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:17.918955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563596+0000","last_change":"2024-09-13T18:27:00.912131+0000","last_active":"2024-09-13T18:27:02.563596+0000","last_peered":"2024-09-13T18:27:02.563596+0000","last_clean":"2024-09-13T18:27:02.563596+0000","last_became_active":"2024-09-13T18:27:00.911544+0000","last_became_peered":"2024-09-13T18:27:00.911544+0000","last_unstale":"2024-09-13T18:27:02.563596+0000","last_undegraded":"2024-09-13T18:27:02.563596+0000","last_fullsized":"2024-09-13T18:27:02.563596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:13.103035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287996+0000","last_change":"2024-09-13T18:27:01.300408+0000","last_active":"2024-09-13T18:27:02.287996+0000","last_peered":"2024-09-13T18:27:02.287996+0000","last_clean":"2024-09-13T18:27:02.287996+0000","last_became_active":"2024-09-13T18:27:01.300091+0000","last_became_peered":"2024-09-13T18:27:01.300091+0000","last_unstale":"2024-09-13T18:27:02.287996+0000","last_undegraded":"2024-09-13T18:27:02.287996+0000","last_fullsized":"2024-09-13T18:27:02.287996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:26.451272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:04.334281+0000","last_change":"2024-09-13T18:27:00.912212+0000","last_active":"2024-09-13T18:27:04.334281+0000","last_peered":"2024-09-13T18:27:04.334281+0000","last_clean":"2024-09-13T18:27:04.334281+0000","last_became_active":"2024-09-13T18:27:00.911910+0000","last_became_peered":"2024-09-13T18:27:00.911910+0000","last_unstale":"2024-09-13T18:27:04.334281+0000","last_undegraded":"2024-09-13T18:27:04.334281+0000","last_fullsized":"2024-09-13T18:27:04.334281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:16.233492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289875+0000","last_change":"2024-09-13T18:27:01.312352+0000","last_active":"2024-09-13T18:27:02.289875+0000","last_peered":"2024-09-13T18:27:02.289875+0000","last_clean":"2024-09-13T18:27:02.289875+0000","last_became_active":"2024-09-13T18:27:01.311778+0000","last_became_peered":"2024-09-13T18:27:01.311778+0000","last_unstale":"2024-09-13T18:27:02.289875+0000","last_undegraded":"2024-09-13T18:27:02.289875+0000","last_fullsized":"2024-09-13T18:27:02.289875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:40.378467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562667+0000","last_change":"2024-09-13T18:27:00.911809+0000","last_active":"2024-09-13T18:27:02.562667+0000","last_peered":"2024-09-13T18:27:02.562667+0000","last_clean":"2024-09-13T18:27:02.562667+0000","last_became_active":"2024-09-13T18:27:00.911539+0000","last_became_peered":"2024-09-13T18:27:00.911539+0000","last_unstale":"2024-09-13T18:27:02.562667+0000","last_undegraded":"2024-09-13T18:27:02.562667+0000","last_fullsized":"2024-09-13T18:27:02.562667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:58.428945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563157+0000","last_change":"2024-09-13T18:27:01.307882+0000","last_active":"2024-09-13T18:27:02.563157+0000","last_peered":"2024-09-13T18:27:02.563157+0000","last_clean":"2024-09-13T18:27:02.563157+0000","last_became_active":"2024-09-13T18:27:01.307639+0000","last_became_peered":"2024-09-13T18:27:01.307639+0000","last_unstale":"2024-09-13T18:27:02.563157+0000","last_undegraded":"2024-09-13T18:27:02.563157+0000","last_fullsized":"2024-09-13T18:27:02.563157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:30.479538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.560713+0000","last_change":"2024-09-13T18:27:00.912694+0000","last_active":"2024-09-13T18:27:02.560713+0000","last_peered":"2024-09-13T18:27:02.560713+0000","last_clean":"2024-09-13T18:27:02.560713+0000","last_became_active":"2024-09-13T18:27:00.912437+0000","last_became_peered":"2024-09-13T18:27:00.912437+0000","last_unstale":"2024-09-13T18:27:02.560713+0000","last_undegraded":"2024-09-13T18:27:02.560713+0000","last_fullsized":"2024-09-13T18:27:02.560713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:03.783202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561673+0000","last_change":"2024-09-13T18:27:01.298321+0000","last_active":"2024-09-13T18:27:02.561673+0000","last_peered":"2024-09-13T18:27:02.561673+0000","last_clean":"2024-09-13T18:27:02.561673+0000","last_became_active":"2024-09-13T18:27:01.298027+0000","last_became_peered":"2024-09-13T18:27:01.298027+0000","last_unstale":"2024-09-13T18:27:02.561673+0000","last_undegraded":"2024-09-13T18:27:02.561673+0000","last_fullsized":"2024-09-13T18:27:02.561673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:04.793190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287769+0000","last_change":"2024-09-13T18:27:00.910495+0000","last_active":"2024-09-13T18:27:02.287769+0000","last_peered":"2024-09-13T18:27:02.287769+0000","last_clean":"2024-09-13T18:27:02.287769+0000","last_became_active":"2024-09-13T18:27:00.910212+0000","last_became_peered":"2024-09-13T18:27:00.910212+0000","last_unstale":"2024-09-13T18:27:02.287769+0000","last_undegraded":"2024-09-13T18:27:02.287769+0000","last_fullsized":"2024-09-13T18:27:02.287769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:03.783202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288669+0000","last_change":"2024-09-13T18:27:01.292715+0000","last_active":"2024-09-13T18:27:02.288669+0000","last_peered":"2024-09-13T18:27:02.288669+0000","last_clean":"2024-09-13T18:27:02.288669+0000","last_became_active":"2024-09-13T18:27:01.292437+0000","last_became_peered":"2024-09-13T18:27:01.292437+0000","last_unstale":"2024-09-13T18:27:02.288669+0000","last_undegraded":"2024-09-13T18:27:02.288669+0000","last_fullsized":"2024-09-13T18:27:02.288669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:58.545057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288228+0000","last_change":"2024-09-13T18:27:00.907866+0000","last_active":"2024-09-13T18:27:02.288228+0000","last_peered":"2024-09-13T18:27:02.288228+0000","last_clean":"2024-09-13T18:27:02.288228+0000","last_became_active":"2024-09-13T18:27:00.907562+0000","last_became_peered":"2024-09-13T18:27:00.907562+0000","last_unstale":"2024-09-13T18:27:02.288228+0000","last_undegraded":"2024-09-13T18:27:02.288228+0000","last_fullsized":"2024-09-13T18:27:02.288228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:58.428945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289387+0000","last_change":"2024-09-13T18:27:01.302235+0000","last_active":"2024-09-13T18:27:02.289387+0000","last_peered":"2024-09-13T18:27:02.289387+0000","last_clean":"2024-09-13T18:27:02.289387+0000","last_became_active":"2024-09-13T18:27:01.301993+0000","last_became_peered":"2024-09-13T18:27:01.301993+0000","last_unstale":"2024-09-13T18:27:02.289387+0000","last_undegraded":"2024-09-13T18:27:02.289387+0000","last_fullsized":"2024-09-13T18:27:02.289387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:36.752876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562564+0000","last_change":"2024-09-13T18:27:00.917608+0000","last_active":"2024-09-13T18:27:02.562564+0000","last_peered":"2024-09-13T18:27:02.562564+0000","last_clean":"2024-09-13T18:27:02.562564+0000","last_became_active":"2024-09-13T18:27:00.917334+0000","last_became_peered":"2024-09-13T18:27:00.917334+0000","last_unstale":"2024-09-13T18:27:02.562564+0000","last_undegraded":"2024-09-13T18:27:02.562564+0000","last_fullsized":"2024-09-13T18:27:02.562564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:53.385777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561361+0000","last_change":"2024-09-13T18:27:01.303769+0000","last_active":"2024-09-13T18:27:02.561361+0000","last_peered":"2024-09-13T18:27:02.561361+0000","last_clean":"2024-09-13T18:27:02.561361+0000","last_became_active":"2024-09-13T18:27:01.303409+0000","last_became_peered":"2024-09-13T18:27:01.303409+0000","last_unstale":"2024-09-13T18:27:02.561361+0000","last_undegraded":"2024-09-13T18:27:02.561361+0000","last_fullsized":"2024-09-13T18:27:02.561361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:58.545057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286775+0000","last_change":"2024-09-13T18:27:01.298238+0000","last_active":"2024-09-13T18:27:02.286775+0000","last_peered":"2024-09-13T18:27:02.286775+0000","last_clean":"2024-09-13T18:27:02.286775+0000","last_became_active":"2024-09-13T18:27:01.297937+0000","last_became_peered":"2024-09-13T18:27:01.297937+0000","last_unstale":"2024-09-13T18:27:02.286775+0000","last_undegraded":"2024-09-13T18:27:02.286775+0000","last_fullsized":"2024-09-13T18:27:02.286775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:36.752876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563094+0000","last_change":"2024-09-13T18:27:00.914839+0000","last_active":"2024-09-13T18:27:02.563094+0000","last_peered":"2024-09-13T18:27:02.563094+0000","last_clean":"2024-09-13T18:27:02.563094+0000","last_became_active":"2024-09-13T18:27:00.914550+0000","last_became_peered":"2024-09-13T18:27:00.914550+0000","last_unstale":"2024-09-13T18:27:02.563094+0000","last_undegraded":"2024-09-13T18:27:02.563094+0000","last_fullsized":"2024-09-13T18:27:02.563094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.933818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286874+0000","last_change":"2024-09-13T18:27:01.302873+0000","last_active":"2024-09-13T18:27:02.286874+0000","last_peered":"2024-09-13T18:27:02.286874+0000","last_clean":"2024-09-13T18:27:02.286874+0000","last_became_active":"2024-09-13T18:27:01.301780+0000","last_became_peered":"2024-09-13T18:27:01.301780+0000","last_unstale":"2024-09-13T18:27:02.286874+0000","last_undegraded":"2024-09-13T18:27:02.286874+0000","last_fullsized":"2024-09-13T18:27:02.286874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:17.450610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563342+0000","last_change":"2024-09-13T18:27:00.912304+0000","last_active":"2024-09-13T18:27:02.563342+0000","last_peered":"2024-09-13T18:27:02.563342+0000","last_clean":"2024-09-13T18:27:02.563342+0000","last_became_active":"2024-09-13T18:27:00.911868+0000","last_became_peered":"2024-09-13T18:27:00.911868+0000","last_unstale":"2024-09-13T18:27:02.563342+0000","last_undegraded":"2024-09-13T18:27:02.563342+0000","last_fullsized":"2024-09-13T18:27:02.563342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:58.428945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562947+0000","last_change":"2024-09-13T18:27:01.302701+0000","last_active":"2024-09-13T18:27:02.562947+0000","last_peered":"2024-09-13T18:27:02.562947+0000","last_clean":"2024-09-13T18:27:02.562947+0000","last_became_active":"2024-09-13T18:27:01.301626+0000","last_became_peered":"2024-09-13T18:27:01.301626+0000","last_unstale":"2024-09-13T18:27:02.562947+0000","last_undegraded":"2024-09-13T18:27:02.562947+0000","last_fullsized":"2024-09-13T18:27:02.562947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:26.451272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289813+0000","last_change":"2024-09-13T18:27:00.913872+0000","last_active":"2024-09-13T18:27:02.289813+0000","last_peered":"2024-09-13T18:27:02.289813+0000","last_clean":"2024-09-13T18:27:02.289813+0000","last_became_active":"2024-09-13T18:27:00.913585+0000","last_became_peered":"2024-09-13T18:27:00.913585+0000","last_unstale":"2024-09-13T18:27:02.289813+0000","last_undegraded":"2024-09-13T18:27:02.289813+0000","last_fullsized":"2024-09-13T18:27:02.289813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:15.665610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289768+0000","last_change":"2024-09-13T18:27:01.301513+0000","last_active":"2024-09-13T18:27:02.289768+0000","last_peered":"2024-09-13T18:27:02.289768+0000","last_clean":"2024-09-13T18:27:02.289768+0000","last_became_active":"2024-09-13T18:27:01.301080+0000","last_became_peered":"2024-09-13T18:27:01.301080+0000","last_unstale":"2024-09-13T18:27:02.289768+0000","last_undegraded":"2024-09-13T18:27:02.289768+0000","last_fullsized":"2024-09-13T18:27:02.289768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:07.409290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563285+0000","last_change":"2024-09-13T18:27:00.913198+0000","last_active":"2024-09-13T18:27:02.563285+0000","last_peered":"2024-09-13T18:27:02.563285+0000","last_clean":"2024-09-13T18:27:02.563285+0000","last_became_active":"2024-09-13T18:27:00.912840+0000","last_became_peered":"2024-09-13T18:27:00.912840+0000","last_unstale":"2024-09-13T18:27:02.563285+0000","last_undegraded":"2024-09-13T18:27:02.563285+0000","last_fullsized":"2024-09-13T18:27:02.563285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:25.457724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4450000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6679999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":823296,"data_stored":666575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:27:13.975 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:27:14.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.079+0000 7f52d759e700 1 Processor -- start 2024-09-13T18:27:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.079+0000 7f52d759e700 1 -- start start 2024-09-13T18:27:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d759e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52d8159720 0x7f52d806cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d759e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f52d80b3ae0 0x7f52d80ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d759e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d806aed0 con 0x7f52d806aa90 2024-09-13T18:27:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d759e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d806d690 con 0x7f52d80b3ae0 2024-09-13T18:27:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d759e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80cbfe0 con 0x7f52d8159720 2024-09-13T18:27:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d6d9d700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f52d80b3ae0 0x7f52d80ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:14.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d659c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52d8159720 0x7f52d806cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:14.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d5d9b700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f52d806aa90 0x7f52d80b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:36096/0 (socket says 172.21.15.44:36096) 2024-09-13T18:27:14.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d5d9b700 1 -- 172.21.15.44:0/319050197 learned_addr learned my addr 172.21.15.44:0/319050197 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:14.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d6d9d700 1 -- 172.21.15.44:0/319050197 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52d8159720 msgr2=0x7f52d806cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:14.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d6d9d700 1 --2- 172.21.15.44:0/319050197 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52d8159720 0x7f52d806cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d6d9d700 1 -- 172.21.15.44:0/319050197 >> v1:172.21.15.99:6789/0 conn(0x7f52d806aa90 legacy=0x7f52d80b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:14.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d6d9d700 1 -- 172.21.15.44:0/319050197 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d80cc2c0 con 0x7f52d80b3ae0 2024-09-13T18:27:14.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d6d9d700 1 --2- 172.21.15.44:0/319050197 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52d80b3ae0 0x7f52d80ccac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f52d0009d90 tx=0x7f52d000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45d0ae98f7ac1170 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:14.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d559a700 1 -- 172.21.15.44:0/319050197 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d000e070 con 0x7f52d80b3ae0 2024-09-13T18:27:14.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d559a700 1 -- 172.21.15.44:0/319050197 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d000bb20 con 0x7f52d80b3ae0 2024-09-13T18:27:14.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d559a700 1 -- 172.21.15.44:0/319050197 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d0012430 con 0x7f52d80b3ae0 2024-09-13T18:27:14.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d759e700 1 -- 172.21.15.44:0/319050197 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52d80b3ae0 msgr2=0x7f52d80ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:14.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d759e700 1 --2- 172.21.15.44:0/319050197 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52d80b3ae0 0x7f52d80ccac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f52d0009d90 tx=0x7f52d000b330 comp rx=0 tx=0).stop 2024-09-13T18:27:14.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d759e700 1 -- 172.21.15.44:0/319050197 shutdown_connections 2024-09-13T18:27:14.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d759e700 1 --2- 172.21.15.44:0/319050197 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52d80b3ae0 0x7f52d80ccac0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d759e700 1 --2- 172.21.15.44:0/319050197 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52d8159720 0x7f52d806cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d759e700 1 -- 172.21.15.44:0/319050197 >> 172.21.15.44:0/319050197 conn(0x7f52d80b0f00 msgr2=0x7f52d80b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:14.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d759e700 1 -- 172.21.15.44:0/319050197 shutdown_connections 2024-09-13T18:27:14.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.083+0000 7f52d759e700 1 -- 172.21.15.44:0/319050197 wait complete. 2024-09-13T18:27:14.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.087+0000 7f52d759e700 1 Processor -- start 2024-09-13T18:27:14.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.087+0000 7f52d759e700 1 -- start start 2024-09-13T18:27:14.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.087+0000 7f52d759e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52d806aa90 0x7f52d81461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.087+0000 7f52d759e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52d80b3ae0 0x7f52d81550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.087+0000 7f52d759e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52d8159720 0x7f52d80ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.087+0000 7f52d759e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d8152a30 con 0x7f52d806aa90 2024-09-13T18:27:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.087+0000 7f52d759e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d8152ec0 con 0x7f52d8159720 2024-09-13T18:27:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.087+0000 7f52d759e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d8152420 con 0x7f52d80b3ae0 2024-09-13T18:27:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.087+0000 7f52d659c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52d806aa90 0x7f52d81461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.087+0000 7f52d659c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52d806aa90 0x7f52d81461d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41632/0 (socket says 172.21.15.44:41632) 2024-09-13T18:27:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.087+0000 7f52d659c700 1 -- 172.21.15.44:0/739852359 learned_addr learned my addr 172.21.15.44:0/739852359 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.087+0000 7f52d6d9d700 1 --2- 172.21.15.44:0/739852359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52d8159720 0x7f52d80ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.087+0000 7f52d5d9b700 1 --2- 172.21.15.44:0/739852359 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52d80b3ae0 0x7f52d81550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:14.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.087+0000 7f52d659c700 1 -- 172.21.15.44:0/739852359 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52d80b3ae0 msgr2=0x7f52d81550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:14.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.087+0000 7f52d659c700 1 --2- 172.21.15.44:0/739852359 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52d80b3ae0 0x7f52d81550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.087+0000 7f52d659c700 1 -- 172.21.15.44:0/739852359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52d8159720 msgr2=0x7f52d80ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:14.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.087+0000 7f52d659c700 1 --2- 172.21.15.44:0/739852359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52d8159720 0x7f52d80ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.087+0000 7f52d659c700 1 -- 172.21.15.44:0/739852359 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d0009a70 con 0x7f52d806aa90 2024-09-13T18:27:14.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.091+0000 7f52d659c700 1 --2- 172.21.15.44:0/739852359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52d806aa90 0x7f52d81461d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f52c800e870 tx=0x7f52c800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:14.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.091+0000 7f52c6ffd700 1 -- 172.21.15.44:0/739852359 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c80095a0 con 0x7f52d806aa90 2024-09-13T18:27:14.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.091+0000 7f52c6ffd700 1 -- 172.21.15.44:0/739852359 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c8013680 con 0x7f52d806aa90 2024-09-13T18:27:14.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.091+0000 7f52d759e700 1 -- 172.21.15.44:0/739852359 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d8155600 con 0x7f52d806aa90 2024-09-13T18:27:14.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.091+0000 7f52c6ffd700 1 -- 172.21.15.44:0/739852359 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c80139f0 con 0x7f52d806aa90 2024-09-13T18:27:14.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.091+0000 7f52d759e700 1 -- 172.21.15.44:0/739852359 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d80affd0 con 0x7f52d806aa90 2024-09-13T18:27:14.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.091+0000 7f52d759e700 1 -- 172.21.15.44:0/739852359 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d80ccac0 con 0x7f52d806aa90 2024-09-13T18:27:14.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.091+0000 7f52c6ffd700 1 -- 172.21.15.44:0/739852359 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f52c8013b50 con 0x7f52d806aa90 2024-09-13T18:27:14.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.091+0000 7f52c6ffd700 1 --2- 172.21.15.44:0/739852359 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f52b8066730 0x7f52b8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:14.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.091+0000 7f52c6ffd700 1 -- 172.21.15.44:0/739852359 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52c8083fe0 con 0x7f52d806aa90 2024-09-13T18:27:14.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.095+0000 7f52d5d9b700 1 --2- 172.21.15.44:0/739852359 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f52b8066730 0x7f52b8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:14.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.095+0000 7f52d5d9b700 1 --2- 172.21.15.44:0/739852359 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f52b8066730 0x7f52b8068bf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f52d80b04f0 tx=0x7f52cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:14.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.103+0000 7f52c6ffd700 1 -- 172.21.15.44:0/739852359 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f52c80512b0 con 0x7f52d806aa90 2024-09-13T18:27:14.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.263+0000 7f52d759e700 1 -- 172.21.15.44:0/739852359 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f52d8070220 con 0x7f52b8066730 2024-09-13T18:27:14.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.283+0000 7f52c6ffd700 1 -- 172.21.15.44:0/739852359 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264534 (secure 0 0 0) 0x7f52d8070220 con 0x7f52b8066730 2024-09-13T18:27:14.289 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:14.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.287+0000 7f52d759e700 1 -- 172.21.15.44:0/739852359 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f52b8066730 msgr2=0x7f52b8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:14.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.287+0000 7f52d759e700 1 --2- 172.21.15.44:0/739852359 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f52b8066730 0x7f52b8068bf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f52d80b04f0 tx=0x7f52cc009040 comp rx=0 tx=0).stop 2024-09-13T18:27:14.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.287+0000 7f52d759e700 1 -- 172.21.15.44:0/739852359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52d806aa90 msgr2=0x7f52d81461d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:14.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.287+0000 7f52d759e700 1 --2- 172.21.15.44:0/739852359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52d806aa90 0x7f52d81461d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f52c800e870 tx=0x7f52c800eb80 comp rx=0 tx=0).stop 2024-09-13T18:27:14.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.287+0000 7f52d759e700 1 -- 172.21.15.44:0/739852359 shutdown_connections 2024-09-13T18:27:14.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.287+0000 7f52d759e700 1 --2- 172.21.15.44:0/739852359 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f52b8066730 0x7f52b8068bf0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.287+0000 7f52d759e700 1 --2- 172.21.15.44:0/739852359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52d8159720 0x7f52d80ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.287+0000 7f52d759e700 1 --2- 172.21.15.44:0/739852359 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52d80b3ae0 0x7f52d81550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.287+0000 7f52d759e700 1 --2- 172.21.15.44:0/739852359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52d806aa90 0x7f52d81461d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.287+0000 7f52d759e700 1 -- 172.21.15.44:0/739852359 >> 172.21.15.44:0/739852359 conn(0x7f52d80b0f00 msgr2=0x7f52d81588f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:14.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.287+0000 7f52d759e700 1 -- 172.21.15.44:0/739852359 shutdown_connections 2024-09-13T18:27:14.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.287+0000 7f52d759e700 1 -- 172.21.15.44:0/739852359 wait complete. 2024-09-13T18:27:14.293 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:27:14.305 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-13T18:27:12.320118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219096,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755624,"statfs":{"total":773094113280,"available":772869758976,"internally_reserved":0,"allocated":2990080,"data_stored":1790012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.037075"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563137+0000","last_change":"2024-09-13T18:27:01.305887+0000","last_active":"2024-09-13T18:27:02.563137+0000","last_peered":"2024-09-13T18:27:02.563137+0000","last_clean":"2024-09-13T18:27:02.563137+0000","last_became_active":"2024-09-13T18:27:01.305625+0000","last_became_peered":"2024-09-13T18:27:01.305625+0000","last_unstale":"2024-09-13T18:27:02.563137+0000","last_undegraded":"2024-09-13T18:27:02.563137+0000","last_fullsized":"2024-09-13T18:27:02.563137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:07.409290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288134+0000","last_change":"2024-09-13T18:27:01.304009+0000","last_active":"2024-09-13T18:27:02.288134+0000","last_peered":"2024-09-13T18:27:02.288134+0000","last_clean":"2024-09-13T18:27:02.288134+0000","last_became_active":"2024-09-13T18:27:01.303652+0000","last_became_peered":"2024-09-13T18:27:01.303652+0000","last_unstale":"2024-09-13T18:27:02.288134+0000","last_undegraded":"2024-09-13T18:27:02.288134+0000","last_fullsized":"2024-09-13T18:27:02.288134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562791+0000","last_change":"2024-09-13T18:27:01.306439+0000","last_active":"2024-09-13T18:27:02.562791+0000","last_peered":"2024-09-13T18:27:02.562791+0000","last_clean":"2024-09-13T18:27:02.562791+0000","last_became_active":"2024-09-13T18:27:01.306181+0000","last_became_peered":"2024-09-13T18:27:01.306181+0000","last_unstale":"2024-09-13T18:27:02.562791+0000","last_undegraded":"2024-09-13T18:27:02.562791+0000","last_fullsized":"2024-09-13T18:27:02.562791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:25.136745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286635+0000","last_change":"2024-09-13T18:27:01.303323+0000","last_active":"2024-09-13T18:27:02.286635+0000","last_peered":"2024-09-13T18:27:02.286635+0000","last_clean":"2024-09-13T18:27:02.286635+0000","last_became_active":"2024-09-13T18:27:01.302581+0000","last_became_peered":"2024-09-13T18:27:01.302581+0000","last_unstale":"2024-09-13T18:27:02.286635+0000","last_undegraded":"2024-09-13T18:27:02.286635+0000","last_fullsized":"2024-09-13T18:27:02.286635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:38.650324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561988+0000","last_change":"2024-09-13T18:27:01.300462+0000","last_active":"2024-09-13T18:27:02.561988+0000","last_peered":"2024-09-13T18:27:02.561988+0000","last_clean":"2024-09-13T18:27:02.561988+0000","last_became_active":"2024-09-13T18:27:01.300188+0000","last_became_peered":"2024-09-13T18:27:01.300188+0000","last_unstale":"2024-09-13T18:27:02.561988+0000","last_undegraded":"2024-09-13T18:27:02.561988+0000","last_fullsized":"2024-09-13T18:27:02.561988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:40.378467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286541+0000","last_change":"2024-09-13T18:27:01.299781+0000","last_active":"2024-09-13T18:27:02.286541+0000","last_peered":"2024-09-13T18:27:02.286541+0000","last_clean":"2024-09-13T18:27:02.286541+0000","last_became_active":"2024-09-13T18:27:01.299516+0000","last_became_peered":"2024-09-13T18:27:01.299516+0000","last_unstale":"2024-09-13T18:27:02.286541+0000","last_undegraded":"2024-09-13T18:27:02.286541+0000","last_fullsized":"2024-09-13T18:27:02.286541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:07.409290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.560812+0000","last_change":"2024-09-13T18:27:01.305664+0000","last_active":"2024-09-13T18:27:02.560812+0000","last_peered":"2024-09-13T18:27:02.560812+0000","last_clean":"2024-09-13T18:27:02.560812+0000","last_became_active":"2024-09-13T18:27:01.305343+0000","last_became_peered":"2024-09-13T18:27:01.305343+0000","last_unstale":"2024-09-13T18:27:02.560812+0000","last_undegraded":"2024-09-13T18:27:02.560812+0000","last_fullsized":"2024-09-13T18:27:02.560812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:40.223464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288405+0000","last_change":"2024-09-13T18:27:01.301564+0000","last_active":"2024-09-13T18:27:02.288405+0000","last_peered":"2024-09-13T18:27:02.288405+0000","last_clean":"2024-09-13T18:27:02.288405+0000","last_became_active":"2024-09-13T18:27:01.301286+0000","last_became_peered":"2024-09-13T18:27:01.301286+0000","last_unstale":"2024-09-13T18:27:02.288405+0000","last_undegraded":"2024-09-13T18:27:02.288405+0000","last_fullsized":"2024-09-13T18:27:02.288405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:40.223464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563309+0000","last_change":"2024-09-13T18:27:01.308981+0000","last_active":"2024-09-13T18:27:02.563309+0000","last_peered":"2024-09-13T18:27:02.563309+0000","last_clean":"2024-09-13T18:27:02.563309+0000","last_became_active":"2024-09-13T18:27:01.308748+0000","last_became_peered":"2024-09-13T18:27:01.308748+0000","last_unstale":"2024-09-13T18:27:02.563309+0000","last_undegraded":"2024-09-13T18:27:02.563309+0000","last_fullsized":"2024-09-13T18:27:02.563309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:08.287280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562011+0000","last_change":"2024-09-13T18:27:01.299859+0000","last_active":"2024-09-13T18:27:02.562011+0000","last_peered":"2024-09-13T18:27:02.562011+0000","last_clean":"2024-09-13T18:27:02.562011+0000","last_became_active":"2024-09-13T18:27:01.299580+0000","last_became_peered":"2024-09-13T18:27:01.299580+0000","last_unstale":"2024-09-13T18:27:02.562011+0000","last_undegraded":"2024-09-13T18:27:02.562011+0000","last_fullsized":"2024-09-13T18:27:02.562011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562374+0000","last_change":"2024-09-13T18:27:01.299858+0000","last_active":"2024-09-13T18:27:02.562374+0000","last_peered":"2024-09-13T18:27:02.562374+0000","last_clean":"2024-09-13T18:27:02.562374+0000","last_became_active":"2024-09-13T18:27:01.299507+0000","last_became_peered":"2024-09-13T18:27:01.299507+0000","last_unstale":"2024-09-13T18:27:02.562374+0000","last_undegraded":"2024-09-13T18:27:02.562374+0000","last_fullsized":"2024-09-13T18:27:02.562374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:32.698886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562231+0000","last_change":"2024-09-13T18:27:01.308216+0000","last_active":"2024-09-13T18:27:02.562231+0000","last_peered":"2024-09-13T18:27:02.562231+0000","last_clean":"2024-09-13T18:27:02.562231+0000","last_became_active":"2024-09-13T18:27:01.307955+0000","last_became_peered":"2024-09-13T18:27:01.307955+0000","last_unstale":"2024-09-13T18:27:02.562231+0000","last_undegraded":"2024-09-13T18:27:02.562231+0000","last_fullsized":"2024-09-13T18:27:02.562231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:17.243480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289436+0000","last_change":"2024-09-13T18:27:01.299496+0000","last_active":"2024-09-13T18:27:02.289436+0000","last_peered":"2024-09-13T18:27:02.289436+0000","last_clean":"2024-09-13T18:27:02.289436+0000","last_became_active":"2024-09-13T18:27:01.299251+0000","last_became_peered":"2024-09-13T18:27:01.299251+0000","last_unstale":"2024-09-13T18:27:02.289436+0000","last_undegraded":"2024-09-13T18:27:02.289436+0000","last_fullsized":"2024-09-13T18:27:02.289436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562502+0000","last_change":"2024-09-13T18:27:01.305015+0000","last_active":"2024-09-13T18:27:02.562502+0000","last_peered":"2024-09-13T18:27:02.562502+0000","last_clean":"2024-09-13T18:27:02.562502+0000","last_became_active":"2024-09-13T18:27:01.304762+0000","last_became_peered":"2024-09-13T18:27:01.304762+0000","last_unstale":"2024-09-13T18:27:02.562502+0000","last_undegraded":"2024-09-13T18:27:02.562502+0000","last_fullsized":"2024-09-13T18:27:02.562502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:39.455167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287647+0000","last_change":"2024-09-13T18:27:01.304368+0000","last_active":"2024-09-13T18:27:02.287647+0000","last_peered":"2024-09-13T18:27:02.287647+0000","last_clean":"2024-09-13T18:27:02.287647+0000","last_became_active":"2024-09-13T18:27:01.304126+0000","last_became_peered":"2024-09-13T18:27:01.304126+0000","last_unstale":"2024-09-13T18:27:02.287647+0000","last_undegraded":"2024-09-13T18:27:02.287647+0000","last_fullsized":"2024-09-13T18:27:02.287647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:36.752876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286091+0000","last_change":"2024-09-13T18:27:01.305236+0000","last_active":"2024-09-13T18:27:02.286091+0000","last_peered":"2024-09-13T18:27:02.286091+0000","last_clean":"2024-09-13T18:27:02.286091+0000","last_became_active":"2024-09-13T18:27:01.302486+0000","last_became_peered":"2024-09-13T18:27:01.302486+0000","last_unstale":"2024-09-13T18:27:02.286091+0000","last_undegraded":"2024-09-13T18:27:02.286091+0000","last_fullsized":"2024-09-13T18:27:02.286091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:08.287280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288208+0000","last_change":"2024-09-13T18:27:01.301131+0000","last_active":"2024-09-13T18:27:02.288208+0000","last_peered":"2024-09-13T18:27:02.288208+0000","last_clean":"2024-09-13T18:27:02.288208+0000","last_became_active":"2024-09-13T18:27:01.300871+0000","last_became_peered":"2024-09-13T18:27:01.300871+0000","last_unstale":"2024-09-13T18:27:02.288208+0000","last_undegraded":"2024-09-13T18:27:02.288208+0000","last_fullsized":"2024-09-13T18:27:02.288208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:58.545057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562414+0000","last_change":"2024-09-13T18:27:01.299631+0000","last_active":"2024-09-13T18:27:02.562414+0000","last_peered":"2024-09-13T18:27:02.562414+0000","last_clean":"2024-09-13T18:27:02.562414+0000","last_became_active":"2024-09-13T18:27:01.299370+0000","last_became_peered":"2024-09-13T18:27:01.299370+0000","last_unstale":"2024-09-13T18:27:02.562414+0000","last_undegraded":"2024-09-13T18:27:02.562414+0000","last_fullsized":"2024-09-13T18:27:02.562414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:04.793190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563485+0000","last_change":"2024-09-13T18:27:01.309339+0000","last_active":"2024-09-13T18:27:02.563485+0000","last_peered":"2024-09-13T18:27:02.563485+0000","last_clean":"2024-09-13T18:27:02.563485+0000","last_became_active":"2024-09-13T18:27:01.308841+0000","last_became_peered":"2024-09-13T18:27:01.308841+0000","last_unstale":"2024-09-13T18:27:02.563485+0000","last_undegraded":"2024-09-13T18:27:02.563485+0000","last_fullsized":"2024-09-13T18:27:02.563485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:17.918955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561983+0000","last_change":"2024-09-13T18:27:01.308696+0000","last_active":"2024-09-13T18:27:02.561983+0000","last_peered":"2024-09-13T18:27:02.561983+0000","last_clean":"2024-09-13T18:27:02.561983+0000","last_became_active":"2024-09-13T18:27:01.308095+0000","last_became_peered":"2024-09-13T18:27:01.308095+0000","last_unstale":"2024-09-13T18:27:02.561983+0000","last_undegraded":"2024-09-13T18:27:02.561983+0000","last_fullsized":"2024-09-13T18:27:02.561983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562445+0000","last_change":"2024-09-13T18:27:01.310681+0000","last_active":"2024-09-13T18:27:02.562445+0000","last_peered":"2024-09-13T18:27:02.562445+0000","last_clean":"2024-09-13T18:27:02.562445+0000","last_became_active":"2024-09-13T18:27:01.310423+0000","last_became_peered":"2024-09-13T18:27:01.310423+0000","last_unstale":"2024-09-13T18:27:02.562445+0000","last_undegraded":"2024-09-13T18:27:02.562445+0000","last_fullsized":"2024-09-13T18:27:02.562445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286784+0000","last_change":"2024-09-13T18:27:01.303954+0000","last_active":"2024-09-13T18:27:02.286784+0000","last_peered":"2024-09-13T18:27:02.286784+0000","last_clean":"2024-09-13T18:27:02.286784+0000","last_became_active":"2024-09-13T18:27:01.303227+0000","last_became_peered":"2024-09-13T18:27:01.303227+0000","last_unstale":"2024-09-13T18:27:02.286784+0000","last_undegraded":"2024-09-13T18:27:02.286784+0000","last_fullsized":"2024-09-13T18:27:02.286784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288715+0000","last_change":"2024-09-13T18:27:01.296775+0000","last_active":"2024-09-13T18:27:02.288715+0000","last_peered":"2024-09-13T18:27:02.288715+0000","last_clean":"2024-09-13T18:27:02.288715+0000","last_became_active":"2024-09-13T18:27:01.296521+0000","last_became_peered":"2024-09-13T18:27:01.296521+0000","last_unstale":"2024-09-13T18:27:02.288715+0000","last_undegraded":"2024-09-13T18:27:02.288715+0000","last_fullsized":"2024-09-13T18:27:02.288715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:26.451272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286251+0000","last_change":"2024-09-13T18:27:01.302747+0000","last_active":"2024-09-13T18:27:02.286251+0000","last_peered":"2024-09-13T18:27:02.286251+0000","last_clean":"2024-09-13T18:27:02.286251+0000","last_became_active":"2024-09-13T18:27:01.302084+0000","last_became_peered":"2024-09-13T18:27:01.302084+0000","last_unstale":"2024-09-13T18:27:02.286251+0000","last_undegraded":"2024-09-13T18:27:02.286251+0000","last_fullsized":"2024-09-13T18:27:02.286251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:40.223464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289687+0000","last_change":"2024-09-13T18:27:01.296882+0000","last_active":"2024-09-13T18:27:02.289687+0000","last_peered":"2024-09-13T18:27:02.289687+0000","last_clean":"2024-09-13T18:27:02.289687+0000","last_became_active":"2024-09-13T18:27:01.296629+0000","last_became_peered":"2024-09-13T18:27:01.296629+0000","last_unstale":"2024-09-13T18:27:02.289687+0000","last_undegraded":"2024-09-13T18:27:02.289687+0000","last_fullsized":"2024-09-13T18:27:02.289687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:26.095535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562232+0000","last_change":"2024-09-13T18:27:01.301327+0000","last_active":"2024-09-13T18:27:02.562232+0000","last_peered":"2024-09-13T18:27:02.562232+0000","last_clean":"2024-09-13T18:27:02.562232+0000","last_became_active":"2024-09-13T18:27:01.301036+0000","last_became_peered":"2024-09-13T18:27:01.301036+0000","last_unstale":"2024-09-13T18:27:02.562232+0000","last_undegraded":"2024-09-13T18:27:02.562232+0000","last_fullsized":"2024-09-13T18:27:02.562232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:26.451272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288168+0000","last_change":"2024-09-13T18:27:01.303654+0000","last_active":"2024-09-13T18:27:02.288168+0000","last_peered":"2024-09-13T18:27:02.288168+0000","last_clean":"2024-09-13T18:27:02.288168+0000","last_became_active":"2024-09-13T18:27:01.303423+0000","last_became_peered":"2024-09-13T18:27:01.303423+0000","last_unstale":"2024-09-13T18:27:02.288168+0000","last_undegraded":"2024-09-13T18:27:02.288168+0000","last_fullsized":"2024-09-13T18:27:02.288168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:58.545057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289581+0000","last_change":"2024-09-13T18:27:01.306805+0000","last_active":"2024-09-13T18:27:02.289581+0000","last_peered":"2024-09-13T18:27:02.289581+0000","last_clean":"2024-09-13T18:27:02.289581+0000","last_became_active":"2024-09-13T18:27:01.306437+0000","last_became_peered":"2024-09-13T18:27:01.306437+0000","last_unstale":"2024-09-13T18:27:02.289581+0000","last_undegraded":"2024-09-13T18:27:02.289581+0000","last_fullsized":"2024-09-13T18:27:02.289581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:30.479538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562688+0000","last_change":"2024-09-13T18:27:01.304058+0000","last_active":"2024-09-13T18:27:02.562688+0000","last_peered":"2024-09-13T18:27:02.562688+0000","last_clean":"2024-09-13T18:27:02.562688+0000","last_became_active":"2024-09-13T18:27:01.303629+0000","last_became_peered":"2024-09-13T18:27:01.303629+0000","last_unstale":"2024-09-13T18:27:02.562688+0000","last_undegraded":"2024-09-13T18:27:02.562688+0000","last_fullsized":"2024-09-13T18:27:02.562688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:22.491328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287025+0000","last_change":"2024-09-13T18:27:01.304393+0000","last_active":"2024-09-13T18:27:02.287025+0000","last_peered":"2024-09-13T18:27:02.287025+0000","last_clean":"2024-09-13T18:27:02.287025+0000","last_became_active":"2024-09-13T18:27:01.304135+0000","last_became_peered":"2024-09-13T18:27:01.304135+0000","last_unstale":"2024-09-13T18:27:02.287025+0000","last_undegraded":"2024-09-13T18:27:02.287025+0000","last_fullsized":"2024-09-13T18:27:02.287025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:40.378467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562959+0000","last_change":"2024-09-13T18:27:01.302991+0000","last_active":"2024-09-13T18:27:02.562959+0000","last_peered":"2024-09-13T18:27:02.562959+0000","last_clean":"2024-09-13T18:27:02.562959+0000","last_became_active":"2024-09-13T18:27:01.302746+0000","last_became_peered":"2024-09-13T18:27:01.302746+0000","last_unstale":"2024-09-13T18:27:02.562959+0000","last_undegraded":"2024-09-13T18:27:02.562959+0000","last_fullsized":"2024-09-13T18:27:02.562959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:17.243480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.560846+0000","last_change":"2024-09-13T18:27:01.306888+0000","last_active":"2024-09-13T18:27:02.560846+0000","last_peered":"2024-09-13T18:27:02.560846+0000","last_clean":"2024-09-13T18:27:02.560846+0000","last_became_active":"2024-09-13T18:27:01.306593+0000","last_became_peered":"2024-09-13T18:27:01.306593+0000","last_unstale":"2024-09-13T18:27:02.560846+0000","last_undegraded":"2024-09-13T18:27:02.560846+0000","last_fullsized":"2024-09-13T18:27:02.560846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:26.095535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561343+0000","last_change":"2024-09-13T18:27:01.306267+0000","last_active":"2024-09-13T18:27:02.561343+0000","last_peered":"2024-09-13T18:27:02.561343+0000","last_clean":"2024-09-13T18:27:02.561343+0000","last_became_active":"2024-09-13T18:27:01.306016+0000","last_became_peered":"2024-09-13T18:27:01.306016+0000","last_unstale":"2024-09-13T18:27:02.561343+0000","last_undegraded":"2024-09-13T18:27:02.561343+0000","last_fullsized":"2024-09-13T18:27:02.561343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:59.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289534+0000","last_change":"2024-09-13T18:27:00.911539+0000","last_active":"2024-09-13T18:27:02.289534+0000","last_peered":"2024-09-13T18:27:02.289534+0000","last_clean":"2024-09-13T18:27:02.289534+0000","last_became_active":"2024-09-13T18:27:00.910841+0000","last_became_peered":"2024-09-13T18:27:00.910841+0000","last_unstale":"2024-09-13T18:27:02.289534+0000","last_undegraded":"2024-09-13T18:27:02.289534+0000","last_fullsized":"2024-09-13T18:27:02.289534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:53.385777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562937+0000","last_change":"2024-09-13T18:27:01.305382+0000","last_active":"2024-09-13T18:27:02.562937+0000","last_peered":"2024-09-13T18:27:02.562937+0000","last_clean":"2024-09-13T18:27:02.562937+0000","last_became_active":"2024-09-13T18:27:01.305139+0000","last_became_peered":"2024-09-13T18:27:01.305139+0000","last_unstale":"2024-09-13T18:27:02.562937+0000","last_undegraded":"2024-09-13T18:27:02.562937+0000","last_fullsized":"2024-09-13T18:27:02.562937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561575+0000","last_change":"2024-09-13T18:27:00.913328+0000","last_active":"2024-09-13T18:27:02.561575+0000","last_peered":"2024-09-13T18:27:02.561575+0000","last_clean":"2024-09-13T18:27:02.561575+0000","last_became_active":"2024-09-13T18:27:00.913086+0000","last_became_peered":"2024-09-13T18:27:00.913086+0000","last_unstale":"2024-09-13T18:27:02.561575+0000","last_undegraded":"2024-09-13T18:27:02.561575+0000","last_fullsized":"2024-09-13T18:27:02.561575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:53.385777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288807+0000","last_change":"2024-09-13T18:27:00.911854+0000","last_active":"2024-09-13T18:27:02.288807+0000","last_peered":"2024-09-13T18:27:02.288807+0000","last_clean":"2024-09-13T18:27:02.288807+0000","last_became_active":"2024-09-13T18:27:00.911591+0000","last_became_peered":"2024-09-13T18:27:00.911591+0000","last_unstale":"2024-09-13T18:27:02.288807+0000","last_undegraded":"2024-09-13T18:27:02.288807+0000","last_fullsized":"2024-09-13T18:27:02.288807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:06.968005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288348+0000","last_change":"2024-09-13T18:27:01.302897+0000","last_active":"2024-09-13T18:27:02.288348+0000","last_peered":"2024-09-13T18:27:02.288348+0000","last_clean":"2024-09-13T18:27:02.288348+0000","last_became_active":"2024-09-13T18:27:01.302678+0000","last_became_peered":"2024-09-13T18:27:01.302678+0000","last_unstale":"2024-09-13T18:27:02.288348+0000","last_undegraded":"2024-09-13T18:27:02.288348+0000","last_fullsized":"2024-09-13T18:27:02.288348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286340+0000","last_change":"2024-09-13T18:27:00.912605+0000","last_active":"2024-09-13T18:27:02.286340+0000","last_peered":"2024-09-13T18:27:02.286340+0000","last_clean":"2024-09-13T18:27:02.286340+0000","last_became_active":"2024-09-13T18:27:00.912293+0000","last_became_peered":"2024-09-13T18:27:00.912293+0000","last_unstale":"2024-09-13T18:27:02.286340+0000","last_undegraded":"2024-09-13T18:27:02.286340+0000","last_fullsized":"2024-09-13T18:27:02.286340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:15.665610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287553+0000","last_change":"2024-09-13T18:27:01.294866+0000","last_active":"2024-09-13T18:27:02.287553+0000","last_peered":"2024-09-13T18:27:02.287553+0000","last_clean":"2024-09-13T18:27:02.287553+0000","last_became_active":"2024-09-13T18:27:01.294614+0000","last_became_peered":"2024-09-13T18:27:01.294614+0000","last_unstale":"2024-09-13T18:27:02.287553+0000","last_undegraded":"2024-09-13T18:27:02.287553+0000","last_fullsized":"2024-09-13T18:27:02.287553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562622+0000","last_change":"2024-09-13T18:27:00.910126+0000","last_active":"2024-09-13T18:27:02.562622+0000","last_peered":"2024-09-13T18:27:02.562622+0000","last_clean":"2024-09-13T18:27:02.562622+0000","last_became_active":"2024-09-13T18:27:00.909845+0000","last_became_peered":"2024-09-13T18:27:00.909845+0000","last_unstale":"2024-09-13T18:27:02.562622+0000","last_undegraded":"2024-09-13T18:27:02.562622+0000","last_fullsized":"2024-09-13T18:27:02.562622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.933818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287706+0000","last_change":"2024-09-13T18:27:01.304023+0000","last_active":"2024-09-13T18:27:02.287706+0000","last_peered":"2024-09-13T18:27:02.287706+0000","last_clean":"2024-09-13T18:27:02.287706+0000","last_became_active":"2024-09-13T18:27:01.303683+0000","last_became_peered":"2024-09-13T18:27:01.303683+0000","last_unstale":"2024-09-13T18:27:02.287706+0000","last_undegraded":"2024-09-13T18:27:02.287706+0000","last_fullsized":"2024-09-13T18:27:02.287706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287684+0000","last_change":"2024-09-13T18:27:00.911226+0000","last_active":"2024-09-13T18:27:02.287684+0000","last_peered":"2024-09-13T18:27:02.287684+0000","last_clean":"2024-09-13T18:27:02.287684+0000","last_became_active":"2024-09-13T18:27:00.910878+0000","last_became_peered":"2024-09-13T18:27:00.910878+0000","last_unstale":"2024-09-13T18:27:02.287684+0000","last_undegraded":"2024-09-13T18:27:02.287684+0000","last_fullsized":"2024-09-13T18:27:02.287684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:58.428945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563113+0000","last_change":"2024-09-13T18:27:01.302430+0000","last_active":"2024-09-13T18:27:02.563113+0000","last_peered":"2024-09-13T18:27:02.563113+0000","last_clean":"2024-09-13T18:27:02.563113+0000","last_became_active":"2024-09-13T18:27:01.301355+0000","last_became_peered":"2024-09-13T18:27:01.301355+0000","last_unstale":"2024-09-13T18:27:02.563113+0000","last_undegraded":"2024-09-13T18:27:02.563113+0000","last_fullsized":"2024-09-13T18:27:02.563113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:26.095535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288349+0000","last_change":"2024-09-13T18:27:00.906914+0000","last_active":"2024-09-13T18:27:02.288349+0000","last_peered":"2024-09-13T18:27:02.288349+0000","last_clean":"2024-09-13T18:27:02.288349+0000","last_became_active":"2024-09-13T18:27:00.905751+0000","last_became_peered":"2024-09-13T18:27:00.905751+0000","last_unstale":"2024-09-13T18:27:02.288349+0000","last_undegraded":"2024-09-13T18:27:02.288349+0000","last_fullsized":"2024-09-13T18:27:02.288349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:13.103035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562471+0000","last_change":"2024-09-13T18:27:01.311919+0000","last_active":"2024-09-13T18:27:02.562471+0000","last_peered":"2024-09-13T18:27:02.562471+0000","last_clean":"2024-09-13T18:27:02.562471+0000","last_became_active":"2024-09-13T18:27:01.311087+0000","last_became_peered":"2024-09-13T18:27:01.311087+0000","last_unstale":"2024-09-13T18:27:02.562471+0000","last_undegraded":"2024-09-13T18:27:02.562471+0000","last_fullsized":"2024-09-13T18:27:02.562471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:14.113024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562110+0000","last_change":"2024-09-13T18:27:00.909802+0000","last_active":"2024-09-13T18:27:02.562110+0000","last_peered":"2024-09-13T18:27:02.562110+0000","last_clean":"2024-09-13T18:27:02.562110+0000","last_became_active":"2024-09-13T18:27:00.909547+0000","last_became_peered":"2024-09-13T18:27:00.909547+0000","last_unstale":"2024-09-13T18:27:02.562110+0000","last_undegraded":"2024-09-13T18:27:02.562110+0000","last_fullsized":"2024-09-13T18:27:02.562110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:13.103035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563137+0000","last_change":"2024-09-13T18:27:01.312609+0000","last_active":"2024-09-13T18:27:02.563137+0000","last_peered":"2024-09-13T18:27:02.563137+0000","last_clean":"2024-09-13T18:27:02.563137+0000","last_became_active":"2024-09-13T18:27:01.312314+0000","last_became_peered":"2024-09-13T18:27:01.312314+0000","last_unstale":"2024-09-13T18:27:02.563137+0000","last_undegraded":"2024-09-13T18:27:02.563137+0000","last_fullsized":"2024-09-13T18:27:02.563137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:38.650324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563169+0000","last_change":"2024-09-13T18:27:00.916915+0000","last_active":"2024-09-13T18:27:02.563169+0000","last_peered":"2024-09-13T18:27:02.563169+0000","last_clean":"2024-09-13T18:27:02.563169+0000","last_became_active":"2024-09-13T18:27:00.916632+0000","last_became_peered":"2024-09-13T18:27:00.916632+0000","last_unstale":"2024-09-13T18:27:02.563169+0000","last_undegraded":"2024-09-13T18:27:02.563169+0000","last_fullsized":"2024-09-13T18:27:02.563169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:50.705752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562755+0000","last_change":"2024-09-13T18:27:01.303166+0000","last_active":"2024-09-13T18:27:02.562755+0000","last_peered":"2024-09-13T18:27:02.562755+0000","last_clean":"2024-09-13T18:27:02.562755+0000","last_became_active":"2024-09-13T18:27:01.302924+0000","last_became_peered":"2024-09-13T18:27:01.302924+0000","last_unstale":"2024-09-13T18:27:02.562755+0000","last_undegraded":"2024-09-13T18:27:02.562755+0000","last_fullsized":"2024-09-13T18:27:02.562755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:04.793190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287214+0000","last_change":"2024-09-13T18:27:00.907398+0000","last_active":"2024-09-13T18:27:02.287214+0000","last_peered":"2024-09-13T18:27:02.287214+0000","last_clean":"2024-09-13T18:27:02.287214+0000","last_became_active":"2024-09-13T18:27:00.906944+0000","last_became_peered":"2024-09-13T18:27:00.906944+0000","last_unstale":"2024-09-13T18:27:02.287214+0000","last_undegraded":"2024-09-13T18:27:02.287214+0000","last_fullsized":"2024-09-13T18:27:02.287214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:06.968005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562208+0000","last_change":"2024-09-13T18:27:01.315035+0000","last_active":"2024-09-13T18:27:02.562208+0000","last_peered":"2024-09-13T18:27:02.562208+0000","last_clean":"2024-09-13T18:27:02.562208+0000","last_became_active":"2024-09-13T18:27:01.314681+0000","last_became_peered":"2024-09-13T18:27:01.314681+0000","last_unstale":"2024-09-13T18:27:02.562208+0000","last_undegraded":"2024-09-13T18:27:02.562208+0000","last_fullsized":"2024-09-13T18:27:02.562208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:36.178176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561303+0000","last_change":"2024-09-13T18:27:00.912840+0000","last_active":"2024-09-13T18:27:02.561303+0000","last_peered":"2024-09-13T18:27:02.561303+0000","last_clean":"2024-09-13T18:27:02.561303+0000","last_became_active":"2024-09-13T18:27:00.912602+0000","last_became_peered":"2024-09-13T18:27:00.912602+0000","last_unstale":"2024-09-13T18:27:02.561303+0000","last_undegraded":"2024-09-13T18:27:02.561303+0000","last_fullsized":"2024-09-13T18:27:02.561303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:15.665610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561087+0000","last_change":"2024-09-13T18:27:01.306616+0000","last_active":"2024-09-13T18:27:02.561087+0000","last_peered":"2024-09-13T18:27:02.561087+0000","last_clean":"2024-09-13T18:27:02.561087+0000","last_became_active":"2024-09-13T18:27:01.306284+0000","last_became_peered":"2024-09-13T18:27:01.306284+0000","last_unstale":"2024-09-13T18:27:02.561087+0000","last_undegraded":"2024-09-13T18:27:02.561087+0000","last_fullsized":"2024-09-13T18:27:02.561087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:30.479538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562519+0000","last_change":"2024-09-13T18:27:00.908275+0000","last_active":"2024-09-13T18:27:02.562519+0000","last_peered":"2024-09-13T18:27:02.562519+0000","last_clean":"2024-09-13T18:27:02.562519+0000","last_became_active":"2024-09-13T18:27:00.907829+0000","last_became_peered":"2024-09-13T18:27:00.907829+0000","last_unstale":"2024-09-13T18:27:02.562519+0000","last_undegraded":"2024-09-13T18:27:02.562519+0000","last_fullsized":"2024-09-13T18:27:02.562519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:25.457724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.560866+0000","last_change":"2024-09-13T18:27:01.314976+0000","last_active":"2024-09-13T18:27:02.560866+0000","last_peered":"2024-09-13T18:27:02.560866+0000","last_clean":"2024-09-13T18:27:02.560866+0000","last_became_active":"2024-09-13T18:27:01.314657+0000","last_became_peered":"2024-09-13T18:27:01.314657+0000","last_unstale":"2024-09-13T18:27:02.560866+0000","last_undegraded":"2024-09-13T18:27:02.560866+0000","last_fullsized":"2024-09-13T18:27:02.560866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:22.797312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562777+0000","last_change":"2024-09-13T18:27:00.912307+0000","last_active":"2024-09-13T18:27:02.562777+0000","last_peered":"2024-09-13T18:27:02.562777+0000","last_clean":"2024-09-13T18:27:02.562777+0000","last_became_active":"2024-09-13T18:27:00.911774+0000","last_became_peered":"2024-09-13T18:27:00.911774+0000","last_unstale":"2024-09-13T18:27:02.562777+0000","last_undegraded":"2024-09-13T18:27:02.562777+0000","last_fullsized":"2024-09-13T18:27:02.562777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:55.668790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563559+0000","last_change":"2024-09-13T18:27:01.315067+0000","last_active":"2024-09-13T18:27:02.563559+0000","last_peered":"2024-09-13T18:27:02.563559+0000","last_clean":"2024-09-13T18:27:02.563559+0000","last_became_active":"2024-09-13T18:27:01.314778+0000","last_became_peered":"2024-09-13T18:27:01.314778+0000","last_unstale":"2024-09-13T18:27:02.563559+0000","last_undegraded":"2024-09-13T18:27:02.563559+0000","last_fullsized":"2024-09-13T18:27:02.563559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:41.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562656+0000","last_change":"2024-09-13T18:27:00.911992+0000","last_active":"2024-09-13T18:27:02.562656+0000","last_peered":"2024-09-13T18:27:02.562656+0000","last_clean":"2024-09-13T18:27:02.562656+0000","last_became_active":"2024-09-13T18:27:00.911708+0000","last_became_peered":"2024-09-13T18:27:00.911708+0000","last_unstale":"2024-09-13T18:27:02.562656+0000","last_undegraded":"2024-09-13T18:27:02.562656+0000","last_fullsized":"2024-09-13T18:27:02.562656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:06.968005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563446+0000","last_change":"2024-09-13T18:27:01.314993+0000","last_active":"2024-09-13T18:27:02.563446+0000","last_peered":"2024-09-13T18:27:02.563446+0000","last_clean":"2024-09-13T18:27:02.563446+0000","last_became_active":"2024-09-13T18:27:01.314728+0000","last_became_peered":"2024-09-13T18:27:01.314728+0000","last_unstale":"2024-09-13T18:27:02.563446+0000","last_undegraded":"2024-09-13T18:27:02.563446+0000","last_fullsized":"2024-09-13T18:27:02.563446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:17.450610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288495+0000","last_change":"2024-09-13T18:27:00.904591+0000","last_active":"2024-09-13T18:27:02.288495+0000","last_peered":"2024-09-13T18:27:02.288495+0000","last_clean":"2024-09-13T18:27:02.288495+0000","last_became_active":"2024-09-13T18:27:00.904193+0000","last_became_peered":"2024-09-13T18:27:00.904193+0000","last_unstale":"2024-09-13T18:27:02.288495+0000","last_undegraded":"2024-09-13T18:27:02.288495+0000","last_fullsized":"2024-09-13T18:27:02.288495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.933818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287084+0000","last_change":"2024-09-13T18:27:01.303085+0000","last_active":"2024-09-13T18:27:02.287084+0000","last_peered":"2024-09-13T18:27:02.287084+0000","last_clean":"2024-09-13T18:27:02.287084+0000","last_became_active":"2024-09-13T18:27:01.302208+0000","last_became_peered":"2024-09-13T18:27:01.302208+0000","last_unstale":"2024-09-13T18:27:02.287084+0000","last_undegraded":"2024-09-13T18:27:02.287084+0000","last_fullsized":"2024-09-13T18:27:02.287084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:36.178176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563635+0000","last_change":"2024-09-13T18:27:00.913872+0000","last_active":"2024-09-13T18:27:02.563635+0000","last_peered":"2024-09-13T18:27:02.563635+0000","last_clean":"2024-09-13T18:27:02.563635+0000","last_became_active":"2024-09-13T18:27:00.913253+0000","last_became_peered":"2024-09-13T18:27:00.913253+0000","last_unstale":"2024-09-13T18:27:02.563635+0000","last_undegraded":"2024-09-13T18:27:02.563635+0000","last_fullsized":"2024-09-13T18:27:02.563635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:15.665610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563701+0000","last_change":"2024-09-13T18:27:01.309496+0000","last_active":"2024-09-13T18:27:02.563701+0000","last_peered":"2024-09-13T18:27:02.563701+0000","last_clean":"2024-09-13T18:27:02.563701+0000","last_became_active":"2024-09-13T18:27:01.309222+0000","last_became_peered":"2024-09-13T18:27:01.309222+0000","last_unstale":"2024-09-13T18:27:02.563701+0000","last_undegraded":"2024-09-13T18:27:02.563701+0000","last_fullsized":"2024-09-13T18:27:02.563701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:01.766818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:27:01.294854+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:27:01.294854+0000","last_peered":"2024-09-13T18:27:01.294854+0000","last_clean":"2024-09-13T18:27:01.294854+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:27:01.294854+0000","last_undegraded":"2024-09-13T18:27:01.294854+0000","last_fullsized":"2024-09-13T18:27:01.294854+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286187+0000","last_change":"2024-09-13T18:27:00.908757+0000","last_active":"2024-09-13T18:27:02.286187+0000","last_peered":"2024-09-13T18:27:02.286187+0000","last_clean":"2024-09-13T18:27:02.286187+0000","last_became_active":"2024-09-13T18:27:00.908473+0000","last_became_peered":"2024-09-13T18:27:00.908473+0000","last_unstale":"2024-09-13T18:27:02.286187+0000","last_undegraded":"2024-09-13T18:27:02.286187+0000","last_fullsized":"2024-09-13T18:27:02.286187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:13.103035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289057+0000","last_change":"2024-09-13T18:27:01.301499+0000","last_active":"2024-09-13T18:27:02.289057+0000","last_peered":"2024-09-13T18:27:02.289057+0000","last_clean":"2024-09-13T18:27:02.289057+0000","last_became_active":"2024-09-13T18:27:01.301225+0000","last_became_peered":"2024-09-13T18:27:01.301225+0000","last_unstale":"2024-09-13T18:27:02.289057+0000","last_undegraded":"2024-09-13T18:27:02.289057+0000","last_fullsized":"2024-09-13T18:27:02.289057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:17.918955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.560941+0000","last_change":"2024-09-13T18:27:00.913941+0000","last_active":"2024-09-13T18:27:02.560941+0000","last_peered":"2024-09-13T18:27:02.560941+0000","last_clean":"2024-09-13T18:27:02.560941+0000","last_became_active":"2024-09-13T18:27:00.913635+0000","last_became_peered":"2024-09-13T18:27:00.913635+0000","last_unstale":"2024-09-13T18:27:02.560941+0000","last_undegraded":"2024-09-13T18:27:02.560941+0000","last_fullsized":"2024-09-13T18:27:02.560941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:16.233492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562003+0000","last_change":"2024-09-13T18:27:01.305523+0000","last_active":"2024-09-13T18:27:02.562003+0000","last_peered":"2024-09-13T18:27:02.562003+0000","last_clean":"2024-09-13T18:27:02.562003+0000","last_became_active":"2024-09-13T18:27:01.305262+0000","last_became_peered":"2024-09-13T18:27:01.305262+0000","last_unstale":"2024-09-13T18:27:02.562003+0000","last_undegraded":"2024-09-13T18:27:02.562003+0000","last_fullsized":"2024-09-13T18:27:02.562003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:58.545057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563149+0000","last_change":"2024-09-13T18:27:00.908133+0000","last_active":"2024-09-13T18:27:02.563149+0000","last_peered":"2024-09-13T18:27:02.563149+0000","last_clean":"2024-09-13T18:27:02.563149+0000","last_became_active":"2024-09-13T18:27:00.907408+0000","last_became_peered":"2024-09-13T18:27:00.907408+0000","last_unstale":"2024-09-13T18:27:02.563149+0000","last_undegraded":"2024-09-13T18:27:02.563149+0000","last_fullsized":"2024-09-13T18:27:02.563149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:53.385777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287467+0000","last_change":"2024-09-13T18:27:01.302404+0000","last_active":"2024-09-13T18:27:02.287467+0000","last_peered":"2024-09-13T18:27:02.287467+0000","last_clean":"2024-09-13T18:27:02.287467+0000","last_became_active":"2024-09-13T18:27:01.302118+0000","last_became_peered":"2024-09-13T18:27:01.302118+0000","last_unstale":"2024-09-13T18:27:02.287467+0000","last_undegraded":"2024-09-13T18:27:02.287467+0000","last_fullsized":"2024-09-13T18:27:02.287467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:26.095535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287402+0000","last_change":"2024-09-13T18:27:00.904991+0000","last_active":"2024-09-13T18:27:02.287402+0000","last_peered":"2024-09-13T18:27:02.287402+0000","last_clean":"2024-09-13T18:27:02.287402+0000","last_became_active":"2024-09-13T18:27:00.903940+0000","last_became_peered":"2024-09-13T18:27:00.903940+0000","last_unstale":"2024-09-13T18:27:02.287402+0000","last_undegraded":"2024-09-13T18:27:02.287402+0000","last_fullsized":"2024-09-13T18:27:02.287402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:53.385777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561995+0000","last_change":"2024-09-13T18:27:01.303896+0000","last_active":"2024-09-13T18:27:02.561995+0000","last_peered":"2024-09-13T18:27:02.561995+0000","last_clean":"2024-09-13T18:27:02.561995+0000","last_became_active":"2024-09-13T18:27:01.303570+0000","last_became_peered":"2024-09-13T18:27:01.303570+0000","last_unstale":"2024-09-13T18:27:02.561995+0000","last_undegraded":"2024-09-13T18:27:02.561995+0000","last_fullsized":"2024-09-13T18:27:02.561995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:47.943806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288178+0000","last_change":"2024-09-13T18:27:00.911270+0000","last_active":"2024-09-13T18:27:02.288178+0000","last_peered":"2024-09-13T18:27:02.288178+0000","last_clean":"2024-09-13T18:27:02.288178+0000","last_became_active":"2024-09-13T18:27:00.910972+0000","last_became_peered":"2024-09-13T18:27:00.910972+0000","last_unstale":"2024-09-13T18:27:02.288178+0000","last_undegraded":"2024-09-13T18:27:02.288178+0000","last_fullsized":"2024-09-13T18:27:02.288178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:47.877280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286988+0000","last_change":"2024-09-13T18:27:01.301470+0000","last_active":"2024-09-13T18:27:02.286988+0000","last_peered":"2024-09-13T18:27:02.286988+0000","last_clean":"2024-09-13T18:27:02.286988+0000","last_became_active":"2024-09-13T18:27:01.301207+0000","last_became_peered":"2024-09-13T18:27:01.301207+0000","last_unstale":"2024-09-13T18:27:02.286988+0000","last_undegraded":"2024-09-13T18:27:02.286988+0000","last_fullsized":"2024-09-13T18:27:02.286988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:17.918955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563596+0000","last_change":"2024-09-13T18:27:00.912131+0000","last_active":"2024-09-13T18:27:02.563596+0000","last_peered":"2024-09-13T18:27:02.563596+0000","last_clean":"2024-09-13T18:27:02.563596+0000","last_became_active":"2024-09-13T18:27:00.911544+0000","last_became_peered":"2024-09-13T18:27:00.911544+0000","last_unstale":"2024-09-13T18:27:02.563596+0000","last_undegraded":"2024-09-13T18:27:02.563596+0000","last_fullsized":"2024-09-13T18:27:02.563596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:13.103035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287996+0000","last_change":"2024-09-13T18:27:01.300408+0000","last_active":"2024-09-13T18:27:02.287996+0000","last_peered":"2024-09-13T18:27:02.287996+0000","last_clean":"2024-09-13T18:27:02.287996+0000","last_became_active":"2024-09-13T18:27:01.300091+0000","last_became_peered":"2024-09-13T18:27:01.300091+0000","last_unstale":"2024-09-13T18:27:02.287996+0000","last_undegraded":"2024-09-13T18:27:02.287996+0000","last_fullsized":"2024-09-13T18:27:02.287996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:26.451272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:04.334281+0000","last_change":"2024-09-13T18:27:00.912212+0000","last_active":"2024-09-13T18:27:04.334281+0000","last_peered":"2024-09-13T18:27:04.334281+0000","last_clean":"2024-09-13T18:27:04.334281+0000","last_became_active":"2024-09-13T18:27:00.911910+0000","last_became_peered":"2024-09-13T18:27:00.911910+0000","last_unstale":"2024-09-13T18:27:04.334281+0000","last_undegraded":"2024-09-13T18:27:04.334281+0000","last_fullsized":"2024-09-13T18:27:04.334281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:16.233492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289875+0000","last_change":"2024-09-13T18:27:01.312352+0000","last_active":"2024-09-13T18:27:02.289875+0000","last_peered":"2024-09-13T18:27:02.289875+0000","last_clean":"2024-09-13T18:27:02.289875+0000","last_became_active":"2024-09-13T18:27:01.311778+0000","last_became_peered":"2024-09-13T18:27:01.311778+0000","last_unstale":"2024-09-13T18:27:02.289875+0000","last_undegraded":"2024-09-13T18:27:02.289875+0000","last_fullsized":"2024-09-13T18:27:02.289875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:40.378467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562667+0000","last_change":"2024-09-13T18:27:00.911809+0000","last_active":"2024-09-13T18:27:02.562667+0000","last_peered":"2024-09-13T18:27:02.562667+0000","last_clean":"2024-09-13T18:27:02.562667+0000","last_became_active":"2024-09-13T18:27:00.911539+0000","last_became_peered":"2024-09-13T18:27:00.911539+0000","last_unstale":"2024-09-13T18:27:02.562667+0000","last_undegraded":"2024-09-13T18:27:02.562667+0000","last_fullsized":"2024-09-13T18:27:02.562667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:58.428945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563157+0000","last_change":"2024-09-13T18:27:01.307882+0000","last_active":"2024-09-13T18:27:02.563157+0000","last_peered":"2024-09-13T18:27:02.563157+0000","last_clean":"2024-09-13T18:27:02.563157+0000","last_became_active":"2024-09-13T18:27:01.307639+0000","last_became_peered":"2024-09-13T18:27:01.307639+0000","last_unstale":"2024-09-13T18:27:02.563157+0000","last_undegraded":"2024-09-13T18:27:02.563157+0000","last_fullsized":"2024-09-13T18:27:02.563157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:30.479538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.560713+0000","last_change":"2024-09-13T18:27:00.912694+0000","last_active":"2024-09-13T18:27:02.560713+0000","last_peered":"2024-09-13T18:27:02.560713+0000","last_clean":"2024-09-13T18:27:02.560713+0000","last_became_active":"2024-09-13T18:27:00.912437+0000","last_became_peered":"2024-09-13T18:27:00.912437+0000","last_unstale":"2024-09-13T18:27:02.560713+0000","last_undegraded":"2024-09-13T18:27:02.560713+0000","last_fullsized":"2024-09-13T18:27:02.560713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:03.783202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561673+0000","last_change":"2024-09-13T18:27:01.298321+0000","last_active":"2024-09-13T18:27:02.561673+0000","last_peered":"2024-09-13T18:27:02.561673+0000","last_clean":"2024-09-13T18:27:02.561673+0000","last_became_active":"2024-09-13T18:27:01.298027+0000","last_became_peered":"2024-09-13T18:27:01.298027+0000","last_unstale":"2024-09-13T18:27:02.561673+0000","last_undegraded":"2024-09-13T18:27:02.561673+0000","last_fullsized":"2024-09-13T18:27:02.561673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:04.793190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.287769+0000","last_change":"2024-09-13T18:27:00.910495+0000","last_active":"2024-09-13T18:27:02.287769+0000","last_peered":"2024-09-13T18:27:02.287769+0000","last_clean":"2024-09-13T18:27:02.287769+0000","last_became_active":"2024-09-13T18:27:00.910212+0000","last_became_peered":"2024-09-13T18:27:00.910212+0000","last_unstale":"2024-09-13T18:27:02.287769+0000","last_undegraded":"2024-09-13T18:27:02.287769+0000","last_fullsized":"2024-09-13T18:27:02.287769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:03.783202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288669+0000","last_change":"2024-09-13T18:27:01.292715+0000","last_active":"2024-09-13T18:27:02.288669+0000","last_peered":"2024-09-13T18:27:02.288669+0000","last_clean":"2024-09-13T18:27:02.288669+0000","last_became_active":"2024-09-13T18:27:01.292437+0000","last_became_peered":"2024-09-13T18:27:01.292437+0000","last_unstale":"2024-09-13T18:27:02.288669+0000","last_undegraded":"2024-09-13T18:27:02.288669+0000","last_fullsized":"2024-09-13T18:27:02.288669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:58.545057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.288228+0000","last_change":"2024-09-13T18:27:00.907866+0000","last_active":"2024-09-13T18:27:02.288228+0000","last_peered":"2024-09-13T18:27:02.288228+0000","last_clean":"2024-09-13T18:27:02.288228+0000","last_became_active":"2024-09-13T18:27:00.907562+0000","last_became_peered":"2024-09-13T18:27:00.907562+0000","last_unstale":"2024-09-13T18:27:02.288228+0000","last_undegraded":"2024-09-13T18:27:02.288228+0000","last_fullsized":"2024-09-13T18:27:02.288228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:58.428945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289387+0000","last_change":"2024-09-13T18:27:01.302235+0000","last_active":"2024-09-13T18:27:02.289387+0000","last_peered":"2024-09-13T18:27:02.289387+0000","last_clean":"2024-09-13T18:27:02.289387+0000","last_became_active":"2024-09-13T18:27:01.301993+0000","last_became_peered":"2024-09-13T18:27:01.301993+0000","last_unstale":"2024-09-13T18:27:02.289387+0000","last_undegraded":"2024-09-13T18:27:02.289387+0000","last_fullsized":"2024-09-13T18:27:02.289387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:36.752876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562564+0000","last_change":"2024-09-13T18:27:00.917608+0000","last_active":"2024-09-13T18:27:02.562564+0000","last_peered":"2024-09-13T18:27:02.562564+0000","last_clean":"2024-09-13T18:27:02.562564+0000","last_became_active":"2024-09-13T18:27:00.917334+0000","last_became_peered":"2024-09-13T18:27:00.917334+0000","last_unstale":"2024-09-13T18:27:02.562564+0000","last_undegraded":"2024-09-13T18:27:02.562564+0000","last_fullsized":"2024-09-13T18:27:02.562564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:53.385777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.561361+0000","last_change":"2024-09-13T18:27:01.303769+0000","last_active":"2024-09-13T18:27:02.561361+0000","last_peered":"2024-09-13T18:27:02.561361+0000","last_clean":"2024-09-13T18:27:02.561361+0000","last_became_active":"2024-09-13T18:27:01.303409+0000","last_became_peered":"2024-09-13T18:27:01.303409+0000","last_unstale":"2024-09-13T18:27:02.561361+0000","last_undegraded":"2024-09-13T18:27:02.561361+0000","last_fullsized":"2024-09-13T18:27:02.561361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:58.545057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286775+0000","last_change":"2024-09-13T18:27:01.298238+0000","last_active":"2024-09-13T18:27:02.286775+0000","last_peered":"2024-09-13T18:27:02.286775+0000","last_clean":"2024-09-13T18:27:02.286775+0000","last_became_active":"2024-09-13T18:27:01.297937+0000","last_became_peered":"2024-09-13T18:27:01.297937+0000","last_unstale":"2024-09-13T18:27:02.286775+0000","last_undegraded":"2024-09-13T18:27:02.286775+0000","last_fullsized":"2024-09-13T18:27:02.286775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:36.752876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563094+0000","last_change":"2024-09-13T18:27:00.914839+0000","last_active":"2024-09-13T18:27:02.563094+0000","last_peered":"2024-09-13T18:27:02.563094+0000","last_clean":"2024-09-13T18:27:02.563094+0000","last_became_active":"2024-09-13T18:27:00.914550+0000","last_became_peered":"2024-09-13T18:27:00.914550+0000","last_unstale":"2024-09-13T18:27:02.563094+0000","last_undegraded":"2024-09-13T18:27:02.563094+0000","last_fullsized":"2024-09-13T18:27:02.563094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.933818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.286874+0000","last_change":"2024-09-13T18:27:01.302873+0000","last_active":"2024-09-13T18:27:02.286874+0000","last_peered":"2024-09-13T18:27:02.286874+0000","last_clean":"2024-09-13T18:27:02.286874+0000","last_became_active":"2024-09-13T18:27:01.301780+0000","last_became_peered":"2024-09-13T18:27:01.301780+0000","last_unstale":"2024-09-13T18:27:02.286874+0000","last_undegraded":"2024-09-13T18:27:02.286874+0000","last_fullsized":"2024-09-13T18:27:02.286874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:17.450610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563342+0000","last_change":"2024-09-13T18:27:00.912304+0000","last_active":"2024-09-13T18:27:02.563342+0000","last_peered":"2024-09-13T18:27:02.563342+0000","last_clean":"2024-09-13T18:27:02.563342+0000","last_became_active":"2024-09-13T18:27:00.911868+0000","last_became_peered":"2024-09-13T18:27:00.911868+0000","last_unstale":"2024-09-13T18:27:02.563342+0000","last_undegraded":"2024-09-13T18:27:02.563342+0000","last_fullsized":"2024-09-13T18:27:02.563342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:58.428945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.562947+0000","last_change":"2024-09-13T18:27:01.302701+0000","last_active":"2024-09-13T18:27:02.562947+0000","last_peered":"2024-09-13T18:27:02.562947+0000","last_clean":"2024-09-13T18:27:02.562947+0000","last_became_active":"2024-09-13T18:27:01.301626+0000","last_became_peered":"2024-09-13T18:27:01.301626+0000","last_unstale":"2024-09-13T18:27:02.562947+0000","last_undegraded":"2024-09-13T18:27:02.562947+0000","last_fullsized":"2024-09-13T18:27:02.562947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:26.451272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289813+0000","last_change":"2024-09-13T18:27:00.913872+0000","last_active":"2024-09-13T18:27:02.289813+0000","last_peered":"2024-09-13T18:27:02.289813+0000","last_clean":"2024-09-13T18:27:02.289813+0000","last_became_active":"2024-09-13T18:27:00.913585+0000","last_became_peered":"2024-09-13T18:27:00.913585+0000","last_unstale":"2024-09-13T18:27:02.289813+0000","last_undegraded":"2024-09-13T18:27:02.289813+0000","last_fullsized":"2024-09-13T18:27:02.289813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:15.665610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.289768+0000","last_change":"2024-09-13T18:27:01.301513+0000","last_active":"2024-09-13T18:27:02.289768+0000","last_peered":"2024-09-13T18:27:02.289768+0000","last_clean":"2024-09-13T18:27:02.289768+0000","last_became_active":"2024-09-13T18:27:01.301080+0000","last_became_peered":"2024-09-13T18:27:01.301080+0000","last_unstale":"2024-09-13T18:27:02.289768+0000","last_undegraded":"2024-09-13T18:27:02.289768+0000","last_fullsized":"2024-09-13T18:27:02.289768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:27:00.879049+0000","last_clean_scrub_stamp":"2024-09-13T18:27:00.879049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:07.409290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:27:02.563285+0000","last_change":"2024-09-13T18:27:00.913198+0000","last_active":"2024-09-13T18:27:02.563285+0000","last_peered":"2024-09-13T18:27:02.563285+0000","last_clean":"2024-09-13T18:27:02.563285+0000","last_became_active":"2024-09-13T18:27:00.912840+0000","last_became_peered":"2024-09-13T18:27:00.912840+0000","last_unstale":"2024-09-13T18:27:02.563285+0000","last_undegraded":"2024-09-13T18:27:02.563285+0000","last_fullsized":"2024-09-13T18:27:02.563285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:59.869061+0000","last_clean_scrub_stamp":"2024-09-13T18:26:59.869061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:25.457724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4450000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6679999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":823296,"data_stored":666575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:27:14.309 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T18:27:14.310 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T18:27:14.310 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T18:27:14.310 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T18:27:14.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.407+0000 7efee4884700 1 Processor -- start 2024-09-13T18:27:14.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.407+0000 7efee4884700 1 -- start start 2024-09-13T18:27:14.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efee4884700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efee006baa0 0x7efee006ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:14.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efee4884700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efee00ce240 0x7efee00ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:14.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efee4884700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee015d160 con 0x7efee015cd80 2024-09-13T18:27:14.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efee4884700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee00d1570 con 0x7efee006baa0 2024-09-13T18:27:14.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efee4884700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee00d25b0 con 0x7efee00ce240 2024-09-13T18:27:14.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efedffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efee00ce240 0x7efee00ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:14.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efedffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efee00ce240 0x7efee00ce6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:57860/0 (socket says 172.21.15.44:57860) 2024-09-13T18:27:14.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efedf7fe700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7efee015cd80 0x7efee006a640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:36102/0 (socket says 172.21.15.44:36102) 2024-09-13T18:27:14.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efedeffd700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efee006baa0 0x7efee006ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:14.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efedffff700 1 -- 172.21.15.44:0/2432768728 learned_addr learned my addr 172.21.15.44:0/2432768728 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:14.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efede7fc700 1 -- 172.21.15.44:0/2432768728 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372692227 0 0) 0x7efee015d160 con 0x7efee015cd80 2024-09-13T18:27:14.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efede7fc700 1 -- 172.21.15.44:0/2432768728 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efecc0035d0 con 0x7efee015cd80 2024-09-13T18:27:14.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efedffff700 1 -- 172.21.15.44:0/2432768728 >> v2:172.21.15.99:3300/0 conn(0x7efee006baa0 msgr2=0x7efee006ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:14.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efedffff700 1 --2- 172.21.15.44:0/2432768728 >> v2:172.21.15.99:3300/0 conn(0x7efee006baa0 0x7efee006ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efedffff700 1 -- 172.21.15.44:0/2432768728 >> v1:172.21.15.99:6789/0 conn(0x7efee015cd80 legacy=0x7efee006a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:14.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efedffff700 1 -- 172.21.15.44:0/2432768728 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee00d2120 con 0x7efee00ce240 2024-09-13T18:27:14.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efedffff700 1 --2- 172.21.15.44:0/2432768728 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efee00ce240 0x7efee00ce6d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efed8009e50 tx=0x7efed800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b23498fc6d905a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:14.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efede7fc700 1 -- 172.21.15.44:0/2432768728 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed800e070 con 0x7efee00ce240 2024-09-13T18:27:14.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efede7fc700 1 -- 172.21.15.44:0/2432768728 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed800b910 con 0x7efee00ce240 2024-09-13T18:27:14.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efede7fc700 1 -- 172.21.15.44:0/2432768728 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed800bc80 con 0x7efee00ce240 2024-09-13T18:27:14.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efee4884700 1 -- 172.21.15.44:0/2432768728 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efee00ce240 msgr2=0x7efee00ce6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:14.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efee4884700 1 --2- 172.21.15.44:0/2432768728 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efee00ce240 0x7efee00ce6d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efed8009e50 tx=0x7efed800b330 comp rx=0 tx=0).stop 2024-09-13T18:27:14.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efee4884700 1 -- 172.21.15.44:0/2432768728 shutdown_connections 2024-09-13T18:27:14.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efee4884700 1 --2- 172.21.15.44:0/2432768728 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efee00ce240 0x7efee00ce6d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efee4884700 1 --2- 172.21.15.44:0/2432768728 >> v2:172.21.15.99:3300/0 conn(0x7efee006baa0 0x7efee006ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efee4884700 1 -- 172.21.15.44:0/2432768728 >> 172.21.15.44:0/2432768728 conn(0x7efee00d30b0 msgr2=0x7efee00d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:14.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efee4884700 1 -- 172.21.15.44:0/2432768728 shutdown_connections 2024-09-13T18:27:14.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.411+0000 7efee4884700 1 -- 172.21.15.44:0/2432768728 wait complete. 2024-09-13T18:27:14.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.415+0000 7efee4884700 1 Processor -- start 2024-09-13T18:27:14.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.415+0000 7efee4884700 1 -- start start 2024-09-13T18:27:14.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.415+0000 7efee4884700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efee006baa0 0x7efee00abca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:14.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.415+0000 7efee4884700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efee00ce240 0x7efee01f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:14.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.415+0000 7efee4884700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efee015cd80 0x7efee015f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:14.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.415+0000 7efee4884700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee00a9610 con 0x7efee006baa0 2024-09-13T18:27:14.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.415+0000 7efee4884700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee00aa190 con 0x7efee00ce240 2024-09-13T18:27:14.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.415+0000 7efee4884700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee00a9860 con 0x7efee015cd80 2024-09-13T18:27:14.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.415+0000 7efedf7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efee006baa0 0x7efee00abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:14.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.415+0000 7efedf7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efee006baa0 0x7efee00abca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41638/0 (socket says 172.21.15.44:41638) 2024-09-13T18:27:14.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.415+0000 7efedf7fe700 1 -- 172.21.15.44:0/504191825 learned_addr learned my addr 172.21.15.44:0/504191825 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:14.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.419+0000 7efedffff700 1 --2- 172.21.15.44:0/504191825 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efee015cd80 0x7efee015f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:14.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.419+0000 7efedeffd700 1 --2- 172.21.15.44:0/504191825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efee00ce240 0x7efee01f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:14.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.419+0000 7efedffff700 1 -- 172.21.15.44:0/504191825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efee00ce240 msgr2=0x7efee01f22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:14.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.419+0000 7efedffff700 1 --2- 172.21.15.44:0/504191825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efee00ce240 0x7efee01f22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.419+0000 7efedffff700 1 -- 172.21.15.44:0/504191825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efee006baa0 msgr2=0x7efee00abca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:14.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.419+0000 7efedffff700 1 --2- 172.21.15.44:0/504191825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efee006baa0 0x7efee00abca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.419+0000 7efedffff700 1 -- 172.21.15.44:0/504191825 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed8009b30 con 0x7efee015cd80 2024-09-13T18:27:14.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.419+0000 7efedf7fe700 1 --2- 172.21.15.44:0/504191825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efee006baa0 0x7efee00abca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:14.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.419+0000 7efedffff700 1 --2- 172.21.15.44:0/504191825 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efee015cd80 0x7efee015f220 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efed8015000 tx=0x7efed8004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:14.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.419+0000 7efed7fff700 1 -- 172.21.15.44:0/504191825 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed8007000 con 0x7efee015cd80 2024-09-13T18:27:14.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.419+0000 7efed7fff700 1 -- 172.21.15.44:0/504191825 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed8004880 con 0x7efee015cd80 2024-09-13T18:27:14.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.419+0000 7efee4884700 1 -- 172.21.15.44:0/504191825 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee00a9b40 con 0x7efee015cd80 2024-09-13T18:27:14.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.419+0000 7efed7fff700 1 -- 172.21.15.44:0/504191825 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed801c680 con 0x7efee015cd80 2024-09-13T18:27:14.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.419+0000 7efee4884700 1 -- 172.21.15.44:0/504191825 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee00ac1e0 con 0x7efee015cd80 2024-09-13T18:27:14.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.419+0000 7efee4884700 1 -- 172.21.15.44:0/504191825 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee00ce6d0 con 0x7efee015cd80 2024-09-13T18:27:14.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.419+0000 7efed7fff700 1 -- 172.21.15.44:0/504191825 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efed801c7e0 con 0x7efee015cd80 2024-09-13T18:27:14.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.423+0000 7efed7fff700 1 --2- 172.21.15.44:0/504191825 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efec0066730 0x7efec0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:14.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.423+0000 7efed7fff700 1 -- 172.21.15.44:0/504191825 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efed8085520 con 0x7efee015cd80 2024-09-13T18:27:14.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.423+0000 7efedf7fe700 1 --2- 172.21.15.44:0/504191825 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efec0066730 0x7efec0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:14.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.423+0000 7efedf7fe700 1 --2- 172.21.15.44:0/504191825 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efec0066730 0x7efec0068bf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efed00011e0 tx=0x7efed0007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:14.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.435+0000 7efed7fff700 1 -- 172.21.15.44:0/504191825 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efed8052890 con 0x7efee015cd80 2024-09-13T18:27:14.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.635+0000 7efee4884700 1 -- 172.21.15.44:0/504191825 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7efee00aa2d0 con 0x7efee015cd80 2024-09-13T18:27:14.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.635+0000 7efed7fff700 1 -- 172.21.15.44:0/504191825 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7efed8055eb0 con 0x7efee015cd80 2024-09-13T18:27:14.639 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:14.639 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T18:27:14.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.639+0000 7efee4884700 1 -- 172.21.15.44:0/504191825 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efec0066730 msgr2=0x7efec0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:14.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.639+0000 7efee4884700 1 --2- 172.21.15.44:0/504191825 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efec0066730 0x7efec0068bf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efed00011e0 tx=0x7efed0007ea0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.639+0000 7efee4884700 1 -- 172.21.15.44:0/504191825 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efee015cd80 msgr2=0x7efee015f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:14.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.639+0000 7efee4884700 1 --2- 172.21.15.44:0/504191825 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efee015cd80 0x7efee015f220 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efed8015000 tx=0x7efed8004af0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.639+0000 7efee4884700 1 -- 172.21.15.44:0/504191825 shutdown_connections 2024-09-13T18:27:14.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.639+0000 7efee4884700 1 --2- 172.21.15.44:0/504191825 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efec0066730 0x7efec0068bf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.639+0000 7efee4884700 1 --2- 172.21.15.44:0/504191825 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efee015cd80 0x7efee015f220 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.639+0000 7efee4884700 1 --2- 172.21.15.44:0/504191825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efee00ce240 0x7efee01f22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.639+0000 7efee4884700 1 --2- 172.21.15.44:0/504191825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efee006baa0 0x7efee00abca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.639+0000 7efee4884700 1 -- 172.21.15.44:0/504191825 >> 172.21.15.44:0/504191825 conn(0x7efee00d30b0 msgr2=0x7efee00b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:14.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.639+0000 7efee4884700 1 -- 172.21.15.44:0/504191825 shutdown_connections 2024-09-13T18:27:14.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.639+0000 7efee4884700 1 -- 172.21.15.44:0/504191825 wait complete. 2024-09-13T18:27:14.657 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T18:27:14.657 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:14.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.759+0000 7f8a23fff700 1 Processor -- start 2024-09-13T18:27:14.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.759+0000 7f8a23fff700 1 -- start start 2024-09-13T18:27:14.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.759+0000 7f8a23fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8a240cdad0 0x7f8a240cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:14.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.759+0000 7f8a23fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a24071c90 0x7f8a240720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:14.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.759+0000 7f8a23fff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2415e080 con 0x7f8a24153ba0 2024-09-13T18:27:14.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.759+0000 7f8a23fff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a240ccde0 con 0x7f8a240cdad0 2024-09-13T18:27:14.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.759+0000 7f8a23fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a24072610 con 0x7f8a24071c90 2024-09-13T18:27:14.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.759+0000 7f8a1a7fc700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8a240cdad0 0x7f8a240cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:14.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.759+0000 7f8a1a7fc700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8a240cdad0 0x7f8a240cdf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41642/0 (socket says 172.21.15.44:41642) 2024-09-13T18:27:14.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.759+0000 7f8a1a7fc700 1 -- 172.21.15.44:0/3759774827 learned_addr learned my addr 172.21.15.44:0/3759774827 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:14.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.759+0000 7f8a237fe700 1 --2- 172.21.15.44:0/3759774827 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a24071c90 0x7f8a240720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:14.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.759+0000 7f8a1a7fc700 1 -- 172.21.15.44:0/3759774827 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a24071c90 msgr2=0x7f8a240720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:14.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.759+0000 7f8a1a7fc700 1 --2- 172.21.15.44:0/3759774827 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a24071c90 0x7f8a240720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.759+0000 7f8a1a7fc700 1 -- 172.21.15.44:0/3759774827 >> v1:172.21.15.44:6789/0 conn(0x7f8a24153ba0 legacy=0x7f8a240c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:14.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.759+0000 7f8a1a7fc700 1 -- 172.21.15.44:0/3759774827 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a24160a60 con 0x7f8a240cdad0 2024-09-13T18:27:14.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.763+0000 7f8a237fe700 1 --2- 172.21.15.44:0/3759774827 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a24071c90 0x7f8a240720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:14.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.763+0000 7f8a1a7fc700 1 --2- 172.21.15.44:0/3759774827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a240cdad0 0x7f8a240cdf20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009910 tx=0x7f8a0c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953f1af4ef0b8e74 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:14.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.763+0000 7f8a227fc700 1 -- 172.21.15.44:0/3759774827 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c00ba60 con 0x7f8a240cdad0 2024-09-13T18:27:14.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.763+0000 7f8a227fc700 1 -- 172.21.15.44:0/3759774827 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c00bbc0 con 0x7f8a240cdad0 2024-09-13T18:27:14.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.763+0000 7f8a227fc700 1 -- 172.21.15.44:0/3759774827 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c009e60 con 0x7f8a240cdad0 2024-09-13T18:27:14.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.763+0000 7f8a23fff700 1 -- 172.21.15.44:0/3759774827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a240cdad0 msgr2=0x7f8a240cdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:14.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.763+0000 7f8a23fff700 1 --2- 172.21.15.44:0/3759774827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a240cdad0 0x7f8a240cdf20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009910 tx=0x7f8a0c009c20 comp rx=0 tx=0).stop 2024-09-13T18:27:14.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.763+0000 7f8a23fff700 1 -- 172.21.15.44:0/3759774827 shutdown_connections 2024-09-13T18:27:14.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.763+0000 7f8a23fff700 1 --2- 172.21.15.44:0/3759774827 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a24071c90 0x7f8a240720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.763+0000 7f8a23fff700 1 --2- 172.21.15.44:0/3759774827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a240cdad0 0x7f8a240cdf20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.763+0000 7f8a23fff700 1 -- 172.21.15.44:0/3759774827 >> 172.21.15.44:0/3759774827 conn(0x7f8a2406a310 msgr2=0x7f8a2406a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:14.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.763+0000 7f8a23fff700 1 -- 172.21.15.44:0/3759774827 shutdown_connections 2024-09-13T18:27:14.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.763+0000 7f8a23fff700 1 -- 172.21.15.44:0/3759774827 wait complete. 2024-09-13T18:27:14.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.763+0000 7f8a23fff700 1 Processor -- start 2024-09-13T18:27:14.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.763+0000 7f8a23fff700 1 -- start start 2024-09-13T18:27:14.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a23fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a24071c90 0x7f8a24147650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a23fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a24153ba0 0x7f8a2415ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a23fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a2415b6b0 0x7f8a2415bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a23fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2415c080 con 0x7f8a2415b6b0 2024-09-13T18:27:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a23fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a24154190 con 0x7f8a24153ba0 2024-09-13T18:27:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a23fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2414cc30 con 0x7f8a24071c90 2024-09-13T18:27:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a237fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a2415b6b0 0x7f8a2415bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a237fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a2415b6b0 0x7f8a2415bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41644/0 (socket says 172.21.15.44:41644) 2024-09-13T18:27:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a237fe700 1 -- 172.21.15.44:0/1006840081 learned_addr learned my addr 172.21.15.44:0/1006840081 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a22ffd700 1 --2- 172.21.15.44:0/1006840081 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a24071c90 0x7f8a24147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a1a7fc700 1 --2- 172.21.15.44:0/1006840081 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a24153ba0 0x7f8a2415ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a237fe700 1 -- 172.21.15.44:0/1006840081 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a24071c90 msgr2=0x7f8a24147650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a237fe700 1 --2- 172.21.15.44:0/1006840081 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a24071c90 0x7f8a24147650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a237fe700 1 -- 172.21.15.44:0/1006840081 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a24153ba0 msgr2=0x7f8a2415ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a237fe700 1 --2- 172.21.15.44:0/1006840081 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a24153ba0 0x7f8a2415ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a237fe700 1 -- 172.21.15.44:0/1006840081 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c009570 con 0x7f8a2415b6b0 2024-09-13T18:27:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a22ffd700 1 --2- 172.21.15.44:0/1006840081 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a24071c90 0x7f8a24147650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a237fe700 1 --2- 172.21.15.44:0/1006840081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a2415b6b0 0x7f8a2415bb40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00cf20 tx=0x7f8a1c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a1bfff700 1 -- 172.21.15.44:0/1006840081 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c00ae80 con 0x7f8a2415b6b0 2024-09-13T18:27:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a1bfff700 1 -- 172.21.15.44:0/1006840081 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c015440 con 0x7f8a2415b6b0 2024-09-13T18:27:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a23fff700 1 -- 172.21.15.44:0/1006840081 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2415ff50 con 0x7f8a2415b6b0 2024-09-13T18:27:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a1bfff700 1 -- 172.21.15.44:0/1006840081 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0157d0 con 0x7f8a2415b6b0 2024-09-13T18:27:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a23fff700 1 -- 172.21.15.44:0/1006840081 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a24160510 con 0x7f8a2415b6b0 2024-09-13T18:27:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.767+0000 7f8a23fff700 1 -- 172.21.15.44:0/1006840081 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a24153f80 con 0x7f8a2415b6b0 2024-09-13T18:27:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.771+0000 7f8a1bfff700 1 -- 172.21.15.44:0/1006840081 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8a1c00d430 con 0x7f8a2415b6b0 2024-09-13T18:27:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.771+0000 7f8a1bfff700 1 --2- 172.21.15.44:0/1006840081 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8a04066730 0x7f8a04068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.771+0000 7f8a1bfff700 1 -- 172.21.15.44:0/1006840081 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a1c084700 con 0x7f8a2415b6b0 2024-09-13T18:27:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.771+0000 7f8a22ffd700 1 --2- 172.21.15.44:0/1006840081 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8a04066730 0x7f8a04068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.771+0000 7f8a22ffd700 1 --2- 172.21.15.44:0/1006840081 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8a04066730 0x7f8a04068bf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8a14000f60 tx=0x7f8a14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.779+0000 7f8a1bfff700 1 -- 172.21.15.44:0/1006840081 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8a1c051a70 con 0x7f8a2415b6b0 2024-09-13T18:27:14.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.951+0000 7f8a23fff700 1 -- 172.21.15.44:0/1006840081 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a2414cd70 con 0x7f8a2415b6b0 2024-09-13T18:27:14.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.951+0000 7f8a1bfff700 1 -- 172.21.15.44:0/1006840081 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f8a1c01a090 con 0x7f8a2415b6b0 2024-09-13T18:27:14.958 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:14.958 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:02.280221+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:14.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.955+0000 7f8a23fff700 1 -- 172.21.15.44:0/1006840081 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8a04066730 msgr2=0x7f8a04068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:14.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.955+0000 7f8a23fff700 1 --2- 172.21.15.44:0/1006840081 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8a04066730 0x7f8a04068bf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8a14000f60 tx=0x7f8a14009040 comp rx=0 tx=0).stop 2024-09-13T18:27:14.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.955+0000 7f8a23fff700 1 -- 172.21.15.44:0/1006840081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a2415b6b0 msgr2=0x7f8a2415bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:14.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.955+0000 7f8a23fff700 1 --2- 172.21.15.44:0/1006840081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a2415b6b0 0x7f8a2415bb40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00cf20 tx=0x7f8a1c00a340 comp rx=0 tx=0).stop 2024-09-13T18:27:14.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.955+0000 7f8a23fff700 1 -- 172.21.15.44:0/1006840081 shutdown_connections 2024-09-13T18:27:14.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.955+0000 7f8a23fff700 1 --2- 172.21.15.44:0/1006840081 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8a04066730 0x7f8a04068bf0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.955+0000 7f8a23fff700 1 --2- 172.21.15.44:0/1006840081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a2415b6b0 0x7f8a2415bb40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.955+0000 7f8a23fff700 1 --2- 172.21.15.44:0/1006840081 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a24153ba0 0x7f8a2415ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.955+0000 7f8a23fff700 1 --2- 172.21.15.44:0/1006840081 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a24071c90 0x7f8a24147650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.955+0000 7f8a23fff700 1 -- 172.21.15.44:0/1006840081 >> 172.21.15.44:0/1006840081 conn(0x7f8a2406a310 msgr2=0x7f8a2406a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:14.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.955+0000 7f8a23fff700 1 -- 172.21.15.44:0/1006840081 shutdown_connections 2024-09-13T18:27:14.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:14.955+0000 7f8a23fff700 1 -- 172.21.15.44:0/1006840081 wait complete. 2024-09-13T18:27:14.971 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:26:59.478511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:27:00.261038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:27:14.972 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:27:15.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.083+0000 7f07ab59e700 1 Processor -- start 2024-09-13T18:27:15.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.083+0000 7f07ab59e700 1 -- start start 2024-09-13T18:27:15.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.083+0000 7f07ab59e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f07ac0cc1c0 0x7f07ac06e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:15.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.083+0000 7f07ab59e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f07ac06e550 0x7f07ac0b2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:15.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.083+0000 7f07ab59e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07ac06e9a0 con 0x7f07ac159810 2024-09-13T18:27:15.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.083+0000 7f07ab59e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07ac0cc600 con 0x7f07ac0cc1c0 2024-09-13T18:27:15.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.083+0000 7f07ab59e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07ac15d790 con 0x7f07ac06e550 2024-09-13T18:27:15.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.083+0000 7f07aa59c700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f07ac159810 0x7f07ac0cb330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44824/0 (socket says 172.21.15.44:44824) 2024-09-13T18:27:15.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.083+0000 7f07aa59c700 1 -- 172.21.15.44:0/3001500433 learned_addr learned my addr 172.21.15.44:0/3001500433 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:15.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.083+0000 7f07a3fff700 1 --2- 172.21.15.44:0/3001500433 >> v2:172.21.15.44:3300/0 conn(0x7f07ac0cc1c0 0x7f07ac06e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:15.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.083+0000 7f07aad9d700 1 --2- 172.21.15.44:0/3001500433 >> v2:172.21.15.99:3300/0 conn(0x7f07ac06e550 0x7f07ac0b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:15.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.083+0000 7f07a9d9b700 1 -- 172.21.15.44:0/3001500433 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473568805 0 0) 0x7f079c001110 con 0x7f07ac159810 2024-09-13T18:27:15.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.087+0000 7f07a9d9b700 1 -- 172.21.15.44:0/3001500433 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07980035d0 con 0x7f07ac159810 2024-09-13T18:27:15.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.087+0000 7f07a3fff700 1 -- 172.21.15.44:0/3001500433 >> v2:172.21.15.99:3300/0 conn(0x7f07ac06e550 msgr2=0x7f07ac0b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:15.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.087+0000 7f07a3fff700 1 --2- 172.21.15.44:0/3001500433 >> v2:172.21.15.99:3300/0 conn(0x7f07ac06e550 0x7f07ac0b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.087+0000 7f07a3fff700 1 -- 172.21.15.44:0/3001500433 >> v1:172.21.15.44:6789/0 conn(0x7f07ac159810 legacy=0x7f07ac0cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:15.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.087+0000 7f07a3fff700 1 -- 172.21.15.44:0/3001500433 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ac15da70 con 0x7f07ac0cc1c0 2024-09-13T18:27:15.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.087+0000 7f07a3fff700 1 --2- 172.21.15.44:0/3001500433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07ac0cc1c0 0x7f07ac06e010 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0700e0 tx=0x7f0794009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2495fbd8533afd43 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:15.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.087+0000 7f07a9d9b700 1 -- 172.21.15.44:0/3001500433 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0794011830 con 0x7f07ac0cc1c0 2024-09-13T18:27:15.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.087+0000 7f07a9d9b700 1 -- 172.21.15.44:0/3001500433 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0794011990 con 0x7f07ac0cc1c0 2024-09-13T18:27:15.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.087+0000 7f07a9d9b700 1 -- 172.21.15.44:0/3001500433 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0794011d20 con 0x7f07ac0cc1c0 2024-09-13T18:27:15.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.087+0000 7f07ab59e700 1 -- 172.21.15.44:0/3001500433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07ac0cc1c0 msgr2=0x7f07ac06e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:15.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.087+0000 7f07ab59e700 1 --2- 172.21.15.44:0/3001500433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07ac0cc1c0 0x7f07ac06e010 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0700e0 tx=0x7f0794009b30 comp rx=0 tx=0).stop 2024-09-13T18:27:15.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.087+0000 7f07ab59e700 1 -- 172.21.15.44:0/3001500433 shutdown_connections 2024-09-13T18:27:15.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.087+0000 7f07ab59e700 1 --2- 172.21.15.44:0/3001500433 >> v2:172.21.15.99:3300/0 conn(0x7f07ac06e550 0x7f07ac0b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.087+0000 7f07ab59e700 1 --2- 172.21.15.44:0/3001500433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07ac0cc1c0 0x7f07ac06e010 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.087+0000 7f07ab59e700 1 -- 172.21.15.44:0/3001500433 >> 172.21.15.44:0/3001500433 conn(0x7f07ac0cf670 msgr2=0x7f07ac06d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:15.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.087+0000 7f07ab59e700 1 -- 172.21.15.44:0/3001500433 shutdown_connections 2024-09-13T18:27:15.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.087+0000 7f07ab59e700 1 -- 172.21.15.44:0/3001500433 wait complete. 2024-09-13T18:27:15.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.087+0000 7f07ab59e700 1 Processor -- start 2024-09-13T18:27:15.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.087+0000 7f07ab59e700 1 -- start start 2024-09-13T18:27:15.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07ab59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07ac06e550 0x7f07ac1489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:15.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07ab59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f07ac0cc1c0 0x7f07ac14e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:15.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07ab59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07ac159810 0x7f07ac14c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:15.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07ab59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac14df90 con 0x7f07ac06e550 2024-09-13T18:27:15.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07ab59e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac14e960 con 0x7f07ac159810 2024-09-13T18:27:15.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07ab59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac14d380 con 0x7f07ac0cc1c0 2024-09-13T18:27:15.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07aa59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07ac06e550 0x7f07ac1489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:15.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07aa59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07ac06e550 0x7f07ac1489b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41656/0 (socket says 172.21.15.44:41656) 2024-09-13T18:27:15.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07aa59c700 1 -- 172.21.15.44:0/3261387329 learned_addr learned my addr 172.21.15.44:0/3261387329 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:15.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07a3fff700 1 --2- 172.21.15.44:0/3261387329 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f07ac0cc1c0 0x7f07ac14e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:15.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07aad9d700 1 --2- 172.21.15.44:0/3261387329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07ac159810 0x7f07ac14c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:15.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07aa59c700 1 -- 172.21.15.44:0/3261387329 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f07ac0cc1c0 msgr2=0x7f07ac14e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:15.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07aa59c700 1 --2- 172.21.15.44:0/3261387329 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f07ac0cc1c0 0x7f07ac14e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07aa59c700 1 -- 172.21.15.44:0/3261387329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07ac159810 msgr2=0x7f07ac14c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:15.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07aa59c700 1 --2- 172.21.15.44:0/3261387329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07ac159810 0x7f07ac14c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07aa59c700 1 -- 172.21.15.44:0/3261387329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07940094b0 con 0x7f07ac06e550 2024-09-13T18:27:15.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07a3fff700 1 --2- 172.21.15.44:0/3261387329 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f07ac0cc1c0 0x7f07ac14e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:15.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07aad9d700 1 --2- 172.21.15.44:0/3261387329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07ac159810 0x7f07ac14c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:15.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07aa59c700 1 --2- 172.21.15.44:0/3261387329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07ac06e550 0x7f07ac1489b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f079c00c700 tx=0x7f079c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:15.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07a2ffd700 1 -- 172.21.15.44:0/3261387329 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c005d90 con 0x7f07ac06e550 2024-09-13T18:27:15.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07a2ffd700 1 -- 172.21.15.44:0/3261387329 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079c0070d0 con 0x7f07ac06e550 2024-09-13T18:27:15.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07ab59e700 1 -- 172.21.15.44:0/3261387329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07ac14d660 con 0x7f07ac06e550 2024-09-13T18:27:15.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07a2ffd700 1 -- 172.21.15.44:0/3261387329 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c007480 con 0x7f07ac06e550 2024-09-13T18:27:15.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07ab59e700 1 -- 172.21.15.44:0/3261387329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ac14dc20 con 0x7f07ac06e550 2024-09-13T18:27:15.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.091+0000 7f07ab59e700 1 -- 172.21.15.44:0/3261387329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07ac0cee20 con 0x7f07ac06e550 2024-09-13T18:27:15.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.095+0000 7f07a2ffd700 1 -- 172.21.15.44:0/3261387329 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f079c0075e0 con 0x7f07ac06e550 2024-09-13T18:27:15.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.095+0000 7f07a2ffd700 1 --2- 172.21.15.44:0/3261387329 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f078c066730 0x7f078c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:15.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.095+0000 7f07a2ffd700 1 -- 172.21.15.44:0/3261387329 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f079c083540 con 0x7f07ac06e550 2024-09-13T18:27:15.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.095+0000 7f07a3fff700 1 --2- 172.21.15.44:0/3261387329 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f078c066730 0x7f078c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:15.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.095+0000 7f07a3fff700 1 --2- 172.21.15.44:0/3261387329 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f078c066730 0x7f078c068bf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f07ac157f00 tx=0x7f0794008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:15.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.099+0000 7f07a2ffd700 1 -- 172.21.15.44:0/3261387329 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f079c0508c0 con 0x7f07ac06e550 2024-09-13T18:27:15.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.267+0000 7f07ab59e700 1 -- 172.21.15.44:0/3261387329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f07ac06e9a0 con 0x7f07ac06e550 2024-09-13T18:27:15.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.267+0000 7f07a2ffd700 1 -- 172.21.15.44:0/3261387329 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f07ac06e9a0 con 0x7f07ac06e550 2024-09-13T18:27:15.271 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:27:15.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.267+0000 7f07ab59e700 1 -- 172.21.15.44:0/3261387329 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f078c066730 msgr2=0x7f078c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:15.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.267+0000 7f07ab59e700 1 --2- 172.21.15.44:0/3261387329 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f078c066730 0x7f078c068bf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f07ac157f00 tx=0x7f0794008030 comp rx=0 tx=0).stop 2024-09-13T18:27:15.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.267+0000 7f07ab59e700 1 -- 172.21.15.44:0/3261387329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07ac06e550 msgr2=0x7f07ac1489b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:15.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.267+0000 7f07ab59e700 1 --2- 172.21.15.44:0/3261387329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07ac06e550 0x7f07ac1489b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f079c00c700 tx=0x7f079c00cac0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.267+0000 7f07ab59e700 1 -- 172.21.15.44:0/3261387329 shutdown_connections 2024-09-13T18:27:15.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.267+0000 7f07ab59e700 1 --2- 172.21.15.44:0/3261387329 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f078c066730 0x7f078c068bf0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.267+0000 7f07ab59e700 1 --2- 172.21.15.44:0/3261387329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07ac159810 0x7f07ac14c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.267+0000 7f07ab59e700 1 --2- 172.21.15.44:0/3261387329 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f07ac0cc1c0 0x7f07ac14e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.267+0000 7f07ab59e700 1 --2- 172.21.15.44:0/3261387329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07ac06e550 0x7f07ac1489b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.267+0000 7f07ab59e700 1 -- 172.21.15.44:0/3261387329 >> 172.21.15.44:0/3261387329 conn(0x7f07ac0cf670 msgr2=0x7f07ac071cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:15.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.267+0000 7f07ab59e700 1 -- 172.21.15.44:0/3261387329 shutdown_connections 2024-09-13T18:27:15.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.267+0000 7f07ab59e700 1 -- 172.21.15.44:0/3261387329 wait complete. 2024-09-13T18:27:15.285 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:27:15.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.403+0000 7f46a24db700 1 Processor -- start 2024-09-13T18:27:15.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.403+0000 7f46a24db700 1 -- start start 2024-09-13T18:27:15.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.403+0000 7f46a24db700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f469c15d690 0x7f469c1656c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:15.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.403+0000 7f46a24db700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469c151e90 con 0x7f469c0d0860 2024-09-13T18:27:15.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.403+0000 7f46a24db700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469c0d0f90 con 0x7f469c0b5c70 2024-09-13T18:27:15.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.403+0000 7f46a24db700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0d1270 con 0x7f469c15d690 2024-09-13T18:27:15.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.403+0000 7f469b7fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f469c0d0860 0x7f469c15b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44834/0 (socket says 172.21.15.44:44834) 2024-09-13T18:27:15.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.403+0000 7f469b7fe700 1 -- 172.21.15.44:0/653984023 learned_addr learned my addr 172.21.15.44:0/653984023 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:15.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.403+0000 7f46a0a78700 1 --2- 172.21.15.44:0/653984023 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f469c15d690 0x7f469c1656c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:15.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.407+0000 7f469affd700 1 -- 172.21.15.44:0/653984023 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691519698 0 0) 0x7f469c151e90 con 0x7f469c0d0860 2024-09-13T18:27:15.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.407+0000 7f469affd700 1 -- 172.21.15.44:0/653984023 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46840035d0 con 0x7f469c0d0860 2024-09-13T18:27:15.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.407+0000 7f46a0a78700 1 -- 172.21.15.44:0/653984023 >> v1:172.21.15.99:6789/0 conn(0x7f469c0b5c70 legacy=0x7f469c0b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:15.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.407+0000 7f46a0a78700 1 -- 172.21.15.44:0/653984023 >> v1:172.21.15.44:6789/0 conn(0x7f469c0d0860 legacy=0x7f469c15b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:15.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.407+0000 7f46a0a78700 1 -- 172.21.15.44:0/653984023 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c0d1550 con 0x7f469c15d690 2024-09-13T18:27:15.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.407+0000 7f46a0a78700 1 --2- 172.21.15.44:0/653984023 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f469c15d690 0x7f469c1656c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4694009dc0 tx=0x7f469400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2899daab775fa505 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:15.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.407+0000 7f469affd700 1 -- 172.21.15.44:0/653984023 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469400e070 con 0x7f469c15d690 2024-09-13T18:27:15.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.407+0000 7f469affd700 1 -- 172.21.15.44:0/653984023 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469400bb20 con 0x7f469c15d690 2024-09-13T18:27:15.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.407+0000 7f469affd700 1 -- 172.21.15.44:0/653984023 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469400be90 con 0x7f469c15d690 2024-09-13T18:27:15.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.407+0000 7f46a24db700 1 -- 172.21.15.44:0/653984023 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f469c15d690 msgr2=0x7f469c1656c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:15.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.407+0000 7f46a24db700 1 --2- 172.21.15.44:0/653984023 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f469c15d690 0x7f469c1656c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4694009dc0 tx=0x7f469400b330 comp rx=0 tx=0).stop 2024-09-13T18:27:15.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.407+0000 7f46a24db700 1 -- 172.21.15.44:0/653984023 shutdown_connections 2024-09-13T18:27:15.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.407+0000 7f46a24db700 1 --2- 172.21.15.44:0/653984023 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f469c15d690 0x7f469c1656c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.407+0000 7f46a24db700 1 -- 172.21.15.44:0/653984023 >> 172.21.15.44:0/653984023 conn(0x7f469c071da0 msgr2=0x7f469c0721b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:15.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.407+0000 7f46a24db700 1 -- 172.21.15.44:0/653984023 shutdown_connections 2024-09-13T18:27:15.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.407+0000 7f46a24db700 1 -- 172.21.15.44:0/653984023 wait complete. 2024-09-13T18:27:15.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f46a24db700 1 Processor -- start 2024-09-13T18:27:15.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f46a24db700 1 -- start start 2024-09-13T18:27:15.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f46a24db700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f469c0b5c70 0x7f469c0c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:15.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f46a24db700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f469c0d0860 0x7f469c1f5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:15.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f46a24db700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f469c15d690 0x7f469c1f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:15.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f46a24db700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c150950 con 0x7f469c0b5c70 2024-09-13T18:27:15.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f46a24db700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c150c30 con 0x7f469c15d690 2024-09-13T18:27:15.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f46a24db700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c150f10 con 0x7f469c0d0860 2024-09-13T18:27:15.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f469bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f469c0b5c70 0x7f469c0c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:15.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f469b7fe700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f469c0d0860 0x7f469c1f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:15.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f469bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f469c0b5c70 0x7f469c0c6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41666/0 (socket says 172.21.15.44:41666) 2024-09-13T18:27:15.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f469bfff700 1 -- 172.21.15.44:0/1784225005 learned_addr learned my addr 172.21.15.44:0/1784225005 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:15.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f46a0a78700 1 --2- 172.21.15.44:0/1784225005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f469c15d690 0x7f469c1f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:15.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f469bfff700 1 -- 172.21.15.44:0/1784225005 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f469c0d0860 msgr2=0x7f469c1f5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:15.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f469bfff700 1 --2- 172.21.15.44:0/1784225005 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f469c0d0860 0x7f469c1f5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f469bfff700 1 -- 172.21.15.44:0/1784225005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f469c15d690 msgr2=0x7f469c1f6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:15.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f469bfff700 1 --2- 172.21.15.44:0/1784225005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f469c15d690 0x7f469c1f6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f469bfff700 1 -- 172.21.15.44:0/1784225005 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4694009a70 con 0x7f469c0b5c70 2024-09-13T18:27:15.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f469bfff700 1 --2- 172.21.15.44:0/1784225005 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f469c0b5c70 0x7f469c0c6a60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f468c00c500 tx=0x7f468c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:15.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f4698ff9700 1 -- 172.21.15.44:0/1784225005 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c0052d0 con 0x7f469c0b5c70 2024-09-13T18:27:15.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f4698ff9700 1 -- 172.21.15.44:0/1784225005 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c005430 con 0x7f469c0b5c70 2024-09-13T18:27:15.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f46a24db700 1 -- 172.21.15.44:0/1784225005 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469c1511f0 con 0x7f469c0b5c70 2024-09-13T18:27:15.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f4698ff9700 1 -- 172.21.15.44:0/1784225005 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c0055a0 con 0x7f469c0b5c70 2024-09-13T18:27:15.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.411+0000 7f46a24db700 1 -- 172.21.15.44:0/1784225005 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469c14f390 con 0x7f469c0b5c70 2024-09-13T18:27:15.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.415+0000 7f46a24db700 1 -- 172.21.15.44:0/1784225005 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469c0b6050 con 0x7f469c0b5c70 2024-09-13T18:27:15.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.415+0000 7f4698ff9700 1 -- 172.21.15.44:0/1784225005 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f468c0038e0 con 0x7f469c0b5c70 2024-09-13T18:27:15.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.415+0000 7f4698ff9700 1 --2- 172.21.15.44:0/1784225005 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4688066760 0x7f4688068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:15.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.415+0000 7f4698ff9700 1 -- 172.21.15.44:0/1784225005 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f468c0833e0 con 0x7f469c0b5c70 2024-09-13T18:27:15.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.415+0000 7f469b7fe700 1 --2- 172.21.15.44:0/1784225005 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4688066760 0x7f4688068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:15.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.415+0000 7f469b7fe700 1 --2- 172.21.15.44:0/1784225005 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4688066760 0x7f4688068c20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4690007fd0 tx=0x7f4690007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:15.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.423+0000 7f4698ff9700 1 -- 172.21.15.44:0/1784225005 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f468c0507e0 con 0x7f469c0b5c70 2024-09-13T18:27:15.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.591+0000 7f46a24db700 1 -- 172.21.15.44:0/1784225005 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f469c0cf640 con 0x7f469c0b5c70 2024-09-13T18:27:15.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.591+0000 7f4698ff9700 1 -- 172.21.15.44:0/1784225005 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f468c053e00 con 0x7f469c0b5c70 2024-09-13T18:27:15.597 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:27:15.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.595+0000 7f46a24db700 1 -- 172.21.15.44:0/1784225005 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4688066760 msgr2=0x7f4688068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:15.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.595+0000 7f46a24db700 1 --2- 172.21.15.44:0/1784225005 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4688066760 0x7f4688068c20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4690007fd0 tx=0x7f4690007de0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.595+0000 7f46a24db700 1 -- 172.21.15.44:0/1784225005 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f469c0b5c70 msgr2=0x7f469c0c6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:15.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.595+0000 7f46a24db700 1 --2- 172.21.15.44:0/1784225005 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f469c0b5c70 0x7f469c0c6a60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f468c00c500 tx=0x7f468c00c810 comp rx=0 tx=0).stop 2024-09-13T18:27:15.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.595+0000 7f46a24db700 1 -- 172.21.15.44:0/1784225005 shutdown_connections 2024-09-13T18:27:15.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.595+0000 7f46a24db700 1 --2- 172.21.15.44:0/1784225005 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4688066760 0x7f4688068c20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.595+0000 7f46a24db700 1 --2- 172.21.15.44:0/1784225005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f469c15d690 0x7f469c1f6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.595+0000 7f46a24db700 1 --2- 172.21.15.44:0/1784225005 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f469c0d0860 0x7f469c1f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.595+0000 7f46a24db700 1 --2- 172.21.15.44:0/1784225005 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f469c0b5c70 0x7f469c0c6a60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.595+0000 7f46a24db700 1 -- 172.21.15.44:0/1784225005 >> 172.21.15.44:0/1784225005 conn(0x7f469c071da0 msgr2=0x7f469c15b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:15.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.595+0000 7f46a24db700 1 -- 172.21.15.44:0/1784225005 shutdown_connections 2024-09-13T18:27:15.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.595+0000 7f46a24db700 1 -- 172.21.15.44:0/1784225005 wait complete. 2024-09-13T18:27:15.612 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:27:15.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.731+0000 7fe87e780700 1 Processor -- start 2024-09-13T18:27:15.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.731+0000 7fe87e780700 1 -- start start 2024-09-13T18:27:15.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe87e780700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe878071ab0 0x7fe8780b3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:15.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe87e780700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe878159ef0 0x7fe8780b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:15.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe87e780700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe87815d6a0 con 0x7fe8780716d0 2024-09-13T18:27:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe87e780700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe87815af20 con 0x7fe878071ab0 2024-09-13T18:27:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe87e780700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe87815a680 con 0x7fe878159ef0 2024-09-13T18:27:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe87cf7d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe878071ab0 0x7fe8780b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe87cf7d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe878071ab0 0x7fe8780b3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41680/0 (socket says 172.21.15.44:41680) 2024-09-13T18:27:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe87cf7d700 1 -- 172.21.15.44:0/3966868801 learned_addr learned my addr 172.21.15.44:0/3966868801 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe87df7f700 1 --2- 172.21.15.44:0/3966868801 >> v2:172.21.15.99:3300/0 conn(0x7fe878159ef0 0x7fe8780b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe87cf7d700 1 -- 172.21.15.44:0/3966868801 >> v2:172.21.15.99:3300/0 conn(0x7fe878159ef0 msgr2=0x7fe8780b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe87cf7d700 1 --2- 172.21.15.44:0/3966868801 >> v2:172.21.15.99:3300/0 conn(0x7fe878159ef0 0x7fe8780b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe87cf7d700 1 -- 172.21.15.44:0/3966868801 >> v1:172.21.15.99:6789/0 conn(0x7fe8780716d0 legacy=0x7fe87815dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe87cf7d700 1 -- 172.21.15.44:0/3966868801 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87815a960 con 0x7fe878071ab0 2024-09-13T18:27:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe87cf7d700 1 --2- 172.21.15.44:0/3966868801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe878071ab0 0x7fe8780b3900 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe878072110 tx=0x7fe868009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35310c6b79b2199 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:15.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe86ffff700 1 -- 172.21.15.44:0/3966868801 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe868004230 con 0x7fe878071ab0 2024-09-13T18:27:15.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe86ffff700 1 -- 172.21.15.44:0/3966868801 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe868004390 con 0x7fe878071ab0 2024-09-13T18:27:15.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe86ffff700 1 -- 172.21.15.44:0/3966868801 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8680036c0 con 0x7fe878071ab0 2024-09-13T18:27:15.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe87e780700 1 -- 172.21.15.44:0/3966868801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe878071ab0 msgr2=0x7fe8780b3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:15.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe87e780700 1 --2- 172.21.15.44:0/3966868801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe878071ab0 0x7fe8780b3900 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe878072110 tx=0x7fe868009bf0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe87e780700 1 -- 172.21.15.44:0/3966868801 shutdown_connections 2024-09-13T18:27:15.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe87e780700 1 --2- 172.21.15.44:0/3966868801 >> v2:172.21.15.99:3300/0 conn(0x7fe878159ef0 0x7fe8780b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe87e780700 1 --2- 172.21.15.44:0/3966868801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe878071ab0 0x7fe8780b3900 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe87e780700 1 -- 172.21.15.44:0/3966868801 >> 172.21.15.44:0/3966868801 conn(0x7fe8780cf420 msgr2=0x7fe8780cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:15.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe87e780700 1 -- 172.21.15.44:0/3966868801 shutdown_connections 2024-09-13T18:27:15.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.735+0000 7fe87e780700 1 -- 172.21.15.44:0/3966868801 wait complete. 2024-09-13T18:27:15.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe87e780700 1 Processor -- start 2024-09-13T18:27:15.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe87e780700 1 -- start start 2024-09-13T18:27:15.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe87e780700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8780716d0 0x7fe878151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:15.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe87e780700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe878071ab0 0x7fe878154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe87e780700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe878159ef0 0x7fe8780cd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe87e780700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8781557a0 con 0x7fe8780716d0 2024-09-13T18:27:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe87e780700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe878155a80 con 0x7fe878071ab0 2024-09-13T18:27:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe87e780700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe878155d60 con 0x7fe878159ef0 2024-09-13T18:27:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe87d77e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8780716d0 0x7fe878151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe87d77e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8780716d0 0x7fe878151880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41694/0 (socket says 172.21.15.44:41694) 2024-09-13T18:27:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe87d77e700 1 -- 172.21.15.44:0/945295611 learned_addr learned my addr 172.21.15.44:0/945295611 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe87cf7d700 1 --2- 172.21.15.44:0/945295611 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe878071ab0 0x7fe878154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe87df7f700 1 --2- 172.21.15.44:0/945295611 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe878159ef0 0x7fe8780cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe87d77e700 1 -- 172.21.15.44:0/945295611 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe878159ef0 msgr2=0x7fe8780cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe87d77e700 1 --2- 172.21.15.44:0/945295611 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe878159ef0 0x7fe8780cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe87d77e700 1 -- 172.21.15.44:0/945295611 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe878071ab0 msgr2=0x7fe878154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe87d77e700 1 --2- 172.21.15.44:0/945295611 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe878071ab0 0x7fe878154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe87d77e700 1 -- 172.21.15.44:0/945295611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe868009570 con 0x7fe8780716d0 2024-09-13T18:27:15.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe87d77e700 1 --2- 172.21.15.44:0/945295611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8780716d0 0x7fe878151880 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe87400c4e0 tx=0x7fe87400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:15.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe86dffb700 1 -- 172.21.15.44:0/945295611 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe874011790 con 0x7fe8780716d0 2024-09-13T18:27:15.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe86dffb700 1 -- 172.21.15.44:0/945295611 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe874011910 con 0x7fe8780716d0 2024-09-13T18:27:15.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe86dffb700 1 -- 172.21.15.44:0/945295611 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe874011cc0 con 0x7fe8780716d0 2024-09-13T18:27:15.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe87e780700 1 -- 172.21.15.44:0/945295611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe87815a450 con 0x7fe8780716d0 2024-09-13T18:27:15.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.739+0000 7fe87e780700 1 -- 172.21.15.44:0/945295611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87814ada0 con 0x7fe8780716d0 2024-09-13T18:27:15.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.743+0000 7fe87e780700 1 -- 172.21.15.44:0/945295611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe87814ac00 con 0x7fe8780716d0 2024-09-13T18:27:15.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.743+0000 7fe86dffb700 1 -- 172.21.15.44:0/945295611 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe87401c460 con 0x7fe8780716d0 2024-09-13T18:27:15.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.743+0000 7fe86dffb700 1 --2- 172.21.15.44:0/945295611 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe85c066730 0x7fe85c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:15.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.743+0000 7fe86dffb700 1 -- 172.21.15.44:0/945295611 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe874084070 con 0x7fe8780716d0 2024-09-13T18:27:15.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.743+0000 7fe87cf7d700 1 --2- 172.21.15.44:0/945295611 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe85c066730 0x7fe85c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:15.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.743+0000 7fe87cf7d700 1 --2- 172.21.15.44:0/945295611 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe85c066730 0x7fe85c068bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe878072110 tx=0x7fe868008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:15.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.751+0000 7fe86dffb700 1 -- 172.21.15.44:0/945295611 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe8740b5db0 con 0x7fe8780716d0 2024-09-13T18:27:15.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.923+0000 7fe87e780700 1 -- 172.21.15.44:0/945295611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe87814af90 con 0x7fe8780716d0 2024-09-13T18:27:15.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.923+0000 7fe86dffb700 1 -- 172.21.15.44:0/945295611 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe87814ac00 con 0x7fe8780716d0 2024-09-13T18:27:15.927 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:27:15.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.923+0000 7fe87e780700 1 -- 172.21.15.44:0/945295611 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe85c066730 msgr2=0x7fe85c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:15.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.923+0000 7fe87e780700 1 --2- 172.21.15.44:0/945295611 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe85c066730 0x7fe85c068bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe878072110 tx=0x7fe868008030 comp rx=0 tx=0).stop 2024-09-13T18:27:15.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.923+0000 7fe87e780700 1 -- 172.21.15.44:0/945295611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8780716d0 msgr2=0x7fe878151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:15.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.923+0000 7fe87e780700 1 --2- 172.21.15.44:0/945295611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8780716d0 0x7fe878151880 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe87400c4e0 tx=0x7fe87400c8a0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.923+0000 7fe87e780700 1 -- 172.21.15.44:0/945295611 shutdown_connections 2024-09-13T18:27:15.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.923+0000 7fe87e780700 1 --2- 172.21.15.44:0/945295611 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe85c066730 0x7fe85c068bf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.923+0000 7fe87e780700 1 --2- 172.21.15.44:0/945295611 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe878159ef0 0x7fe8780cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.923+0000 7fe87e780700 1 --2- 172.21.15.44:0/945295611 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe878071ab0 0x7fe878154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.923+0000 7fe87e780700 1 --2- 172.21.15.44:0/945295611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8780716d0 0x7fe878151880 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:15.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.923+0000 7fe87e780700 1 -- 172.21.15.44:0/945295611 >> 172.21.15.44:0/945295611 conn(0x7fe8780cf420 msgr2=0x7fe87806b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:15.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.923+0000 7fe87e780700 1 -- 172.21.15.44:0/945295611 shutdown_connections 2024-09-13T18:27:15.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:15.927+0000 7fe87e780700 1 -- 172.21.15.44:0/945295611 wait complete. 2024-09-13T18:27:15.942 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:27:16.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9759e700 1 Processor -- start 2024-09-13T18:27:16.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9759e700 1 -- start start 2024-09-13T18:27:16.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9759e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fca90033510 0x7fca9001db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:16.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9759e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca90033e90 con 0x7fca90036d80 2024-09-13T18:27:16.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9759e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca90033bb0 con 0x7fca9004ec10 2024-09-13T18:27:16.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9759e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9001d080 con 0x7fca90033510 2024-09-13T18:27:16.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca95d9b700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fca90036d80 0x7fca90031240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44842/0 (socket says 172.21.15.44:44842) 2024-09-13T18:27:16.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca95d9b700 1 -- 172.21.15.44:0/3860946767 learned_addr learned my addr 172.21.15.44:0/3860946767 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:16.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca96d9d700 1 --2- 172.21.15.44:0/3860946767 >> v2:172.21.15.99:3300/0 conn(0x7fca90033510 0x7fca9001db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:16.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9559a700 1 -- 172.21.15.44:0/3860946767 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145294307 0 0) 0x7fca90033e90 con 0x7fca90036d80 2024-09-13T18:27:16.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9559a700 1 -- 172.21.15.44:0/3860946767 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca800035d0 con 0x7fca90036d80 2024-09-13T18:27:16.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9559a700 1 -- 172.21.15.44:0/3860946767 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2192045648 0 0) 0x7fca800035d0 con 0x7fca90036d80 2024-09-13T18:27:16.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9559a700 1 -- 172.21.15.44:0/3860946767 >> v2:172.21.15.99:3300/0 conn(0x7fca90033510 msgr2=0x7fca9001db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:16.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9559a700 1 --2- 172.21.15.44:0/3860946767 >> v2:172.21.15.99:3300/0 conn(0x7fca90033510 0x7fca9001db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9559a700 1 -- 172.21.15.44:0/3860946767 >> v1:172.21.15.99:6789/0 conn(0x7fca9004ec10 legacy=0x7fca9004eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:16.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9559a700 1 -- 172.21.15.44:0/3860946767 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9001d360 con 0x7fca90036d80 2024-09-13T18:27:16.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9559a700 1 -- 172.21.15.44:0/3860946767 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7fca9804ef50 con 0x7fca90036d80 2024-09-13T18:27:16.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9559a700 1 -- 172.21.15.44:0/3860946767 >> v1:172.21.15.44:6789/0 conn(0x7fca90036d80 legacy=0x7fca90031240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9559a700 1 --2- 172.21.15.44:0/3860946767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca80003a20 0x7fca80003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9559a700 1 --2- 172.21.15.44:0/3860946767 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca80004870 0x7fca80004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9559a700 1 --2- 172.21.15.44:0/3860946767 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fca80005230 0x7fca8000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9559a700 1 -- 172.21.15.44:0/3860946767 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9001d080 con 0x7fca80003a20 2024-09-13T18:27:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9559a700 1 -- 172.21.15.44:0/3860946767 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8000c130 con 0x7fca80004870 2024-09-13T18:27:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9559a700 1 -- 172.21.15.44:0/3860946767 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8000c2f0 con 0x7fca80005230 2024-09-13T18:27:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca96d9d700 1 --2- 172.21.15.44:0/3860946767 >> v2:172.21.15.99:3300/0 conn(0x7fca90033510 0x7fca9001db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9659c700 1 --2- 172.21.15.44:0/3860946767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca80003a20 0x7fca80003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca95d9b700 1 --2- 172.21.15.44:0/3860946767 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca80004870 0x7fca80004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca96d9d700 1 --2- 172.21.15.44:0/3860946767 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fca80005230 0x7fca8000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9659c700 1 -- 172.21.15.44:0/3860946767 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fca80005230 msgr2=0x7fca8000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9659c700 1 --2- 172.21.15.44:0/3860946767 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fca80005230 0x7fca8000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9659c700 1 -- 172.21.15.44:0/3860946767 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca80004870 msgr2=0x7fca80004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9659c700 1 --2- 172.21.15.44:0/3860946767 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca80004870 0x7fca80004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9659c700 1 -- 172.21.15.44:0/3860946767 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca800035d0 con 0x7fca80003a20 2024-09-13T18:27:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca96d9d700 1 --2- 172.21.15.44:0/3860946767 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fca80005230 0x7fca8000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca96d9d700 1 -- 172.21.15.44:0/3860946767 reap_dead start 2024-09-13T18:27:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.055+0000 7fca9659c700 1 --2- 172.21.15.44:0/3860946767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca80003a20 0x7fca80003e40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fca8c001840 tx=0x7fca800058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d5289ad1671bda server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.059+0000 7fca9559a700 1 -- 172.21.15.44:0/3860946767 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c001300 con 0x7fca80003a20 2024-09-13T18:27:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.059+0000 7fca9559a700 1 -- 172.21.15.44:0/3860946767 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8c005240 con 0x7fca80003a20 2024-09-13T18:27:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.059+0000 7fca9559a700 1 -- 172.21.15.44:0/3860946767 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c0055f0 con 0x7fca80003a20 2024-09-13T18:27:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.059+0000 7fca9759e700 1 -- 172.21.15.44:0/3860946767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca80003a20 msgr2=0x7fca80003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.059+0000 7fca9759e700 1 --2- 172.21.15.44:0/3860946767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca80003a20 0x7fca80003e40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fca8c001840 tx=0x7fca800058a0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.059+0000 7fca9759e700 1 -- 172.21.15.44:0/3860946767 shutdown_connections 2024-09-13T18:27:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.059+0000 7fca9759e700 1 --2- 172.21.15.44:0/3860946767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca80003a20 0x7fca80003e40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.059+0000 7fca9759e700 1 -- 172.21.15.44:0/3860946767 >> 172.21.15.44:0/3860946767 conn(0x7fca90036140 msgr2=0x7fca90036550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:16.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.059+0000 7fca9759e700 1 -- 172.21.15.44:0/3860946767 shutdown_connections 2024-09-13T18:27:16.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.059+0000 7fca9759e700 1 -- 172.21.15.44:0/3860946767 wait complete. 2024-09-13T18:27:16.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.063+0000 7fca9759e700 1 Processor -- start 2024-09-13T18:27:16.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.063+0000 7fca9759e700 1 -- start start 2024-09-13T18:27:16.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.063+0000 7fca9759e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fca80003a20 0x7fca9004e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:16.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.063+0000 7fca9759e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca900e3cd0 0x7fca900e2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:16.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.063+0000 7fca9759e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca9004cea0 0x7fca900e5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:16.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.063+0000 7fca9759e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9004e090 con 0x7fca9004cea0 2024-09-13T18:27:16.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.063+0000 7fca9759e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca900e3510 con 0x7fca900e3cd0 2024-09-13T18:27:16.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.063+0000 7fca9759e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9004d410 con 0x7fca80003a20 2024-09-13T18:27:16.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.063+0000 7fca96d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca9004cea0 0x7fca900e5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:16.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.063+0000 7fca96d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca9004cea0 0x7fca900e5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41718/0 (socket says 172.21.15.44:41718) 2024-09-13T18:27:16.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.063+0000 7fca96d9d700 1 -- 172.21.15.44:0/3795079766 learned_addr learned my addr 172.21.15.44:0/3795079766 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:16.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.063+0000 7fca95d9b700 1 --2- 172.21.15.44:0/3795079766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca900e3cd0 0x7fca900e2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:16.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.063+0000 7fca9659c700 1 --2- 172.21.15.44:0/3795079766 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fca80003a20 0x7fca9004e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:16.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.063+0000 7fca96d9d700 1 -- 172.21.15.44:0/3795079766 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fca80003a20 msgr2=0x7fca9004e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:16.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.063+0000 7fca96d9d700 1 --2- 172.21.15.44:0/3795079766 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fca80003a20 0x7fca9004e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.063+0000 7fca96d9d700 1 -- 172.21.15.44:0/3795079766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca900e3cd0 msgr2=0x7fca900e2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:16.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.063+0000 7fca96d9d700 1 --2- 172.21.15.44:0/3795079766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca900e3cd0 0x7fca900e2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.063+0000 7fca96d9d700 1 -- 172.21.15.44:0/3795079766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9004d6f0 con 0x7fca9004cea0 2024-09-13T18:27:16.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.067+0000 7fca96d9d700 1 --2- 172.21.15.44:0/3795079766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca9004cea0 0x7fca900e5da0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fca900ea9e0 tx=0x7fca88010a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:16.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.067+0000 7fca86ffd700 1 -- 172.21.15.44:0/3795079766 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88015880 con 0x7fca9004cea0 2024-09-13T18:27:16.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.067+0000 7fca86ffd700 1 -- 172.21.15.44:0/3795079766 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8800c050 con 0x7fca9004cea0 2024-09-13T18:27:16.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.067+0000 7fca9759e700 1 -- 172.21.15.44:0/3795079766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9004d9d0 con 0x7fca9004cea0 2024-09-13T18:27:16.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.067+0000 7fca86ffd700 1 -- 172.21.15.44:0/3795079766 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88015c20 con 0x7fca9004cea0 2024-09-13T18:27:16.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.067+0000 7fca9759e700 1 -- 172.21.15.44:0/3795079766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca900e36f0 con 0x7fca9004cea0 2024-09-13T18:27:16.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.067+0000 7fca9759e700 1 -- 172.21.15.44:0/3795079766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca90004800 con 0x7fca9004cea0 2024-09-13T18:27:16.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.067+0000 7fca86ffd700 1 -- 172.21.15.44:0/3795079766 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fca88020460 con 0x7fca9004cea0 2024-09-13T18:27:16.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.067+0000 7fca86ffd700 1 --2- 172.21.15.44:0/3795079766 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fca78066730 0x7fca78068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:16.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.067+0000 7fca86ffd700 1 -- 172.21.15.44:0/3795079766 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca88083e50 con 0x7fca9004cea0 2024-09-13T18:27:16.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.067+0000 7fca9659c700 1 --2- 172.21.15.44:0/3795079766 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fca78066730 0x7fca78068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:16.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.071+0000 7fca9659c700 1 --2- 172.21.15.44:0/3795079766 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fca78066730 0x7fca78068bf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fca8c000c00 tx=0x7fca8c005040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:16.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.075+0000 7fca86ffd700 1 -- 172.21.15.44:0/3795079766 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fca880511b0 con 0x7fca9004cea0 2024-09-13T18:27:16.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.283+0000 7fca9759e700 1 -- 172.21.15.44:0/3795079766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca9004e1d0 con 0x7fca9004cea0 2024-09-13T18:27:16.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.283+0000 7fca86ffd700 1 -- 172.21.15.44:0/3795079766 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4725 (secure 0 0 0) 0x7fca9004e1d0 con 0x7fca9004cea0 2024-09-13T18:27:16.289 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:16.290 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2616086834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2616086834},{"type":"v1","addr":"172.21.15.99:6835","nonce":2616086834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/2083799524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2083799524},{"type":"v1","addr":"172.21.15.99:6837","nonce":2083799524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/369871675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":369871675},{"type":"v1","addr":"172.21.15.44:6833","nonce":369871675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:27:01.277463+0000","modified":"2024-09-13T18:27:04.292778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/1402693416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1402693416},{"type":"v1","addr":"172.21.15.44:6835","nonce":1402693416}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:27:16.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.287+0000 7fca9759e700 1 -- 172.21.15.44:0/3795079766 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fca78066730 msgr2=0x7fca78068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:16.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.287+0000 7fca9759e700 1 --2- 172.21.15.44:0/3795079766 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fca78066730 0x7fca78068bf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fca8c000c00 tx=0x7fca8c005040 comp rx=0 tx=0).stop 2024-09-13T18:27:16.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.287+0000 7fca9759e700 1 -- 172.21.15.44:0/3795079766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca9004cea0 msgr2=0x7fca900e5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:16.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.287+0000 7fca9759e700 1 --2- 172.21.15.44:0/3795079766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca9004cea0 0x7fca900e5da0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fca900ea9e0 tx=0x7fca88010a70 comp rx=0 tx=0).stop 2024-09-13T18:27:16.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.287+0000 7fca9759e700 1 -- 172.21.15.44:0/3795079766 shutdown_connections 2024-09-13T18:27:16.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.287+0000 7fca9759e700 1 --2- 172.21.15.44:0/3795079766 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fca78066730 0x7fca78068bf0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.287+0000 7fca9759e700 1 --2- 172.21.15.44:0/3795079766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca9004cea0 0x7fca900e5da0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.287+0000 7fca9759e700 1 --2- 172.21.15.44:0/3795079766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca900e3cd0 0x7fca900e2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.287+0000 7fca9759e700 1 --2- 172.21.15.44:0/3795079766 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fca80003a20 0x7fca9004e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.287+0000 7fca9759e700 1 -- 172.21.15.44:0/3795079766 >> 172.21.15.44:0/3795079766 conn(0x7fca90036140 msgr2=0x7fca900e4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:16.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.287+0000 7fca9759e700 1 -- 172.21.15.44:0/3795079766 shutdown_connections 2024-09-13T18:27:16.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.287+0000 7fca9759e700 1 -- 172.21.15.44:0/3795079766 wait complete. 2024-09-13T18:27:16.294 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 7 2024-09-13T18:27:16.305 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:16.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159ffff700 1 Processor -- start 2024-09-13T18:27:16.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159ffff700 1 -- start start 2024-09-13T18:27:16.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159ffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15a015cae0 0x7f15a00cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:16.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159ffff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f15a015cec0 0x7f15a00d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:16.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159ffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f15a006ac00 0x7f15a006b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:16.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159ffff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a00d1750 con 0x7f15a006ac00 2024-09-13T18:27:16.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159ffff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a006b5b0 con 0x7f15a015cec0 2024-09-13T18:27:16.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159ffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a00d21e0 con 0x7f15a015cae0 2024-09-13T18:27:16.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159e7fc700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f15a015cec0 0x7f15a00d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:16.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159f7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f15a006ac00 0x7f15a006b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:16.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159effd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15a015cae0 0x7f15a00cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:16.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159e7fc700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f15a015cec0 0x7f15a00d1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:39178/0 (socket says 172.21.15.44:39178) 2024-09-13T18:27:16.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159e7fc700 1 -- 172.21.15.44:0/3492572967 learned_addr learned my addr 172.21.15.44:0/3492572967 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:16.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159f7fe700 1 -- 172.21.15.44:0/3492572967 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15a015cae0 msgr2=0x7f15a00cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:16.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159f7fe700 1 --2- 172.21.15.44:0/3492572967 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15a015cae0 0x7f15a00cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159f7fe700 1 -- 172.21.15.44:0/3492572967 >> v2:172.21.15.99:3300/0 conn(0x7f15a015cec0 msgr2=0x7f15a00d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:16.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159f7fe700 1 --2- 172.21.15.44:0/3492572967 >> v2:172.21.15.99:3300/0 conn(0x7f15a015cec0 0x7f15a00d1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159f7fe700 1 -- 172.21.15.44:0/3492572967 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a00d1940 con 0x7f15a006ac00 2024-09-13T18:27:16.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159e7fc700 1 --2- 172.21.15.44:0/3492572967 >> v2:172.21.15.99:3300/0 conn(0x7f15a015cec0 0x7f15a00d1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:16.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159effd700 1 --2- 172.21.15.44:0/3492572967 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15a015cae0 0x7f15a00cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:16.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159f7fe700 1 --2- 172.21.15.44:0/3492572967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a006ac00 0x7f15a006b070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f15a00d3ce0 tx=0x7f1598009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4453b0cc94136d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:16.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159dffb700 1 -- 172.21.15.44:0/3492572967 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598011830 con 0x7f15a006ac00 2024-09-13T18:27:16.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159dffb700 1 -- 172.21.15.44:0/3492572967 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1598011990 con 0x7f15a006ac00 2024-09-13T18:27:16.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.415+0000 7f159dffb700 1 -- 172.21.15.44:0/3492572967 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598011d20 con 0x7f15a006ac00 2024-09-13T18:27:16.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.419+0000 7f159ffff700 1 -- 172.21.15.44:0/3492572967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a006ac00 msgr2=0x7f15a006b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:16.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.419+0000 7f159ffff700 1 --2- 172.21.15.44:0/3492572967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a006ac00 0x7f15a006b070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f15a00d3ce0 tx=0x7f1598009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:16.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.419+0000 7f159ffff700 1 -- 172.21.15.44:0/3492572967 shutdown_connections 2024-09-13T18:27:16.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.419+0000 7f159ffff700 1 --2- 172.21.15.44:0/3492572967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a006ac00 0x7f15a006b070 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.419+0000 7f159ffff700 1 --2- 172.21.15.44:0/3492572967 >> v2:172.21.15.99:3300/0 conn(0x7f15a015cec0 0x7f15a00d1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.419+0000 7f159ffff700 1 --2- 172.21.15.44:0/3492572967 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15a015cae0 0x7f15a00cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.419+0000 7f159ffff700 1 -- 172.21.15.44:0/3492572967 >> 172.21.15.44:0/3492572967 conn(0x7f15a00d2c80 msgr2=0x7f15a00d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:16.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.419+0000 7f159ffff700 1 -- 172.21.15.44:0/3492572967 shutdown_connections 2024-09-13T18:27:16.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.419+0000 7f159ffff700 1 -- 172.21.15.44:0/3492572967 wait complete. 2024-09-13T18:27:16.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.419+0000 7f159ffff700 1 Processor -- start 2024-09-13T18:27:16.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.419+0000 7f159ffff700 1 -- start start 2024-09-13T18:27:16.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.419+0000 7f159ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a006ac00 0x7f15a015d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:16.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.419+0000 7f159ffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a015cae0 0x7f15a00a95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:16.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.419+0000 7f159ffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15a015cec0 0x7f15a00b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:16.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.419+0000 7f159ffff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a014be20 con 0x7f15a006ac00 2024-09-13T18:27:16.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.419+0000 7f159ffff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a00a9b20 con 0x7f15a015cae0 2024-09-13T18:27:16.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.419+0000 7f159ffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a00b4440 con 0x7f15a015cec0 2024-09-13T18:27:16.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.419+0000 7f159effd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a006ac00 0x7f15a015d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:16.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.419+0000 7f159effd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a006ac00 0x7f15a015d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41744/0 (socket says 172.21.15.44:41744) 2024-09-13T18:27:16.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.419+0000 7f159effd700 1 -- 172.21.15.44:0/995669917 learned_addr learned my addr 172.21.15.44:0/995669917 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:16.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.419+0000 7f159f7fe700 1 --2- 172.21.15.44:0/995669917 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15a015cec0 0x7f15a00b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:16.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.419+0000 7f159e7fc700 1 --2- 172.21.15.44:0/995669917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a015cae0 0x7f15a00a95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:16.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.423+0000 7f159effd700 1 -- 172.21.15.44:0/995669917 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15a015cec0 msgr2=0x7f15a00b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:16.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.423+0000 7f159effd700 1 --2- 172.21.15.44:0/995669917 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15a015cec0 0x7f15a00b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.423+0000 7f159effd700 1 -- 172.21.15.44:0/995669917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a015cae0 msgr2=0x7f15a00a95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:16.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.423+0000 7f159effd700 1 --2- 172.21.15.44:0/995669917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a015cae0 0x7f15a00a95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.423+0000 7f159effd700 1 -- 172.21.15.44:0/995669917 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1590009a70 con 0x7f15a006ac00 2024-09-13T18:27:16.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.423+0000 7f159effd700 1 --2- 172.21.15.44:0/995669917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a006ac00 0x7f15a015d590 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f159000eed0 tx=0x7f159000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:16.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.423+0000 7f15977fe700 1 -- 172.21.15.44:0/995669917 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1590010040 con 0x7f15a006ac00 2024-09-13T18:27:16.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.423+0000 7f15977fe700 1 -- 172.21.15.44:0/995669917 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159000bd00 con 0x7f15a006ac00 2024-09-13T18:27:16.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.423+0000 7f159ffff700 1 -- 172.21.15.44:0/995669917 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1588009570 con 0x7f15a006ac00 2024-09-13T18:27:16.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.423+0000 7f15977fe700 1 -- 172.21.15.44:0/995669917 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1590014620 con 0x7f15a006ac00 2024-09-13T18:27:16.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.423+0000 7f159ffff700 1 -- 172.21.15.44:0/995669917 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15980094b0 con 0x7f15a006ac00 2024-09-13T18:27:16.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.423+0000 7f159ffff700 1 -- 172.21.15.44:0/995669917 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a006b070 con 0x7f15a006ac00 2024-09-13T18:27:16.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.423+0000 7f15977fe700 1 -- 172.21.15.44:0/995669917 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1590014780 con 0x7f15a006ac00 2024-09-13T18:27:16.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.423+0000 7f15977fe700 1 --2- 172.21.15.44:0/995669917 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1584066730 0x7f1584068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:16.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.423+0000 7f15977fe700 1 -- 172.21.15.44:0/995669917 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1590084940 con 0x7f15a006ac00 2024-09-13T18:27:16.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.427+0000 7f159e7fc700 1 --2- 172.21.15.44:0/995669917 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1584066730 0x7f1584068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:16.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.427+0000 7f159e7fc700 1 --2- 172.21.15.44:0/995669917 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1584066730 0x7f1584068bf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f15a00724a0 tx=0x7f15880092e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:16.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.435+0000 7f15977fe700 1 -- 172.21.15.44:0/995669917 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1590051cb0 con 0x7f15a006ac00 2024-09-13T18:27:16.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.611+0000 7f159ffff700 1 -- 172.21.15.44:0/995669917 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15a00b7600 con 0x7f15a006ac00 2024-09-13T18:27:16.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.615+0000 7f15977fe700 1 -- 172.21.15.44:0/995669917 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f15900552d0 con 0x7f15a006ac00 2024-09-13T18:27:16.618 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:16.618 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:02.280221+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:16.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.615+0000 7f159ffff700 1 -- 172.21.15.44:0/995669917 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1584066730 msgr2=0x7f1584068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:16.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.615+0000 7f159ffff700 1 --2- 172.21.15.44:0/995669917 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1584066730 0x7f1584068bf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f15a00724a0 tx=0x7f15880092e0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.615+0000 7f159ffff700 1 -- 172.21.15.44:0/995669917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a006ac00 msgr2=0x7f15a015d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:16.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.615+0000 7f159ffff700 1 --2- 172.21.15.44:0/995669917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a006ac00 0x7f15a015d590 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f159000eed0 tx=0x7f159000b390 comp rx=0 tx=0).stop 2024-09-13T18:27:16.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.615+0000 7f159ffff700 1 -- 172.21.15.44:0/995669917 shutdown_connections 2024-09-13T18:27:16.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.615+0000 7f159ffff700 1 --2- 172.21.15.44:0/995669917 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1584066730 0x7f1584068bf0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.615+0000 7f159ffff700 1 --2- 172.21.15.44:0/995669917 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15a015cec0 0x7f15a00b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.615+0000 7f159ffff700 1 --2- 172.21.15.44:0/995669917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a015cae0 0x7f15a00a95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.615+0000 7f159ffff700 1 --2- 172.21.15.44:0/995669917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15a006ac00 0x7f15a015d590 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.615+0000 7f159ffff700 1 -- 172.21.15.44:0/995669917 >> 172.21.15.44:0/995669917 conn(0x7f15a00d2c80 msgr2=0x7f15a00ca4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:16.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.615+0000 7f159ffff700 1 -- 172.21.15.44:0/995669917 shutdown_connections 2024-09-13T18:27:16.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.615+0000 7f159ffff700 1 -- 172.21.15.44:0/995669917 wait complete. 2024-09-13T18:27:16.634 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:26:59.478511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:27:00.261038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:27:16.634 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:27:16.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.751+0000 7f827dd32700 1 Processor -- start 2024-09-13T18:27:16.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.751+0000 7f827dd32700 1 -- start start 2024-09-13T18:27:16.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.751+0000 7f827dd32700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8278146160 0x7f82780cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:16.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.751+0000 7f827dd32700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82780ce130 0x7f82780ad270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:16.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.751+0000 7f827dd32700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f82780ad7b0 0x7f8278160600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:16.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.751+0000 7f827dd32700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82780cc820 con 0x7f8278146160 2024-09-13T18:27:16.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.751+0000 7f827dd32700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82780ae000 con 0x7f82780ad7b0 2024-09-13T18:27:16.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.751+0000 7f827dd32700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8278070070 con 0x7f82780ce130 2024-09-13T18:27:16.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.751+0000 7f827cd30700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8278146160 0x7f82780cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:16.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.751+0000 7f827cd30700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8278146160 0x7f82780cdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41750/0 (socket says 172.21.15.44:41750) 2024-09-13T18:27:16.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.751+0000 7f827cd30700 1 -- 172.21.15.44:0/427424716 learned_addr learned my addr 172.21.15.44:0/427424716 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:16.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.751+0000 7f827d531700 1 --2- 172.21.15.44:0/427424716 >> v2:172.21.15.99:3300/0 conn(0x7f82780ad7b0 0x7f8278160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:16.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.751+0000 7f8277fff700 1 --2- 172.21.15.44:0/427424716 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82780ce130 0x7f82780ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:16.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.751+0000 7f827cd30700 1 -- 172.21.15.44:0/427424716 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82780ce130 msgr2=0x7f82780ad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:16.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.751+0000 7f827cd30700 1 --2- 172.21.15.44:0/427424716 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82780ce130 0x7f82780ad270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.751+0000 7f827cd30700 1 -- 172.21.15.44:0/427424716 >> v2:172.21.15.99:3300/0 conn(0x7f82780ad7b0 msgr2=0x7f8278160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:16.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.751+0000 7f827cd30700 1 --2- 172.21.15.44:0/427424716 >> v2:172.21.15.99:3300/0 conn(0x7f82780ad7b0 0x7f8278160600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.751+0000 7f827cd30700 1 -- 172.21.15.44:0/427424716 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8278070350 con 0x7f8278146160 2024-09-13T18:27:16.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.751+0000 7f8277fff700 1 --2- 172.21.15.44:0/427424716 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82780ce130 0x7f82780ad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:16.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.751+0000 7f827cd30700 1 --2- 172.21.15.44:0/427424716 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8278146160 0x7f82780cdbf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f82780b3760 tx=0x7f8268009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb54c20985cdc097 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:16.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.751+0000 7f82777fe700 1 -- 172.21.15.44:0/427424716 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826800b8a0 con 0x7f8278146160 2024-09-13T18:27:16.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.751+0000 7f82777fe700 1 -- 172.21.15.44:0/427424716 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826800ba00 con 0x7f8278146160 2024-09-13T18:27:16.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.751+0000 7f82777fe700 1 -- 172.21.15.44:0/427424716 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826800bd90 con 0x7f8278146160 2024-09-13T18:27:16.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.755+0000 7f827dd32700 1 -- 172.21.15.44:0/427424716 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8278146160 msgr2=0x7f82780cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:16.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.755+0000 7f827dd32700 1 --2- 172.21.15.44:0/427424716 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8278146160 0x7f82780cdbf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f82780b3760 tx=0x7f8268009bf0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.755+0000 7f827dd32700 1 -- 172.21.15.44:0/427424716 shutdown_connections 2024-09-13T18:27:16.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.755+0000 7f827dd32700 1 --2- 172.21.15.44:0/427424716 >> v2:172.21.15.99:3300/0 conn(0x7f82780ad7b0 0x7f8278160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.755+0000 7f827dd32700 1 --2- 172.21.15.44:0/427424716 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82780ce130 0x7f82780ad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.755+0000 7f827dd32700 1 --2- 172.21.15.44:0/427424716 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8278146160 0x7f82780cdbf0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.755+0000 7f827dd32700 1 -- 172.21.15.44:0/427424716 >> 172.21.15.44:0/427424716 conn(0x7f82780b0e10 msgr2=0x7f82780b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.755+0000 7f827dd32700 1 -- 172.21.15.44:0/427424716 shutdown_connections 2024-09-13T18:27:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.755+0000 7f827dd32700 1 -- 172.21.15.44:0/427424716 wait complete. 2024-09-13T18:27:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.755+0000 7f827dd32700 1 Processor -- start 2024-09-13T18:27:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.755+0000 7f827dd32700 1 -- start start 2024-09-13T18:27:16.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.755+0000 7f827dd32700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82780ad7b0 0x7f827815c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.755+0000 7f827dd32700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82780ce130 0x7f827813d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.755+0000 7f827dd32700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8278146160 0x7f827813bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.755+0000 7f827dd32700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827813ee60 con 0x7f82780ad7b0 2024-09-13T18:27:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.755+0000 7f827dd32700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827813c4f0 con 0x7f8278146160 2024-09-13T18:27:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.755+0000 7f827dd32700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827813dc70 con 0x7f82780ce130 2024-09-13T18:27:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.755+0000 7f827cd30700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82780ad7b0 0x7f827815c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.755+0000 7f827cd30700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82780ad7b0 0x7f827815c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41752/0 (socket says 172.21.15.44:41752) 2024-09-13T18:27:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.755+0000 7f827cd30700 1 -- 172.21.15.44:0/3728224749 learned_addr learned my addr 172.21.15.44:0/3728224749 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.755+0000 7f827d531700 1 --2- 172.21.15.44:0/3728224749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8278146160 0x7f827813bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.755+0000 7f8277fff700 1 --2- 172.21.15.44:0/3728224749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82780ce130 0x7f827813d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.759+0000 7f827cd30700 1 -- 172.21.15.44:0/3728224749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82780ce130 msgr2=0x7f827813d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.759+0000 7f827cd30700 1 --2- 172.21.15.44:0/3728224749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82780ce130 0x7f827813d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.759+0000 7f827cd30700 1 -- 172.21.15.44:0/3728224749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8278146160 msgr2=0x7f827813bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:16.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.759+0000 7f827cd30700 1 --2- 172.21.15.44:0/3728224749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8278146160 0x7f827813bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.759+0000 7f827cd30700 1 -- 172.21.15.44:0/3728224749 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8268009570 con 0x7f82780ad7b0 2024-09-13T18:27:16.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.759+0000 7f8277fff700 1 --2- 172.21.15.44:0/3728224749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82780ce130 0x7f827813d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:16.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.759+0000 7f827cd30700 1 --2- 172.21.15.44:0/3728224749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82780ad7b0 0x7f827815c510 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8268000c00 tx=0x7f8268004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:16.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.759+0000 7f82757fa700 1 -- 172.21.15.44:0/3728224749 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82680038c0 con 0x7f82780ad7b0 2024-09-13T18:27:16.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.759+0000 7f82757fa700 1 -- 172.21.15.44:0/3728224749 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826801e070 con 0x7f82780ad7b0 2024-09-13T18:27:16.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.759+0000 7f827dd32700 1 -- 172.21.15.44:0/3728224749 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f827813eb30 con 0x7f82780ad7b0 2024-09-13T18:27:16.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.759+0000 7f82757fa700 1 -- 172.21.15.44:0/3728224749 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268003c80 con 0x7f82780ad7b0 2024-09-13T18:27:16.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.759+0000 7f827dd32700 1 -- 172.21.15.44:0/3728224749 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f827813d990 con 0x7f82780ad7b0 2024-09-13T18:27:16.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.759+0000 7f827dd32700 1 -- 172.21.15.44:0/3728224749 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82780ad270 con 0x7f82780ad7b0 2024-09-13T18:27:16.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.759+0000 7f82757fa700 1 -- 172.21.15.44:0/3728224749 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8268011420 con 0x7f82780ad7b0 2024-09-13T18:27:16.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.759+0000 7f82757fa700 1 --2- 172.21.15.44:0/3728224749 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8264066730 0x7f8264068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:16.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.759+0000 7f82757fa700 1 -- 172.21.15.44:0/3728224749 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8268020070 con 0x7f82780ad7b0 2024-09-13T18:27:16.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.759+0000 7f8277fff700 1 --2- 172.21.15.44:0/3728224749 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8264066730 0x7f8264068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:16.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.763+0000 7f8277fff700 1 --2- 172.21.15.44:0/3728224749 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8264066730 0x7f8264068bf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f826c006fd0 tx=0x7f826c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:16.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.767+0000 7f82757fa700 1 -- 172.21.15.44:0/3728224749 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8268052c80 con 0x7f82780ad7b0 2024-09-13T18:27:16.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.939+0000 7f827dd32700 1 -- 172.21.15.44:0/3728224749 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82780ae8f0 con 0x7f82780ad7b0 2024-09-13T18:27:16.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.943+0000 7f82757fa700 1 -- 172.21.15.44:0/3728224749 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82680562a0 con 0x7f82780ad7b0 2024-09-13T18:27:16.946 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:27:16.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.943+0000 7f827dd32700 1 -- 172.21.15.44:0/3728224749 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8264066730 msgr2=0x7f8264068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:16.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.943+0000 7f827dd32700 1 --2- 172.21.15.44:0/3728224749 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8264066730 0x7f8264068bf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f826c006fd0 tx=0x7f826c008040 comp rx=0 tx=0).stop 2024-09-13T18:27:16.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.943+0000 7f827dd32700 1 -- 172.21.15.44:0/3728224749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82780ad7b0 msgr2=0x7f827815c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:16.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.943+0000 7f827dd32700 1 --2- 172.21.15.44:0/3728224749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82780ad7b0 0x7f827815c510 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8268000c00 tx=0x7f8268004770 comp rx=0 tx=0).stop 2024-09-13T18:27:16.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.943+0000 7f827dd32700 1 -- 172.21.15.44:0/3728224749 shutdown_connections 2024-09-13T18:27:16.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.943+0000 7f827dd32700 1 --2- 172.21.15.44:0/3728224749 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8264066730 0x7f8264068bf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.943+0000 7f827dd32700 1 --2- 172.21.15.44:0/3728224749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8278146160 0x7f827813bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.943+0000 7f827dd32700 1 --2- 172.21.15.44:0/3728224749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82780ce130 0x7f827813d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.943+0000 7f827dd32700 1 --2- 172.21.15.44:0/3728224749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82780ad7b0 0x7f827815c510 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:16.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.943+0000 7f827dd32700 1 -- 172.21.15.44:0/3728224749 >> 172.21.15.44:0/3728224749 conn(0x7f82780b0e10 msgr2=0x7f82780b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:16.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.943+0000 7f827dd32700 1 -- 172.21.15.44:0/3728224749 shutdown_connections 2024-09-13T18:27:16.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:16.943+0000 7f827dd32700 1 -- 172.21.15.44:0/3728224749 wait complete. 2024-09-13T18:27:16.961 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:27:17.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.079+0000 7f3a5808a700 1 Processor -- start 2024-09-13T18:27:17.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.079+0000 7f3a5808a700 1 -- start start 2024-09-13T18:27:17.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a5808a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3a501436c0 0x7f3a500ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:17.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a5808a700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3a500b4bd0 0x7f3a500b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:17.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a5808a700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a500b3f50 con 0x7f3a500b3490 2024-09-13T18:27:17.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a5808a700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a500b4230 con 0x7f3a500b4bd0 2024-09-13T18:27:17.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a5808a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5006be50 con 0x7f3a501436c0 2024-09-13T18:27:17.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a55625700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3a500b3490 0x7f3a500b44c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44848/0 (socket says 172.21.15.44:44848) 2024-09-13T18:27:17.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a55625700 1 -- 172.21.15.44:0/142258150 learned_addr learned my addr 172.21.15.44:0/142258150 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:17.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a55e26700 1 --2- 172.21.15.44:0/142258150 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3a501436c0 0x7f3a500ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:17.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a56627700 1 --2- 172.21.15.44:0/142258150 >> v2:172.21.15.44:3300/0 conn(0x7f3a500b4bd0 0x7f3a500b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:17.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a56627700 1 -- 172.21.15.44:0/142258150 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3a501436c0 msgr2=0x7f3a500ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:17.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a56627700 1 --2- 172.21.15.44:0/142258150 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3a501436c0 0x7f3a500ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a56627700 1 -- 172.21.15.44:0/142258150 >> v1:172.21.15.44:6789/0 conn(0x7f3a500b3490 legacy=0x7f3a500b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:17.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a56627700 1 -- 172.21.15.44:0/142258150 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5006c130 con 0x7f3a500b4bd0 2024-09-13T18:27:17.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a56627700 1 --2- 172.21.15.44:0/142258150 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a500b4bd0 0x7f3a500b38d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3a48009d90 tx=0x7f3a4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82cb741e6b3d3c60 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:17.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a54e24700 1 -- 172.21.15.44:0/142258150 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4800bd20 con 0x7f3a500b4bd0 2024-09-13T18:27:17.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a54e24700 1 -- 172.21.15.44:0/142258150 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4800be80 con 0x7f3a500b4bd0 2024-09-13T18:27:17.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a54e24700 1 -- 172.21.15.44:0/142258150 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a480116a0 con 0x7f3a500b4bd0 2024-09-13T18:27:17.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a5808a700 1 -- 172.21.15.44:0/142258150 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a500b4bd0 msgr2=0x7f3a500b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:17.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a5808a700 1 --2- 172.21.15.44:0/142258150 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a500b4bd0 0x7f3a500b38d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3a48009d90 tx=0x7f3a4800b330 comp rx=0 tx=0).stop 2024-09-13T18:27:17.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a5808a700 1 -- 172.21.15.44:0/142258150 shutdown_connections 2024-09-13T18:27:17.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a5808a700 1 --2- 172.21.15.44:0/142258150 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a500b4bd0 0x7f3a500b38d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a5808a700 1 --2- 172.21.15.44:0/142258150 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3a501436c0 0x7f3a500ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a5808a700 1 -- 172.21.15.44:0/142258150 >> 172.21.15.44:0/142258150 conn(0x7f3a50070d00 msgr2=0x7f3a50071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:17.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a5808a700 1 -- 172.21.15.44:0/142258150 shutdown_connections 2024-09-13T18:27:17.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a5808a700 1 -- 172.21.15.44:0/142258150 wait complete. 2024-09-13T18:27:17.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.083+0000 7f3a5808a700 1 Processor -- start 2024-09-13T18:27:17.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a5808a700 1 -- start start 2024-09-13T18:27:17.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a5808a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3a500b3490 0x7f3a500cf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:17.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a5808a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a500b4bd0 0x7f3a501361c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:17.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a5808a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a501436c0 0x7f3a501ee900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:17.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a5808a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a50142f20 con 0x7f3a500b4bd0 2024-09-13T18:27:17.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a5808a700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a50158270 con 0x7f3a501436c0 2024-09-13T18:27:17.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a5808a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a50154020 con 0x7f3a500b3490 2024-09-13T18:27:17.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a55625700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a500b4bd0 0x7f3a501361c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:17.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a55625700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a500b4bd0 0x7f3a501361c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41770/0 (socket says 172.21.15.44:41770) 2024-09-13T18:27:17.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a55625700 1 -- 172.21.15.44:0/249375803 learned_addr learned my addr 172.21.15.44:0/249375803 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:17.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a55e26700 1 --2- 172.21.15.44:0/249375803 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3a500b3490 0x7f3a500cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:17.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a56627700 1 --2- 172.21.15.44:0/249375803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a501436c0 0x7f3a501ee900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:17.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a55625700 1 -- 172.21.15.44:0/249375803 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3a500b3490 msgr2=0x7f3a500cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a55625700 1 --2- 172.21.15.44:0/249375803 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3a500b3490 0x7f3a500cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a55625700 1 -- 172.21.15.44:0/249375803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a501436c0 msgr2=0x7f3a501ee900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a55625700 1 --2- 172.21.15.44:0/249375803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a501436c0 0x7f3a501ee900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a55625700 1 -- 172.21.15.44:0/249375803 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a48009a70 con 0x7f3a500b4bd0 2024-09-13T18:27:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a56627700 1 --2- 172.21.15.44:0/249375803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a501436c0 0x7f3a501ee900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a55625700 1 --2- 172.21.15.44:0/249375803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a500b4bd0 0x7f3a501361c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000c520 tx=0x7f3a4000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a467fc700 1 -- 172.21.15.44:0/249375803 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a40005d90 con 0x7f3a500b4bd0 2024-09-13T18:27:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a5808a700 1 -- 172.21.15.44:0/249375803 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a50136700 con 0x7f3a500b4bd0 2024-09-13T18:27:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a5808a700 1 -- 172.21.15.44:0/249375803 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a501539d0 con 0x7f3a500b4bd0 2024-09-13T18:27:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a467fc700 1 -- 172.21.15.44:0/249375803 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a400070d0 con 0x7f3a500b4bd0 2024-09-13T18:27:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a467fc700 1 -- 172.21.15.44:0/249375803 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a40007440 con 0x7f3a500b4bd0 2024-09-13T18:27:17.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.087+0000 7f3a5808a700 1 -- 172.21.15.44:0/249375803 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a38005310 con 0x7f3a500b4bd0 2024-09-13T18:27:17.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.091+0000 7f3a467fc700 1 -- 172.21.15.44:0/249375803 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3a400075a0 con 0x7f3a500b4bd0 2024-09-13T18:27:17.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.091+0000 7f3a467fc700 1 --2- 172.21.15.44:0/249375803 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3a34066730 0x7f3a34068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:17.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.091+0000 7f3a467fc700 1 -- 172.21.15.44:0/249375803 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a40083dd0 con 0x7f3a500b4bd0 2024-09-13T18:27:17.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.091+0000 7f3a55e26700 1 --2- 172.21.15.44:0/249375803 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3a34066730 0x7f3a34068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:17.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.091+0000 7f3a55e26700 1 --2- 172.21.15.44:0/249375803 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3a34066730 0x7f3a34068bf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c009b50 tx=0x7f3a4c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:17.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.099+0000 7f3a467fc700 1 -- 172.21.15.44:0/249375803 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3a40051150 con 0x7f3a500b4bd0 2024-09-13T18:27:17.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.267+0000 7f3a5808a700 1 -- 172.21.15.44:0/249375803 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3a38005b40 con 0x7f3a500b4bd0 2024-09-13T18:27:17.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.267+0000 7f3a467fc700 1 -- 172.21.15.44:0/249375803 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3a40017020 con 0x7f3a500b4bd0 2024-09-13T18:27:17.273 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:27:17.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.271+0000 7f3a5808a700 1 -- 172.21.15.44:0/249375803 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3a34066730 msgr2=0x7f3a34068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:17.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.271+0000 7f3a5808a700 1 --2- 172.21.15.44:0/249375803 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3a34066730 0x7f3a34068bf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c009b50 tx=0x7f3a4c009240 comp rx=0 tx=0).stop 2024-09-13T18:27:17.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.271+0000 7f3a5808a700 1 -- 172.21.15.44:0/249375803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a500b4bd0 msgr2=0x7f3a501361c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:17.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.271+0000 7f3a5808a700 1 --2- 172.21.15.44:0/249375803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a500b4bd0 0x7f3a501361c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000c520 tx=0x7f3a4000c830 comp rx=0 tx=0).stop 2024-09-13T18:27:17.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.271+0000 7f3a5808a700 1 -- 172.21.15.44:0/249375803 shutdown_connections 2024-09-13T18:27:17.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.271+0000 7f3a5808a700 1 --2- 172.21.15.44:0/249375803 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3a34066730 0x7f3a34068bf0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.271+0000 7f3a5808a700 1 --2- 172.21.15.44:0/249375803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a501436c0 0x7f3a501ee900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.271+0000 7f3a5808a700 1 --2- 172.21.15.44:0/249375803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a500b4bd0 0x7f3a501361c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.271+0000 7f3a5808a700 1 --2- 172.21.15.44:0/249375803 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3a500b3490 0x7f3a500cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.271+0000 7f3a5808a700 1 -- 172.21.15.44:0/249375803 >> 172.21.15.44:0/249375803 conn(0x7f3a50070d00 msgr2=0x7f3a500b0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:17.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.271+0000 7f3a5808a700 1 -- 172.21.15.44:0/249375803 shutdown_connections 2024-09-13T18:27:17.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.271+0000 7f3a5808a700 1 -- 172.21.15.44:0/249375803 wait complete. 2024-09-13T18:27:17.288 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:27:17.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.407+0000 7fe66f4ff700 1 Processor -- start 2024-09-13T18:27:17.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.407+0000 7fe66f4ff700 1 -- start start 2024-09-13T18:27:17.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.411+0000 7fe66f4ff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe66815aaa0 0x7fe6680b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:17.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.411+0000 7fe66f4ff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe668070720 0x7fe6680b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:17.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.411+0000 7fe66f4ff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6680c9d20 con 0x7fe66806db00 2024-09-13T18:27:17.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.411+0000 7fe66f4ff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6680b26c0 con 0x7fe668070720 2024-09-13T18:27:17.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.411+0000 7fe66f4ff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6680b4c00 con 0x7fe66815aaa0 2024-09-13T18:27:17.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.411+0000 7fe66dcfc700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe66815aaa0 0x7fe6680b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:17.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.411+0000 7fe66ecfe700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe668070720 0x7fe6680b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:17.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.411+0000 7fe66e4fd700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe66806db00 0x7fe6680b1fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:36128/0 (socket says 172.21.15.44:36128) 2024-09-13T18:27:17.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.411+0000 7fe66e4fd700 1 -- 172.21.15.44:0/1449304653 learned_addr learned my addr 172.21.15.44:0/1449304653 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:17.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.411+0000 7fe66ecfe700 1 -- 172.21.15.44:0/1449304653 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe66815aaa0 msgr2=0x7fe6680b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:17.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.411+0000 7fe66ecfe700 1 --2- 172.21.15.44:0/1449304653 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe66815aaa0 0x7fe6680b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.411+0000 7fe66ecfe700 1 -- 172.21.15.44:0/1449304653 >> v1:172.21.15.99:6789/0 conn(0x7fe66806db00 legacy=0x7fe6680b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:17.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.411+0000 7fe66ecfe700 1 -- 172.21.15.44:0/1449304653 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6680b28e0 con 0x7fe668070720 2024-09-13T18:27:17.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.411+0000 7fe66ecfe700 1 --2- 172.21.15.44:0/1449304653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe668070720 0x7fe6680b46c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe660009d90 tx=0x7fe66000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3deda45681f1c39 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:17.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.419+0000 7fe66d4fb700 1 -- 172.21.15.44:0/1449304653 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66000e070 con 0x7fe668070720 2024-09-13T18:27:17.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.419+0000 7fe66d4fb700 1 -- 172.21.15.44:0/1449304653 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66000bb20 con 0x7fe668070720 2024-09-13T18:27:17.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.419+0000 7fe66d4fb700 1 -- 172.21.15.44:0/1449304653 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660012430 con 0x7fe668070720 2024-09-13T18:27:17.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.419+0000 7fe66f4ff700 1 -- 172.21.15.44:0/1449304653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe668070720 msgr2=0x7fe6680b46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:17.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.419+0000 7fe66f4ff700 1 --2- 172.21.15.44:0/1449304653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe668070720 0x7fe6680b46c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe660009d90 tx=0x7fe66000b330 comp rx=0 tx=0).stop 2024-09-13T18:27:17.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.419+0000 7fe66f4ff700 1 -- 172.21.15.44:0/1449304653 shutdown_connections 2024-09-13T18:27:17.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.419+0000 7fe66f4ff700 1 --2- 172.21.15.44:0/1449304653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe668070720 0x7fe6680b46c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.419+0000 7fe66f4ff700 1 --2- 172.21.15.44:0/1449304653 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe66815aaa0 0x7fe6680b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.419+0000 7fe66f4ff700 1 -- 172.21.15.44:0/1449304653 >> 172.21.15.44:0/1449304653 conn(0x7fe6680cba60 msgr2=0x7fe6680cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:17.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.419+0000 7fe66f4ff700 1 -- 172.21.15.44:0/1449304653 shutdown_connections 2024-09-13T18:27:17.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.419+0000 7fe66f4ff700 1 -- 172.21.15.44:0/1449304653 wait complete. 2024-09-13T18:27:17.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.423+0000 7fe66f4ff700 1 Processor -- start 2024-09-13T18:27:17.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.423+0000 7fe66f4ff700 1 -- start start 2024-09-13T18:27:17.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.423+0000 7fe66f4ff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe66806db00 0x7fe66806a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:17.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.423+0000 7fe66f4ff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe668070720 0x7fe66813c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:17.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.427+0000 7fe66f4ff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe66815aaa0 0x7fe6681579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:17.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.427+0000 7fe66f4ff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66806bef0 con 0x7fe668070720 2024-09-13T18:27:17.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.427+0000 7fe66f4ff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66813c960 con 0x7fe66815aaa0 2024-09-13T18:27:17.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.427+0000 7fe66f4ff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66806c080 con 0x7fe66806db00 2024-09-13T18:27:17.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.427+0000 7fe66dcfc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe668070720 0x7fe66813c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:17.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.427+0000 7fe66dcfc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe668070720 0x7fe66813c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41774/0 (socket says 172.21.15.44:41774) 2024-09-13T18:27:17.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.427+0000 7fe66dcfc700 1 -- 172.21.15.44:0/1145082329 learned_addr learned my addr 172.21.15.44:0/1145082329 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:17.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.427+0000 7fe66e4fd700 1 --2- 172.21.15.44:0/1145082329 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe66806db00 0x7fe66806a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:17.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.427+0000 7fe66ecfe700 1 --2- 172.21.15.44:0/1145082329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe66815aaa0 0x7fe6681579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:17.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.427+0000 7fe66dcfc700 1 -- 172.21.15.44:0/1145082329 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe66806db00 msgr2=0x7fe66806a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:17.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.427+0000 7fe66dcfc700 1 --2- 172.21.15.44:0/1145082329 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe66806db00 0x7fe66806a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.427+0000 7fe66dcfc700 1 -- 172.21.15.44:0/1145082329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe66815aaa0 msgr2=0x7fe6681579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:17.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.427+0000 7fe66dcfc700 1 --2- 172.21.15.44:0/1145082329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe66815aaa0 0x7fe6681579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.427+0000 7fe66dcfc700 1 -- 172.21.15.44:0/1145082329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe660009a70 con 0x7fe668070720 2024-09-13T18:27:17.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.427+0000 7fe66dcfc700 1 --2- 172.21.15.44:0/1145082329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe668070720 0x7fe66813c420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe658009fd0 tx=0x7fe65800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:17.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.427+0000 7fe65effd700 1 -- 172.21.15.44:0/1145082329 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6580095a0 con 0x7fe668070720 2024-09-13T18:27:17.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.427+0000 7fe65effd700 1 -- 172.21.15.44:0/1145082329 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe658013680 con 0x7fe668070720 2024-09-13T18:27:17.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.427+0000 7fe66f4ff700 1 -- 172.21.15.44:0/1145082329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe668157ee0 con 0x7fe668070720 2024-09-13T18:27:17.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.427+0000 7fe65effd700 1 -- 172.21.15.44:0/1145082329 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe658013a30 con 0x7fe668070720 2024-09-13T18:27:17.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.427+0000 7fe66f4ff700 1 -- 172.21.15.44:0/1145082329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6681428f0 con 0x7fe668070720 2024-09-13T18:27:17.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.427+0000 7fe66f4ff700 1 -- 172.21.15.44:0/1145082329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6680b4fe0 con 0x7fe668070720 2024-09-13T18:27:17.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.431+0000 7fe65effd700 1 -- 172.21.15.44:0/1145082329 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe658013b90 con 0x7fe668070720 2024-09-13T18:27:17.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.431+0000 7fe65effd700 1 --2- 172.21.15.44:0/1145082329 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe64c066730 0x7fe64c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:17.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.431+0000 7fe65effd700 1 -- 172.21.15.44:0/1145082329 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe658084060 con 0x7fe668070720 2024-09-13T18:27:17.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.431+0000 7fe66e4fd700 1 --2- 172.21.15.44:0/1145082329 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe64c066730 0x7fe64c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:17.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.431+0000 7fe66e4fd700 1 --2- 172.21.15.44:0/1145082329 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe64c066730 0x7fe64c068bf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe664005930 tx=0x7fe664009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:17.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.439+0000 7fe65effd700 1 -- 172.21.15.44:0/1145082329 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe6580b5db0 con 0x7fe668070720 2024-09-13T18:27:17.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.607+0000 7fe66f4ff700 1 -- 172.21.15.44:0/1145082329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe66806c1f0 con 0x7fe668070720 2024-09-13T18:27:17.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.607+0000 7fe65effd700 1 -- 172.21.15.44:0/1145082329 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe6580512b0 con 0x7fe668070720 2024-09-13T18:27:17.613 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:27:17.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.611+0000 7fe66f4ff700 1 -- 172.21.15.44:0/1145082329 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe64c066730 msgr2=0x7fe64c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:17.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.611+0000 7fe66f4ff700 1 --2- 172.21.15.44:0/1145082329 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe64c066730 0x7fe64c068bf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe664005930 tx=0x7fe664009040 comp rx=0 tx=0).stop 2024-09-13T18:27:17.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.611+0000 7fe66f4ff700 1 -- 172.21.15.44:0/1145082329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe668070720 msgr2=0x7fe66813c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:17.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.611+0000 7fe66f4ff700 1 --2- 172.21.15.44:0/1145082329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe668070720 0x7fe66813c420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe658009fd0 tx=0x7fe65800eb20 comp rx=0 tx=0).stop 2024-09-13T18:27:17.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.611+0000 7fe66f4ff700 1 -- 172.21.15.44:0/1145082329 shutdown_connections 2024-09-13T18:27:17.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.611+0000 7fe66f4ff700 1 --2- 172.21.15.44:0/1145082329 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe64c066730 0x7fe64c068bf0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.611+0000 7fe66f4ff700 1 --2- 172.21.15.44:0/1145082329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe66815aaa0 0x7fe6681579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.611+0000 7fe66f4ff700 1 --2- 172.21.15.44:0/1145082329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe668070720 0x7fe66813c420 secure :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe658009fd0 tx=0x7fe65800eb20 comp rx=0 tx=0).stop 2024-09-13T18:27:17.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.611+0000 7fe66f4ff700 1 --2- 172.21.15.44:0/1145082329 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe66806db00 0x7fe66806a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.611+0000 7fe66f4ff700 1 -- 172.21.15.44:0/1145082329 >> 172.21.15.44:0/1145082329 conn(0x7fe6680cba60 msgr2=0x7fe6680c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:17.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.611+0000 7fe66f4ff700 1 -- 172.21.15.44:0/1145082329 shutdown_connections 2024-09-13T18:27:17.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.611+0000 7fe66f4ff700 1 -- 172.21.15.44:0/1145082329 wait complete. 2024-09-13T18:27:17.633 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:27:17.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.747+0000 7f65a359e700 1 Processor -- start 2024-09-13T18:27:17.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.747+0000 7f65a359e700 1 -- start start 2024-09-13T18:27:17.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.747+0000 7f65a359e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f65a4160eb0 0x7f65a4165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:17.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.747+0000 7f65a359e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65a41619a0 0x7f65a40b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:17.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.747+0000 7f65a359e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a40b3d60 con 0x7f65a40b33d0 2024-09-13T18:27:17.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.747+0000 7f65a359e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a4071f30 con 0x7f65a4160eb0 2024-09-13T18:27:17.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.747+0000 7f65a359e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a41622e0 con 0x7f65a41619a0 2024-09-13T18:27:17.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.747+0000 7f65a259c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f65a4160eb0 0x7f65a4165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:17.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.747+0000 7f65a259c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f65a4160eb0 0x7f65a4165590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41788/0 (socket says 172.21.15.44:41788) 2024-09-13T18:27:17.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.747+0000 7f65a259c700 1 -- 172.21.15.44:0/1195679258 learned_addr learned my addr 172.21.15.44:0/1195679258 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:17.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.747+0000 7f65a2d9d700 1 --2- 172.21.15.44:0/1195679258 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65a41619a0 0x7f65a40b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:17.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.747+0000 7f65a1d9b700 1 -- 172.21.15.44:0/1195679258 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215353528 0 0) 0x7f658c001110 con 0x7f65a40b33d0 2024-09-13T18:27:17.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.747+0000 7f65a1d9b700 1 -- 172.21.15.44:0/1195679258 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65900035d0 con 0x7f65a40b33d0 2024-09-13T18:27:17.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.747+0000 7f65a259c700 1 -- 172.21.15.44:0/1195679258 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65a41619a0 msgr2=0x7f65a40b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:17.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.747+0000 7f65a259c700 1 --2- 172.21.15.44:0/1195679258 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65a41619a0 0x7f65a40b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.747+0000 7f65a259c700 1 -- 172.21.15.44:0/1195679258 >> v1:172.21.15.99:6789/0 conn(0x7f65a40b33d0 legacy=0x7f65a4161290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:17.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.747+0000 7f65a259c700 1 -- 172.21.15.44:0/1195679258 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a4162000 con 0x7f65a4160eb0 2024-09-13T18:27:17.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.747+0000 7f65a2d9d700 1 --2- 172.21.15.44:0/1195679258 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65a41619a0 0x7f65a40b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:17.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.747+0000 7f65a259c700 1 --2- 172.21.15.44:0/1195679258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65a4160eb0 0x7f65a4165590 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6594009910 tx=0x7f6594009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925046d65f769f21 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:17.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.747+0000 7f65a1d9b700 1 -- 172.21.15.44:0/1195679258 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6594011830 con 0x7f65a4160eb0 2024-09-13T18:27:17.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.747+0000 7f65a1d9b700 1 -- 172.21.15.44:0/1195679258 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6594011990 con 0x7f65a4160eb0 2024-09-13T18:27:17.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.747+0000 7f65a1d9b700 1 -- 172.21.15.44:0/1195679258 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6594011d00 con 0x7f65a4160eb0 2024-09-13T18:27:17.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.751+0000 7f65a359e700 1 -- 172.21.15.44:0/1195679258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65a4160eb0 msgr2=0x7f65a4165590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:17.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.751+0000 7f65a359e700 1 --2- 172.21.15.44:0/1195679258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65a4160eb0 0x7f65a4165590 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6594009910 tx=0x7f6594009c20 comp rx=0 tx=0).stop 2024-09-13T18:27:17.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.751+0000 7f65a359e700 1 -- 172.21.15.44:0/1195679258 shutdown_connections 2024-09-13T18:27:17.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.751+0000 7f65a359e700 1 --2- 172.21.15.44:0/1195679258 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65a41619a0 0x7f65a40b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.751+0000 7f65a359e700 1 --2- 172.21.15.44:0/1195679258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65a4160eb0 0x7f65a4165590 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.751+0000 7f65a359e700 1 -- 172.21.15.44:0/1195679258 >> 172.21.15.44:0/1195679258 conn(0x7f65a40b0f00 msgr2=0x7f65a40b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:17.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.751+0000 7f65a359e700 1 -- 172.21.15.44:0/1195679258 shutdown_connections 2024-09-13T18:27:17.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.751+0000 7f65a359e700 1 -- 172.21.15.44:0/1195679258 wait complete. 2024-09-13T18:27:17.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.751+0000 7f65a359e700 1 Processor -- start 2024-09-13T18:27:17.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.751+0000 7f65a359e700 1 -- start start 2024-09-13T18:27:17.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f65a359e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65a40b33d0 0x7f65a415e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:17.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f65a359e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65a4160eb0 0x7f65a4156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:17.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f65a359e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65a41619a0 0x7f65a4158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:17.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f65a359e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a41572a0 con 0x7f65a41619a0 2024-09-13T18:27:17.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f65a359e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a41f6fb0 con 0x7f65a4160eb0 2024-09-13T18:27:17.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f65a359e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a41f7290 con 0x7f65a40b33d0 2024-09-13T18:27:17.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f65a2d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65a41619a0 0x7f65a4158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:17.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f65a259c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65a40b33d0 0x7f65a415e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:17.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f65a259c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65a40b33d0 0x7f65a415e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:58052/0 (socket says 172.21.15.44:58052) 2024-09-13T18:27:17.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f65a259c700 1 -- 172.21.15.44:0/1489861902 learned_addr learned my addr 172.21.15.44:0/1489861902 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:17.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f6599d9b700 1 --2- 172.21.15.44:0/1489861902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65a4160eb0 0x7f65a4156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:17.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f6599d9b700 1 -- 172.21.15.44:0/1489861902 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65a40b33d0 msgr2=0x7f65a415e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:17.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f6599d9b700 1 --2- 172.21.15.44:0/1489861902 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65a40b33d0 0x7f65a415e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f6599d9b700 1 -- 172.21.15.44:0/1489861902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65a41619a0 msgr2=0x7f65a4158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:17.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f6599d9b700 1 --2- 172.21.15.44:0/1489861902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65a41619a0 0x7f65a4158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f6599d9b700 1 -- 172.21.15.44:0/1489861902 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c009a70 con 0x7f65a4160eb0 2024-09-13T18:27:17.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f65a259c700 1 --2- 172.21.15.44:0/1489861902 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65a40b33d0 0x7f65a415e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:17.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f6599d9b700 1 --2- 172.21.15.44:0/1489861902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65a4160eb0 0x7f65a4156af0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f658c00c700 tx=0x7f658c00ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:17.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f659b7fe700 1 -- 172.21.15.44:0/1489861902 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c0052d0 con 0x7f65a4160eb0 2024-09-13T18:27:17.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f65a359e700 1 -- 172.21.15.44:0/1489861902 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6594009570 con 0x7f65a4160eb0 2024-09-13T18:27:17.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f659b7fe700 1 -- 172.21.15.44:0/1489861902 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c005450 con 0x7f65a4160eb0 2024-09-13T18:27:17.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f659b7fe700 1 -- 172.21.15.44:0/1489861902 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c0038e0 con 0x7f65a4160eb0 2024-09-13T18:27:17.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f65a359e700 1 -- 172.21.15.44:0/1489861902 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a41f7850 con 0x7f65a4160eb0 2024-09-13T18:27:17.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.755+0000 7f65a359e700 1 -- 172.21.15.44:0/1489861902 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a406a3e0 con 0x7f65a4160eb0 2024-09-13T18:27:17.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.759+0000 7f659b7fe700 1 -- 172.21.15.44:0/1489861902 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f658c003a40 con 0x7f65a4160eb0 2024-09-13T18:27:17.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.759+0000 7f659b7fe700 1 --2- 172.21.15.44:0/1489861902 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6584066730 0x7f6584068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:17.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.759+0000 7f659b7fe700 1 -- 172.21.15.44:0/1489861902 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f658c0832c0 con 0x7f65a4160eb0 2024-09-13T18:27:17.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.759+0000 7f65a259c700 1 --2- 172.21.15.44:0/1489861902 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6584066730 0x7f6584068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:17.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.759+0000 7f65a259c700 1 --2- 172.21.15.44:0/1489861902 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6584066730 0x7f6584068bf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6594009150 tx=0x7f6594008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:17.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.767+0000 7f659b7fe700 1 -- 172.21.15.44:0/1489861902 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f658c050640 con 0x7f65a4160eb0 2024-09-13T18:27:17.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.975+0000 7f65a359e700 1 -- 172.21.15.44:0/1489861902 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65a40b3d60 con 0x7f65a4160eb0 2024-09-13T18:27:17.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.975+0000 7f659b7fe700 1 -- 172.21.15.44:0/1489861902 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4725 (secure 0 0 0) 0x7f65a40b3d60 con 0x7f65a4160eb0 2024-09-13T18:27:17.981 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:17.981 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2616086834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2616086834},{"type":"v1","addr":"172.21.15.99:6835","nonce":2616086834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/2083799524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2083799524},{"type":"v1","addr":"172.21.15.99:6837","nonce":2083799524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/369871675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":369871675},{"type":"v1","addr":"172.21.15.44:6833","nonce":369871675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:27:01.277463+0000","modified":"2024-09-13T18:27:04.292778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/1402693416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1402693416},{"type":"v1","addr":"172.21.15.44:6835","nonce":1402693416}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:27:17.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.979+0000 7f65a359e700 1 -- 172.21.15.44:0/1489861902 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6584066730 msgr2=0x7f6584068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:17.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.979+0000 7f65a359e700 1 --2- 172.21.15.44:0/1489861902 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6584066730 0x7f6584068bf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6594009150 tx=0x7f6594008030 comp rx=0 tx=0).stop 2024-09-13T18:27:17.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.979+0000 7f65a359e700 1 -- 172.21.15.44:0/1489861902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65a4160eb0 msgr2=0x7f65a4156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:17.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.979+0000 7f65a359e700 1 --2- 172.21.15.44:0/1489861902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65a4160eb0 0x7f65a4156af0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f658c00c700 tx=0x7f658c00ca10 comp rx=0 tx=0).stop 2024-09-13T18:27:17.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.979+0000 7f65a359e700 1 -- 172.21.15.44:0/1489861902 shutdown_connections 2024-09-13T18:27:17.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.979+0000 7f65a359e700 1 --2- 172.21.15.44:0/1489861902 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6584066730 0x7f6584068bf0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.979+0000 7f65a359e700 1 --2- 172.21.15.44:0/1489861902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65a41619a0 0x7f65a4158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.979+0000 7f65a359e700 1 --2- 172.21.15.44:0/1489861902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65a4160eb0 0x7f65a4156af0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.979+0000 7f65a359e700 1 --2- 172.21.15.44:0/1489861902 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65a40b33d0 0x7f65a415e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.979+0000 7f65a359e700 1 -- 172.21.15.44:0/1489861902 >> 172.21.15.44:0/1489861902 conn(0x7f65a40b0f00 msgr2=0x7f65a41637f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:17.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.979+0000 7f65a359e700 1 -- 172.21.15.44:0/1489861902 shutdown_connections 2024-09-13T18:27:17.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:17.979+0000 7f65a359e700 1 -- 172.21.15.44:0/1489861902 wait complete. 2024-09-13T18:27:17.984 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 7 2024-09-13T18:27:17.995 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:18.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.103+0000 7efe18939700 1 Processor -- start 2024-09-13T18:27:18.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.103+0000 7efe18939700 1 -- start start 2024-09-13T18:27:18.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe18939700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe1406d090 0x7efe14159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:18.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe18939700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efe1415a370 0x7efe1415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:18.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe18939700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe1406d700 con 0x7efe14159a50 2024-09-13T18:27:18.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe18939700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1406dcc0 con 0x7efe1415a370 2024-09-13T18:27:18.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe18939700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1406d500 con 0x7efe1406d090 2024-09-13T18:27:18.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe12d9d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7efe14159a50 0x7efe1406c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44860/0 (socket says 172.21.15.44:44860) 2024-09-13T18:27:18.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe12d9d700 1 -- 172.21.15.44:0/93377782 learned_addr learned my addr 172.21.15.44:0/93377782 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:18.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe1359e700 1 --2- 172.21.15.44:0/93377782 >> v2:172.21.15.99:3300/0 conn(0x7efe1415a370 0x7efe1415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:18.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe0bfff700 1 --2- 172.21.15.44:0/93377782 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe1406d090 0x7efe14159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:18.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe1259c700 1 -- 172.21.15.44:0/93377782 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3714671679 0 0) 0x7efe1406d700 con 0x7efe14159a50 2024-09-13T18:27:18.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe1259c700 1 -- 172.21.15.44:0/93377782 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe000035d0 con 0x7efe14159a50 2024-09-13T18:27:18.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe1359e700 1 -- 172.21.15.44:0/93377782 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe1406d090 msgr2=0x7efe14159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:18.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe1359e700 1 --2- 172.21.15.44:0/93377782 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe1406d090 0x7efe14159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe1359e700 1 -- 172.21.15.44:0/93377782 >> v1:172.21.15.44:6789/0 conn(0x7efe14159a50 legacy=0x7efe1406c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:18.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe1359e700 1 -- 172.21.15.44:0/93377782 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1406d9e0 con 0x7efe1415a370 2024-09-13T18:27:18.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe0bfff700 1 --2- 172.21.15.44:0/93377782 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe1406d090 0x7efe14159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:18.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe1359e700 1 --2- 172.21.15.44:0/93377782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe1415a370 0x7efe1415ba00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009d90 tx=0x7efe0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97fe11337240bad6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:18.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe1259c700 1 -- 172.21.15.44:0/93377782 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c00e070 con 0x7efe1415a370 2024-09-13T18:27:18.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe1259c700 1 -- 172.21.15.44:0/93377782 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0c00bae0 con 0x7efe1415a370 2024-09-13T18:27:18.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe1259c700 1 -- 172.21.15.44:0/93377782 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c00be50 con 0x7efe1415a370 2024-09-13T18:27:18.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe18939700 1 -- 172.21.15.44:0/93377782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe1415a370 msgr2=0x7efe1415ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:18.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe18939700 1 --2- 172.21.15.44:0/93377782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe1415a370 0x7efe1415ba00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009d90 tx=0x7efe0c00b330 comp rx=0 tx=0).stop 2024-09-13T18:27:18.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe18939700 1 -- 172.21.15.44:0/93377782 shutdown_connections 2024-09-13T18:27:18.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe18939700 1 --2- 172.21.15.44:0/93377782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe1415a370 0x7efe1415ba00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe18939700 1 --2- 172.21.15.44:0/93377782 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe1406d090 0x7efe14159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe18939700 1 -- 172.21.15.44:0/93377782 >> 172.21.15.44:0/93377782 conn(0x7efe140b1f50 msgr2=0x7efe140cf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:18.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe18939700 1 -- 172.21.15.44:0/93377782 shutdown_connections 2024-09-13T18:27:18.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.107+0000 7efe18939700 1 -- 172.21.15.44:0/93377782 wait complete. 2024-09-13T18:27:18.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe18939700 1 Processor -- start 2024-09-13T18:27:18.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe18939700 1 -- start start 2024-09-13T18:27:18.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe18939700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe1406d090 0x7efe141f2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:18.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe18939700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe14159a50 0x7efe140b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:18.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe18939700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe1415a370 0x7efe140cde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe18939700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe14164d60 con 0x7efe1415a370 2024-09-13T18:27:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe18939700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe141f2bc0 con 0x7efe1406d090 2024-09-13T18:27:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe18939700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe14167180 con 0x7efe14159a50 2024-09-13T18:27:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe1359e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe1415a370 0x7efe140cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe1359e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe1415a370 0x7efe140cde10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41812/0 (socket says 172.21.15.44:41812) 2024-09-13T18:27:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe1359e700 1 -- 172.21.15.44:0/3313045285 learned_addr learned my addr 172.21.15.44:0/3313045285 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe0bfff700 1 --2- 172.21.15.44:0/3313045285 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe14159a50 0x7efe140b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe12d9d700 1 --2- 172.21.15.44:0/3313045285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe1406d090 0x7efe141f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe1359e700 1 -- 172.21.15.44:0/3313045285 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe14159a50 msgr2=0x7efe140b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe1359e700 1 --2- 172.21.15.44:0/3313045285 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe14159a50 0x7efe140b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe1359e700 1 -- 172.21.15.44:0/3313045285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe1406d090 msgr2=0x7efe141f2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe1359e700 1 --2- 172.21.15.44:0/3313045285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe1406d090 0x7efe141f2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe1359e700 1 -- 172.21.15.44:0/3313045285 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc0094b0 con 0x7efe1415a370 2024-09-13T18:27:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe1359e700 1 --2- 172.21.15.44:0/3313045285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe1415a370 0x7efe140cde10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efe140725a0 tx=0x7efe0c004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:18.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe0b7fe700 1 -- 172.21.15.44:0/3313045285 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c0048f0 con 0x7efe1415a370 2024-09-13T18:27:18.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe0b7fe700 1 -- 172.21.15.44:0/3313045285 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0c003e30 con 0x7efe1415a370 2024-09-13T18:27:18.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe18939700 1 -- 172.21.15.44:0/3313045285 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe0c009a70 con 0x7efe1415a370 2024-09-13T18:27:18.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe0b7fe700 1 -- 172.21.15.44:0/3313045285 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c01c680 con 0x7efe1415a370 2024-09-13T18:27:18.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.111+0000 7efe18939700 1 -- 172.21.15.44:0/3313045285 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe14162b50 con 0x7efe1415a370 2024-09-13T18:27:18.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.115+0000 7efe0b7fe700 1 -- 172.21.15.44:0/3313045285 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efe0c01c7e0 con 0x7efe1415a370 2024-09-13T18:27:18.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.115+0000 7efe18939700 1 -- 172.21.15.44:0/3313045285 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe14159e30 con 0x7efe1415a370 2024-09-13T18:27:18.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.115+0000 7efe0b7fe700 1 --2- 172.21.15.44:0/3313045285 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efdf4066730 0x7efdf4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:18.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.115+0000 7efe0b7fe700 1 -- 172.21.15.44:0/3313045285 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe0c085ab0 con 0x7efe1415a370 2024-09-13T18:27:18.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.115+0000 7efe12d9d700 1 --2- 172.21.15.44:0/3313045285 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efdf4066730 0x7efdf4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:18.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.119+0000 7efe12d9d700 1 --2- 172.21.15.44:0/3313045285 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efdf4066730 0x7efdf4068bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efe04007b30 tx=0x7efe04007a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:18.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.127+0000 7efe0b7fe700 1 -- 172.21.15.44:0/3313045285 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efe0c052f50 con 0x7efe1415a370 2024-09-13T18:27:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.303+0000 7efe18939700 1 -- 172.21.15.44:0/3313045285 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe1406bc10 con 0x7efe1415a370 2024-09-13T18:27:18.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.307+0000 7efe0b7fe700 1 -- 172.21.15.44:0/3313045285 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7efe0c022020 con 0x7efe1415a370 2024-09-13T18:27:18.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:18.311 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:02.280221+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.307+0000 7efe18939700 1 -- 172.21.15.44:0/3313045285 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efdf4066730 msgr2=0x7efdf4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.307+0000 7efe18939700 1 --2- 172.21.15.44:0/3313045285 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efdf4066730 0x7efdf4068bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efe04007b30 tx=0x7efe04007a80 comp rx=0 tx=0).stop 2024-09-13T18:27:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.307+0000 7efe18939700 1 -- 172.21.15.44:0/3313045285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe1415a370 msgr2=0x7efe140cde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.307+0000 7efe18939700 1 --2- 172.21.15.44:0/3313045285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe1415a370 0x7efe140cde10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efe140725a0 tx=0x7efe0c004b60 comp rx=0 tx=0).stop 2024-09-13T18:27:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.307+0000 7efe18939700 1 -- 172.21.15.44:0/3313045285 shutdown_connections 2024-09-13T18:27:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.307+0000 7efe18939700 1 --2- 172.21.15.44:0/3313045285 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efdf4066730 0x7efdf4068bf0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.307+0000 7efe18939700 1 --2- 172.21.15.44:0/3313045285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe1415a370 0x7efe140cde10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.307+0000 7efe18939700 1 --2- 172.21.15.44:0/3313045285 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe14159a50 0x7efe140b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.307+0000 7efe18939700 1 --2- 172.21.15.44:0/3313045285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe1406d090 0x7efe141f2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.307+0000 7efe18939700 1 -- 172.21.15.44:0/3313045285 >> 172.21.15.44:0/3313045285 conn(0x7efe140b1f50 msgr2=0x7efe1406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:18.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.307+0000 7efe18939700 1 -- 172.21.15.44:0/3313045285 shutdown_connections 2024-09-13T18:27:18.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.307+0000 7efe18939700 1 -- 172.21.15.44:0/3313045285 wait complete. 2024-09-13T18:27:18.326 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:27:18.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f3541f64700 1 Processor -- start 2024-09-13T18:27:18.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f3541f64700 1 -- start start 2024-09-13T18:27:18.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f3541f64700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3534036d80 0x7f353400adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:18.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f3541f64700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3534050360 con 0x7f353404fc10 2024-09-13T18:27:18.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f3541f64700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f353401d350 con 0x7f35340e2d60 2024-09-13T18:27:18.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f3541f64700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353401d630 con 0x7f3534036d80 2024-09-13T18:27:18.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f353bfff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f353404fc10 0x7f353400a6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44872/0 (socket says 172.21.15.44:44872) 2024-09-13T18:27:18.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f353bfff700 1 -- 172.21.15.44:0/2201050258 learned_addr learned my addr 172.21.15.44:0/2201050258 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:18.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f353b7fe700 1 -- 172.21.15.44:0/2201050258 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468212637 0 0) 0x7f3534050360 con 0x7f353404fc10 2024-09-13T18:27:18.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f3541763700 1 --2- 172.21.15.44:0/2201050258 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3534036d80 0x7f353400adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:18.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f353b7fe700 1 -- 172.21.15.44:0/2201050258 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35240035d0 con 0x7f353404fc10 2024-09-13T18:27:18.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f353b7fe700 1 -- 172.21.15.44:0/2201050258 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 927668263 0 0) 0x7f35240035d0 con 0x7f353404fc10 2024-09-13T18:27:18.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f353b7fe700 1 -- 172.21.15.44:0/2201050258 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3534036d80 msgr2=0x7f353400adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:18.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f353b7fe700 1 --2- 172.21.15.44:0/2201050258 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3534036d80 0x7f353400adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f353b7fe700 1 -- 172.21.15.44:0/2201050258 >> v1:172.21.15.99:6789/0 conn(0x7f35340e2d60 legacy=0x7f353404f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:18.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f353b7fe700 1 -- 172.21.15.44:0/2201050258 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353401d910 con 0x7f353404fc10 2024-09-13T18:27:18.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f353b7fe700 1 -- 172.21.15.44:0/2201050258 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f353c04ef50 con 0x7f353404fc10 2024-09-13T18:27:18.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f353b7fe700 1 -- 172.21.15.44:0/2201050258 >> v1:172.21.15.44:6789/0 conn(0x7f353404fc10 legacy=0x7f353400a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:18.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f353b7fe700 1 --2- 172.21.15.44:0/2201050258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3524003a50 0x7f3524003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:18.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f353b7fe700 1 --2- 172.21.15.44:0/2201050258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3524004870 0x7f3524004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:18.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f353b7fe700 1 --2- 172.21.15.44:0/2201050258 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3524005230 0x7f352400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:18.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f353b7fe700 1 -- 172.21.15.44:0/2201050258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353401d630 con 0x7f3524004870 2024-09-13T18:27:18.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f353b7fe700 1 -- 172.21.15.44:0/2201050258 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352400c050 con 0x7f3524003a50 2024-09-13T18:27:18.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f353b7fe700 1 -- 172.21.15.44:0/2201050258 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352400c210 con 0x7f3524005230 2024-09-13T18:27:18.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f3541763700 1 --2- 172.21.15.44:0/2201050258 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3534036d80 0x7f353400adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:18.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f3540f62700 1 --2- 172.21.15.44:0/2201050258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3524003a50 0x7f3524003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:18.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f353bfff700 1 --2- 172.21.15.44:0/2201050258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3524004870 0x7f3524004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:18.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f3541763700 1 --2- 172.21.15.44:0/2201050258 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3524005230 0x7f352400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:18.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f3540f62700 1 -- 172.21.15.44:0/2201050258 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3524005230 msgr2=0x7f352400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:18.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f3540f62700 1 --2- 172.21.15.44:0/2201050258 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3524005230 0x7f352400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f3540f62700 1 -- 172.21.15.44:0/2201050258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3524004870 msgr2=0x7f3524004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:18.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f3540f62700 1 --2- 172.21.15.44:0/2201050258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3524004870 0x7f3524004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f3540f62700 1 -- 172.21.15.44:0/2201050258 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35240035d0 con 0x7f3524003a50 2024-09-13T18:27:18.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f353bfff700 1 --2- 172.21.15.44:0/2201050258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3524004870 0x7f3524004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:18.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.431+0000 7f3540f62700 1 --2- 172.21.15.44:0/2201050258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3524003a50 0x7f3524003e70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f352c001840 tx=0x7f35240058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfde18063c816971 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:18.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f353b7fe700 1 -- 172.21.15.44:0/2201050258 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c001300 con 0x7f3524003a50 2024-09-13T18:27:18.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f353b7fe700 1 -- 172.21.15.44:0/2201050258 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352c0052f0 con 0x7f3524003a50 2024-09-13T18:27:18.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f353b7fe700 1 -- 172.21.15.44:0/2201050258 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c0036f0 con 0x7f3524003a50 2024-09-13T18:27:18.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f3541f64700 1 -- 172.21.15.44:0/2201050258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3524003a50 msgr2=0x7f3524003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:18.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f3541f64700 1 --2- 172.21.15.44:0/2201050258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3524003a50 0x7f3524003e70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f352c001840 tx=0x7f35240058a0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f3541763700 1 -- 172.21.15.44:0/2201050258 reap_dead start 2024-09-13T18:27:18.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f3541f64700 1 -- 172.21.15.44:0/2201050258 shutdown_connections 2024-09-13T18:27:18.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f3541f64700 1 -- 172.21.15.44:0/2201050258 >> 172.21.15.44:0/2201050258 conn(0x7f3534036140 msgr2=0x7f3534036550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:18.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f3541f64700 1 -- 172.21.15.44:0/2201050258 shutdown_connections 2024-09-13T18:27:18.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f3541f64700 1 -- 172.21.15.44:0/2201050258 wait complete. 2024-09-13T18:27:18.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f3541f64700 1 Processor -- start 2024-09-13T18:27:18.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f3541f64700 1 -- start start 2024-09-13T18:27:18.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f3541f64700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3524003a50 0x7f3534049140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:18.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f3541f64700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f353404b900 0x7f35340ce870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:18.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f3541f64700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f353404bd80 0x7f35340cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:18.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f3541f64700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35340cc5d0 con 0x7f353404b900 2024-09-13T18:27:18.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f3541f64700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3534049680 con 0x7f3524003a50 2024-09-13T18:27:18.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f3541f64700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3534049920 con 0x7f353404bd80 2024-09-13T18:27:18.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f353bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f353404b900 0x7f35340ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:18.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f3540f62700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3524003a50 0x7f3534049140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:18.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f353bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f353404b900 0x7f35340ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41816/0 (socket says 172.21.15.44:41816) 2024-09-13T18:27:18.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f353bfff700 1 -- 172.21.15.44:0/3833422597 learned_addr learned my addr 172.21.15.44:0/3833422597 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:18.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f3541763700 1 --2- 172.21.15.44:0/3833422597 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f353404bd80 0x7f35340cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:18.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f353bfff700 1 -- 172.21.15.44:0/3833422597 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f353404bd80 msgr2=0x7f35340cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:18.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f353bfff700 1 --2- 172.21.15.44:0/3833422597 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f353404bd80 0x7f35340cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f353bfff700 1 -- 172.21.15.44:0/3833422597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3524003a50 msgr2=0x7f3534049140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:18.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f353bfff700 1 --2- 172.21.15.44:0/3833422597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3524003a50 0x7f3534049140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.435+0000 7f353bfff700 1 -- 172.21.15.44:0/3833422597 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3534049c00 con 0x7f353404b900 2024-09-13T18:27:18.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.439+0000 7f353bfff700 1 --2- 172.21.15.44:0/3833422597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f353404b900 0x7f35340ce870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f353c06a200 tx=0x7f353c0675b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:18.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.439+0000 7f35397fa700 1 -- 172.21.15.44:0/3833422597 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c08f070 con 0x7f353404b900 2024-09-13T18:27:18.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.439+0000 7f35397fa700 1 -- 172.21.15.44:0/3833422597 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c0676e0 con 0x7f353404b900 2024-09-13T18:27:18.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.439+0000 7f3541f64700 1 -- 172.21.15.44:0/3833422597 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3534049ee0 con 0x7f353404b900 2024-09-13T18:27:18.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.439+0000 7f35397fa700 1 -- 172.21.15.44:0/3833422597 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c068450 con 0x7f353404b900 2024-09-13T18:27:18.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.439+0000 7f3541f64700 1 -- 172.21.15.44:0/3833422597 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353404a4a0 con 0x7f353404b900 2024-09-13T18:27:18.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.439+0000 7f3541f64700 1 -- 172.21.15.44:0/3833422597 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3534004800 con 0x7f353404b900 2024-09-13T18:27:18.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.439+0000 7f35397fa700 1 -- 172.21.15.44:0/3833422597 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f353c092070 con 0x7f353404b900 2024-09-13T18:27:18.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.439+0000 7f35397fa700 1 --2- 172.21.15.44:0/3833422597 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3528066730 0x7f3528068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:18.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.439+0000 7f35397fa700 1 -- 172.21.15.44:0/3833422597 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f353c0fea60 con 0x7f353404b900 2024-09-13T18:27:18.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.439+0000 7f3540f62700 1 --2- 172.21.15.44:0/3833422597 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3528066730 0x7f3528068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:18.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.443+0000 7f3540f62700 1 --2- 172.21.15.44:0/3833422597 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3528066730 0x7f3528068bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f352c008fd0 tx=0x7f352c009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:18.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.451+0000 7f35397fa700 1 -- 172.21.15.44:0/3833422597 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f353c0cbd30 con 0x7f353404b900 2024-09-13T18:27:18.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.659+0000 7f3541f64700 1 -- 172.21.15.44:0/3833422597 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3534034050 con 0x7f353404b900 2024-09-13T18:27:18.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.659+0000 7f35397fa700 1 -- 172.21.15.44:0/3833422597 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4725 (secure 0 0 0) 0x7f353c099020 con 0x7f353404b900 2024-09-13T18:27:18.665 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:18.665 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2616086834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2616086834},{"type":"v1","addr":"172.21.15.99:6835","nonce":2616086834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/2083799524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2083799524},{"type":"v1","addr":"172.21.15.99:6837","nonce":2083799524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/369871675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":369871675},{"type":"v1","addr":"172.21.15.44:6833","nonce":369871675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:27:01.277463+0000","modified":"2024-09-13T18:27:04.292778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/1402693416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1402693416},{"type":"v1","addr":"172.21.15.44:6835","nonce":1402693416}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:27:18.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.663+0000 7f3541f64700 1 -- 172.21.15.44:0/3833422597 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3528066730 msgr2=0x7f3528068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:18.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.663+0000 7f3541f64700 1 --2- 172.21.15.44:0/3833422597 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3528066730 0x7f3528068bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f352c008fd0 tx=0x7f352c009030 comp rx=0 tx=0).stop 2024-09-13T18:27:18.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.663+0000 7f3541f64700 1 -- 172.21.15.44:0/3833422597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f353404b900 msgr2=0x7f35340ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:18.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.663+0000 7f3541f64700 1 --2- 172.21.15.44:0/3833422597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f353404b900 0x7f35340ce870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f353c06a200 tx=0x7f353c0675b0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.663+0000 7f3541f64700 1 -- 172.21.15.44:0/3833422597 shutdown_connections 2024-09-13T18:27:18.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.663+0000 7f3541f64700 1 --2- 172.21.15.44:0/3833422597 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3528066730 0x7f3528068bf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.663+0000 7f3541f64700 1 --2- 172.21.15.44:0/3833422597 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f353404bd80 0x7f35340cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.663+0000 7f3541f64700 1 --2- 172.21.15.44:0/3833422597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f353404b900 0x7f35340ce870 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.663+0000 7f3541f64700 1 --2- 172.21.15.44:0/3833422597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3524003a50 0x7f3534049140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.663+0000 7f3541f64700 1 -- 172.21.15.44:0/3833422597 >> 172.21.15.44:0/3833422597 conn(0x7f3534036140 msgr2=0x7f3534035030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:18.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.663+0000 7f3541f64700 1 -- 172.21.15.44:0/3833422597 shutdown_connections 2024-09-13T18:27:18.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:18.663+0000 7f3541f64700 1 -- 172.21.15.44:0/3833422597 wait complete. 2024-09-13T18:27:18.669 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 7 2024-09-13T18:27:19.082 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:27:01.277463+0000', 'modified': '2024-09-13T18:27:04.292778+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.44:6835/1402693416', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 1402693416}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 1402693416}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:27:19.083 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:27:19.083 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:27:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.207+0000 7f1c91566700 1 Processor -- start 2024-09-13T18:27:19.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.207+0000 7f1c91566700 1 -- start start 2024-09-13T18:27:19.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.207+0000 7f1c91566700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1c8c144340 0x7f1c8c06d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.207+0000 7f1c91566700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1c8c0cdc90 0x7f1c8c06fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.207+0000 7f1c91566700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c8c144720 con 0x7f1c8c06bdb0 2024-09-13T18:27:19.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.207+0000 7f1c91566700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8c06dd40 con 0x7f1c8c144340 2024-09-13T18:27:19.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.207+0000 7f1c91566700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8c06da60 con 0x7f1c8c0cdc90 2024-09-13T18:27:19.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.207+0000 7f1c8bfff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1c8c144340 0x7f1c8c06d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.207+0000 7f1c8bfff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1c8c144340 0x7f1c8c06d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41822/0 (socket says 172.21.15.44:41822) 2024-09-13T18:27:19.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.207+0000 7f1c8bfff700 1 -- 172.21.15.44:0/3850844025 learned_addr learned my addr 172.21.15.44:0/3850844025 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:19.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.207+0000 7f1c90d65700 1 --2- 172.21.15.44:0/3850844025 >> v2:172.21.15.99:3300/0 conn(0x7f1c8c0cdc90 0x7f1c8c06fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.207+0000 7f1c8bfff700 1 -- 172.21.15.44:0/3850844025 >> v2:172.21.15.99:3300/0 conn(0x7f1c8c0cdc90 msgr2=0x7f1c8c06fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:19.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.207+0000 7f1c8bfff700 1 --2- 172.21.15.44:0/3850844025 >> v2:172.21.15.99:3300/0 conn(0x7f1c8c0cdc90 0x7f1c8c06fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.207+0000 7f1c8bfff700 1 -- 172.21.15.44:0/3850844025 >> v1:172.21.15.44:6789/0 conn(0x7f1c8c06bdb0 legacy=0x7f1c8c0cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:19.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.207+0000 7f1c8affd700 1 -- 172.21.15.44:0/3850844025 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 235456394 0 0) 0x7f1c8c144720 con 0x7f1c8c06bdb0 2024-09-13T18:27:19.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.207+0000 7f1c8bfff700 1 -- 172.21.15.44:0/3850844025 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8c15e660 con 0x7f1c8c144340 2024-09-13T18:27:19.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.207+0000 7f1c8bfff700 1 --2- 172.21.15.44:0/3850844025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c8c144340 0x7f1c8c06d480 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0cb340 tx=0x7f1c74009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ef623fee79dd05 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:19.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.207+0000 7f1c8affd700 1 -- 172.21.15.44:0/3850844025 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c74011830 con 0x7f1c8c144340 2024-09-13T18:27:19.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.207+0000 7f1c8affd700 1 -- 172.21.15.44:0/3850844025 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c74011990 con 0x7f1c8c144340 2024-09-13T18:27:19.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.207+0000 7f1c8affd700 1 -- 172.21.15.44:0/3850844025 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c74011d20 con 0x7f1c8c144340 2024-09-13T18:27:19.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.211+0000 7f1c91566700 1 -- 172.21.15.44:0/3850844025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c8c144340 msgr2=0x7f1c8c06d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.211+0000 7f1c91566700 1 --2- 172.21.15.44:0/3850844025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c8c144340 0x7f1c8c06d480 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0cb340 tx=0x7f1c74009bf0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.211+0000 7f1c91566700 1 -- 172.21.15.44:0/3850844025 shutdown_connections 2024-09-13T18:27:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.211+0000 7f1c91566700 1 --2- 172.21.15.44:0/3850844025 >> v2:172.21.15.99:3300/0 conn(0x7f1c8c0cdc90 0x7f1c8c06fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.211+0000 7f1c91566700 1 --2- 172.21.15.44:0/3850844025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c8c144340 0x7f1c8c06d480 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.211+0000 7f1c91566700 1 -- 172.21.15.44:0/3850844025 >> 172.21.15.44:0/3850844025 conn(0x7f1c8c0b0e10 msgr2=0x7f1c8c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.211+0000 7f1c91566700 1 -- 172.21.15.44:0/3850844025 shutdown_connections 2024-09-13T18:27:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.211+0000 7f1c91566700 1 -- 172.21.15.44:0/3850844025 wait complete. 2024-09-13T18:27:19.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c91566700 1 Processor -- start 2024-09-13T18:27:19.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c91566700 1 -- start start 2024-09-13T18:27:19.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c91566700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c8c06bdb0 0x7f1c8c1f4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c91566700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c8c0cdc90 0x7f1c8c1ef970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c91566700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c8c144340 0x7f1c8c0a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c91566700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c0abfd0 con 0x7f1c8c06bdb0 2024-09-13T18:27:19.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c91566700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c1f4590 con 0x7f1c8c0cdc90 2024-09-13T18:27:19.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c91566700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c13fcd0 con 0x7f1c8c144340 2024-09-13T18:27:19.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c8bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c8c06bdb0 0x7f1c8c1f4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c8bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c8c06bdb0 0x7f1c8c1f4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41824/0 (socket says 172.21.15.44:41824) 2024-09-13T18:27:19.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c8bfff700 1 -- 172.21.15.44:0/4174077570 learned_addr learned my addr 172.21.15.44:0/4174077570 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:19.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c8b7fe700 1 --2- 172.21.15.44:0/4174077570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c8c0cdc90 0x7f1c8c1ef970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c90d65700 1 --2- 172.21.15.44:0/4174077570 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c8c144340 0x7f1c8c0a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c8bfff700 1 -- 172.21.15.44:0/4174077570 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c8c144340 msgr2=0x7f1c8c0a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:19.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c8bfff700 1 --2- 172.21.15.44:0/4174077570 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c8c144340 0x7f1c8c0a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c8bfff700 1 -- 172.21.15.44:0/4174077570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c8c0cdc90 msgr2=0x7f1c8c1ef970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:19.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c8bfff700 1 --2- 172.21.15.44:0/4174077570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c8c0cdc90 0x7f1c8c1ef970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c8bfff700 1 -- 172.21.15.44:0/4174077570 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c74009570 con 0x7f1c8c06bdb0 2024-09-13T18:27:19.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c8b7fe700 1 --2- 172.21.15.44:0/4174077570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c8c0cdc90 0x7f1c8c1ef970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:19.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c8bfff700 1 --2- 172.21.15.44:0/4174077570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c8c06bdb0 0x7f1c8c1f4050 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0b3df0 tx=0x7f1c74004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:19.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c88ff9700 1 -- 172.21.15.44:0/4174077570 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c74004340 con 0x7f1c8c06bdb0 2024-09-13T18:27:19.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c88ff9700 1 -- 172.21.15.44:0/4174077570 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7401e070 con 0x7f1c8c06bdb0 2024-09-13T18:27:19.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c91566700 1 -- 172.21.15.44:0/4174077570 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8c13ffb0 con 0x7f1c8c06bdb0 2024-09-13T18:27:19.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c88ff9700 1 -- 172.21.15.44:0/4174077570 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c740036c0 con 0x7f1c8c06bdb0 2024-09-13T18:27:19.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.215+0000 7f1c91566700 1 -- 172.21.15.44:0/4174077570 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8c1efeb0 con 0x7f1c8c06bdb0 2024-09-13T18:27:19.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.219+0000 7f1c88ff9700 1 -- 172.21.15.44:0/4174077570 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c74020030 con 0x7f1c8c06bdb0 2024-09-13T18:27:19.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.219+0000 7f1c88ff9700 1 --2- 172.21.15.44:0/4174077570 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c70066730 0x7f1c70068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.219+0000 7f1c88ff9700 1 -- 172.21.15.44:0/4174077570 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c74085050 con 0x7f1c8c06bdb0 2024-09-13T18:27:19.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.219+0000 7f1c8b7fe700 1 --2- 172.21.15.44:0/4174077570 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c70066730 0x7f1c70068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c95a79740 1 Processor -- start 2024-09-13T18:27:19.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c8b7fe700 1 --2- 172.21.15.44:0/4174077570 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c70066730 0x7f1c70068bf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0ae6a0 tx=0x7f1c7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:19.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c95a79740 1 -- start start 2024-09-13T18:27:19.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c95a79740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1343230 0x1343610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c95a79740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1321e90 0x130b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c95a79740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1343b50 0x130bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c95a79740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x126ad80 con 0x1343230 2024-09-13T18:27:19.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c95a79740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x1268510 con 0x1343b50 2024-09-13T18:27:19.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c95a79740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x1263e00 con 0x1321e90 2024-09-13T18:27:19.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c8bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1343230 0x1343610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c8bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1343230 0x1343610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41840/0 (socket says 172.21.15.44:41840) 2024-09-13T18:27:19.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c8bfff700 1 -- 172.21.15.44:0/1902910083 learned_addr learned my addr 172.21.15.44:0/1902910083 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:19.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c8b7fe700 1 --2- 172.21.15.44:0/1902910083 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1321e90 0x130b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c90d65700 1 --2- 172.21.15.44:0/1902910083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1343b50 0x130bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c8bfff700 1 -- 172.21.15.44:0/1902910083 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1321e90 msgr2=0x130b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:19.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c8bfff700 1 --2- 172.21.15.44:0/1902910083 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1321e90 0x130b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c8bfff700 1 -- 172.21.15.44:0/1902910083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1343b50 msgr2=0x130bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:19.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c8bfff700 1 --2- 172.21.15.44:0/1902910083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1343b50 0x130bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c8bfff700 1 -- 172.21.15.44:0/1902910083 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10d6960 con 0x1343230 2024-09-13T18:27:19.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c8b7fe700 1 --2- 172.21.15.44:0/1902910083 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1321e90 0x130b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:19.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c8bfff700 1 --2- 172.21.15.44:0/1902910083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1343230 0x1343610 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1c740560a0 tx=0x7f1c74055d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3562dbcd07f7e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:19.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c81ffb700 1 -- 172.21.15.44:0/1902910083 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c74059f40 con 0x1343230 2024-09-13T18:27:19.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c81ffb700 1 -- 172.21.15.44:0/1902910083 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7405e500 con 0x1343230 2024-09-13T18:27:19.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c81ffb700 1 -- 172.21.15.44:0/1902910083 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7405c070 con 0x1343230 2024-09-13T18:27:19.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c95a79740 1 -- 172.21.15.44:0/1902910083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1343230 msgr2=0x1343610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:19.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c95a79740 1 --2- 172.21.15.44:0/1902910083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1343230 0x1343610 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1c740560a0 tx=0x7f1c74055d20 comp rx=0 tx=0).stop 2024-09-13T18:27:19.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c95a79740 1 -- 172.21.15.44:0/1902910083 shutdown_connections 2024-09-13T18:27:19.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c95a79740 1 --2- 172.21.15.44:0/1902910083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1343b50 0x130bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c95a79740 1 --2- 172.21.15.44:0/1902910083 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1321e90 0x130b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c95a79740 1 --2- 172.21.15.44:0/1902910083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1343230 0x1343610 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c95a79740 1 -- 172.21.15.44:0/1902910083 >> 172.21.15.44:0/1902910083 conn(0x108b4d0 msgr2=0x1324e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:19.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c95a79740 1 -- 172.21.15.44:0/1902910083 shutdown_connections 2024-09-13T18:27:19.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.223+0000 7f1c95a79740 1 -- 172.21.15.44:0/1902910083 wait complete. 2024-09-13T18:27:19.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c95a79740 1 -- start start 2024-09-13T18:27:19.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c95a79740 1 Processor -- start 2024-09-13T18:27:19.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c95a79740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1321e90 0x13242b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c95a79740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1343230 0x13215b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c95a79740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1343b50 0x12fd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c95a79740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x1221730 con 0x1343230 2024-09-13T18:27:19.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c95a79740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x12275b0 con 0x1343b50 2024-09-13T18:27:19.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c95a79740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x110faa0 con 0x1321e90 2024-09-13T18:27:19.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c95a79740 10 client.0 _ll_register_callbacks cb 0x125d610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:27:19.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c8b7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1343230 0x13215b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c8b7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1343230 0x13215b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41844/0 (socket says 172.21.15.44:41844) 2024-09-13T18:27:19.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c8bfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1321e90 0x13242b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c8b7fe700 1 -- 172.21.15.44:0/180721843 learned_addr learned my addr 172.21.15.44:0/180721843 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:19.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c90d65700 1 --2- 172.21.15.44:0/180721843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1343b50 0x12fd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c8b7fe700 1 -- 172.21.15.44:0/180721843 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1321e90 msgr2=0x13242b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:19.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c8b7fe700 1 --2- 172.21.15.44:0/180721843 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1321e90 0x13242b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c8b7fe700 1 -- 172.21.15.44:0/180721843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1343b50 msgr2=0x12fd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:19.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c8b7fe700 1 --2- 172.21.15.44:0/180721843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1343b50 0x12fd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c8b7fe700 1 -- 172.21.15.44:0/180721843 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8c1efeb0 con 0x1343230 2024-09-13T18:27:19.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c8b7fe700 1 --2- 172.21.15.44:0/180721843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1343230 0x13215b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c003e40 tx=0x7f1c7c001870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3064719f63bc7f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:19.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c7affd700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-13T18:27:19.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c7affd700 1 -- 172.21.15.44:0/180721843 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c003e70 con 0x1343230 2024-09-13T18:27:19.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c7affd700 1 -- 172.21.15.44:0/180721843 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c7c022a90 con 0x1343230 2024-09-13T18:27:19.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c95a79740 1 -- 172.21.15.44:0/180721843 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x10981e0 con 0x1343230 2024-09-13T18:27:19.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c7affd700 1 -- 172.21.15.44:0/180721843 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c7c022c50 con 0x1343230 2024-09-13T18:27:19.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c95a79740 10 client.4695 fetch_fsmap learned FSMap version 7 2024-09-13T18:27:19.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.227+0000 7f1c95a79740 1 -- 172.21.15.44:0/180721843 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x122a220 con 0x1343230 2024-09-13T18:27:19.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c7affd700 1 -- 172.21.15.44:0/180721843 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x10981e0 con 0x1343230 2024-09-13T18:27:19.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c7affd700 1 -- 172.21.15.44:0/180721843 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f1c7c013420 con 0x1343230 2024-09-13T18:27:19.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c95a79740 10 client.4695 fetch_fsmap finished waiting for FSMap version 7 2024-09-13T18:27:19.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c95a79740 10 client.4695 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:27:19.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c95a79740 20 client.4695 populate_metadata read hostname 'smithi044' 2024-09-13T18:27:19.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c95a79740 1 --2- 172.21.15.44:0/180721843 >> [v2:172.21.15.44:6834/1402693416,v1:172.21.15.44:6835/1402693416] conn(0x12fbf00 0x1356b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c95a79740 4 client.4695 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:27:19.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c95a79740 1 -- 172.21.15.44:0/180721843 --> [v2:172.21.15.44:6834/1402693416,v1:172.21.15.44:6835/1402693416] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x10e2460 con 0x12fbf00 2024-09-13T18:27:19.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c8bfff700 1 --2- 172.21.15.44:0/180721843 >> [v2:172.21.15.44:6834/1402693416,v1:172.21.15.44:6835/1402693416] conn(0x12fbf00 0x1356b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c7affd700 10 client.4695 ms_handle_connect on v2:172.21.15.44:6834/1402693416 2024-09-13T18:27:19.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c8bfff700 1 --2- 172.21.15.44:0/180721843 >> [v2:172.21.15.44:6834/1402693416,v1:172.21.15.44:6835/1402693416] conn(0x12fbf00 0x1356b90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4acddc3b77356f07 server_cookie=2660ba9a9773aad3 in_seq=0 out_seq=0 2024-09-13T18:27:19.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c7affd700 1 -- 172.21.15.44:0/180721843 <== mds.0 v2:172.21.15.44:6834/1402693416 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x10e2460 con 0x12fbf00 2024-09-13T18:27:19.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c7affd700 10 client.4695 handle_command_reply: tid=0 2024-09-13T18:27:19.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c95a79740 1 client.4695 shutdown 2024-09-13T18:27:19.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c95a79740 1 -- 172.21.15.44:0/180721843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1343230 msgr2=0x13215b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:19.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c95a79740 1 --2- 172.21.15.44:0/180721843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1343230 0x13215b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c003e40 tx=0x7f1c7c001870 comp rx=0 tx=0).stop 2024-09-13T18:27:19.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c95a79740 1 -- 172.21.15.44:0/180721843 shutdown_connections 2024-09-13T18:27:19.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c95a79740 1 --2- 172.21.15.44:0/180721843 >> [v2:172.21.15.44:6834/1402693416,v1:172.21.15.44:6835/1402693416] conn(0x12fbf00 0x1356b90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c95a79740 1 --2- 172.21.15.44:0/180721843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1343b50 0x12fd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c95a79740 1 --2- 172.21.15.44:0/180721843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1343230 0x13215b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c7affd700 0 client.4695 ms_handle_reset on v2:172.21.15.44:6834/1402693416 2024-09-13T18:27:19.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c95a79740 1 --2- 172.21.15.44:0/180721843 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1321e90 0x13242b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c95a79740 1 -- 172.21.15.44:0/180721843 >> 172.21.15.44:0/180721843 conn(0x108b4d0 msgr2=0x12f7700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:19.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c95a79740 1 -- 172.21.15.44:0/180721843 shutdown_connections 2024-09-13T18:27:19.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c95a79740 1 -- 172.21.15.44:0/180721843 wait complete. 2024-09-13T18:27:19.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.231+0000 7f1c95a79740 20 client.4695 trim_cache size 0 max 16384 2024-09-13T18:27:19.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c95a79740 1 Processor -- start 2024-09-13T18:27:19.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c95a79740 1 -- start start 2024-09-13T18:27:19.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c95a79740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1321e90 0x12fb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c95a79740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1343230 0x1341a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c95a79740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1343b50 0x1341f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c95a79740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x126ad80 con 0x1321e90 2024-09-13T18:27:19.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c95a79740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x12fe630 con 0x1343230 2024-09-13T18:27:19.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c95a79740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x1292ec0 con 0x1343b50 2024-09-13T18:27:19.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c8bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1321e90 0x12fb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c8bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1321e90 0x12fb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41850/0 (socket says 172.21.15.44:41850) 2024-09-13T18:27:19.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c8bfff700 1 -- 172.21.15.44:0/4229708060 learned_addr learned my addr 172.21.15.44:0/4229708060 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:19.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c90d65700 1 --2- 172.21.15.44:0/4229708060 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1343b50 0x1341f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c8b7fe700 1 --2- 172.21.15.44:0/4229708060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1343230 0x1341a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c8bfff700 1 -- 172.21.15.44:0/4229708060 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1343b50 msgr2=0x1341f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:19.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c8bfff700 1 --2- 172.21.15.44:0/4229708060 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1343b50 0x1341f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c8bfff700 1 -- 172.21.15.44:0/4229708060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1343230 msgr2=0x1341a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:19.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c8bfff700 1 --2- 172.21.15.44:0/4229708060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1343230 0x1341a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c8bfff700 1 -- 172.21.15.44:0/4229708060 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1210450 con 0x1321e90 2024-09-13T18:27:19.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c8bfff700 1 --2- 172.21.15.44:0/4229708060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1321e90 0x12fb170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1c74009150 tx=0x7f1c74055ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323278b9d65eca8e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:19.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c827fc700 1 -- 172.21.15.44:0/4229708060 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c74072040 con 0x1321e90 2024-09-13T18:27:19.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c827fc700 1 -- 172.21.15.44:0/4229708060 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c74059f40 con 0x1321e90 2024-09-13T18:27:19.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c827fc700 1 -- 172.21.15.44:0/4229708060 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c740544b0 con 0x1321e90 2024-09-13T18:27:19.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c95a79740 1 -- 172.21.15.44:0/4229708060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1321e90 msgr2=0x12fb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:19.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c95a79740 1 --2- 172.21.15.44:0/4229708060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1321e90 0x12fb170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1c74009150 tx=0x7f1c74055ba0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c95a79740 1 -- 172.21.15.44:0/4229708060 shutdown_connections 2024-09-13T18:27:19.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c95a79740 1 --2- 172.21.15.44:0/4229708060 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1343b50 0x1341f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c95a79740 1 --2- 172.21.15.44:0/4229708060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1343230 0x1341a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c95a79740 1 --2- 172.21.15.44:0/4229708060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1321e90 0x12fb170 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c95a79740 1 -- 172.21.15.44:0/4229708060 >> 172.21.15.44:0/4229708060 conn(0x108b4d0 msgr2=0x135b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:19.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c95a79740 1 -- 172.21.15.44:0/4229708060 shutdown_connections 2024-09-13T18:27:19.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.255+0000 7f1c95a79740 1 -- 172.21.15.44:0/4229708060 wait complete. 2024-09-13T18:27:19.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c95a79740 1 -- start start 2024-09-13T18:27:19.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c95a79740 1 Processor -- start 2024-09-13T18:27:19.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c95a79740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1321e90 0x13abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c95a79740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1343230 0x12fabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c95a79740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1343b50 0x12fb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c95a79740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x1325600 con 0x1321e90 2024-09-13T18:27:19.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c95a79740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x12289d0 con 0x1343230 2024-09-13T18:27:19.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c95a79740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x1217e10 con 0x1343b50 2024-09-13T18:27:19.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c95a79740 10 client.0 _ll_register_callbacks cb 0x1215ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:27:19.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c8bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1321e90 0x13abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c8bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1321e90 0x13abbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41854/0 (socket says 172.21.15.44:41854) 2024-09-13T18:27:19.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c8bfff700 1 -- 172.21.15.44:0/907067804 learned_addr learned my addr 172.21.15.44:0/907067804 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:19.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c90d65700 1 --2- 172.21.15.44:0/907067804 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1343b50 0x12fb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c8b7fe700 1 --2- 172.21.15.44:0/907067804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1343230 0x12fabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c8bfff700 1 -- 172.21.15.44:0/907067804 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1343b50 msgr2=0x12fb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:19.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c8bfff700 1 --2- 172.21.15.44:0/907067804 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1343b50 0x12fb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c8bfff700 1 -- 172.21.15.44:0/907067804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1343230 msgr2=0x12fabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:19.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c8bfff700 1 --2- 172.21.15.44:0/907067804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1343230 0x12fabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c8bfff700 1 -- 172.21.15.44:0/907067804 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x10d6960 con 0x1321e90 2024-09-13T18:27:19.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c90d65700 1 --2- 172.21.15.44:0/907067804 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1343b50 0x12fb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:19.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c8b7fe700 1 --2- 172.21.15.44:0/907067804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1343230 0x12fabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:19.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c8bfff700 1 --2- 172.21.15.44:0/907067804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1321e90 0x13abbf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1c74009150 tx=0x7f1c7400b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ad17dccb400b5b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:19.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c7affd700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-13T18:27:19.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c7affd700 1 -- 172.21.15.44:0/907067804 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c74072040 con 0x1321e90 2024-09-13T18:27:19.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c7affd700 1 -- 172.21.15.44:0/907067804 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c740544b0 con 0x1321e90 2024-09-13T18:27:19.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c95a79740 1 -- 172.21.15.44:0/907067804 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1c7405e500 con 0x1321e90 2024-09-13T18:27:19.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c7affd700 1 -- 172.21.15.44:0/907067804 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c7405c070 con 0x1321e90 2024-09-13T18:27:19.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c95a79740 10 client.4701 fetch_fsmap learned FSMap version 7 2024-09-13T18:27:19.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c95a79740 1 -- 172.21.15.44:0/907067804 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x1204720 con 0x1321e90 2024-09-13T18:27:19.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c7affd700 1 -- 172.21.15.44:0/907067804 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7405e500 con 0x1321e90 2024-09-13T18:27:19.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c7affd700 1 -- 172.21.15.44:0/907067804 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f1c7402a060 con 0x1321e90 2024-09-13T18:27:19.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c95a79740 10 client.4701 fetch_fsmap finished waiting for FSMap version 7 2024-09-13T18:27:19.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c95a79740 10 client.4701 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:27:19.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c95a79740 20 client.4701 populate_metadata read hostname 'smithi044' 2024-09-13T18:27:19.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c95a79740 1 --2- 172.21.15.44:0/907067804 >> [v2:172.21.15.44:6834/1402693416,v1:172.21.15.44:6835/1402693416] conn(0x1346f90 0x1347370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c95a79740 4 client.4701 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:27:19.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c95a79740 1 -- 172.21.15.44:0/907067804 --> [v2:172.21.15.44:6834/1402693416,v1:172.21.15.44:6835/1402693416] -- command(tid 0: {"prefix": "status"}) v1 -- 0x11071e0 con 0x1346f90 2024-09-13T18:27:19.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c8b7fe700 1 --2- 172.21.15.44:0/907067804 >> [v2:172.21.15.44:6834/1402693416,v1:172.21.15.44:6835/1402693416] conn(0x1346f90 0x1347370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c8b7fe700 1 --2- 172.21.15.44:0/907067804 >> [v2:172.21.15.44:6834/1402693416,v1:172.21.15.44:6835/1402693416] conn(0x1346f90 0x1347370 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59fb0527f6345875 server_cookie=1786c5e14437f178 in_seq=0 out_seq=0 2024-09-13T18:27:19.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.259+0000 7f1c7affd700 10 client.4701 ms_handle_connect on v2:172.21.15.44:6834/1402693416 2024-09-13T18:27:19.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c7affd700 1 -- 172.21.15.44:0/907067804 <== mds.0 v2:172.21.15.44:6834/1402693416 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x11071e0 con 0x1346f90 2024-09-13T18:27:19.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c7affd700 10 client.4701 handle_command_reply: tid=0 2024-09-13T18:27:19.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c95a79740 1 client.4701 shutdown 2024-09-13T18:27:19.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c95a79740 1 -- 172.21.15.44:0/907067804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1321e90 msgr2=0x13abbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:19.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c95a79740 1 --2- 172.21.15.44:0/907067804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1321e90 0x13abbf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1c74009150 tx=0x7f1c7400b050 comp rx=0 tx=0).stop 2024-09-13T18:27:19.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c95a79740 1 -- 172.21.15.44:0/907067804 shutdown_connections 2024-09-13T18:27:19.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c95a79740 1 --2- 172.21.15.44:0/907067804 >> [v2:172.21.15.44:6834/1402693416,v1:172.21.15.44:6835/1402693416] conn(0x1346f90 0x1347370 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c7affd700 0 client.4701 ms_handle_reset on v2:172.21.15.44:6834/1402693416 2024-09-13T18:27:19.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c95a79740 1 --2- 172.21.15.44:0/907067804 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1343b50 0x12fb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c95a79740 1 --2- 172.21.15.44:0/907067804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1343230 0x12fabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c95a79740 1 --2- 172.21.15.44:0/907067804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1321e90 0x13abbf0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c95a79740 1 -- 172.21.15.44:0/907067804 >> 172.21.15.44:0/907067804 conn(0x108b4d0 msgr2=0x12fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:19.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c95a79740 1 -- 172.21.15.44:0/907067804 shutdown_connections 2024-09-13T18:27:19.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c95a79740 1 -- 172.21.15.44:0/907067804 wait complete. 2024-09-13T18:27:19.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c95a79740 20 client.4701 trim_cache size 0 max 16384 2024-09-13T18:27:19.273 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:27:19.273 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "c8e1d12d-7fb9-4a33-982e-b895bb77262c", 2024-09-13T18:27:19.274 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-13T18:27:19.274 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4278, 2024-09-13T18:27:19.274 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-13T18:27:19.274 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-13T18:27:19.274 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-13T18:27:19.274 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 17.984391218999999, 2024-09-13T18:27:19.274 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 7, 2024-09-13T18:27:19.274 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 21, 2024-09-13T18:27:19.274 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 21, 2024-09-13T18:27:19.274 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 24.406146467999999 2024-09-13T18:27:19.274 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:27:19.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c91566700 1 -- 172.21.15.44:0/4174077570 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c70066730 msgr2=0x7f1c70068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:19.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c91566700 1 --2- 172.21.15.44:0/4174077570 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c70066730 0x7f1c70068bf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0ae6a0 tx=0x7f1c7c009040 comp rx=0 tx=0).stop 2024-09-13T18:27:19.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c91566700 1 -- 172.21.15.44:0/4174077570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c8c06bdb0 msgr2=0x7f1c8c1f4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:19.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c91566700 1 --2- 172.21.15.44:0/4174077570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c8c06bdb0 0x7f1c8c1f4050 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0b3df0 tx=0x7f1c74004770 comp rx=0 tx=0).stop 2024-09-13T18:27:19.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c91566700 1 -- 172.21.15.44:0/4174077570 shutdown_connections 2024-09-13T18:27:19.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c91566700 1 --2- 172.21.15.44:0/4174077570 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c70066730 0x7f1c70068bf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c91566700 1 --2- 172.21.15.44:0/4174077570 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c8c144340 0x7f1c8c0a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c91566700 1 --2- 172.21.15.44:0/4174077570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c8c0cdc90 0x7f1c8c1ef970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c91566700 1 --2- 172.21.15.44:0/4174077570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c8c06bdb0 0x7f1c8c1f4050 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c91566700 1 -- 172.21.15.44:0/4174077570 >> 172.21.15.44:0/4174077570 conn(0x7f1c8c0b0e10 msgr2=0x7f1c8c0afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:19.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c91566700 1 -- 172.21.15.44:0/4174077570 shutdown_connections 2024-09-13T18:27:19.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.263+0000 7f1c91566700 1 -- 172.21.15.44:0/4174077570 wait complete. 2024-09-13T18:27:19.282 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T18:27:19.294 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T18:27:19.294 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T18:27:19.294 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T18:27:19.294 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-13T18:27:19.361 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-13T18:27:19.361 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-13T18:27:19.361 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-13T18:27:19.361 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:27:19.361 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:27:19.361 INFO:tasks.ceph_fuse:client.2 config is {} 2024-09-13T18:27:19.361 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:27:19.361 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T18:27:19.362 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-13T18:27:19.362 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:27:19.362 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:27:19.362 INFO:tasks.ceph_fuse:client.3 config is {} 2024-09-13T18:27:19.362 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:27:19.362 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T18:27:19.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:19.362 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-13T18:27:19.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:19.370 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link delete ceph-brx 2024-09-13T18:27:19.434 INFO:teuthology.orchestra.run.smithi044.stderr:Cannot find device "ceph-brx" 2024-09-13T18:27:19.435 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:27:19.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:19.435 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-13T18:27:19.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:19.442 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2024-09-13T18:27:19.460 INFO:teuthology.orchestra.run.smithi099.stderr:Cannot find device "ceph-brx" 2024-09-13T18:27:19.461 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:27:19.461 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-13T18:27:19.462 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T18:27:19.462 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:27:19.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6ee0c700 1 Processor -- start 2024-09-13T18:27:19.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6ee0c700 1 -- start start 2024-09-13T18:27:19.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6ee0c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c6806bbf0 0x7f5c680b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6ee0c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5c680b3910 0x7f5c6806a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6ee0c700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c6813dcb0 con 0x7f5c6806aaf0 2024-09-13T18:27:19.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6ee0c700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c6815be60 con 0x7f5c680b3910 2024-09-13T18:27:19.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6ee0c700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6813ffd0 con 0x7f5c6806bbf0 2024-09-13T18:27:19.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6d609700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5c680b3910 0x7f5c6806a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6d609700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5c680b3910 0x7f5c6806a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41870/0 (socket says 172.21.15.44:41870) 2024-09-13T18:27:19.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6d609700 1 -- 172.21.15.44:0/3417666894 learned_addr learned my addr 172.21.15.44:0/3417666894 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:19.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6de0a700 1 --2- 172.21.15.44:0/3417666894 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c6806bbf0 0x7f5c680b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6d609700 1 -- 172.21.15.44:0/3417666894 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c6806bbf0 msgr2=0x7f5c680b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:19.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6d609700 1 --2- 172.21.15.44:0/3417666894 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c6806bbf0 0x7f5c680b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6d609700 1 -- 172.21.15.44:0/3417666894 >> v1:172.21.15.44:6789/0 conn(0x7f5c6806aaf0 legacy=0x7f5c680cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:19.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6d609700 1 -- 172.21.15.44:0/3417666894 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c680b3d70 con 0x7f5c680b3910 2024-09-13T18:27:19.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6d609700 1 --2- 172.21.15.44:0/3417666894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c680b3910 0x7f5c6806a5b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5c58009910 tx=0x7f5c58009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c201596ec7989b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:19.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6ce08700 1 -- 172.21.15.44:0/3417666894 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5800ba60 con 0x7f5c680b3910 2024-09-13T18:27:19.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6ce08700 1 -- 172.21.15.44:0/3417666894 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5800bbc0 con 0x7f5c680b3910 2024-09-13T18:27:19.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6ce08700 1 -- 172.21.15.44:0/3417666894 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c58009e60 con 0x7f5c680b3910 2024-09-13T18:27:19.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6ee0c700 1 -- 172.21.15.44:0/3417666894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c680b3910 msgr2=0x7f5c6806a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:19.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6ee0c700 1 --2- 172.21.15.44:0/3417666894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c680b3910 0x7f5c6806a5b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5c58009910 tx=0x7f5c58009c20 comp rx=0 tx=0).stop 2024-09-13T18:27:19.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6ee0c700 1 -- 172.21.15.44:0/3417666894 shutdown_connections 2024-09-13T18:27:19.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6ee0c700 1 --2- 172.21.15.44:0/3417666894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c680b3910 0x7f5c6806a5b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6ee0c700 1 --2- 172.21.15.44:0/3417666894 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c6806bbf0 0x7f5c680b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6ee0c700 1 -- 172.21.15.44:0/3417666894 >> 172.21.15.44:0/3417666894 conn(0x7f5c680b0f00 msgr2=0x7f5c680b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:19.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6ee0c700 1 -- 172.21.15.44:0/3417666894 shutdown_connections 2024-09-13T18:27:19.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.579+0000 7f5c6ee0c700 1 -- 172.21.15.44:0/3417666894 wait complete. 2024-09-13T18:27:19.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.583+0000 7f5c6ee0c700 1 Processor -- start 2024-09-13T18:27:19.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.583+0000 7f5c6ee0c700 1 -- start start 2024-09-13T18:27:19.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.583+0000 7f5c6ee0c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c6806aaf0 0x7f5c68137500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.583+0000 7f5c6ee0c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c6806bbf0 0x7f5c6813ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.583+0000 7f5c6ee0c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c680b3910 0x7f5c681518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.583+0000 7f5c6ee0c700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c68139670 con 0x7f5c680b3910 2024-09-13T18:27:19.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.583+0000 7f5c6ee0c700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c68139880 con 0x7f5c6806bbf0 2024-09-13T18:27:19.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.583+0000 7f5c6ee0c700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c68139b60 con 0x7f5c6806aaf0 2024-09-13T18:27:19.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.583+0000 7f5c6de0a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c6806aaf0 0x7f5c68137500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.583+0000 7f5c6de0a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c6806aaf0 0x7f5c68137500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:58154/0 (socket says 172.21.15.44:58154) 2024-09-13T18:27:19.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.583+0000 7f5c6de0a700 1 -- 172.21.15.44:0/610980424 learned_addr learned my addr 172.21.15.44:0/610980424 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:19.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.583+0000 7f5c6d609700 1 --2- 172.21.15.44:0/610980424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c6806bbf0 0x7f5c6813ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.583+0000 7f5c6e60b700 1 --2- 172.21.15.44:0/610980424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c680b3910 0x7f5c681518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.583+0000 7f5c6de0a700 1 -- 172.21.15.44:0/610980424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c6806bbf0 msgr2=0x7f5c6813ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:19.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.583+0000 7f5c6de0a700 1 --2- 172.21.15.44:0/610980424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c6806bbf0 0x7f5c6813ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.583+0000 7f5c6de0a700 1 -- 172.21.15.44:0/610980424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c680b3910 msgr2=0x7f5c681518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:19.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.583+0000 7f5c6de0a700 1 --2- 172.21.15.44:0/610980424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c680b3910 0x7f5c681518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.583+0000 7f5c6de0a700 1 -- 172.21.15.44:0/610980424 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c58009570 con 0x7f5c6806aaf0 2024-09-13T18:27:19.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.583+0000 7f5c6e60b700 1 --2- 172.21.15.44:0/610980424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c680b3910 0x7f5c681518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:19.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.583+0000 7f5c6de0a700 1 --2- 172.21.15.44:0/610980424 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c6806aaf0 0x7f5c68137500 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400e760 tx=0x7f5c6400ea70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:19.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.587+0000 7f5c5e7fc700 1 -- 172.21.15.44:0/610980424 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6400c070 con 0x7f5c6806aaf0 2024-09-13T18:27:19.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.587+0000 7f5c5e7fc700 1 -- 172.21.15.44:0/610980424 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c64013610 con 0x7f5c6806aaf0 2024-09-13T18:27:19.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.587+0000 7f5c5e7fc700 1 -- 172.21.15.44:0/610980424 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c64013980 con 0x7f5c6806aaf0 2024-09-13T18:27:19.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.587+0000 7f5c6ee0c700 1 -- 172.21.15.44:0/610980424 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c68139e40 con 0x7f5c6806aaf0 2024-09-13T18:27:19.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.587+0000 7f5c6ee0c700 1 -- 172.21.15.44:0/610980424 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c6813ee90 con 0x7f5c6806aaf0 2024-09-13T18:27:19.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.587+0000 7f5c6ee0c700 1 -- 172.21.15.44:0/610980424 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c6806bfd0 con 0x7f5c6806aaf0 2024-09-13T18:27:19.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.587+0000 7f5c5e7fc700 1 -- 172.21.15.44:0/610980424 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5c64013ae0 con 0x7f5c6806aaf0 2024-09-13T18:27:19.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.591+0000 7f5c5e7fc700 1 --2- 172.21.15.44:0/610980424 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5c4c066760 0x7f5c4c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:19.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.591+0000 7f5c5e7fc700 1 -- 172.21.15.44:0/610980424 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c64084290 con 0x7f5c6806aaf0 2024-09-13T18:27:19.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.591+0000 7f5c6d609700 1 --2- 172.21.15.44:0/610980424 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5c4c066760 0x7f5c4c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:19.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.591+0000 7f5c6d609700 1 --2- 172.21.15.44:0/610980424 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5c4c066760 0x7f5c4c068c20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5c58009910 tx=0x7f5c58008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:19.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.599+0000 7f5c5e7fc700 1 -- 172.21.15.44:0/610980424 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5c640516e0 con 0x7f5c6806aaf0 2024-09-13T18:27:19.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.807+0000 7f5c6ee0c700 1 -- 172.21.15.44:0/610980424 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5c68139ca0 con 0x7f5c6806aaf0 2024-09-13T18:27:19.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.811+0000 7f5c5e7fc700 1 -- 172.21.15.44:0/610980424 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5c68139ca0 con 0x7f5c6806aaf0 2024-09-13T18:27:19.814 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:27:19.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.811+0000 7f5c6ee0c700 1 -- 172.21.15.44:0/610980424 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5c4c066760 msgr2=0x7f5c4c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:19.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.811+0000 7f5c6ee0c700 1 --2- 172.21.15.44:0/610980424 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5c4c066760 0x7f5c4c068c20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5c58009910 tx=0x7f5c58008030 comp rx=0 tx=0).stop 2024-09-13T18:27:19.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.811+0000 7f5c6ee0c700 1 -- 172.21.15.44:0/610980424 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c6806aaf0 msgr2=0x7f5c68137500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:19.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.811+0000 7f5c6ee0c700 1 --2- 172.21.15.44:0/610980424 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c6806aaf0 0x7f5c68137500 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400e760 tx=0x7f5c6400ea70 comp rx=0 tx=0).stop 2024-09-13T18:27:19.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.811+0000 7f5c6ee0c700 1 -- 172.21.15.44:0/610980424 shutdown_connections 2024-09-13T18:27:19.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.811+0000 7f5c6ee0c700 1 --2- 172.21.15.44:0/610980424 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5c4c066760 0x7f5c4c068c20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.811+0000 7f5c6ee0c700 1 --2- 172.21.15.44:0/610980424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c680b3910 0x7f5c681518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.811+0000 7f5c6ee0c700 1 --2- 172.21.15.44:0/610980424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c6806bbf0 0x7f5c6813ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.811+0000 7f5c6ee0c700 1 --2- 172.21.15.44:0/610980424 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c6806aaf0 0x7f5c68137500 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.811+0000 7f5c6ee0c700 1 -- 172.21.15.44:0/610980424 >> 172.21.15.44:0/610980424 conn(0x7f5c680b0f00 msgr2=0x7f5c6815a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:19.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.811+0000 7f5c6ee0c700 1 -- 172.21.15.44:0/610980424 shutdown_connections 2024-09-13T18:27:19.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:19.811+0000 7f5c6ee0c700 1 -- 172.21.15.44:0/610980424 wait complete. 2024-09-13T18:27:19.829 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:27:19.829 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:27:19.829 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-13T18:27:19.829 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:27:19.829 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:27:19.829 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:27:19.829 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:27:19.829 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:27:19.830 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:27:19.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:19.830 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-13T18:27:19.838 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:27:19.838 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:27:19.838 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:27:19.838 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:19.838 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-13T18:27:19.838 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:19.839 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:27:19.839 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-13T18:27:19.839 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:27:19.839 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:27:19.839 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:27:19.839 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:27:19.840 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:27:19.840 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42584sec preferred_lft 42584sec 2024-09-13T18:27:19.840 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-13T18:27:19.840 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:19.840 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:27:19.841 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:27:19.841 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:27:19.841 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:80:b2:e4:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:27:19.841 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:27:19.841 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:19.842 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:27:19.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:19.842 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2024-09-13T18:27:19.842 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-13T18:27:19.843 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:27:19.843 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr flush dev ceph-brx 2024-09-13T18:27:19.843 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set ceph-brx up 2024-09-13T18:27:19.843 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:27:19.843 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-13T18:27:19.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:19.923 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:27:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-13T18:27:19.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:19.936 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-13T18:27:19.967 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-13T18:27:19.967 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:27:19.967 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:27:19.967 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:27:19.967 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:27:19.968 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:27:19.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:19.968 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2024-09-13T18:27:19.968 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-13T18:27:19.969 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:27:19.969 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:27:19.969 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:27:19.969 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-13T18:27:20.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:20.014 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-13T18:27:20.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:20.021 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list-id 2024-09-13T18:27:20.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:20.069 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2024-09-13T18:27:20.069 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-13T18:27:20.069 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:27:20.069 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T18:27:20.069 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-13T18:27:20.100 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T18:27:20.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:20.100 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2024-09-13T18:27:20.100 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-13T18:27:20.100 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T18:27:20.100 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:27:20.101 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T18:27:20.101 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T18:27:20.101 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T18:27:20.101 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-13T18:27:20.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:20.175 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2024-09-13T18:27:20.175 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-13T18:27:20.175 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-13T18:27:20.175 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:27:20.175 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-13T18:27:20.201 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:27:20.201 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:27:20.201 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:27:20.208 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:27:20.208 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:27:20.208 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:27:20.214 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:27:20.230 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:27:20.230 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:27:20.244 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:27:20.245 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:27:20.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:20.246 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:27:20.296 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:27:20.296 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:27:20.298 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:27:20.314 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:27:20.314 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:27:20.325 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:27:20.325 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:27:20.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:20.326 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:27:20.392 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2024-09-13T18:27:20.387+0000 7f3d051e8640 -1 init, newargv = 0x564466d824f0 newargc=15 2024-09-13T18:27:20.392 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[34350]: starting ceph client 2024-09-13T18:27:20.401 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[34350]: starting fuse 2024-09-13T18:27:21.478 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:27:21.497 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:27:21.497 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:27:21.507 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:27:21.507 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:27:21.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:21.508 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:27:21.556 INFO:teuthology.orchestra.run.smithi044.stdout:52 2024-09-13T18:27:21.556 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T18:27:21.556 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:27:21.557 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2024-09-13T18:27:21.557 DEBUG:teuthology.orchestra.run.smithi044:> import re 2024-09-13T18:27:21.557 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:27:21.557 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2024-09-13T18:27:21.557 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:27:21.557 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2024-09-13T18:27:21.557 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:27:21.557 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2024-09-13T18:27:21.557 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:27:21.557 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:27:21.557 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2024-09-13T18:27:21.557 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2024-09-13T18:27:21.557 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2024-09-13T18:27:21.557 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2024-09-13T18:27:21.557 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:27:21.558 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2024-09-13T18:27:21.558 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:27:21.558 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:27:21.558 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:27:21.558 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2024-09-13T18:27:21.558 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2024-09-13T18:27:21.558 DEBUG:teuthology.orchestra.run.smithi044:> return f 2024-09-13T18:27:21.558 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:27:21.558 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:27:21.558 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.0")) 2024-09-13T18:27:21.558 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:27:21.641 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.0.34350.asok 2024-09-13T18:27:21.827 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34350.asok 2024-09-13T18:27:21.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:21.828 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34350.asok status 2024-09-13T18:27:21.930 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:27:21.930 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2024-09-13T18:27:21.930 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:27:21.930 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:27:21.931 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "0", 2024-09-13T18:27:21.931 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2024-09-13T18:27:21.931 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:27:21.931 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "34350", 2024-09-13T18:27:21.931 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2024-09-13T18:27:21.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:21.931 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2024-09-13T18:27:21.931 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2024-09-13T18:27:21.931 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4719, 2024-09-13T18:27:21.931 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2024-09-13T18:27:21.931 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2024-09-13T18:27:21.931 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2024-09-13T18:27:21.931 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 4719 2024-09-13T18:27:21.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:21.932 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:27:21.932 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-13T18:27:21.932 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:27:21.932 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2991400880 2024-09-13T18:27:21.932 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:21.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:21.932 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:27:21.932 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-13T18:27:21.932 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:27:21.932 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2991400880 2024-09-13T18:27:21.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:21.932 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.4719 192.168.0.1:0/2991400880", 2024-09-13T18:27:21.932 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/2991400880", 2024-09-13T18:27:21.933 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2024-09-13T18:27:21.933 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 7, 2024-09-13T18:27:21.933 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 21, 2024-09-13T18:27:21.933 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:27:21.933 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2024-09-13T18:27:21.933 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2024-09-13T18:27:21.933 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:27:21.940 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T18:27:21.940 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:27:22.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.047+0000 7fd9b499f700 1 Processor -- start 2024-09-13T18:27:22.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.047+0000 7fd9b499f700 1 -- start start 2024-09-13T18:27:22.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9b499f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd9b00b5f40 0x7fd9b00b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:22.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9b499f700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b00b3bf0 con 0x7fd9b0145a30 2024-09-13T18:27:22.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9b499f700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b0145e10 con 0x7fd9b00cf690 2024-09-13T18:27:22.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9b499f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b00b47e0 con 0x7fd9b00b5f40 2024-09-13T18:27:22.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9aed9d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd9b0145a30 0x7fd9b00cfdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:35754/0 (socket says 172.21.15.44:35754) 2024-09-13T18:27:22.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9aed9d700 1 -- 172.21.15.44:0/384840041 learned_addr learned my addr 172.21.15.44:0/384840041 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:22.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9af59e700 1 --2- 172.21.15.44:0/384840041 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd9b00b5f40 0x7fd9b00b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:22.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9add9b700 1 -- 172.21.15.44:0/384840041 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2448142814 0 0) 0x7fd9b00b3bf0 con 0x7fd9b0145a30 2024-09-13T18:27:22.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9add9b700 1 -- 172.21.15.44:0/384840041 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9980035d0 con 0x7fd9b0145a30 2024-09-13T18:27:22.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9add9b700 1 -- 172.21.15.44:0/384840041 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036102741 0 0) 0x7fd9b0145e10 con 0x7fd9b00cf690 2024-09-13T18:27:22.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9add9b700 1 -- 172.21.15.44:0/384840041 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9b00b3bf0 con 0x7fd9b00cf690 2024-09-13T18:27:22.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9af59e700 1 -- 172.21.15.44:0/384840041 >> v1:172.21.15.99:6789/0 conn(0x7fd9b00cf690 legacy=0x7fd9b00b5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:22.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9af59e700 1 -- 172.21.15.44:0/384840041 >> v1:172.21.15.44:6789/0 conn(0x7fd9b0145a30 legacy=0x7fd9b00cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:22.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9add9b700 1 -- 172.21.15.44:0/384840041 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1137087222 0 0) 0x7fd9980035d0 con 0x7fd9b0145a30 2024-09-13T18:27:22.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9af59e700 1 -- 172.21.15.44:0/384840041 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b00b3e40 con 0x7fd9b00b5f40 2024-09-13T18:27:22.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9af59e700 1 --2- 172.21.15.44:0/384840041 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd9b00b5f40 0x7fd9b00b4c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8009dc0 tx=0x7fd9a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=964bc34eb6da478c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:22.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9add9b700 1 -- 172.21.15.44:0/384840041 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a800e070 con 0x7fd9b00b5f40 2024-09-13T18:27:22.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9add9b700 1 -- 172.21.15.44:0/384840041 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a8003a40 con 0x7fd9b00b5f40 2024-09-13T18:27:22.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9add9b700 1 -- 172.21.15.44:0/384840041 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0001670 con 0x7fd9b00b5f40 2024-09-13T18:27:22.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9b499f700 1 -- 172.21.15.44:0/384840041 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd9b00b5f40 msgr2=0x7fd9b00b4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:22.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9b499f700 1 --2- 172.21.15.44:0/384840041 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd9b00b5f40 0x7fd9b00b4c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8009dc0 tx=0x7fd9a800b330 comp rx=0 tx=0).stop 2024-09-13T18:27:22.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9b499f700 1 -- 172.21.15.44:0/384840041 shutdown_connections 2024-09-13T18:27:22.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9b499f700 1 --2- 172.21.15.44:0/384840041 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd9b00b5f40 0x7fd9b00b4c00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:22.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9b499f700 1 -- 172.21.15.44:0/384840041 >> 172.21.15.44:0/384840041 conn(0x7fd9b0071d00 msgr2=0x7fd9b00720e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:22.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9b499f700 1 -- 172.21.15.44:0/384840041 shutdown_connections 2024-09-13T18:27:22.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.051+0000 7fd9b499f700 1 -- 172.21.15.44:0/384840041 wait complete. 2024-09-13T18:27:22.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.055+0000 7fd9b499f700 1 Processor -- start 2024-09-13T18:27:22.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.055+0000 7fd9b499f700 1 -- start start 2024-09-13T18:27:22.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.055+0000 7fd9b499f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9b00b5f40 0x7fd9b015c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:22.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.055+0000 7fd9b499f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd9b00cf690 0x7fd9b013cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:22.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.055+0000 7fd9b499f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9b0145a30 0x7fd9b013d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:22.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.055+0000 7fd9b499f700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b015cd20 con 0x7fd9b0145a30 2024-09-13T18:27:22.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.055+0000 7fd9b499f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b013f090 con 0x7fd9b00b5f40 2024-09-13T18:27:22.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.055+0000 7fd9b499f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b00cba90 con 0x7fd9b00cf690 2024-09-13T18:27:22.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.055+0000 7fd9af59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9b0145a30 0x7fd9b013d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:22.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.055+0000 7fd9af59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9b0145a30 0x7fd9b013d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57808/0 (socket says 172.21.15.44:57808) 2024-09-13T18:27:22.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.055+0000 7fd9af59e700 1 -- 172.21.15.44:0/752662119 learned_addr learned my addr 172.21.15.44:0/752662119 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:22.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.055+0000 7fd9ae59c700 1 --2- 172.21.15.44:0/752662119 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd9b00cf690 0x7fd9b013cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:22.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.055+0000 7fd9aed9d700 1 --2- 172.21.15.44:0/752662119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9b00b5f40 0x7fd9b015c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:22.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.059+0000 7fd9af59e700 1 -- 172.21.15.44:0/752662119 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd9b00cf690 msgr2=0x7fd9b013cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:22.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.059+0000 7fd9af59e700 1 --2- 172.21.15.44:0/752662119 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd9b00cf690 0x7fd9b013cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:22.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.059+0000 7fd9af59e700 1 -- 172.21.15.44:0/752662119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9b00b5f40 msgr2=0x7fd9b015c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:22.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.059+0000 7fd9af59e700 1 --2- 172.21.15.44:0/752662119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9b00b5f40 0x7fd9b015c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:22.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.059+0000 7fd9af59e700 1 -- 172.21.15.44:0/752662119 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a8009a70 con 0x7fd9b0145a30 2024-09-13T18:27:22.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.059+0000 7fd9af59e700 1 --2- 172.21.15.44:0/752662119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9b0145a30 0x7fd9b013d430 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd9a800b370 tx=0x7fd9a8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:22.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.059+0000 7fd9977fe700 1 -- 172.21.15.44:0/752662119 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a80044c0 con 0x7fd9b0145a30 2024-09-13T18:27:22.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.059+0000 7fd9977fe700 1 -- 172.21.15.44:0/752662119 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a8004620 con 0x7fd9b0145a30 2024-09-13T18:27:22.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.059+0000 7fd9b499f700 1 -- 172.21.15.44:0/752662119 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b00cbd70 con 0x7fd9b0145a30 2024-09-13T18:27:22.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.059+0000 7fd9977fe700 1 -- 172.21.15.44:0/752662119 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8004990 con 0x7fd9b0145a30 2024-09-13T18:27:22.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.059+0000 7fd9b499f700 1 -- 172.21.15.44:0/752662119 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b00cc330 con 0x7fd9b0145a30 2024-09-13T18:27:22.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.059+0000 7fd9b499f700 1 -- 172.21.15.44:0/752662119 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b0145e10 con 0x7fd9b0145a30 2024-09-13T18:27:22.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.059+0000 7fd9977fe700 1 -- 172.21.15.44:0/752662119 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd9a801d470 con 0x7fd9b0145a30 2024-09-13T18:27:22.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.063+0000 7fd9977fe700 1 --2- 172.21.15.44:0/752662119 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd99c066730 0x7fd99c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:22.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.063+0000 7fd9977fe700 1 -- 172.21.15.44:0/752662119 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9a8085a50 con 0x7fd9b0145a30 2024-09-13T18:27:22.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.063+0000 7fd9aed9d700 1 --2- 172.21.15.44:0/752662119 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd99c066730 0x7fd99c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:22.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.063+0000 7fd9aed9d700 1 --2- 172.21.15.44:0/752662119 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd99c066730 0x7fd99c068bf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0000f60 tx=0x7fd9a0001670 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:22.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.071+0000 7fd9977fe700 1 -- 172.21.15.44:0/752662119 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd9a8056860 con 0x7fd9b0145a30 2024-09-13T18:27:22.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.279+0000 7fd9b499f700 1 -- 172.21.15.44:0/752662119 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd9b013f200 con 0x7fd9b0145a30 2024-09-13T18:27:22.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.279+0000 7fd9977fe700 1 -- 172.21.15.44:0/752662119 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd9a80563f0 con 0x7fd9b0145a30 2024-09-13T18:27:22.284 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:27:22.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.279+0000 7fd9b499f700 1 -- 172.21.15.44:0/752662119 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd99c066730 msgr2=0x7fd99c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:22.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.279+0000 7fd9b499f700 1 --2- 172.21.15.44:0/752662119 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd99c066730 0x7fd99c068bf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0000f60 tx=0x7fd9a0001670 comp rx=0 tx=0).stop 2024-09-13T18:27:22.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.283+0000 7fd9b499f700 1 -- 172.21.15.44:0/752662119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9b0145a30 msgr2=0x7fd9b013d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:22.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.283+0000 7fd9b499f700 1 --2- 172.21.15.44:0/752662119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9b0145a30 0x7fd9b013d430 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd9a800b370 tx=0x7fd9a8004af0 comp rx=0 tx=0).stop 2024-09-13T18:27:22.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.283+0000 7fd9b499f700 1 -- 172.21.15.44:0/752662119 shutdown_connections 2024-09-13T18:27:22.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.283+0000 7fd9b499f700 1 --2- 172.21.15.44:0/752662119 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd99c066730 0x7fd99c068bf0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:22.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.283+0000 7fd9b499f700 1 --2- 172.21.15.44:0/752662119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9b0145a30 0x7fd9b013d430 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:22.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.283+0000 7fd9b499f700 1 --2- 172.21.15.44:0/752662119 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd9b00cf690 0x7fd9b013cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:22.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.283+0000 7fd9b499f700 1 --2- 172.21.15.44:0/752662119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9b00b5f40 0x7fd9b015c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:22.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.283+0000 7fd9b499f700 1 -- 172.21.15.44:0/752662119 >> 172.21.15.44:0/752662119 conn(0x7fd9b0071d00 msgr2=0x7fd9b00cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:22.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.283+0000 7fd9b499f700 1 -- 172.21.15.44:0/752662119 shutdown_connections 2024-09-13T18:27:22.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:22.283+0000 7fd9b499f700 1 -- 172.21.15.44:0/752662119 wait complete. 2024-09-13T18:27:22.298 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:27:22.298 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:27:22.298 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-13T18:27:22.298 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-13T18:27:22.298 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T18:27:22.298 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:27:22.299 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:27:22.299 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:27:22.299 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-13T18:27:22.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:22.299 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-13T18:27:22.307 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:27:22.307 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:27:22.307 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:27:22.307 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:22.307 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-13T18:27:22.307 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:22.307 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:27:22.307 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-13T18:27:22.307 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:27:22.307 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:27:22.308 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:27:22.308 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:27:22.308 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:27:22.308 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42582sec preferred_lft 42582sec 2024-09-13T18:27:22.308 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-13T18:27:22.308 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:22.308 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:27:22.308 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:27:22.308 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:27:22.308 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:80:b2:e4:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:27:22.308 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:27:22.308 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:22.309 INFO:teuthology.orchestra.run.smithi044.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:27:22.309 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 2e:69:eb:1c:57:57 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:27:22.309 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:27:22.309 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:22.309 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::8842:91ff:feed:2c53/64 scope link 2024-09-13T18:27:22.309 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:22.309 INFO:teuthology.orchestra.run.smithi044.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:27:22.309 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 2e:69:eb:1c:57:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:27:22.309 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::2c69:ebff:fe1c:5757/64 scope link 2024-09-13T18:27:22.309 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:22.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:22.309 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:27:22.323 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-13T18:27:22.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:22.325 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-13T18:27:22.333 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-13T18:27:22.333 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:27:22.333 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:27:22.333 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:27:22.333 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:27:22.333 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:27:22.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:22.334 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2024-09-13T18:27:22.334 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-13T18:27:22.334 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:27:22.334 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:27:22.334 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:27:22.334 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-13T18:27:22.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:22.410 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-13T18:27:22.416 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:27:22.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:22.416 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list-id 2024-09-13T18:27:22.423 INFO:teuthology.orchestra.run.smithi044.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-13T18:27:22.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:22.424 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2024-09-13T18:27:22.424 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-13T18:27:22.424 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:27:22.424 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-13T18:27:22.424 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-13T18:27:22.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:22.452 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T18:27:22.510 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:27:22.510 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:27:22.510 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:27:22.510 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:22.511 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-13T18:27:22.511 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:22.511 INFO:teuthology.orchestra.run.smithi044.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:27:22.511 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 96:c1:1b:93:f5:3e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:27:22.511 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:27:22.511 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:22.511 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::94c1:1bff:fe93:f53e/64 scope link 2024-09-13T18:27:22.511 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:22.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:22.512 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T18:27:22.526 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:27:22.526 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:27:22.526 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:27:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-13T18:27:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:22.527 INFO:teuthology.orchestra.run.smithi044.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:27:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 96:c1:1b:93:f5:3e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:27:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:27:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::94c1:1bff:fe93:f53e/64 scope link 2024-09-13T18:27:22.527 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:22.528 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-13T18:27:22.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:22.528 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2024-09-13T18:27:22.529 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-13T18:27:22.529 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-13T18:27:22.529 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T18:27:22.529 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-13T18:27:22.529 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-13T18:27:22.529 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-13T18:27:22.529 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-13T18:27:22.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:22.583 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2024-09-13T18:27:22.583 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-13T18:27:22.583 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.1 up 2024-09-13T18:27:22.583 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T18:27:22.583 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-13T18:27:22.607 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-09-13T18:27:22.607 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:27:22.607 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-13T18:27:22.614 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-13T18:27:22.614 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:27:22.614 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-13T18:27:22.618 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:27:22.633 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:27:22.633 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:27:22.642 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:27:22.643 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:27:22.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:22.644 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:27:22.692 INFO:teuthology.orchestra.run.smithi044.stdout:52 2024-09-13T18:27:22.692 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2024-09-13T18:27:22.692 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-09-13T18:27:22.695 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:27:22.711 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:27:22.712 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:27:22.769 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:27:22.770 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:27:22.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:22.771 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:27:22.776 INFO:teuthology.orchestra.run.smithi044.stdout:52 2024-09-13T18:27:22.783 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi044.stderr:2024-09-13T18:27:22.779+0000 7f6f8e78f640 -1 init, newargv = 0x5594bd8db2f0 newargc=15 2024-09-13T18:27:22.783 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi044.stderr:ceph-fuse[34489]: starting ceph client 2024-09-13T18:27:22.791 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi044.stderr:ceph-fuse[34489]: starting fuse 2024-09-13T18:27:23.878 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:27:23.897 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:27:23.897 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:27:23.907 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:27:23.908 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:27:23.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:23.909 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:27:23.960 INFO:teuthology.orchestra.run.smithi044.stdout:52 2024-09-13T18:27:23.960 INFO:teuthology.orchestra.run.smithi044.stdout:53 2024-09-13T18:27:23.961 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2024-09-13T18:27:23.961 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:27:23.961 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2024-09-13T18:27:23.961 DEBUG:teuthology.orchestra.run.smithi044:> import re 2024-09-13T18:27:23.961 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:27:23.961 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2024-09-13T18:27:23.961 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:27:23.961 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2024-09-13T18:27:23.961 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-09-13T18:27:23.961 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2024-09-13T18:27:23.962 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-09-13T18:27:23.962 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:27:23.962 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2024-09-13T18:27:23.962 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2024-09-13T18:27:23.962 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2024-09-13T18:27:23.962 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2024-09-13T18:27:23.962 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:27:23.962 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2024-09-13T18:27:23.962 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:27:23.962 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:27:23.962 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:27:23.962 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2024-09-13T18:27:23.962 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2024-09-13T18:27:23.962 DEBUG:teuthology.orchestra.run.smithi044:> return f 2024-09-13T18:27:23.962 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:27:23.963 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:27:23.963 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.2")) 2024-09-13T18:27:23.963 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:27:24.044 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.2.34489.asok 2024-09-13T18:27:24.231 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.34489.asok 2024-09-13T18:27:24.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:24.231 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.34489.asok status 2024-09-13T18:27:24.334 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:27:24.334 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2024-09-13T18:27:24.334 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:27:24.334 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:27:24.334 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "2", 2024-09-13T18:27:24.334 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2024-09-13T18:27:24.334 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-09-13T18:27:24.334 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "34489", 2024-09-13T18:27:24.334 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2024-09-13T18:27:24.334 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:24.334 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2024-09-13T18:27:24.335 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2024-09-13T18:27:24.335 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4731, 2024-09-13T18:27:24.335 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2024-09-13T18:27:24.335 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2024-09-13T18:27:24.335 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2024-09-13T18:27:24.335 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 4731 2024-09-13T18:27:24.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:24.335 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:27:24.335 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-13T18:27:24.335 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.2:0", 2024-09-13T18:27:24.335 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2672593215 2024-09-13T18:27:24.335 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:24.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:24.335 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:27:24.336 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-13T18:27:24.336 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.2:0", 2024-09-13T18:27:24.336 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2672593215 2024-09-13T18:27:24.336 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:24.336 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.4731 192.168.0.2:0/2672593215", 2024-09-13T18:27:24.336 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.2:0/2672593215", 2024-09-13T18:27:24.336 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2024-09-13T18:27:24.336 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 7, 2024-09-13T18:27:24.336 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 21, 2024-09-13T18:27:24.336 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:27:24.336 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2024-09-13T18:27:24.336 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2024-09-13T18:27:24.336 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:27:24.344 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T18:27:24.344 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:27:24.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.455+0000 7f8eeebca700 1 Processor -- start 2024-09-13T18:27:24.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.455+0000 7f8eeebca700 1 -- start start 2024-09-13T18:27:24.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eeebca700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ee815cd80 0x7f8ee806baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:24.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eeebca700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8ee806a640 0x7f8ee806aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:24.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eeebca700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8ee806afa0 0x7f8ee80b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:24.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eeebca700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee815d160 con 0x7f8ee806afa0 2024-09-13T18:27:24.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eeebca700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee80d2120 con 0x7f8ee806a640 2024-09-13T18:27:24.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eeebca700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee80d1570 con 0x7f8ee815cd80 2024-09-13T18:27:24.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eee3c9700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8ee806afa0 0x7f8ee80b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:24.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eee3c9700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8ee806afa0 0x7f8ee80b5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57822/0 (socket says 172.21.15.44:57822) 2024-09-13T18:27:24.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eee3c9700 1 -- 172.21.15.44:0/2949467404 learned_addr learned my addr 172.21.15.44:0/2949467404 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:24.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eedbc8700 1 --2- 172.21.15.44:0/2949467404 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ee815cd80 0x7f8ee806baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:24.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eed3c7700 1 --2- 172.21.15.44:0/2949467404 >> v2:172.21.15.99:3300/0 conn(0x7f8ee806a640 0x7f8ee806aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:24.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eee3c9700 1 -- 172.21.15.44:0/2949467404 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ee815cd80 msgr2=0x7f8ee806baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:24.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eee3c9700 1 --2- 172.21.15.44:0/2949467404 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ee815cd80 0x7f8ee806baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:24.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eee3c9700 1 -- 172.21.15.44:0/2949467404 >> v2:172.21.15.99:3300/0 conn(0x7f8ee806a640 msgr2=0x7f8ee806aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:24.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eee3c9700 1 --2- 172.21.15.44:0/2949467404 >> v2:172.21.15.99:3300/0 conn(0x7f8ee806a640 0x7f8ee806aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:24.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eee3c9700 1 -- 172.21.15.44:0/2949467404 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee806b450 con 0x7f8ee806afa0 2024-09-13T18:27:24.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eee3c9700 1 --2- 172.21.15.44:0/2949467404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ee806afa0 0x7f8ee80b5e90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8160750 tx=0x7f8ee000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d7d4a3623490d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:24.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eecbc6700 1 -- 172.21.15.44:0/2949467404 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee000e070 con 0x7f8ee806afa0 2024-09-13T18:27:24.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eecbc6700 1 -- 172.21.15.44:0/2949467404 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee000b910 con 0x7f8ee806afa0 2024-09-13T18:27:24.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eecbc6700 1 -- 172.21.15.44:0/2949467404 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee000bcc0 con 0x7f8ee806afa0 2024-09-13T18:27:24.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eeebca700 1 -- 172.21.15.44:0/2949467404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ee806afa0 msgr2=0x7f8ee80b5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:24.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eeebca700 1 --2- 172.21.15.44:0/2949467404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ee806afa0 0x7f8ee80b5e90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8160750 tx=0x7f8ee000b330 comp rx=0 tx=0).stop 2024-09-13T18:27:24.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eeebca700 1 -- 172.21.15.44:0/2949467404 shutdown_connections 2024-09-13T18:27:24.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eeebca700 1 --2- 172.21.15.44:0/2949467404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ee806afa0 0x7f8ee80b5e90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:24.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eeebca700 1 --2- 172.21.15.44:0/2949467404 >> v2:172.21.15.99:3300/0 conn(0x7f8ee806a640 0x7f8ee806aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:24.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eeebca700 1 --2- 172.21.15.44:0/2949467404 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ee815cd80 0x7f8ee806baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:24.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eeebca700 1 -- 172.21.15.44:0/2949467404 >> 172.21.15.44:0/2949467404 conn(0x7f8ee80d30b0 msgr2=0x7f8ee80d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:24.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eeebca700 1 -- 172.21.15.44:0/2949467404 shutdown_connections 2024-09-13T18:27:24.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.459+0000 7f8eeebca700 1 -- 172.21.15.44:0/2949467404 wait complete. 2024-09-13T18:27:24.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.463+0000 7f8eeebca700 1 Processor -- start 2024-09-13T18:27:24.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.463+0000 7f8eeebca700 1 -- start start 2024-09-13T18:27:24.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.463+0000 7f8eeebca700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ee806a640 0x7f8ee80aa020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:24.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.463+0000 7f8eeebca700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ee806afa0 0x7f8ee81f3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:24.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.463+0000 7f8eeebca700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ee815cd80 0x7f8ee80cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:24.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.463+0000 7f8eeebca700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee81f3680 con 0x7f8ee815cd80 2024-09-13T18:27:24.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.463+0000 7f8eeebca700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee80ccb40 con 0x7f8ee806afa0 2024-09-13T18:27:24.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.463+0000 7f8eeebca700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee80aa730 con 0x7f8ee806a640 2024-09-13T18:27:24.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.463+0000 7f8eee3c9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ee815cd80 0x7f8ee80cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:24.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.463+0000 7f8eee3c9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ee815cd80 0x7f8ee80cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57826/0 (socket says 172.21.15.44:57826) 2024-09-13T18:27:24.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.463+0000 7f8eee3c9700 1 -- 172.21.15.44:0/125253408 learned_addr learned my addr 172.21.15.44:0/125253408 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:24.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.463+0000 7f8eed3c7700 1 --2- 172.21.15.44:0/125253408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ee806afa0 0x7f8ee81f3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:24.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.463+0000 7f8eedbc8700 1 --2- 172.21.15.44:0/125253408 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ee806a640 0x7f8ee80aa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:24.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.463+0000 7f8eee3c9700 1 -- 172.21.15.44:0/125253408 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ee806a640 msgr2=0x7f8ee80aa020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:24.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.463+0000 7f8eee3c9700 1 --2- 172.21.15.44:0/125253408 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ee806a640 0x7f8ee80aa020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:24.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.463+0000 7f8eee3c9700 1 -- 172.21.15.44:0/125253408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ee806afa0 msgr2=0x7f8ee81f3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:24.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.463+0000 7f8eee3c9700 1 --2- 172.21.15.44:0/125253408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ee806afa0 0x7f8ee81f3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:24.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.463+0000 7f8eee3c9700 1 -- 172.21.15.44:0/125253408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee0009b30 con 0x7f8ee815cd80 2024-09-13T18:27:24.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.463+0000 7f8eee3c9700 1 --2- 172.21.15.44:0/125253408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ee815cd80 0x7f8ee80cc600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80d2b40 tx=0x7f8ee0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:24.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.467+0000 7f8ede7fc700 1 -- 172.21.15.44:0/125253408 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee00092e0 con 0x7f8ee815cd80 2024-09-13T18:27:24.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.467+0000 7f8ede7fc700 1 -- 172.21.15.44:0/125253408 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee0004250 con 0x7f8ee815cd80 2024-09-13T18:27:24.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.467+0000 7f8eeebca700 1 -- 172.21.15.44:0/125253408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee81f37f0 con 0x7f8ee815cd80 2024-09-13T18:27:24.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.467+0000 7f8ede7fc700 1 -- 172.21.15.44:0/125253408 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee0004600 con 0x7f8ee815cd80 2024-09-13T18:27:24.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.467+0000 7f8eeebca700 1 -- 172.21.15.44:0/125253408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee81f3db0 con 0x7f8ee815cd80 2024-09-13T18:27:24.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.467+0000 7f8eeebca700 1 -- 172.21.15.44:0/125253408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee8160480 con 0x7f8ee815cd80 2024-09-13T18:27:24.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.467+0000 7f8ede7fc700 1 -- 172.21.15.44:0/125253408 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8ee0004760 con 0x7f8ee815cd80 2024-09-13T18:27:24.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.467+0000 7f8ede7fc700 1 --2- 172.21.15.44:0/125253408 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8ecc066730 0x7f8ecc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:24.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.467+0000 7f8ede7fc700 1 -- 172.21.15.44:0/125253408 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ee0085880 con 0x7f8ee815cd80 2024-09-13T18:27:24.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.467+0000 7f8eedbc8700 1 --2- 172.21.15.44:0/125253408 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8ecc066730 0x7f8ecc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:24.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.471+0000 7f8eedbc8700 1 --2- 172.21.15.44:0/125253408 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8ecc066730 0x7f8ecc068bf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4009b50 tx=0x7f8ee4009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:24.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.475+0000 7f8ede7fc700 1 -- 172.21.15.44:0/125253408 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8ee0052d20 con 0x7f8ee815cd80 2024-09-13T18:27:24.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.679+0000 7f8eeebca700 1 -- 172.21.15.44:0/125253408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8ee80b8580 con 0x7f8ee815cd80 2024-09-13T18:27:24.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.679+0000 7f8ede7fc700 1 -- 172.21.15.44:0/125253408 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8ee0020020 con 0x7f8ee815cd80 2024-09-13T18:27:24.684 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:27:24.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.679+0000 7f8eeebca700 1 -- 172.21.15.44:0/125253408 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8ecc066730 msgr2=0x7f8ecc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:24.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.679+0000 7f8eeebca700 1 --2- 172.21.15.44:0/125253408 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8ecc066730 0x7f8ecc068bf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4009b50 tx=0x7f8ee4009240 comp rx=0 tx=0).stop 2024-09-13T18:27:24.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.679+0000 7f8eeebca700 1 -- 172.21.15.44:0/125253408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ee815cd80 msgr2=0x7f8ee80cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:24.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.679+0000 7f8eeebca700 1 --2- 172.21.15.44:0/125253408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ee815cd80 0x7f8ee80cc600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80d2b40 tx=0x7f8ee0004af0 comp rx=0 tx=0).stop 2024-09-13T18:27:24.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.683+0000 7f8eeebca700 1 -- 172.21.15.44:0/125253408 shutdown_connections 2024-09-13T18:27:24.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.683+0000 7f8eeebca700 1 --2- 172.21.15.44:0/125253408 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8ecc066730 0x7f8ecc068bf0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:24.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.683+0000 7f8eeebca700 1 --2- 172.21.15.44:0/125253408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ee815cd80 0x7f8ee80cc600 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:24.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.683+0000 7f8eeebca700 1 --2- 172.21.15.44:0/125253408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ee806afa0 0x7f8ee81f3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:24.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.683+0000 7f8eeebca700 1 --2- 172.21.15.44:0/125253408 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ee806a640 0x7f8ee80aa020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:24.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.683+0000 7f8eeebca700 1 -- 172.21.15.44:0/125253408 >> 172.21.15.44:0/125253408 conn(0x7f8ee80d30b0 msgr2=0x7f8ee80d0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:24.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.683+0000 7f8eeebca700 1 -- 172.21.15.44:0/125253408 shutdown_connections 2024-09-13T18:27:24.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:24.683+0000 7f8eeebca700 1 -- 172.21.15.44:0/125253408 wait complete. 2024-09-13T18:27:24.699 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:27:24.699 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:27:24.699 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-09-13T18:27:24.699 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:27:24.699 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:27:24.699 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:27:24.699 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:27:24.699 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:27:24.699 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:27:24.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:24.699 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-09-13T18:27:24.707 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:27:24.708 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:27:24.708 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:27:24.708 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:24.708 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-09-13T18:27:24.708 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:24.708 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:27:24.708 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:27:24.708 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:27:24.708 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:27:24.708 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:27:24.708 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:27:24.709 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:27:24.709 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:27:24.709 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:27:24.709 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42573sec preferred_lft 42573sec 2024-09-13T18:27:24.709 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link 2024-09-13T18:27:24.709 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:24.709 INFO:teuthology.orchestra.run.smithi099.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:27:24.709 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 02:42:11:19:27:37 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:27:24.709 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:27:24.709 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:24.709 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:27:24.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:24.710 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-09-13T18:27:24.710 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-13T18:27:24.710 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:27:24.710 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip addr flush dev ceph-brx 2024-09-13T18:27:24.710 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set ceph-brx up 2024-09-13T18:27:24.710 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:27:24.710 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-13T18:27:24.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:24.797 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:27:24.807 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-09-13T18:27:24.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:24.809 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-09-13T18:27:24.829 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-09-13T18:27:24.830 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:27:24.830 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:27:24.830 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:27:24.830 INFO:teuthology.orchestra.run.smithi099.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:27:24.830 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T18:27:24.830 INFO:teuthology.orchestra.run.smithi099.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:27:24.830 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:27:24.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:24.830 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-09-13T18:27:24.831 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-13T18:27:24.831 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:27:24.831 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:27:24.831 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:27:24.831 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-13T18:27:24.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:24.873 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-13T18:27:24.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:24.921 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list-id 2024-09-13T18:27:24.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:24.927 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-09-13T18:27:24.927 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-13T18:27:24.927 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:27:24.927 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-13T18:27:24.927 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-13T18:27:24.954 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-13T18:27:24.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:24.954 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-09-13T18:27:24.954 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-13T18:27:24.954 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-13T18:27:24.954 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:27:24.954 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-13T18:27:24.955 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-13T18:27:24.955 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-13T18:27:24.955 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-13T18:27:25.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:25.068 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-09-13T18:27:25.068 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-13T18:27:25.069 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.0 up 2024-09-13T18:27:25.069 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:27:25.069 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-13T18:27:25.095 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T18:27:25.095 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:27:25.095 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:27:25.102 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:27:25.102 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:27:25.103 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:27:25.107 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2024-09-13T18:27:25.167 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:27:25.168 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:27:25.177 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:27:25.178 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:27:25.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:25.179 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2024-09-13T18:27:25.183 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:27:25.184 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T18:27:25.186 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2024-09-13T18:27:25.203 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:27:25.203 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:27:25.216 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:27:25.217 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:27:25.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:25.218 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2024-09-13T18:27:25.272 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:2024-09-13T18:27:25.266+0000 7fa940dd7640 -1 init, newargv = 0x559c77a378f0 newargc=15 2024-09-13T18:27:25.272 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[32816]: starting ceph client 2024-09-13T18:27:25.282 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[32816]: starting fuse 2024-09-13T18:27:26.324 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2024-09-13T18:27:26.342 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:27:26.342 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:27:26.352 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:27:26.353 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:27:26.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:26.354 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2024-09-13T18:27:26.359 INFO:teuthology.orchestra.run.smithi099.stdout:52 2024-09-13T18:27:26.359 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T18:27:26.359 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:27:26.359 DEBUG:teuthology.orchestra.run.smithi099:> import glob 2024-09-13T18:27:26.359 DEBUG:teuthology.orchestra.run.smithi099:> import re 2024-09-13T18:27:26.360 DEBUG:teuthology.orchestra.run.smithi099:> import os 2024-09-13T18:27:26.360 DEBUG:teuthology.orchestra.run.smithi099:> import subprocess 2024-09-13T18:27:26.360 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-13T18:27:26.360 DEBUG:teuthology.orchestra.run.smithi099:> def _find_admin_socket(client_name): 2024-09-13T18:27:26.360 DEBUG:teuthology.orchestra.run.smithi099:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T18:27:26.360 DEBUG:teuthology.orchestra.run.smithi099:> files = glob.glob(asok_path) 2024-09-13T18:27:26.360 DEBUG:teuthology.orchestra.run.smithi099:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T18:27:26.360 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-13T18:27:26.360 DEBUG:teuthology.orchestra.run.smithi099:> # Given a non-glob path, it better be there 2024-09-13T18:27:26.360 DEBUG:teuthology.orchestra.run.smithi099:> if "*" not in asok_path: 2024-09-13T18:27:26.361 DEBUG:teuthology.orchestra.run.smithi099:> assert(len(files) == 1) 2024-09-13T18:27:26.361 DEBUG:teuthology.orchestra.run.smithi099:> return files[0] 2024-09-13T18:27:26.361 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-13T18:27:26.361 DEBUG:teuthology.orchestra.run.smithi099:> for f in files: 2024-09-13T18:27:26.361 DEBUG:teuthology.orchestra.run.smithi099:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:27:26.361 DEBUG:teuthology.orchestra.run.smithi099:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:27:26.361 DEBUG:teuthology.orchestra.run.smithi099:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:27:26.361 DEBUG:teuthology.orchestra.run.smithi099:> contents = proc_f.read() 2024-09-13T18:27:26.361 DEBUG:teuthology.orchestra.run.smithi099:> if mountpoint in contents: 2024-09-13T18:27:26.363 DEBUG:teuthology.orchestra.run.smithi099:> return f 2024-09-13T18:27:26.364 DEBUG:teuthology.orchestra.run.smithi099:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:27:26.364 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-13T18:27:26.364 DEBUG:teuthology.orchestra.run.smithi099:> print(_find_admin_socket("client.1")) 2024-09-13T18:27:26.364 DEBUG:teuthology.orchestra.run.smithi099:> ' 2024-09-13T18:27:26.443 INFO:teuthology.orchestra.run.smithi099.stdout:/var/run/ceph/ceph-client.1.32816.asok 2024-09-13T18:27:26.629 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.32816.asok 2024-09-13T18:27:26.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:26.630 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.32816.asok status 2024-09-13T18:27:26.775 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-13T18:27:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": { 2024-09-13T18:27:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:27:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:27:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: "entity_id": "1", 2024-09-13T18:27:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": "smithi099", 2024-09-13T18:27:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T18:27:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: "pid": "32816", 2024-09-13T18:27:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: "root": "/" 2024-09-13T18:27:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-13T18:27:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_count": 0, 2024-09-13T18:27:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_pinned_count": 0, 2024-09-13T18:27:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4592, 2024-09-13T18:27:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: "inst": { 2024-09-13T18:27:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: "name": { 2024-09-13T18:27:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "client", 2024-09-13T18:27:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: "num": 4592 2024-09-13T18:27:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-13T18:27:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2024-09-13T18:27:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-13T18:27:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:27:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2074750124 2024-09-13T18:27:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-13T18:27:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-13T18:27:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2024-09-13T18:27:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-13T18:27:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:27:26.778 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2074750124 2024-09-13T18:27:26.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-13T18:27:26.778 INFO:teuthology.orchestra.run.smithi099.stdout: "inst_str": "client.4592 192.168.0.1:0/2074750124", 2024-09-13T18:27:26.778 INFO:teuthology.orchestra.run.smithi099.stdout: "addr_str": "192.168.0.1:0/2074750124", 2024-09-13T18:27:26.778 INFO:teuthology.orchestra.run.smithi099.stdout: "inode_count": 1, 2024-09-13T18:27:26.778 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_epoch": 7, 2024-09-13T18:27:26.778 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch": 21, 2024-09-13T18:27:26.778 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:27:26.778 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklisted": false, 2024-09-13T18:27:26.778 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs" 2024-09-13T18:27:26.778 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-13T18:27:26.785 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T18:27:26.786 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:27:26.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.899+0000 7f255cb33700 1 Processor -- start 2024-09-13T18:27:26.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.899+0000 7f255cb33700 1 -- start start 2024-09-13T18:27:26.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.903+0000 7f255cb33700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f255806bbf0 0x7f25580b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:26.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.903+0000 7f255cb33700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f25580b3910 0x7f255806a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:26.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.903+0000 7f255cb33700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255813dcb0 con 0x7f255806aaf0 2024-09-13T18:27:26.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.903+0000 7f255cb33700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f255815be60 con 0x7f255806bbf0 2024-09-13T18:27:26.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.903+0000 7f255cb33700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255813ffd0 con 0x7f25580b3910 2024-09-13T18:27:26.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.903+0000 7f25577fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f255806bbf0 0x7f25580b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:26.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.903+0000 7f25577fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f255806bbf0 0x7f25580b33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57834/0 (socket says 172.21.15.44:57834) 2024-09-13T18:27:26.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.903+0000 7f25577fe700 1 -- 172.21.15.44:0/839887010 learned_addr learned my addr 172.21.15.44:0/839887010 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:26.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.903+0000 7f2556ffd700 1 --2- 172.21.15.44:0/839887010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f25580b3910 0x7f255806a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:26.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.903+0000 7f25567fc700 1 -- 172.21.15.44:0/839887010 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399889277 0 0) 0x7f255813dcb0 con 0x7f255806aaf0 2024-09-13T18:27:26.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.903+0000 7f25577fe700 1 -- 172.21.15.44:0/839887010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f25580b3910 msgr2=0x7f255806a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:26.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.903+0000 7f25577fe700 1 --2- 172.21.15.44:0/839887010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f25580b3910 0x7f255806a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:26.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.903+0000 7f25577fe700 1 -- 172.21.15.44:0/839887010 >> v1:172.21.15.99:6789/0 conn(0x7f255806aaf0 legacy=0x7f25580cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:26.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.903+0000 7f25577fe700 1 -- 172.21.15.44:0/839887010 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25580b3d70 con 0x7f255806bbf0 2024-09-13T18:27:26.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.903+0000 7f2556ffd700 1 --2- 172.21.15.44:0/839887010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f25580b3910 0x7f255806a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:26.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.903+0000 7f25577fe700 1 --2- 172.21.15.44:0/839887010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f255806bbf0 0x7f25580b33d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2548009910 tx=0x7f2548009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f04677d58588ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:26.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.903+0000 7f25567fc700 1 -- 172.21.15.44:0/839887010 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548011830 con 0x7f255806bbf0 2024-09-13T18:27:26.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.903+0000 7f25567fc700 1 -- 172.21.15.44:0/839887010 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2548011990 con 0x7f255806bbf0 2024-09-13T18:27:26.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.903+0000 7f25567fc700 1 -- 172.21.15.44:0/839887010 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548011d40 con 0x7f255806bbf0 2024-09-13T18:27:26.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f255cb33700 1 -- 172.21.15.44:0/839887010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f255806bbf0 msgr2=0x7f25580b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:26.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f255cb33700 1 --2- 172.21.15.44:0/839887010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f255806bbf0 0x7f25580b33d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2548009910 tx=0x7f2548009c20 comp rx=0 tx=0).stop 2024-09-13T18:27:26.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f255cb33700 1 -- 172.21.15.44:0/839887010 shutdown_connections 2024-09-13T18:27:26.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f255cb33700 1 --2- 172.21.15.44:0/839887010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f25580b3910 0x7f255806a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:26.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f255cb33700 1 --2- 172.21.15.44:0/839887010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f255806bbf0 0x7f25580b33d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:26.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f255cb33700 1 -- 172.21.15.44:0/839887010 >> 172.21.15.44:0/839887010 conn(0x7f25580b0f00 msgr2=0x7f25580b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:26.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f255cb33700 1 -- 172.21.15.44:0/839887010 shutdown_connections 2024-09-13T18:27:26.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f255cb33700 1 -- 172.21.15.44:0/839887010 wait complete. 2024-09-13T18:27:26.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f255cb33700 1 Processor -- start 2024-09-13T18:27:26.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f255cb33700 1 -- start start 2024-09-13T18:27:26.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f255cb33700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f255806aaf0 0x7f25581f2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:26.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f255cb33700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f255806bbf0 0x7f255815d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:26.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f255cb33700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f25580b3910 0x7f2558143020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:26.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f255cb33700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25580cd2b0 con 0x7f255806bbf0 2024-09-13T18:27:26.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f255cb33700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25580cb3d0 con 0x7f255806aaf0 2024-09-13T18:27:26.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f255cb33700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25581f2f80 con 0x7f25580b3910 2024-09-13T18:27:26.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f2556ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f255806bbf0 0x7f255815d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:26.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f2556ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f255806bbf0 0x7f255815d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57842/0 (socket says 172.21.15.44:57842) 2024-09-13T18:27:26.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f2556ffd700 1 -- 172.21.15.44:0/2239541497 learned_addr learned my addr 172.21.15.44:0/2239541497 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:26.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f2557fff700 1 --2- 172.21.15.44:0/2239541497 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f25580b3910 0x7f2558143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:26.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f25577fe700 1 --2- 172.21.15.44:0/2239541497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f255806aaf0 0x7f25581f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:26.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f2556ffd700 1 -- 172.21.15.44:0/2239541497 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f25580b3910 msgr2=0x7f2558143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:26.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f2556ffd700 1 --2- 172.21.15.44:0/2239541497 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f25580b3910 0x7f2558143020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:26.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f2556ffd700 1 -- 172.21.15.44:0/2239541497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f255806aaf0 msgr2=0x7f25581f2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:26.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f2556ffd700 1 --2- 172.21.15.44:0/2239541497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f255806aaf0 0x7f25581f2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:26.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f2556ffd700 1 -- 172.21.15.44:0/2239541497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25400094b0 con 0x7f255806bbf0 2024-09-13T18:27:26.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.907+0000 7f2556ffd700 1 --2- 172.21.15.44:0/2239541497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f255806bbf0 0x7f255815d940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f254000ebe0 tx=0x7f2540009e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:26.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.911+0000 7f254ffff700 1 -- 172.21.15.44:0/2239541497 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254000c8b0 con 0x7f255806bbf0 2024-09-13T18:27:26.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.911+0000 7f254ffff700 1 -- 172.21.15.44:0/2239541497 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254000ca10 con 0x7f255806bbf0 2024-09-13T18:27:26.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.911+0000 7f255cb33700 1 -- 172.21.15.44:0/2239541497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2548009570 con 0x7f255806bbf0 2024-09-13T18:27:26.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.911+0000 7f254ffff700 1 -- 172.21.15.44:0/2239541497 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254000cda0 con 0x7f255806bbf0 2024-09-13T18:27:26.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.911+0000 7f255cb33700 1 -- 172.21.15.44:0/2239541497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25581f3540 con 0x7f255806bbf0 2024-09-13T18:27:26.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.911+0000 7f255cb33700 1 -- 172.21.15.44:0/2239541497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25580cb5a0 con 0x7f255806bbf0 2024-09-13T18:27:26.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.911+0000 7f254ffff700 1 -- 172.21.15.44:0/2239541497 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2540013470 con 0x7f255806bbf0 2024-09-13T18:27:26.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.911+0000 7f254ffff700 1 --2- 172.21.15.44:0/2239541497 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2538066730 0x7f2538068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:26.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.911+0000 7f254ffff700 1 -- 172.21.15.44:0/2239541497 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25400841e0 con 0x7f255806bbf0 2024-09-13T18:27:26.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.915+0000 7f25577fe700 1 --2- 172.21.15.44:0/2239541497 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2538066730 0x7f2538068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:26.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.915+0000 7f25577fe700 1 --2- 172.21.15.44:0/2239541497 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2538066730 0x7f2538068bf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2548000c00 tx=0x7f2548008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:26.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:26.919+0000 7f254ffff700 1 -- 172.21.15.44:0/2239541497 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f25580cb5a0 con 0x7f255806bbf0 2024-09-13T18:27:27.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:27.131+0000 7f255cb33700 1 -- 172.21.15.44:0/2239541497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f25580cb5a0 con 0x7f255806bbf0 2024-09-13T18:27:27.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:27.131+0000 7f254ffff700 1 -- 172.21.15.44:0/2239541497 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f25580cb5a0 con 0x7f255806bbf0 2024-09-13T18:27:27.135 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:27:27.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:27.131+0000 7f255cb33700 1 -- 172.21.15.44:0/2239541497 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2538066730 msgr2=0x7f2538068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:27.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:27.131+0000 7f255cb33700 1 --2- 172.21.15.44:0/2239541497 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2538066730 0x7f2538068bf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2548000c00 tx=0x7f2548008030 comp rx=0 tx=0).stop 2024-09-13T18:27:27.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:27.131+0000 7f255cb33700 1 -- 172.21.15.44:0/2239541497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f255806bbf0 msgr2=0x7f255815d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:27.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:27.131+0000 7f255cb33700 1 --2- 172.21.15.44:0/2239541497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f255806bbf0 0x7f255815d940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f254000ebe0 tx=0x7f2540009e10 comp rx=0 tx=0).stop 2024-09-13T18:27:27.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:27.131+0000 7f255cb33700 1 -- 172.21.15.44:0/2239541497 shutdown_connections 2024-09-13T18:27:27.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:27.131+0000 7f255cb33700 1 --2- 172.21.15.44:0/2239541497 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2538066730 0x7f2538068bf0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:27.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:27.131+0000 7f255cb33700 1 --2- 172.21.15.44:0/2239541497 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f25580b3910 0x7f2558143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:27.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:27.131+0000 7f255cb33700 1 --2- 172.21.15.44:0/2239541497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f255806bbf0 0x7f255815d940 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:27.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:27.131+0000 7f255cb33700 1 --2- 172.21.15.44:0/2239541497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f255806aaf0 0x7f25581f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:27.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:27.131+0000 7f255cb33700 1 -- 172.21.15.44:0/2239541497 >> 172.21.15.44:0/2239541497 conn(0x7f25580b0f00 msgr2=0x7f25580713c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:27.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:27.135+0000 7f255cb33700 1 -- 172.21.15.44:0/2239541497 shutdown_connections 2024-09-13T18:27:27.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:27.135+0000 7f255cb33700 1 -- 172.21.15.44:0/2239541497 wait complete. 2024-09-13T18:27:27.154 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:27:27.154 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:27:27.154 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-09-13T18:27:27.154 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-13T18:27:27.154 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T18:27:27.154 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:27:27.154 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:27:27.154 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:27:27.154 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-13T18:27:27.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:27.155 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-09-13T18:27:27.163 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:27:27.163 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:27:27.163 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:27:27.163 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:27.163 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-09-13T18:27:27.163 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:27.163 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:27:27.164 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:27:27.164 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:27:27.164 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:27:27.164 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:27:27.164 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:27:27.164 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:27:27.164 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:27:27.164 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:27:27.164 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42570sec preferred_lft 42570sec 2024-09-13T18:27:27.164 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link 2024-09-13T18:27:27.165 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:27.165 INFO:teuthology.orchestra.run.smithi099.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:27:27.165 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 02:42:11:19:27:37 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:27:27.165 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:27:27.165 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:27.165 INFO:teuthology.orchestra.run.smithi099.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:27:27.165 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether d2:b1:c2:02:8e:c1 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:27:27.165 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:27:27.165 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:27.165 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::6c6e:5cff:fef7:1526/64 scope link 2024-09-13T18:27:27.165 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:27.165 INFO:teuthology.orchestra.run.smithi099.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:27:27.165 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether d2:b1:c2:02:8e:c1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:27:27.166 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::d0b1:c2ff:fe02:8ec1/64 scope link 2024-09-13T18:27:27.166 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:27.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:27.166 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:27:27.182 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-09-13T18:27:27.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:27.184 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-09-13T18:27:27.235 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-09-13T18:27:27.235 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:27:27.235 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:27:27.236 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:27:27.236 INFO:teuthology.orchestra.run.smithi099.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:27:27.236 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T18:27:27.236 INFO:teuthology.orchestra.run.smithi099.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:27:27.236 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:27:27.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:27.236 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-09-13T18:27:27.236 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-13T18:27:27.236 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:27:27.236 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:27:27.237 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:27:27.237 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-13T18:27:27.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:27.276 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-13T18:27:27.283 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:27:27.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:27.284 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list-id 2024-09-13T18:27:27.290 INFO:teuthology.orchestra.run.smithi099.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-13T18:27:27.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:27.290 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-09-13T18:27:27.290 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-13T18:27:27.290 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:27:27.290 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-13T18:27:27.290 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-13T18:27:27.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:27.320 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T18:27:27.379 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:27:27.380 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:27:27.380 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:27:27.380 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:27.380 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-09-13T18:27:27.380 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:27.380 INFO:teuthology.orchestra.run.smithi099.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:27:27.380 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 4a:cc:e8:10:be:bd brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:27:27.380 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:27:27.380 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:27.380 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::48cc:e8ff:fe10:bebd/64 scope link 2024-09-13T18:27:27.380 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:27.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:27.381 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T18:27:27.395 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:27:27.395 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:27:27.395 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:27:27.396 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:27.396 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-09-13T18:27:27.396 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:27.396 INFO:teuthology.orchestra.run.smithi099.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:27:27.396 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 4a:cc:e8:10:be:bd brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:27:27.396 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:27:27.396 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:27.396 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::48cc:e8ff:fe10:bebd/64 scope link 2024-09-13T18:27:27.396 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:27:27.397 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-13T18:27:27.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:27.398 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-09-13T18:27:27.398 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-13T18:27:27.398 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-13T18:27:27.398 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T18:27:27.398 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-13T18:27:27.398 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-13T18:27:27.398 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-13T18:27:27.398 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-13T18:27:27.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:27.456 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-09-13T18:27:27.456 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-13T18:27:27.456 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.1 up 2024-09-13T18:27:27.456 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T18:27:27.456 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-13T18:27:27.482 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-09-13T18:27:27.482 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:27:27.482 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-13T18:27:27.488 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-13T18:27:27.489 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:27:27.489 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-13T18:27:27.494 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2024-09-13T18:27:27.511 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:27:27.511 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:27:27.570 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:27:27.571 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:27:27.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:27.572 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2024-09-13T18:27:27.579 INFO:teuthology.orchestra.run.smithi099.stdout:52 2024-09-13T18:27:27.579 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2024-09-13T18:27:27.580 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-09-13T18:27:27.582 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2024-09-13T18:27:27.597 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:27:27.597 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:27:27.658 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:27:27.658 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:27:27.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:27.659 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2024-09-13T18:27:27.663 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi099.stderr:2024-09-13T18:27:27.658+0000 7f1bf76d4640 -1 init, newargv = 0x55d2a25bd550 newargc=15 2024-09-13T18:27:27.664 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi099.stderr:ceph-fuse[32927]: starting ceph client 2024-09-13T18:27:27.665 INFO:teuthology.orchestra.run.smithi099.stdout:52 2024-09-13T18:27:27.672 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi099.stderr:ceph-fuse[32927]: starting fuse 2024-09-13T18:27:28.271 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:27:28.273 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:27:28.766 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2024-09-13T18:27:28.785 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:27:28.785 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:27:28.796 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:27:28.798 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:27:28.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:28.798 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2024-09-13T18:27:28.803 INFO:teuthology.orchestra.run.smithi099.stdout:52 2024-09-13T18:27:28.804 INFO:teuthology.orchestra.run.smithi099.stdout:53 2024-09-13T18:27:28.804 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2024-09-13T18:27:28.804 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:27:28.804 DEBUG:teuthology.orchestra.run.smithi099:> import glob 2024-09-13T18:27:28.804 DEBUG:teuthology.orchestra.run.smithi099:> import re 2024-09-13T18:27:28.804 DEBUG:teuthology.orchestra.run.smithi099:> import os 2024-09-13T18:27:28.804 DEBUG:teuthology.orchestra.run.smithi099:> import subprocess 2024-09-13T18:27:28.804 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-13T18:27:28.804 DEBUG:teuthology.orchestra.run.smithi099:> def _find_admin_socket(client_name): 2024-09-13T18:27:28.804 DEBUG:teuthology.orchestra.run.smithi099:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-09-13T18:27:28.804 DEBUG:teuthology.orchestra.run.smithi099:> files = glob.glob(asok_path) 2024-09-13T18:27:28.805 DEBUG:teuthology.orchestra.run.smithi099:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-09-13T18:27:28.805 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-13T18:27:28.805 DEBUG:teuthology.orchestra.run.smithi099:> # Given a non-glob path, it better be there 2024-09-13T18:27:28.805 DEBUG:teuthology.orchestra.run.smithi099:> if "*" not in asok_path: 2024-09-13T18:27:28.805 DEBUG:teuthology.orchestra.run.smithi099:> assert(len(files) == 1) 2024-09-13T18:27:28.805 DEBUG:teuthology.orchestra.run.smithi099:> return files[0] 2024-09-13T18:27:28.805 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-13T18:27:28.805 DEBUG:teuthology.orchestra.run.smithi099:> for f in files: 2024-09-13T18:27:28.805 DEBUG:teuthology.orchestra.run.smithi099:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:27:28.805 DEBUG:teuthology.orchestra.run.smithi099:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:27:28.805 DEBUG:teuthology.orchestra.run.smithi099:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:27:28.805 DEBUG:teuthology.orchestra.run.smithi099:> contents = proc_f.read() 2024-09-13T18:27:28.805 DEBUG:teuthology.orchestra.run.smithi099:> if mountpoint in contents: 2024-09-13T18:27:28.805 DEBUG:teuthology.orchestra.run.smithi099:> return f 2024-09-13T18:27:28.806 DEBUG:teuthology.orchestra.run.smithi099:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:27:28.806 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-13T18:27:28.806 DEBUG:teuthology.orchestra.run.smithi099:> print(_find_admin_socket("client.3")) 2024-09-13T18:27:28.806 DEBUG:teuthology.orchestra.run.smithi099:> ' 2024-09-13T18:27:28.885 INFO:teuthology.orchestra.run.smithi099.stdout:/var/run/ceph/ceph-client.3.32927.asok 2024-09-13T18:27:29.070 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.32927.asok 2024-09-13T18:27:29.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:29.070 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.32927.asok status 2024-09-13T18:27:29.176 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-13T18:27:29.176 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": { 2024-09-13T18:27:29.176 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:27:29.177 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:27:29.177 INFO:teuthology.orchestra.run.smithi099.stdout: "entity_id": "3", 2024-09-13T18:27:29.177 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": "smithi099", 2024-09-13T18:27:29.177 INFO:teuthology.orchestra.run.smithi099.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-09-13T18:27:29.177 INFO:teuthology.orchestra.run.smithi099.stdout: "pid": "32927", 2024-09-13T18:27:29.177 INFO:teuthology.orchestra.run.smithi099.stdout: "root": "/" 2024-09-13T18:27:29.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-13T18:27:29.177 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_count": 0, 2024-09-13T18:27:29.177 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_pinned_count": 0, 2024-09-13T18:27:29.177 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4705, 2024-09-13T18:27:29.177 INFO:teuthology.orchestra.run.smithi099.stdout: "inst": { 2024-09-13T18:27:29.177 INFO:teuthology.orchestra.run.smithi099.stdout: "name": { 2024-09-13T18:27:29.177 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "client", 2024-09-13T18:27:29.177 INFO:teuthology.orchestra.run.smithi099.stdout: "num": 4705 2024-09-13T18:27:29.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-13T18:27:29.178 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2024-09-13T18:27:29.178 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-13T18:27:29.178 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "192.168.0.2:0", 2024-09-13T18:27:29.178 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1084514477 2024-09-13T18:27:29.178 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-13T18:27:29.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-13T18:27:29.178 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2024-09-13T18:27:29.178 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-13T18:27:29.178 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "192.168.0.2:0", 2024-09-13T18:27:29.178 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1084514477 2024-09-13T18:27:29.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-13T18:27:29.178 INFO:teuthology.orchestra.run.smithi099.stdout: "inst_str": "client.4705 192.168.0.2:0/1084514477", 2024-09-13T18:27:29.179 INFO:teuthology.orchestra.run.smithi099.stdout: "addr_str": "192.168.0.2:0/1084514477", 2024-09-13T18:27:29.179 INFO:teuthology.orchestra.run.smithi099.stdout: "inode_count": 1, 2024-09-13T18:27:29.179 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_epoch": 7, 2024-09-13T18:27:29.179 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch": 21, 2024-09-13T18:27:29.179 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:27:29.179 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklisted": false, 2024-09-13T18:27:29.179 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs" 2024-09-13T18:27:29.179 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-13T18:27:29.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:29.186 DEBUG:teuthology.orchestra.run.smithi044:> stat --file-system '--printf=%T 2024-09-13T18:27:29.186 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:27:29.195 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2024-09-13T18:27:29.195 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:27:29.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:29.195 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:27:29.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:29.256 DEBUG:teuthology.orchestra.run.smithi044:> stat --file-system '--printf=%T 2024-09-13T18:27:29.256 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.2 2024-09-13T18:27:29.262 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2024-09-13T18:27:29.263 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-09-13T18:27:29.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:29.263 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-13T18:27:29.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:29.285 DEBUG:teuthology.orchestra.run.smithi099:> stat --file-system '--printf=%T 2024-09-13T18:27:29.285 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T18:27:29.293 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2024-09-13T18:27:29.293 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T18:27:29.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:29.294 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:27:29.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:29.309 DEBUG:teuthology.orchestra.run.smithi099:> stat --file-system '--printf=%T 2024-09-13T18:27:29.309 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.3 2024-09-13T18:27:29.316 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2024-09-13T18:27:29.316 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-09-13T18:27:29.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:29.317 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-13T18:27:29.331 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-13T18:27:29.347 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:29.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9ee4c2a700 1 Processor -- start 2024-09-13T18:27:29.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9ee4c2a700 1 -- start start 2024-09-13T18:27:29.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9ee4c2a700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9ee00b3ae0 0x7f9ee006cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:29.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9ee4c2a700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee006af40 con 0x7f9ee006aa90 2024-09-13T18:27:29.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9ee4c2a700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee006d690 con 0x7f9ee0159720 2024-09-13T18:27:29.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9ee4c2a700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee00cbfe0 con 0x7f9ee00b3ae0 2024-09-13T18:27:29.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9edffff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9ee006aa90 0x7f9ee00ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:35768/0 (socket says 172.21.15.44:35768) 2024-09-13T18:27:29.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9edffff700 1 -- 172.21.15.44:0/1882913086 learned_addr learned my addr 172.21.15.44:0/1882913086 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:29.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9edeffd700 1 --2- 172.21.15.44:0/1882913086 >> v2:172.21.15.44:3300/0 conn(0x7f9ee00b3ae0 0x7f9ee006cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:29.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9ede7fc700 1 -- 172.21.15.44:0/1882913086 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277814084 0 0) 0x7f9ee006af40 con 0x7f9ee006aa90 2024-09-13T18:27:29.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9ede7fc700 1 -- 172.21.15.44:0/1882913086 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ec80035d0 con 0x7f9ee006aa90 2024-09-13T18:27:29.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9ede7fc700 1 -- 172.21.15.44:0/1882913086 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1199202583 0 0) 0x7f9ec80035d0 con 0x7f9ee006aa90 2024-09-13T18:27:29.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9ede7fc700 1 -- 172.21.15.44:0/1882913086 >> v2:172.21.15.44:3300/0 conn(0x7f9ee00b3ae0 msgr2=0x7f9ee006cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:29.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9ede7fc700 1 --2- 172.21.15.44:0/1882913086 >> v2:172.21.15.44:3300/0 conn(0x7f9ee00b3ae0 0x7f9ee006cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9ede7fc700 1 -- 172.21.15.44:0/1882913086 >> v1:172.21.15.99:6789/0 conn(0x7f9ee0159720 legacy=0x7f9ee00b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:29.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9ede7fc700 1 -- 172.21.15.44:0/1882913086 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee00cc2c0 con 0x7f9ee006aa90 2024-09-13T18:27:29.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9ede7fc700 1 -- 172.21.15.44:0/1882913086 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f9ed80019f0 con 0x7f9ee006aa90 2024-09-13T18:27:29.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9ede7fc700 1 -- 172.21.15.44:0/1882913086 >> v1:172.21.15.44:6789/0 conn(0x7f9ee006aa90 legacy=0x7f9ee00ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:29.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9ede7fc700 1 --2- 172.21.15.44:0/1882913086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ec8003a20 0x7f9ec8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:29.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9ede7fc700 1 --2- 172.21.15.44:0/1882913086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec8004870 0x7f9ec8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:29.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9ede7fc700 1 --2- 172.21.15.44:0/1882913086 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ec8005230 0x7f9ec800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:29.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9ede7fc700 1 -- 172.21.15.44:0/1882913086 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee00cbfe0 con 0x7f9ec8004870 2024-09-13T18:27:29.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9ede7fc700 1 -- 172.21.15.44:0/1882913086 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec800c1d0 con 0x7f9ec8003a20 2024-09-13T18:27:29.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9ede7fc700 1 -- 172.21.15.44:0/1882913086 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec800c390 con 0x7f9ec8005230 2024-09-13T18:27:29.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9edeffd700 1 --2- 172.21.15.44:0/1882913086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec8004870 0x7f9ec8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:29.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9edf7fe700 1 --2- 172.21.15.44:0/1882913086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ec8003a20 0x7f9ec8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:29.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.467+0000 7f9edffff700 1 --2- 172.21.15.44:0/1882913086 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ec8005230 0x7f9ec800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:29.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.471+0000 7f9edeffd700 1 -- 172.21.15.44:0/1882913086 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ec8005230 msgr2=0x7f9ec800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:29.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.471+0000 7f9edeffd700 1 --2- 172.21.15.44:0/1882913086 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ec8005230 0x7f9ec800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.471+0000 7f9edeffd700 1 -- 172.21.15.44:0/1882913086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ec8003a20 msgr2=0x7f9ec8003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:29.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.471+0000 7f9edeffd700 1 --2- 172.21.15.44:0/1882913086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ec8003a20 0x7f9ec8003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.471+0000 7f9edeffd700 1 -- 172.21.15.44:0/1882913086 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec80035d0 con 0x7f9ec8004870 2024-09-13T18:27:29.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.471+0000 7f9edffff700 1 -- 172.21.15.44:0/1882913086 reap_dead start 2024-09-13T18:27:29.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.471+0000 7f9edeffd700 1 --2- 172.21.15.44:0/1882913086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec8004870 0x7f9ec8004cf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0009b70 tx=0x7f9ec80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c076b5f4616fca70 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:29.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.471+0000 7f9ede7fc700 1 -- 172.21.15.44:0/1882913086 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed000e6c0 con 0x7f9ec8004870 2024-09-13T18:27:29.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.471+0000 7f9ede7fc700 1 -- 172.21.15.44:0/1882913086 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed000e820 con 0x7f9ec8004870 2024-09-13T18:27:29.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.471+0000 7f9ede7fc700 1 -- 172.21.15.44:0/1882913086 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed000eb90 con 0x7f9ec8004870 2024-09-13T18:27:29.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.471+0000 7f9ee4c2a700 1 -- 172.21.15.44:0/1882913086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec8004870 msgr2=0x7f9ec8004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:29.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.471+0000 7f9ee4c2a700 1 --2- 172.21.15.44:0/1882913086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec8004870 0x7f9ec8004cf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0009b70 tx=0x7f9ec80058a0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.471+0000 7f9ee4c2a700 1 -- 172.21.15.44:0/1882913086 shutdown_connections 2024-09-13T18:27:29.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.471+0000 7f9ee4c2a700 1 --2- 172.21.15.44:0/1882913086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec8004870 0x7f9ec8004cf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.471+0000 7f9ee4c2a700 1 -- 172.21.15.44:0/1882913086 >> 172.21.15.44:0/1882913086 conn(0x7f9ee00b0f00 msgr2=0x7f9ee00b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:29.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.471+0000 7f9ee4c2a700 1 -- 172.21.15.44:0/1882913086 shutdown_connections 2024-09-13T18:27:29.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.471+0000 7f9ee4c2a700 1 -- 172.21.15.44:0/1882913086 wait complete. 2024-09-13T18:27:29.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.471+0000 7f9ee4c2a700 1 Processor -- start 2024-09-13T18:27:29.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.471+0000 7f9ee4c2a700 1 -- start start 2024-09-13T18:27:29.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.475+0000 7f9ee4c2a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec8004870 0x7f9ee0142060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:29.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.475+0000 7f9ee4c2a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ee01e36e0 0x7f9ee0154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:29.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.475+0000 7f9ee4c2a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ee01e3b60 0x7f9ee0154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:29.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.475+0000 7f9ee4c2a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee01ef3e0 con 0x7f9ec8004870 2024-09-13T18:27:29.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.475+0000 7f9ee4c2a700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee01ee760 con 0x7f9ee01e36e0 2024-09-13T18:27:29.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.475+0000 7f9ee4c2a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee01eea40 con 0x7f9ee01e3b60 2024-09-13T18:27:29.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.475+0000 7f9edf7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec8004870 0x7f9ee0142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:29.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.475+0000 7f9edf7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec8004870 0x7f9ee0142060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57876/0 (socket says 172.21.15.44:57876) 2024-09-13T18:27:29.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.475+0000 7f9edf7fe700 1 -- 172.21.15.44:0/3603895194 learned_addr learned my addr 172.21.15.44:0/3603895194 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:29.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.475+0000 7f9edeffd700 1 --2- 172.21.15.44:0/3603895194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ee01e36e0 0x7f9ee0154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:29.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.475+0000 7f9edffff700 1 --2- 172.21.15.44:0/3603895194 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ee01e3b60 0x7f9ee0154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:29.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.475+0000 7f9edf7fe700 1 -- 172.21.15.44:0/3603895194 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ee01e3b60 msgr2=0x7f9ee0154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:29.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.475+0000 7f9edf7fe700 1 --2- 172.21.15.44:0/3603895194 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ee01e3b60 0x7f9ee0154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.475+0000 7f9edf7fe700 1 -- 172.21.15.44:0/3603895194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ee01e36e0 msgr2=0x7f9ee0154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:29.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.475+0000 7f9edf7fe700 1 --2- 172.21.15.44:0/3603895194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ee01e36e0 0x7f9ee0154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.475+0000 7f9edf7fe700 1 -- 172.21.15.44:0/3603895194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee01eed20 con 0x7f9ec8004870 2024-09-13T18:27:29.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.475+0000 7f9edffff700 1 --2- 172.21.15.44:0/3603895194 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ee01e3b60 0x7f9ee0154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:29.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.475+0000 7f9edf7fe700 1 --2- 172.21.15.44:0/3603895194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec8004870 0x7f9ee0142060 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400f7f0 tx=0x7f9ed400fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:29.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.475+0000 7f9ec7fff700 1 -- 172.21.15.44:0/3603895194 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4005320 con 0x7f9ec8004870 2024-09-13T18:27:29.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.475+0000 7f9ec7fff700 1 -- 172.21.15.44:0/3603895194 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed4005480 con 0x7f9ec8004870 2024-09-13T18:27:29.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.475+0000 7f9ee4c2a700 1 -- 172.21.15.44:0/3603895194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee01ef000 con 0x7f9ec8004870 2024-09-13T18:27:29.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.475+0000 7f9ec7fff700 1 -- 172.21.15.44:0/3603895194 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4006aa0 con 0x7f9ec8004870 2024-09-13T18:27:29.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.475+0000 7f9ee4c2a700 1 -- 172.21.15.44:0/3603895194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee01425a0 con 0x7f9ec8004870 2024-09-13T18:27:29.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.479+0000 7f9ee4c2a700 1 -- 172.21.15.44:0/3603895194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee00b33d0 con 0x7f9ec8004870 2024-09-13T18:27:29.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.479+0000 7f9ec7fff700 1 -- 172.21.15.44:0/3603895194 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9ed4006c00 con 0x7f9ec8004870 2024-09-13T18:27:29.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.479+0000 7f9ec7fff700 1 --2- 172.21.15.44:0/3603895194 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9ecc066760 0x7f9ecc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:29.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.479+0000 7f9ec7fff700 1 -- 172.21.15.44:0/3603895194 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ed40839d0 con 0x7f9ec8004870 2024-09-13T18:27:29.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.479+0000 7f9edeffd700 1 --2- 172.21.15.44:0/3603895194 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9ecc066760 0x7f9ecc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:29.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.479+0000 7f9edeffd700 1 --2- 172.21.15.44:0/3603895194 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9ecc066760 0x7f9ecc068c20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9ed00090b0 tx=0x7f9ed0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:29.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.487+0000 7f9ec7fff700 1 -- 172.21.15.44:0/3603895194 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9ed4050d30 con 0x7f9ec8004870 2024-09-13T18:27:29.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.655+0000 7f9ee4c2a700 1 -- 172.21.15.44:0/3603895194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ee00cb550 con 0x7f9ec8004870 2024-09-13T18:27:29.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.655+0000 7f9ec7fff700 1 -- 172.21.15.44:0/3603895194 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f9ed401a090 con 0x7f9ec8004870 2024-09-13T18:27:29.662 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:29.662 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:02.280221+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:29.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.659+0000 7f9ee4c2a700 1 -- 172.21.15.44:0/3603895194 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9ecc066760 msgr2=0x7f9ecc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:29.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.659+0000 7f9ee4c2a700 1 --2- 172.21.15.44:0/3603895194 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9ecc066760 0x7f9ecc068c20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9ed00090b0 tx=0x7f9ed0008030 comp rx=0 tx=0).stop 2024-09-13T18:27:29.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.659+0000 7f9ee4c2a700 1 -- 172.21.15.44:0/3603895194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec8004870 msgr2=0x7f9ee0142060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.659+0000 7f9ee4c2a700 1 --2- 172.21.15.44:0/3603895194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec8004870 0x7f9ee0142060 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400f7f0 tx=0x7f9ed400fbb0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.659+0000 7f9ee4c2a700 1 -- 172.21.15.44:0/3603895194 shutdown_connections 2024-09-13T18:27:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.659+0000 7f9ee4c2a700 1 --2- 172.21.15.44:0/3603895194 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9ecc066760 0x7f9ecc068c20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.659+0000 7f9ee4c2a700 1 --2- 172.21.15.44:0/3603895194 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ee01e3b60 0x7f9ee0154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.659+0000 7f9ee4c2a700 1 --2- 172.21.15.44:0/3603895194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ee01e36e0 0x7f9ee0154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.659+0000 7f9ee4c2a700 1 --2- 172.21.15.44:0/3603895194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec8004870 0x7f9ee0142060 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.659+0000 7f9ee4c2a700 1 -- 172.21.15.44:0/3603895194 >> 172.21.15.44:0/3603895194 conn(0x7f9ee00b0f00 msgr2=0x7f9ee0157700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.659+0000 7f9ee4c2a700 1 -- 172.21.15.44:0/3603895194 shutdown_connections 2024-09-13T18:27:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.659+0000 7f9ee4c2a700 1 -- 172.21.15.44:0/3603895194 wait complete. 2024-09-13T18:27:29.677 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:26:59.478511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:27:00.261038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:27:29.677 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:27:29.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.791+0000 7f3d23fff700 1 Processor -- start 2024-09-13T18:27:29.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.791+0000 7f3d23fff700 1 -- start start 2024-09-13T18:27:29.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.791+0000 7f3d23fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3d2406b5f0 0x7f3d2406a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:29.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.791+0000 7f3d23fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3d2415ce70 0x7f3d240cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:29.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.791+0000 7f3d23fff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d240d1bc0 con 0x7f3d2415ca90 2024-09-13T18:27:29.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.791+0000 7f3d23fff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d240cdac0 con 0x7f3d2415ce70 2024-09-13T18:27:29.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.791+0000 7f3d23fff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d2406ac20 con 0x7f3d2406b5f0 2024-09-13T18:27:29.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.791+0000 7f3d237fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3d2415ce70 0x7f3d240cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:29.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.791+0000 7f3d237fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3d2415ce70 0x7f3d240cdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57888/0 (socket says 172.21.15.44:57888) 2024-09-13T18:27:29.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.791+0000 7f3d237fe700 1 -- 172.21.15.44:0/1042633340 learned_addr learned my addr 172.21.15.44:0/1042633340 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:29.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.791+0000 7f3d227fc700 1 --2- 172.21.15.44:0/1042633340 >> v2:172.21.15.99:3300/0 conn(0x7f3d2406b5f0 0x7f3d2406a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:29.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.791+0000 7f3d237fe700 1 -- 172.21.15.44:0/1042633340 >> v2:172.21.15.99:3300/0 conn(0x7f3d2406b5f0 msgr2=0x7f3d2406a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:29.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.791+0000 7f3d237fe700 1 --2- 172.21.15.44:0/1042633340 >> v2:172.21.15.99:3300/0 conn(0x7f3d2406b5f0 0x7f3d2406a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.791+0000 7f3d237fe700 1 -- 172.21.15.44:0/1042633340 >> v1:172.21.15.44:6789/0 conn(0x7f3d2415ca90 legacy=0x7f3d2406aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:29.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.795+0000 7f3d237fe700 1 -- 172.21.15.44:0/1042633340 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d240d1290 con 0x7f3d2415ce70 2024-09-13T18:27:29.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.795+0000 7f3d237fe700 1 --2- 172.21.15.44:0/1042633340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d2415ce70 0x7f3d240cdec0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3d240cd1f0 tx=0x7f3d1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91caa2db55ebc70a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:29.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.795+0000 7f3d21ffb700 1 -- 172.21.15.44:0/1042633340 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c00e070 con 0x7f3d2415ce70 2024-09-13T18:27:29.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.795+0000 7f3d21ffb700 1 -- 172.21.15.44:0/1042633340 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1c00b9c0 con 0x7f3d2415ce70 2024-09-13T18:27:29.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.795+0000 7f3d21ffb700 1 -- 172.21.15.44:0/1042633340 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c00bd70 con 0x7f3d2415ce70 2024-09-13T18:27:29.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.795+0000 7f3d23fff700 1 -- 172.21.15.44:0/1042633340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d2415ce70 msgr2=0x7f3d240cdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:29.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.795+0000 7f3d23fff700 1 --2- 172.21.15.44:0/1042633340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d2415ce70 0x7f3d240cdec0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3d240cd1f0 tx=0x7f3d1c00b330 comp rx=0 tx=0).stop 2024-09-13T18:27:29.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.795+0000 7f3d23fff700 1 -- 172.21.15.44:0/1042633340 shutdown_connections 2024-09-13T18:27:29.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.795+0000 7f3d23fff700 1 --2- 172.21.15.44:0/1042633340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d2415ce70 0x7f3d240cdec0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.795+0000 7f3d23fff700 1 --2- 172.21.15.44:0/1042633340 >> v2:172.21.15.99:3300/0 conn(0x7f3d2406b5f0 0x7f3d2406a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.795+0000 7f3d23fff700 1 -- 172.21.15.44:0/1042633340 >> 172.21.15.44:0/1042633340 conn(0x7f3d240d2c10 msgr2=0x7f3d240d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:29.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.795+0000 7f3d23fff700 1 -- 172.21.15.44:0/1042633340 shutdown_connections 2024-09-13T18:27:29.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.795+0000 7f3d23fff700 1 -- 172.21.15.44:0/1042633340 wait complete. 2024-09-13T18:27:29.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.795+0000 7f3d23fff700 1 Processor -- start 2024-09-13T18:27:29.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.795+0000 7f3d23fff700 1 -- start start 2024-09-13T18:27:29.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.799+0000 7f3d23fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d2406b5f0 0x7f3d240cad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:29.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.799+0000 7f3d23fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d2415ca90 0x7f3d241f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:29.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.799+0000 7f3d23fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d2415ce70 0x7f3d241f2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:29.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.799+0000 7f3d23fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d241f2390 con 0x7f3d2415ca90 2024-09-13T18:27:29.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.799+0000 7f3d23fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d240c7530 con 0x7f3d2415ce70 2024-09-13T18:27:29.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.799+0000 7f3d23fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d241f3420 con 0x7f3d2406b5f0 2024-09-13T18:27:29.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.799+0000 7f3d227fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d2415ca90 0x7f3d241f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:29.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.799+0000 7f3d227fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d2415ca90 0x7f3d241f1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57900/0 (socket says 172.21.15.44:57900) 2024-09-13T18:27:29.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.799+0000 7f3d227fc700 1 -- 172.21.15.44:0/99596656 learned_addr learned my addr 172.21.15.44:0/99596656 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:29.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.799+0000 7f3d237fe700 1 --2- 172.21.15.44:0/99596656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d2415ce70 0x7f3d241f2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:29.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.799+0000 7f3d22ffd700 1 --2- 172.21.15.44:0/99596656 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d2406b5f0 0x7f3d240cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:29.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.799+0000 7f3d227fc700 1 -- 172.21.15.44:0/99596656 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d2406b5f0 msgr2=0x7f3d240cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:29.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.799+0000 7f3d227fc700 1 --2- 172.21.15.44:0/99596656 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d2406b5f0 0x7f3d240cad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.799+0000 7f3d227fc700 1 -- 172.21.15.44:0/99596656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d2415ce70 msgr2=0x7f3d241f2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:29.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.799+0000 7f3d227fc700 1 --2- 172.21.15.44:0/99596656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d2415ce70 0x7f3d241f2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.799+0000 7f3d227fc700 1 -- 172.21.15.44:0/99596656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1c009b30 con 0x7f3d2415ca90 2024-09-13T18:27:29.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.799+0000 7f3d227fc700 1 --2- 172.21.15.44:0/99596656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d2415ca90 0x7f3d241f1e50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400d830 tx=0x7f3d1400db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:29.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.799+0000 7f3d1b7fe700 1 -- 172.21.15.44:0/99596656 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d140125f0 con 0x7f3d2415ca90 2024-09-13T18:27:29.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.799+0000 7f3d1b7fe700 1 -- 172.21.15.44:0/99596656 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d14012750 con 0x7f3d2415ca90 2024-09-13T18:27:29.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.799+0000 7f3d23fff700 1 -- 172.21.15.44:0/99596656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d240cb310 con 0x7f3d2415ca90 2024-09-13T18:27:29.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.799+0000 7f3d1b7fe700 1 -- 172.21.15.44:0/99596656 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d14012ac0 con 0x7f3d2415ca90 2024-09-13T18:27:29.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.799+0000 7f3d23fff700 1 -- 172.21.15.44:0/99596656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d240cb8d0 con 0x7f3d2415ca90 2024-09-13T18:27:29.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.799+0000 7f3d23fff700 1 -- 172.21.15.44:0/99596656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d2406a520 con 0x7f3d2415ca90 2024-09-13T18:27:29.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.803+0000 7f3d1b7fe700 1 -- 172.21.15.44:0/99596656 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3d14012c20 con 0x7f3d2415ca90 2024-09-13T18:27:29.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.803+0000 7f3d1b7fe700 1 --2- 172.21.15.44:0/99596656 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3d04066730 0x7f3d04068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:29.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.803+0000 7f3d1b7fe700 1 -- 172.21.15.44:0/99596656 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d14084d50 con 0x7f3d2415ca90 2024-09-13T18:27:29.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.803+0000 7f3d22ffd700 1 --2- 172.21.15.44:0/99596656 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3d04066730 0x7f3d04068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:29.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.807+0000 7f3d22ffd700 1 --2- 172.21.15.44:0/99596656 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3d04066730 0x7f3d04068bf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3d240b15c0 tx=0x7f3d0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:29.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.811+0000 7f3d1b7fe700 1 -- 172.21.15.44:0/99596656 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3d14052150 con 0x7f3d2415ca90 2024-09-13T18:27:29.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.979+0000 7f3d23fff700 1 -- 172.21.15.44:0/99596656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d240ce0a0 con 0x7f3d2415ca90 2024-09-13T18:27:29.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.979+0000 7f3d1b7fe700 1 -- 172.21.15.44:0/99596656 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d14055770 con 0x7f3d2415ca90 2024-09-13T18:27:29.986 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:27:29.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.983+0000 7f3d23fff700 1 -- 172.21.15.44:0/99596656 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3d04066730 msgr2=0x7f3d04068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:29.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.983+0000 7f3d23fff700 1 --2- 172.21.15.44:0/99596656 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3d04066730 0x7f3d04068bf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3d240b15c0 tx=0x7f3d0c009040 comp rx=0 tx=0).stop 2024-09-13T18:27:29.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.983+0000 7f3d23fff700 1 -- 172.21.15.44:0/99596656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d2415ca90 msgr2=0x7f3d241f1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:29.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.983+0000 7f3d23fff700 1 --2- 172.21.15.44:0/99596656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d2415ca90 0x7f3d241f1e50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400d830 tx=0x7f3d1400db40 comp rx=0 tx=0).stop 2024-09-13T18:27:29.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.983+0000 7f3d23fff700 1 -- 172.21.15.44:0/99596656 shutdown_connections 2024-09-13T18:27:29.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.983+0000 7f3d23fff700 1 --2- 172.21.15.44:0/99596656 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3d04066730 0x7f3d04068bf0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.983+0000 7f3d23fff700 1 --2- 172.21.15.44:0/99596656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d2415ce70 0x7f3d241f2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.983+0000 7f3d23fff700 1 --2- 172.21.15.44:0/99596656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d2415ca90 0x7f3d241f1e50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.983+0000 7f3d23fff700 1 --2- 172.21.15.44:0/99596656 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d2406b5f0 0x7f3d240cad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.983+0000 7f3d23fff700 1 -- 172.21.15.44:0/99596656 >> 172.21.15.44:0/99596656 conn(0x7f3d240d2c10 msgr2=0x7f3d2406aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:29.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.983+0000 7f3d23fff700 1 -- 172.21.15.44:0/99596656 shutdown_connections 2024-09-13T18:27:29.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:29.983+0000 7f3d23fff700 1 -- 172.21.15.44:0/99596656 wait complete. 2024-09-13T18:27:30.000 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:27:30.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.119+0000 7fd606676700 1 Processor -- start 2024-09-13T18:27:30.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.119+0000 7fd606676700 1 -- start start 2024-09-13T18:27:30.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.119+0000 7fd606676700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd60015cb30 0x7fd60006e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:30.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.119+0000 7fd606676700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd60006ab90 0x7fd6000b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:30.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.119+0000 7fd606676700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd60015cf10 con 0x7fd60006e960 2024-09-13T18:27:30.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.119+0000 7fd606676700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6000ac8c0 con 0x7fd60015cb30 2024-09-13T18:27:30.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.119+0000 7fd606676700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6000acba0 con 0x7fd60006ab90 2024-09-13T18:27:30.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.123+0000 7fd605674700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd60015cb30 0x7fd60006e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:30.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.123+0000 7fd605674700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd60015cb30 0x7fd60006e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57914/0 (socket says 172.21.15.44:57914) 2024-09-13T18:27:30.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.123+0000 7fd605674700 1 -- 172.21.15.44:0/298950971 learned_addr learned my addr 172.21.15.44:0/298950971 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:30.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.123+0000 7fd604e73700 1 --2- 172.21.15.44:0/298950971 >> v2:172.21.15.99:3300/0 conn(0x7fd60006ab90 0x7fd6000b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:30.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.123+0000 7fd605674700 1 -- 172.21.15.44:0/298950971 >> v2:172.21.15.99:3300/0 conn(0x7fd60006ab90 msgr2=0x7fd6000b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:30.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.123+0000 7fd605674700 1 --2- 172.21.15.44:0/298950971 >> v2:172.21.15.99:3300/0 conn(0x7fd60006ab90 0x7fd6000b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.123+0000 7fd605674700 1 -- 172.21.15.44:0/298950971 >> v1:172.21.15.99:6789/0 conn(0x7fd60006e960 legacy=0x7fd6001606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:30.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.123+0000 7fd605674700 1 -- 172.21.15.44:0/298950971 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6000ace80 con 0x7fd60015cb30 2024-09-13T18:27:30.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.123+0000 7fd605674700 1 --2- 172.21.15.44:0/298950971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd60015cb30 0x7fd60006e420 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd6000b42f0 tx=0x7fd5f4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd66b9a190bece4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:30.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.123+0000 7fd5f3fff700 1 -- 172.21.15.44:0/298950971 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4011830 con 0x7fd60015cb30 2024-09-13T18:27:30.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.123+0000 7fd5f3fff700 1 -- 172.21.15.44:0/298950971 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f4011990 con 0x7fd60015cb30 2024-09-13T18:27:30.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.123+0000 7fd5f3fff700 1 -- 172.21.15.44:0/298950971 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4011d20 con 0x7fd60015cb30 2024-09-13T18:27:30.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.123+0000 7fd606676700 1 -- 172.21.15.44:0/298950971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd60015cb30 msgr2=0x7fd60006e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:30.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.123+0000 7fd606676700 1 --2- 172.21.15.44:0/298950971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd60015cb30 0x7fd60006e420 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd6000b42f0 tx=0x7fd5f4009bf0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.123+0000 7fd606676700 1 -- 172.21.15.44:0/298950971 shutdown_connections 2024-09-13T18:27:30.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.123+0000 7fd606676700 1 --2- 172.21.15.44:0/298950971 >> v2:172.21.15.99:3300/0 conn(0x7fd60006ab90 0x7fd6000b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.123+0000 7fd606676700 1 --2- 172.21.15.44:0/298950971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd60015cb30 0x7fd60006e420 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.123+0000 7fd606676700 1 -- 172.21.15.44:0/298950971 >> 172.21.15.44:0/298950971 conn(0x7fd60006d900 msgr2=0x7fd60006dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:30.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.123+0000 7fd606676700 1 -- 172.21.15.44:0/298950971 shutdown_connections 2024-09-13T18:27:30.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.123+0000 7fd606676700 1 -- 172.21.15.44:0/298950971 wait complete. 2024-09-13T18:27:30.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd606676700 1 Processor -- start 2024-09-13T18:27:30.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd606676700 1 -- start start 2024-09-13T18:27:30.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd606676700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd60006ab90 0x7fd6000caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:30.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd606676700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd60006e960 0x7fd6000cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:30.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd606676700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd6000cc910 0x7fd6001f28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:30.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd606676700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6000cd9c0 con 0x7fd60006ab90 2024-09-13T18:27:30.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd606676700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6000ccdb0 con 0x7fd60006e960 2024-09-13T18:27:30.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd606676700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6000cd090 con 0x7fd6000cc910 2024-09-13T18:27:30.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd605674700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd60006ab90 0x7fd6000caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:30.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd605674700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd60006ab90 0x7fd6000caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57916/0 (socket says 172.21.15.44:57916) 2024-09-13T18:27:30.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd605674700 1 -- 172.21.15.44:0/2639989915 learned_addr learned my addr 172.21.15.44:0/2639989915 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:30.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd604e73700 1 --2- 172.21.15.44:0/2639989915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd60006e960 0x7fd6000cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:30.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd605e75700 1 --2- 172.21.15.44:0/2639989915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd6000cc910 0x7fd6001f28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:30.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd605674700 1 -- 172.21.15.44:0/2639989915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd6000cc910 msgr2=0x7fd6001f28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:30.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd605674700 1 --2- 172.21.15.44:0/2639989915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd6000cc910 0x7fd6001f28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd605674700 1 -- 172.21.15.44:0/2639989915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd60006e960 msgr2=0x7fd6000cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:30.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd605674700 1 --2- 172.21.15.44:0/2639989915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd60006e960 0x7fd6000cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd605674700 1 -- 172.21.15.44:0/2639989915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f4009570 con 0x7fd60006ab90 2024-09-13T18:27:30.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd605674700 1 --2- 172.21.15.44:0/2639989915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd60006ab90 0x7fd6000caaf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4013000 tx=0x7fd5f4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:30.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd5f1ffb700 1 -- 172.21.15.44:0/2639989915 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4004450 con 0x7fd60006ab90 2024-09-13T18:27:30.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd5f1ffb700 1 -- 172.21.15.44:0/2639989915 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f401f070 con 0x7fd60006ab90 2024-09-13T18:27:30.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd606676700 1 -- 172.21.15.44:0/2639989915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6000cd370 con 0x7fd60006ab90 2024-09-13T18:27:30.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd5f1ffb700 1 -- 172.21.15.44:0/2639989915 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4003900 con 0x7fd60006ab90 2024-09-13T18:27:30.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.127+0000 7fd606676700 1 -- 172.21.15.44:0/2639989915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6000cb030 con 0x7fd60006ab90 2024-09-13T18:27:30.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.131+0000 7fd606676700 1 -- 172.21.15.44:0/2639989915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd60006e420 con 0x7fd60006ab90 2024-09-13T18:27:30.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.131+0000 7fd5f1ffb700 1 -- 172.21.15.44:0/2639989915 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd5f4003a60 con 0x7fd60006ab90 2024-09-13T18:27:30.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.131+0000 7fd5f1ffb700 1 --2- 172.21.15.44:0/2639989915 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd5e4066730 0x7fd5e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:30.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.131+0000 7fd5f1ffb700 1 -- 172.21.15.44:0/2639989915 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5f4021070 con 0x7fd60006ab90 2024-09-13T18:27:30.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.131+0000 7fd604e73700 1 --2- 172.21.15.44:0/2639989915 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd5e4066730 0x7fd5e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:30.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.135+0000 7fd604e73700 1 --2- 172.21.15.44:0/2639989915 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd5e4066730 0x7fd5e4068bf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd60015bdc0 tx=0x7fd5fc009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:30.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.143+0000 7fd5f1ffb700 1 -- 172.21.15.44:0/2639989915 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd5f4052890 con 0x7fd60006ab90 2024-09-13T18:27:30.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.311+0000 7fd606676700 1 -- 172.21.15.44:0/2639989915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd6000b2810 con 0x7fd60006ab90 2024-09-13T18:27:30.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.315+0000 7fd5f1ffb700 1 -- 172.21.15.44:0/2639989915 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd5f40045d0 con 0x7fd60006ab90 2024-09-13T18:27:30.319 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:27:30.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.315+0000 7fd606676700 1 -- 172.21.15.44:0/2639989915 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd5e4066730 msgr2=0x7fd5e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:30.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.315+0000 7fd606676700 1 --2- 172.21.15.44:0/2639989915 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd5e4066730 0x7fd5e4068bf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd60015bdc0 tx=0x7fd5fc009240 comp rx=0 tx=0).stop 2024-09-13T18:27:30.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.315+0000 7fd606676700 1 -- 172.21.15.44:0/2639989915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd60006ab90 msgr2=0x7fd6000caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:30.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.315+0000 7fd606676700 1 --2- 172.21.15.44:0/2639989915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd60006ab90 0x7fd6000caaf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4013000 tx=0x7fd5f4004770 comp rx=0 tx=0).stop 2024-09-13T18:27:30.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.315+0000 7fd606676700 1 -- 172.21.15.44:0/2639989915 shutdown_connections 2024-09-13T18:27:30.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.315+0000 7fd606676700 1 --2- 172.21.15.44:0/2639989915 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd5e4066730 0x7fd5e4068bf0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.315+0000 7fd606676700 1 --2- 172.21.15.44:0/2639989915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd6000cc910 0x7fd6001f28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.315+0000 7fd606676700 1 --2- 172.21.15.44:0/2639989915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd60006e960 0x7fd6000cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.315+0000 7fd606676700 1 --2- 172.21.15.44:0/2639989915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd60006ab90 0x7fd6000caaf0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.315+0000 7fd606676700 1 -- 172.21.15.44:0/2639989915 >> 172.21.15.44:0/2639989915 conn(0x7fd60006d900 msgr2=0x7fd60006dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:30.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.315+0000 7fd606676700 1 -- 172.21.15.44:0/2639989915 shutdown_connections 2024-09-13T18:27:30.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.315+0000 7fd606676700 1 -- 172.21.15.44:0/2639989915 wait complete. 2024-09-13T18:27:30.334 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:27:30.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.455+0000 7f8fd3119700 1 Processor -- start 2024-09-13T18:27:30.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.455+0000 7f8fd3119700 1 -- start start 2024-09-13T18:27:30.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.455+0000 7f8fd3119700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8fcc15cda0 0x7f8fcc06b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:30.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.455+0000 7f8fd3119700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8fcc0ceb70 0x7f8fcc0b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:30.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.455+0000 7f8fd3119700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fcc0b8430 con 0x7f8fcc06a520 2024-09-13T18:27:30.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.455+0000 7f8fd3119700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fcc06be40 con 0x7f8fcc15cda0 2024-09-13T18:27:30.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.455+0000 7f8fd3119700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc0cf350 con 0x7f8fcc0ceb70 2024-09-13T18:27:30.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.455+0000 7f8fd2117700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8fcc15cda0 0x7f8fcc06b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:30.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.455+0000 7f8fd2117700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8fcc15cda0 0x7f8fcc06b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57930/0 (socket says 172.21.15.44:57930) 2024-09-13T18:27:30.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.455+0000 7f8fd2117700 1 -- 172.21.15.44:0/596331231 learned_addr learned my addr 172.21.15.44:0/596331231 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:30.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.455+0000 7f8fd1916700 1 --2- 172.21.15.44:0/596331231 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8fcc0ceb70 0x7f8fcc0b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:30.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.455+0000 7f8fd2117700 1 -- 172.21.15.44:0/596331231 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8fcc0ceb70 msgr2=0x7f8fcc0b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:30.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.455+0000 7f8fd2117700 1 --2- 172.21.15.44:0/596331231 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8fcc0ceb70 0x7f8fcc0b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.455+0000 7f8fd2117700 1 -- 172.21.15.44:0/596331231 >> v1:172.21.15.44:6789/0 conn(0x7f8fcc06a520 legacy=0x7f8fcc0d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:30.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.455+0000 7f8fd1115700 1 -- 172.21.15.44:0/596331231 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3315021576 0 0) 0x7f8fcc0b8430 con 0x7f8fcc06a520 2024-09-13T18:27:30.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.455+0000 7f8fd2117700 1 -- 172.21.15.44:0/596331231 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc0d0880 con 0x7f8fcc15cda0 2024-09-13T18:27:30.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.455+0000 7f8fd2117700 1 --2- 172.21.15.44:0/596331231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fcc15cda0 0x7f8fcc06b900 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009910 tx=0x7f8fc8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2682164a3302fa30 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:30.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.455+0000 7f8fd1115700 1 -- 172.21.15.44:0/596331231 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8011830 con 0x7f8fcc15cda0 2024-09-13T18:27:30.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.455+0000 7f8fd1115700 1 -- 172.21.15.44:0/596331231 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc8011990 con 0x7f8fcc15cda0 2024-09-13T18:27:30.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.455+0000 7f8fd1115700 1 -- 172.21.15.44:0/596331231 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8011d40 con 0x7f8fcc15cda0 2024-09-13T18:27:30.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.459+0000 7f8fd3119700 1 -- 172.21.15.44:0/596331231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fcc15cda0 msgr2=0x7f8fcc06b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:30.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.459+0000 7f8fd3119700 1 --2- 172.21.15.44:0/596331231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fcc15cda0 0x7f8fcc06b900 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009910 tx=0x7f8fc8009c20 comp rx=0 tx=0).stop 2024-09-13T18:27:30.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.459+0000 7f8fd3119700 1 -- 172.21.15.44:0/596331231 shutdown_connections 2024-09-13T18:27:30.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.459+0000 7f8fd3119700 1 --2- 172.21.15.44:0/596331231 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8fcc0ceb70 0x7f8fcc0b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.459+0000 7f8fd3119700 1 --2- 172.21.15.44:0/596331231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fcc15cda0 0x7f8fcc06b900 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.459+0000 7f8fd3119700 1 -- 172.21.15.44:0/596331231 >> 172.21.15.44:0/596331231 conn(0x7f8fcc0d2cb0 msgr2=0x7f8fcc0d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:30.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.459+0000 7f8fd3119700 1 -- 172.21.15.44:0/596331231 shutdown_connections 2024-09-13T18:27:30.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.459+0000 7f8fd3119700 1 -- 172.21.15.44:0/596331231 wait complete. 2024-09-13T18:27:30.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.459+0000 7f8fd3119700 1 Processor -- start 2024-09-13T18:27:30.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.459+0000 7f8fd3119700 1 -- start start 2024-09-13T18:27:30.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.459+0000 7f8fd3119700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8fcc06a520 0x7f8fcc150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:30.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.459+0000 7f8fd3119700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fcc0ceb70 0x7f8fcc158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:30.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.459+0000 7f8fd3119700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fcc15cda0 0x7f8fcc155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:30.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.459+0000 7f8fd3119700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc0c8f50 con 0x7f8fcc15cda0 2024-09-13T18:27:30.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.459+0000 7f8fd3119700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc0c8340 con 0x7f8fcc0ceb70 2024-09-13T18:27:30.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.459+0000 7f8fd3119700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc0c8620 con 0x7f8fcc06a520 2024-09-13T18:27:30.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.463+0000 7f8fd2918700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fcc15cda0 0x7f8fcc155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:30.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.463+0000 7f8fd2918700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fcc15cda0 0x7f8fcc155770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57942/0 (socket says 172.21.15.44:57942) 2024-09-13T18:27:30.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.463+0000 7f8fd2918700 1 -- 172.21.15.44:0/3008804666 learned_addr learned my addr 172.21.15.44:0/3008804666 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:30.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.463+0000 7f8fd2117700 1 --2- 172.21.15.44:0/3008804666 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8fcc06a520 0x7f8fcc150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:30.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.463+0000 7f8fd1916700 1 --2- 172.21.15.44:0/3008804666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fcc0ceb70 0x7f8fcc158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:30.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.463+0000 7f8fd2918700 1 -- 172.21.15.44:0/3008804666 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8fcc06a520 msgr2=0x7f8fcc150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:30.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.463+0000 7f8fd2918700 1 --2- 172.21.15.44:0/3008804666 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8fcc06a520 0x7f8fcc150b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.463+0000 7f8fd2918700 1 -- 172.21.15.44:0/3008804666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fcc0ceb70 msgr2=0x7f8fcc158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:30.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.463+0000 7f8fd2918700 1 --2- 172.21.15.44:0/3008804666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fcc0ceb70 0x7f8fcc158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.463+0000 7f8fd2918700 1 -- 172.21.15.44:0/3008804666 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc8009570 con 0x7f8fcc15cda0 2024-09-13T18:27:30.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.463+0000 7f8fd2918700 1 --2- 172.21.15.44:0/3008804666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fcc15cda0 0x7f8fcc155770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8fc400cc70 tx=0x7f8fc400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:30.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.463+0000 7f8fbeffd700 1 -- 172.21.15.44:0/3008804666 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4003e50 con 0x7f8fcc15cda0 2024-09-13T18:27:30.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.463+0000 7f8fbeffd700 1 -- 172.21.15.44:0/3008804666 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc400ce70 con 0x7f8fcc15cda0 2024-09-13T18:27:30.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.463+0000 7f8fbeffd700 1 -- 172.21.15.44:0/3008804666 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc400abd0 con 0x7f8fcc15cda0 2024-09-13T18:27:30.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.463+0000 7f8fd3119700 1 -- 172.21.15.44:0/3008804666 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fcc0c8900 con 0x7f8fcc15cda0 2024-09-13T18:27:30.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.463+0000 7f8fd3119700 1 -- 172.21.15.44:0/3008804666 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fcc151070 con 0x7f8fcc15cda0 2024-09-13T18:27:30.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.467+0000 7f8fbeffd700 1 -- 172.21.15.44:0/3008804666 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8fc400ad30 con 0x7f8fcc15cda0 2024-09-13T18:27:30.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.467+0000 7f8fd3119700 1 -- 172.21.15.44:0/3008804666 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fcc06b900 con 0x7f8fcc15cda0 2024-09-13T18:27:30.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.467+0000 7f8fbeffd700 1 --2- 172.21.15.44:0/3008804666 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8fb0066760 0x7f8fb0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:30.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.467+0000 7f8fbeffd700 1 -- 172.21.15.44:0/3008804666 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fc4083cc0 con 0x7f8fcc15cda0 2024-09-13T18:27:30.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.467+0000 7f8fd2117700 1 --2- 172.21.15.44:0/3008804666 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8fb0066760 0x7f8fb0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:30.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.467+0000 7f8fd2117700 1 --2- 172.21.15.44:0/3008804666 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8fb0066760 0x7f8fb0068c20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8014040 tx=0x7f8fc8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:30.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.475+0000 7f8fbeffd700 1 -- 172.21.15.44:0/3008804666 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8fc4051030 con 0x7f8fcc15cda0 2024-09-13T18:27:30.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.643+0000 7f8fd3119700 1 -- 172.21.15.44:0/3008804666 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8fcc15bcf0 con 0x7f8fcc15cda0 2024-09-13T18:27:30.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.643+0000 7f8fbeffd700 1 -- 172.21.15.44:0/3008804666 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8fc40170a0 con 0x7f8fcc15cda0 2024-09-13T18:27:30.647 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:27:30.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.643+0000 7f8fd3119700 1 -- 172.21.15.44:0/3008804666 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8fb0066760 msgr2=0x7f8fb0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:30.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.643+0000 7f8fd3119700 1 --2- 172.21.15.44:0/3008804666 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8fb0066760 0x7f8fb0068c20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8014040 tx=0x7f8fc8008030 comp rx=0 tx=0).stop 2024-09-13T18:27:30.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.643+0000 7f8fd3119700 1 -- 172.21.15.44:0/3008804666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fcc15cda0 msgr2=0x7f8fcc155770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:30.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.643+0000 7f8fd3119700 1 --2- 172.21.15.44:0/3008804666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fcc15cda0 0x7f8fcc155770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8fc400cc70 tx=0x7f8fc400a340 comp rx=0 tx=0).stop 2024-09-13T18:27:30.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.643+0000 7f8fd3119700 1 -- 172.21.15.44:0/3008804666 shutdown_connections 2024-09-13T18:27:30.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.643+0000 7f8fd3119700 1 --2- 172.21.15.44:0/3008804666 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8fb0066760 0x7f8fb0068c20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.643+0000 7f8fd3119700 1 --2- 172.21.15.44:0/3008804666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fcc15cda0 0x7f8fcc155770 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.643+0000 7f8fd3119700 1 --2- 172.21.15.44:0/3008804666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fcc0ceb70 0x7f8fcc158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.643+0000 7f8fd3119700 1 --2- 172.21.15.44:0/3008804666 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8fcc06a520 0x7f8fcc150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.643+0000 7f8fd3119700 1 -- 172.21.15.44:0/3008804666 >> 172.21.15.44:0/3008804666 conn(0x7f8fcc0d2cb0 msgr2=0x7f8fcc0b5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:30.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.643+0000 7f8fd3119700 1 -- 172.21.15.44:0/3008804666 shutdown_connections 2024-09-13T18:27:30.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.643+0000 7f8fd3119700 1 -- 172.21.15.44:0/3008804666 wait complete. 2024-09-13T18:27:30.662 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:30.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.771+0000 7feb54eaa700 1 Processor -- start 2024-09-13T18:27:30.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.771+0000 7feb54eaa700 1 -- start start 2024-09-13T18:27:30.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb54eaa700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7feb500b3ae0 0x7feb50165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:30.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb54eaa700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb50161290 0x7feb50161700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:30.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb54eaa700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb50071f30 con 0x7feb50160eb0 2024-09-13T18:27:30.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb54eaa700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb501622e0 con 0x7feb500b3ae0 2024-09-13T18:27:30.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb54eaa700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb50162000 con 0x7feb50161290 2024-09-13T18:27:30.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb46ffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7feb500b3ae0 0x7feb50165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:30.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb46ffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7feb500b3ae0 0x7feb50165590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57958/0 (socket says 172.21.15.44:57958) 2024-09-13T18:27:30.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb46ffd700 1 -- 172.21.15.44:0/741239907 learned_addr learned my addr 172.21.15.44:0/741239907 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:30.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb4ffff700 1 --2- 172.21.15.44:0/741239907 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb50161290 0x7feb50161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:30.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb46ffd700 1 -- 172.21.15.44:0/741239907 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb50161290 msgr2=0x7feb50161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:30.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb46ffd700 1 --2- 172.21.15.44:0/741239907 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb50161290 0x7feb50161700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb46ffd700 1 -- 172.21.15.44:0/741239907 >> v1:172.21.15.99:6789/0 conn(0x7feb50160eb0 legacy=0x7feb500b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:30.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb46ffd700 1 -- 172.21.15.44:0/741239907 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb50164ab0 con 0x7feb500b3ae0 2024-09-13T18:27:30.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb46ffd700 1 --2- 172.21.15.44:0/741239907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb500b3ae0 0x7feb50165590 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feb38009910 tx=0x7feb38009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380c1f9667ac238 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:30.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb4effd700 1 -- 172.21.15.44:0/741239907 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb38011830 con 0x7feb500b3ae0 2024-09-13T18:27:30.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb4effd700 1 -- 172.21.15.44:0/741239907 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb38011990 con 0x7feb500b3ae0 2024-09-13T18:27:30.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb4effd700 1 -- 172.21.15.44:0/741239907 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb38011d40 con 0x7feb500b3ae0 2024-09-13T18:27:30.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb54eaa700 1 -- 172.21.15.44:0/741239907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb500b3ae0 msgr2=0x7feb50165590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:30.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb54eaa700 1 --2- 172.21.15.44:0/741239907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb500b3ae0 0x7feb50165590 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feb38009910 tx=0x7feb38009c20 comp rx=0 tx=0).stop 2024-09-13T18:27:30.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb54eaa700 1 -- 172.21.15.44:0/741239907 shutdown_connections 2024-09-13T18:27:30.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb54eaa700 1 --2- 172.21.15.44:0/741239907 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb50161290 0x7feb50161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb54eaa700 1 --2- 172.21.15.44:0/741239907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb500b3ae0 0x7feb50165590 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb54eaa700 1 -- 172.21.15.44:0/741239907 >> 172.21.15.44:0/741239907 conn(0x7feb500b0f00 msgr2=0x7feb500b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:30.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb54eaa700 1 -- 172.21.15.44:0/741239907 shutdown_connections 2024-09-13T18:27:30.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.775+0000 7feb54eaa700 1 -- 172.21.15.44:0/741239907 wait complete. 2024-09-13T18:27:30.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb54eaa700 1 Processor -- start 2024-09-13T18:27:30.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb54eaa700 1 -- start start 2024-09-13T18:27:30.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb54eaa700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb500b3ae0 0x7feb500a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:30.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb54eaa700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb50160eb0 0x7feb500cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:30.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb54eaa700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb50161290 0x7feb50159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:30.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb54eaa700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5015a3d0 con 0x7feb50160eb0 2024-09-13T18:27:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb54eaa700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb500a99f0 con 0x7feb500b3ae0 2024-09-13T18:27:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb54eaa700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb501fa9b0 con 0x7feb50161290 2024-09-13T18:27:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb46ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb50160eb0 0x7feb500cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb46ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb50160eb0 0x7feb500cba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57964/0 (socket says 172.21.15.44:57964) 2024-09-13T18:27:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb46ffd700 1 -- 172.21.15.44:0/1540042337 learned_addr learned my addr 172.21.15.44:0/1540042337 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb4f7fe700 1 --2- 172.21.15.44:0/1540042337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb500b3ae0 0x7feb500a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb4ffff700 1 --2- 172.21.15.44:0/1540042337 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb50161290 0x7feb50159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb46ffd700 1 -- 172.21.15.44:0/1540042337 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb50161290 msgr2=0x7feb50159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb46ffd700 1 --2- 172.21.15.44:0/1540042337 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb50161290 0x7feb50159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb46ffd700 1 -- 172.21.15.44:0/1540042337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb500b3ae0 msgr2=0x7feb500a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb46ffd700 1 --2- 172.21.15.44:0/1540042337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb500b3ae0 0x7feb500a94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb46ffd700 1 -- 172.21.15.44:0/1540042337 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb38009570 con 0x7feb50160eb0 2024-09-13T18:27:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb46ffd700 1 --2- 172.21.15.44:0/1540042337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb50160eb0 0x7feb500cba70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feb38009c60 tx=0x7feb38004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:30.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb4cff9700 1 -- 172.21.15.44:0/1540042337 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb38004300 con 0x7feb50160eb0 2024-09-13T18:27:30.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb4cff9700 1 -- 172.21.15.44:0/1540042337 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3801f070 con 0x7feb50160eb0 2024-09-13T18:27:30.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb4cff9700 1 -- 172.21.15.44:0/1540042337 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb380036c0 con 0x7feb50160eb0 2024-09-13T18:27:30.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb54eaa700 1 -- 172.21.15.44:0/1540042337 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb501fac90 con 0x7feb50160eb0 2024-09-13T18:27:30.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.779+0000 7feb54eaa700 1 -- 172.21.15.44:0/1540042337 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb501fb250 con 0x7feb50160eb0 2024-09-13T18:27:30.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.783+0000 7feb54eaa700 1 -- 172.21.15.44:0/1540042337 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb5015a540 con 0x7feb50160eb0 2024-09-13T18:27:30.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.783+0000 7feb4cff9700 1 -- 172.21.15.44:0/1540042337 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feb38021030 con 0x7feb50160eb0 2024-09-13T18:27:30.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.783+0000 7feb4cff9700 1 --2- 172.21.15.44:0/1540042337 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7feb30066730 0x7feb30068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:30.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.783+0000 7feb4cff9700 1 -- 172.21.15.44:0/1540042337 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb38085580 con 0x7feb50160eb0 2024-09-13T18:27:30.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.783+0000 7feb4f7fe700 1 --2- 172.21.15.44:0/1540042337 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7feb30066730 0x7feb30068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:30.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.783+0000 7feb4f7fe700 1 --2- 172.21.15.44:0/1540042337 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7feb30066730 0x7feb30068bf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7feb400018a0 tx=0x7feb40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:30.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.791+0000 7feb4cff9700 1 -- 172.21.15.44:0/1540042337 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feb38052980 con 0x7feb50160eb0 2024-09-13T18:27:30.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.967+0000 7feb54eaa700 1 -- 172.21.15.44:0/1540042337 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb50165590 con 0x7feb50160eb0 2024-09-13T18:27:30.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.967+0000 7feb4cff9700 1 -- 172.21.15.44:0/1540042337 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7feb38055fa0 con 0x7feb50160eb0 2024-09-13T18:27:30.973 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:30.973 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:02.280221+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:30.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.971+0000 7feb54eaa700 1 -- 172.21.15.44:0/1540042337 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7feb30066730 msgr2=0x7feb30068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:30.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.971+0000 7feb54eaa700 1 --2- 172.21.15.44:0/1540042337 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7feb30066730 0x7feb30068bf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7feb400018a0 tx=0x7feb40009040 comp rx=0 tx=0).stop 2024-09-13T18:27:30.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.971+0000 7feb54eaa700 1 -- 172.21.15.44:0/1540042337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb50160eb0 msgr2=0x7feb500cba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:30.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.971+0000 7feb54eaa700 1 --2- 172.21.15.44:0/1540042337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb50160eb0 0x7feb500cba70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feb38009c60 tx=0x7feb38004770 comp rx=0 tx=0).stop 2024-09-13T18:27:30.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.971+0000 7feb54eaa700 1 -- 172.21.15.44:0/1540042337 shutdown_connections 2024-09-13T18:27:30.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.971+0000 7feb54eaa700 1 --2- 172.21.15.44:0/1540042337 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7feb30066730 0x7feb30068bf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.971+0000 7feb54eaa700 1 --2- 172.21.15.44:0/1540042337 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb50161290 0x7feb50159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.971+0000 7feb54eaa700 1 --2- 172.21.15.44:0/1540042337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb50160eb0 0x7feb500cba70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.971+0000 7feb54eaa700 1 --2- 172.21.15.44:0/1540042337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb500b3ae0 0x7feb500a94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.971+0000 7feb54eaa700 1 -- 172.21.15.44:0/1540042337 >> 172.21.15.44:0/1540042337 conn(0x7feb500b0f00 msgr2=0x7feb500b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:30.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.971+0000 7feb54eaa700 1 -- 172.21.15.44:0/1540042337 shutdown_connections 2024-09-13T18:27:30.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:30.971+0000 7feb54eaa700 1 -- 172.21.15.44:0/1540042337 wait complete. 2024-09-13T18:27:30.988 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:26:59.478511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:27:00.261038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:27:30.989 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:27:31.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.103+0000 7f0638b89700 1 Processor -- start 2024-09-13T18:27:31.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.103+0000 7f0638b89700 1 -- start start 2024-09-13T18:27:31.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f0638b89700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f063406b900 0x7f06340b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:31.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f0638b89700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f063406a520 0x7f063406a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:31.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f0638b89700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06340b8430 con 0x7f063415cda0 2024-09-13T18:27:31.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f0638b89700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063406ae70 con 0x7f063406a520 2024-09-13T18:27:31.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f0638b89700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063406bd60 con 0x7f063406b900 2024-09-13T18:27:31.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f0633fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f063406a520 0x7f063406a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:31.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f06337fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f063415cda0 0x7f06340ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:35788/0 (socket says 172.21.15.44:35788) 2024-09-13T18:27:31.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f06337fe700 1 -- 172.21.15.44:0/3492611472 learned_addr learned my addr 172.21.15.44:0/3492611472 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:31.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f0632ffd700 1 --2- 172.21.15.44:0/3492611472 >> v2:172.21.15.99:3300/0 conn(0x7f063406b900 0x7f06340b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:31.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f0633fff700 1 -- 172.21.15.44:0/3492611472 >> v2:172.21.15.99:3300/0 conn(0x7f063406b900 msgr2=0x7f06340b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:31.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f0633fff700 1 --2- 172.21.15.44:0/3492611472 >> v2:172.21.15.99:3300/0 conn(0x7f063406b900 0x7f06340b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f0633fff700 1 -- 172.21.15.44:0/3492611472 >> v1:172.21.15.44:6789/0 conn(0x7f063415cda0 legacy=0x7f06340ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:31.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f0633fff700 1 -- 172.21.15.44:0/3492611472 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06340cf350 con 0x7f063406a520 2024-09-13T18:27:31.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f0633fff700 1 --2- 172.21.15.44:0/3492611472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f063406a520 0x7f063406a930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f06340cf280 tx=0x7f062c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f189687126e5f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:31.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f06327fc700 1 -- 172.21.15.44:0/3492611472 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c00e070 con 0x7f063406a520 2024-09-13T18:27:31.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f06327fc700 1 -- 172.21.15.44:0/3492611472 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c00bbd0 con 0x7f063406a520 2024-09-13T18:27:31.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f06327fc700 1 -- 172.21.15.44:0/3492611472 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c012430 con 0x7f063406a520 2024-09-13T18:27:31.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f0638b89700 1 -- 172.21.15.44:0/3492611472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f063406a520 msgr2=0x7f063406a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:31.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f0638b89700 1 --2- 172.21.15.44:0/3492611472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f063406a520 0x7f063406a930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f06340cf280 tx=0x7f062c00b330 comp rx=0 tx=0).stop 2024-09-13T18:27:31.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f0638b89700 1 -- 172.21.15.44:0/3492611472 shutdown_connections 2024-09-13T18:27:31.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f0638b89700 1 --2- 172.21.15.44:0/3492611472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f063406a520 0x7f063406a930 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f0638b89700 1 --2- 172.21.15.44:0/3492611472 >> v2:172.21.15.99:3300/0 conn(0x7f063406b900 0x7f06340b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f0638b89700 1 -- 172.21.15.44:0/3492611472 >> 172.21.15.44:0/3492611472 conn(0x7f06340d2cb0 msgr2=0x7f06340d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:31.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f0638b89700 1 -- 172.21.15.44:0/3492611472 shutdown_connections 2024-09-13T18:27:31.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.107+0000 7f0638b89700 1 -- 172.21.15.44:0/3492611472 wait complete. 2024-09-13T18:27:31.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f0638b89700 1 Processor -- start 2024-09-13T18:27:31.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f0638b89700 1 -- start start 2024-09-13T18:27:31.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f0638b89700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f063406a520 0x7f0634152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:31.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f0638b89700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f063406b900 0x7f06340c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:31.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f0638b89700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f063415cda0 0x7f06340c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:31.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f0638b89700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06340c8280 con 0x7f063415cda0 2024-09-13T18:27:31.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f0638b89700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06340c78b0 con 0x7f063406a520 2024-09-13T18:27:31.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f0638b89700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06340c8ae0 con 0x7f063406b900 2024-09-13T18:27:31.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f0633fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f063415cda0 0x7f06340c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:31.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f0633fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f063415cda0 0x7f06340c9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57984/0 (socket says 172.21.15.44:57984) 2024-09-13T18:27:31.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f0633fff700 1 -- 172.21.15.44:0/624854887 learned_addr learned my addr 172.21.15.44:0/624854887 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:31.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f06337fe700 1 --2- 172.21.15.44:0/624854887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f063406a520 0x7f0634152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:31.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f0632ffd700 1 --2- 172.21.15.44:0/624854887 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f063406b900 0x7f06340c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:31.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f0633fff700 1 -- 172.21.15.44:0/624854887 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f063406b900 msgr2=0x7f06340c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:31.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f0633fff700 1 --2- 172.21.15.44:0/624854887 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f063406b900 0x7f06340c7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f0633fff700 1 -- 172.21.15.44:0/624854887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f063406a520 msgr2=0x7f0634152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:31.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f0633fff700 1 --2- 172.21.15.44:0/624854887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f063406a520 0x7f0634152690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f0633fff700 1 -- 172.21.15.44:0/624854887 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c009a70 con 0x7f063415cda0 2024-09-13T18:27:31.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f0633fff700 1 --2- 172.21.15.44:0/624854887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f063415cda0 0x7f06340c9470 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f062c00b370 tx=0x7f062c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:31.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f062bfff700 1 -- 172.21.15.44:0/624854887 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c012430 con 0x7f063415cda0 2024-09-13T18:27:31.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f062bfff700 1 -- 172.21.15.44:0/624854887 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c020070 con 0x7f063415cda0 2024-09-13T18:27:31.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f0638b89700 1 -- 172.21.15.44:0/624854887 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06340c8dc0 con 0x7f063415cda0 2024-09-13T18:27:31.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f062bfff700 1 -- 172.21.15.44:0/624854887 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c009430 con 0x7f063415cda0 2024-09-13T18:27:31.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.111+0000 7f0638b89700 1 -- 172.21.15.44:0/624854887 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06340c7260 con 0x7f063415cda0 2024-09-13T18:27:31.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.115+0000 7f0638b89700 1 -- 172.21.15.44:0/624854887 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063406a930 con 0x7f063415cda0 2024-09-13T18:27:31.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.115+0000 7f062bfff700 1 -- 172.21.15.44:0/624854887 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f062c004040 con 0x7f063415cda0 2024-09-13T18:27:31.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.115+0000 7f062bfff700 1 --2- 172.21.15.44:0/624854887 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0614066730 0x7f0614068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:31.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.115+0000 7f062bfff700 1 -- 172.21.15.44:0/624854887 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f062c022070 con 0x7f063415cda0 2024-09-13T18:27:31.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.115+0000 7f06337fe700 1 --2- 172.21.15.44:0/624854887 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0614066730 0x7f0614068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:31.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.115+0000 7f06337fe700 1 --2- 172.21.15.44:0/624854887 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0614066730 0x7f0614068bf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0624000f60 tx=0x7f0624007f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:31.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.123+0000 7f062bfff700 1 -- 172.21.15.44:0/624854887 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f062c053390 con 0x7f063415cda0 2024-09-13T18:27:31.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.287+0000 7f0638b89700 1 -- 172.21.15.44:0/624854887 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f06340c79f0 con 0x7f063415cda0 2024-09-13T18:27:31.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.291+0000 7f062bfff700 1 -- 172.21.15.44:0/624854887 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f062c0569b0 con 0x7f063415cda0 2024-09-13T18:27:31.294 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:27:31.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.291+0000 7f0638b89700 1 -- 172.21.15.44:0/624854887 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0614066730 msgr2=0x7f0614068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:31.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.291+0000 7f0638b89700 1 --2- 172.21.15.44:0/624854887 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0614066730 0x7f0614068bf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0624000f60 tx=0x7f0624007f30 comp rx=0 tx=0).stop 2024-09-13T18:27:31.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.291+0000 7f0638b89700 1 -- 172.21.15.44:0/624854887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f063415cda0 msgr2=0x7f06340c9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:31.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.291+0000 7f0638b89700 1 --2- 172.21.15.44:0/624854887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f063415cda0 0x7f06340c9470 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f062c00b370 tx=0x7f062c004af0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.291+0000 7f0638b89700 1 -- 172.21.15.44:0/624854887 shutdown_connections 2024-09-13T18:27:31.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.291+0000 7f0638b89700 1 --2- 172.21.15.44:0/624854887 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0614066730 0x7f0614068bf0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.291+0000 7f0638b89700 1 --2- 172.21.15.44:0/624854887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f063415cda0 0x7f06340c9470 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.291+0000 7f0638b89700 1 --2- 172.21.15.44:0/624854887 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f063406b900 0x7f06340c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.291+0000 7f0638b89700 1 --2- 172.21.15.44:0/624854887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f063406a520 0x7f0634152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.291+0000 7f0638b89700 1 -- 172.21.15.44:0/624854887 >> 172.21.15.44:0/624854887 conn(0x7f06340d2cb0 msgr2=0x7f06340d1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:31.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.291+0000 7f0638b89700 1 -- 172.21.15.44:0/624854887 shutdown_connections 2024-09-13T18:27:31.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.291+0000 7f0638b89700 1 -- 172.21.15.44:0/624854887 wait complete. 2024-09-13T18:27:31.313 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:27:31.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.427+0000 7f0d691c2700 1 Processor -- start 2024-09-13T18:27:31.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.427+0000 7f0d691c2700 1 -- start start 2024-09-13T18:27:31.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.427+0000 7f0d691c2700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0d641465c0 0x7f0d64146a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:31.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.427+0000 7f0d691c2700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d64144330 con 0x7f0d64144600 2024-09-13T18:27:31.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.427+0000 7f0d691c2700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d640b3680 con 0x7f0d641461e0 2024-09-13T18:27:31.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.427+0000 7f0d691c2700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d640b4720 con 0x7f0d641465c0 2024-09-13T18:27:31.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.427+0000 7f0d6359e700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0d64144600 0x7f0d64144ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:35794/0 (socket says 172.21.15.44:35794) 2024-09-13T18:27:31.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.427+0000 7f0d6359e700 1 -- 172.21.15.44:0/207832354 learned_addr learned my addr 172.21.15.44:0/207832354 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:31.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.427+0000 7f0d6259c700 1 --2- 172.21.15.44:0/207832354 >> v2:172.21.15.99:3300/0 conn(0x7f0d641465c0 0x7f0d64146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:31.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.427+0000 7f0d61d9b700 1 -- 172.21.15.44:0/207832354 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 526620810 0 0) 0x7f0d64144330 con 0x7f0d64144600 2024-09-13T18:27:31.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.427+0000 7f0d61d9b700 1 -- 172.21.15.44:0/207832354 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d500035d0 con 0x7f0d64144600 2024-09-13T18:27:31.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.427+0000 7f0d6259c700 1 -- 172.21.15.44:0/207832354 >> v1:172.21.15.99:6789/0 conn(0x7f0d641461e0 legacy=0x7f0d640b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:31.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.427+0000 7f0d6259c700 1 -- 172.21.15.44:0/207832354 >> v1:172.21.15.44:6789/0 conn(0x7f0d64144600 legacy=0x7f0d64144ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:31.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.427+0000 7f0d6259c700 1 -- 172.21.15.44:0/207832354 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d640b3960 con 0x7f0d641465c0 2024-09-13T18:27:31.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.427+0000 7f0d6259c700 1 --2- 172.21.15.44:0/207832354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d641465c0 0x7f0d64146a30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009d90 tx=0x7f0d5400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfdc2b869fed7c04 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:31.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.427+0000 7f0d61d9b700 1 -- 172.21.15.44:0/207832354 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5400e070 con 0x7f0d641465c0 2024-09-13T18:27:31.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.427+0000 7f0d61d9b700 1 -- 172.21.15.44:0/207832354 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5400bb20 con 0x7f0d641465c0 2024-09-13T18:27:31.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.427+0000 7f0d61d9b700 1 -- 172.21.15.44:0/207832354 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d54012430 con 0x7f0d641465c0 2024-09-13T18:27:31.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.427+0000 7f0d691c2700 1 -- 172.21.15.44:0/207832354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d641465c0 msgr2=0x7f0d64146a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:31.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.427+0000 7f0d691c2700 1 --2- 172.21.15.44:0/207832354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d641465c0 0x7f0d64146a30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009d90 tx=0x7f0d5400b330 comp rx=0 tx=0).stop 2024-09-13T18:27:31.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.431+0000 7f0d691c2700 1 -- 172.21.15.44:0/207832354 shutdown_connections 2024-09-13T18:27:31.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.431+0000 7f0d691c2700 1 --2- 172.21.15.44:0/207832354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d641465c0 0x7f0d64146a30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.431+0000 7f0d691c2700 1 -- 172.21.15.44:0/207832354 >> 172.21.15.44:0/207832354 conn(0x7f0d640af620 msgr2=0x7f0d640afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:31.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.431+0000 7f0d691c2700 1 -- 172.21.15.44:0/207832354 shutdown_connections 2024-09-13T18:27:31.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.431+0000 7f0d691c2700 1 -- 172.21.15.44:0/207832354 wait complete. 2024-09-13T18:27:31.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.431+0000 7f0d691c2700 1 Processor -- start 2024-09-13T18:27:31.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.431+0000 7f0d691c2700 1 -- start start 2024-09-13T18:27:31.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.431+0000 7f0d691c2700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d64144600 0x7f0d640cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:31.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.431+0000 7f0d691c2700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0d641461e0 0x7f0d64070b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:31.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.431+0000 7f0d691c2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d641465c0 0x7f0d641eb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:31.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.431+0000 7f0d691c2700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640ce6a0 con 0x7f0d641465c0 2024-09-13T18:27:31.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.431+0000 7f0d691c2700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640cdc20 con 0x7f0d64144600 2024-09-13T18:27:31.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.431+0000 7f0d691c2700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640ccb80 con 0x7f0d641461e0 2024-09-13T18:27:31.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.431+0000 7f0d6359e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d641465c0 0x7f0d641eb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:31.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.431+0000 7f0d6359e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d641465c0 0x7f0d641eb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57994/0 (socket says 172.21.15.44:57994) 2024-09-13T18:27:31.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.431+0000 7f0d6259c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0d641461e0 0x7f0d64070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:31.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.431+0000 7f0d6359e700 1 -- 172.21.15.44:0/2160957612 learned_addr learned my addr 172.21.15.44:0/2160957612 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:31.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.431+0000 7f0d62d9d700 1 --2- 172.21.15.44:0/2160957612 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d64144600 0x7f0d640cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:31.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.435+0000 7f0d6359e700 1 -- 172.21.15.44:0/2160957612 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0d641461e0 msgr2=0x7f0d64070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:31.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.435+0000 7f0d6359e700 1 --2- 172.21.15.44:0/2160957612 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0d641461e0 0x7f0d64070b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.435+0000 7f0d6359e700 1 -- 172.21.15.44:0/2160957612 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d64144600 msgr2=0x7f0d640cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:31.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.435+0000 7f0d6359e700 1 --2- 172.21.15.44:0/2160957612 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d64144600 0x7f0d640cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.435+0000 7f0d6359e700 1 -- 172.21.15.44:0/2160957612 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d54009a70 con 0x7f0d641465c0 2024-09-13T18:27:31.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.435+0000 7f0d6359e700 1 --2- 172.21.15.44:0/2160957612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d641465c0 0x7f0d641eb170 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c00c4f0 tx=0x7f0d5c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:31.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.435+0000 7f0d5b7fe700 1 -- 172.21.15.44:0/2160957612 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c005d90 con 0x7f0d641465c0 2024-09-13T18:27:31.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.435+0000 7f0d5b7fe700 1 -- 172.21.15.44:0/2160957612 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5c0070d0 con 0x7f0d641465c0 2024-09-13T18:27:31.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.435+0000 7f0d691c2700 1 -- 172.21.15.44:0/2160957612 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d640cce60 con 0x7f0d641465c0 2024-09-13T18:27:31.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.435+0000 7f0d5b7fe700 1 -- 172.21.15.44:0/2160957612 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c007460 con 0x7f0d641465c0 2024-09-13T18:27:31.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.435+0000 7f0d691c2700 1 -- 172.21.15.44:0/2160957612 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d640cd420 con 0x7f0d641465c0 2024-09-13T18:27:31.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.435+0000 7f0d691c2700 1 -- 172.21.15.44:0/2160957612 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d640cb2c0 con 0x7f0d641465c0 2024-09-13T18:27:31.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.435+0000 7f0d5b7fe700 1 -- 172.21.15.44:0/2160957612 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0d5c0075c0 con 0x7f0d641465c0 2024-09-13T18:27:31.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.439+0000 7f0d5b7fe700 1 --2- 172.21.15.44:0/2160957612 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0d44066730 0x7f0d44068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:31.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.439+0000 7f0d5b7fe700 1 -- 172.21.15.44:0/2160957612 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d5c0835b0 con 0x7f0d641465c0 2024-09-13T18:27:31.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.439+0000 7f0d62d9d700 1 --2- 172.21.15.44:0/2160957612 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0d44066730 0x7f0d44068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:31.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.439+0000 7f0d62d9d700 1 --2- 172.21.15.44:0/2160957612 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0d44066730 0x7f0d44068bf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c000f60 tx=0x7f0d4c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:31.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.447+0000 7f0d5b7fe700 1 -- 172.21.15.44:0/2160957612 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0d5c050920 con 0x7f0d641465c0 2024-09-13T18:27:31.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.615+0000 7f0d691c2700 1 -- 172.21.15.44:0/2160957612 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0d64147430 con 0x7f0d641465c0 2024-09-13T18:27:31.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.615+0000 7f0d5b7fe700 1 -- 172.21.15.44:0/2160957612 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0d5c053f40 con 0x7f0d641465c0 2024-09-13T18:27:31.621 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:27:31.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.619+0000 7f0d691c2700 1 -- 172.21.15.44:0/2160957612 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0d44066730 msgr2=0x7f0d44068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:31.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.619+0000 7f0d691c2700 1 --2- 172.21.15.44:0/2160957612 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0d44066730 0x7f0d44068bf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c000f60 tx=0x7f0d4c009040 comp rx=0 tx=0).stop 2024-09-13T18:27:31.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.619+0000 7f0d691c2700 1 -- 172.21.15.44:0/2160957612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d641465c0 msgr2=0x7f0d641eb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:31.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.619+0000 7f0d691c2700 1 --2- 172.21.15.44:0/2160957612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d641465c0 0x7f0d641eb170 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c00c4f0 tx=0x7f0d5c00c800 comp rx=0 tx=0).stop 2024-09-13T18:27:31.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.619+0000 7f0d691c2700 1 -- 172.21.15.44:0/2160957612 shutdown_connections 2024-09-13T18:27:31.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.619+0000 7f0d691c2700 1 --2- 172.21.15.44:0/2160957612 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0d44066730 0x7f0d44068bf0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.619+0000 7f0d691c2700 1 --2- 172.21.15.44:0/2160957612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d641465c0 0x7f0d641eb170 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.619+0000 7f0d691c2700 1 --2- 172.21.15.44:0/2160957612 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0d641461e0 0x7f0d64070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.619+0000 7f0d691c2700 1 --2- 172.21.15.44:0/2160957612 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d64144600 0x7f0d640cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.619+0000 7f0d691c2700 1 -- 172.21.15.44:0/2160957612 >> 172.21.15.44:0/2160957612 conn(0x7f0d640af620 msgr2=0x7f0d64164a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:31.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.619+0000 7f0d691c2700 1 -- 172.21.15.44:0/2160957612 shutdown_connections 2024-09-13T18:27:31.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.619+0000 7f0d691c2700 1 -- 172.21.15.44:0/2160957612 wait complete. 2024-09-13T18:27:31.636 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:27:31.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.747+0000 7fcf84e44700 1 Processor -- start 2024-09-13T18:27:31.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.747+0000 7fcf84e44700 1 -- start start 2024-09-13T18:27:31.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.747+0000 7fcf84e44700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcf8006b900 0x7fcf800b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:31.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.747+0000 7fcf84e44700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcf8006a520 0x7fcf8006a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:31.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.747+0000 7fcf84e44700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf800b8430 con 0x7fcf8015cda0 2024-09-13T18:27:31.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.747+0000 7fcf84e44700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf8006ae70 con 0x7fcf8006a520 2024-09-13T18:27:31.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.747+0000 7fcf84e44700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf8006bd60 con 0x7fcf8006b900 2024-09-13T18:27:31.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.747+0000 7fcf7ffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcf8006a520 0x7fcf8006a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:31.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.747+0000 7fcf7f7fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fcf8015cda0 0x7fcf800ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:35810/0 (socket says 172.21.15.44:35810) 2024-09-13T18:27:31.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.747+0000 7fcf7f7fe700 1 -- 172.21.15.44:0/3002871370 learned_addr learned my addr 172.21.15.44:0/3002871370 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:31.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.747+0000 7fcf76ffd700 1 --2- 172.21.15.44:0/3002871370 >> v2:172.21.15.99:3300/0 conn(0x7fcf8006b900 0x7fcf800b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:31.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.747+0000 7fcf7ffff700 1 -- 172.21.15.44:0/3002871370 >> v2:172.21.15.99:3300/0 conn(0x7fcf8006b900 msgr2=0x7fcf800b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:31.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.747+0000 7fcf7ffff700 1 --2- 172.21.15.44:0/3002871370 >> v2:172.21.15.99:3300/0 conn(0x7fcf8006b900 0x7fcf800b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.747+0000 7fcf7ffff700 1 -- 172.21.15.44:0/3002871370 >> v1:172.21.15.44:6789/0 conn(0x7fcf8015cda0 legacy=0x7fcf800ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:31.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.747+0000 7fcf7ffff700 1 -- 172.21.15.44:0/3002871370 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf800cf350 con 0x7fcf8006a520 2024-09-13T18:27:31.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.747+0000 7fcf7ffff700 1 --2- 172.21.15.44:0/3002871370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf8006a520 0x7fcf8006a930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcf800cf280 tx=0x7fcf7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c5e0d6794324a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:31.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.747+0000 7fcf7effd700 1 -- 172.21.15.44:0/3002871370 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7800e070 con 0x7fcf8006a520 2024-09-13T18:27:31.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.747+0000 7fcf7effd700 1 -- 172.21.15.44:0/3002871370 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7800bbd0 con 0x7fcf8006a520 2024-09-13T18:27:31.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.747+0000 7fcf7effd700 1 -- 172.21.15.44:0/3002871370 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78012430 con 0x7fcf8006a520 2024-09-13T18:27:31.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf84e44700 1 -- 172.21.15.44:0/3002871370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf8006a520 msgr2=0x7fcf8006a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:31.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf84e44700 1 --2- 172.21.15.44:0/3002871370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf8006a520 0x7fcf8006a930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcf800cf280 tx=0x7fcf7800b330 comp rx=0 tx=0).stop 2024-09-13T18:27:31.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf84e44700 1 -- 172.21.15.44:0/3002871370 shutdown_connections 2024-09-13T18:27:31.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf84e44700 1 --2- 172.21.15.44:0/3002871370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf8006a520 0x7fcf8006a930 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf84e44700 1 --2- 172.21.15.44:0/3002871370 >> v2:172.21.15.99:3300/0 conn(0x7fcf8006b900 0x7fcf800b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf84e44700 1 -- 172.21.15.44:0/3002871370 >> 172.21.15.44:0/3002871370 conn(0x7fcf800d2cb0 msgr2=0x7fcf800d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:31.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf84e44700 1 -- 172.21.15.44:0/3002871370 shutdown_connections 2024-09-13T18:27:31.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf84e44700 1 -- 172.21.15.44:0/3002871370 wait complete. 2024-09-13T18:27:31.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf84e44700 1 Processor -- start 2024-09-13T18:27:31.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf84e44700 1 -- start start 2024-09-13T18:27:31.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf84e44700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf8006a520 0x7fcf800c7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:31.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf84e44700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf8006b900 0x7fcf80155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:31.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf84e44700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf8015cda0 0x7fcf80155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:31.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf84e44700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf800c6f10 con 0x7fcf8006b900 2024-09-13T18:27:31.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf84e44700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf801614a0 con 0x7fcf8006a520 2024-09-13T18:27:31.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf84e44700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf801568c0 con 0x7fcf8015cda0 2024-09-13T18:27:31.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf76ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf8006b900 0x7fcf80155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:31.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf76ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf8006b900 0x7fcf80155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58004/0 (socket says 172.21.15.44:58004) 2024-09-13T18:27:31.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf76ffd700 1 -- 172.21.15.44:0/1610298300 learned_addr learned my addr 172.21.15.44:0/1610298300 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:31.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf7ffff700 1 --2- 172.21.15.44:0/1610298300 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf8015cda0 0x7fcf80155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:31.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf7f7fe700 1 --2- 172.21.15.44:0/1610298300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf8006a520 0x7fcf800c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:31.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf76ffd700 1 -- 172.21.15.44:0/1610298300 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf8015cda0 msgr2=0x7fcf80155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:31.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf76ffd700 1 --2- 172.21.15.44:0/1610298300 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf8015cda0 0x7fcf80155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf76ffd700 1 -- 172.21.15.44:0/1610298300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf8006a520 msgr2=0x7fcf800c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:31.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf76ffd700 1 --2- 172.21.15.44:0/1610298300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf8006a520 0x7fcf800c7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf76ffd700 1 -- 172.21.15.44:0/1610298300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf78009a70 con 0x7fcf8006b900 2024-09-13T18:27:31.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf7f7fe700 1 --2- 172.21.15.44:0/1610298300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf8006a520 0x7fcf800c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:31.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf76ffd700 1 --2- 172.21.15.44:0/1610298300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf8006b900 0x7fcf80155100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800e760 tx=0x7fcf6800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:31.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.751+0000 7fcf7cff9700 1 -- 172.21.15.44:0/1610298300 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68013610 con 0x7fcf8006b900 2024-09-13T18:27:31.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.755+0000 7fcf7cff9700 1 -- 172.21.15.44:0/1610298300 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf68013770 con 0x7fcf8006b900 2024-09-13T18:27:31.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.755+0000 7fcf84e44700 1 -- 172.21.15.44:0/1610298300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf80156ba0 con 0x7fcf8006b900 2024-09-13T18:27:31.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.755+0000 7fcf7cff9700 1 -- 172.21.15.44:0/1610298300 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68013ae0 con 0x7fcf8006b900 2024-09-13T18:27:31.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.755+0000 7fcf84e44700 1 -- 172.21.15.44:0/1610298300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf800c6b30 con 0x7fcf8006b900 2024-09-13T18:27:31.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.755+0000 7fcf84e44700 1 -- 172.21.15.44:0/1610298300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf800c7050 con 0x7fcf8006b900 2024-09-13T18:27:31.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.755+0000 7fcf7cff9700 1 -- 172.21.15.44:0/1610298300 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcf68013c40 con 0x7fcf8006b900 2024-09-13T18:27:31.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.755+0000 7fcf7cff9700 1 --2- 172.21.15.44:0/1610298300 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcf60066730 0x7fcf60068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:31.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.759+0000 7fcf7cff9700 1 -- 172.21.15.44:0/1610298300 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf68083e50 con 0x7fcf8006b900 2024-09-13T18:27:31.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.759+0000 7fcf7f7fe700 1 --2- 172.21.15.44:0/1610298300 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcf60066730 0x7fcf60068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:31.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.759+0000 7fcf7f7fe700 1 --2- 172.21.15.44:0/1610298300 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcf60066730 0x7fcf60068bf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcf70007fd0 tx=0x7fcf70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:31.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.767+0000 7fcf7cff9700 1 -- 172.21.15.44:0/1610298300 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcf800c7050 con 0x7fcf8006b900 2024-09-13T18:27:31.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.931+0000 7fcf84e44700 1 -- 172.21.15.44:0/1610298300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcf800c7050 con 0x7fcf8006b900 2024-09-13T18:27:31.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.931+0000 7fcf7cff9700 1 -- 172.21.15.44:0/1610298300 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcf800c7050 con 0x7fcf8006b900 2024-09-13T18:27:31.936 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:27:31.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.935+0000 7fcf84e44700 1 -- 172.21.15.44:0/1610298300 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcf60066730 msgr2=0x7fcf60068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:31.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.935+0000 7fcf84e44700 1 --2- 172.21.15.44:0/1610298300 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcf60066730 0x7fcf60068bf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcf70007fd0 tx=0x7fcf70009040 comp rx=0 tx=0).stop 2024-09-13T18:27:31.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.935+0000 7fcf84e44700 1 -- 172.21.15.44:0/1610298300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf8006b900 msgr2=0x7fcf80155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:31.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.935+0000 7fcf84e44700 1 --2- 172.21.15.44:0/1610298300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf8006b900 0x7fcf80155100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800e760 tx=0x7fcf6800ea70 comp rx=0 tx=0).stop 2024-09-13T18:27:31.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.935+0000 7fcf84e44700 1 -- 172.21.15.44:0/1610298300 shutdown_connections 2024-09-13T18:27:31.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.935+0000 7fcf84e44700 1 --2- 172.21.15.44:0/1610298300 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcf60066730 0x7fcf60068bf0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.935+0000 7fcf84e44700 1 --2- 172.21.15.44:0/1610298300 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf8015cda0 0x7fcf80155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.935+0000 7fcf84e44700 1 --2- 172.21.15.44:0/1610298300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf8006b900 0x7fcf80155100 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.935+0000 7fcf84e44700 1 --2- 172.21.15.44:0/1610298300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf8006a520 0x7fcf800c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.935+0000 7fcf84e44700 1 -- 172.21.15.44:0/1610298300 >> 172.21.15.44:0/1610298300 conn(0x7fcf800d2cb0 msgr2=0x7fcf800b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:31.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.935+0000 7fcf84e44700 1 -- 172.21.15.44:0/1610298300 shutdown_connections 2024-09-13T18:27:31.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:31.935+0000 7fcf84e44700 1 -- 172.21.15.44:0/1610298300 wait complete. 2024-09-13T18:27:31.957 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:32.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f8badd700 1 Processor -- start 2024-09-13T18:27:32.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f8badd700 1 -- start start 2024-09-13T18:27:32.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f8badd700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1f8415ac40 0x7f1f8406ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:32.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f8badd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1f840ad710 0x7f1f840adba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:32.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f8badd700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8415b020 con 0x7f1f8415e730 2024-09-13T18:27:32.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f8badd700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f840b31e0 con 0x7f1f840ad710 2024-09-13T18:27:32.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f8badd700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f840ae0e0 con 0x7f1f8415ac40 2024-09-13T18:27:32.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f89078700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1f840ad710 0x7f1f840adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:32.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f89078700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1f840ad710 0x7f1f840adba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40380/0 (socket says 172.21.15.44:40380) 2024-09-13T18:27:32.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f89078700 1 -- 172.21.15.44:0/1589668531 learned_addr learned my addr 172.21.15.44:0/1589668531 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:32.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f89879700 1 --2- 172.21.15.44:0/1589668531 >> v2:172.21.15.99:3300/0 conn(0x7f1f8415ac40 0x7f1f8406ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:32.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f89078700 1 -- 172.21.15.44:0/1589668531 >> v2:172.21.15.99:3300/0 conn(0x7f1f8415ac40 msgr2=0x7f1f8406ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:32.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f89078700 1 --2- 172.21.15.44:0/1589668531 >> v2:172.21.15.99:3300/0 conn(0x7f1f8415ac40 0x7f1f8406ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f89078700 1 -- 172.21.15.44:0/1589668531 >> v1:172.21.15.99:6789/0 conn(0x7f1f8415e730 legacy=0x7f1f8415eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:32.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f89078700 1 -- 172.21.15.44:0/1589668531 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8406a6f0 con 0x7f1f840ad710 2024-09-13T18:27:32.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f89078700 1 --2- 172.21.15.44:0/1589668531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f840ad710 0x7f1f840adba0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1f84071fc0 tx=0x7f1f78009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d11e76a48987e00b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:32.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f88877700 1 -- 172.21.15.44:0/1589668531 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7800b8a0 con 0x7f1f840ad710 2024-09-13T18:27:32.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f88877700 1 -- 172.21.15.44:0/1589668531 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7800ba00 con 0x7f1f840ad710 2024-09-13T18:27:32.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f88877700 1 -- 172.21.15.44:0/1589668531 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7800bd90 con 0x7f1f840ad710 2024-09-13T18:27:32.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f8badd700 1 -- 172.21.15.44:0/1589668531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f840ad710 msgr2=0x7f1f840adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:32.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f8badd700 1 --2- 172.21.15.44:0/1589668531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f840ad710 0x7f1f840adba0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1f84071fc0 tx=0x7f1f78009bf0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f8badd700 1 -- 172.21.15.44:0/1589668531 shutdown_connections 2024-09-13T18:27:32.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f8badd700 1 --2- 172.21.15.44:0/1589668531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f840ad710 0x7f1f840adba0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f8badd700 1 --2- 172.21.15.44:0/1589668531 >> v2:172.21.15.99:3300/0 conn(0x7f1f8415ac40 0x7f1f8406ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f8badd700 1 -- 172.21.15.44:0/1589668531 >> 172.21.15.44:0/1589668531 conn(0x7f1f840ce980 msgr2=0x7f1f840ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:32.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f8badd700 1 -- 172.21.15.44:0/1589668531 shutdown_connections 2024-09-13T18:27:32.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.067+0000 7f1f8badd700 1 -- 172.21.15.44:0/1589668531 wait complete. 2024-09-13T18:27:32.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.071+0000 7f1f8badd700 1 Processor -- start 2024-09-13T18:27:32.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.071+0000 7f1f8badd700 1 -- start start 2024-09-13T18:27:32.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.071+0000 7f1f8badd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f840ad710 0x7f1f841f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:32.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.071+0000 7f1f8badd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f8415ac40 0x7f1f8414d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:32.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.071+0000 7f1f8badd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f8415e730 0x7f1f841f06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:32.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.071+0000 7f1f8badd700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f841f1690 con 0x7f1f840ad710 2024-09-13T18:27:32.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.071+0000 7f1f8badd700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f841f4b50 con 0x7f1f8415e730 2024-09-13T18:27:32.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.071+0000 7f1f8badd700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f841f10d0 con 0x7f1f8415ac40 2024-09-13T18:27:32.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.071+0000 7f1f89879700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f840ad710 0x7f1f841f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:32.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.071+0000 7f1f89879700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f840ad710 0x7f1f841f4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40396/0 (socket says 172.21.15.44:40396) 2024-09-13T18:27:32.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.071+0000 7f1f89879700 1 -- 172.21.15.44:0/1656855698 learned_addr learned my addr 172.21.15.44:0/1656855698 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:32.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.071+0000 7f1f89078700 1 --2- 172.21.15.44:0/1656855698 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f8415ac40 0x7f1f8414d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:32.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.071+0000 7f1f8a07a700 1 --2- 172.21.15.44:0/1656855698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f8415e730 0x7f1f841f06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:32.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.071+0000 7f1f89879700 1 -- 172.21.15.44:0/1656855698 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f8415ac40 msgr2=0x7f1f8414d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:32.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.071+0000 7f1f89879700 1 --2- 172.21.15.44:0/1656855698 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f8415ac40 0x7f1f8414d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.071+0000 7f1f89879700 1 -- 172.21.15.44:0/1656855698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f8415e730 msgr2=0x7f1f841f06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:32.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.071+0000 7f1f89879700 1 --2- 172.21.15.44:0/1656855698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f8415e730 0x7f1f841f06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.071+0000 7f1f89879700 1 -- 172.21.15.44:0/1656855698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f78009570 con 0x7f1f840ad710 2024-09-13T18:27:32.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.071+0000 7f1f89879700 1 --2- 172.21.15.44:0/1656855698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f840ad710 0x7f1f841f4610 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000d800 tx=0x7f1f8000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:32.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.071+0000 7f1f767fc700 1 -- 172.21.15.44:0/1656855698 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f800125f0 con 0x7f1f840ad710 2024-09-13T18:27:32.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.071+0000 7f1f767fc700 1 -- 172.21.15.44:0/1656855698 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f80012750 con 0x7f1f840ad710 2024-09-13T18:27:32.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.075+0000 7f1f8badd700 1 -- 172.21.15.44:0/1656855698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f841f13b0 con 0x7f1f840ad710 2024-09-13T18:27:32.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.075+0000 7f1f767fc700 1 -- 172.21.15.44:0/1656855698 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f80012b00 con 0x7f1f840ad710 2024-09-13T18:27:32.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.075+0000 7f1f8badd700 1 -- 172.21.15.44:0/1656855698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f841f40f0 con 0x7f1f840ad710 2024-09-13T18:27:32.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.075+0000 7f1f8badd700 1 -- 172.21.15.44:0/1656855698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f8406d950 con 0x7f1f840ad710 2024-09-13T18:27:32.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.075+0000 7f1f767fc700 1 -- 172.21.15.44:0/1656855698 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1f80012c60 con 0x7f1f840ad710 2024-09-13T18:27:32.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.075+0000 7f1f767fc700 1 --2- 172.21.15.44:0/1656855698 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1f68066730 0x7f1f68068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:32.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.075+0000 7f1f767fc700 1 -- 172.21.15.44:0/1656855698 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f800841e0 con 0x7f1f840ad710 2024-09-13T18:27:32.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.075+0000 7f1f89078700 1 --2- 172.21.15.44:0/1656855698 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1f68066730 0x7f1f68068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:32.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.079+0000 7f1f89078700 1 --2- 172.21.15.44:0/1656855698 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1f68066730 0x7f1f68068bf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1f78000c00 tx=0x7f1f78008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:32.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.083+0000 7f1f767fc700 1 -- 172.21.15.44:0/1656855698 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1f800515e0 con 0x7f1f840ad710 2024-09-13T18:27:32.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.259+0000 7f1f8badd700 1 -- 172.21.15.44:0/1656855698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f840cef70 con 0x7f1f840ad710 2024-09-13T18:27:32.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.263+0000 7f1f767fc700 1 -- 172.21.15.44:0/1656855698 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f1f80054c00 con 0x7f1f840ad710 2024-09-13T18:27:32.268 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:32.268 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:02.280221+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:32.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.263+0000 7f1f8badd700 1 -- 172.21.15.44:0/1656855698 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1f68066730 msgr2=0x7f1f68068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:32.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.263+0000 7f1f8badd700 1 --2- 172.21.15.44:0/1656855698 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1f68066730 0x7f1f68068bf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1f78000c00 tx=0x7f1f78008030 comp rx=0 tx=0).stop 2024-09-13T18:27:32.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.263+0000 7f1f8badd700 1 -- 172.21.15.44:0/1656855698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f840ad710 msgr2=0x7f1f841f4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:32.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.263+0000 7f1f8badd700 1 --2- 172.21.15.44:0/1656855698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f840ad710 0x7f1f841f4610 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000d800 tx=0x7f1f8000db10 comp rx=0 tx=0).stop 2024-09-13T18:27:32.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.263+0000 7f1f8badd700 1 -- 172.21.15.44:0/1656855698 shutdown_connections 2024-09-13T18:27:32.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.263+0000 7f1f8badd700 1 --2- 172.21.15.44:0/1656855698 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1f68066730 0x7f1f68068bf0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.263+0000 7f1f8badd700 1 --2- 172.21.15.44:0/1656855698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f8415e730 0x7f1f841f06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.263+0000 7f1f8badd700 1 --2- 172.21.15.44:0/1656855698 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f8415ac40 0x7f1f8414d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.263+0000 7f1f8badd700 1 --2- 172.21.15.44:0/1656855698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f840ad710 0x7f1f841f4610 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.263+0000 7f1f8badd700 1 -- 172.21.15.44:0/1656855698 >> 172.21.15.44:0/1656855698 conn(0x7f1f840ce980 msgr2=0x7f1f84159920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:32.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.263+0000 7f1f8badd700 1 -- 172.21.15.44:0/1656855698 shutdown_connections 2024-09-13T18:27:32.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.263+0000 7f1f8badd700 1 -- 172.21.15.44:0/1656855698 wait complete. 2024-09-13T18:27:32.282 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:26:59.478511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:27:00.261038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:27:32.283 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:27:32.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.403+0000 7f9498247700 1 Processor -- start 2024-09-13T18:27:32.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.403+0000 7f9498247700 1 -- start start 2024-09-13T18:27:32.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.403+0000 7f9498247700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f949015cda0 0x7f94900d1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:32.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.403+0000 7f9498247700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f94900b5e00 0x7f94900b6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:32.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.403+0000 7f9498247700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94900b6780 0x7f949006a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:32.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.403+0000 7f9498247700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94900cde50 con 0x7f949015cda0 2024-09-13T18:27:32.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.403+0000 7f9498247700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94900d0880 con 0x7f94900b5e00 2024-09-13T18:27:32.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.403+0000 7f9498247700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94900d16e0 con 0x7f94900b6780 2024-09-13T18:27:32.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.403+0000 7f9495fe3700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f949015cda0 0x7f94900d1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:32.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.403+0000 7f9495fe3700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f949015cda0 0x7f94900d1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40404/0 (socket says 172.21.15.44:40404) 2024-09-13T18:27:32.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.403+0000 7f9495fe3700 1 -- 172.21.15.44:0/3958560132 learned_addr learned my addr 172.21.15.44:0/3958560132 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:32.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.403+0000 7f94967e4700 1 --2- 172.21.15.44:0/3958560132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94900b6780 0x7f949006a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:32.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.403+0000 7f94957e2700 1 --2- 172.21.15.44:0/3958560132 >> v2:172.21.15.99:3300/0 conn(0x7f94900b5e00 0x7f94900b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:32.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.403+0000 7f94967e4700 1 -- 172.21.15.44:0/3958560132 >> v2:172.21.15.99:3300/0 conn(0x7f94900b5e00 msgr2=0x7f94900b6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:32.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.403+0000 7f94967e4700 1 --2- 172.21.15.44:0/3958560132 >> v2:172.21.15.99:3300/0 conn(0x7f94900b5e00 0x7f94900b6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.403+0000 7f94967e4700 1 -- 172.21.15.44:0/3958560132 >> v2:172.21.15.44:3300/0 conn(0x7f949015cda0 msgr2=0x7f94900d1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:32.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.403+0000 7f94967e4700 1 --2- 172.21.15.44:0/3958560132 >> v2:172.21.15.44:3300/0 conn(0x7f949015cda0 0x7f94900d1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.403+0000 7f94967e4700 1 -- 172.21.15.44:0/3958560132 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94900d0ad0 con 0x7f94900b6780 2024-09-13T18:27:32.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.407+0000 7f94967e4700 1 --2- 172.21.15.44:0/3958560132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94900b6780 0x7f949006a5b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f949006c470 tx=0x7f948800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d87c9420540a88 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:32.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.407+0000 7f9494fe1700 1 -- 172.21.15.44:0/3958560132 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948800e070 con 0x7f94900b6780 2024-09-13T18:27:32.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.407+0000 7f9494fe1700 1 -- 172.21.15.44:0/3958560132 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948800bb20 con 0x7f94900b6780 2024-09-13T18:27:32.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.407+0000 7f9494fe1700 1 -- 172.21.15.44:0/3958560132 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9488012430 con 0x7f94900b6780 2024-09-13T18:27:32.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.407+0000 7f9498247700 1 -- 172.21.15.44:0/3958560132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94900b6780 msgr2=0x7f949006a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:32.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.407+0000 7f9498247700 1 --2- 172.21.15.44:0/3958560132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94900b6780 0x7f949006a5b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f949006c470 tx=0x7f948800b330 comp rx=0 tx=0).stop 2024-09-13T18:27:32.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.407+0000 7f9498247700 1 -- 172.21.15.44:0/3958560132 shutdown_connections 2024-09-13T18:27:32.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.407+0000 7f9498247700 1 --2- 172.21.15.44:0/3958560132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94900b6780 0x7f949006a5b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.407+0000 7f9498247700 1 --2- 172.21.15.44:0/3958560132 >> v2:172.21.15.99:3300/0 conn(0x7f94900b5e00 0x7f94900b6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.407+0000 7f9498247700 1 --2- 172.21.15.44:0/3958560132 >> v2:172.21.15.44:3300/0 conn(0x7f949015cda0 0x7f94900d1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.407+0000 7f9498247700 1 -- 172.21.15.44:0/3958560132 >> 172.21.15.44:0/3958560132 conn(0x7f94900d2cb0 msgr2=0x7f94900d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:32.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.407+0000 7f9498247700 1 -- 172.21.15.44:0/3958560132 shutdown_connections 2024-09-13T18:27:32.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.407+0000 7f9498247700 1 -- 172.21.15.44:0/3958560132 wait complete. 2024-09-13T18:27:32.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.407+0000 7f9498247700 1 Processor -- start 2024-09-13T18:27:32.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.407+0000 7f9498247700 1 -- start start 2024-09-13T18:27:32.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.411+0000 7f9498247700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94900b5e00 0x7f9490152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:32.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.411+0000 7f9498247700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94900b6780 0x7f94900cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:32.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.411+0000 7f9498247700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f949015cda0 0x7f9490156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:32.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.411+0000 7f9498247700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94901591c0 con 0x7f94900b6780 2024-09-13T18:27:32.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.411+0000 7f9498247700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94900c9e20 con 0x7f949015cda0 2024-09-13T18:27:32.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.411+0000 7f9498247700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94900ca100 con 0x7f94900b5e00 2024-09-13T18:27:32.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.411+0000 7f94957e2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94900b6780 0x7f94900cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:32.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.411+0000 7f94957e2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94900b6780 0x7f94900cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40406/0 (socket says 172.21.15.44:40406) 2024-09-13T18:27:32.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.411+0000 7f94957e2700 1 -- 172.21.15.44:0/2270513452 learned_addr learned my addr 172.21.15.44:0/2270513452 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:32.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.411+0000 7f94967e4700 1 --2- 172.21.15.44:0/2270513452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f949015cda0 0x7f9490156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:32.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.411+0000 7f9495fe3700 1 --2- 172.21.15.44:0/2270513452 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94900b5e00 0x7f9490152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:32.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.411+0000 7f94967e4700 1 -- 172.21.15.44:0/2270513452 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94900b5e00 msgr2=0x7f9490152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:32.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.411+0000 7f94967e4700 1 --2- 172.21.15.44:0/2270513452 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94900b5e00 0x7f9490152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.411+0000 7f94967e4700 1 -- 172.21.15.44:0/2270513452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94900b6780 msgr2=0x7f94900cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:32.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.411+0000 7f94967e4700 1 --2- 172.21.15.44:0/2270513452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94900b6780 0x7f94900cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.411+0000 7f94967e4700 1 -- 172.21.15.44:0/2270513452 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9488009a70 con 0x7f949015cda0 2024-09-13T18:27:32.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.411+0000 7f94957e2700 1 --2- 172.21.15.44:0/2270513452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94900b6780 0x7f94900cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:32.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.411+0000 7f94967e4700 1 --2- 172.21.15.44:0/2270513452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f949015cda0 0x7f9490156b30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9488016000 tx=0x7f9488004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:32.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.411+0000 7f94827fc700 1 -- 172.21.15.44:0/2270513452 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9488012430 con 0x7f949015cda0 2024-09-13T18:27:32.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.411+0000 7f9498247700 1 -- 172.21.15.44:0/2270513452 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94900ca3e0 con 0x7f949015cda0 2024-09-13T18:27:32.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.411+0000 7f94827fc700 1 -- 172.21.15.44:0/2270513452 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9488020070 con 0x7f949015cda0 2024-09-13T18:27:32.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.411+0000 7f94827fc700 1 -- 172.21.15.44:0/2270513452 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9488004280 con 0x7f949015cda0 2024-09-13T18:27:32.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.411+0000 7f9498247700 1 -- 172.21.15.44:0/2270513452 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94901594a0 con 0x7f949015cda0 2024-09-13T18:27:32.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.415+0000 7f9498247700 1 -- 172.21.15.44:0/2270513452 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94900b6240 con 0x7f949015cda0 2024-09-13T18:27:32.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.415+0000 7f94827fc700 1 -- 172.21.15.44:0/2270513452 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f94880043e0 con 0x7f949015cda0 2024-09-13T18:27:32.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.415+0000 7f94827fc700 1 --2- 172.21.15.44:0/2270513452 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9474066730 0x7f9474068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:32.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.415+0000 7f94827fc700 1 -- 172.21.15.44:0/2270513452 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9488022070 con 0x7f949015cda0 2024-09-13T18:27:32.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.415+0000 7f9495fe3700 1 --2- 172.21.15.44:0/2270513452 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9474066730 0x7f9474068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:32.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.415+0000 7f9495fe3700 1 --2- 172.21.15.44:0/2270513452 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9474066730 0x7f9474068bf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f948c006d70 tx=0x7f948c0092e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:32.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.427+0000 7f94827fc700 1 -- 172.21.15.44:0/2270513452 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f94880536c0 con 0x7f949015cda0 2024-09-13T18:27:32.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.599+0000 7f9498247700 1 -- 172.21.15.44:0/2270513452 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f94900ca570 con 0x7f949015cda0 2024-09-13T18:27:32.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.599+0000 7f94827fc700 1 -- 172.21.15.44:0/2270513452 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f948802c020 con 0x7f949015cda0 2024-09-13T18:27:32.604 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:27:32.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.603+0000 7f9498247700 1 -- 172.21.15.44:0/2270513452 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9474066730 msgr2=0x7f9474068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:32.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.603+0000 7f9498247700 1 --2- 172.21.15.44:0/2270513452 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9474066730 0x7f9474068bf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f948c006d70 tx=0x7f948c0092e0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.603+0000 7f9498247700 1 -- 172.21.15.44:0/2270513452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f949015cda0 msgr2=0x7f9490156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:32.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.603+0000 7f9498247700 1 --2- 172.21.15.44:0/2270513452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f949015cda0 0x7f9490156b30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9488016000 tx=0x7f9488004af0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.603+0000 7f9498247700 1 -- 172.21.15.44:0/2270513452 shutdown_connections 2024-09-13T18:27:32.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.603+0000 7f9498247700 1 --2- 172.21.15.44:0/2270513452 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9474066730 0x7f9474068bf0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.603+0000 7f9498247700 1 --2- 172.21.15.44:0/2270513452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f949015cda0 0x7f9490156b30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.603+0000 7f9498247700 1 --2- 172.21.15.44:0/2270513452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94900b6780 0x7f94900cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.603+0000 7f9498247700 1 --2- 172.21.15.44:0/2270513452 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94900b5e00 0x7f9490152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.603+0000 7f9498247700 1 -- 172.21.15.44:0/2270513452 >> 172.21.15.44:0/2270513452 conn(0x7f94900d2cb0 msgr2=0x7f94900ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:32.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.603+0000 7f9498247700 1 -- 172.21.15.44:0/2270513452 shutdown_connections 2024-09-13T18:27:32.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.603+0000 7f9498247700 1 -- 172.21.15.44:0/2270513452 wait complete. 2024-09-13T18:27:32.624 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:27:32.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.739+0000 7f31be7a3700 1 Processor -- start 2024-09-13T18:27:32.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.739+0000 7f31be7a3700 1 -- start start 2024-09-13T18:27:32.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.739+0000 7f31be7a3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f31b815cda0 0x7f31b806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:32.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.739+0000 7f31be7a3700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f31b80ceb70 0x7f31b80b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:32.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.739+0000 7f31be7a3700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f31b806a520 0x7f31b806a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:32.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.739+0000 7f31be7a3700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b806be40 con 0x7f31b80ceb70 2024-09-13T18:27:32.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.739+0000 7f31be7a3700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b806aeb0 con 0x7f31b806a520 2024-09-13T18:27:32.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.739+0000 7f31be7a3700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b80b8430 con 0x7f31b815cda0 2024-09-13T18:27:32.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.739+0000 7f31bcfa0700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f31b80ceb70 0x7f31b80b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:32.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.739+0000 7f31bcfa0700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f31b80ceb70 0x7f31b80b5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40418/0 (socket says 172.21.15.44:40418) 2024-09-13T18:27:32.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.739+0000 7f31bcfa0700 1 -- 172.21.15.44:0/1946659978 learned_addr learned my addr 172.21.15.44:0/1946659978 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:32.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.739+0000 7f31bdfa2700 1 --2- 172.21.15.44:0/1946659978 >> v2:172.21.15.99:3300/0 conn(0x7f31b806a520 0x7f31b806a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:32.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.739+0000 7f31bd7a1700 1 --2- 172.21.15.44:0/1946659978 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f31b815cda0 0x7f31b806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:32.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.739+0000 7f31bcfa0700 1 -- 172.21.15.44:0/1946659978 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f31b815cda0 msgr2=0x7f31b806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:32.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.739+0000 7f31bcfa0700 1 --2- 172.21.15.44:0/1946659978 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f31b815cda0 0x7f31b806b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.739+0000 7f31bcfa0700 1 -- 172.21.15.44:0/1946659978 >> v2:172.21.15.99:3300/0 conn(0x7f31b806a520 msgr2=0x7f31b806a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:32.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.739+0000 7f31bcfa0700 1 --2- 172.21.15.44:0/1946659978 >> v2:172.21.15.99:3300/0 conn(0x7f31b806a520 0x7f31b806a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.739+0000 7f31bcfa0700 1 -- 172.21.15.44:0/1946659978 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b80cf350 con 0x7f31b80ceb70 2024-09-13T18:27:32.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.739+0000 7f31bcfa0700 1 --2- 172.21.15.44:0/1946659978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31b80ceb70 0x7f31b80b5de0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f31b81617d0 tx=0x7f31b4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ea6e320e281791 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:32.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.743+0000 7f31affff700 1 -- 172.21.15.44:0/1946659978 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4011830 con 0x7f31b80ceb70 2024-09-13T18:27:32.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.743+0000 7f31affff700 1 -- 172.21.15.44:0/1946659978 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b4011990 con 0x7f31b80ceb70 2024-09-13T18:27:32.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.743+0000 7f31affff700 1 -- 172.21.15.44:0/1946659978 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4011d20 con 0x7f31b80ceb70 2024-09-13T18:27:32.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.743+0000 7f31be7a3700 1 -- 172.21.15.44:0/1946659978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31b80ceb70 msgr2=0x7f31b80b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:32.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.743+0000 7f31be7a3700 1 --2- 172.21.15.44:0/1946659978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31b80ceb70 0x7f31b80b5de0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f31b81617d0 tx=0x7f31b4009bf0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.743+0000 7f31be7a3700 1 -- 172.21.15.44:0/1946659978 shutdown_connections 2024-09-13T18:27:32.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.743+0000 7f31be7a3700 1 --2- 172.21.15.44:0/1946659978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31b80ceb70 0x7f31b80b5de0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.743+0000 7f31be7a3700 1 --2- 172.21.15.44:0/1946659978 >> v2:172.21.15.99:3300/0 conn(0x7f31b806a520 0x7f31b806a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.743+0000 7f31be7a3700 1 --2- 172.21.15.44:0/1946659978 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f31b815cda0 0x7f31b806b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.743+0000 7f31be7a3700 1 -- 172.21.15.44:0/1946659978 >> 172.21.15.44:0/1946659978 conn(0x7f31b80d2cb0 msgr2=0x7f31b80d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:32.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.743+0000 7f31be7a3700 1 -- 172.21.15.44:0/1946659978 shutdown_connections 2024-09-13T18:27:32.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.743+0000 7f31be7a3700 1 -- 172.21.15.44:0/1946659978 wait complete. 2024-09-13T18:27:32.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.747+0000 7f31be7a3700 1 Processor -- start 2024-09-13T18:27:32.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.747+0000 7f31be7a3700 1 -- start start 2024-09-13T18:27:32.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.747+0000 7f31be7a3700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31b806a520 0x7f31b814fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:32.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.747+0000 7f31be7a3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31b80ceb70 0x7f31b80c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:32.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.747+0000 7f31be7a3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f31b815cda0 0x7f31b80cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:32.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.747+0000 7f31be7a3700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b815e650 con 0x7f31b80ceb70 2024-09-13T18:27:32.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.747+0000 7f31be7a3700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b815d5b0 con 0x7f31b806a520 2024-09-13T18:27:32.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.747+0000 7f31be7a3700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b815d890 con 0x7f31b815cda0 2024-09-13T18:27:32.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.747+0000 7f31bcfa0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31b80ceb70 0x7f31b80c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:32.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.747+0000 7f31bcfa0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31b80ceb70 0x7f31b80c9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40428/0 (socket says 172.21.15.44:40428) 2024-09-13T18:27:32.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.747+0000 7f31bcfa0700 1 -- 172.21.15.44:0/1276377602 learned_addr learned my addr 172.21.15.44:0/1276377602 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:32.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.747+0000 7f31bdfa2700 1 --2- 172.21.15.44:0/1276377602 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f31b815cda0 0x7f31b80cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:32.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.747+0000 7f31bd7a1700 1 --2- 172.21.15.44:0/1276377602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31b806a520 0x7f31b814fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:32.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.747+0000 7f31bcfa0700 1 -- 172.21.15.44:0/1276377602 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f31b815cda0 msgr2=0x7f31b80cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:32.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.747+0000 7f31bcfa0700 1 --2- 172.21.15.44:0/1276377602 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f31b815cda0 0x7f31b80cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.747+0000 7f31bcfa0700 1 -- 172.21.15.44:0/1276377602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31b806a520 msgr2=0x7f31b814fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:32.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.747+0000 7f31bcfa0700 1 --2- 172.21.15.44:0/1276377602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31b806a520 0x7f31b814fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.747+0000 7f31bcfa0700 1 -- 172.21.15.44:0/1276377602 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b4009570 con 0x7f31b80ceb70 2024-09-13T18:27:32.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.747+0000 7f31bcfa0700 1 --2- 172.21.15.44:0/1276377602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31b80ceb70 0x7f31b80c9260 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f31b4000c00 tx=0x7f31b4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:32.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.747+0000 7f31adffb700 1 -- 172.21.15.44:0/1276377602 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4004450 con 0x7f31b80ceb70 2024-09-13T18:27:32.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.751+0000 7f31adffb700 1 -- 172.21.15.44:0/1276377602 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b40045b0 con 0x7f31b80ceb70 2024-09-13T18:27:32.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.751+0000 7f31be7a3700 1 -- 172.21.15.44:0/1276377602 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b815db70 con 0x7f31b80ceb70 2024-09-13T18:27:32.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.751+0000 7f31adffb700 1 -- 172.21.15.44:0/1276377602 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b40038e0 con 0x7f31b80ceb70 2024-09-13T18:27:32.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.751+0000 7f31be7a3700 1 -- 172.21.15.44:0/1276377602 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b815e130 con 0x7f31b80ceb70 2024-09-13T18:27:32.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.751+0000 7f31be7a3700 1 -- 172.21.15.44:0/1276377602 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b80b8cc0 con 0x7f31b80ceb70 2024-09-13T18:27:32.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.751+0000 7f31adffb700 1 -- 172.21.15.44:0/1276377602 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f31b4021070 con 0x7f31b80ceb70 2024-09-13T18:27:32.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.751+0000 7f31adffb700 1 --2- 172.21.15.44:0/1276377602 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f319c066730 0x7f319c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:32.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.751+0000 7f31adffb700 1 -- 172.21.15.44:0/1276377602 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31b40854e0 con 0x7f31b80ceb70 2024-09-13T18:27:32.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.751+0000 7f31bd7a1700 1 --2- 172.21.15.44:0/1276377602 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f319c066730 0x7f319c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:32.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.755+0000 7f31bd7a1700 1 --2- 172.21.15.44:0/1276377602 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f319c066730 0x7f319c068bf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f31a8009ad0 tx=0x7f31a8009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:32.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.759+0000 7f31adffb700 1 -- 172.21.15.44:0/1276377602 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f31b40528e0 con 0x7f31b80ceb70 2024-09-13T18:27:32.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.931+0000 7f31be7a3700 1 -- 172.21.15.44:0/1276377602 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f31b80cefd0 con 0x7f31b80ceb70 2024-09-13T18:27:32.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.935+0000 7f31adffb700 1 -- 172.21.15.44:0/1276377602 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f31b4055f00 con 0x7f31b80ceb70 2024-09-13T18:27:32.938 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:27:32.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.935+0000 7f31be7a3700 1 -- 172.21.15.44:0/1276377602 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f319c066730 msgr2=0x7f319c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:32.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.935+0000 7f31be7a3700 1 --2- 172.21.15.44:0/1276377602 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f319c066730 0x7f319c068bf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f31a8009ad0 tx=0x7f31a8009240 comp rx=0 tx=0).stop 2024-09-13T18:27:32.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.935+0000 7f31be7a3700 1 -- 172.21.15.44:0/1276377602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31b80ceb70 msgr2=0x7f31b80c9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:32.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.935+0000 7f31be7a3700 1 --2- 172.21.15.44:0/1276377602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31b80ceb70 0x7f31b80c9260 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f31b4000c00 tx=0x7f31b4004770 comp rx=0 tx=0).stop 2024-09-13T18:27:32.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.935+0000 7f31be7a3700 1 -- 172.21.15.44:0/1276377602 shutdown_connections 2024-09-13T18:27:32.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.935+0000 7f31be7a3700 1 --2- 172.21.15.44:0/1276377602 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f319c066730 0x7f319c068bf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.935+0000 7f31be7a3700 1 --2- 172.21.15.44:0/1276377602 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f31b815cda0 0x7f31b80cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.935+0000 7f31be7a3700 1 --2- 172.21.15.44:0/1276377602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31b80ceb70 0x7f31b80c9260 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.935+0000 7f31be7a3700 1 --2- 172.21.15.44:0/1276377602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31b806a520 0x7f31b814fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:32.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.935+0000 7f31be7a3700 1 -- 172.21.15.44:0/1276377602 >> 172.21.15.44:0/1276377602 conn(0x7f31b80d2cb0 msgr2=0x7f31b8066110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:32.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.935+0000 7f31be7a3700 1 -- 172.21.15.44:0/1276377602 shutdown_connections 2024-09-13T18:27:32.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:32.935+0000 7f31be7a3700 1 -- 172.21.15.44:0/1276377602 wait complete. 2024-09-13T18:27:32.960 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:27:33.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.075+0000 7fc1e7537700 1 Processor -- start 2024-09-13T18:27:33.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.075+0000 7fc1e7537700 1 -- start start 2024-09-13T18:27:33.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.075+0000 7fc1e7537700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc1e00b5d60 0x7fc1e00d0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:33.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.075+0000 7fc1e7537700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1e006dec0 0x7fc1e006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:33.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.075+0000 7fc1e7537700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e00cd440 con 0x7fc1e015a770 2024-09-13T18:27:33.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.075+0000 7fc1e7537700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e00d0890 con 0x7fc1e00b5d60 2024-09-13T18:27:33.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.075+0000 7fc1e7537700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e006e870 con 0x7fc1e006dec0 2024-09-13T18:27:33.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.075+0000 7fc1e6535700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc1e015a770 0x7fc1e00ce190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42418/0 (socket says 172.21.15.44:42418) 2024-09-13T18:27:33.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.075+0000 7fc1e5d34700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc1e00b5d60 0x7fc1e00d0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:33.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.075+0000 7fc1e6535700 1 -- 172.21.15.44:0/2544216447 learned_addr learned my addr 172.21.15.44:0/2544216447 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:33.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.075+0000 7fc1e6d36700 1 --2- 172.21.15.44:0/2544216447 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1e006dec0 0x7fc1e006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:33.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.079+0000 7fc1e5d34700 1 -- 172.21.15.44:0/2544216447 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1e006dec0 msgr2=0x7fc1e006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:33.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.079+0000 7fc1e5d34700 1 --2- 172.21.15.44:0/2544216447 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1e006dec0 0x7fc1e006e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.079+0000 7fc1e5d34700 1 -- 172.21.15.44:0/2544216447 >> v1:172.21.15.44:6789/0 conn(0x7fc1e015a770 legacy=0x7fc1e00ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:33.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.079+0000 7fc1e5533700 1 -- 172.21.15.44:0/2544216447 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 746760326 0 0) 0x7fc1e00cd440 con 0x7fc1e015a770 2024-09-13T18:27:33.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.079+0000 7fc1e5d34700 1 -- 172.21.15.44:0/2544216447 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e00b61d0 con 0x7fc1e00b5d60 2024-09-13T18:27:33.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.079+0000 7fc1e5d34700 1 --2- 172.21.15.44:0/2544216447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e00b5d60 0x7fc1e00d0350 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009880 tx=0x7fc1dc009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8741c8c542c32e3a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:33.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.079+0000 7fc1e5533700 1 -- 172.21.15.44:0/2544216447 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc011830 con 0x7fc1e00b5d60 2024-09-13T18:27:33.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.079+0000 7fc1e5533700 1 -- 172.21.15.44:0/2544216447 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc011990 con 0x7fc1e00b5d60 2024-09-13T18:27:33.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.079+0000 7fc1e5533700 1 -- 172.21.15.44:0/2544216447 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc011d20 con 0x7fc1e00b5d60 2024-09-13T18:27:33.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.079+0000 7fc1e7537700 1 -- 172.21.15.44:0/2544216447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e00b5d60 msgr2=0x7fc1e00d0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:33.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.079+0000 7fc1e7537700 1 --2- 172.21.15.44:0/2544216447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e00b5d60 0x7fc1e00d0350 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009880 tx=0x7fc1dc009b90 comp rx=0 tx=0).stop 2024-09-13T18:27:33.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.079+0000 7fc1e7537700 1 -- 172.21.15.44:0/2544216447 shutdown_connections 2024-09-13T18:27:33.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.079+0000 7fc1e7537700 1 --2- 172.21.15.44:0/2544216447 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1e006dec0 0x7fc1e006e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.079+0000 7fc1e7537700 1 --2- 172.21.15.44:0/2544216447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e00b5d60 0x7fc1e00d0350 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.079+0000 7fc1e7537700 1 -- 172.21.15.44:0/2544216447 >> 172.21.15.44:0/2544216447 conn(0x7fc1e0071d00 msgr2=0x7fc1e00720e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:33.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.079+0000 7fc1e7537700 1 -- 172.21.15.44:0/2544216447 shutdown_connections 2024-09-13T18:27:33.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.079+0000 7fc1e7537700 1 -- 172.21.15.44:0/2544216447 wait complete. 2024-09-13T18:27:33.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.083+0000 7fc1e7537700 1 Processor -- start 2024-09-13T18:27:33.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.083+0000 7fc1e7537700 1 -- start start 2024-09-13T18:27:33.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.083+0000 7fc1e7537700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1e006dec0 0x7fc1e01f4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:33.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.083+0000 7fc1e7537700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1e00b5d60 0x7fc1e01ed920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:33.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.083+0000 7fc1e7537700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e015a770 0x7fc1e01f0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:33.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.083+0000 7fc1e7537700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e01f4960 con 0x7fc1e015a770 2024-09-13T18:27:33.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.083+0000 7fc1e7537700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e01ede60 con 0x7fc1e00b5d60 2024-09-13T18:27:33.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.083+0000 7fc1e7537700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e0152f90 con 0x7fc1e006dec0 2024-09-13T18:27:33.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.083+0000 7fc1e6d36700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e015a770 0x7fc1e01f0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:33.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.083+0000 7fc1e6d36700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e015a770 0x7fc1e01f0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40434/0 (socket says 172.21.15.44:40434) 2024-09-13T18:27:33.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.083+0000 7fc1e6d36700 1 -- 172.21.15.44:0/3989335573 learned_addr learned my addr 172.21.15.44:0/3989335573 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:33.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.083+0000 7fc1e5d34700 1 --2- 172.21.15.44:0/3989335573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1e00b5d60 0x7fc1e01ed920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:33.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.083+0000 7fc1e6535700 1 --2- 172.21.15.44:0/3989335573 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1e006dec0 0x7fc1e01f4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:33.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.087+0000 7fc1e6d36700 1 -- 172.21.15.44:0/3989335573 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1e006dec0 msgr2=0x7fc1e01f4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:33.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.087+0000 7fc1e6d36700 1 --2- 172.21.15.44:0/3989335573 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1e006dec0 0x7fc1e01f4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.087+0000 7fc1e6d36700 1 -- 172.21.15.44:0/3989335573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1e00b5d60 msgr2=0x7fc1e01ed920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:33.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.087+0000 7fc1e6d36700 1 --2- 172.21.15.44:0/3989335573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1e00b5d60 0x7fc1e01ed920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.087+0000 7fc1e6d36700 1 -- 172.21.15.44:0/3989335573 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc0094b0 con 0x7fc1e015a770 2024-09-13T18:27:33.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.087+0000 7fc1e6d36700 1 --2- 172.21.15.44:0/3989335573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e015a770 0x7fc1e01f0c90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800efc0 tx=0x7fc1d800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:33.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.087+0000 7fc1d2ffd700 1 -- 172.21.15.44:0/3989335573 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8009ea0 con 0x7fc1e015a770 2024-09-13T18:27:33.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.087+0000 7fc1d2ffd700 1 -- 172.21.15.44:0/3989335573 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d800f040 con 0x7fc1e015a770 2024-09-13T18:27:33.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.087+0000 7fc1e7537700 1 -- 172.21.15.44:0/3989335573 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e0153270 con 0x7fc1e015a770 2024-09-13T18:27:33.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.087+0000 7fc1d2ffd700 1 -- 172.21.15.44:0/3989335573 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d800ced0 con 0x7fc1e015a770 2024-09-13T18:27:33.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.087+0000 7fc1e7537700 1 -- 172.21.15.44:0/3989335573 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e01f0770 con 0x7fc1e015a770 2024-09-13T18:27:33.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.087+0000 7fc1e7537700 1 -- 172.21.15.44:0/3989335573 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e01f0990 con 0x7fc1e015a770 2024-09-13T18:27:33.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.087+0000 7fc1d2ffd700 1 -- 172.21.15.44:0/3989335573 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc1d8014480 con 0x7fc1e015a770 2024-09-13T18:27:33.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.091+0000 7fc1d2ffd700 1 --2- 172.21.15.44:0/3989335573 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc1c4066730 0x7fc1c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:33.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.091+0000 7fc1d2ffd700 1 -- 172.21.15.44:0/3989335573 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1d8084980 con 0x7fc1e015a770 2024-09-13T18:27:33.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.091+0000 7fc1e6535700 1 --2- 172.21.15.44:0/3989335573 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc1c4066730 0x7fc1c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:33.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.091+0000 7fc1e6535700 1 --2- 172.21.15.44:0/3989335573 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc1c4066730 0x7fc1c4068bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4000f60 tx=0x7fc1d4007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:33.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.095+0000 7fc1d2ffd700 1 -- 172.21.15.44:0/3989335573 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc1d8051ce0 con 0x7fc1e015a770 2024-09-13T18:27:33.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.267+0000 7fc1e7537700 1 -- 172.21.15.44:0/3989335573 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc1e006e330 con 0x7fc1e015a770 2024-09-13T18:27:33.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.267+0000 7fc1d2ffd700 1 -- 172.21.15.44:0/3989335573 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc1d8018020 con 0x7fc1e015a770 2024-09-13T18:27:33.271 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:27:33.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.267+0000 7fc1e7537700 1 -- 172.21.15.44:0/3989335573 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc1c4066730 msgr2=0x7fc1c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:33.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.267+0000 7fc1e7537700 1 --2- 172.21.15.44:0/3989335573 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc1c4066730 0x7fc1c4068bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4000f60 tx=0x7fc1d4007e90 comp rx=0 tx=0).stop 2024-09-13T18:27:33.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.267+0000 7fc1e7537700 1 -- 172.21.15.44:0/3989335573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e015a770 msgr2=0x7fc1e01f0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:33.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.267+0000 7fc1e7537700 1 --2- 172.21.15.44:0/3989335573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e015a770 0x7fc1e01f0c90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800efc0 tx=0x7fc1d800c3a0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.267+0000 7fc1e7537700 1 -- 172.21.15.44:0/3989335573 shutdown_connections 2024-09-13T18:27:33.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.267+0000 7fc1e7537700 1 --2- 172.21.15.44:0/3989335573 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc1c4066730 0x7fc1c4068bf0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.267+0000 7fc1e7537700 1 --2- 172.21.15.44:0/3989335573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e015a770 0x7fc1e01f0c90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.267+0000 7fc1e7537700 1 --2- 172.21.15.44:0/3989335573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1e00b5d60 0x7fc1e01ed920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.267+0000 7fc1e7537700 1 --2- 172.21.15.44:0/3989335573 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1e006dec0 0x7fc1e01f4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.267+0000 7fc1e7537700 1 -- 172.21.15.44:0/3989335573 >> 172.21.15.44:0/3989335573 conn(0x7fc1e0071d00 msgr2=0x7fc1e0156070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:33.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.267+0000 7fc1e7537700 1 -- 172.21.15.44:0/3989335573 shutdown_connections 2024-09-13T18:27:33.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.271+0000 7fc1e7537700 1 -- 172.21.15.44:0/3989335573 wait complete. 2024-09-13T18:27:33.286 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:33.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.395+0000 7fa06094c700 1 Processor -- start 2024-09-13T18:27:33.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.395+0000 7fa06094c700 1 -- start start 2024-09-13T18:27:33.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa06094c700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa05c1517f0 0x7fa05c0cb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:33.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa06094c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa05c0b31c0 0x7fa05c0b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:33.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa06094c700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa05c06c6e0 con 0x7fa05c15e4b0 2024-09-13T18:27:33.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa06094c700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa05c0b3b70 con 0x7fa05c0b31c0 2024-09-13T18:27:33.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa06094c700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa05c06c9c0 con 0x7fa05c1517f0 2024-09-13T18:27:33.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa05a59c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa05c0b31c0 0x7fa05c0b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:33.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa05a59c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa05c0b31c0 0x7fa05c0b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40444/0 (socket says 172.21.15.44:40444) 2024-09-13T18:27:33.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa05a59c700 1 -- 172.21.15.44:0/679352399 learned_addr learned my addr 172.21.15.44:0/679352399 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:33.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa05ad9d700 1 --2- 172.21.15.44:0/679352399 >> v2:172.21.15.99:3300/0 conn(0x7fa05c1517f0 0x7fa05c0cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:33.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa059d9b700 1 -- 172.21.15.44:0/679352399 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312288320 0 0) 0x7fa05c06c6e0 con 0x7fa05c15e4b0 2024-09-13T18:27:33.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa059d9b700 1 -- 172.21.15.44:0/679352399 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa03c0035d0 con 0x7fa05c15e4b0 2024-09-13T18:27:33.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa05a59c700 1 -- 172.21.15.44:0/679352399 >> v2:172.21.15.99:3300/0 conn(0x7fa05c1517f0 msgr2=0x7fa05c0cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:33.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa05a59c700 1 --2- 172.21.15.44:0/679352399 >> v2:172.21.15.99:3300/0 conn(0x7fa05c1517f0 0x7fa05c0cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa05a59c700 1 -- 172.21.15.44:0/679352399 >> v1:172.21.15.99:6789/0 conn(0x7fa05c15e4b0 legacy=0x7fa05c15e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:33.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa05a59c700 1 -- 172.21.15.44:0/679352399 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05c06cca0 con 0x7fa05c0b31c0 2024-09-13T18:27:33.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa05a59c700 1 --2- 172.21.15.44:0/679352399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa05c0b31c0 0x7fa05c0b3630 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa05c04ef50 tx=0x7fa044009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4eb01496d9ab8b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:33.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa059d9b700 1 -- 172.21.15.44:0/679352399 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044011830 con 0x7fa05c0b31c0 2024-09-13T18:27:33.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa059d9b700 1 -- 172.21.15.44:0/679352399 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa044011990 con 0x7fa05c0b31c0 2024-09-13T18:27:33.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa059d9b700 1 -- 172.21.15.44:0/679352399 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044011d00 con 0x7fa05c0b31c0 2024-09-13T18:27:33.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa06094c700 1 -- 172.21.15.44:0/679352399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa05c0b31c0 msgr2=0x7fa05c0b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:33.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa06094c700 1 --2- 172.21.15.44:0/679352399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa05c0b31c0 0x7fa05c0b3630 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa05c04ef50 tx=0x7fa044009bf0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa06094c700 1 -- 172.21.15.44:0/679352399 shutdown_connections 2024-09-13T18:27:33.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa06094c700 1 --2- 172.21.15.44:0/679352399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa05c0b31c0 0x7fa05c0b3630 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa06094c700 1 --2- 172.21.15.44:0/679352399 >> v2:172.21.15.99:3300/0 conn(0x7fa05c1517f0 0x7fa05c0cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa06094c700 1 -- 172.21.15.44:0/679352399 >> 172.21.15.44:0/679352399 conn(0x7fa05c06d900 msgr2=0x7fa05c06dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:33.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa06094c700 1 -- 172.21.15.44:0/679352399 shutdown_connections 2024-09-13T18:27:33.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.399+0000 7fa06094c700 1 -- 172.21.15.44:0/679352399 wait complete. 2024-09-13T18:27:33.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.403+0000 7fa06094c700 1 Processor -- start 2024-09-13T18:27:33.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.403+0000 7fa06094c700 1 -- start start 2024-09-13T18:27:33.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.403+0000 7fa06094c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa05c0b31c0 0x7fa05c143d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:33.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.403+0000 7fa06094c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa05c1517f0 0x7fa05c1f4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:33.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.403+0000 7fa06094c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa05c15e4b0 0x7fa05c145a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:33.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.403+0000 7fa06094c700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c149c50 con 0x7fa05c15e4b0 2024-09-13T18:27:33.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.403+0000 7fa06094c700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c15a7b0 con 0x7fa05c0b31c0 2024-09-13T18:27:33.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.403+0000 7fa06094c700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c1f47b0 con 0x7fa05c1517f0 2024-09-13T18:27:33.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.403+0000 7fa05b59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa05c15e4b0 0x7fa05c145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:33.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.403+0000 7fa05b59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa05c15e4b0 0x7fa05c145a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40450/0 (socket says 172.21.15.44:40450) 2024-09-13T18:27:33.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.403+0000 7fa05b59e700 1 -- 172.21.15.44:0/3285469324 learned_addr learned my addr 172.21.15.44:0/3285469324 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:33.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.403+0000 7fa05a59c700 1 --2- 172.21.15.44:0/3285469324 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa05c1517f0 0x7fa05c1f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:33.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.403+0000 7fa05ad9d700 1 --2- 172.21.15.44:0/3285469324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa05c0b31c0 0x7fa05c143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:33.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.403+0000 7fa05b59e700 1 -- 172.21.15.44:0/3285469324 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa05c1517f0 msgr2=0x7fa05c1f4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:33.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.403+0000 7fa05b59e700 1 --2- 172.21.15.44:0/3285469324 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa05c1517f0 0x7fa05c1f4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.403+0000 7fa05b59e700 1 -- 172.21.15.44:0/3285469324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa05c0b31c0 msgr2=0x7fa05c143d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:33.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.403+0000 7fa05b59e700 1 --2- 172.21.15.44:0/3285469324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa05c0b31c0 0x7fa05c143d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.403+0000 7fa05b59e700 1 -- 172.21.15.44:0/3285469324 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa044009570 con 0x7fa05c15e4b0 2024-09-13T18:27:33.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.403+0000 7fa05b59e700 1 --2- 172.21.15.44:0/3285469324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa05c15e4b0 0x7fa05c145a20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa05400cc20 tx=0x7fa05400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:33.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.403+0000 7fa0537fe700 1 -- 172.21.15.44:0/3285469324 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054003c20 con 0x7fa05c15e4b0 2024-09-13T18:27:33.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.403+0000 7fa0537fe700 1 -- 172.21.15.44:0/3285469324 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa054003d80 con 0x7fa05c15e4b0 2024-09-13T18:27:33.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.403+0000 7fa06094c700 1 -- 172.21.15.44:0/3285469324 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa05c15c060 con 0x7fa05c15e4b0 2024-09-13T18:27:33.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.403+0000 7fa0537fe700 1 -- 172.21.15.44:0/3285469324 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05400aa60 con 0x7fa05c15e4b0 2024-09-13T18:27:33.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.407+0000 7fa06094c700 1 -- 172.21.15.44:0/3285469324 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa05c15c620 con 0x7fa05c15e4b0 2024-09-13T18:27:33.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.407+0000 7fa06094c700 1 -- 172.21.15.44:0/3285469324 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa05c149d90 con 0x7fa05c15e4b0 2024-09-13T18:27:33.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.407+0000 7fa0537fe700 1 -- 172.21.15.44:0/3285469324 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa05400abc0 con 0x7fa05c15e4b0 2024-09-13T18:27:33.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.407+0000 7fa0537fe700 1 --2- 172.21.15.44:0/3285469324 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa040066760 0x7fa040068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:33.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.407+0000 7fa0537fe700 1 -- 172.21.15.44:0/3285469324 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0540840a0 con 0x7fa05c15e4b0 2024-09-13T18:27:33.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.407+0000 7fa05ad9d700 1 --2- 172.21.15.44:0/3285469324 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa040066760 0x7fa040068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:33.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.411+0000 7fa05ad9d700 1 --2- 172.21.15.44:0/3285469324 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa040066760 0x7fa040068c20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa04c009bf0 tx=0x7fa04c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:33.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.415+0000 7fa0537fe700 1 -- 172.21.15.44:0/3285469324 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa05c149d90 con 0x7fa05c15e4b0 2024-09-13T18:27:33.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.591+0000 7fa06094c700 1 -- 172.21.15.44:0/3285469324 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa05c149d90 con 0x7fa05c15e4b0 2024-09-13T18:27:33.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.591+0000 7fa0537fe700 1 -- 172.21.15.44:0/3285469324 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fa05c149d90 con 0x7fa05c15e4b0 2024-09-13T18:27:33.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:33.598 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:02.280221+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:33.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.595+0000 7fa06094c700 1 -- 172.21.15.44:0/3285469324 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa040066760 msgr2=0x7fa040068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:33.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.595+0000 7fa06094c700 1 --2- 172.21.15.44:0/3285469324 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa040066760 0x7fa040068c20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa04c009bf0 tx=0x7fa04c009240 comp rx=0 tx=0).stop 2024-09-13T18:27:33.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.595+0000 7fa06094c700 1 -- 172.21.15.44:0/3285469324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa05c15e4b0 msgr2=0x7fa05c145a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:33.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.595+0000 7fa06094c700 1 --2- 172.21.15.44:0/3285469324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa05c15e4b0 0x7fa05c145a20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa05400cc20 tx=0x7fa05400cf30 comp rx=0 tx=0).stop 2024-09-13T18:27:33.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.595+0000 7fa06094c700 1 -- 172.21.15.44:0/3285469324 shutdown_connections 2024-09-13T18:27:33.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.595+0000 7fa06094c700 1 --2- 172.21.15.44:0/3285469324 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa040066760 0x7fa040068c20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.595+0000 7fa06094c700 1 --2- 172.21.15.44:0/3285469324 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa05c15e4b0 0x7fa05c145a20 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.595+0000 7fa06094c700 1 --2- 172.21.15.44:0/3285469324 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa05c1517f0 0x7fa05c1f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.595+0000 7fa06094c700 1 --2- 172.21.15.44:0/3285469324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa05c0b31c0 0x7fa05c143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.595+0000 7fa06094c700 1 -- 172.21.15.44:0/3285469324 >> 172.21.15.44:0/3285469324 conn(0x7fa05c06d900 msgr2=0x7fa05c146880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:33.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.595+0000 7fa06094c700 1 -- 172.21.15.44:0/3285469324 shutdown_connections 2024-09-13T18:27:33.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.595+0000 7fa06094c700 1 -- 172.21.15.44:0/3285469324 wait complete. 2024-09-13T18:27:33.617 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:26:59.478511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:27:00.261038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:27:33.618 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:27:33.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.731+0000 7fb358ebd700 1 Processor -- start 2024-09-13T18:27:33.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.731+0000 7fb358ebd700 1 -- start start 2024-09-13T18:27:33.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb358ebd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb35406d6f0 0x7fb3540ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:33.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb358ebd700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35406dad0 con 0x7fb3540adbd0 2024-09-13T18:27:33.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb358ebd700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3540ae3c0 con 0x7fb35415d200 2024-09-13T18:27:33.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb358ebd700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3540705b0 con 0x7fb35406d6f0 2024-09-13T18:27:33.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb34bfff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb3540adbd0 0x7fb35415caf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42434/0 (socket says 172.21.15.44:42434) 2024-09-13T18:27:33.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb34bfff700 1 -- 172.21.15.44:0/1723853120 learned_addr learned my addr 172.21.15.44:0/1723853120 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:33.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb3537fe700 1 --2- 172.21.15.44:0/1723853120 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb35406d6f0 0x7fb3540ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:33.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb352ffd700 1 -- 172.21.15.44:0/1723853120 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103534546 0 0) 0x7fb35406dad0 con 0x7fb3540adbd0 2024-09-13T18:27:33.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb352ffd700 1 -- 172.21.15.44:0/1723853120 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3400035d0 con 0x7fb3540adbd0 2024-09-13T18:27:33.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb352ffd700 1 -- 172.21.15.44:0/1723853120 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169085807 0 0) 0x7fb3540ae3c0 con 0x7fb35415d200 2024-09-13T18:27:33.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb352ffd700 1 -- 172.21.15.44:0/1723853120 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb35406dad0 con 0x7fb35415d200 2024-09-13T18:27:33.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb352ffd700 1 -- 172.21.15.44:0/1723853120 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1560843618 0 0) 0x7fb3400035d0 con 0x7fb3540adbd0 2024-09-13T18:27:33.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb352ffd700 1 -- 172.21.15.44:0/1723853120 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb35406d6f0 msgr2=0x7fb3540ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:33.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb352ffd700 1 --2- 172.21.15.44:0/1723853120 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb35406d6f0 0x7fb3540ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb352ffd700 1 -- 172.21.15.44:0/1723853120 >> v1:172.21.15.99:6789/0 conn(0x7fb35415d200 legacy=0x7fb35406baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:33.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb352ffd700 1 -- 172.21.15.44:0/1723853120 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb354070890 con 0x7fb3540adbd0 2024-09-13T18:27:33.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb352ffd700 1 -- 172.21.15.44:0/1723853120 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7fb33c001670 con 0x7fb3540adbd0 2024-09-13T18:27:33.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb3537fe700 1 --2- 172.21.15.44:0/1723853120 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb35406d6f0 0x7fb3540ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:33.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb352ffd700 1 -- 172.21.15.44:0/1723853120 >> v1:172.21.15.44:6789/0 conn(0x7fb3540adbd0 legacy=0x7fb35415caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:33.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb352ffd700 1 --2- 172.21.15.44:0/1723853120 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb340003be0 0x7fb340003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:33.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb352ffd700 1 --2- 172.21.15.44:0/1723853120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb340004870 0x7fb340004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:33.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb352ffd700 1 --2- 172.21.15.44:0/1723853120 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb35406d6f0 0x7fb340005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:33.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb352ffd700 1 -- 172.21.15.44:0/1723853120 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3540705b0 con 0x7fb340004870 2024-09-13T18:27:33.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb352ffd700 1 -- 172.21.15.44:0/1723853120 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34000cb70 con 0x7fb340003be0 2024-09-13T18:27:33.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb352ffd700 1 -- 172.21.15.44:0/1723853120 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34000cd30 con 0x7fb35406d6f0 2024-09-13T18:27:33.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb34bfff700 1 --2- 172.21.15.44:0/1723853120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb340004870 0x7fb340004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:33.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb3537fe700 1 --2- 172.21.15.44:0/1723853120 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb340003be0 0x7fb340003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:33.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb353fff700 1 --2- 172.21.15.44:0/1723853120 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb35406d6f0 0x7fb340005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:33.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb34bfff700 1 -- 172.21.15.44:0/1723853120 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb35406d6f0 msgr2=0x7fb340005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:33.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb34bfff700 1 --2- 172.21.15.44:0/1723853120 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb35406d6f0 0x7fb340005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb34bfff700 1 -- 172.21.15.44:0/1723853120 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb340003be0 msgr2=0x7fb340003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:33.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb34bfff700 1 --2- 172.21.15.44:0/1723853120 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb340003be0 0x7fb340003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb34bfff700 1 -- 172.21.15.44:0/1723853120 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3440094b0 con 0x7fb340004870 2024-09-13T18:27:33.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb34bfff700 1 --2- 172.21.15.44:0/1723853120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb340004870 0x7fb340004cf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb33c001eb0 tx=0x7fb3400058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33ca89fb9d617d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:33.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb352ffd700 1 -- 172.21.15.44:0/1723853120 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c00ccf0 con 0x7fb340004870 2024-09-13T18:27:33.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb352ffd700 1 -- 172.21.15.44:0/1723853120 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c001af0 con 0x7fb340004870 2024-09-13T18:27:33.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.735+0000 7fb352ffd700 1 -- 172.21.15.44:0/1723853120 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c005bc0 con 0x7fb340004870 2024-09-13T18:27:33.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.739+0000 7fb358ebd700 1 -- 172.21.15.44:0/1723853120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb340004870 msgr2=0x7fb340004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:33.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.739+0000 7fb358ebd700 1 --2- 172.21.15.44:0/1723853120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb340004870 0x7fb340004cf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb33c001eb0 tx=0x7fb3400058a0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.739+0000 7fb353fff700 1 -- 172.21.15.44:0/1723853120 reap_dead start 2024-09-13T18:27:33.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.739+0000 7fb358ebd700 1 -- 172.21.15.44:0/1723853120 shutdown_connections 2024-09-13T18:27:33.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.739+0000 7fb358ebd700 1 -- 172.21.15.44:0/1723853120 >> 172.21.15.44:0/1723853120 conn(0x7fb3540b0e10 msgr2=0x7fb3540b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:33.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.739+0000 7fb358ebd700 1 -- 172.21.15.44:0/1723853120 shutdown_connections 2024-09-13T18:27:33.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.739+0000 7fb358ebd700 1 -- 172.21.15.44:0/1723853120 wait complete. 2024-09-13T18:27:33.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.739+0000 7fb358ebd700 1 Processor -- start 2024-09-13T18:27:33.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.739+0000 7fb358ebd700 1 -- start start 2024-09-13T18:27:33.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb358ebd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb340004870 0x7fb3541532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:33.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb358ebd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb354152db0 0x7fb3541526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:33.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb358ebd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb3541e7990 0x7fb3541e6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:33.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb358ebd700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb354152bf0 con 0x7fb354152db0 2024-09-13T18:27:33.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb358ebd700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3541e4660 con 0x7fb340004870 2024-09-13T18:27:33.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb358ebd700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3541e48b0 con 0x7fb3541e7990 2024-09-13T18:27:33.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb34bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb354152db0 0x7fb3541526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:33.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb34bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb354152db0 0x7fb3541526b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40470/0 (socket says 172.21.15.44:40470) 2024-09-13T18:27:33.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb34bfff700 1 -- 172.21.15.44:0/818651188 learned_addr learned my addr 172.21.15.44:0/818651188 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:33.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb3537fe700 1 --2- 172.21.15.44:0/818651188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb340004870 0x7fb3541532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:33.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb353fff700 1 --2- 172.21.15.44:0/818651188 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb3541e7990 0x7fb3541e6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:33.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb34bfff700 1 -- 172.21.15.44:0/818651188 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb3541e7990 msgr2=0x7fb3541e6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:33.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb34bfff700 1 --2- 172.21.15.44:0/818651188 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb3541e7990 0x7fb3541e6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb34bfff700 1 -- 172.21.15.44:0/818651188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb340004870 msgr2=0x7fb3541532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:33.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb34bfff700 1 --2- 172.21.15.44:0/818651188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb340004870 0x7fb3541532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb34bfff700 1 -- 172.21.15.44:0/818651188 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3541e5d40 con 0x7fb354152db0 2024-09-13T18:27:33.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb34bfff700 1 --2- 172.21.15.44:0/818651188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb354152db0 0x7fb3541526b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb34000cb40 tx=0x7fb33c001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:33.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb350ff9700 1 -- 172.21.15.44:0/818651188 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c0072d0 con 0x7fb354152db0 2024-09-13T18:27:33.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb350ff9700 1 -- 172.21.15.44:0/818651188 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c007450 con 0x7fb354152db0 2024-09-13T18:27:33.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb350ff9700 1 -- 172.21.15.44:0/818651188 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c007800 con 0x7fb354152db0 2024-09-13T18:27:33.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb358ebd700 1 -- 172.21.15.44:0/818651188 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3541e6020 con 0x7fb354152db0 2024-09-13T18:27:33.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb358ebd700 1 -- 172.21.15.44:0/818651188 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3541e7510 con 0x7fb354152db0 2024-09-13T18:27:33.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb358ebd700 1 -- 172.21.15.44:0/818651188 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3541e61b0 con 0x7fb354152db0 2024-09-13T18:27:33.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.743+0000 7fb350ff9700 1 -- 172.21.15.44:0/818651188 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb33c01e430 con 0x7fb354152db0 2024-09-13T18:27:33.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.747+0000 7fb350ff9700 1 --2- 172.21.15.44:0/818651188 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb334066730 0x7fb334068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:33.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.747+0000 7fb350ff9700 1 -- 172.21.15.44:0/818651188 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb33c0850b0 con 0x7fb354152db0 2024-09-13T18:27:33.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.747+0000 7fb3537fe700 1 --2- 172.21.15.44:0/818651188 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb334066730 0x7fb334068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:33.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.747+0000 7fb3537fe700 1 --2- 172.21.15.44:0/818651188 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb334066730 0x7fb334068bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb3540afe30 tx=0x7fb344009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:33.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.755+0000 7fb350ff9700 1 -- 172.21.15.44:0/818651188 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb33c052560 con 0x7fb354152db0 2024-09-13T18:27:33.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.927+0000 7fb358ebd700 1 -- 172.21.15.44:0/818651188 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb354066a50 con 0x7fb354152db0 2024-09-13T18:27:33.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.927+0000 7fb350ff9700 1 -- 172.21.15.44:0/818651188 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb33c055b80 con 0x7fb354152db0 2024-09-13T18:27:33.932 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:27:33.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.931+0000 7fb358ebd700 1 -- 172.21.15.44:0/818651188 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb334066730 msgr2=0x7fb334068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:33.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.931+0000 7fb358ebd700 1 --2- 172.21.15.44:0/818651188 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb334066730 0x7fb334068bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb3540afe30 tx=0x7fb344009240 comp rx=0 tx=0).stop 2024-09-13T18:27:33.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.931+0000 7fb358ebd700 1 -- 172.21.15.44:0/818651188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb354152db0 msgr2=0x7fb3541526b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:33.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.931+0000 7fb358ebd700 1 --2- 172.21.15.44:0/818651188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb354152db0 0x7fb3541526b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb34000cb40 tx=0x7fb33c001980 comp rx=0 tx=0).stop 2024-09-13T18:27:33.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.931+0000 7fb358ebd700 1 -- 172.21.15.44:0/818651188 shutdown_connections 2024-09-13T18:27:33.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.931+0000 7fb358ebd700 1 --2- 172.21.15.44:0/818651188 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb334066730 0x7fb334068bf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.931+0000 7fb358ebd700 1 --2- 172.21.15.44:0/818651188 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb3541e7990 0x7fb3541e6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.931+0000 7fb358ebd700 1 --2- 172.21.15.44:0/818651188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb354152db0 0x7fb3541526b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.931+0000 7fb358ebd700 1 --2- 172.21.15.44:0/818651188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb340004870 0x7fb3541532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.931+0000 7fb358ebd700 1 -- 172.21.15.44:0/818651188 >> 172.21.15.44:0/818651188 conn(0x7fb3540b0e10 msgr2=0x7fb3540b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:33.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.931+0000 7fb358ebd700 1 -- 172.21.15.44:0/818651188 shutdown_connections 2024-09-13T18:27:33.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:33.931+0000 7fb358ebd700 1 -- 172.21.15.44:0/818651188 wait complete. 2024-09-13T18:27:33.947 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:27:34.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.063+0000 7fa692f0e700 1 Processor -- start 2024-09-13T18:27:34.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.063+0000 7fa692f0e700 1 -- start start 2024-09-13T18:27:34.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.063+0000 7fa692f0e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa68c0712b0 0x7fa68c159f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:34.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.063+0000 7fa692f0e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa68c15a460 0x7fa68c06c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:34.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.063+0000 7fa692f0e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68c15ac50 con 0x7fa68c1573e0 2024-09-13T18:27:34.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.063+0000 7fa692f0e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68c0cc1b0 con 0x7fa68c15a460 2024-09-13T18:27:34.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.063+0000 7fa692f0e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c0cb3f0 con 0x7fa68c0712b0 2024-09-13T18:27:34.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.063+0000 7fa69270d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa68c15a460 0x7fa68c06c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:34.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.063+0000 7fa691f0c700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa68c1573e0 0x7fa68c070ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42436/0 (socket says 172.21.15.44:42436) 2024-09-13T18:27:34.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.063+0000 7fa691f0c700 1 -- 172.21.15.44:0/3532752968 learned_addr learned my addr 172.21.15.44:0/3532752968 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:34.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.067+0000 7fa69170b700 1 --2- 172.21.15.44:0/3532752968 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa68c0712b0 0x7fa68c159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:34.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.067+0000 7fa69270d700 1 -- 172.21.15.44:0/3532752968 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa68c0712b0 msgr2=0x7fa68c159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:34.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.067+0000 7fa69270d700 1 --2- 172.21.15.44:0/3532752968 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa68c0712b0 0x7fa68c159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.067+0000 7fa69270d700 1 -- 172.21.15.44:0/3532752968 >> v1:172.21.15.44:6789/0 conn(0x7fa68c1573e0 legacy=0x7fa68c070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:34.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.067+0000 7fa69270d700 1 -- 172.21.15.44:0/3532752968 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68c0cb6d0 con 0x7fa68c15a460 2024-09-13T18:27:34.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.067+0000 7fa690f0a700 1 -- 172.21.15.44:0/3532752968 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2148321997 0 0) 0x7fa68c15ac50 con 0x7fa68c1573e0 2024-09-13T18:27:34.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.067+0000 7fa69270d700 1 --2- 172.21.15.44:0/3532752968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa68c15a460 0x7fa68c06c3e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa684009dc0 tx=0x7fa68400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3adaf15d0e3213 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:34.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.067+0000 7fa690f0a700 1 -- 172.21.15.44:0/3532752968 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68400e070 con 0x7fa68c15a460 2024-09-13T18:27:34.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.067+0000 7fa690f0a700 1 -- 172.21.15.44:0/3532752968 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68400bb90 con 0x7fa68c15a460 2024-09-13T18:27:34.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.067+0000 7fa690f0a700 1 -- 172.21.15.44:0/3532752968 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa684012430 con 0x7fa68c15a460 2024-09-13T18:27:34.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.067+0000 7fa692f0e700 1 -- 172.21.15.44:0/3532752968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa68c15a460 msgr2=0x7fa68c06c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:34.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.067+0000 7fa692f0e700 1 --2- 172.21.15.44:0/3532752968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa68c15a460 0x7fa68c06c3e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa684009dc0 tx=0x7fa68400b330 comp rx=0 tx=0).stop 2024-09-13T18:27:34.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.067+0000 7fa692f0e700 1 -- 172.21.15.44:0/3532752968 shutdown_connections 2024-09-13T18:27:34.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.067+0000 7fa692f0e700 1 --2- 172.21.15.44:0/3532752968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa68c15a460 0x7fa68c06c3e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.067+0000 7fa692f0e700 1 --2- 172.21.15.44:0/3532752968 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa68c0712b0 0x7fa68c159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.067+0000 7fa692f0e700 1 -- 172.21.15.44:0/3532752968 >> 172.21.15.44:0/3532752968 conn(0x7fa68c0b0e10 msgr2=0x7fa68c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:34.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.067+0000 7fa692f0e700 1 -- 172.21.15.44:0/3532752968 shutdown_connections 2024-09-13T18:27:34.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.067+0000 7fa692f0e700 1 -- 172.21.15.44:0/3532752968 wait complete. 2024-09-13T18:27:34.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa692f0e700 1 Processor -- start 2024-09-13T18:27:34.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa692f0e700 1 -- start start 2024-09-13T18:27:34.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa692f0e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa68c0712b0 0x7fa68c14f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:34.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa692f0e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa68c1573e0 0x7fa68c150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:34.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa692f0e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa68c15a460 0x7fa68c06fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:34.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa692f0e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c152570 con 0x7fa68c15a460 2024-09-13T18:27:34.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa692f0e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c151960 con 0x7fa68c0712b0 2024-09-13T18:27:34.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa692f0e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c151c40 con 0x7fa68c1573e0 2024-09-13T18:27:34.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa69270d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa68c15a460 0x7fa68c06fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:34.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa69270d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa68c15a460 0x7fa68c06fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40492/0 (socket says 172.21.15.44:40492) 2024-09-13T18:27:34.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa69270d700 1 -- 172.21.15.44:0/2812003919 learned_addr learned my addr 172.21.15.44:0/2812003919 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:34.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa691f0c700 1 --2- 172.21.15.44:0/2812003919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa68c0712b0 0x7fa68c14f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:34.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa69170b700 1 --2- 172.21.15.44:0/2812003919 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa68c1573e0 0x7fa68c150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:34.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa69270d700 1 -- 172.21.15.44:0/2812003919 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa68c1573e0 msgr2=0x7fa68c150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:34.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa69270d700 1 --2- 172.21.15.44:0/2812003919 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa68c1573e0 0x7fa68c150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa69270d700 1 -- 172.21.15.44:0/2812003919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa68c0712b0 msgr2=0x7fa68c14f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:34.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa69270d700 1 --2- 172.21.15.44:0/2812003919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa68c0712b0 0x7fa68c14f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa69270d700 1 -- 172.21.15.44:0/2812003919 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa684009a70 con 0x7fa68c15a460 2024-09-13T18:27:34.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa69270d700 1 --2- 172.21.15.44:0/2812003919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa68c15a460 0x7fa68c06fa90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa684014040 tx=0x7fa684004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:34.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa68a7fc700 1 -- 172.21.15.44:0/2812003919 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa684012430 con 0x7fa68c15a460 2024-09-13T18:27:34.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa692f0e700 1 -- 172.21.15.44:0/2812003919 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68c151f20 con 0x7fa68c15a460 2024-09-13T18:27:34.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa68a7fc700 1 -- 172.21.15.44:0/2812003919 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa684020070 con 0x7fa68c15a460 2024-09-13T18:27:34.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa692f0e700 1 -- 172.21.15.44:0/2812003919 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68c152a00 con 0x7fa68c15a460 2024-09-13T18:27:34.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.071+0000 7fa68a7fc700 1 -- 172.21.15.44:0/2812003919 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa684004240 con 0x7fa68c15a460 2024-09-13T18:27:34.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.075+0000 7fa692f0e700 1 -- 172.21.15.44:0/2812003919 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68c15be30 con 0x7fa68c15a460 2024-09-13T18:27:34.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.075+0000 7fa68a7fc700 1 -- 172.21.15.44:0/2812003919 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa6840043a0 con 0x7fa68c15a460 2024-09-13T18:27:34.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.075+0000 7fa68a7fc700 1 --2- 172.21.15.44:0/2812003919 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa678066760 0x7fa678068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:34.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.075+0000 7fa68a7fc700 1 -- 172.21.15.44:0/2812003919 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa684022070 con 0x7fa68c15a460 2024-09-13T18:27:34.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.075+0000 7fa691f0c700 1 --2- 172.21.15.44:0/2812003919 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa678066760 0x7fa678068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:34.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.075+0000 7fa691f0c700 1 --2- 172.21.15.44:0/2812003919 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa678066760 0x7fa678068c20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa67c000f60 tx=0x7fa67c007e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.079+0000 7fa68a7fc700 1 -- 172.21.15.44:0/2812003919 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa684053550 con 0x7fa68c15a460 2024-09-13T18:27:34.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.251+0000 7fa692f0e700 1 -- 172.21.15.44:0/2812003919 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa68c159f20 con 0x7fa68c15a460 2024-09-13T18:27:34.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.251+0000 7fa68a7fc700 1 -- 172.21.15.44:0/2812003919 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa684056b70 con 0x7fa68c15a460 2024-09-13T18:27:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:27:34.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.255+0000 7fa692f0e700 1 -- 172.21.15.44:0/2812003919 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa678066760 msgr2=0x7fa678068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:34.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.255+0000 7fa692f0e700 1 --2- 172.21.15.44:0/2812003919 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa678066760 0x7fa678068c20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa67c000f60 tx=0x7fa67c007e00 comp rx=0 tx=0).stop 2024-09-13T18:27:34.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.255+0000 7fa692f0e700 1 -- 172.21.15.44:0/2812003919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa68c15a460 msgr2=0x7fa68c06fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:34.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.255+0000 7fa692f0e700 1 --2- 172.21.15.44:0/2812003919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa68c15a460 0x7fa68c06fa90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa684014040 tx=0x7fa684004af0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.255+0000 7fa692f0e700 1 -- 172.21.15.44:0/2812003919 shutdown_connections 2024-09-13T18:27:34.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.255+0000 7fa692f0e700 1 --2- 172.21.15.44:0/2812003919 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa678066760 0x7fa678068c20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.255+0000 7fa692f0e700 1 --2- 172.21.15.44:0/2812003919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa68c15a460 0x7fa68c06fa90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.255+0000 7fa692f0e700 1 --2- 172.21.15.44:0/2812003919 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa68c1573e0 0x7fa68c150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.255+0000 7fa692f0e700 1 --2- 172.21.15.44:0/2812003919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa68c0712b0 0x7fa68c14f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.255+0000 7fa692f0e700 1 -- 172.21.15.44:0/2812003919 >> 172.21.15.44:0/2812003919 conn(0x7fa68c0b0e10 msgr2=0x7fa68c155570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:34.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.255+0000 7fa692f0e700 1 -- 172.21.15.44:0/2812003919 shutdown_connections 2024-09-13T18:27:34.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.255+0000 7fa692f0e700 1 -- 172.21.15.44:0/2812003919 wait complete. 2024-09-13T18:27:34.271 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:27:34.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.391+0000 7f007ac64700 1 Processor -- start 2024-09-13T18:27:34.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.391+0000 7f007ac64700 1 -- start start 2024-09-13T18:27:34.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.391+0000 7f007ac64700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f007415cda0 0x7f00740d1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:34.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.391+0000 7f007ac64700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f00740b5e00 0x7f00740b6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:34.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.391+0000 7f007ac64700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00740d0880 con 0x7f00740b6780 2024-09-13T18:27:34.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.391+0000 7f007ac64700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00740cde50 con 0x7f00740b5e00 2024-09-13T18:27:34.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.391+0000 7f007ac64700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00740d16e0 con 0x7f007415cda0 2024-09-13T18:27:34.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.391+0000 7f0073fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f00740b5e00 0x7f00740b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:34.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.391+0000 7f0078a00700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f007415cda0 0x7f00740d1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:34.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.391+0000 7f0073fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f00740b5e00 0x7f00740b6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:55688/0 (socket says 172.21.15.44:55688) 2024-09-13T18:27:34.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.391+0000 7f0079201700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f00740b6780 0x7f007406a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:33718/0 (socket says 172.21.15.44:33718) 2024-09-13T18:27:34.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.391+0000 7f0078a00700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f007415cda0 0x7f00740d1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:48684/0 (socket says 172.21.15.44:48684) 2024-09-13T18:27:34.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.391+0000 7f0073fff700 1 -- 172.21.15.44:0/2423165854 learned_addr learned my addr 172.21.15.44:0/2423165854 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:34.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.391+0000 7f0073fff700 1 -- 172.21.15.44:0/2423165854 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f007415cda0 msgr2=0x7f00740d1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:34.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.391+0000 7f0073fff700 1 --2- 172.21.15.44:0/2423165854 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f007415cda0 0x7f00740d1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.391+0000 7f0073fff700 1 -- 172.21.15.44:0/2423165854 >> v1:172.21.15.99:6789/0 conn(0x7f00740b6780 legacy=0x7f007406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:34.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.391+0000 7f0073fff700 1 -- 172.21.15.44:0/2423165854 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00740d0ad0 con 0x7f00740b5e00 2024-09-13T18:27:34.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.391+0000 7f0073fff700 1 --2- 172.21.15.44:0/2423165854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00740b5e00 0x7f00740b6240 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0064009940 tx=0x7f0064009c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51cd70f2c63059c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:34.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.391+0000 7f00737fe700 1 -- 172.21.15.44:0/2423165854 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0064011830 con 0x7f00740b5e00 2024-09-13T18:27:34.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.391+0000 7f00737fe700 1 -- 172.21.15.44:0/2423165854 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0064011990 con 0x7f00740b5e00 2024-09-13T18:27:34.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.391+0000 7f00737fe700 1 -- 172.21.15.44:0/2423165854 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0064011d20 con 0x7f00740b5e00 2024-09-13T18:27:34.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.395+0000 7f007ac64700 1 -- 172.21.15.44:0/2423165854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00740b5e00 msgr2=0x7f00740b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:34.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.395+0000 7f007ac64700 1 --2- 172.21.15.44:0/2423165854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00740b5e00 0x7f00740b6240 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0064009940 tx=0x7f0064009c50 comp rx=0 tx=0).stop 2024-09-13T18:27:34.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.395+0000 7f007ac64700 1 -- 172.21.15.44:0/2423165854 shutdown_connections 2024-09-13T18:27:34.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.395+0000 7f007ac64700 1 --2- 172.21.15.44:0/2423165854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00740b5e00 0x7f00740b6240 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.395+0000 7f007ac64700 1 --2- 172.21.15.44:0/2423165854 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f007415cda0 0x7f00740d1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.395+0000 7f007ac64700 1 -- 172.21.15.44:0/2423165854 >> 172.21.15.44:0/2423165854 conn(0x7f00740d2cb0 msgr2=0x7f00740d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:34.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.395+0000 7f007ac64700 1 -- 172.21.15.44:0/2423165854 shutdown_connections 2024-09-13T18:27:34.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.395+0000 7f007ac64700 1 -- 172.21.15.44:0/2423165854 wait complete. 2024-09-13T18:27:34.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.395+0000 7f007ac64700 1 Processor -- start 2024-09-13T18:27:34.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.395+0000 7f007ac64700 1 -- start start 2024-09-13T18:27:34.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.395+0000 7f007ac64700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00740b5e00 0x7f0074159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:34.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.395+0000 7f007ac64700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00740b6780 0x7f007414e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:34.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.395+0000 7f007ac64700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f007415cda0 0x7f0074155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:34.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.395+0000 7f007ac64700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0074154fc0 con 0x7f00740b6780 2024-09-13T18:27:34.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.395+0000 7f007ac64700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007414e8f0 con 0x7f00740b5e00 2024-09-13T18:27:34.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.395+0000 7f007ac64700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0074154690 con 0x7f007415cda0 2024-09-13T18:27:34.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.395+0000 7f0073fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00740b6780 0x7f007414e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:34.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.395+0000 7f0073fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00740b6780 0x7f007414e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40506/0 (socket says 172.21.15.44:40506) 2024-09-13T18:27:34.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.395+0000 7f0073fff700 1 -- 172.21.15.44:0/1494671886 learned_addr learned my addr 172.21.15.44:0/1494671886 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:34.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.395+0000 7f0079201700 1 --2- 172.21.15.44:0/1494671886 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f007415cda0 0x7f0074155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:34.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.395+0000 7f0078a00700 1 --2- 172.21.15.44:0/1494671886 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00740b5e00 0x7f0074159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:34.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.399+0000 7f0073fff700 1 -- 172.21.15.44:0/1494671886 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f007415cda0 msgr2=0x7f0074155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:34.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.399+0000 7f0073fff700 1 --2- 172.21.15.44:0/1494671886 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f007415cda0 0x7f0074155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.399+0000 7f0073fff700 1 -- 172.21.15.44:0/1494671886 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00740b5e00 msgr2=0x7f0074159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:34.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.399+0000 7f0073fff700 1 --2- 172.21.15.44:0/1494671886 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00740b5e00 0x7f0074159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.399+0000 7f0073fff700 1 -- 172.21.15.44:0/1494671886 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0064009570 con 0x7f00740b6780 2024-09-13T18:27:34.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.399+0000 7f0073fff700 1 --2- 172.21.15.44:0/1494671886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00740b6780 0x7f007414e3b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0064013000 tx=0x7f0064004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:34.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.399+0000 7f00717fa700 1 -- 172.21.15.44:0/1494671886 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00640042c0 con 0x7f00740b6780 2024-09-13T18:27:34.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.399+0000 7f00717fa700 1 -- 172.21.15.44:0/1494671886 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006401f070 con 0x7f00740b6780 2024-09-13T18:27:34.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.399+0000 7f00717fa700 1 -- 172.21.15.44:0/1494671886 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00640036c0 con 0x7f00740b6780 2024-09-13T18:27:34.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.399+0000 7f007ac64700 1 -- 172.21.15.44:0/1494671886 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0074154970 con 0x7f00740b6780 2024-09-13T18:27:34.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.399+0000 7f007ac64700 1 -- 172.21.15.44:0/1494671886 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0074154340 con 0x7f00740b6780 2024-09-13T18:27:34.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.399+0000 7f007ac64700 1 -- 172.21.15.44:0/1494671886 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0074155170 con 0x7f00740b6780 2024-09-13T18:27:34.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.403+0000 7f00717fa700 1 -- 172.21.15.44:0/1494671886 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0064021030 con 0x7f00740b6780 2024-09-13T18:27:34.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.403+0000 7f00717fa700 1 --2- 172.21.15.44:0/1494671886 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0058066730 0x7f0058068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:34.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.403+0000 7f00717fa700 1 -- 172.21.15.44:0/1494671886 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0064085560 con 0x7f00740b6780 2024-09-13T18:27:34.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.403+0000 7f0078a00700 1 --2- 172.21.15.44:0/1494671886 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0058066730 0x7f0058068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:34.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.403+0000 7f0078a00700 1 --2- 172.21.15.44:0/1494671886 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0058066730 0x7f0058068bf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f00741517a0 tx=0x7f005c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:34.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.407+0000 7f00717fa700 1 -- 172.21.15.44:0/1494671886 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0074155170 con 0x7f00740b6780 2024-09-13T18:27:34.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.579+0000 7f007ac64700 1 -- 172.21.15.44:0/1494671886 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f00740b6240 con 0x7f00740b6780 2024-09-13T18:27:34.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.579+0000 7f00717fa700 1 -- 172.21.15.44:0/1494671886 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0064052a00 con 0x7f00740b6780 2024-09-13T18:27:34.585 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:27:34.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.583+0000 7f007ac64700 1 -- 172.21.15.44:0/1494671886 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0058066730 msgr2=0x7f0058068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:34.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.583+0000 7f007ac64700 1 --2- 172.21.15.44:0/1494671886 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0058066730 0x7f0058068bf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f00741517a0 tx=0x7f005c00b040 comp rx=0 tx=0).stop 2024-09-13T18:27:34.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.583+0000 7f007ac64700 1 -- 172.21.15.44:0/1494671886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00740b6780 msgr2=0x7f007414e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:34.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.583+0000 7f007ac64700 1 --2- 172.21.15.44:0/1494671886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00740b6780 0x7f007414e3b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0064013000 tx=0x7f0064004770 comp rx=0 tx=0).stop 2024-09-13T18:27:34.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.583+0000 7f007ac64700 1 -- 172.21.15.44:0/1494671886 shutdown_connections 2024-09-13T18:27:34.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.583+0000 7f007ac64700 1 --2- 172.21.15.44:0/1494671886 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0058066730 0x7f0058068bf0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.583+0000 7f007ac64700 1 --2- 172.21.15.44:0/1494671886 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f007415cda0 0x7f0074155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.583+0000 7f007ac64700 1 --2- 172.21.15.44:0/1494671886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00740b6780 0x7f007414e3b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.583+0000 7f007ac64700 1 --2- 172.21.15.44:0/1494671886 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00740b5e00 0x7f0074159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.583+0000 7f007ac64700 1 -- 172.21.15.44:0/1494671886 >> 172.21.15.44:0/1494671886 conn(0x7f00740d2cb0 msgr2=0x7f007406a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:34.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.583+0000 7f007ac64700 1 -- 172.21.15.44:0/1494671886 shutdown_connections 2024-09-13T18:27:34.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.583+0000 7f007ac64700 1 -- 172.21.15.44:0/1494671886 wait complete. 2024-09-13T18:27:34.630 INFO:tasks.cephfs_test_runner:Starting test: test_inject_to_empty (tasks.cephfs.test_journal_repair.TestJournalRepair) That when some dentries in the journal but nothing is in 2024-09-13T18:27:34.630 INFO:tasks.cephfs_test_runner:test_inject_to_empty (tasks.cephfs.test_journal_repair.TestJournalRepair) 2024-09-13T18:27:34.631 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:34.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23c48c3700 1 Processor -- start 2024-09-13T18:27:34.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23c48c3700 1 -- start start 2024-09-13T18:27:34.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23c48c3700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f23c0165590 0x7f23c01619a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:34.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23c48c3700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c0071f30 con 0x7f23c00b3ae0 2024-09-13T18:27:34.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23c48c3700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c01622e0 con 0x7f23c0160eb0 2024-09-13T18:27:34.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23c48c3700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c0162000 con 0x7f23c0165590 2024-09-13T18:27:34.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23be59c700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f23c00b3ae0 0x7f23c0161290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42446/0 (socket says 172.21.15.44:42446) 2024-09-13T18:27:34.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23be59c700 1 -- 172.21.15.44:0/3280178256 learned_addr learned my addr 172.21.15.44:0/3280178256 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:34.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23bf59e700 1 --2- 172.21.15.44:0/3280178256 >> v2:172.21.15.44:3300/0 conn(0x7f23c0165590 0x7f23c01619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:34.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23bdd9b700 1 -- 172.21.15.44:0/3280178256 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 425319442 0 0) 0x7f23c0071f30 con 0x7f23c00b3ae0 2024-09-13T18:27:34.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23bdd9b700 1 -- 172.21.15.44:0/3280178256 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23ac0035d0 con 0x7f23c00b3ae0 2024-09-13T18:27:34.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23bf59e700 1 -- 172.21.15.44:0/3280178256 >> v1:172.21.15.99:6789/0 conn(0x7f23c0160eb0 legacy=0x7f23c00b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:34.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23bf59e700 1 -- 172.21.15.44:0/3280178256 >> v1:172.21.15.44:6789/0 conn(0x7f23c00b3ae0 legacy=0x7f23c0161290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:34.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23bf59e700 1 -- 172.21.15.44:0/3280178256 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c0164ab0 con 0x7f23c0165590 2024-09-13T18:27:34.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23bf59e700 1 --2- 172.21.15.44:0/3280178256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23c0165590 0x7f23c01619a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f23b8009850 tx=0x7f23b8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a88ddb79510d43 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:34.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23bdd9b700 1 -- 172.21.15.44:0/3280178256 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b8011830 con 0x7f23c0165590 2024-09-13T18:27:34.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23bdd9b700 1 -- 172.21.15.44:0/3280178256 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b8011990 con 0x7f23c0165590 2024-09-13T18:27:34.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23bdd9b700 1 -- 172.21.15.44:0/3280178256 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b8011d40 con 0x7f23c0165590 2024-09-13T18:27:34.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23c48c3700 1 -- 172.21.15.44:0/3280178256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23c0165590 msgr2=0x7f23c01619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:34.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23c48c3700 1 --2- 172.21.15.44:0/3280178256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23c0165590 0x7f23c01619a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f23b8009850 tx=0x7f23b8009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:34.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23c48c3700 1 -- 172.21.15.44:0/3280178256 shutdown_connections 2024-09-13T18:27:34.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23c48c3700 1 --2- 172.21.15.44:0/3280178256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23c0165590 0x7f23c01619a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23c48c3700 1 -- 172.21.15.44:0/3280178256 >> 172.21.15.44:0/3280178256 conn(0x7f23c00b0f00 msgr2=0x7f23c00b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:34.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23c48c3700 1 -- 172.21.15.44:0/3280178256 shutdown_connections 2024-09-13T18:27:34.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.747+0000 7f23c48c3700 1 -- 172.21.15.44:0/3280178256 wait complete. 2024-09-13T18:27:34.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23c48c3700 1 Processor -- start 2024-09-13T18:27:34.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23c48c3700 1 -- start start 2024-09-13T18:27:34.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23c48c3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23c00b3ae0 0x7f23c01f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:34.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23c48c3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23c0160eb0 0x7f23c015a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:34.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23c48c3700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23c0165590 0x7f23c015dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:34.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23c48c3700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c015e1c0 con 0x7f23c0160eb0 2024-09-13T18:27:34.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23c48c3700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c015e3d0 con 0x7f23c0165590 2024-09-13T18:27:34.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23c48c3700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c015e6b0 con 0x7f23c00b3ae0 2024-09-13T18:27:34.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23be59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23c0160eb0 0x7f23c015a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:34.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23be59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23c0160eb0 0x7f23c015a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40510/0 (socket says 172.21.15.44:40510) 2024-09-13T18:27:34.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23be59c700 1 -- 172.21.15.44:0/3158543742 learned_addr learned my addr 172.21.15.44:0/3158543742 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:34.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23bf59e700 1 --2- 172.21.15.44:0/3158543742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23c0165590 0x7f23c015dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:34.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23bed9d700 1 --2- 172.21.15.44:0/3158543742 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23c00b3ae0 0x7f23c01f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:34.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23be59c700 1 -- 172.21.15.44:0/3158543742 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23c00b3ae0 msgr2=0x7f23c01f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:34.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23be59c700 1 --2- 172.21.15.44:0/3158543742 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23c00b3ae0 0x7f23c01f6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23be59c700 1 -- 172.21.15.44:0/3158543742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23c0165590 msgr2=0x7f23c015dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:34.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23be59c700 1 --2- 172.21.15.44:0/3158543742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23c0165590 0x7f23c015dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23be59c700 1 -- 172.21.15.44:0/3158543742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b80094b0 con 0x7f23c0160eb0 2024-09-13T18:27:34.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23be59c700 1 --2- 172.21.15.44:0/3158543742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23c0160eb0 0x7f23c015a160 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f23b000cbc0 tx=0x7f23b000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:34.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23b77fe700 1 -- 172.21.15.44:0/3158543742 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b000a770 con 0x7f23c0160eb0 2024-09-13T18:27:34.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23b77fe700 1 -- 172.21.15.44:0/3158543742 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b000a8d0 con 0x7f23c0160eb0 2024-09-13T18:27:34.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23c48c3700 1 -- 172.21.15.44:0/3158543742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c015e990 con 0x7f23c0160eb0 2024-09-13T18:27:34.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23b77fe700 1 -- 172.21.15.44:0/3158543742 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b000ac60 con 0x7f23c0160eb0 2024-09-13T18:27:34.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.751+0000 7f23c48c3700 1 -- 172.21.15.44:0/3158543742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c015ef50 con 0x7f23c0160eb0 2024-09-13T18:27:34.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.755+0000 7f23c48c3700 1 -- 172.21.15.44:0/3158543742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c015f140 con 0x7f23c0160eb0 2024-09-13T18:27:34.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.755+0000 7f23b77fe700 1 -- 172.21.15.44:0/3158543742 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f23b001b3b0 con 0x7f23c0160eb0 2024-09-13T18:27:34.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.755+0000 7f23b77fe700 1 --2- 172.21.15.44:0/3158543742 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f23a0066730 0x7f23a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:34.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.755+0000 7f23b77fe700 1 -- 172.21.15.44:0/3158543742 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23b0083c50 con 0x7f23c0160eb0 2024-09-13T18:27:34.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.755+0000 7f23bed9d700 1 --2- 172.21.15.44:0/3158543742 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f23a0066730 0x7f23a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:34.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.759+0000 7f23bed9d700 1 --2- 172.21.15.44:0/3158543742 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f23a0066730 0x7f23a0068bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f23a8000f60 tx=0x7f23a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:34.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.763+0000 7f23b77fe700 1 -- 172.21.15.44:0/3158543742 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f23b0089020 con 0x7f23c0160eb0 2024-09-13T18:27:34.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.939+0000 7f23c48c3700 1 -- 172.21.15.44:0/3158543742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23c00b33d0 con 0x7f23c0160eb0 2024-09-13T18:27:34.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.943+0000 7f23b77fe700 1 -- 172.21.15.44:0/3158543742 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f23b0050f40 con 0x7f23c0160eb0 2024-09-13T18:27:34.946 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:34.946 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:02.280221+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:34.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.943+0000 7f23c48c3700 1 -- 172.21.15.44:0/3158543742 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f23a0066730 msgr2=0x7f23a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:34.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.943+0000 7f23c48c3700 1 --2- 172.21.15.44:0/3158543742 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f23a0066730 0x7f23a0068bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f23a8000f60 tx=0x7f23a8009040 comp rx=0 tx=0).stop 2024-09-13T18:27:34.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.943+0000 7f23c48c3700 1 -- 172.21.15.44:0/3158543742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23c0160eb0 msgr2=0x7f23c015a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:34.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.943+0000 7f23c48c3700 1 --2- 172.21.15.44:0/3158543742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23c0160eb0 0x7f23c015a160 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f23b000cbc0 tx=0x7f23b000cbf0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.943+0000 7f23c48c3700 1 -- 172.21.15.44:0/3158543742 shutdown_connections 2024-09-13T18:27:34.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.943+0000 7f23c48c3700 1 --2- 172.21.15.44:0/3158543742 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f23a0066730 0x7f23a0068bf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.943+0000 7f23c48c3700 1 --2- 172.21.15.44:0/3158543742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23c0165590 0x7f23c015dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.943+0000 7f23c48c3700 1 --2- 172.21.15.44:0/3158543742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23c0160eb0 0x7f23c015a160 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.943+0000 7f23c48c3700 1 --2- 172.21.15.44:0/3158543742 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23c00b3ae0 0x7f23c01f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:34.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.943+0000 7f23c48c3700 1 -- 172.21.15.44:0/3158543742 >> 172.21.15.44:0/3158543742 conn(0x7f23c00b0f00 msgr2=0x7f23c00cca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:34.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.943+0000 7f23c48c3700 1 -- 172.21.15.44:0/3158543742 shutdown_connections 2024-09-13T18:27:34.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:34.943+0000 7f23c48c3700 1 -- 172.21.15.44:0/3158543742 wait complete. 2024-09-13T18:27:34.962 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:26:59.478511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:27:00.261038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:27:34.963 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:27:35.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.083+0000 7f3f4d145700 1 Processor -- start 2024-09-13T18:27:35.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.083+0000 7f3f4d145700 1 -- start start 2024-09-13T18:27:35.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.083+0000 7f3f4d145700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f4806ccf0 0x7f3f48159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.083+0000 7f3f4d145700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3f48070ba0 0x7f3f480720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.083+0000 7f3f4d145700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f48071030 con 0x7f3f4806d0d0 2024-09-13T18:27:35.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.083+0000 7f3f4d145700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f48071310 con 0x7f3f48070ba0 2024-09-13T18:27:35.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.083+0000 7f3f4d145700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f480715f0 con 0x7f3f4806ccf0 2024-09-13T18:27:35.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.083+0000 7f3f4c944700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3f4806d0d0 0x7f3f4815af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42458/0 (socket says 172.21.15.44:42458) 2024-09-13T18:27:35.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.087+0000 7f3f4c944700 1 -- 172.21.15.44:0/1734370558 learned_addr learned my addr 172.21.15.44:0/1734370558 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:35.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.087+0000 7f3f47fff700 1 --2- 172.21.15.44:0/1734370558 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f4806ccf0 0x7f3f48159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.087+0000 7f3f477fe700 1 --2- 172.21.15.44:0/1734370558 >> v2:172.21.15.99:3300/0 conn(0x7f3f48070ba0 0x7f3f480720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.087+0000 7f3f46ffd700 1 -- 172.21.15.44:0/1734370558 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1804681463 0 0) 0x7f3f48071030 con 0x7f3f4806d0d0 2024-09-13T18:27:35.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.087+0000 7f3f46ffd700 1 -- 172.21.15.44:0/1734370558 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f300057e0 con 0x7f3f4806d0d0 2024-09-13T18:27:35.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.087+0000 7f3f47fff700 1 -- 172.21.15.44:0/1734370558 >> v2:172.21.15.99:3300/0 conn(0x7f3f48070ba0 msgr2=0x7f3f480720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:35.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.087+0000 7f3f47fff700 1 --2- 172.21.15.44:0/1734370558 >> v2:172.21.15.99:3300/0 conn(0x7f3f48070ba0 0x7f3f480720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.087+0000 7f3f47fff700 1 -- 172.21.15.44:0/1734370558 >> v1:172.21.15.44:6789/0 conn(0x7f3f4806d0d0 legacy=0x7f3f4815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.087+0000 7f3f47fff700 1 -- 172.21.15.44:0/1734370558 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f480718d0 con 0x7f3f4806ccf0 2024-09-13T18:27:35.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.087+0000 7f3f477fe700 1 --2- 172.21.15.44:0/1734370558 >> v2:172.21.15.99:3300/0 conn(0x7f3f48070ba0 0x7f3f480720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:35.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.087+0000 7f3f47fff700 1 --2- 172.21.15.44:0/1734370558 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f4806ccf0 0x7f3f48159dd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009850 tx=0x7f3f38009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f327399b5bd481c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:35.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.087+0000 7f3f46ffd700 1 -- 172.21.15.44:0/1734370558 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f38011830 con 0x7f3f4806ccf0 2024-09-13T18:27:35.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.087+0000 7f3f46ffd700 1 -- 172.21.15.44:0/1734370558 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f38011990 con 0x7f3f4806ccf0 2024-09-13T18:27:35.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.087+0000 7f3f46ffd700 1 -- 172.21.15.44:0/1734370558 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f38011d00 con 0x7f3f4806ccf0 2024-09-13T18:27:35.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.087+0000 7f3f4d145700 1 -- 172.21.15.44:0/1734370558 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f4806ccf0 msgr2=0x7f3f48159dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.087+0000 7f3f4d145700 1 --2- 172.21.15.44:0/1734370558 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f4806ccf0 0x7f3f48159dd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009850 tx=0x7f3f38009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:35.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.087+0000 7f3f4d145700 1 -- 172.21.15.44:0/1734370558 shutdown_connections 2024-09-13T18:27:35.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.087+0000 7f3f4d145700 1 --2- 172.21.15.44:0/1734370558 >> v2:172.21.15.99:3300/0 conn(0x7f3f48070ba0 0x7f3f480720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.087+0000 7f3f4d145700 1 --2- 172.21.15.44:0/1734370558 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f4806ccf0 0x7f3f48159dd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.087+0000 7f3f4d145700 1 -- 172.21.15.44:0/1734370558 >> 172.21.15.44:0/1734370558 conn(0x7f3f480cfad0 msgr2=0x7f3f480cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:35.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.087+0000 7f3f4d145700 1 -- 172.21.15.44:0/1734370558 shutdown_connections 2024-09-13T18:27:35.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.087+0000 7f3f4d145700 1 -- 172.21.15.44:0/1734370558 wait complete. 2024-09-13T18:27:35.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.091+0000 7f3f4d145700 1 Processor -- start 2024-09-13T18:27:35.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.091+0000 7f3f4d145700 1 -- start start 2024-09-13T18:27:35.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.091+0000 7f3f4d145700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f4806ccf0 0x7f3f48149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.091+0000 7f3f4d145700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f4806d0d0 0x7f3f481460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.091+0000 7f3f4d145700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f481465e0 0x7f3f48158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.091+0000 7f3f4d145700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f48146a70 con 0x7f3f4806ccf0 2024-09-13T18:27:35.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.091+0000 7f3f4d145700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f481599b0 con 0x7f3f481465e0 2024-09-13T18:27:35.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.091+0000 7f3f4d145700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f48159c90 con 0x7f3f4806d0d0 2024-09-13T18:27:35.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.091+0000 7f3f47fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f4806ccf0 0x7f3f48149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.091+0000 7f3f47fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f4806ccf0 0x7f3f48149e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40514/0 (socket says 172.21.15.44:40514) 2024-09-13T18:27:35.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.091+0000 7f3f47fff700 1 -- 172.21.15.44:0/3757103461 learned_addr learned my addr 172.21.15.44:0/3757103461 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:35.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.095+0000 7f3f4c944700 1 --2- 172.21.15.44:0/3757103461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f481465e0 0x7f3f48158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.095+0000 7f3f477fe700 1 --2- 172.21.15.44:0/3757103461 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f4806d0d0 0x7f3f481460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.095+0000 7f3f47fff700 1 -- 172.21.15.44:0/3757103461 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f4806d0d0 msgr2=0x7f3f481460a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.095+0000 7f3f47fff700 1 --2- 172.21.15.44:0/3757103461 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f4806d0d0 0x7f3f481460a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.095+0000 7f3f47fff700 1 -- 172.21.15.44:0/3757103461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f481465e0 msgr2=0x7f3f48158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.095+0000 7f3f47fff700 1 --2- 172.21.15.44:0/3757103461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f481465e0 0x7f3f48158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.095+0000 7f3f47fff700 1 -- 172.21.15.44:0/3757103461 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c0094b0 con 0x7f3f4806ccf0 2024-09-13T18:27:35.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.095+0000 7f3f4c944700 1 --2- 172.21.15.44:0/3757103461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f481465e0 0x7f3f48158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:35.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.095+0000 7f3f47fff700 1 --2- 172.21.15.44:0/3757103461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f4806ccf0 0x7f3f48149e30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009ba0 tx=0x7f3f38004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:35.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.095+0000 7f3f44ff9700 1 -- 172.21.15.44:0/3757103461 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f380036c0 con 0x7f3f4806ccf0 2024-09-13T18:27:35.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.095+0000 7f3f4d145700 1 -- 172.21.15.44:0/3757103461 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f380094b0 con 0x7f3f4806ccf0 2024-09-13T18:27:35.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.095+0000 7f3f44ff9700 1 -- 172.21.15.44:0/3757103461 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3801e070 con 0x7f3f4806ccf0 2024-09-13T18:27:35.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.095+0000 7f3f44ff9700 1 -- 172.21.15.44:0/3757103461 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f38003a60 con 0x7f3f4806ccf0 2024-09-13T18:27:35.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.095+0000 7f3f4d145700 1 -- 172.21.15.44:0/3757103461 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f4815a250 con 0x7f3f4806ccf0 2024-09-13T18:27:35.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.095+0000 7f3f4d145700 1 -- 172.21.15.44:0/3757103461 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f480b39b0 con 0x7f3f4806ccf0 2024-09-13T18:27:35.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.095+0000 7f3f44ff9700 1 -- 172.21.15.44:0/3757103461 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3f38003bc0 con 0x7f3f4806ccf0 2024-09-13T18:27:35.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.095+0000 7f3f44ff9700 1 --2- 172.21.15.44:0/3757103461 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3f34066760 0x7f3f34068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.099+0000 7f3f44ff9700 1 -- 172.21.15.44:0/3757103461 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f38085060 con 0x7f3f4806ccf0 2024-09-13T18:27:35.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.099+0000 7f3f477fe700 1 --2- 172.21.15.44:0/3757103461 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3f34066760 0x7f3f34068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.099+0000 7f3f477fe700 1 --2- 172.21.15.44:0/3757103461 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3f34066760 0x7f3f34068c20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3f480ce9f0 tx=0x7f3f3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:35.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.107+0000 7f3f44ff9700 1 -- 172.21.15.44:0/3757103461 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3f380523e0 con 0x7f3f4806ccf0 2024-09-13T18:27:35.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.275+0000 7f3f4d145700 1 -- 172.21.15.44:0/3757103461 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3f48144070 con 0x7f3f4806ccf0 2024-09-13T18:27:35.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.275+0000 7f3f44ff9700 1 -- 172.21.15.44:0/3757103461 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3f38055a00 con 0x7f3f4806ccf0 2024-09-13T18:27:35.279 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:27:35.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.275+0000 7f3f4d145700 1 -- 172.21.15.44:0/3757103461 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3f34066760 msgr2=0x7f3f34068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.275+0000 7f3f4d145700 1 --2- 172.21.15.44:0/3757103461 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3f34066760 0x7f3f34068c20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3f480ce9f0 tx=0x7f3f3c008040 comp rx=0 tx=0).stop 2024-09-13T18:27:35.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.275+0000 7f3f4d145700 1 -- 172.21.15.44:0/3757103461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f4806ccf0 msgr2=0x7f3f48149e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.275+0000 7f3f4d145700 1 --2- 172.21.15.44:0/3757103461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f4806ccf0 0x7f3f48149e30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009ba0 tx=0x7f3f38004770 comp rx=0 tx=0).stop 2024-09-13T18:27:35.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.275+0000 7f3f4d145700 1 -- 172.21.15.44:0/3757103461 shutdown_connections 2024-09-13T18:27:35.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.275+0000 7f3f4d145700 1 --2- 172.21.15.44:0/3757103461 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3f34066760 0x7f3f34068c20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.275+0000 7f3f4d145700 1 --2- 172.21.15.44:0/3757103461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f481465e0 0x7f3f48158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.275+0000 7f3f4d145700 1 --2- 172.21.15.44:0/3757103461 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f4806d0d0 0x7f3f481460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.275+0000 7f3f4d145700 1 --2- 172.21.15.44:0/3757103461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f4806ccf0 0x7f3f48149e30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.275+0000 7f3f4d145700 1 -- 172.21.15.44:0/3757103461 >> 172.21.15.44:0/3757103461 conn(0x7f3f480cfad0 msgr2=0x7f3f48156180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:35.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.275+0000 7f3f4d145700 1 -- 172.21.15.44:0/3757103461 shutdown_connections 2024-09-13T18:27:35.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.275+0000 7f3f4d145700 1 -- 172.21.15.44:0/3757103461 wait complete. 2024-09-13T18:27:35.294 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:27:35.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b709d700 1 Processor -- start 2024-09-13T18:27:35.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b709d700 1 -- start start 2024-09-13T18:27:35.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b709d700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f32b01573e0 0x7f32b0070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b709d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f32b015a630 0x7f32b006c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b709d700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b0071540 con 0x7f32b00710e0 2024-09-13T18:27:35.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b709d700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b00cc1b0 con 0x7f32b015a630 2024-09-13T18:27:35.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b709d700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b015ac50 con 0x7f32b01573e0 2024-09-13T18:27:35.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b689c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f32b015a630 0x7f32b006c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b689c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f32b015a630 0x7f32b006c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40518/0 (socket says 172.21.15.44:40518) 2024-09-13T18:27:35.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b689c700 1 -- 172.21.15.44:0/1447364600 learned_addr learned my addr 172.21.15.44:0/1447364600 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:35.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b609b700 1 --2- 172.21.15.44:0/1447364600 >> v2:172.21.15.99:3300/0 conn(0x7f32b01573e0 0x7f32b0070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b689c700 1 -- 172.21.15.44:0/1447364600 >> v2:172.21.15.99:3300/0 conn(0x7f32b01573e0 msgr2=0x7f32b0070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:35.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b689c700 1 --2- 172.21.15.44:0/1447364600 >> v2:172.21.15.99:3300/0 conn(0x7f32b01573e0 0x7f32b0070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b689c700 1 -- 172.21.15.44:0/1447364600 >> v1:172.21.15.99:6789/0 conn(0x7f32b00710e0 legacy=0x7f32b0159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b689c700 1 -- 172.21.15.44:0/1447364600 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b00cb3f0 con 0x7f32b015a630 2024-09-13T18:27:35.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b689c700 1 --2- 172.21.15.44:0/1447364600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32b015a630 0x7f32b006c3e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f32b00b3ad0 tx=0x7f32a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37deec9539ae80d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:35.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b5099700 1 -- 172.21.15.44:0/1447364600 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a800e070 con 0x7f32b015a630 2024-09-13T18:27:35.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b5099700 1 -- 172.21.15.44:0/1447364600 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a800b910 con 0x7f32b015a630 2024-09-13T18:27:35.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b5099700 1 -- 172.21.15.44:0/1447364600 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a800bcc0 con 0x7f32b015a630 2024-09-13T18:27:35.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b709d700 1 -- 172.21.15.44:0/1447364600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32b015a630 msgr2=0x7f32b006c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b709d700 1 --2- 172.21.15.44:0/1447364600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32b015a630 0x7f32b006c3e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f32b00b3ad0 tx=0x7f32a800b330 comp rx=0 tx=0).stop 2024-09-13T18:27:35.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b709d700 1 -- 172.21.15.44:0/1447364600 shutdown_connections 2024-09-13T18:27:35.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b709d700 1 --2- 172.21.15.44:0/1447364600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32b015a630 0x7f32b006c3e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b709d700 1 --2- 172.21.15.44:0/1447364600 >> v2:172.21.15.99:3300/0 conn(0x7f32b01573e0 0x7f32b0070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b709d700 1 -- 172.21.15.44:0/1447364600 >> 172.21.15.44:0/1447364600 conn(0x7f32b00b0e10 msgr2=0x7f32b00b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:35.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b709d700 1 -- 172.21.15.44:0/1447364600 shutdown_connections 2024-09-13T18:27:35.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.415+0000 7f32b709d700 1 -- 172.21.15.44:0/1447364600 wait complete. 2024-09-13T18:27:35.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.419+0000 7f32b709d700 1 Processor -- start 2024-09-13T18:27:35.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.419+0000 7f32b709d700 1 -- start start 2024-09-13T18:27:35.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.419+0000 7f32b709d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f32b00710e0 0x7f32b0157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.419+0000 7f32b709d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32b01573e0 0x7f32b014f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.419+0000 7f32b709d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32b015a630 0x7f32b006fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.419+0000 7f32b709d700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b014fbb0 con 0x7f32b01573e0 2024-09-13T18:27:35.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.419+0000 7f32b709d700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b0070120 con 0x7f32b015a630 2024-09-13T18:27:35.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.419+0000 7f32b709d700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b01587b0 con 0x7f32b00710e0 2024-09-13T18:27:35.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.419+0000 7f32b589a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32b01573e0 0x7f32b014f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.419+0000 7f32b589a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32b01573e0 0x7f32b014f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40520/0 (socket says 172.21.15.44:40520) 2024-09-13T18:27:35.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.419+0000 7f32b589a700 1 -- 172.21.15.44:0/822601042 learned_addr learned my addr 172.21.15.44:0/822601042 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:35.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.419+0000 7f32b609b700 1 --2- 172.21.15.44:0/822601042 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f32b00710e0 0x7f32b0157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.419+0000 7f32b689c700 1 --2- 172.21.15.44:0/822601042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32b015a630 0x7f32b006fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.423+0000 7f32b589a700 1 -- 172.21.15.44:0/822601042 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f32b00710e0 msgr2=0x7f32b0157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.423+0000 7f32b589a700 1 --2- 172.21.15.44:0/822601042 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f32b00710e0 0x7f32b0157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.423+0000 7f32b589a700 1 -- 172.21.15.44:0/822601042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32b015a630 msgr2=0x7f32b006fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.423+0000 7f32b589a700 1 --2- 172.21.15.44:0/822601042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32b015a630 0x7f32b006fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.423+0000 7f32b589a700 1 -- 172.21.15.44:0/822601042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a8009b30 con 0x7f32b01573e0 2024-09-13T18:27:35.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.423+0000 7f32b609b700 1 --2- 172.21.15.44:0/822601042 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f32b00710e0 0x7f32b0157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:35.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.423+0000 7f32b589a700 1 --2- 172.21.15.44:0/822601042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32b01573e0 0x7f32b014f670 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00c530 tx=0x7f32ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:35.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.423+0000 7f32a2ffd700 1 -- 172.21.15.44:0/822601042 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac0052d0 con 0x7f32b01573e0 2024-09-13T18:27:35.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.423+0000 7f32a2ffd700 1 -- 172.21.15.44:0/822601042 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ac005430 con 0x7f32b01573e0 2024-09-13T18:27:35.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.423+0000 7f32b709d700 1 -- 172.21.15.44:0/822601042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b01f2650 con 0x7f32b01573e0 2024-09-13T18:27:35.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.423+0000 7f32a2ffd700 1 -- 172.21.15.44:0/822601042 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac0055a0 con 0x7f32b01573e0 2024-09-13T18:27:35.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.423+0000 7f32b709d700 1 -- 172.21.15.44:0/822601042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b01584d0 con 0x7f32b01573e0 2024-09-13T18:27:35.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.423+0000 7f32b709d700 1 -- 172.21.15.44:0/822601042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b0070ba0 con 0x7f32b01573e0 2024-09-13T18:27:35.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.423+0000 7f32a2ffd700 1 -- 172.21.15.44:0/822601042 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f32ac0038e0 con 0x7f32b01573e0 2024-09-13T18:27:35.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.423+0000 7f32a2ffd700 1 --2- 172.21.15.44:0/822601042 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3294066730 0x7f3294068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.427+0000 7f32a2ffd700 1 -- 172.21.15.44:0/822601042 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32ac0835d0 con 0x7f32b01573e0 2024-09-13T18:27:35.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.427+0000 7f32b609b700 1 --2- 172.21.15.44:0/822601042 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3294066730 0x7f3294068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.427+0000 7f32b609b700 1 --2- 172.21.15.44:0/822601042 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3294066730 0x7f3294068bf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009c40 tx=0x7f32a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:35.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.431+0000 7f32a2ffd700 1 -- 172.21.15.44:0/822601042 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f32ac0509d0 con 0x7f32b01573e0 2024-09-13T18:27:35.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.595+0000 7f32b709d700 1 -- 172.21.15.44:0/822601042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f32b015ca80 con 0x7f32b01573e0 2024-09-13T18:27:35.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.599+0000 7f32a2ffd700 1 -- 172.21.15.44:0/822601042 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f32ac053ff0 con 0x7f32b01573e0 2024-09-13T18:27:35.602 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:27:35.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.599+0000 7f32b709d700 1 -- 172.21.15.44:0/822601042 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3294066730 msgr2=0x7f3294068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.599+0000 7f32b709d700 1 --2- 172.21.15.44:0/822601042 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3294066730 0x7f3294068bf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009c40 tx=0x7f32a4008040 comp rx=0 tx=0).stop 2024-09-13T18:27:35.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.599+0000 7f32b709d700 1 -- 172.21.15.44:0/822601042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32b01573e0 msgr2=0x7f32b014f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.599+0000 7f32b709d700 1 --2- 172.21.15.44:0/822601042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32b01573e0 0x7f32b014f670 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00c530 tx=0x7f32ac00c8f0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.599+0000 7f32b709d700 1 -- 172.21.15.44:0/822601042 shutdown_connections 2024-09-13T18:27:35.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.599+0000 7f32b709d700 1 --2- 172.21.15.44:0/822601042 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3294066730 0x7f3294068bf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.599+0000 7f32b709d700 1 --2- 172.21.15.44:0/822601042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32b015a630 0x7f32b006fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.599+0000 7f32b709d700 1 --2- 172.21.15.44:0/822601042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32b01573e0 0x7f32b014f670 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.599+0000 7f32b709d700 1 --2- 172.21.15.44:0/822601042 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f32b00710e0 0x7f32b0157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.599+0000 7f32b709d700 1 -- 172.21.15.44:0/822601042 >> 172.21.15.44:0/822601042 conn(0x7f32b00b0e10 msgr2=0x7f32b014ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:35.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.599+0000 7f32b709d700 1 -- 172.21.15.44:0/822601042 shutdown_connections 2024-09-13T18:27:35.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.599+0000 7f32b709d700 1 -- 172.21.15.44:0/822601042 wait complete. 2024-09-13T18:27:35.617 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:27:35.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.735+0000 7f4503fff700 1 Processor -- start 2024-09-13T18:27:35.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.735+0000 7f4503fff700 1 -- start start 2024-09-13T18:27:35.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.735+0000 7f4503fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f450406bc80 0x7f450406a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.735+0000 7f4503fff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450415ad00 con 0x7f45040d18f0 2024-09-13T18:27:35.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.735+0000 7f4503fff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450415d770 con 0x7f450406ada0 2024-09-13T18:27:35.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.735+0000 7f4503fff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450415da50 con 0x7f450406bc80 2024-09-13T18:27:35.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.735+0000 7f4502ffd700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f45040d18f0 0x7f45040d1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42460/0 (socket says 172.21.15.44:42460) 2024-09-13T18:27:35.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.735+0000 7f4502ffd700 1 -- 172.21.15.44:0/4110071242 learned_addr learned my addr 172.21.15.44:0/4110071242 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:35.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.739+0000 7f45027fc700 1 --2- 172.21.15.44:0/4110071242 >> v2:172.21.15.99:3300/0 conn(0x7f450406bc80 0x7f450406a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.739+0000 7f4501ffb700 1 -- 172.21.15.44:0/4110071242 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420993855 0 0) 0x7f450415ad00 con 0x7f45040d18f0 2024-09-13T18:27:35.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.739+0000 7f4501ffb700 1 -- 172.21.15.44:0/4110071242 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44ec0035d0 con 0x7f45040d18f0 2024-09-13T18:27:35.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.739+0000 7f45027fc700 1 -- 172.21.15.44:0/4110071242 >> v1:172.21.15.99:6789/0 conn(0x7f450406ada0 legacy=0x7f45040cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.739+0000 7f45027fc700 1 -- 172.21.15.44:0/4110071242 >> v1:172.21.15.44:6789/0 conn(0x7f45040d18f0 legacy=0x7f45040d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.739+0000 7f45027fc700 1 -- 172.21.15.44:0/4110071242 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450415dd30 con 0x7f450406bc80 2024-09-13T18:27:35.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.739+0000 7f45027fc700 1 --2- 172.21.15.44:0/4110071242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f450406bc80 0x7f450406a860 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009850 tx=0x7f44f4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=747d11c1ac3ee62a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:35.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.739+0000 7f4501ffb700 1 -- 172.21.15.44:0/4110071242 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f4011830 con 0x7f450406bc80 2024-09-13T18:27:35.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.739+0000 7f4501ffb700 1 -- 172.21.15.44:0/4110071242 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f4011990 con 0x7f450406bc80 2024-09-13T18:27:35.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.739+0000 7f4501ffb700 1 -- 172.21.15.44:0/4110071242 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f4011d40 con 0x7f450406bc80 2024-09-13T18:27:35.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.739+0000 7f4503fff700 1 -- 172.21.15.44:0/4110071242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f450406bc80 msgr2=0x7f450406a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.739+0000 7f4503fff700 1 --2- 172.21.15.44:0/4110071242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f450406bc80 0x7f450406a860 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009850 tx=0x7f44f4009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:35.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.739+0000 7f4503fff700 1 -- 172.21.15.44:0/4110071242 shutdown_connections 2024-09-13T18:27:35.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.739+0000 7f4503fff700 1 --2- 172.21.15.44:0/4110071242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f450406bc80 0x7f450406a860 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.739+0000 7f4503fff700 1 -- 172.21.15.44:0/4110071242 >> 172.21.15.44:0/4110071242 conn(0x7f45040b4800 msgr2=0x7f45040b4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:35.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.739+0000 7f4503fff700 1 -- 172.21.15.44:0/4110071242 shutdown_connections 2024-09-13T18:27:35.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.739+0000 7f4503fff700 1 -- 172.21.15.44:0/4110071242 wait complete. 2024-09-13T18:27:35.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f4503fff700 1 Processor -- start 2024-09-13T18:27:35.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f4503fff700 1 -- start start 2024-09-13T18:27:35.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f4503fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f450406ada0 0x7f45041590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f4503fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f450406bc80 0x7f45040cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f4503fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f45040d18f0 0x7f45041f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f4503fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45040b22a0 con 0x7f450406bc80 2024-09-13T18:27:35.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f4503fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4504159680 con 0x7f450406ada0 2024-09-13T18:27:35.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f4503fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4504159960 con 0x7f45040d18f0 2024-09-13T18:27:35.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f45027fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f450406bc80 0x7f45040cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f4502ffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f450406ada0 0x7f45041590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f45027fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f450406bc80 0x7f45040cb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40532/0 (socket says 172.21.15.44:40532) 2024-09-13T18:27:35.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f45027fc700 1 -- 172.21.15.44:0/1598354557 learned_addr learned my addr 172.21.15.44:0/1598354557 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:35.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f45037fe700 1 --2- 172.21.15.44:0/1598354557 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f45040d18f0 0x7f45041f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f4502ffd700 1 -- 172.21.15.44:0/1598354557 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f45040d18f0 msgr2=0x7f45041f23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f4502ffd700 1 --2- 172.21.15.44:0/1598354557 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f45040d18f0 0x7f45041f23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f4502ffd700 1 -- 172.21.15.44:0/1598354557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f450406bc80 msgr2=0x7f45040cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f4502ffd700 1 --2- 172.21.15.44:0/1598354557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f450406bc80 0x7f45040cb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f4502ffd700 1 -- 172.21.15.44:0/1598354557 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f40094b0 con 0x7f450406ada0 2024-09-13T18:27:35.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f4502ffd700 1 --2- 172.21.15.44:0/1598354557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f450406ada0 0x7f45041590a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f44f800c440 tx=0x7f44f800c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:35.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f44eb7fe700 1 -- 172.21.15.44:0/1598354557 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8005d90 con 0x7f450406ada0 2024-09-13T18:27:35.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f44eb7fe700 1 -- 172.21.15.44:0/1598354557 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f800ce10 con 0x7f450406ada0 2024-09-13T18:27:35.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f4503fff700 1 -- 172.21.15.44:0/1598354557 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4504159c40 con 0x7f450406ada0 2024-09-13T18:27:35.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f44eb7fe700 1 -- 172.21.15.44:0/1598354557 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f80072d0 con 0x7f450406ada0 2024-09-13T18:27:35.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f4503fff700 1 -- 172.21.15.44:0/1598354557 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4504157ea0 con 0x7f450406ada0 2024-09-13T18:27:35.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.743+0000 7f4503fff700 1 -- 172.21.15.44:0/1598354557 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f450406a860 con 0x7f450406ada0 2024-09-13T18:27:35.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.747+0000 7f44eb7fe700 1 -- 172.21.15.44:0/1598354557 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f44f8007430 con 0x7f450406ada0 2024-09-13T18:27:35.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.747+0000 7f44eb7fe700 1 --2- 172.21.15.44:0/1598354557 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f44f0066730 0x7f44f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.747+0000 7f44eb7fe700 1 -- 172.21.15.44:0/1598354557 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44f80833e0 con 0x7f450406ada0 2024-09-13T18:27:35.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.747+0000 7f45027fc700 1 --2- 172.21.15.44:0/1598354557 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f44f0066730 0x7f44f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.747+0000 7f45027fc700 1 --2- 172.21.15.44:0/1598354557 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f44f0066730 0x7f44f0068bf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f450406b500 tx=0x7f44f4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:35.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.755+0000 7f44eb7fe700 1 -- 172.21.15.44:0/1598354557 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f44f8050890 con 0x7f450406ada0 2024-09-13T18:27:35.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.927+0000 7f4503fff700 1 -- 172.21.15.44:0/1598354557 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f45040c9380 con 0x7f450406ada0 2024-09-13T18:27:35.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.927+0000 7f44eb7fe700 1 -- 172.21.15.44:0/1598354557 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f44f8020020 con 0x7f450406ada0 2024-09-13T18:27:35.932 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:27:35.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.931+0000 7f4503fff700 1 -- 172.21.15.44:0/1598354557 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f44f0066730 msgr2=0x7f44f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.931+0000 7f4503fff700 1 --2- 172.21.15.44:0/1598354557 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f44f0066730 0x7f44f0068bf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f450406b500 tx=0x7f44f4008030 comp rx=0 tx=0).stop 2024-09-13T18:27:35.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.931+0000 7f4503fff700 1 -- 172.21.15.44:0/1598354557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f450406ada0 msgr2=0x7f45041590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.931+0000 7f4503fff700 1 --2- 172.21.15.44:0/1598354557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f450406ada0 0x7f45041590a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f44f800c440 tx=0x7f44f800c750 comp rx=0 tx=0).stop 2024-09-13T18:27:35.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.931+0000 7f4503fff700 1 -- 172.21.15.44:0/1598354557 shutdown_connections 2024-09-13T18:27:35.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.931+0000 7f4503fff700 1 --2- 172.21.15.44:0/1598354557 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f44f0066730 0x7f44f0068bf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.931+0000 7f4503fff700 1 --2- 172.21.15.44:0/1598354557 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f45040d18f0 0x7f45041f23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.931+0000 7f4503fff700 1 --2- 172.21.15.44:0/1598354557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f450406bc80 0x7f45040cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.931+0000 7f4503fff700 1 --2- 172.21.15.44:0/1598354557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f450406ada0 0x7f45041590a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.931+0000 7f4503fff700 1 -- 172.21.15.44:0/1598354557 >> 172.21.15.44:0/1598354557 conn(0x7f45040b4800 msgr2=0x7f45040d1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:35.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.931+0000 7f4503fff700 1 -- 172.21.15.44:0/1598354557 shutdown_connections 2024-09-13T18:27:35.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:35.931+0000 7f4503fff700 1 -- 172.21.15.44:0/1598354557 wait complete. 2024-09-13T18:27:35.953 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty' 2024-09-13T18:27:36.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c5bfff700 1 Processor -- start 2024-09-13T18:27:36.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c5bfff700 1 -- start start 2024-09-13T18:27:36.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c5bfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c5c06baa0 0x7f1c5c06ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:36.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c5bfff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c5c15d160 con 0x7f1c5c15cd80 2024-09-13T18:27:36.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c5bfff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c5c0d2120 con 0x7f1c5c0ce240 2024-09-13T18:27:36.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c5bfff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c0d1570 con 0x7f1c5c06baa0 2024-09-13T18:27:36.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c5affd700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1c5c15cd80 0x7f1c5c06a640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42470/0 (socket says 172.21.15.44:42470) 2024-09-13T18:27:36.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c5affd700 1 -- 172.21.15.44:0/1526737683 learned_addr learned my addr 172.21.15.44:0/1526737683 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:36.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c5a7fc700 1 --2- 172.21.15.44:0/1526737683 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c5c06baa0 0x7f1c5c06ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:36.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c59ffb700 1 -- 172.21.15.44:0/1526737683 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3175702321 0 0) 0x7f1c5c15d160 con 0x7f1c5c15cd80 2024-09-13T18:27:36.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c59ffb700 1 -- 172.21.15.44:0/1526737683 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c3c0035d0 con 0x7f1c5c15cd80 2024-09-13T18:27:36.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c59ffb700 1 -- 172.21.15.44:0/1526737683 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4134563758 0 0) 0x7f1c3c0035d0 con 0x7f1c5c15cd80 2024-09-13T18:27:36.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c59ffb700 1 -- 172.21.15.44:0/1526737683 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c5c06baa0 msgr2=0x7f1c5c06ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:36.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c59ffb700 1 --2- 172.21.15.44:0/1526737683 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c5c06baa0 0x7f1c5c06ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c59ffb700 1 -- 172.21.15.44:0/1526737683 >> v1:172.21.15.99:6789/0 conn(0x7f1c5c0ce240 legacy=0x7f1c5c0ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:36.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c59ffb700 1 -- 172.21.15.44:0/1526737683 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c0d25b0 con 0x7f1c5c15cd80 2024-09-13T18:27:36.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c59ffb700 1 -- 172.21.15.44:0/1526737683 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f1c540019f0 con 0x7f1c5c15cd80 2024-09-13T18:27:36.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c59ffb700 1 -- 172.21.15.44:0/1526737683 >> v1:172.21.15.44:6789/0 conn(0x7f1c5c15cd80 legacy=0x7f1c5c06a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:36.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c59ffb700 1 --2- 172.21.15.44:0/1526737683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c3c003a50 0x7f1c3c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:36.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c59ffb700 1 --2- 172.21.15.44:0/1526737683 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c5c06baa0 0x7f1c3c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:36.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c59ffb700 1 --2- 172.21.15.44:0/1526737683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c3c004db0 0x7f1c3c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:36.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c59ffb700 1 -- 172.21.15.44:0/1526737683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c0d1570 con 0x7f1c3c003a50 2024-09-13T18:27:36.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c59ffb700 1 -- 172.21.15.44:0/1526737683 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c00bba0 con 0x7f1c3c004db0 2024-09-13T18:27:36.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c59ffb700 1 -- 172.21.15.44:0/1526737683 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c00bd60 con 0x7f1c5c06baa0 2024-09-13T18:27:36.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c5affd700 1 --2- 172.21.15.44:0/1526737683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c3c003a50 0x7f1c3c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:36.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c5a7fc700 1 --2- 172.21.15.44:0/1526737683 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c5c06baa0 0x7f1c3c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:36.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c5affd700 1 -- 172.21.15.44:0/1526737683 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c5c06baa0 msgr2=0x7f1c3c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:36.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c5b7fe700 1 --2- 172.21.15.44:0/1526737683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c3c004db0 0x7f1c3c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:36.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c5affd700 1 --2- 172.21.15.44:0/1526737683 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c5c06baa0 0x7f1c3c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c5affd700 1 -- 172.21.15.44:0/1526737683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c3c004db0 msgr2=0x7f1c3c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:36.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c5affd700 1 --2- 172.21.15.44:0/1526737683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c3c004db0 0x7f1c3c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c5affd700 1 -- 172.21.15.44:0/1526737683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3c0035d0 con 0x7f1c3c003a50 2024-09-13T18:27:36.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c5b7fe700 1 --2- 172.21.15.44:0/1526737683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c3c004db0 0x7f1c3c005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:36.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.063+0000 7f1c5affd700 1 --2- 172.21.15.44:0/1526737683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c3c003a50 0x7f1c3c003e70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1c54002230 tx=0x7f1c3c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31e15ab4bcc1d0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:36.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.067+0000 7f1c59ffb700 1 -- 172.21.15.44:0/1526737683 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5400a2f0 con 0x7f1c3c003a50 2024-09-13T18:27:36.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.067+0000 7f1c59ffb700 1 -- 172.21.15.44:0/1526737683 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5400ae90 con 0x7f1c3c003a50 2024-09-13T18:27:36.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.067+0000 7f1c59ffb700 1 -- 172.21.15.44:0/1526737683 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54007510 con 0x7f1c3c003a50 2024-09-13T18:27:36.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.067+0000 7f1c5bfff700 1 -- 172.21.15.44:0/1526737683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c3c003a50 msgr2=0x7f1c3c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:36.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.067+0000 7f1c5bfff700 1 --2- 172.21.15.44:0/1526737683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c3c003a50 0x7f1c3c003e70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1c54002230 tx=0x7f1c3c0058a0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.067+0000 7f1c5b7fe700 1 -- 172.21.15.44:0/1526737683 reap_dead start 2024-09-13T18:27:36.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.067+0000 7f1c5bfff700 1 -- 172.21.15.44:0/1526737683 shutdown_connections 2024-09-13T18:27:36.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.067+0000 7f1c5bfff700 1 -- 172.21.15.44:0/1526737683 >> 172.21.15.44:0/1526737683 conn(0x7f1c5c0d30b0 msgr2=0x7f1c5c0d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:36.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.067+0000 7f1c5bfff700 1 -- 172.21.15.44:0/1526737683 shutdown_connections 2024-09-13T18:27:36.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.067+0000 7f1c5bfff700 1 -- 172.21.15.44:0/1526737683 wait complete. 2024-09-13T18:27:36.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.067+0000 7f1c5bfff700 1 Processor -- start 2024-09-13T18:27:36.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.067+0000 7f1c5bfff700 1 -- start start 2024-09-13T18:27:36.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c5bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c3c003a50 0x7f1c5c15e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:36.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c5bfff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c5c159460 0x7f1c5c1598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:36.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c5bfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c5c155ed0 0x7f1c5c156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:36.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c5bfff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c159e00 con 0x7f1c3c003a50 2024-09-13T18:27:36.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c5bfff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c156870 con 0x7f1c5c159460 2024-09-13T18:27:36.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c5bfff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c0c9d60 con 0x7f1c5c155ed0 2024-09-13T18:27:36.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c5affd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c3c003a50 0x7f1c5c15e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:36.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c5affd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c3c003a50 0x7f1c5c15e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40556/0 (socket says 172.21.15.44:40556) 2024-09-13T18:27:36.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c5affd700 1 -- 172.21.15.44:0/2785917180 learned_addr learned my addr 172.21.15.44:0/2785917180 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:36.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c5b7fe700 1 --2- 172.21.15.44:0/2785917180 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c5c155ed0 0x7f1c5c156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:36.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c5a7fc700 1 --2- 172.21.15.44:0/2785917180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c5c159460 0x7f1c5c1598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:36.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c5affd700 1 -- 172.21.15.44:0/2785917180 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c5c155ed0 msgr2=0x7f1c5c156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:36.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c5affd700 1 --2- 172.21.15.44:0/2785917180 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c5c155ed0 0x7f1c5c156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c5affd700 1 -- 172.21.15.44:0/2785917180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c5c159460 msgr2=0x7f1c5c1598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:36.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c5affd700 1 --2- 172.21.15.44:0/2785917180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c5c159460 0x7f1c5c1598c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c5affd700 1 -- 172.21.15.44:0/2785917180 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c0cabc0 con 0x7f1c3c003a50 2024-09-13T18:27:36.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c5affd700 1 --2- 172.21.15.44:0/2785917180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c3c003a50 0x7f1c5c15e840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00bb70 tx=0x7f1c5c0b5de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:36.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c537fe700 1 -- 172.21.15.44:0/2785917180 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5400a2f0 con 0x7f1c3c003a50 2024-09-13T18:27:36.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c537fe700 1 -- 172.21.15.44:0/2785917180 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5401f600 con 0x7f1c3c003a50 2024-09-13T18:27:36.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c5bfff700 1 -- 172.21.15.44:0/2785917180 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c5c0c9fb0 con 0x7f1c3c003a50 2024-09-13T18:27:36.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c537fe700 1 -- 172.21.15.44:0/2785917180 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5401f990 con 0x7f1c3c003a50 2024-09-13T18:27:36.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c5bfff700 1 -- 172.21.15.44:0/2785917180 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5c0ca570 con 0x7f1c3c003a50 2024-09-13T18:27:36.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c5bfff700 1 -- 172.21.15.44:0/2785917180 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c5c0ce6f0 con 0x7f1c3c003a50 2024-09-13T18:27:36.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.071+0000 7f1c537fe700 1 -- 172.21.15.44:0/2785917180 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c5401a030 con 0x7f1c3c003a50 2024-09-13T18:27:36.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.075+0000 7f1c537fe700 1 --2- 172.21.15.44:0/2785917180 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c40066760 0x7f1c40068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:36.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.075+0000 7f1c537fe700 1 -- 172.21.15.44:0/2785917180 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c54085f00 con 0x7f1c3c003a50 2024-09-13T18:27:36.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.075+0000 7f1c5a7fc700 1 --2- 172.21.15.44:0/2785917180 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c40066760 0x7f1c40068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:36.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.075+0000 7f1c5a7fc700 1 --2- 172.21.15.44:0/2785917180 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c40066760 0x7f1c40068c20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0d0650 tx=0x7f1c44008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:36.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.083+0000 7f1c537fe700 1 -- 172.21.15.44:0/2785917180 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1c54053450 con 0x7f1c3c003a50 2024-09-13T18:27:36.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.315+0000 7f1c5bfff700 1 -- 172.21.15.44:0/2785917180 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty"]} v 0) v1 -- 0x7f1c5c159e00 con 0x7f1c3c003a50 2024-09-13T18:27:36.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.515+0000 7f1c537fe700 1 -- 172.21.15.44:0/2785917180 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty"]}]=0 v54) v1 ==== 153+0+0 (secure 0 0 0) 0x7f1c54056a70 con 0x7f1c3c003a50 2024-09-13T18:27:36.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.519+0000 7f1c5bfff700 1 -- 172.21.15.44:0/2785917180 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c40066760 msgr2=0x7f1c40068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:36.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.519+0000 7f1c5bfff700 1 --2- 172.21.15.44:0/2785917180 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c40066760 0x7f1c40068c20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0d0650 tx=0x7f1c44008040 comp rx=0 tx=0).stop 2024-09-13T18:27:36.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.519+0000 7f1c5bfff700 1 -- 172.21.15.44:0/2785917180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c3c003a50 msgr2=0x7f1c5c15e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:36.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.523+0000 7f1c5bfff700 1 --2- 172.21.15.44:0/2785917180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c3c003a50 0x7f1c5c15e840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00bb70 tx=0x7f1c5c0b5de0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.523+0000 7f1c5bfff700 1 -- 172.21.15.44:0/2785917180 shutdown_connections 2024-09-13T18:27:36.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.523+0000 7f1c5bfff700 1 --2- 172.21.15.44:0/2785917180 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c40066760 0x7f1c40068c20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.523+0000 7f1c5bfff700 1 --2- 172.21.15.44:0/2785917180 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c5c155ed0 0x7f1c5c156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.523+0000 7f1c5bfff700 1 --2- 172.21.15.44:0/2785917180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c5c159460 0x7f1c5c1598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.523+0000 7f1c5bfff700 1 --2- 172.21.15.44:0/2785917180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c3c003a50 0x7f1c5c15e840 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.523+0000 7f1c5bfff700 1 -- 172.21.15.44:0/2785917180 >> 172.21.15.44:0/2785917180 conn(0x7f1c5c0d30b0 msgr2=0x7f1c5c0b3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:36.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.523+0000 7f1c5bfff700 1 -- 172.21.15.44:0/2785917180 shutdown_connections 2024-09-13T18:27:36.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.523+0000 7f1c5bfff700 1 -- 172.21.15.44:0/2785917180 wait complete. 2024-09-13T18:27:36.543 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:27:36.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.675+0000 7fc466491700 1 Processor -- start 2024-09-13T18:27:36.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.675+0000 7fc466491700 1 -- start start 2024-09-13T18:27:36.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.675+0000 7fc466491700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc460140e40 0x7fc460071430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:36.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.675+0000 7fc466491700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc46015bcb0 0x7fc46006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:36.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.675+0000 7fc466491700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc46015c150 con 0x7fc46006e930 2024-09-13T18:27:36.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.675+0000 7fc466491700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc46006ede0 con 0x7fc46015bcb0 2024-09-13T18:27:36.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.675+0000 7fc466491700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc460071d30 con 0x7fc460140e40 2024-09-13T18:27:36.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.675+0000 7fc45ffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc460140e40 0x7fc460071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:36.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.675+0000 7fc45f7fe700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc46015bcb0 0x7fc46006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:36.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.675+0000 7fc45ffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc460140e40 0x7fc460071430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:48772/0 (socket says 172.21.15.44:48772) 2024-09-13T18:27:36.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.675+0000 7fc464a2e700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc46006e930 0x7fc46015e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:33760/0 (socket says 172.21.15.44:33760) 2024-09-13T18:27:36.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.675+0000 7fc45f7fe700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc46015bcb0 0x7fc46006e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:55808/0 (socket says 172.21.15.44:55808) 2024-09-13T18:27:36.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.675+0000 7fc45ffff700 1 -- 172.21.15.44:0/2907382197 learned_addr learned my addr 172.21.15.44:0/2907382197 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:36.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.675+0000 7fc45effd700 1 -- 172.21.15.44:0/2907382197 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996143371 0 0) 0x7fc46015c150 con 0x7fc46006e930 2024-09-13T18:27:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.675+0000 7fc45effd700 1 -- 172.21.15.44:0/2907382197 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4480035d0 con 0x7fc46006e930 2024-09-13T18:27:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.675+0000 7fc45f7fe700 1 -- 172.21.15.44:0/2907382197 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc460140e40 msgr2=0x7fc460071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.675+0000 7fc45f7fe700 1 --2- 172.21.15.44:0/2907382197 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc460140e40 0x7fc460071430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.675+0000 7fc45f7fe700 1 -- 172.21.15.44:0/2907382197 >> v1:172.21.15.99:6789/0 conn(0x7fc46006e930 legacy=0x7fc46015e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.679+0000 7fc45f7fe700 1 -- 172.21.15.44:0/2907382197 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc460072010 con 0x7fc46015bcb0 2024-09-13T18:27:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.679+0000 7fc45ffff700 1 --2- 172.21.15.44:0/2907382197 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc460140e40 0x7fc460071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.679+0000 7fc45f7fe700 1 --2- 172.21.15.44:0/2907382197 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc46015bcb0 0x7fc46006e3f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc454009850 tx=0x7fc454009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d48a10ea1699b07 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:36.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.679+0000 7fc45effd700 1 -- 172.21.15.44:0/2907382197 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454011830 con 0x7fc46015bcb0 2024-09-13T18:27:36.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.679+0000 7fc45effd700 1 -- 172.21.15.44:0/2907382197 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc454011990 con 0x7fc46015bcb0 2024-09-13T18:27:36.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.679+0000 7fc45effd700 1 -- 172.21.15.44:0/2907382197 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454011d00 con 0x7fc46015bcb0 2024-09-13T18:27:36.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.679+0000 7fc466491700 1 -- 172.21.15.44:0/2907382197 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc46015bcb0 msgr2=0x7fc46006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.679+0000 7fc466491700 1 --2- 172.21.15.44:0/2907382197 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc46015bcb0 0x7fc46006e3f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc454009850 tx=0x7fc454009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.679+0000 7fc466491700 1 -- 172.21.15.44:0/2907382197 shutdown_connections 2024-09-13T18:27:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.679+0000 7fc466491700 1 --2- 172.21.15.44:0/2907382197 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc46015bcb0 0x7fc46006e3f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.679+0000 7fc466491700 1 --2- 172.21.15.44:0/2907382197 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc460140e40 0x7fc460071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.679+0000 7fc466491700 1 -- 172.21.15.44:0/2907382197 >> 172.21.15.44:0/2907382197 conn(0x7fc46006d900 msgr2=0x7fc46006dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.679+0000 7fc466491700 1 -- 172.21.15.44:0/2907382197 shutdown_connections 2024-09-13T18:27:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.679+0000 7fc466491700 1 -- 172.21.15.44:0/2907382197 wait complete. 2024-09-13T18:27:36.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc466491700 1 Processor -- start 2024-09-13T18:27:36.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc466491700 1 -- start start 2024-09-13T18:27:36.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc466491700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc46006e930 0x7fc4601e4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:36.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc466491700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc460140e40 0x7fc4601e4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:36.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc466491700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc46015bcb0 0x7fc4601efd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:36.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc466491700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc460133c70 con 0x7fc46015bcb0 2024-09-13T18:27:36.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc466491700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4601e1c60 con 0x7fc460140e40 2024-09-13T18:27:36.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc466491700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc46015a290 con 0x7fc46006e930 2024-09-13T18:27:36.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc464a2e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc46015bcb0 0x7fc4601efd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:36.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc464a2e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc46015bcb0 0x7fc4601efd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40558/0 (socket says 172.21.15.44:40558) 2024-09-13T18:27:36.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc464a2e700 1 -- 172.21.15.44:0/948055200 learned_addr learned my addr 172.21.15.44:0/948055200 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:36.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc45ffff700 1 --2- 172.21.15.44:0/948055200 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc46006e930 0x7fc4601e4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:36.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc45f7fe700 1 --2- 172.21.15.44:0/948055200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc460140e40 0x7fc4601e4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc464a2e700 1 -- 172.21.15.44:0/948055200 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc46006e930 msgr2=0x7fc4601e4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc464a2e700 1 --2- 172.21.15.44:0/948055200 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc46006e930 0x7fc4601e4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc464a2e700 1 -- 172.21.15.44:0/948055200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc460140e40 msgr2=0x7fc4601e4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc464a2e700 1 --2- 172.21.15.44:0/948055200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc460140e40 0x7fc4601e4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc464a2e700 1 -- 172.21.15.44:0/948055200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc450009b30 con 0x7fc46015bcb0 2024-09-13T18:27:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc464a2e700 1 --2- 172.21.15.44:0/948055200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc46015bcb0 0x7fc4601efd30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc45800c4f0 tx=0x7fc45800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc45cff9700 1 -- 172.21.15.44:0/948055200 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc458005cd0 con 0x7fc46015bcb0 2024-09-13T18:27:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc466491700 1 -- 172.21.15.44:0/948055200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4540094b0 con 0x7fc46015bcb0 2024-09-13T18:27:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc45cff9700 1 -- 172.21.15.44:0/948055200 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc458005e30 con 0x7fc46015bcb0 2024-09-13T18:27:36.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc45cff9700 1 -- 172.21.15.44:0/948055200 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4580072d0 con 0x7fc46015bcb0 2024-09-13T18:27:36.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.683+0000 7fc466491700 1 -- 172.21.15.44:0/948055200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4600cefc0 con 0x7fc46015bcb0 2024-09-13T18:27:36.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.687+0000 7fc466491700 1 -- 172.21.15.44:0/948055200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4600cd530 con 0x7fc46015bcb0 2024-09-13T18:27:36.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.687+0000 7fc45cff9700 1 -- 172.21.15.44:0/948055200 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc458007430 con 0x7fc46015bcb0 2024-09-13T18:27:36.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.687+0000 7fc45cff9700 1 --2- 172.21.15.44:0/948055200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc44c066730 0x7fc44c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:36.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.687+0000 7fc45cff9700 1 -- 172.21.15.44:0/948055200 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc458083420 con 0x7fc46015bcb0 2024-09-13T18:27:36.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.687+0000 7fc45ffff700 1 --2- 172.21.15.44:0/948055200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc44c066730 0x7fc44c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:36.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.691+0000 7fc45ffff700 1 --2- 172.21.15.44:0/948055200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc44c066730 0x7fc44c068bf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc4500072c0 tx=0x7fc45000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:36.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.695+0000 7fc45cff9700 1 -- 172.21.15.44:0/948055200 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc458050850 con 0x7fc46015bcb0 2024-09-13T18:27:36.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.871+0000 7fc466491700 1 -- 172.21.15.44:0/948055200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc46006ac50 con 0x7fc46015bcb0 2024-09-13T18:27:36.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.879+0000 7fc45cff9700 1 -- 172.21.15.44:0/948055200 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc458053e70 con 0x7fc46015bcb0 2024-09-13T18:27:36.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.879+0000 7fc466491700 1 -- 172.21.15.44:0/948055200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc44c066730 msgr2=0x7fc44c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:36.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.879+0000 7fc466491700 1 --2- 172.21.15.44:0/948055200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc44c066730 0x7fc44c068bf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc4500072c0 tx=0x7fc45000b040 comp rx=0 tx=0).stop 2024-09-13T18:27:36.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.879+0000 7fc466491700 1 -- 172.21.15.44:0/948055200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc46015bcb0 msgr2=0x7fc4601efd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:36.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.879+0000 7fc466491700 1 --2- 172.21.15.44:0/948055200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc46015bcb0 0x7fc4601efd30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc45800c4f0 tx=0x7fc45800c800 comp rx=0 tx=0).stop 2024-09-13T18:27:36.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.883+0000 7fc466491700 1 -- 172.21.15.44:0/948055200 shutdown_connections 2024-09-13T18:27:36.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.883+0000 7fc466491700 1 --2- 172.21.15.44:0/948055200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc44c066730 0x7fc44c068bf0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.883+0000 7fc466491700 1 --2- 172.21.15.44:0/948055200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc46015bcb0 0x7fc4601efd30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.883+0000 7fc466491700 1 --2- 172.21.15.44:0/948055200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc460140e40 0x7fc4601e4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.883+0000 7fc466491700 1 --2- 172.21.15.44:0/948055200 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc46006e930 0x7fc4601e4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.883+0000 7fc466491700 1 -- 172.21.15.44:0/948055200 >> 172.21.15.44:0/948055200 conn(0x7fc46006d900 msgr2=0x7fc46006bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:36.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.883+0000 7fc466491700 1 -- 172.21.15.44:0/948055200 shutdown_connections 2024-09-13T18:27:36.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:36.883+0000 7fc466491700 1 -- 172.21.15.44:0/948055200 wait complete. 2024-09-13T18:27:36.900 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:27:36.900 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:27:36.914 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:27:36.934 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:27:36.934 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:27:36.934 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:27:36.941 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:27:36.942 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:27:36.993 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:37.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.103+0000 7f99a562c700 1 Processor -- start 2024-09-13T18:27:37.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.103+0000 7f99a562c700 1 -- start start 2024-09-13T18:27:37.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.103+0000 7f99a562c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f99a006acc0 0x7f99a015ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:37.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.103+0000 7f99a562c700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a013dcb0 con 0x7f99a00b3ae0 2024-09-13T18:27:37.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.103+0000 7f99a562c700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a013ffd0 con 0x7f99a006bbf0 2024-09-13T18:27:37.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.103+0000 7f99a562c700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a006b110 con 0x7f99a006acc0 2024-09-13T18:27:37.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.103+0000 7f99a4e2b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f99a006acc0 0x7f99a015ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:37.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.103+0000 7f999f7fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f99a00b3ae0 0x7f99a006a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42482/0 (socket says 172.21.15.44:42482) 2024-09-13T18:27:37.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.103+0000 7f999f7fe700 1 -- 172.21.15.44:0/4109099429 learned_addr learned my addr 172.21.15.44:0/4109099429 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:37.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.103+0000 7f99a4e2b700 1 -- 172.21.15.44:0/4109099429 >> v1:172.21.15.99:6789/0 conn(0x7f99a006bbf0 legacy=0x7f99a00b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:37.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.103+0000 7f99a4e2b700 1 -- 172.21.15.44:0/4109099429 >> v1:172.21.15.44:6789/0 conn(0x7f99a00b3ae0 legacy=0x7f99a006a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:37.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.103+0000 7f99a4e2b700 1 -- 172.21.15.44:0/4109099429 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a0140220 con 0x7f99a006acc0 2024-09-13T18:27:37.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.103+0000 7f999effd700 1 -- 172.21.15.44:0/4109099429 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4203158995 0 0) 0x7f99a013dcb0 con 0x7f99a00b3ae0 2024-09-13T18:27:37.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.103+0000 7f99a4e2b700 1 --2- 172.21.15.44:0/4109099429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99a006acc0 0x7f99a015ae50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9998009d90 tx=0x7f999800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c534f9fd1d442f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:37.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.103+0000 7f999effd700 1 -- 172.21.15.44:0/4109099429 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999800e070 con 0x7f99a006acc0 2024-09-13T18:27:37.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.103+0000 7f999effd700 1 -- 172.21.15.44:0/4109099429 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999800bbd0 con 0x7f99a006acc0 2024-09-13T18:27:37.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.103+0000 7f999effd700 1 -- 172.21.15.44:0/4109099429 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998012430 con 0x7f99a006acc0 2024-09-13T18:27:37.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.107+0000 7f99a562c700 1 -- 172.21.15.44:0/4109099429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99a006acc0 msgr2=0x7f99a015ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:37.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.107+0000 7f99a562c700 1 --2- 172.21.15.44:0/4109099429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99a006acc0 0x7f99a015ae50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9998009d90 tx=0x7f999800b330 comp rx=0 tx=0).stop 2024-09-13T18:27:37.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.107+0000 7f99a562c700 1 -- 172.21.15.44:0/4109099429 shutdown_connections 2024-09-13T18:27:37.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.107+0000 7f99a562c700 1 --2- 172.21.15.44:0/4109099429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99a006acc0 0x7f99a015ae50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.107+0000 7f99a562c700 1 -- 172.21.15.44:0/4109099429 >> 172.21.15.44:0/4109099429 conn(0x7f99a00b0f00 msgr2=0x7f99a00b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:37.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.107+0000 7f99a562c700 1 -- 172.21.15.44:0/4109099429 shutdown_connections 2024-09-13T18:27:37.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.107+0000 7f99a562c700 1 -- 172.21.15.44:0/4109099429 wait complete. 2024-09-13T18:27:37.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.107+0000 7f99a562c700 1 Processor -- start 2024-09-13T18:27:37.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.107+0000 7f99a562c700 1 -- start start 2024-09-13T18:27:37.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.111+0000 7f99a562c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99a006acc0 0x7f99a0151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:37.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.111+0000 7f99a562c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f99a006bbf0 0x7f99a013a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:37.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.111+0000 7f99a562c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99a00b3ae0 0x7f99a013ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:37.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.111+0000 7f99a562c700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a0139a30 con 0x7f99a00b3ae0 2024-09-13T18:27:37.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.111+0000 7f99a562c700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a0139d10 con 0x7f99a006acc0 2024-09-13T18:27:37.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.111+0000 7f99a562c700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a0139ff0 con 0x7f99a006bbf0 2024-09-13T18:27:37.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.111+0000 7f99a4e2b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99a00b3ae0 0x7f99a013ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:37.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.111+0000 7f99a4e2b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99a00b3ae0 0x7f99a013ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40574/0 (socket says 172.21.15.44:40574) 2024-09-13T18:27:37.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.111+0000 7f99a4e2b700 1 -- 172.21.15.44:0/1485489189 learned_addr learned my addr 172.21.15.44:0/1485489189 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:37.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.111+0000 7f999f7fe700 1 --2- 172.21.15.44:0/1485489189 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f99a006bbf0 0x7f99a013a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:37.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.111+0000 7f999ffff700 1 --2- 172.21.15.44:0/1485489189 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99a006acc0 0x7f99a0151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:37.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.111+0000 7f99a4e2b700 1 -- 172.21.15.44:0/1485489189 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f99a006bbf0 msgr2=0x7f99a013a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:37.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.111+0000 7f99a4e2b700 1 --2- 172.21.15.44:0/1485489189 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f99a006bbf0 0x7f99a013a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.111+0000 7f99a4e2b700 1 -- 172.21.15.44:0/1485489189 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99a006acc0 msgr2=0x7f99a0151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:37.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.111+0000 7f99a4e2b700 1 --2- 172.21.15.44:0/1485489189 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99a006acc0 0x7f99a0151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.111+0000 7f99a4e2b700 1 -- 172.21.15.44:0/1485489189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9998009a70 con 0x7f99a00b3ae0 2024-09-13T18:27:37.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.111+0000 7f999ffff700 1 --2- 172.21.15.44:0/1485489189 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99a006acc0 0x7f99a0151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:37.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.111+0000 7f99a4e2b700 1 --2- 172.21.15.44:0/1485489189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99a00b3ae0 0x7f99a013ad30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9998014040 tx=0x7f9998004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:37.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.111+0000 7f999cff9700 1 -- 172.21.15.44:0/1485489189 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999801b810 con 0x7f99a00b3ae0 2024-09-13T18:27:37.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.111+0000 7f999cff9700 1 -- 172.21.15.44:0/1485489189 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9998020070 con 0x7f99a00b3ae0 2024-09-13T18:27:37.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.111+0000 7f99a562c700 1 -- 172.21.15.44:0/1485489189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a013a2d0 con 0x7f99a00b3ae0 2024-09-13T18:27:37.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.111+0000 7f999cff9700 1 -- 172.21.15.44:0/1485489189 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999801bbb0 con 0x7f99a00b3ae0 2024-09-13T18:27:37.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.111+0000 7f99a562c700 1 -- 172.21.15.44:0/1485489189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a0152690 con 0x7f99a00b3ae0 2024-09-13T18:27:37.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.115+0000 7f99a562c700 1 -- 172.21.15.44:0/1485489189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a00b33d0 con 0x7f99a00b3ae0 2024-09-13T18:27:37.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.115+0000 7f999cff9700 1 -- 172.21.15.44:0/1485489189 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f999801bd10 con 0x7f99a00b3ae0 2024-09-13T18:27:37.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.115+0000 7f999cff9700 1 --2- 172.21.15.44:0/1485489189 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f998c066730 0x7f998c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:37.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.115+0000 7f999cff9700 1 -- 172.21.15.44:0/1485489189 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9998022070 con 0x7f99a00b3ae0 2024-09-13T18:27:37.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.115+0000 7f999ffff700 1 --2- 172.21.15.44:0/1485489189 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f998c066730 0x7f998c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:37.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.115+0000 7f999ffff700 1 --2- 172.21.15.44:0/1485489189 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f998c066730 0x7f998c068bf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9994000f60 tx=0x7f9994009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:37.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.123+0000 7f999cff9700 1 -- 172.21.15.44:0/1485489189 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9998057570 con 0x7f99a00b3ae0 2024-09-13T18:27:37.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.303+0000 7f99a562c700 1 -- 172.21.15.44:0/1485489189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99a0139b70 con 0x7f99a00b3ae0 2024-09-13T18:27:37.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.303+0000 7f999cff9700 1 -- 172.21.15.44:0/1485489189 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f99a0139b70 con 0x7f99a00b3ae0 2024-09-13T18:27:37.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:37.309 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:02.280221+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:37.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.307+0000 7f99a562c700 1 -- 172.21.15.44:0/1485489189 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f998c066730 msgr2=0x7f998c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:37.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.307+0000 7f99a562c700 1 --2- 172.21.15.44:0/1485489189 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f998c066730 0x7f998c068bf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9994000f60 tx=0x7f9994009040 comp rx=0 tx=0).stop 2024-09-13T18:27:37.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.307+0000 7f99a562c700 1 -- 172.21.15.44:0/1485489189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99a00b3ae0 msgr2=0x7f99a013ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:37.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.307+0000 7f99a562c700 1 --2- 172.21.15.44:0/1485489189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99a00b3ae0 0x7f99a013ad30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9998014040 tx=0x7f9998004af0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.307+0000 7f99a562c700 1 -- 172.21.15.44:0/1485489189 shutdown_connections 2024-09-13T18:27:37.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.307+0000 7f99a562c700 1 --2- 172.21.15.44:0/1485489189 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f998c066730 0x7f998c068bf0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.307+0000 7f99a562c700 1 --2- 172.21.15.44:0/1485489189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99a00b3ae0 0x7f99a013ad30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.307+0000 7f99a562c700 1 --2- 172.21.15.44:0/1485489189 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f99a006bbf0 0x7f99a013a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.307+0000 7f99a562c700 1 --2- 172.21.15.44:0/1485489189 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99a006acc0 0x7f99a0151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.307+0000 7f99a562c700 1 -- 172.21.15.44:0/1485489189 >> 172.21.15.44:0/1485489189 conn(0x7f99a00b0f00 msgr2=0x7f99a00af680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:37.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.307+0000 7f99a562c700 1 -- 172.21.15.44:0/1485489189 shutdown_connections 2024-09-13T18:27:37.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.307+0000 7f99a562c700 1 -- 172.21.15.44:0/1485489189 wait complete. 2024-09-13T18:27:37.324 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:26:59.478511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:27:00.261038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:27:37.325 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:27:37.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.443+0000 7f328759e700 1 Processor -- start 2024-09-13T18:27:37.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.443+0000 7f328759e700 1 -- start start 2024-09-13T18:27:37.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.443+0000 7f328759e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f328815cda0 0x7f328806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:37.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.443+0000 7f328759e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f32880ceb70 0x7f32880b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:37.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.443+0000 7f328759e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32880b8430 con 0x7f328806a520 2024-09-13T18:27:37.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.443+0000 7f328759e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f328806be40 con 0x7f32880ceb70 2024-09-13T18:27:37.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.443+0000 7f328759e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32880cf350 con 0x7f328815cda0 2024-09-13T18:27:37.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.443+0000 7f327ffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f32880ceb70 0x7f32880b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:37.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.443+0000 7f327ffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f32880ceb70 0x7f32880b5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40576/0 (socket says 172.21.15.44:40576) 2024-09-13T18:27:37.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.443+0000 7f327ffff700 1 -- 172.21.15.44:0/2791312628 learned_addr learned my addr 172.21.15.44:0/2791312628 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:37.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.443+0000 7f3286d9d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f328806a520 0x7f32880d1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42488/0 (socket says 172.21.15.44:42488) 2024-09-13T18:27:37.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.443+0000 7f328659c700 1 --2- 172.21.15.44:0/2791312628 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f328815cda0 0x7f328806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:37.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.443+0000 7f327ffff700 1 -- 172.21.15.44:0/2791312628 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f328815cda0 msgr2=0x7f328806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:37.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.443+0000 7f327ffff700 1 --2- 172.21.15.44:0/2791312628 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f328815cda0 0x7f328806b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.443+0000 7f3285d9b700 1 -- 172.21.15.44:0/2791312628 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2040177338 0 0) 0x7f32880b8430 con 0x7f328806a520 2024-09-13T18:27:37.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.443+0000 7f327ffff700 1 -- 172.21.15.44:0/2791312628 >> v1:172.21.15.44:6789/0 conn(0x7f328806a520 legacy=0x7f32880d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:37.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.443+0000 7f327ffff700 1 -- 172.21.15.44:0/2791312628 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32880d0880 con 0x7f32880ceb70 2024-09-13T18:27:37.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.443+0000 7f327ffff700 1 --2- 172.21.15.44:0/2791312628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32880ceb70 0x7f32880b5de0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3270009910 tx=0x7f3270009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa18078496f3b9e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:37.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.443+0000 7f3285d9b700 1 -- 172.21.15.44:0/2791312628 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270011830 con 0x7f32880ceb70 2024-09-13T18:27:37.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.443+0000 7f3285d9b700 1 -- 172.21.15.44:0/2791312628 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3270011990 con 0x7f32880ceb70 2024-09-13T18:27:37.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f3285d9b700 1 -- 172.21.15.44:0/2791312628 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270011d40 con 0x7f32880ceb70 2024-09-13T18:27:37.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328759e700 1 -- 172.21.15.44:0/2791312628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32880ceb70 msgr2=0x7f32880b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:37.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328759e700 1 --2- 172.21.15.44:0/2791312628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32880ceb70 0x7f32880b5de0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3270009910 tx=0x7f3270009c20 comp rx=0 tx=0).stop 2024-09-13T18:27:37.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328759e700 1 -- 172.21.15.44:0/2791312628 shutdown_connections 2024-09-13T18:27:37.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328759e700 1 --2- 172.21.15.44:0/2791312628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32880ceb70 0x7f32880b5de0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328759e700 1 --2- 172.21.15.44:0/2791312628 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f328815cda0 0x7f328806b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328759e700 1 -- 172.21.15.44:0/2791312628 >> 172.21.15.44:0/2791312628 conn(0x7f32880d2cb0 msgr2=0x7f32880d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:37.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328759e700 1 -- 172.21.15.44:0/2791312628 shutdown_connections 2024-09-13T18:27:37.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328759e700 1 -- 172.21.15.44:0/2791312628 wait complete. 2024-09-13T18:27:37.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328759e700 1 Processor -- start 2024-09-13T18:27:37.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328759e700 1 -- start start 2024-09-13T18:27:37.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328759e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f328806a520 0x7f32880d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:37.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328759e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f32880ceb70 0x7f3288154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:37.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328759e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f328815cda0 0x7f328815ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:37.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328759e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3288154a50 con 0x7f328806a520 2024-09-13T18:27:37.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328759e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32880c87e0 con 0x7f328815cda0 2024-09-13T18:27:37.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328759e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32880c8a80 con 0x7f32880ceb70 2024-09-13T18:27:37.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328659c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f328806a520 0x7f32880d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:37.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328659c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f328806a520 0x7f32880d1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40592/0 (socket says 172.21.15.44:40592) 2024-09-13T18:27:37.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328659c700 1 -- 172.21.15.44:0/2824684859 learned_addr learned my addr 172.21.15.44:0/2824684859 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:37.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f327ffff700 1 --2- 172.21.15.44:0/2824684859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f32880ceb70 0x7f3288154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:37.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f3286d9d700 1 --2- 172.21.15.44:0/2824684859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f328815cda0 0x7f328815ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:37.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328659c700 1 -- 172.21.15.44:0/2824684859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f32880ceb70 msgr2=0x7f3288154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:37.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328659c700 1 --2- 172.21.15.44:0/2824684859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f32880ceb70 0x7f3288154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328659c700 1 -- 172.21.15.44:0/2824684859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f328815cda0 msgr2=0x7f328815ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:37.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328659c700 1 --2- 172.21.15.44:0/2824684859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f328815cda0 0x7f328815ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328659c700 1 -- 172.21.15.44:0/2824684859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3270009570 con 0x7f328806a520 2024-09-13T18:27:37.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.447+0000 7f328659c700 1 --2- 172.21.15.44:0/2824684859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f328806a520 0x7f32880d1ae0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f327800e840 tx=0x7f327800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:37.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.451+0000 7f327effd700 1 -- 172.21.15.44:0/2824684859 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32780095a0 con 0x7f328806a520 2024-09-13T18:27:37.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.451+0000 7f327effd700 1 -- 172.21.15.44:0/2824684859 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3278013680 con 0x7f328806a520 2024-09-13T18:27:37.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.451+0000 7f328759e700 1 -- 172.21.15.44:0/2824684859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32880c8d60 con 0x7f328806a520 2024-09-13T18:27:37.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.451+0000 7f327effd700 1 -- 172.21.15.44:0/2824684859 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32780139f0 con 0x7f328806a520 2024-09-13T18:27:37.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.451+0000 7f328759e700 1 -- 172.21.15.44:0/2824684859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32880c9320 con 0x7f328806a520 2024-09-13T18:27:37.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.451+0000 7f328759e700 1 -- 172.21.15.44:0/2824684859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f328806b900 con 0x7f328806a520 2024-09-13T18:27:37.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.451+0000 7f327effd700 1 -- 172.21.15.44:0/2824684859 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3278013b50 con 0x7f328806a520 2024-09-13T18:27:37.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.451+0000 7f327effd700 1 --2- 172.21.15.44:0/2824684859 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3268066730 0x7f3268068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:37.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.451+0000 7f327effd700 1 -- 172.21.15.44:0/2824684859 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3278083ef0 con 0x7f328806a520 2024-09-13T18:27:37.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.451+0000 7f327ffff700 1 --2- 172.21.15.44:0/2824684859 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3268066730 0x7f3268068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:37.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.455+0000 7f327ffff700 1 --2- 172.21.15.44:0/2824684859 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3268066730 0x7f3268068bf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3270009910 tx=0x7f3270008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:37.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.463+0000 7f327effd700 1 -- 172.21.15.44:0/2824684859 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f32780512f0 con 0x7f328806a520 2024-09-13T18:27:37.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.631+0000 7f328759e700 1 -- 172.21.15.44:0/2824684859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32880c9a40 con 0x7f328806a520 2024-09-13T18:27:37.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.631+0000 7f327effd700 1 -- 172.21.15.44:0/2824684859 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3278017020 con 0x7f328806a520 2024-09-13T18:27:37.636 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:27:37.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.635+0000 7f328759e700 1 -- 172.21.15.44:0/2824684859 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3268066730 msgr2=0x7f3268068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.635+0000 7f328759e700 1 --2- 172.21.15.44:0/2824684859 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3268066730 0x7f3268068bf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3270009910 tx=0x7f3270008030 comp rx=0 tx=0).stop 2024-09-13T18:27:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.635+0000 7f328759e700 1 -- 172.21.15.44:0/2824684859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f328806a520 msgr2=0x7f32880d1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.635+0000 7f328759e700 1 --2- 172.21.15.44:0/2824684859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f328806a520 0x7f32880d1ae0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f327800e840 tx=0x7f327800eb50 comp rx=0 tx=0).stop 2024-09-13T18:27:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.635+0000 7f328759e700 1 -- 172.21.15.44:0/2824684859 shutdown_connections 2024-09-13T18:27:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.635+0000 7f328759e700 1 --2- 172.21.15.44:0/2824684859 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3268066730 0x7f3268068bf0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.635+0000 7f328759e700 1 --2- 172.21.15.44:0/2824684859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f328815cda0 0x7f328815ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.635+0000 7f328759e700 1 --2- 172.21.15.44:0/2824684859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f32880ceb70 0x7f3288154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.635+0000 7f328759e700 1 --2- 172.21.15.44:0/2824684859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f328806a520 0x7f32880d1ae0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.635+0000 7f328759e700 1 -- 172.21.15.44:0/2824684859 >> 172.21.15.44:0/2824684859 conn(0x7f32880d2cb0 msgr2=0x7f328815afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.635+0000 7f328759e700 1 -- 172.21.15.44:0/2824684859 shutdown_connections 2024-09-13T18:27:37.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.635+0000 7f328759e700 1 -- 172.21.15.44:0/2824684859 wait complete. 2024-09-13T18:27:37.651 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:27:37.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.771+0000 7f28a1ffe700 1 Processor -- start 2024-09-13T18:27:37.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.771+0000 7f28a1ffe700 1 -- start start 2024-09-13T18:27:37.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28a1ffe700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f289c06b900 0x7f289c0b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:37.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28a1ffe700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f289c06a520 0x7f289c06a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:37.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28a1ffe700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f289c06aeb0 con 0x7f289c15cda0 2024-09-13T18:27:37.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28a1ffe700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f289c0b8430 con 0x7f289c06a520 2024-09-13T18:27:37.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28a1ffe700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289c06bd60 con 0x7f289c06b900 2024-09-13T18:27:37.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28a0ffc700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f289c15cda0 0x7f289c0ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42504/0 (socket says 172.21.15.44:42504) 2024-09-13T18:27:37.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28a0ffc700 1 -- 172.21.15.44:0/608213962 learned_addr learned my addr 172.21.15.44:0/608213962 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:37.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28a17fd700 1 --2- 172.21.15.44:0/608213962 >> v2:172.21.15.99:3300/0 conn(0x7f289c06a520 0x7f289c06a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:37.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f2893fff700 1 --2- 172.21.15.44:0/608213962 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f289c06b900 0x7f289c0b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:37.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28937fe700 1 -- 172.21.15.44:0/608213962 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639784041 0 0) 0x7f2898001110 con 0x7f289c15cda0 2024-09-13T18:27:37.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28937fe700 1 -- 172.21.15.44:0/608213962 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28840035d0 con 0x7f289c15cda0 2024-09-13T18:27:37.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28a17fd700 1 -- 172.21.15.44:0/608213962 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f289c06b900 msgr2=0x7f289c0b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:37.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28a17fd700 1 --2- 172.21.15.44:0/608213962 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f289c06b900 0x7f289c0b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28a17fd700 1 -- 172.21.15.44:0/608213962 >> v1:172.21.15.44:6789/0 conn(0x7f289c15cda0 legacy=0x7f289c0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:37.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28a17fd700 1 -- 172.21.15.44:0/608213962 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c0cf350 con 0x7f289c06a520 2024-09-13T18:27:37.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28a17fd700 1 --2- 172.21.15.44:0/608213962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f289c06a520 0x7f289c06a970 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2894009d90 tx=0x7f289400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=856d4fd301746066 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:37.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28937fe700 1 -- 172.21.15.44:0/608213962 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289400e070 con 0x7f289c06a520 2024-09-13T18:27:37.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28937fe700 1 -- 172.21.15.44:0/608213962 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289400bb20 con 0x7f289c06a520 2024-09-13T18:27:37.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28937fe700 1 -- 172.21.15.44:0/608213962 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2894012430 con 0x7f289c06a520 2024-09-13T18:27:37.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28a1ffe700 1 -- 172.21.15.44:0/608213962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f289c06a520 msgr2=0x7f289c06a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:37.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28a1ffe700 1 --2- 172.21.15.44:0/608213962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f289c06a520 0x7f289c06a970 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2894009d90 tx=0x7f289400b330 comp rx=0 tx=0).stop 2024-09-13T18:27:37.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28a1ffe700 1 -- 172.21.15.44:0/608213962 shutdown_connections 2024-09-13T18:27:37.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28a1ffe700 1 --2- 172.21.15.44:0/608213962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f289c06a520 0x7f289c06a970 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28a1ffe700 1 --2- 172.21.15.44:0/608213962 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f289c06b900 0x7f289c0b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28a1ffe700 1 -- 172.21.15.44:0/608213962 >> 172.21.15.44:0/608213962 conn(0x7f289c0d2cb0 msgr2=0x7f289c0d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:37.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28a1ffe700 1 -- 172.21.15.44:0/608213962 shutdown_connections 2024-09-13T18:27:37.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.775+0000 7f28a1ffe700 1 -- 172.21.15.44:0/608213962 wait complete. 2024-09-13T18:27:37.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.779+0000 7f28a1ffe700 1 Processor -- start 2024-09-13T18:27:37.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.779+0000 7f28a1ffe700 1 -- start start 2024-09-13T18:27:37.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.779+0000 7f28a1ffe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f289c06a520 0x7f289c1f3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:37.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.779+0000 7f28a1ffe700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f289c06b900 0x7f289c15fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:37.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.779+0000 7f28a1ffe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f289c15cda0 0x7f289c15d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:37.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.779+0000 7f28a1ffe700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c15fa00 con 0x7f289c06a520 2024-09-13T18:27:37.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.779+0000 7f28a1ffe700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c15edf0 con 0x7f289c15cda0 2024-09-13T18:27:37.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.779+0000 7f28a1ffe700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289c15f0d0 con 0x7f289c06b900 2024-09-13T18:27:37.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.779+0000 7f28a0ffc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f289c06a520 0x7f289c1f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:37.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.779+0000 7f28a0ffc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f289c06a520 0x7f289c1f3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40594/0 (socket says 172.21.15.44:40594) 2024-09-13T18:27:37.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.779+0000 7f28a0ffc700 1 -- 172.21.15.44:0/2452540545 learned_addr learned my addr 172.21.15.44:0/2452540545 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:37.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.779+0000 7f2893fff700 1 --2- 172.21.15.44:0/2452540545 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f289c06b900 0x7f289c15fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:37.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.779+0000 7f28a17fd700 1 --2- 172.21.15.44:0/2452540545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f289c15cda0 0x7f289c15d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:37.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.783+0000 7f28a0ffc700 1 -- 172.21.15.44:0/2452540545 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f289c06b900 msgr2=0x7f289c15fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:37.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.783+0000 7f28a0ffc700 1 --2- 172.21.15.44:0/2452540545 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f289c06b900 0x7f289c15fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.783+0000 7f28a0ffc700 1 -- 172.21.15.44:0/2452540545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f289c15cda0 msgr2=0x7f289c15d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:37.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.783+0000 7f28a0ffc700 1 --2- 172.21.15.44:0/2452540545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f289c15cda0 0x7f289c15d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.783+0000 7f28a0ffc700 1 -- 172.21.15.44:0/2452540545 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2894009a70 con 0x7f289c06a520 2024-09-13T18:27:37.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.783+0000 7f28a17fd700 1 --2- 172.21.15.44:0/2452540545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f289c15cda0 0x7f289c15d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:37.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.783+0000 7f28a0ffc700 1 --2- 172.21.15.44:0/2452540545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f289c06a520 0x7f289c1f3340 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2898001270 tx=0x7f289800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:37.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.783+0000 7f28917fa700 1 -- 172.21.15.44:0/2452540545 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898005d90 con 0x7f289c06a520 2024-09-13T18:27:37.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.783+0000 7f28917fa700 1 -- 172.21.15.44:0/2452540545 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28980070d0 con 0x7f289c06a520 2024-09-13T18:27:37.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.783+0000 7f28a1ffe700 1 -- 172.21.15.44:0/2452540545 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f289c15f3b0 con 0x7f289c06a520 2024-09-13T18:27:37.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.783+0000 7f28917fa700 1 -- 172.21.15.44:0/2452540545 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898007480 con 0x7f289c06a520 2024-09-13T18:27:37.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.783+0000 7f28a1ffe700 1 -- 172.21.15.44:0/2452540545 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f289c1603d0 con 0x7f289c06a520 2024-09-13T18:27:37.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.783+0000 7f28a1ffe700 1 -- 172.21.15.44:0/2452540545 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f289c06a970 con 0x7f289c06a520 2024-09-13T18:27:37.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.783+0000 7f28917fa700 1 -- 172.21.15.44:0/2452540545 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f28980075e0 con 0x7f289c06a520 2024-09-13T18:27:37.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.787+0000 7f28917fa700 1 --2- 172.21.15.44:0/2452540545 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2888066730 0x7f2888068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:37.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.787+0000 7f28917fa700 1 -- 172.21.15.44:0/2452540545 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2898083510 con 0x7f289c06a520 2024-09-13T18:27:37.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.787+0000 7f2893fff700 1 --2- 172.21.15.44:0/2452540545 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2888066730 0x7f2888068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:37.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.787+0000 7f2893fff700 1 --2- 172.21.15.44:0/2452540545 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2888066730 0x7f2888068bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f289c0c9c30 tx=0x7f288c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:37.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.795+0000 7f28917fa700 1 -- 172.21.15.44:0/2452540545 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2898050800 con 0x7f289c06a520 2024-09-13T18:27:37.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.967+0000 7f28a1ffe700 1 -- 172.21.15.44:0/2452540545 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f289c06aeb0 con 0x7f289c06a520 2024-09-13T18:27:37.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.971+0000 7f28917fa700 1 -- 172.21.15.44:0/2452540545 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f289c06aeb0 con 0x7f289c06a520 2024-09-13T18:27:37.974 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:27:37.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.975+0000 7f28a1ffe700 1 -- 172.21.15.44:0/2452540545 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2888066730 msgr2=0x7f2888068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:37.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.975+0000 7f28a1ffe700 1 --2- 172.21.15.44:0/2452540545 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2888066730 0x7f2888068bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f289c0c9c30 tx=0x7f288c009240 comp rx=0 tx=0).stop 2024-09-13T18:27:37.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.975+0000 7f28a1ffe700 1 -- 172.21.15.44:0/2452540545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f289c06a520 msgr2=0x7f289c1f3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:37.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.975+0000 7f28a1ffe700 1 --2- 172.21.15.44:0/2452540545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f289c06a520 0x7f289c1f3340 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2898001270 tx=0x7f289800c7d0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.975+0000 7f28a1ffe700 1 -- 172.21.15.44:0/2452540545 shutdown_connections 2024-09-13T18:27:37.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.975+0000 7f28a1ffe700 1 --2- 172.21.15.44:0/2452540545 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2888066730 0x7f2888068bf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.975+0000 7f28a1ffe700 1 --2- 172.21.15.44:0/2452540545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f289c15cda0 0x7f289c15d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.975+0000 7f28a1ffe700 1 --2- 172.21.15.44:0/2452540545 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f289c06b900 0x7f289c15fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.975+0000 7f28a1ffe700 1 --2- 172.21.15.44:0/2452540545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f289c06a520 0x7f289c1f3340 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:37.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.975+0000 7f28a1ffe700 1 -- 172.21.15.44:0/2452540545 >> 172.21.15.44:0/2452540545 conn(0x7f289c0d2cb0 msgr2=0x7f289c06b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:37.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.975+0000 7f28a1ffe700 1 -- 172.21.15.44:0/2452540545 shutdown_connections 2024-09-13T18:27:37.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:37.975+0000 7f28a1ffe700 1 -- 172.21.15.44:0/2452540545 wait complete. 2024-09-13T18:27:37.994 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:27:38.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.107+0000 7f7d1ffff700 1 Processor -- start 2024-09-13T18:27:38.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.107+0000 7f7d1ffff700 1 -- start start 2024-09-13T18:27:38.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d1ffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7d200d04e0 0x7f7d2006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:38.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d1ffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7d2006e730 0x7f7d2013e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:38.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d1ffff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d2006f850 con 0x7f7d2013d9d0 2024-09-13T18:27:38.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d1ffff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d2013e1a0 con 0x7f7d200d04e0 2024-09-13T18:27:38.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d1ffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2006efb0 con 0x7f7d2006e730 2024-09-13T18:27:38.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d17fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7d200d04e0 0x7f7d2006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:38.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d17fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7d200d04e0 0x7f7d2006e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40598/0 (socket says 172.21.15.44:40598) 2024-09-13T18:27:38.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d17fff700 1 -- 172.21.15.44:0/2800711520 learned_addr learned my addr 172.21.15.44:0/2800711520 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:38.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d1f7fe700 1 --2- 172.21.15.44:0/2800711520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7d2006e730 0x7f7d2013e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:38.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d17fff700 1 -- 172.21.15.44:0/2800711520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7d2006e730 msgr2=0x7f7d2013e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:38.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d17fff700 1 --2- 172.21.15.44:0/2800711520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7d2006e730 0x7f7d2013e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d17fff700 1 -- 172.21.15.44:0/2800711520 >> v1:172.21.15.99:6789/0 conn(0x7f7d2013d9d0 legacy=0x7f7d200cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:38.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d17fff700 1 -- 172.21.15.44:0/2800711520 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2006f290 con 0x7f7d200d04e0 2024-09-13T18:27:38.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d17fff700 1 --2- 172.21.15.44:0/2800711520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d200d04e0 0x7f7d2006e1f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009910 tx=0x7f7d08009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b5ea109b5f78a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d1e7fc700 1 -- 172.21.15.44:0/2800711520 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d08011830 con 0x7f7d200d04e0 2024-09-13T18:27:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d1e7fc700 1 -- 172.21.15.44:0/2800711520 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d08011990 con 0x7f7d200d04e0 2024-09-13T18:27:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d1e7fc700 1 -- 172.21.15.44:0/2800711520 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d08011d40 con 0x7f7d200d04e0 2024-09-13T18:27:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d1ffff700 1 -- 172.21.15.44:0/2800711520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d200d04e0 msgr2=0x7f7d2006e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d1ffff700 1 --2- 172.21.15.44:0/2800711520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d200d04e0 0x7f7d2006e1f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009910 tx=0x7f7d08009c20 comp rx=0 tx=0).stop 2024-09-13T18:27:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d1ffff700 1 -- 172.21.15.44:0/2800711520 shutdown_connections 2024-09-13T18:27:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d1ffff700 1 --2- 172.21.15.44:0/2800711520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7d2006e730 0x7f7d2013e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d1ffff700 1 --2- 172.21.15.44:0/2800711520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d200d04e0 0x7f7d2006e1f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d1ffff700 1 -- 172.21.15.44:0/2800711520 >> 172.21.15.44:0/2800711520 conn(0x7f7d2006a4f0 msgr2=0x7f7d20071d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d1ffff700 1 -- 172.21.15.44:0/2800711520 shutdown_connections 2024-09-13T18:27:38.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.111+0000 7f7d1ffff700 1 -- 172.21.15.44:0/2800711520 wait complete. 2024-09-13T18:27:38.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.115+0000 7f7d1ffff700 1 Processor -- start 2024-09-13T18:27:38.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.115+0000 7f7d1ffff700 1 -- start start 2024-09-13T18:27:38.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.115+0000 7f7d1ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d2006e730 0x7f7d201efdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.119+0000 7f7d1ffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d200d04e0 0x7f7d20155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.119+0000 7f7d1ffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7d2013d9d0 0x7f7d200cc940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.119+0000 7f7d1ffff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d20156300 con 0x7f7d2006e730 2024-09-13T18:27:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.119+0000 7f7d1ffff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d20152670 con 0x7f7d200d04e0 2024-09-13T18:27:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.119+0000 7f7d1ffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d20152910 con 0x7f7d2013d9d0 2024-09-13T18:27:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.119+0000 7f7d1effd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d2006e730 0x7f7d201efdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.119+0000 7f7d1effd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d2006e730 0x7f7d201efdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40608/0 (socket says 172.21.15.44:40608) 2024-09-13T18:27:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.119+0000 7f7d1effd700 1 -- 172.21.15.44:0/2433706082 learned_addr learned my addr 172.21.15.44:0/2433706082 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.119+0000 7f7d17fff700 1 --2- 172.21.15.44:0/2433706082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d200d04e0 0x7f7d20155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.119+0000 7f7d1f7fe700 1 --2- 172.21.15.44:0/2433706082 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7d2013d9d0 0x7f7d200cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.119+0000 7f7d1effd700 1 -- 172.21.15.44:0/2433706082 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7d2013d9d0 msgr2=0x7f7d200cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.119+0000 7f7d1effd700 1 --2- 172.21.15.44:0/2433706082 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7d2013d9d0 0x7f7d200cc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.119+0000 7f7d1effd700 1 -- 172.21.15.44:0/2433706082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d200d04e0 msgr2=0x7f7d20155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:38.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.119+0000 7f7d1effd700 1 --2- 172.21.15.44:0/2433706082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d200d04e0 0x7f7d20155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.119+0000 7f7d1effd700 1 -- 172.21.15.44:0/2433706082 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d08009570 con 0x7f7d2006e730 2024-09-13T18:27:38.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.119+0000 7f7d1effd700 1 --2- 172.21.15.44:0/2433706082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d2006e730 0x7f7d201efdf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7d1000c500 tx=0x7f7d1000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:38.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.119+0000 7f7d1cff9700 1 -- 172.21.15.44:0/2433706082 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d100052d0 con 0x7f7d2006e730 2024-09-13T18:27:38.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.119+0000 7f7d1cff9700 1 -- 172.21.15.44:0/2433706082 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d10005430 con 0x7f7d2006e730 2024-09-13T18:27:38.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.119+0000 7f7d1ffff700 1 -- 172.21.15.44:0/2433706082 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d20152bf0 con 0x7f7d2006e730 2024-09-13T18:27:38.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.119+0000 7f7d1cff9700 1 -- 172.21.15.44:0/2433706082 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d100055a0 con 0x7f7d2006e730 2024-09-13T18:27:38.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.119+0000 7f7d1ffff700 1 -- 172.21.15.44:0/2433706082 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d201f0330 con 0x7f7d2006e730 2024-09-13T18:27:38.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.119+0000 7f7d1ffff700 1 -- 172.21.15.44:0/2433706082 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d20153110 con 0x7f7d2006e730 2024-09-13T18:27:38.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.123+0000 7f7d1cff9700 1 -- 172.21.15.44:0/2433706082 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7d100038e0 con 0x7f7d2006e730 2024-09-13T18:27:38.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.123+0000 7f7d1cff9700 1 --2- 172.21.15.44:0/2433706082 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7d00066730 0x7f7d00068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:38.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.123+0000 7f7d1cff9700 1 -- 172.21.15.44:0/2433706082 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d100834b0 con 0x7f7d2006e730 2024-09-13T18:27:38.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.123+0000 7f7d17fff700 1 --2- 172.21.15.44:0/2433706082 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7d00066730 0x7f7d00068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:38.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.123+0000 7f7d17fff700 1 --2- 172.21.15.44:0/2433706082 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7d00066730 0x7f7d00068bf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7d08000c00 tx=0x7f7d08008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:38.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.127+0000 7f7d1cff9700 1 -- 172.21.15.44:0/2433706082 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7d20153110 con 0x7f7d2006e730 2024-09-13T18:27:38.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.295+0000 7f7d1ffff700 1 -- 172.21.15.44:0/2433706082 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7d20153110 con 0x7f7d2006e730 2024-09-13T18:27:38.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.295+0000 7f7d1cff9700 1 -- 172.21.15.44:0/2433706082 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7d20153110 con 0x7f7d2006e730 2024-09-13T18:27:38.301 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:27:38.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.299+0000 7f7d1ffff700 1 -- 172.21.15.44:0/2433706082 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7d00066730 msgr2=0x7f7d00068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:38.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.299+0000 7f7d1ffff700 1 --2- 172.21.15.44:0/2433706082 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7d00066730 0x7f7d00068bf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7d08000c00 tx=0x7f7d08008030 comp rx=0 tx=0).stop 2024-09-13T18:27:38.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.299+0000 7f7d1ffff700 1 -- 172.21.15.44:0/2433706082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d2006e730 msgr2=0x7f7d201efdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:38.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.299+0000 7f7d1ffff700 1 --2- 172.21.15.44:0/2433706082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d2006e730 0x7f7d201efdf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7d1000c500 tx=0x7f7d1000c810 comp rx=0 tx=0).stop 2024-09-13T18:27:38.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.299+0000 7f7d1ffff700 1 -- 172.21.15.44:0/2433706082 shutdown_connections 2024-09-13T18:27:38.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.299+0000 7f7d1ffff700 1 --2- 172.21.15.44:0/2433706082 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7d00066730 0x7f7d00068bf0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.299+0000 7f7d1ffff700 1 --2- 172.21.15.44:0/2433706082 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7d2013d9d0 0x7f7d200cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.299+0000 7f7d1ffff700 1 --2- 172.21.15.44:0/2433706082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d200d04e0 0x7f7d20155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.299+0000 7f7d1ffff700 1 --2- 172.21.15.44:0/2433706082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d2006e730 0x7f7d201efdf0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.299+0000 7f7d1ffff700 1 -- 172.21.15.44:0/2433706082 >> 172.21.15.44:0/2433706082 conn(0x7f7d2006a4f0 msgr2=0x7f7d2015aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:38.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.299+0000 7f7d1ffff700 1 -- 172.21.15.44:0/2433706082 shutdown_connections 2024-09-13T18:27:38.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.299+0000 7f7d1ffff700 1 -- 172.21.15.44:0/2433706082 wait complete. 2024-09-13T18:27:38.316 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:27:38.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.427+0000 7f7f0887b700 1 Processor -- start 2024-09-13T18:27:38.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.427+0000 7f7f0887b700 1 -- start start 2024-09-13T18:27:38.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.427+0000 7f7f0887b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7f0406b900 0x7f7f040b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:38.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.427+0000 7f7f0887b700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f040b8430 con 0x7f7f0406a520 2024-09-13T18:27:38.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.427+0000 7f7f0887b700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f0406bd60 con 0x7f7f0415cda0 2024-09-13T18:27:38.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.427+0000 7f7f0887b700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f040cf350 con 0x7f7f0406b900 2024-09-13T18:27:38.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.431+0000 7f7f0259c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7f0406b900 0x7f7f040b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:38.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.431+0000 7f7f0359e700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7f0406a520 0x7f7f0406a930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42514/0 (socket says 172.21.15.44:42514) 2024-09-13T18:27:38.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.431+0000 7f7f0359e700 1 -- 172.21.15.44:0/3870656120 learned_addr learned my addr 172.21.15.44:0/3870656120 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:38.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.431+0000 7f7f0259c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7f0406b900 0x7f7f040b5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40620/0 (socket says 172.21.15.44:40620) 2024-09-13T18:27:38.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.431+0000 7f7f0259c700 1 -- 172.21.15.44:0/3870656120 >> v1:172.21.15.99:6789/0 conn(0x7f7f0415cda0 legacy=0x7f7f040ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:38.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.431+0000 7f7f0259c700 1 -- 172.21.15.44:0/3870656120 >> v1:172.21.15.44:6789/0 conn(0x7f7f0406a520 legacy=0x7f7f0406a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:38.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.431+0000 7f7f0259c700 1 -- 172.21.15.44:0/3870656120 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f040d0880 con 0x7f7f0406b900 2024-09-13T18:27:38.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.431+0000 7f7f0259c700 1 --2- 172.21.15.44:0/3870656120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f0406b900 0x7f7f040b5de0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009850 tx=0x7f7ef8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab1e0b6bd6b041f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:38.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.431+0000 7f7f01d9b700 1 -- 172.21.15.44:0/3870656120 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef8011830 con 0x7f7f0406b900 2024-09-13T18:27:38.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.431+0000 7f7f01d9b700 1 -- 172.21.15.44:0/3870656120 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef8011990 con 0x7f7f0406b900 2024-09-13T18:27:38.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.431+0000 7f7f01d9b700 1 -- 172.21.15.44:0/3870656120 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef8011d20 con 0x7f7f0406b900 2024-09-13T18:27:38.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.431+0000 7f7f0887b700 1 -- 172.21.15.44:0/3870656120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f0406b900 msgr2=0x7f7f040b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:38.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.431+0000 7f7f0887b700 1 --2- 172.21.15.44:0/3870656120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f0406b900 0x7f7f040b5de0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009850 tx=0x7f7ef8009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:38.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.431+0000 7f7f0887b700 1 -- 172.21.15.44:0/3870656120 shutdown_connections 2024-09-13T18:27:38.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.431+0000 7f7f0887b700 1 --2- 172.21.15.44:0/3870656120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f0406b900 0x7f7f040b5de0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.431+0000 7f7f0887b700 1 -- 172.21.15.44:0/3870656120 >> 172.21.15.44:0/3870656120 conn(0x7f7f040d2cb0 msgr2=0x7f7f040d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:38.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.431+0000 7f7f0887b700 1 -- 172.21.15.44:0/3870656120 shutdown_connections 2024-09-13T18:27:38.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.431+0000 7f7f0887b700 1 -- 172.21.15.44:0/3870656120 wait complete. 2024-09-13T18:27:38.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7f0887b700 1 Processor -- start 2024-09-13T18:27:38.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7f0887b700 1 -- start start 2024-09-13T18:27:38.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7f0887b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f0406a520 0x7f7f04155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:38.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7f0887b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f0406b900 0x7f7f0414e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:38.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7f0887b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f0415cda0 0x7f7f04156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:38.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7f0887b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f04154e90 con 0x7f7f0415cda0 2024-09-13T18:27:38.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7f0887b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f04154280 con 0x7f7f0406b900 2024-09-13T18:27:38.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7f0887b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f04154560 con 0x7f7f0406a520 2024-09-13T18:27:38.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7f0359e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f0415cda0 0x7f7f04156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:38.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7f0359e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f0415cda0 0x7f7f04156c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40636/0 (socket says 172.21.15.44:40636) 2024-09-13T18:27:38.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7f0359e700 1 -- 172.21.15.44:0/2941064634 learned_addr learned my addr 172.21.15.44:0/2941064634 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:38.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7f02d9d700 1 --2- 172.21.15.44:0/2941064634 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f0406a520 0x7f7f04155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:38.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7f0259c700 1 --2- 172.21.15.44:0/2941064634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f0406b900 0x7f7f0414e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:38.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7f0359e700 1 -- 172.21.15.44:0/2941064634 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f0406a520 msgr2=0x7f7f04155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:38.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7f0359e700 1 --2- 172.21.15.44:0/2941064634 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f0406a520 0x7f7f04155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7f0359e700 1 -- 172.21.15.44:0/2941064634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f0406b900 msgr2=0x7f7f0414e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:38.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7f0359e700 1 --2- 172.21.15.44:0/2941064634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f0406b900 0x7f7f0414e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7f0359e700 1 -- 172.21.15.44:0/2941064634 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef80094b0 con 0x7f7f0415cda0 2024-09-13T18:27:38.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7f0359e700 1 --2- 172.21.15.44:0/2941064634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f0415cda0 0x7f7f04156c50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00cbc0 tx=0x7f7efc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:38.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7eeb7fe700 1 -- 172.21.15.44:0/2941064634 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc007480 con 0x7f7f0415cda0 2024-09-13T18:27:38.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7eeb7fe700 1 -- 172.21.15.44:0/2941064634 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc0075e0 con 0x7f7f0415cda0 2024-09-13T18:27:38.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7f0887b700 1 -- 172.21.15.44:0/2941064634 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f04154840 con 0x7f7f0415cda0 2024-09-13T18:27:38.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7eeb7fe700 1 -- 172.21.15.44:0/2941064634 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc007950 con 0x7f7f0415cda0 2024-09-13T18:27:38.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.435+0000 7f7f0887b700 1 -- 172.21.15.44:0/2941064634 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f04155860 con 0x7f7f0415cda0 2024-09-13T18:27:38.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.439+0000 7f7f0887b700 1 -- 172.21.15.44:0/2941064634 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f04155000 con 0x7f7f0415cda0 2024-09-13T18:27:38.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.439+0000 7f7eeb7fe700 1 -- 172.21.15.44:0/2941064634 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7efc012400 con 0x7f7f0415cda0 2024-09-13T18:27:38.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.439+0000 7f7eeb7fe700 1 --2- 172.21.15.44:0/2941064634 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7ef0066730 0x7f7ef0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:38.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.439+0000 7f7eeb7fe700 1 -- 172.21.15.44:0/2941064634 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7efc083990 con 0x7f7f0415cda0 2024-09-13T18:27:38.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.439+0000 7f7f02d9d700 1 --2- 172.21.15.44:0/2941064634 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7ef0066730 0x7f7ef0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:38.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.439+0000 7f7f02d9d700 1 --2- 172.21.15.44:0/2941064634 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7ef0066730 0x7f7ef0068bf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4000f60 tx=0x7f7ef4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:38.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.447+0000 7f7eeb7fe700 1 -- 172.21.15.44:0/2941064634 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7efc050e40 con 0x7f7f0415cda0 2024-09-13T18:27:38.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.635+0000 7f7f0887b700 1 -- 172.21.15.44:0/2941064634 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7f040b5de0 con 0x7f7f0415cda0 2024-09-13T18:27:38.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.635+0000 7f7eeb7fe700 1 -- 172.21.15.44:0/2941064634 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7efc017020 con 0x7f7f0415cda0 2024-09-13T18:27:38.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.635+0000 7f7f0887b700 1 -- 172.21.15.44:0/2941064634 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7ef0066730 msgr2=0x7f7ef0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:38.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.635+0000 7f7f0887b700 1 --2- 172.21.15.44:0/2941064634 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7ef0066730 0x7f7ef0068bf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4000f60 tx=0x7f7ef4009040 comp rx=0 tx=0).stop 2024-09-13T18:27:38.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.635+0000 7f7f0887b700 1 -- 172.21.15.44:0/2941064634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f0415cda0 msgr2=0x7f7f04156c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:38.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.635+0000 7f7f0887b700 1 --2- 172.21.15.44:0/2941064634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f0415cda0 0x7f7f04156c50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00cbc0 tx=0x7f7efc00cbf0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.635+0000 7f7f0887b700 1 -- 172.21.15.44:0/2941064634 shutdown_connections 2024-09-13T18:27:38.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.635+0000 7f7f0887b700 1 --2- 172.21.15.44:0/2941064634 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7ef0066730 0x7f7ef0068bf0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.635+0000 7f7f0887b700 1 --2- 172.21.15.44:0/2941064634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f0415cda0 0x7f7f04156c50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.635+0000 7f7f0887b700 1 --2- 172.21.15.44:0/2941064634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f0406b900 0x7f7f0414e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.635+0000 7f7f0887b700 1 --2- 172.21.15.44:0/2941064634 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f0406a520 0x7f7f04155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.635+0000 7f7f0887b700 1 -- 172.21.15.44:0/2941064634 >> 172.21.15.44:0/2941064634 conn(0x7f7f040d2cb0 msgr2=0x7f7f040b6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:38.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.635+0000 7f7f0887b700 1 -- 172.21.15.44:0/2941064634 shutdown_connections 2024-09-13T18:27:38.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.635+0000 7f7f0887b700 1 -- 172.21.15.44:0/2941064634 wait complete. 2024-09-13T18:27:38.643 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-13T18:27:38.657 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:27:38.657 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:27:38.663 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:38.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.775+0000 7fc6caf54700 1 Processor -- start 2024-09-13T18:27:38.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.775+0000 7fc6caf54700 1 -- start start 2024-09-13T18:27:38.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.775+0000 7fc6caf54700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc6c406fb30 0x7fc6c40adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:38.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.775+0000 7fc6caf54700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc6c406d150 0x7fc6c406d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:38.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.775+0000 7fc6caf54700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c406a780 con 0x7fc6c406bb90 2024-09-13T18:27:38.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.775+0000 7fc6caf54700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c406cd30 con 0x7fc6c406d150 2024-09-13T18:27:38.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.775+0000 7fc6caf54700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c4159470 con 0x7fc6c406fb30 2024-09-13T18:27:38.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.775+0000 7fc6ca753700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc6c406d150 0x7fc6c406d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:38.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.775+0000 7fc6c9751700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc6c406bb90 0x7fc6c40cbf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42518/0 (socket says 172.21.15.44:42518) 2024-09-13T18:27:38.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.775+0000 7fc6ca753700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc6c406d150 0x7fc6c406d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40642/0 (socket says 172.21.15.44:40642) 2024-09-13T18:27:38.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.775+0000 7fc6c9751700 1 -- 172.21.15.44:0/991204372 learned_addr learned my addr 172.21.15.44:0/991204372 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:38.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.775+0000 7fc6c9f52700 1 --2- 172.21.15.44:0/991204372 >> v2:172.21.15.99:3300/0 conn(0x7fc6c406fb30 0x7fc6c40adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:38.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.779+0000 7fc6ca753700 1 -- 172.21.15.44:0/991204372 >> v2:172.21.15.99:3300/0 conn(0x7fc6c406fb30 msgr2=0x7fc6c40adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:38.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.779+0000 7fc6ca753700 1 --2- 172.21.15.44:0/991204372 >> v2:172.21.15.99:3300/0 conn(0x7fc6c406fb30 0x7fc6c40adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.779+0000 7fc6ca753700 1 -- 172.21.15.44:0/991204372 >> v1:172.21.15.44:6789/0 conn(0x7fc6c406bb90 legacy=0x7fc6c40cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:38.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.779+0000 7fc6ca753700 1 -- 172.21.15.44:0/991204372 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c40cc610 con 0x7fc6c406d150 2024-09-13T18:27:38.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.779+0000 7fc6c8f50700 1 -- 172.21.15.44:0/991204372 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975794807 0 0) 0x7fc6c406a780 con 0x7fc6c406bb90 2024-09-13T18:27:38.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.779+0000 7fc6ca753700 1 --2- 172.21.15.44:0/991204372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6c406d150 0x7fc6c406d5a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc6c40b3de0 tx=0x7fc6bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926c1840a3aa65e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:38.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.779+0000 7fc6c8f50700 1 -- 172.21.15.44:0/991204372 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc00e070 con 0x7fc6c406d150 2024-09-13T18:27:38.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.779+0000 7fc6c8f50700 1 -- 172.21.15.44:0/991204372 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc00bbd0 con 0x7fc6c406d150 2024-09-13T18:27:38.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.779+0000 7fc6c8f50700 1 -- 172.21.15.44:0/991204372 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc012430 con 0x7fc6c406d150 2024-09-13T18:27:38.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.779+0000 7fc6caf54700 1 -- 172.21.15.44:0/991204372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6c406d150 msgr2=0x7fc6c406d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:38.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.779+0000 7fc6caf54700 1 --2- 172.21.15.44:0/991204372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6c406d150 0x7fc6c406d5a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc6c40b3de0 tx=0x7fc6bc00b330 comp rx=0 tx=0).stop 2024-09-13T18:27:38.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.779+0000 7fc6caf54700 1 -- 172.21.15.44:0/991204372 shutdown_connections 2024-09-13T18:27:38.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.779+0000 7fc6caf54700 1 --2- 172.21.15.44:0/991204372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6c406d150 0x7fc6c406d5a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.779+0000 7fc6caf54700 1 --2- 172.21.15.44:0/991204372 >> v2:172.21.15.99:3300/0 conn(0x7fc6c406fb30 0x7fc6c40adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.779+0000 7fc6caf54700 1 -- 172.21.15.44:0/991204372 >> 172.21.15.44:0/991204372 conn(0x7fc6c40b0f00 msgr2=0x7fc6c40b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:38.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.779+0000 7fc6caf54700 1 -- 172.21.15.44:0/991204372 shutdown_connections 2024-09-13T18:27:38.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.779+0000 7fc6caf54700 1 -- 172.21.15.44:0/991204372 wait complete. 2024-09-13T18:27:38.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.779+0000 7fc6caf54700 1 Processor -- start 2024-09-13T18:27:38.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.779+0000 7fc6caf54700 1 -- start start 2024-09-13T18:27:38.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.783+0000 7fc6caf54700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc6c406bb90 0x7fc6c4144120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:38.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.783+0000 7fc6caf54700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6c406d150 0x7fc6c40ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:38.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.783+0000 7fc6caf54700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6c406fb30 0x7fc6c40ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:38.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.783+0000 7fc6caf54700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c4152a90 con 0x7fc6c406d150 2024-09-13T18:27:38.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.783+0000 7fc6caf54700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c41521d0 con 0x7fc6c406fb30 2024-09-13T18:27:38.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.783+0000 7fc6caf54700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c4152440 con 0x7fc6c406bb90 2024-09-13T18:27:38.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.783+0000 7fc6c9751700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6c406d150 0x7fc6c40ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:38.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.783+0000 7fc6c9751700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6c406d150 0x7fc6c40ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40648/0 (socket says 172.21.15.44:40648) 2024-09-13T18:27:38.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.783+0000 7fc6c9751700 1 -- 172.21.15.44:0/666004163 learned_addr learned my addr 172.21.15.44:0/666004163 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:38.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.783+0000 7fc6ca753700 1 --2- 172.21.15.44:0/666004163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6c406fb30 0x7fc6c40ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:38.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.783+0000 7fc6c9f52700 1 --2- 172.21.15.44:0/666004163 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc6c406bb90 0x7fc6c4144120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:38.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.783+0000 7fc6c9751700 1 -- 172.21.15.44:0/666004163 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc6c406bb90 msgr2=0x7fc6c4144120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:38.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.783+0000 7fc6c9751700 1 --2- 172.21.15.44:0/666004163 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc6c406bb90 0x7fc6c4144120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.783+0000 7fc6c9751700 1 -- 172.21.15.44:0/666004163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6c406fb30 msgr2=0x7fc6c40ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:38.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.783+0000 7fc6c9751700 1 --2- 172.21.15.44:0/666004163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6c406fb30 0x7fc6c40ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.783+0000 7fc6c9751700 1 -- 172.21.15.44:0/666004163 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc009a70 con 0x7fc6c406d150 2024-09-13T18:27:38.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.783+0000 7fc6c9751700 1 --2- 172.21.15.44:0/666004163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6c406d150 0x7fc6c40ac8c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400c780 tx=0x7fc6b400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:38.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.783+0000 7fc6ba7fc700 1 -- 172.21.15.44:0/666004163 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4004ca0 con 0x7fc6c406d150 2024-09-13T18:27:38.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.783+0000 7fc6ba7fc700 1 -- 172.21.15.44:0/666004163 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b4004e00 con 0x7fc6c406d150 2024-09-13T18:27:38.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.783+0000 7fc6caf54700 1 -- 172.21.15.44:0/666004163 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c4152720 con 0x7fc6c406d150 2024-09-13T18:27:38.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.783+0000 7fc6ba7fc700 1 -- 172.21.15.44:0/666004163 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4007310 con 0x7fc6c406d150 2024-09-13T18:27:38.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.783+0000 7fc6caf54700 1 -- 172.21.15.44:0/666004163 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c41500b0 con 0x7fc6c406d150 2024-09-13T18:27:38.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.787+0000 7fc6ba7fc700 1 -- 172.21.15.44:0/666004163 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc6b4007470 con 0x7fc6c406d150 2024-09-13T18:27:38.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.787+0000 7fc6caf54700 1 -- 172.21.15.44:0/666004163 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c406d5a0 con 0x7fc6c406d150 2024-09-13T18:27:38.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.787+0000 7fc6ba7fc700 1 --2- 172.21.15.44:0/666004163 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc6a8066730 0x7fc6a8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:38.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.787+0000 7fc6ba7fc700 1 -- 172.21.15.44:0/666004163 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6b4083d80 con 0x7fc6c406d150 2024-09-13T18:27:38.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.787+0000 7fc6c9f52700 1 --2- 172.21.15.44:0/666004163 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc6a8066730 0x7fc6a8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:38.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.787+0000 7fc6c9f52700 1 --2- 172.21.15.44:0/666004163 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc6a8066730 0x7fc6a8068bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0007a60 tx=0x7fc6c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:38.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.795+0000 7fc6ba7fc700 1 -- 172.21.15.44:0/666004163 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc6b40510e0 con 0x7fc6c406d150 2024-09-13T18:27:38.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.967+0000 7fc6caf54700 1 -- 172.21.15.44:0/666004163 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6c41532a0 con 0x7fc6c406d150 2024-09-13T18:27:38.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.971+0000 7fc6ba7fc700 1 -- 172.21.15.44:0/666004163 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fc6b4007720 con 0x7fc6c406d150 2024-09-13T18:27:38.975 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:38.975 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:02.280221+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:38.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.971+0000 7fc6caf54700 1 -- 172.21.15.44:0/666004163 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc6a8066730 msgr2=0x7fc6a8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:38.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.971+0000 7fc6caf54700 1 --2- 172.21.15.44:0/666004163 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc6a8066730 0x7fc6a8068bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0007a60 tx=0x7fc6c0008040 comp rx=0 tx=0).stop 2024-09-13T18:27:38.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.971+0000 7fc6caf54700 1 -- 172.21.15.44:0/666004163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6c406d150 msgr2=0x7fc6c40ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:38.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.971+0000 7fc6caf54700 1 --2- 172.21.15.44:0/666004163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6c406d150 0x7fc6c40ac8c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400c780 tx=0x7fc6b400ca90 comp rx=0 tx=0).stop 2024-09-13T18:27:38.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.971+0000 7fc6caf54700 1 -- 172.21.15.44:0/666004163 shutdown_connections 2024-09-13T18:27:38.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.971+0000 7fc6caf54700 1 --2- 172.21.15.44:0/666004163 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc6a8066730 0x7fc6a8068bf0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.971+0000 7fc6caf54700 1 --2- 172.21.15.44:0/666004163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6c406fb30 0x7fc6c40ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.971+0000 7fc6caf54700 1 --2- 172.21.15.44:0/666004163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6c406d150 0x7fc6c40ac8c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.971+0000 7fc6caf54700 1 --2- 172.21.15.44:0/666004163 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc6c406bb90 0x7fc6c4144120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:38.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.971+0000 7fc6caf54700 1 -- 172.21.15.44:0/666004163 >> 172.21.15.44:0/666004163 conn(0x7fc6c40b0f00 msgr2=0x7fc6c40cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:38.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.971+0000 7fc6caf54700 1 -- 172.21.15.44:0/666004163 shutdown_connections 2024-09-13T18:27:38.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:38.975+0000 7fc6caf54700 1 -- 172.21.15.44:0/666004163 wait complete. 2024-09-13T18:27:38.991 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:26:59.478511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:27:00.261038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:27:38.992 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:27:39.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.111+0000 7f51bac6f700 1 Processor -- start 2024-09-13T18:27:39.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.111+0000 7f51bac6f700 1 -- start start 2024-09-13T18:27:39.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51bac6f700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f51b40712b0 0x7f51b4159f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:39.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51bac6f700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f51b415a460 0x7f51b406c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:39.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51bac6f700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b415ac50 con 0x7f51b41573e0 2024-09-13T18:27:39.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51bac6f700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b40cc1b0 con 0x7f51b415a460 2024-09-13T18:27:39.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51bac6f700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b40cb3f0 con 0x7f51b40712b0 2024-09-13T18:27:39.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51ba46e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f51b415a460 0x7f51b406c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:39.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51ba46e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f51b415a460 0x7f51b406c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40650/0 (socket says 172.21.15.44:40650) 2024-09-13T18:27:39.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51ba46e700 1 -- 172.21.15.44:0/39908169 learned_addr learned my addr 172.21.15.44:0/39908169 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:39.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51b9c6d700 1 --1- 172.21.15.44:0/39908169 >> v1:172.21.15.44:6789/0 conn(0x7f51b41573e0 0x7f51b4070ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42520/0 (socket says 172.21.15.44:42520) 2024-09-13T18:27:39.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51b946c700 1 --2- 172.21.15.44:0/39908169 >> v2:172.21.15.99:3300/0 conn(0x7f51b40712b0 0x7f51b4159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:39.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51ba46e700 1 -- 172.21.15.44:0/39908169 >> v2:172.21.15.99:3300/0 conn(0x7f51b40712b0 msgr2=0x7f51b4159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:39.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51ba46e700 1 --2- 172.21.15.44:0/39908169 >> v2:172.21.15.99:3300/0 conn(0x7f51b40712b0 0x7f51b4159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51ba46e700 1 -- 172.21.15.44:0/39908169 >> v1:172.21.15.44:6789/0 conn(0x7f51b41573e0 legacy=0x7f51b4070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:39.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51ba46e700 1 -- 172.21.15.44:0/39908169 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b40cb6d0 con 0x7f51b415a460 2024-09-13T18:27:39.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51ba46e700 1 --2- 172.21.15.44:0/39908169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51b415a460 0x7f51b406c3e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f51b415d240 tx=0x7f51ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0915e442d457215 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:39.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51b8c6b700 1 -- 172.21.15.44:0/39908169 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac00bbc0 con 0x7f51b415a460 2024-09-13T18:27:39.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51b8c6b700 1 -- 172.21.15.44:0/39908169 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac00bd20 con 0x7f51b415a460 2024-09-13T18:27:39.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51b8c6b700 1 -- 172.21.15.44:0/39908169 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac0116a0 con 0x7f51b415a460 2024-09-13T18:27:39.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51bac6f700 1 -- 172.21.15.44:0/39908169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51b415a460 msgr2=0x7f51b406c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:39.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51bac6f700 1 --2- 172.21.15.44:0/39908169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51b415a460 0x7f51b406c3e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f51b415d240 tx=0x7f51ac00b330 comp rx=0 tx=0).stop 2024-09-13T18:27:39.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51bac6f700 1 -- 172.21.15.44:0/39908169 shutdown_connections 2024-09-13T18:27:39.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51bac6f700 1 --2- 172.21.15.44:0/39908169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51b415a460 0x7f51b406c3e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51bac6f700 1 --2- 172.21.15.44:0/39908169 >> v2:172.21.15.99:3300/0 conn(0x7f51b40712b0 0x7f51b4159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51bac6f700 1 -- 172.21.15.44:0/39908169 >> 172.21.15.44:0/39908169 conn(0x7f51b40b0e10 msgr2=0x7f51b40b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:39.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51bac6f700 1 -- 172.21.15.44:0/39908169 shutdown_connections 2024-09-13T18:27:39.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51bac6f700 1 -- 172.21.15.44:0/39908169 wait complete. 2024-09-13T18:27:39.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51bac6f700 1 Processor -- start 2024-09-13T18:27:39.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.115+0000 7f51bac6f700 1 -- start start 2024-09-13T18:27:39.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51bac6f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51b40712b0 0x7f51b414cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:39.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51bac6f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51b41573e0 0x7f51b415b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:39.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51bac6f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51b415a460 0x7f51b415bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:39.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51bac6f700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b414d180 con 0x7f51b41573e0 2024-09-13T18:27:39.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51bac6f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b40ae590 con 0x7f51b40712b0 2024-09-13T18:27:39.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51bac6f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b40ae7a0 con 0x7f51b415a460 2024-09-13T18:27:39.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51b946c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51b41573e0 0x7f51b415b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:39.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51b946c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51b41573e0 0x7f51b415b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40666/0 (socket says 172.21.15.44:40666) 2024-09-13T18:27:39.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51b946c700 1 -- 172.21.15.44:0/2924501010 learned_addr learned my addr 172.21.15.44:0/2924501010 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:39.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51b9c6d700 1 --2- 172.21.15.44:0/2924501010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51b40712b0 0x7f51b414cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:39.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51ba46e700 1 --2- 172.21.15.44:0/2924501010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51b415a460 0x7f51b415bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:39.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51b946c700 1 -- 172.21.15.44:0/2924501010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51b415a460 msgr2=0x7f51b415bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:39.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51b946c700 1 --2- 172.21.15.44:0/2924501010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51b415a460 0x7f51b415bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51b946c700 1 -- 172.21.15.44:0/2924501010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51b40712b0 msgr2=0x7f51b414cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:39.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51b946c700 1 --2- 172.21.15.44:0/2924501010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51b40712b0 0x7f51b414cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51b946c700 1 -- 172.21.15.44:0/2924501010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac009b30 con 0x7f51b41573e0 2024-09-13T18:27:39.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51b946c700 1 --2- 172.21.15.44:0/2924501010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51b41573e0 0x7f51b415b870 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f51a400e760 tx=0x7f51a400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:39.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51aa7fc700 1 -- 172.21.15.44:0/2924501010 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a400c070 con 0x7f51b41573e0 2024-09-13T18:27:39.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51aa7fc700 1 -- 172.21.15.44:0/2924501010 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a4013610 con 0x7f51b41573e0 2024-09-13T18:27:39.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51bac6f700 1 -- 172.21.15.44:0/2924501010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b40aea80 con 0x7f51b41573e0 2024-09-13T18:27:39.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51aa7fc700 1 -- 172.21.15.44:0/2924501010 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a4013980 con 0x7f51b41573e0 2024-09-13T18:27:39.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51bac6f700 1 -- 172.21.15.44:0/2924501010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b40af040 con 0x7f51b41573e0 2024-09-13T18:27:39.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51bac6f700 1 -- 172.21.15.44:0/2924501010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b4159f20 con 0x7f51b41573e0 2024-09-13T18:27:39.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.119+0000 7f51aa7fc700 1 -- 172.21.15.44:0/2924501010 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f51a4013ae0 con 0x7f51b41573e0 2024-09-13T18:27:39.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.123+0000 7f51aa7fc700 1 --2- 172.21.15.44:0/2924501010 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5198066730 0x7f5198068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:39.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.123+0000 7f51b9c6d700 1 --2- 172.21.15.44:0/2924501010 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5198066730 0x7f5198068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:39.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.123+0000 7f51aa7fc700 1 -- 172.21.15.44:0/2924501010 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51a4083bf0 con 0x7f51b41573e0 2024-09-13T18:27:39.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.123+0000 7f51b9c6d700 1 --2- 172.21.15.44:0/2924501010 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5198066730 0x7f5198068bf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f51b0000f60 tx=0x7f51b0007ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:39.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.131+0000 7f51aa7fc700 1 -- 172.21.15.44:0/2924501010 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f51a4050ed0 con 0x7f51b41573e0 2024-09-13T18:27:39.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.299+0000 7f51bac6f700 1 -- 172.21.15.44:0/2924501010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51b4159ad0 con 0x7f51b41573e0 2024-09-13T18:27:39.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.303+0000 7f51aa7fc700 1 -- 172.21.15.44:0/2924501010 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51a40544f0 con 0x7f51b41573e0 2024-09-13T18:27:39.306 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:27:39.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.303+0000 7f51bac6f700 1 -- 172.21.15.44:0/2924501010 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5198066730 msgr2=0x7f5198068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:39.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.303+0000 7f51bac6f700 1 --2- 172.21.15.44:0/2924501010 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5198066730 0x7f5198068bf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f51b0000f60 tx=0x7f51b0007ef0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.303+0000 7f51bac6f700 1 -- 172.21.15.44:0/2924501010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51b41573e0 msgr2=0x7f51b415b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:39.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.303+0000 7f51bac6f700 1 --2- 172.21.15.44:0/2924501010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51b41573e0 0x7f51b415b870 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f51a400e760 tx=0x7f51a400ea70 comp rx=0 tx=0).stop 2024-09-13T18:27:39.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.303+0000 7f51bac6f700 1 -- 172.21.15.44:0/2924501010 shutdown_connections 2024-09-13T18:27:39.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.303+0000 7f51bac6f700 1 --2- 172.21.15.44:0/2924501010 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5198066730 0x7f5198068bf0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.303+0000 7f51bac6f700 1 --2- 172.21.15.44:0/2924501010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51b415a460 0x7f51b415bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.303+0000 7f51bac6f700 1 --2- 172.21.15.44:0/2924501010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51b41573e0 0x7f51b415b870 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.303+0000 7f51bac6f700 1 --2- 172.21.15.44:0/2924501010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51b40712b0 0x7f51b414cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.303+0000 7f51bac6f700 1 -- 172.21.15.44:0/2924501010 >> 172.21.15.44:0/2924501010 conn(0x7f51b40b0e10 msgr2=0x7f51b406d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:39.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.303+0000 7f51bac6f700 1 -- 172.21.15.44:0/2924501010 shutdown_connections 2024-09-13T18:27:39.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.303+0000 7f51bac6f700 1 -- 172.21.15.44:0/2924501010 wait complete. 2024-09-13T18:27:39.321 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:27:39.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.439+0000 7fbc2a41a700 1 Processor -- start 2024-09-13T18:27:39.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.439+0000 7fbc2a41a700 1 -- start start 2024-09-13T18:27:39.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.439+0000 7fbc2a41a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc240ce270 0x7fbc2415caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:39.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.439+0000 7fbc2a41a700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbc2415d030 0x7fbc2406baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:39.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.439+0000 7fbc2a41a700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc2406dad0 con 0x7fbc2406d6f0 2024-09-13T18:27:39.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.439+0000 7fbc2a41a700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc2415d4c0 con 0x7fbc2415d030 2024-09-13T18:27:39.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.439+0000 7fbc2a41a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240ae3c0 con 0x7fbc240ce270 2024-09-13T18:27:39.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.439+0000 7fbc29418700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fbc2406d6f0 0x7fbc240adbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42536/0 (socket says 172.21.15.44:42536) 2024-09-13T18:27:39.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.439+0000 7fbc29418700 1 -- 172.21.15.44:0/4042730018 learned_addr learned my addr 172.21.15.44:0/4042730018 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:39.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.439+0000 7fbc28c17700 1 --2- 172.21.15.44:0/4042730018 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc240ce270 0x7fbc2415caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:39.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.439+0000 7fbc29c19700 1 --2- 172.21.15.44:0/4042730018 >> v2:172.21.15.99:3300/0 conn(0x7fbc2415d030 0x7fbc2406baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:39.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.439+0000 7fbc17fff700 1 -- 172.21.15.44:0/4042730018 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507982207 0 0) 0x7fbc2406dad0 con 0x7fbc2406d6f0 2024-09-13T18:27:39.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.439+0000 7fbc17fff700 1 -- 172.21.15.44:0/4042730018 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc100035d0 con 0x7fbc2406d6f0 2024-09-13T18:27:39.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.439+0000 7fbc28c17700 1 -- 172.21.15.44:0/4042730018 >> v2:172.21.15.99:3300/0 conn(0x7fbc2415d030 msgr2=0x7fbc2406baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:39.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.439+0000 7fbc28c17700 1 --2- 172.21.15.44:0/4042730018 >> v2:172.21.15.99:3300/0 conn(0x7fbc2415d030 0x7fbc2406baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.439+0000 7fbc28c17700 1 -- 172.21.15.44:0/4042730018 >> v1:172.21.15.44:6789/0 conn(0x7fbc2406d6f0 legacy=0x7fbc240adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:39.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.439+0000 7fbc28c17700 1 -- 172.21.15.44:0/4042730018 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc240705b0 con 0x7fbc240ce270 2024-09-13T18:27:39.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.443+0000 7fbc28c17700 1 --2- 172.21.15.44:0/4042730018 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc240ce270 0x7fbc2415caf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbc20009d90 tx=0x7fbc2000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff3e863d46c81e3b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:39.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.443+0000 7fbc17fff700 1 -- 172.21.15.44:0/4042730018 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2000e070 con 0x7fbc240ce270 2024-09-13T18:27:39.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.443+0000 7fbc17fff700 1 -- 172.21.15.44:0/4042730018 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2000bb20 con 0x7fbc240ce270 2024-09-13T18:27:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.443+0000 7fbc17fff700 1 -- 172.21.15.44:0/4042730018 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2000be90 con 0x7fbc240ce270 2024-09-13T18:27:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.443+0000 7fbc2a41a700 1 -- 172.21.15.44:0/4042730018 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc240ce270 msgr2=0x7fbc2415caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.443+0000 7fbc2a41a700 1 --2- 172.21.15.44:0/4042730018 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc240ce270 0x7fbc2415caf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbc20009d90 tx=0x7fbc2000b330 comp rx=0 tx=0).stop 2024-09-13T18:27:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.443+0000 7fbc2a41a700 1 -- 172.21.15.44:0/4042730018 shutdown_connections 2024-09-13T18:27:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.443+0000 7fbc2a41a700 1 --2- 172.21.15.44:0/4042730018 >> v2:172.21.15.99:3300/0 conn(0x7fbc2415d030 0x7fbc2406baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.443+0000 7fbc2a41a700 1 --2- 172.21.15.44:0/4042730018 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc240ce270 0x7fbc2415caf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.443+0000 7fbc2a41a700 1 -- 172.21.15.44:0/4042730018 >> 172.21.15.44:0/4042730018 conn(0x7fbc240b0e10 msgr2=0x7fbc240b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.443+0000 7fbc2a41a700 1 -- 172.21.15.44:0/4042730018 shutdown_connections 2024-09-13T18:27:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.443+0000 7fbc2a41a700 1 -- 172.21.15.44:0/4042730018 wait complete. 2024-09-13T18:27:39.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.443+0000 7fbc2a41a700 1 Processor -- start 2024-09-13T18:27:39.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.443+0000 7fbc2a41a700 1 -- start start 2024-09-13T18:27:39.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.447+0000 7fbc2a41a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc2406d6f0 0x7fbc24155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:39.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.447+0000 7fbc2a41a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc240ce270 0x7fbc241f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:39.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.447+0000 7fbc2a41a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc2415d030 0x7fbc240ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:39.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.447+0000 7fbc2a41a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240abbe0 con 0x7fbc240ce270 2024-09-13T18:27:39.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.447+0000 7fbc2a41a700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc24155c20 con 0x7fbc2406d6f0 2024-09-13T18:27:39.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.447+0000 7fbc2a41a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240a8f10 con 0x7fbc2415d030 2024-09-13T18:27:39.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.447+0000 7fbc28c17700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc240ce270 0x7fbc241f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:39.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.447+0000 7fbc28c17700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc240ce270 0x7fbc241f0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40672/0 (socket says 172.21.15.44:40672) 2024-09-13T18:27:39.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.447+0000 7fbc28c17700 1 -- 172.21.15.44:0/3921907039 learned_addr learned my addr 172.21.15.44:0/3921907039 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:39.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.447+0000 7fbc29c19700 1 --2- 172.21.15.44:0/3921907039 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc2415d030 0x7fbc240ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:39.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.447+0000 7fbc29418700 1 --2- 172.21.15.44:0/3921907039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc2406d6f0 0x7fbc24155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:39.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.447+0000 7fbc29c19700 1 -- 172.21.15.44:0/3921907039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc2406d6f0 msgr2=0x7fbc24155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.447+0000 7fbc29c19700 1 --2- 172.21.15.44:0/3921907039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc2406d6f0 0x7fbc24155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.447+0000 7fbc29c19700 1 -- 172.21.15.44:0/3921907039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc240ce270 msgr2=0x7fbc241f0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.447+0000 7fbc29c19700 1 --2- 172.21.15.44:0/3921907039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc240ce270 0x7fbc241f0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.447+0000 7fbc29c19700 1 -- 172.21.15.44:0/3921907039 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc20009a70 con 0x7fbc2415d030 2024-09-13T18:27:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.447+0000 7fbc28c17700 1 --2- 172.21.15.44:0/3921907039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc240ce270 0x7fbc241f0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.447+0000 7fbc29c19700 1 --2- 172.21.15.44:0/3921907039 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc2415d030 0x7fbc240ab6a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c00e860 tx=0x7fbc1c00eb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.447+0000 7fbc15ffb700 1 -- 172.21.15.44:0/3921907039 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c013680 con 0x7fbc2415d030 2024-09-13T18:27:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.447+0000 7fbc2a41a700 1 -- 172.21.15.44:0/3921907039 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc240a85e0 con 0x7fbc2415d030 2024-09-13T18:27:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.447+0000 7fbc15ffb700 1 -- 172.21.15.44:0/3921907039 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1c0137e0 con 0x7fbc2415d030 2024-09-13T18:27:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.447+0000 7fbc2a41a700 1 -- 172.21.15.44:0/3921907039 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc240a8ba0 con 0x7fbc2415d030 2024-09-13T18:27:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.447+0000 7fbc15ffb700 1 -- 172.21.15.44:0/3921907039 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c013b90 con 0x7fbc2415d030 2024-09-13T18:27:39.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.451+0000 7fbc2a41a700 1 -- 172.21.15.44:0/3921907039 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc2415caf0 con 0x7fbc2415d030 2024-09-13T18:27:39.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.451+0000 7fbc15ffb700 1 -- 172.21.15.44:0/3921907039 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbc1c013cf0 con 0x7fbc2415d030 2024-09-13T18:27:39.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.451+0000 7fbc15ffb700 1 --2- 172.21.15.44:0/3921907039 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbc08066730 0x7fbc08068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:39.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.451+0000 7fbc15ffb700 1 -- 172.21.15.44:0/3921907039 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc1c084820 con 0x7fbc2415d030 2024-09-13T18:27:39.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.451+0000 7fbc29418700 1 --2- 172.21.15.44:0/3921907039 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbc08066730 0x7fbc08068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:39.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.451+0000 7fbc29418700 1 --2- 172.21.15.44:0/3921907039 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbc08066730 0x7fbc08068bf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbc18007fd0 tx=0x7fbc18009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:39.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.459+0000 7fbc15ffb700 1 -- 172.21.15.44:0/3921907039 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbc1c051ba0 con 0x7fbc2415d030 2024-09-13T18:27:39.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.631+0000 7fbc2a41a700 1 -- 172.21.15.44:0/3921907039 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbc240a9050 con 0x7fbc2415d030 2024-09-13T18:27:39.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.631+0000 7fbc15ffb700 1 -- 172.21.15.44:0/3921907039 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbc1c0551c0 con 0x7fbc2415d030 2024-09-13T18:27:39.637 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:27:39.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.635+0000 7fbc2a41a700 1 -- 172.21.15.44:0/3921907039 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbc08066730 msgr2=0x7fbc08068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:39.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.635+0000 7fbc2a41a700 1 --2- 172.21.15.44:0/3921907039 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbc08066730 0x7fbc08068bf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbc18007fd0 tx=0x7fbc18009040 comp rx=0 tx=0).stop 2024-09-13T18:27:39.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.635+0000 7fbc2a41a700 1 -- 172.21.15.44:0/3921907039 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc2415d030 msgr2=0x7fbc240ab6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:39.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.635+0000 7fbc2a41a700 1 --2- 172.21.15.44:0/3921907039 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc2415d030 0x7fbc240ab6a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c00e860 tx=0x7fbc1c00eb70 comp rx=0 tx=0).stop 2024-09-13T18:27:39.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.635+0000 7fbc2a41a700 1 -- 172.21.15.44:0/3921907039 shutdown_connections 2024-09-13T18:27:39.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.635+0000 7fbc2a41a700 1 --2- 172.21.15.44:0/3921907039 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbc08066730 0x7fbc08068bf0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.635+0000 7fbc2a41a700 1 --2- 172.21.15.44:0/3921907039 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc2415d030 0x7fbc240ab6a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.635+0000 7fbc2a41a700 1 --2- 172.21.15.44:0/3921907039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc240ce270 0x7fbc241f0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.635+0000 7fbc2a41a700 1 --2- 172.21.15.44:0/3921907039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc2406d6f0 0x7fbc24155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.635+0000 7fbc2a41a700 1 -- 172.21.15.44:0/3921907039 >> 172.21.15.44:0/3921907039 conn(0x7fbc240b0e10 msgr2=0x7fbc240b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:39.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.635+0000 7fbc2a41a700 1 -- 172.21.15.44:0/3921907039 shutdown_connections 2024-09-13T18:27:39.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.635+0000 7fbc2a41a700 1 -- 172.21.15.44:0/3921907039 wait complete. 2024-09-13T18:27:39.657 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:27:39.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.775+0000 7f9c152a0700 1 Processor -- start 2024-09-13T18:27:39.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.775+0000 7f9c152a0700 1 -- start start 2024-09-13T18:27:39.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.775+0000 7f9c152a0700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9c1015cda0 0x7f9c100d1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:39.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.775+0000 7f9c152a0700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c100ce260 0x7f9c100ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:39.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.775+0000 7f9c152a0700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c100d0880 con 0x7f9c100b5e00 2024-09-13T18:27:39.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.775+0000 7f9c152a0700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c100cde50 con 0x7f9c1015cda0 2024-09-13T18:27:39.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.775+0000 7f9c152a0700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100d16e0 con 0x7f9c100ce260 2024-09-13T18:27:39.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.775+0000 7f9c0e7fc700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9c100b5e00 0x7f9c100b6240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42552/0 (socket says 172.21.15.44:42552) 2024-09-13T18:27:39.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.775+0000 7f9c0e7fc700 1 -- 172.21.15.44:0/3847847134 learned_addr learned my addr 172.21.15.44:0/3847847134 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:39.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.775+0000 7f9c0f7fe700 1 --2- 172.21.15.44:0/3847847134 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c100ce260 0x7f9c100ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:39.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.775+0000 7f9c0effd700 1 --2- 172.21.15.44:0/3847847134 >> v2:172.21.15.99:3300/0 conn(0x7f9c1015cda0 0x7f9c100d1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:39.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.775+0000 7f9c0dffb700 1 -- 172.21.15.44:0/3847847134 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130451306 0 0) 0x7f9c100d0880 con 0x7f9c100b5e00 2024-09-13T18:27:39.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.775+0000 7f9c0dffb700 1 -- 172.21.15.44:0/3847847134 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bf80035d0 con 0x7f9c100b5e00 2024-09-13T18:27:39.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.775+0000 7f9c0f7fe700 1 -- 172.21.15.44:0/3847847134 >> v2:172.21.15.99:3300/0 conn(0x7f9c1015cda0 msgr2=0x7f9c100d1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:39.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.775+0000 7f9c0f7fe700 1 --2- 172.21.15.44:0/3847847134 >> v2:172.21.15.99:3300/0 conn(0x7f9c1015cda0 0x7f9c100d1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.775+0000 7f9c0f7fe700 1 -- 172.21.15.44:0/3847847134 >> v1:172.21.15.44:6789/0 conn(0x7f9c100b5e00 legacy=0x7f9c100b6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:39.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.775+0000 7f9c0f7fe700 1 -- 172.21.15.44:0/3847847134 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c100b6950 con 0x7f9c100ce260 2024-09-13T18:27:39.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.779+0000 7f9c0f7fe700 1 --2- 172.21.15.44:0/3847847134 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c100ce260 0x7f9c100ce6f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009d90 tx=0x7f9c0800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f5deea8a24b70d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:39.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.779+0000 7f9c0dffb700 1 -- 172.21.15.44:0/3847847134 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0800e070 con 0x7f9c100ce260 2024-09-13T18:27:39.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.779+0000 7f9c0dffb700 1 -- 172.21.15.44:0/3847847134 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0800bb20 con 0x7f9c100ce260 2024-09-13T18:27:39.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.779+0000 7f9c0dffb700 1 -- 172.21.15.44:0/3847847134 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08012430 con 0x7f9c100ce260 2024-09-13T18:27:39.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.779+0000 7f9c152a0700 1 -- 172.21.15.44:0/3847847134 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c100ce260 msgr2=0x7f9c100ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:39.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.779+0000 7f9c152a0700 1 --2- 172.21.15.44:0/3847847134 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c100ce260 0x7f9c100ce6f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009d90 tx=0x7f9c0800b330 comp rx=0 tx=0).stop 2024-09-13T18:27:39.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.779+0000 7f9c152a0700 1 -- 172.21.15.44:0/3847847134 shutdown_connections 2024-09-13T18:27:39.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.779+0000 7f9c152a0700 1 --2- 172.21.15.44:0/3847847134 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c100ce260 0x7f9c100ce6f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.779+0000 7f9c152a0700 1 --2- 172.21.15.44:0/3847847134 >> v2:172.21.15.99:3300/0 conn(0x7f9c1015cda0 0x7f9c100d1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.779+0000 7f9c152a0700 1 -- 172.21.15.44:0/3847847134 >> 172.21.15.44:0/3847847134 conn(0x7f9c100d2cb0 msgr2=0x7f9c100d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:39.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.779+0000 7f9c152a0700 1 -- 172.21.15.44:0/3847847134 shutdown_connections 2024-09-13T18:27:39.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.779+0000 7f9c152a0700 1 -- 172.21.15.44:0/3847847134 wait complete. 2024-09-13T18:27:39.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9c152a0700 1 Processor -- start 2024-09-13T18:27:39.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9c152a0700 1 -- start start 2024-09-13T18:27:39.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9c152a0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c100b5e00 0x7f9c100c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:39.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9c152a0700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c100ce260 0x7f9c10155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:39.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9c152a0700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c1015cda0 0x7f9c101468a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:39.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9c152a0700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c10157bb0 con 0x7f9c100b5e00 2024-09-13T18:27:39.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9c152a0700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c10156f30 con 0x7f9c1015cda0 2024-09-13T18:27:39.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9c152a0700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c10157210 con 0x7f9c100ce260 2024-09-13T18:27:39.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9c0effd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c100b5e00 0x7f9c100c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:39.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9c0effd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c100b5e00 0x7f9c100c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40678/0 (socket says 172.21.15.44:40678) 2024-09-13T18:27:39.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9c0effd700 1 -- 172.21.15.44:0/4224553890 learned_addr learned my addr 172.21.15.44:0/4224553890 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:39.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9c0f7fe700 1 --2- 172.21.15.44:0/4224553890 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c1015cda0 0x7f9c101468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:39.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9c0e7fc700 1 --2- 172.21.15.44:0/4224553890 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c100ce260 0x7f9c10155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:39.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9c0effd700 1 -- 172.21.15.44:0/4224553890 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c100ce260 msgr2=0x7f9c10155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:39.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9c0effd700 1 --2- 172.21.15.44:0/4224553890 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c100ce260 0x7f9c10155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9c0effd700 1 -- 172.21.15.44:0/4224553890 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c1015cda0 msgr2=0x7f9c101468a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:39.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9c0effd700 1 --2- 172.21.15.44:0/4224553890 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c1015cda0 0x7f9c101468a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9c0effd700 1 -- 172.21.15.44:0/4224553890 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c08009a70 con 0x7f9c100b5e00 2024-09-13T18:27:39.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9c0e7fc700 1 --2- 172.21.15.44:0/4224553890 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c100ce260 0x7f9c10155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:39.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9c0effd700 1 --2- 172.21.15.44:0/4224553890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c100b5e00 0x7f9c100c8bd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9c0000e9d0 tx=0x7f9c0000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:39.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9bf77fe700 1 -- 172.21.15.44:0/4224553890 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c00009720 con 0x7f9c100b5e00 2024-09-13T18:27:39.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9bf77fe700 1 -- 172.21.15.44:0/4224553890 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0000ee70 con 0x7f9c100b5e00 2024-09-13T18:27:39.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9c152a0700 1 -- 172.21.15.44:0/4224553890 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c101574f0 con 0x7f9c100b5e00 2024-09-13T18:27:39.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9bf77fe700 1 -- 172.21.15.44:0/4224553890 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0000ca50 con 0x7f9c100b5e00 2024-09-13T18:27:39.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.783+0000 7f9c152a0700 1 -- 172.21.15.44:0/4224553890 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c100c9110 con 0x7f9c100b5e00 2024-09-13T18:27:39.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.787+0000 7f9c152a0700 1 -- 172.21.15.44:0/4224553890 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c10157e20 con 0x7f9c100b5e00 2024-09-13T18:27:39.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.787+0000 7f9bf77fe700 1 -- 172.21.15.44:0/4224553890 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9c0000cbb0 con 0x7f9c100b5e00 2024-09-13T18:27:39.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.787+0000 7f9bf77fe700 1 --2- 172.21.15.44:0/4224553890 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9bfc066730 0x7f9bfc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:39.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.787+0000 7f9bf77fe700 1 -- 172.21.15.44:0/4224553890 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c00084200 con 0x7f9c100b5e00 2024-09-13T18:27:39.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.787+0000 7f9c0e7fc700 1 --2- 172.21.15.44:0/4224553890 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9bfc066730 0x7f9bfc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:39.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.791+0000 7f9c0e7fc700 1 --2- 172.21.15.44:0/4224553890 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9bfc066730 0x7f9bfc068bf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9c101f6020 tx=0x7f9c04007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:39.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.795+0000 7f9bf77fe700 1 -- 172.21.15.44:0/4224553890 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9c000514f0 con 0x7f9c100b5e00 2024-09-13T18:27:39.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.963+0000 7f9c152a0700 1 -- 172.21.15.44:0/4224553890 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c100b4640 con 0x7f9c100b5e00 2024-09-13T18:27:39.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.963+0000 7f9bf77fe700 1 -- 172.21.15.44:0/4224553890 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c0000ce60 con 0x7f9c100b5e00 2024-09-13T18:27:39.969 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:27:39.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.967+0000 7f9c152a0700 1 -- 172.21.15.44:0/4224553890 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9bfc066730 msgr2=0x7f9bfc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:39.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.967+0000 7f9c152a0700 1 --2- 172.21.15.44:0/4224553890 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9bfc066730 0x7f9bfc068bf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9c101f6020 tx=0x7f9c04007de0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.967+0000 7f9c152a0700 1 -- 172.21.15.44:0/4224553890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c100b5e00 msgr2=0x7f9c100c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:39.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.967+0000 7f9c152a0700 1 --2- 172.21.15.44:0/4224553890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c100b5e00 0x7f9c100c8bd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9c0000e9d0 tx=0x7f9c0000ece0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.967+0000 7f9c152a0700 1 -- 172.21.15.44:0/4224553890 shutdown_connections 2024-09-13T18:27:39.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.967+0000 7f9c152a0700 1 --2- 172.21.15.44:0/4224553890 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9bfc066730 0x7f9bfc068bf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.967+0000 7f9c152a0700 1 --2- 172.21.15.44:0/4224553890 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c1015cda0 0x7f9c101468a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.967+0000 7f9c152a0700 1 --2- 172.21.15.44:0/4224553890 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c100ce260 0x7f9c10155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.967+0000 7f9c152a0700 1 --2- 172.21.15.44:0/4224553890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c100b5e00 0x7f9c100c8bd0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.967+0000 7f9c152a0700 1 -- 172.21.15.44:0/4224553890 >> 172.21.15.44:0/4224553890 conn(0x7f9c100d2cb0 msgr2=0x7f9c1006b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:39.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.967+0000 7f9c152a0700 1 -- 172.21.15.44:0/4224553890 shutdown_connections 2024-09-13T18:27:39.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:39.967+0000 7f9c152a0700 1 -- 172.21.15.44:0/4224553890 wait complete. 2024-09-13T18:27:39.985 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:27:40.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.099+0000 7f792359e700 1 Processor -- start 2024-09-13T18:27:40.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.099+0000 7f792359e700 1 -- start start 2024-09-13T18:27:40.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f792359e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7924144340 0x7f792406d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f792359e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79240cdc90 0x7f792406fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f792359e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7924144720 con 0x7f792406bdb0 2024-09-13T18:27:40.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f792359e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792406dd40 con 0x7f7924144340 2024-09-13T18:27:40.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f792359e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792406da60 con 0x7f79240cdc90 2024-09-13T18:27:40.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f7922d9d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79240cdc90 0x7f792406fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f792259c700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7924144340 0x7f792406d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f7921d9b700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f792406bdb0 0x7f79240cd580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:33796/0 (socket says 172.21.15.44:33796) 2024-09-13T18:27:40.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f7921d9b700 1 -- 172.21.15.44:0/745797842 learned_addr learned my addr 172.21.15.44:0/745797842 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:40.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f792159a700 1 -- 172.21.15.44:0/745797842 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3909341368 0 0) 0x7f7924144720 con 0x7f792406bdb0 2024-09-13T18:27:40.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f7922d9d700 1 -- 172.21.15.44:0/745797842 >> v2:172.21.15.99:3300/0 conn(0x7f7924144340 msgr2=0x7f792406d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:40.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f7922d9d700 1 --2- 172.21.15.44:0/745797842 >> v2:172.21.15.99:3300/0 conn(0x7f7924144340 0x7f792406d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f7922d9d700 1 -- 172.21.15.44:0/745797842 >> v1:172.21.15.99:6789/0 conn(0x7f792406bdb0 legacy=0x7f79240cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:40.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f7922d9d700 1 -- 172.21.15.44:0/745797842 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792415e660 con 0x7f79240cdc90 2024-09-13T18:27:40.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f7922d9d700 1 --2- 172.21.15.44:0/745797842 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79240cdc90 0x7f792406fa90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f791c009d90 tx=0x7f791c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7df76ed2073d4828 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:40.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f792159a700 1 -- 172.21.15.44:0/745797842 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c00e070 con 0x7f79240cdc90 2024-09-13T18:27:40.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f792159a700 1 -- 172.21.15.44:0/745797842 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791c00bb20 con 0x7f79240cdc90 2024-09-13T18:27:40.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f792159a700 1 -- 172.21.15.44:0/745797842 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c012430 con 0x7f79240cdc90 2024-09-13T18:27:40.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f792359e700 1 -- 172.21.15.44:0/745797842 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79240cdc90 msgr2=0x7f792406fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:40.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f792359e700 1 --2- 172.21.15.44:0/745797842 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79240cdc90 0x7f792406fa90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f791c009d90 tx=0x7f791c00b330 comp rx=0 tx=0).stop 2024-09-13T18:27:40.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f792359e700 1 -- 172.21.15.44:0/745797842 shutdown_connections 2024-09-13T18:27:40.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f792359e700 1 --2- 172.21.15.44:0/745797842 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79240cdc90 0x7f792406fa90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f792359e700 1 --2- 172.21.15.44:0/745797842 >> v2:172.21.15.99:3300/0 conn(0x7f7924144340 0x7f792406d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f792359e700 1 -- 172.21.15.44:0/745797842 >> 172.21.15.44:0/745797842 conn(0x7f79240b0e10 msgr2=0x7f79240b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:40.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f792359e700 1 -- 172.21.15.44:0/745797842 shutdown_connections 2024-09-13T18:27:40.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.103+0000 7f792359e700 1 -- 172.21.15.44:0/745797842 wait complete. 2024-09-13T18:27:40.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.107+0000 7f792359e700 1 Processor -- start 2024-09-13T18:27:40.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.107+0000 7f792359e700 1 -- start start 2024-09-13T18:27:40.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.107+0000 7f792359e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f792406bdb0 0x7f79240ca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.107+0000 7f792359e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79240cdc90 0x7f79240aac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.107+0000 7f792359e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7924144340 0x7f79240ac750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.107+0000 7f792359e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79240a8560 con 0x7f79240cdc90 2024-09-13T18:27:40.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.107+0000 7f792359e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79240ca690 con 0x7f792406bdb0 2024-09-13T18:27:40.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.107+0000 7f792359e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79240a8770 con 0x7f7924144340 2024-09-13T18:27:40.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.107+0000 7f7921d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79240cdc90 0x7f79240aac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.107+0000 7f7921d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79240cdc90 0x7f79240aac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40686/0 (socket says 172.21.15.44:40686) 2024-09-13T18:27:40.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.107+0000 7f7921d9b700 1 -- 172.21.15.44:0/398486723 learned_addr learned my addr 172.21.15.44:0/398486723 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:40.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.107+0000 7f7922d9d700 1 --2- 172.21.15.44:0/398486723 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7924144340 0x7f79240ac750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.107+0000 7f792259c700 1 --2- 172.21.15.44:0/398486723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f792406bdb0 0x7f79240ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.107+0000 7f7921d9b700 1 -- 172.21.15.44:0/398486723 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7924144340 msgr2=0x7f79240ac750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:40.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.107+0000 7f7921d9b700 1 --2- 172.21.15.44:0/398486723 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7924144340 0x7f79240ac750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.107+0000 7f7921d9b700 1 -- 172.21.15.44:0/398486723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f792406bdb0 msgr2=0x7f79240ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:40.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.107+0000 7f7921d9b700 1 --2- 172.21.15.44:0/398486723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f792406bdb0 0x7f79240ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.107+0000 7f7921d9b700 1 -- 172.21.15.44:0/398486723 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c009a70 con 0x7f79240cdc90 2024-09-13T18:27:40.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.107+0000 7f792259c700 1 --2- 172.21.15.44:0/398486723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f792406bdb0 0x7f79240ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:40.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.107+0000 7f7921d9b700 1 --2- 172.21.15.44:0/398486723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79240cdc90 0x7f79240aac60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f790c00c4e0 tx=0x7f790c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:40.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.111+0000 7f791affd700 1 -- 172.21.15.44:0/398486723 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c004ca0 con 0x7f79240cdc90 2024-09-13T18:27:40.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.111+0000 7f791affd700 1 -- 172.21.15.44:0/398486723 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790c004e20 con 0x7f79240cdc90 2024-09-13T18:27:40.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.111+0000 7f792359e700 1 -- 172.21.15.44:0/398486723 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79240a8a50 con 0x7f79240cdc90 2024-09-13T18:27:40.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.111+0000 7f791affd700 1 -- 172.21.15.44:0/398486723 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c007310 con 0x7f79240cdc90 2024-09-13T18:27:40.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.111+0000 7f792359e700 1 -- 172.21.15.44:0/398486723 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79240a9010 con 0x7f79240cdc90 2024-09-13T18:27:40.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.111+0000 7f792359e700 1 -- 172.21.15.44:0/398486723 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f792406a310 con 0x7f79240cdc90 2024-09-13T18:27:40.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.111+0000 7f791affd700 1 -- 172.21.15.44:0/398486723 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f790c007470 con 0x7f79240cdc90 2024-09-13T18:27:40.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.111+0000 7f791affd700 1 --2- 172.21.15.44:0/398486723 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7904066730 0x7f7904068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.111+0000 7f791affd700 1 -- 172.21.15.44:0/398486723 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f790c083d80 con 0x7f79240cdc90 2024-09-13T18:27:40.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.111+0000 7f792259c700 1 --2- 172.21.15.44:0/398486723 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7904066730 0x7f7904068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.115+0000 7f792259c700 1 --2- 172.21.15.44:0/398486723 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7904066730 0x7f7904068bf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f79240adf40 tx=0x7f7914008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:40.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.123+0000 7f791affd700 1 -- 172.21.15.44:0/398486723 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f790c0510f0 con 0x7f79240cdc90 2024-09-13T18:27:40.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.307+0000 7f792359e700 1 -- 172.21.15.44:0/398486723 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7924143530 con 0x7f79240cdc90 2024-09-13T18:27:40.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.307+0000 7f791affd700 1 -- 172.21.15.44:0/398486723 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f790c007720 con 0x7f79240cdc90 2024-09-13T18:27:40.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.307+0000 7f792359e700 1 -- 172.21.15.44:0/398486723 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7904066730 msgr2=0x7f7904068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:40.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.307+0000 7f792359e700 1 --2- 172.21.15.44:0/398486723 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7904066730 0x7f7904068bf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f79240adf40 tx=0x7f7914008040 comp rx=0 tx=0).stop 2024-09-13T18:27:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.307+0000 7f792359e700 1 -- 172.21.15.44:0/398486723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79240cdc90 msgr2=0x7f79240aac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.307+0000 7f792359e700 1 --2- 172.21.15.44:0/398486723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79240cdc90 0x7f79240aac60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f790c00c4e0 tx=0x7f790c00c7f0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.307+0000 7f792359e700 1 -- 172.21.15.44:0/398486723 shutdown_connections 2024-09-13T18:27:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.307+0000 7f792359e700 1 --2- 172.21.15.44:0/398486723 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7904066730 0x7f7904068bf0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.307+0000 7f792359e700 1 --2- 172.21.15.44:0/398486723 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7924144340 0x7f79240ac750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.307+0000 7f792359e700 1 --2- 172.21.15.44:0/398486723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79240cdc90 0x7f79240aac60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.307+0000 7f792359e700 1 --2- 172.21.15.44:0/398486723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f792406bdb0 0x7f79240ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.307+0000 7f792359e700 1 -- 172.21.15.44:0/398486723 >> 172.21.15.44:0/398486723 conn(0x7f79240b0e10 msgr2=0x7f79240cd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.307+0000 7f792359e700 1 -- 172.21.15.44:0/398486723 shutdown_connections 2024-09-13T18:27:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.307+0000 7f792359e700 1 -- 172.21.15.44:0/398486723 wait complete. 2024-09-13T18:27:40.315 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-13T18:27:40.326 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2024-09-13T18:27:40.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:40.327 DEBUG:teuthology.orchestra.run.smithi044:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:27:40.349 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:27:40.349 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:27:40.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:40.349 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:27:40.387 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:27:40.387 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:27:40.395 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:27:40.395 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:27:40.403 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:40.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8fb48a0700 1 Processor -- start 2024-09-13T18:27:40.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8fb48a0700 1 -- start start 2024-09-13T18:27:40.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8fb48a0700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8fb0159a50 0x7f8fb006c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8fb48a0700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8fb006cec0 0x7f8fb0159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8fb48a0700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8fb015a370 0x7f8fb015d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8fb48a0700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb006dcc0 con 0x7f8fb006cec0 2024-09-13T18:27:40.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8fb48a0700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb006d700 con 0x7f8fb0159a50 2024-09-13T18:27:40.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8fb48a0700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb006d9e0 con 0x7f8fb015a370 2024-09-13T18:27:40.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8faeffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8fb006cec0 0x7f8fb0159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8faeffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8fb006cec0 0x7f8fb0159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40694/0 (socket says 172.21.15.44:40694) 2024-09-13T18:27:40.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8faeffd700 1 -- 172.21.15.44:0/1438244436 learned_addr learned my addr 172.21.15.44:0/1438244436 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:40.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8faffff700 1 --2- 172.21.15.44:0/1438244436 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8fb015a370 0x7f8fb015d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8faf7fe700 1 --2- 172.21.15.44:0/1438244436 >> v2:172.21.15.99:3300/0 conn(0x7f8fb0159a50 0x7f8fb006c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8faeffd700 1 -- 172.21.15.44:0/1438244436 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8fb015a370 msgr2=0x7f8fb015d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:40.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8faeffd700 1 --2- 172.21.15.44:0/1438244436 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8fb015a370 0x7f8fb015d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8faeffd700 1 -- 172.21.15.44:0/1438244436 >> v2:172.21.15.99:3300/0 conn(0x7f8fb0159a50 msgr2=0x7f8fb006c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:40.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8faeffd700 1 --2- 172.21.15.44:0/1438244436 >> v2:172.21.15.99:3300/0 conn(0x7f8fb0159a50 0x7f8fb006c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8faeffd700 1 -- 172.21.15.44:0/1438244436 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb015b200 con 0x7f8fb006cec0 2024-09-13T18:27:40.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8faffff700 1 --2- 172.21.15.44:0/1438244436 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8fb015a370 0x7f8fb015d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:40.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8faeffd700 1 --2- 172.21.15.44:0/1438244436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fb006cec0 0x7f8fb0159e30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0072570 tx=0x7f8fa000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2ca8b9fd41ae0c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:40.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8fae7fc700 1 -- 172.21.15.44:0/1438244436 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa000e070 con 0x7f8fb006cec0 2024-09-13T18:27:40.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8fae7fc700 1 -- 172.21.15.44:0/1438244436 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa000b910 con 0x7f8fb006cec0 2024-09-13T18:27:40.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8fae7fc700 1 -- 172.21.15.44:0/1438244436 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa000bcc0 con 0x7f8fb006cec0 2024-09-13T18:27:40.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8fb48a0700 1 -- 172.21.15.44:0/1438244436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fb006cec0 msgr2=0x7f8fb0159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:40.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8fb48a0700 1 --2- 172.21.15.44:0/1438244436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fb006cec0 0x7f8fb0159e30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0072570 tx=0x7f8fa000b330 comp rx=0 tx=0).stop 2024-09-13T18:27:40.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8fb48a0700 1 -- 172.21.15.44:0/1438244436 shutdown_connections 2024-09-13T18:27:40.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8fb48a0700 1 --2- 172.21.15.44:0/1438244436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fb006cec0 0x7f8fb0159e30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8fb48a0700 1 --2- 172.21.15.44:0/1438244436 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8fb015a370 0x7f8fb015d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8fb48a0700 1 --2- 172.21.15.44:0/1438244436 >> v2:172.21.15.99:3300/0 conn(0x7f8fb0159a50 0x7f8fb006c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8fb48a0700 1 -- 172.21.15.44:0/1438244436 >> 172.21.15.44:0/1438244436 conn(0x7f8fb00b1f50 msgr2=0x7f8fb00cf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:40.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8fb48a0700 1 -- 172.21.15.44:0/1438244436 shutdown_connections 2024-09-13T18:27:40.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.551+0000 7f8fb48a0700 1 -- 172.21.15.44:0/1438244436 wait complete. 2024-09-13T18:27:40.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.555+0000 7f8fb48a0700 1 Processor -- start 2024-09-13T18:27:40.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.555+0000 7f8fb48a0700 1 -- start start 2024-09-13T18:27:40.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.555+0000 7f8fb48a0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fb006cec0 0x7f8fb00cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.555+0000 7f8fb48a0700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fb0159a50 0x7f8fb014efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.555+0000 7f8fb48a0700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8fb015a370 0x7f8fb01f3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.555+0000 7f8fb48a0700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb014f4e0 con 0x7f8fb006cec0 2024-09-13T18:27:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.555+0000 7f8fb48a0700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb01f42f0 con 0x7f8fb0159a50 2024-09-13T18:27:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.555+0000 7f8fb48a0700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb01f45d0 con 0x7f8fb015a370 2024-09-13T18:27:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.555+0000 7f8faf7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fb006cec0 0x7f8fb00cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.555+0000 7f8faf7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fb006cec0 0x7f8fb00cc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40708/0 (socket says 172.21.15.44:40708) 2024-09-13T18:27:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.555+0000 7f8faf7fe700 1 -- 172.21.15.44:0/4086533882 learned_addr learned my addr 172.21.15.44:0/4086533882 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.555+0000 7f8faffff700 1 --2- 172.21.15.44:0/4086533882 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8fb015a370 0x7f8fb01f3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.555+0000 7f8faeffd700 1 --2- 172.21.15.44:0/4086533882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fb0159a50 0x7f8fb014efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.555+0000 7f8faf7fe700 1 -- 172.21.15.44:0/4086533882 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8fb015a370 msgr2=0x7f8fb01f3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:40.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.555+0000 7f8faf7fe700 1 --2- 172.21.15.44:0/4086533882 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8fb015a370 0x7f8fb01f3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.555+0000 7f8faf7fe700 1 -- 172.21.15.44:0/4086533882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fb0159a50 msgr2=0x7f8fb014efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:40.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.555+0000 7f8faf7fe700 1 --2- 172.21.15.44:0/4086533882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fb0159a50 0x7f8fb014efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.555+0000 7f8faf7fe700 1 -- 172.21.15.44:0/4086533882 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa0009b30 con 0x7f8fb006cec0 2024-09-13T18:27:40.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.559+0000 7f8faf7fe700 1 --2- 172.21.15.44:0/4086533882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fb006cec0 0x7f8fb00cc110 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8f9800e940 tx=0x7f8f9800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:40.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.559+0000 7f8fa7fff700 1 -- 172.21.15.44:0/4086533882 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f98013680 con 0x7f8fb006cec0 2024-09-13T18:27:40.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.559+0000 7f8fa7fff700 1 -- 172.21.15.44:0/4086533882 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f980137e0 con 0x7f8fb006cec0 2024-09-13T18:27:40.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.559+0000 7f8fb48a0700 1 -- 172.21.15.44:0/4086533882 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb01f48b0 con 0x7f8fb006cec0 2024-09-13T18:27:40.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.559+0000 7f8fa7fff700 1 -- 172.21.15.44:0/4086533882 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f98013b70 con 0x7f8fb006cec0 2024-09-13T18:27:40.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.559+0000 7f8fb48a0700 1 -- 172.21.15.44:0/4086533882 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb01f08a0 con 0x7f8fb006cec0 2024-09-13T18:27:40.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.559+0000 7f8fb48a0700 1 -- 172.21.15.44:0/4086533882 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb0159e30 con 0x7f8fb006cec0 2024-09-13T18:27:40.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.559+0000 7f8fa7fff700 1 -- 172.21.15.44:0/4086533882 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8f98013cd0 con 0x7f8fb006cec0 2024-09-13T18:27:40.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.563+0000 7f8fa7fff700 1 --2- 172.21.15.44:0/4086533882 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8f90066730 0x7f8f90068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.563+0000 7f8fa7fff700 1 -- 172.21.15.44:0/4086533882 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f98084030 con 0x7f8fb006cec0 2024-09-13T18:27:40.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.563+0000 7f8faeffd700 1 --2- 172.21.15.44:0/4086533882 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8f90066730 0x7f8f90068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.563+0000 7f8faeffd700 1 --2- 172.21.15.44:0/4086533882 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8f90066730 0x7f8f90068bf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000b370 tx=0x7f8fa0009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:40.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.571+0000 7f8fa7fff700 1 -- 172.21.15.44:0/4086533882 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8f98051430 con 0x7f8fb006cec0 2024-09-13T18:27:40.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.743+0000 7f8fb48a0700 1 -- 172.21.15.44:0/4086533882 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8fb006b020 con 0x7f8fb006cec0 2024-09-13T18:27:40.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.747+0000 7f8fa7fff700 1 -- 172.21.15.44:0/4086533882 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f8f98054a50 con 0x7f8fb006cec0 2024-09-13T18:27:40.751 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:40.751 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:02.280221+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.747+0000 7f8fb48a0700 1 -- 172.21.15.44:0/4086533882 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8f90066730 msgr2=0x7f8f90068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.747+0000 7f8fb48a0700 1 --2- 172.21.15.44:0/4086533882 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8f90066730 0x7f8f90068bf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000b370 tx=0x7f8fa0009000 comp rx=0 tx=0).stop 2024-09-13T18:27:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.747+0000 7f8fb48a0700 1 -- 172.21.15.44:0/4086533882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fb006cec0 msgr2=0x7f8fb00cc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.747+0000 7f8fb48a0700 1 --2- 172.21.15.44:0/4086533882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fb006cec0 0x7f8fb00cc110 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8f9800e940 tx=0x7f8f9800ec50 comp rx=0 tx=0).stop 2024-09-13T18:27:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.747+0000 7f8fb48a0700 1 -- 172.21.15.44:0/4086533882 shutdown_connections 2024-09-13T18:27:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.747+0000 7f8fb48a0700 1 --2- 172.21.15.44:0/4086533882 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8f90066730 0x7f8f90068bf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.747+0000 7f8fb48a0700 1 --2- 172.21.15.44:0/4086533882 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8fb015a370 0x7f8fb01f3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.747+0000 7f8fb48a0700 1 --2- 172.21.15.44:0/4086533882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fb0159a50 0x7f8fb014efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.747+0000 7f8fb48a0700 1 --2- 172.21.15.44:0/4086533882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fb006cec0 0x7f8fb00cc110 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.747+0000 7f8fb48a0700 1 -- 172.21.15.44:0/4086533882 >> 172.21.15.44:0/4086533882 conn(0x7f8fb00b1f50 msgr2=0x7f8fb015d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:40.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.747+0000 7f8fb48a0700 1 -- 172.21.15.44:0/4086533882 shutdown_connections 2024-09-13T18:27:40.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.747+0000 7f8fb48a0700 1 -- 172.21.15.44:0/4086533882 wait complete. 2024-09-13T18:27:40.766 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:26:59.478511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:27:00.261038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:27:40.766 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:27:40.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.883+0000 7f141accc700 1 Processor -- start 2024-09-13T18:27:40.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.883+0000 7f141accc700 1 -- start start 2024-09-13T18:27:40.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f141accc700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f141415a700 0x7f14140adc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f141accc700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f141406e4f0 0x7f14140cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f141accc700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14140ae580 con 0x7f141415aae0 2024-09-13T18:27:40.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f141accc700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1414160a70 con 0x7f141415a700 2024-09-13T18:27:40.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f141accc700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1414160d50 con 0x7f141406e4f0 2024-09-13T18:27:40.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f1419cca700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f141415a700 0x7f14140adc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f14194c9700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f141415aae0 0x7f141406dde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42554/0 (socket says 172.21.15.44:42554) 2024-09-13T18:27:40.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f14194c9700 1 -- 172.21.15.44:0/2616582220 learned_addr learned my addr 172.21.15.44:0/2616582220 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:40.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f1419cca700 1 -- 172.21.15.44:0/2616582220 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f141406e4f0 msgr2=0x7f14140cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:40.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f141a4cb700 1 --2- 172.21.15.44:0/2616582220 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f141406e4f0 0x7f14140cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f1419cca700 1 --2- 172.21.15.44:0/2616582220 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f141406e4f0 0x7f14140cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f1418cc8700 1 -- 172.21.15.44:0/2616582220 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227375311 0 0) 0x7f14140ae580 con 0x7f141415aae0 2024-09-13T18:27:40.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f1419cca700 1 -- 172.21.15.44:0/2616582220 >> v1:172.21.15.44:6789/0 conn(0x7f141415aae0 legacy=0x7f141406dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:40.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f1419cca700 1 -- 172.21.15.44:0/2616582220 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1414161030 con 0x7f141415a700 2024-09-13T18:27:40.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f141a4cb700 1 --2- 172.21.15.44:0/2616582220 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f141406e4f0 0x7f14140cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:40.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f1419cca700 1 --2- 172.21.15.44:0/2616582220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f141415a700 0x7f14140adc10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1410009dc0 tx=0x7f141000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572e3fb6ddfa6fec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:40.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f1418cc8700 1 -- 172.21.15.44:0/2616582220 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141000e070 con 0x7f141415a700 2024-09-13T18:27:40.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f1418cc8700 1 -- 172.21.15.44:0/2616582220 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141000bb90 con 0x7f141415a700 2024-09-13T18:27:40.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f1418cc8700 1 -- 172.21.15.44:0/2616582220 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410012430 con 0x7f141415a700 2024-09-13T18:27:40.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f141accc700 1 -- 172.21.15.44:0/2616582220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f141415a700 msgr2=0x7f14140adc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:40.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f141accc700 1 --2- 172.21.15.44:0/2616582220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f141415a700 0x7f14140adc10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1410009dc0 tx=0x7f141000b330 comp rx=0 tx=0).stop 2024-09-13T18:27:40.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f141accc700 1 -- 172.21.15.44:0/2616582220 shutdown_connections 2024-09-13T18:27:40.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f141accc700 1 --2- 172.21.15.44:0/2616582220 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f141406e4f0 0x7f14140cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f141accc700 1 --2- 172.21.15.44:0/2616582220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f141415a700 0x7f14140adc10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f141accc700 1 -- 172.21.15.44:0/2616582220 >> 172.21.15.44:0/2616582220 conn(0x7f14140cf9a0 msgr2=0x7f14140cfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:40.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f141accc700 1 -- 172.21.15.44:0/2616582220 shutdown_connections 2024-09-13T18:27:40.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.887+0000 7f141accc700 1 -- 172.21.15.44:0/2616582220 wait complete. 2024-09-13T18:27:40.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.891+0000 7f141accc700 1 Processor -- start 2024-09-13T18:27:40.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.891+0000 7f141accc700 1 -- start start 2024-09-13T18:27:40.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.895+0000 7f141accc700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f141406e4f0 0x7f14140c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.895+0000 7f141accc700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f141415a700 0x7f14141595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.895+0000 7f141accc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f141415aae0 0x7f14141f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.895+0000 7f141accc700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14141f3720 con 0x7f141415aae0 2024-09-13T18:27:40.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.895+0000 7f141accc700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1414159b10 con 0x7f141415a700 2024-09-13T18:27:40.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.895+0000 7f141accc700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14141f2db0 con 0x7f141406e4f0 2024-09-13T18:27:40.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.895+0000 7f141a4cb700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f141415aae0 0x7f14141f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.895+0000 7f141a4cb700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f141415aae0 0x7f14141f2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40734/0 (socket says 172.21.15.44:40734) 2024-09-13T18:27:40.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.895+0000 7f141a4cb700 1 -- 172.21.15.44:0/222603997 learned_addr learned my addr 172.21.15.44:0/222603997 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:40.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.895+0000 7f1419cca700 1 --2- 172.21.15.44:0/222603997 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f141406e4f0 0x7f14140c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.895+0000 7f14194c9700 1 --2- 172.21.15.44:0/222603997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f141415a700 0x7f14141595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.895+0000 7f141a4cb700 1 -- 172.21.15.44:0/222603997 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f141406e4f0 msgr2=0x7f14140c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:40.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.895+0000 7f141a4cb700 1 --2- 172.21.15.44:0/222603997 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f141406e4f0 0x7f14140c4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.895+0000 7f141a4cb700 1 -- 172.21.15.44:0/222603997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f141415a700 msgr2=0x7f14141595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:40.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.895+0000 7f141a4cb700 1 --2- 172.21.15.44:0/222603997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f141415a700 0x7f14141595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.895+0000 7f141a4cb700 1 -- 172.21.15.44:0/222603997 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1410009a70 con 0x7f141415aae0 2024-09-13T18:27:40.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.895+0000 7f141a4cb700 1 --2- 172.21.15.44:0/222603997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f141415aae0 0x7f14141f2510 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f140c00c7c0 tx=0x7f140c00cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:40.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.895+0000 7f140a7fc700 1 -- 172.21.15.44:0/222603997 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c011800 con 0x7f141415aae0 2024-09-13T18:27:40.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.895+0000 7f140a7fc700 1 -- 172.21.15.44:0/222603997 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c011960 con 0x7f141415aae0 2024-09-13T18:27:40.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.895+0000 7f141accc700 1 -- 172.21.15.44:0/222603997 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14141f3090 con 0x7f141415aae0 2024-09-13T18:27:40.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.895+0000 7f140a7fc700 1 -- 172.21.15.44:0/222603997 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c011d10 con 0x7f141415aae0 2024-09-13T18:27:40.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.895+0000 7f141accc700 1 -- 172.21.15.44:0/222603997 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14141f3930 con 0x7f141415aae0 2024-09-13T18:27:40.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.899+0000 7f141accc700 1 -- 172.21.15.44:0/222603997 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14141f3b50 con 0x7f141415aae0 2024-09-13T18:27:40.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.899+0000 7f140a7fc700 1 -- 172.21.15.44:0/222603997 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f140c021350 con 0x7f141415aae0 2024-09-13T18:27:40.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.899+0000 7f140a7fc700 1 --2- 172.21.15.44:0/222603997 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f13f8066730 0x7f13f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.899+0000 7f140a7fc700 1 -- 172.21.15.44:0/222603997 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f140c083eb0 con 0x7f141415aae0 2024-09-13T18:27:40.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.899+0000 7f1419cca700 1 --2- 172.21.15.44:0/222603997 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f13f8066730 0x7f13f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.899+0000 7f1419cca700 1 --2- 172.21.15.44:0/222603997 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f13f8066730 0x7f13f8068bf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1410014040 tx=0x7f1410011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:40.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:40.907+0000 7f140a7fc700 1 -- 172.21.15.44:0/222603997 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f140c051220 con 0x7f141415aae0 2024-09-13T18:27:41.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.079+0000 7f141accc700 1 -- 172.21.15.44:0/222603997 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1414161550 con 0x7f141415aae0 2024-09-13T18:27:41.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.079+0000 7f140a7fc700 1 -- 172.21.15.44:0/222603997 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f140c01e020 con 0x7f141415aae0 2024-09-13T18:27:41.085 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:27:41.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.083+0000 7f141accc700 1 -- 172.21.15.44:0/222603997 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f13f8066730 msgr2=0x7f13f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:41.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.083+0000 7f141accc700 1 --2- 172.21.15.44:0/222603997 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f13f8066730 0x7f13f8068bf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1410014040 tx=0x7f1410011000 comp rx=0 tx=0).stop 2024-09-13T18:27:41.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.083+0000 7f141accc700 1 -- 172.21.15.44:0/222603997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f141415aae0 msgr2=0x7f14141f2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:41.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.083+0000 7f141accc700 1 --2- 172.21.15.44:0/222603997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f141415aae0 0x7f14141f2510 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f140c00c7c0 tx=0x7f140c00cad0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.083+0000 7f141accc700 1 -- 172.21.15.44:0/222603997 shutdown_connections 2024-09-13T18:27:41.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.083+0000 7f141accc700 1 --2- 172.21.15.44:0/222603997 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f13f8066730 0x7f13f8068bf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.083+0000 7f141accc700 1 --2- 172.21.15.44:0/222603997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f141415aae0 0x7f14141f2510 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.083+0000 7f141accc700 1 --2- 172.21.15.44:0/222603997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f141415a700 0x7f14141595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.083+0000 7f141accc700 1 --2- 172.21.15.44:0/222603997 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f141406e4f0 0x7f14140c4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.083+0000 7f141accc700 1 -- 172.21.15.44:0/222603997 >> 172.21.15.44:0/222603997 conn(0x7f14140cf9a0 msgr2=0x7f14140b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:41.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.083+0000 7f141accc700 1 -- 172.21.15.44:0/222603997 shutdown_connections 2024-09-13T18:27:41.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.083+0000 7f141accc700 1 -- 172.21.15.44:0/222603997 wait complete. 2024-09-13T18:27:41.100 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:27:41.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.219+0000 7f16c5033700 1 Processor -- start 2024-09-13T18:27:41.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.219+0000 7f16c5033700 1 -- start start 2024-09-13T18:27:41.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.223+0000 7f16c5033700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f16c006b900 0x7f16c00b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:41.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.223+0000 7f16c5033700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c00b8430 con 0x7f16c006a520 2024-09-13T18:27:41.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.223+0000 7f16c5033700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c006bd60 con 0x7f16c015cda0 2024-09-13T18:27:41.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.223+0000 7f16c5033700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c00cf350 con 0x7f16c006b900 2024-09-13T18:27:41.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.223+0000 7f16b77fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f16c006b900 0x7f16c00b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:41.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.223+0000 7f16c4832700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f16c006a520 0x7f16c006a930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42562/0 (socket says 172.21.15.44:42562) 2024-09-13T18:27:41.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.223+0000 7f16c4832700 1 -- 172.21.15.44:0/3046580557 learned_addr learned my addr 172.21.15.44:0/3046580557 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:41.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.223+0000 7f16b77fe700 1 -- 172.21.15.44:0/3046580557 >> v1:172.21.15.99:6789/0 conn(0x7f16c015cda0 legacy=0x7f16c00ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:41.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.223+0000 7f16b77fe700 1 -- 172.21.15.44:0/3046580557 >> v1:172.21.15.44:6789/0 conn(0x7f16c006a520 legacy=0x7f16c006a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:41.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.223+0000 7f16bf7fe700 1 -- 172.21.15.44:0/3046580557 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1595334072 0 0) 0x7f16c00b8430 con 0x7f16c006a520 2024-09-13T18:27:41.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.223+0000 7f16b77fe700 1 -- 172.21.15.44:0/3046580557 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c00d0880 con 0x7f16c006b900 2024-09-13T18:27:41.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.223+0000 7f16b77fe700 1 --2- 172.21.15.44:0/3046580557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16c006b900 0x7f16c00b5de0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f16a8009850 tx=0x7f16a8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60179c0adbae2558 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:41.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.223+0000 7f16bf7fe700 1 -- 172.21.15.44:0/3046580557 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a8011830 con 0x7f16c006b900 2024-09-13T18:27:41.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.223+0000 7f16bf7fe700 1 -- 172.21.15.44:0/3046580557 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a8011990 con 0x7f16c006b900 2024-09-13T18:27:41.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.223+0000 7f16bf7fe700 1 -- 172.21.15.44:0/3046580557 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a8011d20 con 0x7f16c006b900 2024-09-13T18:27:41.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.223+0000 7f16c5033700 1 -- 172.21.15.44:0/3046580557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16c006b900 msgr2=0x7f16c00b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:41.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.223+0000 7f16c5033700 1 --2- 172.21.15.44:0/3046580557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16c006b900 0x7f16c00b5de0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f16a8009850 tx=0x7f16a8009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:41.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.223+0000 7f16c5033700 1 -- 172.21.15.44:0/3046580557 shutdown_connections 2024-09-13T18:27:41.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.223+0000 7f16c5033700 1 --2- 172.21.15.44:0/3046580557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16c006b900 0x7f16c00b5de0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.223+0000 7f16c5033700 1 -- 172.21.15.44:0/3046580557 >> 172.21.15.44:0/3046580557 conn(0x7f16c00d2cb0 msgr2=0x7f16c00d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:41.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16c5033700 1 -- 172.21.15.44:0/3046580557 shutdown_connections 2024-09-13T18:27:41.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16c5033700 1 -- 172.21.15.44:0/3046580557 wait complete. 2024-09-13T18:27:41.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16c5033700 1 Processor -- start 2024-09-13T18:27:41.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16c5033700 1 -- start start 2024-09-13T18:27:41.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16c5033700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f16c006a520 0x7f16c0146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:41.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16c5033700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16c006b900 0x7f16c01f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:41.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16c5033700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16c015cda0 0x7f16c00c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:41.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16c5033700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c01522f0 con 0x7f16c015cda0 2024-09-13T18:27:41.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16c5033700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c0154740 con 0x7f16c006b900 2024-09-13T18:27:41.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16c5033700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c0154a20 con 0x7f16c006a520 2024-09-13T18:27:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16c4832700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16c015cda0 0x7f16c00c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16c4832700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16c015cda0 0x7f16c00c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40752/0 (socket says 172.21.15.44:40752) 2024-09-13T18:27:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16c4832700 1 -- 172.21.15.44:0/3109076196 learned_addr learned my addr 172.21.15.44:0/3109076196 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16b77fe700 1 --2- 172.21.15.44:0/3109076196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16c006b900 0x7f16c01f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16bffff700 1 --2- 172.21.15.44:0/3109076196 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f16c006a520 0x7f16c0146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:41.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16c4832700 1 -- 172.21.15.44:0/3109076196 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f16c006a520 msgr2=0x7f16c0146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:41.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16c4832700 1 --2- 172.21.15.44:0/3109076196 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f16c006a520 0x7f16c0146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16c4832700 1 -- 172.21.15.44:0/3109076196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16c006b900 msgr2=0x7f16c01f26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:41.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16c4832700 1 --2- 172.21.15.44:0/3109076196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16c006b900 0x7f16c01f26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16c4832700 1 -- 172.21.15.44:0/3109076196 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a80094b0 con 0x7f16c015cda0 2024-09-13T18:27:41.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16c4832700 1 --2- 172.21.15.44:0/3109076196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16c015cda0 0x7f16c00c89b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f16b8002230 tx=0x7f16b800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:41.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16bd7fa700 1 -- 172.21.15.44:0/3109076196 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b800aac0 con 0x7f16c015cda0 2024-09-13T18:27:41.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16bd7fa700 1 -- 172.21.15.44:0/3109076196 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b800ac40 con 0x7f16c015cda0 2024-09-13T18:27:41.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16c5033700 1 -- 172.21.15.44:0/3109076196 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c0152540 con 0x7f16c015cda0 2024-09-13T18:27:41.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16bd7fa700 1 -- 172.21.15.44:0/3109076196 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b80070d0 con 0x7f16c015cda0 2024-09-13T18:27:41.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.227+0000 7f16c5033700 1 -- 172.21.15.44:0/3109076196 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c01474b0 con 0x7f16c015cda0 2024-09-13T18:27:41.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.231+0000 7f16c5033700 1 -- 172.21.15.44:0/3109076196 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c0152a60 con 0x7f16c015cda0 2024-09-13T18:27:41.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.231+0000 7f16bd7fa700 1 -- 172.21.15.44:0/3109076196 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f16b8007250 con 0x7f16c015cda0 2024-09-13T18:27:41.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.231+0000 7f16bd7fa700 1 --2- 172.21.15.44:0/3109076196 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f16a0066730 0x7f16a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:41.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.231+0000 7f16bd7fa700 1 -- 172.21.15.44:0/3109076196 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16b8083ec0 con 0x7f16c015cda0 2024-09-13T18:27:41.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.231+0000 7f16bffff700 1 --2- 172.21.15.44:0/3109076196 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f16a0066730 0x7f16a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:41.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.235+0000 7f16bffff700 1 --2- 172.21.15.44:0/3109076196 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f16a0066730 0x7f16a0068bf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f16b0000f60 tx=0x7f16b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:41.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.239+0000 7f16bd7fa700 1 -- 172.21.15.44:0/3109076196 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f16b80512c0 con 0x7f16c015cda0 2024-09-13T18:27:41.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.415+0000 7f16c5033700 1 -- 172.21.15.44:0/3109076196 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16c00b62c0 con 0x7f16c015cda0 2024-09-13T18:27:41.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.415+0000 7f16bd7fa700 1 -- 172.21.15.44:0/3109076196 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f16b8018020 con 0x7f16c015cda0 2024-09-13T18:27:41.419 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:27:41.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.415+0000 7f16c5033700 1 -- 172.21.15.44:0/3109076196 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f16a0066730 msgr2=0x7f16a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:41.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.415+0000 7f16c5033700 1 --2- 172.21.15.44:0/3109076196 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f16a0066730 0x7f16a0068bf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f16b0000f60 tx=0x7f16b0009040 comp rx=0 tx=0).stop 2024-09-13T18:27:41.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.415+0000 7f16c5033700 1 -- 172.21.15.44:0/3109076196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16c015cda0 msgr2=0x7f16c00c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:41.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.415+0000 7f16c5033700 1 --2- 172.21.15.44:0/3109076196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16c015cda0 0x7f16c00c89b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f16b8002230 tx=0x7f16b800cf50 comp rx=0 tx=0).stop 2024-09-13T18:27:41.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.415+0000 7f16c5033700 1 -- 172.21.15.44:0/3109076196 shutdown_connections 2024-09-13T18:27:41.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.415+0000 7f16c5033700 1 --2- 172.21.15.44:0/3109076196 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f16a0066730 0x7f16a0068bf0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.415+0000 7f16c5033700 1 --2- 172.21.15.44:0/3109076196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16c015cda0 0x7f16c00c89b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.415+0000 7f16c5033700 1 --2- 172.21.15.44:0/3109076196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16c006b900 0x7f16c01f26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.415+0000 7f16c5033700 1 --2- 172.21.15.44:0/3109076196 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f16c006a520 0x7f16c0146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.415+0000 7f16c5033700 1 -- 172.21.15.44:0/3109076196 >> 172.21.15.44:0/3109076196 conn(0x7f16c00d2cb0 msgr2=0x7f16c00d1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:41.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.419+0000 7f16c5033700 1 -- 172.21.15.44:0/3109076196 shutdown_connections 2024-09-13T18:27:41.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.419+0000 7f16c5033700 1 -- 172.21.15.44:0/3109076196 wait complete. 2024-09-13T18:27:41.435 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:27:41.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14759e700 1 Processor -- start 2024-09-13T18:27:41.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14759e700 1 -- start start 2024-09-13T18:27:41.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14759e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb148164290 0x7fb148070bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:41.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14759e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb148162570 con 0x7fb148165160 2024-09-13T18:27:41.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14759e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb148071240 con 0x7fb14806d8c0 2024-09-13T18:27:41.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14759e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb148162e60 con 0x7fb148164290 2024-09-13T18:27:41.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb145d9b700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb148165160 0x7fb1480704c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42572/0 (socket says 172.21.15.44:42572) 2024-09-13T18:27:41.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb145d9b700 1 -- 172.21.15.44:0/654791671 learned_addr learned my addr 172.21.15.44:0/654791671 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:41.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb146d9d700 1 --2- 172.21.15.44:0/654791671 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb148164290 0x7fb148070bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:41.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14559a700 1 -- 172.21.15.44:0/654791671 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1475429712 0 0) 0x7fb148162570 con 0x7fb148165160 2024-09-13T18:27:41.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14559a700 1 -- 172.21.15.44:0/654791671 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1300035d0 con 0x7fb148165160 2024-09-13T18:27:41.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14559a700 1 -- 172.21.15.44:0/654791671 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 172802507 0 0) 0x7fb148071240 con 0x7fb14806d8c0 2024-09-13T18:27:41.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14559a700 1 -- 172.21.15.44:0/654791671 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb148162570 con 0x7fb14806d8c0 2024-09-13T18:27:41.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14559a700 1 -- 172.21.15.44:0/654791671 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 655875279 0 0) 0x7fb1300035d0 con 0x7fb148165160 2024-09-13T18:27:41.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14559a700 1 -- 172.21.15.44:0/654791671 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb148164290 msgr2=0x7fb148070bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:41.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14559a700 1 --2- 172.21.15.44:0/654791671 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb148164290 0x7fb148070bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14559a700 1 -- 172.21.15.44:0/654791671 >> v1:172.21.15.99:6789/0 conn(0x7fb14806d8c0 legacy=0x7fb148164a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:41.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14559a700 1 -- 172.21.15.44:0/654791671 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1481627a0 con 0x7fb148165160 2024-09-13T18:27:41.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14559a700 1 -- 172.21.15.44:0/654791671 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7fb138001670 con 0x7fb148165160 2024-09-13T18:27:41.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14559a700 1 -- 172.21.15.44:0/654791671 >> v1:172.21.15.44:6789/0 conn(0x7fb148165160 legacy=0x7fb1480704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:41.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14559a700 1 --2- 172.21.15.44:0/654791671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb130003be0 0x7fb130003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:41.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14559a700 1 --2- 172.21.15.44:0/654791671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb130004870 0x7fb130004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:41.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14559a700 1 --2- 172.21.15.44:0/654791671 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb148164290 0x7fb1300052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:41.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14559a700 1 -- 172.21.15.44:0/654791671 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb148162e60 con 0x7fb130003be0 2024-09-13T18:27:41.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14559a700 1 -- 172.21.15.44:0/654791671 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13000bc20 con 0x7fb130004870 2024-09-13T18:27:41.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14559a700 1 -- 172.21.15.44:0/654791671 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13000bde0 con 0x7fb148164290 2024-09-13T18:27:41.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb145d9b700 1 --2- 172.21.15.44:0/654791671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb130004870 0x7fb130004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:41.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14659c700 1 --2- 172.21.15.44:0/654791671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb130003be0 0x7fb130003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:41.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb146d9d700 1 --2- 172.21.15.44:0/654791671 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb148164290 0x7fb1300052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:41.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb145d9b700 1 -- 172.21.15.44:0/654791671 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb148164290 msgr2=0x7fb1300052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:41.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb145d9b700 1 --2- 172.21.15.44:0/654791671 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb148164290 0x7fb1300052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb145d9b700 1 -- 172.21.15.44:0/654791671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb130003be0 msgr2=0x7fb130003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:41.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb145d9b700 1 --2- 172.21.15.44:0/654791671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb130003be0 0x7fb130003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb145d9b700 1 -- 172.21.15.44:0/654791671 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1300035d0 con 0x7fb130004870 2024-09-13T18:27:41.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb14659c700 1 --2- 172.21.15.44:0/654791671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb130003be0 0x7fb130003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:41.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.551+0000 7fb145d9b700 1 --2- 172.21.15.44:0/654791671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb130004870 0x7fb130004cf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb13800c210 tx=0x7fb1300058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e88dfe2de23482f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:41.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.555+0000 7fb14559a700 1 -- 172.21.15.44:0/654791671 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13800cdb0 con 0x7fb130004870 2024-09-13T18:27:41.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.555+0000 7fb14559a700 1 -- 172.21.15.44:0/654791671 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb138005980 con 0x7fb130004870 2024-09-13T18:27:41.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.555+0000 7fb14559a700 1 -- 172.21.15.44:0/654791671 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138005d30 con 0x7fb130004870 2024-09-13T18:27:41.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.555+0000 7fb14759e700 1 -- 172.21.15.44:0/654791671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb130004870 msgr2=0x7fb130004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:41.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.555+0000 7fb14759e700 1 --2- 172.21.15.44:0/654791671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb130004870 0x7fb130004cf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb13800c210 tx=0x7fb1300058a0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.555+0000 7fb146d9d700 1 -- 172.21.15.44:0/654791671 reap_dead start 2024-09-13T18:27:41.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.555+0000 7fb14759e700 1 -- 172.21.15.44:0/654791671 shutdown_connections 2024-09-13T18:27:41.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.555+0000 7fb14759e700 1 -- 172.21.15.44:0/654791671 >> 172.21.15.44:0/654791671 conn(0x7fb1480b0e10 msgr2=0x7fb1480b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:41.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.555+0000 7fb14759e700 1 -- 172.21.15.44:0/654791671 shutdown_connections 2024-09-13T18:27:41.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.555+0000 7fb14759e700 1 -- 172.21.15.44:0/654791671 wait complete. 2024-09-13T18:27:41.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.559+0000 7fb14759e700 1 Processor -- start 2024-09-13T18:27:41.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.559+0000 7fb14759e700 1 -- start start 2024-09-13T18:27:41.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.559+0000 7fb14759e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb130004870 0x7fb14815ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:41.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.559+0000 7fb14759e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb14815cd90 0x7fb14815e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:41.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.559+0000 7fb14759e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb148154d60 0x7fb14806c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:41.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.559+0000 7fb14759e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14815a340 con 0x7fb14815cd90 2024-09-13T18:27:41.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.559+0000 7fb14759e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb148159a00 con 0x7fb148154d60 2024-09-13T18:27:41.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.559+0000 7fb14759e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14815d560 con 0x7fb130004870 2024-09-13T18:27:41.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.559+0000 7fb145d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb14815cd90 0x7fb14815e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:41.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.559+0000 7fb145d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb14815cd90 0x7fb14815e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40764/0 (socket says 172.21.15.44:40764) 2024-09-13T18:27:41.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.559+0000 7fb145d9b700 1 -- 172.21.15.44:0/483013420 learned_addr learned my addr 172.21.15.44:0/483013420 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:41.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.559+0000 7fb14659c700 1 --2- 172.21.15.44:0/483013420 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb130004870 0x7fb14815ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:41.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.559+0000 7fb146d9d700 1 --2- 172.21.15.44:0/483013420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb148154d60 0x7fb14806c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:41.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.559+0000 7fb145d9b700 1 -- 172.21.15.44:0/483013420 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb130004870 msgr2=0x7fb14815ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:41.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.559+0000 7fb145d9b700 1 --2- 172.21.15.44:0/483013420 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb130004870 0x7fb14815ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.559+0000 7fb145d9b700 1 -- 172.21.15.44:0/483013420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb148154d60 msgr2=0x7fb14806c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:41.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.559+0000 7fb145d9b700 1 --2- 172.21.15.44:0/483013420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb148154d60 0x7fb14806c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.559+0000 7fb145d9b700 1 -- 172.21.15.44:0/483013420 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14815d840 con 0x7fb14815cd90 2024-09-13T18:27:41.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.563+0000 7fb145d9b700 1 --2- 172.21.15.44:0/483013420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb14815cd90 0x7fb14815e600 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb13800c800 tx=0x7fb138001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:41.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.563+0000 7fb136ffd700 1 -- 172.21.15.44:0/483013420 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138004890 con 0x7fb14815cd90 2024-09-13T18:27:41.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.563+0000 7fb136ffd700 1 -- 172.21.15.44:0/483013420 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb138004a10 con 0x7fb14815cd90 2024-09-13T18:27:41.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.563+0000 7fb136ffd700 1 -- 172.21.15.44:0/483013420 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138004dc0 con 0x7fb14815cd90 2024-09-13T18:27:41.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.563+0000 7fb14759e700 1 -- 172.21.15.44:0/483013420 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb14815db20 con 0x7fb14815cd90 2024-09-13T18:27:41.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.563+0000 7fb14759e700 1 -- 172.21.15.44:0/483013420 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14815e0e0 con 0x7fb14815cd90 2024-09-13T18:27:41.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.563+0000 7fb136ffd700 1 -- 172.21.15.44:0/483013420 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb138007070 con 0x7fb14815cd90 2024-09-13T18:27:41.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.563+0000 7fb14759e700 1 -- 172.21.15.44:0/483013420 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb14815e2a0 con 0x7fb14815cd90 2024-09-13T18:27:41.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.563+0000 7fb136ffd700 1 --2- 172.21.15.44:0/483013420 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb128066730 0x7fb128068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:41.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.563+0000 7fb136ffd700 1 -- 172.21.15.44:0/483013420 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb138085450 con 0x7fb14815cd90 2024-09-13T18:27:41.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.563+0000 7fb14659c700 1 --2- 172.21.15.44:0/483013420 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb128066730 0x7fb128068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:41.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.567+0000 7fb14659c700 1 --2- 172.21.15.44:0/483013420 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb128066730 0x7fb128068bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb13c000c00 tx=0x7fb13c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:41.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.575+0000 7fb136ffd700 1 -- 172.21.15.44:0/483013420 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb1380528a0 con 0x7fb14815cd90 2024-09-13T18:27:41.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.739+0000 7fb14759e700 1 -- 172.21.15.44:0/483013420 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb148066a50 con 0x7fb14815cd90 2024-09-13T18:27:41.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.739+0000 7fb136ffd700 1 -- 172.21.15.44:0/483013420 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb138055ec0 con 0x7fb14815cd90 2024-09-13T18:27:41.744 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:27:41.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.739+0000 7fb14759e700 1 -- 172.21.15.44:0/483013420 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb128066730 msgr2=0x7fb128068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:41.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.739+0000 7fb14759e700 1 --2- 172.21.15.44:0/483013420 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb128066730 0x7fb128068bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb13c000c00 tx=0x7fb13c009040 comp rx=0 tx=0).stop 2024-09-13T18:27:41.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.739+0000 7fb14759e700 1 -- 172.21.15.44:0/483013420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb14815cd90 msgr2=0x7fb14815e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:41.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.739+0000 7fb14759e700 1 --2- 172.21.15.44:0/483013420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb14815cd90 0x7fb14815e600 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb13800c800 tx=0x7fb138001980 comp rx=0 tx=0).stop 2024-09-13T18:27:41.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.743+0000 7fb14759e700 1 -- 172.21.15.44:0/483013420 shutdown_connections 2024-09-13T18:27:41.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.743+0000 7fb14759e700 1 --2- 172.21.15.44:0/483013420 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb128066730 0x7fb128068bf0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.743+0000 7fb14759e700 1 --2- 172.21.15.44:0/483013420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb148154d60 0x7fb14806c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.743+0000 7fb14759e700 1 --2- 172.21.15.44:0/483013420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb14815cd90 0x7fb14815e600 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.743+0000 7fb14759e700 1 --2- 172.21.15.44:0/483013420 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb130004870 0x7fb14815ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.743+0000 7fb14759e700 1 -- 172.21.15.44:0/483013420 >> 172.21.15.44:0/483013420 conn(0x7fb1480b0e10 msgr2=0x7fb148160840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:41.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.743+0000 7fb14759e700 1 -- 172.21.15.44:0/483013420 shutdown_connections 2024-09-13T18:27:41.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.743+0000 7fb14759e700 1 -- 172.21.15.44:0/483013420 wait complete. 2024-09-13T18:27:41.759 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:27:41.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.871+0000 7f49e0c0a700 1 Processor -- start 2024-09-13T18:27:41.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.871+0000 7f49e0c0a700 1 -- start start 2024-09-13T18:27:41.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49e0c0a700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f49dc0cd6d0 0x7f49dc0cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:41.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49e0c0a700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f49dc06dbf0 0x7f49dc0b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:41.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49e0c0a700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49dc0cdff0 con 0x7f49dc06d760 2024-09-13T18:27:41.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49e0c0a700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49dc15be50 con 0x7f49dc06dbf0 2024-09-13T18:27:41.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49e0c0a700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49dc06b4d0 con 0x7f49dc0cd6d0 2024-09-13T18:27:41.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49dad9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f49dc06dbf0 0x7f49dc0b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:41.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49dad9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f49dc06dbf0 0x7f49dc0b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40780/0 (socket says 172.21.15.44:40780) 2024-09-13T18:27:41.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49dad9d700 1 -- 172.21.15.44:0/3496330980 learned_addr learned my addr 172.21.15.44:0/3496330980 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:41.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49da59c700 1 --2- 172.21.15.44:0/3496330980 >> v2:172.21.15.99:3300/0 conn(0x7f49dc0cd6d0 0x7f49dc0cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:41.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49dad9d700 1 -- 172.21.15.44:0/3496330980 >> v2:172.21.15.99:3300/0 conn(0x7f49dc0cd6d0 msgr2=0x7f49dc0cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:41.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49dad9d700 1 --2- 172.21.15.44:0/3496330980 >> v2:172.21.15.99:3300/0 conn(0x7f49dc0cd6d0 0x7f49dc0cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49dad9d700 1 -- 172.21.15.44:0/3496330980 >> v1:172.21.15.99:6789/0 conn(0x7f49dc06d760 legacy=0x7f49dc0b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:41.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49dad9d700 1 -- 172.21.15.44:0/3496330980 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc15b1d0 con 0x7f49dc06dbf0 2024-09-13T18:27:41.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49dad9d700 1 --2- 172.21.15.44:0/3496330980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49dc06dbf0 0x7f49dc0b3290 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0b17d0 tx=0x7f49d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b5ead315c3312e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:41.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49d9d9b700 1 -- 172.21.15.44:0/3496330980 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d400e070 con 0x7f49dc06dbf0 2024-09-13T18:27:41.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49d9d9b700 1 -- 172.21.15.44:0/3496330980 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d400b980 con 0x7f49dc06dbf0 2024-09-13T18:27:41.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49d9d9b700 1 -- 172.21.15.44:0/3496330980 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d400bd30 con 0x7f49dc06dbf0 2024-09-13T18:27:41.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49e0c0a700 1 -- 172.21.15.44:0/3496330980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49dc06dbf0 msgr2=0x7f49dc0b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:41.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49e0c0a700 1 --2- 172.21.15.44:0/3496330980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49dc06dbf0 0x7f49dc0b3290 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0b17d0 tx=0x7f49d400b330 comp rx=0 tx=0).stop 2024-09-13T18:27:41.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49e0c0a700 1 -- 172.21.15.44:0/3496330980 shutdown_connections 2024-09-13T18:27:41.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49e0c0a700 1 --2- 172.21.15.44:0/3496330980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49dc06dbf0 0x7f49dc0b3290 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49e0c0a700 1 --2- 172.21.15.44:0/3496330980 >> v2:172.21.15.99:3300/0 conn(0x7f49dc0cd6d0 0x7f49dc0cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49e0c0a700 1 -- 172.21.15.44:0/3496330980 >> 172.21.15.44:0/3496330980 conn(0x7f49dc0af620 msgr2=0x7f49dc0afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:41.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49e0c0a700 1 -- 172.21.15.44:0/3496330980 shutdown_connections 2024-09-13T18:27:41.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.875+0000 7f49e0c0a700 1 -- 172.21.15.44:0/3496330980 wait complete. 2024-09-13T18:27:41.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49e0c0a700 1 Processor -- start 2024-09-13T18:27:41.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49e0c0a700 1 -- start start 2024-09-13T18:27:41.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49e0c0a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f49dc06d760 0x7f49dc1e0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:41.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49e0c0a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49dc06dbf0 0x7f49dc1e4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:41.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49e0c0a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49dc0cd6d0 0x7f49dc1598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:41.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49e0c0a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc1e3960 con 0x7f49dc0cd6d0 2024-09-13T18:27:41.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49e0c0a700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc1e3c40 con 0x7f49dc06dbf0 2024-09-13T18:27:41.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49e0c0a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc1e3f20 con 0x7f49dc06d760 2024-09-13T18:27:41.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49dad9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49dc0cd6d0 0x7f49dc1598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:41.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49dad9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49dc0cd6d0 0x7f49dc1598c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40790/0 (socket says 172.21.15.44:40790) 2024-09-13T18:27:41.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49d3fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49dc06dbf0 0x7f49dc1e4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:41.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49dad9d700 1 -- 172.21.15.44:0/3384675637 learned_addr learned my addr 172.21.15.44:0/3384675637 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:41.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49da59c700 1 --2- 172.21.15.44:0/3384675637 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f49dc06d760 0x7f49dc1e0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:41.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49dad9d700 1 -- 172.21.15.44:0/3384675637 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f49dc06d760 msgr2=0x7f49dc1e0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:41.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49dad9d700 1 --2- 172.21.15.44:0/3384675637 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f49dc06d760 0x7f49dc1e0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49dad9d700 1 -- 172.21.15.44:0/3384675637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49dc06dbf0 msgr2=0x7f49dc1e4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:41.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49dad9d700 1 --2- 172.21.15.44:0/3384675637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49dc06dbf0 0x7f49dc1e4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49dad9d700 1 -- 172.21.15.44:0/3384675637 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d4009b30 con 0x7f49dc0cd6d0 2024-09-13T18:27:41.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49dad9d700 1 --2- 172.21.15.44:0/3384675637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49dc0cd6d0 0x7f49dc1598c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0b16b0 tx=0x7f49d4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:41.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49d2ffd700 1 -- 172.21.15.44:0/3384675637 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d4004800 con 0x7f49dc0cd6d0 2024-09-13T18:27:41.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49d2ffd700 1 -- 172.21.15.44:0/3384675637 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d40092e0 con 0x7f49dc0cd6d0 2024-09-13T18:27:41.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49e0c0a700 1 -- 172.21.15.44:0/3384675637 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49dc1e4200 con 0x7f49dc0cd6d0 2024-09-13T18:27:41.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49d2ffd700 1 -- 172.21.15.44:0/3384675637 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d401c680 con 0x7f49dc0cd6d0 2024-09-13T18:27:41.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.879+0000 7f49e0c0a700 1 -- 172.21.15.44:0/3384675637 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49dc1e1300 con 0x7f49dc0cd6d0 2024-09-13T18:27:41.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.883+0000 7f49e0c0a700 1 -- 172.21.15.44:0/3384675637 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49dc1e4720 con 0x7f49dc0cd6d0 2024-09-13T18:27:41.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.883+0000 7f49d2ffd700 1 -- 172.21.15.44:0/3384675637 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f49d401c7e0 con 0x7f49dc0cd6d0 2024-09-13T18:27:41.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.883+0000 7f49d2ffd700 1 --2- 172.21.15.44:0/3384675637 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f49bc066730 0x7f49bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:41.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.883+0000 7f49d2ffd700 1 -- 172.21.15.44:0/3384675637 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49d4085880 con 0x7f49dc0cd6d0 2024-09-13T18:27:41.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.883+0000 7f49da59c700 1 --2- 172.21.15.44:0/3384675637 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f49bc066730 0x7f49bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:41.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.883+0000 7f49da59c700 1 --2- 172.21.15.44:0/3384675637 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f49bc066730 0x7f49bc068bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f49dc071c40 tx=0x7f49cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:41.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:41.891+0000 7f49d2ffd700 1 -- 172.21.15.44:0/3384675637 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f49dc1e4720 con 0x7f49dc0cd6d0 2024-09-13T18:27:42.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.071+0000 7f49e0c0a700 1 -- 172.21.15.44:0/3384675637 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f49dc1e4720 con 0x7f49dc0cd6d0 2024-09-13T18:27:42.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.071+0000 7f49d2ffd700 1 -- 172.21.15.44:0/3384675637 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f49dc1e4720 con 0x7f49dc0cd6d0 2024-09-13T18:27:42.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.075+0000 7f49e0c0a700 1 -- 172.21.15.44:0/3384675637 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f49bc066730 msgr2=0x7f49bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:42.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.075+0000 7f49e0c0a700 1 --2- 172.21.15.44:0/3384675637 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f49bc066730 0x7f49bc068bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f49dc071c40 tx=0x7f49cc008040 comp rx=0 tx=0).stop 2024-09-13T18:27:42.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.075+0000 7f49e0c0a700 1 -- 172.21.15.44:0/3384675637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49dc0cd6d0 msgr2=0x7f49dc1598c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:42.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.075+0000 7f49e0c0a700 1 --2- 172.21.15.44:0/3384675637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49dc0cd6d0 0x7f49dc1598c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0b16b0 tx=0x7f49d4004af0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.075+0000 7f49e0c0a700 1 -- 172.21.15.44:0/3384675637 shutdown_connections 2024-09-13T18:27:42.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.075+0000 7f49e0c0a700 1 --2- 172.21.15.44:0/3384675637 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f49bc066730 0x7f49bc068bf0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.075+0000 7f49e0c0a700 1 --2- 172.21.15.44:0/3384675637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49dc0cd6d0 0x7f49dc1598c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.075+0000 7f49e0c0a700 1 --2- 172.21.15.44:0/3384675637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49dc06dbf0 0x7f49dc1e4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.075+0000 7f49e0c0a700 1 --2- 172.21.15.44:0/3384675637 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f49dc06d760 0x7f49dc1e0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.075+0000 7f49e0c0a700 1 -- 172.21.15.44:0/3384675637 >> 172.21.15.44:0/3384675637 conn(0x7f49dc0af620 msgr2=0x7f49dc142920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:42.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.075+0000 7f49e0c0a700 1 -- 172.21.15.44:0/3384675637 shutdown_connections 2024-09-13T18:27:42.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.075+0000 7f49e0c0a700 1 -- 172.21.15.44:0/3384675637 wait complete. 2024-09-13T18:27:42.081 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-13T18:27:42.092 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:27:42.092 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:27:42.100 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:42.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.207+0000 7feecd0ae700 1 Processor -- start 2024-09-13T18:27:42.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.207+0000 7feecd0ae700 1 -- start start 2024-09-13T18:27:42.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.207+0000 7feecd0ae700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7feec8160eb0 0x7feec8165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:42.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.207+0000 7feecd0ae700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec8071f30 con 0x7feec80b33d0 2024-09-13T18:27:42.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.207+0000 7feecd0ae700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec81622e0 con 0x7feec81619a0 2024-09-13T18:27:42.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.207+0000 7feecd0ae700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec8161df0 con 0x7feec8160eb0 2024-09-13T18:27:42.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feebffff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7feec80b33d0 0x7feec8161290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45104/0 (socket says 172.21.15.44:45104) 2024-09-13T18:27:42.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feebffff700 1 -- 172.21.15.44:0/980953243 learned_addr learned my addr 172.21.15.44:0/980953243 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:42.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feec7fff700 1 --2- 172.21.15.44:0/980953243 >> v2:172.21.15.44:3300/0 conn(0x7feec8160eb0 0x7feec8165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:42.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feec77fe700 1 -- 172.21.15.44:0/980953243 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221143167 0 0) 0x7feec8071f30 con 0x7feec80b33d0 2024-09-13T18:27:42.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feec77fe700 1 -- 172.21.15.44:0/980953243 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeb40035d0 con 0x7feec80b33d0 2024-09-13T18:27:42.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feec77fe700 1 -- 172.21.15.44:0/980953243 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2220625899 0 0) 0x7feeb40035d0 con 0x7feec80b33d0 2024-09-13T18:27:42.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feec77fe700 1 -- 172.21.15.44:0/980953243 >> v2:172.21.15.44:3300/0 conn(0x7feec8160eb0 msgr2=0x7feec8165590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:42.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feec77fe700 1 --2- 172.21.15.44:0/980953243 >> v2:172.21.15.44:3300/0 conn(0x7feec8160eb0 0x7feec8165590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feec77fe700 1 -- 172.21.15.44:0/980953243 >> v1:172.21.15.99:6789/0 conn(0x7feec81619a0 legacy=0x7feec80cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:42.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feec77fe700 1 -- 172.21.15.44:0/980953243 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec8162000 con 0x7feec80b33d0 2024-09-13T18:27:42.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feec77fe700 1 -- 172.21.15.44:0/980953243 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7feeb0001670 con 0x7feec80b33d0 2024-09-13T18:27:42.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feec77fe700 1 -- 172.21.15.44:0/980953243 >> v1:172.21.15.44:6789/0 conn(0x7feec80b33d0 legacy=0x7feec8161290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:42.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feec77fe700 1 --2- 172.21.15.44:0/980953243 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feeb4003a20 0x7feeb4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:42.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feec77fe700 1 --2- 172.21.15.44:0/980953243 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feeb4004420 0x7feeb40048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:42.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feec77fe700 1 --2- 172.21.15.44:0/980953243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feeb40050f0 0x7feeb400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:42.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feec77fe700 1 -- 172.21.15.44:0/980953243 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec8161df0 con 0x7feeb40050f0 2024-09-13T18:27:42.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feec77fe700 1 -- 172.21.15.44:0/980953243 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb400c050 con 0x7feeb4003a20 2024-09-13T18:27:42.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feec77fe700 1 -- 172.21.15.44:0/980953243 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb400c210 con 0x7feeb4004420 2024-09-13T18:27:42.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feecc8ad700 1 --2- 172.21.15.44:0/980953243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feeb40050f0 0x7feeb400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:42.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feebffff700 1 --2- 172.21.15.44:0/980953243 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feeb4004420 0x7feeb40048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:42.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feec7fff700 1 --2- 172.21.15.44:0/980953243 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feeb4003a20 0x7feeb4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:42.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feecc8ad700 1 -- 172.21.15.44:0/980953243 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feeb4004420 msgr2=0x7feeb40048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:42.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feecc8ad700 1 --2- 172.21.15.44:0/980953243 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feeb4004420 0x7feeb40048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feecc8ad700 1 -- 172.21.15.44:0/980953243 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feeb4003a20 msgr2=0x7feeb4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:42.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feecc8ad700 1 --2- 172.21.15.44:0/980953243 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feeb4003a20 0x7feeb4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feecc8ad700 1 -- 172.21.15.44:0/980953243 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb40035d0 con 0x7feeb40050f0 2024-09-13T18:27:42.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feecc8ad700 1 -- 172.21.15.44:0/980953243 reap_dead start 2024-09-13T18:27:42.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feecc8ad700 1 --2- 172.21.15.44:0/980953243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feeb40050f0 0x7feeb400ba30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7feec000c290 tx=0x7feeb40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3ef23d94283103 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feec77fe700 1 -- 172.21.15.44:0/980953243 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0016070 con 0x7feeb40050f0 2024-09-13T18:27:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feec77fe700 1 -- 172.21.15.44:0/980953243 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec000cc30 con 0x7feeb40050f0 2024-09-13T18:27:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feec77fe700 1 -- 172.21.15.44:0/980953243 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0001e70 con 0x7feeb40050f0 2024-09-13T18:27:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feecd0ae700 1 -- 172.21.15.44:0/980953243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feeb40050f0 msgr2=0x7feeb400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feecd0ae700 1 --2- 172.21.15.44:0/980953243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feeb40050f0 0x7feeb400ba30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7feec000c290 tx=0x7feeb40058a0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feecd0ae700 1 -- 172.21.15.44:0/980953243 shutdown_connections 2024-09-13T18:27:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feecd0ae700 1 --2- 172.21.15.44:0/980953243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feeb40050f0 0x7feeb400ba30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feecd0ae700 1 -- 172.21.15.44:0/980953243 >> 172.21.15.44:0/980953243 conn(0x7feec80b0f00 msgr2=0x7feec80b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feecd0ae700 1 -- 172.21.15.44:0/980953243 shutdown_connections 2024-09-13T18:27:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.211+0000 7feecd0ae700 1 -- 172.21.15.44:0/980953243 wait complete. 2024-09-13T18:27:42.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feecd0ae700 1 Processor -- start 2024-09-13T18:27:42.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feecd0ae700 1 -- start start 2024-09-13T18:27:42.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feecd0ae700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feeb40050f0 0x7feec815ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:42.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feecd0ae700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feec80ab550 0x7feec815e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:42.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feecd0ae700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec815e5f0 0x7feec815ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feecd0ae700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec80a8f60 con 0x7feeb40050f0 2024-09-13T18:27:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feecd0ae700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec815ea70 con 0x7feec815e5f0 2024-09-13T18:27:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feecd0ae700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec815b070 con 0x7feec80ab550 2024-09-13T18:27:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feec7fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feeb40050f0 0x7feec815ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feec7fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feeb40050f0 0x7feec815ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36356/0 (socket says 172.21.15.44:36356) 2024-09-13T18:27:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feec7fff700 1 -- 172.21.15.44:0/1506772861 learned_addr learned my addr 172.21.15.44:0/1506772861 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feebffff700 1 --2- 172.21.15.44:0/1506772861 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feec80ab550 0x7feec815e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feecc8ad700 1 --2- 172.21.15.44:0/1506772861 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec815e5f0 0x7feec815ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feec7fff700 1 -- 172.21.15.44:0/1506772861 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feec80ab550 msgr2=0x7feec815e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feec7fff700 1 --2- 172.21.15.44:0/1506772861 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feec80ab550 0x7feec815e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feec7fff700 1 -- 172.21.15.44:0/1506772861 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec815e5f0 msgr2=0x7feec815ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feec7fff700 1 --2- 172.21.15.44:0/1506772861 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec815e5f0 0x7feec815ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feec7fff700 1 -- 172.21.15.44:0/1506772861 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec815ec50 con 0x7feeb40050f0 2024-09-13T18:27:42.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feecc8ad700 1 --2- 172.21.15.44:0/1506772861 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec815e5f0 0x7feec815ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:42.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feec7fff700 1 --2- 172.21.15.44:0/1506772861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feeb40050f0 0x7feec815ab30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7feeb80119b0 tx=0x7feeb8011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:42.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feec57fa700 1 -- 172.21.15.44:0/1506772861 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb800f8e0 con 0x7feeb40050f0 2024-09-13T18:27:42.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feec57fa700 1 -- 172.21.15.44:0/1506772861 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb800fa40 con 0x7feeb40050f0 2024-09-13T18:27:42.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feecd0ae700 1 -- 172.21.15.44:0/1506772861 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec815d480 con 0x7feeb40050f0 2024-09-13T18:27:42.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feec57fa700 1 -- 172.21.15.44:0/1506772861 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb800fdd0 con 0x7feeb40050f0 2024-09-13T18:27:42.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.215+0000 7feecd0ae700 1 -- 172.21.15.44:0/1506772861 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec80a88a0 con 0x7feeb40050f0 2024-09-13T18:27:42.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.219+0000 7feecd0ae700 1 -- 172.21.15.44:0/1506772861 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec80b2f20 con 0x7feeb40050f0 2024-09-13T18:27:42.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.219+0000 7feec57fa700 1 -- 172.21.15.44:0/1506772861 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feeb8014440 con 0x7feeb40050f0 2024-09-13T18:27:42.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.219+0000 7feec57fa700 1 --2- 172.21.15.44:0/1506772861 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7feea8066730 0x7feea8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:42.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.219+0000 7feec57fa700 1 -- 172.21.15.44:0/1506772861 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feeb8084730 con 0x7feeb40050f0 2024-09-13T18:27:42.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.219+0000 7feebffff700 1 --2- 172.21.15.44:0/1506772861 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7feea8066730 0x7feea8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:42.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.223+0000 7feebffff700 1 --2- 172.21.15.44:0/1506772861 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7feea8066730 0x7feea8068bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7feec80b1df0 tx=0x7feeb0000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:42.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.227+0000 7feec57fa700 1 -- 172.21.15.44:0/1506772861 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feeb8051aa0 con 0x7feeb40050f0 2024-09-13T18:27:42.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.403+0000 7feecd0ae700 1 -- 172.21.15.44:0/1506772861 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feec80b3820 con 0x7feeb40050f0 2024-09-13T18:27:42.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.403+0000 7feec57fa700 1 -- 172.21.15.44:0/1506772861 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7feeb80550c0 con 0x7feeb40050f0 2024-09-13T18:27:42.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:42.410 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:02.280221+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:42.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.407+0000 7feecd0ae700 1 -- 172.21.15.44:0/1506772861 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7feea8066730 msgr2=0x7feea8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:42.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.407+0000 7feecd0ae700 1 --2- 172.21.15.44:0/1506772861 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7feea8066730 0x7feea8068bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7feec80b1df0 tx=0x7feeb0000ed0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.407+0000 7feecd0ae700 1 -- 172.21.15.44:0/1506772861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feeb40050f0 msgr2=0x7feec815ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:42.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.407+0000 7feecd0ae700 1 --2- 172.21.15.44:0/1506772861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feeb40050f0 0x7feec815ab30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7feeb80119b0 tx=0x7feeb8011cc0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.407+0000 7feecd0ae700 1 -- 172.21.15.44:0/1506772861 shutdown_connections 2024-09-13T18:27:42.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.407+0000 7feecd0ae700 1 --2- 172.21.15.44:0/1506772861 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7feea8066730 0x7feea8068bf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.407+0000 7feecd0ae700 1 --2- 172.21.15.44:0/1506772861 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec815e5f0 0x7feec815ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.407+0000 7feecd0ae700 1 --2- 172.21.15.44:0/1506772861 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feec80ab550 0x7feec815e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.407+0000 7feecd0ae700 1 --2- 172.21.15.44:0/1506772861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feeb40050f0 0x7feec815ab30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.407+0000 7feecd0ae700 1 -- 172.21.15.44:0/1506772861 >> 172.21.15.44:0/1506772861 conn(0x7feec80b0f00 msgr2=0x7feec80cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:42.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.407+0000 7feecd0ae700 1 -- 172.21.15.44:0/1506772861 shutdown_connections 2024-09-13T18:27:42.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.407+0000 7feecd0ae700 1 -- 172.21.15.44:0/1506772861 wait complete. 2024-09-13T18:27:42.425 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:26:59.478511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:27:00.261038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:27:42.426 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:27:42.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.535+0000 7f0a43344700 1 Processor -- start 2024-09-13T18:27:42.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.539+0000 7f0a43344700 1 -- start start 2024-09-13T18:27:42.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.539+0000 7f0a43344700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0a3c06d6f0 0x7f0a3c0ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:42.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.539+0000 7f0a43344700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3c06dad0 con 0x7f0a3c0adbd0 2024-09-13T18:27:42.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.539+0000 7f0a43344700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3c0ae3c0 con 0x7f0a3c15d200 2024-09-13T18:27:42.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.539+0000 7f0a43344700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3c0705b0 con 0x7f0a3c06d6f0 2024-09-13T18:27:42.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.539+0000 7f0a41b41700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0a3c0adbd0 0x7f0a3c15caf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45116/0 (socket says 172.21.15.44:45116) 2024-09-13T18:27:42.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.539+0000 7f0a41b41700 1 -- 172.21.15.44:0/3870986744 learned_addr learned my addr 172.21.15.44:0/3870986744 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:42.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.539+0000 7f0a42342700 1 --2- 172.21.15.44:0/3870986744 >> v2:172.21.15.99:3300/0 conn(0x7f0a3c06d6f0 0x7f0a3c0ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:42.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.539+0000 7f0a42342700 1 -- 172.21.15.44:0/3870986744 >> v1:172.21.15.99:6789/0 conn(0x7f0a3c15d200 legacy=0x7f0a3c06baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:42.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.539+0000 7f0a42342700 1 -- 172.21.15.44:0/3870986744 >> v1:172.21.15.44:6789/0 conn(0x7f0a3c0adbd0 legacy=0x7f0a3c15caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:42.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.539+0000 7f0a42342700 1 -- 172.21.15.44:0/3870986744 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c070890 con 0x7f0a3c06d6f0 2024-09-13T18:27:42.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.539+0000 7f0a42342700 1 --2- 172.21.15.44:0/3870986744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a3c06d6f0 0x7f0a3c0ce270 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009d90 tx=0x7f0a3400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4de3c48811a53c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:42.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.547+0000 7f0a41340700 1 -- 172.21.15.44:0/3870986744 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3400e070 con 0x7f0a3c06d6f0 2024-09-13T18:27:42.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.547+0000 7f0a41340700 1 -- 172.21.15.44:0/3870986744 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3400bbd0 con 0x7f0a3c06d6f0 2024-09-13T18:27:42.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.547+0000 7f0a41340700 1 -- 172.21.15.44:0/3870986744 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a34012430 con 0x7f0a3c06d6f0 2024-09-13T18:27:42.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.547+0000 7f0a43344700 1 -- 172.21.15.44:0/3870986744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a3c06d6f0 msgr2=0x7f0a3c0ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:42.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.547+0000 7f0a43344700 1 --2- 172.21.15.44:0/3870986744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a3c06d6f0 0x7f0a3c0ce270 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009d90 tx=0x7f0a3400b330 comp rx=0 tx=0).stop 2024-09-13T18:27:42.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.547+0000 7f0a43344700 1 -- 172.21.15.44:0/3870986744 shutdown_connections 2024-09-13T18:27:42.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.547+0000 7f0a43344700 1 --2- 172.21.15.44:0/3870986744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a3c06d6f0 0x7f0a3c0ce270 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.547+0000 7f0a43344700 1 -- 172.21.15.44:0/3870986744 >> 172.21.15.44:0/3870986744 conn(0x7f0a3c0b0e10 msgr2=0x7f0a3c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:42.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.547+0000 7f0a43344700 1 -- 172.21.15.44:0/3870986744 shutdown_connections 2024-09-13T18:27:42.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.547+0000 7f0a43344700 1 -- 172.21.15.44:0/3870986744 wait complete. 2024-09-13T18:27:42.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.547+0000 7f0a43344700 1 Processor -- start 2024-09-13T18:27:42.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a43344700 1 -- start start 2024-09-13T18:27:42.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a43344700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a3c06d6f0 0x7f0a3c14c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:42.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a43344700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a3c0adbd0 0x7f0a3c14cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:42.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a43344700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a3c15d200 0x7f0a3c153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:42.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a43344700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c0ad4e0 con 0x7f0a3c0adbd0 2024-09-13T18:27:42.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a43344700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c14c700 con 0x7f0a3c15d200 2024-09-13T18:27:42.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a43344700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c0ad200 con 0x7f0a3c06d6f0 2024-09-13T18:27:42.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a42342700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a3c06d6f0 0x7f0a3c14c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:42.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a42342700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a3c06d6f0 0x7f0a3c14c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:52846/0 (socket says 172.21.15.44:52846) 2024-09-13T18:27:42.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a42342700 1 -- 172.21.15.44:0/1863972925 learned_addr learned my addr 172.21.15.44:0/1863972925 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:42.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a42b43700 1 --2- 172.21.15.44:0/1863972925 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a3c15d200 0x7f0a3c153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:42.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a41b41700 1 --2- 172.21.15.44:0/1863972925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a3c0adbd0 0x7f0a3c14cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:42.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a41b41700 1 -- 172.21.15.44:0/1863972925 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a3c06d6f0 msgr2=0x7f0a3c14c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:42.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a41b41700 1 --2- 172.21.15.44:0/1863972925 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a3c06d6f0 0x7f0a3c14c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a41b41700 1 -- 172.21.15.44:0/1863972925 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a3c15d200 msgr2=0x7f0a3c153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:42.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a41b41700 1 --2- 172.21.15.44:0/1863972925 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a3c15d200 0x7f0a3c153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a41b41700 1 -- 172.21.15.44:0/1863972925 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a34009a70 con 0x7f0a3c0adbd0 2024-09-13T18:27:42.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a42342700 1 --2- 172.21.15.44:0/1863972925 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a3c06d6f0 0x7f0a3c14c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:42.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a41b41700 1 --2- 172.21.15.44:0/1863972925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a3c0adbd0 0x7f0a3c14cdb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000c4b0 tx=0x7f0a3000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:42.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a2effd700 1 -- 172.21.15.44:0/1863972925 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a30005d90 con 0x7f0a3c0adbd0 2024-09-13T18:27:42.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a2effd700 1 -- 172.21.15.44:0/1863972925 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3000ce80 con 0x7f0a3c0adbd0 2024-09-13T18:27:42.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a2effd700 1 -- 172.21.15.44:0/1863972925 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a300072d0 con 0x7f0a3c0adbd0 2024-09-13T18:27:42.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a43344700 1 -- 172.21.15.44:0/1863972925 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3c14b700 con 0x7f0a3c0adbd0 2024-09-13T18:27:42.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.551+0000 7f0a43344700 1 -- 172.21.15.44:0/1863972925 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3c14bcc0 con 0x7f0a3c0adbd0 2024-09-13T18:27:42.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.555+0000 7f0a43344700 1 -- 172.21.15.44:0/1863972925 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3c14be50 con 0x7f0a3c0adbd0 2024-09-13T18:27:42.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.555+0000 7f0a2effd700 1 -- 172.21.15.44:0/1863972925 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0a30007430 con 0x7f0a3c0adbd0 2024-09-13T18:27:42.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.555+0000 7f0a2effd700 1 --2- 172.21.15.44:0/1863972925 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0a20066730 0x7f0a20068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:42.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.559+0000 7f0a2effd700 1 -- 172.21.15.44:0/1863972925 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0a300834b0 con 0x7f0a3c0adbd0 2024-09-13T18:27:42.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.559+0000 7f0a42342700 1 --2- 172.21.15.44:0/1863972925 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0a20066730 0x7f0a20068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:42.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.559+0000 7f0a42342700 1 --2- 172.21.15.44:0/1863972925 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0a20066730 0x7f0a20068bf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0a34000f80 tx=0x7f0a34011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:42.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.567+0000 7f0a2effd700 1 -- 172.21.15.44:0/1863972925 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0a300507c0 con 0x7f0a3c0adbd0 2024-09-13T18:27:42.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.727+0000 7f0a43344700 1 -- 172.21.15.44:0/1863972925 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0a3c0ce270 con 0x7f0a3c0adbd0 2024-09-13T18:27:42.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.727+0000 7f0a2effd700 1 -- 172.21.15.44:0/1863972925 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0a30017020 con 0x7f0a3c0adbd0 2024-09-13T18:27:42.734 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:27:42.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.731+0000 7f0a43344700 1 -- 172.21.15.44:0/1863972925 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0a20066730 msgr2=0x7f0a20068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:42.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.731+0000 7f0a43344700 1 --2- 172.21.15.44:0/1863972925 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0a20066730 0x7f0a20068bf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0a34000f80 tx=0x7f0a34011000 comp rx=0 tx=0).stop 2024-09-13T18:27:42.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.731+0000 7f0a43344700 1 -- 172.21.15.44:0/1863972925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a3c0adbd0 msgr2=0x7f0a3c14cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:42.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.731+0000 7f0a43344700 1 --2- 172.21.15.44:0/1863972925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a3c0adbd0 0x7f0a3c14cdb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000c4b0 tx=0x7f0a3000c7c0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.731+0000 7f0a43344700 1 -- 172.21.15.44:0/1863972925 shutdown_connections 2024-09-13T18:27:42.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.731+0000 7f0a43344700 1 --2- 172.21.15.44:0/1863972925 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0a20066730 0x7f0a20068bf0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.731+0000 7f0a43344700 1 --2- 172.21.15.44:0/1863972925 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a3c15d200 0x7f0a3c153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.731+0000 7f0a43344700 1 --2- 172.21.15.44:0/1863972925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a3c0adbd0 0x7f0a3c14cdb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.731+0000 7f0a43344700 1 --2- 172.21.15.44:0/1863972925 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a3c06d6f0 0x7f0a3c14c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.731+0000 7f0a43344700 1 -- 172.21.15.44:0/1863972925 >> 172.21.15.44:0/1863972925 conn(0x7f0a3c0b0e10 msgr2=0x7f0a3c0b2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:42.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.731+0000 7f0a43344700 1 -- 172.21.15.44:0/1863972925 shutdown_connections 2024-09-13T18:27:42.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.731+0000 7f0a43344700 1 -- 172.21.15.44:0/1863972925 wait complete. 2024-09-13T18:27:42.749 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:27:42.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.867+0000 7fb7fdb9a700 1 Processor -- start 2024-09-13T18:27:42.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.867+0000 7fb7fdb9a700 1 -- start start 2024-09-13T18:27:42.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7fdb9a700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb7f806b900 0x7fb7f80b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:42.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7fdb9a700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb7f806a520 0x7fb7f806a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:42.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7fdb9a700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f80b8430 con 0x7fb7f815cda0 2024-09-13T18:27:42.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7fdb9a700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f806ae70 con 0x7fb7f806b900 2024-09-13T18:27:42.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7fdb9a700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f806bd60 con 0x7fb7f806a520 2024-09-13T18:27:42.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7f7fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb7f806b900 0x7fb7f80b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:42.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7f7fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb7f806b900 0x7fb7f80b5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36368/0 (socket says 172.21.15.44:36368) 2024-09-13T18:27:42.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7f7fff700 1 -- 172.21.15.44:0/3823277897 learned_addr learned my addr 172.21.15.44:0/3823277897 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:42.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7fd399700 1 --2- 172.21.15.44:0/3823277897 >> v2:172.21.15.99:3300/0 conn(0x7fb7f806a520 0x7fb7f806a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:42.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7f7fff700 1 -- 172.21.15.44:0/3823277897 >> v2:172.21.15.99:3300/0 conn(0x7fb7f806a520 msgr2=0x7fb7f806a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:42.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7f7fff700 1 --2- 172.21.15.44:0/3823277897 >> v2:172.21.15.99:3300/0 conn(0x7fb7f806a520 0x7fb7f806a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7f7fff700 1 -- 172.21.15.44:0/3823277897 >> v1:172.21.15.99:6789/0 conn(0x7fb7f815cda0 legacy=0x7fb7f80ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:42.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7f7fff700 1 -- 172.21.15.44:0/3823277897 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f80cf350 con 0x7fb7f806b900 2024-09-13T18:27:42.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7fd399700 1 --2- 172.21.15.44:0/3823277897 >> v2:172.21.15.99:3300/0 conn(0x7fb7f806a520 0x7fb7f806a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:42.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7f7fff700 1 --2- 172.21.15.44:0/3823277897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7f806b900 0x7fb7f80b5de0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb7f80d2c60 tx=0x7fb7ec009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1d917075fb5bcf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:42.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7f77fe700 1 -- 172.21.15.44:0/3823277897 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec00b8a0 con 0x7fb7f806b900 2024-09-13T18:27:42.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7f77fe700 1 -- 172.21.15.44:0/3823277897 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec00ba00 con 0x7fb7f806b900 2024-09-13T18:27:42.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7f77fe700 1 -- 172.21.15.44:0/3823277897 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec00bd90 con 0x7fb7f806b900 2024-09-13T18:27:42.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7fdb9a700 1 -- 172.21.15.44:0/3823277897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7f806b900 msgr2=0x7fb7f80b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:42.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7fdb9a700 1 --2- 172.21.15.44:0/3823277897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7f806b900 0x7fb7f80b5de0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb7f80d2c60 tx=0x7fb7ec009bf0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7fdb9a700 1 -- 172.21.15.44:0/3823277897 shutdown_connections 2024-09-13T18:27:42.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7fdb9a700 1 --2- 172.21.15.44:0/3823277897 >> v2:172.21.15.99:3300/0 conn(0x7fb7f806a520 0x7fb7f806a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7fdb9a700 1 --2- 172.21.15.44:0/3823277897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7f806b900 0x7fb7f80b5de0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7fdb9a700 1 -- 172.21.15.44:0/3823277897 >> 172.21.15.44:0/3823277897 conn(0x7fb7f80d2cb0 msgr2=0x7fb7f80d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:42.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7fdb9a700 1 -- 172.21.15.44:0/3823277897 shutdown_connections 2024-09-13T18:27:42.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.871+0000 7fb7fdb9a700 1 -- 172.21.15.44:0/3823277897 wait complete. 2024-09-13T18:27:42.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.875+0000 7fb7fdb9a700 1 Processor -- start 2024-09-13T18:27:42.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.875+0000 7fb7fdb9a700 1 -- start start 2024-09-13T18:27:42.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.875+0000 7fb7fdb9a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7f806a520 0x7fb7f80c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:42.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.875+0000 7fb7fdb9a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7f806b900 0x7fb7f815e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:42.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.875+0000 7fb7fdb9a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7f815cda0 0x7fb7f815e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:42.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.875+0000 7fb7fdb9a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f80c9af0 con 0x7fb7f806a520 2024-09-13T18:27:42.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.875+0000 7fb7fdb9a700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f8158660 con 0x7fb7f806b900 2024-09-13T18:27:42.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.875+0000 7fb7fdb9a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f80cb670 con 0x7fb7f815cda0 2024-09-13T18:27:42.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.875+0000 7fb7fcb98700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7f806a520 0x7fb7f80c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:42.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.875+0000 7fb7fcb98700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7f806a520 0x7fb7f80c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36374/0 (socket says 172.21.15.44:36374) 2024-09-13T18:27:42.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.875+0000 7fb7f7fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7f806b900 0x7fb7f815e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:42.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.875+0000 7fb7fcb98700 1 -- 172.21.15.44:0/2259559756 learned_addr learned my addr 172.21.15.44:0/2259559756 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:42.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.875+0000 7fb7fd399700 1 --2- 172.21.15.44:0/2259559756 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7f815cda0 0x7fb7f815e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:42.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.875+0000 7fb7fcb98700 1 -- 172.21.15.44:0/2259559756 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7f815cda0 msgr2=0x7fb7f815e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:42.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.875+0000 7fb7fcb98700 1 --2- 172.21.15.44:0/2259559756 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7f815cda0 0x7fb7f815e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.875+0000 7fb7fcb98700 1 -- 172.21.15.44:0/2259559756 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7f806b900 msgr2=0x7fb7f815e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:42.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.875+0000 7fb7fcb98700 1 --2- 172.21.15.44:0/2259559756 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7f806b900 0x7fb7f815e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.875+0000 7fb7fcb98700 1 -- 172.21.15.44:0/2259559756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec009570 con 0x7fb7f806a520 2024-09-13T18:27:42.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.879+0000 7fb7fcb98700 1 --2- 172.21.15.44:0/2259559756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7f806a520 0x7fb7f80c9d80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400c410 tx=0x7fb7e400c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:42.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.879+0000 7fb7f57fa700 1 -- 172.21.15.44:0/2259559756 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e40052d0 con 0x7fb7f806a520 2024-09-13T18:27:42.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.879+0000 7fb7f57fa700 1 -- 172.21.15.44:0/2259559756 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e4005430 con 0x7fb7f806a520 2024-09-13T18:27:42.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.879+0000 7fb7fdb9a700 1 -- 172.21.15.44:0/2259559756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f80c9810 con 0x7fb7f806a520 2024-09-13T18:27:42.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.879+0000 7fb7f57fa700 1 -- 172.21.15.44:0/2259559756 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e40055a0 con 0x7fb7f806a520 2024-09-13T18:27:42.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.879+0000 7fb7fdb9a700 1 -- 172.21.15.44:0/2259559756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f80cbbf0 con 0x7fb7f806a520 2024-09-13T18:27:42.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.879+0000 7fb7fdb9a700 1 -- 172.21.15.44:0/2259559756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f806a930 con 0x7fb7f806a520 2024-09-13T18:27:42.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.879+0000 7fb7f57fa700 1 -- 172.21.15.44:0/2259559756 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb7e40036a0 con 0x7fb7f806a520 2024-09-13T18:27:42.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.879+0000 7fb7f57fa700 1 --2- 172.21.15.44:0/2259559756 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb7dc066730 0x7fb7dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:42.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.883+0000 7fb7f57fa700 1 -- 172.21.15.44:0/2259559756 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb7e4083240 con 0x7fb7f806a520 2024-09-13T18:27:42.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.883+0000 7fb7f7fff700 1 --2- 172.21.15.44:0/2259559756 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb7dc066730 0x7fb7dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:42.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.883+0000 7fb7f7fff700 1 --2- 172.21.15.44:0/2259559756 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb7dc066730 0x7fb7dc068bf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec000c00 tx=0x7fb7ec008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:42.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:42.887+0000 7fb7f57fa700 1 -- 172.21.15.44:0/2259559756 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb7e40505c0 con 0x7fb7f806a520 2024-09-13T18:27:43.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.059+0000 7fb7fdb9a700 1 -- 172.21.15.44:0/2259559756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb7f815b6e0 con 0x7fb7f806a520 2024-09-13T18:27:43.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.059+0000 7fb7f57fa700 1 -- 172.21.15.44:0/2259559756 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb7e4053be0 con 0x7fb7f806a520 2024-09-13T18:27:43.063 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:27:43.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.059+0000 7fb7fdb9a700 1 -- 172.21.15.44:0/2259559756 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb7dc066730 msgr2=0x7fb7dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:43.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.059+0000 7fb7fdb9a700 1 --2- 172.21.15.44:0/2259559756 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb7dc066730 0x7fb7dc068bf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec000c00 tx=0x7fb7ec008030 comp rx=0 tx=0).stop 2024-09-13T18:27:43.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.059+0000 7fb7fdb9a700 1 -- 172.21.15.44:0/2259559756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7f806a520 msgr2=0x7fb7f80c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:43.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.059+0000 7fb7fdb9a700 1 --2- 172.21.15.44:0/2259559756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7f806a520 0x7fb7f80c9d80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400c410 tx=0x7fb7e400c720 comp rx=0 tx=0).stop 2024-09-13T18:27:43.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.059+0000 7fb7fdb9a700 1 -- 172.21.15.44:0/2259559756 shutdown_connections 2024-09-13T18:27:43.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.059+0000 7fb7fdb9a700 1 --2- 172.21.15.44:0/2259559756 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb7dc066730 0x7fb7dc068bf0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.059+0000 7fb7fdb9a700 1 --2- 172.21.15.44:0/2259559756 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7f815cda0 0x7fb7f815e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.059+0000 7fb7fdb9a700 1 --2- 172.21.15.44:0/2259559756 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7f806b900 0x7fb7f815e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.059+0000 7fb7fdb9a700 1 --2- 172.21.15.44:0/2259559756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7f806a520 0x7fb7f80c9d80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.059+0000 7fb7fdb9a700 1 -- 172.21.15.44:0/2259559756 >> 172.21.15.44:0/2259559756 conn(0x7fb7f80d2cb0 msgr2=0x7fb7f815bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:43.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.059+0000 7fb7fdb9a700 1 -- 172.21.15.44:0/2259559756 shutdown_connections 2024-09-13T18:27:43.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.059+0000 7fb7fdb9a700 1 -- 172.21.15.44:0/2259559756 wait complete. 2024-09-13T18:27:43.078 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:27:43.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.195+0000 7fee40f20700 1 Processor -- start 2024-09-13T18:27:43.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.195+0000 7fee40f20700 1 -- start start 2024-09-13T18:27:43.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.195+0000 7fee40f20700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fee3c15cda0 0x7fee3c0d1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:43.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.195+0000 7fee40f20700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee3c0b5e00 0x7fee3c0b6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:43.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.195+0000 7fee40f20700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee3c0d0880 con 0x7fee3c0b6780 2024-09-13T18:27:43.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.195+0000 7fee40f20700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee3c0cde50 con 0x7fee3c15cda0 2024-09-13T18:27:43.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.195+0000 7fee40f20700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c0d16e0 con 0x7fee3c0b5e00 2024-09-13T18:27:43.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.195+0000 7fee3a59c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fee3c15cda0 0x7fee3c0d1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:43.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.195+0000 7fee3ad9d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fee3c0b6780 0x7fee3c06a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45124/0 (socket says 172.21.15.44:45124) 2024-09-13T18:27:43.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.195+0000 7fee3ad9d700 1 -- 172.21.15.44:0/1769528612 learned_addr learned my addr 172.21.15.44:0/1769528612 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:43.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.195+0000 7fee39d9b700 1 --2- 172.21.15.44:0/1769528612 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee3c0b5e00 0x7fee3c0b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:43.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.195+0000 7fee3a59c700 1 -- 172.21.15.44:0/1769528612 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee3c0b5e00 msgr2=0x7fee3c0b6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:43.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.195+0000 7fee3a59c700 1 --2- 172.21.15.44:0/1769528612 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee3c0b5e00 0x7fee3c0b6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.195+0000 7fee3a59c700 1 -- 172.21.15.44:0/1769528612 >> v1:172.21.15.44:6789/0 conn(0x7fee3c0b6780 legacy=0x7fee3c06a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:43.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.195+0000 7fee3a59c700 1 -- 172.21.15.44:0/1769528612 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3c0d0ad0 con 0x7fee3c15cda0 2024-09-13T18:27:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee3a59c700 1 --2- 172.21.15.44:0/1769528612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee3c15cda0 0x7fee3c0d1b70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fee24009880 tx=0x7fee24009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1f19de6b3db7af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee3959a700 1 -- 172.21.15.44:0/1769528612 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee24011830 con 0x7fee3c15cda0 2024-09-13T18:27:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee3959a700 1 -- 172.21.15.44:0/1769528612 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee24011990 con 0x7fee3c15cda0 2024-09-13T18:27:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee3959a700 1 -- 172.21.15.44:0/1769528612 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee24011d20 con 0x7fee3c15cda0 2024-09-13T18:27:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee40f20700 1 -- 172.21.15.44:0/1769528612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee3c15cda0 msgr2=0x7fee3c0d1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee40f20700 1 --2- 172.21.15.44:0/1769528612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee3c15cda0 0x7fee3c0d1b70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fee24009880 tx=0x7fee24009b90 comp rx=0 tx=0).stop 2024-09-13T18:27:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee40f20700 1 -- 172.21.15.44:0/1769528612 shutdown_connections 2024-09-13T18:27:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee40f20700 1 --2- 172.21.15.44:0/1769528612 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee3c0b5e00 0x7fee3c0b6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee40f20700 1 --2- 172.21.15.44:0/1769528612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee3c15cda0 0x7fee3c0d1b70 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee40f20700 1 -- 172.21.15.44:0/1769528612 >> 172.21.15.44:0/1769528612 conn(0x7fee3c0d2cb0 msgr2=0x7fee3c0d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee40f20700 1 -- 172.21.15.44:0/1769528612 shutdown_connections 2024-09-13T18:27:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee40f20700 1 -- 172.21.15.44:0/1769528612 wait complete. 2024-09-13T18:27:43.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee40f20700 1 Processor -- start 2024-09-13T18:27:43.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee40f20700 1 -- start start 2024-09-13T18:27:43.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee40f20700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee3c0b5e00 0x7fee3c1f1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:43.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee40f20700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee3c0b6780 0x7fee3c1548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:43.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee40f20700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee3c15cda0 0x7fee3c15b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:43.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee40f20700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c153850 con 0x7fee3c0b6780 2024-09-13T18:27:43.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee40f20700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c153b30 con 0x7fee3c0b5e00 2024-09-13T18:27:43.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee40f20700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c153e10 con 0x7fee3c15cda0 2024-09-13T18:27:43.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee39d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee3c0b6780 0x7fee3c1548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:43.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee39d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee3c0b6780 0x7fee3c1548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36396/0 (socket says 172.21.15.44:36396) 2024-09-13T18:27:43.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee39d9b700 1 -- 172.21.15.44:0/912928435 learned_addr learned my addr 172.21.15.44:0/912928435 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:43.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee3ad9d700 1 --2- 172.21.15.44:0/912928435 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee3c15cda0 0x7fee3c15b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:43.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee3a59c700 1 --2- 172.21.15.44:0/912928435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee3c0b5e00 0x7fee3c1f1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:43.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee39d9b700 1 -- 172.21.15.44:0/912928435 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee3c15cda0 msgr2=0x7fee3c15b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:43.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee39d9b700 1 --2- 172.21.15.44:0/912928435 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee3c15cda0 0x7fee3c15b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee39d9b700 1 -- 172.21.15.44:0/912928435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee3c0b5e00 msgr2=0x7fee3c1f1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:43.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee39d9b700 1 --2- 172.21.15.44:0/912928435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee3c0b5e00 0x7fee3c1f1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee39d9b700 1 -- 172.21.15.44:0/912928435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee240094b0 con 0x7fee3c0b6780 2024-09-13T18:27:43.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.199+0000 7fee3a59c700 1 --2- 172.21.15.44:0/912928435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee3c0b5e00 0x7fee3c1f1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:43.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.203+0000 7fee39d9b700 1 --2- 172.21.15.44:0/912928435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee3c0b6780 0x7fee3c1548f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fee2c00e980 tx=0x7fee2c00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:43.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.203+0000 7fee32ffd700 1 -- 172.21.15.44:0/912928435 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2c009700 con 0x7fee3c0b6780 2024-09-13T18:27:43.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.203+0000 7fee32ffd700 1 -- 172.21.15.44:0/912928435 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2c004020 con 0x7fee3c0b6780 2024-09-13T18:27:43.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.203+0000 7fee40f20700 1 -- 172.21.15.44:0/912928435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee3c1540f0 con 0x7fee3c0b6780 2024-09-13T18:27:43.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.203+0000 7fee32ffd700 1 -- 172.21.15.44:0/912928435 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2c0043b0 con 0x7fee3c0b6780 2024-09-13T18:27:43.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.203+0000 7fee40f20700 1 -- 172.21.15.44:0/912928435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee3c154e30 con 0x7fee3c0b6780 2024-09-13T18:27:43.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.203+0000 7fee40f20700 1 -- 172.21.15.44:0/912928435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee3c154610 con 0x7fee3c0b6780 2024-09-13T18:27:43.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.203+0000 7fee32ffd700 1 -- 172.21.15.44:0/912928435 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fee2c00c850 con 0x7fee3c0b6780 2024-09-13T18:27:43.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.203+0000 7fee32ffd700 1 --2- 172.21.15.44:0/912928435 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fee1c066730 0x7fee1c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:43.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.203+0000 7fee32ffd700 1 -- 172.21.15.44:0/912928435 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fee2c0845c0 con 0x7fee3c0b6780 2024-09-13T18:27:43.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.203+0000 7fee3a59c700 1 --2- 172.21.15.44:0/912928435 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fee1c066730 0x7fee1c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:43.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.207+0000 7fee3a59c700 1 --2- 172.21.15.44:0/912928435 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fee1c066730 0x7fee1c068bf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fee24009fd0 tx=0x7fee24008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:43.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.211+0000 7fee32ffd700 1 -- 172.21.15.44:0/912928435 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fee2c0519d0 con 0x7fee3c0b6780 2024-09-13T18:27:43.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.383+0000 7fee40f20700 1 -- 172.21.15.44:0/912928435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fee3c154610 con 0x7fee3c0b6780 2024-09-13T18:27:43.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.383+0000 7fee32ffd700 1 -- 172.21.15.44:0/912928435 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fee2c017020 con 0x7fee3c0b6780 2024-09-13T18:27:43.389 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:27:43.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.387+0000 7fee40f20700 1 -- 172.21.15.44:0/912928435 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fee1c066730 msgr2=0x7fee1c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:43.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.387+0000 7fee40f20700 1 --2- 172.21.15.44:0/912928435 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fee1c066730 0x7fee1c068bf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fee24009fd0 tx=0x7fee24008030 comp rx=0 tx=0).stop 2024-09-13T18:27:43.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.387+0000 7fee40f20700 1 -- 172.21.15.44:0/912928435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee3c0b6780 msgr2=0x7fee3c1548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:43.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.387+0000 7fee40f20700 1 --2- 172.21.15.44:0/912928435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee3c0b6780 0x7fee3c1548f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fee2c00e980 tx=0x7fee2c00ed40 comp rx=0 tx=0).stop 2024-09-13T18:27:43.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.387+0000 7fee40f20700 1 -- 172.21.15.44:0/912928435 shutdown_connections 2024-09-13T18:27:43.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.387+0000 7fee40f20700 1 --2- 172.21.15.44:0/912928435 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fee1c066730 0x7fee1c068bf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.387+0000 7fee40f20700 1 --2- 172.21.15.44:0/912928435 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee3c15cda0 0x7fee3c15b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.387+0000 7fee40f20700 1 --2- 172.21.15.44:0/912928435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee3c0b6780 0x7fee3c1548f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.387+0000 7fee40f20700 1 --2- 172.21.15.44:0/912928435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee3c0b5e00 0x7fee3c1f1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.387+0000 7fee40f20700 1 -- 172.21.15.44:0/912928435 >> 172.21.15.44:0/912928435 conn(0x7fee3c0d2cb0 msgr2=0x7fee3c06a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:43.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.387+0000 7fee40f20700 1 -- 172.21.15.44:0/912928435 shutdown_connections 2024-09-13T18:27:43.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.387+0000 7fee40f20700 1 -- 172.21.15.44:0/912928435 wait complete. 2024-09-13T18:27:43.404 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:27:43.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.519+0000 7fda053f6700 1 Processor -- start 2024-09-13T18:27:43.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.519+0000 7fda053f6700 1 -- start start 2024-09-13T18:27:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.519+0000 7fda053f6700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fda0006bcb0 0x7fda000b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.519+0000 7fda053f6700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fda000cc8b0 0x7fda000aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.519+0000 7fda053f6700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda000ccea0 con 0x7fda0006c090 2024-09-13T18:27:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.519+0000 7fda053f6700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda000b2f80 con 0x7fda0006bcb0 2024-09-13T18:27:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.519+0000 7fda053f6700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda000b3260 con 0x7fda000cc8b0 2024-09-13T18:27:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.519+0000 7fd9fffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fda0006bcb0 0x7fda000b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.523+0000 7fd9fffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fda0006bcb0 0x7fda000b29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36400/0 (socket says 172.21.15.44:36400) 2024-09-13T18:27:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.523+0000 7fd9fffff700 1 -- 172.21.15.44:0/2112797114 learned_addr learned my addr 172.21.15.44:0/2112797114 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.523+0000 7fd9f7fff700 1 --2- 172.21.15.44:0/2112797114 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fda000cc8b0 0x7fda000aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:43.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.523+0000 7fd9fffff700 1 -- 172.21.15.44:0/2112797114 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fda000cc8b0 msgr2=0x7fda000aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:43.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.523+0000 7fd9fffff700 1 --2- 172.21.15.44:0/2112797114 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fda000cc8b0 0x7fda000aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.523+0000 7fd9fffff700 1 -- 172.21.15.44:0/2112797114 >> v1:172.21.15.99:6789/0 conn(0x7fda0006c090 legacy=0x7fda0006c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:43.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.523+0000 7fd9fffff700 1 -- 172.21.15.44:0/2112797114 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda000b3540 con 0x7fda0006bcb0 2024-09-13T18:27:43.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.523+0000 7fd9f7fff700 1 --2- 172.21.15.44:0/2112797114 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fda000cc8b0 0x7fda000aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:43.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.523+0000 7fd9fffff700 1 --2- 172.21.15.44:0/2112797114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda0006bcb0 0x7fda000b29a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0009910 tx=0x7fd9f0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a47369d699a1e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:43.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.523+0000 7fd9ff7fe700 1 -- 172.21.15.44:0/2112797114 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f000ba60 con 0x7fda0006bcb0 2024-09-13T18:27:43.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.523+0000 7fd9ff7fe700 1 -- 172.21.15.44:0/2112797114 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f000bbc0 con 0x7fda0006bcb0 2024-09-13T18:27:43.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.523+0000 7fd9ff7fe700 1 -- 172.21.15.44:0/2112797114 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0009e60 con 0x7fda0006bcb0 2024-09-13T18:27:43.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.523+0000 7fda053f6700 1 -- 172.21.15.44:0/2112797114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda0006bcb0 msgr2=0x7fda000b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:43.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.523+0000 7fda053f6700 1 --2- 172.21.15.44:0/2112797114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda0006bcb0 0x7fda000b29a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0009910 tx=0x7fd9f0009c20 comp rx=0 tx=0).stop 2024-09-13T18:27:43.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.523+0000 7fda053f6700 1 -- 172.21.15.44:0/2112797114 shutdown_connections 2024-09-13T18:27:43.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.523+0000 7fda053f6700 1 --2- 172.21.15.44:0/2112797114 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fda000cc8b0 0x7fda000aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.523+0000 7fda053f6700 1 --2- 172.21.15.44:0/2112797114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda0006bcb0 0x7fda000b29a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.523+0000 7fda053f6700 1 -- 172.21.15.44:0/2112797114 >> 172.21.15.44:0/2112797114 conn(0x7fda000b1cd0 msgr2=0x7fda000cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:43.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.523+0000 7fda053f6700 1 -- 172.21.15.44:0/2112797114 shutdown_connections 2024-09-13T18:27:43.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.523+0000 7fda053f6700 1 -- 172.21.15.44:0/2112797114 wait complete. 2024-09-13T18:27:43.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.527+0000 7fda053f6700 1 Processor -- start 2024-09-13T18:27:43.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.527+0000 7fda053f6700 1 -- start start 2024-09-13T18:27:43.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.527+0000 7fda053f6700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda0006bcb0 0x7fda0013b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:43.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.527+0000 7fda053f6700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda0006c090 0x7fda00146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:43.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.527+0000 7fda053f6700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fda000cc8b0 0x7fda00146890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:43.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.527+0000 7fda053f6700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0015a9b0 con 0x7fda0006bcb0 2024-09-13T18:27:43.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.527+0000 7fda053f6700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda00159dc0 con 0x7fda0006c090 2024-09-13T18:27:43.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.527+0000 7fda053f6700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0015a080 con 0x7fda000cc8b0 2024-09-13T18:27:43.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.527+0000 7fd9fffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda0006bcb0 0x7fda0013b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:43.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.527+0000 7fd9fffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda0006bcb0 0x7fda0013b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36416/0 (socket says 172.21.15.44:36416) 2024-09-13T18:27:43.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.527+0000 7fd9fffff700 1 -- 172.21.15.44:0/1075144403 learned_addr learned my addr 172.21.15.44:0/1075144403 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:43.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.527+0000 7fda04bf5700 1 --2- 172.21.15.44:0/1075144403 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fda000cc8b0 0x7fda00146890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:43.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.527+0000 7fd9f7fff700 1 --2- 172.21.15.44:0/1075144403 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda0006c090 0x7fda00146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:43.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.527+0000 7fd9fffff700 1 -- 172.21.15.44:0/1075144403 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fda000cc8b0 msgr2=0x7fda00146890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:43.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.527+0000 7fd9fffff700 1 --2- 172.21.15.44:0/1075144403 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fda000cc8b0 0x7fda00146890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.527+0000 7fd9fffff700 1 -- 172.21.15.44:0/1075144403 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda0006c090 msgr2=0x7fda00146350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:43.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.527+0000 7fd9fffff700 1 --2- 172.21.15.44:0/1075144403 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda0006c090 0x7fda00146350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.527+0000 7fd9fffff700 1 -- 172.21.15.44:0/1075144403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f0009570 con 0x7fda0006bcb0 2024-09-13T18:27:43.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.527+0000 7fd9fffff700 1 --2- 172.21.15.44:0/1075144403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda0006bcb0 0x7fda0013b690 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0014040 tx=0x7fd9f0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:43.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.527+0000 7fd9fd7fa700 1 -- 172.21.15.44:0/1075144403 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0004610 con 0x7fda0006bcb0 2024-09-13T18:27:43.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.531+0000 7fd9fd7fa700 1 -- 172.21.15.44:0/1075144403 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f001e070 con 0x7fda0006bcb0 2024-09-13T18:27:43.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.531+0000 7fda053f6700 1 -- 172.21.15.44:0/1075144403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0015a360 con 0x7fda0006bcb0 2024-09-13T18:27:43.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.531+0000 7fd9fd7fa700 1 -- 172.21.15.44:0/1075144403 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0003920 con 0x7fda0006bcb0 2024-09-13T18:27:43.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.531+0000 7fda053f6700 1 -- 172.21.15.44:0/1075144403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0013bbd0 con 0x7fda0006bcb0 2024-09-13T18:27:43.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.531+0000 7fda053f6700 1 -- 172.21.15.44:0/1075144403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda0006e320 con 0x7fda0006bcb0 2024-09-13T18:27:43.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.531+0000 7fd9fd7fa700 1 -- 172.21.15.44:0/1075144403 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd9f0003a80 con 0x7fda0006bcb0 2024-09-13T18:27:43.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.531+0000 7fd9fd7fa700 1 --2- 172.21.15.44:0/1075144403 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd9e0066760 0x7fd9e0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:43.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.531+0000 7fd9fd7fa700 1 -- 172.21.15.44:0/1075144403 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd9f0020070 con 0x7fda0006bcb0 2024-09-13T18:27:43.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.531+0000 7fd9f7fff700 1 --2- 172.21.15.44:0/1075144403 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd9e0066760 0x7fd9e0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:43.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.535+0000 7fd9f7fff700 1 --2- 172.21.15.44:0/1075144403 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd9e0066760 0x7fd9e0068c20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fda0006d6f0 tx=0x7fd9e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:43.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.539+0000 7fd9fd7fa700 1 -- 172.21.15.44:0/1075144403 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd9f00529b0 con 0x7fda0006bcb0 2024-09-13T18:27:43.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.727+0000 7fda053f6700 1 -- 172.21.15.44:0/1075144403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fda000b29a0 con 0x7fda0006bcb0 2024-09-13T18:27:43.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.727+0000 7fd9fd7fa700 1 -- 172.21.15.44:0/1075144403 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd9f0055fd0 con 0x7fda0006bcb0 2024-09-13T18:27:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.727+0000 7fda053f6700 1 -- 172.21.15.44:0/1075144403 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd9e0066760 msgr2=0x7fd9e0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:43.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.727+0000 7fda053f6700 1 --2- 172.21.15.44:0/1075144403 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd9e0066760 0x7fd9e0068c20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fda0006d6f0 tx=0x7fd9e8008040 comp rx=0 tx=0).stop 2024-09-13T18:27:43.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.727+0000 7fda053f6700 1 -- 172.21.15.44:0/1075144403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda0006bcb0 msgr2=0x7fda0013b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:43.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.727+0000 7fda053f6700 1 --2- 172.21.15.44:0/1075144403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda0006bcb0 0x7fda0013b690 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0014040 tx=0x7fd9f0004770 comp rx=0 tx=0).stop 2024-09-13T18:27:43.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.727+0000 7fda053f6700 1 -- 172.21.15.44:0/1075144403 shutdown_connections 2024-09-13T18:27:43.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.727+0000 7fda053f6700 1 --2- 172.21.15.44:0/1075144403 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd9e0066760 0x7fd9e0068c20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.727+0000 7fda053f6700 1 --2- 172.21.15.44:0/1075144403 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fda000cc8b0 0x7fda00146890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.727+0000 7fda053f6700 1 --2- 172.21.15.44:0/1075144403 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda0006c090 0x7fda00146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.727+0000 7fda053f6700 1 --2- 172.21.15.44:0/1075144403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda0006bcb0 0x7fda0013b690 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.727+0000 7fda053f6700 1 -- 172.21.15.44:0/1075144403 >> 172.21.15.44:0/1075144403 conn(0x7fda000b1cd0 msgr2=0x7fda0006c500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:43.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.727+0000 7fda053f6700 1 -- 172.21.15.44:0/1075144403 shutdown_connections 2024-09-13T18:27:43.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.727+0000 7fda053f6700 1 -- 172.21.15.44:0/1075144403 wait complete. 2024-09-13T18:27:43.735 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-13T18:27:43.745 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi099.front.sepia.ceph.com... 2024-09-13T18:27:43.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:43.746 DEBUG:teuthology.orchestra.run.smithi099:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T18:27:43.769 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:27:43.769 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:27:43.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:43.770 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:27:43.830 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:27:43.830 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:27:43.837 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:27:43.837 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:27:43.845 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:43.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.959+0000 7f7ccd65b700 1 Processor -- start 2024-09-13T18:27:43.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.959+0000 7f7ccd65b700 1 -- start start 2024-09-13T18:27:43.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.959+0000 7f7ccd65b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7cc806d310 0x7f7cc80ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:43.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.959+0000 7f7ccd65b700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7cc80ca880 0x7f7cc80ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:43.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7ccd65b700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc806d6f0 con 0x7f7cc80c4f90 2024-09-13T18:27:43.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7ccd65b700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc81598c0 con 0x7f7cc806d310 2024-09-13T18:27:43.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7ccd65b700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc80c56b0 con 0x7f7cc80ca880 2024-09-13T18:27:43.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7cbe7fc700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7cc80c4f90 0x7f7cc815cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45132/0 (socket says 172.21.15.44:45132) 2024-09-13T18:27:43.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7cc6ffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7cc806d310 0x7f7cc80ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:43.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7cbe7fc700 1 -- 172.21.15.44:0/4132091243 learned_addr learned my addr 172.21.15.44:0/4132091243 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:43.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7cc77fe700 1 --2- 172.21.15.44:0/4132091243 >> v2:172.21.15.99:3300/0 conn(0x7f7cc80ca880 0x7f7cc80ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:43.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7cc6ffd700 1 -- 172.21.15.44:0/4132091243 >> v2:172.21.15.99:3300/0 conn(0x7f7cc80ca880 msgr2=0x7f7cc80ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:43.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7cc6ffd700 1 --2- 172.21.15.44:0/4132091243 >> v2:172.21.15.99:3300/0 conn(0x7f7cc80ca880 0x7f7cc80ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7cc67fc700 1 -- 172.21.15.44:0/4132091243 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353740987 0 0) 0x7f7cc806d6f0 con 0x7f7cc80c4f90 2024-09-13T18:27:43.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7cc6ffd700 1 -- 172.21.15.44:0/4132091243 >> v1:172.21.15.44:6789/0 conn(0x7f7cc80c4f90 legacy=0x7f7cc815cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:43.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7cc6ffd700 1 -- 172.21.15.44:0/4132091243 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc8071690 con 0x7f7cc806d310 2024-09-13T18:27:43.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7cc6ffd700 1 --2- 172.21.15.44:0/4132091243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cc806d310 0x7f7cc80ce130 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80ccd70 tx=0x7f7cb8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31dd3b529f4f13cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:43.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7cc67fc700 1 -- 172.21.15.44:0/4132091243 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8011830 con 0x7f7cc806d310 2024-09-13T18:27:43.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7cc67fc700 1 -- 172.21.15.44:0/4132091243 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb8011990 con 0x7f7cc806d310 2024-09-13T18:27:43.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7cc67fc700 1 -- 172.21.15.44:0/4132091243 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8011d20 con 0x7f7cc806d310 2024-09-13T18:27:43.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7ccd65b700 1 -- 172.21.15.44:0/4132091243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cc806d310 msgr2=0x7f7cc80ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:43.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7ccd65b700 1 --2- 172.21.15.44:0/4132091243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cc806d310 0x7f7cc80ce130 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80ccd70 tx=0x7f7cb8009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:43.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7ccd65b700 1 -- 172.21.15.44:0/4132091243 shutdown_connections 2024-09-13T18:27:43.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7ccd65b700 1 --2- 172.21.15.44:0/4132091243 >> v2:172.21.15.99:3300/0 conn(0x7f7cc80ca880 0x7f7cc80ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7ccd65b700 1 --2- 172.21.15.44:0/4132091243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cc806d310 0x7f7cc80ce130 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7ccd65b700 1 -- 172.21.15.44:0/4132091243 >> 172.21.15.44:0/4132091243 conn(0x7f7cc80cbca0 msgr2=0x7f7cc80cc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:43.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7ccd65b700 1 -- 172.21.15.44:0/4132091243 shutdown_connections 2024-09-13T18:27:43.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.963+0000 7f7ccd65b700 1 -- 172.21.15.44:0/4132091243 wait complete. 2024-09-13T18:27:43.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.967+0000 7f7ccd65b700 1 Processor -- start 2024-09-13T18:27:43.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.967+0000 7f7ccd65b700 1 -- start start 2024-09-13T18:27:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.967+0000 7f7ccd65b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7cc806d310 0x7f7cc814cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.967+0000 7f7ccd65b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cc80c4f90 0x7f7cc8153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.967+0000 7f7ccd65b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cc80ca880 0x7f7cc814fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.967+0000 7f7ccd65b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc81529f0 con 0x7f7cc80ca880 2024-09-13T18:27:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.967+0000 7f7ccd65b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc8153850 con 0x7f7cc80c4f90 2024-09-13T18:27:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.967+0000 7f7ccd65b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc8152c40 con 0x7f7cc806d310 2024-09-13T18:27:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.967+0000 7f7cc77fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cc80ca880 0x7f7cc814fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.967+0000 7f7cc77fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cc80ca880 0x7f7cc814fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36436/0 (socket says 172.21.15.44:36436) 2024-09-13T18:27:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.967+0000 7f7cc77fe700 1 -- 172.21.15.44:0/3585921260 learned_addr learned my addr 172.21.15.44:0/3585921260 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.967+0000 7f7cc6ffd700 1 --2- 172.21.15.44:0/3585921260 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7cc806d310 0x7f7cc814cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.967+0000 7f7cbe7fc700 1 --2- 172.21.15.44:0/3585921260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cc80c4f90 0x7f7cc8153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.967+0000 7f7cc77fe700 1 -- 172.21.15.44:0/3585921260 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7cc806d310 msgr2=0x7f7cc814cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:43.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.967+0000 7f7cc77fe700 1 --2- 172.21.15.44:0/3585921260 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7cc806d310 0x7f7cc814cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.967+0000 7f7cc77fe700 1 -- 172.21.15.44:0/3585921260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cc80c4f90 msgr2=0x7f7cc8153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:43.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.967+0000 7f7cc77fe700 1 --2- 172.21.15.44:0/3585921260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cc80c4f90 0x7f7cc8153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.967+0000 7f7cc77fe700 1 -- 172.21.15.44:0/3585921260 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb80094b0 con 0x7f7cc80ca880 2024-09-13T18:27:43.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.971+0000 7f7cc77fe700 1 --2- 172.21.15.44:0/3585921260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cc80ca880 0x7f7cc814fe00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000efc0 tx=0x7f7cc000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:43.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.971+0000 7f7cbffff700 1 -- 172.21.15.44:0/3585921260 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc000ca70 con 0x7f7cc80ca880 2024-09-13T18:27:43.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.971+0000 7f7cbffff700 1 -- 172.21.15.44:0/3585921260 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc000f040 con 0x7f7cc80ca880 2024-09-13T18:27:43.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.971+0000 7f7ccd65b700 1 -- 172.21.15.44:0/3585921260 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc8152f20 con 0x7f7cc80ca880 2024-09-13T18:27:43.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.971+0000 7f7cbffff700 1 -- 172.21.15.44:0/3585921260 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc000ce10 con 0x7f7cc80ca880 2024-09-13T18:27:43.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.971+0000 7f7ccd65b700 1 -- 172.21.15.44:0/3585921260 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc81534e0 con 0x7f7cc80ca880 2024-09-13T18:27:43.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.971+0000 7f7ccd65b700 1 -- 172.21.15.44:0/3585921260 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc8071c10 con 0x7f7cc80ca880 2024-09-13T18:27:43.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.971+0000 7f7cbffff700 1 -- 172.21.15.44:0/3585921260 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7cc0014480 con 0x7f7cc80ca880 2024-09-13T18:27:43.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.971+0000 7f7cbffff700 1 --2- 172.21.15.44:0/3585921260 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7ca8066730 0x7f7ca8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:43.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.971+0000 7f7cbffff700 1 -- 172.21.15.44:0/3585921260 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7cc0084c80 con 0x7f7cc80ca880 2024-09-13T18:27:43.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.971+0000 7f7cc6ffd700 1 --2- 172.21.15.44:0/3585921260 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7ca8066730 0x7f7ca8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:43.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.975+0000 7f7cc6ffd700 1 --2- 172.21.15.44:0/3585921260 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7ca8066730 0x7f7ca8068bf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7cb80090b0 tx=0x7f7cb8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:43.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:43.979+0000 7f7cbffff700 1 -- 172.21.15.44:0/3585921260 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7cc0051f70 con 0x7f7cc80ca880 2024-09-13T18:27:44.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.155+0000 7f7ccd65b700 1 -- 172.21.15.44:0/3585921260 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7cc8071220 con 0x7f7cc80ca880 2024-09-13T18:27:44.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.155+0000 7f7cbffff700 1 -- 172.21.15.44:0/3585921260 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16695 (secure 0 0 0) 0x7f7cc0018090 con 0x7f7cc80ca880 2024-09-13T18:27:44.162 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:44.162 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":23,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:43.549975+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:44.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.159+0000 7f7ccd65b700 1 -- 172.21.15.44:0/3585921260 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7ca8066730 msgr2=0x7f7ca8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:44.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.159+0000 7f7ccd65b700 1 --2- 172.21.15.44:0/3585921260 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7ca8066730 0x7f7ca8068bf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7cb80090b0 tx=0x7f7cb8008030 comp rx=0 tx=0).stop 2024-09-13T18:27:44.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.159+0000 7f7ccd65b700 1 -- 172.21.15.44:0/3585921260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cc80ca880 msgr2=0x7f7cc814fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:44.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.159+0000 7f7ccd65b700 1 --2- 172.21.15.44:0/3585921260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cc80ca880 0x7f7cc814fe00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000efc0 tx=0x7f7cc000c0c0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.159+0000 7f7ccd65b700 1 -- 172.21.15.44:0/3585921260 shutdown_connections 2024-09-13T18:27:44.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.159+0000 7f7ccd65b700 1 --2- 172.21.15.44:0/3585921260 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7ca8066730 0x7f7ca8068bf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.159+0000 7f7ccd65b700 1 --2- 172.21.15.44:0/3585921260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cc80ca880 0x7f7cc814fe00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.159+0000 7f7ccd65b700 1 --2- 172.21.15.44:0/3585921260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cc80c4f90 0x7f7cc8153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.159+0000 7f7ccd65b700 1 --2- 172.21.15.44:0/3585921260 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7cc806d310 0x7f7cc814cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.159+0000 7f7ccd65b700 1 -- 172.21.15.44:0/3585921260 >> 172.21.15.44:0/3585921260 conn(0x7f7cc80cbca0 msgr2=0x7f7cc80b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:44.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.159+0000 7f7ccd65b700 1 -- 172.21.15.44:0/3585921260 shutdown_connections 2024-09-13T18:27:44.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.159+0000 7f7ccd65b700 1 -- 172.21.15.44:0/3585921260 wait complete. 2024-09-13T18:27:44.177 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:26:59.478511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:27:00.261038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:27:44.177 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:27:44.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f1323fff700 1 Processor -- start 2024-09-13T18:27:44.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f1323fff700 1 -- start start 2024-09-13T18:27:44.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f1323fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f132406b900 0x7f13240b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:44.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f1323fff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13240b8430 con 0x7f132406a520 2024-09-13T18:27:44.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f1323fff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f132406bd60 con 0x7f132415cda0 2024-09-13T18:27:44.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f1323fff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13240cf350 con 0x7f132406b900 2024-09-13T18:27:44.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f13237fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f132406a520 0x7f132406a930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45142/0 (socket says 172.21.15.44:45142) 2024-09-13T18:27:44.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f13237fe700 1 -- 172.21.15.44:0/1221561444 learned_addr learned my addr 172.21.15.44:0/1221561444 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:44.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f13227fc700 1 --2- 172.21.15.44:0/1221561444 >> v2:172.21.15.44:3300/0 conn(0x7f132406b900 0x7f13240b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:44.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f1321ffb700 1 -- 172.21.15.44:0/1221561444 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155257954 0 0) 0x7f13240b8430 con 0x7f132406a520 2024-09-13T18:27:44.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f1321ffb700 1 -- 172.21.15.44:0/1221561444 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13100035d0 con 0x7f132406a520 2024-09-13T18:27:44.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f1321ffb700 1 -- 172.21.15.44:0/1221561444 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3015429695 0 0) 0x7f13100035d0 con 0x7f132406a520 2024-09-13T18:27:44.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f1321ffb700 1 -- 172.21.15.44:0/1221561444 >> v2:172.21.15.44:3300/0 conn(0x7f132406b900 msgr2=0x7f13240b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:44.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f1321ffb700 1 --2- 172.21.15.44:0/1221561444 >> v2:172.21.15.44:3300/0 conn(0x7f132406b900 0x7f13240b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f1321ffb700 1 -- 172.21.15.44:0/1221561444 >> v1:172.21.15.99:6789/0 conn(0x7f132415cda0 legacy=0x7f13240ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:44.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f1321ffb700 1 -- 172.21.15.44:0/1221561444 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13240d0880 con 0x7f132406a520 2024-09-13T18:27:44.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f1321ffb700 1 -- 172.21.15.44:0/1221561444 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f131c0019f0 con 0x7f132406a520 2024-09-13T18:27:44.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f1321ffb700 1 -- 172.21.15.44:0/1221561444 >> v1:172.21.15.44:6789/0 conn(0x7f132406a520 legacy=0x7f132406a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:44.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f1321ffb700 1 --2- 172.21.15.44:0/1221561444 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1310003a20 0x7f1310003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:44.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f1321ffb700 1 --2- 172.21.15.44:0/1221561444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1310004870 0x7f1310004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:44.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f1321ffb700 1 --2- 172.21.15.44:0/1221561444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1310005230 0x7f131000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:44.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f1321ffb700 1 -- 172.21.15.44:0/1221561444 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13240cf350 con 0x7f1310004870 2024-09-13T18:27:44.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f1321ffb700 1 -- 172.21.15.44:0/1221561444 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131000c0d0 con 0x7f1310005230 2024-09-13T18:27:44.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.295+0000 7f1321ffb700 1 -- 172.21.15.44:0/1221561444 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131000c290 con 0x7f1310003a20 2024-09-13T18:27:44.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.299+0000 7f13227fc700 1 --2- 172.21.15.44:0/1221561444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1310004870 0x7f1310004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:44.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.299+0000 7f13237fe700 1 --2- 172.21.15.44:0/1221561444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1310005230 0x7f131000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:44.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.299+0000 7f1322ffd700 1 --2- 172.21.15.44:0/1221561444 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1310003a20 0x7f1310003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:44.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.299+0000 7f13227fc700 1 -- 172.21.15.44:0/1221561444 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1310003a20 msgr2=0x7f1310003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:44.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.299+0000 7f13227fc700 1 --2- 172.21.15.44:0/1221561444 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1310003a20 0x7f1310003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.299+0000 7f13227fc700 1 -- 172.21.15.44:0/1221561444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1310005230 msgr2=0x7f131000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:44.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.299+0000 7f13227fc700 1 --2- 172.21.15.44:0/1221561444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1310005230 0x7f131000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.299+0000 7f13237fe700 1 -- 172.21.15.44:0/1221561444 reap_dead start 2024-09-13T18:27:44.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.299+0000 7f13227fc700 1 -- 172.21.15.44:0/1221561444 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13100035d0 con 0x7f1310004870 2024-09-13T18:27:44.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.299+0000 7f13227fc700 1 --2- 172.21.15.44:0/1221561444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1310004870 0x7f1310004cf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f130c009b70 tx=0x7f13100058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d88549bccb5afa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:44.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.299+0000 7f1321ffb700 1 -- 172.21.15.44:0/1221561444 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c00e6c0 con 0x7f1310004870 2024-09-13T18:27:44.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.299+0000 7f1321ffb700 1 -- 172.21.15.44:0/1221561444 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c00e820 con 0x7f1310004870 2024-09-13T18:27:44.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.299+0000 7f1321ffb700 1 -- 172.21.15.44:0/1221561444 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c00eb90 con 0x7f1310004870 2024-09-13T18:27:44.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.299+0000 7f1323fff700 1 -- 172.21.15.44:0/1221561444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1310004870 msgr2=0x7f1310004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:44.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.299+0000 7f1323fff700 1 --2- 172.21.15.44:0/1221561444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1310004870 0x7f1310004cf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f130c009b70 tx=0x7f13100058a0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.299+0000 7f1323fff700 1 -- 172.21.15.44:0/1221561444 shutdown_connections 2024-09-13T18:27:44.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.299+0000 7f1323fff700 1 --2- 172.21.15.44:0/1221561444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1310004870 0x7f1310004cf0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.299+0000 7f1323fff700 1 -- 172.21.15.44:0/1221561444 >> 172.21.15.44:0/1221561444 conn(0x7f13240d2cb0 msgr2=0x7f13240d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:44.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.299+0000 7f1323fff700 1 -- 172.21.15.44:0/1221561444 shutdown_connections 2024-09-13T18:27:44.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.299+0000 7f1323fff700 1 -- 172.21.15.44:0/1221561444 wait complete. 2024-09-13T18:27:44.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.299+0000 7f1323fff700 1 Processor -- start 2024-09-13T18:27:44.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.299+0000 7f1323fff700 1 -- start start 2024-09-13T18:27:44.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f1323fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1310004870 0x7f13241f1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:44.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f1323fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13240c84e0 0x7f13240c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:44.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f1323fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f13240cf680 0x7f13240cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:44.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f1323fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13241558a0 con 0x7f13240c84e0 2024-09-13T18:27:44.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f1323fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13240d0040 con 0x7f1310004870 2024-09-13T18:27:44.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f1323fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1324157cc0 con 0x7f13240cf680 2024-09-13T18:27:44.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f13227fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13240c84e0 0x7f13240c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:44.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f13227fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13240c84e0 0x7f13240c8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36462/0 (socket says 172.21.15.44:36462) 2024-09-13T18:27:44.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f13227fc700 1 -- 172.21.15.44:0/1924522305 learned_addr learned my addr 172.21.15.44:0/1924522305 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:44.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f1322ffd700 1 --2- 172.21.15.44:0/1924522305 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1310004870 0x7f13241f1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:44.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f13237fe700 1 --2- 172.21.15.44:0/1924522305 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f13240cf680 0x7f13240cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:44.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f13227fc700 1 -- 172.21.15.44:0/1924522305 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f13240cf680 msgr2=0x7f13240cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f13227fc700 1 --2- 172.21.15.44:0/1924522305 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f13240cf680 0x7f13240cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f13227fc700 1 -- 172.21.15.44:0/1924522305 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1310004870 msgr2=0x7f13241f1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f13227fc700 1 --2- 172.21.15.44:0/1924522305 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1310004870 0x7f13241f1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f13227fc700 1 -- 172.21.15.44:0/1924522305 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1324158790 con 0x7f13240c84e0 2024-09-13T18:27:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f13237fe700 1 --2- 172.21.15.44:0/1924522305 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f13240cf680 0x7f13240cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f1322ffd700 1 --2- 172.21.15.44:0/1924522305 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1310004870 0x7f13241f1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f13227fc700 1 --2- 172.21.15.44:0/1924522305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13240c84e0 0x7f13240c8960 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f131000c0a0 tx=0x7f130c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f131b7fe700 1 -- 172.21.15.44:0/1924522305 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c00e6c0 con 0x7f13240c84e0 2024-09-13T18:27:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f131b7fe700 1 -- 172.21.15.44:0/1924522305 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c003af0 con 0x7f13240c84e0 2024-09-13T18:27:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f1323fff700 1 -- 172.21.15.44:0/1924522305 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1324157ef0 con 0x7f13240c84e0 2024-09-13T18:27:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f131b7fe700 1 -- 172.21.15.44:0/1924522305 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c003ea0 con 0x7f13240c84e0 2024-09-13T18:27:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f1323fff700 1 -- 172.21.15.44:0/1924522305 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13241584b0 con 0x7f13240c84e0 2024-09-13T18:27:44.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.303+0000 7f1323fff700 1 -- 172.21.15.44:0/1924522305 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13240cef00 con 0x7f13240c84e0 2024-09-13T18:27:44.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.307+0000 7f131b7fe700 1 -- 172.21.15.44:0/1924522305 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f130c013470 con 0x7f13240c84e0 2024-09-13T18:27:44.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.307+0000 7f131b7fe700 1 --2- 172.21.15.44:0/1924522305 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1304066760 0x7f1304068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:44.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.307+0000 7f131b7fe700 1 -- 172.21.15.44:0/1924522305 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f130c085da0 con 0x7f13240c84e0 2024-09-13T18:27:44.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.307+0000 7f1322ffd700 1 --2- 172.21.15.44:0/1924522305 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1304066760 0x7f1304068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:44.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.307+0000 7f1322ffd700 1 --2- 172.21.15.44:0/1924522305 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1304066760 0x7f1304068c20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1314000c00 tx=0x7f1314009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:44.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.311+0000 7f131b7fe700 1 -- 172.21.15.44:0/1924522305 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f130c0531a0 con 0x7f13240c84e0 2024-09-13T18:27:44.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.490+0000 7f1323fff700 1 -- 172.21.15.44:0/1924522305 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f13240b61f0 con 0x7f13240c84e0 2024-09-13T18:27:44.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.490+0000 7f131b7fe700 1 -- 172.21.15.44:0/1924522305 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f130c0567c0 con 0x7f13240c84e0 2024-09-13T18:27:44.495 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:27:44.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.494+0000 7f1323fff700 1 -- 172.21.15.44:0/1924522305 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1304066760 msgr2=0x7f1304068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:44.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.494+0000 7f1323fff700 1 --2- 172.21.15.44:0/1924522305 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1304066760 0x7f1304068c20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1314000c00 tx=0x7f1314009040 comp rx=0 tx=0).stop 2024-09-13T18:27:44.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.494+0000 7f1323fff700 1 -- 172.21.15.44:0/1924522305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13240c84e0 msgr2=0x7f13240c8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:44.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.494+0000 7f1323fff700 1 --2- 172.21.15.44:0/1924522305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13240c84e0 0x7f13240c8960 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f131000c0a0 tx=0x7f130c0047e0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.494+0000 7f1323fff700 1 -- 172.21.15.44:0/1924522305 shutdown_connections 2024-09-13T18:27:44.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.494+0000 7f1323fff700 1 --2- 172.21.15.44:0/1924522305 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1304066760 0x7f1304068c20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.494+0000 7f1323fff700 1 --2- 172.21.15.44:0/1924522305 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f13240cf680 0x7f13240cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.494+0000 7f1323fff700 1 --2- 172.21.15.44:0/1924522305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13240c84e0 0x7f13240c8960 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.494+0000 7f1323fff700 1 --2- 172.21.15.44:0/1924522305 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1310004870 0x7f13241f1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.494+0000 7f1323fff700 1 -- 172.21.15.44:0/1924522305 >> 172.21.15.44:0/1924522305 conn(0x7f13240d2cb0 msgr2=0x7f13240b2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:44.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.494+0000 7f1323fff700 1 -- 172.21.15.44:0/1924522305 shutdown_connections 2024-09-13T18:27:44.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.494+0000 7f1323fff700 1 -- 172.21.15.44:0/1924522305 wait complete. 2024-09-13T18:27:44.516 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:27:44.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.630+0000 7f430bfff700 1 Processor -- start 2024-09-13T18:27:44.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.630+0000 7f430bfff700 1 -- start start 2024-09-13T18:27:44.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.630+0000 7f430bfff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f430c15ce90 0x7f430c0ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:44.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.630+0000 7f430bfff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f430c06dde0 0x7f430c06e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:44.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.630+0000 7f430bfff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f430c0cd730 con 0x7f430c0cdbc0 2024-09-13T18:27:44.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.630+0000 7f430bfff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430c06e790 con 0x7f430c06dde0 2024-09-13T18:27:44.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.630+0000 7f430bfff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430c0d0850 con 0x7f430c15ce90 2024-09-13T18:27:44.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.630+0000 7f430a7fc700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f430c06dde0 0x7f430c06e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:44.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.630+0000 7f430b7fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f430c0cdbc0 0x7f430c0cdff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45146/0 (socket says 172.21.15.44:45146) 2024-09-13T18:27:44.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.630+0000 7f430b7fe700 1 -- 172.21.15.44:0/2161630281 learned_addr learned my addr 172.21.15.44:0/2161630281 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:44.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.630+0000 7f430affd700 1 --2- 172.21.15.44:0/2161630281 >> v2:172.21.15.99:3300/0 conn(0x7f430c15ce90 0x7f430c0ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:44.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.630+0000 7f430a7fc700 1 -- 172.21.15.44:0/2161630281 >> v2:172.21.15.99:3300/0 conn(0x7f430c15ce90 msgr2=0x7f430c0ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:44.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.630+0000 7f4309ffb700 1 -- 172.21.15.44:0/2161630281 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308162108 0 0) 0x7f430c0cd730 con 0x7f430c0cdbc0 2024-09-13T18:27:44.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.630+0000 7f430a7fc700 1 --2- 172.21.15.44:0/2161630281 >> v2:172.21.15.99:3300/0 conn(0x7f430c15ce90 0x7f430c0ad2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.630+0000 7f430a7fc700 1 -- 172.21.15.44:0/2161630281 >> v1:172.21.15.44:6789/0 conn(0x7f430c0cdbc0 legacy=0x7f430c0cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:44.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.630+0000 7f430a7fc700 1 -- 172.21.15.44:0/2161630281 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c0adf30 con 0x7f430c06dde0 2024-09-13T18:27:44.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.634+0000 7f430a7fc700 1 --2- 172.21.15.44:0/2161630281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f430c06dde0 0x7f430c06e250 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f430c04e810 tx=0x7f42fc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=512d6779b316be6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:44.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.634+0000 7f4309ffb700 1 -- 172.21.15.44:0/2161630281 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc011830 con 0x7f430c06dde0 2024-09-13T18:27:44.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.634+0000 7f4309ffb700 1 -- 172.21.15.44:0/2161630281 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42fc011990 con 0x7f430c06dde0 2024-09-13T18:27:44.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.634+0000 7f4309ffb700 1 -- 172.21.15.44:0/2161630281 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc011d20 con 0x7f430c06dde0 2024-09-13T18:27:44.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.634+0000 7f430bfff700 1 -- 172.21.15.44:0/2161630281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f430c06dde0 msgr2=0x7f430c06e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:44.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.634+0000 7f430bfff700 1 --2- 172.21.15.44:0/2161630281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f430c06dde0 0x7f430c06e250 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f430c04e810 tx=0x7f42fc009b30 comp rx=0 tx=0).stop 2024-09-13T18:27:44.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.634+0000 7f430bfff700 1 -- 172.21.15.44:0/2161630281 shutdown_connections 2024-09-13T18:27:44.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.634+0000 7f430bfff700 1 --2- 172.21.15.44:0/2161630281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f430c06dde0 0x7f430c06e250 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.634+0000 7f430bfff700 1 --2- 172.21.15.44:0/2161630281 >> v2:172.21.15.99:3300/0 conn(0x7f430c15ce90 0x7f430c0ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.634+0000 7f430bfff700 1 -- 172.21.15.44:0/2161630281 >> 172.21.15.44:0/2161630281 conn(0x7f430c0cf9a0 msgr2=0x7f430c0cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:44.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.634+0000 7f430bfff700 1 -- 172.21.15.44:0/2161630281 shutdown_connections 2024-09-13T18:27:44.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.634+0000 7f430bfff700 1 -- 172.21.15.44:0/2161630281 wait complete. 2024-09-13T18:27:44.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.634+0000 7f430bfff700 1 Processor -- start 2024-09-13T18:27:44.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f430bfff700 1 -- start start 2024-09-13T18:27:44.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f430bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f430c06dde0 0x7f430c153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:44.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f430bfff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f430c0cdbc0 0x7f430c14fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:44.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f430bfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f430c15ce90 0x7f430c154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:44.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f430bfff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c06afe0 con 0x7f430c06dde0 2024-09-13T18:27:44.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f430bfff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c06d4d0 con 0x7f430c0cdbc0 2024-09-13T18:27:44.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f430bfff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430c06ac40 con 0x7f430c15ce90 2024-09-13T18:27:44.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f430affd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f430c06dde0 0x7f430c153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:44.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f430affd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f430c06dde0 0x7f430c153a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36478/0 (socket says 172.21.15.44:36478) 2024-09-13T18:27:44.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f430affd700 1 -- 172.21.15.44:0/1304521976 learned_addr learned my addr 172.21.15.44:0/1304521976 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:44.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f430a7fc700 1 --2- 172.21.15.44:0/1304521976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f430c0cdbc0 0x7f430c14fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:44.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f430b7fe700 1 --2- 172.21.15.44:0/1304521976 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f430c15ce90 0x7f430c154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:44.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f430affd700 1 -- 172.21.15.44:0/1304521976 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f430c15ce90 msgr2=0x7f430c154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:44.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f430affd700 1 --2- 172.21.15.44:0/1304521976 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f430c15ce90 0x7f430c154b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f430affd700 1 -- 172.21.15.44:0/1304521976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f430c0cdbc0 msgr2=0x7f430c14fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:44.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f430affd700 1 --2- 172.21.15.44:0/1304521976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f430c0cdbc0 0x7f430c14fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f430affd700 1 -- 172.21.15.44:0/1304521976 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42fc0094b0 con 0x7f430c06dde0 2024-09-13T18:27:44.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f430b7fe700 1 --2- 172.21.15.44:0/1304521976 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f430c15ce90 0x7f430c154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:44.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f430affd700 1 --2- 172.21.15.44:0/1304521976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f430c06dde0 0x7f430c153a60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f430000e9d0 tx=0x7f430000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:44.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f42f37fe700 1 -- 172.21.15.44:0/1304521976 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300009720 con 0x7f430c06dde0 2024-09-13T18:27:44.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f42f37fe700 1 -- 172.21.15.44:0/1304521976 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430000c850 con 0x7f430c06dde0 2024-09-13T18:27:44.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f430bfff700 1 -- 172.21.15.44:0/1304521976 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f430c06cf10 con 0x7f430c06dde0 2024-09-13T18:27:44.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f42f37fe700 1 -- 172.21.15.44:0/1304521976 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430000cbc0 con 0x7f430c06dde0 2024-09-13T18:27:44.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.638+0000 7f430bfff700 1 -- 172.21.15.44:0/1304521976 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430c153fa0 con 0x7f430c06dde0 2024-09-13T18:27:44.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.642+0000 7f430bfff700 1 -- 172.21.15.44:0/1304521976 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f430c06aaa0 con 0x7f430c06dde0 2024-09-13T18:27:44.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.642+0000 7f42f37fe700 1 -- 172.21.15.44:0/1304521976 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f430000cd20 con 0x7f430c06dde0 2024-09-13T18:27:44.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.642+0000 7f42f37fe700 1 --2- 172.21.15.44:0/1304521976 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f42f8066730 0x7f42f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:44.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.642+0000 7f42f37fe700 1 -- 172.21.15.44:0/1304521976 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4300084240 con 0x7f430c06dde0 2024-09-13T18:27:44.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.642+0000 7f430a7fc700 1 --2- 172.21.15.44:0/1304521976 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f42f8066730 0x7f42f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:44.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.646+0000 7f430a7fc700 1 --2- 172.21.15.44:0/1304521976 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f42f8066730 0x7f42f8068bf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f42fc009fd0 tx=0x7f42fc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:44.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.650+0000 7f42f37fe700 1 -- 172.21.15.44:0/1304521976 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f430c06aaa0 con 0x7f430c06dde0 2024-09-13T18:27:44.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.822+0000 7f430bfff700 1 -- 172.21.15.44:0/1304521976 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f430c06aaa0 con 0x7f430c06dde0 2024-09-13T18:27:44.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.822+0000 7f42f37fe700 1 -- 172.21.15.44:0/1304521976 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f430c06aaa0 con 0x7f430c06dde0 2024-09-13T18:27:44.828 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:27:44.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.826+0000 7f430bfff700 1 -- 172.21.15.44:0/1304521976 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f42f8066730 msgr2=0x7f42f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:44.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.826+0000 7f430bfff700 1 --2- 172.21.15.44:0/1304521976 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f42f8066730 0x7f42f8068bf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f42fc009fd0 tx=0x7f42fc008030 comp rx=0 tx=0).stop 2024-09-13T18:27:44.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.826+0000 7f430bfff700 1 -- 172.21.15.44:0/1304521976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f430c06dde0 msgr2=0x7f430c153a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:44.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.826+0000 7f430bfff700 1 --2- 172.21.15.44:0/1304521976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f430c06dde0 0x7f430c153a60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f430000e9d0 tx=0x7f430000ece0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.826+0000 7f430bfff700 1 -- 172.21.15.44:0/1304521976 shutdown_connections 2024-09-13T18:27:44.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.826+0000 7f430bfff700 1 --2- 172.21.15.44:0/1304521976 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f42f8066730 0x7f42f8068bf0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.826+0000 7f430bfff700 1 --2- 172.21.15.44:0/1304521976 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f430c15ce90 0x7f430c154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.826+0000 7f430bfff700 1 --2- 172.21.15.44:0/1304521976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f430c0cdbc0 0x7f430c14fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.826+0000 7f430bfff700 1 --2- 172.21.15.44:0/1304521976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f430c06dde0 0x7f430c153a60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.826+0000 7f430bfff700 1 -- 172.21.15.44:0/1304521976 >> 172.21.15.44:0/1304521976 conn(0x7f430c0cf9a0 msgr2=0x7f430c0b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:44.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.826+0000 7f430bfff700 1 -- 172.21.15.44:0/1304521976 shutdown_connections 2024-09-13T18:27:44.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.826+0000 7f430bfff700 1 -- 172.21.15.44:0/1304521976 wait complete. 2024-09-13T18:27:44.843 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:27:44.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.954+0000 7f8f07fff700 1 Processor -- start 2024-09-13T18:27:44.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.954+0000 7f8f07fff700 1 -- start start 2024-09-13T18:27:44.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.954+0000 7f8f07fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8f0806b5f0 0x7f8f0806a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:44.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.954+0000 7f8f07fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8f0815ce70 0x7f8f080cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:44.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.954+0000 7f8f07fff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f080d1bc0 con 0x7f8f0815ca90 2024-09-13T18:27:44.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.954+0000 7f8f07fff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f080cdac0 con 0x7f8f0815ce70 2024-09-13T18:27:44.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.954+0000 7f8f07fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0806ac20 con 0x7f8f0806b5f0 2024-09-13T18:27:44.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.958+0000 7f8f06ffd700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8f0815ca90 0x7f8f0806aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45148/0 (socket says 172.21.15.44:45148) 2024-09-13T18:27:44.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.958+0000 7f8f06ffd700 1 -- 172.21.15.44:0/56877051 learned_addr learned my addr 172.21.15.44:0/56877051 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:44.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.958+0000 7f8f067fc700 1 --2- 172.21.15.44:0/56877051 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8f0806b5f0 0x7f8f0806a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:44.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.958+0000 7f8f077fe700 1 --2- 172.21.15.44:0/56877051 >> v2:172.21.15.99:3300/0 conn(0x7f8f0815ce70 0x7f8f080cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:44.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.958+0000 7f8f05ffb700 1 -- 172.21.15.44:0/56877051 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1285851267 0 0) 0x7f8f080d1bc0 con 0x7f8f0815ca90 2024-09-13T18:27:44.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.958+0000 7f8f05ffb700 1 -- 172.21.15.44:0/56877051 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ef00035d0 con 0x7f8f0815ca90 2024-09-13T18:27:44.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.958+0000 7f8f067fc700 1 -- 172.21.15.44:0/56877051 >> v2:172.21.15.99:3300/0 conn(0x7f8f0815ce70 msgr2=0x7f8f080cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:44.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.958+0000 7f8f067fc700 1 --2- 172.21.15.44:0/56877051 >> v2:172.21.15.99:3300/0 conn(0x7f8f0815ce70 0x7f8f080cdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.958+0000 7f8f067fc700 1 -- 172.21.15.44:0/56877051 >> v1:172.21.15.44:6789/0 conn(0x7f8f0815ca90 legacy=0x7f8f0806aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:44.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.958+0000 7f8f067fc700 1 -- 172.21.15.44:0/56877051 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f080d1290 con 0x7f8f0806b5f0 2024-09-13T18:27:44.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.958+0000 7f8f077fe700 1 --2- 172.21.15.44:0/56877051 >> v2:172.21.15.99:3300/0 conn(0x7f8f0815ce70 0x7f8f080cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:44.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.958+0000 7f8f067fc700 1 --2- 172.21.15.44:0/56877051 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8f0806b5f0 0x7f8f0806a520 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009850 tx=0x7f8ef8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58e052127ad8929c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:44.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.958+0000 7f8f05ffb700 1 -- 172.21.15.44:0/56877051 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8011830 con 0x7f8f0806b5f0 2024-09-13T18:27:44.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.958+0000 7f8f05ffb700 1 -- 172.21.15.44:0/56877051 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef8011990 con 0x7f8f0806b5f0 2024-09-13T18:27:44.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.958+0000 7f8f05ffb700 1 -- 172.21.15.44:0/56877051 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8011d00 con 0x7f8f0806b5f0 2024-09-13T18:27:44.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.958+0000 7f8f07fff700 1 -- 172.21.15.44:0/56877051 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8f0806b5f0 msgr2=0x7f8f0806a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:44.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.958+0000 7f8f07fff700 1 --2- 172.21.15.44:0/56877051 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8f0806b5f0 0x7f8f0806a520 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009850 tx=0x7f8ef8009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:44.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.958+0000 7f8f07fff700 1 -- 172.21.15.44:0/56877051 shutdown_connections 2024-09-13T18:27:44.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.958+0000 7f8f07fff700 1 --2- 172.21.15.44:0/56877051 >> v2:172.21.15.99:3300/0 conn(0x7f8f0815ce70 0x7f8f080cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.958+0000 7f8f07fff700 1 --2- 172.21.15.44:0/56877051 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8f0806b5f0 0x7f8f0806a520 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.958+0000 7f8f07fff700 1 -- 172.21.15.44:0/56877051 >> 172.21.15.44:0/56877051 conn(0x7f8f080d2c10 msgr2=0x7f8f080d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:44.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.958+0000 7f8f07fff700 1 -- 172.21.15.44:0/56877051 shutdown_connections 2024-09-13T18:27:44.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.958+0000 7f8f07fff700 1 -- 172.21.15.44:0/56877051 wait complete. 2024-09-13T18:27:44.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8f07fff700 1 Processor -- start 2024-09-13T18:27:44.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8f07fff700 1 -- start start 2024-09-13T18:27:44.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8f07fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f0806b5f0 0x7f8f080cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:44.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8f07fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8f0815ca90 0x7f8f0815e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:44.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8f07fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f0815ce70 0x7f8f080c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:44.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8f07fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0815fd40 con 0x7f8f0806b5f0 2024-09-13T18:27:44.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8f07fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0815eca0 con 0x7f8f0815ce70 2024-09-13T18:27:44.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8f07fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0815ef80 con 0x7f8f0815ca90 2024-09-13T18:27:44.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8f06ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f0806b5f0 0x7f8f080cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:44.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8f06ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f0806b5f0 0x7f8f080cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36484/0 (socket says 172.21.15.44:36484) 2024-09-13T18:27:44.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8f067fc700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8f0815ca90 0x7f8f0815e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:44.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8f06ffd700 1 -- 172.21.15.44:0/3585406219 learned_addr learned my addr 172.21.15.44:0/3585406219 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:44.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8f077fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f0815ce70 0x7f8f080c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:44.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8f06ffd700 1 -- 172.21.15.44:0/3585406219 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8f0815ca90 msgr2=0x7f8f0815e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:44.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8f06ffd700 1 --2- 172.21.15.44:0/3585406219 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8f0815ca90 0x7f8f0815e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8f06ffd700 1 -- 172.21.15.44:0/3585406219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f0815ce70 msgr2=0x7f8f080c6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:44.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8f06ffd700 1 --2- 172.21.15.44:0/3585406219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f0815ce70 0x7f8f080c6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:44.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8f06ffd700 1 -- 172.21.15.44:0/3585406219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f00009a70 con 0x7f8f0806b5f0 2024-09-13T18:27:44.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8f06ffd700 1 --2- 172.21.15.44:0/3585406219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f0806b5f0 0x7f8f080cc4c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00c4f0 tx=0x7f8efc00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:44.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8eef7fe700 1 -- 172.21.15.44:0/3585406219 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc005d90 con 0x7f8f0806b5f0 2024-09-13T18:27:44.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8eef7fe700 1 -- 172.21.15.44:0/3585406219 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8efc0070d0 con 0x7f8f0806b5f0 2024-09-13T18:27:44.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8f07fff700 1 -- 172.21.15.44:0/3585406219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef80094b0 con 0x7f8f0806b5f0 2024-09-13T18:27:44.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8eef7fe700 1 -- 172.21.15.44:0/3585406219 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc007440 con 0x7f8f0806b5f0 2024-09-13T18:27:44.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.962+0000 7f8f07fff700 1 -- 172.21.15.44:0/3585406219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0815f540 con 0x7f8f0806b5f0 2024-09-13T18:27:44.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.966+0000 7f8f07fff700 1 -- 172.21.15.44:0/3585406219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f080c9b00 con 0x7f8f0806b5f0 2024-09-13T18:27:44.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.966+0000 7f8eef7fe700 1 -- 172.21.15.44:0/3585406219 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8efc0075a0 con 0x7f8f0806b5f0 2024-09-13T18:27:44.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.966+0000 7f8eef7fe700 1 --2- 172.21.15.44:0/3585406219 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8ef4066730 0x7f8ef4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:44.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.966+0000 7f8eef7fe700 1 -- 172.21.15.44:0/3585406219 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8efc083420 con 0x7f8f0806b5f0 2024-09-13T18:27:44.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.966+0000 7f8f067fc700 1 --2- 172.21.15.44:0/3585406219 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8ef4066730 0x7f8ef4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:44.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.970+0000 7f8f067fc700 1 --2- 172.21.15.44:0/3585406219 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8ef4066730 0x7f8ef4068bf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8ef80090b0 tx=0x7f8ef8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:44.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:44.974+0000 7f8eef7fe700 1 -- 172.21.15.44:0/3585406219 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8efc050850 con 0x7f8f0806b5f0 2024-09-13T18:27:45.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.142+0000 7f8f07fff700 1 -- 172.21.15.44:0/3585406219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8f0806a520 con 0x7f8f0806b5f0 2024-09-13T18:27:45.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.142+0000 7f8eef7fe700 1 -- 172.21.15.44:0/3585406219 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8efc017020 con 0x7f8f0806b5f0 2024-09-13T18:27:45.148 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:27:45.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.142+0000 7f8f07fff700 1 -- 172.21.15.44:0/3585406219 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8ef4066730 msgr2=0x7f8ef4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:45.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.142+0000 7f8f07fff700 1 --2- 172.21.15.44:0/3585406219 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8ef4066730 0x7f8ef4068bf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8ef80090b0 tx=0x7f8ef8008030 comp rx=0 tx=0).stop 2024-09-13T18:27:45.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.142+0000 7f8f07fff700 1 -- 172.21.15.44:0/3585406219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f0806b5f0 msgr2=0x7f8f080cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:45.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.142+0000 7f8f07fff700 1 --2- 172.21.15.44:0/3585406219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f0806b5f0 0x7f8f080cc4c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00c4f0 tx=0x7f8efc00c800 comp rx=0 tx=0).stop 2024-09-13T18:27:45.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.142+0000 7f8f07fff700 1 -- 172.21.15.44:0/3585406219 shutdown_connections 2024-09-13T18:27:45.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.142+0000 7f8f07fff700 1 --2- 172.21.15.44:0/3585406219 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8ef4066730 0x7f8ef4068bf0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.142+0000 7f8f07fff700 1 --2- 172.21.15.44:0/3585406219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f0815ce70 0x7f8f080c6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.142+0000 7f8f07fff700 1 --2- 172.21.15.44:0/3585406219 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8f0815ca90 0x7f8f0815e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.142+0000 7f8f07fff700 1 --2- 172.21.15.44:0/3585406219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f0806b5f0 0x7f8f080cc4c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.146+0000 7f8f07fff700 1 -- 172.21.15.44:0/3585406219 >> 172.21.15.44:0/3585406219 conn(0x7f8f080d2c10 msgr2=0x7f8f0806aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:45.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.146+0000 7f8f07fff700 1 -- 172.21.15.44:0/3585406219 shutdown_connections 2024-09-13T18:27:45.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.146+0000 7f8f07fff700 1 -- 172.21.15.44:0/3585406219 wait complete. 2024-09-13T18:27:45.163 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:27:45.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.270+0000 7f30a6051700 1 Processor -- start 2024-09-13T18:27:45.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.270+0000 7f30a6051700 1 -- start start 2024-09-13T18:27:45.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.270+0000 7f30a6051700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f30a015cda0 0x7f30a006b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:45.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.270+0000 7f30a6051700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f30a00ceb70 0x7f30a00b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:45.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.270+0000 7f30a6051700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a00b8430 con 0x7f30a006a520 2024-09-13T18:27:45.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.270+0000 7f30a6051700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a006be40 con 0x7f30a015cda0 2024-09-13T18:27:45.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.270+0000 7f30a6051700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00cf350 con 0x7f30a00ceb70 2024-09-13T18:27:45.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.270+0000 7f30a504f700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f30a015cda0 0x7f30a006b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:45.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.270+0000 7f30a504f700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f30a015cda0 0x7f30a006b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36500/0 (socket says 172.21.15.44:36500) 2024-09-13T18:27:45.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.270+0000 7f30a504f700 1 -- 172.21.15.44:0/3034831596 learned_addr learned my addr 172.21.15.44:0/3034831596 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:45.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.270+0000 7f30a484e700 1 --2- 172.21.15.44:0/3034831596 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f30a00ceb70 0x7f30a00b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:45.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.270+0000 7f30a504f700 1 -- 172.21.15.44:0/3034831596 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f30a00ceb70 msgr2=0x7f30a00b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:45.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.270+0000 7f30a504f700 1 --2- 172.21.15.44:0/3034831596 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f30a00ceb70 0x7f30a00b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.270+0000 7f30a504f700 1 -- 172.21.15.44:0/3034831596 >> v1:172.21.15.99:6789/0 conn(0x7f30a006a520 legacy=0x7f30a00d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:45.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.270+0000 7f30a504f700 1 -- 172.21.15.44:0/3034831596 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a00d0880 con 0x7f30a015cda0 2024-09-13T18:27:45.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.270+0000 7f30a504f700 1 --2- 172.21.15.44:0/3034831596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a015cda0 0x7f30a006b900 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f309c009910 tx=0x7f309c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=558a539602c349b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:45.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.270+0000 7f3097fff700 1 -- 172.21.15.44:0/3034831596 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309c011830 con 0x7f30a015cda0 2024-09-13T18:27:45.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.270+0000 7f3097fff700 1 -- 172.21.15.44:0/3034831596 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309c011990 con 0x7f30a015cda0 2024-09-13T18:27:45.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.270+0000 7f3097fff700 1 -- 172.21.15.44:0/3034831596 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309c011d40 con 0x7f30a015cda0 2024-09-13T18:27:45.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.270+0000 7f30a6051700 1 -- 172.21.15.44:0/3034831596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a015cda0 msgr2=0x7f30a006b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:45.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.270+0000 7f30a6051700 1 --2- 172.21.15.44:0/3034831596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a015cda0 0x7f30a006b900 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f309c009910 tx=0x7f309c009c20 comp rx=0 tx=0).stop 2024-09-13T18:27:45.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.274+0000 7f30a6051700 1 -- 172.21.15.44:0/3034831596 shutdown_connections 2024-09-13T18:27:45.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.274+0000 7f30a6051700 1 --2- 172.21.15.44:0/3034831596 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f30a00ceb70 0x7f30a00b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.274+0000 7f30a6051700 1 --2- 172.21.15.44:0/3034831596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a015cda0 0x7f30a006b900 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.274+0000 7f30a6051700 1 -- 172.21.15.44:0/3034831596 >> 172.21.15.44:0/3034831596 conn(0x7f30a00d2cb0 msgr2=0x7f30a00d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:45.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.274+0000 7f30a6051700 1 -- 172.21.15.44:0/3034831596 shutdown_connections 2024-09-13T18:27:45.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.274+0000 7f30a6051700 1 -- 172.21.15.44:0/3034831596 wait complete. 2024-09-13T18:27:45.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.274+0000 7f30a6051700 1 Processor -- start 2024-09-13T18:27:45.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.274+0000 7f30a6051700 1 -- start start 2024-09-13T18:27:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.274+0000 7f30a6051700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30a006a520 0x7f30a0146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.274+0000 7f30a6051700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f30a00ceb70 0x7f30a0152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.274+0000 7f30a6051700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a015cda0 0x7f30a01584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.274+0000 7f30a6051700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00c7c90 con 0x7f30a015cda0 2024-09-13T18:27:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.274+0000 7f30a6051700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00c8810 con 0x7f30a006a520 2024-09-13T18:27:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.274+0000 7f30a6051700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00c7ee0 con 0x7f30a00ceb70 2024-09-13T18:27:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.274+0000 7f30a5850700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a015cda0 0x7f30a01584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.274+0000 7f30a5850700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a015cda0 0x7f30a01584b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36512/0 (socket says 172.21.15.44:36512) 2024-09-13T18:27:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.274+0000 7f30a5850700 1 -- 172.21.15.44:0/3417909996 learned_addr learned my addr 172.21.15.44:0/3417909996 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.274+0000 7f30a504f700 1 --2- 172.21.15.44:0/3417909996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30a006a520 0x7f30a0146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.274+0000 7f30a484e700 1 --2- 172.21.15.44:0/3417909996 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f30a00ceb70 0x7f30a0152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.274+0000 7f30a5850700 1 -- 172.21.15.44:0/3417909996 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f30a00ceb70 msgr2=0x7f30a0152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:45.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.274+0000 7f30a5850700 1 --2- 172.21.15.44:0/3417909996 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f30a00ceb70 0x7f30a0152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.278+0000 7f30a5850700 1 -- 172.21.15.44:0/3417909996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30a006a520 msgr2=0x7f30a0146ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:45.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.278+0000 7f30a5850700 1 --2- 172.21.15.44:0/3417909996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30a006a520 0x7f30a0146ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.278+0000 7f30a5850700 1 -- 172.21.15.44:0/3417909996 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309c009570 con 0x7f30a015cda0 2024-09-13T18:27:45.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.278+0000 7f30a484e700 1 --2- 172.21.15.44:0/3417909996 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f30a00ceb70 0x7f30a0152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:45.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.278+0000 7f30a5850700 1 --2- 172.21.15.44:0/3417909996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a015cda0 0x7f30a01584b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f309800cc50 tx=0x7f309800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:45.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.278+0000 7f3095ffb700 1 -- 172.21.15.44:0/3417909996 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3098003c20 con 0x7f30a015cda0 2024-09-13T18:27:45.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.278+0000 7f3095ffb700 1 -- 172.21.15.44:0/3417909996 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3098003d80 con 0x7f30a015cda0 2024-09-13T18:27:45.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.278+0000 7f30a6051700 1 -- 172.21.15.44:0/3417909996 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a00c81c0 con 0x7f30a015cda0 2024-09-13T18:27:45.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.278+0000 7f3095ffb700 1 -- 172.21.15.44:0/3417909996 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309800ab60 con 0x7f30a015cda0 2024-09-13T18:27:45.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.278+0000 7f30a6051700 1 -- 172.21.15.44:0/3417909996 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a01589f0 con 0x7f30a015cda0 2024-09-13T18:27:45.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.278+0000 7f30a6051700 1 -- 172.21.15.44:0/3417909996 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a00c8980 con 0x7f30a015cda0 2024-09-13T18:27:45.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.278+0000 7f3095ffb700 1 -- 172.21.15.44:0/3417909996 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f309800acc0 con 0x7f30a015cda0 2024-09-13T18:27:45.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.282+0000 7f3095ffb700 1 --2- 172.21.15.44:0/3417909996 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3084066730 0x7f3084068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:45.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.282+0000 7f3095ffb700 1 -- 172.21.15.44:0/3417909996 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f30980842f0 con 0x7f30a015cda0 2024-09-13T18:27:45.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.282+0000 7f30a504f700 1 --2- 172.21.15.44:0/3417909996 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3084066730 0x7f3084068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:45.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.282+0000 7f30a504f700 1 --2- 172.21.15.44:0/3417909996 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3084066730 0x7f3084068bf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f309c000c00 tx=0x7f309c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:45.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.294+0000 7f3095ffb700 1 -- 172.21.15.44:0/3417909996 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3098051540 con 0x7f30a015cda0 2024-09-13T18:27:45.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.474+0000 7f30a6051700 1 -- 172.21.15.44:0/3417909996 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f30a006b900 con 0x7f30a015cda0 2024-09-13T18:27:45.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.474+0000 7f3095ffb700 1 -- 172.21.15.44:0/3417909996 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3098054b60 con 0x7f30a015cda0 2024-09-13T18:27:45.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.478+0000 7f30a6051700 1 -- 172.21.15.44:0/3417909996 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3084066730 msgr2=0x7f3084068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:45.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.478+0000 7f30a6051700 1 --2- 172.21.15.44:0/3417909996 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3084066730 0x7f3084068bf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f309c000c00 tx=0x7f309c008030 comp rx=0 tx=0).stop 2024-09-13T18:27:45.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.478+0000 7f30a6051700 1 -- 172.21.15.44:0/3417909996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a015cda0 msgr2=0x7f30a01584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:45.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.478+0000 7f30a6051700 1 --2- 172.21.15.44:0/3417909996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a015cda0 0x7f30a01584b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f309800cc50 tx=0x7f309800cf60 comp rx=0 tx=0).stop 2024-09-13T18:27:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.478+0000 7f30a6051700 1 -- 172.21.15.44:0/3417909996 shutdown_connections 2024-09-13T18:27:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.478+0000 7f30a6051700 1 --2- 172.21.15.44:0/3417909996 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3084066730 0x7f3084068bf0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.478+0000 7f30a6051700 1 --2- 172.21.15.44:0/3417909996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a015cda0 0x7f30a01584b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.478+0000 7f30a6051700 1 --2- 172.21.15.44:0/3417909996 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f30a00ceb70 0x7f30a0152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.478+0000 7f30a6051700 1 --2- 172.21.15.44:0/3417909996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30a006a520 0x7f30a0146ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.478+0000 7f30a6051700 1 -- 172.21.15.44:0/3417909996 >> 172.21.15.44:0/3417909996 conn(0x7f30a00d2cb0 msgr2=0x7f30a00b2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.478+0000 7f30a6051700 1 -- 172.21.15.44:0/3417909996 shutdown_connections 2024-09-13T18:27:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.478+0000 7f30a6051700 1 -- 172.21.15.44:0/3417909996 wait complete. 2024-09-13T18:27:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-13T18:27:45.496 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:27:45.496 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:27:45.502 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:45.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.606+0000 7f2ed17c0700 1 Processor -- start 2024-09-13T18:27:45.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.606+0000 7f2ed17c0700 1 -- start start 2024-09-13T18:27:45.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.606+0000 7f2ed17c0700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ecc06bbf0 0x7f2ecc0b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:45.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.606+0000 7f2ed17c0700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2ecc0b3910 0x7f2ecc06a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:45.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.606+0000 7f2ed17c0700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2ecc06aaf0 0x7f2ecc0cd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:45.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.606+0000 7f2ed17c0700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ecc13dcb0 con 0x7f2ecc06aaf0 2024-09-13T18:27:45.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.606+0000 7f2ed17c0700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ecc0b3d70 con 0x7f2ecc0b3910 2024-09-13T18:27:45.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.606+0000 7f2ed17c0700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc13ffd0 con 0x7f2ecc06bbf0 2024-09-13T18:27:45.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.606+0000 7f2ed0fbf700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2ecc06aaf0 0x7f2ecc0cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:45.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ed0fbf700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2ecc06aaf0 0x7f2ecc0cd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36526/0 (socket says 172.21.15.44:36526) 2024-09-13T18:27:45.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ed0fbf700 1 -- 172.21.15.44:0/3045130520 learned_addr learned my addr 172.21.15.44:0/3045130520 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:45.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ecb7fe700 1 --2- 172.21.15.44:0/3045130520 >> v2:172.21.15.99:3300/0 conn(0x7f2ecc0b3910 0x7f2ecc06a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:45.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ecbfff700 1 --2- 172.21.15.44:0/3045130520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ecc06bbf0 0x7f2ecc0b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:45.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ed0fbf700 1 -- 172.21.15.44:0/3045130520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ecc06bbf0 msgr2=0x7f2ecc0b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:45.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ed0fbf700 1 --2- 172.21.15.44:0/3045130520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ecc06bbf0 0x7f2ecc0b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ed0fbf700 1 -- 172.21.15.44:0/3045130520 >> v2:172.21.15.99:3300/0 conn(0x7f2ecc0b3910 msgr2=0x7f2ecc06a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:45.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ed0fbf700 1 --2- 172.21.15.44:0/3045130520 >> v2:172.21.15.99:3300/0 conn(0x7f2ecc0b3910 0x7f2ecc06a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ed0fbf700 1 -- 172.21.15.44:0/3045130520 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc140220 con 0x7f2ecc06aaf0 2024-09-13T18:27:45.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ecbfff700 1 --2- 172.21.15.44:0/3045130520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ecc06bbf0 0x7f2ecc0b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:45.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ecb7fe700 1 --2- 172.21.15.44:0/3045130520 >> v2:172.21.15.99:3300/0 conn(0x7f2ecc0b3910 0x7f2ecc06a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:45.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ed0fbf700 1 --2- 172.21.15.44:0/3045130520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ecc06aaf0 0x7f2ecc0cd580 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc06fd10 tx=0x7f2ebc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a60b6dafdc64e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:45.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ecaffd700 1 -- 172.21.15.44:0/3045130520 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc00b8a0 con 0x7f2ecc06aaf0 2024-09-13T18:27:45.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ecaffd700 1 -- 172.21.15.44:0/3045130520 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ebc00ba00 con 0x7f2ecc06aaf0 2024-09-13T18:27:45.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ecaffd700 1 -- 172.21.15.44:0/3045130520 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc00bd90 con 0x7f2ecc06aaf0 2024-09-13T18:27:45.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ed17c0700 1 -- 172.21.15.44:0/3045130520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ecc06aaf0 msgr2=0x7f2ecc0cd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:45.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ed17c0700 1 --2- 172.21.15.44:0/3045130520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ecc06aaf0 0x7f2ecc0cd580 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc06fd10 tx=0x7f2ebc009bf0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ed17c0700 1 -- 172.21.15.44:0/3045130520 shutdown_connections 2024-09-13T18:27:45.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ed17c0700 1 --2- 172.21.15.44:0/3045130520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ecc06aaf0 0x7f2ecc0cd580 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ed17c0700 1 --2- 172.21.15.44:0/3045130520 >> v2:172.21.15.99:3300/0 conn(0x7f2ecc0b3910 0x7f2ecc06a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ed17c0700 1 --2- 172.21.15.44:0/3045130520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ecc06bbf0 0x7f2ecc0b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ed17c0700 1 -- 172.21.15.44:0/3045130520 >> 172.21.15.44:0/3045130520 conn(0x7f2ecc0b0f00 msgr2=0x7f2ecc0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:45.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ed17c0700 1 -- 172.21.15.44:0/3045130520 shutdown_connections 2024-09-13T18:27:45.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ed17c0700 1 -- 172.21.15.44:0/3045130520 wait complete. 2024-09-13T18:27:45.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ed17c0700 1 Processor -- start 2024-09-13T18:27:45.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.610+0000 7f2ed17c0700 1 -- start start 2024-09-13T18:27:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.614+0000 7f2ed17c0700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ecc06aaf0 0x7f2ecc13a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.614+0000 7f2ed17c0700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ecc06bbf0 0x7f2ecc142100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.614+0000 7f2ed17c0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ecc0b3910 0x7f2ecc1551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.614+0000 7f2ed17c0700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc141ce0 con 0x7f2ecc0b3910 2024-09-13T18:27:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.614+0000 7f2ed17c0700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc156170 con 0x7f2ecc06aaf0 2024-09-13T18:27:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.614+0000 7f2ed17c0700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc155bb0 con 0x7f2ecc06bbf0 2024-09-13T18:27:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.614+0000 7f2ed0fbf700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ecc0b3910 0x7f2ecc1551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.614+0000 7f2ed0fbf700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ecc0b3910 0x7f2ecc1551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36530/0 (socket says 172.21.15.44:36530) 2024-09-13T18:27:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.614+0000 7f2ed0fbf700 1 -- 172.21.15.44:0/2532567046 learned_addr learned my addr 172.21.15.44:0/2532567046 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.614+0000 7f2ecbfff700 1 --2- 172.21.15.44:0/2532567046 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ecc06aaf0 0x7f2ecc13a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.614+0000 7f2ecb7fe700 1 --2- 172.21.15.44:0/2532567046 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ecc06bbf0 0x7f2ecc142100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.614+0000 7f2ed0fbf700 1 -- 172.21.15.44:0/2532567046 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ecc06bbf0 msgr2=0x7f2ecc142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.614+0000 7f2ed0fbf700 1 --2- 172.21.15.44:0/2532567046 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ecc06bbf0 0x7f2ecc142100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.614+0000 7f2ed0fbf700 1 -- 172.21.15.44:0/2532567046 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ecc06aaf0 msgr2=0x7f2ecc13a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.614+0000 7f2ed0fbf700 1 --2- 172.21.15.44:0/2532567046 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ecc06aaf0 0x7f2ecc13a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.614+0000 7f2ed0fbf700 1 -- 172.21.15.44:0/2532567046 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc009570 con 0x7f2ecc0b3910 2024-09-13T18:27:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.614+0000 7f2ed0fbf700 1 --2- 172.21.15.44:0/2532567046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ecc0b3910 0x7f2ecc1551d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc06b390 tx=0x7f2ebc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.614+0000 7f2ec8ff9700 1 -- 172.21.15.44:0/2532567046 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0038c0 con 0x7f2ecc0b3910 2024-09-13T18:27:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.614+0000 7f2ec8ff9700 1 -- 172.21.15.44:0/2532567046 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ebc01f070 con 0x7f2ecc0b3910 2024-09-13T18:27:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.614+0000 7f2ed17c0700 1 -- 172.21.15.44:0/2532567046 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ecc155e90 con 0x7f2ecc0b3910 2024-09-13T18:27:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.614+0000 7f2ec8ff9700 1 -- 172.21.15.44:0/2532567046 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc003c60 con 0x7f2ecc0b3910 2024-09-13T18:27:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.614+0000 7f2ed17c0700 1 -- 172.21.15.44:0/2532567046 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ecc13a6c0 con 0x7f2ecc0b3910 2024-09-13T18:27:45.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.614+0000 7f2ed17c0700 1 -- 172.21.15.44:0/2532567046 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ecc06afa0 con 0x7f2ecc0b3910 2024-09-13T18:27:45.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.618+0000 7f2ec8ff9700 1 -- 172.21.15.44:0/2532567046 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2ebc026480 con 0x7f2ecc0b3910 2024-09-13T18:27:45.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.618+0000 7f2ec8ff9700 1 --2- 172.21.15.44:0/2532567046 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2eac066730 0x7f2eac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:45.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.618+0000 7f2ec8ff9700 1 -- 172.21.15.44:0/2532567046 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2ebc021070 con 0x7f2ecc0b3910 2024-09-13T18:27:45.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.618+0000 7f2ecbfff700 1 --2- 172.21.15.44:0/2532567046 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2eac066730 0x7f2eac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:45.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.618+0000 7f2ecbfff700 1 --2- 172.21.15.44:0/2532567046 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2eac066730 0x7f2eac068bf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc159a30 tx=0x7f2ec4003a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:45.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.622+0000 7f2ec8ff9700 1 -- 172.21.15.44:0/2532567046 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2ebc053080 con 0x7f2ecc0b3910 2024-09-13T18:27:45.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.798+0000 7f2ed17c0700 1 -- 172.21.15.44:0/2532567046 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ecc154c70 con 0x7f2ecc0b3910 2024-09-13T18:27:45.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.802+0000 7f2ec8ff9700 1 -- 172.21.15.44:0/2532567046 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16695 (secure 0 0 0) 0x7f2ebc0566a0 con 0x7f2ecc0b3910 2024-09-13T18:27:45.807 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:45.807 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":23,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:43.549975+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:45.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.802+0000 7f2ed17c0700 1 -- 172.21.15.44:0/2532567046 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2eac066730 msgr2=0x7f2eac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:45.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.802+0000 7f2ed17c0700 1 --2- 172.21.15.44:0/2532567046 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2eac066730 0x7f2eac068bf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc159a30 tx=0x7f2ec4003a40 comp rx=0 tx=0).stop 2024-09-13T18:27:45.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.802+0000 7f2ed17c0700 1 -- 172.21.15.44:0/2532567046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ecc0b3910 msgr2=0x7f2ecc1551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:45.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.802+0000 7f2ed17c0700 1 --2- 172.21.15.44:0/2532567046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ecc0b3910 0x7f2ecc1551d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc06b390 tx=0x7f2ebc004770 comp rx=0 tx=0).stop 2024-09-13T18:27:45.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.802+0000 7f2ed17c0700 1 -- 172.21.15.44:0/2532567046 shutdown_connections 2024-09-13T18:27:45.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.802+0000 7f2ed17c0700 1 --2- 172.21.15.44:0/2532567046 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2eac066730 0x7f2eac068bf0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.802+0000 7f2ed17c0700 1 --2- 172.21.15.44:0/2532567046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ecc0b3910 0x7f2ecc1551d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.802+0000 7f2ed17c0700 1 --2- 172.21.15.44:0/2532567046 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ecc06bbf0 0x7f2ecc142100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.802+0000 7f2ed17c0700 1 --2- 172.21.15.44:0/2532567046 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ecc06aaf0 0x7f2ecc13a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.802+0000 7f2ed17c0700 1 -- 172.21.15.44:0/2532567046 >> 172.21.15.44:0/2532567046 conn(0x7f2ecc0b0f00 msgr2=0x7f2ecc158a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:45.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.802+0000 7f2ed17c0700 1 -- 172.21.15.44:0/2532567046 shutdown_connections 2024-09-13T18:27:45.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.802+0000 7f2ed17c0700 1 -- 172.21.15.44:0/2532567046 wait complete. 2024-09-13T18:27:45.823 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:26:59.478511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:27:00.261038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:27:45.824 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:27:45.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.934+0000 7f558ded4700 1 Processor -- start 2024-09-13T18:27:45.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.934+0000 7f558ded4700 1 -- start start 2024-09-13T18:27:45.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.934+0000 7f558ded4700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f558815cda0 0x7f558806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:45.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.934+0000 7f558ded4700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55880b8430 con 0x7f558806a520 2024-09-13T18:27:45.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.934+0000 7f558ded4700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55880cf350 con 0x7f55880ceb70 2024-09-13T18:27:45.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.934+0000 7f558ded4700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558806be40 con 0x7f558815cda0 2024-09-13T18:27:45.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.934+0000 7f558d6d3700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f558806a520 0x7f55880d1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45160/0 (socket says 172.21.15.44:45160) 2024-09-13T18:27:45.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.934+0000 7f558d6d3700 1 -- 172.21.15.44:0/3533899486 learned_addr learned my addr 172.21.15.44:0/3533899486 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:45.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.934+0000 7f558ced2700 1 --2- 172.21.15.44:0/3533899486 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f558815cda0 0x7f558806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:45.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.934+0000 7f55877fe700 1 -- 172.21.15.44:0/3533899486 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1282591262 0 0) 0x7f55880b8430 con 0x7f558806a520 2024-09-13T18:27:45.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.934+0000 7f55877fe700 1 -- 172.21.15.44:0/3533899486 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55700035d0 con 0x7f558806a520 2024-09-13T18:27:45.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.934+0000 7f55877fe700 1 -- 172.21.15.44:0/3533899486 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760864454 0 0) 0x7f55880cf350 con 0x7f55880ceb70 2024-09-13T18:27:45.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.934+0000 7f55877fe700 1 -- 172.21.15.44:0/3533899486 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55880b8430 con 0x7f55880ceb70 2024-09-13T18:27:45.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.938+0000 7f558ced2700 1 -- 172.21.15.44:0/3533899486 >> v1:172.21.15.99:6789/0 conn(0x7f55880ceb70 legacy=0x7f55880b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:45.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.938+0000 7f558ced2700 1 -- 172.21.15.44:0/3533899486 >> v1:172.21.15.44:6789/0 conn(0x7f558806a520 legacy=0x7f55880d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:45.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.938+0000 7f55877fe700 1 -- 172.21.15.44:0/3533899486 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2348823915 0 0) 0x7f55700035d0 con 0x7f558806a520 2024-09-13T18:27:45.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.938+0000 7f558ced2700 1 -- 172.21.15.44:0/3533899486 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55880d0880 con 0x7f558815cda0 2024-09-13T18:27:45.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.938+0000 7f558ced2700 1 --2- 172.21.15.44:0/3533899486 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f558815cda0 0x7f558806b900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f557c009880 tx=0x7f557c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39cc12be2295a527 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:45.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.938+0000 7f55877fe700 1 -- 172.21.15.44:0/3533899486 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55800019f0 con 0x7f558815cda0 2024-09-13T18:27:45.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.938+0000 7f55877fe700 1 -- 172.21.15.44:0/3533899486 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557c004030 con 0x7f558815cda0 2024-09-13T18:27:45.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.938+0000 7f55877fe700 1 -- 172.21.15.44:0/3533899486 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c0043c0 con 0x7f558815cda0 2024-09-13T18:27:45.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.938+0000 7f558ded4700 1 -- 172.21.15.44:0/3533899486 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f558815cda0 msgr2=0x7f558806b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:45.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.938+0000 7f558ded4700 1 --2- 172.21.15.44:0/3533899486 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f558815cda0 0x7f558806b900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f557c009880 tx=0x7f557c009b90 comp rx=0 tx=0).stop 2024-09-13T18:27:45.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.938+0000 7f558ded4700 1 -- 172.21.15.44:0/3533899486 shutdown_connections 2024-09-13T18:27:45.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.938+0000 7f558ded4700 1 --2- 172.21.15.44:0/3533899486 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f558815cda0 0x7f558806b900 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.938+0000 7f558ded4700 1 -- 172.21.15.44:0/3533899486 >> 172.21.15.44:0/3533899486 conn(0x7f55880d2cb0 msgr2=0x7f55880d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:45.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.938+0000 7f558ded4700 1 -- 172.21.15.44:0/3533899486 shutdown_connections 2024-09-13T18:27:45.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.938+0000 7f558ded4700 1 -- 172.21.15.44:0/3533899486 wait complete. 2024-09-13T18:27:45.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.938+0000 7f558ded4700 1 Processor -- start 2024-09-13T18:27:45.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.938+0000 7f558ded4700 1 -- start start 2024-09-13T18:27:45.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.942+0000 7f558ded4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f558806a520 0x7f558815fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:45.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.942+0000 7f558ded4700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55880ceb70 0x7f5588150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:45.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.942+0000 7f558ded4700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f558815cda0 0x7f55880cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:45.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.942+0000 7f558ded4700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558815dbe0 con 0x7f558806a520 2024-09-13T18:27:45.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.942+0000 7f558ded4700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55880cb350 con 0x7f55880ceb70 2024-09-13T18:27:45.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.942+0000 7f558ded4700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5588160130 con 0x7f558815cda0 2024-09-13T18:27:45.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.942+0000 7f558ced2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f558806a520 0x7f558815fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:45.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.942+0000 7f558ced2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f558806a520 0x7f558815fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36538/0 (socket says 172.21.15.44:36538) 2024-09-13T18:27:45.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.942+0000 7f558ced2700 1 -- 172.21.15.44:0/1506397557 learned_addr learned my addr 172.21.15.44:0/1506397557 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:45.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.942+0000 7f558d6d3700 1 --2- 172.21.15.44:0/1506397557 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f558815cda0 0x7f55880cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:45.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.942+0000 7f5587fff700 1 --2- 172.21.15.44:0/1506397557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55880ceb70 0x7f5588150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:45.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.942+0000 7f558ced2700 1 -- 172.21.15.44:0/1506397557 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f558815cda0 msgr2=0x7f55880cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:45.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.942+0000 7f558ced2700 1 --2- 172.21.15.44:0/1506397557 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f558815cda0 0x7f55880cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.942+0000 7f558ced2700 1 -- 172.21.15.44:0/1506397557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55880ceb70 msgr2=0x7f5588150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:45.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.942+0000 7f558ced2700 1 --2- 172.21.15.44:0/1506397557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55880ceb70 0x7f5588150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:45.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.942+0000 7f558ced2700 1 -- 172.21.15.44:0/1506397557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c0094b0 con 0x7f558806a520 2024-09-13T18:27:45.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.942+0000 7f558ced2700 1 --2- 172.21.15.44:0/1506397557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f558806a520 0x7f558815fbf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f557c014040 tx=0x7f557c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:45.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.942+0000 7f55857fa700 1 -- 172.21.15.44:0/1506397557 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c003d00 con 0x7f558806a520 2024-09-13T18:27:45.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.942+0000 7f55857fa700 1 -- 172.21.15.44:0/1506397557 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557c003e60 con 0x7f558806a520 2024-09-13T18:27:45.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.942+0000 7f558ded4700 1 -- 172.21.15.44:0/1506397557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f558815dde0 con 0x7f558806a520 2024-09-13T18:27:45.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.942+0000 7f55857fa700 1 -- 172.21.15.44:0/1506397557 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c011870 con 0x7f558806a520 2024-09-13T18:27:45.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.942+0000 7f558ded4700 1 -- 172.21.15.44:0/1506397557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f558815e640 con 0x7f558806a520 2024-09-13T18:27:45.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.942+0000 7f558ded4700 1 -- 172.21.15.44:0/1506397557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55880d0e00 con 0x7f558806a520 2024-09-13T18:27:45.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.946+0000 7f55857fa700 1 -- 172.21.15.44:0/1506397557 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f557c018050 con 0x7f558806a520 2024-09-13T18:27:45.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.946+0000 7f55857fa700 1 --2- 172.21.15.44:0/1506397557 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5574066730 0x7f5574068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:45.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.946+0000 7f55857fa700 1 -- 172.21.15.44:0/1506397557 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f557c0850f0 con 0x7f558806a520 2024-09-13T18:27:45.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.946+0000 7f5587fff700 1 --2- 172.21.15.44:0/1506397557 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5574066730 0x7f5574068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:45.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.946+0000 7f5587fff700 1 --2- 172.21.15.44:0/1506397557 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5574066730 0x7f5574068bf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5578007fd0 tx=0x7f5578009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:45.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:45.954+0000 7f55857fa700 1 -- 172.21.15.44:0/1506397557 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f557c052470 con 0x7f558806a520 2024-09-13T18:27:46.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.126+0000 7f558ded4700 1 -- 172.21.15.44:0/1506397557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f558815e190 con 0x7f558806a520 2024-09-13T18:27:46.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.126+0000 7f55857fa700 1 -- 172.21.15.44:0/1506397557 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f557c02b020 con 0x7f558806a520 2024-09-13T18:27:46.131 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:27:46.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.126+0000 7f558ded4700 1 -- 172.21.15.44:0/1506397557 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5574066730 msgr2=0x7f5574068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.126+0000 7f558ded4700 1 --2- 172.21.15.44:0/1506397557 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5574066730 0x7f5574068bf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5578007fd0 tx=0x7f5578009040 comp rx=0 tx=0).stop 2024-09-13T18:27:46.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.126+0000 7f558ded4700 1 -- 172.21.15.44:0/1506397557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f558806a520 msgr2=0x7f558815fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.126+0000 7f558ded4700 1 --2- 172.21.15.44:0/1506397557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f558806a520 0x7f558815fbf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f557c014040 tx=0x7f557c004770 comp rx=0 tx=0).stop 2024-09-13T18:27:46.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.126+0000 7f558ded4700 1 -- 172.21.15.44:0/1506397557 shutdown_connections 2024-09-13T18:27:46.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.126+0000 7f558ded4700 1 --2- 172.21.15.44:0/1506397557 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5574066730 0x7f5574068bf0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.126+0000 7f558ded4700 1 --2- 172.21.15.44:0/1506397557 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f558815cda0 0x7f55880cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.126+0000 7f558ded4700 1 --2- 172.21.15.44:0/1506397557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55880ceb70 0x7f5588150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.126+0000 7f558ded4700 1 --2- 172.21.15.44:0/1506397557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f558806a520 0x7f558815fbf0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.126+0000 7f558ded4700 1 -- 172.21.15.44:0/1506397557 >> 172.21.15.44:0/1506397557 conn(0x7f55880d2cb0 msgr2=0x7f5588066110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:46.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.126+0000 7f558ded4700 1 -- 172.21.15.44:0/1506397557 shutdown_connections 2024-09-13T18:27:46.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.130+0000 7f558ded4700 1 -- 172.21.15.44:0/1506397557 wait complete. 2024-09-13T18:27:46.146 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:27:46.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.262+0000 7f12762a8700 1 Processor -- start 2024-09-13T18:27:46.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.262+0000 7f12762a8700 1 -- start start 2024-09-13T18:27:46.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.266+0000 7f12762a8700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f12700b3290 0x7f127015abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.266+0000 7f12762a8700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127015b2e0 con 0x7f127015a800 2024-09-13T18:27:46.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.266+0000 7f12762a8700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127015b5c0 con 0x7f127006f8c0 2024-09-13T18:27:46.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.266+0000 7f12762a8700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f127015bf60 con 0x7f12700b3290 2024-09-13T18:27:46.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.266+0000 7f1274aa5700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f12700b3290 0x7f127015abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.266+0000 7f1274aa5700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f12700b3290 0x7f127015abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36548/0 (socket says 172.21.15.44:36548) 2024-09-13T18:27:46.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.266+0000 7f1274aa5700 1 -- 172.21.15.44:0/340042322 learned_addr learned my addr 172.21.15.44:0/340042322 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:46.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.266+0000 7f12752a6700 1 --1- 172.21.15.44:0/340042322 >> v1:172.21.15.44:6789/0 conn(0x7f127015a800 0x7f12700b2b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45176/0 (socket says 172.21.15.44:45176) 2024-09-13T18:27:46.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.266+0000 7f1274aa5700 1 -- 172.21.15.44:0/340042322 >> v1:172.21.15.99:6789/0 conn(0x7f127006f8c0 legacy=0x7f127015c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.266+0000 7f1274aa5700 1 -- 172.21.15.44:0/340042322 >> v1:172.21.15.44:6789/0 conn(0x7f127015a800 legacy=0x7f12700b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.266+0000 7f1274aa5700 1 -- 172.21.15.44:0/340042322 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127015b8a0 con 0x7f12700b3290 2024-09-13T18:27:46.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.266+0000 7f1274aa5700 1 --2- 172.21.15.44:0/340042322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12700b3290 0x7f127015abe0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1260009910 tx=0x7f1260009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4459638b800642d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:46.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.266+0000 7f1267fff700 1 -- 172.21.15.44:0/340042322 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126000ba60 con 0x7f12700b3290 2024-09-13T18:27:46.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.266+0000 7f1267fff700 1 -- 172.21.15.44:0/340042322 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126000bbc0 con 0x7f12700b3290 2024-09-13T18:27:46.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.266+0000 7f1267fff700 1 -- 172.21.15.44:0/340042322 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260009e60 con 0x7f12700b3290 2024-09-13T18:27:46.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.266+0000 7f12762a8700 1 -- 172.21.15.44:0/340042322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12700b3290 msgr2=0x7f127015abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.266+0000 7f12762a8700 1 --2- 172.21.15.44:0/340042322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12700b3290 0x7f127015abe0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1260009910 tx=0x7f1260009c20 comp rx=0 tx=0).stop 2024-09-13T18:27:46.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.266+0000 7f12762a8700 1 -- 172.21.15.44:0/340042322 shutdown_connections 2024-09-13T18:27:46.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.266+0000 7f12762a8700 1 --2- 172.21.15.44:0/340042322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12700b3290 0x7f127015abe0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.266+0000 7f12762a8700 1 -- 172.21.15.44:0/340042322 >> 172.21.15.44:0/340042322 conn(0x7f1270071ce0 msgr2=0x7f12700720c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:46.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.266+0000 7f12762a8700 1 -- 172.21.15.44:0/340042322 shutdown_connections 2024-09-13T18:27:46.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.266+0000 7f12762a8700 1 -- 172.21.15.44:0/340042322 wait complete. 2024-09-13T18:27:46.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.270+0000 7f12762a8700 1 Processor -- start 2024-09-13T18:27:46.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.270+0000 7f12762a8700 1 -- start start 2024-09-13T18:27:46.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.270+0000 7f12762a8700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f127006f8c0 0x7f127014f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.270+0000 7f12762a8700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f12700b3290 0x7f12701474d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.270+0000 7f12762a8700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f127015a800 0x7f12701f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.270+0000 7f12762a8700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12700caf70 con 0x7f127015a800 2024-09-13T18:27:46.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.270+0000 7f12762a8700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127014fe00 con 0x7f127006f8c0 2024-09-13T18:27:46.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.270+0000 7f12762a8700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127006c9c0 con 0x7f12700b3290 2024-09-13T18:27:46.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.270+0000 7f1275aa7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f127015a800 0x7f12701f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.274+0000 7f1275aa7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f127015a800 0x7f12701f29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36558/0 (socket says 172.21.15.44:36558) 2024-09-13T18:27:46.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.274+0000 7f12752a6700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f127006f8c0 0x7f127014f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.274+0000 7f1275aa7700 1 -- 172.21.15.44:0/3642739415 learned_addr learned my addr 172.21.15.44:0/3642739415 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:46.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.274+0000 7f1274aa5700 1 --2- 172.21.15.44:0/3642739415 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f12700b3290 0x7f12701474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.274+0000 7f1275aa7700 1 -- 172.21.15.44:0/3642739415 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f12700b3290 msgr2=0x7f12701474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.274+0000 7f1275aa7700 1 --2- 172.21.15.44:0/3642739415 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f12700b3290 0x7f12701474d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.274+0000 7f1275aa7700 1 -- 172.21.15.44:0/3642739415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f127006f8c0 msgr2=0x7f127014f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.274+0000 7f1275aa7700 1 --2- 172.21.15.44:0/3642739415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f127006f8c0 0x7f127014f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.274+0000 7f1275aa7700 1 -- 172.21.15.44:0/3642739415 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1260009570 con 0x7f127015a800 2024-09-13T18:27:46.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.274+0000 7f1275aa7700 1 --2- 172.21.15.44:0/3642739415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f127015a800 0x7f12701f29d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f126800cbc0 tx=0x7f126800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:46.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.274+0000 7f1265ffb700 1 -- 172.21.15.44:0/3642739415 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268003c20 con 0x7f127015a800 2024-09-13T18:27:46.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.274+0000 7f1265ffb700 1 -- 172.21.15.44:0/3642739415 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1268003d80 con 0x7f127015a800 2024-09-13T18:27:46.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.274+0000 7f12762a8700 1 -- 172.21.15.44:0/3642739415 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1270150050 con 0x7f127015a800 2024-09-13T18:27:46.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.274+0000 7f1265ffb700 1 -- 172.21.15.44:0/3642739415 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126800aa20 con 0x7f127015a800 2024-09-13T18:27:46.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.274+0000 7f12762a8700 1 -- 172.21.15.44:0/3642739415 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1270147a10 con 0x7f127015a800 2024-09-13T18:27:46.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.274+0000 7f12762a8700 1 -- 172.21.15.44:0/3642739415 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12700cb0b0 con 0x7f127015a800 2024-09-13T18:27:46.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.274+0000 7f1265ffb700 1 -- 172.21.15.44:0/3642739415 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f126800ab80 con 0x7f127015a800 2024-09-13T18:27:46.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.274+0000 7f1265ffb700 1 --2- 172.21.15.44:0/3642739415 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1254066730 0x7f1254068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.278+0000 7f1265ffb700 1 -- 172.21.15.44:0/3642739415 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1268084010 con 0x7f127015a800 2024-09-13T18:27:46.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.278+0000 7f12752a6700 1 --2- 172.21.15.44:0/3642739415 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1254066730 0x7f1254068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.278+0000 7f12752a6700 1 --2- 172.21.15.44:0/3642739415 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1254066730 0x7f1254068bf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f126c000f60 tx=0x7f126c007ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:46.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.286+0000 7f1265ffb700 1 -- 172.21.15.44:0/3642739415 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1268051440 con 0x7f127015a800 2024-09-13T18:27:46.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.454+0000 7f12762a8700 1 -- 172.21.15.44:0/3642739415 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f127015abe0 con 0x7f127015a800 2024-09-13T18:27:46.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.454+0000 7f1265ffb700 1 -- 172.21.15.44:0/3642739415 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1268054a60 con 0x7f127015a800 2024-09-13T18:27:46.459 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:27:46.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.454+0000 7f12762a8700 1 -- 172.21.15.44:0/3642739415 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1254066730 msgr2=0x7f1254068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.454+0000 7f12762a8700 1 --2- 172.21.15.44:0/3642739415 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1254066730 0x7f1254068bf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f126c000f60 tx=0x7f126c007ef0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.454+0000 7f12762a8700 1 -- 172.21.15.44:0/3642739415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f127015a800 msgr2=0x7f12701f29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.454+0000 7f12762a8700 1 --2- 172.21.15.44:0/3642739415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f127015a800 0x7f12701f29d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f126800cbc0 tx=0x7f126800ced0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.454+0000 7f12762a8700 1 -- 172.21.15.44:0/3642739415 shutdown_connections 2024-09-13T18:27:46.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.454+0000 7f12762a8700 1 --2- 172.21.15.44:0/3642739415 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1254066730 0x7f1254068bf0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.454+0000 7f12762a8700 1 --2- 172.21.15.44:0/3642739415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f127015a800 0x7f12701f29d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.454+0000 7f12762a8700 1 --2- 172.21.15.44:0/3642739415 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f12700b3290 0x7f12701474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.454+0000 7f12762a8700 1 --2- 172.21.15.44:0/3642739415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f127006f8c0 0x7f127014f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.454+0000 7f12762a8700 1 -- 172.21.15.44:0/3642739415 >> 172.21.15.44:0/3642739415 conn(0x7f1270071ce0 msgr2=0x7f127015d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:46.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.454+0000 7f12762a8700 1 -- 172.21.15.44:0/3642739415 shutdown_connections 2024-09-13T18:27:46.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.454+0000 7f12762a8700 1 -- 172.21.15.44:0/3642739415 wait complete. 2024-09-13T18:27:46.474 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:27:46.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eaf448700 1 Processor -- start 2024-09-13T18:27:46.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eaf448700 1 -- start start 2024-09-13T18:27:46.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eaf448700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9ea815cda0 0x7f9ea806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eaf448700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9ea806a520 0x7f9ea806a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eaf448700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea80b8430 con 0x7f9ea80ceb70 2024-09-13T18:27:46.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eaf448700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea806be40 con 0x7f9ea806a520 2024-09-13T18:27:46.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eaf448700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea80b64f0 con 0x7f9ea815cda0 2024-09-13T18:27:46.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eaec47700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9ea806a520 0x7f9ea806a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eaec47700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9ea806a520 0x7f9ea806a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36562/0 (socket says 172.21.15.44:36562) 2024-09-13T18:27:46.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eaec47700 1 -- 172.21.15.44:0/100445387 learned_addr learned my addr 172.21.15.44:0/100445387 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:46.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eae446700 1 --2- 172.21.15.44:0/100445387 >> v2:172.21.15.99:3300/0 conn(0x7f9ea815cda0 0x7f9ea806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eaec47700 1 -- 172.21.15.44:0/100445387 >> v2:172.21.15.99:3300/0 conn(0x7f9ea815cda0 msgr2=0x7f9ea806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:46.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eaec47700 1 --2- 172.21.15.44:0/100445387 >> v2:172.21.15.99:3300/0 conn(0x7f9ea815cda0 0x7f9ea806b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eaec47700 1 -- 172.21.15.44:0/100445387 >> v1:172.21.15.99:6789/0 conn(0x7f9ea80ceb70 legacy=0x7f9ea80b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eaec47700 1 -- 172.21.15.44:0/100445387 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea806ae70 con 0x7f9ea806a520 2024-09-13T18:27:46.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eaec47700 1 --2- 172.21.15.44:0/100445387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea806a520 0x7f9ea806a930 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80d0800 tx=0x7f9ea000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1953014acc2062 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:46.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9ead444700 1 -- 172.21.15.44:0/100445387 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea000e070 con 0x7f9ea806a520 2024-09-13T18:27:46.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9ead444700 1 -- 172.21.15.44:0/100445387 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea000b9c0 con 0x7f9ea806a520 2024-09-13T18:27:46.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9ead444700 1 -- 172.21.15.44:0/100445387 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea000bd70 con 0x7f9ea806a520 2024-09-13T18:27:46.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eaf448700 1 -- 172.21.15.44:0/100445387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea806a520 msgr2=0x7f9ea806a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eaf448700 1 --2- 172.21.15.44:0/100445387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea806a520 0x7f9ea806a930 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80d0800 tx=0x7f9ea000b330 comp rx=0 tx=0).stop 2024-09-13T18:27:46.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eaf448700 1 -- 172.21.15.44:0/100445387 shutdown_connections 2024-09-13T18:27:46.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eaf448700 1 --2- 172.21.15.44:0/100445387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea806a520 0x7f9ea806a930 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eaf448700 1 --2- 172.21.15.44:0/100445387 >> v2:172.21.15.99:3300/0 conn(0x7f9ea815cda0 0x7f9ea806b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eaf448700 1 -- 172.21.15.44:0/100445387 >> 172.21.15.44:0/100445387 conn(0x7f9ea80d2cb0 msgr2=0x7f9ea80d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:46.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eaf448700 1 -- 172.21.15.44:0/100445387 shutdown_connections 2024-09-13T18:27:46.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.590+0000 7f9eaf448700 1 -- 172.21.15.44:0/100445387 wait complete. 2024-09-13T18:27:46.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9eaf448700 1 Processor -- start 2024-09-13T18:27:46.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9eaf448700 1 -- start start 2024-09-13T18:27:46.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9eaf448700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea806a520 0x7f9ea80d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9eaf448700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ea80ceb70 0x7f9ea8154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9eaf448700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ea815cda0 0x7f9ea8154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9eaf448700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea80c6850 con 0x7f9ea806a520 2024-09-13T18:27:46.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9eaf448700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea80c6b30 con 0x7f9ea80ceb70 2024-09-13T18:27:46.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9eaf448700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea80c6e10 con 0x7f9ea815cda0 2024-09-13T18:27:46.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9eae446700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea806a520 0x7f9ea80d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9eae446700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea806a520 0x7f9ea80d17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36572/0 (socket says 172.21.15.44:36572) 2024-09-13T18:27:46.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9eae446700 1 -- 172.21.15.44:0/1458034090 learned_addr learned my addr 172.21.15.44:0/1458034090 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:46.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9eaec47700 1 --2- 172.21.15.44:0/1458034090 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ea815cda0 0x7f9ea8154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9eadc45700 1 --2- 172.21.15.44:0/1458034090 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ea80ceb70 0x7f9ea8154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9eae446700 1 -- 172.21.15.44:0/1458034090 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ea815cda0 msgr2=0x7f9ea8154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9eae446700 1 --2- 172.21.15.44:0/1458034090 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ea815cda0 0x7f9ea8154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9eae446700 1 -- 172.21.15.44:0/1458034090 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ea80ceb70 msgr2=0x7f9ea8154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9eae446700 1 --2- 172.21.15.44:0/1458034090 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ea80ceb70 0x7f9ea8154900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9eae446700 1 -- 172.21.15.44:0/1458034090 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea0009b30 con 0x7f9ea806a520 2024-09-13T18:27:46.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9eadc45700 1 --2- 172.21.15.44:0/1458034090 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ea80ceb70 0x7f9ea8154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:46.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9eae446700 1 --2- 172.21.15.44:0/1458034090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea806a520 0x7f9ea80d17b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400d800 tx=0x7f9ea400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:46.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9e9effd700 1 -- 172.21.15.44:0/1458034090 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea40125f0 con 0x7f9ea806a520 2024-09-13T18:27:46.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9eaf448700 1 -- 172.21.15.44:0/1458034090 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea80c70f0 con 0x7f9ea806a520 2024-09-13T18:27:46.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9e9effd700 1 -- 172.21.15.44:0/1458034090 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea4012750 con 0x7f9ea806a520 2024-09-13T18:27:46.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9e9effd700 1 -- 172.21.15.44:0/1458034090 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4012ac0 con 0x7f9ea806a520 2024-09-13T18:27:46.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.594+0000 7f9eaf448700 1 -- 172.21.15.44:0/1458034090 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea80d1cf0 con 0x7f9ea806a520 2024-09-13T18:27:46.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.598+0000 7f9eaf448700 1 -- 172.21.15.44:0/1458034090 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea80d1120 con 0x7f9ea806a520 2024-09-13T18:27:46.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.598+0000 7f9e9effd700 1 -- 172.21.15.44:0/1458034090 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9ea4012c20 con 0x7f9ea806a520 2024-09-13T18:27:46.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.598+0000 7f9e9effd700 1 --2- 172.21.15.44:0/1458034090 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9e8c066730 0x7f9e8c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.598+0000 7f9e9effd700 1 -- 172.21.15.44:0/1458034090 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9ea4084430 con 0x7f9ea806a520 2024-09-13T18:27:46.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.598+0000 7f9eadc45700 1 --2- 172.21.15.44:0/1458034090 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9e8c066730 0x7f9e8c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.602+0000 7f9eadc45700 1 --2- 172.21.15.44:0/1458034090 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9e8c066730 0x7f9e8c068bf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80c84e0 tx=0x7f9e98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:46.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.610+0000 7f9e9effd700 1 -- 172.21.15.44:0/1458034090 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9ea4051600 con 0x7f9ea806a520 2024-09-13T18:27:46.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.778+0000 7f9eaf448700 1 -- 172.21.15.44:0/1458034090 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9ea806b840 con 0x7f9ea806a520 2024-09-13T18:27:46.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.782+0000 7f9e9effd700 1 -- 172.21.15.44:0/1458034090 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9ea4054c20 con 0x7f9ea806a520 2024-09-13T18:27:46.787 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:27:46.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.782+0000 7f9eaf448700 1 -- 172.21.15.44:0/1458034090 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9e8c066730 msgr2=0x7f9e8c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.782+0000 7f9eaf448700 1 --2- 172.21.15.44:0/1458034090 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9e8c066730 0x7f9e8c068bf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80c84e0 tx=0x7f9e98009040 comp rx=0 tx=0).stop 2024-09-13T18:27:46.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.782+0000 7f9eaf448700 1 -- 172.21.15.44:0/1458034090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea806a520 msgr2=0x7f9ea80d17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.782+0000 7f9eaf448700 1 --2- 172.21.15.44:0/1458034090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea806a520 0x7f9ea80d17b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400d800 tx=0x7f9ea400db10 comp rx=0 tx=0).stop 2024-09-13T18:27:46.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.782+0000 7f9eaf448700 1 -- 172.21.15.44:0/1458034090 shutdown_connections 2024-09-13T18:27:46.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.782+0000 7f9eaf448700 1 --2- 172.21.15.44:0/1458034090 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9e8c066730 0x7f9e8c068bf0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.782+0000 7f9eaf448700 1 --2- 172.21.15.44:0/1458034090 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ea815cda0 0x7f9ea8154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.782+0000 7f9eaf448700 1 --2- 172.21.15.44:0/1458034090 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ea80ceb70 0x7f9ea8154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.782+0000 7f9eaf448700 1 --2- 172.21.15.44:0/1458034090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea806a520 0x7f9ea80d17b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.782+0000 7f9eaf448700 1 -- 172.21.15.44:0/1458034090 >> 172.21.15.44:0/1458034090 conn(0x7f9ea80d2cb0 msgr2=0x7f9ea80d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:46.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.782+0000 7f9eaf448700 1 -- 172.21.15.44:0/1458034090 shutdown_connections 2024-09-13T18:27:46.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.782+0000 7f9eaf448700 1 -- 172.21.15.44:0/1458034090 wait complete. 2024-09-13T18:27:46.802 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:27:46.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.906+0000 7f496759e700 1 Processor -- start 2024-09-13T18:27:46.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.906+0000 7f496759e700 1 -- start start 2024-09-13T18:27:46.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.906+0000 7f496759e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f496815cda0 0x7f496806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.906+0000 7f496759e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f49680ceb70 0x7f49680b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.906+0000 7f496759e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f496806a520 0x7f496806a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.906+0000 7f496759e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496806be40 con 0x7f49680ceb70 2024-09-13T18:27:46.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.906+0000 7f496759e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49680b8430 con 0x7f496815cda0 2024-09-13T18:27:46.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.906+0000 7f496759e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496806ae90 con 0x7f496806a520 2024-09-13T18:27:46.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.906+0000 7f4965d9b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f49680ceb70 0x7f49680b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.906+0000 7f4965d9b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f49680ceb70 0x7f49680b5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36582/0 (socket says 172.21.15.44:36582) 2024-09-13T18:27:46.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.906+0000 7f4965d9b700 1 -- 172.21.15.44:0/1109003468 learned_addr learned my addr 172.21.15.44:0/1109003468 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:46.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.910+0000 7f496659c700 1 --2- 172.21.15.44:0/1109003468 >> v2:172.21.15.99:3300/0 conn(0x7f496815cda0 0x7f496806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.910+0000 7f4966d9d700 1 --2- 172.21.15.44:0/1109003468 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f496806a520 0x7f496806a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.910+0000 7f4965d9b700 1 -- 172.21.15.44:0/1109003468 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f496806a520 msgr2=0x7f496806a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:46.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.910+0000 7f4965d9b700 1 --2- 172.21.15.44:0/1109003468 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f496806a520 0x7f496806a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.910+0000 7f4965d9b700 1 -- 172.21.15.44:0/1109003468 >> v2:172.21.15.99:3300/0 conn(0x7f496815cda0 msgr2=0x7f496806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:46.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.910+0000 7f4965d9b700 1 --2- 172.21.15.44:0/1109003468 >> v2:172.21.15.99:3300/0 conn(0x7f496815cda0 0x7f496806b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.910+0000 7f4965d9b700 1 -- 172.21.15.44:0/1109003468 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49680cf350 con 0x7f49680ceb70 2024-09-13T18:27:46.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.910+0000 7f4965d9b700 1 --2- 172.21.15.44:0/1109003468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49680ceb70 0x7f49680b5de0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f49680d0800 tx=0x7f495800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3109a2841b314ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:46.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.910+0000 7f496559a700 1 -- 172.21.15.44:0/1109003468 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495800e070 con 0x7f49680ceb70 2024-09-13T18:27:46.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.910+0000 7f496559a700 1 -- 172.21.15.44:0/1109003468 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495800b9c0 con 0x7f49680ceb70 2024-09-13T18:27:46.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.910+0000 7f496559a700 1 -- 172.21.15.44:0/1109003468 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495800bd70 con 0x7f49680ceb70 2024-09-13T18:27:46.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.910+0000 7f496759e700 1 -- 172.21.15.44:0/1109003468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49680ceb70 msgr2=0x7f49680b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.910+0000 7f496759e700 1 --2- 172.21.15.44:0/1109003468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49680ceb70 0x7f49680b5de0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f49680d0800 tx=0x7f495800b330 comp rx=0 tx=0).stop 2024-09-13T18:27:46.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.910+0000 7f496759e700 1 -- 172.21.15.44:0/1109003468 shutdown_connections 2024-09-13T18:27:46.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.910+0000 7f496759e700 1 --2- 172.21.15.44:0/1109003468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49680ceb70 0x7f49680b5de0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.910+0000 7f496759e700 1 --2- 172.21.15.44:0/1109003468 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f496806a520 0x7f496806a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.910+0000 7f496759e700 1 --2- 172.21.15.44:0/1109003468 >> v2:172.21.15.99:3300/0 conn(0x7f496815cda0 0x7f496806b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.910+0000 7f496759e700 1 -- 172.21.15.44:0/1109003468 >> 172.21.15.44:0/1109003468 conn(0x7f49680d2cb0 msgr2=0x7f49680d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:46.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.910+0000 7f496759e700 1 -- 172.21.15.44:0/1109003468 shutdown_connections 2024-09-13T18:27:46.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.910+0000 7f496759e700 1 -- 172.21.15.44:0/1109003468 wait complete. 2024-09-13T18:27:46.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.910+0000 7f496759e700 1 Processor -- start 2024-09-13T18:27:46.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.910+0000 7f496759e700 1 -- start start 2024-09-13T18:27:46.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.914+0000 7f496759e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f496806a520 0x7f49681f63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.914+0000 7f496759e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49680ceb70 0x7f49680c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.914+0000 7f496759e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f496815cda0 0x7f49680c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.914+0000 7f496759e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49680c96a0 con 0x7f496806a520 2024-09-13T18:27:46.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.914+0000 7f496759e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49680c9970 con 0x7f49680ceb70 2024-09-13T18:27:46.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.914+0000 7f496759e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496815e9b0 con 0x7f496815cda0 2024-09-13T18:27:46.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.914+0000 7f496659c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f496806a520 0x7f49681f63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.914+0000 7f496659c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f496806a520 0x7f49681f63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36590/0 (socket says 172.21.15.44:36590) 2024-09-13T18:27:46.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.914+0000 7f496659c700 1 -- 172.21.15.44:0/948953008 learned_addr learned my addr 172.21.15.44:0/948953008 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:46.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.914+0000 7f4965d9b700 1 --2- 172.21.15.44:0/948953008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49680ceb70 0x7f49680c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.914+0000 7f4966d9d700 1 --2- 172.21.15.44:0/948953008 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f496815cda0 0x7f49680c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.914+0000 7f496659c700 1 -- 172.21.15.44:0/948953008 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f496815cda0 msgr2=0x7f49680c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.914+0000 7f496659c700 1 --2- 172.21.15.44:0/948953008 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f496815cda0 0x7f49680c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.914+0000 7f496659c700 1 -- 172.21.15.44:0/948953008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49680ceb70 msgr2=0x7f49680c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.914+0000 7f496659c700 1 --2- 172.21.15.44:0/948953008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49680ceb70 0x7f49680c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.914+0000 7f496659c700 1 -- 172.21.15.44:0/948953008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4958009b30 con 0x7f496806a520 2024-09-13T18:27:46.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.914+0000 7f496659c700 1 --2- 172.21.15.44:0/948953008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f496806a520 0x7f49681f63c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f495000d800 tx=0x7f495000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:46.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.914+0000 7f495effd700 1 -- 172.21.15.44:0/948953008 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49500125f0 con 0x7f496806a520 2024-09-13T18:27:46.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.914+0000 7f496759e700 1 -- 172.21.15.44:0/948953008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f496815ec90 con 0x7f496806a520 2024-09-13T18:27:46.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.914+0000 7f495effd700 1 -- 172.21.15.44:0/948953008 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4950012750 con 0x7f496806a520 2024-09-13T18:27:46.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.914+0000 7f496759e700 1 -- 172.21.15.44:0/948953008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496815f250 con 0x7f496806a520 2024-09-13T18:27:46.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.914+0000 7f495effd700 1 -- 172.21.15.44:0/948953008 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4950012b00 con 0x7f496806a520 2024-09-13T18:27:46.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.914+0000 7f496759e700 1 -- 172.21.15.44:0/948953008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49680cf000 con 0x7f496806a520 2024-09-13T18:27:46.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.918+0000 7f495effd700 1 -- 172.21.15.44:0/948953008 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4950012c60 con 0x7f496806a520 2024-09-13T18:27:46.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.918+0000 7f495effd700 1 --2- 172.21.15.44:0/948953008 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4948066730 0x7f4948068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.918+0000 7f495effd700 1 -- 172.21.15.44:0/948953008 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4950084600 con 0x7f496806a520 2024-09-13T18:27:46.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.918+0000 7f4965d9b700 1 --2- 172.21.15.44:0/948953008 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4948066730 0x7f4948068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.918+0000 7f4965d9b700 1 --2- 172.21.15.44:0/948953008 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4948066730 0x7f4948068bf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f495800b370 tx=0x7f4958009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:46.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:46.926+0000 7f495effd700 1 -- 172.21.15.44:0/948953008 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f49500517d0 con 0x7f496806a520 2024-09-13T18:27:47.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.110+0000 7f496759e700 1 -- 172.21.15.44:0/948953008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f49680c6dd0 con 0x7f496806a520 2024-09-13T18:27:47.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.114+0000 7f495effd700 1 -- 172.21.15.44:0/948953008 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4950054df0 con 0x7f496806a520 2024-09-13T18:27:47.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.114+0000 7f496759e700 1 -- 172.21.15.44:0/948953008 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4948066730 msgr2=0x7f4948068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:47.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.114+0000 7f496759e700 1 --2- 172.21.15.44:0/948953008 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4948066730 0x7f4948068bf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f495800b370 tx=0x7f4958009000 comp rx=0 tx=0).stop 2024-09-13T18:27:47.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.114+0000 7f496759e700 1 -- 172.21.15.44:0/948953008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f496806a520 msgr2=0x7f49681f63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:47.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.114+0000 7f496759e700 1 --2- 172.21.15.44:0/948953008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f496806a520 0x7f49681f63c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f495000d800 tx=0x7f495000db10 comp rx=0 tx=0).stop 2024-09-13T18:27:47.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.114+0000 7f496759e700 1 -- 172.21.15.44:0/948953008 shutdown_connections 2024-09-13T18:27:47.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.114+0000 7f496759e700 1 --2- 172.21.15.44:0/948953008 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4948066730 0x7f4948068bf0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.114+0000 7f496759e700 1 --2- 172.21.15.44:0/948953008 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f496815cda0 0x7f49680c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.114+0000 7f496759e700 1 --2- 172.21.15.44:0/948953008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49680ceb70 0x7f49680c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.114+0000 7f496759e700 1 --2- 172.21.15.44:0/948953008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f496806a520 0x7f49681f63c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.114+0000 7f496759e700 1 -- 172.21.15.44:0/948953008 >> 172.21.15.44:0/948953008 conn(0x7f49680d2cb0 msgr2=0x7f49680b2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:47.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.114+0000 7f496759e700 1 -- 172.21.15.44:0/948953008 shutdown_connections 2024-09-13T18:27:47.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.114+0000 7f496759e700 1 -- 172.21.15.44:0/948953008 wait complete. 2024-09-13T18:27:47.122 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-13T18:27:47.133 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2024-09-13T18:27:47.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:47.133 DEBUG:teuthology.orchestra.run.smithi044:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-09-13T18:27:47.146 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:27:47.147 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:27:47.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:47.147 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T18:27:47.153 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:27:47.153 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:27:47.161 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:27:47.162 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:27:47.210 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:47.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.326+0000 7fc4114f8700 1 Processor -- start 2024-09-13T18:27:47.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.326+0000 7fc4114f8700 1 -- start start 2024-09-13T18:27:47.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.326+0000 7fc4114f8700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc40c15cae0 0x7fc40c0cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:47.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.326+0000 7fc4114f8700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc40c06b310 0x7fc40c0d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:47.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.326+0000 7fc4114f8700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc40c0d21e0 con 0x7fc40c15cec0 2024-09-13T18:27:47.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.326+0000 7fc4114f8700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40c0d1750 con 0x7fc40c15cae0 2024-09-13T18:27:47.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.326+0000 7fc4114f8700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40c0d1940 con 0x7fc40c06b310 2024-09-13T18:27:47.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.326+0000 7fc40bfff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc40c15cae0 0x7fc40c0cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:47.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.326+0000 7fc40bfff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc40c15cae0 0x7fc40c0cf030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36606/0 (socket says 172.21.15.44:36606) 2024-09-13T18:27:47.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.326+0000 7fc40bfff700 1 -- 172.21.15.44:0/2761366563 learned_addr learned my addr 172.21.15.44:0/2761366563 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:47.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.326+0000 7fc410cf7700 1 --2- 172.21.15.44:0/2761366563 >> v2:172.21.15.99:3300/0 conn(0x7fc40c06b310 0x7fc40c0d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:47.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.330+0000 7fc40bfff700 1 -- 172.21.15.44:0/2761366563 >> v2:172.21.15.99:3300/0 conn(0x7fc40c06b310 msgr2=0x7fc40c0d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:47.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.330+0000 7fc40bfff700 1 --2- 172.21.15.44:0/2761366563 >> v2:172.21.15.99:3300/0 conn(0x7fc40c06b310 0x7fc40c0d1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.330+0000 7fc40bfff700 1 -- 172.21.15.44:0/2761366563 >> v1:172.21.15.99:6789/0 conn(0x7fc40c15cec0 legacy=0x7fc40c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:47.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.330+0000 7fc40bfff700 1 -- 172.21.15.44:0/2761366563 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40c0d1c20 con 0x7fc40c15cae0 2024-09-13T18:27:47.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.330+0000 7fc410cf7700 1 --2- 172.21.15.44:0/2761366563 >> v2:172.21.15.99:3300/0 conn(0x7fc40c06b310 0x7fc40c0d1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:47.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.330+0000 7fc40bfff700 1 --2- 172.21.15.44:0/2761366563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc40c15cae0 0x7fc40c0cf030 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009910 tx=0x7fc3fc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff3ffe6587bb107 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:47.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.330+0000 7fc40affd700 1 -- 172.21.15.44:0/2761366563 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc00ba20 con 0x7fc40c15cae0 2024-09-13T18:27:47.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.330+0000 7fc40affd700 1 -- 172.21.15.44:0/2761366563 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc00bb80 con 0x7fc40c15cae0 2024-09-13T18:27:47.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.330+0000 7fc40affd700 1 -- 172.21.15.44:0/2761366563 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc009e60 con 0x7fc40c15cae0 2024-09-13T18:27:47.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.330+0000 7fc4114f8700 1 -- 172.21.15.44:0/2761366563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc40c15cae0 msgr2=0x7fc40c0cf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:47.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.330+0000 7fc4114f8700 1 --2- 172.21.15.44:0/2761366563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc40c15cae0 0x7fc40c0cf030 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009910 tx=0x7fc3fc009c20 comp rx=0 tx=0).stop 2024-09-13T18:27:47.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.330+0000 7fc4114f8700 1 -- 172.21.15.44:0/2761366563 shutdown_connections 2024-09-13T18:27:47.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.330+0000 7fc4114f8700 1 --2- 172.21.15.44:0/2761366563 >> v2:172.21.15.99:3300/0 conn(0x7fc40c06b310 0x7fc40c0d1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.330+0000 7fc4114f8700 1 --2- 172.21.15.44:0/2761366563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc40c15cae0 0x7fc40c0cf030 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.330+0000 7fc4114f8700 1 -- 172.21.15.44:0/2761366563 >> 172.21.15.44:0/2761366563 conn(0x7fc40c0d2c80 msgr2=0x7fc40c0d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:47.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.330+0000 7fc4114f8700 1 -- 172.21.15.44:0/2761366563 shutdown_connections 2024-09-13T18:27:47.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.330+0000 7fc4114f8700 1 -- 172.21.15.44:0/2761366563 wait complete. 2024-09-13T18:27:47.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc4114f8700 1 Processor -- start 2024-09-13T18:27:47.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc4114f8700 1 -- start start 2024-09-13T18:27:47.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc4114f8700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc40c06b310 0x7fc40c0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:47.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc4114f8700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc40c15cae0 0x7fc40c0b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:47.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc4114f8700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc40c15cec0 0x7fc40c0b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:47.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc4114f8700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c1f5a90 con 0x7fc40c15cec0 2024-09-13T18:27:47.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc4114f8700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c1f29a0 con 0x7fc40c06b310 2024-09-13T18:27:47.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc4114f8700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c1f2c80 con 0x7fc40c15cae0 2024-09-13T18:27:47.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc410cf7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc40c15cec0 0x7fc40c0b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:47.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc40bfff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc40c06b310 0x7fc40c0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:47.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc40b7fe700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc40c15cae0 0x7fc40c0b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:47.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc40b7fe700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc40c15cae0 0x7fc40c0b3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:53078/0 (socket says 172.21.15.44:53078) 2024-09-13T18:27:47.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc410cf7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc40c15cec0 0x7fc40c0b3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36622/0 (socket says 172.21.15.44:36622) 2024-09-13T18:27:47.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc40b7fe700 1 -- 172.21.15.44:0/574216850 learned_addr learned my addr 172.21.15.44:0/574216850 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:47.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc40bfff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc40c06b310 0x7fc40c0cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:54486/0 (socket says 172.21.15.44:54486) 2024-09-13T18:27:47.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc40b7fe700 1 -- 172.21.15.44:0/574216850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc40c06b310 msgr2=0x7fc40c0cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:47.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc40b7fe700 1 --2- 172.21.15.44:0/574216850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc40c06b310 0x7fc40c0cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc40b7fe700 1 -- 172.21.15.44:0/574216850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc40c15cec0 msgr2=0x7fc40c0b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:47.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc40b7fe700 1 --2- 172.21.15.44:0/574216850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc40c15cec0 0x7fc40c0b3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc40b7fe700 1 -- 172.21.15.44:0/574216850 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc009570 con 0x7fc40c15cae0 2024-09-13T18:27:47.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc410cf7700 1 --2- 172.21.15.44:0/574216850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc40c15cec0 0x7fc40c0b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:47.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc40b7fe700 1 --2- 172.21.15.44:0/574216850 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc40c15cae0 0x7fc40c0b3510 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400c500 tx=0x7fc3f400c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:47.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc408ff9700 1 -- 172.21.15.44:0/574216850 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f40052d0 con 0x7fc40c15cae0 2024-09-13T18:27:47.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc408ff9700 1 -- 172.21.15.44:0/574216850 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f4005430 con 0x7fc40c15cae0 2024-09-13T18:27:47.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc4114f8700 1 -- 172.21.15.44:0/574216850 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40c1f2f60 con 0x7fc40c15cae0 2024-09-13T18:27:47.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc408ff9700 1 -- 172.21.15.44:0/574216850 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f40055a0 con 0x7fc40c15cae0 2024-09-13T18:27:47.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.334+0000 7fc4114f8700 1 -- 172.21.15.44:0/574216850 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40c0cc3b0 con 0x7fc40c15cae0 2024-09-13T18:27:47.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.338+0000 7fc4114f8700 1 -- 172.21.15.44:0/574216850 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc40c0cc5d0 con 0x7fc40c15cae0 2024-09-13T18:27:47.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.338+0000 7fc408ff9700 1 -- 172.21.15.44:0/574216850 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc3f40036a0 con 0x7fc40c15cae0 2024-09-13T18:27:47.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.338+0000 7fc408ff9700 1 --2- 172.21.15.44:0/574216850 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc3ec066730 0x7fc3ec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:47.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.338+0000 7fc408ff9700 1 -- 172.21.15.44:0/574216850 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc3f4083420 con 0x7fc40c15cae0 2024-09-13T18:27:47.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.338+0000 7fc40bfff700 1 --2- 172.21.15.44:0/574216850 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc3ec066730 0x7fc3ec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:47.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.342+0000 7fc40bfff700 1 --2- 172.21.15.44:0/574216850 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc3ec066730 0x7fc3ec068bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc000c00 tx=0x7fc3fc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:47.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.346+0000 7fc408ff9700 1 -- 172.21.15.44:0/574216850 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc40c0cc5d0 con 0x7fc40c15cae0 2024-09-13T18:27:47.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.526+0000 7fc4114f8700 1 -- 172.21.15.44:0/574216850 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc40c0cc5d0 con 0x7fc40c15cae0 2024-09-13T18:27:47.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.530+0000 7fc408ff9700 1 -- 172.21.15.44:0/574216850 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16695 (secure 0 0 0) 0x7fc40c0cc5d0 con 0x7fc40c15cae0 2024-09-13T18:27:47.535 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:47.535 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":23,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:43.549975+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:47.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.530+0000 7fc4114f8700 1 -- 172.21.15.44:0/574216850 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc3ec066730 msgr2=0x7fc3ec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:47.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.530+0000 7fc4114f8700 1 --2- 172.21.15.44:0/574216850 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc3ec066730 0x7fc3ec068bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc000c00 tx=0x7fc3fc008030 comp rx=0 tx=0).stop 2024-09-13T18:27:47.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.530+0000 7fc4114f8700 1 -- 172.21.15.44:0/574216850 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc40c15cae0 msgr2=0x7fc40c0b3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:47.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.530+0000 7fc4114f8700 1 --2- 172.21.15.44:0/574216850 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc40c15cae0 0x7fc40c0b3510 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400c500 tx=0x7fc3f400c810 comp rx=0 tx=0).stop 2024-09-13T18:27:47.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.530+0000 7fc4114f8700 1 -- 172.21.15.44:0/574216850 shutdown_connections 2024-09-13T18:27:47.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.530+0000 7fc4114f8700 1 --2- 172.21.15.44:0/574216850 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc3ec066730 0x7fc3ec068bf0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.530+0000 7fc4114f8700 1 --2- 172.21.15.44:0/574216850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc40c15cec0 0x7fc40c0b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.530+0000 7fc4114f8700 1 --2- 172.21.15.44:0/574216850 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc40c15cae0 0x7fc40c0b3510 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.530+0000 7fc4114f8700 1 --2- 172.21.15.44:0/574216850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc40c06b310 0x7fc40c0cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.530+0000 7fc4114f8700 1 -- 172.21.15.44:0/574216850 >> 172.21.15.44:0/574216850 conn(0x7fc40c0d2c80 msgr2=0x7fc40c0b6830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:47.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.530+0000 7fc4114f8700 1 -- 172.21.15.44:0/574216850 shutdown_connections 2024-09-13T18:27:47.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.534+0000 7fc4114f8700 1 -- 172.21.15.44:0/574216850 wait complete. 2024-09-13T18:27:47.551 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:26:59.478511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:27:00.261038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:27:47.551 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:27:47.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.666+0000 7f9bf359e700 1 Processor -- start 2024-09-13T18:27:47.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.666+0000 7f9bf359e700 1 -- start start 2024-09-13T18:27:47.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.666+0000 7f9bf359e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9bf415cda0 0x7f9bf406b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:47.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.666+0000 7f9bf359e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf40b8430 con 0x7f9bf40ceb70 2024-09-13T18:27:47.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.666+0000 7f9bf359e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf40cf350 con 0x7f9bf406a520 2024-09-13T18:27:47.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.666+0000 7f9bf359e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf406be40 con 0x7f9bf415cda0 2024-09-13T18:27:47.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.666+0000 7f9bf259c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9bf415cda0 0x7f9bf406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:47.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.666+0000 7f9bf1d9b700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9bf40ceb70 0x7f9bf40b5de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45192/0 (socket says 172.21.15.44:45192) 2024-09-13T18:27:47.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.666+0000 7f9bf1d9b700 1 -- 172.21.15.44:0/1419289529 learned_addr learned my addr 172.21.15.44:0/1419289529 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:47.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.670+0000 7f9bf259c700 1 -- 172.21.15.44:0/1419289529 >> v1:172.21.15.99:6789/0 conn(0x7f9bf406a520 legacy=0x7f9bf406a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:47.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.670+0000 7f9bf259c700 1 -- 172.21.15.44:0/1419289529 >> v1:172.21.15.44:6789/0 conn(0x7f9bf40ceb70 legacy=0x7f9bf40b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:47.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.670+0000 7f9bf159a700 1 -- 172.21.15.44:0/1419289529 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782350633 0 0) 0x7f9bf40cf350 con 0x7f9bf406a520 2024-09-13T18:27:47.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.670+0000 7f9bf259c700 1 -- 172.21.15.44:0/1419289529 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf40d0880 con 0x7f9bf415cda0 2024-09-13T18:27:47.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.670+0000 7f9bf259c700 1 --2- 172.21.15.44:0/1419289529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bf415cda0 0x7f9bf406b900 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009d90 tx=0x7f9be400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2dbf2168078e6c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:47.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.670+0000 7f9bf159a700 1 -- 172.21.15.44:0/1419289529 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be400e070 con 0x7f9bf415cda0 2024-09-13T18:27:47.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.670+0000 7f9bf159a700 1 -- 172.21.15.44:0/1419289529 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be400bad0 con 0x7f9bf415cda0 2024-09-13T18:27:47.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.670+0000 7f9bf159a700 1 -- 172.21.15.44:0/1419289529 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be400be80 con 0x7f9bf415cda0 2024-09-13T18:27:47.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.670+0000 7f9bf359e700 1 -- 172.21.15.44:0/1419289529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bf415cda0 msgr2=0x7f9bf406b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:47.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.670+0000 7f9bf359e700 1 --2- 172.21.15.44:0/1419289529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bf415cda0 0x7f9bf406b900 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009d90 tx=0x7f9be400b330 comp rx=0 tx=0).stop 2024-09-13T18:27:47.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.670+0000 7f9bf359e700 1 -- 172.21.15.44:0/1419289529 shutdown_connections 2024-09-13T18:27:47.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.670+0000 7f9bf359e700 1 --2- 172.21.15.44:0/1419289529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bf415cda0 0x7f9bf406b900 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.670+0000 7f9bf359e700 1 -- 172.21.15.44:0/1419289529 >> 172.21.15.44:0/1419289529 conn(0x7f9bf40d2cb0 msgr2=0x7f9bf40d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:47.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.670+0000 7f9bf359e700 1 -- 172.21.15.44:0/1419289529 shutdown_connections 2024-09-13T18:27:47.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.670+0000 7f9bf359e700 1 -- 172.21.15.44:0/1419289529 wait complete. 2024-09-13T18:27:47.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9bf359e700 1 Processor -- start 2024-09-13T18:27:47.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9bf359e700 1 -- start start 2024-09-13T18:27:47.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9bf359e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bf406a520 0x7f9bf4158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:47.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9bf359e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bf40ceb70 0x7f9bf4152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:47.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9bf359e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9bf415cda0 0x7f9bf40c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:47.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9bf359e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf40c8a20 con 0x7f9bf406a520 2024-09-13T18:27:47.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9bf359e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf40c7de0 con 0x7f9bf40ceb70 2024-09-13T18:27:47.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9bf359e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf40c8080 con 0x7f9bf415cda0 2024-09-13T18:27:47.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9bf259c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bf406a520 0x7f9bf4158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:47.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9bf259c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bf406a520 0x7f9bf4158450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36642/0 (socket says 172.21.15.44:36642) 2024-09-13T18:27:47.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9bf259c700 1 -- 172.21.15.44:0/2346075714 learned_addr learned my addr 172.21.15.44:0/2346075714 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:47.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9bf2d9d700 1 --2- 172.21.15.44:0/2346075714 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9bf415cda0 0x7f9bf40c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:47.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9bf1d9b700 1 --2- 172.21.15.44:0/2346075714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bf40ceb70 0x7f9bf4152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:47.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9bf259c700 1 -- 172.21.15.44:0/2346075714 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9bf415cda0 msgr2=0x7f9bf40c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:47.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9bf259c700 1 --2- 172.21.15.44:0/2346075714 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9bf415cda0 0x7f9bf40c8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9bf259c700 1 -- 172.21.15.44:0/2346075714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bf40ceb70 msgr2=0x7f9bf4152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:47.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9bf259c700 1 --2- 172.21.15.44:0/2346075714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bf40ceb70 0x7f9bf4152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9bf259c700 1 -- 172.21.15.44:0/2346075714 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be4009a70 con 0x7f9bf406a520 2024-09-13T18:27:47.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9bf259c700 1 --2- 172.21.15.44:0/2346075714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bf406a520 0x7f9bf4158450 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9be4000f80 tx=0x7f9be4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:47.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9beaffd700 1 -- 172.21.15.44:0/2346075714 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be4012630 con 0x7f9bf406a520 2024-09-13T18:27:47.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9beaffd700 1 -- 172.21.15.44:0/2346075714 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be4012790 con 0x7f9bf406a520 2024-09-13T18:27:47.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9bf359e700 1 -- 172.21.15.44:0/2346075714 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf40c8360 con 0x7f9bf406a520 2024-09-13T18:27:47.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9beaffd700 1 -- 172.21.15.44:0/2346075714 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be4012b40 con 0x7f9bf406a520 2024-09-13T18:27:47.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.674+0000 7f9bf359e700 1 -- 172.21.15.44:0/2346075714 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf4158990 con 0x7f9bf406a520 2024-09-13T18:27:47.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.678+0000 7f9bf359e700 1 -- 172.21.15.44:0/2346075714 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf40b6600 con 0x7f9bf406a520 2024-09-13T18:27:47.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.678+0000 7f9beaffd700 1 -- 172.21.15.44:0/2346075714 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9be4012ca0 con 0x7f9bf406a520 2024-09-13T18:27:47.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.678+0000 7f9beaffd700 1 --2- 172.21.15.44:0/2346075714 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9bd4066730 0x7f9bd4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:47.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.678+0000 7f9beaffd700 1 -- 172.21.15.44:0/2346075714 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9be4085a00 con 0x7f9bf406a520 2024-09-13T18:27:47.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.678+0000 7f9bf1d9b700 1 --2- 172.21.15.44:0/2346075714 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9bd4066730 0x7f9bd4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:47.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.682+0000 7f9bf1d9b700 1 --2- 172.21.15.44:0/2346075714 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9bd4066730 0x7f9bd4068bf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4152f20 tx=0x7f9bdc004a70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:47.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.690+0000 7f9beaffd700 1 -- 172.21.15.44:0/2346075714 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9be4052ce0 con 0x7f9bf406a520 2024-09-13T18:27:47.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.854+0000 7f9bf359e700 1 -- 172.21.15.44:0/2346075714 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9bf40c8c90 con 0x7f9bf406a520 2024-09-13T18:27:47.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.854+0000 7f9beaffd700 1 -- 172.21.15.44:0/2346075714 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9be4056300 con 0x7f9bf406a520 2024-09-13T18:27:47.860 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:27:47.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.858+0000 7f9bf359e700 1 -- 172.21.15.44:0/2346075714 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9bd4066730 msgr2=0x7f9bd4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:47.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.858+0000 7f9bf359e700 1 --2- 172.21.15.44:0/2346075714 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9bd4066730 0x7f9bd4068bf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4152f20 tx=0x7f9bdc004a70 comp rx=0 tx=0).stop 2024-09-13T18:27:47.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.858+0000 7f9bf359e700 1 -- 172.21.15.44:0/2346075714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bf406a520 msgr2=0x7f9bf4158450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:47.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.858+0000 7f9bf359e700 1 --2- 172.21.15.44:0/2346075714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bf406a520 0x7f9bf4158450 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9be4000f80 tx=0x7f9be4004af0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.858+0000 7f9bf359e700 1 -- 172.21.15.44:0/2346075714 shutdown_connections 2024-09-13T18:27:47.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.858+0000 7f9bf359e700 1 --2- 172.21.15.44:0/2346075714 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9bd4066730 0x7f9bd4068bf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.858+0000 7f9bf359e700 1 --2- 172.21.15.44:0/2346075714 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9bf415cda0 0x7f9bf40c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.858+0000 7f9bf359e700 1 --2- 172.21.15.44:0/2346075714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bf40ceb70 0x7f9bf4152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.858+0000 7f9bf359e700 1 --2- 172.21.15.44:0/2346075714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bf406a520 0x7f9bf4158450 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.858+0000 7f9bf359e700 1 -- 172.21.15.44:0/2346075714 >> 172.21.15.44:0/2346075714 conn(0x7f9bf40d2cb0 msgr2=0x7f9bf40d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:47.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.858+0000 7f9bf359e700 1 -- 172.21.15.44:0/2346075714 shutdown_connections 2024-09-13T18:27:47.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.858+0000 7f9bf359e700 1 -- 172.21.15.44:0/2346075714 wait complete. 2024-09-13T18:27:47.876 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:27:48.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.994+0000 7fb82b439700 1 Processor -- start 2024-09-13T18:27:48.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.994+0000 7fb82b439700 1 -- start start 2024-09-13T18:27:48.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.994+0000 7fb82b439700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb82406b900 0x7fb8240b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:48.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.994+0000 7fb82b439700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8240b8430 con 0x7fb82415cda0 2024-09-13T18:27:48.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.994+0000 7fb82b439700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb82406bd60 con 0x7fb82406a520 2024-09-13T18:27:48.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.994+0000 7fb82b439700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8240cf350 con 0x7fb82406b900 2024-09-13T18:27:48.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.994+0000 7fb82a437700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb82415cda0 0x7fb8240ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45198/0 (socket says 172.21.15.44:45198) 2024-09-13T18:27:48.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.994+0000 7fb82a437700 1 -- 172.21.15.44:0/355013588 learned_addr learned my addr 172.21.15.44:0/355013588 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:48.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.998+0000 7fb829c36700 1 --2- 172.21.15.44:0/355013588 >> v2:172.21.15.99:3300/0 conn(0x7fb82406b900 0x7fb8240b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:48.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.998+0000 7fb829435700 1 -- 172.21.15.44:0/355013588 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130706439 0 0) 0x7fb8240b8430 con 0x7fb82415cda0 2024-09-13T18:27:48.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.998+0000 7fb829435700 1 -- 172.21.15.44:0/355013588 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8100035d0 con 0x7fb82415cda0 2024-09-13T18:27:48.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.998+0000 7fb829c36700 1 -- 172.21.15.44:0/355013588 >> v1:172.21.15.99:6789/0 conn(0x7fb82406a520 legacy=0x7fb82406a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:48.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.998+0000 7fb829c36700 1 -- 172.21.15.44:0/355013588 >> v1:172.21.15.44:6789/0 conn(0x7fb82415cda0 legacy=0x7fb8240ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:48.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.998+0000 7fb829435700 1 -- 172.21.15.44:0/355013588 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3529572677 0 0) 0x7fb8100035d0 con 0x7fb82415cda0 2024-09-13T18:27:48.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.998+0000 7fb829c36700 1 -- 172.21.15.44:0/355013588 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8240d0880 con 0x7fb82406b900 2024-09-13T18:27:48.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.998+0000 7fb829c36700 1 --2- 172.21.15.44:0/355013588 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb82406b900 0x7fb8240b5de0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb814009850 tx=0x7fb814009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da387a64faf88086 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:48.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.998+0000 7fb829435700 1 -- 172.21.15.44:0/355013588 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820001670 con 0x7fb82406b900 2024-09-13T18:27:48.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.998+0000 7fb829435700 1 -- 172.21.15.44:0/355013588 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb814004030 con 0x7fb82406b900 2024-09-13T18:27:48.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.998+0000 7fb829435700 1 -- 172.21.15.44:0/355013588 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8140043a0 con 0x7fb82406b900 2024-09-13T18:27:48.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.998+0000 7fb82b439700 1 -- 172.21.15.44:0/355013588 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb82406b900 msgr2=0x7fb8240b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:48.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.998+0000 7fb82b439700 1 --2- 172.21.15.44:0/355013588 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb82406b900 0x7fb8240b5de0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb814009850 tx=0x7fb814009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:48.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.998+0000 7fb82b439700 1 -- 172.21.15.44:0/355013588 shutdown_connections 2024-09-13T18:27:48.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.998+0000 7fb82b439700 1 --2- 172.21.15.44:0/355013588 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb82406b900 0x7fb8240b5de0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.998+0000 7fb82b439700 1 -- 172.21.15.44:0/355013588 >> 172.21.15.44:0/355013588 conn(0x7fb8240d2cb0 msgr2=0x7fb8240d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:48.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.998+0000 7fb82b439700 1 -- 172.21.15.44:0/355013588 shutdown_connections 2024-09-13T18:27:48.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:47.998+0000 7fb82b439700 1 -- 172.21.15.44:0/355013588 wait complete. 2024-09-13T18:27:48.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.002+0000 7fb82b439700 1 Processor -- start 2024-09-13T18:27:48.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.002+0000 7fb82b439700 1 -- start start 2024-09-13T18:27:48.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.002+0000 7fb82b439700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb82406a520 0x7fb82415fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:48.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.002+0000 7fb82b439700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb82406b900 0x7fb8240c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:48.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.002+0000 7fb82b439700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb82415cda0 0x7fb8241f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:48.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.002+0000 7fb82b439700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82415e560 con 0x7fb82406a520 2024-09-13T18:27:48.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.002+0000 7fb82b439700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb824160080 con 0x7fb82415cda0 2024-09-13T18:27:48.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.002+0000 7fb82b439700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8240c6980 con 0x7fb82406b900 2024-09-13T18:27:48.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.002+0000 7fb82a437700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb82406a520 0x7fb82415fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:48.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.002+0000 7fb82a437700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb82406a520 0x7fb82415fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36644/0 (socket says 172.21.15.44:36644) 2024-09-13T18:27:48.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.002+0000 7fb82a437700 1 -- 172.21.15.44:0/2170510792 learned_addr learned my addr 172.21.15.44:0/2170510792 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:48.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.002+0000 7fb82ac38700 1 --2- 172.21.15.44:0/2170510792 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb82415cda0 0x7fb8241f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:48.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.002+0000 7fb829c36700 1 --2- 172.21.15.44:0/2170510792 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb82406b900 0x7fb8240c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:48.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.006+0000 7fb82a437700 1 -- 172.21.15.44:0/2170510792 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb82406b900 msgr2=0x7fb8240c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:48.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.006+0000 7fb82a437700 1 --2- 172.21.15.44:0/2170510792 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb82406b900 0x7fb8240c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.006+0000 7fb82a437700 1 -- 172.21.15.44:0/2170510792 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb82415cda0 msgr2=0x7fb8241f2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:48.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.006+0000 7fb82a437700 1 --2- 172.21.15.44:0/2170510792 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb82415cda0 0x7fb8241f2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.006+0000 7fb82a437700 1 -- 172.21.15.44:0/2170510792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8140094b0 con 0x7fb82406a520 2024-09-13T18:27:48.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.006+0000 7fb82ac38700 1 --2- 172.21.15.44:0/2170510792 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb82415cda0 0x7fb8241f2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:48.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.006+0000 7fb82a437700 1 --2- 172.21.15.44:0/2170510792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb82406a520 0x7fb82415fa30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb82000c540 tx=0x7fb82000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:48.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.006+0000 7fb81affd700 1 -- 172.21.15.44:0/2170510792 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820004ca0 con 0x7fb82406a520 2024-09-13T18:27:48.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.006+0000 7fb81affd700 1 -- 172.21.15.44:0/2170510792 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb820004e00 con 0x7fb82406a520 2024-09-13T18:27:48.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.006+0000 7fb82b439700 1 -- 172.21.15.44:0/2170510792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8240c6c60 con 0x7fb82406a520 2024-09-13T18:27:48.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.006+0000 7fb81affd700 1 -- 172.21.15.44:0/2170510792 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820007310 con 0x7fb82406a520 2024-09-13T18:27:48.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.006+0000 7fb82b439700 1 -- 172.21.15.44:0/2170510792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8240c7220 con 0x7fb82406a520 2024-09-13T18:27:48.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.006+0000 7fb82b439700 1 -- 172.21.15.44:0/2170510792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8240b5de0 con 0x7fb82406a520 2024-09-13T18:27:48.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.010+0000 7fb81affd700 1 -- 172.21.15.44:0/2170510792 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb820007470 con 0x7fb82406a520 2024-09-13T18:27:48.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.010+0000 7fb81affd700 1 --2- 172.21.15.44:0/2170510792 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb8080667b0 0x7fb808068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:48.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.010+0000 7fb81affd700 1 -- 172.21.15.44:0/2170510792 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb820083da0 con 0x7fb82406a520 2024-09-13T18:27:48.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.010+0000 7fb829c36700 1 --2- 172.21.15.44:0/2170510792 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb8080667b0 0x7fb808068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:48.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.010+0000 7fb829c36700 1 --2- 172.21.15.44:0/2170510792 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb8080667b0 0x7fb808068c70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb8140090b0 tx=0x7fb814008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:48.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.018+0000 7fb81affd700 1 -- 172.21.15.44:0/2170510792 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb820051100 con 0x7fb82406a520 2024-09-13T18:27:48.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.190+0000 7fb82b439700 1 -- 172.21.15.44:0/2170510792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb82415bea0 con 0x7fb82406a520 2024-09-13T18:27:48.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.190+0000 7fb81affd700 1 -- 172.21.15.44:0/2170510792 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb820007720 con 0x7fb82406a520 2024-09-13T18:27:48.195 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:27:48.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.190+0000 7fb82b439700 1 -- 172.21.15.44:0/2170510792 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb8080667b0 msgr2=0x7fb808068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:48.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.190+0000 7fb82b439700 1 --2- 172.21.15.44:0/2170510792 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb8080667b0 0x7fb808068c70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb8140090b0 tx=0x7fb814008030 comp rx=0 tx=0).stop 2024-09-13T18:27:48.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.190+0000 7fb82b439700 1 -- 172.21.15.44:0/2170510792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb82406a520 msgr2=0x7fb82415fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:48.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.190+0000 7fb82b439700 1 --2- 172.21.15.44:0/2170510792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb82406a520 0x7fb82415fa30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb82000c540 tx=0x7fb82000c850 comp rx=0 tx=0).stop 2024-09-13T18:27:48.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.190+0000 7fb82b439700 1 -- 172.21.15.44:0/2170510792 shutdown_connections 2024-09-13T18:27:48.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.190+0000 7fb82b439700 1 --2- 172.21.15.44:0/2170510792 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb8080667b0 0x7fb808068c70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.190+0000 7fb82b439700 1 --2- 172.21.15.44:0/2170510792 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb82415cda0 0x7fb8241f2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.190+0000 7fb82b439700 1 --2- 172.21.15.44:0/2170510792 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb82406b900 0x7fb8240c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.190+0000 7fb82b439700 1 --2- 172.21.15.44:0/2170510792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb82406a520 0x7fb82415fa30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.190+0000 7fb82b439700 1 -- 172.21.15.44:0/2170510792 >> 172.21.15.44:0/2170510792 conn(0x7fb8240d2cb0 msgr2=0x7fb8240d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:48.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.190+0000 7fb82b439700 1 -- 172.21.15.44:0/2170510792 shutdown_connections 2024-09-13T18:27:48.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.190+0000 7fb82b439700 1 -- 172.21.15.44:0/2170510792 wait complete. 2024-09-13T18:27:48.211 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:27:48.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.330+0000 7f37a6add700 1 Processor -- start 2024-09-13T18:27:48.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.330+0000 7f37a6add700 1 -- start start 2024-09-13T18:27:48.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.330+0000 7f37a6add700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f37a00b5e00 0x7f37a00b6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:48.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.330+0000 7f37a6add700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f37a00b6780 0x7f37a00ce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:48.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.330+0000 7f37a6add700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a00d0880 con 0x7f37a015cda0 2024-09-13T18:27:48.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.330+0000 7f37a6add700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a00d2280 con 0x7f37a00b5e00 2024-09-13T18:27:48.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.330+0000 7f37a6add700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00cde50 con 0x7f37a00b6780 2024-09-13T18:27:48.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.330+0000 7f37a4879700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f37a015cda0 0x7f37a00d1b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45212/0 (socket says 172.21.15.44:45212) 2024-09-13T18:27:48.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.330+0000 7f37a4879700 1 -- 172.21.15.44:0/1926947038 learned_addr learned my addr 172.21.15.44:0/1926947038 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:48.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.334+0000 7f379ffff700 1 --2- 172.21.15.44:0/1926947038 >> v2:172.21.15.99:3300/0 conn(0x7f37a00b5e00 0x7f37a00b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:48.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.334+0000 7f37a507a700 1 --2- 172.21.15.44:0/1926947038 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f37a00b6780 0x7f37a00ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.334+0000 7f379f7fe700 1 -- 172.21.15.44:0/1926947038 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 185340425 0 0) 0x7f37a00d0880 con 0x7f37a015cda0 2024-09-13T18:27:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.334+0000 7f379f7fe700 1 -- 172.21.15.44:0/1926947038 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37900035d0 con 0x7f37a015cda0 2024-09-13T18:27:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.334+0000 7f379ffff700 1 -- 172.21.15.44:0/1926947038 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f37a00b6780 msgr2=0x7f37a00ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.334+0000 7f379ffff700 1 --2- 172.21.15.44:0/1926947038 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f37a00b6780 0x7f37a00ce260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.334+0000 7f379ffff700 1 -- 172.21.15.44:0/1926947038 >> v1:172.21.15.44:6789/0 conn(0x7f37a015cda0 legacy=0x7f37a00d1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.334+0000 7f379ffff700 1 -- 172.21.15.44:0/1926947038 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a00d16e0 con 0x7f37a00b5e00 2024-09-13T18:27:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.334+0000 7f379ffff700 1 --2- 172.21.15.44:0/1926947038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37a00b5e00 0x7f37a00b6240 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f378c009850 tx=0x7f378c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=326d60ff0c413dbc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.334+0000 7f379f7fe700 1 -- 172.21.15.44:0/1926947038 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c011830 con 0x7f37a00b5e00 2024-09-13T18:27:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.334+0000 7f379f7fe700 1 -- 172.21.15.44:0/1926947038 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378c011990 con 0x7f37a00b5e00 2024-09-13T18:27:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.334+0000 7f379f7fe700 1 -- 172.21.15.44:0/1926947038 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c011d00 con 0x7f37a00b5e00 2024-09-13T18:27:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.334+0000 7f37a6add700 1 -- 172.21.15.44:0/1926947038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37a00b5e00 msgr2=0x7f37a00b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.334+0000 7f37a6add700 1 --2- 172.21.15.44:0/1926947038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37a00b5e00 0x7f37a00b6240 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f378c009850 tx=0x7f378c009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.334+0000 7f37a6add700 1 -- 172.21.15.44:0/1926947038 shutdown_connections 2024-09-13T18:27:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.334+0000 7f37a6add700 1 --2- 172.21.15.44:0/1926947038 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f37a00b6780 0x7f37a00ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.334+0000 7f37a6add700 1 --2- 172.21.15.44:0/1926947038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37a00b5e00 0x7f37a00b6240 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.334+0000 7f37a6add700 1 -- 172.21.15.44:0/1926947038 >> 172.21.15.44:0/1926947038 conn(0x7f37a00d2cb0 msgr2=0x7f37a00d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:48.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.334+0000 7f37a6add700 1 -- 172.21.15.44:0/1926947038 shutdown_connections 2024-09-13T18:27:48.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.334+0000 7f37a6add700 1 -- 172.21.15.44:0/1926947038 wait complete. 2024-09-13T18:27:48.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f37a6add700 1 Processor -- start 2024-09-13T18:27:48.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f37a6add700 1 -- start start 2024-09-13T18:27:48.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f37a6add700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37a00b5e00 0x7f37a00cc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:48.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f37a6add700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37a00b6780 0x7f37a01f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:48.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f37a6add700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f37a015cda0 0x7f37a01f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:48.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f37a6add700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00cbd10 con 0x7f37a00b6780 2024-09-13T18:27:48.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f37a6add700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00cae40 con 0x7f37a00b5e00 2024-09-13T18:27:48.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f37a6add700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a01f2a50 con 0x7f37a015cda0 2024-09-13T18:27:48.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f379ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37a00b6780 0x7f37a01f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:48.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f379ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37a00b6780 0x7f37a01f1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36660/0 (socket says 172.21.15.44:36660) 2024-09-13T18:27:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f379ffff700 1 -- 172.21.15.44:0/2028731483 learned_addr learned my addr 172.21.15.44:0/2028731483 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f37a4879700 1 --2- 172.21.15.44:0/2028731483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37a00b5e00 0x7f37a00cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f37a507a700 1 --2- 172.21.15.44:0/2028731483 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f37a015cda0 0x7f37a01f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f379ffff700 1 -- 172.21.15.44:0/2028731483 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f37a015cda0 msgr2=0x7f37a01f2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f379ffff700 1 --2- 172.21.15.44:0/2028731483 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f37a015cda0 0x7f37a01f2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f379ffff700 1 -- 172.21.15.44:0/2028731483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37a00b5e00 msgr2=0x7f37a00cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f379ffff700 1 --2- 172.21.15.44:0/2028731483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37a00b5e00 0x7f37a00cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f379ffff700 1 -- 172.21.15.44:0/2028731483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378c0094b0 con 0x7f37a00b6780 2024-09-13T18:27:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f37a4879700 1 --2- 172.21.15.44:0/2028731483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37a00b5e00 0x7f37a00cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f37a507a700 1 --2- 172.21.15.44:0/2028731483 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f37a015cda0 0x7f37a01f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f379ffff700 1 --2- 172.21.15.44:0/2028731483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37a00b6780 0x7f37a01f1fd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f37a00d3db0 tx=0x7f378c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f379d7fa700 1 -- 172.21.15.44:0/2028731483 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c0036c0 con 0x7f37a00b6780 2024-09-13T18:27:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f379d7fa700 1 -- 172.21.15.44:0/2028731483 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378c01f070 con 0x7f37a00b6780 2024-09-13T18:27:48.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f37a6add700 1 -- 172.21.15.44:0/2028731483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a00cb090 con 0x7f37a00b6780 2024-09-13T18:27:48.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f379d7fa700 1 -- 172.21.15.44:0/2028731483 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c003aa0 con 0x7f37a00b6780 2024-09-13T18:27:48.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.338+0000 7f37a6add700 1 -- 172.21.15.44:0/2028731483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a00cb650 con 0x7f37a00b6780 2024-09-13T18:27:48.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.342+0000 7f37a6add700 1 -- 172.21.15.44:0/2028731483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a00b6240 con 0x7f37a00b6780 2024-09-13T18:27:48.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.342+0000 7f379d7fa700 1 -- 172.21.15.44:0/2028731483 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f378c003c00 con 0x7f37a00b6780 2024-09-13T18:27:48.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.342+0000 7f379d7fa700 1 --2- 172.21.15.44:0/2028731483 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3784066730 0x7f3784068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:48.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.342+0000 7f379d7fa700 1 -- 172.21.15.44:0/2028731483 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f378c021070 con 0x7f37a00b6780 2024-09-13T18:27:48.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.342+0000 7f37a4879700 1 --2- 172.21.15.44:0/2028731483 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3784066730 0x7f3784068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:48.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.346+0000 7f37a4879700 1 --2- 172.21.15.44:0/2028731483 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3784066730 0x7f3784068bf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3794005930 tx=0x7f3794009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:48.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.350+0000 7f379d7fa700 1 -- 172.21.15.44:0/2028731483 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f378c052e40 con 0x7f37a00b6780 2024-09-13T18:27:48.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.518+0000 7f37a6add700 1 -- 172.21.15.44:0/2028731483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f37a0067b70 con 0x7f37a00b6780 2024-09-13T18:27:48.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.518+0000 7f379d7fa700 1 -- 172.21.15.44:0/2028731483 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f378c02b0a0 con 0x7f37a00b6780 2024-09-13T18:27:48.525 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:27:48.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.522+0000 7f37a6add700 1 -- 172.21.15.44:0/2028731483 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3784066730 msgr2=0x7f3784068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:48.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.522+0000 7f37a6add700 1 --2- 172.21.15.44:0/2028731483 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3784066730 0x7f3784068bf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3794005930 tx=0x7f3794009040 comp rx=0 tx=0).stop 2024-09-13T18:27:48.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.522+0000 7f37a6add700 1 -- 172.21.15.44:0/2028731483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37a00b6780 msgr2=0x7f37a01f1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:48.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.522+0000 7f37a6add700 1 --2- 172.21.15.44:0/2028731483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37a00b6780 0x7f37a01f1fd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f37a00d3db0 tx=0x7f378c004770 comp rx=0 tx=0).stop 2024-09-13T18:27:48.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.522+0000 7f37a6add700 1 -- 172.21.15.44:0/2028731483 shutdown_connections 2024-09-13T18:27:48.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.522+0000 7f37a6add700 1 --2- 172.21.15.44:0/2028731483 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3784066730 0x7f3784068bf0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.522+0000 7f37a6add700 1 --2- 172.21.15.44:0/2028731483 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f37a015cda0 0x7f37a01f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.522+0000 7f37a6add700 1 --2- 172.21.15.44:0/2028731483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37a00b6780 0x7f37a01f1fd0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.522+0000 7f37a6add700 1 --2- 172.21.15.44:0/2028731483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37a00b5e00 0x7f37a00cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.522+0000 7f37a6add700 1 -- 172.21.15.44:0/2028731483 >> 172.21.15.44:0/2028731483 conn(0x7f37a00d2cb0 msgr2=0x7f37a00ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:48.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.522+0000 7f37a6add700 1 -- 172.21.15.44:0/2028731483 shutdown_connections 2024-09-13T18:27:48.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.522+0000 7f37a6add700 1 -- 172.21.15.44:0/2028731483 wait complete. 2024-09-13T18:27:48.540 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:27:48.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.650+0000 7fd891ada700 1 Processor -- start 2024-09-13T18:27:48.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.650+0000 7fd891ada700 1 -- start start 2024-09-13T18:27:48.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd891ada700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd88c159080 0x7fd88c0caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:48.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd891ada700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd88c0cb0d0 0x7fd88c0cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:48.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd891ada700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd88c159460 0x7fd88c0ce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:48.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd891ada700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88c15d800 con 0x7fd88c159080 2024-09-13T18:27:48.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd891ada700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88c15cc10 con 0x7fd88c0cb0d0 2024-09-13T18:27:48.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd891ada700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c15ced0 con 0x7fd88c159460 2024-09-13T18:27:48.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd890ad8700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd88c159080 0x7fd88c0caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:48.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd890ad8700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd88c159080 0x7fd88c0caa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36674/0 (socket says 172.21.15.44:36674) 2024-09-13T18:27:48.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd890ad8700 1 -- 172.21.15.44:0/3492299912 learned_addr learned my addr 172.21.15.44:0/3492299912 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:48.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd883fff700 1 --2- 172.21.15.44:0/3492299912 >> v2:172.21.15.99:3300/0 conn(0x7fd88c0cb0d0 0x7fd88c0cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:48.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd8912d9700 1 --2- 172.21.15.44:0/3492299912 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd88c159460 0x7fd88c0ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:48.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd890ad8700 1 -- 172.21.15.44:0/3492299912 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd88c159460 msgr2=0x7fd88c0ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:48.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd890ad8700 1 --2- 172.21.15.44:0/3492299912 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd88c159460 0x7fd88c0ce100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd890ad8700 1 -- 172.21.15.44:0/3492299912 >> v2:172.21.15.99:3300/0 conn(0x7fd88c0cb0d0 msgr2=0x7fd88c0cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:48.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd890ad8700 1 --2- 172.21.15.44:0/3492299912 >> v2:172.21.15.99:3300/0 conn(0x7fd88c0cb0d0 0x7fd88c0cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd890ad8700 1 -- 172.21.15.44:0/3492299912 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88c15d1b0 con 0x7fd88c159080 2024-09-13T18:27:48.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd883fff700 1 --2- 172.21.15.44:0/3492299912 >> v2:172.21.15.99:3300/0 conn(0x7fd88c0cb0d0 0x7fd88c0cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:48.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd8912d9700 1 --2- 172.21.15.44:0/3492299912 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd88c159460 0x7fd88c0ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:48.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd890ad8700 1 --2- 172.21.15.44:0/3492299912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd88c159080 0x7fd88c0caa00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0ceec0 tx=0x7fd888009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51dbff803d57f736 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:48.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd8837fe700 1 -- 172.21.15.44:0/3492299912 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88800b8a0 con 0x7fd88c159080 2024-09-13T18:27:48.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd8837fe700 1 -- 172.21.15.44:0/3492299912 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88800ba00 con 0x7fd88c159080 2024-09-13T18:27:48.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd8837fe700 1 -- 172.21.15.44:0/3492299912 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88800bd90 con 0x7fd88c159080 2024-09-13T18:27:48.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd891ada700 1 -- 172.21.15.44:0/3492299912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd88c159080 msgr2=0x7fd88c0caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:48.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd891ada700 1 --2- 172.21.15.44:0/3492299912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd88c159080 0x7fd88c0caa00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0ceec0 tx=0x7fd888009bf0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd891ada700 1 -- 172.21.15.44:0/3492299912 shutdown_connections 2024-09-13T18:27:48.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd891ada700 1 --2- 172.21.15.44:0/3492299912 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd88c159460 0x7fd88c0ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd891ada700 1 --2- 172.21.15.44:0/3492299912 >> v2:172.21.15.99:3300/0 conn(0x7fd88c0cb0d0 0x7fd88c0cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd891ada700 1 --2- 172.21.15.44:0/3492299912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd88c159080 0x7fd88c0caa00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd891ada700 1 -- 172.21.15.44:0/3492299912 >> 172.21.15.44:0/3492299912 conn(0x7fd88c0cba60 msgr2=0x7fd88c0cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:48.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd891ada700 1 -- 172.21.15.44:0/3492299912 shutdown_connections 2024-09-13T18:27:48.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.654+0000 7fd891ada700 1 -- 172.21.15.44:0/3492299912 wait complete. 2024-09-13T18:27:48.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.658+0000 7fd891ada700 1 Processor -- start 2024-09-13T18:27:48.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.658+0000 7fd891ada700 1 -- start start 2024-09-13T18:27:48.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.658+0000 7fd891ada700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd88c0cb0d0 0x7fd88c150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:48.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.658+0000 7fd891ada700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd88c159080 0x7fd88c0c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:48.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.658+0000 7fd891ada700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd88c159460 0x7fd88c14b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:48.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.658+0000 7fd891ada700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c14cab0 con 0x7fd88c0cb0d0 2024-09-13T18:27:48.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.658+0000 7fd891ada700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c14cd90 con 0x7fd88c159460 2024-09-13T18:27:48.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.658+0000 7fd891ada700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c14d070 con 0x7fd88c159080 2024-09-13T18:27:48.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.658+0000 7fd890ad8700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd88c0cb0d0 0x7fd88c150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:48.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.658+0000 7fd890ad8700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd88c0cb0d0 0x7fd88c150e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36680/0 (socket says 172.21.15.44:36680) 2024-09-13T18:27:48.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.658+0000 7fd890ad8700 1 -- 172.21.15.44:0/2402521021 learned_addr learned my addr 172.21.15.44:0/2402521021 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:48.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.658+0000 7fd8912d9700 1 --2- 172.21.15.44:0/2402521021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd88c159460 0x7fd88c14b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:48.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.658+0000 7fd883fff700 1 --2- 172.21.15.44:0/2402521021 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd88c159080 0x7fd88c0c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:48.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.658+0000 7fd890ad8700 1 -- 172.21.15.44:0/2402521021 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd88c159080 msgr2=0x7fd88c0c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:48.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.658+0000 7fd890ad8700 1 --2- 172.21.15.44:0/2402521021 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd88c159080 0x7fd88c0c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.658+0000 7fd890ad8700 1 -- 172.21.15.44:0/2402521021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd88c159460 msgr2=0x7fd88c14b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:48.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.658+0000 7fd890ad8700 1 --2- 172.21.15.44:0/2402521021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd88c159460 0x7fd88c14b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.658+0000 7fd890ad8700 1 -- 172.21.15.44:0/2402521021 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd888009570 con 0x7fd88c0cb0d0 2024-09-13T18:27:48.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.658+0000 7fd890ad8700 1 --2- 172.21.15.44:0/2402521021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd88c0cb0d0 0x7fd88c150e90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0727d0 tx=0x7fd888004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:48.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.662+0000 7fd8817fa700 1 -- 172.21.15.44:0/2402521021 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88800bee0 con 0x7fd88c0cb0d0 2024-09-13T18:27:48.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.662+0000 7fd8817fa700 1 -- 172.21.15.44:0/2402521021 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88801f070 con 0x7fd88c0cb0d0 2024-09-13T18:27:48.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.662+0000 7fd891ada700 1 -- 172.21.15.44:0/2402521021 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88c14d350 con 0x7fd88c0cb0d0 2024-09-13T18:27:48.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.662+0000 7fd8817fa700 1 -- 172.21.15.44:0/2402521021 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd888003b20 con 0x7fd88c0cb0d0 2024-09-13T18:27:48.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.662+0000 7fd891ada700 1 -- 172.21.15.44:0/2402521021 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88c14c6b0 con 0x7fd88c0cb0d0 2024-09-13T18:27:48.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.662+0000 7fd891ada700 1 -- 172.21.15.44:0/2402521021 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd88c14c840 con 0x7fd88c0cb0d0 2024-09-13T18:27:48.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.662+0000 7fd8817fa700 1 -- 172.21.15.44:0/2402521021 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd888003c80 con 0x7fd88c0cb0d0 2024-09-13T18:27:48.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.662+0000 7fd8817fa700 1 --2- 172.21.15.44:0/2402521021 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd878066730 0x7fd878068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:48.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.662+0000 7fd8817fa700 1 -- 172.21.15.44:0/2402521021 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd888021070 con 0x7fd88c0cb0d0 2024-09-13T18:27:48.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.662+0000 7fd883fff700 1 --2- 172.21.15.44:0/2402521021 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd878066730 0x7fd878068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:48.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.662+0000 7fd883fff700 1 --2- 172.21.15.44:0/2402521021 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd878066730 0x7fd878068bf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd88c066cc0 tx=0x7fd87c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:48.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.666+0000 7fd8817fa700 1 -- 172.21.15.44:0/2402521021 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd888053000 con 0x7fd88c0cb0d0 2024-09-13T18:27:48.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.850+0000 7fd891ada700 1 -- 172.21.15.44:0/2402521021 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd88c06a870 con 0x7fd88c0cb0d0 2024-09-13T18:27:48.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.854+0000 7fd8817fa700 1 -- 172.21.15.44:0/2402521021 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd888056620 con 0x7fd88c0cb0d0 2024-09-13T18:27:48.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.854+0000 7fd891ada700 1 -- 172.21.15.44:0/2402521021 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd878066730 msgr2=0x7fd878068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:48.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.854+0000 7fd891ada700 1 --2- 172.21.15.44:0/2402521021 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd878066730 0x7fd878068bf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd88c066cc0 tx=0x7fd87c008040 comp rx=0 tx=0).stop 2024-09-13T18:27:48.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.854+0000 7fd891ada700 1 -- 172.21.15.44:0/2402521021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd88c0cb0d0 msgr2=0x7fd88c150e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:48.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.854+0000 7fd891ada700 1 --2- 172.21.15.44:0/2402521021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd88c0cb0d0 0x7fd88c150e90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0727d0 tx=0x7fd888004770 comp rx=0 tx=0).stop 2024-09-13T18:27:48.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.854+0000 7fd891ada700 1 -- 172.21.15.44:0/2402521021 shutdown_connections 2024-09-13T18:27:48.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.854+0000 7fd891ada700 1 --2- 172.21.15.44:0/2402521021 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd878066730 0x7fd878068bf0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.854+0000 7fd891ada700 1 --2- 172.21.15.44:0/2402521021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd88c159460 0x7fd88c14b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.854+0000 7fd891ada700 1 --2- 172.21.15.44:0/2402521021 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd88c159080 0x7fd88c0c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.854+0000 7fd891ada700 1 --2- 172.21.15.44:0/2402521021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd88c0cb0d0 0x7fd88c150e90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:48.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.854+0000 7fd891ada700 1 -- 172.21.15.44:0/2402521021 >> 172.21.15.44:0/2402521021 conn(0x7fd88c0cba60 msgr2=0x7fd88c1598f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:48.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.854+0000 7fd891ada700 1 -- 172.21.15.44:0/2402521021 shutdown_connections 2024-09-13T18:27:48.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.854+0000 7fd891ada700 1 -- 172.21.15.44:0/2402521021 wait complete. 2024-09-13T18:27:48.862 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-13T18:27:48.878 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:27:48.878 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:27:48.887 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:49.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.998+0000 7fa015a0a700 1 Processor -- start 2024-09-13T18:27:49.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.998+0000 7fa015a0a700 1 -- start start 2024-09-13T18:27:49.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.998+0000 7fa015a0a700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa01015cae0 0x7fa0100cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:49.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.998+0000 7fa015a0a700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa01015cec0 0x7fa0100d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:49.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.998+0000 7fa015a0a700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0100d21e0 con 0x7fa01006ac00 2024-09-13T18:27:49.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.998+0000 7fa015a0a700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0100d1750 con 0x7fa01015cec0 2024-09-13T18:27:49.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.998+0000 7fa015a0a700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0100d1940 con 0x7fa01015cae0 2024-09-13T18:27:49.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.998+0000 7fa00ffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa01015cec0 0x7fa0100d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:49.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.998+0000 7fa00ffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa01015cec0 0x7fa0100d1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36682/0 (socket says 172.21.15.44:36682) 2024-09-13T18:27:49.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:48.998+0000 7fa00ffff700 1 -- 172.21.15.44:0/1864673604 learned_addr learned my addr 172.21.15.44:0/1864673604 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:49.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.002+0000 7fa014a08700 1 --2- 172.21.15.44:0/1864673604 >> v2:172.21.15.99:3300/0 conn(0x7fa01015cae0 0x7fa0100cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:49.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.002+0000 7fa00ffff700 1 -- 172.21.15.44:0/1864673604 >> v2:172.21.15.99:3300/0 conn(0x7fa01015cae0 msgr2=0x7fa0100cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:49.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.002+0000 7fa00ffff700 1 --2- 172.21.15.44:0/1864673604 >> v2:172.21.15.99:3300/0 conn(0x7fa01015cae0 0x7fa0100cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.002+0000 7fa00ffff700 1 -- 172.21.15.44:0/1864673604 >> v1:172.21.15.99:6789/0 conn(0x7fa01006ac00 legacy=0x7fa0100cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:49.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.002+0000 7fa00ffff700 1 -- 172.21.15.44:0/1864673604 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0100d1c20 con 0x7fa01015cec0 2024-09-13T18:27:49.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.002+0000 7fa014a08700 1 --2- 172.21.15.44:0/1864673604 >> v2:172.21.15.99:3300/0 conn(0x7fa01015cae0 0x7fa0100cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:49.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.002+0000 7fa00ffff700 1 --2- 172.21.15.44:0/1864673604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa01015cec0 0x7fa0100d1210 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa000009910 tx=0x7fa000009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5983088ced42022c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:49.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.002+0000 7fa00f7fe700 1 -- 172.21.15.44:0/1864673604 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00000ba20 con 0x7fa01015cec0 2024-09-13T18:27:49.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.002+0000 7fa00f7fe700 1 -- 172.21.15.44:0/1864673604 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00000bb80 con 0x7fa01015cec0 2024-09-13T18:27:49.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.002+0000 7fa00f7fe700 1 -- 172.21.15.44:0/1864673604 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa000009e60 con 0x7fa01015cec0 2024-09-13T18:27:49.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.002+0000 7fa015a0a700 1 -- 172.21.15.44:0/1864673604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa01015cec0 msgr2=0x7fa0100d1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:49.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.002+0000 7fa015a0a700 1 --2- 172.21.15.44:0/1864673604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa01015cec0 0x7fa0100d1210 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa000009910 tx=0x7fa000009c20 comp rx=0 tx=0).stop 2024-09-13T18:27:49.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.002+0000 7fa015a0a700 1 -- 172.21.15.44:0/1864673604 shutdown_connections 2024-09-13T18:27:49.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.002+0000 7fa015a0a700 1 --2- 172.21.15.44:0/1864673604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa01015cec0 0x7fa0100d1210 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.002+0000 7fa015a0a700 1 --2- 172.21.15.44:0/1864673604 >> v2:172.21.15.99:3300/0 conn(0x7fa01015cae0 0x7fa0100cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.002+0000 7fa015a0a700 1 -- 172.21.15.44:0/1864673604 >> 172.21.15.44:0/1864673604 conn(0x7fa0100d2c80 msgr2=0x7fa0100d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:49.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.002+0000 7fa015a0a700 1 -- 172.21.15.44:0/1864673604 shutdown_connections 2024-09-13T18:27:49.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.002+0000 7fa015a0a700 1 -- 172.21.15.44:0/1864673604 wait complete. 2024-09-13T18:27:49.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa015a0a700 1 Processor -- start 2024-09-13T18:27:49.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa015a0a700 1 -- start start 2024-09-13T18:27:49.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa015a0a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa01006ac00 0x7fa0101f3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:49.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa015a0a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa01015cae0 0x7fa0101ef980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:49.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa015a0a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa01015cec0 0x7fa01015f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:49.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa015a0a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa010158c50 con 0x7fa01015cae0 2024-09-13T18:27:49.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa015a0a700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0101f3550 con 0x7fa01015cec0 2024-09-13T18:27:49.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa015a0a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa010157d70 con 0x7fa01006ac00 2024-09-13T18:27:49.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa00ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa01015cae0 0x7fa0101ef980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:49.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa00ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa01015cae0 0x7fa0101ef980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36696/0 (socket says 172.21.15.44:36696) 2024-09-13T18:27:49.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa00ffff700 1 -- 172.21.15.44:0/2302484363 learned_addr learned my addr 172.21.15.44:0/2302484363 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:49.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa015209700 1 --2- 172.21.15.44:0/2302484363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa01015cec0 0x7fa01015f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:49.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa014a08700 1 --2- 172.21.15.44:0/2302484363 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa01006ac00 0x7fa0101f3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:49.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa00ffff700 1 -- 172.21.15.44:0/2302484363 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa01006ac00 msgr2=0x7fa0101f3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:49.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa00ffff700 1 --2- 172.21.15.44:0/2302484363 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa01006ac00 0x7fa0101f3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa00ffff700 1 -- 172.21.15.44:0/2302484363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa01015cec0 msgr2=0x7fa01015f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:49.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa00ffff700 1 --2- 172.21.15.44:0/2302484363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa01015cec0 0x7fa01015f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa00ffff700 1 -- 172.21.15.44:0/2302484363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa000009570 con 0x7fa01015cae0 2024-09-13T18:27:49.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa014a08700 1 --2- 172.21.15.44:0/2302484363 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa01006ac00 0x7fa0101f3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:49.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa00ffff700 1 --2- 172.21.15.44:0/2302484363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa01015cae0 0x7fa0101ef980 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa0100b57d0 tx=0x7fa000004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:49.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa00d7fa700 1 -- 172.21.15.44:0/2302484363 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa000004310 con 0x7fa01015cae0 2024-09-13T18:27:49.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa00d7fa700 1 -- 172.21.15.44:0/2302484363 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00001f070 con 0x7fa01015cae0 2024-09-13T18:27:49.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa00d7fa700 1 -- 172.21.15.44:0/2302484363 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0000036c0 con 0x7fa01015cae0 2024-09-13T18:27:49.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa015a0a700 1 -- 172.21.15.44:0/2302484363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa010157fd0 con 0x7fa01015cae0 2024-09-13T18:27:49.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa015a0a700 1 -- 172.21.15.44:0/2302484363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa010158590 con 0x7fa01015cae0 2024-09-13T18:27:49.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.006+0000 7fa015a0a700 1 -- 172.21.15.44:0/2302484363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa010158d90 con 0x7fa01015cae0 2024-09-13T18:27:49.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.010+0000 7fa00d7fa700 1 -- 172.21.15.44:0/2302484363 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa000021030 con 0x7fa01015cae0 2024-09-13T18:27:49.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.010+0000 7fa00d7fa700 1 --2- 172.21.15.44:0/2302484363 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9ffc066730 0x7f9ffc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:49.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.010+0000 7fa00d7fa700 1 -- 172.21.15.44:0/2302484363 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa000085540 con 0x7fa01015cae0 2024-09-13T18:27:49.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.010+0000 7fa014a08700 1 --2- 172.21.15.44:0/2302484363 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9ffc066730 0x7f9ffc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:49.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.010+0000 7fa014a08700 1 --2- 172.21.15.44:0/2302484363 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9ffc066730 0x7f9ffc068bf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa004006fd0 tx=0x7fa004008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:49.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.018+0000 7fa00d7fa700 1 -- 172.21.15.44:0/2302484363 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa010158d90 con 0x7fa01015cae0 2024-09-13T18:27:49.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.190+0000 7fa015a0a700 1 -- 172.21.15.44:0/2302484363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa010158d90 con 0x7fa01015cae0 2024-09-13T18:27:49.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.194+0000 7fa00d7fa700 1 -- 172.21.15.44:0/2302484363 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16695 (secure 0 0 0) 0x7fa010158d90 con 0x7fa01015cae0 2024-09-13T18:27:49.199 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:49.200 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":23,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:43.549975+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:49.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.194+0000 7fa015a0a700 1 -- 172.21.15.44:0/2302484363 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9ffc066730 msgr2=0x7f9ffc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:49.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.194+0000 7fa015a0a700 1 --2- 172.21.15.44:0/2302484363 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9ffc066730 0x7f9ffc068bf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa004006fd0 tx=0x7fa004008040 comp rx=0 tx=0).stop 2024-09-13T18:27:49.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.194+0000 7fa015a0a700 1 -- 172.21.15.44:0/2302484363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa01015cae0 msgr2=0x7fa0101ef980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:49.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.194+0000 7fa015a0a700 1 --2- 172.21.15.44:0/2302484363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa01015cae0 0x7fa0101ef980 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa0100b57d0 tx=0x7fa000004770 comp rx=0 tx=0).stop 2024-09-13T18:27:49.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.194+0000 7fa015a0a700 1 -- 172.21.15.44:0/2302484363 shutdown_connections 2024-09-13T18:27:49.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.194+0000 7fa015a0a700 1 --2- 172.21.15.44:0/2302484363 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9ffc066730 0x7f9ffc068bf0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.194+0000 7fa015a0a700 1 --2- 172.21.15.44:0/2302484363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa01015cec0 0x7fa01015f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.194+0000 7fa015a0a700 1 --2- 172.21.15.44:0/2302484363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa01015cae0 0x7fa0101ef980 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.194+0000 7fa015a0a700 1 --2- 172.21.15.44:0/2302484363 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa01006ac00 0x7fa0101f3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.194+0000 7fa015a0a700 1 -- 172.21.15.44:0/2302484363 >> 172.21.15.44:0/2302484363 conn(0x7fa0100d2c80 msgr2=0x7fa0100ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:49.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.194+0000 7fa015a0a700 1 -- 172.21.15.44:0/2302484363 shutdown_connections 2024-09-13T18:27:49.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.194+0000 7fa015a0a700 1 -- 172.21.15.44:0/2302484363 wait complete. 2024-09-13T18:27:49.215 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:26:59.478511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:27:00.261038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:27:49.216 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:27:49.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.330+0000 7f99f9fb1700 1 Processor -- start 2024-09-13T18:27:49.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.330+0000 7f99f9fb1700 1 -- start start 2024-09-13T18:27:49.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.330+0000 7f99f9fb1700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f99f40cea30 0x7f99f415b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:49.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.330+0000 7f99f9fb1700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f99f406cd40 0x7f99f40cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:49.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.330+0000 7f99f9fb1700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f4070350 con 0x7f99f4071640 2024-09-13T18:27:49.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.330+0000 7f99f9fb1700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f415be50 con 0x7f99f40cea30 2024-09-13T18:27:49.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.330+0000 7f99f9fb1700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f40cee10 con 0x7f99f406cd40 2024-09-13T18:27:49.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.330+0000 7f99f8faf700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f99f40cea30 0x7f99f415b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:49.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.330+0000 7f99f3fff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f99f4071640 0x7f99f406c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45222/0 (socket says 172.21.15.44:45222) 2024-09-13T18:27:49.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.330+0000 7f99f3fff700 1 -- 172.21.15.44:0/2199596709 learned_addr learned my addr 172.21.15.44:0/2199596709 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:49.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.334+0000 7f99f97b0700 1 --2- 172.21.15.44:0/2199596709 >> v2:172.21.15.99:3300/0 conn(0x7f99f406cd40 0x7f99f40cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:49.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.334+0000 7f99f8faf700 1 -- 172.21.15.44:0/2199596709 >> v2:172.21.15.99:3300/0 conn(0x7f99f406cd40 msgr2=0x7f99f40cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:49.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.334+0000 7f99f8faf700 1 --2- 172.21.15.44:0/2199596709 >> v2:172.21.15.99:3300/0 conn(0x7f99f406cd40 0x7f99f40cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.334+0000 7f99f8faf700 1 -- 172.21.15.44:0/2199596709 >> v1:172.21.15.44:6789/0 conn(0x7f99f4071640 legacy=0x7f99f406c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:49.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.334+0000 7f99f37fe700 1 -- 172.21.15.44:0/2199596709 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 580241750 0 0) 0x7f99f4070350 con 0x7f99f4071640 2024-09-13T18:27:49.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.334+0000 7f99f8faf700 1 -- 172.21.15.44:0/2199596709 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f40705a0 con 0x7f99f40cea30 2024-09-13T18:27:49.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.334+0000 7f99f97b0700 1 --2- 172.21.15.44:0/2199596709 >> v2:172.21.15.99:3300/0 conn(0x7f99f406cd40 0x7f99f40cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:49.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.334+0000 7f99f8faf700 1 --2- 172.21.15.44:0/2199596709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99f40cea30 0x7f99f415b910 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f99f40cce90 tx=0x7f99e8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc5cd61f3473694 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:49.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.334+0000 7f99f37fe700 1 -- 172.21.15.44:0/2199596709 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e8011830 con 0x7f99f40cea30 2024-09-13T18:27:49.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.334+0000 7f99f37fe700 1 -- 172.21.15.44:0/2199596709 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e8011990 con 0x7f99f40cea30 2024-09-13T18:27:49.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.334+0000 7f99f37fe700 1 -- 172.21.15.44:0/2199596709 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e8011d40 con 0x7f99f40cea30 2024-09-13T18:27:49.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.334+0000 7f99f9fb1700 1 -- 172.21.15.44:0/2199596709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99f40cea30 msgr2=0x7f99f415b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:49.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.334+0000 7f99f9fb1700 1 --2- 172.21.15.44:0/2199596709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99f40cea30 0x7f99f415b910 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f99f40cce90 tx=0x7f99e8009b30 comp rx=0 tx=0).stop 2024-09-13T18:27:49.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.334+0000 7f99f9fb1700 1 -- 172.21.15.44:0/2199596709 shutdown_connections 2024-09-13T18:27:49.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.334+0000 7f99f9fb1700 1 --2- 172.21.15.44:0/2199596709 >> v2:172.21.15.99:3300/0 conn(0x7f99f406cd40 0x7f99f40cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.334+0000 7f99f9fb1700 1 --2- 172.21.15.44:0/2199596709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99f40cea30 0x7f99f415b910 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.334+0000 7f99f9fb1700 1 -- 172.21.15.44:0/2199596709 >> 172.21.15.44:0/2199596709 conn(0x7f99f40cf420 msgr2=0x7f99f40cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:49.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.334+0000 7f99f9fb1700 1 -- 172.21.15.44:0/2199596709 shutdown_connections 2024-09-13T18:27:49.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.334+0000 7f99f9fb1700 1 -- 172.21.15.44:0/2199596709 wait complete. 2024-09-13T18:27:49.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.334+0000 7f99f9fb1700 1 Processor -- start 2024-09-13T18:27:49.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f9fb1700 1 -- start start 2024-09-13T18:27:49.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f9fb1700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f99f406cd40 0x7f99f40c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:49.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f9fb1700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99f4071640 0x7f99f4159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:49.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f9fb1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99f40cea30 0x7f99f4143c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:49.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f9fb1700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f4158be0 con 0x7f99f40cea30 2024-09-13T18:27:49.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f9fb1700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f4158ec0 con 0x7f99f4071640 2024-09-13T18:27:49.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f9fb1700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f41591a0 con 0x7f99f406cd40 2024-09-13T18:27:49.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f97b0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99f40cea30 0x7f99f4143c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:49.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f97b0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99f40cea30 0x7f99f4143c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36724/0 (socket says 172.21.15.44:36724) 2024-09-13T18:27:49.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f97b0700 1 -- 172.21.15.44:0/1581114432 learned_addr learned my addr 172.21.15.44:0/1581114432 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:49.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f8faf700 1 --2- 172.21.15.44:0/1581114432 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f99f406cd40 0x7f99f40c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:49.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f3fff700 1 --2- 172.21.15.44:0/1581114432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99f4071640 0x7f99f4159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:49.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f97b0700 1 -- 172.21.15.44:0/1581114432 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f99f406cd40 msgr2=0x7f99f40c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:49.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f97b0700 1 --2- 172.21.15.44:0/1581114432 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f99f406cd40 0x7f99f40c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f97b0700 1 -- 172.21.15.44:0/1581114432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99f4071640 msgr2=0x7f99f4159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:49.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f97b0700 1 --2- 172.21.15.44:0/1581114432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99f4071640 0x7f99f4159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f97b0700 1 -- 172.21.15.44:0/1581114432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e80094b0 con 0x7f99f40cea30 2024-09-13T18:27:49.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f97b0700 1 --2- 172.21.15.44:0/1581114432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99f40cea30 0x7f99f4143c00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f99ec007e40 tx=0x7f99ec00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:49.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f17fa700 1 -- 172.21.15.44:0/1581114432 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec00dd20 con 0x7f99f40cea30 2024-09-13T18:27:49.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f17fa700 1 -- 172.21.15.44:0/1581114432 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ec00f040 con 0x7f99f40cea30 2024-09-13T18:27:49.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f9fb1700 1 -- 172.21.15.44:0/1581114432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f4159480 con 0x7f99f40cea30 2024-09-13T18:27:49.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f17fa700 1 -- 172.21.15.44:0/1581114432 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec00dea0 con 0x7f99f40cea30 2024-09-13T18:27:49.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f9fb1700 1 -- 172.21.15.44:0/1581114432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f4158400 con 0x7f99f40cea30 2024-09-13T18:27:49.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.338+0000 7f99f9fb1700 1 -- 172.21.15.44:0/1581114432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f41599a0 con 0x7f99f40cea30 2024-09-13T18:27:49.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.342+0000 7f99f17fa700 1 -- 172.21.15.44:0/1581114432 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f99ec003c80 con 0x7f99f40cea30 2024-09-13T18:27:49.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.342+0000 7f99f17fa700 1 --2- 172.21.15.44:0/1581114432 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f99d8066730 0x7f99d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:49.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.342+0000 7f99f17fa700 1 -- 172.21.15.44:0/1581114432 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f99ec0842e0 con 0x7f99f40cea30 2024-09-13T18:27:49.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.342+0000 7f99f8faf700 1 --2- 172.21.15.44:0/1581114432 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f99d8066730 0x7f99d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:49.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.342+0000 7f99f8faf700 1 --2- 172.21.15.44:0/1581114432 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f99d8066730 0x7f99d8068bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f99e80090b0 tx=0x7f99e8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:49.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.346+0000 7f99f17fa700 1 -- 172.21.15.44:0/1581114432 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f99f41599a0 con 0x7f99f40cea30 2024-09-13T18:27:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.518+0000 7f99f9fb1700 1 -- 172.21.15.44:0/1581114432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f99f41599a0 con 0x7f99f40cea30 2024-09-13T18:27:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.518+0000 7f99f17fa700 1 -- 172.21.15.44:0/1581114432 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f99f41599a0 con 0x7f99f40cea30 2024-09-13T18:27:49.524 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:27:49.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.518+0000 7f99f9fb1700 1 -- 172.21.15.44:0/1581114432 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f99d8066730 msgr2=0x7f99d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.522+0000 7f99f9fb1700 1 --2- 172.21.15.44:0/1581114432 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f99d8066730 0x7f99d8068bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f99e80090b0 tx=0x7f99e8008030 comp rx=0 tx=0).stop 2024-09-13T18:27:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.522+0000 7f99f9fb1700 1 -- 172.21.15.44:0/1581114432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99f40cea30 msgr2=0x7f99f4143c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.522+0000 7f99f9fb1700 1 --2- 172.21.15.44:0/1581114432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99f40cea30 0x7f99f4143c00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f99ec007e40 tx=0x7f99ec00d3b0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.522+0000 7f99f9fb1700 1 -- 172.21.15.44:0/1581114432 shutdown_connections 2024-09-13T18:27:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.522+0000 7f99f9fb1700 1 --2- 172.21.15.44:0/1581114432 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f99d8066730 0x7f99d8068bf0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.522+0000 7f99f9fb1700 1 --2- 172.21.15.44:0/1581114432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99f40cea30 0x7f99f4143c00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.522+0000 7f99f9fb1700 1 --2- 172.21.15.44:0/1581114432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99f4071640 0x7f99f4159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.522+0000 7f99f9fb1700 1 --2- 172.21.15.44:0/1581114432 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f99f406cd40 0x7f99f40c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.522+0000 7f99f9fb1700 1 -- 172.21.15.44:0/1581114432 >> 172.21.15.44:0/1581114432 conn(0x7f99f40cf420 msgr2=0x7f99f415c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.522+0000 7f99f9fb1700 1 -- 172.21.15.44:0/1581114432 shutdown_connections 2024-09-13T18:27:49.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.522+0000 7f99f9fb1700 1 -- 172.21.15.44:0/1581114432 wait complete. 2024-09-13T18:27:49.539 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:27:49.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.658+0000 7f18fe6f7700 1 Processor -- start 2024-09-13T18:27:49.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.658+0000 7f18fe6f7700 1 -- start start 2024-09-13T18:27:49.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.658+0000 7f18fe6f7700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f18f8159760 0x7f18f80b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.658+0000 7f18fe6f7700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f18f8070bf0 0x7f18f8072120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.658+0000 7f18fe6f7700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f8072660 con 0x7f18f806cdd0 2024-09-13T18:27:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.658+0000 7f18fe6f7700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f8071d00 con 0x7f18f8159760 2024-09-13T18:27:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.658+0000 7f18fe6f7700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f8071080 con 0x7f18f8070bf0 2024-09-13T18:27:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.658+0000 7f18fd6f5700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f18f8159760 0x7f18f80b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.658+0000 7f18fd6f5700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f18f8159760 0x7f18f80b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36730/0 (socket says 172.21.15.44:36730) 2024-09-13T18:27:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.658+0000 7f18fd6f5700 1 -- 172.21.15.44:0/4075559855 learned_addr learned my addr 172.21.15.44:0/4075559855 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.658+0000 7f18fcef4700 1 --2- 172.21.15.44:0/4075559855 >> v2:172.21.15.99:3300/0 conn(0x7f18f8070bf0 0x7f18f8072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.658+0000 7f18fd6f5700 1 -- 172.21.15.44:0/4075559855 >> v2:172.21.15.99:3300/0 conn(0x7f18f8070bf0 msgr2=0x7f18f8072120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.658+0000 7f18fd6f5700 1 --2- 172.21.15.44:0/4075559855 >> v2:172.21.15.99:3300/0 conn(0x7f18f8070bf0 0x7f18f8072120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.658+0000 7f18fd6f5700 1 -- 172.21.15.44:0/4075559855 >> v1:172.21.15.99:6789/0 conn(0x7f18f806cdd0 legacy=0x7f18f80ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.658+0000 7f18fd6f5700 1 -- 172.21.15.44:0/4075559855 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f8071360 con 0x7f18f8159760 2024-09-13T18:27:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.662+0000 7f18fcef4700 1 --2- 172.21.15.44:0/4075559855 >> v2:172.21.15.99:3300/0 conn(0x7f18f8070bf0 0x7f18f8072120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:49.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.662+0000 7f18fd6f5700 1 --2- 172.21.15.44:0/4075559855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18f8159760 0x7f18f80b46a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f18f80cc660 tx=0x7f18f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d245fdc4991a507a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:49.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.662+0000 7f18ebfff700 1 -- 172.21.15.44:0/4075559855 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f400e070 con 0x7f18f8159760 2024-09-13T18:27:49.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.662+0000 7f18ebfff700 1 -- 172.21.15.44:0/4075559855 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f400b9c0 con 0x7f18f8159760 2024-09-13T18:27:49.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.662+0000 7f18ebfff700 1 -- 172.21.15.44:0/4075559855 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f400bd70 con 0x7f18f8159760 2024-09-13T18:27:49.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.662+0000 7f18fe6f7700 1 -- 172.21.15.44:0/4075559855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18f8159760 msgr2=0x7f18f80b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:49.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.662+0000 7f18fe6f7700 1 --2- 172.21.15.44:0/4075559855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18f8159760 0x7f18f80b46a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f18f80cc660 tx=0x7f18f400b330 comp rx=0 tx=0).stop 2024-09-13T18:27:49.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.662+0000 7f18fe6f7700 1 -- 172.21.15.44:0/4075559855 shutdown_connections 2024-09-13T18:27:49.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.662+0000 7f18fe6f7700 1 --2- 172.21.15.44:0/4075559855 >> v2:172.21.15.99:3300/0 conn(0x7f18f8070bf0 0x7f18f8072120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.662+0000 7f18fe6f7700 1 --2- 172.21.15.44:0/4075559855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18f8159760 0x7f18f80b46a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.662+0000 7f18fe6f7700 1 -- 172.21.15.44:0/4075559855 >> 172.21.15.44:0/4075559855 conn(0x7f18f80b1810 msgr2=0x7f18f80b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:49.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.662+0000 7f18fe6f7700 1 -- 172.21.15.44:0/4075559855 shutdown_connections 2024-09-13T18:27:49.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.662+0000 7f18fe6f7700 1 -- 172.21.15.44:0/4075559855 wait complete. 2024-09-13T18:27:49.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.662+0000 7f18fe6f7700 1 Processor -- start 2024-09-13T18:27:49.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.662+0000 7f18fe6f7700 1 -- start start 2024-09-13T18:27:49.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18fe6f7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18f806cdd0 0x7f18f814ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:49.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18fe6f7700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18f8159760 0x7f18f8152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:49.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18fe6f7700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f18f8153e10 0x7f18f806aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:49.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18fe6f7700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f8152ff0 con 0x7f18f806cdd0 2024-09-13T18:27:49.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18fe6f7700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f8153370 con 0x7f18f8159760 2024-09-13T18:27:49.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18fe6f7700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f8152d10 con 0x7f18f8153e10 2024-09-13T18:27:49.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18fd6f5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18f806cdd0 0x7f18f814ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:49.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18fd6f5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18f806cdd0 0x7f18f814ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36744/0 (socket says 172.21.15.44:36744) 2024-09-13T18:27:49.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18fd6f5700 1 -- 172.21.15.44:0/2208339196 learned_addr learned my addr 172.21.15.44:0/2208339196 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:49.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18fd6f5700 1 -- 172.21.15.44:0/2208339196 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f18f8153e10 msgr2=0x7f18f806aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:49.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18fdef6700 1 --2- 172.21.15.44:0/2208339196 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f18f8153e10 0x7f18f806aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:49.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18fcef4700 1 --2- 172.21.15.44:0/2208339196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18f8159760 0x7f18f8152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:49.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18fd6f5700 1 --2- 172.21.15.44:0/2208339196 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f18f8153e10 0x7f18f806aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18fd6f5700 1 -- 172.21.15.44:0/2208339196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18f8159760 msgr2=0x7f18f8152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:49.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18fd6f5700 1 --2- 172.21.15.44:0/2208339196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18f8159760 0x7f18f8152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18fd6f5700 1 -- 172.21.15.44:0/2208339196 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f4009b30 con 0x7f18f806cdd0 2024-09-13T18:27:49.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18fcef4700 1 --2- 172.21.15.44:0/2208339196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18f8159760 0x7f18f8152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:49.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18fdef6700 1 --2- 172.21.15.44:0/2208339196 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f18f8153e10 0x7f18f806aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:49.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18fd6f5700 1 --2- 172.21.15.44:0/2208339196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18f806cdd0 0x7f18f814ec70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f18f80727f0 tx=0x7f18f4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:49.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18e9ffb700 1 -- 172.21.15.44:0/2208339196 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f40099b0 con 0x7f18f806cdd0 2024-09-13T18:27:49.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18e9ffb700 1 -- 172.21.15.44:0/2208339196 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f40092e0 con 0x7f18f806cdd0 2024-09-13T18:27:49.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18fe6f7700 1 -- 172.21.15.44:0/2208339196 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f8153610 con 0x7f18f806cdd0 2024-09-13T18:27:49.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18e9ffb700 1 -- 172.21.15.44:0/2208339196 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f401b650 con 0x7f18f806cdd0 2024-09-13T18:27:49.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18fe6f7700 1 -- 172.21.15.44:0/2208339196 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f814f1b0 con 0x7f18f806cdd0 2024-09-13T18:27:49.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.666+0000 7f18fe6f7700 1 -- 172.21.15.44:0/2208339196 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f8153b30 con 0x7f18f806cdd0 2024-09-13T18:27:49.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.670+0000 7f18e9ffb700 1 -- 172.21.15.44:0/2208339196 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f18f401b7b0 con 0x7f18f806cdd0 2024-09-13T18:27:49.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.670+0000 7f18e9ffb700 1 --2- 172.21.15.44:0/2208339196 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f18dc0667b0 0x7f18dc068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:49.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.670+0000 7f18e9ffb700 1 -- 172.21.15.44:0/2208339196 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f18f40859e0 con 0x7f18f806cdd0 2024-09-13T18:27:49.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.670+0000 7f18fcef4700 1 --2- 172.21.15.44:0/2208339196 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f18dc0667b0 0x7f18dc068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:49.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.670+0000 7f18fcef4700 1 --2- 172.21.15.44:0/2208339196 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f18dc0667b0 0x7f18dc068c70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f18f80cc500 tx=0x7f18ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:49.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.678+0000 7f18e9ffb700 1 -- 172.21.15.44:0/2208339196 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f18f4052f60 con 0x7f18f806cdd0 2024-09-13T18:27:49.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.846+0000 7f18fe6f7700 1 -- 172.21.15.44:0/2208339196 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f18f8153b30 con 0x7f18f806cdd0 2024-09-13T18:27:49.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.846+0000 7f18e9ffb700 1 -- 172.21.15.44:0/2208339196 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f18f401f020 con 0x7f18f806cdd0 2024-09-13T18:27:49.851 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:27:49.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.846+0000 7f18fe6f7700 1 -- 172.21.15.44:0/2208339196 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f18dc0667b0 msgr2=0x7f18dc068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:49.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.846+0000 7f18fe6f7700 1 --2- 172.21.15.44:0/2208339196 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f18dc0667b0 0x7f18dc068c70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f18f80cc500 tx=0x7f18ec008040 comp rx=0 tx=0).stop 2024-09-13T18:27:49.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.846+0000 7f18fe6f7700 1 -- 172.21.15.44:0/2208339196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18f806cdd0 msgr2=0x7f18f814ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:49.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.846+0000 7f18fe6f7700 1 --2- 172.21.15.44:0/2208339196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18f806cdd0 0x7f18f814ec70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f18f80727f0 tx=0x7f18f4004af0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.846+0000 7f18fe6f7700 1 -- 172.21.15.44:0/2208339196 shutdown_connections 2024-09-13T18:27:49.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.846+0000 7f18fe6f7700 1 --2- 172.21.15.44:0/2208339196 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f18dc0667b0 0x7f18dc068c70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.846+0000 7f18fe6f7700 1 --2- 172.21.15.44:0/2208339196 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f18f8153e10 0x7f18f806aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.846+0000 7f18fe6f7700 1 --2- 172.21.15.44:0/2208339196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18f8159760 0x7f18f8152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.846+0000 7f18fe6f7700 1 --2- 172.21.15.44:0/2208339196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18f806cdd0 0x7f18f814ec70 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.846+0000 7f18fe6f7700 1 -- 172.21.15.44:0/2208339196 >> 172.21.15.44:0/2208339196 conn(0x7f18f80b1810 msgr2=0x7f18f80ae910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:49.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.846+0000 7f18fe6f7700 1 -- 172.21.15.44:0/2208339196 shutdown_connections 2024-09-13T18:27:49.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.846+0000 7f18fe6f7700 1 -- 172.21.15.44:0/2208339196 wait complete. 2024-09-13T18:27:49.866 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:27:49.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.982+0000 7f19c5348700 1 Processor -- start 2024-09-13T18:27:49.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.982+0000 7f19c5348700 1 -- start start 2024-09-13T18:27:49.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.982+0000 7f19c5348700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f19c015cda0 0x7f19c006b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:49.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.982+0000 7f19c5348700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f19c006a520 0x7f19c006a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:49.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.982+0000 7f19c5348700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c00b8430 con 0x7f19c00ceb70 2024-09-13T18:27:49.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.982+0000 7f19c5348700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c006be40 con 0x7f19c006a520 2024-09-13T18:27:49.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.982+0000 7f19c5348700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c00b64f0 con 0x7f19c015cda0 2024-09-13T18:27:49.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19bf7fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f19c00ceb70 0x7f19c00b5de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45226/0 (socket says 172.21.15.44:45226) 2024-09-13T18:27:49.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19bf7fe700 1 -- 172.21.15.44:0/2766715003 learned_addr learned my addr 172.21.15.44:0/2766715003 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:49.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19c4b47700 1 --2- 172.21.15.44:0/2766715003 >> v2:172.21.15.44:3300/0 conn(0x7f19c006a520 0x7f19c006a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:49.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19bffff700 1 --2- 172.21.15.44:0/2766715003 >> v2:172.21.15.99:3300/0 conn(0x7f19c015cda0 0x7f19c006b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:49.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19beffd700 1 -- 172.21.15.44:0/2766715003 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3306303588 0 0) 0x7f19c00b8430 con 0x7f19c00ceb70 2024-09-13T18:27:49.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19beffd700 1 -- 172.21.15.44:0/2766715003 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19a80035d0 con 0x7f19c00ceb70 2024-09-13T18:27:49.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19c4b47700 1 -- 172.21.15.44:0/2766715003 >> v2:172.21.15.99:3300/0 conn(0x7f19c015cda0 msgr2=0x7f19c006b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:49.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19c4b47700 1 --2- 172.21.15.44:0/2766715003 >> v2:172.21.15.99:3300/0 conn(0x7f19c015cda0 0x7f19c006b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19c4b47700 1 -- 172.21.15.44:0/2766715003 >> v1:172.21.15.44:6789/0 conn(0x7f19c00ceb70 legacy=0x7f19c00b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:49.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19c4b47700 1 -- 172.21.15.44:0/2766715003 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c006ae70 con 0x7f19c006a520 2024-09-13T18:27:49.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19bffff700 1 --2- 172.21.15.44:0/2766715003 >> v2:172.21.15.99:3300/0 conn(0x7f19c015cda0 0x7f19c006b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:49.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19c4b47700 1 --2- 172.21.15.44:0/2766715003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19c006a520 0x7f19c006a930 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f19c00d0800 tx=0x7f19b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1eccace1a56b3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:49.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19beffd700 1 -- 172.21.15.44:0/2766715003 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b800e070 con 0x7f19c006a520 2024-09-13T18:27:49.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19beffd700 1 -- 172.21.15.44:0/2766715003 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b800bb20 con 0x7f19c006a520 2024-09-13T18:27:49.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19beffd700 1 -- 172.21.15.44:0/2766715003 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b8012430 con 0x7f19c006a520 2024-09-13T18:27:49.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19c5348700 1 -- 172.21.15.44:0/2766715003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19c006a520 msgr2=0x7f19c006a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:49.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19c5348700 1 --2- 172.21.15.44:0/2766715003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19c006a520 0x7f19c006a930 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f19c00d0800 tx=0x7f19b800b330 comp rx=0 tx=0).stop 2024-09-13T18:27:49.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19c5348700 1 -- 172.21.15.44:0/2766715003 shutdown_connections 2024-09-13T18:27:49.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19c5348700 1 --2- 172.21.15.44:0/2766715003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19c006a520 0x7f19c006a930 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19c5348700 1 --2- 172.21.15.44:0/2766715003 >> v2:172.21.15.99:3300/0 conn(0x7f19c015cda0 0x7f19c006b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19c5348700 1 -- 172.21.15.44:0/2766715003 >> 172.21.15.44:0/2766715003 conn(0x7f19c00d2cb0 msgr2=0x7f19c00d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:49.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19c5348700 1 -- 172.21.15.44:0/2766715003 shutdown_connections 2024-09-13T18:27:49.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19c5348700 1 -- 172.21.15.44:0/2766715003 wait complete. 2024-09-13T18:27:49.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19c5348700 1 Processor -- start 2024-09-13T18:27:49.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.986+0000 7f19c5348700 1 -- start start 2024-09-13T18:27:49.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.990+0000 7f19c5348700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19c006a520 0x7f19c00c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:49.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.990+0000 7f19c5348700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19c00ceb70 0x7f19c00c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:49.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.990+0000 7f19c5348700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19c015cda0 0x7f19c01f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:49.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.990+0000 7f19c5348700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c00c9b20 con 0x7f19c006a520 2024-09-13T18:27:49.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.990+0000 7f19c5348700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c00c6ef0 con 0x7f19c015cda0 2024-09-13T18:27:49.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.990+0000 7f19c5348700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c00c61c0 con 0x7f19c00ceb70 2024-09-13T18:27:49.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.990+0000 7f19bffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19c006a520 0x7f19c00c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:49.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.990+0000 7f19bffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19c006a520 0x7f19c00c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36770/0 (socket says 172.21.15.44:36770) 2024-09-13T18:27:49.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.990+0000 7f19bffff700 1 -- 172.21.15.44:0/2136041572 learned_addr learned my addr 172.21.15.44:0/2136041572 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:49.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.990+0000 7f19bf7fe700 1 --2- 172.21.15.44:0/2136041572 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19c00ceb70 0x7f19c00c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:49.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.990+0000 7f19c4b47700 1 --2- 172.21.15.44:0/2136041572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19c015cda0 0x7f19c01f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:49.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.990+0000 7f19bffff700 1 -- 172.21.15.44:0/2136041572 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19c00ceb70 msgr2=0x7f19c00c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:49.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.990+0000 7f19bffff700 1 --2- 172.21.15.44:0/2136041572 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19c00ceb70 0x7f19c00c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.990+0000 7f19bffff700 1 -- 172.21.15.44:0/2136041572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19c015cda0 msgr2=0x7f19c01f1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:49.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.990+0000 7f19bffff700 1 --2- 172.21.15.44:0/2136041572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19c015cda0 0x7f19c01f1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:49.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.990+0000 7f19bffff700 1 -- 172.21.15.44:0/2136041572 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b40094b0 con 0x7f19c006a520 2024-09-13T18:27:49.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.990+0000 7f19c4b47700 1 --2- 172.21.15.44:0/2136041572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19c015cda0 0x7f19c01f1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:49.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.990+0000 7f19bffff700 1 --2- 172.21.15.44:0/2136041572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19c006a520 0x7f19c00c69b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f19b400ebe0 tx=0x7f19b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:49.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.990+0000 7f19bcff9700 1 -- 172.21.15.44:0/2136041572 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b400c8b0 con 0x7f19c006a520 2024-09-13T18:27:49.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.990+0000 7f19bcff9700 1 -- 172.21.15.44:0/2136041572 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b400ca10 con 0x7f19c006a520 2024-09-13T18:27:49.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.990+0000 7f19c5348700 1 -- 172.21.15.44:0/2136041572 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b8009a70 con 0x7f19c006a520 2024-09-13T18:27:49.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.990+0000 7f19bcff9700 1 -- 172.21.15.44:0/2136041572 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b400cda0 con 0x7f19c006a520 2024-09-13T18:27:49.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.990+0000 7f19c5348700 1 -- 172.21.15.44:0/2136041572 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c01f2000 con 0x7f19c006a520 2024-09-13T18:27:50.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.994+0000 7f19c5348700 1 -- 172.21.15.44:0/2136041572 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c00d1120 con 0x7f19c006a520 2024-09-13T18:27:50.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.994+0000 7f19bcff9700 1 -- 172.21.15.44:0/2136041572 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f19b4013470 con 0x7f19c006a520 2024-09-13T18:27:50.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.994+0000 7f19bcff9700 1 --2- 172.21.15.44:0/2136041572 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f19ac066730 0x7f19ac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:50.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.994+0000 7f19bcff9700 1 -- 172.21.15.44:0/2136041572 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f19b4084140 con 0x7f19c006a520 2024-09-13T18:27:50.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.994+0000 7f19bf7fe700 1 --2- 172.21.15.44:0/2136041572 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f19ac066730 0x7f19ac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:50.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:49.994+0000 7f19bf7fe700 1 --2- 172.21.15.44:0/2136041572 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f19ac066730 0x7f19ac068bf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f19b00011e0 tx=0x7f19b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:50.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.002+0000 7f19bcff9700 1 -- 172.21.15.44:0/2136041572 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f19b4051430 con 0x7f19c006a520 2024-09-13T18:27:50.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.194+0000 7f19c5348700 1 -- 172.21.15.44:0/2136041572 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f19c01f2000 con 0x7f19c006a520 2024-09-13T18:27:50.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.194+0000 7f19bcff9700 1 -- 172.21.15.44:0/2136041572 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f19c01f2000 con 0x7f19c006a520 2024-09-13T18:27:50.201 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:27:50.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.198+0000 7f19c5348700 1 -- 172.21.15.44:0/2136041572 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f19ac066730 msgr2=0x7f19ac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:50.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.198+0000 7f19c5348700 1 --2- 172.21.15.44:0/2136041572 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f19ac066730 0x7f19ac068bf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f19b00011e0 tx=0x7f19b0009040 comp rx=0 tx=0).stop 2024-09-13T18:27:50.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.198+0000 7f19c5348700 1 -- 172.21.15.44:0/2136041572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19c006a520 msgr2=0x7f19c00c69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:50.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.198+0000 7f19c5348700 1 --2- 172.21.15.44:0/2136041572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19c006a520 0x7f19c00c69b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f19b400ebe0 tx=0x7f19b4009e30 comp rx=0 tx=0).stop 2024-09-13T18:27:50.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.198+0000 7f19c5348700 1 -- 172.21.15.44:0/2136041572 shutdown_connections 2024-09-13T18:27:50.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.198+0000 7f19c5348700 1 --2- 172.21.15.44:0/2136041572 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f19ac066730 0x7f19ac068bf0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.198+0000 7f19c5348700 1 --2- 172.21.15.44:0/2136041572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19c015cda0 0x7f19c01f1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.198+0000 7f19c5348700 1 --2- 172.21.15.44:0/2136041572 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19c00ceb70 0x7f19c00c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.198+0000 7f19c5348700 1 --2- 172.21.15.44:0/2136041572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19c006a520 0x7f19c00c69b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.198+0000 7f19c5348700 1 -- 172.21.15.44:0/2136041572 >> 172.21.15.44:0/2136041572 conn(0x7f19c00d2cb0 msgr2=0x7f19c00b6660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:50.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.198+0000 7f19c5348700 1 -- 172.21.15.44:0/2136041572 shutdown_connections 2024-09-13T18:27:50.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.198+0000 7f19c5348700 1 -- 172.21.15.44:0/2136041572 wait complete. 2024-09-13T18:27:50.217 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:27:50.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.330+0000 7fca69c06700 1 Processor -- start 2024-09-13T18:27:50.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.330+0000 7fca69c06700 1 -- start start 2024-09-13T18:27:50.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.330+0000 7fca69c06700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fca6406b900 0x7fca640b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:50.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.330+0000 7fca69c06700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fca6406a520 0x7fca6406a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:50.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.330+0000 7fca69c06700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca640b8430 con 0x7fca6415cda0 2024-09-13T18:27:50.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.330+0000 7fca69c06700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca6406ae90 con 0x7fca6406b900 2024-09-13T18:27:50.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.330+0000 7fca69c06700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6406bd60 con 0x7fca6406a520 2024-09-13T18:27:50.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.330+0000 7fca63fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fca6406b900 0x7fca640b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:50.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.330+0000 7fca69405700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fca6406a520 0x7fca6406a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:50.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.330+0000 7fca68c04700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fca6415cda0 0x7fca640ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:41146/0 (socket says 172.21.15.44:41146) 2024-09-13T18:27:50.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.330+0000 7fca68c04700 1 -- 172.21.15.44:0/2075355118 learned_addr learned my addr 172.21.15.44:0/2075355118 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:50.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.330+0000 7fca637fe700 1 -- 172.21.15.44:0/2075355118 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210530597 0 0) 0x7fca640b8430 con 0x7fca6415cda0 2024-09-13T18:27:50.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.330+0000 7fca637fe700 1 -- 172.21.15.44:0/2075355118 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca540035d0 con 0x7fca6415cda0 2024-09-13T18:27:50.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.330+0000 7fca63fff700 1 -- 172.21.15.44:0/2075355118 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fca6406a520 msgr2=0x7fca6406a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:50.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.330+0000 7fca63fff700 1 --2- 172.21.15.44:0/2075355118 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fca6406a520 0x7fca6406a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.330+0000 7fca63fff700 1 -- 172.21.15.44:0/2075355118 >> v1:172.21.15.99:6789/0 conn(0x7fca6415cda0 legacy=0x7fca640ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:50.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.330+0000 7fca63fff700 1 -- 172.21.15.44:0/2075355118 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca640cf350 con 0x7fca6406b900 2024-09-13T18:27:50.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.330+0000 7fca69405700 1 --2- 172.21.15.44:0/2075355118 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fca6406a520 0x7fca6406a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:50.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.330+0000 7fca63fff700 1 --2- 172.21.15.44:0/2075355118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca6406b900 0x7fca640b5de0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fca50009850 tx=0x7fca50009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985315e50c3aeafc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:50.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.330+0000 7fca637fe700 1 -- 172.21.15.44:0/2075355118 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50011830 con 0x7fca6406b900 2024-09-13T18:27:50.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.330+0000 7fca637fe700 1 -- 172.21.15.44:0/2075355118 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca50011990 con 0x7fca6406b900 2024-09-13T18:27:50.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.330+0000 7fca637fe700 1 -- 172.21.15.44:0/2075355118 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50011d40 con 0x7fca6406b900 2024-09-13T18:27:50.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.334+0000 7fca69c06700 1 -- 172.21.15.44:0/2075355118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca6406b900 msgr2=0x7fca640b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:50.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.334+0000 7fca69c06700 1 --2- 172.21.15.44:0/2075355118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca6406b900 0x7fca640b5de0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fca50009850 tx=0x7fca50009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:50.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.334+0000 7fca69c06700 1 -- 172.21.15.44:0/2075355118 shutdown_connections 2024-09-13T18:27:50.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.334+0000 7fca69c06700 1 --2- 172.21.15.44:0/2075355118 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fca6406a520 0x7fca6406a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.334+0000 7fca69c06700 1 --2- 172.21.15.44:0/2075355118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca6406b900 0x7fca640b5de0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.334+0000 7fca69c06700 1 -- 172.21.15.44:0/2075355118 >> 172.21.15.44:0/2075355118 conn(0x7fca640d2cb0 msgr2=0x7fca640d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:50.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.334+0000 7fca69c06700 1 -- 172.21.15.44:0/2075355118 shutdown_connections 2024-09-13T18:27:50.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.334+0000 7fca69c06700 1 -- 172.21.15.44:0/2075355118 wait complete. 2024-09-13T18:27:50.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.334+0000 7fca69c06700 1 Processor -- start 2024-09-13T18:27:50.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.334+0000 7fca69c06700 1 -- start start 2024-09-13T18:27:50.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.334+0000 7fca69c06700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca6406a520 0x7fca641511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:50.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.334+0000 7fca69c06700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca6406b900 0x7fca6415fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:50.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.334+0000 7fca69c06700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fca6415cda0 0x7fca640cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:50.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.334+0000 7fca69c06700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca640ca790 con 0x7fca6406a520 2024-09-13T18:27:50.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.334+0000 7fca69c06700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca641516e0 con 0x7fca6406b900 2024-09-13T18:27:50.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.334+0000 7fca69c06700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca64160060 con 0x7fca6415cda0 2024-09-13T18:27:50.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.334+0000 7fca68c04700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca6406a520 0x7fca641511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:50.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.334+0000 7fca68c04700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca6406a520 0x7fca641511a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36774/0 (socket says 172.21.15.44:36774) 2024-09-13T18:27:50.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.334+0000 7fca68c04700 1 -- 172.21.15.44:0/631022313 learned_addr learned my addr 172.21.15.44:0/631022313 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:50.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.338+0000 7fca63fff700 1 --2- 172.21.15.44:0/631022313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca6406b900 0x7fca6415fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:50.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.338+0000 7fca69405700 1 --2- 172.21.15.44:0/631022313 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fca6415cda0 0x7fca640cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:50.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.338+0000 7fca68c04700 1 -- 172.21.15.44:0/631022313 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fca6415cda0 msgr2=0x7fca640cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:50.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.338+0000 7fca68c04700 1 --2- 172.21.15.44:0/631022313 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fca6415cda0 0x7fca640cbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.338+0000 7fca68c04700 1 -- 172.21.15.44:0/631022313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca6406b900 msgr2=0x7fca6415fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:50.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.338+0000 7fca68c04700 1 --2- 172.21.15.44:0/631022313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca6406b900 0x7fca6415fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.338+0000 7fca68c04700 1 -- 172.21.15.44:0/631022313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c009a70 con 0x7fca6406a520 2024-09-13T18:27:50.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.338+0000 7fca69405700 1 --2- 172.21.15.44:0/631022313 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fca6415cda0 0x7fca640cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:50.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.338+0000 7fca68c04700 1 --2- 172.21.15.44:0/631022313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca6406a520 0x7fca641511a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fca5800c4d0 tx=0x7fca5800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:50.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.338+0000 7fca617fa700 1 -- 172.21.15.44:0/631022313 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca58005d90 con 0x7fca6406a520 2024-09-13T18:27:50.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.338+0000 7fca617fa700 1 -- 172.21.15.44:0/631022313 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca580070d0 con 0x7fca6406a520 2024-09-13T18:27:50.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.338+0000 7fca69c06700 1 -- 172.21.15.44:0/631022313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca500094b0 con 0x7fca6406a520 2024-09-13T18:27:50.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.338+0000 7fca617fa700 1 -- 172.21.15.44:0/631022313 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca58007480 con 0x7fca6406a520 2024-09-13T18:27:50.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.338+0000 7fca69c06700 1 -- 172.21.15.44:0/631022313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca640ca9a0 con 0x7fca6406a520 2024-09-13T18:27:50.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.338+0000 7fca69c06700 1 -- 172.21.15.44:0/631022313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca6406a950 con 0x7fca6406a520 2024-09-13T18:27:50.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.338+0000 7fca617fa700 1 -- 172.21.15.44:0/631022313 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fca580075e0 con 0x7fca6406a520 2024-09-13T18:27:50.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.338+0000 7fca617fa700 1 --2- 172.21.15.44:0/631022313 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fca48066730 0x7fca48068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:50.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.338+0000 7fca617fa700 1 -- 172.21.15.44:0/631022313 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fca580836a0 con 0x7fca6406a520 2024-09-13T18:27:50.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.338+0000 7fca63fff700 1 --2- 172.21.15.44:0/631022313 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fca48066730 0x7fca48068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:50.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.342+0000 7fca63fff700 1 --2- 172.21.15.44:0/631022313 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fca48066730 0x7fca48068bf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fca500090b0 tx=0x7fca50008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:50.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.346+0000 7fca617fa700 1 -- 172.21.15.44:0/631022313 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fca58050990 con 0x7fca6406a520 2024-09-13T18:27:50.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.526+0000 7fca69c06700 1 -- 172.21.15.44:0/631022313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fca6415c340 con 0x7fca6406a520 2024-09-13T18:27:50.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.526+0000 7fca617fa700 1 -- 172.21.15.44:0/631022313 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fca58053fb0 con 0x7fca6406a520 2024-09-13T18:27:50.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.530+0000 7fca69c06700 1 -- 172.21.15.44:0/631022313 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fca48066730 msgr2=0x7fca48068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:50.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.530+0000 7fca69c06700 1 --2- 172.21.15.44:0/631022313 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fca48066730 0x7fca48068bf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fca500090b0 tx=0x7fca50008030 comp rx=0 tx=0).stop 2024-09-13T18:27:50.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.530+0000 7fca69c06700 1 -- 172.21.15.44:0/631022313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca6406a520 msgr2=0x7fca641511a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:50.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.530+0000 7fca69c06700 1 --2- 172.21.15.44:0/631022313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca6406a520 0x7fca641511a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fca5800c4d0 tx=0x7fca5800c7e0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.530+0000 7fca69c06700 1 -- 172.21.15.44:0/631022313 shutdown_connections 2024-09-13T18:27:50.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.530+0000 7fca69c06700 1 --2- 172.21.15.44:0/631022313 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fca48066730 0x7fca48068bf0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.530+0000 7fca69c06700 1 --2- 172.21.15.44:0/631022313 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fca6415cda0 0x7fca640cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.530+0000 7fca69c06700 1 --2- 172.21.15.44:0/631022313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca6406b900 0x7fca6415fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.530+0000 7fca69c06700 1 --2- 172.21.15.44:0/631022313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca6406a520 0x7fca641511a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.530+0000 7fca69c06700 1 -- 172.21.15.44:0/631022313 >> 172.21.15.44:0/631022313 conn(0x7fca640d2cb0 msgr2=0x7fca640b7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:50.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.530+0000 7fca69c06700 1 -- 172.21.15.44:0/631022313 shutdown_connections 2024-09-13T18:27:50.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.530+0000 7fca69c06700 1 -- 172.21.15.44:0/631022313 wait complete. 2024-09-13T18:27:50.538 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-13T18:27:50.551 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi099.front.sepia.ceph.com... 2024-09-13T18:27:50.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:50.551 DEBUG:teuthology.orchestra.run.smithi099:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-09-13T18:27:50.569 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:27:50.569 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:27:50.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:50.570 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T18:27:50.616 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:27:50.617 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:27:50.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.722+0000 7eff659c8700 1 Processor -- start 2024-09-13T18:27:50.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.722+0000 7eff659c8700 1 -- start start 2024-09-13T18:27:50.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.722+0000 7eff659c8700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff6015cd80 0x7eff6006baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:50.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.722+0000 7eff659c8700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7eff6006a640 0x7eff6006aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:50.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.722+0000 7eff659c8700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6015d160 con 0x7eff6006afa0 2024-09-13T18:27:50.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.722+0000 7eff659c8700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff600d1570 con 0x7eff6006a640 2024-09-13T18:27:50.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.722+0000 7eff659c8700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6006b450 con 0x7eff6015cd80 2024-09-13T18:27:50.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.722+0000 7eff651c7700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7eff6006afa0 0x7eff600b5e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45236/0 (socket says 172.21.15.44:45236) 2024-09-13T18:27:50.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.722+0000 7eff651c7700 1 -- 172.21.15.44:0/4078063263 learned_addr learned my addr 172.21.15.44:0/4078063263 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:50.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.722+0000 7eff5ffff700 1 --2- 172.21.15.44:0/4078063263 >> v2:172.21.15.99:3300/0 conn(0x7eff6006a640 0x7eff6006aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:50.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.722+0000 7eff649c6700 1 --2- 172.21.15.44:0/4078063263 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff6015cd80 0x7eff6006baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:50.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.722+0000 7eff5f7fe700 1 -- 172.21.15.44:0/4078063263 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3542210340 0 0) 0x7eff6015d160 con 0x7eff6006afa0 2024-09-13T18:27:50.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.722+0000 7eff5f7fe700 1 -- 172.21.15.44:0/4078063263 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff480035d0 con 0x7eff6006afa0 2024-09-13T18:27:50.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.722+0000 7eff5ffff700 1 -- 172.21.15.44:0/4078063263 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff6015cd80 msgr2=0x7eff6006baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:50.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.722+0000 7eff5ffff700 1 --2- 172.21.15.44:0/4078063263 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff6015cd80 0x7eff6006baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.722+0000 7eff5ffff700 1 -- 172.21.15.44:0/4078063263 >> v1:172.21.15.44:6789/0 conn(0x7eff6006afa0 legacy=0x7eff600b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:50.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.722+0000 7eff5ffff700 1 -- 172.21.15.44:0/4078063263 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff600d2120 con 0x7eff6006a640 2024-09-13T18:27:50.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.722+0000 7eff649c6700 1 --2- 172.21.15.44:0/4078063263 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff6015cd80 0x7eff6006baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.722+0000 7eff5ffff700 1 --2- 172.21.15.44:0/4078063263 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff6006a640 0x7eff6006aa60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7eff54009850 tx=0x7eff54009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=439892d39d3df792 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.722+0000 7eff5f7fe700 1 -- 172.21.15.44:0/4078063263 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff54011830 con 0x7eff6006a640 2024-09-13T18:27:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.722+0000 7eff5f7fe700 1 -- 172.21.15.44:0/4078063263 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff54011990 con 0x7eff6006a640 2024-09-13T18:27:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.722+0000 7eff5f7fe700 1 -- 172.21.15.44:0/4078063263 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff54011d00 con 0x7eff6006a640 2024-09-13T18:27:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.726+0000 7eff659c8700 1 -- 172.21.15.44:0/4078063263 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff6006a640 msgr2=0x7eff6006aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.726+0000 7eff659c8700 1 --2- 172.21.15.44:0/4078063263 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff6006a640 0x7eff6006aa60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7eff54009850 tx=0x7eff54009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.726+0000 7eff659c8700 1 -- 172.21.15.44:0/4078063263 shutdown_connections 2024-09-13T18:27:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.726+0000 7eff659c8700 1 --2- 172.21.15.44:0/4078063263 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff6006a640 0x7eff6006aa60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.726+0000 7eff659c8700 1 --2- 172.21.15.44:0/4078063263 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff6015cd80 0x7eff6006baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.726+0000 7eff659c8700 1 -- 172.21.15.44:0/4078063263 >> 172.21.15.44:0/4078063263 conn(0x7eff600d30b0 msgr2=0x7eff600d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.726+0000 7eff659c8700 1 -- 172.21.15.44:0/4078063263 shutdown_connections 2024-09-13T18:27:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.726+0000 7eff659c8700 1 -- 172.21.15.44:0/4078063263 wait complete. 2024-09-13T18:27:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.726+0000 7eff659c8700 1 Processor -- start 2024-09-13T18:27:50.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.726+0000 7eff659c8700 1 -- start start 2024-09-13T18:27:50.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff659c8700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff6006a640 0x7eff601f2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:50.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff659c8700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff6006afa0 0x7eff60156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:50.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff659c8700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff6015cd80 0x7eff6015e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:50.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff659c8700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff600b1cd0 con 0x7eff6006afa0 2024-09-13T18:27:50.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff659c8700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff601f22f0 con 0x7eff6006a640 2024-09-13T18:27:50.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff659c8700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff60159930 con 0x7eff6015cd80 2024-09-13T18:27:50.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff5ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff6006afa0 0x7eff60156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:50.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff649c6700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff6006a640 0x7eff601f2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:50.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff5ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff6006afa0 0x7eff60156910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36782/0 (socket says 172.21.15.44:36782) 2024-09-13T18:27:50.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff5ffff700 1 -- 172.21.15.44:0/509408024 learned_addr learned my addr 172.21.15.44:0/509408024 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:50.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff651c7700 1 --2- 172.21.15.44:0/509408024 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff6015cd80 0x7eff6015e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:50.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff5ffff700 1 -- 172.21.15.44:0/509408024 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff6015cd80 msgr2=0x7eff6015e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:50.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff5ffff700 1 --2- 172.21.15.44:0/509408024 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff6015cd80 0x7eff6015e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff5ffff700 1 -- 172.21.15.44:0/509408024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff6006a640 msgr2=0x7eff601f2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:50.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff5ffff700 1 --2- 172.21.15.44:0/509408024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff6006a640 0x7eff601f2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff5ffff700 1 -- 172.21.15.44:0/509408024 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff500094b0 con 0x7eff6006afa0 2024-09-13T18:27:50.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff649c6700 1 --2- 172.21.15.44:0/509408024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff6006a640 0x7eff601f2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:50.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff5ffff700 1 --2- 172.21.15.44:0/509408024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff6006afa0 0x7eff60156910 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7eff54013000 tx=0x7eff54004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:50.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff5d7fa700 1 -- 172.21.15.44:0/509408024 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff540044d0 con 0x7eff6006afa0 2024-09-13T18:27:50.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff5d7fa700 1 -- 172.21.15.44:0/509408024 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5401f070 con 0x7eff6006afa0 2024-09-13T18:27:50.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff659c8700 1 -- 172.21.15.44:0/509408024 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff540094b0 con 0x7eff6006afa0 2024-09-13T18:27:50.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff5d7fa700 1 -- 172.21.15.44:0/509408024 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff540038e0 con 0x7eff6006afa0 2024-09-13T18:27:50.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff659c8700 1 -- 172.21.15.44:0/509408024 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff601f2640 con 0x7eff6006afa0 2024-09-13T18:27:50.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.730+0000 7eff659c8700 1 -- 172.21.15.44:0/509408024 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff601f2ab0 con 0x7eff6006afa0 2024-09-13T18:27:50.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.734+0000 7eff5d7fa700 1 -- 172.21.15.44:0/509408024 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7eff54003a40 con 0x7eff6006afa0 2024-09-13T18:27:50.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.734+0000 7eff5d7fa700 1 --2- 172.21.15.44:0/509408024 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7eff4c066730 0x7eff4c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:50.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.734+0000 7eff5d7fa700 1 -- 172.21.15.44:0/509408024 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7eff54021070 con 0x7eff6006afa0 2024-09-13T18:27:50.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.734+0000 7eff649c6700 1 --2- 172.21.15.44:0/509408024 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7eff4c066730 0x7eff4c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:50.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.734+0000 7eff649c6700 1 --2- 172.21.15.44:0/509408024 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7eff4c066730 0x7eff4c068bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7eff500113d0 tx=0x7eff50009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:50.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.738+0000 7eff5d7fa700 1 -- 172.21.15.44:0/509408024 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7eff601f2ab0 con 0x7eff6006afa0 2024-09-13T18:27:50.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.942+0000 7eff659c8700 1 -- 172.21.15.44:0/509408024 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff601f2ab0 con 0x7eff6006afa0 2024-09-13T18:27:50.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.946+0000 7eff5d7fa700 1 -- 172.21.15.44:0/509408024 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4725 (secure 0 0 0) 0x7eff601f2ab0 con 0x7eff6006afa0 2024-09-13T18:27:50.950 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:50.950 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2616086834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2616086834},{"type":"v1","addr":"172.21.15.99:6835","nonce":2616086834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/2083799524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2083799524},{"type":"v1","addr":"172.21.15.99:6837","nonce":2083799524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/369871675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":369871675},{"type":"v1","addr":"172.21.15.44:6833","nonce":369871675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:27:01.277463+0000","modified":"2024-09-13T18:27:04.292778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/1402693416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1402693416},{"type":"v1","addr":"172.21.15.44:6835","nonce":1402693416}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:27:50.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.946+0000 7eff659c8700 1 -- 172.21.15.44:0/509408024 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7eff4c066730 msgr2=0x7eff4c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:50.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.946+0000 7eff659c8700 1 --2- 172.21.15.44:0/509408024 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7eff4c066730 0x7eff4c068bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7eff500113d0 tx=0x7eff50009240 comp rx=0 tx=0).stop 2024-09-13T18:27:50.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.946+0000 7eff659c8700 1 -- 172.21.15.44:0/509408024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff6006afa0 msgr2=0x7eff60156910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:50.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.946+0000 7eff659c8700 1 --2- 172.21.15.44:0/509408024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff6006afa0 0x7eff60156910 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7eff54013000 tx=0x7eff54004770 comp rx=0 tx=0).stop 2024-09-13T18:27:50.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.946+0000 7eff659c8700 1 -- 172.21.15.44:0/509408024 shutdown_connections 2024-09-13T18:27:50.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.946+0000 7eff659c8700 1 --2- 172.21.15.44:0/509408024 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7eff4c066730 0x7eff4c068bf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.946+0000 7eff659c8700 1 --2- 172.21.15.44:0/509408024 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff6015cd80 0x7eff6015e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.946+0000 7eff659c8700 1 --2- 172.21.15.44:0/509408024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff6006afa0 0x7eff60156910 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.946+0000 7eff659c8700 1 --2- 172.21.15.44:0/509408024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff6006a640 0x7eff601f2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.946+0000 7eff659c8700 1 -- 172.21.15.44:0/509408024 >> 172.21.15.44:0/509408024 conn(0x7eff600d30b0 msgr2=0x7eff600b3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:50.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.946+0000 7eff659c8700 1 -- 172.21.15.44:0/509408024 shutdown_connections 2024-09-13T18:27:50.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:50.946+0000 7eff659c8700 1 -- 172.21.15.44:0/509408024 wait complete. 2024-09-13T18:27:50.954 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 7 2024-09-13T18:27:50.971 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:51.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.078+0000 7ffb1ffff700 1 Processor -- start 2024-09-13T18:27:51.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.078+0000 7ffb1ffff700 1 -- start start 2024-09-13T18:27:51.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.078+0000 7ffb1ffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb200b31c0 0x7ffb200b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:51.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.078+0000 7ffb1ffff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffb200cd450 0x7ffb200cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:51.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.078+0000 7ffb1ffff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb200cbe90 con 0x7ffb201517f0 2024-09-13T18:27:51.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.078+0000 7ffb1ffff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb200b3b70 con 0x7ffb200cd450 2024-09-13T18:27:51.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.078+0000 7ffb1ffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2006c6e0 con 0x7ffb200b31c0 2024-09-13T18:27:51.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.078+0000 7ffb1e7fc700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb200b31c0 0x7ffb200b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:51.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.082+0000 7ffb1e7fc700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb200b31c0 0x7ffb200b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:53234/0 (socket says 172.21.15.44:53234) 2024-09-13T18:27:51.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.082+0000 7ffb1f7fe700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffb200cd450 0x7ffb200cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:51.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.082+0000 7ffb1e7fc700 1 -- 172.21.15.44:0/1492319317 learned_addr learned my addr 172.21.15.44:0/1492319317 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:51.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.082+0000 7ffb1e7fc700 1 -- 172.21.15.44:0/1492319317 >> v2:172.21.15.99:3300/0 conn(0x7ffb200cd450 msgr2=0x7ffb200cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:51.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.082+0000 7ffb1e7fc700 1 --2- 172.21.15.44:0/1492319317 >> v2:172.21.15.99:3300/0 conn(0x7ffb200cd450 0x7ffb200cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.082+0000 7ffb1e7fc700 1 -- 172.21.15.44:0/1492319317 >> v1:172.21.15.99:6789/0 conn(0x7ffb201517f0 legacy=0x7ffb200cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:51.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.082+0000 7ffb1e7fc700 1 -- 172.21.15.44:0/1492319317 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2006c9c0 con 0x7ffb200b31c0 2024-09-13T18:27:51.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.082+0000 7ffb1e7fc700 1 --2- 172.21.15.44:0/1492319317 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb200b31c0 0x7ffb200b3630 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009940 tx=0x7ffb08009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbc44cc6da0b6807 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:51.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.082+0000 7ffb1dffb700 1 -- 172.21.15.44:0/1492319317 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb08011830 con 0x7ffb200b31c0 2024-09-13T18:27:51.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.082+0000 7ffb1dffb700 1 -- 172.21.15.44:0/1492319317 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb08011990 con 0x7ffb200b31c0 2024-09-13T18:27:51.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.082+0000 7ffb1dffb700 1 -- 172.21.15.44:0/1492319317 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb08011d20 con 0x7ffb200b31c0 2024-09-13T18:27:51.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.082+0000 7ffb1ffff700 1 -- 172.21.15.44:0/1492319317 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb200b31c0 msgr2=0x7ffb200b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:51.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.082+0000 7ffb1ffff700 1 --2- 172.21.15.44:0/1492319317 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb200b31c0 0x7ffb200b3630 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009940 tx=0x7ffb08009c50 comp rx=0 tx=0).stop 2024-09-13T18:27:51.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.082+0000 7ffb1ffff700 1 -- 172.21.15.44:0/1492319317 shutdown_connections 2024-09-13T18:27:51.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.082+0000 7ffb1ffff700 1 --2- 172.21.15.44:0/1492319317 >> v2:172.21.15.99:3300/0 conn(0x7ffb200cd450 0x7ffb200cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.082+0000 7ffb1ffff700 1 --2- 172.21.15.44:0/1492319317 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb200b31c0 0x7ffb200b3630 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.082+0000 7ffb1ffff700 1 -- 172.21.15.44:0/1492319317 >> 172.21.15.44:0/1492319317 conn(0x7ffb2006d900 msgr2=0x7ffb2006dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:51.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.082+0000 7ffb1ffff700 1 -- 172.21.15.44:0/1492319317 shutdown_connections 2024-09-13T18:27:51.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.082+0000 7ffb1ffff700 1 -- 172.21.15.44:0/1492319317 wait complete. 2024-09-13T18:27:51.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.082+0000 7ffb1ffff700 1 Processor -- start 2024-09-13T18:27:51.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.082+0000 7ffb1ffff700 1 -- start start 2024-09-13T18:27:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.086+0000 7ffb1ffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb200b31c0 0x7ffb200714a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.086+0000 7ffb1ffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb200cd450 0x7ffb200719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.086+0000 7ffb1ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb201517f0 0x7ffb200afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.086+0000 7ffb1ffff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb201f2600 con 0x7ffb201517f0 2024-09-13T18:27:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.086+0000 7ffb1ffff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb20155090 con 0x7ffb200cd450 2024-09-13T18:27:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.086+0000 7ffb1ffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb20154db0 con 0x7ffb200b31c0 2024-09-13T18:27:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.086+0000 7ffb1f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb201517f0 0x7ffb200afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.086+0000 7ffb1f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb201517f0 0x7ffb200afc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36792/0 (socket says 172.21.15.44:36792) 2024-09-13T18:27:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.086+0000 7ffb1f7fe700 1 -- 172.21.15.44:0/1779074857 learned_addr learned my addr 172.21.15.44:0/1779074857 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.086+0000 7ffb1effd700 1 --2- 172.21.15.44:0/1779074857 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb200b31c0 0x7ffb200714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.086+0000 7ffb1e7fc700 1 --2- 172.21.15.44:0/1779074857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb200cd450 0x7ffb200719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.086+0000 7ffb1f7fe700 1 -- 172.21.15.44:0/1779074857 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb200b31c0 msgr2=0x7ffb200714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.086+0000 7ffb1f7fe700 1 --2- 172.21.15.44:0/1779074857 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb200b31c0 0x7ffb200714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.086+0000 7ffb1f7fe700 1 -- 172.21.15.44:0/1779074857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb200cd450 msgr2=0x7ffb200719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:51.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.086+0000 7ffb1f7fe700 1 --2- 172.21.15.44:0/1779074857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb200cd450 0x7ffb200719e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.086+0000 7ffb1f7fe700 1 -- 172.21.15.44:0/1779074857 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb08009570 con 0x7ffb201517f0 2024-09-13T18:27:51.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.086+0000 7ffb1f7fe700 1 --2- 172.21.15.44:0/1779074857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb201517f0 0x7ffb200afc70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800efc0 tx=0x7ffb1800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:51.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.086+0000 7ffb177fe700 1 -- 172.21.15.44:0/1779074857 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb18009ea0 con 0x7ffb201517f0 2024-09-13T18:27:51.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.086+0000 7ffb177fe700 1 -- 172.21.15.44:0/1779074857 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1800f040 con 0x7ffb201517f0 2024-09-13T18:27:51.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.086+0000 7ffb177fe700 1 -- 172.21.15.44:0/1779074857 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1800ced0 con 0x7ffb201517f0 2024-09-13T18:27:51.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.086+0000 7ffb1ffff700 1 -- 172.21.15.44:0/1779074857 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb201f2810 con 0x7ffb201517f0 2024-09-13T18:27:51.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.086+0000 7ffb1ffff700 1 -- 172.21.15.44:0/1779074857 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb201f2dd0 con 0x7ffb201517f0 2024-09-13T18:27:51.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.086+0000 7ffb1ffff700 1 -- 172.21.15.44:0/1779074857 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb20073d10 con 0x7ffb201517f0 2024-09-13T18:27:51.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.090+0000 7ffb177fe700 1 -- 172.21.15.44:0/1779074857 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffb18014480 con 0x7ffb201517f0 2024-09-13T18:27:51.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.090+0000 7ffb177fe700 1 --2- 172.21.15.44:0/1779074857 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ffb04066730 0x7ffb04068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:51.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.090+0000 7ffb177fe700 1 -- 172.21.15.44:0/1779074857 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ffb18084990 con 0x7ffb201517f0 2024-09-13T18:27:51.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.090+0000 7ffb1effd700 1 --2- 172.21.15.44:0/1779074857 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ffb04066730 0x7ffb04068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:51.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.090+0000 7ffb1effd700 1 --2- 172.21.15.44:0/1779074857 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ffb04066730 0x7ffb04068bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffb10000f60 tx=0x7ffb10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:51.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.094+0000 7ffb177fe700 1 -- 172.21.15.44:0/1779074857 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffb18051d30 con 0x7ffb201517f0 2024-09-13T18:27:51.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.266+0000 7ffb1ffff700 1 -- 172.21.15.44:0/1779074857 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb201f2fc0 con 0x7ffb201517f0 2024-09-13T18:27:51.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.266+0000 7ffb177fe700 1 -- 172.21.15.44:0/1779074857 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16695 (secure 0 0 0) 0x7ffb18018070 con 0x7ffb201517f0 2024-09-13T18:27:51.272 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:51.272 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":23,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:43.549975+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:51.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.270+0000 7ffb1ffff700 1 -- 172.21.15.44:0/1779074857 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ffb04066730 msgr2=0x7ffb04068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:51.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.270+0000 7ffb1ffff700 1 --2- 172.21.15.44:0/1779074857 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ffb04066730 0x7ffb04068bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffb10000f60 tx=0x7ffb10009040 comp rx=0 tx=0).stop 2024-09-13T18:27:51.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.270+0000 7ffb1ffff700 1 -- 172.21.15.44:0/1779074857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb201517f0 msgr2=0x7ffb200afc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:51.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.270+0000 7ffb1ffff700 1 --2- 172.21.15.44:0/1779074857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb201517f0 0x7ffb200afc70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800efc0 tx=0x7ffb1800c3a0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.270+0000 7ffb1ffff700 1 -- 172.21.15.44:0/1779074857 shutdown_connections 2024-09-13T18:27:51.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.270+0000 7ffb1ffff700 1 --2- 172.21.15.44:0/1779074857 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ffb04066730 0x7ffb04068bf0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.270+0000 7ffb1ffff700 1 --2- 172.21.15.44:0/1779074857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb201517f0 0x7ffb200afc70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.270+0000 7ffb1ffff700 1 --2- 172.21.15.44:0/1779074857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb200cd450 0x7ffb200719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.270+0000 7ffb1ffff700 1 --2- 172.21.15.44:0/1779074857 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb200b31c0 0x7ffb200714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.270+0000 7ffb1ffff700 1 -- 172.21.15.44:0/1779074857 >> 172.21.15.44:0/1779074857 conn(0x7ffb2006d900 msgr2=0x7ffb20158a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:51.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.270+0000 7ffb1ffff700 1 -- 172.21.15.44:0/1779074857 shutdown_connections 2024-09-13T18:27:51.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.270+0000 7ffb1ffff700 1 -- 172.21.15.44:0/1779074857 wait complete. 2024-09-13T18:27:51.288 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:26:59.478511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:27:00.261038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:27:51.288 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:27:51.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.398+0000 7f1855a42700 1 Processor -- start 2024-09-13T18:27:51.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.398+0000 7f1855a42700 1 -- start start 2024-09-13T18:27:51.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.398+0000 7f1855a42700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f185006a520 0x7f185006a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:51.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.398+0000 7f1855a42700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18500b8430 con 0x7f185015cda0 2024-09-13T18:27:51.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.398+0000 7f1855a42700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f185006ae70 con 0x7f185006b900 2024-09-13T18:27:51.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.398+0000 7f1855a42700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18500b64f0 con 0x7f185006a520 2024-09-13T18:27:51.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f1855241700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f185006a520 0x7f185006a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:51.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f1854a40700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f185015cda0 0x7f18500ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45250/0 (socket says 172.21.15.44:45250) 2024-09-13T18:27:51.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f1854a40700 1 -- 172.21.15.44:0/2919471533 learned_addr learned my addr 172.21.15.44:0/2919471533 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:51.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f1855241700 1 -- 172.21.15.44:0/2919471533 >> v1:172.21.15.99:6789/0 conn(0x7f185006b900 legacy=0x7f18500b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:51.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f1855241700 1 -- 172.21.15.44:0/2919471533 >> v1:172.21.15.44:6789/0 conn(0x7f185015cda0 legacy=0x7f18500ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:51.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f1855241700 1 -- 172.21.15.44:0/2919471533 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185006bd60 con 0x7f185006a520 2024-09-13T18:27:51.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f184f7fe700 1 -- 172.21.15.44:0/2919471533 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3732006255 0 0) 0x7f18500b8430 con 0x7f185015cda0 2024-09-13T18:27:51.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f1855241700 1 --2- 172.21.15.44:0/2919471533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f185006a520 0x7f185006a930 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1848009d90 tx=0x7f184800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0854add1bedaf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:51.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f184f7fe700 1 -- 172.21.15.44:0/2919471533 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184800e070 con 0x7f185006a520 2024-09-13T18:27:51.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f184f7fe700 1 -- 172.21.15.44:0/2919471533 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184800bbd0 con 0x7f185006a520 2024-09-13T18:27:51.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f184f7fe700 1 -- 172.21.15.44:0/2919471533 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1848012430 con 0x7f185006a520 2024-09-13T18:27:51.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f1855a42700 1 -- 172.21.15.44:0/2919471533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f185006a520 msgr2=0x7f185006a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:51.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f1855a42700 1 --2- 172.21.15.44:0/2919471533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f185006a520 0x7f185006a930 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1848009d90 tx=0x7f184800b330 comp rx=0 tx=0).stop 2024-09-13T18:27:51.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f1855a42700 1 -- 172.21.15.44:0/2919471533 shutdown_connections 2024-09-13T18:27:51.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f1855a42700 1 --2- 172.21.15.44:0/2919471533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f185006a520 0x7f185006a930 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f1855a42700 1 -- 172.21.15.44:0/2919471533 >> 172.21.15.44:0/2919471533 conn(0x7f18500d2cb0 msgr2=0x7f18500d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:51.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f1855a42700 1 -- 172.21.15.44:0/2919471533 shutdown_connections 2024-09-13T18:27:51.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f1855a42700 1 -- 172.21.15.44:0/2919471533 wait complete. 2024-09-13T18:27:51.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f1855a42700 1 Processor -- start 2024-09-13T18:27:51.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f1855a42700 1 -- start start 2024-09-13T18:27:51.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f1855a42700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f185006a520 0x7f18501efc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:51.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f1855a42700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f185006b900 0x7f18501f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:51.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f1855a42700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f185015cda0 0x7f18500c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:51.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f1855a42700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18500c6580 con 0x7f185015cda0 2024-09-13T18:27:51.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f1855a42700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18500c8f00 con 0x7f185006a520 2024-09-13T18:27:51.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.402+0000 7f1855a42700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18501f3540 con 0x7f185006b900 2024-09-13T18:27:51.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.406+0000 7f1855241700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f185015cda0 0x7f18500c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:51.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.406+0000 7f1854a40700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f185006a520 0x7f18501efc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:51.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.406+0000 7f184ffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f185006b900 0x7f18501f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:51.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.406+0000 7f1854a40700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f185006a520 0x7f18501efc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:54648/0 (socket says 172.21.15.44:54648) 2024-09-13T18:27:51.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.406+0000 7f1855241700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f185015cda0 0x7f18500c9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36818/0 (socket says 172.21.15.44:36818) 2024-09-13T18:27:51.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.406+0000 7f184ffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f185006b900 0x7f18501f3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:53252/0 (socket says 172.21.15.44:53252) 2024-09-13T18:27:51.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.406+0000 7f1854a40700 1 -- 172.21.15.44:0/3861305845 learned_addr learned my addr 172.21.15.44:0/3861305845 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:51.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.406+0000 7f184ffff700 1 -- 172.21.15.44:0/3861305845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f185006a520 msgr2=0x7f18501efc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:51.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.406+0000 7f184ffff700 1 --2- 172.21.15.44:0/3861305845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f185006a520 0x7f18501efc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.406+0000 7f184ffff700 1 -- 172.21.15.44:0/3861305845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f185015cda0 msgr2=0x7f18500c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:51.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.406+0000 7f184ffff700 1 --2- 172.21.15.44:0/3861305845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f185015cda0 0x7f18500c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.406+0000 7f184ffff700 1 -- 172.21.15.44:0/3861305845 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1848009a70 con 0x7f185006b900 2024-09-13T18:27:51.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.406+0000 7f184ffff700 1 --2- 172.21.15.44:0/3861305845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f185006b900 0x7f18501f3000 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f183800c480 tx=0x7f183800c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:51.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.406+0000 7f184d7fa700 1 -- 172.21.15.44:0/3861305845 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18380052d0 con 0x7f185006b900 2024-09-13T18:27:51.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.406+0000 7f184d7fa700 1 -- 172.21.15.44:0/3861305845 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1838005430 con 0x7f185006b900 2024-09-13T18:27:51.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.406+0000 7f1855a42700 1 -- 172.21.15.44:0/3861305845 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18500c82f0 con 0x7f185006b900 2024-09-13T18:27:51.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.406+0000 7f184d7fa700 1 -- 172.21.15.44:0/3861305845 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18380055a0 con 0x7f185006b900 2024-09-13T18:27:51.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.406+0000 7f1855a42700 1 -- 172.21.15.44:0/3861305845 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18500c88b0 con 0x7f185006b900 2024-09-13T18:27:51.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.406+0000 7f1855a42700 1 -- 172.21.15.44:0/3861305845 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18500c9070 con 0x7f185006b900 2024-09-13T18:27:51.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.410+0000 7f184d7fa700 1 -- 172.21.15.44:0/3861305845 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f18380038e0 con 0x7f185006b900 2024-09-13T18:27:51.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.410+0000 7f184d7fa700 1 --2- 172.21.15.44:0/3861305845 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1834066760 0x7f1834068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:51.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.410+0000 7f184d7fa700 1 -- 172.21.15.44:0/3861305845 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f18380833e0 con 0x7f185006b900 2024-09-13T18:27:51.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.410+0000 7f1854a40700 1 --2- 172.21.15.44:0/3861305845 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1834066760 0x7f1834068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:51.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.410+0000 7f1854a40700 1 --2- 172.21.15.44:0/3861305845 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1834066760 0x7f1834068c20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f18400012d0 tx=0x7f1840007c40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:51.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.418+0000 7f184d7fa700 1 -- 172.21.15.44:0/3861305845 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1838050760 con 0x7f185006b900 2024-09-13T18:27:51.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.582+0000 7f1855a42700 1 -- 172.21.15.44:0/3861305845 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f18500d1120 con 0x7f185006b900 2024-09-13T18:27:51.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.586+0000 7f184d7fa700 1 -- 172.21.15.44:0/3861305845 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f183805a070 con 0x7f185006b900 2024-09-13T18:27:51.591 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:27:51.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.590+0000 7f1855a42700 1 -- 172.21.15.44:0/3861305845 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1834066760 msgr2=0x7f1834068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:51.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.590+0000 7f1855a42700 1 --2- 172.21.15.44:0/3861305845 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1834066760 0x7f1834068c20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f18400012d0 tx=0x7f1840007c40 comp rx=0 tx=0).stop 2024-09-13T18:27:51.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.590+0000 7f1855a42700 1 -- 172.21.15.44:0/3861305845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f185006b900 msgr2=0x7f18501f3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:51.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.590+0000 7f1855a42700 1 --2- 172.21.15.44:0/3861305845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f185006b900 0x7f18501f3000 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f183800c480 tx=0x7f183800c790 comp rx=0 tx=0).stop 2024-09-13T18:27:51.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.590+0000 7f1855a42700 1 -- 172.21.15.44:0/3861305845 shutdown_connections 2024-09-13T18:27:51.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.590+0000 7f1855a42700 1 --2- 172.21.15.44:0/3861305845 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1834066760 0x7f1834068c20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.590+0000 7f1855a42700 1 --2- 172.21.15.44:0/3861305845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f185015cda0 0x7f18500c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.590+0000 7f1855a42700 1 --2- 172.21.15.44:0/3861305845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f185006b900 0x7f18501f3000 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.590+0000 7f1855a42700 1 --2- 172.21.15.44:0/3861305845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f185006a520 0x7f18501efc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.590+0000 7f1855a42700 1 -- 172.21.15.44:0/3861305845 >> 172.21.15.44:0/3861305845 conn(0x7f18500d2cb0 msgr2=0x7f18500ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:51.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.590+0000 7f1855a42700 1 -- 172.21.15.44:0/3861305845 shutdown_connections 2024-09-13T18:27:51.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.590+0000 7f1855a42700 1 -- 172.21.15.44:0/3861305845 wait complete. 2024-09-13T18:27:51.612 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:27:51.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.718+0000 7f703359e700 1 Processor -- start 2024-09-13T18:27:51.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.718+0000 7f703359e700 1 -- start start 2024-09-13T18:27:51.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.718+0000 7f703359e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f703415cda0 0x7f703406b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:51.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.718+0000 7f703359e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70340b8430 con 0x7f70340ceb70 2024-09-13T18:27:51.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.718+0000 7f703359e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70340cf350 con 0x7f703406a520 2024-09-13T18:27:51.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.718+0000 7f703359e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703406be40 con 0x7f703415cda0 2024-09-13T18:27:51.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.722+0000 7f7031d9b700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f70340ceb70 0x7f70340b5de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45254/0 (socket says 172.21.15.44:45254) 2024-09-13T18:27:51.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.722+0000 7f7031d9b700 1 -- 172.21.15.44:0/3556474512 learned_addr learned my addr 172.21.15.44:0/3556474512 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.722+0000 7f703259c700 1 --2- 172.21.15.44:0/3556474512 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f703415cda0 0x7f703406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.722+0000 7f703159a700 1 -- 172.21.15.44:0/3556474512 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236792287 0 0) 0x7f70340b8430 con 0x7f70340ceb70 2024-09-13T18:27:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.722+0000 7f703159a700 1 -- 172.21.15.44:0/3556474512 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f701c0035d0 con 0x7f70340ceb70 2024-09-13T18:27:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.722+0000 7f703159a700 1 -- 172.21.15.44:0/3556474512 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684900612 0 0) 0x7f70340cf350 con 0x7f703406a520 2024-09-13T18:27:51.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.722+0000 7f703159a700 1 -- 172.21.15.44:0/3556474512 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70340b8430 con 0x7f703406a520 2024-09-13T18:27:51.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.722+0000 7f703259c700 1 -- 172.21.15.44:0/3556474512 >> v1:172.21.15.99:6789/0 conn(0x7f703406a520 legacy=0x7f70340d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:51.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.722+0000 7f703159a700 1 -- 172.21.15.44:0/3556474512 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3547920374 0 0) 0x7f701c0035d0 con 0x7f70340ceb70 2024-09-13T18:27:51.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.722+0000 7f703259c700 1 -- 172.21.15.44:0/3556474512 >> v1:172.21.15.44:6789/0 conn(0x7f70340ceb70 legacy=0x7f70340b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:51.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.722+0000 7f703259c700 1 -- 172.21.15.44:0/3556474512 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70340d0880 con 0x7f703415cda0 2024-09-13T18:27:51.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.722+0000 7f703259c700 1 --2- 172.21.15.44:0/3556474512 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f703415cda0 0x7f703406b900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7028009880 tx=0x7f7028009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3bcdbce39154cd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:51.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.722+0000 7f703159a700 1 -- 172.21.15.44:0/3556474512 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70240019f0 con 0x7f703415cda0 2024-09-13T18:27:51.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.722+0000 7f703159a700 1 -- 172.21.15.44:0/3556474512 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7028004030 con 0x7f703415cda0 2024-09-13T18:27:51.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.722+0000 7f703159a700 1 -- 172.21.15.44:0/3556474512 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70280043a0 con 0x7f703415cda0 2024-09-13T18:27:51.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.722+0000 7f703359e700 1 -- 172.21.15.44:0/3556474512 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f703415cda0 msgr2=0x7f703406b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:51.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.722+0000 7f703359e700 1 --2- 172.21.15.44:0/3556474512 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f703415cda0 0x7f703406b900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7028009880 tx=0x7f7028009b90 comp rx=0 tx=0).stop 2024-09-13T18:27:51.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.722+0000 7f703359e700 1 -- 172.21.15.44:0/3556474512 shutdown_connections 2024-09-13T18:27:51.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.722+0000 7f703359e700 1 --2- 172.21.15.44:0/3556474512 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f703415cda0 0x7f703406b900 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.722+0000 7f703359e700 1 -- 172.21.15.44:0/3556474512 >> 172.21.15.44:0/3556474512 conn(0x7f70340d2cb0 msgr2=0x7f70340d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:51.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.722+0000 7f703359e700 1 -- 172.21.15.44:0/3556474512 shutdown_connections 2024-09-13T18:27:51.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.722+0000 7f703359e700 1 -- 172.21.15.44:0/3556474512 wait complete. 2024-09-13T18:27:51.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f703359e700 1 Processor -- start 2024-09-13T18:27:51.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f703359e700 1 -- start start 2024-09-13T18:27:51.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f703359e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f703406a520 0x7f7034156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:51.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f703359e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f70340ceb70 0x7f7034157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:51.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f703359e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f703415cda0 0x7f70340c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:51.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f703359e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70340c6aa0 con 0x7f703415cda0 2024-09-13T18:27:51.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f703359e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70341578b0 con 0x7f703406a520 2024-09-13T18:27:51.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f703359e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703415f330 con 0x7f70340ceb70 2024-09-13T18:27:51.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f7032d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f703415cda0 0x7f70340c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:51.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f7032d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f703415cda0 0x7f70340c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36820/0 (socket says 172.21.15.44:36820) 2024-09-13T18:27:51.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f7032d9d700 1 -- 172.21.15.44:0/395359768 learned_addr learned my addr 172.21.15.44:0/395359768 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:51.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f703259c700 1 --2- 172.21.15.44:0/395359768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f703406a520 0x7f7034156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:51.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f7031d9b700 1 --2- 172.21.15.44:0/395359768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f70340ceb70 0x7f7034157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:51.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f7032d9d700 1 -- 172.21.15.44:0/395359768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f70340ceb70 msgr2=0x7f7034157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:51.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f7032d9d700 1 --2- 172.21.15.44:0/395359768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f70340ceb70 0x7f7034157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f7032d9d700 1 -- 172.21.15.44:0/395359768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f703406a520 msgr2=0x7f7034156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:51.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f7032d9d700 1 --2- 172.21.15.44:0/395359768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f703406a520 0x7f7034156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f7032d9d700 1 -- 172.21.15.44:0/395359768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70280094b0 con 0x7f703415cda0 2024-09-13T18:27:51.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f703259c700 1 --2- 172.21.15.44:0/395359768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f703406a520 0x7f7034156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:51.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f7032d9d700 1 --2- 172.21.15.44:0/395359768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f703415cda0 0x7f70340c8bd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f702c00c530 tx=0x7f702c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:51.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f7022ffd700 1 -- 172.21.15.44:0/395359768 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c0052d0 con 0x7f703415cda0 2024-09-13T18:27:51.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f7022ffd700 1 -- 172.21.15.44:0/395359768 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c005430 con 0x7f703415cda0 2024-09-13T18:27:51.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f703359e700 1 -- 172.21.15.44:0/395359768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703415f610 con 0x7f703415cda0 2024-09-13T18:27:51.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f7022ffd700 1 -- 172.21.15.44:0/395359768 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c0055a0 con 0x7f703415cda0 2024-09-13T18:27:51.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.726+0000 7f703359e700 1 -- 172.21.15.44:0/395359768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703415fbd0 con 0x7f703415cda0 2024-09-13T18:27:51.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.730+0000 7f703359e700 1 -- 172.21.15.44:0/395359768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70340cefb0 con 0x7f703415cda0 2024-09-13T18:27:51.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.730+0000 7f7022ffd700 1 -- 172.21.15.44:0/395359768 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f702c0038e0 con 0x7f703415cda0 2024-09-13T18:27:51.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.730+0000 7f7022ffd700 1 --2- 172.21.15.44:0/395359768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7014066730 0x7f7014068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:51.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.730+0000 7f7022ffd700 1 -- 172.21.15.44:0/395359768 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f702c0835b0 con 0x7f703415cda0 2024-09-13T18:27:51.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.730+0000 7f703259c700 1 --2- 172.21.15.44:0/395359768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7014066730 0x7f7014068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:51.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.734+0000 7f703259c700 1 --2- 172.21.15.44:0/395359768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7014066730 0x7f7014068bf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f70280097d0 tx=0x7f7028010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:51.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.742+0000 7f7022ffd700 1 -- 172.21.15.44:0/395359768 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f70340cefb0 con 0x7f703415cda0 2024-09-13T18:27:51.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.902+0000 7f703359e700 1 -- 172.21.15.44:0/395359768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f70340c6c50 con 0x7f703415cda0 2024-09-13T18:27:51.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.902+0000 7f7022ffd700 1 -- 172.21.15.44:0/395359768 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f70340c6c50 con 0x7f703415cda0 2024-09-13T18:27:51.910 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:27:51.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.906+0000 7f703359e700 1 -- 172.21.15.44:0/395359768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7014066730 msgr2=0x7f7014068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:51.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.906+0000 7f703359e700 1 --2- 172.21.15.44:0/395359768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7014066730 0x7f7014068bf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f70280097d0 tx=0x7f7028010000 comp rx=0 tx=0).stop 2024-09-13T18:27:51.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.906+0000 7f703359e700 1 -- 172.21.15.44:0/395359768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f703415cda0 msgr2=0x7f70340c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:51.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.906+0000 7f703359e700 1 --2- 172.21.15.44:0/395359768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f703415cda0 0x7f70340c8bd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f702c00c530 tx=0x7f702c00c840 comp rx=0 tx=0).stop 2024-09-13T18:27:51.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.906+0000 7f703359e700 1 -- 172.21.15.44:0/395359768 shutdown_connections 2024-09-13T18:27:51.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.906+0000 7f703359e700 1 --2- 172.21.15.44:0/395359768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7014066730 0x7f7014068bf0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.906+0000 7f703359e700 1 --2- 172.21.15.44:0/395359768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f703415cda0 0x7f70340c8bd0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.906+0000 7f703359e700 1 --2- 172.21.15.44:0/395359768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f70340ceb70 0x7f7034157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.906+0000 7f703359e700 1 --2- 172.21.15.44:0/395359768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f703406a520 0x7f7034156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.906+0000 7f703359e700 1 -- 172.21.15.44:0/395359768 >> 172.21.15.44:0/395359768 conn(0x7f70340d2cb0 msgr2=0x7f70340d1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:51.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.906+0000 7f703359e700 1 -- 172.21.15.44:0/395359768 shutdown_connections 2024-09-13T18:27:51.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:51.906+0000 7f703359e700 1 -- 172.21.15.44:0/395359768 wait complete. 2024-09-13T18:27:51.924 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:27:52.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.034+0000 7fe423fff700 1 Processor -- start 2024-09-13T18:27:52.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.034+0000 7fe423fff700 1 -- start start 2024-09-13T18:27:52.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.034+0000 7fe423fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe424159760 0x7fe4240b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:52.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.034+0000 7fe423fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe42406d4e0 0x7fe424072120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:52.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.034+0000 7fe423fff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe424072660 con 0x7fe424070bf0 2024-09-13T18:27:52.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.034+0000 7fe423fff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe424071d00 con 0x7fe424159760 2024-09-13T18:27:52.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.034+0000 7fe423fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe424071080 con 0x7fe42406d4e0 2024-09-13T18:27:52.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.034+0000 7fe422ffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe424159760 0x7fe4240b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:52.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.034+0000 7fe422ffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe424159760 0x7fe4240b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41110/0 (socket says 172.21.15.44:41110) 2024-09-13T18:27:52.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.034+0000 7fe422ffd700 1 -- 172.21.15.44:0/1590395170 learned_addr learned my addr 172.21.15.44:0/1590395170 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:52.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.038+0000 7fe4237fe700 1 --2- 172.21.15.44:0/1590395170 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe42406d4e0 0x7fe424072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:52.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.038+0000 7fe422ffd700 1 -- 172.21.15.44:0/1590395170 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe42406d4e0 msgr2=0x7fe424072120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:52.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.038+0000 7fe422ffd700 1 --2- 172.21.15.44:0/1590395170 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe42406d4e0 0x7fe424072120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.038+0000 7fe422ffd700 1 -- 172.21.15.44:0/1590395170 >> v1:172.21.15.99:6789/0 conn(0x7fe424070bf0 legacy=0x7fe42406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:52.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.038+0000 7fe422ffd700 1 -- 172.21.15.44:0/1590395170 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe424071360 con 0x7fe424159760 2024-09-13T18:27:52.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.038+0000 7fe422ffd700 1 --2- 172.21.15.44:0/1590395170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe424159760 0x7fe4240b46a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe424072880 tx=0x7fe414009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694d4db57f1e0b39 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:52.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.038+0000 7fe421ffb700 1 -- 172.21.15.44:0/1590395170 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41400b860 con 0x7fe424159760 2024-09-13T18:27:52.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.038+0000 7fe421ffb700 1 -- 172.21.15.44:0/1590395170 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41400b9c0 con 0x7fe424159760 2024-09-13T18:27:52.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.038+0000 7fe421ffb700 1 -- 172.21.15.44:0/1590395170 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41400bd50 con 0x7fe424159760 2024-09-13T18:27:52.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.038+0000 7fe423fff700 1 -- 172.21.15.44:0/1590395170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe424159760 msgr2=0x7fe4240b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:52.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.038+0000 7fe423fff700 1 --2- 172.21.15.44:0/1590395170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe424159760 0x7fe4240b46a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe424072880 tx=0x7fe414009bf0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.038+0000 7fe423fff700 1 -- 172.21.15.44:0/1590395170 shutdown_connections 2024-09-13T18:27:52.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.038+0000 7fe423fff700 1 --2- 172.21.15.44:0/1590395170 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe42406d4e0 0x7fe424072120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.038+0000 7fe423fff700 1 --2- 172.21.15.44:0/1590395170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe424159760 0x7fe4240b46a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.038+0000 7fe423fff700 1 -- 172.21.15.44:0/1590395170 >> 172.21.15.44:0/1590395170 conn(0x7fe4240b1810 msgr2=0x7fe4240b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:52.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.038+0000 7fe423fff700 1 -- 172.21.15.44:0/1590395170 shutdown_connections 2024-09-13T18:27:52.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.038+0000 7fe423fff700 1 -- 172.21.15.44:0/1590395170 wait complete. 2024-09-13T18:27:52.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.042+0000 7fe423fff700 1 Processor -- start 2024-09-13T18:27:52.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.042+0000 7fe423fff700 1 -- start start 2024-09-13T18:27:52.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.042+0000 7fe423fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe42406d4e0 0x7fe42414e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:52.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.042+0000 7fe423fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe424159760 0x7fe424151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:52.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.042+0000 7fe423fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe424152380 0x7fe424154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:52.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.042+0000 7fe423fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4241543d0 con 0x7fe424152380 2024-09-13T18:27:52.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.042+0000 7fe423fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe424152820 con 0x7fe424159760 2024-09-13T18:27:52.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.042+0000 7fe423fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe424152b00 con 0x7fe42406d4e0 2024-09-13T18:27:52.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.042+0000 7fe4237fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe424152380 0x7fe424154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:52.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.042+0000 7fe4237fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe424152380 0x7fe424154e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41126/0 (socket says 172.21.15.44:41126) 2024-09-13T18:27:52.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.042+0000 7fe4237fe700 1 -- 172.21.15.44:0/1495407071 learned_addr learned my addr 172.21.15.44:0/1495407071 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:52.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.042+0000 7fe422ffd700 1 --2- 172.21.15.44:0/1495407071 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe42406d4e0 0x7fe42414e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:52.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.042+0000 7fe4227fc700 1 --2- 172.21.15.44:0/1495407071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe424159760 0x7fe424151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:52.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.042+0000 7fe4237fe700 1 -- 172.21.15.44:0/1495407071 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe42406d4e0 msgr2=0x7fe42414e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:52.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.042+0000 7fe4237fe700 1 --2- 172.21.15.44:0/1495407071 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe42406d4e0 0x7fe42414e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.042+0000 7fe4237fe700 1 -- 172.21.15.44:0/1495407071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe424159760 msgr2=0x7fe424151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:52.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.042+0000 7fe4237fe700 1 --2- 172.21.15.44:0/1495407071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe424159760 0x7fe424151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.042+0000 7fe4237fe700 1 -- 172.21.15.44:0/1495407071 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe414009570 con 0x7fe424152380 2024-09-13T18:27:52.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.042+0000 7fe4237fe700 1 --2- 172.21.15.44:0/1495407071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe424152380 0x7fe424154e20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe41c007e40 tx=0x7fe41c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:52.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.046+0000 7fe40b7fe700 1 -- 172.21.15.44:0/1495407071 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c00ede0 con 0x7fe424152380 2024-09-13T18:27:52.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.046+0000 7fe40b7fe700 1 -- 172.21.15.44:0/1495407071 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41c014420 con 0x7fe424152380 2024-09-13T18:27:52.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.046+0000 7fe423fff700 1 -- 172.21.15.44:0/1495407071 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe424154620 con 0x7fe424152380 2024-09-13T18:27:52.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.046+0000 7fe40b7fe700 1 -- 172.21.15.44:0/1495407071 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0147d0 con 0x7fe424152380 2024-09-13T18:27:52.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.046+0000 7fe423fff700 1 -- 172.21.15.44:0/1495407071 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42414eb60 con 0x7fe424152380 2024-09-13T18:27:52.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.046+0000 7fe40b7fe700 1 -- 172.21.15.44:0/1495407071 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe41c014930 con 0x7fe424152380 2024-09-13T18:27:52.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.046+0000 7fe40b7fe700 1 --2- 172.21.15.44:0/1495407071 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe410066760 0x7fe410068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:52.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.046+0000 7fe423fff700 1 -- 172.21.15.44:0/1495407071 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe42414ed20 con 0x7fe424152380 2024-09-13T18:27:52.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.046+0000 7fe40b7fe700 1 -- 172.21.15.44:0/1495407071 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe41c084930 con 0x7fe424152380 2024-09-13T18:27:52.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.046+0000 7fe422ffd700 1 --2- 172.21.15.44:0/1495407071 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe410066760 0x7fe410068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:52.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.046+0000 7fe422ffd700 1 --2- 172.21.15.44:0/1495407071 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe410066760 0x7fe410068c20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe414014040 tx=0x7fe414008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:52.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.050+0000 7fe40b7fe700 1 -- 172.21.15.44:0/1495407071 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe42414ed20 con 0x7fe424152380 2024-09-13T18:27:52.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.222+0000 7fe423fff700 1 -- 172.21.15.44:0/1495407071 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe42414ed20 con 0x7fe424152380 2024-09-13T18:27:52.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.222+0000 7fe40b7fe700 1 -- 172.21.15.44:0/1495407071 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe42414ed20 con 0x7fe424152380 2024-09-13T18:27:52.229 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:27:52.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.226+0000 7fe423fff700 1 -- 172.21.15.44:0/1495407071 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe410066760 msgr2=0x7fe410068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:52.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.226+0000 7fe423fff700 1 --2- 172.21.15.44:0/1495407071 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe410066760 0x7fe410068c20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe414014040 tx=0x7fe414008030 comp rx=0 tx=0).stop 2024-09-13T18:27:52.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.226+0000 7fe423fff700 1 -- 172.21.15.44:0/1495407071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe424152380 msgr2=0x7fe424154e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:52.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.226+0000 7fe423fff700 1 --2- 172.21.15.44:0/1495407071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe424152380 0x7fe424154e20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe41c007e40 tx=0x7fe41c00e3c0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.226+0000 7fe423fff700 1 -- 172.21.15.44:0/1495407071 shutdown_connections 2024-09-13T18:27:52.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.226+0000 7fe423fff700 1 --2- 172.21.15.44:0/1495407071 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe410066760 0x7fe410068c20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.226+0000 7fe423fff700 1 --2- 172.21.15.44:0/1495407071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe424152380 0x7fe424154e20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.226+0000 7fe423fff700 1 --2- 172.21.15.44:0/1495407071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe424159760 0x7fe424151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.226+0000 7fe423fff700 1 --2- 172.21.15.44:0/1495407071 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe42406d4e0 0x7fe42414e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.226+0000 7fe423fff700 1 -- 172.21.15.44:0/1495407071 >> 172.21.15.44:0/1495407071 conn(0x7fe4240b1810 msgr2=0x7fe4240af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:52.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.226+0000 7fe423fff700 1 -- 172.21.15.44:0/1495407071 shutdown_connections 2024-09-13T18:27:52.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.226+0000 7fe423fff700 1 -- 172.21.15.44:0/1495407071 wait complete. 2024-09-13T18:27:52.244 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:27:52.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.350+0000 7f063759e700 1 Processor -- start 2024-09-13T18:27:52.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.350+0000 7f063759e700 1 -- start start 2024-09-13T18:27:52.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.350+0000 7f063759e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06380b29a0 0x7f06380b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:52.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.350+0000 7f063759e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0638070b30 0x7f0638070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:52.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.350+0000 7f063759e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06380b53c0 con 0x7f0638161eb0 2024-09-13T18:27:52.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.350+0000 7f063759e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06380714e0 con 0x7f0638070b30 2024-09-13T18:27:52.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.350+0000 7f063759e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06380b3460 con 0x7f06380b29a0 2024-09-13T18:27:52.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.350+0000 7f063659c700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0638161eb0 0x7f06380b4cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54520/0 (socket says 172.21.15.44:54520) 2024-09-13T18:27:52.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.350+0000 7f063659c700 1 -- 172.21.15.44:0/3973419952 learned_addr learned my addr 172.21.15.44:0/3973419952 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:52.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.350+0000 7f0636d9d700 1 --2- 172.21.15.44:0/3973419952 >> v2:172.21.15.44:3300/0 conn(0x7f0638070b30 0x7f0638070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:52.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.354+0000 7f062ffff700 1 --2- 172.21.15.44:0/3973419952 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06380b29a0 0x7f06380b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:52.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.354+0000 7f0635d9b700 1 -- 172.21.15.44:0/3973419952 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398359254 0 0) 0x7f06380b53c0 con 0x7f0638161eb0 2024-09-13T18:27:52.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.354+0000 7f0635d9b700 1 -- 172.21.15.44:0/3973419952 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06240035d0 con 0x7f0638161eb0 2024-09-13T18:27:52.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.354+0000 7f062ffff700 1 -- 172.21.15.44:0/3973419952 >> v2:172.21.15.44:3300/0 conn(0x7f0638070b30 msgr2=0x7f0638070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:52.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.354+0000 7f062ffff700 1 --2- 172.21.15.44:0/3973419952 >> v2:172.21.15.44:3300/0 conn(0x7f0638070b30 0x7f0638070fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.354+0000 7f062ffff700 1 -- 172.21.15.44:0/3973419952 >> v1:172.21.15.44:6789/0 conn(0x7f0638161eb0 legacy=0x7f06380b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:52.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.354+0000 7f062ffff700 1 -- 172.21.15.44:0/3973419952 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06380b3740 con 0x7f06380b29a0 2024-09-13T18:27:52.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.354+0000 7f062ffff700 1 --2- 172.21.15.44:0/3973419952 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06380b29a0 0x7f06380b2e10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0620009850 tx=0x7f0620009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd50e0c93c6b3831 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:52.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.354+0000 7f0635d9b700 1 -- 172.21.15.44:0/3973419952 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0620011830 con 0x7f06380b29a0 2024-09-13T18:27:52.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.354+0000 7f0635d9b700 1 -- 172.21.15.44:0/3973419952 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0620011990 con 0x7f06380b29a0 2024-09-13T18:27:52.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.354+0000 7f0635d9b700 1 -- 172.21.15.44:0/3973419952 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0620011d00 con 0x7f06380b29a0 2024-09-13T18:27:52.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.354+0000 7f063759e700 1 -- 172.21.15.44:0/3973419952 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06380b29a0 msgr2=0x7f06380b2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:52.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.354+0000 7f063759e700 1 --2- 172.21.15.44:0/3973419952 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06380b29a0 0x7f06380b2e10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0620009850 tx=0x7f0620009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:52.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.354+0000 7f063759e700 1 -- 172.21.15.44:0/3973419952 shutdown_connections 2024-09-13T18:27:52.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.354+0000 7f063759e700 1 --2- 172.21.15.44:0/3973419952 >> v2:172.21.15.44:3300/0 conn(0x7f0638070b30 0x7f0638070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.354+0000 7f063759e700 1 --2- 172.21.15.44:0/3973419952 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06380b29a0 0x7f06380b2e10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.354+0000 7f063759e700 1 -- 172.21.15.44:0/3973419952 >> 172.21.15.44:0/3973419952 conn(0x7f06380b16a0 msgr2=0x7f06380b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:52.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.354+0000 7f063759e700 1 -- 172.21.15.44:0/3973419952 shutdown_connections 2024-09-13T18:27:52.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.354+0000 7f063759e700 1 -- 172.21.15.44:0/3973419952 wait complete. 2024-09-13T18:27:52.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.358+0000 7f063759e700 1 Processor -- start 2024-09-13T18:27:52.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.358+0000 7f063759e700 1 -- start start 2024-09-13T18:27:52.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.358+0000 7f063759e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0638070b30 0x7f063815af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:52.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.358+0000 7f063759e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06380b29a0 0x7f063815d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:52.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.358+0000 7f063759e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0638161eb0 0x7f063815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:52.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f063759e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06381f7730 con 0x7f06380b29a0 2024-09-13T18:27:52.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f063759e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063815b4a0 con 0x7f0638161eb0 2024-09-13T18:27:52.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f063759e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06381f6ab0 con 0x7f0638070b30 2024-09-13T18:27:52.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f062ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06380b29a0 0x7f063815d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:52.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f062ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06380b29a0 0x7f063815d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41146/0 (socket says 172.21.15.44:41146) 2024-09-13T18:27:52.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f062ffff700 1 -- 172.21.15.44:0/1627569712 learned_addr learned my addr 172.21.15.44:0/1627569712 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:52.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f063659c700 1 --2- 172.21.15.44:0/1627569712 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0638070b30 0x7f063815af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:52.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f0636d9d700 1 --2- 172.21.15.44:0/1627569712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0638161eb0 0x7f063815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:52.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f062ffff700 1 -- 172.21.15.44:0/1627569712 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0638070b30 msgr2=0x7f063815af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:52.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f062ffff700 1 --2- 172.21.15.44:0/1627569712 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0638070b30 0x7f063815af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f062ffff700 1 -- 172.21.15.44:0/1627569712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0638161eb0 msgr2=0x7f063815dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:52.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f062ffff700 1 --2- 172.21.15.44:0/1627569712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0638161eb0 0x7f063815dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f062ffff700 1 -- 172.21.15.44:0/1627569712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06200094b0 con 0x7f06380b29a0 2024-09-13T18:27:52.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f0636d9d700 1 --2- 172.21.15.44:0/1627569712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0638161eb0 0x7f063815dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:52.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f062ffff700 1 --2- 172.21.15.44:0/1627569712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06380b29a0 0x7f063815d810 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f06200090b0 tx=0x7f0620004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:52.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f062effd700 1 -- 172.21.15.44:0/1627569712 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0620004550 con 0x7f06380b29a0 2024-09-13T18:27:52.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f062effd700 1 -- 172.21.15.44:0/1627569712 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062001f070 con 0x7f06380b29a0 2024-09-13T18:27:52.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f063759e700 1 -- 172.21.15.44:0/1627569712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06381f6d90 con 0x7f06380b29a0 2024-09-13T18:27:52.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f062effd700 1 -- 172.21.15.44:0/1627569712 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0620003900 con 0x7f06380b29a0 2024-09-13T18:27:52.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f063759e700 1 -- 172.21.15.44:0/1627569712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06381f7350 con 0x7f06380b29a0 2024-09-13T18:27:52.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f063759e700 1 -- 172.21.15.44:0/1627569712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06381f7870 con 0x7f06380b29a0 2024-09-13T18:27:52.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f062effd700 1 -- 172.21.15.44:0/1627569712 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0620003a60 con 0x7f06380b29a0 2024-09-13T18:27:52.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f062effd700 1 --2- 172.21.15.44:0/1627569712 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0618066730 0x7f0618068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:52.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.362+0000 7f062effd700 1 -- 172.21.15.44:0/1627569712 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0620021070 con 0x7f06380b29a0 2024-09-13T18:27:52.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.366+0000 7f063659c700 1 --2- 172.21.15.44:0/1627569712 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0618066730 0x7f0618068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:52.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.366+0000 7f063659c700 1 --2- 172.21.15.44:0/1627569712 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0618066730 0x7f0618068bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0628007fd0 tx=0x7f0628009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:52.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.370+0000 7f062effd700 1 -- 172.21.15.44:0/1627569712 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f06381f7870 con 0x7f06380b29a0 2024-09-13T18:27:52.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.578+0000 7f063759e700 1 -- 172.21.15.44:0/1627569712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06381f7870 con 0x7f06380b29a0 2024-09-13T18:27:52.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.582+0000 7f062effd700 1 -- 172.21.15.44:0/1627569712 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4725 (secure 0 0 0) 0x7f06381f7870 con 0x7f06380b29a0 2024-09-13T18:27:52.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:52.587 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2616086834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2616086834},{"type":"v1","addr":"172.21.15.99:6835","nonce":2616086834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/2083799524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2083799524},{"type":"v1","addr":"172.21.15.99:6837","nonce":2083799524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/369871675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":369871675},{"type":"v1","addr":"172.21.15.44:6833","nonce":369871675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:27:01.277463+0000","modified":"2024-09-13T18:27:04.292778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/1402693416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1402693416},{"type":"v1","addr":"172.21.15.44:6835","nonce":1402693416}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:27:52.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.582+0000 7f063759e700 1 -- 172.21.15.44:0/1627569712 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0618066730 msgr2=0x7f0618068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:52.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.582+0000 7f063759e700 1 --2- 172.21.15.44:0/1627569712 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0618066730 0x7f0618068bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0628007fd0 tx=0x7f0628009040 comp rx=0 tx=0).stop 2024-09-13T18:27:52.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.582+0000 7f063759e700 1 -- 172.21.15.44:0/1627569712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06380b29a0 msgr2=0x7f063815d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:52.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.582+0000 7f063759e700 1 --2- 172.21.15.44:0/1627569712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06380b29a0 0x7f063815d810 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f06200090b0 tx=0x7f0620004770 comp rx=0 tx=0).stop 2024-09-13T18:27:52.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.582+0000 7f063759e700 1 -- 172.21.15.44:0/1627569712 shutdown_connections 2024-09-13T18:27:52.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.582+0000 7f063759e700 1 --2- 172.21.15.44:0/1627569712 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0618066730 0x7f0618068bf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.582+0000 7f063759e700 1 --2- 172.21.15.44:0/1627569712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0638161eb0 0x7f063815dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.582+0000 7f063759e700 1 --2- 172.21.15.44:0/1627569712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06380b29a0 0x7f063815d810 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.582+0000 7f063759e700 1 --2- 172.21.15.44:0/1627569712 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0638070b30 0x7f063815af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.582+0000 7f063759e700 1 -- 172.21.15.44:0/1627569712 >> 172.21.15.44:0/1627569712 conn(0x7f06380b16a0 msgr2=0x7f06380b4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:52.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.582+0000 7f063759e700 1 -- 172.21.15.44:0/1627569712 shutdown_connections 2024-09-13T18:27:52.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.582+0000 7f063759e700 1 -- 172.21.15.44:0/1627569712 wait complete. 2024-09-13T18:27:52.591 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 7 2024-09-13T18:27:52.602 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:52.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.706+0000 7f31bd40a700 1 Processor -- start 2024-09-13T18:27:52.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.706+0000 7f31bd40a700 1 -- start start 2024-09-13T18:27:52.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31bd40a700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f31b8159870 0x7f31b806d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:52.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31bd40a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f31b8070ba0 0x7f31b8070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:52.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31bd40a700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b806c3c0 con 0x7f31b80b3f90 2024-09-13T18:27:52.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31bd40a700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b806dbe0 con 0x7f31b8159870 2024-09-13T18:27:52.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31bd40a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b8071530 con 0x7f31b8070ba0 2024-09-13T18:27:52.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31b77fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f31b80b3f90 0x7f31b806bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54522/0 (socket says 172.21.15.44:54522) 2024-09-13T18:27:52.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31b77fe700 1 -- 172.21.15.44:0/3219308365 learned_addr learned my addr 172.21.15.44:0/3219308365 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:52.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31b7fff700 1 --2- 172.21.15.44:0/3219308365 >> v2:172.21.15.44:3300/0 conn(0x7f31b8159870 0x7f31b806d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:52.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31bcc09700 1 --2- 172.21.15.44:0/3219308365 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f31b8070ba0 0x7f31b8070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:52.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31b6ffd700 1 -- 172.21.15.44:0/3219308365 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243589044 0 0) 0x7f31a8001110 con 0x7f31b80b3f90 2024-09-13T18:27:52.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31b6ffd700 1 -- 172.21.15.44:0/3219308365 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31a00035d0 con 0x7f31b80b3f90 2024-09-13T18:27:52.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31b7fff700 1 -- 172.21.15.44:0/3219308365 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f31b8070ba0 msgr2=0x7f31b8070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:52.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31b7fff700 1 --2- 172.21.15.44:0/3219308365 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f31b8070ba0 0x7f31b8070ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31b7fff700 1 -- 172.21.15.44:0/3219308365 >> v1:172.21.15.44:6789/0 conn(0x7f31b80b3f90 legacy=0x7f31b806bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:52.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31b7fff700 1 -- 172.21.15.44:0/3219308365 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b806c600 con 0x7f31b8159870 2024-09-13T18:27:52.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31b7fff700 1 --2- 172.21.15.44:0/3219308365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31b8159870 0x7f31b806d6a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009850 tx=0x7f31ac009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21607f7a87212e72 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:52.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31b6ffd700 1 -- 172.21.15.44:0/3219308365 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac011830 con 0x7f31b8159870 2024-09-13T18:27:52.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31b6ffd700 1 -- 172.21.15.44:0/3219308365 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ac011990 con 0x7f31b8159870 2024-09-13T18:27:52.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31b6ffd700 1 -- 172.21.15.44:0/3219308365 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac011d00 con 0x7f31b8159870 2024-09-13T18:27:52.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31bd40a700 1 -- 172.21.15.44:0/3219308365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31b8159870 msgr2=0x7f31b806d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:52.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31bd40a700 1 --2- 172.21.15.44:0/3219308365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31b8159870 0x7f31b806d6a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009850 tx=0x7f31ac009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:52.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31bd40a700 1 -- 172.21.15.44:0/3219308365 shutdown_connections 2024-09-13T18:27:52.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31bd40a700 1 --2- 172.21.15.44:0/3219308365 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f31b8070ba0 0x7f31b8070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31bd40a700 1 --2- 172.21.15.44:0/3219308365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31b8159870 0x7f31b806d6a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31bd40a700 1 -- 172.21.15.44:0/3219308365 >> 172.21.15.44:0/3219308365 conn(0x7f31b80b1630 msgr2=0x7f31b80b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:52.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31bd40a700 1 -- 172.21.15.44:0/3219308365 shutdown_connections 2024-09-13T18:27:52.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.710+0000 7f31bd40a700 1 -- 172.21.15.44:0/3219308365 wait complete. 2024-09-13T18:27:52.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31bd40a700 1 Processor -- start 2024-09-13T18:27:52.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31bd40a700 1 -- start start 2024-09-13T18:27:52.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31bd40a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f31b8070ba0 0x7f31b814f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:52.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31bd40a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31b80b3f90 0x7f31b80c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:52.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31bd40a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31b8159870 0x7f31b81f37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:52.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31bd40a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b80c4fe0 con 0x7f31b8159870 2024-09-13T18:27:52.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31bd40a700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b814f760 con 0x7f31b80b3f90 2024-09-13T18:27:52.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31bd40a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b80c4a20 con 0x7f31b8070ba0 2024-09-13T18:27:52.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31bcc09700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31b8159870 0x7f31b81f37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:52.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31bcc09700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31b8159870 0x7f31b81f37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41172/0 (socket says 172.21.15.44:41172) 2024-09-13T18:27:52.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31bcc09700 1 -- 172.21.15.44:0/148889522 learned_addr learned my addr 172.21.15.44:0/148889522 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:52.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31b7fff700 1 --2- 172.21.15.44:0/148889522 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f31b8070ba0 0x7f31b814f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:52.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31b77fe700 1 --2- 172.21.15.44:0/148889522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31b80b3f90 0x7f31b80c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:52.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31bcc09700 1 -- 172.21.15.44:0/148889522 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f31b8070ba0 msgr2=0x7f31b814f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:52.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31bcc09700 1 --2- 172.21.15.44:0/148889522 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f31b8070ba0 0x7f31b814f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31bcc09700 1 -- 172.21.15.44:0/148889522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31b80b3f90 msgr2=0x7f31b80c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:52.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31bcc09700 1 --2- 172.21.15.44:0/148889522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31b80b3f90 0x7f31b80c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31bcc09700 1 -- 172.21.15.44:0/148889522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac0094b0 con 0x7f31b8159870 2024-09-13T18:27:52.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31bcc09700 1 --2- 172.21.15.44:0/148889522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31b8159870 0x7f31b81f37f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f31b000efc0 tx=0x7f31b000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:52.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31b4ff9700 1 -- 172.21.15.44:0/148889522 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b000cd40 con 0x7f31b8159870 2024-09-13T18:27:52.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31b4ff9700 1 -- 172.21.15.44:0/148889522 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b000f040 con 0x7f31b8159870 2024-09-13T18:27:52.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31bd40a700 1 -- 172.21.15.44:0/148889522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b80c4d00 con 0x7f31b8159870 2024-09-13T18:27:52.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31b4ff9700 1 -- 172.21.15.44:0/148889522 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b00146c0 con 0x7f31b8159870 2024-09-13T18:27:52.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.714+0000 7f31bd40a700 1 -- 172.21.15.44:0/148889522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b81553a0 con 0x7f31b8159870 2024-09-13T18:27:52.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.718+0000 7f31b4ff9700 1 -- 172.21.15.44:0/148889522 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f31b0014820 con 0x7f31b8159870 2024-09-13T18:27:52.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.718+0000 7f31bd40a700 1 -- 172.21.15.44:0/148889522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b80b4ea0 con 0x7f31b8159870 2024-09-13T18:27:52.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.718+0000 7f31b4ff9700 1 --2- 172.21.15.44:0/148889522 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f31a4066730 0x7f31a4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:52.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.718+0000 7f31b4ff9700 1 -- 172.21.15.44:0/148889522 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f31b0084df0 con 0x7f31b8159870 2024-09-13T18:27:52.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.718+0000 7f31b7fff700 1 --2- 172.21.15.44:0/148889522 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f31a4066730 0x7f31a4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:52.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.722+0000 7f31b7fff700 1 --2- 172.21.15.44:0/148889522 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f31a4066730 0x7f31a4068bf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0090b0 tx=0x7f31ac008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:52.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.730+0000 7f31b4ff9700 1 -- 172.21.15.44:0/148889522 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f31b00520d0 con 0x7f31b8159870 2024-09-13T18:27:52.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.902+0000 7f31bd40a700 1 -- 172.21.15.44:0/148889522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31b806c970 con 0x7f31b8159870 2024-09-13T18:27:52.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.906+0000 7f31b4ff9700 1 -- 172.21.15.44:0/148889522 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16695 (secure 0 0 0) 0x7f31b0018020 con 0x7f31b8159870 2024-09-13T18:27:52.911 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:52.911 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":23,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:43.549975+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:52.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.906+0000 7f31bd40a700 1 -- 172.21.15.44:0/148889522 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f31a4066730 msgr2=0x7f31a4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:52.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.906+0000 7f31bd40a700 1 --2- 172.21.15.44:0/148889522 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f31a4066730 0x7f31a4068bf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0090b0 tx=0x7f31ac008030 comp rx=0 tx=0).stop 2024-09-13T18:27:52.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.906+0000 7f31bd40a700 1 -- 172.21.15.44:0/148889522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31b8159870 msgr2=0x7f31b81f37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:52.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.906+0000 7f31bd40a700 1 --2- 172.21.15.44:0/148889522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31b8159870 0x7f31b81f37f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f31b000efc0 tx=0x7f31b000c3a0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.906+0000 7f31bd40a700 1 -- 172.21.15.44:0/148889522 shutdown_connections 2024-09-13T18:27:52.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.906+0000 7f31bd40a700 1 --2- 172.21.15.44:0/148889522 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f31a4066730 0x7f31a4068bf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.906+0000 7f31bd40a700 1 --2- 172.21.15.44:0/148889522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31b8159870 0x7f31b81f37f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.906+0000 7f31bd40a700 1 --2- 172.21.15.44:0/148889522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31b80b3f90 0x7f31b80c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.906+0000 7f31bd40a700 1 --2- 172.21.15.44:0/148889522 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f31b8070ba0 0x7f31b814f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.906+0000 7f31bd40a700 1 -- 172.21.15.44:0/148889522 >> 172.21.15.44:0/148889522 conn(0x7f31b80b1630 msgr2=0x7f31b8157b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:52.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.906+0000 7f31bd40a700 1 -- 172.21.15.44:0/148889522 shutdown_connections 2024-09-13T18:27:52.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:52.906+0000 7f31bd40a700 1 -- 172.21.15.44:0/148889522 wait complete. 2024-09-13T18:27:52.927 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:27:52.927 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:27:53.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.030+0000 7f4dc32e0700 1 Processor -- start 2024-09-13T18:27:53.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.030+0000 7f4dc32e0700 1 -- start start 2024-09-13T18:27:53.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.034+0000 7f4dc32e0700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4dbc0b38d0 0x7f4dbc15b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:53.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.034+0000 7f4dc32e0700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dbc06d3f0 con 0x7f4dbc06ea40 2024-09-13T18:27:53.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.034+0000 7f4dc32e0700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dbc151e10 con 0x7f4dbc151a30 2024-09-13T18:27:53.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.034+0000 7f4dc32e0700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc15bea0 con 0x7f4dbc0b38d0 2024-09-13T18:27:53.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.034+0000 7f4dc2adf700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4dbc06ea40 0x7f4dbc0cd530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54536/0 (socket says 172.21.15.44:54536) 2024-09-13T18:27:53.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.034+0000 7f4dc2adf700 1 -- 172.21.15.44:0/3394759849 learned_addr learned my addr 172.21.15.44:0/3394759849 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:53.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.034+0000 7f4dc1add700 1 --2- 172.21.15.44:0/3394759849 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4dbc0b38d0 0x7f4dbc15b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:53.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.034+0000 7f4dc12dc700 1 -- 172.21.15.44:0/3394759849 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905233048 0 0) 0x7f4dbc06d3f0 con 0x7f4dbc06ea40 2024-09-13T18:27:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.034+0000 7f4dc12dc700 1 -- 172.21.15.44:0/3394759849 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4da80035d0 con 0x7f4dbc06ea40 2024-09-13T18:27:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.034+0000 7f4dc12dc700 1 -- 172.21.15.44:0/3394759849 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103361634 0 0) 0x7f4dbc151e10 con 0x7f4dbc151a30 2024-09-13T18:27:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.034+0000 7f4dc12dc700 1 -- 172.21.15.44:0/3394759849 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dbc06d3f0 con 0x7f4dbc151a30 2024-09-13T18:27:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.034+0000 7f4dc1add700 1 -- 172.21.15.44:0/3394759849 >> v1:172.21.15.99:6789/0 conn(0x7f4dbc151a30 legacy=0x7f4dbc0b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.034+0000 7f4dc1add700 1 -- 172.21.15.44:0/3394759849 >> v1:172.21.15.44:6789/0 conn(0x7f4dbc06ea40 legacy=0x7f4dbc0cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.034+0000 7f4dc1add700 1 -- 172.21.15.44:0/3394759849 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc06c540 con 0x7f4dbc0b38d0 2024-09-13T18:27:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.034+0000 7f4dc1add700 1 --2- 172.21.15.44:0/3394759849 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4dbc0b38d0 0x7f4dbc15b960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009880 tx=0x7f4db0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=572ccf59210fdabe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:53.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.034+0000 7f4dc12dc700 1 -- 172.21.15.44:0/3394759849 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db0011830 con 0x7f4dbc0b38d0 2024-09-13T18:27:53.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.034+0000 7f4dc12dc700 1 -- 172.21.15.44:0/3394759849 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db0011990 con 0x7f4dbc0b38d0 2024-09-13T18:27:53.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.034+0000 7f4dc12dc700 1 -- 172.21.15.44:0/3394759849 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db0011d00 con 0x7f4dbc0b38d0 2024-09-13T18:27:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.038+0000 7f4dc32e0700 1 -- 172.21.15.44:0/3394759849 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4dbc0b38d0 msgr2=0x7f4dbc15b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.038+0000 7f4dc32e0700 1 --2- 172.21.15.44:0/3394759849 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4dbc0b38d0 0x7f4dbc15b960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009880 tx=0x7f4db0009b90 comp rx=0 tx=0).stop 2024-09-13T18:27:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.038+0000 7f4dc32e0700 1 -- 172.21.15.44:0/3394759849 shutdown_connections 2024-09-13T18:27:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.038+0000 7f4dc32e0700 1 --2- 172.21.15.44:0/3394759849 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4dbc0b38d0 0x7f4dbc15b960 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.038+0000 7f4dc32e0700 1 -- 172.21.15.44:0/3394759849 >> 172.21.15.44:0/3394759849 conn(0x7f4dbc06d900 msgr2=0x7f4dbc06dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.038+0000 7f4dc32e0700 1 -- 172.21.15.44:0/3394759849 shutdown_connections 2024-09-13T18:27:53.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.038+0000 7f4dc32e0700 1 -- 172.21.15.44:0/3394759849 wait complete. 2024-09-13T18:27:53.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.038+0000 7f4dc32e0700 1 Processor -- start 2024-09-13T18:27:53.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.038+0000 7f4dc32e0700 1 -- start start 2024-09-13T18:27:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4dc32e0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dbc06ea40 0x7f4dbc14ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4dc32e0700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4dbc0b38d0 0x7f4dbc1e31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4dc32e0700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dbc151a30 0x7f4dbc14ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4dc32e0700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc14ac40 con 0x7f4dbc06ea40 2024-09-13T18:27:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4dc32e0700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc1f0880 con 0x7f4dbc151a30 2024-09-13T18:27:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4dc32e0700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc1e3800 con 0x7f4dbc0b38d0 2024-09-13T18:27:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4dc22de700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dbc06ea40 0x7f4dbc14ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4dc22de700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dbc06ea40 0x7f4dbc14ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41174/0 (socket says 172.21.15.44:41174) 2024-09-13T18:27:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4dc22de700 1 -- 172.21.15.44:0/2084651319 learned_addr learned my addr 172.21.15.44:0/2084651319 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4dc2adf700 1 --2- 172.21.15.44:0/2084651319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dbc151a30 0x7f4dbc14ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4dc1add700 1 --2- 172.21.15.44:0/2084651319 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4dbc0b38d0 0x7f4dbc1e31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4dc22de700 1 -- 172.21.15.44:0/2084651319 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4dbc0b38d0 msgr2=0x7f4dbc1e31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4dc22de700 1 --2- 172.21.15.44:0/2084651319 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4dbc0b38d0 0x7f4dbc1e31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4dc22de700 1 -- 172.21.15.44:0/2084651319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dbc151a30 msgr2=0x7f4dbc14ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4dc22de700 1 --2- 172.21.15.44:0/2084651319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dbc151a30 0x7f4dbc14ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4dc22de700 1 -- 172.21.15.44:0/2084651319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db00094b0 con 0x7f4dbc06ea40 2024-09-13T18:27:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4dc2adf700 1 --2- 172.21.15.44:0/2084651319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dbc151a30 0x7f4dbc14ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4dc22de700 1 --2- 172.21.15.44:0/2084651319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dbc06ea40 0x7f4dbc14ae90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4db800c500 tx=0x7f4db800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:53.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4daeffd700 1 -- 172.21.15.44:0/2084651319 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db80052d0 con 0x7f4dbc06ea40 2024-09-13T18:27:53.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4daeffd700 1 -- 172.21.15.44:0/2084651319 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db8005450 con 0x7f4dbc06ea40 2024-09-13T18:27:53.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4daeffd700 1 -- 172.21.15.44:0/2084651319 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db80038e0 con 0x7f4dbc06ea40 2024-09-13T18:27:53.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4dc32e0700 1 -- 172.21.15.44:0/2084651319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dbc1e3ae0 con 0x7f4dbc06ea40 2024-09-13T18:27:53.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4dc32e0700 1 -- 172.21.15.44:0/2084651319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dbc1f0b40 con 0x7f4dbc06ea40 2024-09-13T18:27:53.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.042+0000 7f4dc32e0700 1 -- 172.21.15.44:0/2084651319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dbc073820 con 0x7f4dbc06ea40 2024-09-13T18:27:53.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.046+0000 7f4daeffd700 1 -- 172.21.15.44:0/2084651319 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4db8003a40 con 0x7f4dbc06ea40 2024-09-13T18:27:53.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.046+0000 7f4daeffd700 1 --2- 172.21.15.44:0/2084651319 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4da0066730 0x7f4da0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:53.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.046+0000 7f4daeffd700 1 -- 172.21.15.44:0/2084651319 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4db8083530 con 0x7f4dbc06ea40 2024-09-13T18:27:53.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.046+0000 7f4dc1add700 1 --2- 172.21.15.44:0/2084651319 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4da0066730 0x7f4da0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:53.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.046+0000 7f4dc1add700 1 --2- 172.21.15.44:0/2084651319 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4da0066730 0x7f4da0068bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4db00090b0 tx=0x7f4db0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:53.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.054+0000 7f4daeffd700 1 -- 172.21.15.44:0/2084651319 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4db80508b0 con 0x7f4dbc06ea40 2024-09-13T18:27:53.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.262+0000 7f4dc32e0700 1 -- 172.21.15.44:0/2084651319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4dbc15b960 con 0x7f4dbc06ea40 2024-09-13T18:27:53.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.262+0000 7f4daeffd700 1 -- 172.21.15.44:0/2084651319 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4725 (secure 0 0 0) 0x7f4db8053ed0 con 0x7f4dbc06ea40 2024-09-13T18:27:53.267 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:53.267 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2616086834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2616086834},{"type":"v1","addr":"172.21.15.99:6835","nonce":2616086834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/2083799524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2083799524},{"type":"v1","addr":"172.21.15.99:6837","nonce":2083799524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/369871675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":369871675},{"type":"v1","addr":"172.21.15.44:6833","nonce":369871675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:27:01.277463+0000","modified":"2024-09-13T18:27:04.292778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/1402693416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1402693416},{"type":"v1","addr":"172.21.15.44:6835","nonce":1402693416}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:27:53.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.262+0000 7f4dc32e0700 1 -- 172.21.15.44:0/2084651319 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4da0066730 msgr2=0x7f4da0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:53.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.262+0000 7f4dc32e0700 1 --2- 172.21.15.44:0/2084651319 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4da0066730 0x7f4da0068bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4db00090b0 tx=0x7f4db0010000 comp rx=0 tx=0).stop 2024-09-13T18:27:53.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.262+0000 7f4dc32e0700 1 -- 172.21.15.44:0/2084651319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dbc06ea40 msgr2=0x7f4dbc14ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:53.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.262+0000 7f4dc32e0700 1 --2- 172.21.15.44:0/2084651319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dbc06ea40 0x7f4dbc14ae90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4db800c500 tx=0x7f4db800c810 comp rx=0 tx=0).stop 2024-09-13T18:27:53.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.262+0000 7f4dc32e0700 1 -- 172.21.15.44:0/2084651319 shutdown_connections 2024-09-13T18:27:53.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.262+0000 7f4dc32e0700 1 --2- 172.21.15.44:0/2084651319 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4da0066730 0x7f4da0068bf0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.262+0000 7f4dc32e0700 1 --2- 172.21.15.44:0/2084651319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dbc151a30 0x7f4dbc14ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.262+0000 7f4dc32e0700 1 --2- 172.21.15.44:0/2084651319 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4dbc0b38d0 0x7f4dbc1e31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.262+0000 7f4dc32e0700 1 --2- 172.21.15.44:0/2084651319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dbc06ea40 0x7f4dbc14ae90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.262+0000 7f4dc32e0700 1 -- 172.21.15.44:0/2084651319 >> 172.21.15.44:0/2084651319 conn(0x7f4dbc06d900 msgr2=0x7f4dbc0af090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:53.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.262+0000 7f4dc32e0700 1 -- 172.21.15.44:0/2084651319 shutdown_connections 2024-09-13T18:27:53.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.262+0000 7f4dc32e0700 1 -- 172.21.15.44:0/2084651319 wait complete. 2024-09-13T18:27:53.271 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 7 2024-09-13T18:27:53.283 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:27:53.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.386+0000 7fd00d8f4700 1 Processor -- start 2024-09-13T18:27:53.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.386+0000 7fd00d8f4700 1 -- start start 2024-09-13T18:27:53.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd00d8f4700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd0080b3ae0 0x7fd00806cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:53.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd00d8f4700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd00806aa90 0x7fd0080ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:53.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd00d8f4700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd00806af40 con 0x7fd008159720 2024-09-13T18:27:53.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd00d8f4700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd00806d690 con 0x7fd00806aa90 2024-09-13T18:27:53.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd00d8f4700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0080cbfe0 con 0x7fd0080b3ae0 2024-09-13T18:27:53.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd00c8f2700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd008159720 0x7fd0080b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54550/0 (socket says 172.21.15.44:54550) 2024-09-13T18:27:53.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd00c8f2700 1 -- 172.21.15.44:0/1238779942 learned_addr learned my addr 172.21.15.44:0/1238779942 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:53.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd007fff700 1 --2- 172.21.15.44:0/1238779942 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd0080b3ae0 0x7fd00806cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:53.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd00d0f3700 1 --2- 172.21.15.44:0/1238779942 >> v2:172.21.15.99:3300/0 conn(0x7fd00806aa90 0x7fd0080ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:53.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd0077fe700 1 -- 172.21.15.44:0/1238779942 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3841881601 0 0) 0x7fd00806af40 con 0x7fd008159720 2024-09-13T18:27:53.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd0077fe700 1 -- 172.21.15.44:0/1238779942 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcff40035d0 con 0x7fd008159720 2024-09-13T18:27:53.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd007fff700 1 -- 172.21.15.44:0/1238779942 >> v2:172.21.15.99:3300/0 conn(0x7fd00806aa90 msgr2=0x7fd0080ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:53.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd007fff700 1 --2- 172.21.15.44:0/1238779942 >> v2:172.21.15.99:3300/0 conn(0x7fd00806aa90 0x7fd0080ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd007fff700 1 -- 172.21.15.44:0/1238779942 >> v1:172.21.15.44:6789/0 conn(0x7fd008159720 legacy=0x7fd0080b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:53.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd007fff700 1 -- 172.21.15.44:0/1238779942 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0080cc2c0 con 0x7fd0080b3ae0 2024-09-13T18:27:53.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd007fff700 1 --2- 172.21.15.44:0/1238779942 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd0080b3ae0 0x7fd00806cf90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009850 tx=0x7fcff8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1edeaae7ddd28061 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:53.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd0077fe700 1 -- 172.21.15.44:0/1238779942 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff8011830 con 0x7fd0080b3ae0 2024-09-13T18:27:53.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd0077fe700 1 -- 172.21.15.44:0/1238779942 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff8011990 con 0x7fd0080b3ae0 2024-09-13T18:27:53.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd0077fe700 1 -- 172.21.15.44:0/1238779942 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff8011d40 con 0x7fd0080b3ae0 2024-09-13T18:27:53.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd00d8f4700 1 -- 172.21.15.44:0/1238779942 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd0080b3ae0 msgr2=0x7fd00806cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:53.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd00d8f4700 1 --2- 172.21.15.44:0/1238779942 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd0080b3ae0 0x7fd00806cf90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009850 tx=0x7fcff8009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:53.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd00d8f4700 1 -- 172.21.15.44:0/1238779942 shutdown_connections 2024-09-13T18:27:53.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd00d8f4700 1 --2- 172.21.15.44:0/1238779942 >> v2:172.21.15.99:3300/0 conn(0x7fd00806aa90 0x7fd0080ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd00d8f4700 1 --2- 172.21.15.44:0/1238779942 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd0080b3ae0 0x7fd00806cf90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd00d8f4700 1 -- 172.21.15.44:0/1238779942 >> 172.21.15.44:0/1238779942 conn(0x7fd0080b0f00 msgr2=0x7fd0080b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:53.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd00d8f4700 1 -- 172.21.15.44:0/1238779942 shutdown_connections 2024-09-13T18:27:53.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.390+0000 7fd00d8f4700 1 -- 172.21.15.44:0/1238779942 wait complete. 2024-09-13T18:27:53.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd00d8f4700 1 Processor -- start 2024-09-13T18:27:53.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd00d8f4700 1 -- start start 2024-09-13T18:27:53.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd00d8f4700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd00806aa90 0x7fd00815c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:53.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd00d8f4700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0080b3ae0 0x7fd008150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:53.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd00d8f4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd008159720 0x7fd008145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:53.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd00d8f4700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00815c250 con 0x7fd008159720 2024-09-13T18:27:53.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd00d8f4700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00815b5d0 con 0x7fd0080b3ae0 2024-09-13T18:27:53.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd00d8f4700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00815b8b0 con 0x7fd00806aa90 2024-09-13T18:27:53.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd00d0f3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd008159720 0x7fd008145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:53.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd007fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0080b3ae0 0x7fd008150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:53.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd00c8f2700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd00806aa90 0x7fd00815c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:53.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd00d0f3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd008159720 0x7fd008145000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41184/0 (socket says 172.21.15.44:41184) 2024-09-13T18:27:53.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd00c8f2700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd00806aa90 0x7fd00815c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:45344/0 (socket says 172.21.15.44:45344) 2024-09-13T18:27:53.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd00d0f3700 1 -- 172.21.15.44:0/3061512752 learned_addr learned my addr 172.21.15.44:0/3061512752 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:53.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd00d0f3700 1 -- 172.21.15.44:0/3061512752 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd00806aa90 msgr2=0x7fd00815c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:53.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd00d0f3700 1 --2- 172.21.15.44:0/3061512752 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd00806aa90 0x7fd00815c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd00d0f3700 1 -- 172.21.15.44:0/3061512752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0080b3ae0 msgr2=0x7fd008150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:53.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd00d0f3700 1 --2- 172.21.15.44:0/3061512752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0080b3ae0 0x7fd008150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd00d0f3700 1 -- 172.21.15.44:0/3061512752 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff80094b0 con 0x7fd008159720 2024-09-13T18:27:53.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd00d0f3700 1 --2- 172.21.15.44:0/3061512752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd008159720 0x7fd008145000 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd00000efc0 tx=0x7fd00000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:53.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd0057fa700 1 -- 172.21.15.44:0/3061512752 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd000009ea0 con 0x7fd008159720 2024-09-13T18:27:53.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd0057fa700 1 -- 172.21.15.44:0/3061512752 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00000f040 con 0x7fd008159720 2024-09-13T18:27:53.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd00d8f4700 1 -- 172.21.15.44:0/3061512752 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00815bb90 con 0x7fd008159720 2024-09-13T18:27:53.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd0057fa700 1 -- 172.21.15.44:0/3061512752 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00000ced0 con 0x7fd008159720 2024-09-13T18:27:53.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.394+0000 7fd00d8f4700 1 -- 172.21.15.44:0/3061512752 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd008150bb0 con 0x7fd008159720 2024-09-13T18:27:53.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.398+0000 7fd00d8f4700 1 -- 172.21.15.44:0/3061512752 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd00815c390 con 0x7fd008159720 2024-09-13T18:27:53.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.398+0000 7fd0057fa700 1 -- 172.21.15.44:0/3061512752 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd000014480 con 0x7fd008159720 2024-09-13T18:27:53.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.398+0000 7fd0057fa700 1 --2- 172.21.15.44:0/3061512752 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcfe8066730 0x7fcfe8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:53.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.398+0000 7fd0057fa700 1 -- 172.21.15.44:0/3061512752 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd000084900 con 0x7fd008159720 2024-09-13T18:27:53.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.398+0000 7fd00c8f2700 1 --2- 172.21.15.44:0/3061512752 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcfe8066730 0x7fcfe8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:53.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.398+0000 7fd00c8f2700 1 --2- 172.21.15.44:0/3061512752 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcfe8066730 0x7fcfe8068bf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcff0007fd0 tx=0x7fcff0007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:53.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.406+0000 7fd0057fa700 1 -- 172.21.15.44:0/3061512752 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd00815c390 con 0x7fd008159720 2024-09-13T18:27:53.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.610+0000 7fd00d8f4700 1 -- 172.21.15.44:0/3061512752 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd00815c390 con 0x7fd008159720 2024-09-13T18:27:53.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.614+0000 7fd0057fa700 1 -- 172.21.15.44:0/3061512752 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4725 (secure 0 0 0) 0x7fd00815c390 con 0x7fd008159720 2024-09-13T18:27:53.619 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:53.619 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2616086834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2616086834},{"type":"v1","addr":"172.21.15.99:6835","nonce":2616086834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/2083799524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2083799524},{"type":"v1","addr":"172.21.15.99:6837","nonce":2083799524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/369871675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":369871675},{"type":"v1","addr":"172.21.15.44:6833","nonce":369871675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:27:01.277463+0000","modified":"2024-09-13T18:27:04.292778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/1402693416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1402693416},{"type":"v1","addr":"172.21.15.44:6835","nonce":1402693416}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:27:53.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.614+0000 7fd00d8f4700 1 -- 172.21.15.44:0/3061512752 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcfe8066730 msgr2=0x7fcfe8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:53.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.614+0000 7fd00d8f4700 1 --2- 172.21.15.44:0/3061512752 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcfe8066730 0x7fcfe8068bf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcff0007fd0 tx=0x7fcff0007de0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.614+0000 7fd00d8f4700 1 -- 172.21.15.44:0/3061512752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd008159720 msgr2=0x7fd008145000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:53.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.614+0000 7fd00d8f4700 1 --2- 172.21.15.44:0/3061512752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd008159720 0x7fd008145000 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd00000efc0 tx=0x7fd00000c3a0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.618+0000 7fd00d8f4700 1 -- 172.21.15.44:0/3061512752 shutdown_connections 2024-09-13T18:27:53.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.618+0000 7fd00d8f4700 1 --2- 172.21.15.44:0/3061512752 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcfe8066730 0x7fcfe8068bf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.618+0000 7fd00d8f4700 1 --2- 172.21.15.44:0/3061512752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd008159720 0x7fd008145000 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.618+0000 7fd00d8f4700 1 --2- 172.21.15.44:0/3061512752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0080b3ae0 0x7fd008150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.618+0000 7fd00d8f4700 1 --2- 172.21.15.44:0/3061512752 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd00806aa90 0x7fd00815c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.618+0000 7fd00d8f4700 1 -- 172.21.15.44:0/3061512752 >> 172.21.15.44:0/3061512752 conn(0x7fd0080b0f00 msgr2=0x7fd008156920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:53.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.618+0000 7fd00d8f4700 1 -- 172.21.15.44:0/3061512752 shutdown_connections 2024-09-13T18:27:53.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.618+0000 7fd00d8f4700 1 -- 172.21.15.44:0/3061512752 wait complete. 2024-09-13T18:27:53.623 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 7 2024-09-13T18:27:53.635 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:53.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.742+0000 7fc879fd8700 1 Processor -- start 2024-09-13T18:27:53.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.742+0000 7fc879fd8700 1 -- start start 2024-09-13T18:27:53.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.746+0000 7fc879fd8700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc874159770 0x7fc87406ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:53.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.746+0000 7fc879fd8700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8740cb5b0 con 0x7fc87406e970 2024-09-13T18:27:53.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.746+0000 7fc879fd8700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8740cb890 con 0x7fc87406c3d0 2024-09-13T18:27:53.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.746+0000 7fc879fd8700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87406b3d0 con 0x7fc874159770 2024-09-13T18:27:53.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.746+0000 7fc873fff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc87406e970 0x7fc87406bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54566/0 (socket says 172.21.15.44:54566) 2024-09-13T18:27:53.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.746+0000 7fc873fff700 1 -- 172.21.15.44:0/91433708 learned_addr learned my addr 172.21.15.44:0/91433708 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:53.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.746+0000 7fc878fd6700 1 --2- 172.21.15.44:0/91433708 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc874159770 0x7fc87406ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:53.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.746+0000 7fc8737fe700 1 -- 172.21.15.44:0/91433708 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3475242148 0 0) 0x7fc8740cb5b0 con 0x7fc87406e970 2024-09-13T18:27:53.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.746+0000 7fc8737fe700 1 -- 172.21.15.44:0/91433708 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc85c0035d0 con 0x7fc87406e970 2024-09-13T18:27:53.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.746+0000 7fc8737fe700 1 -- 172.21.15.44:0/91433708 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601422993 0 0) 0x7fc8740cb890 con 0x7fc87406c3d0 2024-09-13T18:27:53.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.746+0000 7fc878fd6700 1 -- 172.21.15.44:0/91433708 >> v1:172.21.15.99:6789/0 conn(0x7fc87406c3d0 legacy=0x7fc874070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:53.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.746+0000 7fc878fd6700 1 -- 172.21.15.44:0/91433708 >> v1:172.21.15.44:6789/0 conn(0x7fc87406e970 legacy=0x7fc87406bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:53.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.746+0000 7fc878fd6700 1 -- 172.21.15.44:0/91433708 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87406a3b0 con 0x7fc874159770 2024-09-13T18:27:53.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.746+0000 7fc878fd6700 1 --2- 172.21.15.44:0/91433708 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc874159770 0x7fc87406ae90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc864009880 tx=0x7fc864009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f25999e1e7a92dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:53.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.750+0000 7fc8737fe700 1 -- 172.21.15.44:0/91433708 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc868001670 con 0x7fc874159770 2024-09-13T18:27:53.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.750+0000 7fc8737fe700 1 -- 172.21.15.44:0/91433708 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc864010590 con 0x7fc874159770 2024-09-13T18:27:53.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.750+0000 7fc8737fe700 1 -- 172.21.15.44:0/91433708 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc864010940 con 0x7fc874159770 2024-09-13T18:27:53.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.750+0000 7fc879fd8700 1 -- 172.21.15.44:0/91433708 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc874159770 msgr2=0x7fc87406ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:53.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.750+0000 7fc879fd8700 1 --2- 172.21.15.44:0/91433708 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc874159770 0x7fc87406ae90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc864009880 tx=0x7fc864009b90 comp rx=0 tx=0).stop 2024-09-13T18:27:53.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.750+0000 7fc879fd8700 1 -- 172.21.15.44:0/91433708 shutdown_connections 2024-09-13T18:27:53.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.750+0000 7fc879fd8700 1 --2- 172.21.15.44:0/91433708 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc874159770 0x7fc87406ae90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.750+0000 7fc879fd8700 1 -- 172.21.15.44:0/91433708 >> 172.21.15.44:0/91433708 conn(0x7fc87406d900 msgr2=0x7fc87406dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:53.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.750+0000 7fc879fd8700 1 -- 172.21.15.44:0/91433708 shutdown_connections 2024-09-13T18:27:53.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.750+0000 7fc879fd8700 1 -- 172.21.15.44:0/91433708 wait complete. 2024-09-13T18:27:53.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.750+0000 7fc879fd8700 1 Processor -- start 2024-09-13T18:27:53.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.750+0000 7fc879fd8700 1 -- start start 2024-09-13T18:27:53.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.754+0000 7fc879fd8700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc87406c3d0 0x7fc874148980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:53.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.754+0000 7fc879fd8700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc87406e970 0x7fc874154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:53.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.754+0000 7fc879fd8700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc874159770 0x7fc8740b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:53.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.754+0000 7fc879fd8700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc874155510 con 0x7fc87406e970 2024-09-13T18:27:53.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.754+0000 7fc879fd8700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc874154900 con 0x7fc874159770 2024-09-13T18:27:53.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.754+0000 7fc879fd8700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc874154be0 con 0x7fc87406c3d0 2024-09-13T18:27:53.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.754+0000 7fc873fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc87406e970 0x7fc874154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:53.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.754+0000 7fc878fd6700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc87406c3d0 0x7fc874148980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:53.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.754+0000 7fc873fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc87406e970 0x7fc874154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41198/0 (socket says 172.21.15.44:41198) 2024-09-13T18:27:53.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.754+0000 7fc873fff700 1 -- 172.21.15.44:0/1223974200 learned_addr learned my addr 172.21.15.44:0/1223974200 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:53.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.754+0000 7fc8797d7700 1 --2- 172.21.15.44:0/1223974200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc874159770 0x7fc8740b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:53.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.754+0000 7fc878fd6700 1 -- 172.21.15.44:0/1223974200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc874159770 msgr2=0x7fc8740b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:53.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.754+0000 7fc878fd6700 1 --2- 172.21.15.44:0/1223974200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc874159770 0x7fc8740b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.754+0000 7fc878fd6700 1 -- 172.21.15.44:0/1223974200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc87406e970 msgr2=0x7fc874154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:53.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.754+0000 7fc878fd6700 1 --2- 172.21.15.44:0/1223974200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc87406e970 0x7fc874154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.754+0000 7fc878fd6700 1 -- 172.21.15.44:0/1223974200 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8640094b0 con 0x7fc87406c3d0 2024-09-13T18:27:53.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.754+0000 7fc878fd6700 1 --2- 172.21.15.44:0/1223974200 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc87406c3d0 0x7fc874148980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc864015000 tx=0x7fc864004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:53.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.754+0000 7fc8717fa700 1 -- 172.21.15.44:0/1223974200 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc864004510 con 0x7fc87406c3d0 2024-09-13T18:27:53.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.754+0000 7fc8717fa700 1 -- 172.21.15.44:0/1223974200 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8640036c0 con 0x7fc87406c3d0 2024-09-13T18:27:53.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.754+0000 7fc879fd8700 1 -- 172.21.15.44:0/1223974200 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc874154ec0 con 0x7fc87406c3d0 2024-09-13T18:27:53.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.754+0000 7fc8717fa700 1 -- 172.21.15.44:0/1223974200 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc864003a70 con 0x7fc87406c3d0 2024-09-13T18:27:53.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.754+0000 7fc879fd8700 1 -- 172.21.15.44:0/1223974200 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc874148ec0 con 0x7fc87406c3d0 2024-09-13T18:27:53.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.758+0000 7fc879fd8700 1 -- 172.21.15.44:0/1223974200 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc87406ae90 con 0x7fc87406c3d0 2024-09-13T18:27:53.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.758+0000 7fc8717fa700 1 -- 172.21.15.44:0/1223974200 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc864003bd0 con 0x7fc87406c3d0 2024-09-13T18:27:53.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.758+0000 7fc8717fa700 1 --2- 172.21.15.44:0/1223974200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc860066730 0x7fc860068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:53.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.758+0000 7fc8717fa700 1 -- 172.21.15.44:0/1223974200 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc8640858d0 con 0x7fc87406c3d0 2024-09-13T18:27:53.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.758+0000 7fc873fff700 1 --2- 172.21.15.44:0/1223974200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc860066730 0x7fc860068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:53.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.758+0000 7fc873fff700 1 --2- 172.21.15.44:0/1223974200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc860066730 0x7fc860068bf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc87415c760 tx=0x7fc868001ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:53.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.770+0000 7fc8717fa700 1 -- 172.21.15.44:0/1223974200 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc864052ce0 con 0x7fc87406c3d0 2024-09-13T18:27:53.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.946+0000 7fc879fd8700 1 -- 172.21.15.44:0/1223974200 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8740712f0 con 0x7fc87406c3d0 2024-09-13T18:27:53.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.950+0000 7fc8717fa700 1 -- 172.21.15.44:0/1223974200 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16695 (secure 0 0 0) 0x7fc864056300 con 0x7fc87406c3d0 2024-09-13T18:27:53.955 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:53.955 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":23,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:43.549975+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:59.478511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:27:00.261038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:53.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.954+0000 7fc879fd8700 1 -- 172.21.15.44:0/1223974200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc860066730 msgr2=0x7fc860068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:53.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.954+0000 7fc879fd8700 1 --2- 172.21.15.44:0/1223974200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc860066730 0x7fc860068bf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc87415c760 tx=0x7fc868001ac0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.954+0000 7fc879fd8700 1 -- 172.21.15.44:0/1223974200 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc87406c3d0 msgr2=0x7fc874148980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:53.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.954+0000 7fc879fd8700 1 --2- 172.21.15.44:0/1223974200 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc87406c3d0 0x7fc874148980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc864015000 tx=0x7fc864004770 comp rx=0 tx=0).stop 2024-09-13T18:27:53.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.954+0000 7fc879fd8700 1 -- 172.21.15.44:0/1223974200 shutdown_connections 2024-09-13T18:27:53.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.954+0000 7fc879fd8700 1 --2- 172.21.15.44:0/1223974200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc860066730 0x7fc860068bf0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.954+0000 7fc879fd8700 1 --2- 172.21.15.44:0/1223974200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc874159770 0x7fc8740b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.954+0000 7fc879fd8700 1 --2- 172.21.15.44:0/1223974200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc87406e970 0x7fc874154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.954+0000 7fc879fd8700 1 --2- 172.21.15.44:0/1223974200 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc87406c3d0 0x7fc874148980 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:53.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.954+0000 7fc879fd8700 1 -- 172.21.15.44:0/1223974200 >> 172.21.15.44:0/1223974200 conn(0x7fc87406d900 msgr2=0x7fc87406bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:53.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.954+0000 7fc879fd8700 1 -- 172.21.15.44:0/1223974200 shutdown_connections 2024-09-13T18:27:53.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:53.954+0000 7fc879fd8700 1 -- 172.21.15.44:0/1223974200 wait complete. 2024-09-13T18:27:53.976 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:27:54.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.090+0000 7fba11c49700 1 Processor -- start 2024-09-13T18:27:54.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.090+0000 7fba11c49700 1 -- start start 2024-09-13T18:27:54.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.090+0000 7fba11c49700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fba0c144340 0x7fba0c06d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:54.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.090+0000 7fba11c49700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0c144720 con 0x7fba0c0cdc90 2024-09-13T18:27:54.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.090+0000 7fba11c49700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0c06dd40 con 0x7fba0c06bdb0 2024-09-13T18:27:54.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.090+0000 7fba11c49700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba0c06da60 con 0x7fba0c144340 2024-09-13T18:27:54.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.090+0000 7fba10c47700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fba0c144340 0x7fba0c06d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:54.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.090+0000 7fba10c47700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fba0c144340 0x7fba0c06d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41200/0 (socket says 172.21.15.44:41200) 2024-09-13T18:27:54.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.090+0000 7fba10c47700 1 -- 172.21.15.44:0/2408271042 learned_addr learned my addr 172.21.15.44:0/2408271042 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:54.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.090+0000 7fba11448700 1 --1- 172.21.15.44:0/2408271042 >> v1:172.21.15.44:6789/0 conn(0x7fba0c0cdc90 0x7fba0c06fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54580/0 (socket says 172.21.15.44:54580) 2024-09-13T18:27:54.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.090+0000 7fba10c47700 1 -- 172.21.15.44:0/2408271042 >> v1:172.21.15.99:6789/0 conn(0x7fba0c06bdb0 legacy=0x7fba0c0cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:54.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.090+0000 7fba10c47700 1 -- 172.21.15.44:0/2408271042 >> v1:172.21.15.44:6789/0 conn(0x7fba0c0cdc90 legacy=0x7fba0c06fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:54.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.090+0000 7fba0b7fe700 1 -- 172.21.15.44:0/2408271042 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952513148 0 0) 0x7fba0c144720 con 0x7fba0c0cdc90 2024-09-13T18:27:54.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.090+0000 7fba10c47700 1 -- 172.21.15.44:0/2408271042 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0c15e660 con 0x7fba0c144340 2024-09-13T18:27:54.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.090+0000 7fba10c47700 1 --2- 172.21.15.44:0/2408271042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba0c144340 0x7fba0c06d480 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009910 tx=0x7fb9fc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff81d97b4dd6e86c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:54.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.090+0000 7fba0b7fe700 1 -- 172.21.15.44:0/2408271042 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc00ba60 con 0x7fba0c144340 2024-09-13T18:27:54.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.090+0000 7fba0b7fe700 1 -- 172.21.15.44:0/2408271042 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc00bbc0 con 0x7fba0c144340 2024-09-13T18:27:54.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.090+0000 7fba0b7fe700 1 -- 172.21.15.44:0/2408271042 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc009e60 con 0x7fba0c144340 2024-09-13T18:27:54.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.094+0000 7fba11c49700 1 -- 172.21.15.44:0/2408271042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba0c144340 msgr2=0x7fba0c06d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:54.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.094+0000 7fba11c49700 1 --2- 172.21.15.44:0/2408271042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba0c144340 0x7fba0c06d480 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009910 tx=0x7fb9fc009c20 comp rx=0 tx=0).stop 2024-09-13T18:27:54.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.094+0000 7fba11c49700 1 -- 172.21.15.44:0/2408271042 shutdown_connections 2024-09-13T18:27:54.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.094+0000 7fba11c49700 1 --2- 172.21.15.44:0/2408271042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba0c144340 0x7fba0c06d480 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:54.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.094+0000 7fba11c49700 1 -- 172.21.15.44:0/2408271042 >> 172.21.15.44:0/2408271042 conn(0x7fba0c0b0e10 msgr2=0x7fba0c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:54.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.094+0000 7fba11c49700 1 -- 172.21.15.44:0/2408271042 shutdown_connections 2024-09-13T18:27:54.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.094+0000 7fba11c49700 1 -- 172.21.15.44:0/2408271042 wait complete. 2024-09-13T18:27:54.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.094+0000 7fba11c49700 1 Processor -- start 2024-09-13T18:27:54.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.094+0000 7fba11c49700 1 -- start start 2024-09-13T18:27:54.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.098+0000 7fba11c49700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba0c06bdb0 0x7fba0c0c3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:54.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.098+0000 7fba11c49700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba0c0cdc90 0x7fba0c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:54.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.098+0000 7fba11c49700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba0c144340 0x7fba0c15c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:54.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.098+0000 7fba11c49700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c15a8a0 con 0x7fba0c06bdb0 2024-09-13T18:27:54.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.098+0000 7fba11c49700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c132e10 con 0x7fba0c144340 2024-09-13T18:27:54.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.098+0000 7fba11c49700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c1330b0 con 0x7fba0c0cdc90 2024-09-13T18:27:54.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.098+0000 7fba10c47700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba0c06bdb0 0x7fba0c0c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:54.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.098+0000 7fba10c47700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba0c06bdb0 0x7fba0c0c3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41210/0 (socket says 172.21.15.44:41210) 2024-09-13T18:27:54.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.098+0000 7fba10c47700 1 -- 172.21.15.44:0/96430375 learned_addr learned my addr 172.21.15.44:0/96430375 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:54.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.098+0000 7fba11448700 1 --2- 172.21.15.44:0/96430375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba0c144340 0x7fba0c15c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:54.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.098+0000 7fba0bfff700 1 --2- 172.21.15.44:0/96430375 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba0c0cdc90 0x7fba0c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:54.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.098+0000 7fba10c47700 1 -- 172.21.15.44:0/96430375 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba0c0cdc90 msgr2=0x7fba0c15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:54.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.098+0000 7fba10c47700 1 --2- 172.21.15.44:0/96430375 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba0c0cdc90 0x7fba0c15a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:54.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.098+0000 7fba10c47700 1 -- 172.21.15.44:0/96430375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba0c144340 msgr2=0x7fba0c15c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:54.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.098+0000 7fba10c47700 1 --2- 172.21.15.44:0/96430375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba0c144340 0x7fba0c15c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:54.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.098+0000 7fba10c47700 1 -- 172.21.15.44:0/96430375 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc009570 con 0x7fba0c06bdb0 2024-09-13T18:27:54.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.098+0000 7fba11448700 1 --2- 172.21.15.44:0/96430375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba0c144340 0x7fba0c15c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:54.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.098+0000 7fba10c47700 1 --2- 172.21.15.44:0/96430375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba0c06bdb0 0x7fba0c0c3890 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009c60 tx=0x7fb9fc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:54.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.098+0000 7fba097fa700 1 -- 172.21.15.44:0/96430375 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc011ab0 con 0x7fba0c06bdb0 2024-09-13T18:27:54.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.098+0000 7fba097fa700 1 -- 172.21.15.44:0/96430375 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc01f070 con 0x7fba0c06bdb0 2024-09-13T18:27:54.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.098+0000 7fba097fa700 1 -- 172.21.15.44:0/96430375 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc011e10 con 0x7fba0c06bdb0 2024-09-13T18:27:54.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.098+0000 7fba11c49700 1 -- 172.21.15.44:0/96430375 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba0c133390 con 0x7fba0c06bdb0 2024-09-13T18:27:54.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.098+0000 7fba11c49700 1 -- 172.21.15.44:0/96430375 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0c133950 con 0x7fba0c06bdb0 2024-09-13T18:27:54.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.102+0000 7fba097fa700 1 -- 172.21.15.44:0/96430375 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb9fc01a430 con 0x7fba0c06bdb0 2024-09-13T18:27:54.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.102+0000 7fba11c49700 1 -- 172.21.15.44:0/96430375 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba0c0ce2a0 con 0x7fba0c06bdb0 2024-09-13T18:27:54.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.102+0000 7fba097fa700 1 --2- 172.21.15.44:0/96430375 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb9f0066730 0x7fb9f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:54.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.102+0000 7fba097fa700 1 -- 172.21.15.44:0/96430375 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb9fc021070 con 0x7fba0c06bdb0 2024-09-13T18:27:54.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.102+0000 7fba0bfff700 1 --2- 172.21.15.44:0/96430375 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb9f0066730 0x7fb9f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:54.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.102+0000 7fba0bfff700 1 --2- 172.21.15.44:0/96430375 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb9f0066730 0x7fb9f0068bf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fba0c139480 tx=0x7fb9f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:54.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.110+0000 7fba097fa700 1 -- 172.21.15.44:0/96430375 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb9fc052fc0 con 0x7fba0c06bdb0 2024-09-13T18:27:54.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.322+0000 7fba11c49700 1 -- 172.21.15.44:0/96430375 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fba0c071ea0 con 0x7fba0c06bdb0 2024-09-13T18:27:54.329 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-13T18:27:54.322+0000 7fc22bbc2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:27:54.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.338+0000 7fba097fa700 1 -- 172.21.15.44:0/96430375 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb9fc02b090 con 0x7fba0c06bdb0 2024-09-13T18:27:54.345 INFO:tasks.ceph.mds.c.smithi044.stderr: -3027> 2024-09-13T18:27:05.863+0000 7fb5f3ed5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:27:54.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.342+0000 7fba11c49700 1 -- 172.21.15.44:0/96430375 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb9f0066730 msgr2=0x7fb9f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:54.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.342+0000 7fba11c49700 1 --2- 172.21.15.44:0/96430375 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb9f0066730 0x7fb9f0068bf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fba0c139480 tx=0x7fb9f4009040 comp rx=0 tx=0).stop 2024-09-13T18:27:54.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.342+0000 7fba11c49700 1 -- 172.21.15.44:0/96430375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba0c06bdb0 msgr2=0x7fba0c0c3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:54.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.342+0000 7fba11c49700 1 --2- 172.21.15.44:0/96430375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba0c06bdb0 0x7fba0c0c3890 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009c60 tx=0x7fb9fc004770 comp rx=0 tx=0).stop 2024-09-13T18:27:54.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.342+0000 7fba11c49700 1 -- 172.21.15.44:0/96430375 shutdown_connections 2024-09-13T18:27:54.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.342+0000 7fba11c49700 1 --2- 172.21.15.44:0/96430375 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb9f0066730 0x7fb9f0068bf0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:54.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.342+0000 7fba11c49700 1 --2- 172.21.15.44:0/96430375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba0c144340 0x7fba0c15c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:54.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.342+0000 7fba11c49700 1 --2- 172.21.15.44:0/96430375 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba0c0cdc90 0x7fba0c15a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:54.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.342+0000 7fba11c49700 1 --2- 172.21.15.44:0/96430375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba0c06bdb0 0x7fba0c0c3890 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:54.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.342+0000 7fba11c49700 1 -- 172.21.15.44:0/96430375 >> 172.21.15.44:0/96430375 conn(0x7fba0c0b0e10 msgr2=0x7fba0c06fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:54.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.342+0000 7fba11c49700 1 -- 172.21.15.44:0/96430375 shutdown_connections 2024-09-13T18:27:54.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.342+0000 7fba11c49700 1 -- 172.21.15.44:0/96430375 wait complete. 2024-09-13T18:27:54.350 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:27:54.363 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:27:54.377 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-13T18:27:54.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.474+0000 7f7016665700 1 Processor -- start 2024-09-13T18:27:54.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.474+0000 7f7016665700 1 -- start start 2024-09-13T18:27:54.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.474+0000 7f7016665700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f70100cdc90 0x7f701006d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:54.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.474+0000 7f7016665700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f701006bdb0 0x7f701006fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:54.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.474+0000 7f7016665700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7010144720 con 0x7f7010144340 2024-09-13T18:27:54.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.474+0000 7f7016665700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701006dd40 con 0x7f70100cdc90 2024-09-13T18:27:54.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.474+0000 7f7016665700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701006da60 con 0x7f701006bdb0 2024-09-13T18:27:54.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.478+0000 7f7014e62700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f70100cdc90 0x7f701006d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:54.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.478+0000 7f7014e62700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f70100cdc90 0x7f701006d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41232/0 (socket says 172.21.15.44:41232) 2024-09-13T18:27:54.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.478+0000 7f7014e62700 1 -- 172.21.15.44:0/223662357 learned_addr learned my addr 172.21.15.44:0/223662357 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:54.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.478+0000 7f7015e64700 1 --2- 172.21.15.44:0/223662357 >> v2:172.21.15.99:3300/0 conn(0x7f701006bdb0 0x7f701006fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:54.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.478+0000 7f7014e62700 1 -- 172.21.15.44:0/223662357 >> v2:172.21.15.99:3300/0 conn(0x7f701006bdb0 msgr2=0x7f701006fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:54.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.478+0000 7f7014e62700 1 --2- 172.21.15.44:0/223662357 >> v2:172.21.15.99:3300/0 conn(0x7f701006bdb0 0x7f701006fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:54.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.478+0000 7f7014e62700 1 -- 172.21.15.44:0/223662357 >> v1:172.21.15.99:6789/0 conn(0x7f7010144340 legacy=0x7f70100cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:54.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.478+0000 7f7014e62700 1 -- 172.21.15.44:0/223662357 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701015e660 con 0x7f70100cdc90 2024-09-13T18:27:54.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.478+0000 7f7014e62700 1 --2- 172.21.15.44:0/223662357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70100cdc90 0x7f701006d480 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f701015afc0 tx=0x7f700400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef86bb87aeec537f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:54.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.478+0000 7f7003fff700 1 -- 172.21.15.44:0/223662357 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700400e070 con 0x7f70100cdc90 2024-09-13T18:27:54.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.478+0000 7f7003fff700 1 -- 172.21.15.44:0/223662357 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700400b9c0 con 0x7f70100cdc90 2024-09-13T18:27:54.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.478+0000 7f7003fff700 1 -- 172.21.15.44:0/223662357 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700400bd70 con 0x7f70100cdc90 2024-09-13T18:27:54.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.478+0000 7f7016665700 1 -- 172.21.15.44:0/223662357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70100cdc90 msgr2=0x7f701006d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:54.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.478+0000 7f7016665700 1 --2- 172.21.15.44:0/223662357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70100cdc90 0x7f701006d480 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f701015afc0 tx=0x7f700400b330 comp rx=0 tx=0).stop 2024-09-13T18:27:54.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.478+0000 7f7016665700 1 -- 172.21.15.44:0/223662357 shutdown_connections 2024-09-13T18:27:54.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.478+0000 7f7016665700 1 --2- 172.21.15.44:0/223662357 >> v2:172.21.15.99:3300/0 conn(0x7f701006bdb0 0x7f701006fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:54.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.478+0000 7f7016665700 1 --2- 172.21.15.44:0/223662357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70100cdc90 0x7f701006d480 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:54.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.478+0000 7f7016665700 1 -- 172.21.15.44:0/223662357 >> 172.21.15.44:0/223662357 conn(0x7f70100b0e10 msgr2=0x7f70100b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:54.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.478+0000 7f7016665700 1 -- 172.21.15.44:0/223662357 shutdown_connections 2024-09-13T18:27:54.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.478+0000 7f7016665700 1 -- 172.21.15.44:0/223662357 wait complete. 2024-09-13T18:27:54.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.482+0000 7f7016665700 1 Processor -- start 2024-09-13T18:27:54.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.482+0000 7f7016665700 1 -- start start 2024-09-13T18:27:54.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.482+0000 7f7016665700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f701006bdb0 0x7f701013ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:54.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.482+0000 7f7016665700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70100cdc90 0x7f701013bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:54.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.482+0000 7f7016665700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7010144340 0x7f701013c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:54.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.482+0000 7f7016665700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70101f45e0 con 0x7f70100cdc90 2024-09-13T18:27:54.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.482+0000 7f7016665700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701013df50 con 0x7f701006bdb0 2024-09-13T18:27:54.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.482+0000 7f7016665700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701013e230 con 0x7f7010144340 2024-09-13T18:27:54.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.482+0000 7f7014e62700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70100cdc90 0x7f701013bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:54.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.482+0000 7f7014e62700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70100cdc90 0x7f701013bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41246/0 (socket says 172.21.15.44:41246) 2024-09-13T18:27:54.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.482+0000 7f7015663700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f701006bdb0 0x7f701013ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:54.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.482+0000 7f7014e62700 1 -- 172.21.15.44:0/3271557435 learned_addr learned my addr 172.21.15.44:0/3271557435 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:54.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.482+0000 7f7015e64700 1 --2- 172.21.15.44:0/3271557435 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7010144340 0x7f701013c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:54.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.482+0000 7f7014e62700 1 -- 172.21.15.44:0/3271557435 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7010144340 msgr2=0x7f701013c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:54.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.482+0000 7f7014e62700 1 --2- 172.21.15.44:0/3271557435 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7010144340 0x7f701013c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:54.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.482+0000 7f7014e62700 1 -- 172.21.15.44:0/3271557435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f701006bdb0 msgr2=0x7f701013ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:54.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.482+0000 7f7014e62700 1 --2- 172.21.15.44:0/3271557435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f701006bdb0 0x7f701013ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:54.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.482+0000 7f7014e62700 1 -- 172.21.15.44:0/3271557435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7004009b30 con 0x7f70100cdc90 2024-09-13T18:27:54.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.486+0000 7f7014e62700 1 --2- 172.21.15.44:0/3271557435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70100cdc90 0x7f701013bad0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7004012000 tx=0x7f7004004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:54.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.486+0000 7f7001ffb700 1 -- 172.21.15.44:0/3271557435 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70040048c0 con 0x7f70100cdc90 2024-09-13T18:27:54.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.486+0000 7f7001ffb700 1 -- 172.21.15.44:0/3271557435 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70040099b0 con 0x7f70100cdc90 2024-09-13T18:27:54.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.486+0000 7f7016665700 1 -- 172.21.15.44:0/3271557435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f701013e510 con 0x7f70100cdc90 2024-09-13T18:27:54.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.486+0000 7f7001ffb700 1 -- 172.21.15.44:0/3271557435 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700401c680 con 0x7f70100cdc90 2024-09-13T18:27:54.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.486+0000 7f7016665700 1 -- 172.21.15.44:0/3271557435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70101f3820 con 0x7f70100cdc90 2024-09-13T18:27:54.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.486+0000 7f7016665700 1 -- 172.21.15.44:0/3271557435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701013dd50 con 0x7f70100cdc90 2024-09-13T18:27:54.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.486+0000 7f7001ffb700 1 -- 172.21.15.44:0/3271557435 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f700401c7e0 con 0x7f70100cdc90 2024-09-13T18:27:54.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.490+0000 7f7001ffb700 1 --2- 172.21.15.44:0/3271557435 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6ff4066730 0x7f6ff4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:54.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.490+0000 7f7001ffb700 1 -- 172.21.15.44:0/3271557435 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f7004085ac0 con 0x7f70100cdc90 2024-09-13T18:27:54.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.490+0000 7f7015663700 1 --2- 172.21.15.44:0/3271557435 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6ff4066730 0x7f6ff4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:54.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.490+0000 7f7015663700 1 --2- 172.21.15.44:0/3271557435 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6ff4066730 0x7f6ff4068bf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f70100ada30 tx=0x7f700c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:54.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.498+0000 7f7001ffb700 1 -- 172.21.15.44:0/3271557435 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7004052d50 con 0x7f70100cdc90 2024-09-13T18:27:54.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:54.710+0000 7f7016665700 1 -- 172.21.15.44:0/3271557435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f701006a310 con 0x7f70100cdc90 2024-09-13T18:27:55.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.346+0000 7f7001ffb700 1 -- 172.21.15.44:0/3271557435 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7004056370 con 0x7f70100cdc90 2024-09-13T18:27:55.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.350+0000 7f7016665700 1 -- 172.21.15.44:0/3271557435 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6ff4066730 msgr2=0x7f6ff4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:55.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.350+0000 7f7016665700 1 --2- 172.21.15.44:0/3271557435 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6ff4066730 0x7f6ff4068bf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f70100ada30 tx=0x7f700c009040 comp rx=0 tx=0).stop 2024-09-13T18:27:55.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.350+0000 7f7016665700 1 -- 172.21.15.44:0/3271557435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70100cdc90 msgr2=0x7f701013bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:55.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.350+0000 7f7016665700 1 --2- 172.21.15.44:0/3271557435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70100cdc90 0x7f701013bad0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7004012000 tx=0x7f7004004af0 comp rx=0 tx=0).stop 2024-09-13T18:27:55.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.350+0000 7f7016665700 1 -- 172.21.15.44:0/3271557435 shutdown_connections 2024-09-13T18:27:55.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.350+0000 7f7016665700 1 --2- 172.21.15.44:0/3271557435 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6ff4066730 0x7f6ff4068bf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:55.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.350+0000 7f7016665700 1 --2- 172.21.15.44:0/3271557435 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7010144340 0x7f701013c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:55.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.350+0000 7f7016665700 1 --2- 172.21.15.44:0/3271557435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70100cdc90 0x7f701013bad0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:55.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.350+0000 7f7016665700 1 --2- 172.21.15.44:0/3271557435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f701006bdb0 0x7f701013ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:55.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.350+0000 7f7016665700 1 -- 172.21.15.44:0/3271557435 >> 172.21.15.44:0/3271557435 conn(0x7f70100b0e10 msgr2=0x7f70100b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:55.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.350+0000 7f7016665700 1 -- 172.21.15.44:0/3271557435 shutdown_connections 2024-09-13T18:27:55.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.350+0000 7f7016665700 1 -- 172.21.15.44:0/3271557435 wait complete. 2024-09-13T18:27:55.374 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:27:55.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.490+0000 7f6a07591700 1 Processor -- start 2024-09-13T18:27:55.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.490+0000 7f6a07591700 1 -- start start 2024-09-13T18:27:55.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.490+0000 7f6a07591700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a00154fa0 0x7f6a0006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:55.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.490+0000 7f6a07591700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6a0006b0e0 0x7f6a00070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:55.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.490+0000 7f6a07591700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6a000710e0 0x7f6a0006cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:55.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.490+0000 7f6a07591700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a00155380 con 0x7f6a0006b0e0 2024-09-13T18:27:55.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.490+0000 7f6a07591700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0015b240 con 0x7f6a000710e0 2024-09-13T18:27:55.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.490+0000 7f6a07591700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a00071590 con 0x7f6a00154fa0 2024-09-13T18:27:55.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.490+0000 7f6a05d8e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6a0006b0e0 0x7f6a00070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:55.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.490+0000 7f6a05d8e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6a0006b0e0 0x7f6a00070ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41250/0 (socket says 172.21.15.44:41250) 2024-09-13T18:27:55.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.490+0000 7f6a05d8e700 1 -- 172.21.15.44:0/3428237922 learned_addr learned my addr 172.21.15.44:0/3428237922 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:55.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.490+0000 7f6a06d90700 1 --2- 172.21.15.44:0/3428237922 >> v2:172.21.15.99:3300/0 conn(0x7f6a000710e0 0x7f6a0006cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:55.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.490+0000 7f6a0658f700 1 --2- 172.21.15.44:0/3428237922 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a00154fa0 0x7f6a0006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:55.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.490+0000 7f6a05d8e700 1 -- 172.21.15.44:0/3428237922 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a00154fa0 msgr2=0x7f6a0006aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:55.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.490+0000 7f6a05d8e700 1 --2- 172.21.15.44:0/3428237922 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a00154fa0 0x7f6a0006aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:55.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.490+0000 7f6a05d8e700 1 -- 172.21.15.44:0/3428237922 >> v2:172.21.15.99:3300/0 conn(0x7f6a000710e0 msgr2=0x7f6a0006cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:55.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.490+0000 7f6a05d8e700 1 --2- 172.21.15.44:0/3428237922 >> v2:172.21.15.99:3300/0 conn(0x7f6a000710e0 0x7f6a0006cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:55.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.490+0000 7f6a05d8e700 1 -- 172.21.15.44:0/3428237922 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0006b540 con 0x7f6a0006b0e0 2024-09-13T18:27:55.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.490+0000 7f6a05d8e700 1 --2- 172.21.15.44:0/3428237922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a0006b0e0 0x7f6a00070ba0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6a0006c380 tx=0x7f69f4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6328753a5db03eb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:55.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.490+0000 7f6a0558d700 1 -- 172.21.15.44:0/3428237922 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4011830 con 0x7f6a0006b0e0 2024-09-13T18:27:55.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.494+0000 7f6a0558d700 1 -- 172.21.15.44:0/3428237922 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f4011990 con 0x7f6a0006b0e0 2024-09-13T18:27:55.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.494+0000 7f6a0558d700 1 -- 172.21.15.44:0/3428237922 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4011d40 con 0x7f6a0006b0e0 2024-09-13T18:27:55.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.494+0000 7f6a07591700 1 -- 172.21.15.44:0/3428237922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a0006b0e0 msgr2=0x7f6a00070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:55.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.494+0000 7f6a07591700 1 --2- 172.21.15.44:0/3428237922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a0006b0e0 0x7f6a00070ba0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6a0006c380 tx=0x7f69f4009c20 comp rx=0 tx=0).stop 2024-09-13T18:27:55.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.494+0000 7f6a07591700 1 -- 172.21.15.44:0/3428237922 shutdown_connections 2024-09-13T18:27:55.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.494+0000 7f6a07591700 1 --2- 172.21.15.44:0/3428237922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a0006b0e0 0x7f6a00070ba0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:55.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.494+0000 7f6a07591700 1 --2- 172.21.15.44:0/3428237922 >> v2:172.21.15.99:3300/0 conn(0x7f6a000710e0 0x7f6a0006cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:55.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.494+0000 7f6a07591700 1 --2- 172.21.15.44:0/3428237922 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a00154fa0 0x7f6a0006aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:55.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.494+0000 7f6a07591700 1 -- 172.21.15.44:0/3428237922 >> 172.21.15.44:0/3428237922 conn(0x7f6a000cfad0 msgr2=0x7f6a000cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:55.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.494+0000 7f6a07591700 1 -- 172.21.15.44:0/3428237922 shutdown_connections 2024-09-13T18:27:55.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.494+0000 7f6a07591700 1 -- 172.21.15.44:0/3428237922 wait complete. 2024-09-13T18:27:55.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.494+0000 7f6a07591700 1 Processor -- start 2024-09-13T18:27:55.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.494+0000 7f6a07591700 1 -- start start 2024-09-13T18:27:55.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f6a07591700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a0006b0e0 0x7f6a0015a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:55.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f6a07591700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a000710e0 0x7f6a0014a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:55.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f6a07591700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a00154fa0 0x7f6a000a9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f6a07591700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a000a9430 con 0x7f6a0006b0e0 2024-09-13T18:27:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f6a07591700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a000a8820 con 0x7f6a00154fa0 2024-09-13T18:27:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f6a07591700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a000a8b00 con 0x7f6a000710e0 2024-09-13T18:27:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f6a0658f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a0006b0e0 0x7f6a0015a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f6a05d8e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a000710e0 0x7f6a0014a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f6a0658f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a0006b0e0 0x7f6a0015a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41254/0 (socket says 172.21.15.44:41254) 2024-09-13T18:27:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f6a0658f700 1 -- 172.21.15.44:0/697511147 learned_addr learned my addr 172.21.15.44:0/697511147 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f6a06d90700 1 --2- 172.21.15.44:0/697511147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a00154fa0 0x7f6a000a9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:55.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f6a0658f700 1 -- 172.21.15.44:0/697511147 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a000710e0 msgr2=0x7f6a0014a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:55.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f6a0658f700 1 --2- 172.21.15.44:0/697511147 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a000710e0 0x7f6a0014a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:55.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f6a0658f700 1 -- 172.21.15.44:0/697511147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a00154fa0 msgr2=0x7f6a000a9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:55.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f6a0658f700 1 --2- 172.21.15.44:0/697511147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a00154fa0 0x7f6a000a9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:55.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f6a0658f700 1 -- 172.21.15.44:0/697511147 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f4009570 con 0x7f6a0006b0e0 2024-09-13T18:27:55.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f6a05d8e700 1 --2- 172.21.15.44:0/697511147 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a000710e0 0x7f6a0014a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:55.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f6a06d90700 1 --2- 172.21.15.44:0/697511147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a00154fa0 0x7f6a000a9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:55.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f6a0658f700 1 --2- 172.21.15.44:0/697511147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a0006b0e0 0x7f6a0015a480 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00e870 tx=0x7f69fc00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:55.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f69f2ffd700 1 -- 172.21.15.44:0/697511147 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc0095c0 con 0x7f6a0006b0e0 2024-09-13T18:27:55.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f69f2ffd700 1 -- 172.21.15.44:0/697511147 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69fc013680 con 0x7f6a0006b0e0 2024-09-13T18:27:55.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f6a07591700 1 -- 172.21.15.44:0/697511147 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a000a8de0 con 0x7f6a0006b0e0 2024-09-13T18:27:55.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f69f2ffd700 1 -- 172.21.15.44:0/697511147 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc013a10 con 0x7f6a0006b0e0 2024-09-13T18:27:55.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.498+0000 7f6a07591700 1 -- 172.21.15.44:0/697511147 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a000a84b0 con 0x7f6a0006b0e0 2024-09-13T18:27:55.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.502+0000 7f6a07591700 1 -- 172.21.15.44:0/697511147 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a00072050 con 0x7f6a0006b0e0 2024-09-13T18:27:55.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.502+0000 7f69f2ffd700 1 -- 172.21.15.44:0/697511147 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f69fc013b70 con 0x7f6a0006b0e0 2024-09-13T18:27:55.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.502+0000 7f69f2ffd700 1 --2- 172.21.15.44:0/697511147 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f69e4066730 0x7f69e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:55.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.502+0000 7f69f2ffd700 1 -- 172.21.15.44:0/697511147 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f69fc0840d0 con 0x7f6a0006b0e0 2024-09-13T18:27:55.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.502+0000 7f6a05d8e700 1 --2- 172.21.15.44:0/697511147 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f69e4066730 0x7f69e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:55.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.506+0000 7f6a05d8e700 1 --2- 172.21.15.44:0/697511147 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f69e4066730 0x7f69e4068bf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6a0006c380 tx=0x7f69f4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:55.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.510+0000 7f69f2ffd700 1 -- 172.21.15.44:0/697511147 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f69fc051370 con 0x7f6a0006b0e0 2024-09-13T18:27:55.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:55.682+0000 7f6a07591700 1 -- 172.21.15.44:0/697511147 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6a000af940 con 0x7f6a0006b0e0 2024-09-13T18:27:56.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.626+0000 7f69f2ffd700 1 -- 172.21.15.44:0/697511147 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7f69fc054990 con 0x7f6a0006b0e0 2024-09-13T18:27:56.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.634+0000 7f6a07591700 1 -- 172.21.15.44:0/697511147 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f69e4066730 msgr2=0x7f69e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:56.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.634+0000 7f6a07591700 1 --2- 172.21.15.44:0/697511147 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f69e4066730 0x7f69e4068bf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6a0006c380 tx=0x7f69f4008030 comp rx=0 tx=0).stop 2024-09-13T18:27:56.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.634+0000 7f6a07591700 1 -- 172.21.15.44:0/697511147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a0006b0e0 msgr2=0x7f6a0015a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:56.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.634+0000 7f6a07591700 1 --2- 172.21.15.44:0/697511147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a0006b0e0 0x7f6a0015a480 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00e870 tx=0x7f69fc00eb80 comp rx=0 tx=0).stop 2024-09-13T18:27:56.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.634+0000 7f6a07591700 1 -- 172.21.15.44:0/697511147 shutdown_connections 2024-09-13T18:27:56.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.634+0000 7f6a07591700 1 --2- 172.21.15.44:0/697511147 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f69e4066730 0x7f69e4068bf0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:56.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.634+0000 7f6a07591700 1 --2- 172.21.15.44:0/697511147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a00154fa0 0x7f6a000a9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:56.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.634+0000 7f6a07591700 1 --2- 172.21.15.44:0/697511147 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a000710e0 0x7f6a0014a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:56.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.634+0000 7f6a07591700 1 --2- 172.21.15.44:0/697511147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a0006b0e0 0x7f6a0015a480 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:56.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.634+0000 7f6a07591700 1 -- 172.21.15.44:0/697511147 >> 172.21.15.44:0/697511147 conn(0x7f6a000cfad0 msgr2=0x7f6a0015cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:56.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.634+0000 7f6a07591700 1 -- 172.21.15.44:0/697511147 shutdown_connections 2024-09-13T18:27:56.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.634+0000 7f6a07591700 1 -- 172.21.15.44:0/697511147 wait complete. 2024-09-13T18:27:56.641 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:27:56.656 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:27:56.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.770+0000 7f05cffff700 1 Processor -- start 2024-09-13T18:27:56.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.770+0000 7f05cffff700 1 -- start start 2024-09-13T18:27:56.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.770+0000 7f05cffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f05d015cbe0 0x7f05d00cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:56.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.770+0000 7f05cffff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f05d00d1de0 0x7f05d01666f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:56.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.770+0000 7f05cffff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d015cfc0 con 0x7f05d00ce5b0 2024-09-13T18:27:56.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.770+0000 7f05cffff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d00ce210 con 0x7f05d00d1de0 2024-09-13T18:27:56.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.770+0000 7f05cffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00ce9f0 con 0x7f05d015cbe0 2024-09-13T18:27:56.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.770+0000 7f05ceffd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f05d015cbe0 0x7f05d00cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:56.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.770+0000 7f05cf7fe700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f05d00d1de0 0x7f05d01666f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:56.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.770+0000 7f05ceffd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f05d015cbe0 0x7f05d00cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:45424/0 (socket says 172.21.15.44:45424) 2024-09-13T18:27:56.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.770+0000 7f05ceffd700 1 -- 172.21.15.44:0/2601798010 learned_addr learned my addr 172.21.15.44:0/2601798010 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:56.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.770+0000 7f05ceffd700 1 -- 172.21.15.44:0/2601798010 >> v2:172.21.15.99:3300/0 conn(0x7f05d00d1de0 msgr2=0x7f05d01666f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:56.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.770+0000 7f05ceffd700 1 --2- 172.21.15.44:0/2601798010 >> v2:172.21.15.99:3300/0 conn(0x7f05d00d1de0 0x7f05d01666f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:56.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.774+0000 7f05ceffd700 1 -- 172.21.15.44:0/2601798010 >> v1:172.21.15.99:6789/0 conn(0x7f05d00ce5b0 legacy=0x7f05d00d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:56.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.774+0000 7f05ceffd700 1 -- 172.21.15.44:0/2601798010 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d00b5ae0 con 0x7f05d015cbe0 2024-09-13T18:27:56.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.774+0000 7f05ceffd700 1 --2- 172.21.15.44:0/2601798010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f05d015cbe0 0x7f05d00cdb50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009910 tx=0x7f05c0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b647978b53620db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:56.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.774+0000 7f05ce7fc700 1 -- 172.21.15.44:0/2601798010 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0011830 con 0x7f05d015cbe0 2024-09-13T18:27:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.774+0000 7f05ce7fc700 1 -- 172.21.15.44:0/2601798010 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c0011990 con 0x7f05d015cbe0 2024-09-13T18:27:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.774+0000 7f05ce7fc700 1 -- 172.21.15.44:0/2601798010 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0011d40 con 0x7f05d015cbe0 2024-09-13T18:27:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.774+0000 7f05cffff700 1 -- 172.21.15.44:0/2601798010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f05d015cbe0 msgr2=0x7f05d00cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.774+0000 7f05cffff700 1 --2- 172.21.15.44:0/2601798010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f05d015cbe0 0x7f05d00cdb50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009910 tx=0x7f05c0009c20 comp rx=0 tx=0).stop 2024-09-13T18:27:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.774+0000 7f05cffff700 1 -- 172.21.15.44:0/2601798010 shutdown_connections 2024-09-13T18:27:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.774+0000 7f05cffff700 1 --2- 172.21.15.44:0/2601798010 >> v2:172.21.15.99:3300/0 conn(0x7f05d00d1de0 0x7f05d01666f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.774+0000 7f05cffff700 1 --2- 172.21.15.44:0/2601798010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f05d015cbe0 0x7f05d00cdb50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.774+0000 7f05cffff700 1 -- 172.21.15.44:0/2601798010 >> 172.21.15.44:0/2601798010 conn(0x7f05d00d36a0 msgr2=0x7f05d00b45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.774+0000 7f05cffff700 1 -- 172.21.15.44:0/2601798010 shutdown_connections 2024-09-13T18:27:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.774+0000 7f05cffff700 1 -- 172.21.15.44:0/2601798010 wait complete. 2024-09-13T18:27:56.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05cffff700 1 Processor -- start 2024-09-13T18:27:56.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05cffff700 1 -- start start 2024-09-13T18:27:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05cffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05d00ce5b0 0x7f05d006c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05cffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05d00d1de0 0x7f05d006a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05cffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f05d015cbe0 0x7f05d0156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05cffff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00c7600 con 0x7f05d00d1de0 2024-09-13T18:27:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05cffff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00c8f30 con 0x7f05d00ce5b0 2024-09-13T18:27:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05cffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00c7040 con 0x7f05d015cbe0 2024-09-13T18:27:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05c67fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05d00d1de0 0x7f05d006a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05ceffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05d00ce5b0 0x7f05d006c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05c67fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05d00d1de0 0x7f05d006a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41260/0 (socket says 172.21.15.44:41260) 2024-09-13T18:27:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05c67fc700 1 -- 172.21.15.44:0/2836370079 learned_addr learned my addr 172.21.15.44:0/2836370079 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05cf7fe700 1 --2- 172.21.15.44:0/2836370079 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f05d015cbe0 0x7f05d0156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05cf7fe700 1 -- 172.21.15.44:0/2836370079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05d00ce5b0 msgr2=0x7f05d006c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05cf7fe700 1 --2- 172.21.15.44:0/2836370079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05d00ce5b0 0x7f05d006c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05cf7fe700 1 -- 172.21.15.44:0/2836370079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05d00d1de0 msgr2=0x7f05d006a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05cf7fe700 1 --2- 172.21.15.44:0/2836370079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05d00d1de0 0x7f05d006a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05cf7fe700 1 -- 172.21.15.44:0/2836370079 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c0009570 con 0x7f05d015cbe0 2024-09-13T18:27:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05c67fc700 1 --2- 172.21.15.44:0/2836370079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05d00d1de0 0x7f05d006a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05cf7fe700 1 --2- 172.21.15.44:0/2836370079 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f05d015cbe0 0x7f05d0156a30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f05c800ef90 tx=0x7f05c800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05c7fff700 1 -- 172.21.15.44:0/2836370079 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c800cc90 con 0x7f05d015cbe0 2024-09-13T18:27:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05c7fff700 1 -- 172.21.15.44:0/2836370079 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c800f040 con 0x7f05d015cbe0 2024-09-13T18:27:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05cffff700 1 -- 172.21.15.44:0/2836370079 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d00c7320 con 0x7f05d015cbe0 2024-09-13T18:27:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05c7fff700 1 -- 172.21.15.44:0/2836370079 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c80146c0 con 0x7f05d015cbe0 2024-09-13T18:27:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.778+0000 7f05cffff700 1 -- 172.21.15.44:0/2836370079 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d006a850 con 0x7f05d015cbe0 2024-09-13T18:27:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.782+0000 7f05cffff700 1 -- 172.21.15.44:0/2836370079 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d00cdb50 con 0x7f05d015cbe0 2024-09-13T18:27:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.782+0000 7f05c7fff700 1 -- 172.21.15.44:0/2836370079 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f05c8014820 con 0x7f05d015cbe0 2024-09-13T18:27:56.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.782+0000 7f05c7fff700 1 --2- 172.21.15.44:0/2836370079 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f05b0066730 0x7f05b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:56.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.782+0000 7f05c7fff700 1 -- 172.21.15.44:0/2836370079 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f05c8084bc0 con 0x7f05d015cbe0 2024-09-13T18:27:56.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.782+0000 7f05ceffd700 1 --2- 172.21.15.44:0/2836370079 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f05b0066730 0x7f05b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.786+0000 7f05ceffd700 1 --2- 172.21.15.44:0/2836370079 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f05b0066730 0x7f05b0068bf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f05c0000c00 tx=0x7f05c0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:56.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.794+0000 7f05c7fff700 1 -- 172.21.15.44:0/2836370079 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f05c8052020 con 0x7f05d015cbe0 2024-09-13T18:27:56.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:56.966+0000 7f05cffff700 1 -- 172.21.15.44:0/2836370079 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f05d006d550 con 0x7f05d015cbe0 2024-09-13T18:27:57.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.634+0000 7f05c7fff700 1 -- 172.21.15.44:0/2836370079 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f05c8018020 con 0x7f05d015cbe0 2024-09-13T18:27:57.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.642+0000 7f05cffff700 1 -- 172.21.15.44:0/2836370079 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f05b0066730 msgr2=0x7f05b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:57.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.642+0000 7f05cffff700 1 --2- 172.21.15.44:0/2836370079 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f05b0066730 0x7f05b0068bf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f05c0000c00 tx=0x7f05c0008030 comp rx=0 tx=0).stop 2024-09-13T18:27:57.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.642+0000 7f05cffff700 1 -- 172.21.15.44:0/2836370079 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f05d015cbe0 msgr2=0x7f05d0156a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:57.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.642+0000 7f05cffff700 1 --2- 172.21.15.44:0/2836370079 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f05d015cbe0 0x7f05d0156a30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f05c800ef90 tx=0x7f05c800c3a0 comp rx=0 tx=0).stop 2024-09-13T18:27:57.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.642+0000 7f05cffff700 1 -- 172.21.15.44:0/2836370079 shutdown_connections 2024-09-13T18:27:57.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.642+0000 7f05cffff700 1 --2- 172.21.15.44:0/2836370079 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f05b0066730 0x7f05b0068bf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:57.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.642+0000 7f05cffff700 1 --2- 172.21.15.44:0/2836370079 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f05d015cbe0 0x7f05d0156a30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:57.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.642+0000 7f05cffff700 1 --2- 172.21.15.44:0/2836370079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05d00d1de0 0x7f05d006a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:57.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.642+0000 7f05cffff700 1 --2- 172.21.15.44:0/2836370079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05d00ce5b0 0x7f05d006c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:57.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.642+0000 7f05cffff700 1 -- 172.21.15.44:0/2836370079 >> 172.21.15.44:0/2836370079 conn(0x7f05d00d36a0 msgr2=0x7f05d00b3910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:57.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.642+0000 7f05cffff700 1 -- 172.21.15.44:0/2836370079 shutdown_connections 2024-09-13T18:27:57.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.642+0000 7f05cffff700 1 -- 172.21.15.44:0/2836370079 wait complete. 2024-09-13T18:27:57.648 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2024-09-13T18:27:57.662 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:27:57.662 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:27:57.662 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:27:57.662 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:27:57.663 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:27:57.663 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:27:57.663 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:27:57.663 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:27:57.663 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:27:57.663 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:27:57.664 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:27:57.664 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:27:57.664 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:27:57.664 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:27:57.664 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:27:57.664 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:27:57.676 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:27:57.676 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:27:57.678 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:27:57.678 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:27:57.679 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:27:57.680 DEBUG:teuthology.parallel:result is None 2024-09-13T18:27:57.680 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:27:57.680 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:27:57.681 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:27:57.681 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:27:57.682 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:27:57.682 DEBUG:teuthology.parallel:result is None 2024-09-13T18:27:57.724 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:27:57.724 DEBUG:teuthology.parallel:result is None 2024-09-13T18:27:57.725 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:27:57.726 DEBUG:teuthology.parallel:result is None 2024-09-13T18:27:57.726 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:27:57.757 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-13T18:27:57.766 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-13T18:27:57.819 INFO:tasks.ceph.mds.d.smithi099.stdout:starting mds.d at 2024-09-13T18:27:57.819 INFO:tasks.ceph.mds.b.smithi099.stdout:starting mds.b at 2024-09-13T18:27:57.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.834+0000 7f9c57161700 1 Processor -- start 2024-09-13T18:27:57.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.834+0000 7f9c57161700 1 -- start start 2024-09-13T18:27:57.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.834+0000 7f9c57161700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c5006ac90 0x7f9c5006cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:57.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.834+0000 7f9c57161700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9c5006e420 0x7f9c500ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:57.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.834+0000 7f9c57161700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c500ce6f0 con 0x7f9c5006b070 2024-09-13T18:27:57.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.834+0000 7f9c57161700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5006d1a0 con 0x7f9c5006e420 2024-09-13T18:27:57.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.834+0000 7f9c57161700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5006d380 con 0x7f9c5006ac90 2024-09-13T18:27:57.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.834+0000 7f9c4ffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9c5006e420 0x7f9c500ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:57.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.834+0000 7f9c556fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9c5006b070 0x7f9c5015d3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54602/0 (socket says 172.21.15.44:54602) 2024-09-13T18:27:57.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.834+0000 7f9c556fe700 1 -- 172.21.15.44:0/3325552684 learned_addr learned my addr 172.21.15.44:0/3325552684 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:57.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.834+0000 7f9c54efd700 1 --2- 172.21.15.44:0/3325552684 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c5006ac90 0x7f9c5006cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:57.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.834+0000 7f9c54efd700 1 -- 172.21.15.44:0/3325552684 >> v2:172.21.15.44:3300/0 conn(0x7f9c5006e420 msgr2=0x7f9c500ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:57.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.834+0000 7f9c54efd700 1 --2- 172.21.15.44:0/3325552684 >> v2:172.21.15.44:3300/0 conn(0x7f9c5006e420 0x7f9c500ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:57.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.834+0000 7f9c54efd700 1 -- 172.21.15.44:0/3325552684 >> v1:172.21.15.44:6789/0 conn(0x7f9c5006b070 legacy=0x7f9c5015d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:57.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.834+0000 7f9c54efd700 1 -- 172.21.15.44:0/3325552684 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5006d660 con 0x7f9c5006ac90 2024-09-13T18:27:57.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.834+0000 7f9c4f7fe700 1 -- 172.21.15.44:0/3325552684 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652835686 0 0) 0x7f9c500ce6f0 con 0x7f9c5006b070 2024-09-13T18:27:57.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.834+0000 7f9c4ffff700 1 --2- 172.21.15.44:0/3325552684 >> v2:172.21.15.44:3300/0 conn(0x7f9c5006e420 0x7f9c500ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:57.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.838+0000 7f9c54efd700 1 --2- 172.21.15.44:0/3325552684 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c5006ac90 0x7f9c5006cc60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009d90 tx=0x7f9c4800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9771db590a54265 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:57.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.838+0000 7f9c4f7fe700 1 -- 172.21.15.44:0/3325552684 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4800e070 con 0x7f9c5006ac90 2024-09-13T18:27:57.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.838+0000 7f9c4f7fe700 1 -- 172.21.15.44:0/3325552684 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4800bb20 con 0x7f9c5006ac90 2024-09-13T18:27:57.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.838+0000 7f9c4f7fe700 1 -- 172.21.15.44:0/3325552684 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48012430 con 0x7f9c5006ac90 2024-09-13T18:27:57.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.838+0000 7f9c57161700 1 -- 172.21.15.44:0/3325552684 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c5006ac90 msgr2=0x7f9c5006cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:57.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.838+0000 7f9c57161700 1 --2- 172.21.15.44:0/3325552684 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c5006ac90 0x7f9c5006cc60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009d90 tx=0x7f9c4800b330 comp rx=0 tx=0).stop 2024-09-13T18:27:57.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.838+0000 7f9c57161700 1 -- 172.21.15.44:0/3325552684 shutdown_connections 2024-09-13T18:27:57.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.838+0000 7f9c57161700 1 --2- 172.21.15.44:0/3325552684 >> v2:172.21.15.44:3300/0 conn(0x7f9c5006e420 0x7f9c500ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:57.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.838+0000 7f9c57161700 1 --2- 172.21.15.44:0/3325552684 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c5006ac90 0x7f9c5006cc60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:57.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.838+0000 7f9c57161700 1 -- 172.21.15.44:0/3325552684 >> 172.21.15.44:0/3325552684 conn(0x7f9c500af5d0 msgr2=0x7f9c500af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:57.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.838+0000 7f9c57161700 1 -- 172.21.15.44:0/3325552684 shutdown_connections 2024-09-13T18:27:57.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.838+0000 7f9c57161700 1 -- 172.21.15.44:0/3325552684 wait complete. 2024-09-13T18:27:57.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.838+0000 7f9c57161700 1 Processor -- start 2024-09-13T18:27:57.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.838+0000 7f9c57161700 1 -- start start 2024-09-13T18:27:57.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c57161700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c5006ac90 0x7f9c5014f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:57.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c57161700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c5006b070 0x7f9c50157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:57.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c57161700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c5006e420 0x7f9c50158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:57.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c57161700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c500a9da0 con 0x7f9c5006e420 2024-09-13T18:27:57.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c57161700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c501f0200 con 0x7f9c5006b070 2024-09-13T18:27:57.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c57161700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c501f0480 con 0x7f9c5006ac90 2024-09-13T18:27:57.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c556fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c5006e420 0x7f9c50158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:57.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c54efd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c5006ac90 0x7f9c5014f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:57.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c54efd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c5006ac90 0x7f9c5014f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:45470/0 (socket says 172.21.15.44:45470) 2024-09-13T18:27:57.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c54efd700 1 -- 172.21.15.44:0/712526503 learned_addr learned my addr 172.21.15.44:0/712526503 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:57.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c4ffff700 1 --2- 172.21.15.44:0/712526503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c5006b070 0x7f9c50157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:57.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c54efd700 1 -- 172.21.15.44:0/712526503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c5006b070 msgr2=0x7f9c50157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:57.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c54efd700 1 --2- 172.21.15.44:0/712526503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c5006b070 0x7f9c50157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:57.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c54efd700 1 -- 172.21.15.44:0/712526503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c5006e420 msgr2=0x7f9c50158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:57.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c54efd700 1 --2- 172.21.15.44:0/712526503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c5006e420 0x7f9c50158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:57.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c54efd700 1 -- 172.21.15.44:0/712526503 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c380094b0 con 0x7f9c5006ac90 2024-09-13T18:27:57.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c556fe700 1 --2- 172.21.15.44:0/712526503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c5006e420 0x7f9c50158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:57.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c54efd700 1 --2- 172.21.15.44:0/712526503 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c5006ac90 0x7f9c5014f110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9c48014040 tx=0x7f9c48004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:57.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c4d7fa700 1 -- 172.21.15.44:0/712526503 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48012430 con 0x7f9c5006ac90 2024-09-13T18:27:57.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c4d7fa700 1 -- 172.21.15.44:0/712526503 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c48020070 con 0x7f9c5006ac90 2024-09-13T18:27:57.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c4d7fa700 1 -- 172.21.15.44:0/712526503 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48004280 con 0x7f9c5006ac90 2024-09-13T18:27:57.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c57161700 1 -- 172.21.15.44:0/712526503 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c48009a70 con 0x7f9c5006ac90 2024-09-13T18:27:57.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c57161700 1 -- 172.21.15.44:0/712526503 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c501f0a40 con 0x7f9c5006ac90 2024-09-13T18:27:57.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.842+0000 7f9c57161700 1 -- 172.21.15.44:0/712526503 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c50159b30 con 0x7f9c5006ac90 2024-09-13T18:27:57.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.846+0000 7f9c4d7fa700 1 -- 172.21.15.44:0/712526503 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9c480043e0 con 0x7f9c5006ac90 2024-09-13T18:27:57.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.846+0000 7f9c4d7fa700 1 --2- 172.21.15.44:0/712526503 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9c30066730 0x7f9c30068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:57.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.846+0000 7f9c4d7fa700 1 -- 172.21.15.44:0/712526503 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9c48022070 con 0x7f9c5006ac90 2024-09-13T18:27:57.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.846+0000 7f9c4ffff700 1 --2- 172.21.15.44:0/712526503 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9c30066730 0x7f9c30068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:57.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.846+0000 7f9c4ffff700 1 --2- 172.21.15.44:0/712526503 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9c30066730 0x7f9c30068bf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9c500b3b40 tx=0x7f9c38009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:57.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:57.854+0000 7f9c4d7fa700 1 -- 172.21.15.44:0/712526503 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9c48053140 con 0x7f9c5006ac90 2024-09-13T18:27:58.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.034+0000 7f9c57161700 1 -- 172.21.15.44:0/712526503 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9c500b3890 con 0x7f9c5006ac90 2024-09-13T18:27:58.320 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:27:58.323 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:27:58.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.838+0000 7f9c4d7fa700 1 -- 172.21.15.44:0/712526503 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v31) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9c4802c080 con 0x7f9c5006ac90 2024-09-13T18:27:58.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.842+0000 7f9c57161700 1 -- 172.21.15.44:0/712526503 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9c30066730 msgr2=0x7f9c30068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:58.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.842+0000 7f9c57161700 1 --2- 172.21.15.44:0/712526503 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9c30066730 0x7f9c30068bf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9c500b3b40 tx=0x7f9c38009240 comp rx=0 tx=0).stop 2024-09-13T18:27:58.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.842+0000 7f9c57161700 1 -- 172.21.15.44:0/712526503 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c5006ac90 msgr2=0x7f9c5014f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:58.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.842+0000 7f9c57161700 1 --2- 172.21.15.44:0/712526503 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c5006ac90 0x7f9c5014f110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9c48014040 tx=0x7f9c48004af0 comp rx=0 tx=0).stop 2024-09-13T18:27:58.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.842+0000 7f9c57161700 1 -- 172.21.15.44:0/712526503 shutdown_connections 2024-09-13T18:27:58.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.842+0000 7f9c57161700 1 --2- 172.21.15.44:0/712526503 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9c30066730 0x7f9c30068bf0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:58.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.842+0000 7f9c57161700 1 --2- 172.21.15.44:0/712526503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c5006e420 0x7f9c50158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:58.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.842+0000 7f9c57161700 1 --2- 172.21.15.44:0/712526503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c5006b070 0x7f9c50157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:58.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.842+0000 7f9c57161700 1 --2- 172.21.15.44:0/712526503 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c5006ac90 0x7f9c5014f110 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:58.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.842+0000 7f9c57161700 1 -- 172.21.15.44:0/712526503 >> 172.21.15.44:0/712526503 conn(0x7f9c500af5d0 msgr2=0x7f9c50071160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:58.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.842+0000 7f9c57161700 1 -- 172.21.15.44:0/712526503 shutdown_connections 2024-09-13T18:27:58.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.842+0000 7f9c57161700 1 -- 172.21.15.44:0/712526503 wait complete. 2024-09-13T18:27:58.851 INFO:teuthology.orchestra.run.smithi044.stderr: removed all blocklist entries 2024-09-13T18:27:58.866 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:27:58.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.978+0000 7f85c3fff700 1 Processor -- start 2024-09-13T18:27:58.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.978+0000 7f85c3fff700 1 -- start start 2024-09-13T18:27:58.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.978+0000 7f85c3fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f85c40b3ae0 0x7f85c406a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:58.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.978+0000 7f85c3fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f85c406aaf0 0x7f85c415e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:58.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.978+0000 7f85c3fff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c413dcb0 con 0x7f85c406bbf0 2024-09-13T18:27:58.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.978+0000 7f85c3fff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c415be60 con 0x7f85c406aaf0 2024-09-13T18:27:58.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.978+0000 7f85c3fff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c413ffd0 con 0x7f85c40b3ae0 2024-09-13T18:27:58.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.978+0000 7f85c37fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f85c406aaf0 0x7f85c415e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:58.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.978+0000 7f85c37fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f85c406aaf0 0x7f85c415e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41314/0 (socket says 172.21.15.44:41314) 2024-09-13T18:27:58.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.978+0000 7f85c37fe700 1 -- 172.21.15.44:0/1681928292 learned_addr learned my addr 172.21.15.44:0/1681928292 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:58.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.978+0000 7f85c27fc700 1 --2- 172.21.15.44:0/1681928292 >> v2:172.21.15.99:3300/0 conn(0x7f85c40b3ae0 0x7f85c406a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:58.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.978+0000 7f85c37fe700 1 -- 172.21.15.44:0/1681928292 >> v2:172.21.15.99:3300/0 conn(0x7f85c40b3ae0 msgr2=0x7f85c406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:58.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.978+0000 7f85c37fe700 1 --2- 172.21.15.44:0/1681928292 >> v2:172.21.15.99:3300/0 conn(0x7f85c40b3ae0 0x7f85c406a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:58.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.978+0000 7f85c37fe700 1 -- 172.21.15.44:0/1681928292 >> v1:172.21.15.99:6789/0 conn(0x7f85c406bbf0 legacy=0x7f85c40b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:58.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.978+0000 7f85c37fe700 1 -- 172.21.15.44:0/1681928292 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c4140220 con 0x7f85c406aaf0 2024-09-13T18:27:58.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.982+0000 7f85c37fe700 1 --2- 172.21.15.44:0/1681928292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85c406aaf0 0x7f85c415e440 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f85c41445b0 tx=0x7f85bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6dce166e333a589 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:58.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.982+0000 7f85c1ffb700 1 -- 172.21.15.44:0/1681928292 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc00e070 con 0x7f85c406aaf0 2024-09-13T18:27:58.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.982+0000 7f85c1ffb700 1 -- 172.21.15.44:0/1681928292 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85bc00b910 con 0x7f85c406aaf0 2024-09-13T18:27:58.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.982+0000 7f85c1ffb700 1 -- 172.21.15.44:0/1681928292 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc00bcc0 con 0x7f85c406aaf0 2024-09-13T18:27:58.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.982+0000 7f85c3fff700 1 -- 172.21.15.44:0/1681928292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85c406aaf0 msgr2=0x7f85c415e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:58.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.982+0000 7f85c3fff700 1 --2- 172.21.15.44:0/1681928292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85c406aaf0 0x7f85c415e440 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f85c41445b0 tx=0x7f85bc00b330 comp rx=0 tx=0).stop 2024-09-13T18:27:58.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.982+0000 7f85c3fff700 1 -- 172.21.15.44:0/1681928292 shutdown_connections 2024-09-13T18:27:58.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.982+0000 7f85c3fff700 1 --2- 172.21.15.44:0/1681928292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85c406aaf0 0x7f85c415e440 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:58.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.982+0000 7f85c3fff700 1 --2- 172.21.15.44:0/1681928292 >> v2:172.21.15.99:3300/0 conn(0x7f85c40b3ae0 0x7f85c406a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:58.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.982+0000 7f85c3fff700 1 -- 172.21.15.44:0/1681928292 >> 172.21.15.44:0/1681928292 conn(0x7f85c40b0f00 msgr2=0x7f85c40b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:58.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.982+0000 7f85c3fff700 1 -- 172.21.15.44:0/1681928292 shutdown_connections 2024-09-13T18:27:58.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.982+0000 7f85c3fff700 1 -- 172.21.15.44:0/1681928292 wait complete. 2024-09-13T18:27:58.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.982+0000 7f85c3fff700 1 Processor -- start 2024-09-13T18:27:58.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.986+0000 7f85c3fff700 1 -- start start 2024-09-13T18:27:58.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.986+0000 7f85c3fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85c406aaf0 0x7f85c4143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:58.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.986+0000 7f85c3fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85c406bbf0 0x7f85c413d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:58.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.986+0000 7f85c3fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85c40b3ae0 0x7f85c4155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:58.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.986+0000 7f85c3fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c4155b50 con 0x7f85c40b3ae0 2024-09-13T18:27:58.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.986+0000 7f85c3fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c4142090 con 0x7f85c406aaf0 2024-09-13T18:27:58.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.986+0000 7f85c3fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c4142370 con 0x7f85c406bbf0 2024-09-13T18:27:58.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.986+0000 7f85c37fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85c40b3ae0 0x7f85c4155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:58.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.986+0000 7f85c37fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85c40b3ae0 0x7f85c4155f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41316/0 (socket says 172.21.15.44:41316) 2024-09-13T18:27:58.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.986+0000 7f85c37fe700 1 -- 172.21.15.44:0/3021783118 learned_addr learned my addr 172.21.15.44:0/3021783118 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:58.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.986+0000 7f85c27fc700 1 --2- 172.21.15.44:0/3021783118 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85c406bbf0 0x7f85c413d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:58.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.986+0000 7f85c2ffd700 1 --2- 172.21.15.44:0/3021783118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85c406aaf0 0x7f85c4143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:58.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.986+0000 7f85c37fe700 1 -- 172.21.15.44:0/3021783118 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85c406bbf0 msgr2=0x7f85c413d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:58.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.986+0000 7f85c37fe700 1 --2- 172.21.15.44:0/3021783118 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85c406bbf0 0x7f85c413d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:58.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.986+0000 7f85c37fe700 1 -- 172.21.15.44:0/3021783118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85c406aaf0 msgr2=0x7f85c4143130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:58.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.986+0000 7f85c37fe700 1 --2- 172.21.15.44:0/3021783118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85c406aaf0 0x7f85c4143130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:58.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.986+0000 7f85c37fe700 1 -- 172.21.15.44:0/3021783118 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85bc009b30 con 0x7f85c40b3ae0 2024-09-13T18:27:58.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.986+0000 7f85c37fe700 1 --2- 172.21.15.44:0/3021783118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85c40b3ae0 0x7f85c4155f00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f85c406b390 tx=0x7f85bc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:58.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.986+0000 7f85ab7fe700 1 -- 172.21.15.44:0/3021783118 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc004880 con 0x7f85c40b3ae0 2024-09-13T18:27:58.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.986+0000 7f85ab7fe700 1 -- 172.21.15.44:0/3021783118 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85bc0099b0 con 0x7f85c40b3ae0 2024-09-13T18:27:58.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.986+0000 7f85c3fff700 1 -- 172.21.15.44:0/3021783118 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c4142650 con 0x7f85c40b3ae0 2024-09-13T18:27:58.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.986+0000 7f85ab7fe700 1 -- 172.21.15.44:0/3021783118 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc01c680 con 0x7f85c40b3ae0 2024-09-13T18:27:58.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.986+0000 7f85c3fff700 1 -- 172.21.15.44:0/3021783118 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c4142c10 con 0x7f85c40b3ae0 2024-09-13T18:27:58.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.990+0000 7f85c3fff700 1 -- 172.21.15.44:0/3021783118 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c4142e30 con 0x7f85c40b3ae0 2024-09-13T18:27:58.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.990+0000 7f85ab7fe700 1 -- 172.21.15.44:0/3021783118 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f85bc01c7e0 con 0x7f85c40b3ae0 2024-09-13T18:27:58.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.990+0000 7f85ab7fe700 1 --2- 172.21.15.44:0/3021783118 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f85b0066730 0x7f85b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:58.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.990+0000 7f85ab7fe700 1 -- 172.21.15.44:0/3021783118 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f85bc0853b0 con 0x7f85c40b3ae0 2024-09-13T18:27:58.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.990+0000 7f85c2ffd700 1 --2- 172.21.15.44:0/3021783118 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f85b0066730 0x7f85b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:58.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.994+0000 7f85c2ffd700 1 --2- 172.21.15.44:0/3021783118 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f85b0066730 0x7f85b0068bf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f85b4000f60 tx=0x7f85b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:59.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:58.998+0000 7f85ab7fe700 1 -- 172.21.15.44:0/3021783118 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f85bc0529d0 con 0x7f85c40b3ae0 2024-09-13T18:27:59.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.226+0000 7f85c3fff700 1 -- 172.21.15.44:0/3021783118 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f85c406af40 con 0x7f85c40b3ae0 2024-09-13T18:27:59.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.230+0000 7f85ab7fe700 1 -- 172.21.15.44:0/3021783118 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f85bc055ff0 con 0x7f85c40b3ae0 2024-09-13T18:27:59.235 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:27:59.235 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:27:59.235 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_dump": [ 2024-09-13T18:27:59.235 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.235 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.a", 2024-09-13T18:27:59.236 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rmm4/RGxAAtGPYfgzYpmE4yHhoggZJ8Q==", 2024-09-13T18:27:59.236 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.236 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:27:59.236 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:27:59.236 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:27:59.236 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:27:59.236 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.236 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.236 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.236 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.b", 2024-09-13T18:27:59.236 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rm8qC+JhAAhdkL3zbxM9+GI8+khy+cSg==", 2024-09-13T18:27:59.236 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.236 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:27:59.237 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:27:59.237 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:27:59.237 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:27:59.237 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.237 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.237 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.237 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.c", 2024-09-13T18:27:59.237 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rmr/OCIhAAvBF106ILl0AZlzCZ+S990Q==", 2024-09-13T18:27:59.237 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.237 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:27:59.237 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:27:59.237 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:27:59.237 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:27:59.237 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.238 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.238 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.238 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.d", 2024-09-13T18:27:59.238 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+RmSHbxKRAAAGsAWnIPUDUk3Y0aYryf+w==", 2024-09-13T18:27:59.238 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.238 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:27:59.238 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:27:59.238 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:27:59.238 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:27:59.238 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.238 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.238 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.238 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.0", 2024-09-13T18:27:59.239 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC6g+Rmw8xKHxAArYof7SeFMvQGq5AnVMbiog==", 2024-09-13T18:27:59.239 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.239 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:27:59.239 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:27:59.239 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:27:59.239 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.239 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.239 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.239 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.1", 2024-09-13T18:27:59.239 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC9g+RmLRFsMxAAC0SXlbIRvFc3byOy742GSg==", 2024-09-13T18:27:59.239 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.239 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:27:59.239 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:27:59.239 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:27:59.239 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.240 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.240 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.240 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.2", 2024-09-13T18:27:59.240 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDAg+RmvbTXNxAAyoLLo9RMD7817x8cdlYjWg==", 2024-09-13T18:27:59.240 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.240 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:27:59.240 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:27:59.240 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:27:59.240 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.240 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.240 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.240 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.3", 2024-09-13T18:27:59.240 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDDg+Rm4/jKOhAAYVOXNUkd3Z9CXAzbxJw34g==", 2024-09-13T18:27:59.240 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.241 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:27:59.241 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:27:59.241 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:27:59.241 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.241 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.241 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.4", 2024-09-13T18:27:59.241 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDJg+RmEZwhJBAAqtUZtMmRzRulAa6cnyvSmQ==", 2024-09-13T18:27:59.241 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.241 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:27:59.241 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:27:59.241 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:27:59.241 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.242 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.242 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.242 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.5", 2024-09-13T18:27:59.242 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDMg+RmCqBKKRAA7oP48mScYw7mkNGahg+ptw==", 2024-09-13T18:27:59.242 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.242 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:27:59.242 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:27:59.242 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:27:59.242 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.242 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.242 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.242 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.6", 2024-09-13T18:27:59.242 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDPg+RmbjDyLxAAIRb9i9TtRsDg+M9SnEegug==", 2024-09-13T18:27:59.243 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.243 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:27:59.243 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:27:59.243 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:27:59.243 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.243 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.243 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.243 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.7", 2024-09-13T18:27:59.243 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDSg+RmA4v7NhAAVe6GV0DVksIWiq6KQvMgVg==", 2024-09-13T18:27:59.243 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.243 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:27:59.244 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:27:59.244 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:27:59.244 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.244 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.244 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.244 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.0", 2024-09-13T18:27:59.244 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rm7FEGMBAAosZ34edcGJmTiY8UhPtung==", 2024-09-13T18:27:59.244 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.244 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:27:59.244 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-13T18:27:59.244 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-13T18:27:59.244 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-13T18:27:59.245 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.245 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.245 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.245 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.1", 2024-09-13T18:27:59.245 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rmpu2zNhAAc0mOfL8c/MYij8KYpvsjRw==", 2024-09-13T18:27:59.245 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.245 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:27:59.245 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-13T18:27:59.245 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-13T18:27:59.245 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-13T18:27:59.245 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.245 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.245 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.246 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.2", 2024-09-13T18:27:59.246 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rm0xw5MxAAWu4i4+IAjW5QzQwiILs6bg==", 2024-09-13T18:27:59.246 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.246 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:27:59.246 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-13T18:27:59.246 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-13T18:27:59.246 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-13T18:27:59.246 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.246 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.246 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.246 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.3", 2024-09-13T18:27:59.246 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+RmZdTZORAA26aYb0Nz0g+rRBG+zAu/EQ==", 2024-09-13T18:27:59.246 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.246 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:27:59.247 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-13T18:27:59.247 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-13T18:27:59.247 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-13T18:27:59.247 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.247 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.247 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.admin", 2024-09-13T18:27:59.247 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+RmVt6IDBAALp4ZMLL2ehaE9O4vCSZzxQ==", 2024-09-13T18:27:59.247 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.247 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-13T18:27:59.247 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:27:59.247 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:27:59.247 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:27:59.247 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.248 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.248 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-mds", 2024-09-13T18:27:59.248 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDdg+RmrcitARAA2x+kTkd7mUAHBC/Ys3/J8A==", 2024-09-13T18:27:59.248 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.248 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-mds" 2024-09-13T18:27:59.248 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.248 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.248 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.248 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-mgr", 2024-09-13T18:27:59.248 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDdg+RmDOStARAARbWvUCuOrZzTU5UgT7ROVQ==", 2024-09-13T18:27:59.248 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.248 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-13T18:27:59.248 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.248 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.249 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-osd", 2024-09-13T18:27:59.249 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDdg+RmnPmtARAAwFX5o0DCTzjvlyah3Jy2PA==", 2024-09-13T18:27:59.249 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.249 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-osd" 2024-09-13T18:27:59.249 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.249 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-rbd", 2024-09-13T18:27:59.249 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDdg+RmUQ+uARAAzpORR44ho0I3h3Swu8Spuw==", 2024-09-13T18:27:59.249 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.249 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-13T18:27:59.249 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.250 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-13T18:27:59.250 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDdg+Rm4SSuARAA663iyFQG3JmuSyhJM1XdFQ==", 2024-09-13T18:27:59.250 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.250 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-13T18:27:59.250 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.250 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.250 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.250 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-rgw", 2024-09-13T18:27:59.250 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDdg+RmnDquARAAFjju4eczubz9iylHkzFF7A==", 2024-09-13T18:27:59.250 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.250 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-13T18:27:59.250 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.250 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.250 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.250 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.x", 2024-09-13T18:27:59.251 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+RmBmEBGBAARTj0TQ0laAEW0n888vMZrA==", 2024-09-13T18:27:59.251 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.251 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-13T18:27:59.251 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-13T18:27:59.251 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:27:59.251 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.251 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:27:59.251 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:27:59.251 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.y", 2024-09-13T18:27:59.251 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rm1KSoFBAALCTzYRRxF7MPxQHL3ETGqQ==", 2024-09-13T18:27:59.251 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:27:59.251 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-13T18:27:59.251 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-13T18:27:59.252 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:27:59.252 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.252 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:27:59.252 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-13T18:27:59.252 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:27:59.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.230+0000 7f85c3fff700 1 -- 172.21.15.44:0/3021783118 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f85b0066730 msgr2=0x7f85b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:59.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.230+0000 7f85c3fff700 1 --2- 172.21.15.44:0/3021783118 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f85b0066730 0x7f85b0068bf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f85b4000f60 tx=0x7f85b4009040 comp rx=0 tx=0).stop 2024-09-13T18:27:59.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.230+0000 7f85c3fff700 1 -- 172.21.15.44:0/3021783118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85c40b3ae0 msgr2=0x7f85c4155f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:59.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.230+0000 7f85c3fff700 1 --2- 172.21.15.44:0/3021783118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85c40b3ae0 0x7f85c4155f00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f85c406b390 tx=0x7f85bc004af0 comp rx=0 tx=0).stop 2024-09-13T18:27:59.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.230+0000 7f85c3fff700 1 -- 172.21.15.44:0/3021783118 shutdown_connections 2024-09-13T18:27:59.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.230+0000 7f85c3fff700 1 --2- 172.21.15.44:0/3021783118 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f85b0066730 0x7f85b0068bf0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:59.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.230+0000 7f85c3fff700 1 --2- 172.21.15.44:0/3021783118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85c40b3ae0 0x7f85c4155f00 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:59.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.230+0000 7f85c3fff700 1 --2- 172.21.15.44:0/3021783118 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85c406bbf0 0x7f85c413d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:59.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.230+0000 7f85c3fff700 1 --2- 172.21.15.44:0/3021783118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85c406aaf0 0x7f85c4143130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:59.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.230+0000 7f85c3fff700 1 -- 172.21.15.44:0/3021783118 >> 172.21.15.44:0/3021783118 conn(0x7f85c40b0f00 msgr2=0x7f85c4071930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:59.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.230+0000 7f85c3fff700 1 -- 172.21.15.44:0/3021783118 shutdown_connections 2024-09-13T18:27:59.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.230+0000 7f85c3fff700 1 -- 172.21.15.44:0/3021783118 wait complete. 2024-09-13T18:27:59.255 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-13T18:27:59.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.370+0000 7f523c81d700 1 Processor -- start 2024-09-13T18:27:59.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.370+0000 7f523c81d700 1 -- start start 2024-09-13T18:27:59.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f523c81d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f52381540a0 0x7f523815a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:59.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f523c81d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52380b4a20 0x7f523806bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:59.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f523c81d700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52380b2a10 con 0x7f52380b3d50 2024-09-13T18:27:59.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f523c81d700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52380b2cb0 con 0x7f52381540a0 2024-09-13T18:27:59.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f523c81d700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52380b2f90 con 0x7f52380b4a20 2024-09-13T18:27:59.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f5236d9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f52381540a0 0x7f523815a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:59.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f523659c700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f52380b3d50 0x7f52380b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54610/0 (socket says 172.21.15.44:54610) 2024-09-13T18:27:59.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f523659c700 1 -- 172.21.15.44:0/1433904090 learned_addr learned my addr 172.21.15.44:0/1433904090 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:27:59.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f523759e700 1 --2- 172.21.15.44:0/1433904090 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52380b4a20 0x7f523806bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:59.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f5235d9b700 1 -- 172.21.15.44:0/1433904090 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4081456336 0 0) 0x7f52380b2a10 con 0x7f52380b3d50 2024-09-13T18:27:59.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f5235d9b700 1 -- 172.21.15.44:0/1433904090 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52240035d0 con 0x7f52380b3d50 2024-09-13T18:27:59.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f5235d9b700 1 -- 172.21.15.44:0/1433904090 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1658864060 0 0) 0x7f52240035d0 con 0x7f52380b3d50 2024-09-13T18:27:59.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f523759e700 1 -- 172.21.15.44:0/1433904090 >> v2:172.21.15.44:3300/0 conn(0x7f52381540a0 msgr2=0x7f523815a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:59.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f523759e700 1 --2- 172.21.15.44:0/1433904090 >> v2:172.21.15.44:3300/0 conn(0x7f52381540a0 0x7f523815a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:59.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f523759e700 1 -- 172.21.15.44:0/1433904090 >> v1:172.21.15.44:6789/0 conn(0x7f52380b3d50 legacy=0x7f52380b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:59.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f523759e700 1 -- 172.21.15.44:0/1433904090 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52380b3270 con 0x7f52380b4a20 2024-09-13T18:27:59.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f5236d9d700 1 --2- 172.21.15.44:0/1433904090 >> v2:172.21.15.44:3300/0 conn(0x7f52381540a0 0x7f523815a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:59.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f523759e700 1 --2- 172.21.15.44:0/1433904090 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52380b4a20 0x7f523806bcb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5230009d90 tx=0x7f523000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41ec28f46739fcbf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:59.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f5235d9b700 1 -- 172.21.15.44:0/1433904090 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523000e070 con 0x7f52380b4a20 2024-09-13T18:27:59.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f5235d9b700 1 -- 172.21.15.44:0/1433904090 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5230003a40 con 0x7f52380b4a20 2024-09-13T18:27:59.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f5235d9b700 1 -- 172.21.15.44:0/1433904090 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220001670 con 0x7f52380b4a20 2024-09-13T18:27:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f523c81d700 1 -- 172.21.15.44:0/1433904090 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52380b4a20 msgr2=0x7f523806bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f523c81d700 1 --2- 172.21.15.44:0/1433904090 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52380b4a20 0x7f523806bcb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5230009d90 tx=0x7f523000b330 comp rx=0 tx=0).stop 2024-09-13T18:27:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f523c81d700 1 -- 172.21.15.44:0/1433904090 shutdown_connections 2024-09-13T18:27:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f523c81d700 1 --2- 172.21.15.44:0/1433904090 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52380b4a20 0x7f523806bcb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f523c81d700 1 --2- 172.21.15.44:0/1433904090 >> v2:172.21.15.44:3300/0 conn(0x7f52381540a0 0x7f523815a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f523c81d700 1 -- 172.21.15.44:0/1433904090 >> 172.21.15.44:0/1433904090 conn(0x7f52380cf980 msgr2=0x7f52380cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f523c81d700 1 -- 172.21.15.44:0/1433904090 shutdown_connections 2024-09-13T18:27:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.374+0000 7f523c81d700 1 -- 172.21.15.44:0/1433904090 wait complete. 2024-09-13T18:27:59.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.378+0000 7f523c81d700 1 Processor -- start 2024-09-13T18:27:59.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.378+0000 7f523c81d700 1 -- start start 2024-09-13T18:27:59.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.378+0000 7f523c81d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52380b3d50 0x7f52381544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:59.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.378+0000 7f523c81d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52380b4a20 0x7f523806c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:59.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.378+0000 7f523c81d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52381540a0 0x7f523815c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:59.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.378+0000 7f523c81d700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5238152030 con 0x7f52381540a0 2024-09-13T18:27:59.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.378+0000 7f523c81d700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523806ce70 con 0x7f52380b4a20 2024-09-13T18:27:59.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.378+0000 7f523c81d700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52381edfa0 con 0x7f52380b3d50 2024-09-13T18:27:59.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.378+0000 7f523759e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52381540a0 0x7f523815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:59.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.378+0000 7f523759e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52381540a0 0x7f523815c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41342/0 (socket says 172.21.15.44:41342) 2024-09-13T18:27:59.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.378+0000 7f523759e700 1 -- 172.21.15.44:0/736053053 learned_addr learned my addr 172.21.15.44:0/736053053 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:59.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.378+0000 7f5236d9d700 1 --2- 172.21.15.44:0/736053053 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52380b3d50 0x7f52381544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:59.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.378+0000 7f523659c700 1 --2- 172.21.15.44:0/736053053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52380b4a20 0x7f523806c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:59.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.378+0000 7f523759e700 1 -- 172.21.15.44:0/736053053 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52380b3d50 msgr2=0x7f52381544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:59.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.378+0000 7f523759e700 1 --2- 172.21.15.44:0/736053053 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52380b3d50 0x7f52381544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:59.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.378+0000 7f523759e700 1 -- 172.21.15.44:0/736053053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52380b4a20 msgr2=0x7f523806c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:59.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.378+0000 7f523759e700 1 --2- 172.21.15.44:0/736053053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52380b4a20 0x7f523806c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:59.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.378+0000 7f523759e700 1 -- 172.21.15.44:0/736053053 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52280094b0 con 0x7f52381540a0 2024-09-13T18:27:59.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.378+0000 7f5236d9d700 1 --2- 172.21.15.44:0/736053053 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52380b3d50 0x7f52381544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:59.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.378+0000 7f523759e700 1 --2- 172.21.15.44:0/736053053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52381540a0 0x7f523815c070 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f52380b30d0 tx=0x7f5230004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:59.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.382+0000 7f522f7fe700 1 -- 172.21.15.44:0/736053053 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5230004670 con 0x7f52381540a0 2024-09-13T18:27:59.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.382+0000 7f522f7fe700 1 -- 172.21.15.44:0/736053053 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52300047d0 con 0x7f52381540a0 2024-09-13T18:27:59.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.382+0000 7f523c81d700 1 -- 172.21.15.44:0/736053053 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5230009a70 con 0x7f52381540a0 2024-09-13T18:27:59.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.382+0000 7f522f7fe700 1 -- 172.21.15.44:0/736053053 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5230012670 con 0x7f52381540a0 2024-09-13T18:27:59.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.382+0000 7f523c81d700 1 -- 172.21.15.44:0/736053053 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5238154e50 con 0x7f52381540a0 2024-09-13T18:27:59.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.382+0000 7f523c81d700 1 -- 172.21.15.44:0/736053053 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52381ee1c0 con 0x7f52381540a0 2024-09-13T18:27:59.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.382+0000 7f522f7fe700 1 -- 172.21.15.44:0/736053053 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f52300127d0 con 0x7f52381540a0 2024-09-13T18:27:59.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.382+0000 7f522f7fe700 1 --2- 172.21.15.44:0/736053053 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5218066730 0x7f5218068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:59.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.382+0000 7f522f7fe700 1 -- 172.21.15.44:0/736053053 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5230086230 con 0x7f52381540a0 2024-09-13T18:27:59.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.382+0000 7f5236d9d700 1 --2- 172.21.15.44:0/736053053 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5218066730 0x7f5218068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:59.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.386+0000 7f5236d9d700 1 --2- 172.21.15.44:0/736053053 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5218066730 0x7f5218068bf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5228009d30 tx=0x7f5228008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:59.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.390+0000 7f522f7fe700 1 -- 172.21.15.44:0/736053053 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5230057410 con 0x7f52381540a0 2024-09-13T18:27:59.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.618+0000 7f523c81d700 1 -- 172.21.15.44:0/736053053 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f523806dad0 con 0x7f52381540a0 2024-09-13T18:27:59.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.626+0000 7f522f7fe700 1 -- 172.21.15.44:0/736053053 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5230056fa0 con 0x7f52381540a0 2024-09-13T18:27:59.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.630+0000 7f523c81d700 1 -- 172.21.15.44:0/736053053 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5218066730 msgr2=0x7f5218068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:59.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.630+0000 7f523c81d700 1 --2- 172.21.15.44:0/736053053 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5218066730 0x7f5218068bf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5228009d30 tx=0x7f5228008040 comp rx=0 tx=0).stop 2024-09-13T18:27:59.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.630+0000 7f523c81d700 1 -- 172.21.15.44:0/736053053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52381540a0 msgr2=0x7f523815c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:59.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.630+0000 7f523c81d700 1 --2- 172.21.15.44:0/736053053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52381540a0 0x7f523815c070 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f52380b30d0 tx=0x7f5230004af0 comp rx=0 tx=0).stop 2024-09-13T18:27:59.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.630+0000 7f523c81d700 1 -- 172.21.15.44:0/736053053 shutdown_connections 2024-09-13T18:27:59.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.630+0000 7f523c81d700 1 --2- 172.21.15.44:0/736053053 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5218066730 0x7f5218068bf0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:59.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.630+0000 7f523c81d700 1 --2- 172.21.15.44:0/736053053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52381540a0 0x7f523815c070 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:59.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.630+0000 7f523c81d700 1 --2- 172.21.15.44:0/736053053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52380b4a20 0x7f523806c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:59.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.630+0000 7f523c81d700 1 --2- 172.21.15.44:0/736053053 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52380b3d50 0x7f52381544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:59.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.630+0000 7f523c81d700 1 -- 172.21.15.44:0/736053053 >> 172.21.15.44:0/736053053 conn(0x7f52380cf980 msgr2=0x7f52380b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:59.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.630+0000 7f523c81d700 1 -- 172.21.15.44:0/736053053 shutdown_connections 2024-09-13T18:27:59.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.630+0000 7f523c81d700 1 -- 172.21.15.44:0/736053053 wait complete. 2024-09-13T18:27:59.651 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-13T18:27:59.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.762+0000 7f472d290700 1 Processor -- start 2024-09-13T18:27:59.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.762+0000 7f472d290700 1 -- start start 2024-09-13T18:27:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.762+0000 7f472d290700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f472815cda0 0x7f472806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.762+0000 7f472d290700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f47280ceb70 0x7f47280b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.762+0000 7f472d290700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47280b8430 con 0x7f472806a520 2024-09-13T18:27:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.762+0000 7f472d290700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f472806be40 con 0x7f47280ceb70 2024-09-13T18:27:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.762+0000 7f472d290700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47280cf350 con 0x7f472815cda0 2024-09-13T18:27:59.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.766+0000 7f47277fe700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f47280ceb70 0x7f47280b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:59.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.766+0000 7f4727fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f472815cda0 0x7f472806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:59.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.766+0000 7f47277fe700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f47280ceb70 0x7f47280b5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:55474/0 (socket says 172.21.15.44:55474) 2024-09-13T18:27:59.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.766+0000 7f47277fe700 1 -- 172.21.15.44:0/1920025345 learned_addr learned my addr 172.21.15.44:0/1920025345 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:59.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.766+0000 7f472ca8f700 1 --1- 172.21.15.44:0/1920025345 >> v1:172.21.15.99:6789/0 conn(0x7f472806a520 0x7f47280d1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:46782/0 (socket says 172.21.15.44:46782) 2024-09-13T18:27:59.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.766+0000 7f4727fff700 1 -- 172.21.15.44:0/1920025345 >> v2:172.21.15.99:3300/0 conn(0x7f47280ceb70 msgr2=0x7f47280b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:59.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.766+0000 7f4727fff700 1 --2- 172.21.15.44:0/1920025345 >> v2:172.21.15.99:3300/0 conn(0x7f47280ceb70 0x7f47280b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:59.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.766+0000 7f4727fff700 1 -- 172.21.15.44:0/1920025345 >> v1:172.21.15.99:6789/0 conn(0x7f472806a520 legacy=0x7f47280d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:59.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.766+0000 7f4726ffd700 1 -- 172.21.15.44:0/1920025345 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 331374135 0 0) 0x7f47280b8430 con 0x7f472806a520 2024-09-13T18:27:59.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.766+0000 7f4727fff700 1 -- 172.21.15.44:0/1920025345 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47280d0880 con 0x7f472815cda0 2024-09-13T18:27:59.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.766+0000 7f47277fe700 1 --2- 172.21.15.44:0/1920025345 >> v2:172.21.15.99:3300/0 conn(0x7f47280ceb70 0x7f47280b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:59.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.766+0000 7f4727fff700 1 --2- 172.21.15.44:0/1920025345 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f472815cda0 0x7f472806b900 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4718009850 tx=0x7f4718009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d1a15a7c2a1a741 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:59.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.766+0000 7f4726ffd700 1 -- 172.21.15.44:0/1920025345 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718011830 con 0x7f472815cda0 2024-09-13T18:27:59.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.766+0000 7f4726ffd700 1 -- 172.21.15.44:0/1920025345 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4718011990 con 0x7f472815cda0 2024-09-13T18:27:59.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.766+0000 7f4726ffd700 1 -- 172.21.15.44:0/1920025345 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718011d40 con 0x7f472815cda0 2024-09-13T18:27:59.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.766+0000 7f472d290700 1 -- 172.21.15.44:0/1920025345 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f472815cda0 msgr2=0x7f472806b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:59.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.766+0000 7f472d290700 1 --2- 172.21.15.44:0/1920025345 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f472815cda0 0x7f472806b900 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4718009850 tx=0x7f4718009b60 comp rx=0 tx=0).stop 2024-09-13T18:27:59.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.766+0000 7f472d290700 1 -- 172.21.15.44:0/1920025345 shutdown_connections 2024-09-13T18:27:59.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.766+0000 7f472d290700 1 --2- 172.21.15.44:0/1920025345 >> v2:172.21.15.99:3300/0 conn(0x7f47280ceb70 0x7f47280b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:59.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.766+0000 7f472d290700 1 --2- 172.21.15.44:0/1920025345 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f472815cda0 0x7f472806b900 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:59.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.766+0000 7f472d290700 1 -- 172.21.15.44:0/1920025345 >> 172.21.15.44:0/1920025345 conn(0x7f47280d2cb0 msgr2=0x7f47280d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:59.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.766+0000 7f472d290700 1 -- 172.21.15.44:0/1920025345 shutdown_connections 2024-09-13T18:27:59.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.766+0000 7f472d290700 1 -- 172.21.15.44:0/1920025345 wait complete. 2024-09-13T18:27:59.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.770+0000 7f472d290700 1 Processor -- start 2024-09-13T18:27:59.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.770+0000 7f472d290700 1 -- start start 2024-09-13T18:27:59.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.774+0000 7f472d290700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f472806a520 0x7f4728150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:59.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.774+0000 7f472d290700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47280ceb70 0x7f47280c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:59.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.774+0000 7f472d290700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f472815cda0 0x7f47280b6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:59.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.774+0000 7f472d290700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47281513d0 con 0x7f472806a520 2024-09-13T18:27:59.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.774+0000 7f472d290700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47280c8e60 con 0x7f472815cda0 2024-09-13T18:27:59.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.774+0000 7f472d290700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472815e330 con 0x7f47280ceb70 2024-09-13T18:27:59.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.774+0000 7f4727fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f472806a520 0x7f4728150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:59.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.774+0000 7f4727fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f472806a520 0x7f4728150e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41344/0 (socket says 172.21.15.44:41344) 2024-09-13T18:27:59.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.774+0000 7f4727fff700 1 -- 172.21.15.44:0/4123478249 learned_addr learned my addr 172.21.15.44:0/4123478249 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:27:59.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.774+0000 7f47277fe700 1 --2- 172.21.15.44:0/4123478249 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47280ceb70 0x7f47280c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:59.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.774+0000 7f472ca8f700 1 --2- 172.21.15.44:0/4123478249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f472815cda0 0x7f47280b6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:59.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.774+0000 7f4727fff700 1 -- 172.21.15.44:0/4123478249 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47280ceb70 msgr2=0x7f47280c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:59.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.774+0000 7f4727fff700 1 --2- 172.21.15.44:0/4123478249 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47280ceb70 0x7f47280c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:59.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.774+0000 7f4727fff700 1 -- 172.21.15.44:0/4123478249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f472815cda0 msgr2=0x7f47280b6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:59.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.774+0000 7f4727fff700 1 --2- 172.21.15.44:0/4123478249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f472815cda0 0x7f47280b6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:59.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.774+0000 7f4727fff700 1 -- 172.21.15.44:0/4123478249 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4710009570 con 0x7f472806a520 2024-09-13T18:27:59.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.774+0000 7f4727fff700 1 --2- 172.21.15.44:0/4123478249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f472806a520 0x7f4728150e90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4718014040 tx=0x7f4718004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:59.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.774+0000 7f4724ff9700 1 -- 172.21.15.44:0/4123478249 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718019980 con 0x7f472806a520 2024-09-13T18:27:59.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.774+0000 7f4724ff9700 1 -- 172.21.15.44:0/4123478249 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471801e070 con 0x7f472806a520 2024-09-13T18:27:59.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.774+0000 7f472d290700 1 -- 172.21.15.44:0/4123478249 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47180094b0 con 0x7f472806a520 2024-09-13T18:27:59.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.774+0000 7f4724ff9700 1 -- 172.21.15.44:0/4123478249 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718019d20 con 0x7f472806a520 2024-09-13T18:27:59.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.774+0000 7f472d290700 1 -- 172.21.15.44:0/4123478249 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472815e8f0 con 0x7f472806a520 2024-09-13T18:27:59.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.778+0000 7f472d290700 1 -- 172.21.15.44:0/4123478249 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472815eae0 con 0x7f472806a520 2024-09-13T18:27:59.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.778+0000 7f4724ff9700 1 -- 172.21.15.44:0/4123478249 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f471802d430 con 0x7f472806a520 2024-09-13T18:27:59.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.778+0000 7f4724ff9700 1 --2- 172.21.15.44:0/4123478249 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4708066760 0x7f4708068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:59.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.778+0000 7f4724ff9700 1 -- 172.21.15.44:0/4123478249 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4718084d70 con 0x7f472806a520 2024-09-13T18:27:59.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.778+0000 7f47277fe700 1 --2- 172.21.15.44:0/4123478249 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4708066760 0x7f4708068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:59.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.778+0000 7f47277fe700 1 --2- 172.21.15.44:0/4123478249 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4708066760 0x7f4708068c20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f472815c5f0 tx=0x7f47100092e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:59.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:27:59.786+0000 7f4724ff9700 1 -- 172.21.15.44:0/4123478249 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4718052440 con 0x7f472806a520 2024-09-13T18:28:00.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.018+0000 7f472d290700 1 -- 172.21.15.44:0/4123478249 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f472806b900 con 0x7f472806a520 2024-09-13T18:28:00.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.026+0000 7f4724ff9700 1 -- 172.21.15.44:0/4123478249 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4718055a60 con 0x7f472806a520 2024-09-13T18:28:00.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.030+0000 7f472d290700 1 -- 172.21.15.44:0/4123478249 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4708066760 msgr2=0x7f4708068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:00.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.030+0000 7f472d290700 1 --2- 172.21.15.44:0/4123478249 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4708066760 0x7f4708068c20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f472815c5f0 tx=0x7f47100092e0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.030+0000 7f472d290700 1 -- 172.21.15.44:0/4123478249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f472806a520 msgr2=0x7f4728150e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:00.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.030+0000 7f472d290700 1 --2- 172.21.15.44:0/4123478249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f472806a520 0x7f4728150e90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4718014040 tx=0x7f4718004770 comp rx=0 tx=0).stop 2024-09-13T18:28:00.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.030+0000 7f472d290700 1 -- 172.21.15.44:0/4123478249 shutdown_connections 2024-09-13T18:28:00.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.030+0000 7f472d290700 1 --2- 172.21.15.44:0/4123478249 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4708066760 0x7f4708068c20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.030+0000 7f472d290700 1 --2- 172.21.15.44:0/4123478249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f472815cda0 0x7f47280b6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.030+0000 7f472d290700 1 --2- 172.21.15.44:0/4123478249 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47280ceb70 0x7f47280c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.030+0000 7f472d290700 1 --2- 172.21.15.44:0/4123478249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f472806a520 0x7f4728150e90 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.030+0000 7f472d290700 1 -- 172.21.15.44:0/4123478249 >> 172.21.15.44:0/4123478249 conn(0x7f47280d2cb0 msgr2=0x7f47280cf680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:00.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.030+0000 7f472d290700 1 -- 172.21.15.44:0/4123478249 shutdown_connections 2024-09-13T18:28:00.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.030+0000 7f472d290700 1 -- 172.21.15.44:0/4123478249 wait complete. 2024-09-13T18:28:00.048 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-13T18:28:00.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.158+0000 7f95e6bcf700 1 Processor -- start 2024-09-13T18:28:00.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.158+0000 7f95e6bcf700 1 -- start start 2024-09-13T18:28:00.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.158+0000 7f95e6bcf700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95e0154fa0 0x7f95e006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:00.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.158+0000 7f95e6bcf700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f95e006b0e0 0x7f95e0070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:00.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.158+0000 7f95e6bcf700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e006b540 con 0x7f95e00710e0 2024-09-13T18:28:00.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.158+0000 7f95e6bcf700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e0155380 con 0x7f95e006b0e0 2024-09-13T18:28:00.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.158+0000 7f95e6bcf700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e015b240 con 0x7f95e0154fa0 2024-09-13T18:28:00.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.158+0000 7f95e53cc700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f95e006b0e0 0x7f95e0070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:00.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.158+0000 7f95e53cc700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f95e006b0e0 0x7f95e0070ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41354/0 (socket says 172.21.15.44:41354) 2024-09-13T18:28:00.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.158+0000 7f95e53cc700 1 -- 172.21.15.44:0/1766011124 learned_addr learned my addr 172.21.15.44:0/1766011124 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:00.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.158+0000 7f95e5bcd700 1 --2- 172.21.15.44:0/1766011124 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95e0154fa0 0x7f95e006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:00.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.158+0000 7f95e53cc700 1 -- 172.21.15.44:0/1766011124 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95e0154fa0 msgr2=0x7f95e006aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:00.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.158+0000 7f95e53cc700 1 --2- 172.21.15.44:0/1766011124 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95e0154fa0 0x7f95e006aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.158+0000 7f95e53cc700 1 -- 172.21.15.44:0/1766011124 >> v1:172.21.15.99:6789/0 conn(0x7f95e00710e0 legacy=0x7f95e006cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:00.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.158+0000 7f95e53cc700 1 -- 172.21.15.44:0/1766011124 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e00723c0 con 0x7f95e006b0e0 2024-09-13T18:28:00.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.158+0000 7f95e53cc700 1 --2- 172.21.15.44:0/1766011124 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e006b0e0 0x7f95e0070ba0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009e50 tx=0x7f95dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7951a26f57b9c76b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:00.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.158+0000 7f95e4bcb700 1 -- 172.21.15.44:0/1766011124 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc00e070 con 0x7f95e006b0e0 2024-09-13T18:28:00.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.158+0000 7f95e4bcb700 1 -- 172.21.15.44:0/1766011124 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95dc00b9c0 con 0x7f95e006b0e0 2024-09-13T18:28:00.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.158+0000 7f95e4bcb700 1 -- 172.21.15.44:0/1766011124 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc00bd70 con 0x7f95e006b0e0 2024-09-13T18:28:00.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.158+0000 7f95e6bcf700 1 -- 172.21.15.44:0/1766011124 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e006b0e0 msgr2=0x7f95e0070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:00.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.158+0000 7f95e6bcf700 1 --2- 172.21.15.44:0/1766011124 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e006b0e0 0x7f95e0070ba0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009e50 tx=0x7f95dc00b330 comp rx=0 tx=0).stop 2024-09-13T18:28:00.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.158+0000 7f95e6bcf700 1 -- 172.21.15.44:0/1766011124 shutdown_connections 2024-09-13T18:28:00.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.162+0000 7f95e6bcf700 1 --2- 172.21.15.44:0/1766011124 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e006b0e0 0x7f95e0070ba0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.162+0000 7f95e6bcf700 1 --2- 172.21.15.44:0/1766011124 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95e0154fa0 0x7f95e006aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.162+0000 7f95e6bcf700 1 -- 172.21.15.44:0/1766011124 >> 172.21.15.44:0/1766011124 conn(0x7f95e00cfad0 msgr2=0x7f95e00cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:00.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.162+0000 7f95e6bcf700 1 -- 172.21.15.44:0/1766011124 shutdown_connections 2024-09-13T18:28:00.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.162+0000 7f95e6bcf700 1 -- 172.21.15.44:0/1766011124 wait complete. 2024-09-13T18:28:00.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.162+0000 7f95e6bcf700 1 Processor -- start 2024-09-13T18:28:00.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.162+0000 7f95e6bcf700 1 -- start start 2024-09-13T18:28:00.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.162+0000 7f95e6bcf700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95e006b0e0 0x7f95e0151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:00.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.162+0000 7f95e6bcf700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e00710e0 0x7f95e0150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:00.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.162+0000 7f95e6bcf700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95e0154fa0 0x7f95e014cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:00.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.162+0000 7f95e6bcf700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e01510e0 con 0x7f95e00710e0 2024-09-13T18:28:00.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.162+0000 7f95e6bcf700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e014c270 con 0x7f95e006b0e0 2024-09-13T18:28:00.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.162+0000 7f95e6bcf700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e014c510 con 0x7f95e0154fa0 2024-09-13T18:28:00.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.162+0000 7f95e53cc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e00710e0 0x7f95e0150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:00.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.162+0000 7f95e53cc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e00710e0 0x7f95e0150ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41362/0 (socket says 172.21.15.44:41362) 2024-09-13T18:28:00.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.162+0000 7f95e53cc700 1 -- 172.21.15.44:0/2229891699 learned_addr learned my addr 172.21.15.44:0/2229891699 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:00.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.162+0000 7f95e5bcd700 1 --2- 172.21.15.44:0/2229891699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95e006b0e0 0x7f95e0151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:00.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.162+0000 7f95e63ce700 1 --2- 172.21.15.44:0/2229891699 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95e0154fa0 0x7f95e014cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:00.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.166+0000 7f95e53cc700 1 -- 172.21.15.44:0/2229891699 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95e0154fa0 msgr2=0x7f95e014cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:00.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.166+0000 7f95e53cc700 1 --2- 172.21.15.44:0/2229891699 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95e0154fa0 0x7f95e014cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.166+0000 7f95e53cc700 1 -- 172.21.15.44:0/2229891699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95e006b0e0 msgr2=0x7f95e0151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:00.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.166+0000 7f95e53cc700 1 --2- 172.21.15.44:0/2229891699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95e006b0e0 0x7f95e0151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.166+0000 7f95e53cc700 1 -- 172.21.15.44:0/2229891699 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95dc009b30 con 0x7f95e00710e0 2024-09-13T18:28:00.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.166+0000 7f95e53cc700 1 --2- 172.21.15.44:0/2229891699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e00710e0 0x7f95e0150ba0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00b370 tx=0x7f95dc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:00.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.166+0000 7f95d27fc700 1 -- 172.21.15.44:0/2229891699 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc004800 con 0x7f95e00710e0 2024-09-13T18:28:00.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.166+0000 7f95d27fc700 1 -- 172.21.15.44:0/2229891699 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95dc0092e0 con 0x7f95e00710e0 2024-09-13T18:28:00.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.166+0000 7f95e6bcf700 1 -- 172.21.15.44:0/2229891699 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e014c7f0 con 0x7f95e00710e0 2024-09-13T18:28:00.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.166+0000 7f95d27fc700 1 -- 172.21.15.44:0/2229891699 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc01c680 con 0x7f95e00710e0 2024-09-13T18:28:00.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.166+0000 7f95e6bcf700 1 -- 172.21.15.44:0/2229891699 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e0151310 con 0x7f95e00710e0 2024-09-13T18:28:00.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.166+0000 7f95e6bcf700 1 -- 172.21.15.44:0/2229891699 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e015e100 con 0x7f95e00710e0 2024-09-13T18:28:00.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.170+0000 7f95d27fc700 1 -- 172.21.15.44:0/2229891699 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f95dc01c7e0 con 0x7f95e00710e0 2024-09-13T18:28:00.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.170+0000 7f95d27fc700 1 --2- 172.21.15.44:0/2229891699 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f95c4066730 0x7f95c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:00.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.170+0000 7f95d27fc700 1 -- 172.21.15.44:0/2229891699 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f95dc085a20 con 0x7f95e00710e0 2024-09-13T18:28:00.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.170+0000 7f95e5bcd700 1 --2- 172.21.15.44:0/2229891699 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f95c4066730 0x7f95c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:00.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.170+0000 7f95e5bcd700 1 --2- 172.21.15.44:0/2229891699 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f95c4066730 0x7f95c4068bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f95d4007a60 tx=0x7f95d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:00.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.178+0000 7f95d27fc700 1 -- 172.21.15.44:0/2229891699 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f95dc053290 con 0x7f95e00710e0 2024-09-13T18:28:00.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.410+0000 7f95e6bcf700 1 -- 172.21.15.44:0/2229891699 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f95e0072050 con 0x7f95e00710e0 2024-09-13T18:28:00.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.414+0000 7f95d27fc700 1 -- 172.21.15.44:0/2229891699 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f95dc0568b0 con 0x7f95e00710e0 2024-09-13T18:28:00.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.418+0000 7f95e6bcf700 1 -- 172.21.15.44:0/2229891699 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f95c4066730 msgr2=0x7f95c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:00.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.418+0000 7f95e6bcf700 1 --2- 172.21.15.44:0/2229891699 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f95c4066730 0x7f95c4068bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f95d4007a60 tx=0x7f95d4008040 comp rx=0 tx=0).stop 2024-09-13T18:28:00.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.418+0000 7f95e6bcf700 1 -- 172.21.15.44:0/2229891699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e00710e0 msgr2=0x7f95e0150ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:00.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.418+0000 7f95e6bcf700 1 --2- 172.21.15.44:0/2229891699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e00710e0 0x7f95e0150ba0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00b370 tx=0x7f95dc004af0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.418+0000 7f95e6bcf700 1 -- 172.21.15.44:0/2229891699 shutdown_connections 2024-09-13T18:28:00.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.418+0000 7f95e6bcf700 1 --2- 172.21.15.44:0/2229891699 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f95c4066730 0x7f95c4068bf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.418+0000 7f95e6bcf700 1 --2- 172.21.15.44:0/2229891699 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95e0154fa0 0x7f95e014cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.422+0000 7f95e6bcf700 1 --2- 172.21.15.44:0/2229891699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e00710e0 0x7f95e0150ba0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.422+0000 7f95e6bcf700 1 --2- 172.21.15.44:0/2229891699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95e006b0e0 0x7f95e0151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.422+0000 7f95e6bcf700 1 -- 172.21.15.44:0/2229891699 >> 172.21.15.44:0/2229891699 conn(0x7f95e00cfad0 msgr2=0x7f95e015b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:00.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.422+0000 7f95e6bcf700 1 -- 172.21.15.44:0/2229891699 shutdown_connections 2024-09-13T18:28:00.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.422+0000 7f95e6bcf700 1 -- 172.21.15.44:0/2229891699 wait complete. 2024-09-13T18:28:00.441 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-13T18:28:00.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.550+0000 7f51b4f85700 1 Processor -- start 2024-09-13T18:28:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.550+0000 7f51b4f85700 1 -- start start 2024-09-13T18:28:00.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.550+0000 7f51b4f85700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51b00cadd0 0x7f51b00cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:00.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.550+0000 7f51b4f85700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f51b015e990 0x7f51b00ca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:00.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.550+0000 7f51b4f85700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b015d4f0 con 0x7f51b00cddd0 2024-09-13T18:28:00.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.550+0000 7f51b4f85700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b00cb6f0 con 0x7f51b015e990 2024-09-13T18:28:00.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.550+0000 7f51b4f85700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b00ce7b0 con 0x7f51b00cadd0 2024-09-13T18:28:00.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.554+0000 7f51af7fe700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51b00cadd0 0x7f51b00cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:00.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.554+0000 7f51affff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f51b015e990 0x7f51b00ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:00.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.554+0000 7f51a6ffd700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f51b00cddd0 0x7f51b00c9d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:46802/0 (socket says 172.21.15.44:46802) 2024-09-13T18:28:00.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.554+0000 7f51a6ffd700 1 -- 172.21.15.44:0/2144324132 learned_addr learned my addr 172.21.15.44:0/2144324132 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:00.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.554+0000 7f51affff700 1 -- 172.21.15.44:0/2144324132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51b00cadd0 msgr2=0x7f51b00cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:00.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.554+0000 7f51affff700 1 --2- 172.21.15.44:0/2144324132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51b00cadd0 0x7f51b00cb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.554+0000 7f51affff700 1 -- 172.21.15.44:0/2144324132 >> v1:172.21.15.99:6789/0 conn(0x7f51b00cddd0 legacy=0x7f51b00c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:00.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.554+0000 7f51aeffd700 1 -- 172.21.15.44:0/2144324132 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688161977 0 0) 0x7f51b015d4f0 con 0x7f51b00cddd0 2024-09-13T18:28:00.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.554+0000 7f51affff700 1 -- 172.21.15.44:0/2144324132 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b00cea90 con 0x7f51b015e990 2024-09-13T18:28:00.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.554+0000 7f51affff700 1 --2- 172.21.15.44:0/2144324132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51b015e990 0x7f51b00ca430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009d90 tx=0x7f51a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e987aed5efc78c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:00.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.554+0000 7f51aeffd700 1 -- 172.21.15.44:0/2144324132 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a800e070 con 0x7f51b015e990 2024-09-13T18:28:00.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.554+0000 7f51aeffd700 1 -- 172.21.15.44:0/2144324132 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a800bb20 con 0x7f51b015e990 2024-09-13T18:28:00.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.554+0000 7f51aeffd700 1 -- 172.21.15.44:0/2144324132 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8012430 con 0x7f51b015e990 2024-09-13T18:28:00.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.554+0000 7f51b4f85700 1 -- 172.21.15.44:0/2144324132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51b015e990 msgr2=0x7f51b00ca430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:00.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.554+0000 7f51b4f85700 1 --2- 172.21.15.44:0/2144324132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51b015e990 0x7f51b00ca430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009d90 tx=0x7f51a800b330 comp rx=0 tx=0).stop 2024-09-13T18:28:00.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.554+0000 7f51b4f85700 1 -- 172.21.15.44:0/2144324132 shutdown_connections 2024-09-13T18:28:00.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.554+0000 7f51b4f85700 1 --2- 172.21.15.44:0/2144324132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51b015e990 0x7f51b00ca430 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.554+0000 7f51b4f85700 1 --2- 172.21.15.44:0/2144324132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51b00cadd0 0x7f51b00cb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.554+0000 7f51b4f85700 1 -- 172.21.15.44:0/2144324132 >> 172.21.15.44:0/2144324132 conn(0x7f51b006a4f0 msgr2=0x7f51b0071d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:00.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.554+0000 7f51b4f85700 1 -- 172.21.15.44:0/2144324132 shutdown_connections 2024-09-13T18:28:00.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.554+0000 7f51b4f85700 1 -- 172.21.15.44:0/2144324132 wait complete. 2024-09-13T18:28:00.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.554+0000 7f51b4f85700 1 Processor -- start 2024-09-13T18:28:00.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.558+0000 7f51b4f85700 1 -- start start 2024-09-13T18:28:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.558+0000 7f51b4f85700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51b00cadd0 0x7f51b0144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.558+0000 7f51b4f85700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51b00cddd0 0x7f51b00ab9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.558+0000 7f51b4f85700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51b015e990 0x7f51b00abef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.558+0000 7f51b4f85700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b0135f70 con 0x7f51b015e990 2024-09-13T18:28:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.558+0000 7f51b4f85700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b0133750 con 0x7f51b00cadd0 2024-09-13T18:28:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.558+0000 7f51b4f85700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b01363e0 con 0x7f51b00cddd0 2024-09-13T18:28:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.558+0000 7f51affff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51b015e990 0x7f51b00abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.558+0000 7f51af7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51b00cadd0 0x7f51b0144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.558+0000 7f51affff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51b015e990 0x7f51b00abef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41372/0 (socket says 172.21.15.44:41372) 2024-09-13T18:28:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.558+0000 7f51affff700 1 -- 172.21.15.44:0/2817305947 learned_addr learned my addr 172.21.15.44:0/2817305947 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.558+0000 7f51a6ffd700 1 --2- 172.21.15.44:0/2817305947 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51b00cddd0 0x7f51b00ab9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:00.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.558+0000 7f51affff700 1 -- 172.21.15.44:0/2817305947 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51b00cddd0 msgr2=0x7f51b00ab9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:00.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.558+0000 7f51affff700 1 --2- 172.21.15.44:0/2817305947 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51b00cddd0 0x7f51b00ab9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.558+0000 7f51affff700 1 -- 172.21.15.44:0/2817305947 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51b00cadd0 msgr2=0x7f51b0144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:00.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.558+0000 7f51affff700 1 --2- 172.21.15.44:0/2817305947 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51b00cadd0 0x7f51b0144bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.558+0000 7f51affff700 1 -- 172.21.15.44:0/2817305947 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a8009a70 con 0x7f51b015e990 2024-09-13T18:28:00.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.558+0000 7f51affff700 1 --2- 172.21.15.44:0/2817305947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51b015e990 0x7f51b00abef0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f51a800b370 tx=0x7f51a8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:00.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.558+0000 7f51acff9700 1 -- 172.21.15.44:0/2817305947 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8012430 con 0x7f51b015e990 2024-09-13T18:28:00.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.558+0000 7f51acff9700 1 -- 172.21.15.44:0/2817305947 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a8020070 con 0x7f51b015e990 2024-09-13T18:28:00.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.558+0000 7f51acff9700 1 -- 172.21.15.44:0/2817305947 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8004280 con 0x7f51b015e990 2024-09-13T18:28:00.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.558+0000 7f51b4f85700 1 -- 172.21.15.44:0/2817305947 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b0135c90 con 0x7f51b015e990 2024-09-13T18:28:00.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.558+0000 7f51b4f85700 1 -- 172.21.15.44:0/2817305947 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b0133370 con 0x7f51b015e990 2024-09-13T18:28:00.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.562+0000 7f51b4f85700 1 -- 172.21.15.44:0/2817305947 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b0132ef0 con 0x7f51b015e990 2024-09-13T18:28:00.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.562+0000 7f51acff9700 1 -- 172.21.15.44:0/2817305947 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f51a80043e0 con 0x7f51b015e990 2024-09-13T18:28:00.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.562+0000 7f51acff9700 1 --2- 172.21.15.44:0/2817305947 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5190066730 0x7f5190068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:00.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.562+0000 7f51acff9700 1 -- 172.21.15.44:0/2817305947 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f51a8022070 con 0x7f51b015e990 2024-09-13T18:28:00.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.562+0000 7f51af7fe700 1 --2- 172.21.15.44:0/2817305947 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5190066730 0x7f5190068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:00.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.566+0000 7f51af7fe700 1 --2- 172.21.15.44:0/2817305947 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5190066730 0x7f5190068bf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f51a0009bf0 tx=0x7f51a0009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:00.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.570+0000 7f51acff9700 1 -- 172.21.15.44:0/2817305947 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f51a8053650 con 0x7f51b015e990 2024-09-13T18:28:00.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.802+0000 7f51b4f85700 1 -- 172.21.15.44:0/2817305947 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f51b0133890 con 0x7f51b015e990 2024-09-13T18:28:00.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.806+0000 7f51acff9700 1 -- 172.21.15.44:0/2817305947 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f51b0133890 con 0x7f51b015e990 2024-09-13T18:28:00.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.810+0000 7f51b4f85700 1 -- 172.21.15.44:0/2817305947 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5190066730 msgr2=0x7f5190068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:00.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.810+0000 7f51b4f85700 1 --2- 172.21.15.44:0/2817305947 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5190066730 0x7f5190068bf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f51a0009bf0 tx=0x7f51a0009240 comp rx=0 tx=0).stop 2024-09-13T18:28:00.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.810+0000 7f51b4f85700 1 -- 172.21.15.44:0/2817305947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51b015e990 msgr2=0x7f51b00abef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:00.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.810+0000 7f51b4f85700 1 --2- 172.21.15.44:0/2817305947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51b015e990 0x7f51b00abef0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f51a800b370 tx=0x7f51a8004af0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.810+0000 7f51b4f85700 1 -- 172.21.15.44:0/2817305947 shutdown_connections 2024-09-13T18:28:00.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.810+0000 7f51b4f85700 1 --2- 172.21.15.44:0/2817305947 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5190066730 0x7f5190068bf0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.810+0000 7f51b4f85700 1 --2- 172.21.15.44:0/2817305947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51b015e990 0x7f51b00abef0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.810+0000 7f51b4f85700 1 --2- 172.21.15.44:0/2817305947 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51b00cddd0 0x7f51b00ab9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.810+0000 7f51b4f85700 1 --2- 172.21.15.44:0/2817305947 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51b00cadd0 0x7f51b0144bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.810+0000 7f51b4f85700 1 -- 172.21.15.44:0/2817305947 >> 172.21.15.44:0/2817305947 conn(0x7f51b006a4f0 msgr2=0x7f51b00b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:00.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.810+0000 7f51b4f85700 1 -- 172.21.15.44:0/2817305947 shutdown_connections 2024-09-13T18:28:00.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.810+0000 7f51b4f85700 1 -- 172.21.15.44:0/2817305947 wait complete. 2024-09-13T18:28:00.832 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-13T18:28:00.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.942+0000 7fc22f59e700 1 Processor -- start 2024-09-13T18:28:00.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.942+0000 7fc22f59e700 1 -- start start 2024-09-13T18:28:00.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.942+0000 7fc22f59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc23015cda0 0x7fc23006b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:00.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.942+0000 7fc22f59e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc23006a520 0x7fc23006a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:00.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.942+0000 7fc22f59e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc23006aeb0 con 0x7fc2300ceb70 2024-09-13T18:28:00.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.942+0000 7fc22f59e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc23006be40 con 0x7fc23006a520 2024-09-13T18:28:00.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.942+0000 7fc22f59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2300b64f0 con 0x7fc23015cda0 2024-09-13T18:28:00.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.942+0000 7fc22ed9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc23006a520 0x7fc23006a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:00.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.942+0000 7fc22e59c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc23015cda0 0x7fc23006b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:00.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.942+0000 7fc22dd9b700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc2300ceb70 0x7fc2300b5de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:46808/0 (socket says 172.21.15.44:46808) 2024-09-13T18:28:00.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.942+0000 7fc22dd9b700 1 -- 172.21.15.44:0/1936441280 learned_addr learned my addr 172.21.15.44:0/1936441280 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:00.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.946+0000 7fc22ed9d700 1 -- 172.21.15.44:0/1936441280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc23015cda0 msgr2=0x7fc23006b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:00.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.946+0000 7fc22ed9d700 1 --2- 172.21.15.44:0/1936441280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc23015cda0 0x7fc23006b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.946+0000 7fc22ed9d700 1 -- 172.21.15.44:0/1936441280 >> v1:172.21.15.99:6789/0 conn(0x7fc2300ceb70 legacy=0x7fc2300b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:00.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.946+0000 7fc22ed9d700 1 -- 172.21.15.44:0/1936441280 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2300b8430 con 0x7fc23006a520 2024-09-13T18:28:00.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.946+0000 7fc22d59a700 1 -- 172.21.15.44:0/1936441280 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547963217 0 0) 0x7fc218001110 con 0x7fc2300ceb70 2024-09-13T18:28:00.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.946+0000 7fc22ed9d700 1 --2- 172.21.15.44:0/1936441280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc23006a520 0x7fc23006a970 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc228009d90 tx=0x7fc22800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf213f2a42f1d307 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:00.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.946+0000 7fc22d59a700 1 -- 172.21.15.44:0/1936441280 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22800e070 con 0x7fc23006a520 2024-09-13T18:28:00.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.946+0000 7fc22d59a700 1 -- 172.21.15.44:0/1936441280 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22800bb20 con 0x7fc23006a520 2024-09-13T18:28:00.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.946+0000 7fc22d59a700 1 -- 172.21.15.44:0/1936441280 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc228012430 con 0x7fc23006a520 2024-09-13T18:28:00.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.946+0000 7fc22f59e700 1 -- 172.21.15.44:0/1936441280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc23006a520 msgr2=0x7fc23006a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:00.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.946+0000 7fc22f59e700 1 --2- 172.21.15.44:0/1936441280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc23006a520 0x7fc23006a970 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc228009d90 tx=0x7fc22800b330 comp rx=0 tx=0).stop 2024-09-13T18:28:00.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.946+0000 7fc22f59e700 1 -- 172.21.15.44:0/1936441280 shutdown_connections 2024-09-13T18:28:00.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.946+0000 7fc22f59e700 1 --2- 172.21.15.44:0/1936441280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc23006a520 0x7fc23006a970 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.946+0000 7fc22f59e700 1 --2- 172.21.15.44:0/1936441280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc23015cda0 0x7fc23006b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.946+0000 7fc22f59e700 1 -- 172.21.15.44:0/1936441280 >> 172.21.15.44:0/1936441280 conn(0x7fc2300d2cb0 msgr2=0x7fc2300d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:00.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.946+0000 7fc22f59e700 1 -- 172.21.15.44:0/1936441280 shutdown_connections 2024-09-13T18:28:00.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.946+0000 7fc22f59e700 1 -- 172.21.15.44:0/1936441280 wait complete. 2024-09-13T18:28:00.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.946+0000 7fc22f59e700 1 Processor -- start 2024-09-13T18:28:00.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.946+0000 7fc22f59e700 1 -- start start 2024-09-13T18:28:00.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc22f59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc23006a520 0x7fc2301f5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:00.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc22f59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2300ceb70 0x7fc23015f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:00.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc22f59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc23015cda0 0x7fc23015fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:00.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc22f59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2300ccb40 con 0x7fc2300ceb70 2024-09-13T18:28:00.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc22f59e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2300cce20 con 0x7fc23006a520 2024-09-13T18:28:00.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc22f59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2301560a0 con 0x7fc23015cda0 2024-09-13T18:28:00.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc22dd9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2300ceb70 0x7fc23015f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:00.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc22dd9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2300ceb70 0x7fc23015f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41402/0 (socket says 172.21.15.44:41402) 2024-09-13T18:28:00.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc22dd9b700 1 -- 172.21.15.44:0/1616047204 learned_addr learned my addr 172.21.15.44:0/1616047204 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:00.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc22ed9d700 1 --2- 172.21.15.44:0/1616047204 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc23015cda0 0x7fc23015fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:00.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc22e59c700 1 --2- 172.21.15.44:0/1616047204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc23006a520 0x7fc2301f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:00.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc22dd9b700 1 -- 172.21.15.44:0/1616047204 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc23015cda0 msgr2=0x7fc23015fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:00.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc22dd9b700 1 --2- 172.21.15.44:0/1616047204 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc23015cda0 0x7fc23015fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc22dd9b700 1 -- 172.21.15.44:0/1616047204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc23006a520 msgr2=0x7fc2301f5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:00.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc22dd9b700 1 --2- 172.21.15.44:0/1616047204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc23006a520 0x7fc2301f5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:00.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc22dd9b700 1 -- 172.21.15.44:0/1616047204 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc228009a70 con 0x7fc2300ceb70 2024-09-13T18:28:00.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc22e59c700 1 --2- 172.21.15.44:0/1616047204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc23006a520 0x7fc2301f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:00.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc22dd9b700 1 --2- 172.21.15.44:0/1616047204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2300ceb70 0x7fc23015f7e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc21800c730 tx=0x7fc21800caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:00.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc226ffd700 1 -- 172.21.15.44:0/1616047204 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc218004ca0 con 0x7fc2300ceb70 2024-09-13T18:28:00.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc226ffd700 1 -- 172.21.15.44:0/1616047204 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc218004e20 con 0x7fc2300ceb70 2024-09-13T18:28:00.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc22f59e700 1 -- 172.21.15.44:0/1616047204 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc230156380 con 0x7fc2300ceb70 2024-09-13T18:28:00.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc226ffd700 1 -- 172.21.15.44:0/1616047204 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc218007310 con 0x7fc2300ceb70 2024-09-13T18:28:00.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc22f59e700 1 -- 172.21.15.44:0/1616047204 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc230160260 con 0x7fc2300ceb70 2024-09-13T18:28:00.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.950+0000 7fc22f59e700 1 -- 172.21.15.44:0/1616047204 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2300d1120 con 0x7fc2300ceb70 2024-09-13T18:28:00.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.954+0000 7fc226ffd700 1 -- 172.21.15.44:0/1616047204 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc218007470 con 0x7fc2300ceb70 2024-09-13T18:28:00.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.954+0000 7fc226ffd700 1 --2- 172.21.15.44:0/1616047204 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc210066730 0x7fc210068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:00.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.954+0000 7fc226ffd700 1 -- 172.21.15.44:0/1616047204 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc218084090 con 0x7fc2300ceb70 2024-09-13T18:28:00.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.954+0000 7fc22e59c700 1 --2- 172.21.15.44:0/1616047204 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc210066730 0x7fc210068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:00.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.954+0000 7fc22e59c700 1 --2- 172.21.15.44:0/1616047204 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc210066730 0x7fc210068bf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc220009ad0 tx=0x7fc220008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:00.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:00.962+0000 7fc226ffd700 1 -- 172.21.15.44:0/1616047204 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc218051750 con 0x7fc2300ceb70 2024-09-13T18:28:01.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.190+0000 7fc22f59e700 1 -- 172.21.15.44:0/1616047204 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fc23006b680 con 0x7fc2300ceb70 2024-09-13T18:28:01.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.198+0000 7fc226ffd700 1 -- 172.21.15.44:0/1616047204 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc23006b680 con 0x7fc2300ceb70 2024-09-13T18:28:01.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.202+0000 7fc22f59e700 1 -- 172.21.15.44:0/1616047204 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc210066730 msgr2=0x7fc210068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:01.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.202+0000 7fc22f59e700 1 --2- 172.21.15.44:0/1616047204 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc210066730 0x7fc210068bf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc220009ad0 tx=0x7fc220008040 comp rx=0 tx=0).stop 2024-09-13T18:28:01.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.202+0000 7fc22f59e700 1 -- 172.21.15.44:0/1616047204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2300ceb70 msgr2=0x7fc23015f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:01.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.202+0000 7fc22f59e700 1 --2- 172.21.15.44:0/1616047204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2300ceb70 0x7fc23015f7e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc21800c730 tx=0x7fc21800caf0 comp rx=0 tx=0).stop 2024-09-13T18:28:01.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.202+0000 7fc22f59e700 1 -- 172.21.15.44:0/1616047204 shutdown_connections 2024-09-13T18:28:01.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.202+0000 7fc22f59e700 1 --2- 172.21.15.44:0/1616047204 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc210066730 0x7fc210068bf0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:01.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.202+0000 7fc22f59e700 1 --2- 172.21.15.44:0/1616047204 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc23015cda0 0x7fc23015fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:01.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.202+0000 7fc22f59e700 1 --2- 172.21.15.44:0/1616047204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2300ceb70 0x7fc23015f7e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:01.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.202+0000 7fc22f59e700 1 --2- 172.21.15.44:0/1616047204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc23006a520 0x7fc2301f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:01.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.202+0000 7fc22f59e700 1 -- 172.21.15.44:0/1616047204 >> 172.21.15.44:0/1616047204 conn(0x7fc2300d2cb0 msgr2=0x7fc2300b2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:01.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.202+0000 7fc22f59e700 1 -- 172.21.15.44:0/1616047204 shutdown_connections 2024-09-13T18:28:01.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.202+0000 7fc22f59e700 1 -- 172.21.15.44:0/1616047204 wait complete. 2024-09-13T18:28:01.222 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-13T18:28:01.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.330+0000 7fd2dd10e700 1 Processor -- start 2024-09-13T18:28:01.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.330+0000 7fd2dd10e700 1 -- start start 2024-09-13T18:28:01.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.330+0000 7fd2dd10e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd2d806b240 0x7fd2d806b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:01.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.330+0000 7fd2dd10e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d80ce740 con 0x7fd2d80d0b20 2024-09-13T18:28:01.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.330+0000 7fd2dd10e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d80cdb30 con 0x7fd2d815c880 2024-09-13T18:28:01.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.330+0000 7fd2dd10e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d80cde10 con 0x7fd2d806b240 2024-09-13T18:28:01.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.334+0000 7fd2dc90d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd2d806b240 0x7fd2d806b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:01.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.334+0000 7fd2d77fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd2d80d0b20 0x7fd2d80d0f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54612/0 (socket says 172.21.15.44:54612) 2024-09-13T18:28:01.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.334+0000 7fd2d77fe700 1 -- 172.21.15.44:0/513640644 learned_addr learned my addr 172.21.15.44:0/513640644 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:01.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.334+0000 7fd2dc90d700 1 -- 172.21.15.44:0/513640644 >> v1:172.21.15.99:6789/0 conn(0x7fd2d815c880 legacy=0x7fd2d80cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:01.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.334+0000 7fd2dc90d700 1 -- 172.21.15.44:0/513640644 >> v1:172.21.15.44:6789/0 conn(0x7fd2d80d0b20 legacy=0x7fd2d80d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:01.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.334+0000 7fd2dc90d700 1 -- 172.21.15.44:0/513640644 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d80ce0f0 con 0x7fd2d806b240 2024-09-13T18:28:01.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.334+0000 7fd2dc90d700 1 --2- 172.21.15.44:0/513640644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2d806b240 0x7fd2d806b660 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009d90 tx=0x7fd2d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db100dd089db3c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:01.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.334+0000 7fd2d6ffd700 1 -- 172.21.15.44:0/513640644 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d000e070 con 0x7fd2d806b240 2024-09-13T18:28:01.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.334+0000 7fd2d6ffd700 1 -- 172.21.15.44:0/513640644 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d000bbd0 con 0x7fd2d806b240 2024-09-13T18:28:01.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.334+0000 7fd2d6ffd700 1 -- 172.21.15.44:0/513640644 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0012430 con 0x7fd2d806b240 2024-09-13T18:28:01.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.334+0000 7fd2dd10e700 1 -- 172.21.15.44:0/513640644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2d806b240 msgr2=0x7fd2d806b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:01.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.334+0000 7fd2dd10e700 1 --2- 172.21.15.44:0/513640644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2d806b240 0x7fd2d806b660 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009d90 tx=0x7fd2d000b330 comp rx=0 tx=0).stop 2024-09-13T18:28:01.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.334+0000 7fd2dd10e700 1 -- 172.21.15.44:0/513640644 shutdown_connections 2024-09-13T18:28:01.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.334+0000 7fd2dd10e700 1 --2- 172.21.15.44:0/513640644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2d806b240 0x7fd2d806b660 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:01.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.334+0000 7fd2dd10e700 1 -- 172.21.15.44:0/513640644 >> 172.21.15.44:0/513640644 conn(0x7fd2d80d3050 msgr2=0x7fd2d80d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:01.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.334+0000 7fd2dd10e700 1 -- 172.21.15.44:0/513640644 shutdown_connections 2024-09-13T18:28:01.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.334+0000 7fd2dd10e700 1 -- 172.21.15.44:0/513640644 wait complete. 2024-09-13T18:28:01.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.338+0000 7fd2dd10e700 1 Processor -- start 2024-09-13T18:28:01.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.338+0000 7fd2dd10e700 1 -- start start 2024-09-13T18:28:01.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2dd10e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2d806b240 0x7fd2d81f4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:01.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2dd10e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd2d80d0b20 0x7fd2d80b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:01.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2dd10e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2d815c880 0x7fd2d80b7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:01.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2dd10e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d81f4b10 con 0x7fd2d806b240 2024-09-13T18:28:01.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2dd10e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d81f4df0 con 0x7fd2d815c880 2024-09-13T18:28:01.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2dd10e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d81f50d0 con 0x7fd2d80d0b20 2024-09-13T18:28:01.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2d7fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2d806b240 0x7fd2d81f4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:01.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2d7fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2d806b240 0x7fd2d81f4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41430/0 (socket says 172.21.15.44:41430) 2024-09-13T18:28:01.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2d7fff700 1 -- 172.21.15.44:0/1173554812 learned_addr learned my addr 172.21.15.44:0/1173554812 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:01.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2d77fe700 1 --2- 172.21.15.44:0/1173554812 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd2d80d0b20 0x7fd2d80b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:01.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2dc90d700 1 --2- 172.21.15.44:0/1173554812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2d815c880 0x7fd2d80b7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:01.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2d7fff700 1 -- 172.21.15.44:0/1173554812 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd2d80d0b20 msgr2=0x7fd2d80b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:01.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2d7fff700 1 --2- 172.21.15.44:0/1173554812 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd2d80d0b20 0x7fd2d80b78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:01.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2d7fff700 1 -- 172.21.15.44:0/1173554812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2d815c880 msgr2=0x7fd2d80b7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:01.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2d7fff700 1 --2- 172.21.15.44:0/1173554812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2d815c880 0x7fd2d80b7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:01.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2d7fff700 1 -- 172.21.15.44:0/1173554812 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d0009a70 con 0x7fd2d806b240 2024-09-13T18:28:01.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2dc90d700 1 --2- 172.21.15.44:0/1173554812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2d815c880 0x7fd2d80b7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:01.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2d7fff700 1 --2- 172.21.15.44:0/1173554812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2d806b240 0x7fd2d81f4290 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800c500 tx=0x7fd2c800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:01.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2d4ff9700 1 -- 172.21.15.44:0/1173554812 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c80052d0 con 0x7fd2d806b240 2024-09-13T18:28:01.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2d4ff9700 1 -- 172.21.15.44:0/1173554812 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c8005430 con 0x7fd2d806b240 2024-09-13T18:28:01.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2dd10e700 1 -- 172.21.15.44:0/1173554812 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d81f53b0 con 0x7fd2d806b240 2024-09-13T18:28:01.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2d4ff9700 1 -- 172.21.15.44:0/1173554812 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c80055a0 con 0x7fd2d806b240 2024-09-13T18:28:01.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2dd10e700 1 -- 172.21.15.44:0/1173554812 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d81f47d0 con 0x7fd2d806b240 2024-09-13T18:28:01.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2dd10e700 1 -- 172.21.15.44:0/1173554812 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d81f58d0 con 0x7fd2d806b240 2024-09-13T18:28:01.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2d4ff9700 1 -- 172.21.15.44:0/1173554812 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd2c80036a0 con 0x7fd2d806b240 2024-09-13T18:28:01.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2d4ff9700 1 --2- 172.21.15.44:0/1173554812 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd2b8066760 0x7fd2b8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:01.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2d4ff9700 1 -- 172.21.15.44:0/1173554812 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd2c80830b0 con 0x7fd2d806b240 2024-09-13T18:28:01.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.342+0000 7fd2d77fe700 1 --2- 172.21.15.44:0/1173554812 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd2b8066760 0x7fd2b8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:01.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.346+0000 7fd2d77fe700 1 --2- 172.21.15.44:0/1173554812 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd2b8066760 0x7fd2b8068c20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd2d806c0d0 tx=0x7fd2c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:01.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.350+0000 7fd2d4ff9700 1 -- 172.21.15.44:0/1173554812 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd2d81f58d0 con 0x7fd2d806b240 2024-09-13T18:28:01.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.586+0000 7fd2dd10e700 1 -- 172.21.15.44:0/1173554812 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fd2d81f58d0 con 0x7fd2d806b240 2024-09-13T18:28:01.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.594+0000 7fd2d4ff9700 1 -- 172.21.15.44:0/1173554812 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd2d81f58d0 con 0x7fd2d806b240 2024-09-13T18:28:01.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.598+0000 7fd2dd10e700 1 -- 172.21.15.44:0/1173554812 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd2b8066760 msgr2=0x7fd2b8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:01.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.598+0000 7fd2dd10e700 1 --2- 172.21.15.44:0/1173554812 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd2b8066760 0x7fd2b8068c20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd2d806c0d0 tx=0x7fd2c0009040 comp rx=0 tx=0).stop 2024-09-13T18:28:01.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.598+0000 7fd2dd10e700 1 -- 172.21.15.44:0/1173554812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2d806b240 msgr2=0x7fd2d81f4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:01.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.598+0000 7fd2dd10e700 1 --2- 172.21.15.44:0/1173554812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2d806b240 0x7fd2d81f4290 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800c500 tx=0x7fd2c800c8c0 comp rx=0 tx=0).stop 2024-09-13T18:28:01.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.598+0000 7fd2dd10e700 1 -- 172.21.15.44:0/1173554812 shutdown_connections 2024-09-13T18:28:01.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.598+0000 7fd2dd10e700 1 --2- 172.21.15.44:0/1173554812 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd2b8066760 0x7fd2b8068c20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:01.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.598+0000 7fd2dd10e700 1 --2- 172.21.15.44:0/1173554812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2d815c880 0x7fd2d80b7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:01.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.598+0000 7fd2dd10e700 1 --2- 172.21.15.44:0/1173554812 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd2d80d0b20 0x7fd2d80b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:01.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.598+0000 7fd2dd10e700 1 --2- 172.21.15.44:0/1173554812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2d806b240 0x7fd2d81f4290 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:01.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.598+0000 7fd2dd10e700 1 -- 172.21.15.44:0/1173554812 >> 172.21.15.44:0/1173554812 conn(0x7fd2d80d3050 msgr2=0x7fd2d815cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:01.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.598+0000 7fd2dd10e700 1 -- 172.21.15.44:0/1173554812 shutdown_connections 2024-09-13T18:28:01.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.598+0000 7fd2dd10e700 1 -- 172.21.15.44:0/1173554812 wait complete. 2024-09-13T18:28:01.619 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:28:01.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.730+0000 7fe3ca5ee700 1 Processor -- start 2024-09-13T18:28:01.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.730+0000 7fe3ca5ee700 1 -- start start 2024-09-13T18:28:01.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.730+0000 7fe3ca5ee700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3c415cd80 0x7fe3c406baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:01.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.730+0000 7fe3ca5ee700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe3c406b170 0x7fe3c40ce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:01.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.730+0000 7fe3ca5ee700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c415d160 con 0x7fe3c406a640 2024-09-13T18:28:01.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.730+0000 7fe3ca5ee700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c40d1570 con 0x7fe3c406b170 2024-09-13T18:28:01.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.730+0000 7fe3ca5ee700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40d25b0 con 0x7fe3c415cd80 2024-09-13T18:28:01.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.730+0000 7fe3c9ded700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe3c406b170 0x7fe3c40ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:01.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.730+0000 7fe3c95ec700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3c415cd80 0x7fe3c406baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:01.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.730+0000 7fe3c8deb700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe3c406a640 0x7fe3c406aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:46824/0 (socket says 172.21.15.44:46824) 2024-09-13T18:28:01.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.730+0000 7fe3c8deb700 1 -- 172.21.15.44:0/2386691846 learned_addr learned my addr 172.21.15.44:0/2386691846 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:01.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.730+0000 7fe3bbfff700 1 -- 172.21.15.44:0/2386691846 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031722534 0 0) 0x7fe3c415d160 con 0x7fe3c406a640 2024-09-13T18:28:01.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.730+0000 7fe3bbfff700 1 -- 172.21.15.44:0/2386691846 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3b00035d0 con 0x7fe3c406a640 2024-09-13T18:28:01.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.730+0000 7fe3c95ec700 1 -- 172.21.15.44:0/2386691846 >> v2:172.21.15.99:3300/0 conn(0x7fe3c406b170 msgr2=0x7fe3c40ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:01.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.730+0000 7fe3c95ec700 1 --2- 172.21.15.44:0/2386691846 >> v2:172.21.15.99:3300/0 conn(0x7fe3c406b170 0x7fe3c40ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:01.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.730+0000 7fe3c95ec700 1 -- 172.21.15.44:0/2386691846 >> v1:172.21.15.99:6789/0 conn(0x7fe3c406a640 legacy=0x7fe3c406aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:01.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.730+0000 7fe3c95ec700 1 -- 172.21.15.44:0/2386691846 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c40d2120 con 0x7fe3c415cd80 2024-09-13T18:28:01.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.730+0000 7fe3c9ded700 1 --2- 172.21.15.44:0/2386691846 >> v2:172.21.15.99:3300/0 conn(0x7fe3c406b170 0x7fe3c40ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:01.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.730+0000 7fe3c95ec700 1 --2- 172.21.15.44:0/2386691846 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3c415cd80 0x7fe3c406baa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0009850 tx=0x7fe3c0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39e63ee50ebe1be2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:01.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3bbfff700 1 -- 172.21.15.44:0/2386691846 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c0011830 con 0x7fe3c415cd80 2024-09-13T18:28:01.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3bbfff700 1 -- 172.21.15.44:0/2386691846 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c0011990 con 0x7fe3c415cd80 2024-09-13T18:28:01.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3bbfff700 1 -- 172.21.15.44:0/2386691846 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c0011d00 con 0x7fe3c415cd80 2024-09-13T18:28:01.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3ca5ee700 1 -- 172.21.15.44:0/2386691846 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3c415cd80 msgr2=0x7fe3c406baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:01.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3ca5ee700 1 --2- 172.21.15.44:0/2386691846 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3c415cd80 0x7fe3c406baa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0009850 tx=0x7fe3c0009b60 comp rx=0 tx=0).stop 2024-09-13T18:28:01.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3ca5ee700 1 -- 172.21.15.44:0/2386691846 shutdown_connections 2024-09-13T18:28:01.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3ca5ee700 1 --2- 172.21.15.44:0/2386691846 >> v2:172.21.15.99:3300/0 conn(0x7fe3c406b170 0x7fe3c40ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:01.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3ca5ee700 1 --2- 172.21.15.44:0/2386691846 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3c415cd80 0x7fe3c406baa0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:01.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3ca5ee700 1 -- 172.21.15.44:0/2386691846 >> 172.21.15.44:0/2386691846 conn(0x7fe3c40d30b0 msgr2=0x7fe3c40d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:01.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3ca5ee700 1 -- 172.21.15.44:0/2386691846 shutdown_connections 2024-09-13T18:28:01.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3ca5ee700 1 -- 172.21.15.44:0/2386691846 wait complete. 2024-09-13T18:28:01.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3ca5ee700 1 Processor -- start 2024-09-13T18:28:01.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3ca5ee700 1 -- start start 2024-09-13T18:28:01.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3ca5ee700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3c406a640 0x7fe3c4157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:01.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3ca5ee700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3c406b170 0x7fe3c40cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:01.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3ca5ee700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3c415cd80 0x7fe3c40b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:01.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3ca5ee700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c41f2310 con 0x7fe3c415cd80 2024-09-13T18:28:01.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3ca5ee700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40a9610 con 0x7fe3c406a640 2024-09-13T18:28:01.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3ca5ee700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40a9860 con 0x7fe3c406b170 2024-09-13T18:28:01.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3c9ded700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3c415cd80 0x7fe3c40b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:01.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3c9ded700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3c415cd80 0x7fe3c40b5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41432/0 (socket says 172.21.15.44:41432) 2024-09-13T18:28:01.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3c95ec700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3c406a640 0x7fe3c4157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:01.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3c9ded700 1 -- 172.21.15.44:0/4268878313 learned_addr learned my addr 172.21.15.44:0/4268878313 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:01.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.734+0000 7fe3c8deb700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3c406b170 0x7fe3c40cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:01.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.738+0000 7fe3c9ded700 1 -- 172.21.15.44:0/4268878313 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3c406b170 msgr2=0x7fe3c40cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:01.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.738+0000 7fe3c9ded700 1 --2- 172.21.15.44:0/4268878313 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3c406b170 0x7fe3c40cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:01.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.738+0000 7fe3c9ded700 1 -- 172.21.15.44:0/4268878313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3c406a640 msgr2=0x7fe3c4157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:01.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.738+0000 7fe3c9ded700 1 --2- 172.21.15.44:0/4268878313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3c406a640 0x7fe3c4157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:01.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.738+0000 7fe3c9ded700 1 -- 172.21.15.44:0/4268878313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3bc009a70 con 0x7fe3c415cd80 2024-09-13T18:28:01.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.738+0000 7fe3c9ded700 1 --2- 172.21.15.44:0/4268878313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3c415cd80 0x7fe3c40b5d50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00ef90 tx=0x7fe3bc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:01.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.738+0000 7fe3b9ffb700 1 -- 172.21.15.44:0/4268878313 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc00cc90 con 0x7fe3c415cd80 2024-09-13T18:28:01.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.738+0000 7fe3b9ffb700 1 -- 172.21.15.44:0/4268878313 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc00f040 con 0x7fe3c415cd80 2024-09-13T18:28:01.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.738+0000 7fe3ca5ee700 1 -- 172.21.15.44:0/4268878313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c00094b0 con 0x7fe3c415cd80 2024-09-13T18:28:01.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.738+0000 7fe3b9ffb700 1 -- 172.21.15.44:0/4268878313 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc0146c0 con 0x7fe3c415cd80 2024-09-13T18:28:01.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.738+0000 7fe3ca5ee700 1 -- 172.21.15.44:0/4268878313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c40a9e20 con 0x7fe3c415cd80 2024-09-13T18:28:01.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.738+0000 7fe3ca5ee700 1 -- 172.21.15.44:0/4268878313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c406baa0 con 0x7fe3c415cd80 2024-09-13T18:28:01.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.738+0000 7fe3b9ffb700 1 -- 172.21.15.44:0/4268878313 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe3bc014820 con 0x7fe3c415cd80 2024-09-13T18:28:01.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.738+0000 7fe3b9ffb700 1 --2- 172.21.15.44:0/4268878313 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe3a8066730 0x7fe3a8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:01.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.742+0000 7fe3b9ffb700 1 -- 172.21.15.44:0/4268878313 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe3bc0849e0 con 0x7fe3c415cd80 2024-09-13T18:28:01.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.742+0000 7fe3c95ec700 1 --2- 172.21.15.44:0/4268878313 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe3a8066730 0x7fe3a8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:01.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.742+0000 7fe3c95ec700 1 --2- 172.21.15.44:0/4268878313 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe3a8066730 0x7fe3a8068bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe3c00090b0 tx=0x7fe3c0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:01.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.746+0000 7fe3b9ffb700 1 -- 172.21.15.44:0/4268878313 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe3bc0520a0 con 0x7fe3c415cd80 2024-09-13T18:28:01.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.918+0000 7fe3ca5ee700 1 -- 172.21.15.44:0/4268878313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3c40b88e0 con 0x7fe3c415cd80 2024-09-13T18:28:01.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.922+0000 7fe3b9ffb700 1 -- 172.21.15.44:0/4268878313 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+12797 (secure 0 0 0) 0x7fe3bc018020 con 0x7fe3c415cd80 2024-09-13T18:28:01.928 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:01.928 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":31,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:27:58.834634+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:28:01.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.922+0000 7fe3ca5ee700 1 -- 172.21.15.44:0/4268878313 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe3a8066730 msgr2=0x7fe3a8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:01.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.922+0000 7fe3ca5ee700 1 --2- 172.21.15.44:0/4268878313 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe3a8066730 0x7fe3a8068bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe3c00090b0 tx=0x7fe3c0008030 comp rx=0 tx=0).stop 2024-09-13T18:28:01.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.922+0000 7fe3ca5ee700 1 -- 172.21.15.44:0/4268878313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3c415cd80 msgr2=0x7fe3c40b5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:01.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.922+0000 7fe3ca5ee700 1 --2- 172.21.15.44:0/4268878313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3c415cd80 0x7fe3c40b5d50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00ef90 tx=0x7fe3bc00c3a0 comp rx=0 tx=0).stop 2024-09-13T18:28:01.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.926+0000 7fe3ca5ee700 1 -- 172.21.15.44:0/4268878313 shutdown_connections 2024-09-13T18:28:01.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.926+0000 7fe3ca5ee700 1 --2- 172.21.15.44:0/4268878313 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe3a8066730 0x7fe3a8068bf0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:01.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.926+0000 7fe3ca5ee700 1 --2- 172.21.15.44:0/4268878313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3c415cd80 0x7fe3c40b5d50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:01.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.926+0000 7fe3ca5ee700 1 --2- 172.21.15.44:0/4268878313 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3c406b170 0x7fe3c40cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:01.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.926+0000 7fe3ca5ee700 1 --2- 172.21.15.44:0/4268878313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3c406a640 0x7fe3c4157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:01.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.926+0000 7fe3ca5ee700 1 -- 172.21.15.44:0/4268878313 >> 172.21.15.44:0/4268878313 conn(0x7fe3c40d30b0 msgr2=0x7fe3c40d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:01.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.926+0000 7fe3ca5ee700 1 -- 172.21.15.44:0/4268878313 shutdown_connections 2024-09-13T18:28:01.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:01.926+0000 7fe3ca5ee700 1 -- 172.21.15.44:0/4268878313 wait complete. 2024-09-13T18:28:01.943 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:28:01.943 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:28:02.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.054+0000 7f708d4d7700 1 Processor -- start 2024-09-13T18:28:02.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.054+0000 7f708d4d7700 1 -- start start 2024-09-13T18:28:02.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f708d4d7700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f70880b5e00 0x7f70880b6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:02.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f708d4d7700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f70880b6780 0x7f70880ce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:02.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f708d4d7700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70880d0880 con 0x7f708815cda0 2024-09-13T18:28:02.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f708d4d7700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70880d2280 con 0x7f70880b5e00 2024-09-13T18:28:02.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f708d4d7700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70880cde50 con 0x7f70880b6780 2024-09-13T18:28:02.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f70867fc700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f70880b5e00 0x7f70880b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:02.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f70867fc700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f70880b5e00 0x7f70880b6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35018/0 (socket says 172.21.15.44:35018) 2024-09-13T18:28:02.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f70867fc700 1 -- 172.21.15.44:0/1840517969 learned_addr learned my addr 172.21.15.44:0/1840517969 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:02.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f70877fe700 1 --2- 172.21.15.44:0/1840517969 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f70880b6780 0x7f70880ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:02.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f70867fc700 1 -- 172.21.15.44:0/1840517969 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f70880b6780 msgr2=0x7f70880ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:02.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f70867fc700 1 --2- 172.21.15.44:0/1840517969 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f70880b6780 0x7f70880ce260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f70867fc700 1 -- 172.21.15.44:0/1840517969 >> v1:172.21.15.99:6789/0 conn(0x7f708815cda0 legacy=0x7f70880d1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:02.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f70867fc700 1 -- 172.21.15.44:0/1840517969 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70880d16e0 con 0x7f70880b5e00 2024-09-13T18:28:02.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f70877fe700 1 --2- 172.21.15.44:0/1840517969 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f70880b6780 0x7f70880ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:02.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f70867fc700 1 --2- 172.21.15.44:0/1840517969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70880b5e00 0x7f70880b6240 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7070009910 tx=0x7f7070009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5213f51ef03512c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:02.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f7085ffb700 1 -- 172.21.15.44:0/1840517969 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707000ba60 con 0x7f70880b5e00 2024-09-13T18:28:02.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f7085ffb700 1 -- 172.21.15.44:0/1840517969 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707000bbc0 con 0x7f70880b5e00 2024-09-13T18:28:02.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f7085ffb700 1 -- 172.21.15.44:0/1840517969 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7070009e60 con 0x7f70880b5e00 2024-09-13T18:28:02.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f708d4d7700 1 -- 172.21.15.44:0/1840517969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70880b5e00 msgr2=0x7f70880b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:02.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f708d4d7700 1 --2- 172.21.15.44:0/1840517969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70880b5e00 0x7f70880b6240 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7070009910 tx=0x7f7070009c20 comp rx=0 tx=0).stop 2024-09-13T18:28:02.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f708d4d7700 1 -- 172.21.15.44:0/1840517969 shutdown_connections 2024-09-13T18:28:02.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f708d4d7700 1 --2- 172.21.15.44:0/1840517969 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f70880b6780 0x7f70880ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f708d4d7700 1 --2- 172.21.15.44:0/1840517969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70880b5e00 0x7f70880b6240 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f708d4d7700 1 -- 172.21.15.44:0/1840517969 >> 172.21.15.44:0/1840517969 conn(0x7f70880d2cb0 msgr2=0x7f70880d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:02.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f708d4d7700 1 -- 172.21.15.44:0/1840517969 shutdown_connections 2024-09-13T18:28:02.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.058+0000 7f708d4d7700 1 -- 172.21.15.44:0/1840517969 wait complete. 2024-09-13T18:28:02.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f708d4d7700 1 Processor -- start 2024-09-13T18:28:02.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f708d4d7700 1 -- start start 2024-09-13T18:28:02.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f708d4d7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70880b6780 0x7f7088157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:02.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f708d4d7700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f708815cda0 0x7f708814e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:02.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f708d4d7700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f70880c9d80 0x7f70880cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:02.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f708d4d7700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708814e6d0 con 0x7f70880b6780 2024-09-13T18:28:02.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f708d4d7700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70880ca2f0 con 0x7f708815cda0 2024-09-13T18:28:02.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f708d4d7700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70880cc800 con 0x7f70880c9d80 2024-09-13T18:28:02.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f7086ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70880b6780 0x7f7088157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:02.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f7086ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70880b6780 0x7f7088157880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35026/0 (socket says 172.21.15.44:35026) 2024-09-13T18:28:02.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f7086ffd700 1 -- 172.21.15.44:0/1466207190 learned_addr learned my addr 172.21.15.44:0/1466207190 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:02.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f70877fe700 1 --2- 172.21.15.44:0/1466207190 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f70880c9d80 0x7f70880cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:02.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f70867fc700 1 --2- 172.21.15.44:0/1466207190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f708815cda0 0x7f708814e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:02.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f7086ffd700 1 -- 172.21.15.44:0/1466207190 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f70880c9d80 msgr2=0x7f70880cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:02.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f7086ffd700 1 --2- 172.21.15.44:0/1466207190 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f70880c9d80 0x7f70880cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f7086ffd700 1 -- 172.21.15.44:0/1466207190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f708815cda0 msgr2=0x7f708814e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:02.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f7086ffd700 1 --2- 172.21.15.44:0/1466207190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f708815cda0 0x7f708814e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f7086ffd700 1 -- 172.21.15.44:0/1466207190 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7070009570 con 0x7f70880b6780 2024-09-13T18:28:02.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f70877fe700 1 --2- 172.21.15.44:0/1466207190 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f70880c9d80 0x7f70880cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:02.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f7086ffd700 1 --2- 172.21.15.44:0/1466207190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70880b6780 0x7f7088157880 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f707800cbd0 tx=0x7f707800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:02.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f707f7fe700 1 -- 172.21.15.44:0/1466207190 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7078003c20 con 0x7f70880b6780 2024-09-13T18:28:02.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f707f7fe700 1 -- 172.21.15.44:0/1466207190 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7078003d80 con 0x7f70880b6780 2024-09-13T18:28:02.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f708d4d7700 1 -- 172.21.15.44:0/1466207190 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70880ccae0 con 0x7f70880b6780 2024-09-13T18:28:02.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f707f7fe700 1 -- 172.21.15.44:0/1466207190 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707800abf0 con 0x7f70880b6780 2024-09-13T18:28:02.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.062+0000 7f708d4d7700 1 -- 172.21.15.44:0/1466207190 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70880cbec0 con 0x7f70880b6780 2024-09-13T18:28:02.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.066+0000 7f707f7fe700 1 -- 172.21.15.44:0/1466207190 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f707800ad50 con 0x7f70880b6780 2024-09-13T18:28:02.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.066+0000 7f708d4d7700 1 -- 172.21.15.44:0/1466207190 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70880cccd0 con 0x7f70880b6780 2024-09-13T18:28:02.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.066+0000 7f707f7fe700 1 --2- 172.21.15.44:0/1466207190 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7068066760 0x7f7068068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:02.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.066+0000 7f707f7fe700 1 -- 172.21.15.44:0/1466207190 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7078083e90 con 0x7f70880b6780 2024-09-13T18:28:02.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.066+0000 7f70867fc700 1 --2- 172.21.15.44:0/1466207190 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7068066760 0x7f7068068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:02.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.066+0000 7f70867fc700 1 --2- 172.21.15.44:0/1466207190 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7068066760 0x7f7068068c20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f70880d2710 tx=0x7f7070008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:02.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.074+0000 7f707f7fe700 1 -- 172.21.15.44:0/1466207190 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f70780515e0 con 0x7f70880b6780 2024-09-13T18:28:02.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.246+0000 7f708d4d7700 1 -- 172.21.15.44:0/1466207190 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f70880b6240 con 0x7f70880b6780 2024-09-13T18:28:02.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.246+0000 7f707f7fe700 1 -- 172.21.15.44:0/1466207190 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7078054c00 con 0x7f70880b6780 2024-09-13T18:28:02.253 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:28:02.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.250+0000 7f708d4d7700 1 -- 172.21.15.44:0/1466207190 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7068066760 msgr2=0x7f7068068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:02.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.250+0000 7f708d4d7700 1 --2- 172.21.15.44:0/1466207190 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7068066760 0x7f7068068c20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f70880d2710 tx=0x7f7070008030 comp rx=0 tx=0).stop 2024-09-13T18:28:02.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.250+0000 7f708d4d7700 1 -- 172.21.15.44:0/1466207190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70880b6780 msgr2=0x7f7088157880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:02.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.250+0000 7f708d4d7700 1 --2- 172.21.15.44:0/1466207190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70880b6780 0x7f7088157880 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f707800cbd0 tx=0x7f707800cf90 comp rx=0 tx=0).stop 2024-09-13T18:28:02.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.250+0000 7f708d4d7700 1 -- 172.21.15.44:0/1466207190 shutdown_connections 2024-09-13T18:28:02.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.250+0000 7f708d4d7700 1 --2- 172.21.15.44:0/1466207190 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7068066760 0x7f7068068c20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.250+0000 7f708d4d7700 1 --2- 172.21.15.44:0/1466207190 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f70880c9d80 0x7f70880cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.250+0000 7f708d4d7700 1 --2- 172.21.15.44:0/1466207190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f708815cda0 0x7f708814e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.250+0000 7f708d4d7700 1 --2- 172.21.15.44:0/1466207190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70880b6780 0x7f7088157880 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.250+0000 7f708d4d7700 1 -- 172.21.15.44:0/1466207190 >> 172.21.15.44:0/1466207190 conn(0x7f70880d2cb0 msgr2=0x7f70880b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:02.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.250+0000 7f708d4d7700 1 -- 172.21.15.44:0/1466207190 shutdown_connections 2024-09-13T18:28:02.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.250+0000 7f708d4d7700 1 -- 172.21.15.44:0/1466207190 wait complete. 2024-09-13T18:28:02.268 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:28:02.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.378+0000 7fcdf7fff700 1 Processor -- start 2024-09-13T18:28:02.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.378+0000 7fcdf7fff700 1 -- start start 2024-09-13T18:28:02.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf7fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcdf806b3c0 0x7fcdf806b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:02.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf7fff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf806b200 con 0x7fcdf815ae40 2024-09-13T18:28:02.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf7fff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf806bd70 con 0x7fcdf80b3380 2024-09-13T18:28:02.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf7fff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf806c010 con 0x7fcdf806b3c0 2024-09-13T18:28:02.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf77fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fcdf815ae40 0x7fcdf815b2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56910/0 (socket says 172.21.15.44:56910) 2024-09-13T18:28:02.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf77fe700 1 -- 172.21.15.44:0/3331882352 learned_addr learned my addr 172.21.15.44:0/3331882352 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:02.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf67fc700 1 --2- 172.21.15.44:0/3331882352 >> v2:172.21.15.99:3300/0 conn(0x7fcdf806b3c0 0x7fcdf806b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:02.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf5ffb700 1 -- 172.21.15.44:0/3331882352 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816415569 0 0) 0x7fcdf806b200 con 0x7fcdf815ae40 2024-09-13T18:28:02.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf5ffb700 1 -- 172.21.15.44:0/3331882352 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcde00035d0 con 0x7fcdf815ae40 2024-09-13T18:28:02.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf5ffb700 1 -- 172.21.15.44:0/3331882352 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 570157494 0 0) 0x7fcde00035d0 con 0x7fcdf815ae40 2024-09-13T18:28:02.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf5ffb700 1 -- 172.21.15.44:0/3331882352 >> v2:172.21.15.99:3300/0 conn(0x7fcdf806b3c0 msgr2=0x7fcdf806b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:02.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf5ffb700 1 --2- 172.21.15.44:0/3331882352 >> v2:172.21.15.99:3300/0 conn(0x7fcdf806b3c0 0x7fcdf806b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf5ffb700 1 -- 172.21.15.44:0/3331882352 >> v1:172.21.15.99:6789/0 conn(0x7fcdf80b3380 legacy=0x7fcdf80b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:02.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf5ffb700 1 -- 172.21.15.44:0/3331882352 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf815c000 con 0x7fcdf815ae40 2024-09-13T18:28:02.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf5ffb700 1 -- 172.21.15.44:0/3331882352 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7fcdf00019f0 con 0x7fcdf815ae40 2024-09-13T18:28:02.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf5ffb700 1 -- 172.21.15.44:0/3331882352 >> v1:172.21.15.44:6789/0 conn(0x7fcdf815ae40 legacy=0x7fcdf815b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:02.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf5ffb700 1 --2- 172.21.15.44:0/3331882352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcde0003a20 0x7fcde0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:02.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf5ffb700 1 --2- 172.21.15.44:0/3331882352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcde0004870 0x7fcde0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:02.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf5ffb700 1 --2- 172.21.15.44:0/3331882352 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcde0005230 0x7fcde000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:02.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf5ffb700 1 -- 172.21.15.44:0/3331882352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf806c010 con 0x7fcde0003a20 2024-09-13T18:28:02.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf5ffb700 1 -- 172.21.15.44:0/3331882352 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde000c1d0 con 0x7fcde0004870 2024-09-13T18:28:02.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf5ffb700 1 -- 172.21.15.44:0/3331882352 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde000c390 con 0x7fcde0005230 2024-09-13T18:28:02.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf6ffd700 1 --2- 172.21.15.44:0/3331882352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcde0003a20 0x7fcde0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:02.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf77fe700 1 --2- 172.21.15.44:0/3331882352 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcde0005230 0x7fcde000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:02.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf67fc700 1 --2- 172.21.15.44:0/3331882352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcde0004870 0x7fcde0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:02.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf6ffd700 1 -- 172.21.15.44:0/3331882352 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcde0005230 msgr2=0x7fcde000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:02.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf6ffd700 1 --2- 172.21.15.44:0/3331882352 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcde0005230 0x7fcde000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf6ffd700 1 -- 172.21.15.44:0/3331882352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcde0004870 msgr2=0x7fcde0004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:02.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf6ffd700 1 --2- 172.21.15.44:0/3331882352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcde0004870 0x7fcde0004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf6ffd700 1 -- 172.21.15.44:0/3331882352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde00035d0 con 0x7fcde0003a20 2024-09-13T18:28:02.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf77fe700 1 -- 172.21.15.44:0/3331882352 reap_dead start 2024-09-13T18:28:02.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf6ffd700 1 --2- 172.21.15.44:0/3331882352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcde0003a20 0x7fcde0003e40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcde80017e0 tx=0x7fcde00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da06b5097497a160 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:02.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf5ffb700 1 -- 172.21.15.44:0/3331882352 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde80052d0 con 0x7fcde0003a20 2024-09-13T18:28:02.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf5ffb700 1 -- 172.21.15.44:0/3331882352 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde8005450 con 0x7fcde0003a20 2024-09-13T18:28:02.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.382+0000 7fcdf5ffb700 1 -- 172.21.15.44:0/3331882352 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde80038e0 con 0x7fcde0003a20 2024-09-13T18:28:02.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.386+0000 7fcdf7fff700 1 -- 172.21.15.44:0/3331882352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcde0003a20 msgr2=0x7fcde0003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:02.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.386+0000 7fcdf7fff700 1 --2- 172.21.15.44:0/3331882352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcde0003a20 0x7fcde0003e40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcde80017e0 tx=0x7fcde00058a0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.386+0000 7fcdf7fff700 1 -- 172.21.15.44:0/3331882352 shutdown_connections 2024-09-13T18:28:02.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.386+0000 7fcdf7fff700 1 --2- 172.21.15.44:0/3331882352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcde0003a20 0x7fcde0003e40 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.386+0000 7fcdf7fff700 1 -- 172.21.15.44:0/3331882352 >> 172.21.15.44:0/3331882352 conn(0x7fcdf80b0f00 msgr2=0x7fcdf80b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:02.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.386+0000 7fcdf7fff700 1 -- 172.21.15.44:0/3331882352 shutdown_connections 2024-09-13T18:28:02.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.386+0000 7fcdf7fff700 1 -- 172.21.15.44:0/3331882352 wait complete. 2024-09-13T18:28:02.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.386+0000 7fcdf7fff700 1 Processor -- start 2024-09-13T18:28:02.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.386+0000 7fcdf7fff700 1 -- start start 2024-09-13T18:28:02.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.386+0000 7fcdf7fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcde0003a20 0x7fcdf8142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:02.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.386+0000 7fcdf7fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcdf81e8760 0x7fcdf80cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:02.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.386+0000 7fcdf7fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdf8142440 0x7fcdf81e7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:02.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.386+0000 7fcdf7fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf8143450 con 0x7fcdf8142440 2024-09-13T18:28:02.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.390+0000 7fcdf7fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf80cd390 con 0x7fcde0003a20 2024-09-13T18:28:02.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.390+0000 7fcdf7fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf81586a0 con 0x7fcdf81e8760 2024-09-13T18:28:02.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.390+0000 7fcdf77fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdf8142440 0x7fcdf81e7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:02.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.390+0000 7fcdf77fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdf8142440 0x7fcdf81e7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35044/0 (socket says 172.21.15.44:35044) 2024-09-13T18:28:02.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.390+0000 7fcdf77fe700 1 -- 172.21.15.44:0/1165765559 learned_addr learned my addr 172.21.15.44:0/1165765559 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:02.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.390+0000 7fcdf6ffd700 1 --2- 172.21.15.44:0/1165765559 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcde0003a20 0x7fcdf8142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:02.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.390+0000 7fcdf67fc700 1 --2- 172.21.15.44:0/1165765559 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcdf81e8760 0x7fcdf80cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:02.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.390+0000 7fcdf77fe700 1 -- 172.21.15.44:0/1165765559 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcdf81e8760 msgr2=0x7fcdf80cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:02.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.390+0000 7fcdf77fe700 1 --2- 172.21.15.44:0/1165765559 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcdf81e8760 0x7fcdf80cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.390+0000 7fcdf77fe700 1 -- 172.21.15.44:0/1165765559 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcde0003a20 msgr2=0x7fcdf8142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:02.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.390+0000 7fcdf77fe700 1 --2- 172.21.15.44:0/1165765559 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcde0003a20 0x7fcdf8142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.390+0000 7fcdf77fe700 1 -- 172.21.15.44:0/1165765559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf81580e0 con 0x7fcdf8142440 2024-09-13T18:28:02.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.390+0000 7fcdf77fe700 1 --2- 172.21.15.44:0/1165765559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdf8142440 0x7fcdf81e7290 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcdf815b220 tx=0x7fcdf00019e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:02.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.390+0000 7fcddffff700 1 -- 172.21.15.44:0/1165765559 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf000a8e0 con 0x7fcdf8142440 2024-09-13T18:28:02.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.390+0000 7fcddffff700 1 -- 172.21.15.44:0/1165765559 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf000aa80 con 0x7fcdf8142440 2024-09-13T18:28:02.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.390+0000 7fcdf7fff700 1 -- 172.21.15.44:0/1165765559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf81583c0 con 0x7fcdf8142440 2024-09-13T18:28:02.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.390+0000 7fcddffff700 1 -- 172.21.15.44:0/1165765559 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf000ae30 con 0x7fcdf8142440 2024-09-13T18:28:02.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.390+0000 7fcdf7fff700 1 -- 172.21.15.44:0/1165765559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf81e8240 con 0x7fcdf8142440 2024-09-13T18:28:02.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.390+0000 7fcdf7fff700 1 -- 172.21.15.44:0/1165765559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf8159bc0 con 0x7fcdf8142440 2024-09-13T18:28:02.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.390+0000 7fcddffff700 1 -- 172.21.15.44:0/1165765559 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcdf001e460 con 0x7fcdf8142440 2024-09-13T18:28:02.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.394+0000 7fcddffff700 1 --2- 172.21.15.44:0/1165765559 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcde4066760 0x7fcde4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:02.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.394+0000 7fcddffff700 1 -- 172.21.15.44:0/1165765559 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcdf0084230 con 0x7fcdf8142440 2024-09-13T18:28:02.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.394+0000 7fcdf6ffd700 1 --2- 172.21.15.44:0/1165765559 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcde4066760 0x7fcde4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:02.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.394+0000 7fcdf6ffd700 1 --2- 172.21.15.44:0/1165765559 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcde4066760 0x7fcde4068c20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcde8005040 tx=0x7fcde8009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:02.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.402+0000 7fcddffff700 1 -- 172.21.15.44:0/1165765559 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcdf00518f0 con 0x7fcdf8142440 2024-09-13T18:28:02.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.574+0000 7fcdf7fff700 1 -- 172.21.15.44:0/1165765559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcdf81e8430 con 0x7fcdf8142440 2024-09-13T18:28:02.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.574+0000 7fcddffff700 1 -- 172.21.15.44:0/1165765559 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+65 (secure 0 0 0) 0x7fcdf0054f10 con 0x7fcdf8142440 2024-09-13T18:28:02.581 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:02.581 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-09-13T18:28:02.582 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:28:02.582 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2024-09-13T18:28:02.582 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2024-09-13T18:28:02.582 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:28:02.582 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-09-13T18:28:02.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.578+0000 7fcdf7fff700 1 -- 172.21.15.44:0/1165765559 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcde4066760 msgr2=0x7fcde4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:02.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.578+0000 7fcdf7fff700 1 --2- 172.21.15.44:0/1165765559 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcde4066760 0x7fcde4068c20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcde8005040 tx=0x7fcde8009030 comp rx=0 tx=0).stop 2024-09-13T18:28:02.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.578+0000 7fcdf7fff700 1 -- 172.21.15.44:0/1165765559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdf8142440 msgr2=0x7fcdf81e7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:02.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.578+0000 7fcdf7fff700 1 --2- 172.21.15.44:0/1165765559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdf8142440 0x7fcdf81e7290 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcdf815b220 tx=0x7fcdf00019e0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.578+0000 7fcdf7fff700 1 -- 172.21.15.44:0/1165765559 shutdown_connections 2024-09-13T18:28:02.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.578+0000 7fcdf7fff700 1 --2- 172.21.15.44:0/1165765559 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcde4066760 0x7fcde4068c20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.578+0000 7fcdf7fff700 1 --2- 172.21.15.44:0/1165765559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdf8142440 0x7fcdf81e7290 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.578+0000 7fcdf7fff700 1 --2- 172.21.15.44:0/1165765559 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcdf81e8760 0x7fcdf80cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.578+0000 7fcdf7fff700 1 --2- 172.21.15.44:0/1165765559 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcde0003a20 0x7fcdf8142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.578+0000 7fcdf7fff700 1 -- 172.21.15.44:0/1165765559 >> 172.21.15.44:0/1165765559 conn(0x7fcdf80b0f00 msgr2=0x7fcdf8159e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:02.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.578+0000 7fcdf7fff700 1 -- 172.21.15.44:0/1165765559 shutdown_connections 2024-09-13T18:28:02.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.578+0000 7fcdf7fff700 1 -- 172.21.15.44:0/1165765559 wait complete. 2024-09-13T18:28:02.597 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:28:02.597 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:28:02.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f4891e17700 1 Processor -- start 2024-09-13T18:28:02.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f4891e17700 1 -- start start 2024-09-13T18:28:02.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f4891e17700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f488c0ceac0 0x7f488c06a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:02.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f4891e17700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f488c0b70d0 0x7f488c06aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:02.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f4891e17700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f488c0d1540 con 0x7f488c15ce20 2024-09-13T18:28:02.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f4891e17700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f488c0d1820 con 0x7f488c0b70d0 2024-09-13T18:28:02.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f4891e17700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0d1b00 con 0x7f488c0ceac0 2024-09-13T18:28:02.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f488bfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f488c0ceac0 0x7f488c06a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:02.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f4891616700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f488c0b70d0 0x7f488c06aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:02.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f488bfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f488c0ceac0 0x7f488c06a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:32890/0 (socket says 172.21.15.44:32890) 2024-09-13T18:28:02.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f4891616700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f488c0b70d0 0x7f488c06aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:42120/0 (socket says 172.21.15.44:42120) 2024-09-13T18:28:02.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f488bfff700 1 -- 172.21.15.44:0/2693935701 learned_addr learned my addr 172.21.15.44:0/2693935701 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:02.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f4891616700 1 -- 172.21.15.44:0/2693935701 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f488c0ceac0 msgr2=0x7f488c06a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:02.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f4891616700 1 --2- 172.21.15.44:0/2693935701 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f488c0ceac0 0x7f488c06a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f4891616700 1 -- 172.21.15.44:0/2693935701 >> v1:172.21.15.99:6789/0 conn(0x7f488c15ce20 legacy=0x7f488c0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:02.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f4891616700 1 -- 172.21.15.44:0/2693935701 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c0d1de0 con 0x7f488c0b70d0 2024-09-13T18:28:02.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f488bfff700 1 --2- 172.21.15.44:0/2693935701 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f488c0ceac0 0x7f488c06a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:02.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f4891616700 1 --2- 172.21.15.44:0/2693935701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f488c0b70d0 0x7f488c06aa60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4884009d90 tx=0x7f488400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aabc87df54091fc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:02.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f488b7fe700 1 -- 172.21.15.44:0/2693935701 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488400e070 con 0x7f488c0b70d0 2024-09-13T18:28:02.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f488b7fe700 1 -- 172.21.15.44:0/2693935701 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488400bb20 con 0x7f488c0b70d0 2024-09-13T18:28:02.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f488b7fe700 1 -- 172.21.15.44:0/2693935701 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4884012430 con 0x7f488c0b70d0 2024-09-13T18:28:02.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f4891e17700 1 -- 172.21.15.44:0/2693935701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f488c0b70d0 msgr2=0x7f488c06aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:02.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f4891e17700 1 --2- 172.21.15.44:0/2693935701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f488c0b70d0 0x7f488c06aa60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4884009d90 tx=0x7f488400b330 comp rx=0 tx=0).stop 2024-09-13T18:28:02.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.718+0000 7f4891e17700 1 -- 172.21.15.44:0/2693935701 shutdown_connections 2024-09-13T18:28:02.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.722+0000 7f4891e17700 1 --2- 172.21.15.44:0/2693935701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f488c0b70d0 0x7f488c06aa60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.722+0000 7f4891e17700 1 --2- 172.21.15.44:0/2693935701 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f488c0ceac0 0x7f488c06a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.722+0000 7f4891e17700 1 -- 172.21.15.44:0/2693935701 >> 172.21.15.44:0/2693935701 conn(0x7f488c0d2c30 msgr2=0x7f488c0d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:02.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.722+0000 7f4891e17700 1 -- 172.21.15.44:0/2693935701 shutdown_connections 2024-09-13T18:28:02.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.722+0000 7f4891e17700 1 -- 172.21.15.44:0/2693935701 wait complete. 2024-09-13T18:28:02.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.722+0000 7f4891e17700 1 Processor -- start 2024-09-13T18:28:02.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.722+0000 7f4891e17700 1 -- start start 2024-09-13T18:28:02.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.722+0000 7f4891e17700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f488c0b70d0 0x7f488c1f3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:02.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.722+0000 7f4891e17700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f488c0ceac0 0x7f488c1f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:02.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.722+0000 7f4891e17700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f488c15ce20 0x7f488c0c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:02.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.722+0000 7f4891e17700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c1f3200 con 0x7f488c0b70d0 2024-09-13T18:28:02.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.722+0000 7f4891e17700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c1f54f0 con 0x7f488c0ceac0 2024-09-13T18:28:02.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.722+0000 7f4891e17700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488c1f25f0 con 0x7f488c15ce20 2024-09-13T18:28:02.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.722+0000 7f4890e15700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f488c0b70d0 0x7f488c1f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:02.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.722+0000 7f4890e15700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f488c0b70d0 0x7f488c1f3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35054/0 (socket says 172.21.15.44:35054) 2024-09-13T18:28:02.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.722+0000 7f4890e15700 1 -- 172.21.15.44:0/1703331985 learned_addr learned my addr 172.21.15.44:0/1703331985 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:02.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.722+0000 7f488bfff700 1 --2- 172.21.15.44:0/1703331985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f488c0ceac0 0x7f488c1f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:02.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.722+0000 7f4891616700 1 --2- 172.21.15.44:0/1703331985 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f488c15ce20 0x7f488c0c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:02.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.722+0000 7f4890e15700 1 -- 172.21.15.44:0/1703331985 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f488c15ce20 msgr2=0x7f488c0c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:02.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.722+0000 7f4890e15700 1 --2- 172.21.15.44:0/1703331985 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f488c15ce20 0x7f488c0c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.722+0000 7f4890e15700 1 -- 172.21.15.44:0/1703331985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f488c0ceac0 msgr2=0x7f488c1f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:02.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.722+0000 7f4890e15700 1 --2- 172.21.15.44:0/1703331985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f488c0ceac0 0x7f488c1f4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:02.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.722+0000 7f4890e15700 1 -- 172.21.15.44:0/1703331985 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4878009570 con 0x7f488c0b70d0 2024-09-13T18:28:02.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.726+0000 7f4890e15700 1 --2- 172.21.15.44:0/1703331985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f488c0b70d0 0x7f488c1f3360 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f488000c500 tx=0x7f488000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:02.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.726+0000 7f48897fa700 1 -- 172.21.15.44:0/1703331985 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48800052d0 con 0x7f488c0b70d0 2024-09-13T18:28:02.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.726+0000 7f4891e17700 1 -- 172.21.15.44:0/1703331985 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4884009a70 con 0x7f488c0b70d0 2024-09-13T18:28:02.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.726+0000 7f48897fa700 1 -- 172.21.15.44:0/1703331985 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4880005430 con 0x7f488c0b70d0 2024-09-13T18:28:02.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.726+0000 7f48897fa700 1 -- 172.21.15.44:0/1703331985 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48800055a0 con 0x7f488c0b70d0 2024-09-13T18:28:02.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.726+0000 7f4891e17700 1 -- 172.21.15.44:0/1703331985 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488c1f2bb0 con 0x7f488c0b70d0 2024-09-13T18:28:02.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.726+0000 7f4891e17700 1 -- 172.21.15.44:0/1703331985 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488c0b3070 con 0x7f488c0b70d0 2024-09-13T18:28:02.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.726+0000 7f48897fa700 1 -- 172.21.15.44:0/1703331985 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f48800038e0 con 0x7f488c0b70d0 2024-09-13T18:28:02.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.730+0000 7f48897fa700 1 --2- 172.21.15.44:0/1703331985 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4870066760 0x7f4870068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:02.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.730+0000 7f48897fa700 1 -- 172.21.15.44:0/1703331985 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4880083170 con 0x7f488c0b70d0 2024-09-13T18:28:02.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.730+0000 7f488bfff700 1 --2- 172.21.15.44:0/1703331985 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4870066760 0x7f4870068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:02.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.730+0000 7f488bfff700 1 --2- 172.21.15.44:0/1703331985 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4870066760 0x7f4870068c20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f488c153b60 tx=0x7f48780092e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:02.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.738+0000 7f48897fa700 1 -- 172.21.15.44:0/1703331985 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f48800507b0 con 0x7f488c0b70d0 2024-09-13T18:28:02.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:02.906+0000 7f4891e17700 1 -- 172.21.15.44:0/1703331985 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f488c0ce330 con 0x7f488c0b70d0 2024-09-13T18:28:03.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.674+0000 7f48897fa700 1 -- 172.21.15.44:0/1703331985 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4880053dd0 con 0x7f488c0b70d0 2024-09-13T18:28:03.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.678+0000 7f4891e17700 1 -- 172.21.15.44:0/1703331985 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4870066760 msgr2=0x7f4870068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:03.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.678+0000 7f4891e17700 1 --2- 172.21.15.44:0/1703331985 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4870066760 0x7f4870068c20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f488c153b60 tx=0x7f48780092e0 comp rx=0 tx=0).stop 2024-09-13T18:28:03.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.682+0000 7f4891e17700 1 -- 172.21.15.44:0/1703331985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f488c0b70d0 msgr2=0x7f488c1f3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:03.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.682+0000 7f4891e17700 1 --2- 172.21.15.44:0/1703331985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f488c0b70d0 0x7f488c1f3360 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f488000c500 tx=0x7f488000c810 comp rx=0 tx=0).stop 2024-09-13T18:28:03.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.682+0000 7f4891e17700 1 -- 172.21.15.44:0/1703331985 shutdown_connections 2024-09-13T18:28:03.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.682+0000 7f4891e17700 1 --2- 172.21.15.44:0/1703331985 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4870066760 0x7f4870068c20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:03.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.682+0000 7f4891e17700 1 --2- 172.21.15.44:0/1703331985 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f488c15ce20 0x7f488c0c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:03.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.682+0000 7f4891e17700 1 --2- 172.21.15.44:0/1703331985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f488c0ceac0 0x7f488c1f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:03.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.682+0000 7f4891e17700 1 --2- 172.21.15.44:0/1703331985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f488c0b70d0 0x7f488c1f3360 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:03.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.682+0000 7f4891e17700 1 -- 172.21.15.44:0/1703331985 >> 172.21.15.44:0/1703331985 conn(0x7f488c0d2c30 msgr2=0x7f488c0b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:03.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.682+0000 7f4891e17700 1 -- 172.21.15.44:0/1703331985 shutdown_connections 2024-09-13T18:28:03.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.682+0000 7f4891e17700 1 -- 172.21.15.44:0/1703331985 wait complete. 2024-09-13T18:28:03.688 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2024-09-13T18:28:03.701 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:28:03.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.818+0000 7f490359e700 1 Processor -- start 2024-09-13T18:28:03.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.818+0000 7f490359e700 1 -- start start 2024-09-13T18:28:03.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.818+0000 7f490359e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f490415cda0 0x7f490406b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:03.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.818+0000 7f490359e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49040b8430 con 0x7f490406a520 2024-09-13T18:28:03.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.818+0000 7f490359e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49040cf350 con 0x7f49040ceb70 2024-09-13T18:28:03.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.818+0000 7f490359e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490406be40 con 0x7f490415cda0 2024-09-13T18:28:03.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.818+0000 7f4902d9d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f490406a520 0x7f49040d1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56914/0 (socket says 172.21.15.44:56914) 2024-09-13T18:28:03.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.818+0000 7f4902d9d700 1 -- 172.21.15.44:0/2802412281 learned_addr learned my addr 172.21.15.44:0/2802412281 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:03.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.818+0000 7f490259c700 1 --2- 172.21.15.44:0/2802412281 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f490415cda0 0x7f490406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:03.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.818+0000 7f490159a700 1 -- 172.21.15.44:0/2802412281 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2099768428 0 0) 0x7f49040b8430 con 0x7f490406a520 2024-09-13T18:28:03.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.818+0000 7f490159a700 1 -- 172.21.15.44:0/2802412281 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48ec0035d0 con 0x7f490406a520 2024-09-13T18:28:03.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.818+0000 7f490159a700 1 -- 172.21.15.44:0/2802412281 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378353657 0 0) 0x7f49040cf350 con 0x7f49040ceb70 2024-09-13T18:28:03.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.818+0000 7f490159a700 1 -- 172.21.15.44:0/2802412281 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49040b8430 con 0x7f49040ceb70 2024-09-13T18:28:03.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.818+0000 7f490259c700 1 -- 172.21.15.44:0/2802412281 >> v1:172.21.15.99:6789/0 conn(0x7f49040ceb70 legacy=0x7f49040b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:03.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.818+0000 7f490259c700 1 -- 172.21.15.44:0/2802412281 >> v1:172.21.15.44:6789/0 conn(0x7f490406a520 legacy=0x7f49040d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:03.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.818+0000 7f490259c700 1 -- 172.21.15.44:0/2802412281 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49040d0880 con 0x7f490415cda0 2024-09-13T18:28:03.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.822+0000 7f490259c700 1 --2- 172.21.15.44:0/2802412281 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f490415cda0 0x7f490406b900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009880 tx=0x7f48f4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98daebf336083739 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:03.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.822+0000 7f490159a700 1 -- 172.21.15.44:0/2802412281 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4011830 con 0x7f490415cda0 2024-09-13T18:28:03.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.822+0000 7f490159a700 1 -- 172.21.15.44:0/2802412281 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f4011990 con 0x7f490415cda0 2024-09-13T18:28:03.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.822+0000 7f490159a700 1 -- 172.21.15.44:0/2802412281 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4011d00 con 0x7f490415cda0 2024-09-13T18:28:03.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.822+0000 7f490359e700 1 -- 172.21.15.44:0/2802412281 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f490415cda0 msgr2=0x7f490406b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:03.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.822+0000 7f490359e700 1 --2- 172.21.15.44:0/2802412281 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f490415cda0 0x7f490406b900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009880 tx=0x7f48f4009b90 comp rx=0 tx=0).stop 2024-09-13T18:28:03.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.822+0000 7f490359e700 1 -- 172.21.15.44:0/2802412281 shutdown_connections 2024-09-13T18:28:03.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.822+0000 7f490359e700 1 --2- 172.21.15.44:0/2802412281 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f490415cda0 0x7f490406b900 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:03.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.822+0000 7f490359e700 1 -- 172.21.15.44:0/2802412281 >> 172.21.15.44:0/2802412281 conn(0x7f49040d2cb0 msgr2=0x7f49040d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:03.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.822+0000 7f490359e700 1 -- 172.21.15.44:0/2802412281 shutdown_connections 2024-09-13T18:28:03.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.822+0000 7f490359e700 1 -- 172.21.15.44:0/2802412281 wait complete. 2024-09-13T18:28:03.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.826+0000 7f490359e700 1 Processor -- start 2024-09-13T18:28:03.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.826+0000 7f490359e700 1 -- start start 2024-09-13T18:28:03.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.826+0000 7f490359e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f490406a520 0x7f49041512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:03.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.826+0000 7f490359e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49040ceb70 0x7f49040cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:03.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.826+0000 7f490359e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f490415cda0 0x7f49040b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:03.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.826+0000 7f490359e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4904151800 con 0x7f49040ceb70 2024-09-13T18:28:03.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.826+0000 7f490359e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49040cbd20 con 0x7f490415cda0 2024-09-13T18:28:03.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.826+0000 7f490359e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4904157140 con 0x7f490406a520 2024-09-13T18:28:03.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.826+0000 7f4901d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49040ceb70 0x7f49040cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:03.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.826+0000 7f4901d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49040ceb70 0x7f49040cb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35062/0 (socket says 172.21.15.44:35062) 2024-09-13T18:28:03.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.826+0000 7f4901d9b700 1 -- 172.21.15.44:0/3142800267 learned_addr learned my addr 172.21.15.44:0/3142800267 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:03.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.826+0000 7f490259c700 1 --2- 172.21.15.44:0/3142800267 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f490406a520 0x7f49041512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:03.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.826+0000 7f4902d9d700 1 --2- 172.21.15.44:0/3142800267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f490415cda0 0x7f49040b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:03.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.826+0000 7f4901d9b700 1 -- 172.21.15.44:0/3142800267 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f490406a520 msgr2=0x7f49041512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:03.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.826+0000 7f4901d9b700 1 --2- 172.21.15.44:0/3142800267 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f490406a520 0x7f49041512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:03.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.826+0000 7f4901d9b700 1 -- 172.21.15.44:0/3142800267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f490415cda0 msgr2=0x7f49040b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:03.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.826+0000 7f4901d9b700 1 --2- 172.21.15.44:0/3142800267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f490415cda0 0x7f49040b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:03.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.826+0000 7f4901d9b700 1 -- 172.21.15.44:0/3142800267 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f40094b0 con 0x7f49040ceb70 2024-09-13T18:28:03.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.826+0000 7f4902d9d700 1 --2- 172.21.15.44:0/3142800267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f490415cda0 0x7f49040b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:03.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.830+0000 7f4901d9b700 1 --2- 172.21.15.44:0/3142800267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49040ceb70 0x7f49040cb7e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f48f800c520 tx=0x7f48f800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:03.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.830+0000 7f48f2ffd700 1 -- 172.21.15.44:0/3142800267 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f80052d0 con 0x7f49040ceb70 2024-09-13T18:28:03.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.830+0000 7f48f2ffd700 1 -- 172.21.15.44:0/3142800267 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f8005430 con 0x7f49040ceb70 2024-09-13T18:28:03.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.830+0000 7f490359e700 1 -- 172.21.15.44:0/3142800267 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4904157420 con 0x7f49040ceb70 2024-09-13T18:28:03.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.830+0000 7f48f2ffd700 1 -- 172.21.15.44:0/3142800267 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f80055a0 con 0x7f49040ceb70 2024-09-13T18:28:03.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.830+0000 7f490359e700 1 -- 172.21.15.44:0/3142800267 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49041579e0 con 0x7f49040ceb70 2024-09-13T18:28:03.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.830+0000 7f490359e700 1 -- 172.21.15.44:0/3142800267 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f490406b900 con 0x7f49040ceb70 2024-09-13T18:28:03.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.830+0000 7f48f2ffd700 1 -- 172.21.15.44:0/3142800267 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f48f80038e0 con 0x7f49040ceb70 2024-09-13T18:28:03.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.834+0000 7f48f2ffd700 1 --2- 172.21.15.44:0/3142800267 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f48e4066730 0x7f48e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:03.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.834+0000 7f48f2ffd700 1 -- 172.21.15.44:0/3142800267 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f48f8083330 con 0x7f49040ceb70 2024-09-13T18:28:03.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.834+0000 7f490259c700 1 --2- 172.21.15.44:0/3142800267 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f48e4066730 0x7f48e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:03.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.834+0000 7f490259c700 1 --2- 172.21.15.44:0/3142800267 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f48e4066730 0x7f48e4068bf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f48f40090b0 tx=0x7f48f4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:03.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:03.838+0000 7f48f2ffd700 1 -- 172.21.15.44:0/3142800267 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f48f8050880 con 0x7f49040ceb70 2024-09-13T18:28:04.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.010+0000 7f490359e700 1 -- 172.21.15.44:0/3142800267 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f490415c040 con 0x7f49040ceb70 2024-09-13T18:28:04.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.678+0000 7f48f2ffd700 1 -- 172.21.15.44:0/3142800267 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7f48f8081e60 con 0x7f49040ceb70 2024-09-13T18:28:04.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.694+0000 7f490359e700 1 -- 172.21.15.44:0/3142800267 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f48e4066730 msgr2=0x7f48e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:04.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.694+0000 7f490359e700 1 --2- 172.21.15.44:0/3142800267 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f48e4066730 0x7f48e4068bf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f48f40090b0 tx=0x7f48f4010000 comp rx=0 tx=0).stop 2024-09-13T18:28:04.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.694+0000 7f490359e700 1 -- 172.21.15.44:0/3142800267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49040ceb70 msgr2=0x7f49040cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:04.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.694+0000 7f490359e700 1 --2- 172.21.15.44:0/3142800267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49040ceb70 0x7f49040cb7e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f48f800c520 tx=0x7f48f800c830 comp rx=0 tx=0).stop 2024-09-13T18:28:04.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.698+0000 7f490359e700 1 -- 172.21.15.44:0/3142800267 shutdown_connections 2024-09-13T18:28:04.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.698+0000 7f490359e700 1 --2- 172.21.15.44:0/3142800267 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f48e4066730 0x7f48e4068bf0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:04.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.698+0000 7f490359e700 1 --2- 172.21.15.44:0/3142800267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f490415cda0 0x7f49040b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:04.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.698+0000 7f490359e700 1 --2- 172.21.15.44:0/3142800267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49040ceb70 0x7f49040cb7e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:04.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.698+0000 7f490359e700 1 --2- 172.21.15.44:0/3142800267 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f490406a520 0x7f49041512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:04.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.698+0000 7f490359e700 1 -- 172.21.15.44:0/3142800267 >> 172.21.15.44:0/3142800267 conn(0x7f49040d2cb0 msgr2=0x7f49040b72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:04.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.698+0000 7f490359e700 1 -- 172.21.15.44:0/3142800267 shutdown_connections 2024-09-13T18:28:04.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.698+0000 7f490359e700 1 -- 172.21.15.44:0/3142800267 wait complete. 2024-09-13T18:28:04.706 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2024-09-13T18:28:04.719 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:28:04.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.826+0000 7f7f4cff0700 1 Processor -- start 2024-09-13T18:28:04.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.826+0000 7f7f4cff0700 1 -- start start 2024-09-13T18:28:04.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.826+0000 7f7f4cff0700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7f480cf360 0x7f7f480ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:04.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.826+0000 7f7f4cff0700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f480b4590 con 0x7f7f480adf20 2024-09-13T18:28:04.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.826+0000 7f7f4cff0700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f480b4870 con 0x7f7f480b3f20 2024-09-13T18:28:04.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.826+0000 7f7f4cff0700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f480cf740 con 0x7f7f480cf360 2024-09-13T18:28:04.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.826+0000 7f7f477fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7f480cf360 0x7f7f480ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:04.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.826+0000 7f7f3ffff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7f480adf20 0x7f7f480b3810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56930/0 (socket says 172.21.15.44:56930) 2024-09-13T18:28:04.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.826+0000 7f7f477fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7f480cf360 0x7f7f480ad9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35070/0 (socket says 172.21.15.44:35070) 2024-09-13T18:28:04.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.826+0000 7f7f3ffff700 1 -- 172.21.15.44:0/795189672 learned_addr learned my addr 172.21.15.44:0/795189672 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:04.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.826+0000 7f7f477fe700 1 -- 172.21.15.44:0/795189672 >> v1:172.21.15.99:6789/0 conn(0x7f7f480b3f20 legacy=0x7f7f48071590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:04.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.826+0000 7f7f477fe700 1 -- 172.21.15.44:0/795189672 >> v1:172.21.15.44:6789/0 conn(0x7f7f480adf20 legacy=0x7f7f480b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:04.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.826+0000 7f7f477fe700 1 -- 172.21.15.44:0/795189672 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f48070d90 con 0x7f7f480cf360 2024-09-13T18:28:04.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.826+0000 7f7f477fe700 1 --2- 172.21.15.44:0/795189672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f480cf360 0x7f7f480ad9e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7f38009850 tx=0x7f7f38009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8cb8aa872cd088a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:04.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.830+0000 7f7f46ffd700 1 -- 172.21.15.44:0/795189672 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f38011830 con 0x7f7f480cf360 2024-09-13T18:28:04.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.830+0000 7f7f46ffd700 1 -- 172.21.15.44:0/795189672 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f38011990 con 0x7f7f480cf360 2024-09-13T18:28:04.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.830+0000 7f7f46ffd700 1 -- 172.21.15.44:0/795189672 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f38011d20 con 0x7f7f480cf360 2024-09-13T18:28:04.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.830+0000 7f7f4cff0700 1 -- 172.21.15.44:0/795189672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f480cf360 msgr2=0x7f7f480ad9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:04.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.830+0000 7f7f4cff0700 1 --2- 172.21.15.44:0/795189672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f480cf360 0x7f7f480ad9e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7f38009850 tx=0x7f7f38009b60 comp rx=0 tx=0).stop 2024-09-13T18:28:04.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.830+0000 7f7f4cff0700 1 -- 172.21.15.44:0/795189672 shutdown_connections 2024-09-13T18:28:04.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.830+0000 7f7f4cff0700 1 --2- 172.21.15.44:0/795189672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f480cf360 0x7f7f480ad9e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:04.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.830+0000 7f7f4cff0700 1 -- 172.21.15.44:0/795189672 >> 172.21.15.44:0/795189672 conn(0x7f7f480b1810 msgr2=0x7f7f480b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:04.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.830+0000 7f7f4cff0700 1 -- 172.21.15.44:0/795189672 shutdown_connections 2024-09-13T18:28:04.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.830+0000 7f7f4cff0700 1 -- 172.21.15.44:0/795189672 wait complete. 2024-09-13T18:28:04.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.830+0000 7f7f4cff0700 1 Processor -- start 2024-09-13T18:28:04.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.830+0000 7f7f4cff0700 1 -- start start 2024-09-13T18:28:04.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f4cff0700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f480adf20 0x7f7f481471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:04.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f4cff0700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f480b3f20 0x7f7f4815b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:04.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f4cff0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f480cf360 0x7f7f4815b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:04.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f4cff0700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f480b4b50 con 0x7f7f480cf360 2024-09-13T18:28:04.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f4cff0700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f481537d0 con 0x7f7f480adf20 2024-09-13T18:28:04.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f4cff0700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f481f6b10 con 0x7f7f480b3f20 2024-09-13T18:28:04.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f47fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f480cf360 0x7f7f4815b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:04.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f477fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f480adf20 0x7f7f481471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:04.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f47fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f480cf360 0x7f7f4815b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35072/0 (socket says 172.21.15.44:35072) 2024-09-13T18:28:04.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f47fff700 1 -- 172.21.15.44:0/3735007256 learned_addr learned my addr 172.21.15.44:0/3735007256 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:04.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f3ffff700 1 --2- 172.21.15.44:0/3735007256 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f480b3f20 0x7f7f4815b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:04.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f47fff700 1 -- 172.21.15.44:0/3735007256 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f480b3f20 msgr2=0x7f7f4815b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:04.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f47fff700 1 --2- 172.21.15.44:0/3735007256 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f480b3f20 0x7f7f4815b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:04.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f47fff700 1 -- 172.21.15.44:0/3735007256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f480adf20 msgr2=0x7f7f481471f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:04.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f47fff700 1 --2- 172.21.15.44:0/3735007256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f480adf20 0x7f7f481471f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:04.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f47fff700 1 -- 172.21.15.44:0/3735007256 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f380094b0 con 0x7f7f480cf360 2024-09-13T18:28:04.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f477fe700 1 --2- 172.21.15.44:0/3735007256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f480adf20 0x7f7f481471f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:04.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f47fff700 1 --2- 172.21.15.44:0/3735007256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f480cf360 0x7f7f4815b760 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7f4000cc50 tx=0x7f7f4000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:04.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f44ff9700 1 -- 172.21.15.44:0/3735007256 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f40003c20 con 0x7f7f480cf360 2024-09-13T18:28:04.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f44ff9700 1 -- 172.21.15.44:0/3735007256 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f40003d80 con 0x7f7f480cf360 2024-09-13T18:28:04.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f4cff0700 1 -- 172.21.15.44:0/3735007256 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f481f6220 con 0x7f7f480cf360 2024-09-13T18:28:04.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f44ff9700 1 -- 172.21.15.44:0/3735007256 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4000aab0 con 0x7f7f480cf360 2024-09-13T18:28:04.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f4cff0700 1 -- 172.21.15.44:0/3735007256 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f481f64c0 con 0x7f7f480cf360 2024-09-13T18:28:04.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.834+0000 7f7f4cff0700 1 -- 172.21.15.44:0/3735007256 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f481f6cc0 con 0x7f7f480cf360 2024-09-13T18:28:04.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.838+0000 7f7f44ff9700 1 -- 172.21.15.44:0/3735007256 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7f4000ac10 con 0x7f7f480cf360 2024-09-13T18:28:04.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.838+0000 7f7f44ff9700 1 --2- 172.21.15.44:0/3735007256 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7f28066730 0x7f7f28068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:04.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.838+0000 7f7f44ff9700 1 -- 172.21.15.44:0/3735007256 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f7f400840f0 con 0x7f7f480cf360 2024-09-13T18:28:04.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.838+0000 7f7f477fe700 1 --2- 172.21.15.44:0/3735007256 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7f28066730 0x7f7f28068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:04.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.838+0000 7f7f477fe700 1 --2- 172.21.15.44:0/3735007256 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7f28066730 0x7f7f28068bf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7f38014040 tx=0x7f7f3801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:04.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:04.846+0000 7f7f44ff9700 1 -- 172.21.15.44:0/3735007256 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7f481f6cc0 con 0x7f7f480cf360 2024-09-13T18:28:05.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.058+0000 7f7f4cff0700 1 -- 172.21.15.44:0/3735007256 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7f481f6c80 con 0x7f7f480cf360 2024-09-13T18:28:05.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.066+0000 7f7f44ff9700 1 -- 172.21.15.44:0/3735007256 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7f400514f0 con 0x7f7f480cf360 2024-09-13T18:28:05.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.074+0000 7f7f4cff0700 1 -- 172.21.15.44:0/3735007256 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7f28066730 msgr2=0x7f7f28068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:05.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.074+0000 7f7f4cff0700 1 --2- 172.21.15.44:0/3735007256 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7f28066730 0x7f7f28068bf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7f38014040 tx=0x7f7f3801c040 comp rx=0 tx=0).stop 2024-09-13T18:28:05.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.074+0000 7f7f4cff0700 1 -- 172.21.15.44:0/3735007256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f480cf360 msgr2=0x7f7f4815b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:05.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.074+0000 7f7f4cff0700 1 --2- 172.21.15.44:0/3735007256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f480cf360 0x7f7f4815b760 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7f4000cc50 tx=0x7f7f4000cf60 comp rx=0 tx=0).stop 2024-09-13T18:28:05.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.074+0000 7f7f4cff0700 1 -- 172.21.15.44:0/3735007256 shutdown_connections 2024-09-13T18:28:05.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.074+0000 7f7f4cff0700 1 --2- 172.21.15.44:0/3735007256 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7f28066730 0x7f7f28068bf0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.074+0000 7f7f4cff0700 1 --2- 172.21.15.44:0/3735007256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f480cf360 0x7f7f4815b760 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.074+0000 7f7f4cff0700 1 --2- 172.21.15.44:0/3735007256 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f480b3f20 0x7f7f4815b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.074+0000 7f7f4cff0700 1 --2- 172.21.15.44:0/3735007256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f480adf20 0x7f7f481471f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.074+0000 7f7f4cff0700 1 -- 172.21.15.44:0/3735007256 >> 172.21.15.44:0/3735007256 conn(0x7f7f480b1810 msgr2=0x7f7f480cb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:05.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.074+0000 7f7f4cff0700 1 -- 172.21.15.44:0/3735007256 shutdown_connections 2024-09-13T18:28:05.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.074+0000 7f7f4cff0700 1 -- 172.21.15.44:0/3735007256 wait complete. 2024-09-13T18:28:05.085 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 4 and data pool 5 2024-09-13T18:28:05.106 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:28:05.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.198+0000 7f560d4b2700 1 Processor -- start 2024-09-13T18:28:05.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.198+0000 7f560d4b2700 1 -- start start 2024-09-13T18:28:05.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f560d4b2700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f560815cae0 0x7f56080cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:05.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f560d4b2700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f560806b310 0x7f56080d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:05.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f560d4b2700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56080d21e0 con 0x7f560815cec0 2024-09-13T18:28:05.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f560d4b2700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56080d1750 con 0x7f560806b310 2024-09-13T18:28:05.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f560d4b2700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56080d1940 con 0x7f560815cae0 2024-09-13T18:28:05.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f560ccb1700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f560806b310 0x7f56080d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:05.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f5607fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f560815cae0 0x7f56080cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:05.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f56077fe700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f560815cec0 0x7f560806ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:38648/0 (socket says 172.21.15.44:38648) 2024-09-13T18:28:05.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f56077fe700 1 -- 172.21.15.44:0/860544642 learned_addr learned my addr 172.21.15.44:0/860544642 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:05.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f5606ffd700 1 -- 172.21.15.44:0/860544642 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3466523634 0 0) 0x7f56080d21e0 con 0x7f560815cec0 2024-09-13T18:28:05.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f5606ffd700 1 -- 172.21.15.44:0/860544642 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55f40035d0 con 0x7f560815cec0 2024-09-13T18:28:05.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f5607fff700 1 -- 172.21.15.44:0/860544642 >> v2:172.21.15.99:3300/0 conn(0x7f560806b310 msgr2=0x7f56080d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:05.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f5607fff700 1 --2- 172.21.15.44:0/860544642 >> v2:172.21.15.99:3300/0 conn(0x7f560806b310 0x7f56080d1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f5607fff700 1 -- 172.21.15.44:0/860544642 >> v1:172.21.15.99:6789/0 conn(0x7f560815cec0 legacy=0x7f560806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:05.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f5607fff700 1 -- 172.21.15.44:0/860544642 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56080d1c20 con 0x7f560815cae0 2024-09-13T18:28:05.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f560ccb1700 1 --2- 172.21.15.44:0/860544642 >> v2:172.21.15.99:3300/0 conn(0x7f560806b310 0x7f56080d1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:05.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f5607fff700 1 --2- 172.21.15.44:0/860544642 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f560815cae0 0x7f56080cf030 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f55f8009850 tx=0x7f55f8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=857f0e121aef9bae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:05.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f5606ffd700 1 -- 172.21.15.44:0/860544642 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f8011830 con 0x7f560815cae0 2024-09-13T18:28:05.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f5606ffd700 1 -- 172.21.15.44:0/860544642 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f8011990 con 0x7f560815cae0 2024-09-13T18:28:05.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f5606ffd700 1 -- 172.21.15.44:0/860544642 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f8011d00 con 0x7f560815cae0 2024-09-13T18:28:05.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f560d4b2700 1 -- 172.21.15.44:0/860544642 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f560815cae0 msgr2=0x7f56080cf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:05.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f560d4b2700 1 --2- 172.21.15.44:0/860544642 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f560815cae0 0x7f56080cf030 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f55f8009850 tx=0x7f55f8009b60 comp rx=0 tx=0).stop 2024-09-13T18:28:05.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f560d4b2700 1 -- 172.21.15.44:0/860544642 shutdown_connections 2024-09-13T18:28:05.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f560d4b2700 1 --2- 172.21.15.44:0/860544642 >> v2:172.21.15.99:3300/0 conn(0x7f560806b310 0x7f56080d1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f560d4b2700 1 --2- 172.21.15.44:0/860544642 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f560815cae0 0x7f56080cf030 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f560d4b2700 1 -- 172.21.15.44:0/860544642 >> 172.21.15.44:0/860544642 conn(0x7f56080d2c80 msgr2=0x7f56080d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:05.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f560d4b2700 1 -- 172.21.15.44:0/860544642 shutdown_connections 2024-09-13T18:28:05.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.202+0000 7f560d4b2700 1 -- 172.21.15.44:0/860544642 wait complete. 2024-09-13T18:28:05.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.206+0000 7f560d4b2700 1 Processor -- start 2024-09-13T18:28:05.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.206+0000 7f560d4b2700 1 -- start start 2024-09-13T18:28:05.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.206+0000 7f560d4b2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f560806b310 0x7f56080c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:05.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.206+0000 7f560d4b2700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f560815cae0 0x7f56081f1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:05.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.206+0000 7f560d4b2700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f560815cec0 0x7f560815a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:05.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.206+0000 7f560d4b2700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56080c7ae0 con 0x7f560806b310 2024-09-13T18:28:05.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.206+0000 7f560d4b2700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56080c6c50 con 0x7f560815cec0 2024-09-13T18:28:05.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.206+0000 7f560d4b2700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56080c6f30 con 0x7f560815cae0 2024-09-13T18:28:05.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.206+0000 7f5607fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f560806b310 0x7f56080c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:05.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.206+0000 7f5607fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f560806b310 0x7f56080c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35082/0 (socket says 172.21.15.44:35082) 2024-09-13T18:28:05.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.206+0000 7f5607fff700 1 -- 172.21.15.44:0/2608770774 learned_addr learned my addr 172.21.15.44:0/2608770774 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:05.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.206+0000 7f560ccb1700 1 --2- 172.21.15.44:0/2608770774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f560815cec0 0x7f560815a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:05.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.206+0000 7f56077fe700 1 --2- 172.21.15.44:0/2608770774 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f560815cae0 0x7f56081f1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:05.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.206+0000 7f5607fff700 1 -- 172.21.15.44:0/2608770774 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f560815cae0 msgr2=0x7f56081f1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:05.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.206+0000 7f5607fff700 1 --2- 172.21.15.44:0/2608770774 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f560815cae0 0x7f56081f1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.206+0000 7f5607fff700 1 -- 172.21.15.44:0/2608770774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f560815cec0 msgr2=0x7f560815a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:05.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.206+0000 7f5607fff700 1 --2- 172.21.15.44:0/2608770774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f560815cec0 0x7f560815a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.206+0000 7f5607fff700 1 -- 172.21.15.44:0/2608770774 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5600009a70 con 0x7f560806b310 2024-09-13T18:28:05.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.210+0000 7f5607fff700 1 --2- 172.21.15.44:0/2608770774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f560806b310 0x7f56080c6670 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f55f80090b0 tx=0x7f55f8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:05.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.210+0000 7f5604ff9700 1 -- 172.21.15.44:0/2608770774 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f8004550 con 0x7f560806b310 2024-09-13T18:28:05.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.210+0000 7f5604ff9700 1 -- 172.21.15.44:0/2608770774 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f801f070 con 0x7f560806b310 2024-09-13T18:28:05.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.210+0000 7f560d4b2700 1 -- 172.21.15.44:0/2608770774 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f80094b0 con 0x7f560806b310 2024-09-13T18:28:05.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.210+0000 7f5604ff9700 1 -- 172.21.15.44:0/2608770774 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f8003900 con 0x7f560806b310 2024-09-13T18:28:05.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.210+0000 7f560d4b2700 1 -- 172.21.15.44:0/2608770774 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56080c74f0 con 0x7f560806b310 2024-09-13T18:28:05.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.210+0000 7f560d4b2700 1 -- 172.21.15.44:0/2608770774 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56080d1210 con 0x7f560806b310 2024-09-13T18:28:05.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.210+0000 7f5604ff9700 1 -- 172.21.15.44:0/2608770774 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f55f8003a60 con 0x7f560806b310 2024-09-13T18:28:05.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.210+0000 7f5604ff9700 1 --2- 172.21.15.44:0/2608770774 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f55e8066730 0x7f55e8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:05.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.210+0000 7f5604ff9700 1 -- 172.21.15.44:0/2608770774 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55f8021070 con 0x7f560806b310 2024-09-13T18:28:05.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.210+0000 7f56077fe700 1 --2- 172.21.15.44:0/2608770774 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f55e8066730 0x7f55e8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:05.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.214+0000 7f56077fe700 1 --2- 172.21.15.44:0/2608770774 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f55e8066730 0x7f55e8068bf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f560815ad60 tx=0x7f55f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:05.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.218+0000 7f5604ff9700 1 -- 172.21.15.44:0/2608770774 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f55f8052c30 con 0x7f560806b310 2024-09-13T18:28:05.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.394+0000 7f560d4b2700 1 -- 172.21.15.44:0/2608770774 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56080cf210 con 0x7f560806b310 2024-09-13T18:28:05.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.398+0000 7f5604ff9700 1 -- 172.21.15.44:0/2608770774 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16522 (secure 0 0 0) 0x7f55f8015090 con 0x7f560806b310 2024-09-13T18:28:05.403 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:05.403 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":34,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:28:05.062235+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:28:02.951723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:28:04.057772+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:28:05.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.398+0000 7f560d4b2700 1 -- 172.21.15.44:0/2608770774 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f55e8066730 msgr2=0x7f55e8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:05.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.398+0000 7f560d4b2700 1 --2- 172.21.15.44:0/2608770774 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f55e8066730 0x7f55e8068bf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f560815ad60 tx=0x7f55f0009040 comp rx=0 tx=0).stop 2024-09-13T18:28:05.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.398+0000 7f560d4b2700 1 -- 172.21.15.44:0/2608770774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f560806b310 msgr2=0x7f56080c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:05.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.398+0000 7f560d4b2700 1 --2- 172.21.15.44:0/2608770774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f560806b310 0x7f56080c6670 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f55f80090b0 tx=0x7f55f8004770 comp rx=0 tx=0).stop 2024-09-13T18:28:05.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.398+0000 7f560d4b2700 1 -- 172.21.15.44:0/2608770774 shutdown_connections 2024-09-13T18:28:05.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.398+0000 7f560d4b2700 1 --2- 172.21.15.44:0/2608770774 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f55e8066730 0x7f55e8068bf0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.398+0000 7f560d4b2700 1 --2- 172.21.15.44:0/2608770774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f560815cec0 0x7f560815a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.398+0000 7f560d4b2700 1 --2- 172.21.15.44:0/2608770774 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f560815cae0 0x7f56081f1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.398+0000 7f560d4b2700 1 --2- 172.21.15.44:0/2608770774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f560806b310 0x7f56080c6670 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.398+0000 7f560d4b2700 1 -- 172.21.15.44:0/2608770774 >> 172.21.15.44:0/2608770774 conn(0x7f56080d2c80 msgr2=0x7f56080d3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:05.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.398+0000 7f560d4b2700 1 -- 172.21.15.44:0/2608770774 shutdown_connections 2024-09-13T18:28:05.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.398+0000 7f560d4b2700 1 -- 172.21.15.44:0/2608770774 wait complete. 2024-09-13T18:28:05.418 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:28:05.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.526+0000 7f63a66d4700 1 Processor -- start 2024-09-13T18:28:05.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.526+0000 7f63a66d4700 1 -- start start 2024-09-13T18:28:05.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.526+0000 7f63a66d4700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63a015cae0 0x7f63a00cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:05.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.526+0000 7f63a66d4700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f63a015cec0 0x7f63a00d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:05.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.526+0000 7f63a66d4700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a00d21e0 con 0x7f63a006ac00 2024-09-13T18:28:05.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.526+0000 7f63a66d4700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a00d1750 con 0x7f63a015cec0 2024-09-13T18:28:05.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.526+0000 7f63a66d4700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a00d1940 con 0x7f63a015cae0 2024-09-13T18:28:05.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.530+0000 7f63a4ed1700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f63a015cec0 0x7f63a00d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:05.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.530+0000 7f63a4ed1700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f63a015cec0 0x7f63a00d1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35096/0 (socket says 172.21.15.44:35096) 2024-09-13T18:28:05.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.530+0000 7f63a4ed1700 1 -- 172.21.15.44:0/2875205819 learned_addr learned my addr 172.21.15.44:0/2875205819 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:05.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.530+0000 7f63a56d2700 1 --2- 172.21.15.44:0/2875205819 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63a015cae0 0x7f63a00cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:05.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.530+0000 7f63a4ed1700 1 -- 172.21.15.44:0/2875205819 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63a015cae0 msgr2=0x7f63a00cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:05.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.530+0000 7f63a4ed1700 1 --2- 172.21.15.44:0/2875205819 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63a015cae0 0x7f63a00cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.530+0000 7f63a4ed1700 1 -- 172.21.15.44:0/2875205819 >> v1:172.21.15.44:6789/0 conn(0x7f63a006ac00 legacy=0x7f63a00cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:05.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.530+0000 7f63a4ed1700 1 -- 172.21.15.44:0/2875205819 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a00d1c20 con 0x7f63a015cec0 2024-09-13T18:28:05.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.530+0000 7f63a4ed1700 1 --2- 172.21.15.44:0/2875205819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a015cec0 0x7f63a00d1210 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6390009910 tx=0x7f6390009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278a5d3abbb48e44 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:05.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.530+0000 7f6397fff700 1 -- 172.21.15.44:0/2875205819 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639000ba60 con 0x7f63a015cec0 2024-09-13T18:28:05.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.530+0000 7f6397fff700 1 -- 172.21.15.44:0/2875205819 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639000bbc0 con 0x7f63a015cec0 2024-09-13T18:28:05.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.530+0000 7f6397fff700 1 -- 172.21.15.44:0/2875205819 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6390009e60 con 0x7f63a015cec0 2024-09-13T18:28:05.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.530+0000 7f63a66d4700 1 -- 172.21.15.44:0/2875205819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a015cec0 msgr2=0x7f63a00d1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:05.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.530+0000 7f63a66d4700 1 --2- 172.21.15.44:0/2875205819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a015cec0 0x7f63a00d1210 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6390009910 tx=0x7f6390009c20 comp rx=0 tx=0).stop 2024-09-13T18:28:05.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.530+0000 7f63a66d4700 1 -- 172.21.15.44:0/2875205819 shutdown_connections 2024-09-13T18:28:05.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.530+0000 7f63a66d4700 1 --2- 172.21.15.44:0/2875205819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a015cec0 0x7f63a00d1210 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.530+0000 7f63a66d4700 1 --2- 172.21.15.44:0/2875205819 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63a015cae0 0x7f63a00cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.530+0000 7f63a66d4700 1 -- 172.21.15.44:0/2875205819 >> 172.21.15.44:0/2875205819 conn(0x7f63a00d2c80 msgr2=0x7f63a00d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:05.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.530+0000 7f63a66d4700 1 -- 172.21.15.44:0/2875205819 shutdown_connections 2024-09-13T18:28:05.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.530+0000 7f63a66d4700 1 -- 172.21.15.44:0/2875205819 wait complete. 2024-09-13T18:28:05.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f63a66d4700 1 Processor -- start 2024-09-13T18:28:05.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f63a66d4700 1 -- start start 2024-09-13T18:28:05.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f63a66d4700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63a006ac00 0x7f63a0153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:05.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f63a66d4700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63a015cae0 0x7f63a0155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:05.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f63a66d4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a015cec0 0x7f63a015ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:05.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f63a66d4700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a00cbdc0 con 0x7f63a015cec0 2024-09-13T18:28:05.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f63a66d4700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a00caef0 con 0x7f63a006ac00 2024-09-13T18:28:05.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f63a66d4700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a0156210 con 0x7f63a015cae0 2024-09-13T18:28:05.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f63a5ed3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a015cec0 0x7f63a015ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:05.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f63a5ed3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a015cec0 0x7f63a015ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35100/0 (socket says 172.21.15.44:35100) 2024-09-13T18:28:05.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f63a5ed3700 1 -- 172.21.15.44:0/2833784712 learned_addr learned my addr 172.21.15.44:0/2833784712 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:05.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f63a4ed1700 1 --2- 172.21.15.44:0/2833784712 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63a015cae0 0x7f63a0155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:05.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f63a56d2700 1 --2- 172.21.15.44:0/2833784712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63a006ac00 0x7f63a0153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f63a5ed3700 1 -- 172.21.15.44:0/2833784712 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63a015cae0 msgr2=0x7f63a0155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f63a5ed3700 1 --2- 172.21.15.44:0/2833784712 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63a015cae0 0x7f63a0155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f63a5ed3700 1 -- 172.21.15.44:0/2833784712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63a006ac00 msgr2=0x7f63a0153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f63a5ed3700 1 --2- 172.21.15.44:0/2833784712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63a006ac00 0x7f63a0153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f63a5ed3700 1 -- 172.21.15.44:0/2833784712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6390009570 con 0x7f63a015cec0 2024-09-13T18:28:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f63a5ed3700 1 --2- 172.21.15.44:0/2833784712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a015cec0 0x7f63a015ee30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f639800cb50 tx=0x7f639800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f6395ffb700 1 -- 172.21.15.44:0/2833784712 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6398003c20 con 0x7f63a015cec0 2024-09-13T18:28:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f6395ffb700 1 -- 172.21.15.44:0/2833784712 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6398003d80 con 0x7f63a015cec0 2024-09-13T18:28:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f63a66d4700 1 -- 172.21.15.44:0/2833784712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a00cb140 con 0x7f63a015cec0 2024-09-13T18:28:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f6395ffb700 1 -- 172.21.15.44:0/2833784712 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639800aa20 con 0x7f63a015cec0 2024-09-13T18:28:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.534+0000 7f63a66d4700 1 -- 172.21.15.44:0/2833784712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a00cb700 con 0x7f63a015cec0 2024-09-13T18:28:05.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.538+0000 7f63a66d4700 1 -- 172.21.15.44:0/2833784712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a00d1210 con 0x7f63a015cec0 2024-09-13T18:28:05.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.538+0000 7f6395ffb700 1 -- 172.21.15.44:0/2833784712 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f639800ab80 con 0x7f63a015cec0 2024-09-13T18:28:05.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.538+0000 7f6395ffb700 1 --2- 172.21.15.44:0/2833784712 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6384066730 0x7f6384068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:05.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.538+0000 7f6395ffb700 1 -- 172.21.15.44:0/2833784712 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63980840a0 con 0x7f63a015cec0 2024-09-13T18:28:05.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.538+0000 7f63a56d2700 1 --2- 172.21.15.44:0/2833784712 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6384066730 0x7f6384068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:05.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.538+0000 7f63a56d2700 1 --2- 172.21.15.44:0/2833784712 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6384066730 0x7f6384068bf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f639c009a00 tx=0x7f639c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:05.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.550+0000 7f6395ffb700 1 -- 172.21.15.44:0/2833784712 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f63980514a0 con 0x7f63a015cec0 2024-09-13T18:28:05.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.726+0000 7f63a66d4700 1 -- 172.21.15.44:0/2833784712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63a006b730 con 0x7f63a015cec0 2024-09-13T18:28:05.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.726+0000 7f6395ffb700 1 -- 172.21.15.44:0/2833784712 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16522 (secure 0 0 0) 0x7f6398054ac0 con 0x7f63a015cec0 2024-09-13T18:28:05.733 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:05.734 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":34,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:28:05.062235+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:28:02.951723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:28:04.057772+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:28:05.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.730+0000 7f63a66d4700 1 -- 172.21.15.44:0/2833784712 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6384066730 msgr2=0x7f6384068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:05.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.730+0000 7f63a66d4700 1 --2- 172.21.15.44:0/2833784712 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6384066730 0x7f6384068bf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f639c009a00 tx=0x7f639c008040 comp rx=0 tx=0).stop 2024-09-13T18:28:05.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.730+0000 7f63a66d4700 1 -- 172.21.15.44:0/2833784712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a015cec0 msgr2=0x7f63a015ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:05.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.730+0000 7f63a66d4700 1 --2- 172.21.15.44:0/2833784712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a015cec0 0x7f63a015ee30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f639800cb50 tx=0x7f639800ce60 comp rx=0 tx=0).stop 2024-09-13T18:28:05.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.730+0000 7f63a66d4700 1 -- 172.21.15.44:0/2833784712 shutdown_connections 2024-09-13T18:28:05.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.730+0000 7f63a66d4700 1 --2- 172.21.15.44:0/2833784712 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6384066730 0x7f6384068bf0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.730+0000 7f63a66d4700 1 --2- 172.21.15.44:0/2833784712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a015cec0 0x7f63a015ee30 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.730+0000 7f63a66d4700 1 --2- 172.21.15.44:0/2833784712 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63a015cae0 0x7f63a0155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.730+0000 7f63a66d4700 1 --2- 172.21.15.44:0/2833784712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63a006ac00 0x7f63a0153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.730+0000 7f63a66d4700 1 -- 172.21.15.44:0/2833784712 >> 172.21.15.44:0/2833784712 conn(0x7f63a00d2c80 msgr2=0x7f63a00b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:05.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.730+0000 7f63a66d4700 1 -- 172.21.15.44:0/2833784712 shutdown_connections 2024-09-13T18:28:05.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.730+0000 7f63a66d4700 1 -- 172.21.15.44:0/2833784712 wait complete. 2024-09-13T18:28:05.749 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:28:05.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.858+0000 7fb78b2c9700 1 Processor -- start 2024-09-13T18:28:05.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.858+0000 7fb78b2c9700 1 -- start start 2024-09-13T18:28:05.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.858+0000 7fb78b2c9700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7841573e0 0x7fb784070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:05.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.858+0000 7fb78b2c9700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb78415a630 0x7fb78406c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:05.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.858+0000 7fb78b2c9700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb784071540 con 0x7fb7840710e0 2024-09-13T18:28:05.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.858+0000 7fb78b2c9700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7840cc1b0 con 0x7fb78415a630 2024-09-13T18:28:05.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.858+0000 7fb78b2c9700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb78415ac50 con 0x7fb7841573e0 2024-09-13T18:28:05.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.858+0000 7fb78aac8700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb78415a630 0x7fb78406c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:05.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.858+0000 7fb78aac8700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb78415a630 0x7fb78406c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35110/0 (socket says 172.21.15.44:35110) 2024-09-13T18:28:05.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.858+0000 7fb78aac8700 1 -- 172.21.15.44:0/3150656983 learned_addr learned my addr 172.21.15.44:0/3150656983 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:05.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.858+0000 7fb78a2c7700 1 --2- 172.21.15.44:0/3150656983 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7841573e0 0x7fb784070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:05.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.858+0000 7fb78aac8700 1 -- 172.21.15.44:0/3150656983 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7841573e0 msgr2=0x7fb784070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:05.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.858+0000 7fb78aac8700 1 --2- 172.21.15.44:0/3150656983 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7841573e0 0x7fb784070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.858+0000 7fb78aac8700 1 -- 172.21.15.44:0/3150656983 >> v1:172.21.15.99:6789/0 conn(0x7fb7840710e0 legacy=0x7fb784159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:05.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.858+0000 7fb78aac8700 1 -- 172.21.15.44:0/3150656983 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7840cb3f0 con 0x7fb78415a630 2024-09-13T18:28:05.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.858+0000 7fb78a2c7700 1 --2- 172.21.15.44:0/3150656983 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7841573e0 0x7fb784070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:05.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.862+0000 7fb78aac8700 1 --2- 172.21.15.44:0/3150656983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb78415a630 0x7fb78406c3e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb77c009940 tx=0x7fb77c009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea1726698373eda server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:05.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.862+0000 7fb7892c5700 1 -- 172.21.15.44:0/3150656983 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c00ba20 con 0x7fb78415a630 2024-09-13T18:28:05.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.862+0000 7fb7892c5700 1 -- 172.21.15.44:0/3150656983 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77c009e90 con 0x7fb78415a630 2024-09-13T18:28:05.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.862+0000 7fb7892c5700 1 -- 172.21.15.44:0/3150656983 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c00bda0 con 0x7fb78415a630 2024-09-13T18:28:05.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.862+0000 7fb78b2c9700 1 -- 172.21.15.44:0/3150656983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb78415a630 msgr2=0x7fb78406c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:05.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.862+0000 7fb78b2c9700 1 --2- 172.21.15.44:0/3150656983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb78415a630 0x7fb78406c3e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb77c009940 tx=0x7fb77c009c50 comp rx=0 tx=0).stop 2024-09-13T18:28:05.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.862+0000 7fb78b2c9700 1 -- 172.21.15.44:0/3150656983 shutdown_connections 2024-09-13T18:28:05.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.862+0000 7fb78b2c9700 1 --2- 172.21.15.44:0/3150656983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb78415a630 0x7fb78406c3e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.862+0000 7fb78b2c9700 1 --2- 172.21.15.44:0/3150656983 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7841573e0 0x7fb784070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.862+0000 7fb78b2c9700 1 -- 172.21.15.44:0/3150656983 >> 172.21.15.44:0/3150656983 conn(0x7fb7840b0e10 msgr2=0x7fb7840b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:05.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.862+0000 7fb78b2c9700 1 -- 172.21.15.44:0/3150656983 shutdown_connections 2024-09-13T18:28:05.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.862+0000 7fb78b2c9700 1 -- 172.21.15.44:0/3150656983 wait complete. 2024-09-13T18:28:05.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.866+0000 7fb78b2c9700 1 Processor -- start 2024-09-13T18:28:05.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.866+0000 7fb78b2c9700 1 -- start start 2024-09-13T18:28:05.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.866+0000 7fb78b2c9700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7840710e0 0x7fb7841441b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:05.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.866+0000 7fb78b2c9700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7841573e0 0x7fb784150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:05.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.866+0000 7fb78b2c9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb78415a630 0x7fb7841508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:05.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.866+0000 7fb78b2c9700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7841446f0 con 0x7fb78415a630 2024-09-13T18:28:05.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.866+0000 7fb78b2c9700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78414e080 con 0x7fb7841573e0 2024-09-13T18:28:05.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.866+0000 7fb78b2c9700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb784153670 con 0x7fb7840710e0 2024-09-13T18:28:05.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.866+0000 7fb78aac8700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb78415a630 0x7fb7841508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:05.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.866+0000 7fb78aac8700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb78415a630 0x7fb7841508a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35120/0 (socket says 172.21.15.44:35120) 2024-09-13T18:28:05.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.866+0000 7fb78aac8700 1 -- 172.21.15.44:0/3074480394 learned_addr learned my addr 172.21.15.44:0/3074480394 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:05.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.866+0000 7fb789ac6700 1 --2- 172.21.15.44:0/3074480394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7841573e0 0x7fb784150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:05.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.866+0000 7fb78a2c7700 1 --2- 172.21.15.44:0/3074480394 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7840710e0 0x7fb7841441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:05.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.866+0000 7fb78aac8700 1 -- 172.21.15.44:0/3074480394 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7840710e0 msgr2=0x7fb7841441b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:05.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.866+0000 7fb78aac8700 1 --2- 172.21.15.44:0/3074480394 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7840710e0 0x7fb7841441b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.866+0000 7fb78aac8700 1 -- 172.21.15.44:0/3074480394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7841573e0 msgr2=0x7fb784150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:05.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.866+0000 7fb78aac8700 1 --2- 172.21.15.44:0/3074480394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7841573e0 0x7fb784150360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:05.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.866+0000 7fb78aac8700 1 -- 172.21.15.44:0/3074480394 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c009570 con 0x7fb78415a630 2024-09-13T18:28:05.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.866+0000 7fb78aac8700 1 --2- 172.21.15.44:0/3074480394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb78415a630 0x7fb7841508a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb77c014040 tx=0x7fb77c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:05.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.870+0000 7fb776ffd700 1 -- 172.21.15.44:0/3074480394 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c004240 con 0x7fb78415a630 2024-09-13T18:28:05.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.870+0000 7fb776ffd700 1 -- 172.21.15.44:0/3074480394 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77c01e070 con 0x7fb78415a630 2024-09-13T18:28:05.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.870+0000 7fb776ffd700 1 -- 172.21.15.44:0/3074480394 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c0045e0 con 0x7fb78415a630 2024-09-13T18:28:05.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.870+0000 7fb78b2c9700 1 -- 172.21.15.44:0/3074480394 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb784153950 con 0x7fb78415a630 2024-09-13T18:28:05.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.870+0000 7fb78b2c9700 1 -- 172.21.15.44:0/3074480394 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb784153f10 con 0x7fb78415a630 2024-09-13T18:28:05.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.870+0000 7fb78b2c9700 1 -- 172.21.15.44:0/3074480394 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb784070ba0 con 0x7fb78415a630 2024-09-13T18:28:05.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.870+0000 7fb776ffd700 1 -- 172.21.15.44:0/3074480394 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb77c020030 con 0x7fb78415a630 2024-09-13T18:28:05.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.870+0000 7fb776ffd700 1 --2- 172.21.15.44:0/3074480394 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb768066760 0x7fb768068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:05.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.870+0000 7fb776ffd700 1 -- 172.21.15.44:0/3074480394 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb77c084f50 con 0x7fb78415a630 2024-09-13T18:28:05.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.870+0000 7fb78a2c7700 1 --2- 172.21.15.44:0/3074480394 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb768066760 0x7fb768068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:05.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.874+0000 7fb78a2c7700 1 --2- 172.21.15.44:0/3074480394 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb768066760 0x7fb768068c20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb7840afb50 tx=0x7fb780009890 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:05.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:05.878+0000 7fb776ffd700 1 -- 172.21.15.44:0/3074480394 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb77c052350 con 0x7fb78415a630 2024-09-13T18:28:06.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:06.090+0000 7fb78b2c9700 1 -- 172.21.15.44:0/3074480394 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb78406db90 con 0x7fb78415a630 2024-09-13T18:28:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.074+0000 7fb776ffd700 1 -- 172.21.15.44:0/3074480394 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb77c055970 con 0x7fb78415a630 2024-09-13T18:28:07.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.078+0000 7fb78b2c9700 1 -- 172.21.15.44:0/3074480394 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb768066760 msgr2=0x7fb768068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:07.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.078+0000 7fb78b2c9700 1 --2- 172.21.15.44:0/3074480394 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb768066760 0x7fb768068c20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb7840afb50 tx=0x7fb780009890 comp rx=0 tx=0).stop 2024-09-13T18:28:07.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.078+0000 7fb78b2c9700 1 -- 172.21.15.44:0/3074480394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb78415a630 msgr2=0x7fb7841508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:07.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.078+0000 7fb78b2c9700 1 --2- 172.21.15.44:0/3074480394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb78415a630 0x7fb7841508a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb77c014040 tx=0x7fb77c004770 comp rx=0 tx=0).stop 2024-09-13T18:28:07.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.078+0000 7fb78b2c9700 1 -- 172.21.15.44:0/3074480394 shutdown_connections 2024-09-13T18:28:07.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.082+0000 7fb78b2c9700 1 --2- 172.21.15.44:0/3074480394 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb768066760 0x7fb768068c20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:07.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.082+0000 7fb78b2c9700 1 --2- 172.21.15.44:0/3074480394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb78415a630 0x7fb7841508a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:07.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.082+0000 7fb78b2c9700 1 --2- 172.21.15.44:0/3074480394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7841573e0 0x7fb784150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:07.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.082+0000 7fb78b2c9700 1 --2- 172.21.15.44:0/3074480394 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb7840710e0 0x7fb7841441b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:07.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.082+0000 7fb78b2c9700 1 -- 172.21.15.44:0/3074480394 >> 172.21.15.44:0/3074480394 conn(0x7fb7840b0e10 msgr2=0x7fb78406cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:07.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.082+0000 7fb78b2c9700 1 -- 172.21.15.44:0/3074480394 shutdown_connections 2024-09-13T18:28:07.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.082+0000 7fb78b2c9700 1 -- 172.21.15.44:0/3074480394 wait complete. 2024-09-13T18:28:07.103 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:28:07.104 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:28:07.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.222+0000 7f56cefd1700 1 Processor -- start 2024-09-13T18:28:07.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.222+0000 7f56cefd1700 1 -- start start 2024-09-13T18:28:07.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.222+0000 7f56cefd1700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f56c815ce40 0x7f56c806aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:07.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.222+0000 7f56cefd1700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f56c806b400 0x7f56c80cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:07.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.222+0000 7f56cefd1700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56c80ce000 0x7f56c80d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:07.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.222+0000 7f56cefd1700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c806b870 con 0x7f56c806b400 2024-09-13T18:28:07.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.222+0000 7f56cefd1700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c80ce830 con 0x7f56c815ce40 2024-09-13T18:28:07.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.222+0000 7f56cefd1700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c80ceb10 con 0x7f56c80ce000 2024-09-13T18:28:07.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.222+0000 7f56c7fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f56c806b400 0x7f56c80cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:07.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.222+0000 7f56c7fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f56c806b400 0x7f56c80cdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35124/0 (socket says 172.21.15.44:35124) 2024-09-13T18:28:07.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.222+0000 7f56c7fff700 1 -- 172.21.15.44:0/1390081844 learned_addr learned my addr 172.21.15.44:0/1390081844 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:07.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.222+0000 7f56cd56e700 1 --2- 172.21.15.44:0/1390081844 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56c80ce000 0x7f56c80d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:07.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.222+0000 7f56ccd6d700 1 --2- 172.21.15.44:0/1390081844 >> v2:172.21.15.99:3300/0 conn(0x7f56c815ce40 0x7f56c806aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:07.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.226+0000 7f56c7fff700 1 -- 172.21.15.44:0/1390081844 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56c80ce000 msgr2=0x7f56c80d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:07.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.226+0000 7f56c7fff700 1 --2- 172.21.15.44:0/1390081844 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56c80ce000 0x7f56c80d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:07.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.226+0000 7f56c7fff700 1 -- 172.21.15.44:0/1390081844 >> v2:172.21.15.99:3300/0 conn(0x7f56c815ce40 msgr2=0x7f56c806aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:07.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.226+0000 7f56c7fff700 1 --2- 172.21.15.44:0/1390081844 >> v2:172.21.15.99:3300/0 conn(0x7f56c815ce40 0x7f56c806aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:07.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.226+0000 7f56c7fff700 1 -- 172.21.15.44:0/1390081844 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c80cedf0 con 0x7f56c806b400 2024-09-13T18:28:07.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.226+0000 7f56cd56e700 1 --2- 172.21.15.44:0/1390081844 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56c80ce000 0x7f56c80d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:07.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.226+0000 7f56c7fff700 1 --2- 172.21.15.44:0/1390081844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56c806b400 0x7f56c80cdac0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f56c8067b20 tx=0x7f56b8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1549204292a842c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:07.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.226+0000 7f56c77fe700 1 -- 172.21.15.44:0/1390081844 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b800b8a0 con 0x7f56c806b400 2024-09-13T18:28:07.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.226+0000 7f56c77fe700 1 -- 172.21.15.44:0/1390081844 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b800ba00 con 0x7f56c806b400 2024-09-13T18:28:07.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.226+0000 7f56c77fe700 1 -- 172.21.15.44:0/1390081844 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b800bd90 con 0x7f56c806b400 2024-09-13T18:28:07.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.226+0000 7f56cefd1700 1 -- 172.21.15.44:0/1390081844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56c806b400 msgr2=0x7f56c80cdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:07.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.226+0000 7f56cefd1700 1 --2- 172.21.15.44:0/1390081844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56c806b400 0x7f56c80cdac0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f56c8067b20 tx=0x7f56b8009bf0 comp rx=0 tx=0).stop 2024-09-13T18:28:07.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.226+0000 7f56cefd1700 1 -- 172.21.15.44:0/1390081844 shutdown_connections 2024-09-13T18:28:07.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.226+0000 7f56cefd1700 1 --2- 172.21.15.44:0/1390081844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56c806b400 0x7f56c80cdac0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:07.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.226+0000 7f56cefd1700 1 --2- 172.21.15.44:0/1390081844 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56c80ce000 0x7f56c80d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:07.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.226+0000 7f56cefd1700 1 --2- 172.21.15.44:0/1390081844 >> v2:172.21.15.99:3300/0 conn(0x7f56c815ce40 0x7f56c806aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:07.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.226+0000 7f56cefd1700 1 -- 172.21.15.44:0/1390081844 >> 172.21.15.44:0/1390081844 conn(0x7f56c80d2f30 msgr2=0x7f56c80d3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:07.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.226+0000 7f56cefd1700 1 -- 172.21.15.44:0/1390081844 shutdown_connections 2024-09-13T18:28:07.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.226+0000 7f56cefd1700 1 -- 172.21.15.44:0/1390081844 wait complete. 2024-09-13T18:28:07.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.226+0000 7f56cefd1700 1 Processor -- start 2024-09-13T18:28:07.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.226+0000 7f56cefd1700 1 -- start start 2024-09-13T18:28:07.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.230+0000 7f56cefd1700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56c806b400 0x7f56c80cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:07.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.230+0000 7f56cefd1700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56c80ce000 0x7f56c80cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:07.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.230+0000 7f56cefd1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56c815ce40 0x7f56c80cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:07.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.230+0000 7f56cefd1700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c8151850 con 0x7f56c815ce40 2024-09-13T18:28:07.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.230+0000 7f56cefd1700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c80c81f0 con 0x7f56c80ce000 2024-09-13T18:28:07.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.230+0000 7f56cefd1700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c80c75e0 con 0x7f56c806b400 2024-09-13T18:28:07.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.230+0000 7f56cd56e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56c815ce40 0x7f56c80cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:07.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.230+0000 7f56cd56e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56c815ce40 0x7f56c80cc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35138/0 (socket says 172.21.15.44:35138) 2024-09-13T18:28:07.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.230+0000 7f56cd56e700 1 -- 172.21.15.44:0/2318109791 learned_addr learned my addr 172.21.15.44:0/2318109791 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:07.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.230+0000 7f56ccd6d700 1 --2- 172.21.15.44:0/2318109791 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56c806b400 0x7f56c80cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:07.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.230+0000 7f56c7fff700 1 --2- 172.21.15.44:0/2318109791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56c80ce000 0x7f56c80cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:07.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.230+0000 7f56cd56e700 1 -- 172.21.15.44:0/2318109791 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56c806b400 msgr2=0x7f56c80cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:07.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.230+0000 7f56cd56e700 1 --2- 172.21.15.44:0/2318109791 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56c806b400 0x7f56c80cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:07.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.230+0000 7f56cd56e700 1 -- 172.21.15.44:0/2318109791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56c80ce000 msgr2=0x7f56c80cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:07.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.230+0000 7f56cd56e700 1 --2- 172.21.15.44:0/2318109791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56c80ce000 0x7f56c80cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:07.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.230+0000 7f56cd56e700 1 -- 172.21.15.44:0/2318109791 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b8009570 con 0x7f56c815ce40 2024-09-13T18:28:07.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.230+0000 7f56cd56e700 1 --2- 172.21.15.44:0/2318109791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56c815ce40 0x7f56c80cc770 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f56c0007e10 tx=0x7f56c000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:07.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.230+0000 7f56c57fa700 1 -- 172.21.15.44:0/2318109791 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c000dd20 con 0x7f56c815ce40 2024-09-13T18:28:07.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.230+0000 7f56c57fa700 1 -- 172.21.15.44:0/2318109791 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c000f040 con 0x7f56c815ce40 2024-09-13T18:28:07.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.230+0000 7f56c57fa700 1 -- 172.21.15.44:0/2318109791 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0003c80 con 0x7f56c815ce40 2024-09-13T18:28:07.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.230+0000 7f56cefd1700 1 -- 172.21.15.44:0/2318109791 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c80c78c0 con 0x7f56c815ce40 2024-09-13T18:28:07.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.230+0000 7f56cefd1700 1 -- 172.21.15.44:0/2318109791 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c80c7e80 con 0x7f56c815ce40 2024-09-13T18:28:07.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.234+0000 7f56cefd1700 1 -- 172.21.15.44:0/2318109791 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c80ce410 con 0x7f56c815ce40 2024-09-13T18:28:07.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.234+0000 7f56c57fa700 1 -- 172.21.15.44:0/2318109791 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f56c0004030 con 0x7f56c815ce40 2024-09-13T18:28:07.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.234+0000 7f56c57fa700 1 --2- 172.21.15.44:0/2318109791 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f56a8066760 0x7f56a8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:07.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.234+0000 7f56c57fa700 1 -- 172.21.15.44:0/2318109791 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56c0084130 con 0x7f56c815ce40 2024-09-13T18:28:07.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.234+0000 7f56ccd6d700 1 --2- 172.21.15.44:0/2318109791 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f56a8066760 0x7f56a8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:07.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.234+0000 7f56ccd6d700 1 --2- 172.21.15.44:0/2318109791 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f56a8066760 0x7f56a8068c20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f56c8154f40 tx=0x7f56b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:07.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.238+0000 7f56c57fa700 1 -- 172.21.15.44:0/2318109791 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f56c00514a0 con 0x7f56c815ce40 2024-09-13T18:28:07.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:07.446+0000 7f56cefd1700 1 -- 172.21.15.44:0/2318109791 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f56c80b76a0 con 0x7f56c815ce40 2024-09-13T18:28:08.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.086+0000 7f56c57fa700 1 -- 172.21.15.44:0/2318109791 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f56c0054ac0 con 0x7f56c815ce40 2024-09-13T18:28:08.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.090+0000 7f56cefd1700 1 -- 172.21.15.44:0/2318109791 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f56a8066760 msgr2=0x7f56a8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.090+0000 7f56cefd1700 1 --2- 172.21.15.44:0/2318109791 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f56a8066760 0x7f56a8068c20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f56c8154f40 tx=0x7f56b0008040 comp rx=0 tx=0).stop 2024-09-13T18:28:08.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.090+0000 7f56cefd1700 1 -- 172.21.15.44:0/2318109791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56c815ce40 msgr2=0x7f56c80cc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.090+0000 7f56cefd1700 1 --2- 172.21.15.44:0/2318109791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56c815ce40 0x7f56c80cc770 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f56c0007e10 tx=0x7f56c000d3b0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.090+0000 7f56cefd1700 1 -- 172.21.15.44:0/2318109791 shutdown_connections 2024-09-13T18:28:08.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.090+0000 7f56cefd1700 1 --2- 172.21.15.44:0/2318109791 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f56a8066760 0x7f56a8068c20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.090+0000 7f56cefd1700 1 --2- 172.21.15.44:0/2318109791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56c815ce40 0x7f56c80cc770 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.090+0000 7f56cefd1700 1 --2- 172.21.15.44:0/2318109791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56c80ce000 0x7f56c80cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.090+0000 7f56cefd1700 1 --2- 172.21.15.44:0/2318109791 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56c806b400 0x7f56c80cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.090+0000 7f56cefd1700 1 -- 172.21.15.44:0/2318109791 >> 172.21.15.44:0/2318109791 conn(0x7f56c80d2f30 msgr2=0x7f56c815d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:08.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.090+0000 7f56cefd1700 1 -- 172.21.15.44:0/2318109791 shutdown_connections 2024-09-13T18:28:08.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.090+0000 7f56cefd1700 1 -- 172.21.15.44:0/2318109791 wait complete. 2024-09-13T18:28:08.114 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:28:08.114 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:28:08.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.230+0000 7fcecf59e700 1 Processor -- start 2024-09-13T18:28:08.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.230+0000 7fcecf59e700 1 -- start start 2024-09-13T18:28:08.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.230+0000 7fcecf59e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fced00b3ae0 0x7fced0165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:08.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.230+0000 7fcecf59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fced0161290 0x7fced0161700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:08.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.230+0000 7fcecf59e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced0071f30 con 0x7fced0160eb0 2024-09-13T18:28:08.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.230+0000 7fcecf59e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced01622e0 con 0x7fced00b3ae0 2024-09-13T18:28:08.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.230+0000 7fcecf59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced0162000 con 0x7fced0161290 2024-09-13T18:28:08.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.230+0000 7fcecdd9b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fced00b3ae0 0x7fced0165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:08.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.230+0000 7fcecdd9b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fced00b3ae0 0x7fced0165590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35146/0 (socket says 172.21.15.44:35146) 2024-09-13T18:28:08.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.230+0000 7fcecdd9b700 1 -- 172.21.15.44:0/2861265260 learned_addr learned my addr 172.21.15.44:0/2861265260 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:08.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.230+0000 7fceced9d700 1 --2- 172.21.15.44:0/2861265260 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fced0161290 0x7fced0161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:08.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.230+0000 7fcecdd9b700 1 -- 172.21.15.44:0/2861265260 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fced0161290 msgr2=0x7fced0161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:08.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.234+0000 7fcecdd9b700 1 --2- 172.21.15.44:0/2861265260 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fced0161290 0x7fced0161700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.234+0000 7fcecdd9b700 1 -- 172.21.15.44:0/2861265260 >> v1:172.21.15.99:6789/0 conn(0x7fced0160eb0 legacy=0x7fced00b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.234+0000 7fcecdd9b700 1 -- 172.21.15.44:0/2861265260 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced0164ab0 con 0x7fced00b3ae0 2024-09-13T18:28:08.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.234+0000 7fcecdd9b700 1 --2- 172.21.15.44:0/2861265260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fced00b3ae0 0x7fced0165590 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcec0009e50 tx=0x7fcec000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5548ef10f9a6209 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:08.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.234+0000 7fcecd59a700 1 -- 172.21.15.44:0/2861265260 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec000e070 con 0x7fced00b3ae0 2024-09-13T18:28:08.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.234+0000 7fcecd59a700 1 -- 172.21.15.44:0/2861265260 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec000b9c0 con 0x7fced00b3ae0 2024-09-13T18:28:08.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.234+0000 7fcecd59a700 1 -- 172.21.15.44:0/2861265260 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec000bd70 con 0x7fced00b3ae0 2024-09-13T18:28:08.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.234+0000 7fcecf59e700 1 -- 172.21.15.44:0/2861265260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fced00b3ae0 msgr2=0x7fced0165590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.234+0000 7fcecf59e700 1 --2- 172.21.15.44:0/2861265260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fced00b3ae0 0x7fced0165590 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcec0009e50 tx=0x7fcec000b330 comp rx=0 tx=0).stop 2024-09-13T18:28:08.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.234+0000 7fcecf59e700 1 -- 172.21.15.44:0/2861265260 shutdown_connections 2024-09-13T18:28:08.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.234+0000 7fcecf59e700 1 --2- 172.21.15.44:0/2861265260 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fced0161290 0x7fced0161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.234+0000 7fcecf59e700 1 --2- 172.21.15.44:0/2861265260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fced00b3ae0 0x7fced0165590 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.234+0000 7fcecf59e700 1 -- 172.21.15.44:0/2861265260 >> 172.21.15.44:0/2861265260 conn(0x7fced00b0f00 msgr2=0x7fced00b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:08.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.234+0000 7fcecf59e700 1 -- 172.21.15.44:0/2861265260 shutdown_connections 2024-09-13T18:28:08.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.234+0000 7fcecf59e700 1 -- 172.21.15.44:0/2861265260 wait complete. 2024-09-13T18:28:08.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fcecf59e700 1 Processor -- start 2024-09-13T18:28:08.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fcecf59e700 1 -- start start 2024-09-13T18:28:08.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fcecf59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fced00b3ae0 0x7fced0156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:08.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fcecf59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fced0160eb0 0x7fced01586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:08.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fcecf59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fced0161290 0x7fced01f6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:08.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fcecf59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced01f7910 con 0x7fced00b3ae0 2024-09-13T18:28:08.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fcecf59e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced01f6e60 con 0x7fced0161290 2024-09-13T18:28:08.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fcecf59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced01fa120 con 0x7fced0160eb0 2024-09-13T18:28:08.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fcece59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fced00b3ae0 0x7fced0156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:08.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fcece59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fced00b3ae0 0x7fced0156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35150/0 (socket says 172.21.15.44:35150) 2024-09-13T18:28:08.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fcece59c700 1 -- 172.21.15.44:0/239878855 learned_addr learned my addr 172.21.15.44:0/239878855 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:08.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fcecdd9b700 1 --2- 172.21.15.44:0/239878855 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fced0160eb0 0x7fced01586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:08.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fceced9d700 1 --2- 172.21.15.44:0/239878855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fced0161290 0x7fced01f6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:08.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fcece59c700 1 -- 172.21.15.44:0/239878855 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fced0160eb0 msgr2=0x7fced01586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fcece59c700 1 --2- 172.21.15.44:0/239878855 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fced0160eb0 0x7fced01586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fcece59c700 1 -- 172.21.15.44:0/239878855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fced0161290 msgr2=0x7fced01f6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fcece59c700 1 --2- 172.21.15.44:0/239878855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fced0161290 0x7fced01f6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fcece59c700 1 -- 172.21.15.44:0/239878855 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec0009b30 con 0x7fced00b3ae0 2024-09-13T18:28:08.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fceced9d700 1 --2- 172.21.15.44:0/239878855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fced0161290 0x7fced01f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:08.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fcece59c700 1 --2- 172.21.15.44:0/239878855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fced00b3ae0 0x7fced0156bf0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcec400c500 tx=0x7fcec400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:08.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fcebeffd700 1 -- 172.21.15.44:0/239878855 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec40052d0 con 0x7fced00b3ae0 2024-09-13T18:28:08.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fcebeffd700 1 -- 172.21.15.44:0/239878855 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec4005430 con 0x7fced00b3ae0 2024-09-13T18:28:08.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fcecf59e700 1 -- 172.21.15.44:0/239878855 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced01f7070 con 0x7fced00b3ae0 2024-09-13T18:28:08.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fcebeffd700 1 -- 172.21.15.44:0/239878855 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec40055a0 con 0x7fced00b3ae0 2024-09-13T18:28:08.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.238+0000 7fcecf59e700 1 -- 172.21.15.44:0/239878855 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced01f7630 con 0x7fced00b3ae0 2024-09-13T18:28:08.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.242+0000 7fcecf59e700 1 -- 172.21.15.44:0/239878855 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced01f9f10 con 0x7fced00b3ae0 2024-09-13T18:28:08.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.242+0000 7fcebeffd700 1 -- 172.21.15.44:0/239878855 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcec40036a0 con 0x7fced00b3ae0 2024-09-13T18:28:08.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.242+0000 7fcebeffd700 1 --2- 172.21.15.44:0/239878855 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fceb0066760 0x7fceb0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:08.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.242+0000 7fcebeffd700 1 -- 172.21.15.44:0/239878855 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcec4083520 con 0x7fced00b3ae0 2024-09-13T18:28:08.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.242+0000 7fcecdd9b700 1 --2- 172.21.15.44:0/239878855 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fceb0066760 0x7fceb0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:08.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.242+0000 7fcecdd9b700 1 --2- 172.21.15.44:0/239878855 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fceb0066760 0x7fceb0068c20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcec000b370 tx=0x7fcec0009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:08.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.254+0000 7fcebeffd700 1 -- 172.21.15.44:0/239878855 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcec4050800 con 0x7fced00b3ae0 2024-09-13T18:28:08.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.462+0000 7fcecf59e700 1 -- 172.21.15.44:0/239878855 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fced0165590 con 0x7fced00b3ae0 2024-09-13T18:28:08.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.462+0000 7fcebeffd700 1 -- 172.21.15.44:0/239878855 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4731 (secure 0 0 0) 0x7fcec4053e20 con 0x7fced00b3ae0 2024-09-13T18:28:08.470 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:08.470 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5191,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/2593282586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2593282586},{"type":"v1","addr":"172.21.15.99:6836","nonce":2593282586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3094334762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3094334762},{"type":"v1","addr":"172.21.15.99:6837","nonce":3094334762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1843893566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1843893566},{"type":"v1","addr":"172.21.15.44:6833","nonce":1843893566}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:28:05.062964+0000","modified":"2024-09-13T18:28:08.082434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/939073284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":939073284},{"type":"v1","addr":"172.21.15.44:6835","nonce":939073284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:28:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.466+0000 7fcecf59e700 1 -- 172.21.15.44:0/239878855 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fceb0066760 msgr2=0x7fceb0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.466+0000 7fcecf59e700 1 --2- 172.21.15.44:0/239878855 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fceb0066760 0x7fceb0068c20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcec000b370 tx=0x7fcec0009000 comp rx=0 tx=0).stop 2024-09-13T18:28:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.466+0000 7fcecf59e700 1 -- 172.21.15.44:0/239878855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fced00b3ae0 msgr2=0x7fced0156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.466+0000 7fcecf59e700 1 --2- 172.21.15.44:0/239878855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fced00b3ae0 0x7fced0156bf0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcec400c500 tx=0x7fcec400c8c0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.466+0000 7fcecf59e700 1 -- 172.21.15.44:0/239878855 shutdown_connections 2024-09-13T18:28:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.466+0000 7fcecf59e700 1 --2- 172.21.15.44:0/239878855 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fceb0066760 0x7fceb0068c20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.466+0000 7fcecf59e700 1 --2- 172.21.15.44:0/239878855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fced0161290 0x7fced01f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.466+0000 7fcecf59e700 1 --2- 172.21.15.44:0/239878855 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fced0160eb0 0x7fced01586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.466+0000 7fcecf59e700 1 --2- 172.21.15.44:0/239878855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fced00b3ae0 0x7fced0156bf0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.466+0000 7fcecf59e700 1 -- 172.21.15.44:0/239878855 >> 172.21.15.44:0/239878855 conn(0x7fced00b0f00 msgr2=0x7fced0162da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:08.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.466+0000 7fcecf59e700 1 -- 172.21.15.44:0/239878855 shutdown_connections 2024-09-13T18:28:08.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.466+0000 7fcecf59e700 1 -- 172.21.15.44:0/239878855 wait complete. 2024-09-13T18:28:08.475 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 15 2024-09-13T18:28:08.491 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:28:08.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.602+0000 7f8ddefd1700 1 Processor -- start 2024-09-13T18:28:08.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.602+0000 7f8ddefd1700 1 -- start start 2024-09-13T18:28:08.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.602+0000 7f8ddefd1700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8dd80b3ae0 0x7f8dd806a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:08.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.602+0000 7f8ddefd1700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd813dcb0 con 0x7f8dd806bbf0 2024-09-13T18:28:08.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.602+0000 7f8ddefd1700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd815be60 con 0x7f8dd806aaf0 2024-09-13T18:28:08.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.602+0000 7f8ddefd1700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd813ffd0 con 0x7f8dd80b3ae0 2024-09-13T18:28:08.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.602+0000 7f8dddfcf700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8dd806bbf0 0x7f8dd80b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56958/0 (socket says 172.21.15.44:56958) 2024-09-13T18:28:08.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.602+0000 7f8dddfcf700 1 -- 172.21.15.44:0/2636247387 learned_addr learned my addr 172.21.15.44:0/2636247387 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:08.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.602+0000 7f8ddd7ce700 1 --2- 172.21.15.44:0/2636247387 >> v2:172.21.15.99:3300/0 conn(0x7f8dd80b3ae0 0x7f8dd806a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:08.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.602+0000 7f8ddcfcd700 1 -- 172.21.15.44:0/2636247387 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144496547 0 0) 0x7f8dd813dcb0 con 0x7f8dd806bbf0 2024-09-13T18:28:08.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.602+0000 7f8ddcfcd700 1 -- 172.21.15.44:0/2636247387 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dc40035d0 con 0x7f8dd806bbf0 2024-09-13T18:28:08.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.602+0000 7f8ddd7ce700 1 -- 172.21.15.44:0/2636247387 >> v1:172.21.15.99:6789/0 conn(0x7f8dd806aaf0 legacy=0x7f8dd815e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.602+0000 7f8ddcfcd700 1 -- 172.21.15.44:0/2636247387 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426847368 0 0) 0x7f8dd815be60 con 0x7f8dd806aaf0 2024-09-13T18:28:08.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.602+0000 7f8ddd7ce700 1 -- 172.21.15.44:0/2636247387 >> v1:172.21.15.44:6789/0 conn(0x7f8dd806bbf0 legacy=0x7f8dd80b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.602+0000 7f8ddd7ce700 1 -- 172.21.15.44:0/2636247387 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd8140220 con 0x7f8dd80b3ae0 2024-09-13T18:28:08.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.606+0000 7f8ddd7ce700 1 --2- 172.21.15.44:0/2636247387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8dd80b3ae0 0x7f8dd806a5b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009850 tx=0x7f8dd4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bbf53b24d239bbf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:08.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.606+0000 7f8ddcfcd700 1 -- 172.21.15.44:0/2636247387 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc0015f0 con 0x7f8dd80b3ae0 2024-09-13T18:28:08.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.606+0000 7f8ddcfcd700 1 -- 172.21.15.44:0/2636247387 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd4010590 con 0x7f8dd80b3ae0 2024-09-13T18:28:08.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.606+0000 7f8ddcfcd700 1 -- 172.21.15.44:0/2636247387 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4010900 con 0x7f8dd80b3ae0 2024-09-13T18:28:08.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.606+0000 7f8ddefd1700 1 -- 172.21.15.44:0/2636247387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8dd80b3ae0 msgr2=0x7f8dd806a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.606+0000 7f8ddefd1700 1 --2- 172.21.15.44:0/2636247387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8dd80b3ae0 0x7f8dd806a5b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009850 tx=0x7f8dd4009b60 comp rx=0 tx=0).stop 2024-09-13T18:28:08.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.606+0000 7f8ddefd1700 1 -- 172.21.15.44:0/2636247387 shutdown_connections 2024-09-13T18:28:08.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.606+0000 7f8ddefd1700 1 --2- 172.21.15.44:0/2636247387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8dd80b3ae0 0x7f8dd806a5b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.606+0000 7f8ddefd1700 1 -- 172.21.15.44:0/2636247387 >> 172.21.15.44:0/2636247387 conn(0x7f8dd80b0f00 msgr2=0x7f8dd80b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:08.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.606+0000 7f8ddefd1700 1 -- 172.21.15.44:0/2636247387 shutdown_connections 2024-09-13T18:28:08.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.606+0000 7f8ddefd1700 1 -- 172.21.15.44:0/2636247387 wait complete. 2024-09-13T18:28:08.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.610+0000 7f8ddefd1700 1 Processor -- start 2024-09-13T18:28:08.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.610+0000 7f8ddefd1700 1 -- start start 2024-09-13T18:28:08.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.610+0000 7f8ddefd1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dd806aaf0 0x7f8dd81575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:08.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.610+0000 7f8ddefd1700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8dd806bbf0 0x7f8dd813a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:08.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.610+0000 7f8ddefd1700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8dd80b3ae0 0x7f8dd80a8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:08.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.610+0000 7f8ddefd1700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd813aae0 con 0x7f8dd806aaf0 2024-09-13T18:28:08.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.610+0000 7f8ddefd1700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd80aa740 con 0x7f8dd806bbf0 2024-09-13T18:28:08.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.610+0000 7f8ddefd1700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd80a9400 con 0x7f8dd80b3ae0 2024-09-13T18:28:08.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.610+0000 7f8dddfcf700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dd806aaf0 0x7f8dd81575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:08.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.610+0000 7f8dddfcf700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dd806aaf0 0x7f8dd81575d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35152/0 (socket says 172.21.15.44:35152) 2024-09-13T18:28:08.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.610+0000 7f8dddfcf700 1 -- 172.21.15.44:0/4092823843 learned_addr learned my addr 172.21.15.44:0/4092823843 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:08.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.610+0000 7f8ddd7ce700 1 --2- 172.21.15.44:0/4092823843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8dd806bbf0 0x7f8dd813a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:08.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.610+0000 7f8dde7d0700 1 --2- 172.21.15.44:0/4092823843 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8dd80b3ae0 0x7f8dd80a8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:08.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.610+0000 7f8dddfcf700 1 -- 172.21.15.44:0/4092823843 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8dd80b3ae0 msgr2=0x7f8dd80a8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.610+0000 7f8dddfcf700 1 --2- 172.21.15.44:0/4092823843 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8dd80b3ae0 0x7f8dd80a8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.610+0000 7f8dddfcf700 1 -- 172.21.15.44:0/4092823843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8dd806bbf0 msgr2=0x7f8dd813a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.610+0000 7f8dddfcf700 1 --2- 172.21.15.44:0/4092823843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8dd806bbf0 0x7f8dd813a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.610+0000 7f8dddfcf700 1 -- 172.21.15.44:0/4092823843 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd40094b0 con 0x7f8dd806aaf0 2024-09-13T18:28:08.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.614+0000 7f8dddfcf700 1 --2- 172.21.15.44:0/4092823843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dd806aaf0 0x7f8dd81575d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc0011e0 tx=0x7f8dcc00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:08.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.614+0000 7f8dca7fc700 1 -- 172.21.15.44:0/4092823843 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc004ca0 con 0x7f8dd806aaf0 2024-09-13T18:28:08.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.614+0000 7f8dca7fc700 1 -- 172.21.15.44:0/4092823843 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dcc004e00 con 0x7f8dd806aaf0 2024-09-13T18:28:08.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.614+0000 7f8ddefd1700 1 -- 172.21.15.44:0/4092823843 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd80a96a0 con 0x7f8dd806aaf0 2024-09-13T18:28:08.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.614+0000 7f8dca7fc700 1 -- 172.21.15.44:0/4092823843 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc0072f0 con 0x7f8dd806aaf0 2024-09-13T18:28:08.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.614+0000 7f8ddefd1700 1 -- 172.21.15.44:0/4092823843 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd80a9c60 con 0x7f8dd806aaf0 2024-09-13T18:28:08.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.614+0000 7f8ddefd1700 1 -- 172.21.15.44:0/4092823843 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd806af40 con 0x7f8dd806aaf0 2024-09-13T18:28:08.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.614+0000 7f8dca7fc700 1 -- 172.21.15.44:0/4092823843 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8dcc007450 con 0x7f8dd806aaf0 2024-09-13T18:28:08.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.614+0000 7f8dca7fc700 1 --2- 172.21.15.44:0/4092823843 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8dbc066730 0x7f8dbc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:08.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.614+0000 7f8dca7fc700 1 -- 172.21.15.44:0/4092823843 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8dcc083f00 con 0x7f8dd806aaf0 2024-09-13T18:28:08.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.618+0000 7f8ddd7ce700 1 --2- 172.21.15.44:0/4092823843 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8dbc066730 0x7f8dbc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:08.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.618+0000 7f8ddd7ce700 1 --2- 172.21.15.44:0/4092823843 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8dbc066730 0x7f8dbc068bf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4013040 tx=0x7f8dd401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:08.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.626+0000 7f8dca7fc700 1 -- 172.21.15.44:0/4092823843 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8dcc051280 con 0x7f8dd806aaf0 2024-09-13T18:28:08.659 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-09-13T18:28:08.654+0000 7f9f9ad35700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:28:08.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.798+0000 7f8ddefd1700 1 -- 172.21.15.44:0/4092823843 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8dd80b2f00 con 0x7f8dd806aaf0 2024-09-13T18:28:08.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.802+0000 7f8dca7fc700 1 -- 172.21.15.44:0/4092823843 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16509 (secure 0 0 0) 0x7f8dcc0548a0 con 0x7f8dd806aaf0 2024-09-13T18:28:08.808 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:08.808 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":35,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:28:06.066299+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:28:02.951723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:28:04.057772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:28:08.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.802+0000 7f8ddefd1700 1 -- 172.21.15.44:0/4092823843 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8dbc066730 msgr2=0x7f8dbc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.802+0000 7f8ddefd1700 1 --2- 172.21.15.44:0/4092823843 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8dbc066730 0x7f8dbc068bf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4013040 tx=0x7f8dd401c040 comp rx=0 tx=0).stop 2024-09-13T18:28:08.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.802+0000 7f8ddefd1700 1 -- 172.21.15.44:0/4092823843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dd806aaf0 msgr2=0x7f8dd81575d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.802+0000 7f8ddefd1700 1 --2- 172.21.15.44:0/4092823843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dd806aaf0 0x7f8dd81575d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc0011e0 tx=0x7f8dcc00ca30 comp rx=0 tx=0).stop 2024-09-13T18:28:08.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.802+0000 7f8ddefd1700 1 -- 172.21.15.44:0/4092823843 shutdown_connections 2024-09-13T18:28:08.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.802+0000 7f8ddefd1700 1 --2- 172.21.15.44:0/4092823843 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8dbc066730 0x7f8dbc068bf0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.802+0000 7f8ddefd1700 1 --2- 172.21.15.44:0/4092823843 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8dd80b3ae0 0x7f8dd80a8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.802+0000 7f8ddefd1700 1 --2- 172.21.15.44:0/4092823843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8dd806bbf0 0x7f8dd813a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.802+0000 7f8ddefd1700 1 --2- 172.21.15.44:0/4092823843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dd806aaf0 0x7f8dd81575d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.802+0000 7f8ddefd1700 1 -- 172.21.15.44:0/4092823843 >> 172.21.15.44:0/4092823843 conn(0x7f8dd80b0f00 msgr2=0x7f8dd80b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:08.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.806+0000 7f8ddefd1700 1 -- 172.21.15.44:0/4092823843 shutdown_connections 2024-09-13T18:28:08.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.806+0000 7f8ddefd1700 1 -- 172.21.15.44:0/4092823843 wait complete. 2024-09-13T18:28:08.823 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:28:08.823 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:28:08.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.930+0000 7f3412bc5700 1 Processor -- start 2024-09-13T18:28:08.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.930+0000 7f3412bc5700 1 -- start start 2024-09-13T18:28:08.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.930+0000 7f3412bc5700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f340c165590 0x7f340c1619a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:08.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.930+0000 7f3412bc5700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f340c071f30 con 0x7f340c0b3ae0 2024-09-13T18:28:08.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.930+0000 7f3412bc5700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f340c1622e0 con 0x7f340c160eb0 2024-09-13T18:28:08.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.930+0000 7f3412bc5700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f340c162000 con 0x7f340c165590 2024-09-13T18:28:08.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.930+0000 7f34113c2700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f340c0b3ae0 0x7f340c161290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56960/0 (socket says 172.21.15.44:56960) 2024-09-13T18:28:08.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.930+0000 7f34113c2700 1 -- 172.21.15.44:0/3797217158 learned_addr learned my addr 172.21.15.44:0/3797217158 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:08.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.930+0000 7f34123c4700 1 --2- 172.21.15.44:0/3797217158 >> v2:172.21.15.99:3300/0 conn(0x7f340c165590 0x7f340c1619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:08.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.930+0000 7f3410bc1700 1 -- 172.21.15.44:0/3797217158 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1438272170 0 0) 0x7f340c071f30 con 0x7f340c0b3ae0 2024-09-13T18:28:08.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.930+0000 7f3410bc1700 1 -- 172.21.15.44:0/3797217158 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33f80035d0 con 0x7f340c0b3ae0 2024-09-13T18:28:08.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.930+0000 7f34123c4700 1 -- 172.21.15.44:0/3797217158 >> v1:172.21.15.99:6789/0 conn(0x7f340c160eb0 legacy=0x7f340c0b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.930+0000 7f34123c4700 1 -- 172.21.15.44:0/3797217158 >> v1:172.21.15.44:6789/0 conn(0x7f340c0b3ae0 legacy=0x7f340c161290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.930+0000 7f34123c4700 1 -- 172.21.15.44:0/3797217158 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340c164ab0 con 0x7f340c165590 2024-09-13T18:28:08.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.930+0000 7f34123c4700 1 --2- 172.21.15.44:0/3797217158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f340c165590 0x7f340c1619a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3404009850 tx=0x7f3404009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a8498fba49d9a1c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:08.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.930+0000 7f3410bc1700 1 -- 172.21.15.44:0/3797217158 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3404011830 con 0x7f340c165590 2024-09-13T18:28:08.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.930+0000 7f3410bc1700 1 -- 172.21.15.44:0/3797217158 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3404011990 con 0x7f340c165590 2024-09-13T18:28:08.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.930+0000 7f3410bc1700 1 -- 172.21.15.44:0/3797217158 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3404011d40 con 0x7f340c165590 2024-09-13T18:28:08.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.930+0000 7f3412bc5700 1 -- 172.21.15.44:0/3797217158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f340c165590 msgr2=0x7f340c1619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.930+0000 7f3412bc5700 1 --2- 172.21.15.44:0/3797217158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f340c165590 0x7f340c1619a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3404009850 tx=0x7f3404009b60 comp rx=0 tx=0).stop 2024-09-13T18:28:08.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.930+0000 7f3412bc5700 1 -- 172.21.15.44:0/3797217158 shutdown_connections 2024-09-13T18:28:08.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.930+0000 7f3412bc5700 1 --2- 172.21.15.44:0/3797217158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f340c165590 0x7f340c1619a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.930+0000 7f3412bc5700 1 -- 172.21.15.44:0/3797217158 >> 172.21.15.44:0/3797217158 conn(0x7f340c0b0f00 msgr2=0x7f340c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:08.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.934+0000 7f3412bc5700 1 -- 172.21.15.44:0/3797217158 shutdown_connections 2024-09-13T18:28:08.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.934+0000 7f3412bc5700 1 -- 172.21.15.44:0/3797217158 wait complete. 2024-09-13T18:28:08.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.934+0000 7f3412bc5700 1 Processor -- start 2024-09-13T18:28:08.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.934+0000 7f3412bc5700 1 -- start start 2024-09-13T18:28:08.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.934+0000 7f3412bc5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f340c0b3ae0 0x7f340c1f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:08.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.934+0000 7f3412bc5700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f340c160eb0 0x7f340c15a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:08.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.934+0000 7f3412bc5700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f340c165590 0x7f340c15dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:08.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.934+0000 7f3412bc5700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340c15e1c0 con 0x7f340c0b3ae0 2024-09-13T18:28:08.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.934+0000 7f3412bc5700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340c15e3d0 con 0x7f340c160eb0 2024-09-13T18:28:08.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.934+0000 7f3412bc5700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340c15e6b0 con 0x7f340c165590 2024-09-13T18:28:08.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.934+0000 7f3411bc3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f340c0b3ae0 0x7f340c1f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:08.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.934+0000 7f3411bc3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f340c0b3ae0 0x7f340c1f6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35158/0 (socket says 172.21.15.44:35158) 2024-09-13T18:28:08.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.934+0000 7f3411bc3700 1 -- 172.21.15.44:0/150873219 learned_addr learned my addr 172.21.15.44:0/150873219 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:08.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.934+0000 7f34113c2700 1 --2- 172.21.15.44:0/150873219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f340c160eb0 0x7f340c15a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:08.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.938+0000 7f34123c4700 1 --2- 172.21.15.44:0/150873219 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f340c165590 0x7f340c15dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:08.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.938+0000 7f3411bc3700 1 -- 172.21.15.44:0/150873219 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f340c165590 msgr2=0x7f340c15dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.938+0000 7f3411bc3700 1 --2- 172.21.15.44:0/150873219 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f340c165590 0x7f340c15dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.938+0000 7f3411bc3700 1 -- 172.21.15.44:0/150873219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f340c160eb0 msgr2=0x7f340c15a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.938+0000 7f3411bc3700 1 --2- 172.21.15.44:0/150873219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f340c160eb0 0x7f340c15a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.938+0000 7f3411bc3700 1 -- 172.21.15.44:0/150873219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34040094b0 con 0x7f340c0b3ae0 2024-09-13T18:28:08.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.938+0000 7f34123c4700 1 --2- 172.21.15.44:0/150873219 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f340c165590 0x7f340c15dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:08.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.938+0000 7f3411bc3700 1 --2- 172.21.15.44:0/150873219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f340c0b3ae0 0x7f340c1f6590 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3408001ed0 tx=0x7f34080021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:08.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.938+0000 7f34027fc700 1 -- 172.21.15.44:0/150873219 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408003c20 con 0x7f340c0b3ae0 2024-09-13T18:28:08.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.938+0000 7f34027fc700 1 -- 172.21.15.44:0/150873219 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3408003d80 con 0x7f340c0b3ae0 2024-09-13T18:28:08.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.938+0000 7f3412bc5700 1 -- 172.21.15.44:0/150873219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f340c15e990 con 0x7f340c0b3ae0 2024-09-13T18:28:08.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.938+0000 7f34027fc700 1 -- 172.21.15.44:0/150873219 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340800abf0 con 0x7f340c0b3ae0 2024-09-13T18:28:08.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.938+0000 7f3412bc5700 1 -- 172.21.15.44:0/150873219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f340c15ef50 con 0x7f340c0b3ae0 2024-09-13T18:28:08.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.938+0000 7f3412bc5700 1 -- 172.21.15.44:0/150873219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f340c15f170 con 0x7f340c0b3ae0 2024-09-13T18:28:08.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.938+0000 7f34027fc700 1 -- 172.21.15.44:0/150873219 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f340800ad50 con 0x7f340c0b3ae0 2024-09-13T18:28:08.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.942+0000 7f34027fc700 1 --2- 172.21.15.44:0/150873219 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f33f0066730 0x7f33f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:08.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.942+0000 7f34027fc700 1 -- 172.21.15.44:0/150873219 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3408084290 con 0x7f340c0b3ae0 2024-09-13T18:28:08.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.942+0000 7f34113c2700 1 --2- 172.21.15.44:0/150873219 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f33f0066730 0x7f33f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:08.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.942+0000 7f34113c2700 1 --2- 172.21.15.44:0/150873219 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f33f0066730 0x7f33f0068bf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f340c0cb1c0 tx=0x7f33fc007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:08.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:08.950+0000 7f34027fc700 1 -- 172.21.15.44:0/150873219 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3408051600 con 0x7f340c0b3ae0 2024-09-13T18:28:09.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.122+0000 7f3412bc5700 1 -- 172.21.15.44:0/150873219 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f340c165070 con 0x7f33f0066730 2024-09-13T18:28:09.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.134+0000 7f34027fc700 1 -- 172.21.15.44:0/150873219 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277084 (secure 0 0 0) 0x7f33fc006bf0 con 0x7f33f0066730 2024-09-13T18:28:09.145 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:09.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.138+0000 7f3412bc5700 1 -- 172.21.15.44:0/150873219 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f33f0066730 msgr2=0x7f33f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:09.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.138+0000 7f3412bc5700 1 --2- 172.21.15.44:0/150873219 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f33f0066730 0x7f33f0068bf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f340c0cb1c0 tx=0x7f33fc007de0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.138+0000 7f3412bc5700 1 -- 172.21.15.44:0/150873219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f340c0b3ae0 msgr2=0x7f340c1f6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:09.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.142+0000 7f3412bc5700 1 --2- 172.21.15.44:0/150873219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f340c0b3ae0 0x7f340c1f6590 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3408001ed0 tx=0x7f34080021e0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.142+0000 7f3412bc5700 1 -- 172.21.15.44:0/150873219 shutdown_connections 2024-09-13T18:28:09.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.142+0000 7f3412bc5700 1 --2- 172.21.15.44:0/150873219 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f33f0066730 0x7f33f0068bf0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.142+0000 7f3412bc5700 1 --2- 172.21.15.44:0/150873219 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f340c165590 0x7f340c15dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.142+0000 7f3412bc5700 1 --2- 172.21.15.44:0/150873219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f340c160eb0 0x7f340c15a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.142+0000 7f3412bc5700 1 --2- 172.21.15.44:0/150873219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f340c0b3ae0 0x7f340c1f6590 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.142+0000 7f3412bc5700 1 -- 172.21.15.44:0/150873219 >> 172.21.15.44:0/150873219 conn(0x7f340c0b0f00 msgr2=0x7f340c0cca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:09.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.142+0000 7f3412bc5700 1 -- 172.21.15.44:0/150873219 shutdown_connections 2024-09-13T18:28:09.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.142+0000 7f3412bc5700 1 -- 172.21.15.44:0/150873219 wait complete. 2024-09-13T18:28:09.149 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:28:09.160 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-13T18:28:08.340534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220124,"kb_used_data":3964,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754596,"statfs":{"total":773094113280,"available":772868706304,"internally_reserved":0,"allocated":4059136,"data_stored":2272775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.667416"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.684254+0000","last_change":"2024-09-13T18:28:03.684254+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.684254+0000","last_undegraded":"2024-09-13T18:28:03.684254+0000","last_fullsized":"2024-09-13T18:28:03.684254+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:32.822140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.925581+0000","last_change":"2024-09-13T18:28:03.925581+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.925581+0000","last_undegraded":"2024-09-13T18:28:03.925581+0000","last_fullsized":"2024-09-13T18:28:03.925581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:32.822140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.679016+0000","last_change":"2024-09-13T18:28:03.679016+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.679016+0000","last_undegraded":"2024-09-13T18:28:03.679016+0000","last_fullsized":"2024-09-13T18:28:03.679016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:42.130944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.679136+0000","last_change":"2024-09-13T18:28:03.679136+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.679136+0000","last_undegraded":"2024-09-13T18:28:03.679136+0000","last_fullsized":"2024-09-13T18:28:03.679136+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:33.121990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688941+0000","last_change":"2024-09-13T18:28:03.688941+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688941+0000","last_undegraded":"2024-09-13T18:28:03.688941+0000","last_fullsized":"2024-09-13T18:28:03.688941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:41:43.880877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688205+0000","last_change":"2024-09-13T18:28:03.688205+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688205+0000","last_undegraded":"2024-09-13T18:28:03.688205+0000","last_fullsized":"2024-09-13T18:28:03.688205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:17.011477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.680649+0000","last_change":"2024-09-13T18:28:03.680649+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.680649+0000","last_undegraded":"2024-09-13T18:28:03.680649+0000","last_fullsized":"2024-09-13T18:28:03.680649+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:12.871246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688084+0000","last_change":"2024-09-13T18:28:03.688084+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688084+0000","last_undegraded":"2024-09-13T18:28:03.688084+0000","last_fullsized":"2024-09-13T18:28:03.688084+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:37.246556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.682083+0000","last_change":"2024-09-13T18:28:03.682083+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.682083+0000","last_undegraded":"2024-09-13T18:28:03.682083+0000","last_fullsized":"2024-09-13T18:28:03.682083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:38.670033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.924440+0000","last_change":"2024-09-13T18:28:03.924440+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.924440+0000","last_undegraded":"2024-09-13T18:28:03.924440+0000","last_fullsized":"2024-09-13T18:28:03.924440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:25.827205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.677373+0000","last_change":"2024-09-13T18:28:03.677373+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.677373+0000","last_undegraded":"2024-09-13T18:28:03.677373+0000","last_fullsized":"2024-09-13T18:28:03.677373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:38.670033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.679941+0000","last_change":"2024-09-13T18:28:03.679941+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.679941+0000","last_undegraded":"2024-09-13T18:28:03.679941+0000","last_fullsized":"2024-09-13T18:28:03.679941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:26.748656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688334+0000","last_change":"2024-09-13T18:28:03.688334+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688334+0000","last_undegraded":"2024-09-13T18:28:03.688334+0000","last_fullsized":"2024-09-13T18:28:03.688334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:39.589241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.683650+0000","last_change":"2024-09-13T18:28:03.683650+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.683650+0000","last_undegraded":"2024-09-13T18:28:03.683650+0000","last_fullsized":"2024-09-13T18:28:03.683650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:06.426362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.679189+0000","last_change":"2024-09-13T18:28:03.679189+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.679189+0000","last_undegraded":"2024-09-13T18:28:03.679189+0000","last_fullsized":"2024-09-13T18:28:03.679189+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:08.566891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.680231+0000","last_change":"2024-09-13T18:28:03.680231+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.680231+0000","last_undegraded":"2024-09-13T18:28:03.680231+0000","last_fullsized":"2024-09-13T18:28:03.680231+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:32.822140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.684171+0000","last_change":"2024-09-13T18:28:03.684171+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.684171+0000","last_undegraded":"2024-09-13T18:28:03.684171+0000","last_fullsized":"2024-09-13T18:28:03.684171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:33.907905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688450+0000","last_change":"2024-09-13T18:28:03.688450+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688450+0000","last_undegraded":"2024-09-13T18:28:03.688450+0000","last_fullsized":"2024-09-13T18:28:03.688450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:47.115877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.689319+0000","last_change":"2024-09-13T18:28:03.689319+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.689319+0000","last_undegraded":"2024-09-13T18:28:03.689319+0000","last_fullsized":"2024-09-13T18:28:03.689319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:47.800960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688450+0000","last_change":"2024-09-13T18:28:03.688450+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688450+0000","last_undegraded":"2024-09-13T18:28:03.688450+0000","last_fullsized":"2024-09-13T18:28:03.688450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:55.211725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.924457+0000","last_change":"2024-09-13T18:28:03.924457+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.924457+0000","last_undegraded":"2024-09-13T18:28:03.924457+0000","last_fullsized":"2024-09-13T18:28:03.924457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:08.566891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.684257+0000","last_change":"2024-09-13T18:28:03.684257+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.684257+0000","last_undegraded":"2024-09-13T18:28:03.684257+0000","last_fullsized":"2024-09-13T18:28:03.684257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:08.566891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688963+0000","last_change":"2024-09-13T18:28:03.688963+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688963+0000","last_undegraded":"2024-09-13T18:28:03.688963+0000","last_fullsized":"2024-09-13T18:28:03.688963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:33.128414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.677462+0000","last_change":"2024-09-13T18:28:03.677462+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.677462+0000","last_undegraded":"2024-09-13T18:28:03.677462+0000","last_fullsized":"2024-09-13T18:28:03.677462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:35.414482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.682509+0000","last_change":"2024-09-13T18:28:03.682509+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.682509+0000","last_undegraded":"2024-09-13T18:28:03.682509+0000","last_fullsized":"2024-09-13T18:28:03.682509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:20.810230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.923564+0000","last_change":"2024-09-13T18:28:03.923564+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.923564+0000","last_undegraded":"2024-09-13T18:28:03.923564+0000","last_fullsized":"2024-09-13T18:28:03.923564+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:37.734096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.682613+0000","last_change":"2024-09-13T18:28:03.682613+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.682613+0000","last_undegraded":"2024-09-13T18:28:03.682613+0000","last_fullsized":"2024-09-13T18:28:03.682613+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:42.130944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.923472+0000","last_change":"2024-09-13T18:28:03.923472+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.923472+0000","last_undegraded":"2024-09-13T18:28:03.923472+0000","last_fullsized":"2024-09-13T18:28:03.923472+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:12.871246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.682269+0000","last_change":"2024-09-13T18:28:03.682269+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.682269+0000","last_undegraded":"2024-09-13T18:28:03.682269+0000","last_fullsized":"2024-09-13T18:28:03.682269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:38.670033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688251+0000","last_change":"2024-09-13T18:28:03.688251+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688251+0000","last_undegraded":"2024-09-13T18:28:03.688251+0000","last_fullsized":"2024-09-13T18:28:03.688251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:59.837694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.679121+0000","last_change":"2024-09-13T18:28:03.679121+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.679121+0000","last_undegraded":"2024-09-13T18:28:03.679121+0000","last_fullsized":"2024-09-13T18:28:03.679121+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:35.414482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.683916+0000","last_change":"2024-09-13T18:28:03.683916+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.683916+0000","last_undegraded":"2024-09-13T18:28:03.683916+0000","last_fullsized":"2024-09-13T18:28:03.683916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:26.748656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T18:27:59.837452+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:27:59.837452+0000","last_peered":"2024-09-13T18:27:59.837452+0000","last_clean":"2024-09-13T18:27:59.837452+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:27:59.837452+0000","last_undegraded":"2024-09-13T18:27:59.837452+0000","last_fullsized":"2024-09-13T18:27:59.837452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":727600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.86499999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.68999999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.83099999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.98699999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.66700000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.056}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":137232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.75800000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.875},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.85499999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.72199999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.83099999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.81399999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.96099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":131415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.625}]},{"osd":1,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.0209999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.77500000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.59899999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.98999999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.1040000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.077},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.048}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":137232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.871}]},{"osd":1,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.90800000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":1.087},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.0680000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.3889999999999998,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":1.022},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.048}]},{"osd":6,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.1100000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.996},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":1.141}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":137232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.64900000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.93000000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":1.052},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.79300000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":1}]},{"osd":6,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.1399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.82899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":137232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.78000000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.69199999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.95899999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.876},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.147}]},{"osd":5,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.111}]},{"osd":6,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.762,"5min":2.762,"15min":2.762},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.204}]},{"osd":7,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":1.081},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.26}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":137232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.89700000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.879},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.98899999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.80800000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.96499999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.0109999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.028},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.403}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":727600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.51300000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.59199999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.86399999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.71899999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.96299999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.0529999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.878}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:28:09.166 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:28:09.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.278+0000 7fb41dfba700 1 Processor -- start 2024-09-13T18:28:09.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.278+0000 7fb41dfba700 1 -- start start 2024-09-13T18:28:09.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.278+0000 7fb41dfba700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb41815cf30 0x7fb41806b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:09.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.278+0000 7fb41dfba700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4180b8750 con 0x7fb41806b590 2024-09-13T18:28:09.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.278+0000 7fb41dfba700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb41806ba00 con 0x7fb4180d1190 2024-09-13T18:28:09.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.278+0000 7fb41dfba700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4180d15e0 con 0x7fb41815cf30 2024-09-13T18:28:09.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.278+0000 7fb4177fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb41815cf30 0x7fb41806b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:09.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.278+0000 7fb40effd700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb41806b590 0x7fb4180d0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56964/0 (socket says 172.21.15.44:56964) 2024-09-13T18:28:09.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.278+0000 7fb40effd700 1 -- 172.21.15.44:0/368869352 learned_addr learned my addr 172.21.15.44:0/368869352 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:09.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.278+0000 7fb4177fe700 1 -- 172.21.15.44:0/368869352 >> v1:172.21.15.99:6789/0 conn(0x7fb4180d1190 legacy=0x7fb4180b64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:09.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.278+0000 7fb4177fe700 1 -- 172.21.15.44:0/368869352 >> v1:172.21.15.44:6789/0 conn(0x7fb41806b590 legacy=0x7fb4180d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:09.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.278+0000 7fb4177fe700 1 -- 172.21.15.44:0/368869352 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4180d2350 con 0x7fb41815cf30 2024-09-13T18:28:09.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.278+0000 7fb4177fe700 1 --2- 172.21.15.44:0/368869352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb41815cf30 0x7fb41806b050 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb408009850 tx=0x7fb408009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76938ba5471dd037 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:09.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.278+0000 7fb416ffd700 1 -- 172.21.15.44:0/368869352 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408004230 con 0x7fb41815cf30 2024-09-13T18:28:09.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.278+0000 7fb416ffd700 1 -- 172.21.15.44:0/368869352 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb408004390 con 0x7fb41815cf30 2024-09-13T18:28:09.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.278+0000 7fb416ffd700 1 -- 172.21.15.44:0/368869352 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4080036c0 con 0x7fb41815cf30 2024-09-13T18:28:09.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.278+0000 7fb41dfba700 1 -- 172.21.15.44:0/368869352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb41815cf30 msgr2=0x7fb41806b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:09.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.278+0000 7fb41dfba700 1 --2- 172.21.15.44:0/368869352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb41815cf30 0x7fb41806b050 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb408009850 tx=0x7fb408009b60 comp rx=0 tx=0).stop 2024-09-13T18:28:09.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.278+0000 7fb41dfba700 1 -- 172.21.15.44:0/368869352 shutdown_connections 2024-09-13T18:28:09.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.278+0000 7fb41dfba700 1 --2- 172.21.15.44:0/368869352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb41815cf30 0x7fb41806b050 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.278+0000 7fb41dfba700 1 -- 172.21.15.44:0/368869352 >> 172.21.15.44:0/368869352 conn(0x7fb4180d2e40 msgr2=0x7fb4180d3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:09.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.278+0000 7fb41dfba700 1 -- 172.21.15.44:0/368869352 shutdown_connections 2024-09-13T18:28:09.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.282+0000 7fb41dfba700 1 -- 172.21.15.44:0/368869352 wait complete. 2024-09-13T18:28:09.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.282+0000 7fb41dfba700 1 Processor -- start 2024-09-13T18:28:09.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.282+0000 7fb41dfba700 1 -- start start 2024-09-13T18:28:09.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.282+0000 7fb41dfba700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb41806b590 0x7fb41814dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:09.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.282+0000 7fb41dfba700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb4180d1190 0x7fb4180c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:09.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.282+0000 7fb41dfba700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb41815cf30 0x7fb41815d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:09.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.282+0000 7fb41dfba700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180cceb0 con 0x7fb41806b590 2024-09-13T18:28:09.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.282+0000 7fb41dfba700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180c92e0 con 0x7fb41815cf30 2024-09-13T18:28:09.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.282+0000 7fb41dfba700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180c8d20 con 0x7fb4180d1190 2024-09-13T18:28:09.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.282+0000 7fb4177fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb41806b590 0x7fb41814dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:09.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.282+0000 7fb4177fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb41806b590 0x7fb41814dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35172/0 (socket says 172.21.15.44:35172) 2024-09-13T18:28:09.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.282+0000 7fb4177fe700 1 -- 172.21.15.44:0/2120336490 learned_addr learned my addr 172.21.15.44:0/2120336490 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:09.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.282+0000 7fb40effd700 1 --2- 172.21.15.44:0/2120336490 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb4180d1190 0x7fb4180c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:09.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.282+0000 7fb417fff700 1 --2- 172.21.15.44:0/2120336490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb41815cf30 0x7fb41815d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:09.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.286+0000 7fb4177fe700 1 -- 172.21.15.44:0/2120336490 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb4180d1190 msgr2=0x7fb4180c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:09.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.286+0000 7fb4177fe700 1 --2- 172.21.15.44:0/2120336490 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb4180d1190 0x7fb4180c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.286+0000 7fb4177fe700 1 -- 172.21.15.44:0/2120336490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb41815cf30 msgr2=0x7fb41815d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:09.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.286+0000 7fb4177fe700 1 --2- 172.21.15.44:0/2120336490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb41815cf30 0x7fb41815d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.286+0000 7fb4177fe700 1 -- 172.21.15.44:0/2120336490 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4080094b0 con 0x7fb41806b590 2024-09-13T18:28:09.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.286+0000 7fb4177fe700 1 --2- 172.21.15.44:0/2120336490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb41806b590 0x7fb41814dc10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb4080090b0 tx=0x7fb408004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:09.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.286+0000 7fb414ff9700 1 -- 172.21.15.44:0/2120336490 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408011630 con 0x7fb41806b590 2024-09-13T18:28:09.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.286+0000 7fb41dfba700 1 -- 172.21.15.44:0/2120336490 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4180c9000 con 0x7fb41806b590 2024-09-13T18:28:09.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.286+0000 7fb414ff9700 1 -- 172.21.15.44:0/2120336490 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb408011790 con 0x7fb41806b590 2024-09-13T18:28:09.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.286+0000 7fb414ff9700 1 -- 172.21.15.44:0/2120336490 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408011b40 con 0x7fb41806b590 2024-09-13T18:28:09.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.286+0000 7fb41dfba700 1 -- 172.21.15.44:0/2120336490 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4180cac40 con 0x7fb41806b590 2024-09-13T18:28:09.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.286+0000 7fb41dfba700 1 -- 172.21.15.44:0/2120336490 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb41815d310 con 0x7fb41806b590 2024-09-13T18:28:09.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.290+0000 7fb414ff9700 1 -- 172.21.15.44:0/2120336490 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb408018050 con 0x7fb41806b590 2024-09-13T18:28:09.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.290+0000 7fb414ff9700 1 --2- 172.21.15.44:0/2120336490 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb3f8066730 0x7fb3f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:09.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.290+0000 7fb414ff9700 1 -- 172.21.15.44:0/2120336490 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb408084cb0 con 0x7fb41806b590 2024-09-13T18:28:09.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.290+0000 7fb40effd700 1 --2- 172.21.15.44:0/2120336490 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb3f8066730 0x7fb3f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:09.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.290+0000 7fb40effd700 1 --2- 172.21.15.44:0/2120336490 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb3f8066730 0x7fb3f8068bf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb41806a9d0 tx=0x7fb400004a70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:09.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.294+0000 7fb414ff9700 1 -- 172.21.15.44:0/2120336490 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb408052030 con 0x7fb41806b590 2024-09-13T18:28:09.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.466+0000 7fb41dfba700 1 -- 172.21.15.44:0/2120336490 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb4180d1d90 con 0x7fb3f8066730 2024-09-13T18:28:09.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.486+0000 7fb414ff9700 1 -- 172.21.15.44:0/2120336490 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277084 (secure 0 0 0) 0x7fb400001640 con 0x7fb3f8066730 2024-09-13T18:28:09.494 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:09.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.490+0000 7fb41dfba700 1 -- 172.21.15.44:0/2120336490 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb3f8066730 msgr2=0x7fb3f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:09.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.490+0000 7fb41dfba700 1 --2- 172.21.15.44:0/2120336490 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb3f8066730 0x7fb3f8068bf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb41806a9d0 tx=0x7fb400004a70 comp rx=0 tx=0).stop 2024-09-13T18:28:09.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.490+0000 7fb41dfba700 1 -- 172.21.15.44:0/2120336490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb41806b590 msgr2=0x7fb41814dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:09.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.490+0000 7fb41dfba700 1 --2- 172.21.15.44:0/2120336490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb41806b590 0x7fb41814dc10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb4080090b0 tx=0x7fb408004770 comp rx=0 tx=0).stop 2024-09-13T18:28:09.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.490+0000 7fb41dfba700 1 -- 172.21.15.44:0/2120336490 shutdown_connections 2024-09-13T18:28:09.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.490+0000 7fb41dfba700 1 --2- 172.21.15.44:0/2120336490 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb3f8066730 0x7fb3f8068bf0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.490+0000 7fb41dfba700 1 --2- 172.21.15.44:0/2120336490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb41815cf30 0x7fb41815d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.490+0000 7fb41dfba700 1 --2- 172.21.15.44:0/2120336490 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb4180d1190 0x7fb4180c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.490+0000 7fb41dfba700 1 --2- 172.21.15.44:0/2120336490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb41806b590 0x7fb41814dc10 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.490+0000 7fb41dfba700 1 -- 172.21.15.44:0/2120336490 >> 172.21.15.44:0/2120336490 conn(0x7fb4180d2e40 msgr2=0x7fb4180ce210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:09.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.490+0000 7fb41dfba700 1 -- 172.21.15.44:0/2120336490 shutdown_connections 2024-09-13T18:28:09.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.490+0000 7fb41dfba700 1 -- 172.21.15.44:0/2120336490 wait complete. 2024-09-13T18:28:09.498 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:28:09.510 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-13T18:28:08.340534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220124,"kb_used_data":3964,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754596,"statfs":{"total":773094113280,"available":772868706304,"internally_reserved":0,"allocated":4059136,"data_stored":2272775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.667416"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.684254+0000","last_change":"2024-09-13T18:28:03.684254+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.684254+0000","last_undegraded":"2024-09-13T18:28:03.684254+0000","last_fullsized":"2024-09-13T18:28:03.684254+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:32.822140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.925581+0000","last_change":"2024-09-13T18:28:03.925581+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.925581+0000","last_undegraded":"2024-09-13T18:28:03.925581+0000","last_fullsized":"2024-09-13T18:28:03.925581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:32.822140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.679016+0000","last_change":"2024-09-13T18:28:03.679016+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.679016+0000","last_undegraded":"2024-09-13T18:28:03.679016+0000","last_fullsized":"2024-09-13T18:28:03.679016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:42.130944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.679136+0000","last_change":"2024-09-13T18:28:03.679136+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.679136+0000","last_undegraded":"2024-09-13T18:28:03.679136+0000","last_fullsized":"2024-09-13T18:28:03.679136+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:33.121990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688941+0000","last_change":"2024-09-13T18:28:03.688941+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688941+0000","last_undegraded":"2024-09-13T18:28:03.688941+0000","last_fullsized":"2024-09-13T18:28:03.688941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:41:43.880877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688205+0000","last_change":"2024-09-13T18:28:03.688205+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688205+0000","last_undegraded":"2024-09-13T18:28:03.688205+0000","last_fullsized":"2024-09-13T18:28:03.688205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:17.011477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.680649+0000","last_change":"2024-09-13T18:28:03.680649+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.680649+0000","last_undegraded":"2024-09-13T18:28:03.680649+0000","last_fullsized":"2024-09-13T18:28:03.680649+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:12.871246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688084+0000","last_change":"2024-09-13T18:28:03.688084+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688084+0000","last_undegraded":"2024-09-13T18:28:03.688084+0000","last_fullsized":"2024-09-13T18:28:03.688084+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:37.246556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.682083+0000","last_change":"2024-09-13T18:28:03.682083+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.682083+0000","last_undegraded":"2024-09-13T18:28:03.682083+0000","last_fullsized":"2024-09-13T18:28:03.682083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:38.670033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.924440+0000","last_change":"2024-09-13T18:28:03.924440+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.924440+0000","last_undegraded":"2024-09-13T18:28:03.924440+0000","last_fullsized":"2024-09-13T18:28:03.924440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:25.827205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.677373+0000","last_change":"2024-09-13T18:28:03.677373+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.677373+0000","last_undegraded":"2024-09-13T18:28:03.677373+0000","last_fullsized":"2024-09-13T18:28:03.677373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:38.670033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.679941+0000","last_change":"2024-09-13T18:28:03.679941+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.679941+0000","last_undegraded":"2024-09-13T18:28:03.679941+0000","last_fullsized":"2024-09-13T18:28:03.679941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:26.748656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688334+0000","last_change":"2024-09-13T18:28:03.688334+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688334+0000","last_undegraded":"2024-09-13T18:28:03.688334+0000","last_fullsized":"2024-09-13T18:28:03.688334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:39.589241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.683650+0000","last_change":"2024-09-13T18:28:03.683650+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.683650+0000","last_undegraded":"2024-09-13T18:28:03.683650+0000","last_fullsized":"2024-09-13T18:28:03.683650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:06.426362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.679189+0000","last_change":"2024-09-13T18:28:03.679189+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.679189+0000","last_undegraded":"2024-09-13T18:28:03.679189+0000","last_fullsized":"2024-09-13T18:28:03.679189+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:08.566891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.680231+0000","last_change":"2024-09-13T18:28:03.680231+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.680231+0000","last_undegraded":"2024-09-13T18:28:03.680231+0000","last_fullsized":"2024-09-13T18:28:03.680231+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:32.822140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.684171+0000","last_change":"2024-09-13T18:28:03.684171+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.684171+0000","last_undegraded":"2024-09-13T18:28:03.684171+0000","last_fullsized":"2024-09-13T18:28:03.684171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:33.907905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688450+0000","last_change":"2024-09-13T18:28:03.688450+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688450+0000","last_undegraded":"2024-09-13T18:28:03.688450+0000","last_fullsized":"2024-09-13T18:28:03.688450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:47.115877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.689319+0000","last_change":"2024-09-13T18:28:03.689319+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.689319+0000","last_undegraded":"2024-09-13T18:28:03.689319+0000","last_fullsized":"2024-09-13T18:28:03.689319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:47.800960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688450+0000","last_change":"2024-09-13T18:28:03.688450+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688450+0000","last_undegraded":"2024-09-13T18:28:03.688450+0000","last_fullsized":"2024-09-13T18:28:03.688450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:55.211725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.924457+0000","last_change":"2024-09-13T18:28:03.924457+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.924457+0000","last_undegraded":"2024-09-13T18:28:03.924457+0000","last_fullsized":"2024-09-13T18:28:03.924457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:08.566891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.684257+0000","last_change":"2024-09-13T18:28:03.684257+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.684257+0000","last_undegraded":"2024-09-13T18:28:03.684257+0000","last_fullsized":"2024-09-13T18:28:03.684257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:08.566891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688963+0000","last_change":"2024-09-13T18:28:03.688963+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688963+0000","last_undegraded":"2024-09-13T18:28:03.688963+0000","last_fullsized":"2024-09-13T18:28:03.688963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:33.128414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.677462+0000","last_change":"2024-09-13T18:28:03.677462+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.677462+0000","last_undegraded":"2024-09-13T18:28:03.677462+0000","last_fullsized":"2024-09-13T18:28:03.677462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:35.414482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.682509+0000","last_change":"2024-09-13T18:28:03.682509+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.682509+0000","last_undegraded":"2024-09-13T18:28:03.682509+0000","last_fullsized":"2024-09-13T18:28:03.682509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:20.810230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.923564+0000","last_change":"2024-09-13T18:28:03.923564+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.923564+0000","last_undegraded":"2024-09-13T18:28:03.923564+0000","last_fullsized":"2024-09-13T18:28:03.923564+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:37.734096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.682613+0000","last_change":"2024-09-13T18:28:03.682613+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.682613+0000","last_undegraded":"2024-09-13T18:28:03.682613+0000","last_fullsized":"2024-09-13T18:28:03.682613+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:42.130944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.923472+0000","last_change":"2024-09-13T18:28:03.923472+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.923472+0000","last_undegraded":"2024-09-13T18:28:03.923472+0000","last_fullsized":"2024-09-13T18:28:03.923472+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:12.871246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.682269+0000","last_change":"2024-09-13T18:28:03.682269+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.682269+0000","last_undegraded":"2024-09-13T18:28:03.682269+0000","last_fullsized":"2024-09-13T18:28:03.682269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:38.670033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688251+0000","last_change":"2024-09-13T18:28:03.688251+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688251+0000","last_undegraded":"2024-09-13T18:28:03.688251+0000","last_fullsized":"2024-09-13T18:28:03.688251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:59.837694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.679121+0000","last_change":"2024-09-13T18:28:03.679121+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.679121+0000","last_undegraded":"2024-09-13T18:28:03.679121+0000","last_fullsized":"2024-09-13T18:28:03.679121+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:35.414482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.683916+0000","last_change":"2024-09-13T18:28:03.683916+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.683916+0000","last_undegraded":"2024-09-13T18:28:03.683916+0000","last_fullsized":"2024-09-13T18:28:03.683916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:26.748656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T18:27:59.837452+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:27:59.837452+0000","last_peered":"2024-09-13T18:27:59.837452+0000","last_clean":"2024-09-13T18:27:59.837452+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:27:59.837452+0000","last_undegraded":"2024-09-13T18:27:59.837452+0000","last_fullsized":"2024-09-13T18:27:59.837452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":727600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.86499999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.68999999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.83099999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.98699999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.66700000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.056}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":137232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.75800000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.875},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.85499999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.72199999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.83099999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.81399999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.96099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":131415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.625}]},{"osd":1,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.0209999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.77500000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.59899999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.98999999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.1040000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.077},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.048}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":137232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.871}]},{"osd":1,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.90800000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":1.087},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.0680000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.3889999999999998,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":1.022},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.048}]},{"osd":6,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.1100000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.996},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":1.141}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":137232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.64900000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.93000000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":1.052},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.79300000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":1}]},{"osd":6,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.1399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.82899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":137232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.78000000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.69199999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.95899999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.876},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.147}]},{"osd":5,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.111}]},{"osd":6,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.762,"5min":2.762,"15min":2.762},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.204}]},{"osd":7,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":1.081},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.26}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":137232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.89700000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.879},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.98899999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.80800000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.96499999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.0109999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.028},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.403}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":727600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.51300000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.59199999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.86399999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.71899999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.96299999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.0529999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.878}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:28:09.514 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:28:09.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.618+0000 7efe849f5700 1 Processor -- start 2024-09-13T18:28:09.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.618+0000 7efe849f5700 1 -- start start 2024-09-13T18:28:09.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.618+0000 7efe849f5700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe800c5bb0 0x7efe80071440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:09.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.618+0000 7efe849f5700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efe800c4aa0 0x7efe800c4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:09.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.618+0000 7efe849f5700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe80072010 con 0x7efe8015ad90 2024-09-13T18:28:09.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.618+0000 7efe849f5700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe800c40c0 con 0x7efe800c4aa0 2024-09-13T18:28:09.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.618+0000 7efe849f5700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe800c5470 con 0x7efe800c5bb0 2024-09-13T18:28:09.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.622+0000 7efe75d9b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe800c5bb0 0x7efe80071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:09.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.622+0000 7efe7ed9d700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efe800c4aa0 0x7efe800c4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:09.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.622+0000 7efe75d9b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe800c5bb0 0x7efe80071440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:33028/0 (socket says 172.21.15.44:33028) 2024-09-13T18:28:09.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.622+0000 7efe75d9b700 1 -- 172.21.15.44:0/3866911669 learned_addr learned my addr 172.21.15.44:0/3866911669 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:09.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.622+0000 7efe7ed9d700 1 -- 172.21.15.44:0/3866911669 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe800c5bb0 msgr2=0x7efe80071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:09.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.622+0000 7efe7ed9d700 1 --2- 172.21.15.44:0/3866911669 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe800c5bb0 0x7efe80071440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.622+0000 7efe7ed9d700 1 -- 172.21.15.44:0/3866911669 >> v1:172.21.15.99:6789/0 conn(0x7efe8015ad90 legacy=0x7efe800b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:09.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.622+0000 7efe7ed9d700 1 -- 172.21.15.44:0/3866911669 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe800711c0 con 0x7efe800c4aa0 2024-09-13T18:28:09.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.622+0000 7efe7ed9d700 1 --2- 172.21.15.44:0/3866911669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe800c4aa0 0x7efe800c4f30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efe78009d90 tx=0x7efe7800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84f978a098d953d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:09.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.622+0000 7efe7dd9b700 1 -- 172.21.15.44:0/3866911669 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7800e070 con 0x7efe800c4aa0 2024-09-13T18:28:09.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.622+0000 7efe7dd9b700 1 -- 172.21.15.44:0/3866911669 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7800bb20 con 0x7efe800c4aa0 2024-09-13T18:28:09.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.622+0000 7efe7dd9b700 1 -- 172.21.15.44:0/3866911669 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe78012430 con 0x7efe800c4aa0 2024-09-13T18:28:09.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.622+0000 7efe849f5700 1 -- 172.21.15.44:0/3866911669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe800c4aa0 msgr2=0x7efe800c4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:09.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.622+0000 7efe849f5700 1 --2- 172.21.15.44:0/3866911669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe800c4aa0 0x7efe800c4f30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efe78009d90 tx=0x7efe7800b330 comp rx=0 tx=0).stop 2024-09-13T18:28:09.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.622+0000 7efe849f5700 1 -- 172.21.15.44:0/3866911669 shutdown_connections 2024-09-13T18:28:09.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.622+0000 7efe849f5700 1 --2- 172.21.15.44:0/3866911669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe800c4aa0 0x7efe800c4f30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.622+0000 7efe849f5700 1 --2- 172.21.15.44:0/3866911669 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe800c5bb0 0x7efe80071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.622+0000 7efe849f5700 1 -- 172.21.15.44:0/3866911669 >> 172.21.15.44:0/3866911669 conn(0x7efe800cbca0 msgr2=0x7efe800cc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:09.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.622+0000 7efe849f5700 1 -- 172.21.15.44:0/3866911669 shutdown_connections 2024-09-13T18:28:09.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.622+0000 7efe849f5700 1 -- 172.21.15.44:0/3866911669 wait complete. 2024-09-13T18:28:09.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe849f5700 1 Processor -- start 2024-09-13T18:28:09.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe849f5700 1 -- start start 2024-09-13T18:28:09.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe849f5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe800c4aa0 0x7efe8014da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:09.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe849f5700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe800c5bb0 0x7efe8015d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:09.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe849f5700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe8015ad90 0x7efe8015de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:09.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe849f5700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8006be40 con 0x7efe800c4aa0 2024-09-13T18:28:09.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe849f5700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe800c7430 con 0x7efe8015ad90 2024-09-13T18:28:09.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe849f5700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8006b2c0 con 0x7efe800c5bb0 2024-09-13T18:28:09.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe7e59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe800c4aa0 0x7efe8014da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:09.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe7e59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe800c4aa0 0x7efe8014da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35184/0 (socket says 172.21.15.44:35184) 2024-09-13T18:28:09.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe7e59c700 1 -- 172.21.15.44:0/2765234626 learned_addr learned my addr 172.21.15.44:0/2765234626 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:09.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe7ed9d700 1 --2- 172.21.15.44:0/2765234626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe8015ad90 0x7efe8015de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:09.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe75d9b700 1 --2- 172.21.15.44:0/2765234626 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe800c5bb0 0x7efe8015d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:09.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe7e59c700 1 -- 172.21.15.44:0/2765234626 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe800c5bb0 msgr2=0x7efe8015d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:09.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe7e59c700 1 --2- 172.21.15.44:0/2765234626 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe800c5bb0 0x7efe8015d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe7e59c700 1 -- 172.21.15.44:0/2765234626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe8015ad90 msgr2=0x7efe8015de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:09.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe7e59c700 1 --2- 172.21.15.44:0/2765234626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe8015ad90 0x7efe8015de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe7e59c700 1 -- 172.21.15.44:0/2765234626 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe78009a70 con 0x7efe800c4aa0 2024-09-13T18:28:09.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe7ed9d700 1 --2- 172.21.15.44:0/2765234626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe8015ad90 0x7efe8015de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:09.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe7e59c700 1 --2- 172.21.15.44:0/2765234626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe800c4aa0 0x7efe8014da70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7efe7000c500 tx=0x7efe7000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:09.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe777fe700 1 -- 172.21.15.44:0/2765234626 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe700052d0 con 0x7efe800c4aa0 2024-09-13T18:28:09.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe849f5700 1 -- 172.21.15.44:0/2765234626 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe8006b5a0 con 0x7efe800c4aa0 2024-09-13T18:28:09.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe777fe700 1 -- 172.21.15.44:0/2765234626 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe70005430 con 0x7efe800c4aa0 2024-09-13T18:28:09.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe777fe700 1 -- 172.21.15.44:0/2765234626 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe700055a0 con 0x7efe800c4aa0 2024-09-13T18:28:09.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.626+0000 7efe849f5700 1 -- 172.21.15.44:0/2765234626 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe8006bb60 con 0x7efe800c4aa0 2024-09-13T18:28:09.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.630+0000 7efe849f5700 1 -- 172.21.15.44:0/2765234626 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe8015b170 con 0x7efe800c4aa0 2024-09-13T18:28:09.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.630+0000 7efe777fe700 1 -- 172.21.15.44:0/2765234626 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efe700038a0 con 0x7efe800c4aa0 2024-09-13T18:28:09.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.630+0000 7efe777fe700 1 --2- 172.21.15.44:0/2765234626 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe60066730 0x7efe60068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:09.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.630+0000 7efe777fe700 1 -- 172.21.15.44:0/2765234626 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe70083360 con 0x7efe800c4aa0 2024-09-13T18:28:09.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.630+0000 7efe75d9b700 1 --2- 172.21.15.44:0/2765234626 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe60066730 0x7efe60068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:09.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.630+0000 7efe75d9b700 1 --2- 172.21.15.44:0/2765234626 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe60066730 0x7efe60068bf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efe8014e740 tx=0x7efe68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:09.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.638+0000 7efe777fe700 1 -- 172.21.15.44:0/2765234626 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efe70050700 con 0x7efe800c4aa0 2024-09-13T18:28:09.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.802+0000 7efe849f5700 1 -- 172.21.15.44:0/2765234626 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe800c42a0 con 0x7efe60066730 2024-09-13T18:28:09.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.822+0000 7efe777fe700 1 -- 172.21.15.44:0/2765234626 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277084 (secure 0 0 0) 0x7efe680117b0 con 0x7efe60066730 2024-09-13T18:28:09.831 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:09.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.826+0000 7efe849f5700 1 -- 172.21.15.44:0/2765234626 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe60066730 msgr2=0x7efe60068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:09.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.826+0000 7efe849f5700 1 --2- 172.21.15.44:0/2765234626 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe60066730 0x7efe60068bf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efe8014e740 tx=0x7efe68008040 comp rx=0 tx=0).stop 2024-09-13T18:28:09.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.826+0000 7efe849f5700 1 -- 172.21.15.44:0/2765234626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe800c4aa0 msgr2=0x7efe8014da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:09.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.826+0000 7efe849f5700 1 --2- 172.21.15.44:0/2765234626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe800c4aa0 0x7efe8014da70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7efe7000c500 tx=0x7efe7000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.826+0000 7efe849f5700 1 -- 172.21.15.44:0/2765234626 shutdown_connections 2024-09-13T18:28:09.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.826+0000 7efe849f5700 1 --2- 172.21.15.44:0/2765234626 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe60066730 0x7efe60068bf0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.826+0000 7efe849f5700 1 --2- 172.21.15.44:0/2765234626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe8015ad90 0x7efe8015de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.826+0000 7efe849f5700 1 --2- 172.21.15.44:0/2765234626 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe800c5bb0 0x7efe8015d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.826+0000 7efe849f5700 1 --2- 172.21.15.44:0/2765234626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe800c4aa0 0x7efe8014da70 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.826+0000 7efe849f5700 1 -- 172.21.15.44:0/2765234626 >> 172.21.15.44:0/2765234626 conn(0x7efe800cbca0 msgr2=0x7efe800aed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:09.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.826+0000 7efe849f5700 1 -- 172.21.15.44:0/2765234626 shutdown_connections 2024-09-13T18:28:09.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.826+0000 7efe849f5700 1 -- 172.21.15.44:0/2765234626 wait complete. 2024-09-13T18:28:09.834 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:28:09.849 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-13T18:28:08.340534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220124,"kb_used_data":3964,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754596,"statfs":{"total":773094113280,"available":772868706304,"internally_reserved":0,"allocated":4059136,"data_stored":2272775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.667416"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.684254+0000","last_change":"2024-09-13T18:28:03.684254+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.684254+0000","last_undegraded":"2024-09-13T18:28:03.684254+0000","last_fullsized":"2024-09-13T18:28:03.684254+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:32.822140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.925581+0000","last_change":"2024-09-13T18:28:03.925581+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.925581+0000","last_undegraded":"2024-09-13T18:28:03.925581+0000","last_fullsized":"2024-09-13T18:28:03.925581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:32.822140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.679016+0000","last_change":"2024-09-13T18:28:03.679016+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.679016+0000","last_undegraded":"2024-09-13T18:28:03.679016+0000","last_fullsized":"2024-09-13T18:28:03.679016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:42.130944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.679136+0000","last_change":"2024-09-13T18:28:03.679136+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.679136+0000","last_undegraded":"2024-09-13T18:28:03.679136+0000","last_fullsized":"2024-09-13T18:28:03.679136+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:33.121990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688941+0000","last_change":"2024-09-13T18:28:03.688941+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688941+0000","last_undegraded":"2024-09-13T18:28:03.688941+0000","last_fullsized":"2024-09-13T18:28:03.688941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:41:43.880877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688205+0000","last_change":"2024-09-13T18:28:03.688205+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688205+0000","last_undegraded":"2024-09-13T18:28:03.688205+0000","last_fullsized":"2024-09-13T18:28:03.688205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:17.011477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.680649+0000","last_change":"2024-09-13T18:28:03.680649+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.680649+0000","last_undegraded":"2024-09-13T18:28:03.680649+0000","last_fullsized":"2024-09-13T18:28:03.680649+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:12.871246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688084+0000","last_change":"2024-09-13T18:28:03.688084+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688084+0000","last_undegraded":"2024-09-13T18:28:03.688084+0000","last_fullsized":"2024-09-13T18:28:03.688084+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:37.246556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.682083+0000","last_change":"2024-09-13T18:28:03.682083+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.682083+0000","last_undegraded":"2024-09-13T18:28:03.682083+0000","last_fullsized":"2024-09-13T18:28:03.682083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:38.670033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.924440+0000","last_change":"2024-09-13T18:28:03.924440+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.924440+0000","last_undegraded":"2024-09-13T18:28:03.924440+0000","last_fullsized":"2024-09-13T18:28:03.924440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:25.827205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.677373+0000","last_change":"2024-09-13T18:28:03.677373+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.677373+0000","last_undegraded":"2024-09-13T18:28:03.677373+0000","last_fullsized":"2024-09-13T18:28:03.677373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:38.670033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.679941+0000","last_change":"2024-09-13T18:28:03.679941+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.679941+0000","last_undegraded":"2024-09-13T18:28:03.679941+0000","last_fullsized":"2024-09-13T18:28:03.679941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:26.748656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688334+0000","last_change":"2024-09-13T18:28:03.688334+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688334+0000","last_undegraded":"2024-09-13T18:28:03.688334+0000","last_fullsized":"2024-09-13T18:28:03.688334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:39.589241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.683650+0000","last_change":"2024-09-13T18:28:03.683650+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.683650+0000","last_undegraded":"2024-09-13T18:28:03.683650+0000","last_fullsized":"2024-09-13T18:28:03.683650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:06.426362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.679189+0000","last_change":"2024-09-13T18:28:03.679189+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.679189+0000","last_undegraded":"2024-09-13T18:28:03.679189+0000","last_fullsized":"2024-09-13T18:28:03.679189+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:08.566891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.680231+0000","last_change":"2024-09-13T18:28:03.680231+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.680231+0000","last_undegraded":"2024-09-13T18:28:03.680231+0000","last_fullsized":"2024-09-13T18:28:03.680231+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:32.822140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.684171+0000","last_change":"2024-09-13T18:28:03.684171+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.684171+0000","last_undegraded":"2024-09-13T18:28:03.684171+0000","last_fullsized":"2024-09-13T18:28:03.684171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:33.907905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688450+0000","last_change":"2024-09-13T18:28:03.688450+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688450+0000","last_undegraded":"2024-09-13T18:28:03.688450+0000","last_fullsized":"2024-09-13T18:28:03.688450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:47.115877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.689319+0000","last_change":"2024-09-13T18:28:03.689319+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.689319+0000","last_undegraded":"2024-09-13T18:28:03.689319+0000","last_fullsized":"2024-09-13T18:28:03.689319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:47.800960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688450+0000","last_change":"2024-09-13T18:28:03.688450+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688450+0000","last_undegraded":"2024-09-13T18:28:03.688450+0000","last_fullsized":"2024-09-13T18:28:03.688450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:55.211725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.924457+0000","last_change":"2024-09-13T18:28:03.924457+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.924457+0000","last_undegraded":"2024-09-13T18:28:03.924457+0000","last_fullsized":"2024-09-13T18:28:03.924457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:08.566891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.684257+0000","last_change":"2024-09-13T18:28:03.684257+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.684257+0000","last_undegraded":"2024-09-13T18:28:03.684257+0000","last_fullsized":"2024-09-13T18:28:03.684257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:08.566891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688963+0000","last_change":"2024-09-13T18:28:03.688963+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688963+0000","last_undegraded":"2024-09-13T18:28:03.688963+0000","last_fullsized":"2024-09-13T18:28:03.688963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:33.128414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.677462+0000","last_change":"2024-09-13T18:28:03.677462+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.677462+0000","last_undegraded":"2024-09-13T18:28:03.677462+0000","last_fullsized":"2024-09-13T18:28:03.677462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:35.414482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.682509+0000","last_change":"2024-09-13T18:28:03.682509+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.682509+0000","last_undegraded":"2024-09-13T18:28:03.682509+0000","last_fullsized":"2024-09-13T18:28:03.682509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:20.810230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.923564+0000","last_change":"2024-09-13T18:28:03.923564+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.923564+0000","last_undegraded":"2024-09-13T18:28:03.923564+0000","last_fullsized":"2024-09-13T18:28:03.923564+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:37.734096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.682613+0000","last_change":"2024-09-13T18:28:03.682613+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.682613+0000","last_undegraded":"2024-09-13T18:28:03.682613+0000","last_fullsized":"2024-09-13T18:28:03.682613+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:42.130944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.923472+0000","last_change":"2024-09-13T18:28:03.923472+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.923472+0000","last_undegraded":"2024-09-13T18:28:03.923472+0000","last_fullsized":"2024-09-13T18:28:03.923472+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:12.871246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.682269+0000","last_change":"2024-09-13T18:28:03.682269+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.682269+0000","last_undegraded":"2024-09-13T18:28:03.682269+0000","last_fullsized":"2024-09-13T18:28:03.682269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:38.670033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.688251+0000","last_change":"2024-09-13T18:28:03.688251+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.688251+0000","last_undegraded":"2024-09-13T18:28:03.688251+0000","last_fullsized":"2024-09-13T18:28:03.688251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:59.837694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.679121+0000","last_change":"2024-09-13T18:28:03.679121+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.679121+0000","last_undegraded":"2024-09-13T18:28:03.679121+0000","last_fullsized":"2024-09-13T18:28:03.679121+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:35.414482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:04.671598+0000","last_change":"2024-09-13T18:28:04.671598+0000","last_active":"2024-09-13T18:28:04.671598+0000","last_peered":"2024-09-13T18:28:04.671598+0000","last_clean":"2024-09-13T18:28:04.671598+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:04.671598+0000","last_undegraded":"2024-09-13T18:28:04.671598+0000","last_fullsized":"2024-09-13T18:28:04.671598+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-13T18:28:03.683916+0000","last_change":"2024-09-13T18:28:03.683916+0000","last_active":"2024-09-13T18:28:03.659537+0000","last_peered":"2024-09-13T18:28:03.659537+0000","last_clean":"2024-09-13T18:28:03.659537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:03.683916+0000","last_undegraded":"2024-09-13T18:28:03.683916+0000","last_fullsized":"2024-09-13T18:28:03.683916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:26.748656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T18:27:59.837452+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:27:59.837452+0000","last_peered":"2024-09-13T18:27:59.837452+0000","last_clean":"2024-09-13T18:27:59.837452+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:27:59.837452+0000","last_undegraded":"2024-09-13T18:27:59.837452+0000","last_fullsized":"2024-09-13T18:27:59.837452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":727600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.86499999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.68999999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.83099999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.98699999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.66700000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.056}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":137232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.75800000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.875},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.85499999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.72199999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.83099999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.81399999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.96099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":131415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.625}]},{"osd":1,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.0209999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.77500000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.59899999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.98999999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.1040000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.077},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.048}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":137232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.871}]},{"osd":1,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.90800000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":1.087},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.0680000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.3889999999999998,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":1.022},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.048}]},{"osd":6,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.1100000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.996},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":1.141}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":137232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.64900000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.93000000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":1.052},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.79300000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":1}]},{"osd":6,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.1399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.82899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":137232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.78000000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.69199999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.95899999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.876},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.147}]},{"osd":5,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.111}]},{"osd":6,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.762,"5min":2.762,"15min":2.762},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.204}]},{"osd":7,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":1.081},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.26}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":137232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.89700000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.879},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.98899999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.80800000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.96499999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.0109999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.028},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.403}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":727600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.51300000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.59199999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.86399999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.71899999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.96299999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.0529999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.878}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:28:09.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-09-13T18:28:09.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-09-13T18:28:09.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-09-13T18:28:09.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-09-13T18:28:09.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-09-13T18:28:09.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-09-13T18:28:09.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-09-13T18:28:09.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-09-13T18:28:09.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-09-13T18:28:09.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-09-13T18:28:09.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-09-13T18:28:09.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-09-13T18:28:09.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-09-13T18:28:09.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-09-13T18:28:09.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-09-13T18:28:09.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-09-13T18:28:09.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-09-13T18:28:09.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-09-13T18:28:09.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-09-13T18:28:09.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-09-13T18:28:09.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-09-13T18:28:09.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-09-13T18:28:09.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-09-13T18:28:09.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-09-13T18:28:09.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-09-13T18:28:09.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-09-13T18:28:09.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-09-13T18:28:09.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-09-13T18:28:09.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-09-13T18:28:09.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-09-13T18:28:09.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-09-13T18:28:09.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-09-13T18:28:09.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-09-13T18:28:09.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-09-13T18:28:09.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.684254+0000', 'last_change': '2024-09-13T18:28:03.684254+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.684254+0000', 'last_undegraded': '2024-09-13T18:28:03.684254+0000', 'last_fullsized': '2024-09-13T18:28:03.684254+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:01:32.822140+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:28:09.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-09-13T18:28:09.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-09-13T18:28:09.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.925581+0000', 'last_change': '2024-09-13T18:28:03.925581+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.925581+0000', 'last_undegraded': '2024-09-13T18:28:03.925581+0000', 'last_fullsized': '2024-09-13T18:28:03.925581+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:01:32.822140+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:28:09.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-09-13T18:28:09.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-09-13T18:28:09.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.679016+0000', 'last_change': '2024-09-13T18:28:03.679016+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.679016+0000', 'last_undegraded': '2024-09-13T18:28:03.679016+0000', 'last_fullsized': '2024-09-13T18:28:03.679016+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:02:42.130944+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:28:09.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-09-13T18:28:09.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-09-13T18:28:09.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.679136+0000', 'last_change': '2024-09-13T18:28:03.679136+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.679136+0000', 'last_undegraded': '2024-09-13T18:28:03.679136+0000', 'last_fullsized': '2024-09-13T18:28:03.679136+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:20:33.121990+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:28:09.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-09-13T18:28:09.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-09-13T18:28:09.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.688941+0000', 'last_change': '2024-09-13T18:28:03.688941+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.688941+0000', 'last_undegraded': '2024-09-13T18:28:03.688941+0000', 'last_fullsized': '2024-09-13T18:28:03.688941+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:41:43.880877+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:28:09.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-09-13T18:28:09.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-09-13T18:28:09.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.688205+0000', 'last_change': '2024-09-13T18:28:03.688205+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.688205+0000', 'last_undegraded': '2024-09-13T18:28:03.688205+0000', 'last_fullsized': '2024-09-13T18:28:03.688205+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:49:17.011477+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:28:09.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-09-13T18:28:09.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-09-13T18:28:09.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.680649+0000', 'last_change': '2024-09-13T18:28:03.680649+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.680649+0000', 'last_undegraded': '2024-09-13T18:28:03.680649+0000', 'last_fullsized': '2024-09-13T18:28:03.680649+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:27:12.871246+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:28:09.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-09-13T18:28:09.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-09-13T18:28:09.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.688084+0000', 'last_change': '2024-09-13T18:28:03.688084+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.688084+0000', 'last_undegraded': '2024-09-13T18:28:03.688084+0000', 'last_fullsized': '2024-09-13T18:28:03.688084+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:09:37.246556+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:28:09.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-09-13T18:28:09.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-09-13T18:28:09.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.682083+0000', 'last_change': '2024-09-13T18:28:03.682083+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.682083+0000', 'last_undegraded': '2024-09-13T18:28:03.682083+0000', 'last_fullsized': '2024-09-13T18:28:03.682083+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:33:38.670033+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:28:09.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-09-13T18:28:09.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-09-13T18:28:09.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.924440+0000', 'last_change': '2024-09-13T18:28:03.924440+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.924440+0000', 'last_undegraded': '2024-09-13T18:28:03.924440+0000', 'last_fullsized': '2024-09-13T18:28:03.924440+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:38:25.827205+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:28:09.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-09-13T18:28:09.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-09-13T18:28:09.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.677373+0000', 'last_change': '2024-09-13T18:28:03.677373+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.677373+0000', 'last_undegraded': '2024-09-13T18:28:03.677373+0000', 'last_fullsized': '2024-09-13T18:28:03.677373+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:33:38.670033+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:28:09.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-09-13T18:28:09.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-09-13T18:28:09.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.679941+0000', 'last_change': '2024-09-13T18:28:03.679941+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.679941+0000', 'last_undegraded': '2024-09-13T18:28:03.679941+0000', 'last_fullsized': '2024-09-13T18:28:03.679941+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:40:26.748656+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:28:09.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-09-13T18:28:09.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-09-13T18:28:09.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.688334+0000', 'last_change': '2024-09-13T18:28:03.688334+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.688334+0000', 'last_undegraded': '2024-09-13T18:28:03.688334+0000', 'last_fullsized': '2024-09-13T18:28:03.688334+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:11:39.589241+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:28:09.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-09-13T18:28:09.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-09-13T18:28:09.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.683650+0000', 'last_change': '2024-09-13T18:28:03.683650+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.683650+0000', 'last_undegraded': '2024-09-13T18:28:03.683650+0000', 'last_fullsized': '2024-09-13T18:28:03.683650+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:00:06.426362+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:28:09.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-09-13T18:28:09.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-09-13T18:28:09.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.679189+0000', 'last_change': '2024-09-13T18:28:03.679189+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.679189+0000', 'last_undegraded': '2024-09-13T18:28:03.679189+0000', 'last_fullsized': '2024-09-13T18:28:03.679189+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:21:08.566891+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:28:09.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-09-13T18:28:09.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-09-13T18:28:09.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.680231+0000', 'last_change': '2024-09-13T18:28:03.680231+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.680231+0000', 'last_undegraded': '2024-09-13T18:28:03.680231+0000', 'last_fullsized': '2024-09-13T18:28:03.680231+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:01:32.822140+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:28:09.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-09-13T18:28:09.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-09-13T18:28:09.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.684171+0000', 'last_change': '2024-09-13T18:28:03.684171+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.684171+0000', 'last_undegraded': '2024-09-13T18:28:03.684171+0000', 'last_fullsized': '2024-09-13T18:28:03.684171+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:34:33.907905+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:28:09.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-09-13T18:28:09.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-09-13T18:28:09.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.688450+0000', 'last_change': '2024-09-13T18:28:03.688450+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.688450+0000', 'last_undegraded': '2024-09-13T18:28:03.688450+0000', 'last_fullsized': '2024-09-13T18:28:03.688450+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:57:47.115877+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:28:09.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-09-13T18:28:09.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-09-13T18:28:09.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.689319+0000', 'last_change': '2024-09-13T18:28:03.689319+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.689319+0000', 'last_undegraded': '2024-09-13T18:28:03.689319+0000', 'last_fullsized': '2024-09-13T18:28:03.689319+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:16:47.800960+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:28:09.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-09-13T18:28:09.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-09-13T18:28:09.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.688450+0000', 'last_change': '2024-09-13T18:28:03.688450+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.688450+0000', 'last_undegraded': '2024-09-13T18:28:03.688450+0000', 'last_fullsized': '2024-09-13T18:28:03.688450+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:23:55.211725+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:28:09.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-09-13T18:28:09.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-09-13T18:28:09.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.924457+0000', 'last_change': '2024-09-13T18:28:03.924457+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.924457+0000', 'last_undegraded': '2024-09-13T18:28:03.924457+0000', 'last_fullsized': '2024-09-13T18:28:03.924457+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:21:08.566891+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:28:09.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-09-13T18:28:09.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-09-13T18:28:09.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.684257+0000', 'last_change': '2024-09-13T18:28:03.684257+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.684257+0000', 'last_undegraded': '2024-09-13T18:28:03.684257+0000', 'last_fullsized': '2024-09-13T18:28:03.684257+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:21:08.566891+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:28:09.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-09-13T18:28:09.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-09-13T18:28:09.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.688963+0000', 'last_change': '2024-09-13T18:28:03.688963+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.688963+0000', 'last_undegraded': '2024-09-13T18:28:03.688963+0000', 'last_fullsized': '2024-09-13T18:28:03.688963+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:03:33.128414+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:28:09.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-09-13T18:28:09.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-09-13T18:28:09.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.677462+0000', 'last_change': '2024-09-13T18:28:03.677462+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.677462+0000', 'last_undegraded': '2024-09-13T18:28:03.677462+0000', 'last_fullsized': '2024-09-13T18:28:03.677462+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:57:35.414482+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:28:09.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-09-13T18:28:09.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-09-13T18:28:09.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.682509+0000', 'last_change': '2024-09-13T18:28:03.682509+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.682509+0000', 'last_undegraded': '2024-09-13T18:28:03.682509+0000', 'last_fullsized': '2024-09-13T18:28:03.682509+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:40:20.810230+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:28:09.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-09-13T18:28:09.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-09-13T18:28:09.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.923564+0000', 'last_change': '2024-09-13T18:28:03.923564+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.923564+0000', 'last_undegraded': '2024-09-13T18:28:03.923564+0000', 'last_fullsized': '2024-09-13T18:28:03.923564+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T06:08:37.734096+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:28:09.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-09-13T18:28:09.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-09-13T18:28:09.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.682613+0000', 'last_change': '2024-09-13T18:28:03.682613+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.682613+0000', 'last_undegraded': '2024-09-13T18:28:03.682613+0000', 'last_fullsized': '2024-09-13T18:28:03.682613+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:02:42.130944+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:28:09.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-09-13T18:28:09.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-09-13T18:28:09.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.923472+0000', 'last_change': '2024-09-13T18:28:03.923472+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.923472+0000', 'last_undegraded': '2024-09-13T18:28:03.923472+0000', 'last_fullsized': '2024-09-13T18:28:03.923472+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:27:12.871246+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:28:09.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-09-13T18:28:09.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-09-13T18:28:09.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.682269+0000', 'last_change': '2024-09-13T18:28:03.682269+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.682269+0000', 'last_undegraded': '2024-09-13T18:28:03.682269+0000', 'last_fullsized': '2024-09-13T18:28:03.682269+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:33:38.670033+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:28:09.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-09-13T18:28:09.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-09-13T18:28:09.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.688251+0000', 'last_change': '2024-09-13T18:28:03.688251+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.688251+0000', 'last_undegraded': '2024-09-13T18:28:03.688251+0000', 'last_fullsized': '2024-09-13T18:28:03.688251+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:31:59.837694+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:28:09.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-09-13T18:28:09.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-09-13T18:28:09.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.679121+0000', 'last_change': '2024-09-13T18:28:03.679121+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.679121+0000', 'last_undegraded': '2024-09-13T18:28:03.679121+0000', 'last_fullsized': '2024-09-13T18:28:03.679121+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:57:35.414482+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:28:09.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-09-13T18:28:09.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:04.671598+0000', 'last_change': '2024-09-13T18:28:04.671598+0000', 'last_active': '2024-09-13T18:28:04.671598+0000', 'last_peered': '2024-09-13T18:28:04.671598+0000', 'last_clean': '2024-09-13T18:28:04.671598+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:04.671598+0000', 'last_undegraded': '2024-09-13T18:28:04.671598+0000', 'last_fullsized': '2024-09-13T18:28:04.671598+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:04.671598+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:09.872 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-09-13T18:28:09.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:03.683916+0000', 'last_change': '2024-09-13T18:28:03.683916+0000', 'last_active': '2024-09-13T18:28:03.659537+0000', 'last_peered': '2024-09-13T18:28:03.659537+0000', 'last_clean': '2024-09-13T18:28:03.659537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:03.683916+0000', 'last_undegraded': '2024-09-13T18:28:03.683916+0000', 'last_fullsized': '2024-09-13T18:28:03.683916+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:03.659537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:40:26.748656+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:28:09.872 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:28:09.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.986+0000 7fc38c92c700 1 Processor -- start 2024-09-13T18:28:09.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.986+0000 7fc38c92c700 1 -- start start 2024-09-13T18:28:09.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.986+0000 7fc38c92c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc3880cede0 0x7fc38806a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:09.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.986+0000 7fc38c92c700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3880d0a60 con 0x7fc388160f30 2024-09-13T18:28:09.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.986+0000 7fc38c92c700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3880cde10 con 0x7fc38806aa60 2024-09-13T18:28:09.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.986+0000 7fc38c92c700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc38806aef0 con 0x7fc3880cede0 2024-09-13T18:28:09.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.986+0000 7fc38659c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc3880cede0 0x7fc38806a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:09.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.986+0000 7fc386d9d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc388160f30 0x7fc38806c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56980/0 (socket says 172.21.15.44:56980) 2024-09-13T18:28:09.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.986+0000 7fc386d9d700 1 -- 172.21.15.44:0/1729968436 learned_addr learned my addr 172.21.15.44:0/1729968436 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:09.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.986+0000 7fc38659c700 1 -- 172.21.15.44:0/1729968436 >> v1:172.21.15.99:6789/0 conn(0x7fc38806aa60 legacy=0x7fc3880d0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:09.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.986+0000 7fc38659c700 1 -- 172.21.15.44:0/1729968436 >> v1:172.21.15.44:6789/0 conn(0x7fc388160f30 legacy=0x7fc38806c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:09.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.986+0000 7fc385d9b700 1 -- 172.21.15.44:0/1729968436 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292120752 0 0) 0x7fc3880d0a60 con 0x7fc388160f30 2024-09-13T18:28:09.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.986+0000 7fc38659c700 1 -- 172.21.15.44:0/1729968436 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3880ce0f0 con 0x7fc3880cede0 2024-09-13T18:28:09.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.986+0000 7fc38659c700 1 --2- 172.21.15.44:0/1729968436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3880cede0 0x7fc38806a520 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc370009850 tx=0x7fc370009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26ce8988e84adea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:09.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.990+0000 7fc385d9b700 1 -- 172.21.15.44:0/1729968436 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc370004230 con 0x7fc3880cede0 2024-09-13T18:28:09.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.990+0000 7fc385d9b700 1 -- 172.21.15.44:0/1729968436 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc370004390 con 0x7fc3880cede0 2024-09-13T18:28:09.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.990+0000 7fc385d9b700 1 -- 172.21.15.44:0/1729968436 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3700036c0 con 0x7fc3880cede0 2024-09-13T18:28:09.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.990+0000 7fc38c92c700 1 -- 172.21.15.44:0/1729968436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3880cede0 msgr2=0x7fc38806a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:09.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.990+0000 7fc38c92c700 1 --2- 172.21.15.44:0/1729968436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3880cede0 0x7fc38806a520 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc370009850 tx=0x7fc370009b60 comp rx=0 tx=0).stop 2024-09-13T18:28:09.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.990+0000 7fc38c92c700 1 -- 172.21.15.44:0/1729968436 shutdown_connections 2024-09-13T18:28:09.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.990+0000 7fc38c92c700 1 --2- 172.21.15.44:0/1729968436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3880cede0 0x7fc38806a520 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:09.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.990+0000 7fc38c92c700 1 -- 172.21.15.44:0/1729968436 >> 172.21.15.44:0/1729968436 conn(0x7fc3880d2c80 msgr2=0x7fc3880d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:09.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.990+0000 7fc38c92c700 1 -- 172.21.15.44:0/1729968436 shutdown_connections 2024-09-13T18:28:09.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.990+0000 7fc38c92c700 1 -- 172.21.15.44:0/1729968436 wait complete. 2024-09-13T18:28:09.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.994+0000 7fc38c92c700 1 Processor -- start 2024-09-13T18:28:09.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.994+0000 7fc38c92c700 1 -- start start 2024-09-13T18:28:10.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.994+0000 7fc38c92c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc38806aa60 0x7fc388070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:10.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.994+0000 7fc38c92c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc3880cede0 0x7fc38815feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:10.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.994+0000 7fc38c92c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc388160f30 0x7fc3880b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:10.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.994+0000 7fc38c92c700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc388071230 con 0x7fc38806aa60 2024-09-13T18:28:10.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.994+0000 7fc38c92c700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc388070c80 con 0x7fc388160f30 2024-09-13T18:28:10.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.994+0000 7fc38c92c700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc388070f50 con 0x7fc3880cede0 2024-09-13T18:28:10.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.994+0000 7fc386d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc38806aa60 0x7fc388070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:10.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.994+0000 7fc386d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc38806aa60 0x7fc388070740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35208/0 (socket says 172.21.15.44:35208) 2024-09-13T18:28:10.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.994+0000 7fc386d9d700 1 -- 172.21.15.44:0/2061170000 learned_addr learned my addr 172.21.15.44:0/2061170000 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:10.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.994+0000 7fc38659c700 1 --2- 172.21.15.44:0/2061170000 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc3880cede0 0x7fc38815feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:10.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.994+0000 7fc38759e700 1 --2- 172.21.15.44:0/2061170000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc388160f30 0x7fc3880b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:10.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.994+0000 7fc386d9d700 1 -- 172.21.15.44:0/2061170000 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc3880cede0 msgr2=0x7fc38815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:10.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.994+0000 7fc386d9d700 1 --2- 172.21.15.44:0/2061170000 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc3880cede0 0x7fc38815feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:10.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.994+0000 7fc386d9d700 1 -- 172.21.15.44:0/2061170000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc388160f30 msgr2=0x7fc3880b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:10.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.994+0000 7fc386d9d700 1 --2- 172.21.15.44:0/2061170000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc388160f30 0x7fc3880b5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:10.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.994+0000 7fc386d9d700 1 -- 172.21.15.44:0/2061170000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3700094b0 con 0x7fc38806aa60 2024-09-13T18:28:10.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.998+0000 7fc386d9d700 1 --2- 172.21.15.44:0/2061170000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc38806aa60 0x7fc388070740 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc37800c4a0 tx=0x7fc37800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:10.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.998+0000 7fc37f7fe700 1 -- 172.21.15.44:0/2061170000 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc378004ca0 con 0x7fc38806aa60 2024-09-13T18:28:10.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.998+0000 7fc37f7fe700 1 -- 172.21.15.44:0/2061170000 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc378004e00 con 0x7fc38806aa60 2024-09-13T18:28:10.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.998+0000 7fc38c92c700 1 -- 172.21.15.44:0/2061170000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc38815dbd0 con 0x7fc38806aa60 2024-09-13T18:28:10.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.998+0000 7fc37f7fe700 1 -- 172.21.15.44:0/2061170000 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc378007310 con 0x7fc38806aa60 2024-09-13T18:28:10.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.998+0000 7fc38c92c700 1 -- 172.21.15.44:0/2061170000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc38815e190 con 0x7fc38806aa60 2024-09-13T18:28:10.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.998+0000 7fc37f7fe700 1 -- 172.21.15.44:0/2061170000 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc378007470 con 0x7fc38806aa60 2024-09-13T18:28:10.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.998+0000 7fc38c92c700 1 -- 172.21.15.44:0/2061170000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc38815e380 con 0x7fc38806aa60 2024-09-13T18:28:10.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.998+0000 7fc37f7fe700 1 --2- 172.21.15.44:0/2061170000 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc368066730 0x7fc368068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:10.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.998+0000 7fc37f7fe700 1 -- 172.21.15.44:0/2061170000 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc378083c80 con 0x7fc38806aa60 2024-09-13T18:28:10.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:09.998+0000 7fc38659c700 1 --2- 172.21.15.44:0/2061170000 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc368066730 0x7fc368068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:10.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.002+0000 7fc38659c700 1 --2- 172.21.15.44:0/2061170000 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc368066730 0x7fc368068bf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc370009850 tx=0x7fc370008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:10.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.010+0000 7fc37f7fe700 1 -- 172.21.15.44:0/2061170000 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc378051080 con 0x7fc38806aa60 2024-09-13T18:28:10.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.238+0000 7fc38c92c700 1 -- 172.21.15.44:0/2061170000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc38806a520 con 0x7fc38806aa60 2024-09-13T18:28:10.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.238+0000 7fc37f7fe700 1 -- 172.21.15.44:0/2061170000 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1268 (secure 0 0 0) 0x7fc378007720 con 0x7fc38806aa60 2024-09-13T18:28:10.245 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:10.245 INFO:teuthology.orchestra.run.smithi044.stdout:{"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":93,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":35,"num_osds":8,"num_up_osds":8,"osd_up_since":1726252008,"num_in_osds":8,"osd_in_since":1726251999,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225406976,"bytes_avail":772868706304,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5298}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-13T18:27:56.337223+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T18:28:10.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.242+0000 7fc38c92c700 1 -- 172.21.15.44:0/2061170000 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc368066730 msgr2=0x7fc368068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:10.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.242+0000 7fc38c92c700 1 --2- 172.21.15.44:0/2061170000 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc368066730 0x7fc368068bf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc370009850 tx=0x7fc370008030 comp rx=0 tx=0).stop 2024-09-13T18:28:10.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.242+0000 7fc38c92c700 1 -- 172.21.15.44:0/2061170000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc38806aa60 msgr2=0x7fc388070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:10.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.242+0000 7fc38c92c700 1 --2- 172.21.15.44:0/2061170000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc38806aa60 0x7fc388070740 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc37800c4a0 tx=0x7fc37800c7b0 comp rx=0 tx=0).stop 2024-09-13T18:28:10.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.242+0000 7fc38c92c700 1 -- 172.21.15.44:0/2061170000 shutdown_connections 2024-09-13T18:28:10.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.242+0000 7fc38c92c700 1 --2- 172.21.15.44:0/2061170000 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc368066730 0x7fc368068bf0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:10.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.242+0000 7fc38c92c700 1 --2- 172.21.15.44:0/2061170000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc388160f30 0x7fc3880b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:10.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.242+0000 7fc38c92c700 1 --2- 172.21.15.44:0/2061170000 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc3880cede0 0x7fc38815feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:10.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.242+0000 7fc38c92c700 1 --2- 172.21.15.44:0/2061170000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc38806aa60 0x7fc388070740 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:10.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.242+0000 7fc38c92c700 1 -- 172.21.15.44:0/2061170000 >> 172.21.15.44:0/2061170000 conn(0x7fc3880d2c80 msgr2=0x7fc3880b7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:10.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.242+0000 7fc38c92c700 1 -- 172.21.15.44:0/2061170000 shutdown_connections 2024-09-13T18:28:10.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.242+0000 7fc38c92c700 1 -- 172.21.15.44:0/2061170000 wait complete. 2024-09-13T18:28:10.260 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T18:28:10.260 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:28:10.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.362+0000 7f8525cb5700 1 Processor -- start 2024-09-13T18:28:10.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.362+0000 7f8525cb5700 1 -- start start 2024-09-13T18:28:10.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f8525cb5700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f852013d8b0 0x7f852006e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:10.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f8525cb5700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f852015bba0 0x7f852015c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:10.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f8525cb5700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f852013e050 con 0x7f8520071c90 2024-09-13T18:28:10.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f8525cb5700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f852006ede0 con 0x7f852015bba0 2024-09-13T18:28:10.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f8525cb5700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852013e2a0 con 0x7f852013d8b0 2024-09-13T18:28:10.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f851ffff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f852015bba0 0x7f852015c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:10.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f8524cb3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f852013d8b0 0x7f852006e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:10.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f851ffff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f852015bba0 0x7f852015c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:42276/0 (socket says 172.21.15.44:42276) 2024-09-13T18:28:10.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f851ffff700 1 -- 172.21.15.44:0/2211875899 learned_addr learned my addr 172.21.15.44:0/2211875899 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:10.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f8524cb3700 1 -- 172.21.15.44:0/2211875899 >> v2:172.21.15.99:3300/0 conn(0x7f852015bba0 msgr2=0x7f852015c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:10.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f8524cb3700 1 --2- 172.21.15.44:0/2211875899 >> v2:172.21.15.99:3300/0 conn(0x7f852015bba0 0x7f852015c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:10.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f8524cb3700 1 -- 172.21.15.44:0/2211875899 >> v1:172.21.15.99:6789/0 conn(0x7f8520071c90 legacy=0x7f852013f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:10.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f8524cb3700 1 -- 172.21.15.44:0/2211875899 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852013e580 con 0x7f852013d8b0 2024-09-13T18:28:10.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f851ffff700 1 --2- 172.21.15.44:0/2211875899 >> v2:172.21.15.99:3300/0 conn(0x7f852015bba0 0x7f852015c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:10.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f8524cb3700 1 --2- 172.21.15.44:0/2211875899 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f852013d8b0 0x7f852006e8a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8514009850 tx=0x7f8514009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a691fb4ed9d2610 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:10.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f851f7fe700 1 -- 172.21.15.44:0/2211875899 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514011830 con 0x7f852013d8b0 2024-09-13T18:28:10.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f851f7fe700 1 -- 172.21.15.44:0/2211875899 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8514011990 con 0x7f852013d8b0 2024-09-13T18:28:10.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f851f7fe700 1 -- 172.21.15.44:0/2211875899 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514011d40 con 0x7f852013d8b0 2024-09-13T18:28:10.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f8525cb5700 1 -- 172.21.15.44:0/2211875899 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f852013d8b0 msgr2=0x7f852006e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:10.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f8525cb5700 1 --2- 172.21.15.44:0/2211875899 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f852013d8b0 0x7f852006e8a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8514009850 tx=0x7f8514009b60 comp rx=0 tx=0).stop 2024-09-13T18:28:10.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f8525cb5700 1 -- 172.21.15.44:0/2211875899 shutdown_connections 2024-09-13T18:28:10.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f8525cb5700 1 --2- 172.21.15.44:0/2211875899 >> v2:172.21.15.99:3300/0 conn(0x7f852015bba0 0x7f852015c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:10.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f8525cb5700 1 --2- 172.21.15.44:0/2211875899 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f852013d8b0 0x7f852006e8a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:10.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f8525cb5700 1 -- 172.21.15.44:0/2211875899 >> 172.21.15.44:0/2211875899 conn(0x7f852006a310 msgr2=0x7f852006a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:10.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f8525cb5700 1 -- 172.21.15.44:0/2211875899 shutdown_connections 2024-09-13T18:28:10.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.366+0000 7f8525cb5700 1 -- 172.21.15.44:0/2211875899 wait complete. 2024-09-13T18:28:10.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f8525cb5700 1 Processor -- start 2024-09-13T18:28:10.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f8525cb5700 1 -- start start 2024-09-13T18:28:10.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f8525cb5700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8520071c90 0x7f8520135670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f8525cb5700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f852013d8b0 0x7f85200cb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f8525cb5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f852015bba0 0x7f85200cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f8525cb5700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8520154cb0 con 0x7f852015bba0 2024-09-13T18:28:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f8525cb5700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8520132d90 con 0x7f8520071c90 2024-09-13T18:28:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f8525cb5700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8520135bb0 con 0x7f852013d8b0 2024-09-13T18:28:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f85254b4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f852015bba0 0x7f85200cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f85254b4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f852015bba0 0x7f85200cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35216/0 (socket says 172.21.15.44:35216) 2024-09-13T18:28:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f85254b4700 1 -- 172.21.15.44:0/1735409734 learned_addr learned my addr 172.21.15.44:0/1735409734 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f851ffff700 1 --2- 172.21.15.44:0/1735409734 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f852013d8b0 0x7f85200cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f8524cb3700 1 --2- 172.21.15.44:0/1735409734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8520071c90 0x7f8520135670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f85254b4700 1 -- 172.21.15.44:0/1735409734 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f852013d8b0 msgr2=0x7f85200cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f85254b4700 1 --2- 172.21.15.44:0/1735409734 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f852013d8b0 0x7f85200cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:10.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f85254b4700 1 -- 172.21.15.44:0/1735409734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8520071c90 msgr2=0x7f8520135670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:10.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f85254b4700 1 --2- 172.21.15.44:0/1735409734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8520071c90 0x7f8520135670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:10.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f85254b4700 1 -- 172.21.15.44:0/1735409734 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c009570 con 0x7f852015bba0 2024-09-13T18:28:10.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f8524cb3700 1 --2- 172.21.15.44:0/1735409734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8520071c90 0x7f8520135670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:10.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f85254b4700 1 --2- 172.21.15.44:0/1735409734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f852015bba0 0x7f85200cb640 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f851800cbd0 tx=0x7f851800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:10.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f851d7fa700 1 -- 172.21.15.44:0/1735409734 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8518003c20 con 0x7f852015bba0 2024-09-13T18:28:10.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f8525cb5700 1 -- 172.21.15.44:0/1735409734 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85140094b0 con 0x7f852015bba0 2024-09-13T18:28:10.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f851d7fa700 1 -- 172.21.15.44:0/1735409734 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8518003d80 con 0x7f852015bba0 2024-09-13T18:28:10.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f851d7fa700 1 -- 172.21.15.44:0/1735409734 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851800ab00 con 0x7f852015bba0 2024-09-13T18:28:10.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.370+0000 7f8525cb5700 1 -- 172.21.15.44:0/1735409734 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852006dc50 con 0x7f852015bba0 2024-09-13T18:28:10.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.374+0000 7f8525cb5700 1 -- 172.21.15.44:0/1735409734 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8520154df0 con 0x7f852015bba0 2024-09-13T18:28:10.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.374+0000 7f851d7fa700 1 -- 172.21.15.44:0/1735409734 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f851800ac60 con 0x7f852015bba0 2024-09-13T18:28:10.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.374+0000 7f851d7fa700 1 --2- 172.21.15.44:0/1735409734 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8504066730 0x7f8504068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:10.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.374+0000 7f851d7fa700 1 -- 172.21.15.44:0/1735409734 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8518084280 con 0x7f852015bba0 2024-09-13T18:28:10.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.374+0000 7f8524cb3700 1 --2- 172.21.15.44:0/1735409734 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8504066730 0x7f8504068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:10.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.374+0000 7f8524cb3700 1 --2- 172.21.15.44:0/1735409734 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8504066730 0x7f8504068bf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f85140090b0 tx=0x7f8514008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:10.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.382+0000 7f851d7fa700 1 -- 172.21.15.44:0/1735409734 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8520154df0 con 0x7f852015bba0 2024-09-13T18:28:10.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.550+0000 7f8525cb5700 1 -- 172.21.15.44:0/1735409734 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f852015b880 con 0x7f8504066730 2024-09-13T18:28:10.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.570+0000 7f851d7fa700 1 -- 172.21.15.44:0/1735409734 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287943 (secure 0 0 0) 0x7f852015b880 con 0x7f8504066730 2024-09-13T18:28:10.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:10.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.574+0000 7f8525cb5700 1 -- 172.21.15.44:0/1735409734 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8504066730 msgr2=0x7f8504068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:10.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.574+0000 7f8525cb5700 1 --2- 172.21.15.44:0/1735409734 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8504066730 0x7f8504068bf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f85140090b0 tx=0x7f8514008030 comp rx=0 tx=0).stop 2024-09-13T18:28:10.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.574+0000 7f8525cb5700 1 -- 172.21.15.44:0/1735409734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f852015bba0 msgr2=0x7f85200cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:10.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.574+0000 7f8525cb5700 1 --2- 172.21.15.44:0/1735409734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f852015bba0 0x7f85200cb640 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f851800cbd0 tx=0x7f851800cee0 comp rx=0 tx=0).stop 2024-09-13T18:28:10.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.574+0000 7f8525cb5700 1 -- 172.21.15.44:0/1735409734 shutdown_connections 2024-09-13T18:28:10.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.574+0000 7f8525cb5700 1 --2- 172.21.15.44:0/1735409734 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8504066730 0x7f8504068bf0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:10.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.574+0000 7f8525cb5700 1 --2- 172.21.15.44:0/1735409734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f852015bba0 0x7f85200cb640 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:10.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.574+0000 7f8525cb5700 1 --2- 172.21.15.44:0/1735409734 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f852013d8b0 0x7f85200cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:10.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.574+0000 7f8525cb5700 1 --2- 172.21.15.44:0/1735409734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8520071c90 0x7f8520135670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:10.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.574+0000 7f8525cb5700 1 -- 172.21.15.44:0/1735409734 >> 172.21.15.44:0/1735409734 conn(0x7f852006a310 msgr2=0x7f8520159f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:10.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.574+0000 7f8525cb5700 1 -- 172.21.15.44:0/1735409734 shutdown_connections 2024-09-13T18:28:10.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:10.574+0000 7f8525cb5700 1 -- 172.21.15.44:0/1735409734 wait complete. 2024-09-13T18:28:10.583 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:28:10.597 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-09-13T18:28:10.341126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220540,"kb_used_data":4328,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754180,"statfs":{"total":773094113280,"available":772868280320,"internally_reserved":0,"allocated":4431872,"data_stored":2438052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001881"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124010+0000","last_change":"2024-09-13T18:28:05.088360+0000","last_active":"2024-09-13T18:28:06.124010+0000","last_peered":"2024-09-13T18:28:06.124010+0000","last_clean":"2024-09-13T18:28:06.124010+0000","last_became_active":"2024-09-13T18:28:05.087928+0000","last_became_peered":"2024-09-13T18:28:05.087928+0000","last_unstale":"2024-09-13T18:28:06.124010+0000","last_undegraded":"2024-09-13T18:28:06.124010+0000","last_fullsized":"2024-09-13T18:28:06.124010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:50.909232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.079976+0000","last_change":"2024-09-13T18:28:05.092675+0000","last_active":"2024-09-13T18:28:06.079976+0000","last_peered":"2024-09-13T18:28:06.079976+0000","last_clean":"2024-09-13T18:28:06.079976+0000","last_became_active":"2024-09-13T18:28:05.092426+0000","last_became_peered":"2024-09-13T18:28:05.092426+0000","last_unstale":"2024-09-13T18:28:06.079976+0000","last_undegraded":"2024-09-13T18:28:06.079976+0000","last_fullsized":"2024-09-13T18:28:06.079976+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:21.271196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.077717+0000","last_change":"2024-09-13T18:28:05.093768+0000","last_active":"2024-09-13T18:28:06.077717+0000","last_peered":"2024-09-13T18:28:06.077717+0000","last_clean":"2024-09-13T18:28:06.077717+0000","last_became_active":"2024-09-13T18:28:05.093449+0000","last_became_peered":"2024-09-13T18:28:05.093449+0000","last_unstale":"2024-09-13T18:28:06.077717+0000","last_undegraded":"2024-09-13T18:28:06.077717+0000","last_fullsized":"2024-09-13T18:28:06.077717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:46.785919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.079410+0000","last_change":"2024-09-13T18:28:05.100243+0000","last_active":"2024-09-13T18:28:06.079410+0000","last_peered":"2024-09-13T18:28:06.079410+0000","last_clean":"2024-09-13T18:28:06.079410+0000","last_became_active":"2024-09-13T18:28:05.099429+0000","last_became_peered":"2024-09-13T18:28:05.099429+0000","last_unstale":"2024-09-13T18:28:06.079410+0000","last_undegraded":"2024-09-13T18:28:06.079410+0000","last_fullsized":"2024-09-13T18:28:06.079410+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:46.785919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.126637+0000","last_change":"2024-09-13T18:28:05.098046+0000","last_active":"2024-09-13T18:28:06.126637+0000","last_peered":"2024-09-13T18:28:06.126637+0000","last_clean":"2024-09-13T18:28:06.126637+0000","last_became_active":"2024-09-13T18:28:05.097751+0000","last_became_peered":"2024-09-13T18:28:05.097751+0000","last_unstale":"2024-09-13T18:28:06.126637+0000","last_undegraded":"2024-09-13T18:28:06.126637+0000","last_fullsized":"2024-09-13T18:28:06.126637+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:24.515101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.079635+0000","last_change":"2024-09-13T18:28:05.096203+0000","last_active":"2024-09-13T18:28:06.079635+0000","last_peered":"2024-09-13T18:28:06.079635+0000","last_clean":"2024-09-13T18:28:06.079635+0000","last_became_active":"2024-09-13T18:28:05.095617+0000","last_became_peered":"2024-09-13T18:28:05.095617+0000","last_unstale":"2024-09-13T18:28:06.079635+0000","last_undegraded":"2024-09-13T18:28:06.079635+0000","last_fullsized":"2024-09-13T18:28:06.079635+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:01.427692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124593+0000","last_change":"2024-09-13T18:28:05.082230+0000","last_active":"2024-09-13T18:28:06.124593+0000","last_peered":"2024-09-13T18:28:06.124593+0000","last_clean":"2024-09-13T18:28:06.124593+0000","last_became_active":"2024-09-13T18:28:05.081249+0000","last_became_peered":"2024-09-13T18:28:05.081249+0000","last_unstale":"2024-09-13T18:28:06.124593+0000","last_undegraded":"2024-09-13T18:28:06.124593+0000","last_fullsized":"2024-09-13T18:28:06.124593+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:25.028196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.123829+0000","last_change":"2024-09-13T18:28:05.076775+0000","last_active":"2024-09-13T18:28:06.123829+0000","last_peered":"2024-09-13T18:28:06.123829+0000","last_clean":"2024-09-13T18:28:06.123829+0000","last_became_active":"2024-09-13T18:28:05.076431+0000","last_became_peered":"2024-09-13T18:28:05.076431+0000","last_unstale":"2024-09-13T18:28:06.123829+0000","last_undegraded":"2024-09-13T18:28:06.123829+0000","last_fullsized":"2024-09-13T18:28:06.123829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:07.569004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.126001+0000","last_change":"2024-09-13T18:28:05.097693+0000","last_active":"2024-09-13T18:28:06.126001+0000","last_peered":"2024-09-13T18:28:06.126001+0000","last_clean":"2024-09-13T18:28:06.126001+0000","last_became_active":"2024-09-13T18:28:05.097288+0000","last_became_peered":"2024-09-13T18:28:05.097288+0000","last_unstale":"2024-09-13T18:28:06.126001+0000","last_undegraded":"2024-09-13T18:28:06.126001+0000","last_fullsized":"2024-09-13T18:28:06.126001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:43.143004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.079781+0000","last_change":"2024-09-13T18:28:05.100913+0000","last_active":"2024-09-13T18:28:06.079781+0000","last_peered":"2024-09-13T18:28:06.079781+0000","last_clean":"2024-09-13T18:28:06.079781+0000","last_became_active":"2024-09-13T18:28:05.099195+0000","last_became_peered":"2024-09-13T18:28:05.099195+0000","last_unstale":"2024-09-13T18:28:06.079781+0000","last_undegraded":"2024-09-13T18:28:06.079781+0000","last_fullsized":"2024-09-13T18:28:06.079781+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:00.027242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.125045+0000","last_change":"2024-09-13T18:28:05.077317+0000","last_active":"2024-09-13T18:28:06.125045+0000","last_peered":"2024-09-13T18:28:06.125045+0000","last_clean":"2024-09-13T18:28:06.125045+0000","last_became_active":"2024-09-13T18:28:05.077112+0000","last_became_peered":"2024-09-13T18:28:05.077112+0000","last_unstale":"2024-09-13T18:28:06.125045+0000","last_undegraded":"2024-09-13T18:28:06.125045+0000","last_fullsized":"2024-09-13T18:28:06.125045+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:41.532371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.077295+0000","last_change":"2024-09-13T18:28:05.093648+0000","last_active":"2024-09-13T18:28:06.077295+0000","last_peered":"2024-09-13T18:28:06.077295+0000","last_clean":"2024-09-13T18:28:06.077295+0000","last_became_active":"2024-09-13T18:28:05.093327+0000","last_became_peered":"2024-09-13T18:28:05.093327+0000","last_unstale":"2024-09-13T18:28:06.077295+0000","last_undegraded":"2024-09-13T18:28:06.077295+0000","last_fullsized":"2024-09-13T18:28:06.077295+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:07.569004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.126731+0000","last_change":"2024-09-13T18:28:05.079792+0000","last_active":"2024-09-13T18:28:06.126731+0000","last_peered":"2024-09-13T18:28:06.126731+0000","last_clean":"2024-09-13T18:28:06.126731+0000","last_became_active":"2024-09-13T18:28:05.079533+0000","last_became_peered":"2024-09-13T18:28:05.079533+0000","last_unstale":"2024-09-13T18:28:06.126731+0000","last_undegraded":"2024-09-13T18:28:06.126731+0000","last_fullsized":"2024-09-13T18:28:06.126731+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:26.839265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.079772+0000","last_change":"2024-09-13T18:28:05.095970+0000","last_active":"2024-09-13T18:28:06.079772+0000","last_peered":"2024-09-13T18:28:06.079772+0000","last_clean":"2024-09-13T18:28:06.079772+0000","last_became_active":"2024-09-13T18:28:05.095293+0000","last_became_peered":"2024-09-13T18:28:05.095293+0000","last_unstale":"2024-09-13T18:28:06.079772+0000","last_undegraded":"2024-09-13T18:28:06.079772+0000","last_fullsized":"2024-09-13T18:28:06.079772+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:20.996616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.076897+0000","last_change":"2024-09-13T18:28:05.095379+0000","last_active":"2024-09-13T18:28:06.076897+0000","last_peered":"2024-09-13T18:28:06.076897+0000","last_clean":"2024-09-13T18:28:06.076897+0000","last_became_active":"2024-09-13T18:28:05.094947+0000","last_became_peered":"2024-09-13T18:28:05.094947+0000","last_unstale":"2024-09-13T18:28:06.076897+0000","last_undegraded":"2024-09-13T18:28:06.076897+0000","last_fullsized":"2024-09-13T18:28:06.076897+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:20.996616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124655+0000","last_change":"2024-09-13T18:28:05.093849+0000","last_active":"2024-09-13T18:28:06.124655+0000","last_peered":"2024-09-13T18:28:06.124655+0000","last_clean":"2024-09-13T18:28:06.124655+0000","last_became_active":"2024-09-13T18:28:05.093567+0000","last_became_peered":"2024-09-13T18:28:05.093567+0000","last_unstale":"2024-09-13T18:28:06.124655+0000","last_undegraded":"2024-09-13T18:28:06.124655+0000","last_fullsized":"2024-09-13T18:28:06.124655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:01.427692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.125302+0000","last_change":"2024-09-13T18:28:05.081931+0000","last_active":"2024-09-13T18:28:06.125302+0000","last_peered":"2024-09-13T18:28:06.125302+0000","last_clean":"2024-09-13T18:28:06.125302+0000","last_became_active":"2024-09-13T18:28:05.081546+0000","last_became_peered":"2024-09-13T18:28:05.081546+0000","last_unstale":"2024-09-13T18:28:06.125302+0000","last_undegraded":"2024-09-13T18:28:06.125302+0000","last_fullsized":"2024-09-13T18:28:06.125302+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:20.371685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.079998+0000","last_change":"2024-09-13T18:28:05.094207+0000","last_active":"2024-09-13T18:28:06.079998+0000","last_peered":"2024-09-13T18:28:06.079998+0000","last_clean":"2024-09-13T18:28:06.079998+0000","last_became_active":"2024-09-13T18:28:05.093956+0000","last_became_peered":"2024-09-13T18:28:05.093956+0000","last_unstale":"2024-09-13T18:28:06.079998+0000","last_undegraded":"2024-09-13T18:28:06.079998+0000","last_fullsized":"2024-09-13T18:28:06.079998+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:27.053514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.080683+0000","last_change":"2024-09-13T18:28:05.093918+0000","last_active":"2024-09-13T18:28:06.080683+0000","last_peered":"2024-09-13T18:28:06.080683+0000","last_clean":"2024-09-13T18:28:06.080683+0000","last_became_active":"2024-09-13T18:28:05.093611+0000","last_became_peered":"2024-09-13T18:28:05.093611+0000","last_unstale":"2024-09-13T18:28:06.080683+0000","last_undegraded":"2024-09-13T18:28:06.080683+0000","last_fullsized":"2024-09-13T18:28:06.080683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:46.785919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.126854+0000","last_change":"2024-09-13T18:28:05.090722+0000","last_active":"2024-09-13T18:28:06.126854+0000","last_peered":"2024-09-13T18:28:06.126854+0000","last_clean":"2024-09-13T18:28:06.126854+0000","last_became_active":"2024-09-13T18:28:05.090454+0000","last_became_peered":"2024-09-13T18:28:05.090454+0000","last_unstale":"2024-09-13T18:28:06.126854+0000","last_undegraded":"2024-09-13T18:28:06.126854+0000","last_fullsized":"2024-09-13T18:28:06.126854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:24.932773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.123550+0000","last_change":"2024-09-13T18:28:05.090695+0000","last_active":"2024-09-13T18:28:06.123550+0000","last_peered":"2024-09-13T18:28:06.123550+0000","last_clean":"2024-09-13T18:28:06.123550+0000","last_became_active":"2024-09-13T18:28:05.090382+0000","last_became_peered":"2024-09-13T18:28:05.090382+0000","last_unstale":"2024-09-13T18:28:06.123550+0000","last_undegraded":"2024-09-13T18:28:06.123550+0000","last_fullsized":"2024-09-13T18:28:06.123550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:39.682094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124687+0000","last_change":"2024-09-13T18:28:05.096139+0000","last_active":"2024-09-13T18:28:06.124687+0000","last_peered":"2024-09-13T18:28:06.124687+0000","last_clean":"2024-09-13T18:28:06.124687+0000","last_became_active":"2024-09-13T18:28:05.095035+0000","last_became_peered":"2024-09-13T18:28:05.095035+0000","last_unstale":"2024-09-13T18:28:06.124687+0000","last_undegraded":"2024-09-13T18:28:06.124687+0000","last_fullsized":"2024-09-13T18:28:06.124687+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:34.919966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124489+0000","last_change":"2024-09-13T18:28:05.091827+0000","last_active":"2024-09-13T18:28:06.124489+0000","last_peered":"2024-09-13T18:28:06.124489+0000","last_clean":"2024-09-13T18:28:06.124489+0000","last_became_active":"2024-09-13T18:28:05.091552+0000","last_became_peered":"2024-09-13T18:28:05.091552+0000","last_unstale":"2024-09-13T18:28:06.124489+0000","last_undegraded":"2024-09-13T18:28:06.124489+0000","last_fullsized":"2024-09-13T18:28:06.124489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:07.438422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.076895+0000","last_change":"2024-09-13T18:28:05.100612+0000","last_active":"2024-09-13T18:28:06.076895+0000","last_peered":"2024-09-13T18:28:06.076895+0000","last_clean":"2024-09-13T18:28:06.076895+0000","last_became_active":"2024-09-13T18:28:05.100343+0000","last_became_peered":"2024-09-13T18:28:05.100343+0000","last_unstale":"2024-09-13T18:28:06.076895+0000","last_undegraded":"2024-09-13T18:28:06.076895+0000","last_fullsized":"2024-09-13T18:28:06.076895+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:25.028196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.080323+0000","last_change":"2024-09-13T18:28:05.079767+0000","last_active":"2024-09-13T18:28:06.080323+0000","last_peered":"2024-09-13T18:28:06.080323+0000","last_clean":"2024-09-13T18:28:06.080323+0000","last_became_active":"2024-09-13T18:28:05.079346+0000","last_became_peered":"2024-09-13T18:28:05.079346+0000","last_unstale":"2024-09-13T18:28:06.080323+0000","last_undegraded":"2024-09-13T18:28:06.080323+0000","last_fullsized":"2024-09-13T18:28:06.080323+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:07.569004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.080126+0000","last_change":"2024-09-13T18:28:05.096292+0000","last_active":"2024-09-13T18:28:06.080126+0000","last_peered":"2024-09-13T18:28:06.080126+0000","last_clean":"2024-09-13T18:28:06.080126+0000","last_became_active":"2024-09-13T18:28:05.096057+0000","last_became_peered":"2024-09-13T18:28:05.096057+0000","last_unstale":"2024-09-13T18:28:06.080126+0000","last_undegraded":"2024-09-13T18:28:06.080126+0000","last_fullsized":"2024-09-13T18:28:06.080126+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:53.035865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.079966+0000","last_change":"2024-09-13T18:28:05.100687+0000","last_active":"2024-09-13T18:28:06.079966+0000","last_peered":"2024-09-13T18:28:06.079966+0000","last_clean":"2024-09-13T18:28:06.079966+0000","last_became_active":"2024-09-13T18:28:05.100302+0000","last_became_peered":"2024-09-13T18:28:05.100302+0000","last_unstale":"2024-09-13T18:28:06.079966+0000","last_undegraded":"2024-09-13T18:28:06.079966+0000","last_fullsized":"2024-09-13T18:28:06.079966+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:20.996616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.077412+0000","last_change":"2024-09-13T18:28:05.099034+0000","last_active":"2024-09-13T18:28:06.077412+0000","last_peered":"2024-09-13T18:28:06.077412+0000","last_clean":"2024-09-13T18:28:06.077412+0000","last_became_active":"2024-09-13T18:28:05.098737+0000","last_became_peered":"2024-09-13T18:28:05.098737+0000","last_unstale":"2024-09-13T18:28:06.077412+0000","last_undegraded":"2024-09-13T18:28:06.077412+0000","last_fullsized":"2024-09-13T18:28:06.077412+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:53.958704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.125076+0000","last_change":"2024-09-13T18:28:05.097071+0000","last_active":"2024-09-13T18:28:06.125076+0000","last_peered":"2024-09-13T18:28:06.125076+0000","last_clean":"2024-09-13T18:28:06.125076+0000","last_became_active":"2024-09-13T18:28:05.096741+0000","last_became_peered":"2024-09-13T18:28:05.096741+0000","last_unstale":"2024-09-13T18:28:06.125076+0000","last_undegraded":"2024-09-13T18:28:06.125076+0000","last_fullsized":"2024-09-13T18:28:06.125076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:21.822290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.123928+0000","last_change":"2024-09-13T18:28:05.079325+0000","last_active":"2024-09-13T18:28:06.123928+0000","last_peered":"2024-09-13T18:28:06.123928+0000","last_clean":"2024-09-13T18:28:06.123928+0000","last_became_active":"2024-09-13T18:28:05.078997+0000","last_became_peered":"2024-09-13T18:28:05.078997+0000","last_unstale":"2024-09-13T18:28:06.123928+0000","last_undegraded":"2024-09-13T18:28:06.123928+0000","last_fullsized":"2024-09-13T18:28:06.123928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:20.996616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.125371+0000","last_change":"2024-09-13T18:28:05.078849+0000","last_active":"2024-09-13T18:28:06.125371+0000","last_peered":"2024-09-13T18:28:06.125371+0000","last_clean":"2024-09-13T18:28:06.125371+0000","last_became_active":"2024-09-13T18:28:05.078583+0000","last_became_peered":"2024-09-13T18:28:05.078583+0000","last_unstale":"2024-09-13T18:28:06.125371+0000","last_undegraded":"2024-09-13T18:28:06.125371+0000","last_fullsized":"2024-09-13T18:28:06.125371+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:40.162785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124068+0000","last_change":"2024-09-13T18:28:05.095531+0000","last_active":"2024-09-13T18:28:06.124068+0000","last_peered":"2024-09-13T18:28:06.124068+0000","last_clean":"2024-09-13T18:28:06.124068+0000","last_became_active":"2024-09-13T18:28:05.094639+0000","last_became_peered":"2024-09-13T18:28:05.094639+0000","last_unstale":"2024-09-13T18:28:06.124068+0000","last_undegraded":"2024-09-13T18:28:06.124068+0000","last_fullsized":"2024-09-13T18:28:06.124068+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:00.027242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124818+0000","last_change":"2024-09-13T18:28:05.091014+0000","last_active":"2024-09-13T18:28:06.124818+0000","last_peered":"2024-09-13T18:28:06.124818+0000","last_clean":"2024-09-13T18:28:06.124818+0000","last_became_active":"2024-09-13T18:28:05.090767+0000","last_became_peered":"2024-09-13T18:28:05.090767+0000","last_unstale":"2024-09-13T18:28:06.124818+0000","last_undegraded":"2024-09-13T18:28:06.124818+0000","last_fullsized":"2024-09-13T18:28:06.124818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:50.909232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.095877+0000","last_change":"2024-09-13T18:28:04.694663+0000","last_active":"2024-09-13T18:28:05.095877+0000","last_peered":"2024-09-13T18:28:05.095877+0000","last_clean":"2024-09-13T18:28:05.095877+0000","last_became_active":"2024-09-13T18:28:04.694398+0000","last_became_peered":"2024-09-13T18:28:04.694398+0000","last_unstale":"2024-09-13T18:28:05.095877+0000","last_undegraded":"2024-09-13T18:28:05.095877+0000","last_fullsized":"2024-09-13T18:28:05.095877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:32.822140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124192+0000","last_change":"2024-09-13T18:28:05.092994+0000","last_active":"2024-09-13T18:28:06.124192+0000","last_peered":"2024-09-13T18:28:06.124192+0000","last_clean":"2024-09-13T18:28:06.124192+0000","last_became_active":"2024-09-13T18:28:05.092480+0000","last_became_peered":"2024-09-13T18:28:05.092480+0000","last_unstale":"2024-09-13T18:28:06.124192+0000","last_undegraded":"2024-09-13T18:28:06.124192+0000","last_fullsized":"2024-09-13T18:28:06.124192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:20.371685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.090576+0000","last_change":"2024-09-13T18:28:04.698296+0000","last_active":"2024-09-13T18:28:05.090576+0000","last_peered":"2024-09-13T18:28:05.090576+0000","last_clean":"2024-09-13T18:28:05.090576+0000","last_became_active":"2024-09-13T18:28:04.697969+0000","last_became_peered":"2024-09-13T18:28:04.697969+0000","last_unstale":"2024-09-13T18:28:05.090576+0000","last_undegraded":"2024-09-13T18:28:05.090576+0000","last_fullsized":"2024-09-13T18:28:05.090576+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:32.822140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.125512+0000","last_change":"2024-09-13T18:28:05.094442+0000","last_active":"2024-09-13T18:28:06.125512+0000","last_peered":"2024-09-13T18:28:06.125512+0000","last_clean":"2024-09-13T18:28:06.125512+0000","last_became_active":"2024-09-13T18:28:05.094133+0000","last_became_peered":"2024-09-13T18:28:05.094133+0000","last_unstale":"2024-09-13T18:28:06.125512+0000","last_undegraded":"2024-09-13T18:28:06.125512+0000","last_fullsized":"2024-09-13T18:28:06.125512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:27.760716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.100025+0000","last_change":"2024-09-13T18:28:04.703043+0000","last_active":"2024-09-13T18:28:05.100025+0000","last_peered":"2024-09-13T18:28:05.100025+0000","last_clean":"2024-09-13T18:28:05.100025+0000","last_became_active":"2024-09-13T18:28:04.702812+0000","last_became_peered":"2024-09-13T18:28:04.702812+0000","last_unstale":"2024-09-13T18:28:05.100025+0000","last_undegraded":"2024-09-13T18:28:05.100025+0000","last_fullsized":"2024-09-13T18:28:05.100025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:42.130944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.080059+0000","last_change":"2024-09-13T18:28:05.100534+0000","last_active":"2024-09-13T18:28:06.080059+0000","last_peered":"2024-09-13T18:28:06.080059+0000","last_clean":"2024-09-13T18:28:06.080059+0000","last_became_active":"2024-09-13T18:28:05.099338+0000","last_became_peered":"2024-09-13T18:28:05.099338+0000","last_unstale":"2024-09-13T18:28:06.080059+0000","last_undegraded":"2024-09-13T18:28:06.080059+0000","last_fullsized":"2024-09-13T18:28:06.080059+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:23.427581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.096973+0000","last_change":"2024-09-13T18:28:04.702536+0000","last_active":"2024-09-13T18:28:05.096973+0000","last_peered":"2024-09-13T18:28:05.096973+0000","last_clean":"2024-09-13T18:28:05.096973+0000","last_became_active":"2024-09-13T18:28:04.702236+0000","last_became_peered":"2024-09-13T18:28:04.702236+0000","last_unstale":"2024-09-13T18:28:05.096973+0000","last_undegraded":"2024-09-13T18:28:05.096973+0000","last_fullsized":"2024-09-13T18:28:05.096973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:33.121990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124175+0000","last_change":"2024-09-13T18:28:05.094849+0000","last_active":"2024-09-13T18:28:06.124175+0000","last_peered":"2024-09-13T18:28:06.124175+0000","last_clean":"2024-09-13T18:28:06.124175+0000","last_became_active":"2024-09-13T18:28:05.094563+0000","last_became_peered":"2024-09-13T18:28:05.094563+0000","last_unstale":"2024-09-13T18:28:06.124175+0000","last_undegraded":"2024-09-13T18:28:06.124175+0000","last_fullsized":"2024-09-13T18:28:06.124175+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:46.785919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.096979+0000","last_change":"2024-09-13T18:28:04.697709+0000","last_active":"2024-09-13T18:28:05.096979+0000","last_peered":"2024-09-13T18:28:05.096979+0000","last_clean":"2024-09-13T18:28:05.096979+0000","last_became_active":"2024-09-13T18:28:04.697460+0000","last_became_peered":"2024-09-13T18:28:04.697460+0000","last_unstale":"2024-09-13T18:28:05.096979+0000","last_undegraded":"2024-09-13T18:28:05.096979+0000","last_fullsized":"2024-09-13T18:28:05.096979+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:41:43.880877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.077261+0000","last_change":"2024-09-13T18:28:05.099082+0000","last_active":"2024-09-13T18:28:06.077261+0000","last_peered":"2024-09-13T18:28:06.077261+0000","last_clean":"2024-09-13T18:28:06.077261+0000","last_became_active":"2024-09-13T18:28:05.098788+0000","last_became_peered":"2024-09-13T18:28:05.098788+0000","last_unstale":"2024-09-13T18:28:06.077261+0000","last_undegraded":"2024-09-13T18:28:06.077261+0000","last_fullsized":"2024-09-13T18:28:06.077261+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:21.206373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.096928+0000","last_change":"2024-09-13T18:28:04.697139+0000","last_active":"2024-09-13T18:28:05.096928+0000","last_peered":"2024-09-13T18:28:05.096928+0000","last_clean":"2024-09-13T18:28:05.096928+0000","last_became_active":"2024-09-13T18:28:04.696682+0000","last_became_peered":"2024-09-13T18:28:04.696682+0000","last_unstale":"2024-09-13T18:28:05.096928+0000","last_undegraded":"2024-09-13T18:28:05.096928+0000","last_fullsized":"2024-09-13T18:28:05.096928+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:17.011477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.123707+0000","last_change":"2024-09-13T18:28:05.096386+0000","last_active":"2024-09-13T18:28:06.123707+0000","last_peered":"2024-09-13T18:28:06.123707+0000","last_clean":"2024-09-13T18:28:06.123707+0000","last_became_active":"2024-09-13T18:28:05.094644+0000","last_became_peered":"2024-09-13T18:28:05.094644+0000","last_unstale":"2024-09-13T18:28:06.123707+0000","last_undegraded":"2024-09-13T18:28:06.123707+0000","last_fullsized":"2024-09-13T18:28:06.123707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:36.426543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.085394+0000","last_change":"2024-09-13T18:28:04.696673+0000","last_active":"2024-09-13T18:28:05.085394+0000","last_peered":"2024-09-13T18:28:05.085394+0000","last_clean":"2024-09-13T18:28:05.085394+0000","last_became_active":"2024-09-13T18:28:04.696409+0000","last_became_peered":"2024-09-13T18:28:04.696409+0000","last_unstale":"2024-09-13T18:28:05.085394+0000","last_undegraded":"2024-09-13T18:28:05.085394+0000","last_fullsized":"2024-09-13T18:28:05.085394+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:12.871246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.078542+0000","last_change":"2024-09-13T18:28:05.096518+0000","last_active":"2024-09-13T18:28:06.078542+0000","last_peered":"2024-09-13T18:28:06.078542+0000","last_clean":"2024-09-13T18:28:06.078542+0000","last_became_active":"2024-09-13T18:28:05.095081+0000","last_became_peered":"2024-09-13T18:28:05.095081+0000","last_unstale":"2024-09-13T18:28:06.078542+0000","last_undegraded":"2024-09-13T18:28:06.078542+0000","last_fullsized":"2024-09-13T18:28:06.078542+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:01.427692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.086610+0000","last_change":"2024-09-13T18:28:04.694111+0000","last_active":"2024-09-13T18:28:05.086610+0000","last_peered":"2024-09-13T18:28:05.086610+0000","last_clean":"2024-09-13T18:28:05.086610+0000","last_became_active":"2024-09-13T18:28:04.693830+0000","last_became_peered":"2024-09-13T18:28:04.693830+0000","last_unstale":"2024-09-13T18:28:05.086610+0000","last_undegraded":"2024-09-13T18:28:05.086610+0000","last_fullsized":"2024-09-13T18:28:05.086610+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:37.246556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.077470+0000","last_change":"2024-09-13T18:28:05.092935+0000","last_active":"2024-09-13T18:28:06.077470+0000","last_peered":"2024-09-13T18:28:06.077470+0000","last_clean":"2024-09-13T18:28:06.077470+0000","last_became_active":"2024-09-13T18:28:05.092658+0000","last_became_peered":"2024-09-13T18:28:05.092658+0000","last_unstale":"2024-09-13T18:28:06.077470+0000","last_undegraded":"2024-09-13T18:28:06.077470+0000","last_fullsized":"2024-09-13T18:28:06.077470+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:53.035865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.085776+0000","last_change":"2024-09-13T18:28:04.702012+0000","last_active":"2024-09-13T18:28:05.085776+0000","last_peered":"2024-09-13T18:28:05.085776+0000","last_clean":"2024-09-13T18:28:05.085776+0000","last_became_active":"2024-09-13T18:28:04.700003+0000","last_became_peered":"2024-09-13T18:28:04.700003+0000","last_unstale":"2024-09-13T18:28:05.085776+0000","last_undegraded":"2024-09-13T18:28:05.085776+0000","last_fullsized":"2024-09-13T18:28:05.085776+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:38.670033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.080078+0000","last_change":"2024-09-13T18:28:05.095018+0000","last_active":"2024-09-13T18:28:06.080078+0000","last_peered":"2024-09-13T18:28:06.080078+0000","last_clean":"2024-09-13T18:28:06.080078+0000","last_became_active":"2024-09-13T18:28:05.094740+0000","last_became_peered":"2024-09-13T18:28:05.094740+0000","last_unstale":"2024-09-13T18:28:06.080078+0000","last_undegraded":"2024-09-13T18:28:06.080078+0000","last_fullsized":"2024-09-13T18:28:06.080078+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:41.532371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.085089+0000","last_change":"2024-09-13T18:28:04.699830+0000","last_active":"2024-09-13T18:28:05.085089+0000","last_peered":"2024-09-13T18:28:05.085089+0000","last_clean":"2024-09-13T18:28:05.085089+0000","last_became_active":"2024-09-13T18:28:04.699552+0000","last_became_peered":"2024-09-13T18:28:04.699552+0000","last_unstale":"2024-09-13T18:28:05.085089+0000","last_undegraded":"2024-09-13T18:28:05.085089+0000","last_fullsized":"2024-09-13T18:28:05.085089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:25.827205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.080071+0000","last_change":"2024-09-13T18:28:05.094786+0000","last_active":"2024-09-13T18:28:06.080071+0000","last_peered":"2024-09-13T18:28:06.080071+0000","last_clean":"2024-09-13T18:28:06.080071+0000","last_became_active":"2024-09-13T18:28:05.094538+0000","last_became_peered":"2024-09-13T18:28:05.094538+0000","last_unstale":"2024-09-13T18:28:06.080071+0000","last_undegraded":"2024-09-13T18:28:06.080071+0000","last_fullsized":"2024-09-13T18:28:06.080071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:07.569004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.090060+0000","last_change":"2024-09-13T18:28:04.694813+0000","last_active":"2024-09-13T18:28:05.090060+0000","last_peered":"2024-09-13T18:28:05.090060+0000","last_clean":"2024-09-13T18:28:05.090060+0000","last_became_active":"2024-09-13T18:28:04.694560+0000","last_became_peered":"2024-09-13T18:28:04.694560+0000","last_unstale":"2024-09-13T18:28:05.090060+0000","last_undegraded":"2024-09-13T18:28:05.090060+0000","last_fullsized":"2024-09-13T18:28:05.090060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:38.670033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.077537+0000","last_change":"2024-09-13T18:28:05.094023+0000","last_active":"2024-09-13T18:28:06.077537+0000","last_peered":"2024-09-13T18:28:06.077537+0000","last_clean":"2024-09-13T18:28:06.077537+0000","last_became_active":"2024-09-13T18:28:05.093696+0000","last_became_peered":"2024-09-13T18:28:05.093696+0000","last_unstale":"2024-09-13T18:28:06.077537+0000","last_undegraded":"2024-09-13T18:28:06.077537+0000","last_fullsized":"2024-09-13T18:28:06.077537+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:00.027242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.107338+0000","last_change":"2024-09-13T18:28:04.702585+0000","last_active":"2024-09-13T18:28:05.107338+0000","last_peered":"2024-09-13T18:28:05.107338+0000","last_clean":"2024-09-13T18:28:05.107338+0000","last_became_active":"2024-09-13T18:28:04.702318+0000","last_became_peered":"2024-09-13T18:28:04.702318+0000","last_unstale":"2024-09-13T18:28:05.107338+0000","last_undegraded":"2024-09-13T18:28:05.107338+0000","last_fullsized":"2024-09-13T18:28:05.107338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:26.748656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.078830+0000","last_change":"2024-09-13T18:28:05.096363+0000","last_active":"2024-09-13T18:28:06.078830+0000","last_peered":"2024-09-13T18:28:06.078830+0000","last_clean":"2024-09-13T18:28:06.078830+0000","last_became_active":"2024-09-13T18:28:05.095124+0000","last_became_peered":"2024-09-13T18:28:05.095124+0000","last_unstale":"2024-09-13T18:28:06.078830+0000","last_undegraded":"2024-09-13T18:28:06.078830+0000","last_fullsized":"2024-09-13T18:28:06.078830+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:21.271196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.097078+0000","last_change":"2024-09-13T18:28:04.696819+0000","last_active":"2024-09-13T18:28:05.097078+0000","last_peered":"2024-09-13T18:28:05.097078+0000","last_clean":"2024-09-13T18:28:05.097078+0000","last_became_active":"2024-09-13T18:28:04.694707+0000","last_became_peered":"2024-09-13T18:28:04.694707+0000","last_unstale":"2024-09-13T18:28:05.097078+0000","last_undegraded":"2024-09-13T18:28:05.097078+0000","last_fullsized":"2024-09-13T18:28:05.097078+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:39.589241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.079719+0000","last_change":"2024-09-13T18:28:05.097035+0000","last_active":"2024-09-13T18:28:06.079719+0000","last_peered":"2024-09-13T18:28:06.079719+0000","last_clean":"2024-09-13T18:28:06.079719+0000","last_became_active":"2024-09-13T18:28:05.096782+0000","last_became_peered":"2024-09-13T18:28:05.096782+0000","last_unstale":"2024-09-13T18:28:06.079719+0000","last_undegraded":"2024-09-13T18:28:06.079719+0000","last_fullsized":"2024-09-13T18:28:06.079719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:53.514705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.069128+0000","last_change":"2024-09-13T18:28:04.701044+0000","last_active":"2024-09-13T18:28:05.069128+0000","last_peered":"2024-09-13T18:28:05.069128+0000","last_clean":"2024-09-13T18:28:05.069128+0000","last_became_active":"2024-09-13T18:28:04.700732+0000","last_became_peered":"2024-09-13T18:28:04.700732+0000","last_unstale":"2024-09-13T18:28:05.069128+0000","last_undegraded":"2024-09-13T18:28:05.069128+0000","last_fullsized":"2024-09-13T18:28:05.069128+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:06.426362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124293+0000","last_change":"2024-09-13T18:28:05.092344+0000","last_active":"2024-09-13T18:28:06.124293+0000","last_peered":"2024-09-13T18:28:06.124293+0000","last_clean":"2024-09-13T18:28:06.124293+0000","last_became_active":"2024-09-13T18:28:05.092103+0000","last_became_peered":"2024-09-13T18:28:05.092103+0000","last_unstale":"2024-09-13T18:28:06.124293+0000","last_undegraded":"2024-09-13T18:28:06.124293+0000","last_fullsized":"2024-09-13T18:28:06.124293+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:21.271196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.085489+0000","last_change":"2024-09-13T18:28:04.699454+0000","last_active":"2024-09-13T18:28:05.085489+0000","last_peered":"2024-09-13T18:28:05.085489+0000","last_clean":"2024-09-13T18:28:05.085489+0000","last_became_active":"2024-09-13T18:28:04.699065+0000","last_became_peered":"2024-09-13T18:28:04.699065+0000","last_unstale":"2024-09-13T18:28:05.085489+0000","last_undegraded":"2024-09-13T18:28:05.085489+0000","last_fullsized":"2024-09-13T18:28:05.085489+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:08.566891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.125586+0000","last_change":"2024-09-13T18:28:05.090102+0000","last_active":"2024-09-13T18:28:06.125586+0000","last_peered":"2024-09-13T18:28:06.125586+0000","last_clean":"2024-09-13T18:28:06.125586+0000","last_became_active":"2024-09-13T18:28:05.089793+0000","last_became_peered":"2024-09-13T18:28:05.089793+0000","last_unstale":"2024-09-13T18:28:06.125586+0000","last_undegraded":"2024-09-13T18:28:06.125586+0000","last_fullsized":"2024-09-13T18:28:06.125586+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:53.514705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.102993+0000","last_change":"2024-09-13T18:28:04.702445+0000","last_active":"2024-09-13T18:28:05.102993+0000","last_peered":"2024-09-13T18:28:05.102993+0000","last_clean":"2024-09-13T18:28:05.102993+0000","last_became_active":"2024-09-13T18:28:04.702194+0000","last_became_peered":"2024-09-13T18:28:04.702194+0000","last_unstale":"2024-09-13T18:28:05.102993+0000","last_undegraded":"2024-09-13T18:28:05.102993+0000","last_fullsized":"2024-09-13T18:28:05.102993+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:32.822140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.125736+0000","last_change":"2024-09-13T18:28:05.093390+0000","last_active":"2024-09-13T18:28:06.125736+0000","last_peered":"2024-09-13T18:28:06.125736+0000","last_clean":"2024-09-13T18:28:06.125736+0000","last_became_active":"2024-09-13T18:28:05.093041+0000","last_became_peered":"2024-09-13T18:28:05.093041+0000","last_unstale":"2024-09-13T18:28:06.125736+0000","last_undegraded":"2024-09-13T18:28:06.125736+0000","last_fullsized":"2024-09-13T18:28:06.125736+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:33.834200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.091512+0000","last_change":"2024-09-13T18:28:04.705433+0000","last_active":"2024-09-13T18:28:05.091512+0000","last_peered":"2024-09-13T18:28:05.091512+0000","last_clean":"2024-09-13T18:28:05.091512+0000","last_became_active":"2024-09-13T18:28:04.705140+0000","last_became_peered":"2024-09-13T18:28:04.705140+0000","last_unstale":"2024-09-13T18:28:05.091512+0000","last_undegraded":"2024-09-13T18:28:05.091512+0000","last_fullsized":"2024-09-13T18:28:05.091512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:33.907905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.077584+0000","last_change":"2024-09-13T18:28:05.092329+0000","last_active":"2024-09-13T18:28:06.077584+0000","last_peered":"2024-09-13T18:28:06.077584+0000","last_clean":"2024-09-13T18:28:06.077584+0000","last_became_active":"2024-09-13T18:28:05.092045+0000","last_became_peered":"2024-09-13T18:28:05.092045+0000","last_unstale":"2024-09-13T18:28:06.077584+0000","last_undegraded":"2024-09-13T18:28:06.077584+0000","last_fullsized":"2024-09-13T18:28:06.077584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:01.427692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.093971+0000","last_change":"2024-09-13T18:28:04.699607+0000","last_active":"2024-09-13T18:28:05.093971+0000","last_peered":"2024-09-13T18:28:05.093971+0000","last_clean":"2024-09-13T18:28:05.093971+0000","last_became_active":"2024-09-13T18:28:04.699283+0000","last_became_peered":"2024-09-13T18:28:04.699283+0000","last_unstale":"2024-09-13T18:28:05.093971+0000","last_undegraded":"2024-09-13T18:28:05.093971+0000","last_fullsized":"2024-09-13T18:28:05.093971+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:47.115877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.079483+0000","last_change":"2024-09-13T18:28:05.100617+0000","last_active":"2024-09-13T18:28:06.079483+0000","last_peered":"2024-09-13T18:28:06.079483+0000","last_clean":"2024-09-13T18:28:06.079483+0000","last_became_active":"2024-09-13T18:28:05.100370+0000","last_became_peered":"2024-09-13T18:28:05.100370+0000","last_unstale":"2024-09-13T18:28:06.079483+0000","last_undegraded":"2024-09-13T18:28:06.079483+0000","last_fullsized":"2024-09-13T18:28:06.079483+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:53.035865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.100559+0000","last_change":"2024-09-13T18:28:04.697351+0000","last_active":"2024-09-13T18:28:05.100559+0000","last_peered":"2024-09-13T18:28:05.100559+0000","last_clean":"2024-09-13T18:28:05.100559+0000","last_became_active":"2024-09-13T18:28:04.697073+0000","last_became_peered":"2024-09-13T18:28:04.697073+0000","last_unstale":"2024-09-13T18:28:05.100559+0000","last_undegraded":"2024-09-13T18:28:05.100559+0000","last_fullsized":"2024-09-13T18:28:05.100559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:47.800960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.126922+0000","last_change":"2024-09-13T18:28:05.080975+0000","last_active":"2024-09-13T18:28:06.126922+0000","last_peered":"2024-09-13T18:28:06.126922+0000","last_clean":"2024-09-13T18:28:06.126922+0000","last_became_active":"2024-09-13T18:28:05.080746+0000","last_became_peered":"2024-09-13T18:28:05.080746+0000","last_unstale":"2024-09-13T18:28:06.126922+0000","last_undegraded":"2024-09-13T18:28:06.126922+0000","last_fullsized":"2024-09-13T18:28:06.126922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:44.939214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.086913+0000","last_change":"2024-09-13T18:28:04.697278+0000","last_active":"2024-09-13T18:28:05.086913+0000","last_peered":"2024-09-13T18:28:05.086913+0000","last_clean":"2024-09-13T18:28:05.086913+0000","last_became_active":"2024-09-13T18:28:04.696839+0000","last_became_peered":"2024-09-13T18:28:04.696839+0000","last_unstale":"2024-09-13T18:28:05.086913+0000","last_undegraded":"2024-09-13T18:28:05.086913+0000","last_fullsized":"2024-09-13T18:28:05.086913+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:55.211725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.126642+0000","last_change":"2024-09-13T18:28:05.092381+0000","last_active":"2024-09-13T18:28:06.126642+0000","last_peered":"2024-09-13T18:28:06.126642+0000","last_clean":"2024-09-13T18:28:06.126642+0000","last_became_active":"2024-09-13T18:28:05.092108+0000","last_became_peered":"2024-09-13T18:28:05.092108+0000","last_unstale":"2024-09-13T18:28:06.126642+0000","last_undegraded":"2024-09-13T18:28:06.126642+0000","last_fullsized":"2024-09-13T18:28:06.126642+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:36.710867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.095563+0000","last_change":"2024-09-13T18:28:04.695492+0000","last_active":"2024-09-13T18:28:05.095563+0000","last_peered":"2024-09-13T18:28:05.095563+0000","last_clean":"2024-09-13T18:28:05.095563+0000","last_became_active":"2024-09-13T18:28:04.695206+0000","last_became_peered":"2024-09-13T18:28:04.695206+0000","last_unstale":"2024-09-13T18:28:05.095563+0000","last_undegraded":"2024-09-13T18:28:05.095563+0000","last_fullsized":"2024-09-13T18:28:05.095563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:08.566891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.126919+0000","last_change":"2024-09-13T18:28:05.097221+0000","last_active":"2024-09-13T18:28:06.126919+0000","last_peered":"2024-09-13T18:28:06.126919+0000","last_clean":"2024-09-13T18:28:06.126919+0000","last_became_active":"2024-09-13T18:28:05.096946+0000","last_became_peered":"2024-09-13T18:28:05.096946+0000","last_unstale":"2024-09-13T18:28:06.126919+0000","last_undegraded":"2024-09-13T18:28:06.126919+0000","last_fullsized":"2024-09-13T18:28:06.126919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:38.746157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.075172+0000","last_change":"2024-09-13T18:28:04.700141+0000","last_active":"2024-09-13T18:28:05.075172+0000","last_peered":"2024-09-13T18:28:05.075172+0000","last_clean":"2024-09-13T18:28:05.075172+0000","last_became_active":"2024-09-13T18:28:04.699828+0000","last_became_peered":"2024-09-13T18:28:04.699828+0000","last_unstale":"2024-09-13T18:28:05.075172+0000","last_undegraded":"2024-09-13T18:28:05.075172+0000","last_fullsized":"2024-09-13T18:28:05.075172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:08.566891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.126531+0000","last_change":"2024-09-13T18:28:05.092322+0000","last_active":"2024-09-13T18:28:06.126531+0000","last_peered":"2024-09-13T18:28:06.126531+0000","last_clean":"2024-09-13T18:28:06.126531+0000","last_became_active":"2024-09-13T18:28:05.092056+0000","last_became_peered":"2024-09-13T18:28:05.092056+0000","last_unstale":"2024-09-13T18:28:06.126531+0000","last_undegraded":"2024-09-13T18:28:06.126531+0000","last_fullsized":"2024-09-13T18:28:06.126531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:11.662995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.086789+0000","last_change":"2024-09-13T18:28:04.700002+0000","last_active":"2024-09-13T18:28:05.086789+0000","last_peered":"2024-09-13T18:28:05.086789+0000","last_clean":"2024-09-13T18:28:05.086789+0000","last_became_active":"2024-09-13T18:28:04.699677+0000","last_became_peered":"2024-09-13T18:28:04.699677+0000","last_unstale":"2024-09-13T18:28:05.086789+0000","last_undegraded":"2024-09-13T18:28:05.086789+0000","last_fullsized":"2024-09-13T18:28:05.086789+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:33.128414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124234+0000","last_change":"2024-09-13T18:28:05.081378+0000","last_active":"2024-09-13T18:28:06.124234+0000","last_peered":"2024-09-13T18:28:06.124234+0000","last_clean":"2024-09-13T18:28:06.124234+0000","last_became_active":"2024-09-13T18:28:05.081097+0000","last_became_peered":"2024-09-13T18:28:05.081097+0000","last_unstale":"2024-09-13T18:28:06.124234+0000","last_undegraded":"2024-09-13T18:28:06.124234+0000","last_fullsized":"2024-09-13T18:28:06.124234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:29.444409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.081356+0000","last_change":"2024-09-13T18:28:04.695611+0000","last_active":"2024-09-13T18:28:05.081356+0000","last_peered":"2024-09-13T18:28:05.081356+0000","last_clean":"2024-09-13T18:28:05.081356+0000","last_became_active":"2024-09-13T18:28:04.695405+0000","last_became_peered":"2024-09-13T18:28:04.695405+0000","last_unstale":"2024-09-13T18:28:05.081356+0000","last_undegraded":"2024-09-13T18:28:05.081356+0000","last_fullsized":"2024-09-13T18:28:05.081356+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:35.414482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.126883+0000","last_change":"2024-09-13T18:28:05.090105+0000","last_active":"2024-09-13T18:28:06.126883+0000","last_peered":"2024-09-13T18:28:06.126883+0000","last_clean":"2024-09-13T18:28:06.126883+0000","last_became_active":"2024-09-13T18:28:05.089858+0000","last_became_peered":"2024-09-13T18:28:05.089858+0000","last_unstale":"2024-09-13T18:28:06.126883+0000","last_undegraded":"2024-09-13T18:28:06.126883+0000","last_fullsized":"2024-09-13T18:28:06.126883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:43.888532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.096259+0000","last_change":"2024-09-13T18:28:04.699907+0000","last_active":"2024-09-13T18:28:05.096259+0000","last_peered":"2024-09-13T18:28:05.096259+0000","last_clean":"2024-09-13T18:28:05.096259+0000","last_became_active":"2024-09-13T18:28:04.699559+0000","last_became_peered":"2024-09-13T18:28:04.699559+0000","last_unstale":"2024-09-13T18:28:05.096259+0000","last_undegraded":"2024-09-13T18:28:05.096259+0000","last_fullsized":"2024-09-13T18:28:05.096259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:20.810230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.077485+0000","last_change":"2024-09-13T18:28:05.100532+0000","last_active":"2024-09-13T18:28:06.077485+0000","last_peered":"2024-09-13T18:28:06.077485+0000","last_clean":"2024-09-13T18:28:06.077485+0000","last_became_active":"2024-09-13T18:28:05.100250+0000","last_became_peered":"2024-09-13T18:28:05.100250+0000","last_unstale":"2024-09-13T18:28:06.077485+0000","last_undegraded":"2024-09-13T18:28:06.077485+0000","last_fullsized":"2024-09-13T18:28:06.077485+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:21.271196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.125124+0000","last_change":"2024-09-13T18:28:04.696563+0000","last_active":"2024-09-13T18:28:06.125124+0000","last_peered":"2024-09-13T18:28:06.125124+0000","last_clean":"2024-09-13T18:28:06.125124+0000","last_became_active":"2024-09-13T18:28:04.696304+0000","last_became_peered":"2024-09-13T18:28:04.696304+0000","last_unstale":"2024-09-13T18:28:06.125124+0000","last_undegraded":"2024-09-13T18:28:06.125124+0000","last_fullsized":"2024-09-13T18:28:06.125124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:37.734096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124765+0000","last_change":"2024-09-13T18:28:05.091331+0000","last_active":"2024-09-13T18:28:06.124765+0000","last_peered":"2024-09-13T18:28:06.124765+0000","last_clean":"2024-09-13T18:28:06.124765+0000","last_became_active":"2024-09-13T18:28:05.091061+0000","last_became_peered":"2024-09-13T18:28:05.091061+0000","last_unstale":"2024-09-13T18:28:06.124765+0000","last_undegraded":"2024-09-13T18:28:06.124765+0000","last_fullsized":"2024-09-13T18:28:06.124765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:40.162785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.071162+0000","last_change":"2024-09-13T18:28:04.702812+0000","last_active":"2024-09-13T18:28:05.071162+0000","last_peered":"2024-09-13T18:28:05.071162+0000","last_clean":"2024-09-13T18:28:05.071162+0000","last_became_active":"2024-09-13T18:28:04.702538+0000","last_became_peered":"2024-09-13T18:28:04.702538+0000","last_unstale":"2024-09-13T18:28:05.071162+0000","last_undegraded":"2024-09-13T18:28:05.071162+0000","last_fullsized":"2024-09-13T18:28:05.071162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:42.130944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124414+0000","last_change":"2024-09-13T18:28:05.091029+0000","last_active":"2024-09-13T18:28:06.124414+0000","last_peered":"2024-09-13T18:28:06.124414+0000","last_clean":"2024-09-13T18:28:06.124414+0000","last_became_active":"2024-09-13T18:28:05.090606+0000","last_became_peered":"2024-09-13T18:28:05.090606+0000","last_unstale":"2024-09-13T18:28:06.124414+0000","last_undegraded":"2024-09-13T18:28:06.124414+0000","last_fullsized":"2024-09-13T18:28:06.124414+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:41.571876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.084852+0000","last_change":"2024-09-13T18:28:04.691483+0000","last_active":"2024-09-13T18:28:05.084852+0000","last_peered":"2024-09-13T18:28:05.084852+0000","last_clean":"2024-09-13T18:28:05.084852+0000","last_became_active":"2024-09-13T18:28:04.691135+0000","last_became_peered":"2024-09-13T18:28:04.691135+0000","last_unstale":"2024-09-13T18:28:05.084852+0000","last_undegraded":"2024-09-13T18:28:05.084852+0000","last_fullsized":"2024-09-13T18:28:05.084852+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:12.871246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124812+0000","last_change":"2024-09-13T18:28:05.096021+0000","last_active":"2024-09-13T18:28:06.124812+0000","last_peered":"2024-09-13T18:28:06.124812+0000","last_clean":"2024-09-13T18:28:06.124812+0000","last_became_active":"2024-09-13T18:28:05.095790+0000","last_became_peered":"2024-09-13T18:28:05.095790+0000","last_unstale":"2024-09-13T18:28:06.124812+0000","last_undegraded":"2024-09-13T18:28:06.124812+0000","last_fullsized":"2024-09-13T18:28:06.124812+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:34.919966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.069222+0000","last_change":"2024-09-13T18:28:04.700371+0000","last_active":"2024-09-13T18:28:05.069222+0000","last_peered":"2024-09-13T18:28:05.069222+0000","last_clean":"2024-09-13T18:28:05.069222+0000","last_became_active":"2024-09-13T18:28:04.700114+0000","last_became_peered":"2024-09-13T18:28:04.700114+0000","last_unstale":"2024-09-13T18:28:05.069222+0000","last_undegraded":"2024-09-13T18:28:05.069222+0000","last_fullsized":"2024-09-13T18:28:05.069222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:38.670033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.078615+0000","last_change":"2024-09-13T18:28:05.093628+0000","last_active":"2024-09-13T18:28:06.078615+0000","last_peered":"2024-09-13T18:28:06.078615+0000","last_clean":"2024-09-13T18:28:06.078615+0000","last_became_active":"2024-09-13T18:28:05.093376+0000","last_became_peered":"2024-09-13T18:28:05.093376+0000","last_unstale":"2024-09-13T18:28:06.078615+0000","last_undegraded":"2024-09-13T18:28:06.078615+0000","last_fullsized":"2024-09-13T18:28:06.078615+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:00.027242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.086887+0000","last_change":"2024-09-13T18:28:04.696846+0000","last_active":"2024-09-13T18:28:05.086887+0000","last_peered":"2024-09-13T18:28:05.086887+0000","last_clean":"2024-09-13T18:28:05.086887+0000","last_became_active":"2024-09-13T18:28:04.696487+0000","last_became_peered":"2024-09-13T18:28:04.696487+0000","last_unstale":"2024-09-13T18:28:05.086887+0000","last_undegraded":"2024-09-13T18:28:05.086887+0000","last_fullsized":"2024-09-13T18:28:05.086887+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:59.837694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124065+0000","last_change":"2024-09-13T18:28:05.096018+0000","last_active":"2024-09-13T18:28:06.124065+0000","last_peered":"2024-09-13T18:28:06.124065+0000","last_clean":"2024-09-13T18:28:06.124065+0000","last_became_active":"2024-09-13T18:28:05.095391+0000","last_became_peered":"2024-09-13T18:28:05.095391+0000","last_unstale":"2024-09-13T18:28:06.124065+0000","last_undegraded":"2024-09-13T18:28:06.124065+0000","last_fullsized":"2024-09-13T18:28:06.124065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:09.578952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.086059+0000","last_change":"2024-09-13T18:28:04.702176+0000","last_active":"2024-09-13T18:28:05.086059+0000","last_peered":"2024-09-13T18:28:05.086059+0000","last_clean":"2024-09-13T18:28:05.086059+0000","last_became_active":"2024-09-13T18:28:04.700006+0000","last_became_peered":"2024-09-13T18:28:04.700006+0000","last_unstale":"2024-09-13T18:28:05.086059+0000","last_undegraded":"2024-09-13T18:28:05.086059+0000","last_fullsized":"2024-09-13T18:28:05.086059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:35.414482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124609+0000","last_change":"2024-09-13T18:28:05.076887+0000","last_active":"2024-09-13T18:28:06.124609+0000","last_peered":"2024-09-13T18:28:06.124609+0000","last_clean":"2024-09-13T18:28:06.124609+0000","last_became_active":"2024-09-13T18:28:05.076325+0000","last_became_peered":"2024-09-13T18:28:05.076325+0000","last_unstale":"2024-09-13T18:28:06.124609+0000","last_undegraded":"2024-09-13T18:28:06.124609+0000","last_fullsized":"2024-09-13T18:28:06.124609+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:53.035865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.073251+0000","last_change":"2024-09-13T18:28:04.698321+0000","last_active":"2024-09-13T18:28:05.073251+0000","last_peered":"2024-09-13T18:28:05.073251+0000","last_clean":"2024-09-13T18:28:05.073251+0000","last_became_active":"2024-09-13T18:28:04.698076+0000","last_became_peered":"2024-09-13T18:28:04.698076+0000","last_unstale":"2024-09-13T18:28:05.073251+0000","last_undegraded":"2024-09-13T18:28:05.073251+0000","last_fullsized":"2024-09-13T18:28:05.073251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:26.748656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.072359+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:28:05.072359+0000","last_peered":"2024-09-13T18:28:05.072359+0000","last_clean":"2024-09-13T18:28:05.072359+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:28:05.072359+0000","last_undegraded":"2024-09-13T18:28:05.072359+0000","last_fullsized":"2024-09-13T18:28:05.072359+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":995328,"data_stored":747032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.96499999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.998},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.044}]},{"osd":2,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.111}]},{"osd":3,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.92300000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.145}]},{"osd":5,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":1.302},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.66900000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":1.091},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.0740000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":157190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.77000000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":1.1859999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.0820000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.056}]},{"osd":4,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0249999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.268},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.0029999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.2270000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":157246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.90700000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.92800000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.85499999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.97399999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.879},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.68500000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":1.054},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.1100000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.1899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":405504,"data_stored":156678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.997}]},{"osd":1,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.73099999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.88100000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.90200000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.3889999999999998,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.042}]},{"osd":6,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.0189999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.86099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":158160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.89700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.79700000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.64900000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.873}]},{"osd":5,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":1.0580000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.03}]},{"osd":7,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.179},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.96899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":156644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.78000000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.69199999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.95899999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.876},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.147}]},{"osd":5,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.111}]},{"osd":6,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.762,"5min":2.762,"15min":2.762},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.204}]},{"osd":7,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":1.081},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.26}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":158160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.69799999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.71599999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.64100000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.0309999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.123},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.1919999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.1639999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.26},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.85099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":991232,"data_stored":746942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.73999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.68200000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.70199999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.4810000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.4179999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.355},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.288}]},{"osd":7,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.327},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.1910000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:28:13.603 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:28:13.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.722+0000 7facccffb700 1 Processor -- start 2024-09-13T18:28:13.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.722+0000 7facccffb700 1 -- start start 2024-09-13T18:28:13.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.722+0000 7facccffb700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7facc815a8e0 0x7facc806ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:13.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.722+0000 7facccffb700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7facc80d0780 0x7facc80d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:13.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.722+0000 7facccffb700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7facc80b5c00 0x7facc80b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:13.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.722+0000 7facccffb700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc815ce50 con 0x7facc80b5c00 2024-09-13T18:28:13.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.722+0000 7facccffb700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc80d1120 con 0x7facc80d0780 2024-09-13T18:28:13.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.722+0000 7facccffb700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc815c240 con 0x7facc815a8e0 2024-09-13T18:28:13.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.722+0000 7facc7fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7facc80b5c00 0x7facc80b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:13.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.722+0000 7facc7fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7facc80b5c00 0x7facc80b60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50710/0 (socket says 172.21.15.44:50710) 2024-09-13T18:28:13.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.722+0000 7facc7fff700 1 -- 172.21.15.44:0/1786744027 learned_addr learned my addr 172.21.15.44:0/1786744027 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:13.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.726+0000 7facc6ffd700 1 --2- 172.21.15.44:0/1786744027 >> v2:172.21.15.99:3300/0 conn(0x7facc80d0780 0x7facc80d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:13.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.726+0000 7facc77fe700 1 --2- 172.21.15.44:0/1786744027 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7facc815a8e0 0x7facc806ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:13.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.726+0000 7facc7fff700 1 -- 172.21.15.44:0/1786744027 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7facc815a8e0 msgr2=0x7facc806ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:13.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.726+0000 7facc7fff700 1 --2- 172.21.15.44:0/1786744027 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7facc815a8e0 0x7facc806ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.726+0000 7facc7fff700 1 -- 172.21.15.44:0/1786744027 >> v2:172.21.15.99:3300/0 conn(0x7facc80d0780 msgr2=0x7facc80d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:13.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.726+0000 7facc7fff700 1 --2- 172.21.15.44:0/1786744027 >> v2:172.21.15.99:3300/0 conn(0x7facc80d0780 0x7facc80d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.726+0000 7facc7fff700 1 -- 172.21.15.44:0/1786744027 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc815c520 con 0x7facc80b5c00 2024-09-13T18:28:13.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.726+0000 7facc7fff700 1 --2- 172.21.15.44:0/1786744027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7facc80b5c00 0x7facc80b60b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7facc806ae10 tx=0x7facc000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e6008448c15fd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:13.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.726+0000 7facc67fc700 1 -- 172.21.15.44:0/1786744027 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc000e070 con 0x7facc80b5c00 2024-09-13T18:28:13.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.726+0000 7facc67fc700 1 -- 172.21.15.44:0/1786744027 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc000b9c0 con 0x7facc80b5c00 2024-09-13T18:28:13.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.726+0000 7facc67fc700 1 -- 172.21.15.44:0/1786744027 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc000bd70 con 0x7facc80b5c00 2024-09-13T18:28:13.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.726+0000 7facccffb700 1 -- 172.21.15.44:0/1786744027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7facc80b5c00 msgr2=0x7facc80b60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:13.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.726+0000 7facccffb700 1 --2- 172.21.15.44:0/1786744027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7facc80b5c00 0x7facc80b60b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7facc806ae10 tx=0x7facc000b330 comp rx=0 tx=0).stop 2024-09-13T18:28:13.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.726+0000 7facccffb700 1 -- 172.21.15.44:0/1786744027 shutdown_connections 2024-09-13T18:28:13.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.726+0000 7facccffb700 1 --2- 172.21.15.44:0/1786744027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7facc80b5c00 0x7facc80b60b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.726+0000 7facccffb700 1 --2- 172.21.15.44:0/1786744027 >> v2:172.21.15.99:3300/0 conn(0x7facc80d0780 0x7facc80d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.726+0000 7facccffb700 1 --2- 172.21.15.44:0/1786744027 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7facc815a8e0 0x7facc806ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.726+0000 7facccffb700 1 -- 172.21.15.44:0/1786744027 >> 172.21.15.44:0/1786744027 conn(0x7facc806a730 msgr2=0x7facc8071d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:13.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.726+0000 7facccffb700 1 -- 172.21.15.44:0/1786744027 shutdown_connections 2024-09-13T18:28:13.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.726+0000 7facccffb700 1 -- 172.21.15.44:0/1786744027 wait complete. 2024-09-13T18:28:13.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facccffb700 1 Processor -- start 2024-09-13T18:28:13.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facccffb700 1 -- start start 2024-09-13T18:28:13.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facccffb700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7facc80b5c00 0x7facc80c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:13.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facccffb700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facc80d0780 0x7facc81514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:13.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facccffb700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7facc815a8e0 0x7facc81519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:13.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facccffb700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc8146760 con 0x7facc80b5c00 2024-09-13T18:28:13.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facccffb700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc8140e90 con 0x7facc80d0780 2024-09-13T18:28:13.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facccffb700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc8140860 con 0x7facc815a8e0 2024-09-13T18:28:13.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facc77fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7facc80b5c00 0x7facc80c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:13.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facc77fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7facc80b5c00 0x7facc80c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50712/0 (socket says 172.21.15.44:50712) 2024-09-13T18:28:13.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facc77fe700 1 -- 172.21.15.44:0/3798346603 learned_addr learned my addr 172.21.15.44:0/3798346603 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:13.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facc6ffd700 1 --2- 172.21.15.44:0/3798346603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facc80d0780 0x7facc81514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:13.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facc7fff700 1 --2- 172.21.15.44:0/3798346603 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7facc815a8e0 0x7facc81519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:13.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facc77fe700 1 -- 172.21.15.44:0/3798346603 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7facc815a8e0 msgr2=0x7facc81519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:13.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facc77fe700 1 --2- 172.21.15.44:0/3798346603 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7facc815a8e0 0x7facc81519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facc77fe700 1 -- 172.21.15.44:0/3798346603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facc80d0780 msgr2=0x7facc81514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:13.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facc77fe700 1 --2- 172.21.15.44:0/3798346603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facc80d0780 0x7facc81514b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facc77fe700 1 -- 172.21.15.44:0/3798346603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc0009b30 con 0x7facc80b5c00 2024-09-13T18:28:13.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facc6ffd700 1 --2- 172.21.15.44:0/3798346603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facc80d0780 0x7facc81514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:13.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facc77fe700 1 --2- 172.21.15.44:0/3798346603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7facc80b5c00 0x7facc80c61e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7facb800c7f0 tx=0x7facb800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:13.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facaffff700 1 -- 172.21.15.44:0/3798346603 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb8011800 con 0x7facc80b5c00 2024-09-13T18:28:13.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facaffff700 1 -- 172.21.15.44:0/3798346603 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb8011960 con 0x7facc80b5c00 2024-09-13T18:28:13.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facccffb700 1 -- 172.21.15.44:0/3798346603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc81520c0 con 0x7facc80b5c00 2024-09-13T18:28:13.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facaffff700 1 -- 172.21.15.44:0/3798346603 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb8011cf0 con 0x7facc80b5c00 2024-09-13T18:28:13.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.730+0000 7facccffb700 1 -- 172.21.15.44:0/3798346603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc8140b20 con 0x7facc80b5c00 2024-09-13T18:28:13.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.734+0000 7facccffb700 1 -- 172.21.15.44:0/3798346603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc80cd260 con 0x7facc80b5c00 2024-09-13T18:28:13.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.734+0000 7facaffff700 1 -- 172.21.15.44:0/3798346603 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7facb8018360 con 0x7facc80b5c00 2024-09-13T18:28:13.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.734+0000 7facaffff700 1 --2- 172.21.15.44:0/3798346603 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7facb4066730 0x7facb4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:13.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.734+0000 7facaffff700 1 -- 172.21.15.44:0/3798346603 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facb80840b0 con 0x7facc80b5c00 2024-09-13T18:28:13.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.734+0000 7facc6ffd700 1 --2- 172.21.15.44:0/3798346603 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7facb4066730 0x7facb4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:13.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.738+0000 7facc6ffd700 1 --2- 172.21.15.44:0/3798346603 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7facb4066730 0x7facb4068bf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7facc814f7c0 tx=0x7facbc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:13.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.742+0000 7facaffff700 1 -- 172.21.15.44:0/3798346603 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7facb8051390 con 0x7facc80b5c00 2024-09-13T18:28:13.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.906+0000 7facccffb700 1 -- 172.21.15.44:0/3798346603 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7facc806f0f0 con 0x7facb4066730 2024-09-13T18:28:13.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.926+0000 7facaffff700 1 -- 172.21.15.44:0/3798346603 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287943 (secure 0 0 0) 0x7facbc0096a0 con 0x7facb4066730 2024-09-13T18:28:13.934 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:13.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.930+0000 7facccffb700 1 -- 172.21.15.44:0/3798346603 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7facb4066730 msgr2=0x7facb4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:13.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.930+0000 7facccffb700 1 --2- 172.21.15.44:0/3798346603 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7facb4066730 0x7facb4068bf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7facc814f7c0 tx=0x7facbc008040 comp rx=0 tx=0).stop 2024-09-13T18:28:13.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.930+0000 7facccffb700 1 -- 172.21.15.44:0/3798346603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7facc80b5c00 msgr2=0x7facc80c61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:13.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.930+0000 7facccffb700 1 --2- 172.21.15.44:0/3798346603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7facc80b5c00 0x7facc80c61e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7facb800c7f0 tx=0x7facb800cbb0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.930+0000 7facccffb700 1 -- 172.21.15.44:0/3798346603 shutdown_connections 2024-09-13T18:28:13.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.930+0000 7facccffb700 1 --2- 172.21.15.44:0/3798346603 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7facb4066730 0x7facb4068bf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.930+0000 7facccffb700 1 --2- 172.21.15.44:0/3798346603 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7facc815a8e0 0x7facc81519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.930+0000 7facccffb700 1 --2- 172.21.15.44:0/3798346603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facc80d0780 0x7facc81514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.930+0000 7facccffb700 1 --2- 172.21.15.44:0/3798346603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7facc80b5c00 0x7facc80c61e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.930+0000 7facccffb700 1 -- 172.21.15.44:0/3798346603 >> 172.21.15.44:0/3798346603 conn(0x7facc806a730 msgr2=0x7facc80cd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:13.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.930+0000 7facccffb700 1 -- 172.21.15.44:0/3798346603 shutdown_connections 2024-09-13T18:28:13.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:13.930+0000 7facccffb700 1 -- 172.21.15.44:0/3798346603 wait complete. 2024-09-13T18:28:13.937 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:28:13.949 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-09-13T18:28:12.342067+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220540,"kb_used_data":4328,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754180,"statfs":{"total":773094113280,"available":772868280320,"internally_reserved":0,"allocated":4431872,"data_stored":2438052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.666333"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124010+0000","last_change":"2024-09-13T18:28:05.088360+0000","last_active":"2024-09-13T18:28:06.124010+0000","last_peered":"2024-09-13T18:28:06.124010+0000","last_clean":"2024-09-13T18:28:06.124010+0000","last_became_active":"2024-09-13T18:28:05.087928+0000","last_became_peered":"2024-09-13T18:28:05.087928+0000","last_unstale":"2024-09-13T18:28:06.124010+0000","last_undegraded":"2024-09-13T18:28:06.124010+0000","last_fullsized":"2024-09-13T18:28:06.124010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:50.909232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.079976+0000","last_change":"2024-09-13T18:28:05.092675+0000","last_active":"2024-09-13T18:28:06.079976+0000","last_peered":"2024-09-13T18:28:06.079976+0000","last_clean":"2024-09-13T18:28:06.079976+0000","last_became_active":"2024-09-13T18:28:05.092426+0000","last_became_peered":"2024-09-13T18:28:05.092426+0000","last_unstale":"2024-09-13T18:28:06.079976+0000","last_undegraded":"2024-09-13T18:28:06.079976+0000","last_fullsized":"2024-09-13T18:28:06.079976+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:21.271196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.077717+0000","last_change":"2024-09-13T18:28:05.093768+0000","last_active":"2024-09-13T18:28:06.077717+0000","last_peered":"2024-09-13T18:28:06.077717+0000","last_clean":"2024-09-13T18:28:06.077717+0000","last_became_active":"2024-09-13T18:28:05.093449+0000","last_became_peered":"2024-09-13T18:28:05.093449+0000","last_unstale":"2024-09-13T18:28:06.077717+0000","last_undegraded":"2024-09-13T18:28:06.077717+0000","last_fullsized":"2024-09-13T18:28:06.077717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:46.785919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.079410+0000","last_change":"2024-09-13T18:28:05.100243+0000","last_active":"2024-09-13T18:28:06.079410+0000","last_peered":"2024-09-13T18:28:06.079410+0000","last_clean":"2024-09-13T18:28:06.079410+0000","last_became_active":"2024-09-13T18:28:05.099429+0000","last_became_peered":"2024-09-13T18:28:05.099429+0000","last_unstale":"2024-09-13T18:28:06.079410+0000","last_undegraded":"2024-09-13T18:28:06.079410+0000","last_fullsized":"2024-09-13T18:28:06.079410+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:46.785919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.126637+0000","last_change":"2024-09-13T18:28:05.098046+0000","last_active":"2024-09-13T18:28:06.126637+0000","last_peered":"2024-09-13T18:28:06.126637+0000","last_clean":"2024-09-13T18:28:06.126637+0000","last_became_active":"2024-09-13T18:28:05.097751+0000","last_became_peered":"2024-09-13T18:28:05.097751+0000","last_unstale":"2024-09-13T18:28:06.126637+0000","last_undegraded":"2024-09-13T18:28:06.126637+0000","last_fullsized":"2024-09-13T18:28:06.126637+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:24.515101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.079635+0000","last_change":"2024-09-13T18:28:05.096203+0000","last_active":"2024-09-13T18:28:06.079635+0000","last_peered":"2024-09-13T18:28:06.079635+0000","last_clean":"2024-09-13T18:28:06.079635+0000","last_became_active":"2024-09-13T18:28:05.095617+0000","last_became_peered":"2024-09-13T18:28:05.095617+0000","last_unstale":"2024-09-13T18:28:06.079635+0000","last_undegraded":"2024-09-13T18:28:06.079635+0000","last_fullsized":"2024-09-13T18:28:06.079635+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:01.427692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124593+0000","last_change":"2024-09-13T18:28:05.082230+0000","last_active":"2024-09-13T18:28:06.124593+0000","last_peered":"2024-09-13T18:28:06.124593+0000","last_clean":"2024-09-13T18:28:06.124593+0000","last_became_active":"2024-09-13T18:28:05.081249+0000","last_became_peered":"2024-09-13T18:28:05.081249+0000","last_unstale":"2024-09-13T18:28:06.124593+0000","last_undegraded":"2024-09-13T18:28:06.124593+0000","last_fullsized":"2024-09-13T18:28:06.124593+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:25.028196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.123829+0000","last_change":"2024-09-13T18:28:05.076775+0000","last_active":"2024-09-13T18:28:06.123829+0000","last_peered":"2024-09-13T18:28:06.123829+0000","last_clean":"2024-09-13T18:28:06.123829+0000","last_became_active":"2024-09-13T18:28:05.076431+0000","last_became_peered":"2024-09-13T18:28:05.076431+0000","last_unstale":"2024-09-13T18:28:06.123829+0000","last_undegraded":"2024-09-13T18:28:06.123829+0000","last_fullsized":"2024-09-13T18:28:06.123829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:07.569004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.126001+0000","last_change":"2024-09-13T18:28:05.097693+0000","last_active":"2024-09-13T18:28:06.126001+0000","last_peered":"2024-09-13T18:28:06.126001+0000","last_clean":"2024-09-13T18:28:06.126001+0000","last_became_active":"2024-09-13T18:28:05.097288+0000","last_became_peered":"2024-09-13T18:28:05.097288+0000","last_unstale":"2024-09-13T18:28:06.126001+0000","last_undegraded":"2024-09-13T18:28:06.126001+0000","last_fullsized":"2024-09-13T18:28:06.126001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:43.143004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.079781+0000","last_change":"2024-09-13T18:28:05.100913+0000","last_active":"2024-09-13T18:28:06.079781+0000","last_peered":"2024-09-13T18:28:06.079781+0000","last_clean":"2024-09-13T18:28:06.079781+0000","last_became_active":"2024-09-13T18:28:05.099195+0000","last_became_peered":"2024-09-13T18:28:05.099195+0000","last_unstale":"2024-09-13T18:28:06.079781+0000","last_undegraded":"2024-09-13T18:28:06.079781+0000","last_fullsized":"2024-09-13T18:28:06.079781+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:00.027242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.125045+0000","last_change":"2024-09-13T18:28:05.077317+0000","last_active":"2024-09-13T18:28:06.125045+0000","last_peered":"2024-09-13T18:28:06.125045+0000","last_clean":"2024-09-13T18:28:06.125045+0000","last_became_active":"2024-09-13T18:28:05.077112+0000","last_became_peered":"2024-09-13T18:28:05.077112+0000","last_unstale":"2024-09-13T18:28:06.125045+0000","last_undegraded":"2024-09-13T18:28:06.125045+0000","last_fullsized":"2024-09-13T18:28:06.125045+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:41.532371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.077295+0000","last_change":"2024-09-13T18:28:05.093648+0000","last_active":"2024-09-13T18:28:06.077295+0000","last_peered":"2024-09-13T18:28:06.077295+0000","last_clean":"2024-09-13T18:28:06.077295+0000","last_became_active":"2024-09-13T18:28:05.093327+0000","last_became_peered":"2024-09-13T18:28:05.093327+0000","last_unstale":"2024-09-13T18:28:06.077295+0000","last_undegraded":"2024-09-13T18:28:06.077295+0000","last_fullsized":"2024-09-13T18:28:06.077295+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:07.569004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.126731+0000","last_change":"2024-09-13T18:28:05.079792+0000","last_active":"2024-09-13T18:28:06.126731+0000","last_peered":"2024-09-13T18:28:06.126731+0000","last_clean":"2024-09-13T18:28:06.126731+0000","last_became_active":"2024-09-13T18:28:05.079533+0000","last_became_peered":"2024-09-13T18:28:05.079533+0000","last_unstale":"2024-09-13T18:28:06.126731+0000","last_undegraded":"2024-09-13T18:28:06.126731+0000","last_fullsized":"2024-09-13T18:28:06.126731+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:26.839265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.079772+0000","last_change":"2024-09-13T18:28:05.095970+0000","last_active":"2024-09-13T18:28:06.079772+0000","last_peered":"2024-09-13T18:28:06.079772+0000","last_clean":"2024-09-13T18:28:06.079772+0000","last_became_active":"2024-09-13T18:28:05.095293+0000","last_became_peered":"2024-09-13T18:28:05.095293+0000","last_unstale":"2024-09-13T18:28:06.079772+0000","last_undegraded":"2024-09-13T18:28:06.079772+0000","last_fullsized":"2024-09-13T18:28:06.079772+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:20.996616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.076897+0000","last_change":"2024-09-13T18:28:05.095379+0000","last_active":"2024-09-13T18:28:06.076897+0000","last_peered":"2024-09-13T18:28:06.076897+0000","last_clean":"2024-09-13T18:28:06.076897+0000","last_became_active":"2024-09-13T18:28:05.094947+0000","last_became_peered":"2024-09-13T18:28:05.094947+0000","last_unstale":"2024-09-13T18:28:06.076897+0000","last_undegraded":"2024-09-13T18:28:06.076897+0000","last_fullsized":"2024-09-13T18:28:06.076897+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:20.996616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124655+0000","last_change":"2024-09-13T18:28:05.093849+0000","last_active":"2024-09-13T18:28:06.124655+0000","last_peered":"2024-09-13T18:28:06.124655+0000","last_clean":"2024-09-13T18:28:06.124655+0000","last_became_active":"2024-09-13T18:28:05.093567+0000","last_became_peered":"2024-09-13T18:28:05.093567+0000","last_unstale":"2024-09-13T18:28:06.124655+0000","last_undegraded":"2024-09-13T18:28:06.124655+0000","last_fullsized":"2024-09-13T18:28:06.124655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:01.427692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.125302+0000","last_change":"2024-09-13T18:28:05.081931+0000","last_active":"2024-09-13T18:28:06.125302+0000","last_peered":"2024-09-13T18:28:06.125302+0000","last_clean":"2024-09-13T18:28:06.125302+0000","last_became_active":"2024-09-13T18:28:05.081546+0000","last_became_peered":"2024-09-13T18:28:05.081546+0000","last_unstale":"2024-09-13T18:28:06.125302+0000","last_undegraded":"2024-09-13T18:28:06.125302+0000","last_fullsized":"2024-09-13T18:28:06.125302+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:20.371685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.079998+0000","last_change":"2024-09-13T18:28:05.094207+0000","last_active":"2024-09-13T18:28:06.079998+0000","last_peered":"2024-09-13T18:28:06.079998+0000","last_clean":"2024-09-13T18:28:06.079998+0000","last_became_active":"2024-09-13T18:28:05.093956+0000","last_became_peered":"2024-09-13T18:28:05.093956+0000","last_unstale":"2024-09-13T18:28:06.079998+0000","last_undegraded":"2024-09-13T18:28:06.079998+0000","last_fullsized":"2024-09-13T18:28:06.079998+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:27.053514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.080683+0000","last_change":"2024-09-13T18:28:05.093918+0000","last_active":"2024-09-13T18:28:06.080683+0000","last_peered":"2024-09-13T18:28:06.080683+0000","last_clean":"2024-09-13T18:28:06.080683+0000","last_became_active":"2024-09-13T18:28:05.093611+0000","last_became_peered":"2024-09-13T18:28:05.093611+0000","last_unstale":"2024-09-13T18:28:06.080683+0000","last_undegraded":"2024-09-13T18:28:06.080683+0000","last_fullsized":"2024-09-13T18:28:06.080683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:46.785919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.126854+0000","last_change":"2024-09-13T18:28:05.090722+0000","last_active":"2024-09-13T18:28:06.126854+0000","last_peered":"2024-09-13T18:28:06.126854+0000","last_clean":"2024-09-13T18:28:06.126854+0000","last_became_active":"2024-09-13T18:28:05.090454+0000","last_became_peered":"2024-09-13T18:28:05.090454+0000","last_unstale":"2024-09-13T18:28:06.126854+0000","last_undegraded":"2024-09-13T18:28:06.126854+0000","last_fullsized":"2024-09-13T18:28:06.126854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:24.932773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.123550+0000","last_change":"2024-09-13T18:28:05.090695+0000","last_active":"2024-09-13T18:28:06.123550+0000","last_peered":"2024-09-13T18:28:06.123550+0000","last_clean":"2024-09-13T18:28:06.123550+0000","last_became_active":"2024-09-13T18:28:05.090382+0000","last_became_peered":"2024-09-13T18:28:05.090382+0000","last_unstale":"2024-09-13T18:28:06.123550+0000","last_undegraded":"2024-09-13T18:28:06.123550+0000","last_fullsized":"2024-09-13T18:28:06.123550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:39.682094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124687+0000","last_change":"2024-09-13T18:28:05.096139+0000","last_active":"2024-09-13T18:28:06.124687+0000","last_peered":"2024-09-13T18:28:06.124687+0000","last_clean":"2024-09-13T18:28:06.124687+0000","last_became_active":"2024-09-13T18:28:05.095035+0000","last_became_peered":"2024-09-13T18:28:05.095035+0000","last_unstale":"2024-09-13T18:28:06.124687+0000","last_undegraded":"2024-09-13T18:28:06.124687+0000","last_fullsized":"2024-09-13T18:28:06.124687+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:34.919966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124489+0000","last_change":"2024-09-13T18:28:05.091827+0000","last_active":"2024-09-13T18:28:06.124489+0000","last_peered":"2024-09-13T18:28:06.124489+0000","last_clean":"2024-09-13T18:28:06.124489+0000","last_became_active":"2024-09-13T18:28:05.091552+0000","last_became_peered":"2024-09-13T18:28:05.091552+0000","last_unstale":"2024-09-13T18:28:06.124489+0000","last_undegraded":"2024-09-13T18:28:06.124489+0000","last_fullsized":"2024-09-13T18:28:06.124489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:07.438422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.076895+0000","last_change":"2024-09-13T18:28:05.100612+0000","last_active":"2024-09-13T18:28:06.076895+0000","last_peered":"2024-09-13T18:28:06.076895+0000","last_clean":"2024-09-13T18:28:06.076895+0000","last_became_active":"2024-09-13T18:28:05.100343+0000","last_became_peered":"2024-09-13T18:28:05.100343+0000","last_unstale":"2024-09-13T18:28:06.076895+0000","last_undegraded":"2024-09-13T18:28:06.076895+0000","last_fullsized":"2024-09-13T18:28:06.076895+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:25.028196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.080323+0000","last_change":"2024-09-13T18:28:05.079767+0000","last_active":"2024-09-13T18:28:06.080323+0000","last_peered":"2024-09-13T18:28:06.080323+0000","last_clean":"2024-09-13T18:28:06.080323+0000","last_became_active":"2024-09-13T18:28:05.079346+0000","last_became_peered":"2024-09-13T18:28:05.079346+0000","last_unstale":"2024-09-13T18:28:06.080323+0000","last_undegraded":"2024-09-13T18:28:06.080323+0000","last_fullsized":"2024-09-13T18:28:06.080323+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:07.569004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.080126+0000","last_change":"2024-09-13T18:28:05.096292+0000","last_active":"2024-09-13T18:28:06.080126+0000","last_peered":"2024-09-13T18:28:06.080126+0000","last_clean":"2024-09-13T18:28:06.080126+0000","last_became_active":"2024-09-13T18:28:05.096057+0000","last_became_peered":"2024-09-13T18:28:05.096057+0000","last_unstale":"2024-09-13T18:28:06.080126+0000","last_undegraded":"2024-09-13T18:28:06.080126+0000","last_fullsized":"2024-09-13T18:28:06.080126+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:53.035865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.079966+0000","last_change":"2024-09-13T18:28:05.100687+0000","last_active":"2024-09-13T18:28:06.079966+0000","last_peered":"2024-09-13T18:28:06.079966+0000","last_clean":"2024-09-13T18:28:06.079966+0000","last_became_active":"2024-09-13T18:28:05.100302+0000","last_became_peered":"2024-09-13T18:28:05.100302+0000","last_unstale":"2024-09-13T18:28:06.079966+0000","last_undegraded":"2024-09-13T18:28:06.079966+0000","last_fullsized":"2024-09-13T18:28:06.079966+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:20.996616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.077412+0000","last_change":"2024-09-13T18:28:05.099034+0000","last_active":"2024-09-13T18:28:06.077412+0000","last_peered":"2024-09-13T18:28:06.077412+0000","last_clean":"2024-09-13T18:28:06.077412+0000","last_became_active":"2024-09-13T18:28:05.098737+0000","last_became_peered":"2024-09-13T18:28:05.098737+0000","last_unstale":"2024-09-13T18:28:06.077412+0000","last_undegraded":"2024-09-13T18:28:06.077412+0000","last_fullsized":"2024-09-13T18:28:06.077412+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:53.958704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.125076+0000","last_change":"2024-09-13T18:28:05.097071+0000","last_active":"2024-09-13T18:28:06.125076+0000","last_peered":"2024-09-13T18:28:06.125076+0000","last_clean":"2024-09-13T18:28:06.125076+0000","last_became_active":"2024-09-13T18:28:05.096741+0000","last_became_peered":"2024-09-13T18:28:05.096741+0000","last_unstale":"2024-09-13T18:28:06.125076+0000","last_undegraded":"2024-09-13T18:28:06.125076+0000","last_fullsized":"2024-09-13T18:28:06.125076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:21.822290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.123928+0000","last_change":"2024-09-13T18:28:05.079325+0000","last_active":"2024-09-13T18:28:06.123928+0000","last_peered":"2024-09-13T18:28:06.123928+0000","last_clean":"2024-09-13T18:28:06.123928+0000","last_became_active":"2024-09-13T18:28:05.078997+0000","last_became_peered":"2024-09-13T18:28:05.078997+0000","last_unstale":"2024-09-13T18:28:06.123928+0000","last_undegraded":"2024-09-13T18:28:06.123928+0000","last_fullsized":"2024-09-13T18:28:06.123928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:20.996616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.125371+0000","last_change":"2024-09-13T18:28:05.078849+0000","last_active":"2024-09-13T18:28:06.125371+0000","last_peered":"2024-09-13T18:28:06.125371+0000","last_clean":"2024-09-13T18:28:06.125371+0000","last_became_active":"2024-09-13T18:28:05.078583+0000","last_became_peered":"2024-09-13T18:28:05.078583+0000","last_unstale":"2024-09-13T18:28:06.125371+0000","last_undegraded":"2024-09-13T18:28:06.125371+0000","last_fullsized":"2024-09-13T18:28:06.125371+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:40.162785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124068+0000","last_change":"2024-09-13T18:28:05.095531+0000","last_active":"2024-09-13T18:28:06.124068+0000","last_peered":"2024-09-13T18:28:06.124068+0000","last_clean":"2024-09-13T18:28:06.124068+0000","last_became_active":"2024-09-13T18:28:05.094639+0000","last_became_peered":"2024-09-13T18:28:05.094639+0000","last_unstale":"2024-09-13T18:28:06.124068+0000","last_undegraded":"2024-09-13T18:28:06.124068+0000","last_fullsized":"2024-09-13T18:28:06.124068+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:00.027242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124818+0000","last_change":"2024-09-13T18:28:05.091014+0000","last_active":"2024-09-13T18:28:06.124818+0000","last_peered":"2024-09-13T18:28:06.124818+0000","last_clean":"2024-09-13T18:28:06.124818+0000","last_became_active":"2024-09-13T18:28:05.090767+0000","last_became_peered":"2024-09-13T18:28:05.090767+0000","last_unstale":"2024-09-13T18:28:06.124818+0000","last_undegraded":"2024-09-13T18:28:06.124818+0000","last_fullsized":"2024-09-13T18:28:06.124818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:50.909232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.095877+0000","last_change":"2024-09-13T18:28:04.694663+0000","last_active":"2024-09-13T18:28:05.095877+0000","last_peered":"2024-09-13T18:28:05.095877+0000","last_clean":"2024-09-13T18:28:05.095877+0000","last_became_active":"2024-09-13T18:28:04.694398+0000","last_became_peered":"2024-09-13T18:28:04.694398+0000","last_unstale":"2024-09-13T18:28:05.095877+0000","last_undegraded":"2024-09-13T18:28:05.095877+0000","last_fullsized":"2024-09-13T18:28:05.095877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:32.822140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124192+0000","last_change":"2024-09-13T18:28:05.092994+0000","last_active":"2024-09-13T18:28:06.124192+0000","last_peered":"2024-09-13T18:28:06.124192+0000","last_clean":"2024-09-13T18:28:06.124192+0000","last_became_active":"2024-09-13T18:28:05.092480+0000","last_became_peered":"2024-09-13T18:28:05.092480+0000","last_unstale":"2024-09-13T18:28:06.124192+0000","last_undegraded":"2024-09-13T18:28:06.124192+0000","last_fullsized":"2024-09-13T18:28:06.124192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:20.371685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.090576+0000","last_change":"2024-09-13T18:28:04.698296+0000","last_active":"2024-09-13T18:28:05.090576+0000","last_peered":"2024-09-13T18:28:05.090576+0000","last_clean":"2024-09-13T18:28:05.090576+0000","last_became_active":"2024-09-13T18:28:04.697969+0000","last_became_peered":"2024-09-13T18:28:04.697969+0000","last_unstale":"2024-09-13T18:28:05.090576+0000","last_undegraded":"2024-09-13T18:28:05.090576+0000","last_fullsized":"2024-09-13T18:28:05.090576+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:32.822140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.125512+0000","last_change":"2024-09-13T18:28:05.094442+0000","last_active":"2024-09-13T18:28:06.125512+0000","last_peered":"2024-09-13T18:28:06.125512+0000","last_clean":"2024-09-13T18:28:06.125512+0000","last_became_active":"2024-09-13T18:28:05.094133+0000","last_became_peered":"2024-09-13T18:28:05.094133+0000","last_unstale":"2024-09-13T18:28:06.125512+0000","last_undegraded":"2024-09-13T18:28:06.125512+0000","last_fullsized":"2024-09-13T18:28:06.125512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:27.760716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.100025+0000","last_change":"2024-09-13T18:28:04.703043+0000","last_active":"2024-09-13T18:28:05.100025+0000","last_peered":"2024-09-13T18:28:05.100025+0000","last_clean":"2024-09-13T18:28:05.100025+0000","last_became_active":"2024-09-13T18:28:04.702812+0000","last_became_peered":"2024-09-13T18:28:04.702812+0000","last_unstale":"2024-09-13T18:28:05.100025+0000","last_undegraded":"2024-09-13T18:28:05.100025+0000","last_fullsized":"2024-09-13T18:28:05.100025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:42.130944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.080059+0000","last_change":"2024-09-13T18:28:05.100534+0000","last_active":"2024-09-13T18:28:06.080059+0000","last_peered":"2024-09-13T18:28:06.080059+0000","last_clean":"2024-09-13T18:28:06.080059+0000","last_became_active":"2024-09-13T18:28:05.099338+0000","last_became_peered":"2024-09-13T18:28:05.099338+0000","last_unstale":"2024-09-13T18:28:06.080059+0000","last_undegraded":"2024-09-13T18:28:06.080059+0000","last_fullsized":"2024-09-13T18:28:06.080059+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:23.427581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.096973+0000","last_change":"2024-09-13T18:28:04.702536+0000","last_active":"2024-09-13T18:28:05.096973+0000","last_peered":"2024-09-13T18:28:05.096973+0000","last_clean":"2024-09-13T18:28:05.096973+0000","last_became_active":"2024-09-13T18:28:04.702236+0000","last_became_peered":"2024-09-13T18:28:04.702236+0000","last_unstale":"2024-09-13T18:28:05.096973+0000","last_undegraded":"2024-09-13T18:28:05.096973+0000","last_fullsized":"2024-09-13T18:28:05.096973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:33.121990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124175+0000","last_change":"2024-09-13T18:28:05.094849+0000","last_active":"2024-09-13T18:28:06.124175+0000","last_peered":"2024-09-13T18:28:06.124175+0000","last_clean":"2024-09-13T18:28:06.124175+0000","last_became_active":"2024-09-13T18:28:05.094563+0000","last_became_peered":"2024-09-13T18:28:05.094563+0000","last_unstale":"2024-09-13T18:28:06.124175+0000","last_undegraded":"2024-09-13T18:28:06.124175+0000","last_fullsized":"2024-09-13T18:28:06.124175+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:46.785919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.096979+0000","last_change":"2024-09-13T18:28:04.697709+0000","last_active":"2024-09-13T18:28:05.096979+0000","last_peered":"2024-09-13T18:28:05.096979+0000","last_clean":"2024-09-13T18:28:05.096979+0000","last_became_active":"2024-09-13T18:28:04.697460+0000","last_became_peered":"2024-09-13T18:28:04.697460+0000","last_unstale":"2024-09-13T18:28:05.096979+0000","last_undegraded":"2024-09-13T18:28:05.096979+0000","last_fullsized":"2024-09-13T18:28:05.096979+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:41:43.880877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.077261+0000","last_change":"2024-09-13T18:28:05.099082+0000","last_active":"2024-09-13T18:28:06.077261+0000","last_peered":"2024-09-13T18:28:06.077261+0000","last_clean":"2024-09-13T18:28:06.077261+0000","last_became_active":"2024-09-13T18:28:05.098788+0000","last_became_peered":"2024-09-13T18:28:05.098788+0000","last_unstale":"2024-09-13T18:28:06.077261+0000","last_undegraded":"2024-09-13T18:28:06.077261+0000","last_fullsized":"2024-09-13T18:28:06.077261+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:21.206373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.096928+0000","last_change":"2024-09-13T18:28:04.697139+0000","last_active":"2024-09-13T18:28:05.096928+0000","last_peered":"2024-09-13T18:28:05.096928+0000","last_clean":"2024-09-13T18:28:05.096928+0000","last_became_active":"2024-09-13T18:28:04.696682+0000","last_became_peered":"2024-09-13T18:28:04.696682+0000","last_unstale":"2024-09-13T18:28:05.096928+0000","last_undegraded":"2024-09-13T18:28:05.096928+0000","last_fullsized":"2024-09-13T18:28:05.096928+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:17.011477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.123707+0000","last_change":"2024-09-13T18:28:05.096386+0000","last_active":"2024-09-13T18:28:06.123707+0000","last_peered":"2024-09-13T18:28:06.123707+0000","last_clean":"2024-09-13T18:28:06.123707+0000","last_became_active":"2024-09-13T18:28:05.094644+0000","last_became_peered":"2024-09-13T18:28:05.094644+0000","last_unstale":"2024-09-13T18:28:06.123707+0000","last_undegraded":"2024-09-13T18:28:06.123707+0000","last_fullsized":"2024-09-13T18:28:06.123707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:36.426543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.085394+0000","last_change":"2024-09-13T18:28:04.696673+0000","last_active":"2024-09-13T18:28:05.085394+0000","last_peered":"2024-09-13T18:28:05.085394+0000","last_clean":"2024-09-13T18:28:05.085394+0000","last_became_active":"2024-09-13T18:28:04.696409+0000","last_became_peered":"2024-09-13T18:28:04.696409+0000","last_unstale":"2024-09-13T18:28:05.085394+0000","last_undegraded":"2024-09-13T18:28:05.085394+0000","last_fullsized":"2024-09-13T18:28:05.085394+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:12.871246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.078542+0000","last_change":"2024-09-13T18:28:05.096518+0000","last_active":"2024-09-13T18:28:06.078542+0000","last_peered":"2024-09-13T18:28:06.078542+0000","last_clean":"2024-09-13T18:28:06.078542+0000","last_became_active":"2024-09-13T18:28:05.095081+0000","last_became_peered":"2024-09-13T18:28:05.095081+0000","last_unstale":"2024-09-13T18:28:06.078542+0000","last_undegraded":"2024-09-13T18:28:06.078542+0000","last_fullsized":"2024-09-13T18:28:06.078542+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:01.427692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.086610+0000","last_change":"2024-09-13T18:28:04.694111+0000","last_active":"2024-09-13T18:28:05.086610+0000","last_peered":"2024-09-13T18:28:05.086610+0000","last_clean":"2024-09-13T18:28:05.086610+0000","last_became_active":"2024-09-13T18:28:04.693830+0000","last_became_peered":"2024-09-13T18:28:04.693830+0000","last_unstale":"2024-09-13T18:28:05.086610+0000","last_undegraded":"2024-09-13T18:28:05.086610+0000","last_fullsized":"2024-09-13T18:28:05.086610+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:37.246556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.077470+0000","last_change":"2024-09-13T18:28:05.092935+0000","last_active":"2024-09-13T18:28:06.077470+0000","last_peered":"2024-09-13T18:28:06.077470+0000","last_clean":"2024-09-13T18:28:06.077470+0000","last_became_active":"2024-09-13T18:28:05.092658+0000","last_became_peered":"2024-09-13T18:28:05.092658+0000","last_unstale":"2024-09-13T18:28:06.077470+0000","last_undegraded":"2024-09-13T18:28:06.077470+0000","last_fullsized":"2024-09-13T18:28:06.077470+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:53.035865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.085776+0000","last_change":"2024-09-13T18:28:04.702012+0000","last_active":"2024-09-13T18:28:05.085776+0000","last_peered":"2024-09-13T18:28:05.085776+0000","last_clean":"2024-09-13T18:28:05.085776+0000","last_became_active":"2024-09-13T18:28:04.700003+0000","last_became_peered":"2024-09-13T18:28:04.700003+0000","last_unstale":"2024-09-13T18:28:05.085776+0000","last_undegraded":"2024-09-13T18:28:05.085776+0000","last_fullsized":"2024-09-13T18:28:05.085776+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:38.670033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.080078+0000","last_change":"2024-09-13T18:28:05.095018+0000","last_active":"2024-09-13T18:28:06.080078+0000","last_peered":"2024-09-13T18:28:06.080078+0000","last_clean":"2024-09-13T18:28:06.080078+0000","last_became_active":"2024-09-13T18:28:05.094740+0000","last_became_peered":"2024-09-13T18:28:05.094740+0000","last_unstale":"2024-09-13T18:28:06.080078+0000","last_undegraded":"2024-09-13T18:28:06.080078+0000","last_fullsized":"2024-09-13T18:28:06.080078+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:41.532371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.085089+0000","last_change":"2024-09-13T18:28:04.699830+0000","last_active":"2024-09-13T18:28:05.085089+0000","last_peered":"2024-09-13T18:28:05.085089+0000","last_clean":"2024-09-13T18:28:05.085089+0000","last_became_active":"2024-09-13T18:28:04.699552+0000","last_became_peered":"2024-09-13T18:28:04.699552+0000","last_unstale":"2024-09-13T18:28:05.085089+0000","last_undegraded":"2024-09-13T18:28:05.085089+0000","last_fullsized":"2024-09-13T18:28:05.085089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:25.827205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.080071+0000","last_change":"2024-09-13T18:28:05.094786+0000","last_active":"2024-09-13T18:28:06.080071+0000","last_peered":"2024-09-13T18:28:06.080071+0000","last_clean":"2024-09-13T18:28:06.080071+0000","last_became_active":"2024-09-13T18:28:05.094538+0000","last_became_peered":"2024-09-13T18:28:05.094538+0000","last_unstale":"2024-09-13T18:28:06.080071+0000","last_undegraded":"2024-09-13T18:28:06.080071+0000","last_fullsized":"2024-09-13T18:28:06.080071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:07.569004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.090060+0000","last_change":"2024-09-13T18:28:04.694813+0000","last_active":"2024-09-13T18:28:05.090060+0000","last_peered":"2024-09-13T18:28:05.090060+0000","last_clean":"2024-09-13T18:28:05.090060+0000","last_became_active":"2024-09-13T18:28:04.694560+0000","last_became_peered":"2024-09-13T18:28:04.694560+0000","last_unstale":"2024-09-13T18:28:05.090060+0000","last_undegraded":"2024-09-13T18:28:05.090060+0000","last_fullsized":"2024-09-13T18:28:05.090060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:38.670033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.077537+0000","last_change":"2024-09-13T18:28:05.094023+0000","last_active":"2024-09-13T18:28:06.077537+0000","last_peered":"2024-09-13T18:28:06.077537+0000","last_clean":"2024-09-13T18:28:06.077537+0000","last_became_active":"2024-09-13T18:28:05.093696+0000","last_became_peered":"2024-09-13T18:28:05.093696+0000","last_unstale":"2024-09-13T18:28:06.077537+0000","last_undegraded":"2024-09-13T18:28:06.077537+0000","last_fullsized":"2024-09-13T18:28:06.077537+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:00.027242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.107338+0000","last_change":"2024-09-13T18:28:04.702585+0000","last_active":"2024-09-13T18:28:05.107338+0000","last_peered":"2024-09-13T18:28:05.107338+0000","last_clean":"2024-09-13T18:28:05.107338+0000","last_became_active":"2024-09-13T18:28:04.702318+0000","last_became_peered":"2024-09-13T18:28:04.702318+0000","last_unstale":"2024-09-13T18:28:05.107338+0000","last_undegraded":"2024-09-13T18:28:05.107338+0000","last_fullsized":"2024-09-13T18:28:05.107338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:26.748656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.078830+0000","last_change":"2024-09-13T18:28:05.096363+0000","last_active":"2024-09-13T18:28:06.078830+0000","last_peered":"2024-09-13T18:28:06.078830+0000","last_clean":"2024-09-13T18:28:06.078830+0000","last_became_active":"2024-09-13T18:28:05.095124+0000","last_became_peered":"2024-09-13T18:28:05.095124+0000","last_unstale":"2024-09-13T18:28:06.078830+0000","last_undegraded":"2024-09-13T18:28:06.078830+0000","last_fullsized":"2024-09-13T18:28:06.078830+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:21.271196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.097078+0000","last_change":"2024-09-13T18:28:04.696819+0000","last_active":"2024-09-13T18:28:05.097078+0000","last_peered":"2024-09-13T18:28:05.097078+0000","last_clean":"2024-09-13T18:28:05.097078+0000","last_became_active":"2024-09-13T18:28:04.694707+0000","last_became_peered":"2024-09-13T18:28:04.694707+0000","last_unstale":"2024-09-13T18:28:05.097078+0000","last_undegraded":"2024-09-13T18:28:05.097078+0000","last_fullsized":"2024-09-13T18:28:05.097078+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:39.589241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.079719+0000","last_change":"2024-09-13T18:28:05.097035+0000","last_active":"2024-09-13T18:28:06.079719+0000","last_peered":"2024-09-13T18:28:06.079719+0000","last_clean":"2024-09-13T18:28:06.079719+0000","last_became_active":"2024-09-13T18:28:05.096782+0000","last_became_peered":"2024-09-13T18:28:05.096782+0000","last_unstale":"2024-09-13T18:28:06.079719+0000","last_undegraded":"2024-09-13T18:28:06.079719+0000","last_fullsized":"2024-09-13T18:28:06.079719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:53.514705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.069128+0000","last_change":"2024-09-13T18:28:04.701044+0000","last_active":"2024-09-13T18:28:05.069128+0000","last_peered":"2024-09-13T18:28:05.069128+0000","last_clean":"2024-09-13T18:28:05.069128+0000","last_became_active":"2024-09-13T18:28:04.700732+0000","last_became_peered":"2024-09-13T18:28:04.700732+0000","last_unstale":"2024-09-13T18:28:05.069128+0000","last_undegraded":"2024-09-13T18:28:05.069128+0000","last_fullsized":"2024-09-13T18:28:05.069128+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:06.426362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124293+0000","last_change":"2024-09-13T18:28:05.092344+0000","last_active":"2024-09-13T18:28:06.124293+0000","last_peered":"2024-09-13T18:28:06.124293+0000","last_clean":"2024-09-13T18:28:06.124293+0000","last_became_active":"2024-09-13T18:28:05.092103+0000","last_became_peered":"2024-09-13T18:28:05.092103+0000","last_unstale":"2024-09-13T18:28:06.124293+0000","last_undegraded":"2024-09-13T18:28:06.124293+0000","last_fullsized":"2024-09-13T18:28:06.124293+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:21.271196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.085489+0000","last_change":"2024-09-13T18:28:04.699454+0000","last_active":"2024-09-13T18:28:05.085489+0000","last_peered":"2024-09-13T18:28:05.085489+0000","last_clean":"2024-09-13T18:28:05.085489+0000","last_became_active":"2024-09-13T18:28:04.699065+0000","last_became_peered":"2024-09-13T18:28:04.699065+0000","last_unstale":"2024-09-13T18:28:05.085489+0000","last_undegraded":"2024-09-13T18:28:05.085489+0000","last_fullsized":"2024-09-13T18:28:05.085489+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:08.566891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.125586+0000","last_change":"2024-09-13T18:28:05.090102+0000","last_active":"2024-09-13T18:28:06.125586+0000","last_peered":"2024-09-13T18:28:06.125586+0000","last_clean":"2024-09-13T18:28:06.125586+0000","last_became_active":"2024-09-13T18:28:05.089793+0000","last_became_peered":"2024-09-13T18:28:05.089793+0000","last_unstale":"2024-09-13T18:28:06.125586+0000","last_undegraded":"2024-09-13T18:28:06.125586+0000","last_fullsized":"2024-09-13T18:28:06.125586+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:53.514705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.102993+0000","last_change":"2024-09-13T18:28:04.702445+0000","last_active":"2024-09-13T18:28:05.102993+0000","last_peered":"2024-09-13T18:28:05.102993+0000","last_clean":"2024-09-13T18:28:05.102993+0000","last_became_active":"2024-09-13T18:28:04.702194+0000","last_became_peered":"2024-09-13T18:28:04.702194+0000","last_unstale":"2024-09-13T18:28:05.102993+0000","last_undegraded":"2024-09-13T18:28:05.102993+0000","last_fullsized":"2024-09-13T18:28:05.102993+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:32.822140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.125736+0000","last_change":"2024-09-13T18:28:05.093390+0000","last_active":"2024-09-13T18:28:06.125736+0000","last_peered":"2024-09-13T18:28:06.125736+0000","last_clean":"2024-09-13T18:28:06.125736+0000","last_became_active":"2024-09-13T18:28:05.093041+0000","last_became_peered":"2024-09-13T18:28:05.093041+0000","last_unstale":"2024-09-13T18:28:06.125736+0000","last_undegraded":"2024-09-13T18:28:06.125736+0000","last_fullsized":"2024-09-13T18:28:06.125736+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:33.834200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.091512+0000","last_change":"2024-09-13T18:28:04.705433+0000","last_active":"2024-09-13T18:28:05.091512+0000","last_peered":"2024-09-13T18:28:05.091512+0000","last_clean":"2024-09-13T18:28:05.091512+0000","last_became_active":"2024-09-13T18:28:04.705140+0000","last_became_peered":"2024-09-13T18:28:04.705140+0000","last_unstale":"2024-09-13T18:28:05.091512+0000","last_undegraded":"2024-09-13T18:28:05.091512+0000","last_fullsized":"2024-09-13T18:28:05.091512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:33.907905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.077584+0000","last_change":"2024-09-13T18:28:05.092329+0000","last_active":"2024-09-13T18:28:06.077584+0000","last_peered":"2024-09-13T18:28:06.077584+0000","last_clean":"2024-09-13T18:28:06.077584+0000","last_became_active":"2024-09-13T18:28:05.092045+0000","last_became_peered":"2024-09-13T18:28:05.092045+0000","last_unstale":"2024-09-13T18:28:06.077584+0000","last_undegraded":"2024-09-13T18:28:06.077584+0000","last_fullsized":"2024-09-13T18:28:06.077584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:01.427692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.093971+0000","last_change":"2024-09-13T18:28:04.699607+0000","last_active":"2024-09-13T18:28:05.093971+0000","last_peered":"2024-09-13T18:28:05.093971+0000","last_clean":"2024-09-13T18:28:05.093971+0000","last_became_active":"2024-09-13T18:28:04.699283+0000","last_became_peered":"2024-09-13T18:28:04.699283+0000","last_unstale":"2024-09-13T18:28:05.093971+0000","last_undegraded":"2024-09-13T18:28:05.093971+0000","last_fullsized":"2024-09-13T18:28:05.093971+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:47.115877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.079483+0000","last_change":"2024-09-13T18:28:05.100617+0000","last_active":"2024-09-13T18:28:06.079483+0000","last_peered":"2024-09-13T18:28:06.079483+0000","last_clean":"2024-09-13T18:28:06.079483+0000","last_became_active":"2024-09-13T18:28:05.100370+0000","last_became_peered":"2024-09-13T18:28:05.100370+0000","last_unstale":"2024-09-13T18:28:06.079483+0000","last_undegraded":"2024-09-13T18:28:06.079483+0000","last_fullsized":"2024-09-13T18:28:06.079483+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:53.035865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.100559+0000","last_change":"2024-09-13T18:28:04.697351+0000","last_active":"2024-09-13T18:28:05.100559+0000","last_peered":"2024-09-13T18:28:05.100559+0000","last_clean":"2024-09-13T18:28:05.100559+0000","last_became_active":"2024-09-13T18:28:04.697073+0000","last_became_peered":"2024-09-13T18:28:04.697073+0000","last_unstale":"2024-09-13T18:28:05.100559+0000","last_undegraded":"2024-09-13T18:28:05.100559+0000","last_fullsized":"2024-09-13T18:28:05.100559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:47.800960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.126922+0000","last_change":"2024-09-13T18:28:05.080975+0000","last_active":"2024-09-13T18:28:06.126922+0000","last_peered":"2024-09-13T18:28:06.126922+0000","last_clean":"2024-09-13T18:28:06.126922+0000","last_became_active":"2024-09-13T18:28:05.080746+0000","last_became_peered":"2024-09-13T18:28:05.080746+0000","last_unstale":"2024-09-13T18:28:06.126922+0000","last_undegraded":"2024-09-13T18:28:06.126922+0000","last_fullsized":"2024-09-13T18:28:06.126922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:44.939214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.086913+0000","last_change":"2024-09-13T18:28:04.697278+0000","last_active":"2024-09-13T18:28:05.086913+0000","last_peered":"2024-09-13T18:28:05.086913+0000","last_clean":"2024-09-13T18:28:05.086913+0000","last_became_active":"2024-09-13T18:28:04.696839+0000","last_became_peered":"2024-09-13T18:28:04.696839+0000","last_unstale":"2024-09-13T18:28:05.086913+0000","last_undegraded":"2024-09-13T18:28:05.086913+0000","last_fullsized":"2024-09-13T18:28:05.086913+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:55.211725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.126642+0000","last_change":"2024-09-13T18:28:05.092381+0000","last_active":"2024-09-13T18:28:06.126642+0000","last_peered":"2024-09-13T18:28:06.126642+0000","last_clean":"2024-09-13T18:28:06.126642+0000","last_became_active":"2024-09-13T18:28:05.092108+0000","last_became_peered":"2024-09-13T18:28:05.092108+0000","last_unstale":"2024-09-13T18:28:06.126642+0000","last_undegraded":"2024-09-13T18:28:06.126642+0000","last_fullsized":"2024-09-13T18:28:06.126642+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:36.710867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.095563+0000","last_change":"2024-09-13T18:28:04.695492+0000","last_active":"2024-09-13T18:28:05.095563+0000","last_peered":"2024-09-13T18:28:05.095563+0000","last_clean":"2024-09-13T18:28:05.095563+0000","last_became_active":"2024-09-13T18:28:04.695206+0000","last_became_peered":"2024-09-13T18:28:04.695206+0000","last_unstale":"2024-09-13T18:28:05.095563+0000","last_undegraded":"2024-09-13T18:28:05.095563+0000","last_fullsized":"2024-09-13T18:28:05.095563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:08.566891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.126919+0000","last_change":"2024-09-13T18:28:05.097221+0000","last_active":"2024-09-13T18:28:06.126919+0000","last_peered":"2024-09-13T18:28:06.126919+0000","last_clean":"2024-09-13T18:28:06.126919+0000","last_became_active":"2024-09-13T18:28:05.096946+0000","last_became_peered":"2024-09-13T18:28:05.096946+0000","last_unstale":"2024-09-13T18:28:06.126919+0000","last_undegraded":"2024-09-13T18:28:06.126919+0000","last_fullsized":"2024-09-13T18:28:06.126919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:38.746157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.075172+0000","last_change":"2024-09-13T18:28:04.700141+0000","last_active":"2024-09-13T18:28:05.075172+0000","last_peered":"2024-09-13T18:28:05.075172+0000","last_clean":"2024-09-13T18:28:05.075172+0000","last_became_active":"2024-09-13T18:28:04.699828+0000","last_became_peered":"2024-09-13T18:28:04.699828+0000","last_unstale":"2024-09-13T18:28:05.075172+0000","last_undegraded":"2024-09-13T18:28:05.075172+0000","last_fullsized":"2024-09-13T18:28:05.075172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:08.566891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.126531+0000","last_change":"2024-09-13T18:28:05.092322+0000","last_active":"2024-09-13T18:28:06.126531+0000","last_peered":"2024-09-13T18:28:06.126531+0000","last_clean":"2024-09-13T18:28:06.126531+0000","last_became_active":"2024-09-13T18:28:05.092056+0000","last_became_peered":"2024-09-13T18:28:05.092056+0000","last_unstale":"2024-09-13T18:28:06.126531+0000","last_undegraded":"2024-09-13T18:28:06.126531+0000","last_fullsized":"2024-09-13T18:28:06.126531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:11.662995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.086789+0000","last_change":"2024-09-13T18:28:04.700002+0000","last_active":"2024-09-13T18:28:05.086789+0000","last_peered":"2024-09-13T18:28:05.086789+0000","last_clean":"2024-09-13T18:28:05.086789+0000","last_became_active":"2024-09-13T18:28:04.699677+0000","last_became_peered":"2024-09-13T18:28:04.699677+0000","last_unstale":"2024-09-13T18:28:05.086789+0000","last_undegraded":"2024-09-13T18:28:05.086789+0000","last_fullsized":"2024-09-13T18:28:05.086789+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:33.128414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124234+0000","last_change":"2024-09-13T18:28:05.081378+0000","last_active":"2024-09-13T18:28:06.124234+0000","last_peered":"2024-09-13T18:28:06.124234+0000","last_clean":"2024-09-13T18:28:06.124234+0000","last_became_active":"2024-09-13T18:28:05.081097+0000","last_became_peered":"2024-09-13T18:28:05.081097+0000","last_unstale":"2024-09-13T18:28:06.124234+0000","last_undegraded":"2024-09-13T18:28:06.124234+0000","last_fullsized":"2024-09-13T18:28:06.124234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:29.444409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.081356+0000","last_change":"2024-09-13T18:28:04.695611+0000","last_active":"2024-09-13T18:28:05.081356+0000","last_peered":"2024-09-13T18:28:05.081356+0000","last_clean":"2024-09-13T18:28:05.081356+0000","last_became_active":"2024-09-13T18:28:04.695405+0000","last_became_peered":"2024-09-13T18:28:04.695405+0000","last_unstale":"2024-09-13T18:28:05.081356+0000","last_undegraded":"2024-09-13T18:28:05.081356+0000","last_fullsized":"2024-09-13T18:28:05.081356+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:35.414482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.126883+0000","last_change":"2024-09-13T18:28:05.090105+0000","last_active":"2024-09-13T18:28:06.126883+0000","last_peered":"2024-09-13T18:28:06.126883+0000","last_clean":"2024-09-13T18:28:06.126883+0000","last_became_active":"2024-09-13T18:28:05.089858+0000","last_became_peered":"2024-09-13T18:28:05.089858+0000","last_unstale":"2024-09-13T18:28:06.126883+0000","last_undegraded":"2024-09-13T18:28:06.126883+0000","last_fullsized":"2024-09-13T18:28:06.126883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:43.888532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.096259+0000","last_change":"2024-09-13T18:28:04.699907+0000","last_active":"2024-09-13T18:28:05.096259+0000","last_peered":"2024-09-13T18:28:05.096259+0000","last_clean":"2024-09-13T18:28:05.096259+0000","last_became_active":"2024-09-13T18:28:04.699559+0000","last_became_peered":"2024-09-13T18:28:04.699559+0000","last_unstale":"2024-09-13T18:28:05.096259+0000","last_undegraded":"2024-09-13T18:28:05.096259+0000","last_fullsized":"2024-09-13T18:28:05.096259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:20.810230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.077485+0000","last_change":"2024-09-13T18:28:05.100532+0000","last_active":"2024-09-13T18:28:06.077485+0000","last_peered":"2024-09-13T18:28:06.077485+0000","last_clean":"2024-09-13T18:28:06.077485+0000","last_became_active":"2024-09-13T18:28:05.100250+0000","last_became_peered":"2024-09-13T18:28:05.100250+0000","last_unstale":"2024-09-13T18:28:06.077485+0000","last_undegraded":"2024-09-13T18:28:06.077485+0000","last_fullsized":"2024-09-13T18:28:06.077485+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:21.271196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.125124+0000","last_change":"2024-09-13T18:28:04.696563+0000","last_active":"2024-09-13T18:28:06.125124+0000","last_peered":"2024-09-13T18:28:06.125124+0000","last_clean":"2024-09-13T18:28:06.125124+0000","last_became_active":"2024-09-13T18:28:04.696304+0000","last_became_peered":"2024-09-13T18:28:04.696304+0000","last_unstale":"2024-09-13T18:28:06.125124+0000","last_undegraded":"2024-09-13T18:28:06.125124+0000","last_fullsized":"2024-09-13T18:28:06.125124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:37.734096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124765+0000","last_change":"2024-09-13T18:28:05.091331+0000","last_active":"2024-09-13T18:28:06.124765+0000","last_peered":"2024-09-13T18:28:06.124765+0000","last_clean":"2024-09-13T18:28:06.124765+0000","last_became_active":"2024-09-13T18:28:05.091061+0000","last_became_peered":"2024-09-13T18:28:05.091061+0000","last_unstale":"2024-09-13T18:28:06.124765+0000","last_undegraded":"2024-09-13T18:28:06.124765+0000","last_fullsized":"2024-09-13T18:28:06.124765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:40.162785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.071162+0000","last_change":"2024-09-13T18:28:04.702812+0000","last_active":"2024-09-13T18:28:05.071162+0000","last_peered":"2024-09-13T18:28:05.071162+0000","last_clean":"2024-09-13T18:28:05.071162+0000","last_became_active":"2024-09-13T18:28:04.702538+0000","last_became_peered":"2024-09-13T18:28:04.702538+0000","last_unstale":"2024-09-13T18:28:05.071162+0000","last_undegraded":"2024-09-13T18:28:05.071162+0000","last_fullsized":"2024-09-13T18:28:05.071162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:42.130944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124414+0000","last_change":"2024-09-13T18:28:05.091029+0000","last_active":"2024-09-13T18:28:06.124414+0000","last_peered":"2024-09-13T18:28:06.124414+0000","last_clean":"2024-09-13T18:28:06.124414+0000","last_became_active":"2024-09-13T18:28:05.090606+0000","last_became_peered":"2024-09-13T18:28:05.090606+0000","last_unstale":"2024-09-13T18:28:06.124414+0000","last_undegraded":"2024-09-13T18:28:06.124414+0000","last_fullsized":"2024-09-13T18:28:06.124414+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:41.571876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.084852+0000","last_change":"2024-09-13T18:28:04.691483+0000","last_active":"2024-09-13T18:28:05.084852+0000","last_peered":"2024-09-13T18:28:05.084852+0000","last_clean":"2024-09-13T18:28:05.084852+0000","last_became_active":"2024-09-13T18:28:04.691135+0000","last_became_peered":"2024-09-13T18:28:04.691135+0000","last_unstale":"2024-09-13T18:28:05.084852+0000","last_undegraded":"2024-09-13T18:28:05.084852+0000","last_fullsized":"2024-09-13T18:28:05.084852+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:12.871246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124812+0000","last_change":"2024-09-13T18:28:05.096021+0000","last_active":"2024-09-13T18:28:06.124812+0000","last_peered":"2024-09-13T18:28:06.124812+0000","last_clean":"2024-09-13T18:28:06.124812+0000","last_became_active":"2024-09-13T18:28:05.095790+0000","last_became_peered":"2024-09-13T18:28:05.095790+0000","last_unstale":"2024-09-13T18:28:06.124812+0000","last_undegraded":"2024-09-13T18:28:06.124812+0000","last_fullsized":"2024-09-13T18:28:06.124812+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:34.919966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.069222+0000","last_change":"2024-09-13T18:28:04.700371+0000","last_active":"2024-09-13T18:28:05.069222+0000","last_peered":"2024-09-13T18:28:05.069222+0000","last_clean":"2024-09-13T18:28:05.069222+0000","last_became_active":"2024-09-13T18:28:04.700114+0000","last_became_peered":"2024-09-13T18:28:04.700114+0000","last_unstale":"2024-09-13T18:28:05.069222+0000","last_undegraded":"2024-09-13T18:28:05.069222+0000","last_fullsized":"2024-09-13T18:28:05.069222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:38.670033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.078615+0000","last_change":"2024-09-13T18:28:05.093628+0000","last_active":"2024-09-13T18:28:06.078615+0000","last_peered":"2024-09-13T18:28:06.078615+0000","last_clean":"2024-09-13T18:28:06.078615+0000","last_became_active":"2024-09-13T18:28:05.093376+0000","last_became_peered":"2024-09-13T18:28:05.093376+0000","last_unstale":"2024-09-13T18:28:06.078615+0000","last_undegraded":"2024-09-13T18:28:06.078615+0000","last_fullsized":"2024-09-13T18:28:06.078615+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:00.027242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.086887+0000","last_change":"2024-09-13T18:28:04.696846+0000","last_active":"2024-09-13T18:28:05.086887+0000","last_peered":"2024-09-13T18:28:05.086887+0000","last_clean":"2024-09-13T18:28:05.086887+0000","last_became_active":"2024-09-13T18:28:04.696487+0000","last_became_peered":"2024-09-13T18:28:04.696487+0000","last_unstale":"2024-09-13T18:28:05.086887+0000","last_undegraded":"2024-09-13T18:28:05.086887+0000","last_fullsized":"2024-09-13T18:28:05.086887+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:59.837694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124065+0000","last_change":"2024-09-13T18:28:05.096018+0000","last_active":"2024-09-13T18:28:06.124065+0000","last_peered":"2024-09-13T18:28:06.124065+0000","last_clean":"2024-09-13T18:28:06.124065+0000","last_became_active":"2024-09-13T18:28:05.095391+0000","last_became_peered":"2024-09-13T18:28:05.095391+0000","last_unstale":"2024-09-13T18:28:06.124065+0000","last_undegraded":"2024-09-13T18:28:06.124065+0000","last_fullsized":"2024-09-13T18:28:06.124065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:09.578952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.086059+0000","last_change":"2024-09-13T18:28:04.702176+0000","last_active":"2024-09-13T18:28:05.086059+0000","last_peered":"2024-09-13T18:28:05.086059+0000","last_clean":"2024-09-13T18:28:05.086059+0000","last_became_active":"2024-09-13T18:28:04.700006+0000","last_became_peered":"2024-09-13T18:28:04.700006+0000","last_unstale":"2024-09-13T18:28:05.086059+0000","last_undegraded":"2024-09-13T18:28:05.086059+0000","last_fullsized":"2024-09-13T18:28:05.086059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:35.414482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:28:06.124609+0000","last_change":"2024-09-13T18:28:05.076887+0000","last_active":"2024-09-13T18:28:06.124609+0000","last_peered":"2024-09-13T18:28:06.124609+0000","last_clean":"2024-09-13T18:28:06.124609+0000","last_became_active":"2024-09-13T18:28:05.076325+0000","last_became_peered":"2024-09-13T18:28:05.076325+0000","last_unstale":"2024-09-13T18:28:06.124609+0000","last_undegraded":"2024-09-13T18:28:06.124609+0000","last_fullsized":"2024-09-13T18:28:06.124609+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:04.671598+0000","last_clean_scrub_stamp":"2024-09-13T18:28:04.671598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:53.035865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.073251+0000","last_change":"2024-09-13T18:28:04.698321+0000","last_active":"2024-09-13T18:28:05.073251+0000","last_peered":"2024-09-13T18:28:05.073251+0000","last_clean":"2024-09-13T18:28:05.073251+0000","last_became_active":"2024-09-13T18:28:04.698076+0000","last_became_peered":"2024-09-13T18:28:04.698076+0000","last_unstale":"2024-09-13T18:28:05.073251+0000","last_undegraded":"2024-09-13T18:28:05.073251+0000","last_fullsized":"2024-09-13T18:28:05.073251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:03.659537+0000","last_clean_scrub_stamp":"2024-09-13T18:28:03.659537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:26.748656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:28:05.072359+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:28:05.072359+0000","last_peered":"2024-09-13T18:28:05.072359+0000","last_clean":"2024-09-13T18:28:05.072359+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:28:05.072359+0000","last_undegraded":"2024-09-13T18:28:05.072359+0000","last_fullsized":"2024-09-13T18:28:05.072359+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":995328,"data_stored":747032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.96499999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.998},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.044}]},{"osd":2,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.111}]},{"osd":3,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.92300000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.145}]},{"osd":5,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":1.302},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.66900000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":1.091},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.0740000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":157190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.77000000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":1.1859999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.0820000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.056}]},{"osd":4,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0249999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.268},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.0029999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:27:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.2270000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":157246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.90700000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.92800000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.85499999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.97399999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.879},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.68500000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":1.054},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.1100000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.1899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":405504,"data_stored":156678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.997}]},{"osd":1,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.73099999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.88100000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.90200000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.3889999999999998,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.042}]},{"osd":6,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.0189999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.86099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":158160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.89700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.79700000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.64900000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.873}]},{"osd":5,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":1.0580000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.03}]},{"osd":7,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.179},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.96899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":156644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.78000000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.69199999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.95899999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.876},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.147}]},{"osd":5,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.111}]},{"osd":6,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.762,"5min":2.762,"15min":2.762},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.204}]},{"osd":7,"last update":"Fri Sep 13 18:27:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":1.081},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.26}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":158160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.69799999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.71599999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.64100000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.0309999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.123},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.1919999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.1639999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.26},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.85099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":991232,"data_stored":746942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.73999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.68200000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.70199999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.4810000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.4179999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.355},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.288}]},{"osd":7,"last update":"Fri Sep 13 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.327},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.1910000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:28:13.954 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:28:13.954 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:28:14.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.074+0000 7f1a7e30f700 1 Processor -- start 2024-09-13T18:28:14.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.074+0000 7f1a7e30f700 1 -- start start 2024-09-13T18:28:14.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a7e30f700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1a7806a520 0x7f1a7806a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a7e30f700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a780b8430 con 0x7f1a7815cda0 2024-09-13T18:28:14.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a7e30f700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a7806ae70 con 0x7f1a7806b900 2024-09-13T18:28:14.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a7e30f700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a780b64f0 con 0x7f1a7806a520 2024-09-13T18:28:14.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a7d30d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1a7815cda0 0x7f1a780ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44732/0 (socket says 172.21.15.44:44732) 2024-09-13T18:28:14.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a7d30d700 1 -- 172.21.15.44:0/2561584562 learned_addr learned my addr 172.21.15.44:0/2561584562 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:14.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a7db0e700 1 --2- 172.21.15.44:0/2561584562 >> v2:172.21.15.99:3300/0 conn(0x7f1a7806a520 0x7f1a7806a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a6ffff700 1 -- 172.21.15.44:0/2561584562 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1664224162 0 0) 0x7f1a780b8430 con 0x7f1a7815cda0 2024-09-13T18:28:14.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a6ffff700 1 -- 172.21.15.44:0/2561584562 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a640035d0 con 0x7f1a7815cda0 2024-09-13T18:28:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a6ffff700 1 -- 172.21.15.44:0/2561584562 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 26922314 0 0) 0x7f1a640035d0 con 0x7f1a7815cda0 2024-09-13T18:28:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a6ffff700 1 -- 172.21.15.44:0/2561584562 >> v2:172.21.15.99:3300/0 conn(0x7f1a7806a520 msgr2=0x7f1a7806a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a6ffff700 1 --2- 172.21.15.44:0/2561584562 >> v2:172.21.15.99:3300/0 conn(0x7f1a7806a520 0x7f1a7806a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a6ffff700 1 -- 172.21.15.44:0/2561584562 >> v1:172.21.15.99:6789/0 conn(0x7f1a7806b900 legacy=0x7f1a780b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a6ffff700 1 -- 172.21.15.44:0/2561584562 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7806bd60 con 0x7f1a7815cda0 2024-09-13T18:28:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a6ffff700 1 -- 172.21.15.44:0/2561584562 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f1a74001670 con 0x7f1a7815cda0 2024-09-13T18:28:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a6ffff700 1 -- 172.21.15.44:0/2561584562 >> v1:172.21.15.44:6789/0 conn(0x7f1a7815cda0 legacy=0x7f1a780ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a6ffff700 1 --2- 172.21.15.44:0/2561584562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a64003a20 0x7f1a64003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a6ffff700 1 --2- 172.21.15.44:0/2561584562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a64004870 0x7f1a64004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a6ffff700 1 --2- 172.21.15.44:0/2561584562 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1a64005230 0x7f1a6400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a6ffff700 1 -- 172.21.15.44:0/2561584562 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a780b64f0 con 0x7f1a64003a20 2024-09-13T18:28:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a6ffff700 1 -- 172.21.15.44:0/2561584562 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6400c0d0 con 0x7f1a64004870 2024-09-13T18:28:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a6ffff700 1 -- 172.21.15.44:0/2561584562 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6400c290 con 0x7f1a64005230 2024-09-13T18:28:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a7cb0c700 1 --2- 172.21.15.44:0/2561584562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a64004870 0x7f1a64004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a7d30d700 1 --2- 172.21.15.44:0/2561584562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a64003a20 0x7f1a64003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a7db0e700 1 --2- 172.21.15.44:0/2561584562 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1a64005230 0x7f1a6400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a7cb0c700 1 -- 172.21.15.44:0/2561584562 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1a64005230 msgr2=0x7f1a6400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a7cb0c700 1 --2- 172.21.15.44:0/2561584562 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1a64005230 0x7f1a6400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a7cb0c700 1 -- 172.21.15.44:0/2561584562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a64003a20 msgr2=0x7f1a64003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a7cb0c700 1 --2- 172.21.15.44:0/2561584562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a64003a20 0x7f1a64003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a7db0e700 1 -- 172.21.15.44:0/2561584562 reap_dead start 2024-09-13T18:28:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a7cb0c700 1 -- 172.21.15.44:0/2561584562 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a640035d0 con 0x7f1a64004870 2024-09-13T18:28:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a7d30d700 1 --2- 172.21.15.44:0/2561584562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a64003a20 0x7f1a64003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:14.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a7cb0c700 1 --2- 172.21.15.44:0/2561584562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a64004870 0x7f1a64004cf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1a680017e0 tx=0x7f1a640058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba76d107b35250c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:14.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a6ffff700 1 -- 172.21.15.44:0/2561584562 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a680052d0 con 0x7f1a64004870 2024-09-13T18:28:14.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a6ffff700 1 -- 172.21.15.44:0/2561584562 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a68005450 con 0x7f1a64004870 2024-09-13T18:28:14.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.078+0000 7f1a6ffff700 1 -- 172.21.15.44:0/2561584562 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a680038e0 con 0x7f1a64004870 2024-09-13T18:28:14.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.082+0000 7f1a7e30f700 1 -- 172.21.15.44:0/2561584562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a64004870 msgr2=0x7f1a64004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.082+0000 7f1a7e30f700 1 --2- 172.21.15.44:0/2561584562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a64004870 0x7f1a64004cf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1a680017e0 tx=0x7f1a640058a0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.082+0000 7f1a7e30f700 1 -- 172.21.15.44:0/2561584562 shutdown_connections 2024-09-13T18:28:14.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.082+0000 7f1a7e30f700 1 --2- 172.21.15.44:0/2561584562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a64004870 0x7f1a64004cf0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.082+0000 7f1a7e30f700 1 -- 172.21.15.44:0/2561584562 >> 172.21.15.44:0/2561584562 conn(0x7f1a780d2cb0 msgr2=0x7f1a780d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:14.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.082+0000 7f1a7e30f700 1 -- 172.21.15.44:0/2561584562 shutdown_connections 2024-09-13T18:28:14.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.082+0000 7f1a7e30f700 1 -- 172.21.15.44:0/2561584562 wait complete. 2024-09-13T18:28:14.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a7e30f700 1 Processor -- start 2024-09-13T18:28:14.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a7e30f700 1 -- start start 2024-09-13T18:28:14.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a7e30f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a64004870 0x7f1a781583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a7e30f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a78160180 0x7f1a780cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a7e30f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1a780c89b0 0x7f1a780c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a7e30f700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a780c93a0 con 0x7f1a64004870 2024-09-13T18:28:14.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a7e30f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a781588e0 con 0x7f1a78160180 2024-09-13T18:28:14.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a7e30f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a780b36b0 con 0x7f1a780c89b0 2024-09-13T18:28:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a7d30d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a64004870 0x7f1a781583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a7d30d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a64004870 0x7f1a781583a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50732/0 (socket says 172.21.15.44:50732) 2024-09-13T18:28:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a7d30d700 1 -- 172.21.15.44:0/1693553768 learned_addr learned my addr 172.21.15.44:0/1693553768 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a7db0e700 1 --2- 172.21.15.44:0/1693553768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1a780c89b0 0x7f1a780c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a7cb0c700 1 --2- 172.21.15.44:0/1693553768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a78160180 0x7f1a780cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a7d30d700 1 -- 172.21.15.44:0/1693553768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1a780c89b0 msgr2=0x7f1a780c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a7d30d700 1 --2- 172.21.15.44:0/1693553768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1a780c89b0 0x7f1a780c8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a7d30d700 1 -- 172.21.15.44:0/1693553768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a78160180 msgr2=0x7f1a780cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a7d30d700 1 --2- 172.21.15.44:0/1693553768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a78160180 0x7f1a780cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a7d30d700 1 -- 172.21.15.44:0/1693553768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a780b3950 con 0x7f1a64004870 2024-09-13T18:28:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a7d30d700 1 --2- 172.21.15.44:0/1693553768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a64004870 0x7f1a781583a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1a74007600 tx=0x7f1a74007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a6dffb700 1 -- 172.21.15.44:0/1693553768 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7400f850 con 0x7f1a64004870 2024-09-13T18:28:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a6dffb700 1 -- 172.21.15.44:0/1693553768 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7400f9b0 con 0x7f1a64004870 2024-09-13T18:28:14.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a7e30f700 1 -- 172.21.15.44:0/1693553768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a780b3c30 con 0x7f1a64004870 2024-09-13T18:28:14.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a6dffb700 1 -- 172.21.15.44:0/1693553768 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7400fd20 con 0x7f1a64004870 2024-09-13T18:28:14.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.086+0000 7f1a7e30f700 1 -- 172.21.15.44:0/1693553768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a7815f980 con 0x7f1a64004870 2024-09-13T18:28:14.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.090+0000 7f1a7e30f700 1 -- 172.21.15.44:0/1693553768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a780d1120 con 0x7f1a64004870 2024-09-13T18:28:14.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.090+0000 7f1a6dffb700 1 -- 172.21.15.44:0/1693553768 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1a7401d460 con 0x7f1a64004870 2024-09-13T18:28:14.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.090+0000 7f1a6dffb700 1 --2- 172.21.15.44:0/1693553768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1a5c066760 0x7f1a5c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.090+0000 7f1a6dffb700 1 -- 172.21.15.44:0/1693553768 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a74083ff0 con 0x7f1a64004870 2024-09-13T18:28:14.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.090+0000 7f1a7cb0c700 1 --2- 172.21.15.44:0/1693553768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1a5c066760 0x7f1a5c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.090+0000 7f1a7cb0c700 1 --2- 172.21.15.44:0/1693553768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1a5c066760 0x7f1a5c068c20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1a68005040 tx=0x7f1a68009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:14.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.098+0000 7f1a6dffb700 1 -- 172.21.15.44:0/1693553768 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1a74051360 con 0x7f1a64004870 2024-09-13T18:28:14.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.334+0000 7f1a7e30f700 1 -- 172.21.15.44:0/1693553768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f1a780b5da0 con 0x7f1a64004870 2024-09-13T18:28:14.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.342+0000 7f1a6dffb700 1 -- 172.21.15.44:0/1693553768 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7f1a74054980 con 0x7f1a64004870 2024-09-13T18:28:14.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.342+0000 7f1a7e30f700 1 -- 172.21.15.44:0/1693553768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1a5c066760 msgr2=0x7f1a5c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.342+0000 7f1a7e30f700 1 --2- 172.21.15.44:0/1693553768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1a5c066760 0x7f1a5c068c20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1a68005040 tx=0x7f1a68009030 comp rx=0 tx=0).stop 2024-09-13T18:28:14.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.342+0000 7f1a7e30f700 1 -- 172.21.15.44:0/1693553768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a64004870 msgr2=0x7f1a781583a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.342+0000 7f1a7e30f700 1 --2- 172.21.15.44:0/1693553768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a64004870 0x7f1a781583a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1a74007600 tx=0x7f1a74007910 comp rx=0 tx=0).stop 2024-09-13T18:28:14.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.342+0000 7f1a7e30f700 1 -- 172.21.15.44:0/1693553768 shutdown_connections 2024-09-13T18:28:14.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.342+0000 7f1a7e30f700 1 --2- 172.21.15.44:0/1693553768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1a5c066760 0x7f1a5c068c20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.342+0000 7f1a7e30f700 1 --2- 172.21.15.44:0/1693553768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1a780c89b0 0x7f1a780c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.342+0000 7f1a7e30f700 1 --2- 172.21.15.44:0/1693553768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a78160180 0x7f1a780cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.342+0000 7f1a7e30f700 1 --2- 172.21.15.44:0/1693553768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a64004870 0x7f1a781583a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.342+0000 7f1a7e30f700 1 -- 172.21.15.44:0/1693553768 >> 172.21.15.44:0/1693553768 conn(0x7f1a780d2cb0 msgr2=0x7f1a780ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:14.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.342+0000 7f1a7e30f700 1 -- 172.21.15.44:0/1693553768 shutdown_connections 2024-09-13T18:28:14.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.342+0000 7f1a7e30f700 1 -- 172.21.15.44:0/1693553768 wait complete. 2024-09-13T18:28:14.351 INFO:teuthology.orchestra.run.smithi044.stderr:updated caps for client.0 2024-09-13T18:28:14.365 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:28:14.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c7bfff700 1 Processor -- start 2024-09-13T18:28:14.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c7bfff700 1 -- start start 2024-09-13T18:28:14.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c7bfff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1c7c15cae0 0x7f1c7c0cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c7bfff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1c7c06b310 0x7f1c7c0d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c7bfff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c7c0d21e0 con 0x7f1c7c15cec0 2024-09-13T18:28:14.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c7bfff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c7c0d1750 con 0x7f1c7c06b310 2024-09-13T18:28:14.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c7bfff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c7c0d1940 con 0x7f1c7c15cae0 2024-09-13T18:28:14.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c7a7fc700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1c7c15cec0 0x7f1c7c06ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44746/0 (socket says 172.21.15.44:44746) 2024-09-13T18:28:14.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c7a7fc700 1 -- 172.21.15.44:0/4198744059 learned_addr learned my addr 172.21.15.44:0/4198744059 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:14.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c7affd700 1 --2- 172.21.15.44:0/4198744059 >> v2:172.21.15.99:3300/0 conn(0x7f1c7c15cae0 0x7f1c7c0cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c7b7fe700 1 --2- 172.21.15.44:0/4198744059 >> v2:172.21.15.44:3300/0 conn(0x7f1c7c06b310 0x7f1c7c0d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c79ffb700 1 -- 172.21.15.44:0/4198744059 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823974358 0 0) 0x7f1c7c0d21e0 con 0x7f1c7c15cec0 2024-09-13T18:28:14.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c79ffb700 1 -- 172.21.15.44:0/4198744059 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c680035d0 con 0x7f1c7c15cec0 2024-09-13T18:28:14.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c79ffb700 1 -- 172.21.15.44:0/4198744059 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2370623173 0 0) 0x7f1c680035d0 con 0x7f1c7c15cec0 2024-09-13T18:28:14.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c79ffb700 1 -- 172.21.15.44:0/4198744059 >> v2:172.21.15.99:3300/0 conn(0x7f1c7c15cae0 msgr2=0x7f1c7c0cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:14.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c79ffb700 1 --2- 172.21.15.44:0/4198744059 >> v2:172.21.15.99:3300/0 conn(0x7f1c7c15cae0 0x7f1c7c0cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c79ffb700 1 -- 172.21.15.44:0/4198744059 >> v2:172.21.15.44:3300/0 conn(0x7f1c7c06b310 msgr2=0x7f1c7c0d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:14.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c79ffb700 1 --2- 172.21.15.44:0/4198744059 >> v2:172.21.15.44:3300/0 conn(0x7f1c7c06b310 0x7f1c7c0d1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c79ffb700 1 -- 172.21.15.44:0/4198744059 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7c0d1c20 con 0x7f1c7c15cec0 2024-09-13T18:28:14.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c79ffb700 1 -- 172.21.15.44:0/4198744059 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f1c6c0019f0 con 0x7f1c7c15cec0 2024-09-13T18:28:14.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c7b7fe700 1 --2- 172.21.15.44:0/4198744059 >> v2:172.21.15.44:3300/0 conn(0x7f1c7c06b310 0x7f1c7c0d1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:14.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c79ffb700 1 -- 172.21.15.44:0/4198744059 >> v1:172.21.15.44:6789/0 conn(0x7f1c7c15cec0 legacy=0x7f1c7c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c79ffb700 1 --2- 172.21.15.44:0/4198744059 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c68003a20 0x7f1c68003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c79ffb700 1 --2- 172.21.15.44:0/4198744059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c68004870 0x7f1c68004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c79ffb700 1 --2- 172.21.15.44:0/4198744059 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c68005230 0x7f1c6800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c79ffb700 1 -- 172.21.15.44:0/4198744059 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c0d1940 con 0x7f1c68004870 2024-09-13T18:28:14.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c79ffb700 1 -- 172.21.15.44:0/4198744059 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6800bff0 con 0x7f1c68003a20 2024-09-13T18:28:14.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.474+0000 7f1c79ffb700 1 -- 172.21.15.44:0/4198744059 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6800c1b0 con 0x7f1c68005230 2024-09-13T18:28:14.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.478+0000 7f1c7a7fc700 1 --2- 172.21.15.44:0/4198744059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c68004870 0x7f1c68004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.478+0000 7f1c7affd700 1 --2- 172.21.15.44:0/4198744059 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c68003a20 0x7f1c68003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.478+0000 7f1c7a7fc700 1 -- 172.21.15.44:0/4198744059 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c68005230 msgr2=0x7f1c6800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:14.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.478+0000 7f1c7b7fe700 1 --2- 172.21.15.44:0/4198744059 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c68005230 0x7f1c6800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.478+0000 7f1c7a7fc700 1 --2- 172.21.15.44:0/4198744059 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c68005230 0x7f1c6800ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.478+0000 7f1c7a7fc700 1 -- 172.21.15.44:0/4198744059 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c68003a20 msgr2=0x7f1c68003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:14.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.478+0000 7f1c7a7fc700 1 --2- 172.21.15.44:0/4198744059 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c68003a20 0x7f1c68003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.478+0000 7f1c7a7fc700 1 -- 172.21.15.44:0/4198744059 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c680035d0 con 0x7f1c68004870 2024-09-13T18:28:14.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.478+0000 7f1c7b7fe700 1 -- 172.21.15.44:0/4198744059 reap_dead start 2024-09-13T18:28:14.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.478+0000 7f1c7affd700 1 --2- 172.21.15.44:0/4198744059 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c68003a20 0x7f1c68003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:14.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.478+0000 7f1c7a7fc700 1 --2- 172.21.15.44:0/4198744059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c68004870 0x7f1c68004cf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c00a830 tx=0x7f1c680058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcfec1f83ee9ae82 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:14.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.478+0000 7f1c79ffb700 1 -- 172.21.15.44:0/4198744059 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c00a2f0 con 0x7f1c68004870 2024-09-13T18:28:14.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.478+0000 7f1c79ffb700 1 -- 172.21.15.44:0/4198744059 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6c0072f0 con 0x7f1c68004870 2024-09-13T18:28:14.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.478+0000 7f1c79ffb700 1 -- 172.21.15.44:0/4198744059 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c0076a0 con 0x7f1c68004870 2024-09-13T18:28:14.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.478+0000 7f1c7bfff700 1 -- 172.21.15.44:0/4198744059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c68004870 msgr2=0x7f1c68004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.478+0000 7f1c7bfff700 1 --2- 172.21.15.44:0/4198744059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c68004870 0x7f1c68004cf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c00a830 tx=0x7f1c680058a0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.478+0000 7f1c7bfff700 1 -- 172.21.15.44:0/4198744059 shutdown_connections 2024-09-13T18:28:14.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.478+0000 7f1c7bfff700 1 --2- 172.21.15.44:0/4198744059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c68004870 0x7f1c68004cf0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.478+0000 7f1c7bfff700 1 -- 172.21.15.44:0/4198744059 >> 172.21.15.44:0/4198744059 conn(0x7f1c7c0d2c80 msgr2=0x7f1c7c0d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:14.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.478+0000 7f1c7bfff700 1 -- 172.21.15.44:0/4198744059 shutdown_connections 2024-09-13T18:28:14.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.478+0000 7f1c7bfff700 1 -- 172.21.15.44:0/4198744059 wait complete. 2024-09-13T18:28:14.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.482+0000 7f1c7bfff700 1 Processor -- start 2024-09-13T18:28:14.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.482+0000 7f1c7bfff700 1 -- start start 2024-09-13T18:28:14.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.482+0000 7f1c7bfff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c68004870 0x7f1c7c15dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.482+0000 7f1c7bfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c7c1535e0 0x7f1c7c0b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.482+0000 7f1c7bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c7c0b66f0 0x7f1c7c15e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.482+0000 7f1c7bfff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c0b6b70 con 0x7f1c7c0b66f0 2024-09-13T18:28:14.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.482+0000 7f1c7bfff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c153b50 con 0x7f1c68004870 2024-09-13T18:28:14.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.482+0000 7f1c7bfff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c153e30 con 0x7f1c7c1535e0 2024-09-13T18:28:14.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.482+0000 7f1c7b7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c7c0b66f0 0x7f1c7c15e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.482+0000 7f1c7b7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c7c0b66f0 0x7f1c7c15e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50770/0 (socket says 172.21.15.44:50770) 2024-09-13T18:28:14.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.482+0000 7f1c7b7fe700 1 -- 172.21.15.44:0/1010034628 learned_addr learned my addr 172.21.15.44:0/1010034628 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:14.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.482+0000 7f1c7a7fc700 1 --2- 172.21.15.44:0/1010034628 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c7c1535e0 0x7f1c7c0b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.482+0000 7f1c7affd700 1 --2- 172.21.15.44:0/1010034628 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c68004870 0x7f1c7c15dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.482+0000 7f1c7b7fe700 1 -- 172.21.15.44:0/1010034628 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c7c1535e0 msgr2=0x7f1c7c0b61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.482+0000 7f1c7b7fe700 1 --2- 172.21.15.44:0/1010034628 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c7c1535e0 0x7f1c7c0b61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.482+0000 7f1c7b7fe700 1 -- 172.21.15.44:0/1010034628 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c68004870 msgr2=0x7f1c7c15dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.482+0000 7f1c7b7fe700 1 --2- 172.21.15.44:0/1010034628 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c68004870 0x7f1c7c15dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.482+0000 7f1c7b7fe700 1 -- 172.21.15.44:0/1010034628 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7c154110 con 0x7f1c7c0b66f0 2024-09-13T18:28:14.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.486+0000 7f1c7b7fe700 1 --2- 172.21.15.44:0/1010034628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c7c0b66f0 0x7f1c7c15e710 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c160700 tx=0x7f1c74010bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.486+0000 7f1c737fe700 1 -- 172.21.15.44:0/1010034628 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c74004440 con 0x7f1c7c0b66f0 2024-09-13T18:28:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.486+0000 7f1c737fe700 1 -- 172.21.15.44:0/1010034628 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c740045c0 con 0x7f1c7c0b66f0 2024-09-13T18:28:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.486+0000 7f1c7bfff700 1 -- 172.21.15.44:0/1010034628 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c7c1543f0 con 0x7f1c7c0b66f0 2024-09-13T18:28:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.486+0000 7f1c737fe700 1 -- 172.21.15.44:0/1010034628 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c74003900 con 0x7f1c7c0b66f0 2024-09-13T18:28:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.486+0000 7f1c7bfff700 1 -- 172.21.15.44:0/1010034628 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7c15e1f0 con 0x7f1c7c0b66f0 2024-09-13T18:28:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.486+0000 7f1c7bfff700 1 -- 172.21.15.44:0/1010034628 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c7c154910 con 0x7f1c7c0b66f0 2024-09-13T18:28:14.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.486+0000 7f1c737fe700 1 -- 172.21.15.44:0/1010034628 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c74003a60 con 0x7f1c7c0b66f0 2024-09-13T18:28:14.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.490+0000 7f1c737fe700 1 --2- 172.21.15.44:0/1010034628 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c5c066730 0x7f1c5c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.490+0000 7f1c737fe700 1 -- 172.21.15.44:0/1010034628 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c740841a0 con 0x7f1c7c0b66f0 2024-09-13T18:28:14.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.490+0000 7f1c7affd700 1 --2- 172.21.15.44:0/1010034628 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c5c066730 0x7f1c5c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.490+0000 7f1c7affd700 1 --2- 172.21.15.44:0/1010034628 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c5c066730 0x7f1c5c068bf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c04ff70 tx=0x7f1c64008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:14.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.498+0000 7f1c737fe700 1 -- 172.21.15.44:0/1010034628 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1c7c154910 con 0x7f1c7c0b66f0 2024-09-13T18:28:14.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.706+0000 7f1c7bfff700 1 -- 172.21.15.44:0/1010034628 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c7c154910 con 0x7f1c7c0b66f0 2024-09-13T18:28:14.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.706+0000 7f1c737fe700 1 -- 172.21.15.44:0/1010034628 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4731 (secure 0 0 0) 0x7f1c74051510 con 0x7f1c7c0b66f0 2024-09-13T18:28:14.713 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:14.713 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5191,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/2593282586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2593282586},{"type":"v1","addr":"172.21.15.99:6836","nonce":2593282586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3094334762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3094334762},{"type":"v1","addr":"172.21.15.99:6837","nonce":3094334762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1843893566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1843893566},{"type":"v1","addr":"172.21.15.44:6833","nonce":1843893566}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:28:05.062964+0000","modified":"2024-09-13T18:28:08.082434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/939073284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":939073284},{"type":"v1","addr":"172.21.15.44:6835","nonce":939073284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:28:14.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.710+0000 7f1c7bfff700 1 -- 172.21.15.44:0/1010034628 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c5c066730 msgr2=0x7f1c5c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.710+0000 7f1c7bfff700 1 --2- 172.21.15.44:0/1010034628 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c5c066730 0x7f1c5c068bf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c04ff70 tx=0x7f1c64008040 comp rx=0 tx=0).stop 2024-09-13T18:28:14.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.710+0000 7f1c7bfff700 1 -- 172.21.15.44:0/1010034628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c7c0b66f0 msgr2=0x7f1c7c15e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.710+0000 7f1c7bfff700 1 --2- 172.21.15.44:0/1010034628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c7c0b66f0 0x7f1c7c15e710 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c160700 tx=0x7f1c74010bb0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.710+0000 7f1c7bfff700 1 -- 172.21.15.44:0/1010034628 shutdown_connections 2024-09-13T18:28:14.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.710+0000 7f1c7bfff700 1 --2- 172.21.15.44:0/1010034628 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c5c066730 0x7f1c5c068bf0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.710+0000 7f1c7bfff700 1 --2- 172.21.15.44:0/1010034628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c7c0b66f0 0x7f1c7c15e710 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.710+0000 7f1c7bfff700 1 --2- 172.21.15.44:0/1010034628 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c7c1535e0 0x7f1c7c0b61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.710+0000 7f1c7bfff700 1 --2- 172.21.15.44:0/1010034628 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c68004870 0x7f1c7c15dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.710+0000 7f1c7bfff700 1 -- 172.21.15.44:0/1010034628 >> 172.21.15.44:0/1010034628 conn(0x7f1c7c0d2c80 msgr2=0x7f1c7c15b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:14.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.710+0000 7f1c7bfff700 1 -- 172.21.15.44:0/1010034628 shutdown_connections 2024-09-13T18:28:14.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:14.710+0000 7f1c7bfff700 1 -- 172.21.15.44:0/1010034628 wait complete. 2024-09-13T18:28:14.717 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 15 2024-09-13T18:28:15.131 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:28:05.062964+0000', 'modified': '2024-09-13T18:28:08.082434+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5298}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5298': {'gid': 5298, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.44:6835/939073284', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 939073284}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 939073284}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:28:15.131 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:28:15.131 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:28:15.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.254+0000 7f71f0a48700 1 Processor -- start 2024-09-13T18:28:15.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.254+0000 7f71f0a48700 1 -- start start 2024-09-13T18:28:15.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.254+0000 7f71f0a48700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f71ec15ab70 0x7f71ec159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.254+0000 7f71f0a48700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f71ec06d670 0x7f71ec0cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.254+0000 7f71f0a48700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71ec15af50 con 0x7f71ec06bcb0 2024-09-13T18:28:15.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.254+0000 7f71f0a48700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71ec06ccf0 con 0x7f71ec15ab70 2024-09-13T18:28:15.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.254+0000 7f71f0a48700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec0cd6a0 con 0x7f71ec06d670 2024-09-13T18:28:15.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.254+0000 7f71eb7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f71ec15ab70 0x7f71ec159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.254+0000 7f71eb7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f71ec15ab70 0x7f71ec159fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50776/0 (socket says 172.21.15.44:50776) 2024-09-13T18:28:15.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.254+0000 7f71eb7fe700 1 -- 172.21.15.44:0/2077052214 learned_addr learned my addr 172.21.15.44:0/2077052214 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:15.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.254+0000 7f71ebfff700 1 --2- 172.21.15.44:0/2077052214 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f71ec06d670 0x7f71ec0cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.254+0000 7f71eb7fe700 1 -- 172.21.15.44:0/2077052214 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f71ec06d670 msgr2=0x7f71ec0cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:15.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.254+0000 7f71eb7fe700 1 --2- 172.21.15.44:0/2077052214 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f71ec06d670 0x7f71ec0cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.254+0000 7f71eb7fe700 1 -- 172.21.15.44:0/2077052214 >> v1:172.21.15.99:6789/0 conn(0x7f71ec06bcb0 legacy=0x7f71ec06cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.254+0000 7f71eb7fe700 1 -- 172.21.15.44:0/2077052214 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec06c450 con 0x7f71ec15ab70 2024-09-13T18:28:15.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.258+0000 7f71eb7fe700 1 --2- 172.21.15.44:0/2077052214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71ec15ab70 0x7f71ec159fc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f71dc00d150 tx=0x7f71dc00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9211f2eb693b49 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:15.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.258+0000 7f71ea7fc700 1 -- 172.21.15.44:0/2077052214 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc010070 con 0x7f71ec15ab70 2024-09-13T18:28:15.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.258+0000 7f71ea7fc700 1 -- 172.21.15.44:0/2077052214 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71dc00ddc0 con 0x7f71ec15ab70 2024-09-13T18:28:15.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.258+0000 7f71ea7fc700 1 -- 172.21.15.44:0/2077052214 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc00b310 con 0x7f71ec15ab70 2024-09-13T18:28:15.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.258+0000 7f71f0a48700 1 -- 172.21.15.44:0/2077052214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71ec15ab70 msgr2=0x7f71ec159fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.258+0000 7f71f0a48700 1 --2- 172.21.15.44:0/2077052214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71ec15ab70 0x7f71ec159fc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f71dc00d150 tx=0x7f71dc00d460 comp rx=0 tx=0).stop 2024-09-13T18:28:15.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.258+0000 7f71f0a48700 1 -- 172.21.15.44:0/2077052214 shutdown_connections 2024-09-13T18:28:15.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.258+0000 7f71f0a48700 1 --2- 172.21.15.44:0/2077052214 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f71ec06d670 0x7f71ec0cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.258+0000 7f71f0a48700 1 --2- 172.21.15.44:0/2077052214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71ec15ab70 0x7f71ec159fc0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.258+0000 7f71f0a48700 1 -- 172.21.15.44:0/2077052214 >> 172.21.15.44:0/2077052214 conn(0x7f71ec0cf9a0 msgr2=0x7f71ec0cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:15.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.258+0000 7f71f0a48700 1 -- 172.21.15.44:0/2077052214 shutdown_connections 2024-09-13T18:28:15.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.258+0000 7f71f0a48700 1 -- 172.21.15.44:0/2077052214 wait complete. 2024-09-13T18:28:15.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.258+0000 7f71f0a48700 1 Processor -- start 2024-09-13T18:28:15.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.258+0000 7f71f0a48700 1 -- start start 2024-09-13T18:28:15.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.262+0000 7f71f0a48700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71ec06bcb0 0x7f71ec0aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.262+0000 7f71f0a48700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f71ec06d670 0x7f71ec154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.262+0000 7f71f0a48700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71ec15ab70 0x7f71ec143190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.262+0000 7f71f0a48700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec155a90 con 0x7f71ec06bcb0 2024-09-13T18:28:15.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.262+0000 7f71f0a48700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec154b40 con 0x7f71ec15ab70 2024-09-13T18:28:15.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.262+0000 7f71f0a48700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec154e10 con 0x7f71ec06d670 2024-09-13T18:28:15.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.262+0000 7f71eb7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71ec06bcb0 0x7f71ec0aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.262+0000 7f71eb7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71ec06bcb0 0x7f71ec0aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50782/0 (socket says 172.21.15.44:50782) 2024-09-13T18:28:15.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.262+0000 7f71eb7fe700 1 -- 172.21.15.44:0/3955117640 learned_addr learned my addr 172.21.15.44:0/3955117640 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:15.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.262+0000 7f71eaffd700 1 --2- 172.21.15.44:0/3955117640 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f71ec06d670 0x7f71ec154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.262+0000 7f71ebfff700 1 --2- 172.21.15.44:0/3955117640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71ec15ab70 0x7f71ec143190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.262+0000 7f71eb7fe700 1 -- 172.21.15.44:0/3955117640 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f71ec06d670 msgr2=0x7f71ec154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.262+0000 7f71eb7fe700 1 --2- 172.21.15.44:0/3955117640 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f71ec06d670 0x7f71ec154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.262+0000 7f71eb7fe700 1 -- 172.21.15.44:0/3955117640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71ec15ab70 msgr2=0x7f71ec143190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.262+0000 7f71eb7fe700 1 --2- 172.21.15.44:0/3955117640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71ec15ab70 0x7f71ec143190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.262+0000 7f71eb7fe700 1 -- 172.21.15.44:0/3955117640 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc00bd40 con 0x7f71ec06bcb0 2024-09-13T18:28:15.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.262+0000 7f71eaffd700 1 --2- 172.21.15.44:0/3955117640 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f71ec06d670 0x7f71ec154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:15.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.262+0000 7f71eb7fe700 1 --2- 172.21.15.44:0/3955117640 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71ec06bcb0 0x7f71ec0aef70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f71ec06f740 tx=0x7f71dc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:15.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.262+0000 7f71e3fff700 1 -- 172.21.15.44:0/3955117640 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc00bbc0 con 0x7f71ec06bcb0 2024-09-13T18:28:15.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.262+0000 7f71e3fff700 1 -- 172.21.15.44:0/3955117640 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71dc00b4c0 con 0x7f71ec06bcb0 2024-09-13T18:28:15.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.262+0000 7f71f0a48700 1 -- 172.21.15.44:0/3955117640 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ec1550f0 con 0x7f71ec06bcb0 2024-09-13T18:28:15.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.262+0000 7f71e3fff700 1 -- 172.21.15.44:0/3955117640 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc004260 con 0x7f71ec06bcb0 2024-09-13T18:28:15.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.262+0000 7f71f0a48700 1 -- 172.21.15.44:0/3955117640 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ec1556b0 con 0x7f71ec06bcb0 2024-09-13T18:28:15.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.266+0000 7f71e3fff700 1 -- 172.21.15.44:0/3955117640 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f71dc0043c0 con 0x7f71ec06bcb0 2024-09-13T18:28:15.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.266+0000 7f71e3fff700 1 --2- 172.21.15.44:0/3955117640 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f71cc066760 0x7f71cc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.266+0000 7f71e3fff700 1 -- 172.21.15.44:0/3955117640 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71dc0875e0 con 0x7f71ec06bcb0 2024-09-13T18:28:15.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.266+0000 7f71f4f5b740 1 Processor -- start 2024-09-13T18:28:15.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.266+0000 7f71eaffd700 1 --2- 172.21.15.44:0/3955117640 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f71cc066760 0x7f71cc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.266+0000 7f71f4f5b740 1 -- start start 2024-09-13T18:28:15.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.266+0000 7f71eaffd700 1 --2- 172.21.15.44:0/3955117640 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f71cc066760 0x7f71cc068c20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f71ec15a460 tx=0x7f71d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:15.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.266+0000 7f71f4f5b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bda530 0x1bda910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.266+0000 7f71f4f5b740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bdb290 0x1c02540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.266+0000 7f71f4f5b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb670 0x1c02a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.266+0000 7f71f4f5b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b47d80 con 0x1bdb670 2024-09-13T18:28:15.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.266+0000 7f71f4f5b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b45510 con 0x1bda530 2024-09-13T18:28:15.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.266+0000 7f71f4f5b740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b40e00 con 0x1bdb290 2024-09-13T18:28:15.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.266+0000 7f71ebfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb670 0x1c02a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.266+0000 7f71ebfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb670 0x1c02a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50792/0 (socket says 172.21.15.44:50792) 2024-09-13T18:28:15.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.266+0000 7f71eb7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bda530 0x1bda910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.266+0000 7f71ebfff700 1 -- 172.21.15.44:0/6803666 learned_addr learned my addr 172.21.15.44:0/6803666 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:15.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.266+0000 7f71eaffd700 1 --2- 172.21.15.44:0/6803666 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bdb290 0x1c02540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.270+0000 7f71ebfff700 1 -- 172.21.15.44:0/6803666 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bdb290 msgr2=0x1c02540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:15.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.270+0000 7f71ebfff700 1 --2- 172.21.15.44:0/6803666 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bdb290 0x1c02540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.270+0000 7f71ebfff700 1 -- 172.21.15.44:0/6803666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bda530 msgr2=0x1bda910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:15.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.270+0000 7f71ebfff700 1 --2- 172.21.15.44:0/6803666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bda530 0x1bda910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.270+0000 7f71ebfff700 1 -- 172.21.15.44:0/6803666 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x19b3960 con 0x1bdb670 2024-09-13T18:28:15.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.270+0000 7f71ebfff700 1 --2- 172.21.15.44:0/6803666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb670 0x1c02a80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009af0 tx=0x7f71e4009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3777e84a64bb8ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:15.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.270+0000 7f71e17fa700 1 -- 172.21.15.44:0/6803666 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4010af0 con 0x1bdb670 2024-09-13T18:28:15.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.270+0000 7f71e17fa700 1 -- 172.21.15.44:0/6803666 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e400c050 con 0x1bdb670 2024-09-13T18:28:15.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.270+0000 7f71e17fa700 1 -- 172.21.15.44:0/6803666 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4010e50 con 0x1bdb670 2024-09-13T18:28:15.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.270+0000 7f71f4f5b740 1 -- 172.21.15.44:0/6803666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb670 msgr2=0x1c02a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.270+0000 7f71f4f5b740 1 --2- 172.21.15.44:0/6803666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb670 0x1c02a80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009af0 tx=0x7f71e4009e00 comp rx=0 tx=0).stop 2024-09-13T18:28:15.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.270+0000 7f71f4f5b740 1 -- 172.21.15.44:0/6803666 shutdown_connections 2024-09-13T18:28:15.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.270+0000 7f71f4f5b740 1 --2- 172.21.15.44:0/6803666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb670 0x1c02a80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.270+0000 7f71f4f5b740 1 --2- 172.21.15.44:0/6803666 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bdb290 0x1c02540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.270+0000 7f71f4f5b740 1 --2- 172.21.15.44:0/6803666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bda530 0x1bda910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.270+0000 7f71f4f5b740 1 -- 172.21.15.44:0/6803666 >> 172.21.15.44:0/6803666 conn(0x19684d0 msgr2=0x1c01e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:15.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.270+0000 7f71f4f5b740 1 -- 172.21.15.44:0/6803666 shutdown_connections 2024-09-13T18:28:15.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.270+0000 7f71f4f5b740 1 -- 172.21.15.44:0/6803666 wait complete. 2024-09-13T18:28:15.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.270+0000 7f71f4f5b740 1 -- start start 2024-09-13T18:28:15.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.270+0000 7f71f4f5b740 1 Processor -- start 2024-09-13T18:28:15.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71f4f5b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bda530 0x1c229b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71f4f5b740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bdb290 0x1bfcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71f4f5b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb670 0x1c02020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71f4f5b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x1afe730 con 0x1bdb670 2024-09-13T18:28:15.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71f4f5b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b045b0 con 0x1bda530 2024-09-13T18:28:15.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71f4f5b740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x19ecaa0 con 0x1bdb290 2024-09-13T18:28:15.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71f4f5b740 10 client.0 _ll_register_callbacks cb 0x1b3a610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:28:15.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71ebfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb670 0x1c02020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71ebfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb670 0x1c02020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50808/0 (socket says 172.21.15.44:50808) 2024-09-13T18:28:15.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71ebfff700 1 -- 172.21.15.44:0/1565143535 learned_addr learned my addr 172.21.15.44:0/1565143535 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:15.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71eaffd700 1 --2- 172.21.15.44:0/1565143535 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bdb290 0x1bfcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71eb7fe700 1 --2- 172.21.15.44:0/1565143535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bda530 0x1c229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71ebfff700 1 -- 172.21.15.44:0/1565143535 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bdb290 msgr2=0x1bfcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:15.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71ebfff700 1 --2- 172.21.15.44:0/1565143535 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bdb290 0x1bfcdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71ebfff700 1 -- 172.21.15.44:0/1565143535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bda530 msgr2=0x1c229b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:15.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71ebfff700 1 --2- 172.21.15.44:0/1565143535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bda530 0x1c229b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71ebfff700 1 -- 172.21.15.44:0/1565143535 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e4009720 con 0x1bdb670 2024-09-13T18:28:15.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71ebfff700 1 --2- 172.21.15.44:0/1565143535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb670 0x1c02020 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x1b02fb0 tx=0x7f71e40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63218dca53430851 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:15.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71ca7fc700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-13T18:28:15.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71ca7fc700 1 -- 172.21.15.44:0/1565143535 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4015880 con 0x1bdb670 2024-09-13T18:28:15.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71ca7fc700 1 -- 172.21.15.44:0/1565143535 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71e402aab0 con 0x1bdb670 2024-09-13T18:28:15.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71f4f5b740 1 -- 172.21.15.44:0/1565143535 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x19751e0 con 0x1bdb670 2024-09-13T18:28:15.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71ca7fc700 1 -- 172.21.15.44:0/1565143535 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71e402ac70 con 0x1bdb670 2024-09-13T18:28:15.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71f4f5b740 10 client.5490 fetch_fsmap learned FSMap version 15 2024-09-13T18:28:15.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71f4f5b740 1 -- 172.21.15.44:0/1565143535 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x1b07220 con 0x1bdb670 2024-09-13T18:28:15.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71ca7fc700 1 -- 172.21.15.44:0/1565143535 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x19751e0 con 0x1bdb670 2024-09-13T18:28:15.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71ca7fc700 1 -- 172.21.15.44:0/1565143535 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 15) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f71e4027070 con 0x1bdb670 2024-09-13T18:28:15.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71f4f5b740 10 client.5490 fetch_fsmap finished waiting for FSMap version 15 2024-09-13T18:28:15.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71f4f5b740 10 client.5490 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:28:15.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71f4f5b740 20 client.5490 populate_metadata read hostname 'smithi044' 2024-09-13T18:28:15.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71f4f5b740 1 --2- 172.21.15.44:0/1565143535 >> [v2:172.21.15.44:6834/939073284,v1:172.21.15.44:6835/939073284] conn(0x1c2bac0 0x1c383a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71f4f5b740 4 client.5490 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:28:15.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.274+0000 7f71f4f5b740 1 -- 172.21.15.44:0/1565143535 --> [v2:172.21.15.44:6834/939073284,v1:172.21.15.44:6835/939073284] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x19bf460 con 0x1c2bac0 2024-09-13T18:28:15.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.278+0000 7f71eb7fe700 1 --2- 172.21.15.44:0/1565143535 >> [v2:172.21.15.44:6834/939073284,v1:172.21.15.44:6835/939073284] conn(0x1c2bac0 0x1c383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.278+0000 7f71eb7fe700 1 --2- 172.21.15.44:0/1565143535 >> [v2:172.21.15.44:6834/939073284,v1:172.21.15.44:6835/939073284] conn(0x1c2bac0 0x1c383a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94d2e77a716cfd1c server_cookie=3a3bccc6ef13c58e in_seq=0 out_seq=0 2024-09-13T18:28:15.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.278+0000 7f71ca7fc700 10 client.5490 ms_handle_connect on v2:172.21.15.44:6834/939073284 2024-09-13T18:28:15.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.278+0000 7f71ca7fc700 1 -- 172.21.15.44:0/1565143535 <== mds.0 v2:172.21.15.44:6834/939073284 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x19bf460 con 0x1c2bac0 2024-09-13T18:28:15.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.278+0000 7f71ca7fc700 10 client.5490 handle_command_reply: tid=0 2024-09-13T18:28:15.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.278+0000 7f71f4f5b740 1 client.5490 shutdown 2024-09-13T18:28:15.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.278+0000 7f71f4f5b740 1 -- 172.21.15.44:0/1565143535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb670 msgr2=0x1c02020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.278+0000 7f71f4f5b740 1 --2- 172.21.15.44:0/1565143535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb670 0x1c02020 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x1b02fb0 tx=0x7f71e40047e0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.278+0000 7f71f4f5b740 1 -- 172.21.15.44:0/1565143535 shutdown_connections 2024-09-13T18:28:15.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.278+0000 7f71f4f5b740 1 --2- 172.21.15.44:0/1565143535 >> [v2:172.21.15.44:6834/939073284,v1:172.21.15.44:6835/939073284] conn(0x1c2bac0 0x1c383a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.278+0000 7f71f4f5b740 1 --2- 172.21.15.44:0/1565143535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb670 0x1c02020 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.278+0000 7f71ca7fc700 0 client.5490 ms_handle_reset on v2:172.21.15.44:6834/939073284 2024-09-13T18:28:15.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.278+0000 7f71f4f5b740 1 --2- 172.21.15.44:0/1565143535 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bdb290 0x1bfcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.278+0000 7f71f4f5b740 1 --2- 172.21.15.44:0/1565143535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bda530 0x1c229b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.278+0000 7f71f4f5b740 1 -- 172.21.15.44:0/1565143535 >> 172.21.15.44:0/1565143535 conn(0x19684d0 msgr2=0x1c03060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:15.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.278+0000 7f71f4f5b740 1 -- 172.21.15.44:0/1565143535 shutdown_connections 2024-09-13T18:28:15.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.278+0000 7f71f4f5b740 1 -- 172.21.15.44:0/1565143535 wait complete. 2024-09-13T18:28:15.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.278+0000 7f71f4f5b740 20 client.5490 trim_cache size 0 max 16384 2024-09-13T18:28:15.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.298+0000 7f71f4f5b740 1 Processor -- start 2024-09-13T18:28:15.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.298+0000 7f71f4f5b740 1 -- start start 2024-09-13T18:28:15.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.298+0000 7f71f4f5b740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bda530 0x1bfc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.298+0000 7f71f4f5b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb290 0x1bd4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.298+0000 7f71f4f5b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bdb670 0x1bd4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.298+0000 7f71f4f5b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bd5df0 con 0x1bdb290 2024-09-13T18:28:15.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.298+0000 7f71f4f5b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c24090 con 0x1bdb670 2024-09-13T18:28:15.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.298+0000 7f71f4f5b740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x1adf470 con 0x1bda530 2024-09-13T18:28:15.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.298+0000 7f71eaffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb290 0x1bd4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.298+0000 7f71eaffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb290 0x1bd4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50824/0 (socket says 172.21.15.44:50824) 2024-09-13T18:28:15.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.298+0000 7f71eaffd700 1 -- 172.21.15.44:0/1575157190 learned_addr learned my addr 172.21.15.44:0/1575157190 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:15.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.298+0000 7f71eb7fe700 1 --2- 172.21.15.44:0/1575157190 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bda530 0x1bfc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.298+0000 7f71ebfff700 1 --2- 172.21.15.44:0/1575157190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bdb670 0x1bd4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.298+0000 7f71eaffd700 1 -- 172.21.15.44:0/1575157190 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bda530 msgr2=0x1bfc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:15.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.298+0000 7f71eaffd700 1 --2- 172.21.15.44:0/1575157190 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bda530 0x1bfc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.298+0000 7f71eaffd700 1 -- 172.21.15.44:0/1575157190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bdb670 msgr2=0x1bd4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:15.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.298+0000 7f71eaffd700 1 --2- 172.21.15.44:0/1575157190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bdb670 0x1bd4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.298+0000 7f71eaffd700 1 -- 172.21.15.44:0/1575157190 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1aed450 con 0x1bdb290 2024-09-13T18:28:15.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.298+0000 7f71eb7fe700 1 --2- 172.21.15.44:0/1575157190 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bda530 0x1bfc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:15.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.298+0000 7f71eaffd700 1 --2- 172.21.15.44:0/1575157190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb290 0x1bd4700 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f71d4005370 tx=0x7f71d4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16509fefb52663eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:15.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.302+0000 7f71e1ffb700 1 -- 172.21.15.44:0/1575157190 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4003c40 con 0x1bdb290 2024-09-13T18:28:15.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.302+0000 7f71e1ffb700 1 -- 172.21.15.44:0/1575157190 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d4003da0 con 0x1bdb290 2024-09-13T18:28:15.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.302+0000 7f71e1ffb700 1 -- 172.21.15.44:0/1575157190 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d400e620 con 0x1bdb290 2024-09-13T18:28:15.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.302+0000 7f71f4f5b740 1 -- 172.21.15.44:0/1575157190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb290 msgr2=0x1bd4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.302+0000 7f71f4f5b740 1 --2- 172.21.15.44:0/1575157190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb290 0x1bd4700 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f71d4005370 tx=0x7f71d4011000 comp rx=0 tx=0).stop 2024-09-13T18:28:15.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.302+0000 7f71f4f5b740 1 -- 172.21.15.44:0/1575157190 shutdown_connections 2024-09-13T18:28:15.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.302+0000 7f71f4f5b740 1 --2- 172.21.15.44:0/1575157190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bdb670 0x1bd4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.302+0000 7f71f4f5b740 1 --2- 172.21.15.44:0/1575157190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb290 0x1bd4700 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.302+0000 7f71f4f5b740 1 --2- 172.21.15.44:0/1575157190 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bda530 0x1bfc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.302+0000 7f71f4f5b740 1 -- 172.21.15.44:0/1575157190 >> 172.21.15.44:0/1575157190 conn(0x19684d0 msgr2=0x1c3cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:15.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.302+0000 7f71f4f5b740 1 -- 172.21.15.44:0/1575157190 shutdown_connections 2024-09-13T18:28:15.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.302+0000 7f71f4f5b740 1 -- 172.21.15.44:0/1575157190 wait complete. 2024-09-13T18:28:15.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.302+0000 7f71f4f5b740 1 -- start start 2024-09-13T18:28:15.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.302+0000 7f71f4f5b740 1 Processor -- start 2024-09-13T18:28:15.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71f4f5b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bda530 0x1c88870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71f4f5b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb290 0x1c27ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71f4f5b740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bdb670 0x1c280e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71f4f5b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b6fec0 con 0x1bdb290 2024-09-13T18:28:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71f4f5b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bdba50 con 0x1bda530 2024-09-13T18:28:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71f4f5b740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c86ac0 con 0x1bdb670 2024-09-13T18:28:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71f4f5b740 10 client.0 _ll_register_callbacks cb 0x1bdbb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:28:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71eaffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb290 0x1c27ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71eaffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb290 0x1c27ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50840/0 (socket says 172.21.15.44:50840) 2024-09-13T18:28:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71eaffd700 1 -- 172.21.15.44:0/3224919034 learned_addr learned my addr 172.21.15.44:0/3224919034 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71ebfff700 1 --2- 172.21.15.44:0/3224919034 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bdb670 0x1c280e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71eb7fe700 1 --2- 172.21.15.44:0/3224919034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bda530 0x1c88870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71eaffd700 1 -- 172.21.15.44:0/3224919034 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bdb670 msgr2=0x1c280e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71eaffd700 1 --2- 172.21.15.44:0/3224919034 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bdb670 0x1c280e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71eaffd700 1 -- 172.21.15.44:0/3224919034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bda530 msgr2=0x1c88870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71eaffd700 1 --2- 172.21.15.44:0/3224919034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bda530 0x1c88870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71eaffd700 1 -- 172.21.15.44:0/3224919034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d400f040 con 0x1bdb290 2024-09-13T18:28:15.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71eb7fe700 1 --2- 172.21.15.44:0/3224919034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bda530 0x1c88870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:15.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71eaffd700 1 --2- 172.21.15.44:0/3224919034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb290 0x1c27ba0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f71d4005340 tx=0x7f71d4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b595cafa24dbc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:15.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71ca7fc700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-13T18:28:15.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71ca7fc700 1 -- 172.21.15.44:0/3224919034 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4003c40 con 0x1bdb290 2024-09-13T18:28:15.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71ca7fc700 1 -- 172.21.15.44:0/3224919034 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71d400ec50 con 0x1bdb290 2024-09-13T18:28:15.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71f4f5b740 1 -- 172.21.15.44:0/3224919034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f71e400c050 con 0x1bdb290 2024-09-13T18:28:15.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71ca7fc700 1 -- 172.21.15.44:0/3224919034 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71d400ee10 con 0x1bdb290 2024-09-13T18:28:15.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71f4f5b740 10 client.5496 fetch_fsmap learned FSMap version 15 2024-09-13T18:28:15.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71f4f5b740 1 -- 172.21.15.44:0/3224919034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x1ae1720 con 0x1bdb290 2024-09-13T18:28:15.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71ca7fc700 1 -- 172.21.15.44:0/3224919034 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e400c050 con 0x1bdb290 2024-09-13T18:28:15.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71ca7fc700 1 -- 172.21.15.44:0/3224919034 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 15) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f71d4023470 con 0x1bdb290 2024-09-13T18:28:15.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71f4f5b740 10 client.5496 fetch_fsmap finished waiting for FSMap version 15 2024-09-13T18:28:15.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71f4f5b740 10 client.5496 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:28:15.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71f4f5b740 20 client.5496 populate_metadata read hostname 'smithi044' 2024-09-13T18:28:15.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71f4f5b740 1 --2- 172.21.15.44:0/3224919034 >> [v2:172.21.15.44:6834/939073284,v1:172.21.15.44:6835/939073284] conn(0x1c870d0 0x1c874b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71f4f5b740 4 client.5496 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:28:15.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71f4f5b740 1 -- 172.21.15.44:0/3224919034 --> [v2:172.21.15.44:6834/939073284,v1:172.21.15.44:6835/939073284] -- command(tid 0: {"prefix": "status"}) v1 -- 0x19e41e0 con 0x1c870d0 2024-09-13T18:28:15.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.306+0000 7f71eb7fe700 1 --2- 172.21.15.44:0/3224919034 >> [v2:172.21.15.44:6834/939073284,v1:172.21.15.44:6835/939073284] conn(0x1c870d0 0x1c874b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71ca7fc700 10 client.5496 ms_handle_connect on v2:172.21.15.44:6834/939073284 2024-09-13T18:28:15.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71eb7fe700 1 --2- 172.21.15.44:0/3224919034 >> [v2:172.21.15.44:6834/939073284,v1:172.21.15.44:6835/939073284] conn(0x1c870d0 0x1c874b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85d49de77c45703d server_cookie=593f5f3d3a0f626c in_seq=0 out_seq=0 2024-09-13T18:28:15.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71ca7fc700 1 -- 172.21.15.44:0/3224919034 <== mds.0 v2:172.21.15.44:6834/939073284 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x19e41e0 con 0x1c870d0 2024-09-13T18:28:15.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71ca7fc700 10 client.5496 handle_command_reply: tid=0 2024-09-13T18:28:15.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f4f5b740 1 client.5496 shutdown 2024-09-13T18:28:15.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f4f5b740 1 -- 172.21.15.44:0/3224919034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb290 msgr2=0x1c27ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f4f5b740 1 --2- 172.21.15.44:0/3224919034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb290 0x1c27ba0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f71d4005340 tx=0x7f71d4000ed0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f4f5b740 1 -- 172.21.15.44:0/3224919034 shutdown_connections 2024-09-13T18:28:15.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f4f5b740 1 --2- 172.21.15.44:0/3224919034 >> [v2:172.21.15.44:6834/939073284,v1:172.21.15.44:6835/939073284] conn(0x1c870d0 0x1c874b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f4f5b740 1 --2- 172.21.15.44:0/3224919034 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bdb670 0x1c280e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71ca7fc700 0 client.5496 ms_handle_reset on v2:172.21.15.44:6834/939073284 2024-09-13T18:28:15.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f4f5b740 1 --2- 172.21.15.44:0/3224919034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bdb290 0x1c27ba0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f4f5b740 1 --2- 172.21.15.44:0/3224919034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bda530 0x1c88870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f4f5b740 1 -- 172.21.15.44:0/3224919034 >> 172.21.15.44:0/3224919034 conn(0x19684d0 msgr2=0x1bfc240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:15.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f4f5b740 1 -- 172.21.15.44:0/3224919034 shutdown_connections 2024-09-13T18:28:15.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f4f5b740 1 -- 172.21.15.44:0/3224919034 wait complete. 2024-09-13T18:28:15.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f4f5b740 20 client.5496 trim_cache size 0 max 16384 2024-09-13T18:28:15.319 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:28:15.319 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "c8e1d12d-7fb9-4a33-982e-b895bb77262c", 2024-09-13T18:28:15.319 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-13T18:28:15.319 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 5298, 2024-09-13T18:28:15.319 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-13T18:28:15.319 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-13T18:28:15.319 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-13T18:28:15.319 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 10.247552728, 2024-09-13T18:28:15.319 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 15, 2024-09-13T18:28:15.319 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 35, 2024-09-13T18:28:15.320 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 35, 2024-09-13T18:28:15.320 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 17.545237267000001 2024-09-13T18:28:15.320 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:28:15.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f0a48700 1 -- 172.21.15.44:0/3955117640 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f71cc066760 msgr2=0x7f71cc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f0a48700 1 --2- 172.21.15.44:0/3955117640 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f71cc066760 0x7f71cc068c20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f71ec15a460 tx=0x7f71d4009040 comp rx=0 tx=0).stop 2024-09-13T18:28:15.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f0a48700 1 -- 172.21.15.44:0/3955117640 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71ec06bcb0 msgr2=0x7f71ec0aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f0a48700 1 --2- 172.21.15.44:0/3955117640 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71ec06bcb0 0x7f71ec0aef70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f71ec06f740 tx=0x7f71dc004af0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f0a48700 1 -- 172.21.15.44:0/3955117640 shutdown_connections 2024-09-13T18:28:15.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f0a48700 1 --2- 172.21.15.44:0/3955117640 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f71cc066760 0x7f71cc068c20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f0a48700 1 --2- 172.21.15.44:0/3955117640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71ec15ab70 0x7f71ec143190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f0a48700 1 --2- 172.21.15.44:0/3955117640 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f71ec06d670 0x7f71ec154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f0a48700 1 --2- 172.21.15.44:0/3955117640 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71ec06bcb0 0x7f71ec0aef70 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f0a48700 1 -- 172.21.15.44:0/3955117640 >> 172.21.15.44:0/3955117640 conn(0x7f71ec0cf9a0 msgr2=0x7f71ec06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:15.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f0a48700 1 -- 172.21.15.44:0/3955117640 shutdown_connections 2024-09-13T18:28:15.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.310+0000 7f71f0a48700 1 -- 172.21.15.44:0/3955117640 wait complete. 2024-09-13T18:28:15.334 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:28:15.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.446+0000 7f9783fff700 1 Processor -- start 2024-09-13T18:28:15.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.446+0000 7f9783fff700 1 -- start start 2024-09-13T18:28:15.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9783fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f978415b690 0x7f978415f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9783fff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f978415ec40 con 0x7f97840cf290 2024-09-13T18:28:15.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9783fff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97840af210 con 0x7f97840722c0 2024-09-13T18:28:15.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9783fff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978415bb60 con 0x7f978415b690 2024-09-13T18:28:15.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9782ffd700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f97840cf290 0x7f9784071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44752/0 (socket says 172.21.15.44:44752) 2024-09-13T18:28:15.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9782ffd700 1 -- 172.21.15.44:0/3406025298 learned_addr learned my addr 172.21.15.44:0/3406025298 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:15.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f97837fe700 1 --2- 172.21.15.44:0/3406025298 >> v2:172.21.15.99:3300/0 conn(0x7f978415b690 0x7f978415f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9781ffb700 1 -- 172.21.15.44:0/3406025298 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 59176331 0 0) 0x7f978415ec40 con 0x7f97840cf290 2024-09-13T18:28:15.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9781ffb700 1 -- 172.21.15.44:0/3406025298 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97700035d0 con 0x7f97840cf290 2024-09-13T18:28:15.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9781ffb700 1 -- 172.21.15.44:0/3406025298 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2753254491 0 0) 0x7f97700035d0 con 0x7f97840cf290 2024-09-13T18:28:15.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9781ffb700 1 -- 172.21.15.44:0/3406025298 >> v2:172.21.15.99:3300/0 conn(0x7f978415b690 msgr2=0x7f978415f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:15.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9781ffb700 1 --2- 172.21.15.44:0/3406025298 >> v2:172.21.15.99:3300/0 conn(0x7f978415b690 0x7f978415f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9781ffb700 1 -- 172.21.15.44:0/3406025298 >> v1:172.21.15.99:6789/0 conn(0x7f97840722c0 legacy=0x7f978415af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9781ffb700 1 -- 172.21.15.44:0/3406025298 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978415e5f0 con 0x7f97840cf290 2024-09-13T18:28:15.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9781ffb700 1 -- 172.21.15.44:0/3406025298 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f976c001670 con 0x7f97840cf290 2024-09-13T18:28:15.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9781ffb700 1 -- 172.21.15.44:0/3406025298 >> v1:172.21.15.44:6789/0 conn(0x7f97840cf290 legacy=0x7f9784071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9781ffb700 1 --2- 172.21.15.44:0/3406025298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9770003a20 0x7f9770003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9781ffb700 1 --2- 172.21.15.44:0/3406025298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9770004870 0x7f9770004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9781ffb700 1 --2- 172.21.15.44:0/3406025298 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9770005230 0x7f977000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9781ffb700 1 -- 172.21.15.44:0/3406025298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978415bb60 con 0x7f9770003a20 2024-09-13T18:28:15.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9781ffb700 1 -- 172.21.15.44:0/3406025298 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977000c080 con 0x7f9770004870 2024-09-13T18:28:15.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9781ffb700 1 -- 172.21.15.44:0/3406025298 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977000c240 con 0x7f9770005230 2024-09-13T18:28:15.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9782ffd700 1 --2- 172.21.15.44:0/3406025298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9770003a20 0x7f9770003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f97827fc700 1 --2- 172.21.15.44:0/3406025298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9770004870 0x7f9770004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f97837fe700 1 --2- 172.21.15.44:0/3406025298 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9770005230 0x7f977000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9782ffd700 1 -- 172.21.15.44:0/3406025298 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9770005230 msgr2=0x7f977000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:15.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9782ffd700 1 --2- 172.21.15.44:0/3406025298 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9770005230 0x7f977000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9782ffd700 1 -- 172.21.15.44:0/3406025298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9770004870 msgr2=0x7f9770004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:15.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9782ffd700 1 --2- 172.21.15.44:0/3406025298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9770004870 0x7f9770004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9782ffd700 1 -- 172.21.15.44:0/3406025298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978415e5f0 con 0x7f9770003a20 2024-09-13T18:28:15.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f97837fe700 1 -- 172.21.15.44:0/3406025298 reap_dead start 2024-09-13T18:28:15.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9782ffd700 1 --2- 172.21.15.44:0/3406025298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9770003a20 0x7f9770003e40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f976c00c340 tx=0x7f97700058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c12a637a8a92e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:15.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9781ffb700 1 -- 172.21.15.44:0/3406025298 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c005980 con 0x7f9770003a20 2024-09-13T18:28:15.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9781ffb700 1 -- 172.21.15.44:0/3406025298 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c005ae0 con 0x7f9770003a20 2024-09-13T18:28:15.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.450+0000 7f9781ffb700 1 -- 172.21.15.44:0/3406025298 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c005e90 con 0x7f9770003a20 2024-09-13T18:28:15.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9783fff700 1 -- 172.21.15.44:0/3406025298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9770003a20 msgr2=0x7f9770003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9783fff700 1 --2- 172.21.15.44:0/3406025298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9770003a20 0x7f9770003e40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f976c00c340 tx=0x7f97700058a0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9783fff700 1 -- 172.21.15.44:0/3406025298 shutdown_connections 2024-09-13T18:28:15.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9783fff700 1 --2- 172.21.15.44:0/3406025298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9770003a20 0x7f9770003e40 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9783fff700 1 -- 172.21.15.44:0/3406025298 >> 172.21.15.44:0/3406025298 conn(0x7f97840cf910 msgr2=0x7f97840cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:15.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9783fff700 1 -- 172.21.15.44:0/3406025298 shutdown_connections 2024-09-13T18:28:15.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9783fff700 1 -- 172.21.15.44:0/3406025298 wait complete. 2024-09-13T18:28:15.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9783fff700 1 Processor -- start 2024-09-13T18:28:15.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9783fff700 1 -- start start 2024-09-13T18:28:15.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9783fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9770003a20 0x7f978414d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9783fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f978414d540 0x7f9784159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9783fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f978414bb30 0x7f9784159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9783fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97840a84b0 con 0x7f9770003a20 2024-09-13T18:28:15.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9783fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97840a8a00 con 0x7f978414bb30 2024-09-13T18:28:15.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9783fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978414da60 con 0x7f978414d540 2024-09-13T18:28:15.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9782ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9770003a20 0x7f978414d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9782ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9770003a20 0x7f978414d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50868/0 (socket says 172.21.15.44:50868) 2024-09-13T18:28:15.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9782ffd700 1 -- 172.21.15.44:0/404829487 learned_addr learned my addr 172.21.15.44:0/404829487 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:15.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f97827fc700 1 --2- 172.21.15.44:0/404829487 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f978414d540 0x7f9784159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f97837fe700 1 --2- 172.21.15.44:0/404829487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f978414bb30 0x7f9784159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9782ffd700 1 -- 172.21.15.44:0/404829487 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f978414d540 msgr2=0x7f9784159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9782ffd700 1 --2- 172.21.15.44:0/404829487 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f978414d540 0x7f9784159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9782ffd700 1 -- 172.21.15.44:0/404829487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f978414bb30 msgr2=0x7f9784159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9782ffd700 1 --2- 172.21.15.44:0/404829487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f978414bb30 0x7f9784159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9782ffd700 1 -- 172.21.15.44:0/404829487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978414dd40 con 0x7f9770003a20 2024-09-13T18:28:15.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f97837fe700 1 --2- 172.21.15.44:0/404829487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f978414bb30 0x7f9784159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:15.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.454+0000 7f9782ffd700 1 --2- 172.21.15.44:0/404829487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9770003a20 0x7f978414d000 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f976c00c930 tx=0x7f976c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:15.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.458+0000 7f977b7fe700 1 -- 172.21.15.44:0/404829487 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c007c40 con 0x7f9770003a20 2024-09-13T18:28:15.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.458+0000 7f9783fff700 1 -- 172.21.15.44:0/404829487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97840a8690 con 0x7f9770003a20 2024-09-13T18:28:15.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.458+0000 7f977b7fe700 1 -- 172.21.15.44:0/404829487 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c004aa0 con 0x7f9770003a20 2024-09-13T18:28:15.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.458+0000 7f9783fff700 1 -- 172.21.15.44:0/404829487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f978414e1a0 con 0x7f9770003a20 2024-09-13T18:28:15.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.458+0000 7f977b7fe700 1 -- 172.21.15.44:0/404829487 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c004e10 con 0x7f9770003a20 2024-09-13T18:28:15.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.458+0000 7f977b7fe700 1 -- 172.21.15.44:0/404829487 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f976c0070d0 con 0x7f9770003a20 2024-09-13T18:28:15.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.458+0000 7f977b7fe700 1 --2- 172.21.15.44:0/404829487 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9764066760 0x7f9764068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.458+0000 7f9783fff700 1 -- 172.21.15.44:0/404829487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f978414df80 con 0x7f9770003a20 2024-09-13T18:28:15.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.458+0000 7f977b7fe700 1 -- 172.21.15.44:0/404829487 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f976c0854e0 con 0x7f9770003a20 2024-09-13T18:28:15.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.458+0000 7f97827fc700 1 --2- 172.21.15.44:0/404829487 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9764066760 0x7f9764068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.462+0000 7f97827fc700 1 --2- 172.21.15.44:0/404829487 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9764066760 0x7f9764068c20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9784071ab0 tx=0x7f9774009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:15.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.466+0000 7f977b7fe700 1 -- 172.21.15.44:0/404829487 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f976c056410 con 0x7f9770003a20 2024-09-13T18:28:15.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.670+0000 7f9783fff700 1 -- 172.21.15.44:0/404829487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f978415af80 con 0x7f9770003a20 2024-09-13T18:28:15.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.670+0000 7f977b7fe700 1 -- 172.21.15.44:0/404829487 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f976c021070 con 0x7f9770003a20 2024-09-13T18:28:15.677 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:28:15.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.674+0000 7f9783fff700 1 -- 172.21.15.44:0/404829487 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9764066760 msgr2=0x7f9764068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.674+0000 7f9783fff700 1 --2- 172.21.15.44:0/404829487 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9764066760 0x7f9764068c20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9784071ab0 tx=0x7f9774009040 comp rx=0 tx=0).stop 2024-09-13T18:28:15.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.674+0000 7f9783fff700 1 -- 172.21.15.44:0/404829487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9770003a20 msgr2=0x7f978414d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.674+0000 7f9783fff700 1 --2- 172.21.15.44:0/404829487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9770003a20 0x7f978414d000 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f976c00c930 tx=0x7f976c000fe0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.674+0000 7f9783fff700 1 -- 172.21.15.44:0/404829487 shutdown_connections 2024-09-13T18:28:15.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.674+0000 7f9783fff700 1 --2- 172.21.15.44:0/404829487 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9764066760 0x7f9764068c20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.674+0000 7f9783fff700 1 --2- 172.21.15.44:0/404829487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f978414bb30 0x7f9784159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.674+0000 7f9783fff700 1 --2- 172.21.15.44:0/404829487 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f978414d540 0x7f9784159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.674+0000 7f9783fff700 1 --2- 172.21.15.44:0/404829487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9770003a20 0x7f978414d000 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.674+0000 7f9783fff700 1 -- 172.21.15.44:0/404829487 >> 172.21.15.44:0/404829487 conn(0x7f97840cf910 msgr2=0x7f97840cfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:15.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.674+0000 7f9783fff700 1 -- 172.21.15.44:0/404829487 shutdown_connections 2024-09-13T18:28:15.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:15.674+0000 7f9783fff700 1 -- 172.21.15.44:0/404829487 wait complete. 2024-09-13T18:28:15.692 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:28:15.692 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:28:15.692 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-13T18:28:15.692 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:28:15.692 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:15.692 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:28:15.693 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:28:15.693 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:28:15.693 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:28:15.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:15.693 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-13T18:28:15.699 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:28:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:28:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:28:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-13T18:28:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:15.699 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:28:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:15.699 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:28:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:15.699 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:28:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:15.699 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:28:15.700 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42528sec preferred_lft 42528sec 2024-09-13T18:28:15.700 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-13T18:28:15.700 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:15.700 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:28:15.700 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:15.700 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:28:15.700 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:80:b2:e4:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:15.700 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:28:15.700 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:15.700 INFO:teuthology.orchestra.run.smithi044.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:28:15.700 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 2e:69:eb:1c:57:57 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:15.700 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:28:15.700 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:15.700 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::8842:91ff:feed:2c53/64 scope link 2024-09-13T18:28:15.701 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:15.701 INFO:teuthology.orchestra.run.smithi044.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:28:15.701 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 2e:69:eb:1c:57:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:28:15.701 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::2c69:ebff:fe1c:5757/64 scope link 2024-09-13T18:28:15.701 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:15.701 INFO:teuthology.orchestra.run.smithi044.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:28:15.701 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 86:e5:07:ac:f1:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:28:15.701 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::84e5:7ff:feac:f11b/64 scope link 2024-09-13T18:28:15.701 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:15.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:15.701 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:28:15.715 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-13T18:28:15.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:15.717 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-13T18:28:15.766 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-13T18:28:15.767 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:28:15.767 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:28:15.767 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:28:15.767 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:28:15.767 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:28:15.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:15.767 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2024-09-13T18:28:15.767 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-13T18:28:15.767 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:28:15.768 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:28:15.768 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:28:15.768 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-13T18:28:15.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:15.809 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-13T18:28:15.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:28:15.815 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:28:15.816 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:28:15.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:15.816 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-13T18:28:15.873 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:28:15.873 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:28:15.873 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:15.878 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:28:15.879 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:28:15.879 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:15.886 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:28:15.900 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:28:15.900 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:28:15.955 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:28:15.957 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:28:15.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:15.957 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:28:15.963 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:28:15.964 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:28:15.966 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:28:15.981 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:28:15.981 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:28:15.998 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:28:15.998 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:28:15.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:15.999 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:28:16.054 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2024-09-13T18:28:16.046+0000 7fb788994640 -1 init, newargv = 0x555ff15ad390 newargc=15 2024-09-13T18:28:16.054 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[37621]: starting ceph client 2024-09-13T18:28:16.063 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[37621]: starting fuse 2024-09-13T18:28:17.156 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:28:17.175 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:28:17.175 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:28:17.234 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:28:17.234 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:28:17.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:17.235 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:28:17.240 INFO:teuthology.orchestra.run.smithi044.stdout:52 2024-09-13T18:28:17.241 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T18:28:17.241 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:28:17.241 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2024-09-13T18:28:17.241 DEBUG:teuthology.orchestra.run.smithi044:> import re 2024-09-13T18:28:17.241 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:28:17.241 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2024-09-13T18:28:17.241 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:17.241 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2024-09-13T18:28:17.241 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:28:17.241 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2024-09-13T18:28:17.241 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:28:17.241 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:17.242 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2024-09-13T18:28:17.242 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2024-09-13T18:28:17.242 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2024-09-13T18:28:17.242 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2024-09-13T18:28:17.242 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:17.242 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2024-09-13T18:28:17.242 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:28:17.242 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:28:17.242 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:28:17.242 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2024-09-13T18:28:17.242 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2024-09-13T18:28:17.242 DEBUG:teuthology.orchestra.run.smithi044:> return f 2024-09-13T18:28:17.242 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:28:17.242 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:17.242 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.0")) 2024-09-13T18:28:17.243 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:28:17.326 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.0.37621.asok 2024-09-13T18:28:17.512 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37621.asok 2024-09-13T18:28:17.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:17.512 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37621.asok status 2024-09-13T18:28:17.661 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:28:17.661 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2024-09-13T18:28:17.661 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:28:17.661 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:28:17.661 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "0", 2024-09-13T18:28:17.661 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2024-09-13T18:28:17.661 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:28:17.661 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "37621", 2024-09-13T18:28:17.661 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2024-09-13T18:28:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:28:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2024-09-13T18:28:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2024-09-13T18:28:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 5511, 2024-09-13T18:28:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2024-09-13T18:28:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2024-09-13T18:28:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2024-09-13T18:28:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 5511 2024-09-13T18:28:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:28:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:28:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-13T18:28:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:28:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2308726279 2024-09-13T18:28:17.662 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:28:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:28:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:28:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-13T18:28:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:28:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2308726279 2024-09-13T18:28:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:28:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.5511 192.168.0.1:0/2308726279", 2024-09-13T18:28:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/2308726279", 2024-09-13T18:28:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2024-09-13T18:28:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 15, 2024-09-13T18:28:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 35, 2024-09-13T18:28:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:28:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2024-09-13T18:28:17.663 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2024-09-13T18:28:17.663 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:28:17.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:17.672 DEBUG:teuthology.orchestra.run.smithi044:> stat --file-system '--printf=%T 2024-09-13T18:28:17.672 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:17.680 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2024-09-13T18:28:17.680 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:17.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:17.680 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:17.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:17.697 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rootfile) 2024-09-13T18:28:17.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:17.715 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-13T18:28:17.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:17.728 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/subdirfile) 2024-09-13T18:28:17.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:17.744 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir linkdir) 2024-09-13T18:28:17.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:17.755 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch linkdir/link0) 2024-09-13T18:28:17.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:17.811 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f linkdir/link0) 2024-09-13T18:28:17.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:17.822 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln subdir/subdirfile linkdir/link0) 2024-09-13T18:28:17.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:17.836 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln subdir/subdirfile linkdir/link1) 2024-09-13T18:28:17.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:17.848 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln subdir/subdirfile linkdir/link2) 2024-09-13T18:28:17.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:17.862 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f linkdir/link2) 2024-09-13T18:28:17.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:17.876 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch linkdir/link2) 2024-09-13T18:28:17.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:17.929 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln subdir/subdirfile linkdir/link3) 2024-09-13T18:28:17.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:17.949 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f linkdir/link3) 2024-09-13T18:28:18.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:18.007 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln rootfile linkdir/link3) 2024-09-13T18:28:18.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:18.019 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir/subsubdir) 2024-09-13T18:28:18.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:18.074 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync) 2024-09-13T18:28:18.430 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:28:18.430 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:28:18.430 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-13T18:28:18.430 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:18.430 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/rootfile").st_ino) 2024-09-13T18:28:18.430 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:28:18.500 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627776 2024-09-13T18:28:18.689 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:28:18.690 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:28:18.690 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-13T18:28:18.690 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:18.690 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2024-09-13T18:28:18.690 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:28:18.798 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627777 2024-09-13T18:28:18.987 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:28:18.987 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:28:18.987 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-13T18:28:18.987 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:18.987 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/linkdir").st_ino) 2024-09-13T18:28:18.987 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:28:19.058 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628279 2024-09-13T18:28:19.246 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:28:19.246 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:28:19.246 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-13T18:28:19.246 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:19.247 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir/subdirfile").st_ino) 2024-09-13T18:28:19.247 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:28:19.317 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627778 2024-09-13T18:28:19.505 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:28:19.506 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:28:19.506 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-13T18:28:19.506 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:19.506 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir/subsubdir").st_ino) 2024-09-13T18:28:19.506 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:28:19.617 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628282 2024-09-13T18:28:19.805 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:28:19.806 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:28:19.814 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:28:19.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.934+0000 7f1c31a4d700 1 Processor -- start 2024-09-13T18:28:19.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.934+0000 7f1c31a4d700 1 -- start start 2024-09-13T18:28:19.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.934+0000 7f1c31a4d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1c2c160eb0 0x7f1c2c165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:19.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.934+0000 7f1c31a4d700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1c2c0b33d0 0x7f1c2c0b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:19.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.934+0000 7f1c31a4d700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2c0b3d60 con 0x7f1c2c161290 2024-09-13T18:28:19.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.934+0000 7f1c31a4d700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c2c161df0 con 0x7f1c2c160eb0 2024-09-13T18:28:19.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.934+0000 7f1c31a4d700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c2c071f30 con 0x7f1c2c0b33d0 2024-09-13T18:28:19.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.934+0000 7f1c30a4b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1c2c160eb0 0x7f1c2c165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:19.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.934+0000 7f1c30a4b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1c2c160eb0 0x7f1c2c165590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50878/0 (socket says 172.21.15.44:50878) 2024-09-13T18:28:19.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.934+0000 7f1c30a4b700 1 -- 172.21.15.44:0/1989841353 learned_addr learned my addr 172.21.15.44:0/1989841353 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:19.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.934+0000 7f1c2bfff700 1 --2- 172.21.15.44:0/1989841353 >> v2:172.21.15.99:3300/0 conn(0x7f1c2c0b33d0 0x7f1c2c0b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:19.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.934+0000 7f1c30a4b700 1 -- 172.21.15.44:0/1989841353 >> v2:172.21.15.99:3300/0 conn(0x7f1c2c0b33d0 msgr2=0x7f1c2c0b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:19.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.934+0000 7f1c30a4b700 1 --2- 172.21.15.44:0/1989841353 >> v2:172.21.15.99:3300/0 conn(0x7f1c2c0b33d0 0x7f1c2c0b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:19.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.934+0000 7f1c30a4b700 1 -- 172.21.15.44:0/1989841353 >> v1:172.21.15.99:6789/0 conn(0x7f1c2c161290 legacy=0x7f1c2c1616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:19.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.934+0000 7f1c30a4b700 1 -- 172.21.15.44:0/1989841353 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c1622e0 con 0x7f1c2c160eb0 2024-09-13T18:28:19.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.934+0000 7f1c30a4b700 1 --2- 172.21.15.44:0/1989841353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c2c160eb0 0x7f1c2c165590 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c06ab00 tx=0x7f1c20009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2609cf98044d760 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:19.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.938+0000 7f1c2b7fe700 1 -- 172.21.15.44:0/1989841353 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20011830 con 0x7f1c2c160eb0 2024-09-13T18:28:19.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.938+0000 7f1c2b7fe700 1 -- 172.21.15.44:0/1989841353 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c20011990 con 0x7f1c2c160eb0 2024-09-13T18:28:19.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.938+0000 7f1c2b7fe700 1 -- 172.21.15.44:0/1989841353 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20011d20 con 0x7f1c2c160eb0 2024-09-13T18:28:19.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.938+0000 7f1c31a4d700 1 -- 172.21.15.44:0/1989841353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c2c160eb0 msgr2=0x7f1c2c165590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:19.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.938+0000 7f1c31a4d700 1 --2- 172.21.15.44:0/1989841353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c2c160eb0 0x7f1c2c165590 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c06ab00 tx=0x7f1c20009bf0 comp rx=0 tx=0).stop 2024-09-13T18:28:19.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.938+0000 7f1c31a4d700 1 -- 172.21.15.44:0/1989841353 shutdown_connections 2024-09-13T18:28:19.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.938+0000 7f1c31a4d700 1 --2- 172.21.15.44:0/1989841353 >> v2:172.21.15.99:3300/0 conn(0x7f1c2c0b33d0 0x7f1c2c0b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:19.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.938+0000 7f1c31a4d700 1 --2- 172.21.15.44:0/1989841353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c2c160eb0 0x7f1c2c165590 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:19.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.938+0000 7f1c31a4d700 1 -- 172.21.15.44:0/1989841353 >> 172.21.15.44:0/1989841353 conn(0x7f1c2c0b0f00 msgr2=0x7f1c2c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:19.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.938+0000 7f1c31a4d700 1 -- 172.21.15.44:0/1989841353 shutdown_connections 2024-09-13T18:28:19.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.938+0000 7f1c31a4d700 1 -- 172.21.15.44:0/1989841353 wait complete. 2024-09-13T18:28:19.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.942+0000 7f1c31a4d700 1 Processor -- start 2024-09-13T18:28:19.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.942+0000 7f1c31a4d700 1 -- start start 2024-09-13T18:28:19.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.942+0000 7f1c31a4d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c2c0b33d0 0x7f1c2c15c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:19.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.942+0000 7f1c31a4d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c2c160eb0 0x7f1c2c0b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.942+0000 7f1c31a4d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c2c161290 0x7f1c2c0b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.942+0000 7f1c31a4d700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c0ab630 con 0x7f1c2c0b33d0 2024-09-13T18:28:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.942+0000 7f1c31a4d700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c160710 con 0x7f1c2c161290 2024-09-13T18:28:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.942+0000 7f1c31a4d700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c15ca90 con 0x7f1c2c160eb0 2024-09-13T18:28:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.942+0000 7f1c30a4b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c2c0b33d0 0x7f1c2c15c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.942+0000 7f1c30a4b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c2c0b33d0 0x7f1c2c15c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50884/0 (socket says 172.21.15.44:50884) 2024-09-13T18:28:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.942+0000 7f1c30a4b700 1 -- 172.21.15.44:0/3295946018 learned_addr learned my addr 172.21.15.44:0/3295946018 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.942+0000 7f1c2bfff700 1 --2- 172.21.15.44:0/3295946018 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c2c160eb0 0x7f1c2c0b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.942+0000 7f1c3124c700 1 --2- 172.21.15.44:0/3295946018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c2c161290 0x7f1c2c0b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.942+0000 7f1c30a4b700 1 -- 172.21.15.44:0/3295946018 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c2c160eb0 msgr2=0x7f1c2c0b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.942+0000 7f1c30a4b700 1 --2- 172.21.15.44:0/3295946018 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c2c160eb0 0x7f1c2c0b2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.942+0000 7f1c30a4b700 1 -- 172.21.15.44:0/3295946018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c2c161290 msgr2=0x7f1c2c0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.942+0000 7f1c30a4b700 1 --2- 172.21.15.44:0/3295946018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c2c161290 0x7f1c2c0b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.942+0000 7f1c30a4b700 1 -- 172.21.15.44:0/3295946018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c20009570 con 0x7f1c2c0b33d0 2024-09-13T18:28:19.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.942+0000 7f1c30a4b700 1 --2- 172.21.15.44:0/3295946018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c2c0b33d0 0x7f1c2c15c550 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c070ba0 tx=0x7f1c20004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:19.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.942+0000 7f1c297fa700 1 -- 172.21.15.44:0/3295946018 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20004450 con 0x7f1c2c0b33d0 2024-09-13T18:28:19.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.942+0000 7f1c297fa700 1 -- 172.21.15.44:0/3295946018 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2001f070 con 0x7f1c2c0b33d0 2024-09-13T18:28:19.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.942+0000 7f1c31a4d700 1 -- 172.21.15.44:0/3295946018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c2c15e3f0 con 0x7f1c2c0b33d0 2024-09-13T18:28:19.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.942+0000 7f1c297fa700 1 -- 172.21.15.44:0/3295946018 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20003900 con 0x7f1c2c0b33d0 2024-09-13T18:28:19.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.946+0000 7f1c31a4d700 1 -- 172.21.15.44:0/3295946018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c2c15e9b0 con 0x7f1c2c0b33d0 2024-09-13T18:28:19.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.946+0000 7f1c31a4d700 1 -- 172.21.15.44:0/3295946018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c2c0b3820 con 0x7f1c2c0b33d0 2024-09-13T18:28:19.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.946+0000 7f1c297fa700 1 -- 172.21.15.44:0/3295946018 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c20003a60 con 0x7f1c2c0b33d0 2024-09-13T18:28:19.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.946+0000 7f1c297fa700 1 --2- 172.21.15.44:0/3295946018 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c18066730 0x7f1c18068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:19.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.946+0000 7f1c297fa700 1 -- 172.21.15.44:0/3295946018 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c20021070 con 0x7f1c2c0b33d0 2024-09-13T18:28:19.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.946+0000 7f1c2bfff700 1 --2- 172.21.15.44:0/3295946018 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c18066730 0x7f1c18068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:19.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.946+0000 7f1c2bfff700 1 --2- 172.21.15.44:0/3295946018 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c18066730 0x7f1c18068bf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c1ebe60 tx=0x7f1c1c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:19.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:19.954+0000 7f1c297fa700 1 -- 172.21.15.44:0/3295946018 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1c20052950 con 0x7f1c2c0b33d0 2024-09-13T18:28:20.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.130+0000 7f1c31a4d700 1 -- 172.21.15.44:0/3295946018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c2c1619c0 con 0x7f1c2c0b33d0 2024-09-13T18:28:20.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.130+0000 7f1c297fa700 1 -- 172.21.15.44:0/3295946018 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16509 (secure 0 0 0) 0x7f1c20083e60 con 0x7f1c2c0b33d0 2024-09-13T18:28:20.136 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:20.137 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":35,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:28:06.066299+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:28:02.951723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:28:04.057772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:28:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.134+0000 7f1c31a4d700 1 -- 172.21.15.44:0/3295946018 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c18066730 msgr2=0x7f1c18068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.134+0000 7f1c31a4d700 1 --2- 172.21.15.44:0/3295946018 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c18066730 0x7f1c18068bf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c1ebe60 tx=0x7f1c1c009240 comp rx=0 tx=0).stop 2024-09-13T18:28:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.134+0000 7f1c31a4d700 1 -- 172.21.15.44:0/3295946018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c2c0b33d0 msgr2=0x7f1c2c15c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.134+0000 7f1c31a4d700 1 --2- 172.21.15.44:0/3295946018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c2c0b33d0 0x7f1c2c15c550 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c070ba0 tx=0x7f1c20004770 comp rx=0 tx=0).stop 2024-09-13T18:28:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.134+0000 7f1c31a4d700 1 -- 172.21.15.44:0/3295946018 shutdown_connections 2024-09-13T18:28:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.134+0000 7f1c31a4d700 1 --2- 172.21.15.44:0/3295946018 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1c18066730 0x7f1c18068bf0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.134+0000 7f1c31a4d700 1 --2- 172.21.15.44:0/3295946018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c2c161290 0x7f1c2c0b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.134+0000 7f1c31a4d700 1 --2- 172.21.15.44:0/3295946018 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c2c160eb0 0x7f1c2c0b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.134+0000 7f1c31a4d700 1 --2- 172.21.15.44:0/3295946018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c2c0b33d0 0x7f1c2c15c550 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.134+0000 7f1c31a4d700 1 -- 172.21.15.44:0/3295946018 >> 172.21.15.44:0/3295946018 conn(0x7f1c2c0b0f00 msgr2=0x7f1c2c0af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.134+0000 7f1c31a4d700 1 -- 172.21.15.44:0/3295946018 shutdown_connections 2024-09-13T18:28:20.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.134+0000 7f1c31a4d700 1 -- 172.21.15.44:0/3295946018 wait complete. 2024-09-13T18:28:20.152 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:28:02.951723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:28:04.057772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:28:20.152 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:28:20.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.266+0000 7f6e21885700 1 Processor -- start 2024-09-13T18:28:20.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.266+0000 7f6e21885700 1 -- start start 2024-09-13T18:28:20.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.266+0000 7f6e21885700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e1c15cda0 0x7f6e1c06b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.266+0000 7f6e21885700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6e1c06a520 0x7f6e1c06a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.266+0000 7f6e21885700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e1c06aeb0 con 0x7f6e1c0ceb70 2024-09-13T18:28:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.266+0000 7f6e21885700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e1c06be40 con 0x7f6e1c06a520 2024-09-13T18:28:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.266+0000 7f6e21885700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c0b64f0 con 0x7f6e1c15cda0 2024-09-13T18:28:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.266+0000 7f6e20883700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e1c15cda0 0x7f6e1c06b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.266+0000 7f6e21084700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6e1c06a520 0x7f6e1c06a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.266+0000 7f6e20883700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e1c15cda0 0x7f6e1c06b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:40336/0 (socket says 172.21.15.44:40336) 2024-09-13T18:28:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.266+0000 7f6e20883700 1 -- 172.21.15.44:0/1498555732 learned_addr learned my addr 172.21.15.44:0/1498555732 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.266+0000 7f6e20883700 1 -- 172.21.15.44:0/1498555732 >> v2:172.21.15.99:3300/0 conn(0x7f6e1c06a520 msgr2=0x7f6e1c06a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.266+0000 7f6e20883700 1 --2- 172.21.15.44:0/1498555732 >> v2:172.21.15.99:3300/0 conn(0x7f6e1c06a520 0x7f6e1c06a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.266+0000 7f6e20883700 1 -- 172.21.15.44:0/1498555732 >> v1:172.21.15.99:6789/0 conn(0x7f6e1c0ceb70 legacy=0x7f6e1c0b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.266+0000 7f6e20883700 1 -- 172.21.15.44:0/1498555732 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c0b8430 con 0x7f6e1c15cda0 2024-09-13T18:28:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.266+0000 7f6e20883700 1 --2- 172.21.15.44:0/1498555732 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e1c15cda0 0x7f6e1c06b900 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6e08009910 tx=0x7f6e08009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4c8be4efb6c3677 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.266+0000 7f6e1b7fe700 1 -- 172.21.15.44:0/1498555732 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e08011830 con 0x7f6e1c15cda0 2024-09-13T18:28:20.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.266+0000 7f6e1b7fe700 1 -- 172.21.15.44:0/1498555732 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e08011990 con 0x7f6e1c15cda0 2024-09-13T18:28:20.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.266+0000 7f6e1b7fe700 1 -- 172.21.15.44:0/1498555732 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e08011d40 con 0x7f6e1c15cda0 2024-09-13T18:28:20.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.270+0000 7f6e21885700 1 -- 172.21.15.44:0/1498555732 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e1c15cda0 msgr2=0x7f6e1c06b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:20.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.270+0000 7f6e21885700 1 --2- 172.21.15.44:0/1498555732 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e1c15cda0 0x7f6e1c06b900 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6e08009910 tx=0x7f6e08009c20 comp rx=0 tx=0).stop 2024-09-13T18:28:20.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.270+0000 7f6e21885700 1 -- 172.21.15.44:0/1498555732 shutdown_connections 2024-09-13T18:28:20.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.270+0000 7f6e21885700 1 --2- 172.21.15.44:0/1498555732 >> v2:172.21.15.99:3300/0 conn(0x7f6e1c06a520 0x7f6e1c06a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.270+0000 7f6e21885700 1 --2- 172.21.15.44:0/1498555732 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e1c15cda0 0x7f6e1c06b900 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.270+0000 7f6e21885700 1 -- 172.21.15.44:0/1498555732 >> 172.21.15.44:0/1498555732 conn(0x7f6e1c0d2cb0 msgr2=0x7f6e1c0d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:20.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.270+0000 7f6e21885700 1 -- 172.21.15.44:0/1498555732 shutdown_connections 2024-09-13T18:28:20.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.270+0000 7f6e21885700 1 -- 172.21.15.44:0/1498555732 wait complete. 2024-09-13T18:28:20.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.270+0000 7f6e21885700 1 Processor -- start 2024-09-13T18:28:20.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.270+0000 7f6e21885700 1 -- start start 2024-09-13T18:28:20.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e21885700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e1c06a520 0x7f6e1c144d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e21885700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e1c0ceb70 0x7f6e1c15d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e21885700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e1c15cda0 0x7f6e1c0c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e21885700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c0c9ac0 con 0x7f6e1c0ceb70 2024-09-13T18:28:20.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e21885700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c15f2a0 con 0x7f6e1c06a520 2024-09-13T18:28:20.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e21885700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c1478a0 con 0x7f6e1c15cda0 2024-09-13T18:28:20.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e1bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e1c0ceb70 0x7f6e1c15d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e1bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e1c0ceb70 0x7f6e1c15d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50896/0 (socket says 172.21.15.44:50896) 2024-09-13T18:28:20.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e1bfff700 1 -- 172.21.15.44:0/368168758 learned_addr learned my addr 172.21.15.44:0/368168758 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:20.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e20883700 1 --2- 172.21.15.44:0/368168758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e1c06a520 0x7f6e1c144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e21084700 1 --2- 172.21.15.44:0/368168758 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e1c15cda0 0x7f6e1c0c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e1bfff700 1 -- 172.21.15.44:0/368168758 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e1c15cda0 msgr2=0x7f6e1c0c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:20.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e1bfff700 1 --2- 172.21.15.44:0/368168758 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e1c15cda0 0x7f6e1c0c9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e1bfff700 1 -- 172.21.15.44:0/368168758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e1c06a520 msgr2=0x7f6e1c144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:20.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e1bfff700 1 --2- 172.21.15.44:0/368168758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e1c06a520 0x7f6e1c144d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e1bfff700 1 -- 172.21.15.44:0/368168758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e08009570 con 0x7f6e1c0ceb70 2024-09-13T18:28:20.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e20883700 1 --2- 172.21.15.44:0/368168758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e1c06a520 0x7f6e1c144d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:20.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e1bfff700 1 --2- 172.21.15.44:0/368168758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e1c0ceb70 0x7f6e1c15d210 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000c4d0 tx=0x7f6e1000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:20.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e197fa700 1 -- 172.21.15.44:0/368168758 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e100052d0 con 0x7f6e1c0ceb70 2024-09-13T18:28:20.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e21885700 1 -- 172.21.15.44:0/368168758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1c147b80 con 0x7f6e1c0ceb70 2024-09-13T18:28:20.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e197fa700 1 -- 172.21.15.44:0/368168758 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e10005430 con 0x7f6e1c0ceb70 2024-09-13T18:28:20.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e197fa700 1 -- 172.21.15.44:0/368168758 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e100055a0 con 0x7f6e1c0ceb70 2024-09-13T18:28:20.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e21885700 1 -- 172.21.15.44:0/368168758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1c15ebe0 con 0x7f6e1c0ceb70 2024-09-13T18:28:20.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.274+0000 7f6e21885700 1 -- 172.21.15.44:0/368168758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e1c0cefd0 con 0x7f6e1c0ceb70 2024-09-13T18:28:20.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.278+0000 7f6e197fa700 1 -- 172.21.15.44:0/368168758 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6e100038a0 con 0x7f6e1c0ceb70 2024-09-13T18:28:20.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.278+0000 7f6e197fa700 1 --2- 172.21.15.44:0/368168758 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6e00066730 0x7f6e00068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.278+0000 7f6e197fa700 1 -- 172.21.15.44:0/368168758 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e100833a0 con 0x7f6e1c0ceb70 2024-09-13T18:28:20.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.278+0000 7f6e20883700 1 --2- 172.21.15.44:0/368168758 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6e00066730 0x7f6e00068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.278+0000 7f6e20883700 1 --2- 172.21.15.44:0/368168758 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6e00066730 0x7f6e00068bf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6e08000c00 tx=0x7f6e08008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:20.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.286+0000 7f6e197fa700 1 -- 172.21.15.44:0/368168758 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6e10050740 con 0x7f6e1c0ceb70 2024-09-13T18:28:20.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.454+0000 7f6e21885700 1 -- 172.21.15.44:0/368168758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e1c06b680 con 0x7f6e1c0ceb70 2024-09-13T18:28:20.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.454+0000 7f6e197fa700 1 -- 172.21.15.44:0/368168758 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e1c06b680 con 0x7f6e1c0ceb70 2024-09-13T18:28:20.461 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:28:20.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.458+0000 7f6e21885700 1 -- 172.21.15.44:0/368168758 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6e00066730 msgr2=0x7f6e00068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:20.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.458+0000 7f6e21885700 1 --2- 172.21.15.44:0/368168758 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6e00066730 0x7f6e00068bf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6e08000c00 tx=0x7f6e08008030 comp rx=0 tx=0).stop 2024-09-13T18:28:20.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.458+0000 7f6e21885700 1 -- 172.21.15.44:0/368168758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e1c0ceb70 msgr2=0x7f6e1c15d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:20.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.458+0000 7f6e21885700 1 --2- 172.21.15.44:0/368168758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e1c0ceb70 0x7f6e1c15d210 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000c4d0 tx=0x7f6e1000c890 comp rx=0 tx=0).stop 2024-09-13T18:28:20.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.458+0000 7f6e21885700 1 -- 172.21.15.44:0/368168758 shutdown_connections 2024-09-13T18:28:20.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.458+0000 7f6e21885700 1 --2- 172.21.15.44:0/368168758 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6e00066730 0x7f6e00068bf0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.458+0000 7f6e21885700 1 --2- 172.21.15.44:0/368168758 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e1c15cda0 0x7f6e1c0c9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.458+0000 7f6e21885700 1 --2- 172.21.15.44:0/368168758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e1c0ceb70 0x7f6e1c15d210 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.458+0000 7f6e21885700 1 --2- 172.21.15.44:0/368168758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e1c06a520 0x7f6e1c144d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.458+0000 7f6e21885700 1 -- 172.21.15.44:0/368168758 >> 172.21.15.44:0/368168758 conn(0x7f6e1c0d2cb0 msgr2=0x7f6e1c066110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:20.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.458+0000 7f6e21885700 1 -- 172.21.15.44:0/368168758 shutdown_connections 2024-09-13T18:28:20.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.458+0000 7f6e21885700 1 -- 172.21.15.44:0/368168758 wait complete. 2024-09-13T18:28:20.476 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:28:20.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.586+0000 7f1240909700 1 Processor -- start 2024-09-13T18:28:20.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.586+0000 7f1240909700 1 -- start start 2024-09-13T18:28:20.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.586+0000 7f1240909700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f123c0b29a0 0x7f123c0cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.586+0000 7f1240909700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f123c06c090 0x7f123c06c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.586+0000 7f1240909700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123c0ccea0 con 0x7f123c06bcb0 2024-09-13T18:28:20.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.586+0000 7f1240909700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123c0b2f80 con 0x7f123c0b29a0 2024-09-13T18:28:20.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.586+0000 7f1240909700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123c0b3260 con 0x7f123c06c090 2024-09-13T18:28:20.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.586+0000 7f123a59c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f123c0b29a0 0x7f123c0cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.586+0000 7f123a59c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f123c0b29a0 0x7f123c0cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50908/0 (socket says 172.21.15.44:50908) 2024-09-13T18:28:20.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.586+0000 7f123a59c700 1 -- 172.21.15.44:0/1215733464 learned_addr learned my addr 172.21.15.44:0/1215733464 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:20.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.586+0000 7f123b59e700 1 --2- 172.21.15.44:0/1215733464 >> v2:172.21.15.99:3300/0 conn(0x7f123c06c090 0x7f123c06c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.586+0000 7f123a59c700 1 -- 172.21.15.44:0/1215733464 >> v2:172.21.15.99:3300/0 conn(0x7f123c06c090 msgr2=0x7f123c06c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:20.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.586+0000 7f123a59c700 1 --2- 172.21.15.44:0/1215733464 >> v2:172.21.15.99:3300/0 conn(0x7f123c06c090 0x7f123c06c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.590+0000 7f123a59c700 1 -- 172.21.15.44:0/1215733464 >> v1:172.21.15.99:6789/0 conn(0x7f123c06bcb0 legacy=0x7f123c0aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:20.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.590+0000 7f123a59c700 1 -- 172.21.15.44:0/1215733464 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c0b3540 con 0x7f123c0b29a0 2024-09-13T18:28:20.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.590+0000 7f123a59c700 1 --2- 172.21.15.44:0/1215733464 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f123c0b29a0 0x7f123c0cc8b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f123c072500 tx=0x7f122c00be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81424d45cab736b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:20.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.590+0000 7f1239d9b700 1 -- 172.21.15.44:0/1215733464 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c00dd50 con 0x7f123c0b29a0 2024-09-13T18:28:20.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.590+0000 7f1239d9b700 1 -- 172.21.15.44:0/1215733464 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c004030 con 0x7f123c0b29a0 2024-09-13T18:28:20.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.590+0000 7f1239d9b700 1 -- 172.21.15.44:0/1215733464 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c0043c0 con 0x7f123c0b29a0 2024-09-13T18:28:20.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.590+0000 7f1240909700 1 -- 172.21.15.44:0/1215733464 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f123c0b29a0 msgr2=0x7f123c0cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:20.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.590+0000 7f1240909700 1 --2- 172.21.15.44:0/1215733464 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f123c0b29a0 0x7f123c0cc8b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f123c072500 tx=0x7f122c00be90 comp rx=0 tx=0).stop 2024-09-13T18:28:20.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.590+0000 7f1240909700 1 -- 172.21.15.44:0/1215733464 shutdown_connections 2024-09-13T18:28:20.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.590+0000 7f1240909700 1 --2- 172.21.15.44:0/1215733464 >> v2:172.21.15.99:3300/0 conn(0x7f123c06c090 0x7f123c06c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.590+0000 7f1240909700 1 --2- 172.21.15.44:0/1215733464 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f123c0b29a0 0x7f123c0cc8b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.590+0000 7f1240909700 1 -- 172.21.15.44:0/1215733464 >> 172.21.15.44:0/1215733464 conn(0x7f123c0b1cd0 msgr2=0x7f123c0cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:20.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.590+0000 7f1240909700 1 -- 172.21.15.44:0/1215733464 shutdown_connections 2024-09-13T18:28:20.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.590+0000 7f1240909700 1 -- 172.21.15.44:0/1215733464 wait complete. 2024-09-13T18:28:20.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.594+0000 7f1240909700 1 Processor -- start 2024-09-13T18:28:20.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.594+0000 7f1240909700 1 -- start start 2024-09-13T18:28:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.594+0000 7f1240909700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f123c06bcb0 0x7f123c0ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.594+0000 7f1240909700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f123c06c090 0x7f123c1528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.594+0000 7f1240909700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f123c0b29a0 0x7f123c150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.594+0000 7f1240909700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c155600 con 0x7f123c06c090 2024-09-13T18:28:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.594+0000 7f1240909700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c154df0 con 0x7f123c0b29a0 2024-09-13T18:28:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.594+0000 7f1240909700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c1558a0 con 0x7f123c06bcb0 2024-09-13T18:28:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.594+0000 7f123a59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f123c06c090 0x7f123c1528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.594+0000 7f123a59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f123c06c090 0x7f123c1528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50924/0 (socket says 172.21.15.44:50924) 2024-09-13T18:28:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.594+0000 7f123a59c700 1 -- 172.21.15.44:0/3106346206 learned_addr learned my addr 172.21.15.44:0/3106346206 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.594+0000 7f123b59e700 1 --2- 172.21.15.44:0/3106346206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f123c0b29a0 0x7f123c150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.594+0000 7f123ad9d700 1 --2- 172.21.15.44:0/3106346206 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f123c06bcb0 0x7f123c0ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.598+0000 7f123a59c700 1 -- 172.21.15.44:0/3106346206 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f123c06bcb0 msgr2=0x7f123c0ab2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:20.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.598+0000 7f123a59c700 1 --2- 172.21.15.44:0/3106346206 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f123c06bcb0 0x7f123c0ab2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.598+0000 7f123a59c700 1 -- 172.21.15.44:0/3106346206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f123c0b29a0 msgr2=0x7f123c150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:20.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.598+0000 7f123a59c700 1 --2- 172.21.15.44:0/3106346206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f123c0b29a0 0x7f123c150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.598+0000 7f123a59c700 1 -- 172.21.15.44:0/3106346206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122c00b810 con 0x7f123c06c090 2024-09-13T18:28:20.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.598+0000 7f123b59e700 1 --2- 172.21.15.44:0/3106346206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f123c0b29a0 0x7f123c150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:20.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.598+0000 7f123ad9d700 1 --2- 172.21.15.44:0/3106346206 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f123c06bcb0 0x7f123c0ab2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:20.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.598+0000 7f123a59c700 1 --2- 172.21.15.44:0/3106346206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f123c06c090 0x7f123c1528e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f123c0722e0 tx=0x7f122c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:20.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.598+0000 7f12337fe700 1 -- 172.21.15.44:0/3106346206 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c020070 con 0x7f123c06c090 2024-09-13T18:28:20.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.598+0000 7f12337fe700 1 -- 172.21.15.44:0/3106346206 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c003b00 con 0x7f123c06c090 2024-09-13T18:28:20.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.598+0000 7f1240909700 1 -- 172.21.15.44:0/3106346206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123c155b80 con 0x7f123c06c090 2024-09-13T18:28:20.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.598+0000 7f12337fe700 1 -- 172.21.15.44:0/3106346206 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c003e90 con 0x7f123c06c090 2024-09-13T18:28:20.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.598+0000 7f1240909700 1 -- 172.21.15.44:0/3106346206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123c152e20 con 0x7f123c06c090 2024-09-13T18:28:20.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.598+0000 7f1240909700 1 -- 172.21.15.44:0/3106346206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123c153010 con 0x7f123c06c090 2024-09-13T18:28:20.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.598+0000 7f12337fe700 1 -- 172.21.15.44:0/3106346206 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f122c0193f0 con 0x7f123c06c090 2024-09-13T18:28:20.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.602+0000 7f12337fe700 1 --2- 172.21.15.44:0/3106346206 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f121c066730 0x7f121c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.602+0000 7f12337fe700 1 -- 172.21.15.44:0/3106346206 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f122c0876b0 con 0x7f123c06c090 2024-09-13T18:28:20.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.602+0000 7f123ad9d700 1 --2- 172.21.15.44:0/3106346206 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f121c066730 0x7f121c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.602+0000 7f123ad9d700 1 --2- 172.21.15.44:0/3106346206 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f121c066730 0x7f121c068bf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f122400a8f0 tx=0x7f1224008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:20.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.606+0000 7f12337fe700 1 -- 172.21.15.44:0/3106346206 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f122c054ab0 con 0x7f123c06c090 2024-09-13T18:28:20.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.778+0000 7f1240909700 1 -- 172.21.15.44:0/3106346206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f123c155d90 con 0x7f123c06c090 2024-09-13T18:28:20.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.778+0000 7f12337fe700 1 -- 172.21.15.44:0/3106346206 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f122c0580d0 con 0x7f123c06c090 2024-09-13T18:28:20.785 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:28:20.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.782+0000 7f1240909700 1 -- 172.21.15.44:0/3106346206 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f121c066730 msgr2=0x7f121c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:20.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.782+0000 7f1240909700 1 --2- 172.21.15.44:0/3106346206 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f121c066730 0x7f121c068bf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f122400a8f0 tx=0x7f1224008040 comp rx=0 tx=0).stop 2024-09-13T18:28:20.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.782+0000 7f1240909700 1 -- 172.21.15.44:0/3106346206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f123c06c090 msgr2=0x7f123c1528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:20.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.782+0000 7f1240909700 1 --2- 172.21.15.44:0/3106346206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f123c06c090 0x7f123c1528e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f123c0722e0 tx=0x7f122c004770 comp rx=0 tx=0).stop 2024-09-13T18:28:20.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.782+0000 7f1240909700 1 -- 172.21.15.44:0/3106346206 shutdown_connections 2024-09-13T18:28:20.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.782+0000 7f1240909700 1 --2- 172.21.15.44:0/3106346206 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f121c066730 0x7f121c068bf0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.782+0000 7f1240909700 1 --2- 172.21.15.44:0/3106346206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f123c0b29a0 0x7f123c150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.782+0000 7f1240909700 1 --2- 172.21.15.44:0/3106346206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f123c06c090 0x7f123c1528e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.782+0000 7f1240909700 1 --2- 172.21.15.44:0/3106346206 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f123c06bcb0 0x7f123c0ab2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.782+0000 7f1240909700 1 -- 172.21.15.44:0/3106346206 >> 172.21.15.44:0/3106346206 conn(0x7f123c0b1cd0 msgr2=0x7f123c070c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:20.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.782+0000 7f1240909700 1 -- 172.21.15.44:0/3106346206 shutdown_connections 2024-09-13T18:28:20.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.782+0000 7f1240909700 1 -- 172.21.15.44:0/3106346206 wait complete. 2024-09-13T18:28:20.799 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:28:20.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.910+0000 7f8828d6f700 1 Processor -- start 2024-09-13T18:28:20.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.910+0000 7f8828d6f700 1 -- start start 2024-09-13T18:28:20.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f8828d6f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8824070ba0 0x7f8824159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f8828d6f700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8824072560 con 0x7f88240720d0 2024-09-13T18:28:20.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f8828d6f700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8824071030 con 0x7f882406ccf0 2024-09-13T18:28:20.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f8828d6f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8824071310 con 0x7f8824070ba0 2024-09-13T18:28:20.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f8823fff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f88240720d0 0x7f882415af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44754/0 (socket says 172.21.15.44:44754) 2024-09-13T18:28:20.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f8823fff700 1 -- 172.21.15.44:0/3873006785 learned_addr learned my addr 172.21.15.44:0/3873006785 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:20.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f8822ffd700 1 --2- 172.21.15.44:0/3873006785 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8824070ba0 0x7f8824159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f88227fc700 1 -- 172.21.15.44:0/3873006785 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1141643373 0 0) 0x7f8824072560 con 0x7f88240720d0 2024-09-13T18:28:20.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f88227fc700 1 -- 172.21.15.44:0/3873006785 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f880c0035d0 con 0x7f88240720d0 2024-09-13T18:28:20.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f88227fc700 1 -- 172.21.15.44:0/3873006785 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543861241 0 0) 0x7f8824071030 con 0x7f882406ccf0 2024-09-13T18:28:20.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f88227fc700 1 -- 172.21.15.44:0/3873006785 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8824072560 con 0x7f882406ccf0 2024-09-13T18:28:20.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f8822ffd700 1 -- 172.21.15.44:0/3873006785 >> v1:172.21.15.99:6789/0 conn(0x7f882406ccf0 legacy=0x7f882406d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:20.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f8822ffd700 1 -- 172.21.15.44:0/3873006785 >> v1:172.21.15.44:6789/0 conn(0x7f88240720d0 legacy=0x7f882415af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:20.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f8822ffd700 1 -- 172.21.15.44:0/3873006785 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88240715f0 con 0x7f8824070ba0 2024-09-13T18:28:20.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f8822ffd700 1 --2- 172.21.15.44:0/3873006785 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8824070ba0 0x7f8824159dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8818009880 tx=0x7f8818009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b061156b2a08b40a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:20.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f88227fc700 1 -- 172.21.15.44:0/3873006785 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8818011830 con 0x7f8824070ba0 2024-09-13T18:28:20.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f88227fc700 1 -- 172.21.15.44:0/3873006785 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8818011990 con 0x7f8824070ba0 2024-09-13T18:28:20.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f88227fc700 1 -- 172.21.15.44:0/3873006785 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8818011d20 con 0x7f8824070ba0 2024-09-13T18:28:20.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f8828d6f700 1 -- 172.21.15.44:0/3873006785 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8824070ba0 msgr2=0x7f8824159dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:20.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f8828d6f700 1 --2- 172.21.15.44:0/3873006785 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8824070ba0 0x7f8824159dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8818009880 tx=0x7f8818009b90 comp rx=0 tx=0).stop 2024-09-13T18:28:20.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f8828d6f700 1 -- 172.21.15.44:0/3873006785 shutdown_connections 2024-09-13T18:28:20.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f8828d6f700 1 --2- 172.21.15.44:0/3873006785 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8824070ba0 0x7f8824159dd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f8828d6f700 1 -- 172.21.15.44:0/3873006785 >> 172.21.15.44:0/3873006785 conn(0x7f88240cfad0 msgr2=0x7f88240cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:20.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f8828d6f700 1 -- 172.21.15.44:0/3873006785 shutdown_connections 2024-09-13T18:28:20.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.914+0000 7f8828d6f700 1 -- 172.21.15.44:0/3873006785 wait complete. 2024-09-13T18:28:20.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f8828d6f700 1 Processor -- start 2024-09-13T18:28:20.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f8828d6f700 1 -- start start 2024-09-13T18:28:20.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f8828d6f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f882406ccf0 0x7f8824155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f8828d6f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88240720d0 0x7f88241562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f8828d6f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88240cbd60 0x7f88240adda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f8828d6f700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88241e4fb0 con 0x7f88240cbd60 2024-09-13T18:28:20.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f8828d6f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8824156810 con 0x7f882406ccf0 2024-09-13T18:28:20.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f8828d6f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88241e5800 con 0x7f88240720d0 2024-09-13T18:28:20.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f8823fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88240cbd60 0x7f88240adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f8823fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88240cbd60 0x7f88240adda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50938/0 (socket says 172.21.15.44:50938) 2024-09-13T18:28:20.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f8823fff700 1 -- 172.21.15.44:0/2860053607 learned_addr learned my addr 172.21.15.44:0/2860053607 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:20.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f8822ffd700 1 --2- 172.21.15.44:0/2860053607 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88240720d0 0x7f88241562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f88237fe700 1 --2- 172.21.15.44:0/2860053607 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f882406ccf0 0x7f8824155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f8823fff700 1 -- 172.21.15.44:0/2860053607 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88240720d0 msgr2=0x7f88241562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:20.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f8823fff700 1 --2- 172.21.15.44:0/2860053607 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88240720d0 0x7f88241562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f8823fff700 1 -- 172.21.15.44:0/2860053607 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f882406ccf0 msgr2=0x7f8824155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:20.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f8823fff700 1 --2- 172.21.15.44:0/2860053607 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f882406ccf0 0x7f8824155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f8823fff700 1 -- 172.21.15.44:0/2860053607 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88180094b0 con 0x7f88240cbd60 2024-09-13T18:28:20.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f8822ffd700 1 --2- 172.21.15.44:0/2860053607 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88240720d0 0x7f88241562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:20.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f8823fff700 1 --2- 172.21.15.44:0/2860053607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88240cbd60 0x7f88240adda0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f881c00cbd0 tx=0x7f881c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:20.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f880bfff700 1 -- 172.21.15.44:0/2860053607 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c00a7b0 con 0x7f88240cbd60 2024-09-13T18:28:20.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f880bfff700 1 -- 172.21.15.44:0/2860053607 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c00a910 con 0x7f88240cbd60 2024-09-13T18:28:20.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f8828d6f700 1 -- 172.21.15.44:0/2860053607 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88241e5ae0 con 0x7f88240cbd60 2024-09-13T18:28:20.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f880bfff700 1 -- 172.21.15.44:0/2860053607 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c00aca0 con 0x7f88240cbd60 2024-09-13T18:28:20.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.918+0000 7f8828d6f700 1 -- 172.21.15.44:0/2860053607 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88241e54b0 con 0x7f88240cbd60 2024-09-13T18:28:20.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.922+0000 7f8828d6f700 1 -- 172.21.15.44:0/2860053607 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88240adac0 con 0x7f88240cbd60 2024-09-13T18:28:20.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.922+0000 7f880bfff700 1 -- 172.21.15.44:0/2860053607 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f881c01b3b0 con 0x7f88240cbd60 2024-09-13T18:28:20.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.922+0000 7f880bfff700 1 --2- 172.21.15.44:0/2860053607 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8810066730 0x7f8810068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.926+0000 7f880bfff700 1 -- 172.21.15.44:0/2860053607 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f881c083e50 con 0x7f88240cbd60 2024-09-13T18:28:20.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.926+0000 7f88237fe700 1 --2- 172.21.15.44:0/2860053607 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8810066730 0x7f8810068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.926+0000 7f88237fe700 1 --2- 172.21.15.44:0/2860053607 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8810066730 0x7f8810068bf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f88140011e0 tx=0x7f8814009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:20.930+0000 7f880bfff700 1 -- 172.21.15.44:0/2860053607 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f881c051230 con 0x7f88240cbd60 2024-09-13T18:28:21.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.102+0000 7f8828d6f700 1 -- 172.21.15.44:0/2860053607 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f88240adac0 con 0x7f88240cbd60 2024-09-13T18:28:21.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.102+0000 7f880bfff700 1 -- 172.21.15.44:0/2860053607 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f881c017020 con 0x7f88240cbd60 2024-09-13T18:28:21.109 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:28:21.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.106+0000 7f8828d6f700 1 -- 172.21.15.44:0/2860053607 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8810066730 msgr2=0x7f8810068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.106+0000 7f8828d6f700 1 --2- 172.21.15.44:0/2860053607 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8810066730 0x7f8810068bf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f88140011e0 tx=0x7f8814009040 comp rx=0 tx=0).stop 2024-09-13T18:28:21.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.106+0000 7f8828d6f700 1 -- 172.21.15.44:0/2860053607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88240cbd60 msgr2=0x7f88240adda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.106+0000 7f8828d6f700 1 --2- 172.21.15.44:0/2860053607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88240cbd60 0x7f88240adda0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f881c00cbd0 tx=0x7f881c00cc00 comp rx=0 tx=0).stop 2024-09-13T18:28:21.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.106+0000 7f8828d6f700 1 -- 172.21.15.44:0/2860053607 shutdown_connections 2024-09-13T18:28:21.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.106+0000 7f8828d6f700 1 --2- 172.21.15.44:0/2860053607 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8810066730 0x7f8810068bf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.106+0000 7f8828d6f700 1 --2- 172.21.15.44:0/2860053607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88240cbd60 0x7f88240adda0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.106+0000 7f8828d6f700 1 --2- 172.21.15.44:0/2860053607 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88240720d0 0x7f88241562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.106+0000 7f8828d6f700 1 --2- 172.21.15.44:0/2860053607 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f882406ccf0 0x7f8824155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.106+0000 7f8828d6f700 1 -- 172.21.15.44:0/2860053607 >> 172.21.15.44:0/2860053607 conn(0x7f88240cfad0 msgr2=0x7f8824158e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:21.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.106+0000 7f8828d6f700 1 -- 172.21.15.44:0/2860053607 shutdown_connections 2024-09-13T18:28:21.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.106+0000 7f8828d6f700 1 -- 172.21.15.44:0/2860053607 wait complete. 2024-09-13T18:28:21.123 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:28:21.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.230+0000 7f7a39f16700 1 Processor -- start 2024-09-13T18:28:21.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.230+0000 7f7a39f16700 1 -- start start 2024-09-13T18:28:21.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.230+0000 7f7a39f16700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7a3406d6f0 0x7f7a340ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.230+0000 7f7a39f16700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7a3415d200 0x7f7a3406baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.230+0000 7f7a39f16700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a3406dad0 con 0x7f7a340adbd0 2024-09-13T18:28:21.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.230+0000 7f7a39f16700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a340ae3c0 con 0x7f7a3415d200 2024-09-13T18:28:21.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.230+0000 7f7a39f16700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a340705b0 con 0x7f7a3406d6f0 2024-09-13T18:28:21.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.230+0000 7f7a39715700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7a3415d200 0x7f7a3406baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.234+0000 7f7a39715700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7a3415d200 0x7f7a3406baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50946/0 (socket says 172.21.15.44:50946) 2024-09-13T18:28:21.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.234+0000 7f7a39715700 1 -- 172.21.15.44:0/2585539052 learned_addr learned my addr 172.21.15.44:0/2585539052 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:21.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.234+0000 7f7a38f14700 1 --2- 172.21.15.44:0/2585539052 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7a3406d6f0 0x7f7a340ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.234+0000 7f7a39715700 1 -- 172.21.15.44:0/2585539052 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7a3406d6f0 msgr2=0x7f7a340ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:21.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.234+0000 7f7a39715700 1 --2- 172.21.15.44:0/2585539052 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7a3406d6f0 0x7f7a340ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.234+0000 7f7a39715700 1 -- 172.21.15.44:0/2585539052 >> v1:172.21.15.99:6789/0 conn(0x7f7a340adbd0 legacy=0x7f7a3415caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.234+0000 7f7a39715700 1 -- 172.21.15.44:0/2585539052 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a34070890 con 0x7f7a3415d200 2024-09-13T18:28:21.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.234+0000 7f7a39715700 1 --2- 172.21.15.44:0/2585539052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a3415d200 0x7f7a3406baf0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c009970 tx=0x7f7a2c009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98f18df9d1b4067 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:21.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.234+0000 7f7a337fe700 1 -- 172.21.15.44:0/2585539052 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c011830 con 0x7f7a3415d200 2024-09-13T18:28:21.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.234+0000 7f7a337fe700 1 -- 172.21.15.44:0/2585539052 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2c011990 con 0x7f7a3415d200 2024-09-13T18:28:21.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.234+0000 7f7a337fe700 1 -- 172.21.15.44:0/2585539052 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c011d20 con 0x7f7a3415d200 2024-09-13T18:28:21.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.234+0000 7f7a39f16700 1 -- 172.21.15.44:0/2585539052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a3415d200 msgr2=0x7f7a3406baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.234+0000 7f7a39f16700 1 --2- 172.21.15.44:0/2585539052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a3415d200 0x7f7a3406baf0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c009970 tx=0x7f7a2c009c80 comp rx=0 tx=0).stop 2024-09-13T18:28:21.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.234+0000 7f7a39f16700 1 -- 172.21.15.44:0/2585539052 shutdown_connections 2024-09-13T18:28:21.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.234+0000 7f7a39f16700 1 --2- 172.21.15.44:0/2585539052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a3415d200 0x7f7a3406baf0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.234+0000 7f7a39f16700 1 --2- 172.21.15.44:0/2585539052 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7a3406d6f0 0x7f7a340ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.234+0000 7f7a39f16700 1 -- 172.21.15.44:0/2585539052 >> 172.21.15.44:0/2585539052 conn(0x7f7a340b0e10 msgr2=0x7f7a340b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:21.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.234+0000 7f7a39f16700 1 -- 172.21.15.44:0/2585539052 shutdown_connections 2024-09-13T18:28:21.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.234+0000 7f7a39f16700 1 -- 172.21.15.44:0/2585539052 wait complete. 2024-09-13T18:28:21.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.234+0000 7f7a39f16700 1 Processor -- start 2024-09-13T18:28:21.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.234+0000 7f7a39f16700 1 -- start start 2024-09-13T18:28:21.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a39f16700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a3406d6f0 0x7f7a341474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a39f16700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7a340adbd0 0x7f7a341479f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a39f16700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a3415d200 0x7f7a34147f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a39f16700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a34140a20 con 0x7f7a3415d200 2024-09-13T18:28:21.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a39f16700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3414ae50 con 0x7f7a3406d6f0 2024-09-13T18:28:21.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a39f16700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a34143ba0 con 0x7f7a340adbd0 2024-09-13T18:28:21.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a39715700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a3415d200 0x7f7a34147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a33fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7a340adbd0 0x7f7a341479f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a38f14700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a3406d6f0 0x7f7a341474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a33fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7a340adbd0 0x7f7a341479f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:40398/0 (socket says 172.21.15.44:40398) 2024-09-13T18:28:21.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a33fff700 1 -- 172.21.15.44:0/4081655247 learned_addr learned my addr 172.21.15.44:0/4081655247 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:21.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a39715700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a3415d200 0x7f7a34147f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50948/0 (socket says 172.21.15.44:50948) 2024-09-13T18:28:21.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a33fff700 1 -- 172.21.15.44:0/4081655247 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a3406d6f0 msgr2=0x7f7a341474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a33fff700 1 --2- 172.21.15.44:0/4081655247 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a3406d6f0 0x7f7a341474b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a33fff700 1 -- 172.21.15.44:0/4081655247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a3415d200 msgr2=0x7f7a34147f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a33fff700 1 --2- 172.21.15.44:0/4081655247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a3415d200 0x7f7a34147f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a33fff700 1 -- 172.21.15.44:0/4081655247 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c009570 con 0x7f7a340adbd0 2024-09-13T18:28:21.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a39715700 1 --2- 172.21.15.44:0/4081655247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a3415d200 0x7f7a34147f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:21.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a33fff700 1 --2- 172.21.15.44:0/4081655247 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7a340adbd0 0x7f7a341479f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400cc80 tx=0x7f7a2400cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:21.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a317fa700 1 -- 172.21.15.44:0/4081655247 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24003c20 con 0x7f7a340adbd0 2024-09-13T18:28:21.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a39f16700 1 -- 172.21.15.44:0/4081655247 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a3414b0a0 con 0x7f7a340adbd0 2024-09-13T18:28:21.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a317fa700 1 -- 172.21.15.44:0/4081655247 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a24003d80 con 0x7f7a340adbd0 2024-09-13T18:28:21.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a317fa700 1 -- 172.21.15.44:0/4081655247 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400ab00 con 0x7f7a340adbd0 2024-09-13T18:28:21.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.238+0000 7f7a39f16700 1 -- 172.21.15.44:0/4081655247 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a3414d890 con 0x7f7a340adbd0 2024-09-13T18:28:21.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.242+0000 7f7a39f16700 1 -- 172.21.15.44:0/4081655247 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a3414dab0 con 0x7f7a340adbd0 2024-09-13T18:28:21.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.242+0000 7f7a317fa700 1 -- 172.21.15.44:0/4081655247 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7a2400ac60 con 0x7f7a340adbd0 2024-09-13T18:28:21.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.242+0000 7f7a317fa700 1 --2- 172.21.15.44:0/4081655247 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7a14066730 0x7f7a14068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.242+0000 7f7a317fa700 1 -- 172.21.15.44:0/4081655247 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a24084140 con 0x7f7a340adbd0 2024-09-13T18:28:21.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.242+0000 7f7a38f14700 1 --2- 172.21.15.44:0/4081655247 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7a14066730 0x7f7a14068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.242+0000 7f7a38f14700 1 --2- 172.21.15.44:0/4081655247 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7a14066730 0x7f7a14068bf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7a34140240 tx=0x7f7a1c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:21.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.254+0000 7f7a317fa700 1 -- 172.21.15.44:0/4081655247 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7a240514c0 con 0x7f7a340adbd0 2024-09-13T18:28:21.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.442+0000 7f7a39f16700 1 -- 172.21.15.44:0/4081655247 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7a340ce270 con 0x7f7a340adbd0 2024-09-13T18:28:21.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.442+0000 7f7a317fa700 1 -- 172.21.15.44:0/4081655247 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7a24054ae0 con 0x7f7a340adbd0 2024-09-13T18:28:21.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.446+0000 7f7a39f16700 1 -- 172.21.15.44:0/4081655247 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7a14066730 msgr2=0x7f7a14068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.446+0000 7f7a39f16700 1 --2- 172.21.15.44:0/4081655247 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7a14066730 0x7f7a14068bf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7a34140240 tx=0x7f7a1c009240 comp rx=0 tx=0).stop 2024-09-13T18:28:21.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.446+0000 7f7a39f16700 1 -- 172.21.15.44:0/4081655247 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7a340adbd0 msgr2=0x7f7a341479f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.446+0000 7f7a39f16700 1 --2- 172.21.15.44:0/4081655247 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7a340adbd0 0x7f7a341479f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400cc80 tx=0x7f7a2400cf90 comp rx=0 tx=0).stop 2024-09-13T18:28:21.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.446+0000 7f7a39f16700 1 -- 172.21.15.44:0/4081655247 shutdown_connections 2024-09-13T18:28:21.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.446+0000 7f7a39f16700 1 --2- 172.21.15.44:0/4081655247 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7a14066730 0x7f7a14068bf0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.446+0000 7f7a39f16700 1 --2- 172.21.15.44:0/4081655247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a3415d200 0x7f7a34147f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.446+0000 7f7a39f16700 1 --2- 172.21.15.44:0/4081655247 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7a340adbd0 0x7f7a341479f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.446+0000 7f7a39f16700 1 --2- 172.21.15.44:0/4081655247 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a3406d6f0 0x7f7a341474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.446+0000 7f7a39f16700 1 -- 172.21.15.44:0/4081655247 >> 172.21.15.44:0/4081655247 conn(0x7f7a340b0e10 msgr2=0x7f7a340b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:21.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.446+0000 7f7a39f16700 1 -- 172.21.15.44:0/4081655247 shutdown_connections 2024-09-13T18:28:21.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.446+0000 7f7a39f16700 1 -- 172.21.15.44:0/4081655247 wait complete. 2024-09-13T18:28:21.455 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-13T18:28:21.467 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:28:21.467 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:28:21.474 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:28:21.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.582+0000 7f60e7fff700 1 Processor -- start 2024-09-13T18:28:21.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.582+0000 7f60e7fff700 1 -- start start 2024-09-13T18:28:21.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.582+0000 7f60e7fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60e8160eb0 0x7f60e8165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.582+0000 7f60e7fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f60e8161290 0x7f60e8161740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.582+0000 7f60e7fff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e8071f30 con 0x7f60e80b33d0 2024-09-13T18:28:21.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.582+0000 7f60e7fff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e81622e0 con 0x7f60e8161290 2024-09-13T18:28:21.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.582+0000 7f60e7fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e8162000 con 0x7f60e8160eb0 2024-09-13T18:28:21.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.582+0000 7f60e67fc700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f60e80b33d0 0x7f60e80b37f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44760/0 (socket says 172.21.15.44:44760) 2024-09-13T18:28:21.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.582+0000 7f60e67fc700 1 -- 172.21.15.44:0/3653353070 learned_addr learned my addr 172.21.15.44:0/3653353070 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:21.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.582+0000 7f60e77fe700 1 --2- 172.21.15.44:0/3653353070 >> v2:172.21.15.44:3300/0 conn(0x7f60e8161290 0x7f60e8161740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.582+0000 7f60e6ffd700 1 --2- 172.21.15.44:0/3653353070 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60e8160eb0 0x7f60e8165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.582+0000 7f60e5ffb700 1 -- 172.21.15.44:0/3653353070 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734969266 0 0) 0x7f60e8071f30 con 0x7f60e80b33d0 2024-09-13T18:28:21.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.582+0000 7f60e5ffb700 1 -- 172.21.15.44:0/3653353070 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60d00035d0 con 0x7f60e80b33d0 2024-09-13T18:28:21.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.582+0000 7f60e77fe700 1 -- 172.21.15.44:0/3653353070 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60e8160eb0 msgr2=0x7f60e8165590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:21.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.582+0000 7f60e77fe700 1 --2- 172.21.15.44:0/3653353070 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60e8160eb0 0x7f60e8165590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.582+0000 7f60e77fe700 1 -- 172.21.15.44:0/3653353070 >> v1:172.21.15.44:6789/0 conn(0x7f60e80b33d0 legacy=0x7f60e80b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.582+0000 7f60e77fe700 1 -- 172.21.15.44:0/3653353070 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e8164ab0 con 0x7f60e8161290 2024-09-13T18:28:21.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.586+0000 7f60e77fe700 1 --2- 172.21.15.44:0/3653353070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60e8161290 0x7f60e8161740 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009d90 tx=0x7f60e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6f77a0627273f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:21.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.586+0000 7f60e5ffb700 1 -- 172.21.15.44:0/3653353070 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e000e070 con 0x7f60e8161290 2024-09-13T18:28:21.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.586+0000 7f60e5ffb700 1 -- 172.21.15.44:0/3653353070 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e000bb20 con 0x7f60e8161290 2024-09-13T18:28:21.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.586+0000 7f60e5ffb700 1 -- 172.21.15.44:0/3653353070 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e000be90 con 0x7f60e8161290 2024-09-13T18:28:21.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.586+0000 7f60e7fff700 1 -- 172.21.15.44:0/3653353070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60e8161290 msgr2=0x7f60e8161740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.586+0000 7f60e7fff700 1 --2- 172.21.15.44:0/3653353070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60e8161290 0x7f60e8161740 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009d90 tx=0x7f60e000b330 comp rx=0 tx=0).stop 2024-09-13T18:28:21.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.586+0000 7f60e7fff700 1 -- 172.21.15.44:0/3653353070 shutdown_connections 2024-09-13T18:28:21.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.586+0000 7f60e7fff700 1 --2- 172.21.15.44:0/3653353070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60e8161290 0x7f60e8161740 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.586+0000 7f60e7fff700 1 --2- 172.21.15.44:0/3653353070 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60e8160eb0 0x7f60e8165590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.586+0000 7f60e7fff700 1 -- 172.21.15.44:0/3653353070 >> 172.21.15.44:0/3653353070 conn(0x7f60e80b0f00 msgr2=0x7f60e80b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:21.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.586+0000 7f60e7fff700 1 -- 172.21.15.44:0/3653353070 shutdown_connections 2024-09-13T18:28:21.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.586+0000 7f60e7fff700 1 -- 172.21.15.44:0/3653353070 wait complete. 2024-09-13T18:28:21.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.590+0000 7f60e7fff700 1 Processor -- start 2024-09-13T18:28:21.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.590+0000 7f60e7fff700 1 -- start start 2024-09-13T18:28:21.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.590+0000 7f60e7fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60e80b33d0 0x7f60e8159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.590+0000 7f60e7fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60e8160eb0 0x7f60e81637c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.590+0000 7f60e7fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60e8161290 0x7f60e8163d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.590+0000 7f60e7fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80a9990 con 0x7f60e8160eb0 2024-09-13T18:28:21.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.590+0000 7f60e7fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e815e7e0 con 0x7f60e80b33d0 2024-09-13T18:28:21.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.590+0000 7f60e7fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e815ea30 con 0x7f60e8161290 2024-09-13T18:28:21.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.590+0000 7f60e67fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60e8160eb0 0x7f60e81637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.590+0000 7f60e67fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60e8160eb0 0x7f60e81637c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50974/0 (socket says 172.21.15.44:50974) 2024-09-13T18:28:21.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.590+0000 7f60e67fc700 1 -- 172.21.15.44:0/2706530602 learned_addr learned my addr 172.21.15.44:0/2706530602 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:21.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.590+0000 7f60e6ffd700 1 --2- 172.21.15.44:0/2706530602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60e80b33d0 0x7f60e8159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.590+0000 7f60e77fe700 1 --2- 172.21.15.44:0/2706530602 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60e8161290 0x7f60e8163d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.590+0000 7f60e67fc700 1 -- 172.21.15.44:0/2706530602 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60e8161290 msgr2=0x7f60e8163d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.590+0000 7f60e67fc700 1 --2- 172.21.15.44:0/2706530602 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60e8161290 0x7f60e8163d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.594+0000 7f60e67fc700 1 -- 172.21.15.44:0/2706530602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60e80b33d0 msgr2=0x7f60e8159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.594+0000 7f60e67fc700 1 --2- 172.21.15.44:0/2706530602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60e80b33d0 0x7f60e8159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.594+0000 7f60e67fc700 1 -- 172.21.15.44:0/2706530602 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e0009a70 con 0x7f60e8160eb0 2024-09-13T18:28:21.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.594+0000 7f60e77fe700 1 --2- 172.21.15.44:0/2706530602 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60e8161290 0x7f60e8163d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:21.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.594+0000 7f60e67fc700 1 --2- 172.21.15.44:0/2706530602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60e8160eb0 0x7f60e81637c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0010e0 tx=0x7f60dc00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:21.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.594+0000 7f60cffff700 1 -- 172.21.15.44:0/2706530602 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc005d90 con 0x7f60e8160eb0 2024-09-13T18:28:21.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.594+0000 7f60cffff700 1 -- 172.21.15.44:0/2706530602 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc0070d0 con 0x7f60e8160eb0 2024-09-13T18:28:21.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.594+0000 7f60e7fff700 1 -- 172.21.15.44:0/2706530602 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e815ed10 con 0x7f60e8160eb0 2024-09-13T18:28:21.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.594+0000 7f60cffff700 1 -- 172.21.15.44:0/2706530602 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc007460 con 0x7f60e8160eb0 2024-09-13T18:28:21.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.594+0000 7f60e7fff700 1 -- 172.21.15.44:0/2706530602 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e815f2d0 con 0x7f60e8160eb0 2024-09-13T18:28:21.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.594+0000 7f60e7fff700 1 -- 172.21.15.44:0/2706530602 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e8071580 con 0x7f60e8160eb0 2024-09-13T18:28:21.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.594+0000 7f60cffff700 1 -- 172.21.15.44:0/2706530602 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f60dc0075c0 con 0x7f60e8160eb0 2024-09-13T18:28:21.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.598+0000 7f60cffff700 1 --2- 172.21.15.44:0/2706530602 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f60d4066730 0x7f60d4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.598+0000 7f60cffff700 1 -- 172.21.15.44:0/2706530602 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60dc0836e0 con 0x7f60e8160eb0 2024-09-13T18:28:21.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.598+0000 7f60e6ffd700 1 --2- 172.21.15.44:0/2706530602 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f60d4066730 0x7f60d4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.598+0000 7f60e6ffd700 1 --2- 172.21.15.44:0/2706530602 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f60d4066730 0x7f60d4068bf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009bf0 tx=0x7f60d8009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:21.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.602+0000 7f60cffff700 1 -- 172.21.15.44:0/2706530602 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f60dc050930 con 0x7f60e8160eb0 2024-09-13T18:28:21.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.778+0000 7f60e7fff700 1 -- 172.21.15.44:0/2706530602 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60e8165590 con 0x7f60e8160eb0 2024-09-13T18:28:21.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.778+0000 7f60cffff700 1 -- 172.21.15.44:0/2706530602 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16509 (secure 0 0 0) 0x7f60dc053f50 con 0x7f60e8160eb0 2024-09-13T18:28:21.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:21.785 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":35,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:28:06.066299+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:28:02.951723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:28:04.057772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:28:21.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.782+0000 7f60e7fff700 1 -- 172.21.15.44:0/2706530602 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f60d4066730 msgr2=0x7f60d4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.782+0000 7f60e7fff700 1 --2- 172.21.15.44:0/2706530602 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f60d4066730 0x7f60d4068bf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009bf0 tx=0x7f60d8009240 comp rx=0 tx=0).stop 2024-09-13T18:28:21.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.782+0000 7f60e7fff700 1 -- 172.21.15.44:0/2706530602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60e8160eb0 msgr2=0x7f60e81637c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.782+0000 7f60e7fff700 1 --2- 172.21.15.44:0/2706530602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60e8160eb0 0x7f60e81637c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0010e0 tx=0x7f60dc00c7d0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.782+0000 7f60e7fff700 1 -- 172.21.15.44:0/2706530602 shutdown_connections 2024-09-13T18:28:21.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.782+0000 7f60e7fff700 1 --2- 172.21.15.44:0/2706530602 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f60d4066730 0x7f60d4068bf0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.782+0000 7f60e7fff700 1 --2- 172.21.15.44:0/2706530602 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60e8161290 0x7f60e8163d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.782+0000 7f60e7fff700 1 --2- 172.21.15.44:0/2706530602 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60e8160eb0 0x7f60e81637c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.782+0000 7f60e7fff700 1 --2- 172.21.15.44:0/2706530602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60e80b33d0 0x7f60e8159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.782+0000 7f60e7fff700 1 -- 172.21.15.44:0/2706530602 >> 172.21.15.44:0/2706530602 conn(0x7f60e80b0f00 msgr2=0x7f60e806d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:21.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.782+0000 7f60e7fff700 1 -- 172.21.15.44:0/2706530602 shutdown_connections 2024-09-13T18:28:21.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.782+0000 7f60e7fff700 1 -- 172.21.15.44:0/2706530602 wait complete. 2024-09-13T18:28:21.801 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:28:02.951723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:28:04.057772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:28:21.801 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:28:21.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.922+0000 7f25bfb61700 1 Processor -- start 2024-09-13T18:28:21.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.922+0000 7f25bfb61700 1 -- start start 2024-09-13T18:28:21.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.922+0000 7f25bfb61700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f25b815cda0 0x7f25b80d1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.922+0000 7f25bfb61700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f25b80b5e00 0x7f25b80b6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.922+0000 7f25bfb61700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b80d0880 con 0x7f25b80b6780 2024-09-13T18:28:21.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.922+0000 7f25bfb61700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b80cde50 con 0x7f25b80b5e00 2024-09-13T18:28:21.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.922+0000 7f25bfb61700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b80d16e0 con 0x7f25b815cda0 2024-09-13T18:28:21.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.922+0000 7f25bd0fc700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f25b80b5e00 0x7f25b80b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.922+0000 7f25be0fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f25b80b6780 0x7f25b806a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44764/0 (socket says 172.21.15.44:44764) 2024-09-13T18:28:21.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.922+0000 7f25be0fe700 1 -- 172.21.15.44:0/689746902 learned_addr learned my addr 172.21.15.44:0/689746902 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:21.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.922+0000 7f25bd8fd700 1 --2- 172.21.15.44:0/689746902 >> v2:172.21.15.99:3300/0 conn(0x7f25b815cda0 0x7f25b80d1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.922+0000 7f25bd0fc700 1 -- 172.21.15.44:0/689746902 >> v2:172.21.15.99:3300/0 conn(0x7f25b815cda0 msgr2=0x7f25b80d1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:21.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.922+0000 7f25bd0fc700 1 --2- 172.21.15.44:0/689746902 >> v2:172.21.15.99:3300/0 conn(0x7f25b815cda0 0x7f25b80d1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.922+0000 7f25bd0fc700 1 -- 172.21.15.44:0/689746902 >> v1:172.21.15.44:6789/0 conn(0x7f25b80b6780 legacy=0x7f25b806a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.922+0000 7f25bd0fc700 1 -- 172.21.15.44:0/689746902 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b80d0ad0 con 0x7f25b80b5e00 2024-09-13T18:28:21.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.922+0000 7f25bd0fc700 1 --2- 172.21.15.44:0/689746902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25b80b5e00 0x7f25b80b6240 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f25b80d0830 tx=0x7f25a8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba39fbb780bec5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:21.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.922+0000 7f25bc8fb700 1 -- 172.21.15.44:0/689746902 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a8011830 con 0x7f25b80b5e00 2024-09-13T18:28:21.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.922+0000 7f25bc8fb700 1 -- 172.21.15.44:0/689746902 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a8011990 con 0x7f25b80b5e00 2024-09-13T18:28:21.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.922+0000 7f25bc8fb700 1 -- 172.21.15.44:0/689746902 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a8011d20 con 0x7f25b80b5e00 2024-09-13T18:28:21.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.926+0000 7f25bfb61700 1 -- 172.21.15.44:0/689746902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25b80b5e00 msgr2=0x7f25b80b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.926+0000 7f25bfb61700 1 --2- 172.21.15.44:0/689746902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25b80b5e00 0x7f25b80b6240 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f25b80d0830 tx=0x7f25a8009b30 comp rx=0 tx=0).stop 2024-09-13T18:28:21.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.926+0000 7f25bfb61700 1 -- 172.21.15.44:0/689746902 shutdown_connections 2024-09-13T18:28:21.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.926+0000 7f25bfb61700 1 --2- 172.21.15.44:0/689746902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25b80b5e00 0x7f25b80b6240 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.926+0000 7f25bfb61700 1 --2- 172.21.15.44:0/689746902 >> v2:172.21.15.99:3300/0 conn(0x7f25b815cda0 0x7f25b80d1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.926+0000 7f25bfb61700 1 -- 172.21.15.44:0/689746902 >> 172.21.15.44:0/689746902 conn(0x7f25b80d2cb0 msgr2=0x7f25b80d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:21.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.926+0000 7f25bfb61700 1 -- 172.21.15.44:0/689746902 shutdown_connections 2024-09-13T18:28:21.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.926+0000 7f25bfb61700 1 -- 172.21.15.44:0/689746902 wait complete. 2024-09-13T18:28:21.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.926+0000 7f25bfb61700 1 Processor -- start 2024-09-13T18:28:21.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.926+0000 7f25bfb61700 1 -- start start 2024-09-13T18:28:21.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.930+0000 7f25bfb61700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25b80b5e00 0x7f25b8159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.930+0000 7f25bfb61700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f25b80b6780 0x7f25b80c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.930+0000 7f25bfb61700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25b815cda0 0x7f25b80ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.930+0000 7f25bfb61700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b81547c0 con 0x7f25b80b5e00 2024-09-13T18:28:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.930+0000 7f25bfb61700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b8153f20 con 0x7f25b815cda0 2024-09-13T18:28:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.930+0000 7f25bfb61700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b8150330 con 0x7f25b80b6780 2024-09-13T18:28:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.930+0000 7f25bd8fd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25b80b5e00 0x7f25b8159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.930+0000 7f25bd8fd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25b80b5e00 0x7f25b8159220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50994/0 (socket says 172.21.15.44:50994) 2024-09-13T18:28:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.930+0000 7f25bd8fd700 1 -- 172.21.15.44:0/1208352097 learned_addr learned my addr 172.21.15.44:0/1208352097 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.930+0000 7f25bd0fc700 1 --2- 172.21.15.44:0/1208352097 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f25b80b6780 0x7f25b80c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.930+0000 7f25be0fe700 1 --2- 172.21.15.44:0/1208352097 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25b815cda0 0x7f25b80ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.930+0000 7f25bd8fd700 1 -- 172.21.15.44:0/1208352097 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f25b80b6780 msgr2=0x7f25b80c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.930+0000 7f25bd8fd700 1 --2- 172.21.15.44:0/1208352097 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f25b80b6780 0x7f25b80c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.930+0000 7f25bd8fd700 1 -- 172.21.15.44:0/1208352097 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25b815cda0 msgr2=0x7f25b80ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.930+0000 7f25bd8fd700 1 --2- 172.21.15.44:0/1208352097 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25b815cda0 0x7f25b80ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.930+0000 7f25bd8fd700 1 -- 172.21.15.44:0/1208352097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a80094b0 con 0x7f25b80b5e00 2024-09-13T18:28:21.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.930+0000 7f25bd8fd700 1 --2- 172.21.15.44:0/1208352097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25b80b5e00 0x7f25b8159220 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f25b400e840 tx=0x7f25b400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:21.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.930+0000 7f25ae7fc700 1 -- 172.21.15.44:0/1208352097 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b40095a0 con 0x7f25b80b5e00 2024-09-13T18:28:21.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.930+0000 7f25ae7fc700 1 -- 172.21.15.44:0/1208352097 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b4013680 con 0x7f25b80b5e00 2024-09-13T18:28:21.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.930+0000 7f25bfb61700 1 -- 172.21.15.44:0/1208352097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b8154170 con 0x7f25b80b5e00 2024-09-13T18:28:21.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.930+0000 7f25ae7fc700 1 -- 172.21.15.44:0/1208352097 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b40139f0 con 0x7f25b80b5e00 2024-09-13T18:28:21.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.930+0000 7f25bfb61700 1 -- 172.21.15.44:0/1208352097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b8159760 con 0x7f25b80b5e00 2024-09-13T18:28:21.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.934+0000 7f25bfb61700 1 -- 172.21.15.44:0/1208352097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b80b6240 con 0x7f25b80b5e00 2024-09-13T18:28:21.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.934+0000 7f25ae7fc700 1 -- 172.21.15.44:0/1208352097 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f25b4013b50 con 0x7f25b80b5e00 2024-09-13T18:28:21.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.934+0000 7f25ae7fc700 1 --2- 172.21.15.44:0/1208352097 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f259c066730 0x7f259c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.934+0000 7f25ae7fc700 1 -- 172.21.15.44:0/1208352097 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25b4084040 con 0x7f25b80b5e00 2024-09-13T18:28:21.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.934+0000 7f25bd0fc700 1 --2- 172.21.15.44:0/1208352097 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f259c066730 0x7f259c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.934+0000 7f25bd0fc700 1 --2- 172.21.15.44:0/1208352097 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f259c066730 0x7f259c068bf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f25a8000c00 tx=0x7f25a8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:21.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:21.942+0000 7f25ae7fc700 1 -- 172.21.15.44:0/1208352097 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f25b40513b0 con 0x7f25b80b5e00 2024-09-13T18:28:22.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.114+0000 7f25bfb61700 1 -- 172.21.15.44:0/1208352097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f25b80b8260 con 0x7f25b80b5e00 2024-09-13T18:28:22.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.114+0000 7f25ae7fc700 1 -- 172.21.15.44:0/1208352097 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f25b40549d0 con 0x7f25b80b5e00 2024-09-13T18:28:22.122 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:28:22.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.118+0000 7f25bfb61700 1 -- 172.21.15.44:0/1208352097 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f259c066730 msgr2=0x7f259c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.118+0000 7f25bfb61700 1 --2- 172.21.15.44:0/1208352097 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f259c066730 0x7f259c068bf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f25a8000c00 tx=0x7f25a8008030 comp rx=0 tx=0).stop 2024-09-13T18:28:22.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.118+0000 7f25bfb61700 1 -- 172.21.15.44:0/1208352097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25b80b5e00 msgr2=0x7f25b8159220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.118+0000 7f25bfb61700 1 --2- 172.21.15.44:0/1208352097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25b80b5e00 0x7f25b8159220 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f25b400e840 tx=0x7f25b400eb50 comp rx=0 tx=0).stop 2024-09-13T18:28:22.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.118+0000 7f25bfb61700 1 -- 172.21.15.44:0/1208352097 shutdown_connections 2024-09-13T18:28:22.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.118+0000 7f25bfb61700 1 --2- 172.21.15.44:0/1208352097 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f259c066730 0x7f259c068bf0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.118+0000 7f25bfb61700 1 --2- 172.21.15.44:0/1208352097 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25b815cda0 0x7f25b80ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.118+0000 7f25bfb61700 1 --2- 172.21.15.44:0/1208352097 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f25b80b6780 0x7f25b80c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.118+0000 7f25bfb61700 1 --2- 172.21.15.44:0/1208352097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25b80b5e00 0x7f25b8159220 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.118+0000 7f25bfb61700 1 -- 172.21.15.44:0/1208352097 >> 172.21.15.44:0/1208352097 conn(0x7f25b80d2cb0 msgr2=0x7f25b80d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:22.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.118+0000 7f25bfb61700 1 -- 172.21.15.44:0/1208352097 shutdown_connections 2024-09-13T18:28:22.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.118+0000 7f25bfb61700 1 -- 172.21.15.44:0/1208352097 wait complete. 2024-09-13T18:28:22.136 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:28:22.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.246+0000 7f60dbfff700 1 Processor -- start 2024-09-13T18:28:22.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.246+0000 7f60dbfff700 1 -- start start 2024-09-13T18:28:22.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60dbfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60dc1573e0 0x7f60dc070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60dbfff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60dc071540 con 0x7f60dc0710e0 2024-09-13T18:28:22.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60dbfff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60dc15ac50 con 0x7f60dc15a630 2024-09-13T18:28:22.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60dbfff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc0cc1b0 con 0x7f60dc1573e0 2024-09-13T18:28:22.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60da7fc700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f60dc0710e0 0x7f60dc159f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:33350/0 (socket says 172.21.15.44:33350) 2024-09-13T18:28:22.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60da7fc700 1 -- 172.21.15.44:0/3426679291 learned_addr learned my addr 172.21.15.44:0/3426679291 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:22.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60daffd700 1 --2- 172.21.15.44:0/3426679291 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60dc1573e0 0x7f60dc070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60d9ffb700 1 -- 172.21.15.44:0/3426679291 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157462409 0 0) 0x7f60dc071540 con 0x7f60dc0710e0 2024-09-13T18:28:22.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60d9ffb700 1 -- 172.21.15.44:0/3426679291 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60c80035d0 con 0x7f60dc0710e0 2024-09-13T18:28:22.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60d9ffb700 1 -- 172.21.15.44:0/3426679291 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3241480468 0 0) 0x7f60dc15ac50 con 0x7f60dc15a630 2024-09-13T18:28:22.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60daffd700 1 -- 172.21.15.44:0/3426679291 >> v1:172.21.15.99:6789/0 conn(0x7f60dc15a630 legacy=0x7f60dc06c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60daffd700 1 -- 172.21.15.44:0/3426679291 >> v1:172.21.15.44:6789/0 conn(0x7f60dc0710e0 legacy=0x7f60dc159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60daffd700 1 -- 172.21.15.44:0/3426679291 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc0cb3f0 con 0x7f60dc1573e0 2024-09-13T18:28:22.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60daffd700 1 --2- 172.21.15.44:0/3426679291 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60dc1573e0 0x7f60dc070ba0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f60c40098b0 tx=0x7f60c4009bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=735ce9a5e46d3a90 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:22.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60d9ffb700 1 -- 172.21.15.44:0/3426679291 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c4004230 con 0x7f60dc1573e0 2024-09-13T18:28:22.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60d9ffb700 1 -- 172.21.15.44:0/3426679291 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c4004390 con 0x7f60dc1573e0 2024-09-13T18:28:22.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60d9ffb700 1 -- 172.21.15.44:0/3426679291 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c40036c0 con 0x7f60dc1573e0 2024-09-13T18:28:22.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60dbfff700 1 -- 172.21.15.44:0/3426679291 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60dc1573e0 msgr2=0x7f60dc070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60dbfff700 1 --2- 172.21.15.44:0/3426679291 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60dc1573e0 0x7f60dc070ba0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f60c40098b0 tx=0x7f60c4009bc0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60dbfff700 1 -- 172.21.15.44:0/3426679291 shutdown_connections 2024-09-13T18:28:22.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60dbfff700 1 --2- 172.21.15.44:0/3426679291 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60dc1573e0 0x7f60dc070ba0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60dbfff700 1 -- 172.21.15.44:0/3426679291 >> 172.21.15.44:0/3426679291 conn(0x7f60dc0b0e10 msgr2=0x7f60dc0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:22.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60dbfff700 1 -- 172.21.15.44:0/3426679291 shutdown_connections 2024-09-13T18:28:22.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.250+0000 7f60dbfff700 1 -- 172.21.15.44:0/3426679291 wait complete. 2024-09-13T18:28:22.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.254+0000 7f60dbfff700 1 Processor -- start 2024-09-13T18:28:22.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.254+0000 7f60dbfff700 1 -- start start 2024-09-13T18:28:22.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.254+0000 7f60dbfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60dc0710e0 0x7f60dc143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.254+0000 7f60dbfff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60dc1573e0 0x7f60dc0a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.254+0000 7f60dbfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60dc15a630 0x7f60dc140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.254+0000 7f60dbfff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc1442b0 con 0x7f60dc0710e0 2024-09-13T18:28:22.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.254+0000 7f60dbfff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc153ea0 con 0x7f60dc1573e0 2024-09-13T18:28:22.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.254+0000 7f60dbfff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc154180 con 0x7f60dc15a630 2024-09-13T18:28:22.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.254+0000 7f60daffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60dc0710e0 0x7f60dc143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.254+0000 7f60daffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60dc0710e0 0x7f60dc143cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52134/0 (socket says 172.21.15.44:52134) 2024-09-13T18:28:22.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.254+0000 7f60daffd700 1 -- 172.21.15.44:0/3533507979 learned_addr learned my addr 172.21.15.44:0/3533507979 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:22.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.254+0000 7f60da7fc700 1 --2- 172.21.15.44:0/3533507979 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60dc1573e0 0x7f60dc0a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.258+0000 7f60db7fe700 1 --2- 172.21.15.44:0/3533507979 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60dc15a630 0x7f60dc140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.258+0000 7f60daffd700 1 -- 172.21.15.44:0/3533507979 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60dc15a630 msgr2=0x7f60dc140ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.258+0000 7f60daffd700 1 --2- 172.21.15.44:0/3533507979 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60dc15a630 0x7f60dc140ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.258+0000 7f60daffd700 1 -- 172.21.15.44:0/3533507979 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60dc1573e0 msgr2=0x7f60dc0a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.258+0000 7f60daffd700 1 --2- 172.21.15.44:0/3533507979 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60dc1573e0 0x7f60dc0a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.258+0000 7f60daffd700 1 -- 172.21.15.44:0/3533507979 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c40094b0 con 0x7f60dc0710e0 2024-09-13T18:28:22.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.258+0000 7f60daffd700 1 --2- 172.21.15.44:0/3533507979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60dc0710e0 0x7f60dc143cb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f60c40090b0 tx=0x7f60c4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:22.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.258+0000 7f60d3fff700 1 -- 172.21.15.44:0/3533507979 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c4003de0 con 0x7f60dc0710e0 2024-09-13T18:28:22.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.258+0000 7f60d3fff700 1 -- 172.21.15.44:0/3533507979 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c401f070 con 0x7f60dc0710e0 2024-09-13T18:28:22.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.258+0000 7f60dbfff700 1 -- 172.21.15.44:0/3533507979 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60dc1412d0 con 0x7f60dc0710e0 2024-09-13T18:28:22.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.258+0000 7f60d3fff700 1 -- 172.21.15.44:0/3533507979 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c4011870 con 0x7f60dc0710e0 2024-09-13T18:28:22.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.258+0000 7f60dbfff700 1 -- 172.21.15.44:0/3533507979 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60dc1505a0 con 0x7f60dc0710e0 2024-09-13T18:28:22.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.258+0000 7f60dbfff700 1 -- 172.21.15.44:0/3533507979 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60dc070ba0 con 0x7f60dc0710e0 2024-09-13T18:28:22.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.258+0000 7f60d3fff700 1 -- 172.21.15.44:0/3533507979 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f60c4021030 con 0x7f60dc0710e0 2024-09-13T18:28:22.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.262+0000 7f60d3fff700 1 --2- 172.21.15.44:0/3533507979 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f60bc066730 0x7f60bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.262+0000 7f60d3fff700 1 -- 172.21.15.44:0/3533507979 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60c40855d0 con 0x7f60dc0710e0 2024-09-13T18:28:22.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.262+0000 7f60da7fc700 1 --2- 172.21.15.44:0/3533507979 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f60bc066730 0x7f60bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.262+0000 7f60da7fc700 1 --2- 172.21.15.44:0/3533507979 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f60bc066730 0x7f60bc068bf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f60dc15e0b0 tx=0x7f60cc007d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:22.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.266+0000 7f60d3fff700 1 -- 172.21.15.44:0/3533507979 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f60c4052930 con 0x7f60dc0710e0 2024-09-13T18:28:22.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.438+0000 7f60dbfff700 1 -- 172.21.15.44:0/3533507979 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f60dc070ba0 con 0x7f60dc0710e0 2024-09-13T18:28:22.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.438+0000 7f60d3fff700 1 -- 172.21.15.44:0/3533507979 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f60c40045d0 con 0x7f60dc0710e0 2024-09-13T18:28:22.446 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:28:22.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.442+0000 7f60dbfff700 1 -- 172.21.15.44:0/3533507979 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f60bc066730 msgr2=0x7f60bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.442+0000 7f60dbfff700 1 --2- 172.21.15.44:0/3533507979 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f60bc066730 0x7f60bc068bf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f60dc15e0b0 tx=0x7f60cc007d80 comp rx=0 tx=0).stop 2024-09-13T18:28:22.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.442+0000 7f60dbfff700 1 -- 172.21.15.44:0/3533507979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60dc0710e0 msgr2=0x7f60dc143cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.442+0000 7f60dbfff700 1 --2- 172.21.15.44:0/3533507979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60dc0710e0 0x7f60dc143cb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f60c40090b0 tx=0x7f60c4004770 comp rx=0 tx=0).stop 2024-09-13T18:28:22.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.442+0000 7f60dbfff700 1 -- 172.21.15.44:0/3533507979 shutdown_connections 2024-09-13T18:28:22.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.442+0000 7f60dbfff700 1 --2- 172.21.15.44:0/3533507979 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f60bc066730 0x7f60bc068bf0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.442+0000 7f60dbfff700 1 --2- 172.21.15.44:0/3533507979 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60dc15a630 0x7f60dc140ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.442+0000 7f60dbfff700 1 --2- 172.21.15.44:0/3533507979 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60dc1573e0 0x7f60dc0a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.442+0000 7f60dbfff700 1 --2- 172.21.15.44:0/3533507979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60dc0710e0 0x7f60dc143cb0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.442+0000 7f60dbfff700 1 -- 172.21.15.44:0/3533507979 >> 172.21.15.44:0/3533507979 conn(0x7f60dc0b0e10 msgr2=0x7f60dc0b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:22.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.442+0000 7f60dbfff700 1 -- 172.21.15.44:0/3533507979 shutdown_connections 2024-09-13T18:28:22.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.442+0000 7f60dbfff700 1 -- 172.21.15.44:0/3533507979 wait complete. 2024-09-13T18:28:22.460 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:28:22.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.570+0000 7fa8db59e700 1 Processor -- start 2024-09-13T18:28:22.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.570+0000 7fa8db59e700 1 -- start start 2024-09-13T18:28:22.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8db59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8dc0ce270 0x7fa8dc15caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8db59e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8dc06dad0 con 0x7fa8dc15d030 2024-09-13T18:28:22.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8db59e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8dc0ae3c0 con 0x7fa8dc06d6f0 2024-09-13T18:28:22.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8db59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc15d4c0 con 0x7fa8dc0ce270 2024-09-13T18:28:22.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8dad9d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa8dc15d030 0x7fa8dc06baf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:33352/0 (socket says 172.21.15.44:33352) 2024-09-13T18:28:22.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8dad9d700 1 -- 172.21.15.44:0/4157653850 learned_addr learned my addr 172.21.15.44:0/4157653850 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:22.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8d9d9b700 1 --2- 172.21.15.44:0/4157653850 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8dc0ce270 0x7fa8dc15caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8d959a700 1 -- 172.21.15.44:0/4157653850 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1729273427 0 0) 0x7fa8dc06dad0 con 0x7fa8dc15d030 2024-09-13T18:28:22.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8d959a700 1 -- 172.21.15.44:0/4157653850 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8c40057e0 con 0x7fa8dc15d030 2024-09-13T18:28:22.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8d959a700 1 -- 172.21.15.44:0/4157653850 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 315722133 0 0) 0x7fa8dc0ae3c0 con 0x7fa8dc06d6f0 2024-09-13T18:28:22.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8d959a700 1 -- 172.21.15.44:0/4157653850 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8dc06dad0 con 0x7fa8dc06d6f0 2024-09-13T18:28:22.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8d9d9b700 1 -- 172.21.15.44:0/4157653850 >> v1:172.21.15.99:6789/0 conn(0x7fa8dc06d6f0 legacy=0x7fa8dc0adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8d9d9b700 1 -- 172.21.15.44:0/4157653850 >> v1:172.21.15.44:6789/0 conn(0x7fa8dc15d030 legacy=0x7fa8dc06baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8d9d9b700 1 -- 172.21.15.44:0/4157653850 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8dc0705b0 con 0x7fa8dc0ce270 2024-09-13T18:28:22.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8d9d9b700 1 --2- 172.21.15.44:0/4157653850 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8dc0ce270 0x7fa8dc15caf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009880 tx=0x7fa8cc009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf8076af17e0eedb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:22.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8d959a700 1 -- 172.21.15.44:0/4157653850 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc011830 con 0x7fa8dc0ce270 2024-09-13T18:28:22.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8d959a700 1 -- 172.21.15.44:0/4157653850 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8cc011990 con 0x7fa8dc0ce270 2024-09-13T18:28:22.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8d959a700 1 -- 172.21.15.44:0/4157653850 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc011d00 con 0x7fa8dc0ce270 2024-09-13T18:28:22.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8db59e700 1 -- 172.21.15.44:0/4157653850 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8dc0ce270 msgr2=0x7fa8dc15caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8db59e700 1 --2- 172.21.15.44:0/4157653850 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8dc0ce270 0x7fa8dc15caf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009880 tx=0x7fa8cc009b90 comp rx=0 tx=0).stop 2024-09-13T18:28:22.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8db59e700 1 -- 172.21.15.44:0/4157653850 shutdown_connections 2024-09-13T18:28:22.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8db59e700 1 --2- 172.21.15.44:0/4157653850 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8dc0ce270 0x7fa8dc15caf0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8db59e700 1 -- 172.21.15.44:0/4157653850 >> 172.21.15.44:0/4157653850 conn(0x7fa8dc0b0e10 msgr2=0x7fa8dc0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:22.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8db59e700 1 -- 172.21.15.44:0/4157653850 shutdown_connections 2024-09-13T18:28:22.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.574+0000 7fa8db59e700 1 -- 172.21.15.44:0/4157653850 wait complete. 2024-09-13T18:28:22.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8db59e700 1 Processor -- start 2024-09-13T18:28:22.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8db59e700 1 -- start start 2024-09-13T18:28:22.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8db59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8dc06d6f0 0x7fa8dc0ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8db59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8dc0ce270 0x7fa8dc156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8db59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8dc15d030 0x7fa8dc0aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8db59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc0ca670 con 0x7fa8dc06d6f0 2024-09-13T18:28:22.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8db59e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc0ac540 con 0x7fa8dc15d030 2024-09-13T18:28:22.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8db59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc0ac820 con 0x7fa8dc0ce270 2024-09-13T18:28:22.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8da59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8dc06d6f0 0x7fa8dc0ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8da59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8dc06d6f0 0x7fa8dc0ca130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52148/0 (socket says 172.21.15.44:52148) 2024-09-13T18:28:22.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8da59c700 1 -- 172.21.15.44:0/1975963669 learned_addr learned my addr 172.21.15.44:0/1975963669 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:22.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8d9d9b700 1 --2- 172.21.15.44:0/1975963669 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8dc0ce270 0x7fa8dc156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8dad9d700 1 --2- 172.21.15.44:0/1975963669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8dc15d030 0x7fa8dc0aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8da59c700 1 -- 172.21.15.44:0/1975963669 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8dc0ce270 msgr2=0x7fa8dc156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8da59c700 1 --2- 172.21.15.44:0/1975963669 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8dc0ce270 0x7fa8dc156100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8da59c700 1 -- 172.21.15.44:0/1975963669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8dc15d030 msgr2=0x7fa8dc0aa3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8da59c700 1 --2- 172.21.15.44:0/1975963669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8dc15d030 0x7fa8dc0aa3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8da59c700 1 -- 172.21.15.44:0/1975963669 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc0094b0 con 0x7fa8dc06d6f0 2024-09-13T18:28:22.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8d9d9b700 1 --2- 172.21.15.44:0/1975963669 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8dc0ce270 0x7fa8dc156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:22.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8dad9d700 1 --2- 172.21.15.44:0/1975963669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8dc15d030 0x7fa8dc0aa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:22.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8da59c700 1 --2- 172.21.15.44:0/1975963669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8dc06d6f0 0x7fa8dc0ca130 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa8d000c500 tx=0x7fa8d000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:22.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8caffd700 1 -- 172.21.15.44:0/1975963669 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d00052d0 con 0x7fa8dc06d6f0 2024-09-13T18:28:22.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8caffd700 1 -- 172.21.15.44:0/1975963669 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d0005450 con 0x7fa8dc06d6f0 2024-09-13T18:28:22.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8caffd700 1 -- 172.21.15.44:0/1975963669 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d00038e0 con 0x7fa8dc06d6f0 2024-09-13T18:28:22.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8db59e700 1 -- 172.21.15.44:0/1975963669 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8dc0acb00 con 0x7fa8dc06d6f0 2024-09-13T18:28:22.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.578+0000 7fa8db59e700 1 -- 172.21.15.44:0/1975963669 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8dc0ad0c0 con 0x7fa8dc06d6f0 2024-09-13T18:28:22.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.582+0000 7fa8db59e700 1 -- 172.21.15.44:0/1975963669 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8dc0a9630 con 0x7fa8dc06d6f0 2024-09-13T18:28:22.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.582+0000 7fa8caffd700 1 -- 172.21.15.44:0/1975963669 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa8d0003a40 con 0x7fa8dc06d6f0 2024-09-13T18:28:22.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.582+0000 7fa8caffd700 1 --2- 172.21.15.44:0/1975963669 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa8bc066730 0x7fa8bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.582+0000 7fa8caffd700 1 -- 172.21.15.44:0/1975963669 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8d0083670 con 0x7fa8dc06d6f0 2024-09-13T18:28:22.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.582+0000 7fa8d9d9b700 1 --2- 172.21.15.44:0/1975963669 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa8bc066730 0x7fa8bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.586+0000 7fa8d9d9b700 1 --2- 172.21.15.44:0/1975963669 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa8bc066730 0x7fa8bc068bf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc0090b0 tx=0x7fa8cc010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:22.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.590+0000 7fa8caffd700 1 -- 172.21.15.44:0/1975963669 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa8d0050940 con 0x7fa8dc06d6f0 2024-09-13T18:28:22.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.762+0000 7fa8db59e700 1 -- 172.21.15.44:0/1975963669 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa8dc15caf0 con 0x7fa8dc06d6f0 2024-09-13T18:28:22.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.762+0000 7fa8caffd700 1 -- 172.21.15.44:0/1975963669 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa8d0053f60 con 0x7fa8dc06d6f0 2024-09-13T18:28:22.768 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:28:22.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.762+0000 7fa8db59e700 1 -- 172.21.15.44:0/1975963669 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa8bc066730 msgr2=0x7fa8bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.762+0000 7fa8db59e700 1 --2- 172.21.15.44:0/1975963669 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa8bc066730 0x7fa8bc068bf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc0090b0 tx=0x7fa8cc010000 comp rx=0 tx=0).stop 2024-09-13T18:28:22.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.762+0000 7fa8db59e700 1 -- 172.21.15.44:0/1975963669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8dc06d6f0 msgr2=0x7fa8dc0ca130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.762+0000 7fa8db59e700 1 --2- 172.21.15.44:0/1975963669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8dc06d6f0 0x7fa8dc0ca130 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa8d000c500 tx=0x7fa8d000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.766+0000 7fa8db59e700 1 -- 172.21.15.44:0/1975963669 shutdown_connections 2024-09-13T18:28:22.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.766+0000 7fa8db59e700 1 --2- 172.21.15.44:0/1975963669 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa8bc066730 0x7fa8bc068bf0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.766+0000 7fa8db59e700 1 --2- 172.21.15.44:0/1975963669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8dc15d030 0x7fa8dc0aa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.766+0000 7fa8db59e700 1 --2- 172.21.15.44:0/1975963669 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8dc0ce270 0x7fa8dc156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.766+0000 7fa8db59e700 1 --2- 172.21.15.44:0/1975963669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8dc06d6f0 0x7fa8dc0ca130 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.766+0000 7fa8db59e700 1 -- 172.21.15.44:0/1975963669 >> 172.21.15.44:0/1975963669 conn(0x7fa8dc0b0e10 msgr2=0x7fa8dc1577e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:22.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.766+0000 7fa8db59e700 1 -- 172.21.15.44:0/1975963669 shutdown_connections 2024-09-13T18:28:22.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.766+0000 7fa8db59e700 1 -- 172.21.15.44:0/1975963669 wait complete. 2024-09-13T18:28:22.787 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:28:22.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.890+0000 7f7297fff700 1 Processor -- start 2024-09-13T18:28:22.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.890+0000 7f7297fff700 1 -- start start 2024-09-13T18:28:22.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f7297fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7298144340 0x7f729806d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f7297fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f729806bdb0 0x7f72980cd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f7297fff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7298144720 con 0x7f729815f140 2024-09-13T18:28:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f7297fff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f729806dd40 con 0x7f729806bdb0 2024-09-13T18:28:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f7297fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729806da60 con 0x7f7298144340 2024-09-13T18:28:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f72967fc700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f729806bdb0 0x7f72980cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f7296ffd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7298144340 0x7f729806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f72967fc700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f729806bdb0 0x7f72980cd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:40424/0 (socket says 172.21.15.44:40424) 2024-09-13T18:28:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f72967fc700 1 -- 172.21.15.44:0/4107661932 learned_addr learned my addr 172.21.15.44:0/4107661932 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f72967fc700 1 -- 172.21.15.44:0/4107661932 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7298144340 msgr2=0x7f729806d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f72967fc700 1 --2- 172.21.15.44:0/4107661932 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7298144340 0x7f729806d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f72967fc700 1 -- 172.21.15.44:0/4107661932 >> v1:172.21.15.99:6789/0 conn(0x7f729815f140 legacy=0x7f7298070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f72967fc700 1 -- 172.21.15.44:0/4107661932 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729815e660 con 0x7f729806bdb0 2024-09-13T18:28:22.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f72967fc700 1 --2- 172.21.15.44:0/4107661932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f729806bdb0 0x7f72980cd580 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7288009910 tx=0x7f7288009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7b1f7ae6b3351ae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:22.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f7295ffb700 1 -- 172.21.15.44:0/4107661932 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7288011830 con 0x7f729806bdb0 2024-09-13T18:28:22.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f7295ffb700 1 -- 172.21.15.44:0/4107661932 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7288011990 con 0x7f729806bdb0 2024-09-13T18:28:22.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f7295ffb700 1 -- 172.21.15.44:0/4107661932 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7288011d40 con 0x7f729806bdb0 2024-09-13T18:28:22.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f7297fff700 1 -- 172.21.15.44:0/4107661932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f729806bdb0 msgr2=0x7f72980cd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f7297fff700 1 --2- 172.21.15.44:0/4107661932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f729806bdb0 0x7f72980cd580 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7288009910 tx=0x7f7288009c20 comp rx=0 tx=0).stop 2024-09-13T18:28:22.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f7297fff700 1 -- 172.21.15.44:0/4107661932 shutdown_connections 2024-09-13T18:28:22.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f7297fff700 1 --2- 172.21.15.44:0/4107661932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f729806bdb0 0x7f72980cd580 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f7297fff700 1 --2- 172.21.15.44:0/4107661932 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7298144340 0x7f729806d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f7297fff700 1 -- 172.21.15.44:0/4107661932 >> 172.21.15.44:0/4107661932 conn(0x7f72980b0e10 msgr2=0x7f72980b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:22.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f7297fff700 1 -- 172.21.15.44:0/4107661932 shutdown_connections 2024-09-13T18:28:22.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.894+0000 7f7297fff700 1 -- 172.21.15.44:0/4107661932 wait complete. 2024-09-13T18:28:22.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.898+0000 7f7297fff700 1 Processor -- start 2024-09-13T18:28:22.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.898+0000 7f7297fff700 1 -- start start 2024-09-13T18:28:22.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.898+0000 7f7297fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f729806bdb0 0x7f729815a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.898+0000 7f7297fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7298144340 0x7f72980cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.898+0000 7f7297fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f729815f140 0x7f72980ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.898+0000 7f7297fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72981e4e30 con 0x7f729815f140 2024-09-13T18:28:22.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.898+0000 7f7297fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72980cc700 con 0x7f729806bdb0 2024-09-13T18:28:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.898+0000 7f7297fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72981e5250 con 0x7f7298144340 2024-09-13T18:28:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.898+0000 7f72977fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f729815f140 0x7f72980ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.898+0000 7f7296ffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f729806bdb0 0x7f729815a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.898+0000 7f72977fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f729815f140 0x7f72980ae930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52156/0 (socket says 172.21.15.44:52156) 2024-09-13T18:28:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.898+0000 7f72977fe700 1 -- 172.21.15.44:0/3584663949 learned_addr learned my addr 172.21.15.44:0/3584663949 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.898+0000 7f72967fc700 1 --2- 172.21.15.44:0/3584663949 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7298144340 0x7f72980cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.898+0000 7f72977fe700 1 -- 172.21.15.44:0/3584663949 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7298144340 msgr2=0x7f72980cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.898+0000 7f72977fe700 1 --2- 172.21.15.44:0/3584663949 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7298144340 0x7f72980cbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.898+0000 7f72977fe700 1 -- 172.21.15.44:0/3584663949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f729806bdb0 msgr2=0x7f729815a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.898+0000 7f72977fe700 1 --2- 172.21.15.44:0/3584663949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f729806bdb0 0x7f729815a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.898+0000 7f72977fe700 1 -- 172.21.15.44:0/3584663949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7288009570 con 0x7f729815f140 2024-09-13T18:28:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.898+0000 7f72977fe700 1 --2- 172.21.15.44:0/3584663949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f729815f140 0x7f72980ae930 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f729000cbc0 tx=0x7f729000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.898+0000 7f727f7fe700 1 -- 172.21.15.44:0/3584663949 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7290003c20 con 0x7f729815f140 2024-09-13T18:28:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.898+0000 7f727f7fe700 1 -- 172.21.15.44:0/3584663949 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7290003d80 con 0x7f729815f140 2024-09-13T18:28:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.898+0000 7f7297fff700 1 -- 172.21.15.44:0/3584663949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f729815be20 con 0x7f729815f140 2024-09-13T18:28:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.898+0000 7f727f7fe700 1 -- 172.21.15.44:0/3584663949 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729000aa20 con 0x7f729815f140 2024-09-13T18:28:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.902+0000 7f7297fff700 1 -- 172.21.15.44:0/3584663949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72981e4770 con 0x7f729815f140 2024-09-13T18:28:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.902+0000 7f7297fff700 1 -- 172.21.15.44:0/3584663949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72981e4f70 con 0x7f729815f140 2024-09-13T18:28:22.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.902+0000 7f727f7fe700 1 -- 172.21.15.44:0/3584663949 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f729000ab80 con 0x7f729815f140 2024-09-13T18:28:22.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.902+0000 7f727f7fe700 1 --2- 172.21.15.44:0/3584663949 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7284066730 0x7f7284068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.902+0000 7f727f7fe700 1 -- 172.21.15.44:0/3584663949 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7290083f90 con 0x7f729815f140 2024-09-13T18:28:22.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.902+0000 7f7296ffd700 1 --2- 172.21.15.44:0/3584663949 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7284066730 0x7f7284068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.902+0000 7f7296ffd700 1 --2- 172.21.15.44:0/3584663949 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7284066730 0x7f7284068bf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f728c009bf0 tx=0x7f728c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:22.914+0000 7f727f7fe700 1 -- 172.21.15.44:0/3584663949 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f72900b5db0 con 0x7f729815f140 2024-09-13T18:28:23.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:23.098+0000 7f7297fff700 1 -- 172.21.15.44:0/3584663949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f729806d480 con 0x7f729815f140 2024-09-13T18:28:23.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:23.098+0000 7f727f7fe700 1 -- 172.21.15.44:0/3584663949 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) v1 ==== 80+0+0 (secure 0 0 0) 0x7f72981e4f70 con 0x7f729815f140 2024-09-13T18:28:23.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:23.102+0000 7f7297fff700 1 -- 172.21.15.44:0/3584663949 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7284066730 msgr2=0x7f7284068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:23.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:23.102+0000 7f7297fff700 1 --2- 172.21.15.44:0/3584663949 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7284066730 0x7f7284068bf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f728c009bf0 tx=0x7f728c009240 comp rx=0 tx=0).stop 2024-09-13T18:28:23.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:23.102+0000 7f7297fff700 1 -- 172.21.15.44:0/3584663949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f729815f140 msgr2=0x7f72980ae930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:23.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:23.102+0000 7f7297fff700 1 --2- 172.21.15.44:0/3584663949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f729815f140 0x7f72980ae930 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f729000cbc0 tx=0x7f729000ced0 comp rx=0 tx=0).stop 2024-09-13T18:28:23.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:23.102+0000 7f7297fff700 1 -- 172.21.15.44:0/3584663949 shutdown_connections 2024-09-13T18:28:23.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:23.102+0000 7f7297fff700 1 --2- 172.21.15.44:0/3584663949 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7284066730 0x7f7284068bf0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:23.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:23.102+0000 7f7297fff700 1 --2- 172.21.15.44:0/3584663949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f729815f140 0x7f72980ae930 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:23.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:23.102+0000 7f7297fff700 1 --2- 172.21.15.44:0/3584663949 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7298144340 0x7f72980cbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:23.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:23.102+0000 7f7297fff700 1 --2- 172.21.15.44:0/3584663949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f729806bdb0 0x7f729815a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:23.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:23.102+0000 7f7297fff700 1 -- 172.21.15.44:0/3584663949 >> 172.21.15.44:0/3584663949 conn(0x7f72980b0e10 msgr2=0x7f72980cac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:23.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:23.102+0000 7f7297fff700 1 -- 172.21.15.44:0/3584663949 shutdown_connections 2024-09-13T18:28:23.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:23.102+0000 7f7297fff700 1 -- 172.21.15.44:0/3584663949 wait complete. 2024-09-13T18:28:23.108 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-13T18:28:23.119 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2024-09-13T18:28:23.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:23.119 DEBUG:teuthology.orchestra.run.smithi044:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:23.128 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[37621]: fuse finished with error 0 and tester_r 0 2024-09-13T18:28:23.130 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:28:28.372 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:28:28.374 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:28:29.231 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:28:29.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:29.232 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:28:29.240 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:28:29.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.405+0000 7efdeffff700 1 Processor -- start 2024-09-13T18:28:29.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.405+0000 7efdeffff700 1 -- start start 2024-09-13T18:28:29.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.405+0000 7efdeffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdf015a930 0x7efdf0071d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.405+0000 7efdeffff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efdf00722b0 0x7efdf00cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.405+0000 7efdeffff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf015ad10 con 0x7efdf00cd960 2024-09-13T18:28:29.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.405+0000 7efdeffff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf00cd0a0 con 0x7efdf00722b0 2024-09-13T18:28:29.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.405+0000 7efdeffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf00718e0 con 0x7efdf015a930 2024-09-13T18:28:29.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.405+0000 7efdee7fc700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efdf00722b0 0x7efdf00cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.405+0000 7efdeeffd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdf015a930 0x7efdf0071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.405+0000 7efdef7fe700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7efdf00cd960 0x7efdf006aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:47482/0 (socket says 172.21.15.44:47482) 2024-09-13T18:28:29.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.405+0000 7efdef7fe700 1 -- 172.21.15.44:0/3915848122 learned_addr learned my addr 172.21.15.44:0/3915848122 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:29.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.405+0000 7efdedffb700 1 -- 172.21.15.44:0/3915848122 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130164713 0 0) 0x7efdf015ad10 con 0x7efdf00cd960 2024-09-13T18:28:29.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.405+0000 7efdedffb700 1 -- 172.21.15.44:0/3915848122 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdd80035d0 con 0x7efdf00cd960 2024-09-13T18:28:29.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.405+0000 7efdeeffd700 1 -- 172.21.15.44:0/3915848122 >> v2:172.21.15.99:3300/0 conn(0x7efdf00722b0 msgr2=0x7efdf00cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:29.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.405+0000 7efdeeffd700 1 --2- 172.21.15.44:0/3915848122 >> v2:172.21.15.99:3300/0 conn(0x7efdf00722b0 0x7efdf00cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.405+0000 7efdeeffd700 1 -- 172.21.15.44:0/3915848122 >> v1:172.21.15.99:6789/0 conn(0x7efdf00cd960 legacy=0x7efdf006aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.405+0000 7efdeeffd700 1 -- 172.21.15.44:0/3915848122 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf0070cd0 con 0x7efdf015a930 2024-09-13T18:28:29.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.405+0000 7efdee7fc700 1 --2- 172.21.15.44:0/3915848122 >> v2:172.21.15.99:3300/0 conn(0x7efdf00722b0 0x7efdf00cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:29.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.405+0000 7efdeeffd700 1 --2- 172.21.15.44:0/3915848122 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdf015a930 0x7efdf0071d70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efde4009850 tx=0x7efde4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=399573469f3165e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:29.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.405+0000 7efdedffb700 1 -- 172.21.15.44:0/3915848122 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde4011830 con 0x7efdf015a930 2024-09-13T18:28:29.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.405+0000 7efdedffb700 1 -- 172.21.15.44:0/3915848122 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde4011990 con 0x7efdf015a930 2024-09-13T18:28:29.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.405+0000 7efdedffb700 1 -- 172.21.15.44:0/3915848122 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde4011d40 con 0x7efdf015a930 2024-09-13T18:28:29.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.409+0000 7efdeffff700 1 -- 172.21.15.44:0/3915848122 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdf015a930 msgr2=0x7efdf0071d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.409+0000 7efdeffff700 1 --2- 172.21.15.44:0/3915848122 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdf015a930 0x7efdf0071d70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efde4009850 tx=0x7efde4009b60 comp rx=0 tx=0).stop 2024-09-13T18:28:29.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.409+0000 7efdeffff700 1 -- 172.21.15.44:0/3915848122 shutdown_connections 2024-09-13T18:28:29.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.409+0000 7efdeffff700 1 --2- 172.21.15.44:0/3915848122 >> v2:172.21.15.99:3300/0 conn(0x7efdf00722b0 0x7efdf00cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.409+0000 7efdeffff700 1 --2- 172.21.15.44:0/3915848122 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdf015a930 0x7efdf0071d70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.409+0000 7efdeffff700 1 -- 172.21.15.44:0/3915848122 >> 172.21.15.44:0/3915848122 conn(0x7efdf00b1810 msgr2=0x7efdf00b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:29.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.409+0000 7efdeffff700 1 -- 172.21.15.44:0/3915848122 shutdown_connections 2024-09-13T18:28:29.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.409+0000 7efdeffff700 1 -- 172.21.15.44:0/3915848122 wait complete. 2024-09-13T18:28:29.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.409+0000 7efdeffff700 1 Processor -- start 2024-09-13T18:28:29.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.409+0000 7efdeffff700 1 -- start start 2024-09-13T18:28:29.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdeffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdf00722b0 0x7efdf01ed730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdeffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdf00cd960 0x7efdf01f41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdeffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdf015a930 0x7efdf0146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdeffff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf01edc70 con 0x7efdf00cd960 2024-09-13T18:28:29.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdeffff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf01f4730 con 0x7efdf015a930 2024-09-13T18:28:29.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdeffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf00acb40 con 0x7efdf00722b0 2024-09-13T18:28:29.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdee7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdf00cd960 0x7efdf01f41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdee7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdf00cd960 0x7efdf01f41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52166/0 (socket says 172.21.15.44:52166) 2024-09-13T18:28:29.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdee7fc700 1 -- 172.21.15.44:0/3487105037 learned_addr learned my addr 172.21.15.44:0/3487105037 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:29.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdef7fe700 1 --2- 172.21.15.44:0/3487105037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdf015a930 0x7efdf0146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdeeffd700 1 --2- 172.21.15.44:0/3487105037 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdf00722b0 0x7efdf01ed730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdee7fc700 1 -- 172.21.15.44:0/3487105037 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdf00722b0 msgr2=0x7efdf01ed730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdee7fc700 1 --2- 172.21.15.44:0/3487105037 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdf00722b0 0x7efdf01ed730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdee7fc700 1 -- 172.21.15.44:0/3487105037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdf015a930 msgr2=0x7efdf0146e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdee7fc700 1 --2- 172.21.15.44:0/3487105037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdf015a930 0x7efdf0146e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdee7fc700 1 -- 172.21.15.44:0/3487105037 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde00094b0 con 0x7efdf00cd960 2024-09-13T18:28:29.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdef7fe700 1 --2- 172.21.15.44:0/3487105037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdf015a930 0x7efdf0146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:29.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdee7fc700 1 --2- 172.21.15.44:0/3487105037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdf00cd960 0x7efdf01f41f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7efde000ebe0 tx=0x7efde000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:29.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdd77fe700 1 -- 172.21.15.44:0/3487105037 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde000c850 con 0x7efdf00cd960 2024-09-13T18:28:29.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdd77fe700 1 -- 172.21.15.44:0/3487105037 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde000c9b0 con 0x7efdf00cd960 2024-09-13T18:28:29.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdeffff700 1 -- 172.21.15.44:0/3487105037 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde40094b0 con 0x7efdf00cd960 2024-09-13T18:28:29.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdd77fe700 1 -- 172.21.15.44:0/3487105037 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde000cd40 con 0x7efdf00cd960 2024-09-13T18:28:29.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdeffff700 1 -- 172.21.15.44:0/3487105037 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf01f0990 con 0x7efdf00cd960 2024-09-13T18:28:29.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.413+0000 7efdeffff700 1 -- 172.21.15.44:0/3487105037 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf00cd420 con 0x7efdf00cd960 2024-09-13T18:28:29.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.417+0000 7efdd77fe700 1 -- 172.21.15.44:0/3487105037 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efde0013470 con 0x7efdf00cd960 2024-09-13T18:28:29.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.417+0000 7efdd77fe700 1 --2- 172.21.15.44:0/3487105037 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efddc066730 0x7efddc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.417+0000 7efdd77fe700 1 -- 172.21.15.44:0/3487105037 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efde0084280 con 0x7efdf00cd960 2024-09-13T18:28:29.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.417+0000 7efdeeffd700 1 --2- 172.21.15.44:0/3487105037 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efddc066730 0x7efddc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.417+0000 7efdeeffd700 1 --2- 172.21.15.44:0/3487105037 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efddc066730 0x7efddc068bf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efde40090b0 tx=0x7efde401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:29.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.425+0000 7efdd77fe700 1 -- 172.21.15.44:0/3487105037 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efde0051550 con 0x7efdf00cd960 2024-09-13T18:28:29.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.633+0000 7efdeffff700 1 -- 172.21.15.44:0/3487105037 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7efdf00ae5a0 con 0x7efdf00cd960 2024-09-13T18:28:29.642 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-13T18:28:29.633+0000 7fc22bbc2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:28:29.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.649+0000 7efdd77fe700 1 -- 172.21.15.44:0/3487105037 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7efde000cea0 con 0x7efdf00cd960 2024-09-13T18:28:29.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.649+0000 7efdeffff700 1 -- 172.21.15.44:0/3487105037 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efddc066730 msgr2=0x7efddc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.649+0000 7efdeffff700 1 --2- 172.21.15.44:0/3487105037 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efddc066730 0x7efddc068bf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efde40090b0 tx=0x7efde401c040 comp rx=0 tx=0).stop 2024-09-13T18:28:29.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.649+0000 7efdeffff700 1 -- 172.21.15.44:0/3487105037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdf00cd960 msgr2=0x7efdf01f41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.649+0000 7efdeffff700 1 --2- 172.21.15.44:0/3487105037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdf00cd960 0x7efdf01f41f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7efde000ebe0 tx=0x7efde000eef0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.649+0000 7efdeffff700 1 -- 172.21.15.44:0/3487105037 shutdown_connections 2024-09-13T18:28:29.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.649+0000 7efdeffff700 1 --2- 172.21.15.44:0/3487105037 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efddc066730 0x7efddc068bf0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.649+0000 7efdeffff700 1 --2- 172.21.15.44:0/3487105037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdf015a930 0x7efdf0146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.649+0000 7efdeffff700 1 --2- 172.21.15.44:0/3487105037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdf00cd960 0x7efdf01f41f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.649+0000 7efdeffff700 1 --2- 172.21.15.44:0/3487105037 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdf00722b0 0x7efdf01ed730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.649+0000 7efdeffff700 1 -- 172.21.15.44:0/3487105037 >> 172.21.15.44:0/3487105037 conn(0x7efdf00b1810 msgr2=0x7efdf00cf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:29.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.649+0000 7efdeffff700 1 -- 172.21.15.44:0/3487105037 shutdown_connections 2024-09-13T18:28:29.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.649+0000 7efdeffff700 1 -- 172.21.15.44:0/3487105037 wait complete. 2024-09-13T18:28:29.659 INFO:tasks.ceph.mds.a.smithi044.stderr: -8869> 2024-09-13T18:28:08.654+0000 7f9f9ad35700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:28:29.660 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:28:29.673 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000001.00000000 2024-09-13T18:28:29.696 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-13T18:28:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.701+0000 7f0cd45e8140 1 Processor -- start 2024-09-13T18:28:29.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.701+0000 7f0cd45e8140 1 -- start start 2024-09-13T18:28:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd45e8140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b85229510 0x564b852dddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd45e8140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x564b852df110 0x564b852fc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd45e8140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b852df4f0 0x564b852fae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd45e8140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b851bb2f0 con 0x564b852df4f0 2024-09-13T18:28:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd45e8140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b851778e0 con 0x564b85229510 2024-09-13T18:28:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd45e8140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b85177580 con 0x564b852df110 2024-09-13T18:28:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd291e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b852df4f0 0x564b852fae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd291e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b852df4f0 0x564b852fae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52216/0 (socket says 172.21.15.44:52216) 2024-09-13T18:28:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd291e700 1 -- 172.21.15.44:0/4281642731 learned_addr learned my addr 172.21.15.44:0/4281642731 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd211d700 1 --2- 172.21.15.44:0/4281642731 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b85229510 0x564b852dddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cc991c700 1 --2- 172.21.15.44:0/4281642731 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x564b852df110 0x564b852fc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd291e700 1 -- 172.21.15.44:0/4281642731 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x564b852df110 msgr2=0x564b852fc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd291e700 1 --2- 172.21.15.44:0/4281642731 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x564b852df110 0x564b852fc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd291e700 1 -- 172.21.15.44:0/4281642731 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b85229510 msgr2=0x564b852dddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd291e700 1 --2- 172.21.15.44:0/4281642731 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b85229510 0x564b852dddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd291e700 1 -- 172.21.15.44:0/4281642731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc4005de0 con 0x564b852df4f0 2024-09-13T18:28:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd291e700 1 --2- 172.21.15.44:0/4281642731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b852df4f0 0x564b852fae60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc006f80 tx=0x7f0ccc001820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fcc3e2694d90314 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd111b700 1 -- 172.21.15.44:0/4281642731 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc012600 con 0x564b852df4f0 2024-09-13T18:28:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd111b700 1 -- 172.21.15.44:0/4281642731 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ccc012760 con 0x564b852df4f0 2024-09-13T18:28:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd111b700 1 -- 172.21.15.44:0/4281642731 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc012af0 con 0x564b852df4f0 2024-09-13T18:28:29.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd45e8140 1 -- 172.21.15.44:0/4281642731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b852df4f0 msgr2=0x564b852fae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd45e8140 1 --2- 172.21.15.44:0/4281642731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b852df4f0 0x564b852fae60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc006f80 tx=0x7f0ccc001820 comp rx=0 tx=0).stop 2024-09-13T18:28:29.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd45e8140 1 -- 172.21.15.44:0/4281642731 shutdown_connections 2024-09-13T18:28:29.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd45e8140 1 --2- 172.21.15.44:0/4281642731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b852df4f0 0x564b852fae60 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd45e8140 1 --2- 172.21.15.44:0/4281642731 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x564b852df110 0x564b852fc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd45e8140 1 --2- 172.21.15.44:0/4281642731 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b85229510 0x564b852dddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd45e8140 1 -- 172.21.15.44:0/4281642731 >> 172.21.15.44:0/4281642731 conn(0x564b8522b160 msgr2=0x564b852287e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd45e8140 1 -- 172.21.15.44:0/4281642731 shutdown_connections 2024-09-13T18:28:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd45e8140 1 -- 172.21.15.44:0/4281642731 wait complete. 2024-09-13T18:28:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd45e8140 1 Processor -- start 2024-09-13T18:28:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.705+0000 7f0cd45e8140 1 -- start start 2024-09-13T18:28:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.709+0000 7f0cd45e8140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b85229510 0x564b852dc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.709+0000 7f0cd45e8140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b852df110 0x564b8526e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.709+0000 7f0cd45e8140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x564b852df4f0 0x564b85226eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.709+0000 7f0cd45e8140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b8514d8d0 con 0x564b85229510 2024-09-13T18:28:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.709+0000 7f0cd45e8140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b852dcee0 con 0x564b852df110 2024-09-13T18:28:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.709+0000 7f0cd45e8140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b85270fb0 con 0x564b852df4f0 2024-09-13T18:28:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.709+0000 7f0cd211d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b85229510 0x564b852dc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.709+0000 7f0cd211d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b85229510 0x564b852dc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52224/0 (socket says 172.21.15.44:52224) 2024-09-13T18:28:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.709+0000 7f0cd211d700 1 -- 172.21.15.44:0/2558923968 learned_addr learned my addr 172.21.15.44:0/2558923968 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.709+0000 7f0cc991c700 1 --2- 172.21.15.44:0/2558923968 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b852df110 0x564b8526e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.709+0000 7f0cd291e700 1 --2- 172.21.15.44:0/2558923968 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x564b852df4f0 0x564b85226eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.709+0000 7f0cd211d700 1 -- 172.21.15.44:0/2558923968 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x564b852df4f0 msgr2=0x564b85226eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.709+0000 7f0cd211d700 1 --2- 172.21.15.44:0/2558923968 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x564b852df4f0 0x564b85226eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.709+0000 7f0cd211d700 1 -- 172.21.15.44:0/2558923968 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b852df110 msgr2=0x564b8526e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.709+0000 7f0cd211d700 1 --2- 172.21.15.44:0/2558923968 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b852df110 0x564b8526e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.709+0000 7f0cd211d700 1 -- 172.21.15.44:0/2558923968 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b85158bb0 con 0x564b85229510 2024-09-13T18:28:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.709+0000 7f0cd211d700 1 --2- 172.21.15.44:0/2558923968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b85229510 0x564b852dc9a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x564b8522cef0 tx=0x7f0cc4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.709+0000 7f0ccbfff700 1 -- 172.21.15.44:0/2558923968 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc4008690 con 0x564b85229510 2024-09-13T18:28:29.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.709+0000 7f0ccbfff700 1 -- 172.21.15.44:0/2558923968 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc4005540 con 0x564b85229510 2024-09-13T18:28:29.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.709+0000 7f0cd45e8140 1 -- 172.21.15.44:0/2558923968 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564b85165b00 con 0x564b85229510 2024-09-13T18:28:29.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.709+0000 7f0ccbfff700 1 -- 172.21.15.44:0/2558923968 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc401d850 con 0x564b85229510 2024-09-13T18:28:29.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.709+0000 7f0cd45e8140 1 -- 172.21.15.44:0/2558923968 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b85158f40 con 0x564b85229510 2024-09-13T18:28:29.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.709+0000 7f0ccbfff700 1 -- 172.21.15.44:0/2558923968 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0cc401d9b0 con 0x564b85229510 2024-09-13T18:28:29.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.713+0000 7f0ccbfff700 1 --2- 172.21.15.44:0/2558923968 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0cb4065060 0x7f0cb4067520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.713+0000 7f0ccbfff700 1 -- 172.21.15.44:0/2558923968 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0cc40842c0 con 0x564b85229510 2024-09-13T18:28:29.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.713+0000 7f0cc991c700 1 --2- 172.21.15.44:0/2558923968 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0cb4065060 0x7f0cb4067520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.713+0000 7f0cd45e8140 1 --2- 172.21.15.44:0/2558923968 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x564b8526eb20 0x564b852f8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.713+0000 7f0cd45e8140 1 -- 172.21.15.44:0/2558923968 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:1 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x564b852f90f0 con 0x564b8526eb20 2024-09-13T18:28:29.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.713+0000 7f0cd291e700 1 --2- 172.21.15.44:0/2558923968 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x564b8526eb20 0x564b852f8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.713+0000 7f0cc991c700 1 --2- 172.21.15.44:0/2558923968 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0cb4065060 0x7f0cb4067520 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc005fd0 tx=0x7f0cbc00c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:29.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.713+0000 7f0cd291e700 1 --2- 172.21.15.44:0/2558923968 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x564b8526eb20 0x564b852f8bb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:29.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.717+0000 7f0cd291e700 1 -- 172.21.15.44:0/2558923968 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== osd_op_reply(1 10000000001.00000000 [omap-get-keys] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0ccc0128d0 con 0x564b8526eb20 2024-09-13T18:28:29.725 INFO:teuthology.orchestra.run.smithi044.stderr:error getting omap key set cephfs_metadata/10000000001.00000000: (2) No such file or directory 2024-09-13T18:28:29.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.717+0000 7f0cd45e8140 1 -- 172.21.15.44:0/2558923968 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x564b8526eb20 msgr2=0x564b852f8bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.717+0000 7f0cd45e8140 1 --2- 172.21.15.44:0/2558923968 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x564b8526eb20 0x564b852f8bb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.717+0000 7f0cd45e8140 1 -- 172.21.15.44:0/2558923968 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0cb4065060 msgr2=0x7f0cb4067520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.717+0000 7f0cd45e8140 1 --2- 172.21.15.44:0/2558923968 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0cb4065060 0x7f0cb4067520 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc005fd0 tx=0x7f0cbc00c040 comp rx=0 tx=0).stop 2024-09-13T18:28:29.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.717+0000 7f0cd45e8140 1 -- 172.21.15.44:0/2558923968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b85229510 msgr2=0x564b852dc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.717+0000 7f0cd45e8140 1 --2- 172.21.15.44:0/2558923968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b85229510 0x564b852dc9a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x564b8522cef0 tx=0x7f0cc4002fb0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.717+0000 7f0cd291e700 1 -- 172.21.15.44:0/2558923968 reap_dead start 2024-09-13T18:28:29.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.717+0000 7f0cd45e8140 1 -- 172.21.15.44:0/2558923968 shutdown_connections 2024-09-13T18:28:29.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.717+0000 7f0cd45e8140 1 -- 172.21.15.44:0/2558923968 >> 172.21.15.44:0/2558923968 conn(0x564b8522b160 msgr2=0x564b852e08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:29.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.717+0000 7f0cd45e8140 1 -- 172.21.15.44:0/2558923968 shutdown_connections 2024-09-13T18:28:29.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.717+0000 7f0cd45e8140 1 -- 172.21.15.44:0/2558923968 wait complete. 2024-09-13T18:28:29.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:28:29.728 ERROR:tasks.cephfs.filesystem:Command failed on smithi044 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000001.00000000' 2024-09-13T18:28:29.728 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000 2024-09-13T18:28:29.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.757+0000 7f0312c6c140 1 Processor -- start 2024-09-13T18:28:29.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.757+0000 7f0312c6c140 1 -- start start 2024-09-13T18:28:29.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f0312c6c140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd0dbd5140 0x55bd0dc90dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f0312c6c140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd0dcab140 0x55bd0dd3cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f0312c6c140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55bd0dcab520 0x55bd0dd3d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f0312c6c140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd0db672f0 con 0x55bd0dbd5140 2024-09-13T18:28:29.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f0312c6c140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd0db238e0 con 0x55bd0dcab140 2024-09-13T18:28:29.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f0312c6c140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bd0db23580 con 0x55bd0dcab520 2024-09-13T18:28:29.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f03107a1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd0dbd5140 0x55bd0dc90dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f03107a1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd0dbd5140 0x55bd0dc90dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52252/0 (socket says 172.21.15.44:52252) 2024-09-13T18:28:29.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f03107a1700 1 -- 172.21.15.44:0/2315983822 learned_addr learned my addr 172.21.15.44:0/2315983822 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:29.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f0310fa2700 1 --2- 172.21.15.44:0/2315983822 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55bd0dcab520 0x55bd0dd3d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f030ffa0700 1 --2- 172.21.15.44:0/2315983822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd0dcab140 0x55bd0dd3cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f03107a1700 1 -- 172.21.15.44:0/2315983822 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55bd0dcab520 msgr2=0x55bd0dd3d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:29.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f03107a1700 1 --2- 172.21.15.44:0/2315983822 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55bd0dcab520 0x55bd0dd3d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f03107a1700 1 -- 172.21.15.44:0/2315983822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd0dcab140 msgr2=0x55bd0dd3cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:29.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f03107a1700 1 --2- 172.21.15.44:0/2315983822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd0dcab140 0x55bd0dd3cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f03107a1700 1 -- 172.21.15.44:0/2315983822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0300005de0 con 0x55bd0dbd5140 2024-09-13T18:28:29.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f03107a1700 1 --2- 172.21.15.44:0/2315983822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd0dbd5140 0x55bd0dc90dd0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0308001580 tx=0x7f0308001890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba7118cbc4a0e07 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:29.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f030ef9e700 1 -- 172.21.15.44:0/2315983822 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0308012400 con 0x55bd0dbd5140 2024-09-13T18:28:29.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f030ef9e700 1 -- 172.21.15.44:0/2315983822 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0308012580 con 0x55bd0dbd5140 2024-09-13T18:28:29.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f030ef9e700 1 -- 172.21.15.44:0/2315983822 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0308012930 con 0x55bd0dbd5140 2024-09-13T18:28:29.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f0312c6c140 1 -- 172.21.15.44:0/2315983822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd0dbd5140 msgr2=0x55bd0dc90dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f0312c6c140 1 --2- 172.21.15.44:0/2315983822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd0dbd5140 0x55bd0dc90dd0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0308001580 tx=0x7f0308001890 comp rx=0 tx=0).stop 2024-09-13T18:28:29.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f0312c6c140 1 -- 172.21.15.44:0/2315983822 shutdown_connections 2024-09-13T18:28:29.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f0312c6c140 1 --2- 172.21.15.44:0/2315983822 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55bd0dcab520 0x55bd0dd3d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f0312c6c140 1 --2- 172.21.15.44:0/2315983822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd0dcab140 0x55bd0dd3cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f0312c6c140 1 --2- 172.21.15.44:0/2315983822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd0dbd5140 0x55bd0dc90dd0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f0312c6c140 1 -- 172.21.15.44:0/2315983822 >> 172.21.15.44:0/2315983822 conn(0x55bd0dc04280 msgr2=0x55bd0dc07820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:29.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f0312c6c140 1 -- 172.21.15.44:0/2315983822 shutdown_connections 2024-09-13T18:28:29.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.761+0000 7f0312c6c140 1 -- 172.21.15.44:0/2315983822 wait complete. 2024-09-13T18:28:29.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f0312c6c140 1 Processor -- start 2024-09-13T18:28:29.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f0312c6c140 1 -- start start 2024-09-13T18:28:29.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f0312c6c140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55bd0dbd5140 0x55bd0dc1a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f0312c6c140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd0dcab140 0x55bd0dbfa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f0312c6c140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd0dcab520 0x55bd0dbfa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f0312c6c140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd0daf98d0 con 0x55bd0dcab520 2024-09-13T18:28:29.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f0312c6c140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd0dc1b150 con 0x55bd0dcab140 2024-09-13T18:28:29.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f0312c6c140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bd0dc1b3f0 con 0x55bd0dbd5140 2024-09-13T18:28:29.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f0310fa2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd0dcab520 0x55bd0dbfa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f03107a1700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55bd0dbd5140 0x55bd0dc1a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f030ffa0700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd0dcab140 0x55bd0dbfa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f03107a1700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55bd0dbd5140 0x55bd0dc1a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:38378/0 (socket says 172.21.15.44:38378) 2024-09-13T18:28:29.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f03107a1700 1 -- 172.21.15.44:0/2988433271 learned_addr learned my addr 172.21.15.44:0/2988433271 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:29.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f0310fa2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd0dcab520 0x55bd0dbfa6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52264/0 (socket says 172.21.15.44:52264) 2024-09-13T18:28:29.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f03107a1700 1 -- 172.21.15.44:0/2988433271 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd0dcab140 msgr2=0x55bd0dbfa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f03107a1700 1 --2- 172.21.15.44:0/2988433271 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd0dcab140 0x55bd0dbfa1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f03107a1700 1 -- 172.21.15.44:0/2988433271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd0dcab520 msgr2=0x55bd0dbfa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f03107a1700 1 --2- 172.21.15.44:0/2988433271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd0dcab520 0x55bd0dbfa6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f03107a1700 1 -- 172.21.15.44:0/2988433271 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd0db04bb0 con 0x55bd0dbd5140 2024-09-13T18:28:29.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f03107a1700 1 --2- 172.21.15.44:0/2988433271 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55bd0dbd5140 0x55bd0dc1a610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0308011660 tx=0x7f0308000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:29.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f030df9c700 1 -- 172.21.15.44:0/2988433271 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0308012e90 con 0x55bd0dbd5140 2024-09-13T18:28:29.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f030df9c700 1 -- 172.21.15.44:0/2988433271 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0308012400 con 0x55bd0dbd5140 2024-09-13T18:28:29.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f0312c6c140 1 -- 172.21.15.44:0/2988433271 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bd0db11b00 con 0x55bd0dbd5140 2024-09-13T18:28:29.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.765+0000 7f030df9c700 1 -- 172.21.15.44:0/2988433271 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0308011a90 con 0x55bd0dbd5140 2024-09-13T18:28:29.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.769+0000 7f0312c6c140 1 -- 172.21.15.44:0/2988433271 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bd0db04f40 con 0x55bd0dbd5140 2024-09-13T18:28:29.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.769+0000 7f030df9c700 1 -- 172.21.15.44:0/2988433271 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0308011bf0 con 0x55bd0dbd5140 2024-09-13T18:28:29.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.769+0000 7f030df9c700 1 --2- 172.21.15.44:0/2988433271 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f02fc065090 0x7f02fc067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.769+0000 7f030df9c700 1 -- 172.21.15.44:0/2988433271 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0308084440 con 0x55bd0dbd5140 2024-09-13T18:28:29.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.769+0000 7f030ffa0700 1 --2- 172.21.15.44:0/2988433271 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f02fc065090 0x7f02fc067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.769+0000 7f0312c6c140 1 --2- 172.21.15.44:0/2988433271 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55bd0dc1dc60 0x55bd0dd4bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.769+0000 7f0312c6c140 1 -- 172.21.15.44:0/2988433271 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:1 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x55bd0dc1cde0 con 0x55bd0dc1dc60 2024-09-13T18:28:29.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.773+0000 7f0310fa2700 1 --2- 172.21.15.44:0/2988433271 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55bd0dc1dc60 0x55bd0dd4bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.773+0000 7f030ffa0700 1 --2- 172.21.15.44:0/2988433271 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f02fc065090 0x7f02fc067550 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0304009700 tx=0x7f0304005aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:29.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.773+0000 7f0310fa2700 1 --2- 172.21.15.44:0/2988433271 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55bd0dc1dc60 0x55bd0dd4bbd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:29.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.777+0000 7f0310fa2700 1 -- 172.21.15.44:0/2988433271 <== osd.6 v2:172.21.15.99:6808/2907584318 1 ==== osd_op_reply(1 1.00000000 [omap-get-keys out=5b] v0'0 uv2 ondisk = 0) v8 ==== 154+0+5 (crc 0 0 0) 0x7f0300019040 con 0x55bd0dc1dc60 2024-09-13T18:28:29.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.777+0000 7f0312c6c140 1 -- 172.21.15.44:0/2988433271 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55bd0dc1dc60 msgr2=0x55bd0dd4bbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.777+0000 7f0312c6c140 1 --2- 172.21.15.44:0/2988433271 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55bd0dc1dc60 0x55bd0dd4bbd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.777+0000 7f0312c6c140 1 -- 172.21.15.44:0/2988433271 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f02fc065090 msgr2=0x7f02fc067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.777+0000 7f0312c6c140 1 --2- 172.21.15.44:0/2988433271 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f02fc065090 0x7f02fc067550 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0304009700 tx=0x7f0304005aa0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.777+0000 7f0312c6c140 1 -- 172.21.15.44:0/2988433271 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55bd0dbd5140 msgr2=0x55bd0dc1a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.777+0000 7f0312c6c140 1 --2- 172.21.15.44:0/2988433271 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55bd0dbd5140 0x55bd0dc1a610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0308011660 tx=0x7f0308000f40 comp rx=0 tx=0).stop 2024-09-13T18:28:29.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.777+0000 7f0310fa2700 1 -- 172.21.15.44:0/2988433271 reap_dead start 2024-09-13T18:28:29.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.777+0000 7f0312c6c140 1 -- 172.21.15.44:0/2988433271 shutdown_connections 2024-09-13T18:28:29.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.777+0000 7f0312c6c140 1 -- 172.21.15.44:0/2988433271 >> 172.21.15.44:0/2988433271 conn(0x55bd0dc04280 msgr2=0x55bd0dc073f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:29.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.777+0000 7f0312c6c140 1 -- 172.21.15.44:0/2988433271 shutdown_connections 2024-09-13T18:28:29.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.777+0000 7f0312c6c140 1 -- 172.21.15.44:0/2988433271 wait complete. 2024-09-13T18:28:29.791 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event recover_dentries list 2024-09-13T18:28:29.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.825+0000 7f21d4dc1500 1 -- start start 2024-09-13T18:28:29.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.825+0000 7f21d4dc1500 1 Processor -- start 2024-09-13T18:28:29.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d4dc1500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561fe8e1f800 0x561fe8ec4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d4dc1500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561fe8e1f400 0x561fe8ec4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d4dc1500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561fe8e1f000 0x561fe8ec5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d4dc1500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe8ea0780 con 0x561fe8e1f400 2024-09-13T18:28:29.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d4dc1500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe8ea0a00 con 0x561fe8e1f800 2024-09-13T18:28:29.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d4dc1500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x561fe8ea0640 con 0x561fe8e1f000 2024-09-13T18:28:29.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d2d7a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561fe8e1f400 0x561fe8ec4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d2d7a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561fe8e1f400 0x561fe8ec4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52288/0 (socket says 172.21.15.44:52288) 2024-09-13T18:28:29.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d2d7a700 1 -- 172.21.15.44:0/4025219440 learned_addr learned my addr 172.21.15.44:0/4025219440 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:29.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d3d7c700 1 --2- 172.21.15.44:0/4025219440 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561fe8e1f000 0x561fe8ec5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d357b700 1 --2- 172.21.15.44:0/4025219440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561fe8e1f800 0x561fe8ec4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d2d7a700 1 -- 172.21.15.44:0/4025219440 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561fe8e1f000 msgr2=0x561fe8ec5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:29.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d2d7a700 1 --2- 172.21.15.44:0/4025219440 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561fe8e1f000 0x561fe8ec5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d2d7a700 1 -- 172.21.15.44:0/4025219440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561fe8e1f800 msgr2=0x561fe8ec4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:29.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d2d7a700 1 --2- 172.21.15.44:0/4025219440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561fe8e1f800 0x561fe8ec4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d2d7a700 1 -- 172.21.15.44:0/4025219440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fe8e429c0 con 0x561fe8e1f400 2024-09-13T18:28:29.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d3d7c700 1 --2- 172.21.15.44:0/4025219440 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561fe8e1f000 0x561fe8ec5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:29.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d2d7a700 1 --2- 172.21.15.44:0/4025219440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561fe8e1f400 0x561fe8ec4b00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x561fe8f31260 tx=0x561fe8ef5260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f38d9ccb5e2f4149 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:29.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d0d76700 1 -- 172.21.15.44:0/4025219440 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561fe8e6f080 con 0x561fe8e1f400 2024-09-13T18:28:29.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d0d76700 1 -- 172.21.15.44:0/4025219440 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561fe9c10300 con 0x561fe8e1f400 2024-09-13T18:28:29.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d0d76700 1 -- 172.21.15.44:0/4025219440 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561fe8e6f600 con 0x561fe8e1f400 2024-09-13T18:28:29.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d4dc1500 1 -- 172.21.15.44:0/4025219440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561fe8e421a0 con 0x561fe8e1f400 2024-09-13T18:28:29.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d4dc1500 1 -- 172.21.15.44:0/4025219440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x561fe8e429c0 con 0x561fe8e1f400 2024-09-13T18:28:29.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d4dc1500 4 waiting for MDS map... 2024-09-13T18:28:29.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d0d76700 1 -- 172.21.15.44:0/4025219440 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x561fe8e58c40 con 0x561fe8e1f400 2024-09-13T18:28:29.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d0d76700 1 -- 172.21.15.44:0/4025219440 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 16) v1 ==== 2573+0+0 (secure 0 0 0) 0x561fe8e60f00 con 0x561fe8e1f400 2024-09-13T18:28:29.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d4dc1500 4 Got MDS map 16 2024-09-13T18:28:29.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.829+0000 7f21d4dc1500 10 main: JournalTool::main 2024-09-13T18:28:29.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.833+0000 7f21d4dc1500 4 main: JournalTool: connecting to RADOS... 2024-09-13T18:28:29.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.833+0000 7f21d4dc1500 1 Processor -- start 2024-09-13T18:28:29.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.833+0000 7f21d4dc1500 1 -- start start 2024-09-13T18:28:29.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.833+0000 7f21d4dc1500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561fe9ca8800 0x561fe8ec5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.833+0000 7f21d4dc1500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561fe9ca8c00 0x561fe8ec5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.833+0000 7f21d4dc1500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561fe9ca9000 0x561fe8ec6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.833+0000 7f21d4dc1500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe8e55e00 con 0x561fe9ca8c00 2024-09-13T18:28:29.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.833+0000 7f21d4dc1500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe8ea0a00 con 0x561fe9ca9000 2024-09-13T18:28:29.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.833+0000 7f21d4dc1500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x561fe8ea0780 con 0x561fe9ca8800 2024-09-13T18:28:29.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.833+0000 7f21d357b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561fe9ca8c00 0x561fe8ec5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.833+0000 7f21d357b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561fe9ca8c00 0x561fe8ec5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52302/0 (socket says 172.21.15.44:52302) 2024-09-13T18:28:29.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.833+0000 7f21d357b700 1 -- 172.21.15.44:0/3388029046 learned_addr learned my addr 172.21.15.44:0/3388029046 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:29.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.833+0000 7f21d3d7c700 1 --2- 172.21.15.44:0/3388029046 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561fe9ca8800 0x561fe8ec5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.833+0000 7f21d2d7a700 1 --2- 172.21.15.44:0/3388029046 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561fe9ca9000 0x561fe8ec6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.833+0000 7f21d357b700 1 -- 172.21.15.44:0/3388029046 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561fe9ca8800 msgr2=0x561fe8ec5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:29.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.833+0000 7f21d357b700 1 --2- 172.21.15.44:0/3388029046 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561fe9ca8800 0x561fe8ec5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.833+0000 7f21d357b700 1 -- 172.21.15.44:0/3388029046 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561fe9ca9000 msgr2=0x561fe8ec6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:29.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.833+0000 7f21d357b700 1 --2- 172.21.15.44:0/3388029046 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561fe9ca9000 0x561fe8ec6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.833+0000 7f21d357b700 1 -- 172.21.15.44:0/3388029046 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fe8e42b60 con 0x561fe9ca8c00 2024-09-13T18:28:29.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21d357b700 1 --2- 172.21.15.44:0/3388029046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561fe9ca8c00 0x561fe8ec5b80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x561fe91586f0 tx=0x561fe9178000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61cd147e3702566 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:29.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21ced72700 1 -- 172.21.15.44:0/3388029046 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561fe8e6f080 con 0x561fe9ca8c00 2024-09-13T18:28:29.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21ced72700 1 -- 172.21.15.44:0/3388029046 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561fe9c10300 con 0x561fe9ca8c00 2024-09-13T18:28:29.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21ced72700 1 -- 172.21.15.44:0/3388029046 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561fe8e6f600 con 0x561fe9ca8c00 2024-09-13T18:28:29.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3388029046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561fe9ca8c00 msgr2=0x561fe8ec5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/3388029046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561fe9ca8c00 0x561fe8ec5b80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x561fe91586f0 tx=0x561fe9178000 comp rx=0 tx=0).stop 2024-09-13T18:28:29.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3388029046 shutdown_connections 2024-09-13T18:28:29.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/3388029046 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561fe9ca9000 0x561fe8ec6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/3388029046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561fe9ca8c00 0x561fe8ec5b80 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/3388029046 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561fe9ca8800 0x561fe8ec5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3388029046 >> 172.21.15.44:0/3388029046 conn(0x561fe8e1ec00 msgr2=0x561fe8f0f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:29.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3388029046 shutdown_connections 2024-09-13T18:28:29.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3388029046 wait complete. 2024-09-13T18:28:29.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21d4dc1500 1 Processor -- start 2024-09-13T18:28:29.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21d4dc1500 1 -- start start 2024-09-13T18:28:29.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21d4dc1500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561fe9ca8800 0x561fe8ec7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21d4dc1500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561fe9ca8c00 0x561fe8ec6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21d4dc1500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561fe9ca9000 0x561fe8ec6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21d4dc1500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe8ea0500 con 0x561fe9ca8800 2024-09-13T18:28:29.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21d4dc1500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe8ea03c0 con 0x561fe9ca9000 2024-09-13T18:28:29.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21d4dc1500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x561fe8ea0280 con 0x561fe9ca8c00 2024-09-13T18:28:29.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21d3d7c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561fe9ca8800 0x561fe8ec7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21d3d7c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561fe9ca8800 0x561fe8ec7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52314/0 (socket says 172.21.15.44:52314) 2024-09-13T18:28:29.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 learned_addr learned my addr 172.21.15.44:0/3955014589 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:29.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.837+0000 7f21d2d7a700 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561fe9ca9000 0x561fe8ec6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.841+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561fe9ca8c00 msgr2=0x561fe8ec6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.841+0000 7f21d3d7c700 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561fe9ca8c00 0x561fe8ec6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.841+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561fe9ca9000 msgr2=0x561fe8ec6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.841+0000 7f21d3d7c700 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561fe9ca9000 0x561fe8ec6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.841+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fe8e42340 con 0x561fe9ca8800 2024-09-13T18:28:29.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.841+0000 7f21d3d7c700 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561fe9ca8800 0x561fe8ec7180 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x561fe91593e0 tx=0x561fe9178d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:29.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.841+0000 7f21cd56f700 1 -- 172.21.15.44:0/3955014589 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561fe8e6f080 con 0x561fe9ca8800 2024-09-13T18:28:29.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.841+0000 7f21cd56f700 1 -- 172.21.15.44:0/3955014589 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561fe9c11500 con 0x561fe9ca8800 2024-09-13T18:28:29.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.841+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561fe8e42000 con 0x561fe9ca8800 2024-09-13T18:28:29.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.841+0000 7f21cd56f700 1 -- 172.21.15.44:0/3955014589 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561fe8e6f600 con 0x561fe9ca8800 2024-09-13T18:28:29.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.841+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561fe8e42ea0 con 0x561fe9ca8800 2024-09-13T18:28:29.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.841+0000 7f21d4dc1500 4 main: JournalTool: resolving pool 4 2024-09-13T18:28:29.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.841+0000 7f21cd56f700 1 -- 172.21.15.44:0/3955014589 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x561fe8e7e840 con 0x561fe9ca8800 2024-09-13T18:28:29.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.845+0000 7f21cd56f700 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x561fe9184800 0x561fe8ec7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.845+0000 7f21cd56f700 1 -- 172.21.15.44:0/3955014589 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x561fe8e58a80 con 0x561fe9ca8800 2024-09-13T18:28:29.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.845+0000 7f21d4dc1500 4 main: JournalTool: creating IoCtx.. 2024-09-13T18:28:29.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.845+0000 7f21d4dc1500 4 main: Executing for rank 0 2024-09-13T18:28:29.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.845+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x561fe9ca9400 0x561fe8ec6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.845+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:1 4.f 4:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9ca9800 con 0x561fe9ca9400 2024-09-13T18:28:29.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.845+0000 7f21d2d7a700 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x561fe9ca9400 0x561fe8ec6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.845+0000 7f21d2d7a700 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x561fe9ca9400 0x561fe8ec6100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:29.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.845+0000 7f21d357b700 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x561fe9184800 0x561fe8ec7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.845+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:29.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.845+0000 7f21d4dc1500 4 Pointer 400.00000000 is readable 2024-09-13T18:28:29.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.845+0000 7f21d4dc1500 4 JournalScanner::scan: reading header object '200.00000000' 2024-09-13T18:28:29.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.845+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x561fe9ca9c00 0x561fe8ec5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.845+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:2 4.14 4:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9184c00 con 0x561fe9ca9c00 2024-09-13T18:28:29.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.845+0000 7f21d357b700 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x561fe9184800 0x561fe8ec7700 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x561fe91586f0 tx=0x561fe8ef2cc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:29.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.845+0000 7f21d3d7c700 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x561fe9ca9c00 0x561fe8ec5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.845+0000 7f21d3d7c700 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x561fe9ca9c00 0x561fe8ec5b80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:29.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.845+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv17 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:29.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.845+0000 7f21d4dc1500 10 Header 0x400000 0x400000 0x4064fb 2024-09-13T18:28:29.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.845+0000 7f21d4dc1500 10 Starting journal scan from offset 0x400000 2024-09-13T18:28:29.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.845+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:3 4.14 4:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185000 con 0x561fe9ca9c00 2024-09-13T18:28:29.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 2 ==== osd_op_reply(3 200.00000001 [read 0~52204 out=52204b] v0'0 uv22 ondisk = 0) v8 ==== 156+0+52204 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:29.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 4 Read 0xcbec bytes from 200.00000001 gap=0 2024-09-13T18:28:29.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Parsing data, 0xcbec bytes available 2024-09-13T18:28:29.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x400000 2024-09-13T18:28:29.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0x37c bytes 2024-09-13T18:28:29.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x400000 2024-09-13T18:28:29.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x40037c 2024-09-13T18:28:29.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0x1ba bytes 2024-09-13T18:28:29.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x40037c 2024-09-13T18:28:29.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x400536 2024-09-13T18:28:29.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0x32f bytes 2024-09-13T18:28:29.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x400536 2024-09-13T18:28:29.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x400865 2024-09-13T18:28:29.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0x6b2 bytes 2024-09-13T18:28:29.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x400865 2024-09-13T18:28:29.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x400f17 2024-09-13T18:28:29.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0x7ce bytes 2024-09-13T18:28:29.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x400f17 2024-09-13T18:28:29.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x4016e5 2024-09-13T18:28:29.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0x7ac bytes 2024-09-13T18:28:29.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x4016e5 2024-09-13T18:28:29.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x401e91 2024-09-13T18:28:29.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0x7df bytes 2024-09-13T18:28:29.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x401e91 2024-09-13T18:28:29.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x402670 2024-09-13T18:28:29.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0x472 bytes 2024-09-13T18:28:29.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x402670 2024-09-13T18:28:29.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x402ae2 2024-09-13T18:28:29.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0x7a8 bytes 2024-09-13T18:28:29.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x402ae2 2024-09-13T18:28:29.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x40328a 2024-09-13T18:28:29.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0xc8c bytes 2024-09-13T18:28:29.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x40328a 2024-09-13T18:28:29.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x403f16 2024-09-13T18:28:29.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0x79a bytes 2024-09-13T18:28:29.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x403f16 2024-09-13T18:28:29.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x4046b0 2024-09-13T18:28:29.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0x78b bytes 2024-09-13T18:28:29.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x4046b0 2024-09-13T18:28:29.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x404e3b 2024-09-13T18:28:29.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0xb60 bytes 2024-09-13T18:28:29.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x404e3b 2024-09-13T18:28:29.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x40599b 2024-09-13T18:28:29.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0xb60 bytes 2024-09-13T18:28:29.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x40599b 2024-09-13T18:28:29.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x4064fb 2024-09-13T18:28:29.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0xb60 bytes 2024-09-13T18:28:29.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x4064fb 2024-09-13T18:28:29.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x40705b 2024-09-13T18:28:29.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0xb63 bytes 2024-09-13T18:28:29.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x40705b 2024-09-13T18:28:29.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x407bbe 2024-09-13T18:28:29.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0x7a8 bytes 2024-09-13T18:28:29.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x407bbe 2024-09-13T18:28:29.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x408366 2024-09-13T18:28:29.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0xb6e bytes 2024-09-13T18:28:29.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x408366 2024-09-13T18:28:29.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x408ed4 2024-09-13T18:28:29.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0xb63 bytes 2024-09-13T18:28:29.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x408ed4 2024-09-13T18:28:29.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x409a37 2024-09-13T18:28:29.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0x681 bytes 2024-09-13T18:28:29.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x409a37 2024-09-13T18:28:29.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x40a0b8 2024-09-13T18:28:29.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0xa56 bytes 2024-09-13T18:28:29.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x40a0b8 2024-09-13T18:28:29.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x40ab0e 2024-09-13T18:28:29.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0x8d9 bytes 2024-09-13T18:28:29.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x40ab0e 2024-09-13T18:28:29.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x40b3e7 2024-09-13T18:28:29.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0x257 bytes 2024-09-13T18:28:29.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x40b3e7 2024-09-13T18:28:29.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x40b63e 2024-09-13T18:28:29.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0x9d0 bytes 2024-09-13T18:28:29.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x40b63e 2024-09-13T18:28:29.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x40c00e 2024-09-13T18:28:29.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0x673 bytes 2024-09-13T18:28:29.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x40c00e 2024-09-13T18:28:29.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x40c681 2024-09-13T18:28:29.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0x472 bytes 2024-09-13T18:28:29.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x40c681 2024-09-13T18:28:29.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x40caf3 2024-09-13T18:28:29.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0xad bytes 2024-09-13T18:28:29.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x40caf3 2024-09-13T18:28:29.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Attempting decode at 0x40cba0 2024-09-13T18:28:29.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Consumed 0x4c bytes 2024-09-13T18:28:29.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 10 Valid entry at 0x40cba0 2024-09-13T18:28:29.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x561fe9185400 0x561fe8ec5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:4 4.1b 4:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185800 con 0x561fe9185400 2024-09-13T18:28:29.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d357b700 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x561fe9185400 0x561fe8ec5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d357b700 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x561fe9185400 0x561fe8ec5600 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:29.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d357b700 1 -- 172.21.15.44:0/3955014589 <== osd.4 v2:172.21.15.99:6816/2515272044 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x561fe929c000 con 0x561fe9185400 2024-09-13T18:28:29.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 4 Reached end of journal objects 2024-09-13T18:28:29.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 4 Scanned objects, 0 missing, 1 valid 2024-09-13T18:28:29.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 4 Events scanned, 0 gaps 2024-09-13T18:28:29.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 4 Found 28 valid events 2024-09-13T18:28:29.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 4 Selected 28 events events for processing 2024-09-13T18:28:29.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 1.00000000 2024-09-13T18:28:29.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x561fe9185c00 0x561fe929e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:5 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2000 con 0x561fe9185c00 2024-09-13T18:28:29.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d2d7a700 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x561fe9185c00 0x561fe929e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d2d7a700 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x561fe9185c00 0x561fe929e000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:29.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 1 ==== osd_op_reply(5 1.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.849+0000 7f21d4dc1500 4 recover_dentries: frag 1.00000000 fnode old v1 vs new v1 2024-09-13T18:28:29.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.853+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:6 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2400 con 0x561fe9185c00 2024-09-13T18:28:29.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.853+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 2 ==== osd_op_reply(6 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.853+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 100.00000000 2024-09-13T18:28:29.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.853+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:7 4.13 4:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2800 con 0x561fe9185400 2024-09-13T18:28:29.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.853+0000 7f21d357b700 1 -- 172.21.15.44:0/3955014589 <== osd.4 v2:172.21.15.99:6816/2515272044 2 ==== osd_op_reply(7 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x561fe929c000 con 0x561fe9185400 2024-09-13T18:28:29.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.853+0000 7f21d4dc1500 4 recover_dentries: frag 100.00000000 fnode old v1 vs new v1 2024-09-13T18:28:29.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.853+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:8 4.13 4:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2c00 con 0x561fe9185400 2024-09-13T18:28:29.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.853+0000 7f21d357b700 1 -- 172.21.15.44:0/3955014589 <== osd.4 v2:172.21.15.99:6816/2515272044 3 ==== osd_op_reply(8 100.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+4 (crc 0 0 0) 0x561fe929c000 con 0x561fe9185400 2024-09-13T18:28:29.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.853+0000 7f21d4dc1500 4 recover_dentries: updating root 0x1 2024-09-13T18:28:29.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.853+0000 7f21d4dc1500 4 recover_dentries: object id 1.00000000.inode 2024-09-13T18:28:29.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.853+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:9 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3000 con 0x561fe9ca9c00 2024-09-13T18:28:29.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.853+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 3 ==== osd_op_reply(9 1.00000000.inode [read 0~582 out=582b] v0'0 uv4 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:29.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.853+0000 7f21d4dc1500 4 recover_dentries: root exists, will modify (582) 2024-09-13T18:28:29.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.853+0000 7f21d4dc1500 4 recover_dentries: magic ok 2024-09-13T18:28:29.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.853+0000 7f21d4dc1500 4 recover_dentries: writing root ino 1.00000000.inode version 2 2024-09-13T18:28:29.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.853+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:10 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3400 con 0x561fe9ca9c00 2024-09-13T18:28:29.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.857+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 4 ==== osd_op_reply(10 1.00000000.inode [writefull 0~582] v36'23 uv23 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.857+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 1.00000000 2024-09-13T18:28:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.857+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:11 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3800 con 0x561fe9185c00 2024-09-13T18:28:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.857+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 3 ==== osd_op_reply(11 1.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.857+0000 7f21d4dc1500 4 recover_dentries: frag 1.00000000 fnode old v1 vs new v3 2024-09-13T18:28:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.857+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.857+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:12 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3c00 con 0x561fe9185c00 2024-09-13T18:28:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.857+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 4 ==== osd_op_reply(12 1.00000000 [omap-set-header] v36'5 uv5 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.857+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:13 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3000 con 0x561fe9185c00 2024-09-13T18:28:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.861+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 5 ==== osd_op_reply(13 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv5 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.861+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/rootfile 2024-09-13T18:28:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.861+0000 7f21d4dc1500 4 recover_dentries: dentry did not already exist, will create 2024-09-13T18:28:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.861+0000 7f21d4dc1500 4 recover_dentries: writing i dentry rootfile_head into frag 1.00000000 2024-09-13T18:28:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.861+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.861+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:14 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=563b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2800 con 0x561fe9185c00 2024-09-13T18:28:29.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.861+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 6 ==== osd_op_reply(14 1.00000000 [omap-set-vals] v36'6 uv6 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.861+0000 7f21d4dc1500 4 recover_dentries: updating root 0x1 2024-09-13T18:28:29.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.861+0000 7f21d4dc1500 4 recover_dentries: object id 1.00000000.inode 2024-09-13T18:28:29.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.861+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:15 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2000 con 0x561fe9ca9c00 2024-09-13T18:28:29.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.861+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 5 ==== osd_op_reply(15 1.00000000.inode [read 0~582 out=582b] v0'0 uv23 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:29.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.861+0000 7f21d4dc1500 4 recover_dentries: root exists, will modify (582) 2024-09-13T18:28:29.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.861+0000 7f21d4dc1500 4 recover_dentries: magic ok 2024-09-13T18:28:29.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.861+0000 7f21d4dc1500 4 recover_dentries: writing root ino 1.00000000.inode version 3 2024-09-13T18:28:29.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.861+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:16 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2400 con 0x561fe9ca9c00 2024-09-13T18:28:29.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.865+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 6 ==== osd_op_reply(16 1.00000000.inode [writefull 0~582] v36'24 uv24 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:29.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.865+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 1.00000000 2024-09-13T18:28:29.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.865+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:17 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9ca9800 con 0x561fe9185c00 2024-09-13T18:28:29.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.865+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 7 ==== osd_op_reply(17 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.865+0000 7f21d4dc1500 4 recover_dentries: frag 1.00000000 fnode old v3 vs new v5 2024-09-13T18:28:29.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.865+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:29.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.865+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:18 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9184400 con 0x561fe9185c00 2024-09-13T18:28:29.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.869+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 8 ==== osd_op_reply(18 1.00000000 [omap-set-header] v36'7 uv7 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.869+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:19 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9184c00 con 0x561fe9185c00 2024-09-13T18:28:29.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.869+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 9 ==== osd_op_reply(19 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv7 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.869+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-09-13T18:28:29.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.869+0000 7f21d4dc1500 4 recover_dentries: dentry did not already exist, will create 2024-09-13T18:28:29.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.869+0000 7f21d4dc1500 4 recover_dentries: writing i dentry subdir_head into frag 1.00000000 2024-09-13T18:28:29.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.869+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:29.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.869+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:20 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185000 con 0x561fe9185c00 2024-09-13T18:28:29.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.869+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 10 ==== osd_op_reply(20 1.00000000 [omap-set-vals] v36'8 uv8 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.869+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 10000000001.00000000 2024-09-13T18:28:29.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.869+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:21 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185800 con 0x561fe9ca9400 2024-09-13T18:28:29.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.869+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 2 ==== osd_op_reply(21 10000000001.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:29.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.869+0000 7f21d4dc1500 4 recover_dentries: failed to read OMAP header from directory fragment 10000000001.00000000 (2) No such file or directory 2024-09-13T18:28:29.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.869+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:29.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.869+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:22 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3800 con 0x561fe9ca9400 2024-09-13T18:28:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.873+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 3 ==== osd_op_reply(22 10000000001.00000000 [omap-set-header] v36'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.873+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:23 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3c00 con 0x561fe9ca9400 2024-09-13T18:28:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.873+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 4 ==== osd_op_reply(23 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.873+0000 7f21d4dc1500 4 recover_dentries: updating root 0x1 2024-09-13T18:28:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.873+0000 7f21d4dc1500 4 recover_dentries: object id 1.00000000.inode 2024-09-13T18:28:29.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.873+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:24 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3000 con 0x561fe9ca9c00 2024-09-13T18:28:29.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.873+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 7 ==== osd_op_reply(24 1.00000000.inode [read 0~582 out=582b] v0'0 uv24 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:29.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.877+0000 7f21d4dc1500 4 recover_dentries: root exists, will modify (582) 2024-09-13T18:28:29.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.877+0000 7f21d4dc1500 4 recover_dentries: magic ok 2024-09-13T18:28:29.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.877+0000 7f21d4dc1500 4 recover_dentries: writing root ino 1.00000000.inode version 4 2024-09-13T18:28:29.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.877+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:25 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2800 con 0x561fe9ca9c00 2024-09-13T18:28:29.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.877+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 8 ==== osd_op_reply(25 1.00000000.inode [writefull 0~582] v36'25 uv25 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:29.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.877+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 1.00000000 2024-09-13T18:28:29.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.877+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:26 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9184400 con 0x561fe9185c00 2024-09-13T18:28:29.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.877+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 11 ==== osd_op_reply(26 1.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.877+0000 7f21d4dc1500 4 recover_dentries: frag 1.00000000 fnode old v5 vs new v7 2024-09-13T18:28:29.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.877+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:29.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.877+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:27 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9184c00 con 0x561fe9185c00 2024-09-13T18:28:29.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.881+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 12 ==== osd_op_reply(27 1.00000000 [omap-set-header] v36'9 uv9 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.881+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:28 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185000 con 0x561fe9185c00 2024-09-13T18:28:29.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.881+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 13 ==== osd_op_reply(28 1.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+523 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.881+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-09-13T18:28:29.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.881+0000 7f21d4dc1500 4 recover_dentries: dentry subdir_head existed already 2024-09-13T18:28:29.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.881+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:29.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.881+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 4 vs fullbit version 6 2024-09-13T18:28:29.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.881+0000 7f21d4dc1500 4 recover_dentries: writing i dentry subdir_head into frag 1.00000000 2024-09-13T18:28:29.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.881+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:29.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.881+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:29 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185800 con 0x561fe9185c00 2024-09-13T18:28:29.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.885+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 14 ==== osd_op_reply(29 1.00000000 [omap-set-vals] v36'10 uv10 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.885+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 10000000001.00000000 2024-09-13T18:28:29.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.885+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:30 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9ca9800 con 0x561fe9ca9400 2024-09-13T18:28:29.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.885+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 5 ==== osd_op_reply(30 10000000001.00000000 [omap-get-header out=274b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:29.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.885+0000 7f21d4dc1500 4 recover_dentries: frag 10000000001.00000000 fnode old v1 vs new v3 2024-09-13T18:28:29.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.885+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:29.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.885+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:31 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3800 con 0x561fe9ca9400 2024-09-13T18:28:29.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.889+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 6 ==== osd_op_reply(31 10000000001.00000000 [omap-set-header] v36'4 uv4 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:29.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.889+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:32 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3c00 con 0x561fe9ca9400 2024-09-13T18:28:29.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.889+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 7 ==== osd_op_reply(32 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:29.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.889+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-09-13T18:28:29.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.889+0000 7f21d4dc1500 4 recover_dentries: dentry did not already exist, will create 2024-09-13T18:28:29.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.889+0000 7f21d4dc1500 4 recover_dentries: writing i dentry subdirfile_head into frag 10000000001.00000000 2024-09-13T18:28:29.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.889+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:29.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.889+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:33 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=565b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3400 con 0x561fe9ca9400 2024-09-13T18:28:29.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.893+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 8 ==== osd_op_reply(33 10000000001.00000000 [omap-set-vals] v36'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:29.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.893+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 1.00000000 2024-09-13T18:28:29.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.893+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:34 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2000 con 0x561fe9185c00 2024-09-13T18:28:29.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.893+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 15 ==== osd_op_reply(34 1.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.893+0000 7f21d4dc1500 4 recover_dentries: frag 1.00000000 fnode old v7 vs new v9 2024-09-13T18:28:29.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.893+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:29.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.893+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:35 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2400 con 0x561fe9185c00 2024-09-13T18:28:29.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.905+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 16 ==== osd_op_reply(35 1.00000000 [omap-set-header] v36'11 uv11 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.905+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:36 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3000 con 0x561fe9185c00 2024-09-13T18:28:29.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.905+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 17 ==== osd_op_reply(36 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv11 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.905+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-13T18:28:29.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.905+0000 7f21d4dc1500 4 recover_dentries: dentry did not already exist, will create 2024-09-13T18:28:29.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.905+0000 7f21d4dc1500 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-13T18:28:29.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.905+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:29.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.905+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:37 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=524b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2800 con 0x561fe9185c00 2024-09-13T18:28:29.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.909+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 18 ==== osd_op_reply(37 1.00000000 [omap-set-vals] v36'12 uv12 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.909+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-13T18:28:29.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.909+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x561fe9184400 0x561fe929e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.909+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:38 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9184c00 con 0x561fe9184400 2024-09-13T18:28:29.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.909+0000 7f21d3d7c700 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x561fe9184400 0x561fe929e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.909+0000 7f21d3d7c700 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x561fe9184400 0x561fe929e580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:29.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.909+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 1 ==== osd_op_reply(38 100000001f7.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:29.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.909+0000 7f21d4dc1500 4 recover_dentries: failed to read OMAP header from directory fragment 100000001f7.00000000 (2) No such file or directory 2024-09-13T18:28:29.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.909+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:29.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.909+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:39 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185000 con 0x561fe9184400 2024-09-13T18:28:29.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.913+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 2 ==== osd_op_reply(39 100000001f7.00000000 [omap-set-header] v36'1 uv1 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:29.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.913+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:40 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185800 con 0x561fe9184400 2024-09-13T18:28:29.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.913+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 3 ==== osd_op_reply(40 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:29.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.913+0000 7f21d4dc1500 4 recover_dentries: updating root 0x1 2024-09-13T18:28:29.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.913+0000 7f21d4dc1500 4 recover_dentries: object id 1.00000000.inode 2024-09-13T18:28:29.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.913+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:41 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3800 con 0x561fe9ca9c00 2024-09-13T18:28:29.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.913+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 9 ==== osd_op_reply(41 1.00000000.inode [read 0~582 out=582b] v0'0 uv25 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:29.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.913+0000 7f21d4dc1500 4 recover_dentries: root exists, will modify (582) 2024-09-13T18:28:29.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.913+0000 7f21d4dc1500 4 recover_dentries: magic ok 2024-09-13T18:28:29.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.913+0000 7f21d4dc1500 4 recover_dentries: writing root ino 1.00000000.inode version 5 2024-09-13T18:28:29.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.913+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:42 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3c00 con 0x561fe9ca9c00 2024-09-13T18:28:29.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.917+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 10 ==== osd_op_reply(42 1.00000000.inode [writefull 0~582] v36'26 uv26 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:29.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.917+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 1.00000000 2024-09-13T18:28:29.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.917+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:43 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3400 con 0x561fe9185c00 2024-09-13T18:28:29.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.917+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 19 ==== osd_op_reply(43 1.00000000 [omap-get-header out=274b] v0'0 uv12 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.917+0000 7f21d4dc1500 4 recover_dentries: frag 1.00000000 fnode old v9 vs new v10 2024-09-13T18:28:29.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.917+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:29.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.917+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:44 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2000 con 0x561fe9185c00 2024-09-13T18:28:29.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.921+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 20 ==== osd_op_reply(44 1.00000000 [omap-set-header] v36'13 uv13 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.921+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:45 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2400 con 0x561fe9185c00 2024-09-13T18:28:29.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.921+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 21 ==== osd_op_reply(45 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv13 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.921+0000 7f21d4dc1500 4 recover_dentries: updating root 0x1 2024-09-13T18:28:29.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.921+0000 7f21d4dc1500 4 recover_dentries: object id 1.00000000.inode 2024-09-13T18:28:29.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.921+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:46 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3000 con 0x561fe9ca9c00 2024-09-13T18:28:29.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.925+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 11 ==== osd_op_reply(46 1.00000000.inode [read 0~582 out=582b] v0'0 uv26 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:29.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.925+0000 7f21d4dc1500 4 recover_dentries: root exists, will modify (582) 2024-09-13T18:28:29.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.925+0000 7f21d4dc1500 4 recover_dentries: magic ok 2024-09-13T18:28:29.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.925+0000 7f21d4dc1500 4 recover_dentries: writing root ino 1.00000000.inode version 6 2024-09-13T18:28:29.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.925+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:47 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9ca9800 con 0x561fe9ca9c00 2024-09-13T18:28:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.925+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 12 ==== osd_op_reply(47 1.00000000.inode [writefull 0~582] v36'27 uv27 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.925+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 1.00000000 2024-09-13T18:28:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.925+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:48 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3800 con 0x561fe9185c00 2024-09-13T18:28:29.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.925+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 22 ==== osd_op_reply(48 1.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.925+0000 7f21d4dc1500 4 recover_dentries: frag 1.00000000 fnode old v10 vs new v12 2024-09-13T18:28:29.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.925+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:29.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.925+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:49 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3c00 con 0x561fe9185c00 2024-09-13T18:28:29.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.929+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 23 ==== osd_op_reply(49 1.00000000 [omap-set-header] v36'14 uv14 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.929+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:50 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3000 con 0x561fe9185c00 2024-09-13T18:28:29.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.929+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 24 ==== osd_op_reply(50 1.00000000 [omap-get-vals-by-keys out=524b] v0'0 uv14 ondisk = 0) v8 ==== 154+0+524 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.929+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-13T18:28:29.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.929+0000 7f21d4dc1500 4 recover_dentries: dentry linkdir_head existed already 2024-09-13T18:28:29.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.929+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:29.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.929+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 8 vs fullbit version 11 2024-09-13T18:28:29.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.929+0000 7f21d4dc1500 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-13T18:28:29.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.929+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:29.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.929+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:51 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=524b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9184c00 con 0x561fe9185c00 2024-09-13T18:28:29.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.933+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 25 ==== osd_op_reply(51 1.00000000 [omap-set-vals] v36'15 uv15 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.933+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-13T18:28:29.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.933+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:52 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185000 con 0x561fe9184400 2024-09-13T18:28:29.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.933+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 4 ==== osd_op_reply(52 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:29.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.933+0000 7f21d4dc1500 4 recover_dentries: frag 100000001f7.00000000 fnode old v1 vs new v3 2024-09-13T18:28:29.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.933+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:29.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.933+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:53 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185800 con 0x561fe9184400 2024-09-13T18:28:29.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.937+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 5 ==== osd_op_reply(53 100000001f7.00000000 [omap-set-header] v36'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:29.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.937+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:54 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9184c00 con 0x561fe9184400 2024-09-13T18:28:29.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.937+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 6 ==== osd_op_reply(54 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:29.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.937+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 100000001f7.00000000/link0 2024-09-13T18:28:29.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.937+0000 7f21d4dc1500 4 recover_dentries: dentry did not already exist, will create 2024-09-13T18:28:29.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.937+0000 7f21d4dc1500 4 recover_dentries: writing i dentry link0_head into frag 100000001f7.00000000 2024-09-13T18:28:29.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.937+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:29.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.937+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:55 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=560b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2800 con 0x561fe9184400 2024-09-13T18:28:29.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.941+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 7 ==== osd_op_reply(55 100000001f7.00000000 [omap-set-vals] v36'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:29.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.941+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 1.00000000 2024-09-13T18:28:29.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.941+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:56 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3400 con 0x561fe9185c00 2024-09-13T18:28:29.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.941+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 26 ==== osd_op_reply(56 1.00000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.941+0000 7f21d4dc1500 4 recover_dentries: frag 1.00000000 fnode old v12 vs new v14 2024-09-13T18:28:29.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.941+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:29.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.941+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:57 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2000 con 0x561fe9185c00 2024-09-13T18:28:29.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.945+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 27 ==== osd_op_reply(57 1.00000000 [omap-set-header] v36'16 uv16 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.945+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:58 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2400 con 0x561fe9185c00 2024-09-13T18:28:29.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.945+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 28 ==== osd_op_reply(58 1.00000000 [omap-get-vals-by-keys out=524b] v0'0 uv16 ondisk = 0) v8 ==== 154+0+524 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.945+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-13T18:28:29.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.945+0000 7f21d4dc1500 4 recover_dentries: dentry linkdir_head existed already 2024-09-13T18:28:29.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.945+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:29.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.945+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 11 vs fullbit version 13 2024-09-13T18:28:29.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.945+0000 7f21d4dc1500 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-13T18:28:29.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.945+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:29.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.945+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:59 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=524b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3800 con 0x561fe9185c00 2024-09-13T18:28:29.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.949+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 29 ==== osd_op_reply(59 1.00000000 [omap-set-vals] v36'17 uv17 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.949+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 100.00000000 2024-09-13T18:28:29.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.949+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:60 4.13 4:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3c00 con 0x561fe9185400 2024-09-13T18:28:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.949+0000 7f21d357b700 1 -- 172.21.15.44:0/3955014589 <== osd.4 v2:172.21.15.99:6816/2515272044 4 ==== osd_op_reply(60 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x561fe929c000 con 0x561fe9185400 2024-09-13T18:28:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.949+0000 7f21d4dc1500 4 recover_dentries: frag 100.00000000 fnode old v1 vs new v3 2024-09-13T18:28:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.949+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.949+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:61 4.13 4:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3000 con 0x561fe9185400 2024-09-13T18:28:29.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.953+0000 7f21d357b700 1 -- 172.21.15.44:0/3955014589 <== osd.4 v2:172.21.15.99:6816/2515272044 5 ==== osd_op_reply(61 100.00000000 [omap-set-header] v36'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x561fe929c000 con 0x561fe9185400 2024-09-13T18:28:29.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.953+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:62 4.13 4:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2c00 con 0x561fe9185400 2024-09-13T18:28:29.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.953+0000 7f21d357b700 1 -- 172.21.15.44:0/3955014589 <== osd.4 v2:172.21.15.99:6816/2515272044 6 ==== osd_op_reply(62 100.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+523 (crc 0 0 0) 0x561fe929c000 con 0x561fe9185400 2024-09-13T18:28:29.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.953+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 100.00000000/stray1 2024-09-13T18:28:29.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.953+0000 7f21d4dc1500 4 recover_dentries: dentry stray1_head existed already 2024-09-13T18:28:29.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.953+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:29.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.953+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 1 vs fullbit version 2 2024-09-13T18:28:29.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.953+0000 7f21d4dc1500 4 recover_dentries: writing i dentry stray1_head into frag 100.00000000 2024-09-13T18:28:29.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.953+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:29.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.953+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:63 4.13 4:cd5a64a3:::100.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3c00 con 0x561fe9185400 2024-09-13T18:28:29.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.957+0000 7f21d357b700 1 -- 172.21.15.44:0/3955014589 <== osd.4 v2:172.21.15.99:6816/2515272044 7 ==== osd_op_reply(63 100.00000000 [omap-set-vals] v36'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x561fe929c000 con 0x561fe9185400 2024-09-13T18:28:29.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.957+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 601.00000000 2024-09-13T18:28:29.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.957+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:64 4.10 4:09401a81:::601.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3000 con 0x561fe9ca9c00 2024-09-13T18:28:29.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.957+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 13 ==== osd_op_reply(64 601.00000000 [omap-get-header out=274b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:29.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.957+0000 7f21d4dc1500 4 recover_dentries: frag 601.00000000 fnode old v1 vs new v4 2024-09-13T18:28:29.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.957+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:29.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.957+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:65 4.10 4:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92c6000 con 0x561fe9ca9c00 2024-09-13T18:28:29.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.961+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 14 ==== osd_op_reply(65 601.00000000 [omap-set-header] v36'9 uv9 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:29.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.961+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:66 4.10 4:09401a81:::601.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92c6400 con 0x561fe9ca9c00 2024-09-13T18:28:29.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.961+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 15 ==== osd_op_reply(66 601.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv9 ondisk = 0) v8 ==== 156+0+4 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:29.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.961+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 601.00000000/100000001f8 2024-09-13T18:28:29.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.961+0000 7f21d4dc1500 4 recover_dentries: dentry did not already exist, will create 2024-09-13T18:28:29.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.961+0000 7f21d4dc1500 4 recover_dentries: writing i dentry 100000001f8_head into frag 601.00000000 2024-09-13T18:28:29.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.961+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:29.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.961+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:67 4.10 4:09401a81:::601.00000000:head [omap-set-vals in=580b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92c6800 con 0x561fe9ca9c00 2024-09-13T18:28:29.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.965+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 16 ==== osd_op_reply(67 601.00000000 [omap-set-vals] v36'10 uv10 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:29.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.965+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-13T18:28:29.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.965+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:68 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92c6c00 con 0x561fe9184400 2024-09-13T18:28:29.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.965+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 8 ==== osd_op_reply(68 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:29.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.965+0000 7f21d4dc1500 4 recover_dentries: frag 100000001f7.00000000 fnode old v3 vs new v5 2024-09-13T18:28:29.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.965+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:29.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.965+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:69 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92c7000 con 0x561fe9184400 2024-09-13T18:28:29.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.969+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 9 ==== osd_op_reply(69 100000001f7.00000000 [omap-set-header] v36'4 uv4 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:29.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.969+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:70 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92c7400 con 0x561fe9184400 2024-09-13T18:28:29.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.969+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 10 ==== osd_op_reply(70 100000001f7.00000000 [omap-get-vals-by-keys out=560b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+560 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:29.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.969+0000 7f21d4dc1500 4 recover_dentries: inspecting nullbit 100000001f7.00000000/link0 2024-09-13T18:28:29.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.969+0000 7f21d4dc1500 4 recover_dentries: dentry exists, will remove 2024-09-13T18:28:29.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.969+0000 7f21d4dc1500 10 recover_dentries: Existing full inode in slot to be (maybe) removed by null journal dn 'link0' with lump fnode version 5vs existing fnode version 3 2024-09-13T18:28:29.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.969+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:71 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92c7800 con 0x561fe9184400 2024-09-13T18:28:29.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.969+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 11 ==== osd_op_reply(71 100000001f7.00000000 [omap-rm-keys] v36'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:29.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.969+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 100.00000000 2024-09-13T18:28:29.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.969+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:72 4.13 4:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92c7c00 con 0x561fe9185400 2024-09-13T18:28:29.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.973+0000 7f21d357b700 1 -- 172.21.15.44:0/3955014589 <== osd.4 v2:172.21.15.99:6816/2515272044 8 ==== osd_op_reply(72 100.00000000 [omap-get-header out=274b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x561fe929c000 con 0x561fe9185400 2024-09-13T18:28:29.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.973+0000 7f21d4dc1500 4 recover_dentries: frag 100.00000000 fnode old v3 vs new v5 2024-09-13T18:28:29.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.973+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:29.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.973+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:73 4.13 4:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92c6000 con 0x561fe9185400 2024-09-13T18:28:29.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.973+0000 7f21d357b700 1 -- 172.21.15.44:0/3955014589 <== osd.4 v2:172.21.15.99:6816/2515272044 9 ==== osd_op_reply(73 100.00000000 [omap-set-header] v36'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x561fe929c000 con 0x561fe9185400 2024-09-13T18:28:29.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.973+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:74 4.13 4:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2800 con 0x561fe9185400 2024-09-13T18:28:29.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.973+0000 7f21d357b700 1 -- 172.21.15.44:0/3955014589 <== osd.4 v2:172.21.15.99:6816/2515272044 10 ==== osd_op_reply(74 100.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+523 (crc 0 0 0) 0x561fe929c000 con 0x561fe9185400 2024-09-13T18:28:29.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.977+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 100.00000000/stray1 2024-09-13T18:28:29.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.977+0000 7f21d4dc1500 4 recover_dentries: dentry stray1_head existed already 2024-09-13T18:28:29.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.977+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:29.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.977+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 4 2024-09-13T18:28:29.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.977+0000 7f21d4dc1500 4 recover_dentries: writing i dentry stray1_head into frag 100.00000000 2024-09-13T18:28:29.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.977+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:29.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.977+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:75 4.13 4:cd5a64a3:::100.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3000 con 0x561fe9185400 2024-09-13T18:28:29.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.977+0000 7f21d357b700 1 -- 172.21.15.44:0/3955014589 <== osd.4 v2:172.21.15.99:6816/2515272044 11 ==== osd_op_reply(75 100.00000000 [omap-set-vals] v36'6 uv6 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x561fe929c000 con 0x561fe9185400 2024-09-13T18:28:29.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.977+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 601.00000000 2024-09-13T18:28:29.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.977+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:76 4.10 4:09401a81:::601.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185000 con 0x561fe9ca9c00 2024-09-13T18:28:29.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.977+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 17 ==== osd_op_reply(76 601.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:29.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.977+0000 7f21d4dc1500 4 recover_dentries: frag 601.00000000 fnode old v4 vs new v6 2024-09-13T18:28:29.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.977+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:29.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.977+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:77 4.10 4:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185800 con 0x561fe9ca9c00 2024-09-13T18:28:29.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.981+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 18 ==== osd_op_reply(77 601.00000000 [omap-set-header] v36'11 uv11 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:29.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.981+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:78 4.10 4:09401a81:::601.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9184c00 con 0x561fe9ca9c00 2024-09-13T18:28:29.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.981+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 19 ==== osd_op_reply(78 601.00000000 [omap-get-vals-by-keys out=580b] v0'0 uv11 ondisk = 0) v8 ==== 156+0+580 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:29.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.981+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 601.00000000/100000001f8 2024-09-13T18:28:29.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.981+0000 7f21d4dc1500 4 recover_dentries: dentry 100000001f8_head existed already 2024-09-13T18:28:29.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.981+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:29.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.981+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 3 vs fullbit version 5 2024-09-13T18:28:29.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.981+0000 7f21d4dc1500 4 recover_dentries: writing i dentry 100000001f8_head into frag 601.00000000 2024-09-13T18:28:29.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.981+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:29.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.981+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:79 4.10 4:09401a81:::601.00000000:head [omap-set-vals in=542b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9ca9800 con 0x561fe9ca9c00 2024-09-13T18:28:29.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.985+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 20 ==== osd_op_reply(79 601.00000000 [omap-set-vals] v36'12 uv12 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:29.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.985+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 1.00000000 2024-09-13T18:28:29.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.985+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:80 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2c00 con 0x561fe9185c00 2024-09-13T18:28:29.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.985+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 30 ==== osd_op_reply(80 1.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.985+0000 7f21d4dc1500 4 recover_dentries: frag 1.00000000 fnode old v14 vs new v16 2024-09-13T18:28:29.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.985+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:29.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.985+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:81 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3c00 con 0x561fe9185c00 2024-09-13T18:28:29.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.989+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 31 ==== osd_op_reply(81 1.00000000 [omap-set-header] v36'18 uv18 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.989+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:82 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185000 con 0x561fe9185c00 2024-09-13T18:28:29.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.989+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 32 ==== osd_op_reply(82 1.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv18 ondisk = 0) v8 ==== 154+0+523 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.989+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-09-13T18:28:29.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.989+0000 7f21d4dc1500 4 recover_dentries: dentry subdir_head existed already 2024-09-13T18:28:29.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.989+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:29.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.989+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 6 vs fullbit version 15 2024-09-13T18:28:29.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.989+0000 7f21d4dc1500 4 recover_dentries: writing i dentry subdir_head into frag 1.00000000 2024-09-13T18:28:29.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.989+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:29.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.989+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:83 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185800 con 0x561fe9185c00 2024-09-13T18:28:29.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.993+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 33 ==== osd_op_reply(83 1.00000000 [omap-set-vals] v36'19 uv19 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:29.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.993+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 10000000001.00000000 2024-09-13T18:28:29.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.993+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:84 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0000 con 0x561fe9ca9400 2024-09-13T18:28:30.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.993+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 9 ==== osd_op_reply(84 10000000001.00000000 [omap-get-header out=274b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.993+0000 7f21d4dc1500 4 recover_dentries: frag 10000000001.00000000 fnode old v3 vs new v5 2024-09-13T18:28:30.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.993+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.993+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:85 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0400 con 0x561fe9ca9400 2024-09-13T18:28:30.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.997+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 10 ==== osd_op_reply(85 10000000001.00000000 [omap-set-header] v36'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.997+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:86 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0800 con 0x561fe9ca9400 2024-09-13T18:28:30.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.997+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 11 ==== osd_op_reply(86 10000000001.00000000 [omap-get-vals-by-keys out=565b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+565 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.997+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-09-13T18:28:30.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.997+0000 7f21d4dc1500 4 recover_dentries: dentry subdirfile_head existed already 2024-09-13T18:28:30.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.997+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.997+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 4 2024-09-13T18:28:30.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.997+0000 7f21d4dc1500 4 recover_dentries: writing i dentry subdirfile_head into frag 10000000001.00000000 2024-09-13T18:28:30.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.997+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:29.997+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:87 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=527b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0c00 con 0x561fe9ca9400 2024-09-13T18:28:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.001+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 12 ==== osd_op_reply(87 10000000001.00000000 [omap-set-vals] v36'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.001+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 1.00000000 2024-09-13T18:28:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.001+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:88 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1000 con 0x561fe9185c00 2024-09-13T18:28:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.001+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 34 ==== osd_op_reply(88 1.00000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.001+0000 7f21d4dc1500 4 recover_dentries: frag 1.00000000 fnode old v16 vs new v20 2024-09-13T18:28:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.001+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.001+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:89 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1400 con 0x561fe9185c00 2024-09-13T18:28:30.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.005+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 35 ==== osd_op_reply(89 1.00000000 [omap-set-header] v36'20 uv20 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.005+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:90 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1800 con 0x561fe9185c00 2024-09-13T18:28:30.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.005+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 36 ==== osd_op_reply(90 1.00000000 [omap-get-vals-by-keys out=1043b] v0'0 uv20 ondisk = 0) v8 ==== 154+0+1043 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.005+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-13T18:28:30.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.005+0000 7f21d4dc1500 4 recover_dentries: dentry linkdir_head existed already 2024-09-13T18:28:30.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.005+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.005+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 13 vs fullbit version 17 2024-09-13T18:28:30.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.005+0000 7f21d4dc1500 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-13T18:28:30.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.005+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.005+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-09-13T18:28:30.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.005+0000 7f21d4dc1500 4 recover_dentries: dentry subdir_head existed already 2024-09-13T18:28:30.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.005+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.005+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 15 vs fullbit version 19 2024-09-13T18:28:30.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.005+0000 7f21d4dc1500 4 recover_dentries: writing i dentry subdir_head into frag 1.00000000 2024-09-13T18:28:30.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.005+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.005+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:91 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=1043b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1c00 con 0x561fe9185c00 2024-09-13T18:28:30.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.009+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 37 ==== osd_op_reply(91 1.00000000 [omap-set-vals] v36'21 uv21 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.009+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-13T18:28:30.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.009+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:92 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0000 con 0x561fe9184400 2024-09-13T18:28:30.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.009+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 12 ==== osd_op_reply(92 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.009+0000 7f21d4dc1500 4 recover_dentries: frag 100000001f7.00000000 fnode old v5 vs new v7 2024-09-13T18:28:30.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.009+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.009+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:93 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185000 con 0x561fe9184400 2024-09-13T18:28:30.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.013+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 13 ==== osd_op_reply(93 100000001f7.00000000 [omap-set-header] v36'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.013+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:94 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185800 con 0x561fe9184400 2024-09-13T18:28:30.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.013+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 14 ==== osd_op_reply(94 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.013+0000 7f21d4dc1500 4 recover_dentries: inspecting remotebit 100000001f7.00000000/link0 2024-09-13T18:28:30.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.013+0000 7f21d4dc1500 4 recover_dentries: dentry did not already exist, will create 2024-09-13T18:28:30.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.013+0000 7f21d4dc1500 4 recover_dentries: writing L dentry link0_head into frag 100000001f7.00000000 2024-09-13T18:28:30.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.013+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:95 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3400 con 0x561fe9184400 2024-09-13T18:28:30.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.013+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 15 ==== osd_op_reply(95 100000001f7.00000000 [omap-set-vals] v36'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.013+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 10000000001.00000000 2024-09-13T18:28:30.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.013+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:96 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2000 con 0x561fe9ca9400 2024-09-13T18:28:30.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.017+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 13 ==== osd_op_reply(96 10000000001.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.017+0000 7f21d4dc1500 4 recover_dentries: frag 10000000001.00000000 fnode old v5 vs new v7 2024-09-13T18:28:30.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.017+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.017+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:97 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2400 con 0x561fe9ca9400 2024-09-13T18:28:30.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.017+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 14 ==== osd_op_reply(97 10000000001.00000000 [omap-set-header] v36'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.017+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:98 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3800 con 0x561fe9ca9400 2024-09-13T18:28:30.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.017+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 15 ==== osd_op_reply(98 10000000001.00000000 [omap-get-vals-by-keys out=527b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+527 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.017+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-09-13T18:28:30.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.017+0000 7f21d4dc1500 4 recover_dentries: dentry subdirfile_head existed already 2024-09-13T18:28:30.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.017+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.017+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 4 vs fullbit version 6 2024-09-13T18:28:30.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.017+0000 7f21d4dc1500 4 recover_dentries: writing i dentry subdirfile_head into frag 10000000001.00000000 2024-09-13T18:28:30.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.017+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.017+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:99 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=605b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2c00 con 0x561fe9ca9400 2024-09-13T18:28:30.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.021+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 16 ==== osd_op_reply(99 10000000001.00000000 [omap-set-vals] v36'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.021+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 1.00000000 2024-09-13T18:28:30.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.021+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:100 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3c00 con 0x561fe9185c00 2024-09-13T18:28:30.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.021+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 38 ==== osd_op_reply(100 1.00000000 [omap-get-header out=274b] v0'0 uv21 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.021+0000 7f21d4dc1500 4 recover_dentries: frag 1.00000000 fnode old v20 vs new v24 2024-09-13T18:28:30.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.021+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.021+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:101 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2000 con 0x561fe9185c00 2024-09-13T18:28:30.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.025+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 39 ==== osd_op_reply(101 1.00000000 [omap-set-header] v36'22 uv22 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.025+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:102 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2400 con 0x561fe9185c00 2024-09-13T18:28:30.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.025+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 40 ==== osd_op_reply(102 1.00000000 [omap-get-vals-by-keys out=1043b] v0'0 uv22 ondisk = 0) v8 ==== 154+0+1043 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.025+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-13T18:28:30.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.025+0000 7f21d4dc1500 4 recover_dentries: dentry linkdir_head existed already 2024-09-13T18:28:30.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.025+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.025+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 17 vs fullbit version 21 2024-09-13T18:28:30.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.025+0000 7f21d4dc1500 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-13T18:28:30.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.025+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.025+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-09-13T18:28:30.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.025+0000 7f21d4dc1500 4 recover_dentries: dentry subdir_head existed already 2024-09-13T18:28:30.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.025+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.025+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 19 vs fullbit version 23 2024-09-13T18:28:30.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.025+0000 7f21d4dc1500 4 recover_dentries: writing i dentry subdir_head into frag 1.00000000 2024-09-13T18:28:30.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.025+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.025+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:103 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=1043b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3800 con 0x561fe9185c00 2024-09-13T18:28:30.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.029+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 41 ==== osd_op_reply(103 1.00000000 [omap-set-vals] v36'23 uv23 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.029+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-13T18:28:30.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.029+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:104 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0400 con 0x561fe9184400 2024-09-13T18:28:30.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.029+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 16 ==== osd_op_reply(104 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.029+0000 7f21d4dc1500 4 recover_dentries: frag 100000001f7.00000000 fnode old v7 vs new v9 2024-09-13T18:28:30.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.029+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.029+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:105 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0800 con 0x561fe9184400 2024-09-13T18:28:30.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.033+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 17 ==== osd_op_reply(105 100000001f7.00000000 [omap-set-header] v36'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.033+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:106 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0c00 con 0x561fe9184400 2024-09-13T18:28:30.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.033+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 18 ==== osd_op_reply(106 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.033+0000 7f21d4dc1500 4 recover_dentries: inspecting remotebit 100000001f7.00000000/link1 2024-09-13T18:28:30.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.033+0000 7f21d4dc1500 4 recover_dentries: dentry did not already exist, will create 2024-09-13T18:28:30.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.033+0000 7f21d4dc1500 4 recover_dentries: writing L dentry link1_head into frag 100000001f7.00000000 2024-09-13T18:28:30.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.033+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:107 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1000 con 0x561fe9184400 2024-09-13T18:28:30.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.033+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 19 ==== osd_op_reply(107 100000001f7.00000000 [omap-set-vals] v36'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.033+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 10000000001.00000000 2024-09-13T18:28:30.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.033+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:108 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1400 con 0x561fe9ca9400 2024-09-13T18:28:30.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.033+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 17 ==== osd_op_reply(108 10000000001.00000000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.033+0000 7f21d4dc1500 4 recover_dentries: frag 10000000001.00000000 fnode old v7 vs new v9 2024-09-13T18:28:30.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.033+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.033+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:109 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1800 con 0x561fe9ca9400 2024-09-13T18:28:30.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.037+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 18 ==== osd_op_reply(109 10000000001.00000000 [omap-set-header] v36'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.037+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:110 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1c00 con 0x561fe9ca9400 2024-09-13T18:28:30.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.037+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 19 ==== osd_op_reply(110 10000000001.00000000 [omap-get-vals-by-keys out=605b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+605 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.037+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-09-13T18:28:30.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.037+0000 7f21d4dc1500 4 recover_dentries: dentry subdirfile_head existed already 2024-09-13T18:28:30.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.037+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.037+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 6 vs fullbit version 8 2024-09-13T18:28:30.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.037+0000 7f21d4dc1500 4 recover_dentries: writing i dentry subdirfile_head into frag 10000000001.00000000 2024-09-13T18:28:30.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.037+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.037+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:111 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=605b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0000 con 0x561fe9ca9400 2024-09-13T18:28:30.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.041+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 20 ==== osd_op_reply(111 10000000001.00000000 [omap-set-vals] v36'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.041+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 1.00000000 2024-09-13T18:28:30.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.041+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:112 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0400 con 0x561fe9185c00 2024-09-13T18:28:30.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.041+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 42 ==== osd_op_reply(112 1.00000000 [omap-get-header out=274b] v0'0 uv23 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.041+0000 7f21d4dc1500 4 recover_dentries: frag 1.00000000 fnode old v24 vs new v28 2024-09-13T18:28:30.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.041+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.041+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:113 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0800 con 0x561fe9185c00 2024-09-13T18:28:30.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.045+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 43 ==== osd_op_reply(113 1.00000000 [omap-set-header] v36'24 uv24 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.045+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:114 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0c00 con 0x561fe9185c00 2024-09-13T18:28:30.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.045+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 44 ==== osd_op_reply(114 1.00000000 [omap-get-vals-by-keys out=1043b] v0'0 uv24 ondisk = 0) v8 ==== 154+0+1043 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.045+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-13T18:28:30.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.045+0000 7f21d4dc1500 4 recover_dentries: dentry linkdir_head existed already 2024-09-13T18:28:30.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.045+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.045+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 21 vs fullbit version 25 2024-09-13T18:28:30.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.045+0000 7f21d4dc1500 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-13T18:28:30.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.045+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.045+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-09-13T18:28:30.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.045+0000 7f21d4dc1500 4 recover_dentries: dentry subdir_head existed already 2024-09-13T18:28:30.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.045+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.045+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 23 vs fullbit version 27 2024-09-13T18:28:30.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.045+0000 7f21d4dc1500 4 recover_dentries: writing i dentry subdir_head into frag 1.00000000 2024-09-13T18:28:30.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.045+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.045+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:115 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=1043b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3400 con 0x561fe9185c00 2024-09-13T18:28:30.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.049+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 45 ==== osd_op_reply(115 1.00000000 [omap-set-vals] v36'25 uv25 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.049+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-13T18:28:30.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.049+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:116 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9184c00 con 0x561fe9184400 2024-09-13T18:28:30.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.049+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 20 ==== osd_op_reply(116 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.049+0000 7f21d4dc1500 4 recover_dentries: frag 100000001f7.00000000 fnode old v9 vs new v11 2024-09-13T18:28:30.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.049+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.049+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:117 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185000 con 0x561fe9184400 2024-09-13T18:28:30.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.053+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 21 ==== osd_op_reply(117 100000001f7.00000000 [omap-set-header] v36'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.053+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:118 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185800 con 0x561fe9184400 2024-09-13T18:28:30.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.053+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 22 ==== osd_op_reply(118 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.053+0000 7f21d4dc1500 4 recover_dentries: inspecting remotebit 100000001f7.00000000/link2 2024-09-13T18:28:30.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.053+0000 7f21d4dc1500 4 recover_dentries: dentry did not already exist, will create 2024-09-13T18:28:30.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.053+0000 7f21d4dc1500 4 recover_dentries: writing L dentry link2_head into frag 100000001f7.00000000 2024-09-13T18:28:30.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.053+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:119 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9ca9800 con 0x561fe9184400 2024-09-13T18:28:30.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.057+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 23 ==== osd_op_reply(119 100000001f7.00000000 [omap-set-vals] v36'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.057+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 10000000001.00000000 2024-09-13T18:28:30.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.057+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:120 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1400 con 0x561fe9ca9400 2024-09-13T18:28:30.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.057+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 21 ==== osd_op_reply(120 10000000001.00000000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.057+0000 7f21d4dc1500 4 recover_dentries: frag 10000000001.00000000 fnode old v9 vs new v11 2024-09-13T18:28:30.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.057+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.057+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:121 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1800 con 0x561fe9ca9400 2024-09-13T18:28:30.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.061+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 22 ==== osd_op_reply(121 10000000001.00000000 [omap-set-header] v36'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.061+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:122 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1c00 con 0x561fe9ca9400 2024-09-13T18:28:30.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.061+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 23 ==== osd_op_reply(122 10000000001.00000000 [omap-get-vals-by-keys out=605b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+605 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.061+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-09-13T18:28:30.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.061+0000 7f21d4dc1500 4 recover_dentries: dentry subdirfile_head existed already 2024-09-13T18:28:30.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.061+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.061+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 8 vs fullbit version 10 2024-09-13T18:28:30.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.061+0000 7f21d4dc1500 4 recover_dentries: writing i dentry subdirfile_head into frag 10000000001.00000000 2024-09-13T18:28:30.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.061+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.061+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:123 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=605b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0000 con 0x561fe9ca9400 2024-09-13T18:28:30.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.065+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 24 ==== osd_op_reply(123 10000000001.00000000 [omap-set-vals] v36'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.065+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 1.00000000 2024-09-13T18:28:30.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.065+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:124 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0400 con 0x561fe9185c00 2024-09-13T18:28:30.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.065+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 46 ==== osd_op_reply(124 1.00000000 [omap-get-header out=274b] v0'0 uv25 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.065+0000 7f21d4dc1500 4 recover_dentries: frag 1.00000000 fnode old v28 vs new v32 2024-09-13T18:28:30.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.065+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.065+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:125 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0800 con 0x561fe9185c00 2024-09-13T18:28:30.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.069+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 47 ==== osd_op_reply(125 1.00000000 [omap-set-header] v36'26 uv26 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.069+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:126 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2c00 con 0x561fe9185c00 2024-09-13T18:28:30.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.069+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 48 ==== osd_op_reply(126 1.00000000 [omap-get-vals-by-keys out=1043b] v0'0 uv26 ondisk = 0) v8 ==== 154+0+1043 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.069+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-13T18:28:30.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.069+0000 7f21d4dc1500 4 recover_dentries: dentry linkdir_head existed already 2024-09-13T18:28:30.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.069+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.069+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 25 vs fullbit version 29 2024-09-13T18:28:30.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.069+0000 7f21d4dc1500 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-13T18:28:30.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.069+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.069+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-09-13T18:28:30.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.069+0000 7f21d4dc1500 4 recover_dentries: dentry subdir_head existed already 2024-09-13T18:28:30.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.069+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.069+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 27 vs fullbit version 31 2024-09-13T18:28:30.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.069+0000 7f21d4dc1500 4 recover_dentries: writing i dentry subdir_head into frag 1.00000000 2024-09-13T18:28:30.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.069+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.069+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:127 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=1043b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3c00 con 0x561fe9185c00 2024-09-13T18:28:30.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.073+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 49 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v36'27 uv27 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.073+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 10000000001.00000000 2024-09-13T18:28:30.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.073+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:128 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2000 con 0x561fe9ca9400 2024-09-13T18:28:30.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.073+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 25 ==== osd_op_reply(128 10000000001.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.073+0000 7f21d4dc1500 4 recover_dentries: frag 10000000001.00000000 fnode old v11 vs new v13 2024-09-13T18:28:30.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.073+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.073+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:129 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2400 con 0x561fe9ca9400 2024-09-13T18:28:30.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.073+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 26 ==== osd_op_reply(129 10000000001.00000000 [omap-set-header] v36'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.073+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:130 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3800 con 0x561fe9ca9400 2024-09-13T18:28:30.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.073+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 27 ==== osd_op_reply(130 10000000001.00000000 [omap-get-vals-by-keys out=605b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+605 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.077+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-09-13T18:28:30.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.077+0000 7f21d4dc1500 4 recover_dentries: dentry subdirfile_head existed already 2024-09-13T18:28:30.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.077+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.077+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 10 vs fullbit version 12 2024-09-13T18:28:30.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.077+0000 7f21d4dc1500 4 recover_dentries: writing i dentry subdirfile_head into frag 10000000001.00000000 2024-09-13T18:28:30.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.077+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.077+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:131 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=619b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3400 con 0x561fe9ca9400 2024-09-13T18:28:30.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.077+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 28 ==== osd_op_reply(131 10000000001.00000000 [omap-set-vals] v36'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.077+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-13T18:28:30.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.077+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:132 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2c00 con 0x561fe9184400 2024-09-13T18:28:30.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.077+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 24 ==== osd_op_reply(132 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.077+0000 7f21d4dc1500 4 recover_dentries: frag 100000001f7.00000000 fnode old v11 vs new v13 2024-09-13T18:28:30.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.077+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.077+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:133 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3c00 con 0x561fe9184400 2024-09-13T18:28:30.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.081+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 25 ==== osd_op_reply(133 100000001f7.00000000 [omap-set-header] v36'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.081+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:134 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2000 con 0x561fe9184400 2024-09-13T18:28:30.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.081+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 26 ==== osd_op_reply(134 100000001f7.00000000 [omap-get-vals-by-keys out=50b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+50 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.081+0000 7f21d4dc1500 4 recover_dentries: inspecting nullbit 100000001f7.00000000/link2 2024-09-13T18:28:30.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.081+0000 7f21d4dc1500 4 recover_dentries: dentry exists, will remove 2024-09-13T18:28:30.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.081+0000 7f21d4dc1500 10 recover_dentries: Existing hardlink inode in slot to be (maybe) removed by null journal dn 'link2' with lump fnode version 13vs existing fnode version 11 2024-09-13T18:28:30.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.081+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:135 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2400 con 0x561fe9184400 2024-09-13T18:28:30.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.085+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 27 ==== osd_op_reply(135 100000001f7.00000000 [omap-rm-keys] v36'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.085+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 1.00000000 2024-09-13T18:28:30.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.085+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:136 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0c00 con 0x561fe9185c00 2024-09-13T18:28:30.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.085+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 50 ==== osd_op_reply(136 1.00000000 [omap-get-header out=274b] v0'0 uv27 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.085+0000 7f21d4dc1500 4 recover_dentries: frag 1.00000000 fnode old v32 vs new v34 2024-09-13T18:28:30.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.085+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.085+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:137 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1400 con 0x561fe9185c00 2024-09-13T18:28:30.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.089+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 51 ==== osd_op_reply(137 1.00000000 [omap-set-header] v36'28 uv28 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.089+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:138 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1800 con 0x561fe9185c00 2024-09-13T18:28:30.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.089+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 52 ==== osd_op_reply(138 1.00000000 [omap-get-vals-by-keys out=524b] v0'0 uv28 ondisk = 0) v8 ==== 154+0+524 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.089+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-13T18:28:30.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.089+0000 7f21d4dc1500 4 recover_dentries: dentry linkdir_head existed already 2024-09-13T18:28:30.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.089+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.089+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 29 vs fullbit version 33 2024-09-13T18:28:30.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.089+0000 7f21d4dc1500 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-13T18:28:30.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.089+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.089+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:139 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=524b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1c00 con 0x561fe9185c00 2024-09-13T18:28:30.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.093+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 53 ==== osd_op_reply(139 1.00000000 [omap-set-vals] v36'29 uv29 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.093+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-13T18:28:30.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.093+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:140 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0000 con 0x561fe9184400 2024-09-13T18:28:30.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.093+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 28 ==== osd_op_reply(140 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.093+0000 7f21d4dc1500 4 recover_dentries: frag 100000001f7.00000000 fnode old v13 vs new v15 2024-09-13T18:28:30.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.093+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.093+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:141 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0400 con 0x561fe9184400 2024-09-13T18:28:30.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.097+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 29 ==== osd_op_reply(141 100000001f7.00000000 [omap-set-header] v36'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.097+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:142 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0800 con 0x561fe9184400 2024-09-13T18:28:30.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.097+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 30 ==== osd_op_reply(142 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.097+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 100000001f7.00000000/link2 2024-09-13T18:28:30.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.097+0000 7f21d4dc1500 4 recover_dentries: dentry did not already exist, will create 2024-09-13T18:28:30.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.097+0000 7f21d4dc1500 4 recover_dentries: writing i dentry link2_head into frag 100000001f7.00000000 2024-09-13T18:28:30.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.097+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.097+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:143 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=560b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1000 con 0x561fe9184400 2024-09-13T18:28:30.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.101+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 31 ==== osd_op_reply(143 100000001f7.00000000 [omap-set-vals] v36'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.101+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 1.00000000 2024-09-13T18:28:30.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.101+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:144 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0000 con 0x561fe9185c00 2024-09-13T18:28:30.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.101+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 54 ==== osd_op_reply(144 1.00000000 [omap-get-header out=274b] v0'0 uv29 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.101+0000 7f21d4dc1500 4 recover_dentries: frag 1.00000000 fnode old v34 vs new v38 2024-09-13T18:28:30.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.101+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.101+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:145 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2c00 con 0x561fe9185c00 2024-09-13T18:28:30.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.105+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 55 ==== osd_op_reply(145 1.00000000 [omap-set-header] v36'30 uv30 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.105+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:146 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3c00 con 0x561fe9185c00 2024-09-13T18:28:30.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.105+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 56 ==== osd_op_reply(146 1.00000000 [omap-get-vals-by-keys out=1043b] v0'0 uv30 ondisk = 0) v8 ==== 154+0+1043 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.105+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-13T18:28:30.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.105+0000 7f21d4dc1500 4 recover_dentries: dentry linkdir_head existed already 2024-09-13T18:28:30.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.105+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.105+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 33 vs fullbit version 35 2024-09-13T18:28:30.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.105+0000 7f21d4dc1500 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-13T18:28:30.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.105+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.105+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-09-13T18:28:30.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.105+0000 7f21d4dc1500 4 recover_dentries: dentry subdir_head existed already 2024-09-13T18:28:30.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.105+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.105+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 31 vs fullbit version 37 2024-09-13T18:28:30.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.105+0000 7f21d4dc1500 4 recover_dentries: writing i dentry subdir_head into frag 1.00000000 2024-09-13T18:28:30.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.105+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.105+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:147 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=1043b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2000 con 0x561fe9185c00 2024-09-13T18:28:30.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.109+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 57 ==== osd_op_reply(147 1.00000000 [omap-set-vals] v36'31 uv31 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.109+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-13T18:28:30.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.109+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:148 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2400 con 0x561fe9184400 2024-09-13T18:28:30.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.109+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 32 ==== osd_op_reply(148 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.109+0000 7f21d4dc1500 4 recover_dentries: frag 100000001f7.00000000 fnode old v15 vs new v17 2024-09-13T18:28:30.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.109+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.109+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:149 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9ca9800 con 0x561fe9184400 2024-09-13T18:28:30.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.113+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 33 ==== osd_op_reply(149 100000001f7.00000000 [omap-set-header] v36'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.113+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:150 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9184c00 con 0x561fe9184400 2024-09-13T18:28:30.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.113+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 34 ==== osd_op_reply(150 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.113+0000 7f21d4dc1500 4 recover_dentries: inspecting remotebit 100000001f7.00000000/link3 2024-09-13T18:28:30.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.113+0000 7f21d4dc1500 4 recover_dentries: dentry did not already exist, will create 2024-09-13T18:28:30.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.113+0000 7f21d4dc1500 4 recover_dentries: writing L dentry link3_head into frag 100000001f7.00000000 2024-09-13T18:28:30.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.113+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:151 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185000 con 0x561fe9184400 2024-09-13T18:28:30.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.113+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 35 ==== osd_op_reply(151 100000001f7.00000000 [omap-set-vals] v36'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.113+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 10000000001.00000000 2024-09-13T18:28:30.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.113+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:152 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185800 con 0x561fe9ca9400 2024-09-13T18:28:30.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.117+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 29 ==== osd_op_reply(152 10000000001.00000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.117+0000 7f21d4dc1500 4 recover_dentries: frag 10000000001.00000000 fnode old v13 vs new v15 2024-09-13T18:28:30.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.117+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.117+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:153 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92fa000 con 0x561fe9ca9400 2024-09-13T18:28:30.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.117+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 30 ==== osd_op_reply(153 10000000001.00000000 [omap-set-header] v36'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.117+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:154 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92fa400 con 0x561fe9ca9400 2024-09-13T18:28:30.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.117+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 31 ==== osd_op_reply(154 10000000001.00000000 [omap-get-vals-by-keys out=619b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+619 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.117+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-09-13T18:28:30.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.121+0000 7f21d4dc1500 4 recover_dentries: dentry subdirfile_head existed already 2024-09-13T18:28:30.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.121+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.121+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 12 vs fullbit version 14 2024-09-13T18:28:30.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.121+0000 7f21d4dc1500 4 recover_dentries: writing i dentry subdirfile_head into frag 10000000001.00000000 2024-09-13T18:28:30.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.121+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.121+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:155 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=619b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92fa800 con 0x561fe9ca9400 2024-09-13T18:28:30.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.121+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 32 ==== osd_op_reply(155 10000000001.00000000 [omap-set-vals] v36'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.121+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 1.00000000 2024-09-13T18:28:30.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.121+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:156 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92fac00 con 0x561fe9185c00 2024-09-13T18:28:30.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.121+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 58 ==== osd_op_reply(156 1.00000000 [omap-get-header out=274b] v0'0 uv31 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.121+0000 7f21d4dc1500 4 recover_dentries: frag 1.00000000 fnode old v38 vs new v42 2024-09-13T18:28:30.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.121+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.121+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:157 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92fb000 con 0x561fe9185c00 2024-09-13T18:28:30.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.125+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 59 ==== osd_op_reply(157 1.00000000 [omap-set-header] v36'32 uv32 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.125+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:158 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92fb400 con 0x561fe9185c00 2024-09-13T18:28:30.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.129+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 60 ==== osd_op_reply(158 1.00000000 [omap-get-vals-by-keys out=1043b] v0'0 uv32 ondisk = 0) v8 ==== 154+0+1043 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.129+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-13T18:28:30.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.129+0000 7f21d4dc1500 4 recover_dentries: dentry linkdir_head existed already 2024-09-13T18:28:30.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.129+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.129+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 35 vs fullbit version 39 2024-09-13T18:28:30.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.129+0000 7f21d4dc1500 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-13T18:28:30.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.129+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.129+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-09-13T18:28:30.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.129+0000 7f21d4dc1500 4 recover_dentries: dentry subdir_head existed already 2024-09-13T18:28:30.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.129+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.129+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 37 vs fullbit version 41 2024-09-13T18:28:30.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.129+0000 7f21d4dc1500 4 recover_dentries: writing i dentry subdir_head into frag 1.00000000 2024-09-13T18:28:30.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.129+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.129+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:159 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=1043b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92fb800 con 0x561fe9185c00 2024-09-13T18:28:30.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.129+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 61 ==== osd_op_reply(159 1.00000000 [omap-set-vals] v36'33 uv33 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.129+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 10000000001.00000000 2024-09-13T18:28:30.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.129+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:160 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92fbc00 con 0x561fe9ca9400 2024-09-13T18:28:30.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.129+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 33 ==== osd_op_reply(160 10000000001.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.133+0000 7f21d4dc1500 4 recover_dentries: frag 10000000001.00000000 fnode old v15 vs new v17 2024-09-13T18:28:30.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.133+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.133+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:161 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92fa000 con 0x561fe9ca9400 2024-09-13T18:28:30.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.133+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 34 ==== osd_op_reply(161 10000000001.00000000 [omap-set-header] v36'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.133+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:162 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92fa400 con 0x561fe9ca9400 2024-09-13T18:28:30.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.133+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 35 ==== osd_op_reply(162 10000000001.00000000 [omap-get-vals-by-keys out=619b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+619 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.133+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2024-09-13T18:28:30.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.133+0000 7f21d4dc1500 4 recover_dentries: dentry subdirfile_head existed already 2024-09-13T18:28:30.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.133+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.133+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 14 vs fullbit version 16 2024-09-13T18:28:30.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.133+0000 7f21d4dc1500 4 recover_dentries: writing i dentry subdirfile_head into frag 10000000001.00000000 2024-09-13T18:28:30.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.133+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.133+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:163 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=619b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185800 con 0x561fe9ca9400 2024-09-13T18:28:30.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.137+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 36 ==== osd_op_reply(163 10000000001.00000000 [omap-set-vals] v36'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.137+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-13T18:28:30.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.137+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:164 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3800 con 0x561fe9184400 2024-09-13T18:28:30.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.137+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 36 ==== osd_op_reply(164 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.137+0000 7f21d4dc1500 4 recover_dentries: frag 100000001f7.00000000 fnode old v17 vs new v19 2024-09-13T18:28:30.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.137+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.137+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:165 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3400 con 0x561fe9184400 2024-09-13T18:28:30.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.141+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 37 ==== osd_op_reply(165 100000001f7.00000000 [omap-set-header] v36'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.141+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:166 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2c00 con 0x561fe9184400 2024-09-13T18:28:30.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.141+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 38 ==== osd_op_reply(166 100000001f7.00000000 [omap-get-vals-by-keys out=50b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+50 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.141+0000 7f21d4dc1500 4 recover_dentries: inspecting nullbit 100000001f7.00000000/link3 2024-09-13T18:28:30.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.141+0000 7f21d4dc1500 4 recover_dentries: dentry exists, will remove 2024-09-13T18:28:30.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.141+0000 7f21d4dc1500 10 recover_dentries: Existing hardlink inode in slot to be (maybe) removed by null journal dn 'link3' with lump fnode version 19vs existing fnode version 17 2024-09-13T18:28:30.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.141+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:167 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3c00 con 0x561fe9184400 2024-09-13T18:28:30.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.145+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 39 ==== osd_op_reply(167 100000001f7.00000000 [omap-rm-keys] v36'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.145+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 1.00000000 2024-09-13T18:28:30.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.145+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:168 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2000 con 0x561fe9185c00 2024-09-13T18:28:30.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.145+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 62 ==== osd_op_reply(168 1.00000000 [omap-get-header out=274b] v0'0 uv33 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.145+0000 7f21d4dc1500 4 recover_dentries: frag 1.00000000 fnode old v42 vs new v44 2024-09-13T18:28:30.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.145+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.145+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:169 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0c00 con 0x561fe9185c00 2024-09-13T18:28:30.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.149+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 63 ==== osd_op_reply(169 1.00000000 [omap-set-header] v36'34 uv34 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.149+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:170 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1400 con 0x561fe9185c00 2024-09-13T18:28:30.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.149+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 64 ==== osd_op_reply(170 1.00000000 [omap-get-vals-by-keys out=563b] v0'0 uv34 ondisk = 0) v8 ==== 154+0+563 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.149+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/rootfile 2024-09-13T18:28:30.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.149+0000 7f21d4dc1500 4 recover_dentries: dentry rootfile_head existed already 2024-09-13T18:28:30.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.149+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.149+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 43 2024-09-13T18:28:30.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.149+0000 7f21d4dc1500 4 recover_dentries: writing i dentry rootfile_head into frag 1.00000000 2024-09-13T18:28:30.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.149+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.149+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:171 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=525b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1800 con 0x561fe9185c00 2024-09-13T18:28:30.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.153+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 65 ==== osd_op_reply(171 1.00000000 [omap-set-vals] v36'35 uv35 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.153+0000 7f21d4dc1500 4 recover_dentries: updating root 0x1 2024-09-13T18:28:30.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.153+0000 7f21d4dc1500 4 recover_dentries: object id 1.00000000.inode 2024-09-13T18:28:30.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.153+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:172 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1c00 con 0x561fe9ca9c00 2024-09-13T18:28:30.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.153+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 21 ==== osd_op_reply(172 1.00000000.inode [read 0~582 out=582b] v0'0 uv27 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:30.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.153+0000 7f21d4dc1500 4 recover_dentries: root exists, will modify (582) 2024-09-13T18:28:30.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.153+0000 7f21d4dc1500 4 recover_dentries: magic ok 2024-09-13T18:28:30.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.153+0000 7f21d4dc1500 4 recover_dentries: writing root ino 1.00000000.inode version 7 2024-09-13T18:28:30.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.153+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:173 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0000 con 0x561fe9ca9c00 2024-09-13T18:28:30.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.157+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 22 ==== osd_op_reply(173 1.00000000.inode [writefull 0~582] v36'28 uv28 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:30.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.157+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 1.00000000 2024-09-13T18:28:30.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.157+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:174 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2400 con 0x561fe9185c00 2024-09-13T18:28:30.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.161+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 66 ==== osd_op_reply(174 1.00000000 [omap-get-header out=274b] v0'0 uv35 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.161+0000 7f21d4dc1500 4 recover_dentries: frag 1.00000000 fnode old v44 vs new v48 2024-09-13T18:28:30.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.161+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.161+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:175 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3800 con 0x561fe9185c00 2024-09-13T18:28:30.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.165+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 67 ==== osd_op_reply(175 1.00000000 [omap-set-header] v36'36 uv36 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.165+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:176 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=37b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3400 con 0x561fe9185c00 2024-09-13T18:28:30.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.165+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 68 ==== osd_op_reply(176 1.00000000 [omap-get-vals-by-keys out=1045b] v0'0 uv36 ondisk = 0) v8 ==== 154+0+1045 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.165+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-13T18:28:30.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.165+0000 7f21d4dc1500 4 recover_dentries: dentry linkdir_head existed already 2024-09-13T18:28:30.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.165+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.165+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 39 vs fullbit version 46 2024-09-13T18:28:30.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.165+0000 7f21d4dc1500 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-13T18:28:30.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.165+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.165+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/rootfile 2024-09-13T18:28:30.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.165+0000 7f21d4dc1500 4 recover_dentries: dentry rootfile_head existed already 2024-09-13T18:28:30.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.165+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.165+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 43 vs fullbit version 45 2024-09-13T18:28:30.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.165+0000 7f21d4dc1500 4 recover_dentries: writing i dentry rootfile_head into frag 1.00000000 2024-09-13T18:28:30.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.165+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.165+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:177 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=1123b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2c00 con 0x561fe9185c00 2024-09-13T18:28:30.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.169+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 69 ==== osd_op_reply(177 1.00000000 [omap-set-vals] v36'37 uv37 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.169+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-13T18:28:30.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.169+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:178 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3c00 con 0x561fe9184400 2024-09-13T18:28:30.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.169+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 40 ==== osd_op_reply(178 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.169+0000 7f21d4dc1500 4 recover_dentries: frag 100000001f7.00000000 fnode old v19 vs new v21 2024-09-13T18:28:30.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.169+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.169+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:179 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9184c00 con 0x561fe9184400 2024-09-13T18:28:30.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.173+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 41 ==== osd_op_reply(179 100000001f7.00000000 [omap-set-header] v36'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.173+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:180 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185000 con 0x561fe9184400 2024-09-13T18:28:30.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.173+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 42 ==== osd_op_reply(180 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.173+0000 7f21d4dc1500 4 recover_dentries: inspecting remotebit 100000001f7.00000000/link3 2024-09-13T18:28:30.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.173+0000 7f21d4dc1500 4 recover_dentries: dentry did not already exist, will create 2024-09-13T18:28:30.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.173+0000 7f21d4dc1500 4 recover_dentries: writing L dentry link3_head into frag 100000001f7.00000000 2024-09-13T18:28:30.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.173+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:181 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9ca9800 con 0x561fe9184400 2024-09-13T18:28:30.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.177+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 43 ==== osd_op_reply(181 100000001f7.00000000 [omap-set-vals] v36'21 uv21 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.177+0000 7f21d4dc1500 4 recover_dentries: updating root 0x1 2024-09-13T18:28:30.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.177+0000 7f21d4dc1500 4 recover_dentries: object id 1.00000000.inode 2024-09-13T18:28:30.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.177+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:182 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0400 con 0x561fe9ca9c00 2024-09-13T18:28:30.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.177+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 23 ==== osd_op_reply(182 1.00000000.inode [read 0~582 out=582b] v0'0 uv28 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:30.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.177+0000 7f21d4dc1500 4 recover_dentries: root exists, will modify (582) 2024-09-13T18:28:30.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.177+0000 7f21d4dc1500 4 recover_dentries: magic ok 2024-09-13T18:28:30.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.177+0000 7f21d4dc1500 4 recover_dentries: writing root ino 1.00000000.inode version 8 2024-09-13T18:28:30.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.177+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:183 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0800 con 0x561fe9ca9c00 2024-09-13T18:28:30.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.181+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 24 ==== osd_op_reply(183 1.00000000.inode [writefull 0~582] v36'29 uv29 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:30.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.181+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 1.00000000 2024-09-13T18:28:30.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.181+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:184 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1000 con 0x561fe9185c00 2024-09-13T18:28:30.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.181+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 70 ==== osd_op_reply(184 1.00000000 [omap-get-header out=274b] v0'0 uv37 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.181+0000 7f21d4dc1500 4 recover_dentries: frag 1.00000000 fnode old v48 vs new v50 2024-09-13T18:28:30.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.181+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.181+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:185 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2000 con 0x561fe9185c00 2024-09-13T18:28:30.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.185+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 71 ==== osd_op_reply(185 1.00000000 [omap-set-header] v36'38 uv38 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.185+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:186 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a2400 con 0x561fe9185c00 2024-09-13T18:28:30.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.185+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 72 ==== osd_op_reply(186 1.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv38 ondisk = 0) v8 ==== 154+0+523 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.185+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2024-09-13T18:28:30.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.185+0000 7f21d4dc1500 4 recover_dentries: dentry subdir_head existed already 2024-09-13T18:28:30.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.185+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.185+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 41 vs fullbit version 49 2024-09-13T18:28:30.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.185+0000 7f21d4dc1500 4 recover_dentries: writing i dentry subdir_head into frag 1.00000000 2024-09-13T18:28:30.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.185+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.185+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:187 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0c00 con 0x561fe9185c00 2024-09-13T18:28:30.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.189+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 73 ==== osd_op_reply(187 1.00000000 [omap-set-vals] v36'39 uv39 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.189+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 10000000001.00000000 2024-09-13T18:28:30.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.189+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:188 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1400 con 0x561fe9ca9400 2024-09-13T18:28:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.189+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 37 ==== osd_op_reply(188 10000000001.00000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.189+0000 7f21d4dc1500 4 recover_dentries: frag 10000000001.00000000 fnode old v17 vs new v19 2024-09-13T18:28:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.189+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.189+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:189 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1800 con 0x561fe9ca9400 2024-09-13T18:28:30.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.193+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 38 ==== osd_op_reply(189 10000000001.00000000 [omap-set-header] v36'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.193+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:190 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=22b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185800 con 0x561fe9ca9400 2024-09-13T18:28:30.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.193+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 39 ==== osd_op_reply(190 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.193+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 10000000001.00000000/subsubdir 2024-09-13T18:28:30.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.193+0000 7f21d4dc1500 4 recover_dentries: dentry did not already exist, will create 2024-09-13T18:28:30.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.193+0000 7f21d4dc1500 4 recover_dentries: writing i dentry subsubdir_head into frag 10000000001.00000000 2024-09-13T18:28:30.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.193+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.193+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:191 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=526b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe930e000 con 0x561fe9ca9400 2024-09-13T18:28:30.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.197+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.1 v2:172.21.15.44:6816/2250405239 40 ==== osd_op_reply(191 10000000001.00000000 [omap-set-vals] v36'21 uv21 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9ca9400 2024-09-13T18:28:30.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.197+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 100000001fa.00000000 2024-09-13T18:28:30.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.197+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:192 4.1f 4:feb1c803:::100000001fa.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe930e400 con 0x561fe9185c00 2024-09-13T18:28:30.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.197+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 74 ==== osd_op_reply(192 100000001fa.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.197+0000 7f21d4dc1500 4 recover_dentries: failed to read OMAP header from directory fragment 100000001fa.00000000 (2) No such file or directory 2024-09-13T18:28:30.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.197+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.197+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:193 4.1f 4:feb1c803:::100000001fa.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe930e800 con 0x561fe9185c00 2024-09-13T18:28:30.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.201+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 75 ==== osd_op_reply(193 100000001fa.00000000 [omap-set-header] v36'40 uv40 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.201+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:194 4.1f 4:feb1c803:::100000001fa.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe930ec00 con 0x561fe9185c00 2024-09-13T18:28:30.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.201+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 76 ==== osd_op_reply(194 100000001fa.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv40 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.201+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 601.00000000 2024-09-13T18:28:30.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.201+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:195 4.10 4:09401a81:::601.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe930f000 con 0x561fe9ca9c00 2024-09-13T18:28:30.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.201+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 25 ==== osd_op_reply(195 601.00000000 [omap-get-header out=274b] v0'0 uv12 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:30.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.201+0000 7f21d4dc1500 4 recover_dentries: frag 601.00000000 fnode old v6 vs new v8 2024-09-13T18:28:30.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.201+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.201+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:196 4.10 4:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe930f400 con 0x561fe9ca9c00 2024-09-13T18:28:30.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.205+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 26 ==== osd_op_reply(196 601.00000000 [omap-set-header] v36'13 uv13 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:30.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.205+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:197 4.10 4:09401a81:::601.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe930f800 con 0x561fe9ca9c00 2024-09-13T18:28:30.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.205+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 27 ==== osd_op_reply(197 601.00000000 [omap-get-vals-by-keys out=542b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+542 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:30.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.205+0000 7f21d4dc1500 4 recover_dentries: inspecting nullbit 601.00000000/100000001f8 2024-09-13T18:28:30.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.205+0000 7f21d4dc1500 4 recover_dentries: dentry exists, will remove 2024-09-13T18:28:30.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.205+0000 7f21d4dc1500 10 recover_dentries: Existing full inode in slot to be (maybe) removed by null journal dn '100000001f8' with lump fnode version 8vs existing fnode version 6 2024-09-13T18:28:30.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.205+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:198 4.10 4:09401a81:::601.00000000:head [omap-rm-keys in=24b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe930fc00 con 0x561fe9ca9c00 2024-09-13T18:28:30.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.209+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 28 ==== osd_op_reply(198 601.00000000 [omap-rm-keys] v36'14 uv14 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:30.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.209+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 1.00000000 2024-09-13T18:28:30.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.209+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:199 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe930f000 con 0x561fe9185c00 2024-09-13T18:28:30.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.209+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 77 ==== osd_op_reply(199 1.00000000 [omap-get-header out=274b] v0'0 uv39 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.209+0000 7f21d4dc1500 4 recover_dentries: frag 1.00000000 fnode old v50 vs new v52 2024-09-13T18:28:30.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.209+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.209+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:200 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe930f400 con 0x561fe9185c00 2024-09-13T18:28:30.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.213+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 78 ==== osd_op_reply(200 1.00000000 [omap-set-header] v36'41 uv41 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.213+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:201 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe930f800 con 0x561fe9185c00 2024-09-13T18:28:30.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.213+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 79 ==== osd_op_reply(201 1.00000000 [omap-get-vals-by-keys out=524b] v0'0 uv41 ondisk = 0) v8 ==== 154+0+524 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.213+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2024-09-13T18:28:30.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.213+0000 7f21d4dc1500 4 recover_dentries: dentry linkdir_head existed already 2024-09-13T18:28:30.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.213+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.213+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 46 vs fullbit version 51 2024-09-13T18:28:30.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.213+0000 7f21d4dc1500 4 recover_dentries: writing i dentry linkdir_head into frag 1.00000000 2024-09-13T18:28:30.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.213+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.213+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:202 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=524b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe930fc00 con 0x561fe9185c00 2024-09-13T18:28:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.217+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 80 ==== osd_op_reply(202 1.00000000 [omap-set-vals] v36'42 uv42 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.217+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 100000001f7.00000000 2024-09-13T18:28:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.217+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:203 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1c00 con 0x561fe9184400 2024-09-13T18:28:30.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.217+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 44 ==== osd_op_reply(203 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.217+0000 7f21d4dc1500 4 recover_dentries: frag 100000001f7.00000000 fnode old v21 vs new v23 2024-09-13T18:28:30.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.217+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.217+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:204 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0000 con 0x561fe9184400 2024-09-13T18:28:30.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.217+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 45 ==== osd_op_reply(204 100000001f7.00000000 [omap-set-header] v36'22 uv22 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.217+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:205 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0400 con 0x561fe9184400 2024-09-13T18:28:30.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.221+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 46 ==== osd_op_reply(205 100000001f7.00000000 [omap-get-vals-by-keys out=560b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+560 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.221+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 100000001f7.00000000/link2 2024-09-13T18:28:30.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.221+0000 7f21d4dc1500 4 recover_dentries: dentry link2_head existed already 2024-09-13T18:28:30.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.221+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.221+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 14 vs fullbit version 22 2024-09-13T18:28:30.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.221+0000 7f21d4dc1500 4 recover_dentries: writing i dentry link2_head into frag 100000001f7.00000000 2024-09-13T18:28:30.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.221+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.221+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:206 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=522b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0800 con 0x561fe9184400 2024-09-13T18:28:30.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.221+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.0 v2:172.21.15.44:6800/2647753462 47 ==== osd_op_reply(206 100000001f7.00000000 [omap-set-vals] v36'23 uv23 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9184400 2024-09-13T18:28:30.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.221+0000 7f21d4dc1500 4 recover_dentries: updating root 0x1 2024-09-13T18:28:30.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.221+0000 7f21d4dc1500 4 recover_dentries: object id 1.00000000.inode 2024-09-13T18:28:30.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.221+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:207 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9ca9800 con 0x561fe9ca9c00 2024-09-13T18:28:30.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.225+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 29 ==== osd_op_reply(207 1.00000000.inode [read 0~582 out=582b] v0'0 uv29 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:30.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.225+0000 7f21d4dc1500 4 recover_dentries: root exists, will modify (582) 2024-09-13T18:28:30.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.225+0000 7f21d4dc1500 4 recover_dentries: magic ok 2024-09-13T18:28:30.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.225+0000 7f21d4dc1500 4 recover_dentries: writing root ino 1.00000000.inode version 9 2024-09-13T18:28:30.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.225+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:208 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9184c00 con 0x561fe9ca9c00 2024-09-13T18:28:30.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.225+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 30 ==== osd_op_reply(208 1.00000000.inode [writefull 0~582] v36'30 uv30 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:30.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.225+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 100.00000000 2024-09-13T18:28:30.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.225+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:209 4.13 4:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185000 con 0x561fe9185400 2024-09-13T18:28:30.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.229+0000 7f21d357b700 1 -- 172.21.15.44:0/3955014589 <== osd.4 v2:172.21.15.99:6816/2515272044 12 ==== osd_op_reply(209 100.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x561fe929c000 con 0x561fe9185400 2024-09-13T18:28:30.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.229+0000 7f21d4dc1500 4 recover_dentries: frag 100.00000000 fnode old v5 vs new v7 2024-09-13T18:28:30.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.229+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.229+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:210 4.13 4:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3c00 con 0x561fe9185400 2024-09-13T18:28:30.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.229+0000 7f21d357b700 1 -- 172.21.15.44:0/3955014589 <== osd.4 v2:172.21.15.99:6816/2515272044 13 ==== osd_op_reply(210 100.00000000 [omap-set-header] v36'7 uv7 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x561fe929c000 con 0x561fe9185400 2024-09-13T18:28:30.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.229+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:211 4.13 4:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe930e000 con 0x561fe9185400 2024-09-13T18:28:30.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.233+0000 7f21d357b700 1 -- 172.21.15.44:0/3955014589 <== osd.4 v2:172.21.15.99:6816/2515272044 14 ==== osd_op_reply(211 100.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+523 (crc 0 0 0) 0x561fe929c000 con 0x561fe9185400 2024-09-13T18:28:30.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.233+0000 7f21d4dc1500 4 recover_dentries: inspecting fullbit 100.00000000/stray1 2024-09-13T18:28:30.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.233+0000 7f21d4dc1500 4 recover_dentries: dentry stray1_head existed already 2024-09-13T18:28:30.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.233+0000 7f21d4dc1500 4 recover_dentries: dentry exists, checking versions... 2024-09-13T18:28:30.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.233+0000 7f21d4dc1500 4 recover_dentries: decoded embedded inode version 4 vs fullbit version 6 2024-09-13T18:28:30.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.233+0000 7f21d4dc1500 4 recover_dentries: writing i dentry stray1_head into frag 100.00000000 2024-09-13T18:28:30.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.233+0000 7f21d4dc1500 20 recover_dentries: dnfirst = 2 2024-09-13T18:28:30.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.233+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:212 4.13 4:cd5a64a3:::100.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe930e400 con 0x561fe9185400 2024-09-13T18:28:30.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.233+0000 7f21d357b700 1 -- 172.21.15.44:0/3955014589 <== osd.4 v2:172.21.15.99:6816/2515272044 15 ==== osd_op_reply(212 100.00000000 [omap-set-vals] v36'8 uv8 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x561fe929c000 con 0x561fe9185400 2024-09-13T18:28:30.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.233+0000 7f21d4dc1500 4 recover_dentries: updating root 0x100 2024-09-13T18:28:30.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.233+0000 7f21d4dc1500 4 recover_dentries: object id 100.00000000.inode 2024-09-13T18:28:30.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.233+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:213 4.1f 4:fe07bba1:::100.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe930e800 con 0x561fe9185c00 2024-09-13T18:28:30.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.237+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 81 ==== osd_op_reply(213 100.00000000.inode [read 0~582 out=582b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+582 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.237+0000 7f21d4dc1500 4 recover_dentries: root exists, will modify (582) 2024-09-13T18:28:30.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.237+0000 7f21d4dc1500 4 recover_dentries: magic ok 2024-09-13T18:28:30.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.237+0000 7f21d4dc1500 4 recover_dentries: writing root ino 100.00000000.inode version 2 2024-09-13T18:28:30.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.237+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:214 4.1f 4:fe07bba1:::100.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe930ec00 con 0x561fe9185c00 2024-09-13T18:28:30.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.237+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 82 ==== osd_op_reply(214 100.00000000.inode [writefull 0~582] v36'43 uv43 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.237+0000 7f21d4dc1500 4 recover_dentries: inspecting lump 1.00000000 2024-09-13T18:28:30.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.237+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:215 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe930f000 con 0x561fe9185c00 2024-09-13T18:28:30.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.241+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 83 ==== osd_op_reply(215 1.00000000 [omap-get-header out=274b] v0'0 uv42 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.241+0000 7f21d4dc1500 4 recover_dentries: frag 1.00000000 fnode old v52 vs new v53 2024-09-13T18:28:30.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.241+0000 7f21d4dc1500 4 recover_dentries: writing fnode to omap header 2024-09-13T18:28:30.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.241+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:216 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe9185800 con 0x561fe9185c00 2024-09-13T18:28:30.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.241+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 84 ==== osd_op_reply(216 1.00000000 [omap-set-header] v36'44 uv44 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.241+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:217 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1000 con 0x561fe9185c00 2024-09-13T18:28:30.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.245+0000 7f21d2d7a700 1 -- 172.21.15.44:0/3955014589 <== osd.6 v2:172.21.15.99:6808/2907584318 85 ==== osd_op_reply(217 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv44 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x561fe9b8cb40 con 0x561fe9185c00 2024-09-13T18:28:30.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.245+0000 7f21d4dc1500 4 recover_dentries: updating root 0x1 2024-09-13T18:28:30.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.245+0000 7f21d4dc1500 4 recover_dentries: object id 1.00000000.inode 2024-09-13T18:28:30.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.245+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:218 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d0c00 con 0x561fe9ca9c00 2024-09-13T18:28:30.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.245+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 31 ==== osd_op_reply(218 1.00000000.inode [read 0~582 out=582b] v0'0 uv30 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:30.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.245+0000 7f21d4dc1500 4 recover_dentries: root exists, will modify (582) 2024-09-13T18:28:30.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.245+0000 7f21d4dc1500 4 recover_dentries: magic ok 2024-09-13T18:28:30.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.245+0000 7f21d4dc1500 4 recover_dentries: writing root ino 1.00000000.inode version 10 2024-09-13T18:28:30.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.245+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:219 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1400 con 0x561fe9ca9c00 2024-09-13T18:28:30.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.245+0000 7f21d3d7c700 1 -- 172.21.15.44:0/3955014589 <== osd.3 v2:172.21.15.44:6808/771281770 32 ==== osd_op_reply(219 1.00000000.inode [writefull 0~582] v36'31 uv31 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x561fe9b8cd80 con 0x561fe9ca9c00 2024-09-13T18:28:30.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.245+0000 7f21d4dc1500 4 main_event: consumed 8 inodes 2024-09-13T18:28:30.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.245+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:220 4.13 4:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92d1800 con 0x561fe9185400 2024-09-13T18:28:30.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.249+0000 7f21d357b700 1 -- 172.21.15.44:0/3955014589 <== osd.4 v2:172.21.15.99:6816/2515272044 16 ==== osd_op_reply(220 mds0_inotable [read 0~34 out=34b] v0'0 uv2 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x561fe929c000 con 0x561fe9185400 2024-09-13T18:28:30.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.249+0000 7f21d4dc1500 4 consume_inos: Used ino 0x10000000000 requires inotable update 2024-09-13T18:28:30.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.249+0000 7f21d4dc1500 4 consume_inos: Used ino 0x10000000001 requires inotable update 2024-09-13T18:28:30.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.249+0000 7f21d4dc1500 4 consume_inos: Used ino 0x10000000002 requires inotable update 2024-09-13T18:28:30.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.249+0000 7f21d4dc1500 4 consume_inos: Used ino 0x100000001f7 requires inotable update 2024-09-13T18:28:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.249+0000 7f21d4dc1500 4 consume_inos: Used ino 0x100000001f8 requires inotable update 2024-09-13T18:28:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.249+0000 7f21d4dc1500 4 consume_inos: Used ino 0x100000001f9 requires inotable update 2024-09-13T18:28:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.249+0000 7f21d4dc1500 4 consume_inos: Used ino 0x100000001fa requires inotable update 2024-09-13T18:28:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.249+0000 7f21d4dc1500 4 consume_inos: writing modified inotable version 1 2024-09-13T18:28:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.249+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:221 4.13 4:c91d4a1d:::mds0_inotable:head [writefull 0~50 in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x561fe92a3800 con 0x561fe9185400 2024-09-13T18:28:30.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d357b700 1 -- 172.21.15.44:0/3955014589 <== osd.4 v2:172.21.15.99:6816/2515272044 17 ==== osd_op_reply(221 mds0_inotable [writefull 0~50] v36'9 uv9 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x561fe929c000 con 0x561fe9185400 2024-09-13T18:28:30.259 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:05.073211+0000 0x400000 SUBTREEMAP: () 2024-09-13T18:28:30.259 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:16.056916+0000 0x40037c SESSION: () 2024-09-13T18:28:30.259 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:17.694842+0000 0x400536 UPDATE: (setattr) 2024-09-13T18:28:30.259 INFO:teuthology.orchestra.run.smithi044.stdout: / 2024-09-13T18:28:30.259 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:17.708251+0000 0x400865 UPDATE: (openc) 2024-09-13T18:28:30.260 INFO:teuthology.orchestra.run.smithi044.stdout: rootfile 2024-09-13T18:28:30.260 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:17.725407+0000 0x400f17 UPDATE: (mkdir) 2024-09-13T18:28:30.260 INFO:teuthology.orchestra.run.smithi044.stdout: subdir 2024-09-13T18:28:30.260 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:17.741067+0000 0x4016e5 UPDATE: (openc) 2024-09-13T18:28:30.260 INFO:teuthology.orchestra.run.smithi044.stdout: subdir/subdirfile 2024-09-13T18:28:30.260 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:17.752580+0000 0x401e91 UPDATE: (mkdir) 2024-09-13T18:28:30.260 INFO:teuthology.orchestra.run.smithi044.stdout: linkdir 2024-09-13T18:28:30.260 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:17.777917+0000 0x402670 UPDATE: (scatter_writebehind) 2024-09-13T18:28:30.260 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:17.808065+0000 0x402ae2 UPDATE: (openc) 2024-09-13T18:28:30.260 INFO:teuthology.orchestra.run.smithi044.stdout: linkdir/link0 2024-09-13T18:28:30.260 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:17.819603+0000 0x40328a UPDATE: (unlink_local) 2024-09-13T18:28:30.260 INFO:teuthology.orchestra.run.smithi044.stdout: stray1/100000001f8 2024-09-13T18:28:30.261 INFO:teuthology.orchestra.run.smithi044.stdout: linkdir/link0 2024-09-13T18:28:30.261 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:17.820091+0000 0x403f16 UPDATE: (cap update) 2024-09-13T18:28:30.261 INFO:teuthology.orchestra.run.smithi044.stdout: stray1/100000001f8 2024-09-13T18:28:30.261 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:17.831512+0000 0x4046b0 UPDATE: (cap update) 2024-09-13T18:28:30.261 INFO:teuthology.orchestra.run.smithi044.stdout: subdir/subdirfile 2024-09-13T18:28:30.261 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:17.832641+0000 0x404e3b UPDATE: (link_local) 2024-09-13T18:28:30.261 INFO:teuthology.orchestra.run.smithi044.stdout: subdir/subdirfile 2024-09-13T18:28:30.261 INFO:teuthology.orchestra.run.smithi044.stdout: linkdir/link0 2024-09-13T18:28:30.261 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:17.846106+0000 0x40599b UPDATE: (link_local) 2024-09-13T18:28:30.261 INFO:teuthology.orchestra.run.smithi044.stdout: subdir/subdirfile 2024-09-13T18:28:30.261 INFO:teuthology.orchestra.run.smithi044.stdout: linkdir/link1 2024-09-13T18:28:30.261 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:17.858004+0000 0x4064fb UPDATE: (link_local) 2024-09-13T18:28:30.261 INFO:teuthology.orchestra.run.smithi044.stdout: subdir/subdirfile 2024-09-13T18:28:30.261 INFO:teuthology.orchestra.run.smithi044.stdout: linkdir/link2 2024-09-13T18:28:30.262 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:17.874060+0000 0x40705b UPDATE: (unlink_local) 2024-09-13T18:28:30.262 INFO:teuthology.orchestra.run.smithi044.stdout: subdir/subdirfile 2024-09-13T18:28:30.262 INFO:teuthology.orchestra.run.smithi044.stdout: linkdir/link2 2024-09-13T18:28:30.262 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:17.925957+0000 0x407bbe UPDATE: (openc) 2024-09-13T18:28:30.262 INFO:teuthology.orchestra.run.smithi044.stdout: linkdir/link2 2024-09-13T18:28:30.262 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:17.945151+0000 0x408366 UPDATE: (link_local) 2024-09-13T18:28:30.262 INFO:teuthology.orchestra.run.smithi044.stdout: subdir/subdirfile 2024-09-13T18:28:30.262 INFO:teuthology.orchestra.run.smithi044.stdout: linkdir/link3 2024-09-13T18:28:30.262 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:18.004109+0000 0x408ed4 UPDATE: (unlink_local) 2024-09-13T18:28:30.262 INFO:teuthology.orchestra.run.smithi044.stdout: subdir/subdirfile 2024-09-13T18:28:30.262 INFO:teuthology.orchestra.run.smithi044.stdout: linkdir/link3 2024-09-13T18:28:30.262 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:18.016380+0000 0x409a37 UPDATE: (cap update) 2024-09-13T18:28:30.262 INFO:teuthology.orchestra.run.smithi044.stdout: rootfile 2024-09-13T18:28:30.262 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:18.017204+0000 0x40a0b8 UPDATE: (link_local) 2024-09-13T18:28:30.262 INFO:teuthology.orchestra.run.smithi044.stdout: rootfile 2024-09-13T18:28:30.262 INFO:teuthology.orchestra.run.smithi044.stdout: linkdir/link3 2024-09-13T18:28:30.263 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:18.071290+0000 0x40ab0e UPDATE: (mkdir) 2024-09-13T18:28:30.263 INFO:teuthology.orchestra.run.smithi044.stdout: subdir/subsubdir 2024-09-13T18:28:30.263 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:19.097137+0000 0x40b3e7 UPDATE: (purge_stray) 2024-09-13T18:28:30.263 INFO:teuthology.orchestra.run.smithi044.stdout: 100000001f8 2024-09-13T18:28:30.263 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:23.058918+0000 0x40b63e UPDATE: (cap update) 2024-09-13T18:28:30.263 INFO:teuthology.orchestra.run.smithi044.stdout: linkdir/link2 2024-09-13T18:28:30.263 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:27.772455+0000 0x40c00e UPDATE: (scatter_writebehind) 2024-09-13T18:28:30.263 INFO:teuthology.orchestra.run.smithi044.stdout: stray1 2024-09-13T18:28:30.263 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:27.778222+0000 0x40c681 UPDATE: (scatter_writebehind) 2024-09-13T18:28:30.263 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-13T18:28:27.778946+0000 0x40caf3 SESSION: () 2024-09-13T18:28:30.263 INFO:teuthology.orchestra.run.smithi044.stdout:0.000000 0x40cba0 PURGED: () 2024-09-13T18:28:30.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 4 28 events 2024-09-13T18:28:30.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x561fe9184400 msgr2=0x561fe929e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x561fe9184400 0x561fe929e580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x561fe9ca9400 msgr2=0x561fe8ec6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x561fe9ca9400 0x561fe8ec6100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x561fe9ca9c00 msgr2=0x561fe8ec5b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x561fe9ca9c00 0x561fe8ec5b80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x561fe9185400 msgr2=0x561fe8ec5600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d357b700 1 -- 172.21.15.44:0/3955014589 reap_dead start 2024-09-13T18:28:30.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x561fe9185400 0x561fe8ec5600 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x561fe9185c00 msgr2=0x561fe929e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x561fe9185c00 0x561fe929e000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x561fe9184800 msgr2=0x561fe8ec7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x561fe9184800 0x561fe8ec7700 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x561fe91586f0 tx=0x561fe8ef2cc0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561fe9ca8800 msgr2=0x561fe8ec7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561fe9ca8800 0x561fe8ec7180 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x561fe91593e0 tx=0x561fe9178d20 comp rx=0 tx=0).stop 2024-09-13T18:28:30.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 shutdown_connections 2024-09-13T18:28:30.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x561fe9185400 0x561fe8ec5600 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x561fe9185c00 0x561fe929e000 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x561fe9184800 0x561fe8ec7700 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/3955014589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561fe9ca8800 0x561fe8ec7180 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 >> 172.21.15.44:0/3955014589 conn(0x561fe8e1ec00 msgr2=0x561fe8f0f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:30.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 shutdown_connections 2024-09-13T18:28:30.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 -- 172.21.15.44:0/3955014589 wait complete. 2024-09-13T18:28:30.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 -- 172.21.15.44:0/4025219440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561fe8e1f400 msgr2=0x561fe8ec4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/4025219440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561fe8e1f400 0x561fe8ec4b00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x561fe8f31260 tx=0x561fe8ef5260 comp rx=0 tx=0).stop 2024-09-13T18:28:30.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 -- 172.21.15.44:0/4025219440 shutdown_connections 2024-09-13T18:28:30.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/4025219440 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561fe8e1f000 0x561fe8ec5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/4025219440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561fe8e1f400 0x561fe8ec4b00 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 --2- 172.21.15.44:0/4025219440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561fe8e1f800 0x561fe8ec4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 -- 172.21.15.44:0/4025219440 >> 172.21.15.44:0/4025219440 conn(0x561fe8e1fc00 msgr2=0x561fe8f0f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:30.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 -- 172.21.15.44:0/4025219440 shutdown_connections 2024-09-13T18:28:30.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.253+0000 7f21d4dc1500 1 -- 172.21.15.44:0/4025219440 wait complete. 2024-09-13T18:28:30.268 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'recover_dentries', 'list'] in time 0:00:00.476944, result: 2024-09-13T18:28:05.073211+0000 0x400000 SUBTREEMAP: () 2024-09-13T18:28:16.056916+0000 0x40037c SESSION: () 2024-09-13T18:28:17.694842+0000 0x400536 UPDATE: (setattr) / 2024-09-13T18:28:17.708251+0000 0x400865 UPDATE: (openc) rootfile 2024-09-13T18:28:17.725407+0000 0x400f17 UPDATE: (mkdir) subdir 2024-09-13T18:28:17.741067+0000 0x4016e5 UPDATE: (openc) subdir/subdirfile 2024-09-13T18:28:17.752580+0000 0x401e91 UPDATE: (mkdir) linkdir 2024-09-13T18:28:17.777917+0000 0x402670 UPDATE: (scatter_writebehind) 2024-09-13T18:28:17.808065+0000 0x402ae2 UPDATE: (openc) linkdir/link0 2024-09-13T18:28:17.819603+0000 0x40328a UPDATE: (unlink_local) stray1/100000001f8 linkdir/link0 2024-09-13T18:28:17.820091+0000 0x403f16 UPDATE: (cap update) stray1/100000001f8 2024-09-13T18:28:17.831512+0000 0x4046b0 UPDATE: (cap update) subdir/subdirfile 2024-09-13T18:28:17.832641+0000 0x404e3b UPDATE: (link_local) subdir/subdirfile linkdir/link0 2024-09-13T18:28:17.846106+0000 0x40599b UPDATE: (link_local) subdir/subdirfile linkdir/link1 2024-09-13T18:28:17.858004+0000 0x4064fb UPDATE: (link_local) subdir/subdirfile linkdir/link2 2024-09-13T18:28:17.874060+0000 0x40705b UPDATE: (unlink_local) subdir/subdirfile linkdir/link2 2024-09-13T18:28:17.925957+0000 0x407bbe UPDATE: (openc) linkdir/link2 2024-09-13T18:28:17.945151+0000 0x408366 UPDATE: (link_local) subdir/subdirfile linkdir/link3 2024-09-13T18:28:18.004109+0000 0x408ed4 UPDATE: (unlink_local) subdir/subdirfile linkdir/link3 2024-09-13T18:28:18.016380+0000 0x409a37 UPDATE: (cap update) rootfile 2024-09-13T18:28:18.017204+0000 0x40a0b8 UPDATE: (link_local) rootfile linkdir/link3 2024-09-13T18:28:18.071290+0000 0x40ab0e UPDATE: (mkdir) subdir/subsubdir 2024-09-13T18:28:19.097137+0000 0x40b3e7 UPDATE: (purge_stray) 100000001f8 2024-09-13T18:28:23.058918+0000 0x40b63e UPDATE: (cap update) linkdir/link2 2024-09-13T18:28:27.772455+0000 0x40c00e UPDATE: (scatter_writebehind) stray1 2024-09-13T18:28:27.778222+0000 0x40c681 UPDATE: (scatter_writebehind) 2024-09-13T18:28:27.778946+0000 0x40caf3 SESSION: () 0.000000 0x40cba0 PURGED: () 2024-09-13T18:28:30.269 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000 2024-09-13T18:28:30.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce8fb6140 1 Processor -- start 2024-09-13T18:28:30.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce8fb6140 1 -- start start 2024-09-13T18:28:30.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce8fb6140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56015b15d850 0x56015b235600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce8fb6140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56015b233140 0x56015b18f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce8fb6140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56015b233520 0x56015b2316f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce8fb6140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56015b0f3a00 con 0x56015b15d850 2024-09-13T18:28:30.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce8fb6140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56015b0ef2f0 con 0x56015b233140 2024-09-13T18:28:30.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce8fb6140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x56015b0ab8e0 con 0x56015b233520 2024-09-13T18:28:30.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce6aeb700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56015b15d850 0x56015b235600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce6aeb700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56015b15d850 0x56015b235600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52324/0 (socket says 172.21.15.44:52324) 2024-09-13T18:28:30.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce6aeb700 1 -- 172.21.15.44:0/4029688159 learned_addr learned my addr 172.21.15.44:0/4029688159 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:30.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce62ea700 1 --2- 172.21.15.44:0/4029688159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56015b233140 0x56015b18f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce72ec700 1 --2- 172.21.15.44:0/4029688159 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56015b233520 0x56015b2316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce6aeb700 1 -- 172.21.15.44:0/4029688159 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56015b233520 msgr2=0x56015b2316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:30.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce6aeb700 1 --2- 172.21.15.44:0/4029688159 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56015b233520 0x56015b2316f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce6aeb700 1 -- 172.21.15.44:0/4029688159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56015b233140 msgr2=0x56015b18f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:30.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce6aeb700 1 --2- 172.21.15.44:0/4029688159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56015b233140 0x56015b18f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce6aeb700 1 -- 172.21.15.44:0/4029688159 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce000a100 con 0x56015b15d850 2024-09-13T18:28:30.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce72ec700 1 --2- 172.21.15.44:0/4029688159 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56015b233520 0x56015b2316f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:30.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce6aeb700 1 --2- 172.21.15.44:0/4029688159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56015b15d850 0x56015b235600 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800b2e0 tx=0x7f7cd800b5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8dc7c1a43414091 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce52e8700 1 -- 172.21.15.44:0/4029688159 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8014070 con 0x56015b15d850 2024-09-13T18:28:30.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce52e8700 1 -- 172.21.15.44:0/4029688159 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd800f3f0 con 0x56015b15d850 2024-09-13T18:28:30.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce52e8700 1 -- 172.21.15.44:0/4029688159 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd800f7c0 con 0x56015b15d850 2024-09-13T18:28:30.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce8fb6140 1 -- 172.21.15.44:0/4029688159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56015b15d850 msgr2=0x56015b235600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce8fb6140 1 --2- 172.21.15.44:0/4029688159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56015b15d850 0x56015b235600 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800b2e0 tx=0x7f7cd800b5f0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce8fb6140 1 -- 172.21.15.44:0/4029688159 shutdown_connections 2024-09-13T18:28:30.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce8fb6140 1 --2- 172.21.15.44:0/4029688159 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56015b233520 0x56015b2316f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce8fb6140 1 --2- 172.21.15.44:0/4029688159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56015b233140 0x56015b18f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce8fb6140 1 --2- 172.21.15.44:0/4029688159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56015b15d850 0x56015b235600 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.345+0000 7f7ce8fb6140 1 -- 172.21.15.44:0/4029688159 >> 172.21.15.44:0/4029688159 conn(0x56015b18c280 msgr2=0x56015b218b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:30.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce8fb6140 1 -- 172.21.15.44:0/4029688159 shutdown_connections 2024-09-13T18:28:30.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce8fb6140 1 -- 172.21.15.44:0/4029688159 wait complete. 2024-09-13T18:28:30.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce8fb6140 1 Processor -- start 2024-09-13T18:28:30.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce8fb6140 1 -- start start 2024-09-13T18:28:30.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce8fb6140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56015b15d850 0x56015b2c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce8fb6140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56015b233140 0x56015b2c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce8fb6140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56015b233520 0x56015b215eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce8fb6140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56015b0ab580 con 0x56015b233520 2024-09-13T18:28:30.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce8fb6140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56015b0818d0 con 0x56015b233140 2024-09-13T18:28:30.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce8fb6140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x56015b2c9990 con 0x56015b15d850 2024-09-13T18:28:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce72ec700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56015b233520 0x56015b215eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce72ec700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56015b233520 0x56015b215eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52338/0 (socket says 172.21.15.44:52338) 2024-09-13T18:28:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce72ec700 1 -- 172.21.15.44:0/2990640393 learned_addr learned my addr 172.21.15.44:0/2990640393 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce62ea700 1 --2- 172.21.15.44:0/2990640393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56015b233140 0x56015b2c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce6aeb700 1 --2- 172.21.15.44:0/2990640393 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56015b15d850 0x56015b2c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce72ec700 1 -- 172.21.15.44:0/2990640393 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56015b15d850 msgr2=0x56015b2c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce72ec700 1 --2- 172.21.15.44:0/2990640393 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56015b15d850 0x56015b2c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce72ec700 1 -- 172.21.15.44:0/2990640393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56015b233140 msgr2=0x56015b2c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce72ec700 1 --2- 172.21.15.44:0/2990640393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56015b233140 0x56015b2c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce72ec700 1 -- 172.21.15.44:0/2990640393 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd8001500 con 0x56015b233520 2024-09-13T18:28:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce6aeb700 1 --2- 172.21.15.44:0/2990640393 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56015b15d850 0x56015b2c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce72ec700 1 --2- 172.21.15.44:0/2990640393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56015b233520 0x56015b215eb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0013040 tx=0x7f7ce0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7cdffff700 1 -- 172.21.15.44:0/2990640393 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0025660 con 0x56015b233520 2024-09-13T18:28:30.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7cdffff700 1 -- 172.21.15.44:0/2990640393 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce00257e0 con 0x56015b233520 2024-09-13T18:28:30.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7cdffff700 1 -- 172.21.15.44:0/2990640393 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0025b90 con 0x56015b233520 2024-09-13T18:28:30.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce8fb6140 1 -- 172.21.15.44:0/2990640393 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56015b08cf40 con 0x56015b233520 2024-09-13T18:28:30.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.349+0000 7f7ce8fb6140 1 -- 172.21.15.44:0/2990640393 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56015b08c9a0 con 0x56015b233520 2024-09-13T18:28:30.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.353+0000 7f7cdffff700 1 -- 172.21.15.44:0/2990640393 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7ce001c400 con 0x56015b233520 2024-09-13T18:28:30.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.353+0000 7f7cdffff700 1 --2- 172.21.15.44:0/2990640393 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7cc8065090 0x7f7cc8067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.353+0000 7f7cdffff700 1 -- 172.21.15.44:0/2990640393 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7ce0084a60 con 0x56015b233520 2024-09-13T18:28:30.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.353+0000 7f7ce8fb6140 1 --2- 172.21.15.44:0/2990640393 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x56015b2163f0 0x56015b2caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.353+0000 7f7ce8fb6140 1 -- 172.21.15.44:0/2990640393 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:1 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x56015b2cb010 con 0x56015b2163f0 2024-09-13T18:28:30.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.353+0000 7f7ce6aeb700 1 --2- 172.21.15.44:0/2990640393 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7cc8065090 0x7f7cc8067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.353+0000 7f7ce62ea700 1 --2- 172.21.15.44:0/2990640393 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x56015b2163f0 0x56015b2caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.357+0000 7f7ce62ea700 1 --2- 172.21.15.44:0/2990640393 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x56015b2163f0 0x56015b2caad0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.357+0000 7f7ce6aeb700 1 --2- 172.21.15.44:0/2990640393 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7cc8065090 0x7f7cc8067550 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800b630 tx=0x7f7cd8008000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.357+0000 7f7ce62ea700 1 -- 172.21.15.44:0/2990640393 <== osd.6 v2:172.21.15.99:6808/2907584318 1 ==== osd_op_reply(1 1.00000000 [omap-get-keys out=53b] v0'0 uv44 ondisk = 0) v8 ==== 154+0+53 (crc 0 0 0) 0x7f7cd0001990 con 0x56015b2163f0 2024-09-13T18:28:30.363 INFO:teuthology.orchestra.run.smithi044.stdout:linkdir_head 2024-09-13T18:28:30.364 INFO:teuthology.orchestra.run.smithi044.stdout:rootfile_head 2024-09-13T18:28:30.364 INFO:teuthology.orchestra.run.smithi044.stdout:subdir_head 2024-09-13T18:28:30.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.357+0000 7f7ce8fb6140 1 -- 172.21.15.44:0/2990640393 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x56015b2163f0 msgr2=0x56015b2caad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.357+0000 7f7ce8fb6140 1 --2- 172.21.15.44:0/2990640393 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x56015b2163f0 0x56015b2caad0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.357+0000 7f7ce8fb6140 1 -- 172.21.15.44:0/2990640393 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7cc8065090 msgr2=0x7f7cc8067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.357+0000 7f7ce8fb6140 1 --2- 172.21.15.44:0/2990640393 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7cc8065090 0x7f7cc8067550 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800b630 tx=0x7f7cd8008000 comp rx=0 tx=0).stop 2024-09-13T18:28:30.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.357+0000 7f7ce8fb6140 1 -- 172.21.15.44:0/2990640393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56015b233520 msgr2=0x56015b215eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.357+0000 7f7ce8fb6140 1 --2- 172.21.15.44:0/2990640393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56015b233520 0x56015b215eb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0013040 tx=0x7f7ce0003330 comp rx=0 tx=0).stop 2024-09-13T18:28:30.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.357+0000 7f7ce72ec700 1 -- 172.21.15.44:0/2990640393 reap_dead start 2024-09-13T18:28:30.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.357+0000 7f7ce8fb6140 1 -- 172.21.15.44:0/2990640393 shutdown_connections 2024-09-13T18:28:30.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.357+0000 7f7ce8fb6140 1 -- 172.21.15.44:0/2990640393 >> 172.21.15.44:0/2990640393 conn(0x56015b18c280 msgr2=0x56015b1a92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:30.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.357+0000 7f7ce8fb6140 1 -- 172.21.15.44:0/2990640393 shutdown_connections 2024-09-13T18:28:30.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.357+0000 7f7ce8fb6140 1 -- 172.21.15.44:0/2990640393 wait complete. 2024-09-13T18:28:30.369 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000001.00000000 2024-09-13T18:28:30.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.401+0000 7f7c47d28140 1 Processor -- start 2024-09-13T18:28:30.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.401+0000 7f7c47d28140 1 -- start start 2024-09-13T18:28:30.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c47d28140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563afd63f140 0x563afd6719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c47d28140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563afd715140 0x563afd715930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c47d28140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563afd715520 0x563afd715e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c47d28140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x563afd5d5a00 con 0x563afd715520 2024-09-13T18:28:30.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c47d28140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x563afd5d12f0 con 0x563afd63f140 2024-09-13T18:28:30.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c47d28140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x563afd58d8e0 con 0x563afd715140 2024-09-13T18:28:30.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c4605e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563afd715520 0x563afd715e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c4605e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563afd715520 0x563afd715e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52350/0 (socket says 172.21.15.44:52350) 2024-09-13T18:28:30.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c4505c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563afd715140 0x563afd715930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c4585d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563afd63f140 0x563afd6719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c4605e700 1 -- 172.21.15.44:0/3908672939 learned_addr learned my addr 172.21.15.44:0/3908672939 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:30.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c4505c700 1 -- 172.21.15.44:0/3908672939 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563afd63f140 msgr2=0x563afd6719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:30.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c4505c700 1 --2- 172.21.15.44:0/3908672939 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563afd63f140 0x563afd6719f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c4505c700 1 -- 172.21.15.44:0/3908672939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563afd715520 msgr2=0x563afd715e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:30.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c4505c700 1 --2- 172.21.15.44:0/3908672939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563afd715520 0x563afd715e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c4505c700 1 -- 172.21.15.44:0/3908672939 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c30005d20 con 0x563afd715140 2024-09-13T18:28:30.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c4505c700 1 --2- 172.21.15.44:0/3908672939 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563afd715140 0x563afd715930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7c30014000 tx=0x7f7c3000d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8177a5a8265d2ae8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c3ffff700 1 -- 172.21.15.44:0/3908672939 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c30008a00 con 0x563afd715140 2024-09-13T18:28:30.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c3ffff700 1 -- 172.21.15.44:0/3908672939 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c30008b60 con 0x563afd715140 2024-09-13T18:28:30.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c3ffff700 1 -- 172.21.15.44:0/3908672939 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c300054e0 con 0x563afd715140 2024-09-13T18:28:30.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c47d28140 1 -- 172.21.15.44:0/3908672939 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563afd715140 msgr2=0x563afd715930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c47d28140 1 --2- 172.21.15.44:0/3908672939 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563afd715140 0x563afd715930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7c30014000 tx=0x7f7c3000d000 comp rx=0 tx=0).stop 2024-09-13T18:28:30.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c47d28140 1 -- 172.21.15.44:0/3908672939 shutdown_connections 2024-09-13T18:28:30.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c47d28140 1 --2- 172.21.15.44:0/3908672939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563afd715520 0x563afd715e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c47d28140 1 --2- 172.21.15.44:0/3908672939 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563afd715140 0x563afd715930 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c47d28140 1 --2- 172.21.15.44:0/3908672939 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563afd63f140 0x563afd6719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c47d28140 1 -- 172.21.15.44:0/3908672939 >> 172.21.15.44:0/3908672939 conn(0x563afd66e280 msgr2=0x563afd6fab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:30.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c47d28140 1 -- 172.21.15.44:0/3908672939 shutdown_connections 2024-09-13T18:28:30.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.405+0000 7f7c47d28140 1 -- 172.21.15.44:0/3908672939 wait complete. 2024-09-13T18:28:30.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.409+0000 7f7c47d28140 1 Processor -- start 2024-09-13T18:28:30.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.409+0000 7f7c47d28140 1 -- start start 2024-09-13T18:28:30.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.409+0000 7f7c47d28140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563afd63f140 0x563afd6844c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.409+0000 7f7c47d28140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563afd715140 0x563afd7ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.409+0000 7f7c47d28140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563afd715520 0x563afd7aa380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.409+0000 7f7c47d28140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x563afd58d580 con 0x563afd63f140 2024-09-13T18:28:30.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.409+0000 7f7c47d28140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x563afd5638d0 con 0x563afd715520 2024-09-13T18:28:30.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.409+0000 7f7c47d28140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x563afd684b60 con 0x563afd715140 2024-09-13T18:28:30.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.409+0000 7f7c4585d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563afd63f140 0x563afd6844c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.409+0000 7f7c4585d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563afd63f140 0x563afd6844c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52360/0 (socket says 172.21.15.44:52360) 2024-09-13T18:28:30.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.409+0000 7f7c4585d700 1 -- 172.21.15.44:0/726745621 learned_addr learned my addr 172.21.15.44:0/726745621 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:30.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.409+0000 7f7c4605e700 1 --2- 172.21.15.44:0/726745621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563afd715520 0x563afd7aa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.409+0000 7f7c4505c700 1 --2- 172.21.15.44:0/726745621 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563afd715140 0x563afd7ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.413+0000 7f7c4585d700 1 -- 172.21.15.44:0/726745621 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563afd715140 msgr2=0x563afd7ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.413+0000 7f7c4585d700 1 --2- 172.21.15.44:0/726745621 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563afd715140 0x563afd7ad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.413+0000 7f7c4585d700 1 -- 172.21.15.44:0/726745621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563afd715520 msgr2=0x563afd7aa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.413+0000 7f7c4585d700 1 --2- 172.21.15.44:0/726745621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563afd715520 0x563afd7aa380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.413+0000 7f7c4585d700 1 -- 172.21.15.44:0/726745621 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563afd57bb00 con 0x563afd63f140 2024-09-13T18:28:30.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.413+0000 7f7c4605e700 1 --2- 172.21.15.44:0/726745621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563afd715520 0x563afd7aa380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:30.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.413+0000 7f7c4505c700 1 --2- 172.21.15.44:0/726745621 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563afd715140 0x563afd7ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:30.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.413+0000 7f7c4585d700 1 --2- 172.21.15.44:0/726745621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563afd63f140 0x563afd6844c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7c40005e60 tx=0x7f7c40001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.413+0000 7f7c3effd700 1 -- 172.21.15.44:0/726745621 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c400123f0 con 0x563afd63f140 2024-09-13T18:28:30.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.413+0000 7f7c3effd700 1 -- 172.21.15.44:0/726745621 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c40012550 con 0x563afd63f140 2024-09-13T18:28:30.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.413+0000 7f7c47d28140 1 -- 172.21.15.44:0/726745621 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563afd56ef40 con 0x563afd63f140 2024-09-13T18:28:30.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.413+0000 7f7c3effd700 1 -- 172.21.15.44:0/726745621 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c40012900 con 0x563afd63f140 2024-09-13T18:28:30.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.413+0000 7f7c47d28140 1 -- 172.21.15.44:0/726745621 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563afd56e9a0 con 0x563afd63f140 2024-09-13T18:28:30.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.413+0000 7f7c3effd700 1 -- 172.21.15.44:0/726745621 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7c40012a60 con 0x563afd63f140 2024-09-13T18:28:30.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.413+0000 7f7c3effd700 1 --2- 172.21.15.44:0/726745621 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7c2c065060 0x7f7c2c067520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.413+0000 7f7c3effd700 1 -- 172.21.15.44:0/726745621 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7c400829e0 con 0x563afd63f140 2024-09-13T18:28:30.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.417+0000 7f7c4505c700 1 --2- 172.21.15.44:0/726745621 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7c2c065060 0x7f7c2c067520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.417+0000 7f7c47d28140 1 --2- 172.21.15.44:0/726745621 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x563afd716c60 0x563afd685a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.417+0000 7f7c47d28140 1 -- 172.21.15.44:0/726745621 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:1 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x563afd685fc0 con 0x563afd716c60 2024-09-13T18:28:30.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.417+0000 7f7c4605e700 1 --2- 172.21.15.44:0/726745621 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x563afd716c60 0x563afd685a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.417+0000 7f7c4505c700 1 --2- 172.21.15.44:0/726745621 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7c2c065060 0x7f7c2c067520 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x563afd7174d0 tx=0x7f7c30008000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.417+0000 7f7c4605e700 1 --2- 172.21.15.44:0/726745621 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x563afd716c60 0x563afd685a80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.417+0000 7f7c4605e700 1 -- 172.21.15.44:0/726745621 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== osd_op_reply(1 10000000001.00000000 [omap-get-keys out=42b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+42 (crc 0 0 0) 0x7f7c38001a70 con 0x563afd716c60 2024-09-13T18:28:30.425 INFO:teuthology.orchestra.run.smithi044.stdout:subdirfile_head 2024-09-13T18:28:30.425 INFO:teuthology.orchestra.run.smithi044.stdout:subsubdir_head 2024-09-13T18:28:30.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.417+0000 7f7c47d28140 1 -- 172.21.15.44:0/726745621 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x563afd716c60 msgr2=0x563afd685a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.417+0000 7f7c47d28140 1 --2- 172.21.15.44:0/726745621 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x563afd716c60 0x563afd685a80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.417+0000 7f7c47d28140 1 -- 172.21.15.44:0/726745621 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7c2c065060 msgr2=0x7f7c2c067520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.417+0000 7f7c47d28140 1 --2- 172.21.15.44:0/726745621 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7c2c065060 0x7f7c2c067520 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x563afd7174d0 tx=0x7f7c30008000 comp rx=0 tx=0).stop 2024-09-13T18:28:30.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.417+0000 7f7c47d28140 1 -- 172.21.15.44:0/726745621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563afd63f140 msgr2=0x563afd6844c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.417+0000 7f7c47d28140 1 --2- 172.21.15.44:0/726745621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563afd63f140 0x563afd6844c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7c40005e60 tx=0x7f7c40001930 comp rx=0 tx=0).stop 2024-09-13T18:28:30.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.417+0000 7f7c4605e700 1 -- 172.21.15.44:0/726745621 reap_dead start 2024-09-13T18:28:30.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.417+0000 7f7c47d28140 1 -- 172.21.15.44:0/726745621 shutdown_connections 2024-09-13T18:28:30.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.417+0000 7f7c47d28140 1 -- 172.21.15.44:0/726745621 >> 172.21.15.44:0/726745621 conn(0x563afd66e280 msgr2=0x563afd7143c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:30.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.417+0000 7f7c47d28140 1 -- 172.21.15.44:0/726745621 shutdown_connections 2024-09-13T18:28:30.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.417+0000 7f7c47d28140 1 -- 172.21.15.44:0/726745621 wait complete. 2024-09-13T18:28:30.428 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 100000001f7.00000000 2024-09-13T18:28:30.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.461+0000 7fd04f732140 1 Processor -- start 2024-09-13T18:28:30.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.461+0000 7fd04f732140 1 -- start start 2024-09-13T18:28:30.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.461+0000 7fd04f732140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cec0d68160 0x55cec0df4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.461+0000 7fd04f732140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cec0d68540 0x55cec0d4cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.461+0000 7fd04f732140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cec0dd8a10 0x55cec0d4d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.461+0000 7fd04f732140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cec0cb02f0 con 0x55cec0dd8a10 2024-09-13T18:28:30.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.461+0000 7fd04f732140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cec0c6c8e0 con 0x55cec0d68160 2024-09-13T18:28:30.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.461+0000 7fd04f732140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cec0c6c580 con 0x55cec0d68540 2024-09-13T18:28:30.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.461+0000 7fd04da68700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cec0dd8a10 0x55cec0d4d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.461+0000 7fd04da68700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cec0dd8a10 0x55cec0d4d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52386/0 (socket says 172.21.15.44:52386) 2024-09-13T18:28:30.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.461+0000 7fd04d267700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cec0d68160 0x55cec0df4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.461+0000 7fd04da68700 1 -- 172.21.15.44:0/714619681 learned_addr learned my addr 172.21.15.44:0/714619681 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:30.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.461+0000 7fd04ca66700 1 --2- 172.21.15.44:0/714619681 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cec0d68540 0x55cec0d4cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.461+0000 7fd04da68700 1 -- 172.21.15.44:0/714619681 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cec0d68540 msgr2=0x55cec0d4cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:30.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.461+0000 7fd04da68700 1 --2- 172.21.15.44:0/714619681 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cec0d68540 0x55cec0d4cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.461+0000 7fd04da68700 1 -- 172.21.15.44:0/714619681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cec0d68160 msgr2=0x55cec0df4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:30.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.461+0000 7fd04da68700 1 --2- 172.21.15.44:0/714619681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cec0d68160 0x55cec0df4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.461+0000 7fd04da68700 1 -- 172.21.15.44:0/714619681 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd044005d20 con 0x55cec0dd8a10 2024-09-13T18:28:30.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.461+0000 7fd04d267700 1 --2- 172.21.15.44:0/714619681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cec0d68160 0x55cec0df4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:30.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.465+0000 7fd04da68700 1 --2- 172.21.15.44:0/714619681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cec0dd8a10 0x55cec0d4d430 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd04800b6f0 tx=0x7fd04800ba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b73475ad4d6495c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.465+0000 7fd03f7fe700 1 -- 172.21.15.44:0/714619681 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd048011600 con 0x55cec0dd8a10 2024-09-13T18:28:30.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.465+0000 7fd03f7fe700 1 -- 172.21.15.44:0/714619681 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd048011760 con 0x55cec0dd8a10 2024-09-13T18:28:30.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.465+0000 7fd03f7fe700 1 -- 172.21.15.44:0/714619681 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd048011b10 con 0x55cec0dd8a10 2024-09-13T18:28:30.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.465+0000 7fd04f732140 1 -- 172.21.15.44:0/714619681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cec0dd8a10 msgr2=0x55cec0d4d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.465+0000 7fd04f732140 1 --2- 172.21.15.44:0/714619681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cec0dd8a10 0x55cec0d4d430 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd04800b6f0 tx=0x7fd04800ba00 comp rx=0 tx=0).stop 2024-09-13T18:28:30.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.465+0000 7fd04f732140 1 -- 172.21.15.44:0/714619681 shutdown_connections 2024-09-13T18:28:30.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.465+0000 7fd04f732140 1 --2- 172.21.15.44:0/714619681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cec0dd8a10 0x55cec0d4d430 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.465+0000 7fd04f732140 1 --2- 172.21.15.44:0/714619681 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cec0d68540 0x55cec0d4cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.465+0000 7fd04f732140 1 --2- 172.21.15.44:0/714619681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cec0d68160 0x55cec0df4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.465+0000 7fd04f732140 1 -- 172.21.15.44:0/714619681 >> 172.21.15.44:0/714619681 conn(0x55cec0d1c5a0 msgr2=0x55cec0df52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:30.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.465+0000 7fd04f732140 1 -- 172.21.15.44:0/714619681 shutdown_connections 2024-09-13T18:28:30.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.465+0000 7fd04f732140 1 -- 172.21.15.44:0/714619681 wait complete. 2024-09-13T18:28:30.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.465+0000 7fd04f732140 1 Processor -- start 2024-09-13T18:28:30.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.465+0000 7fd04f732140 1 -- start start 2024-09-13T18:28:30.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.469+0000 7fd04f732140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cec0d68160 0x55cec0df30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.469+0000 7fd04f732140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cec0d68540 0x55cec0d4da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.469+0000 7fd04f732140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cec0dd8a10 0x55cec0d4dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.469+0000 7fd04f732140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cec0c428d0 con 0x55cec0d68540 2024-09-13T18:28:30.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.469+0000 7fd04f732140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cec0d650f0 con 0x55cec0dd8a10 2024-09-13T18:28:30.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.469+0000 7fd04f732140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cec0d65390 con 0x55cec0d68160 2024-09-13T18:28:30.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.469+0000 7fd04ca66700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cec0d68540 0x55cec0d4da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.469+0000 7fd04ca66700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cec0d68540 0x55cec0d4da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52392/0 (socket says 172.21.15.44:52392) 2024-09-13T18:28:30.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.469+0000 7fd04ca66700 1 -- 172.21.15.44:0/1533235458 learned_addr learned my addr 172.21.15.44:0/1533235458 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:30.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.469+0000 7fd04da68700 1 --2- 172.21.15.44:0/1533235458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cec0dd8a10 0x55cec0d4dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.469+0000 7fd04d267700 1 --2- 172.21.15.44:0/1533235458 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cec0d68160 0x55cec0df30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.469+0000 7fd04ca66700 1 -- 172.21.15.44:0/1533235458 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cec0d68160 msgr2=0x55cec0df30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.469+0000 7fd04ca66700 1 --2- 172.21.15.44:0/1533235458 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cec0d68160 0x55cec0df30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.469+0000 7fd04ca66700 1 -- 172.21.15.44:0/1533235458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cec0dd8a10 msgr2=0x55cec0d4dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.469+0000 7fd04ca66700 1 --2- 172.21.15.44:0/1533235458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cec0dd8a10 0x55cec0d4dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.469+0000 7fd04ca66700 1 -- 172.21.15.44:0/1533235458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cec0c74ca0 con 0x55cec0d68540 2024-09-13T18:28:30.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.469+0000 7fd04ca66700 1 --2- 172.21.15.44:0/1533235458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cec0d68540 0x55cec0d4da90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd04000c580 tx=0x7fd04000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.469+0000 7fd03e7fc700 1 -- 172.21.15.44:0/1533235458 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd040016030 con 0x55cec0d68540 2024-09-13T18:28:30.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.469+0000 7fd03e7fc700 1 -- 172.21.15.44:0/1533235458 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd040005070 con 0x55cec0d68540 2024-09-13T18:28:30.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.469+0000 7fd04f732140 1 -- 172.21.15.44:0/1533235458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04800b3a0 con 0x55cec0d68540 2024-09-13T18:28:30.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.469+0000 7fd03e7fc700 1 -- 172.21.15.44:0/1533235458 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0400116a0 con 0x55cec0d68540 2024-09-13T18:28:30.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.469+0000 7fd04f732140 1 -- 172.21.15.44:0/1533235458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cec0c5ab00 con 0x55cec0d68540 2024-09-13T18:28:30.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.473+0000 7fd03e7fc700 1 -- 172.21.15.44:0/1533235458 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd040019070 con 0x55cec0d68540 2024-09-13T18:28:30.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.473+0000 7fd03e7fc700 1 --2- 172.21.15.44:0/1533235458 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd030065090 0x7fd030067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.473+0000 7fd03e7fc700 1 -- 172.21.15.44:0/1533235458 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd040017070 con 0x55cec0d68540 2024-09-13T18:28:30.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.473+0000 7fd04d267700 1 --2- 172.21.15.44:0/1533235458 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd030065090 0x7fd030067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.473+0000 7fd04f732140 1 --2- 172.21.15.44:0/1533235458 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x55cec0e87f10 0x55cec0e88320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.473+0000 7fd04f732140 1 -- 172.21.15.44:0/1533235458 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:1 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x55cec0e88860 con 0x55cec0e87f10 2024-09-13T18:28:30.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.473+0000 7fd04da68700 1 --2- 172.21.15.44:0/1533235458 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x55cec0e87f10 0x55cec0e88320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.473+0000 7fd04d267700 1 --2- 172.21.15.44:0/1533235458 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd030065090 0x7fd030067550 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd04400a440 tx=0x7fd04400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.473+0000 7fd04da68700 1 --2- 172.21.15.44:0/1533235458 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x55cec0e87f10 0x55cec0e88320 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.473+0000 7fd04da68700 1 -- 172.21.15.44:0/1533235458 <== osd.0 v2:172.21.15.44:6800/2647753462 1 ==== osd_op_reply(1 100000001f7.00000000 [omap-get-keys out=61b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+61 (crc 0 0 0) 0x7fd048017070 con 0x55cec0e87f10 2024-09-13T18:28:30.482 INFO:teuthology.orchestra.run.smithi044.stdout:link0_head 2024-09-13T18:28:30.482 INFO:teuthology.orchestra.run.smithi044.stdout:link1_head 2024-09-13T18:28:30.482 INFO:teuthology.orchestra.run.smithi044.stdout:link2_head 2024-09-13T18:28:30.482 INFO:teuthology.orchestra.run.smithi044.stdout:link3_head 2024-09-13T18:28:30.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.473+0000 7fd04f732140 1 -- 172.21.15.44:0/1533235458 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x55cec0e87f10 msgr2=0x55cec0e88320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.473+0000 7fd04f732140 1 --2- 172.21.15.44:0/1533235458 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x55cec0e87f10 0x55cec0e88320 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.477+0000 7fd04f732140 1 -- 172.21.15.44:0/1533235458 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd030065090 msgr2=0x7fd030067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.477+0000 7fd04f732140 1 --2- 172.21.15.44:0/1533235458 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd030065090 0x7fd030067550 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd04400a440 tx=0x7fd04400f000 comp rx=0 tx=0).stop 2024-09-13T18:28:30.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.477+0000 7fd04f732140 1 -- 172.21.15.44:0/1533235458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cec0d68540 msgr2=0x55cec0d4da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.477+0000 7fd04f732140 1 --2- 172.21.15.44:0/1533235458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cec0d68540 0x55cec0d4da90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd04000c580 tx=0x7fd04000c890 comp rx=0 tx=0).stop 2024-09-13T18:28:30.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.477+0000 7fd04da68700 1 -- 172.21.15.44:0/1533235458 reap_dead start 2024-09-13T18:28:30.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.477+0000 7fd04f732140 1 -- 172.21.15.44:0/1533235458 shutdown_connections 2024-09-13T18:28:30.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.477+0000 7fd04f732140 1 -- 172.21.15.44:0/1533235458 >> 172.21.15.44:0/1533235458 conn(0x55cec0d1c5a0 msgr2=0x55cec0d20800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:30.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.477+0000 7fd04f732140 1 -- 172.21.15.44:0/1533235458 shutdown_connections 2024-09-13T18:28:30.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.477+0000 7fd04f732140 1 -- 172.21.15.44:0/1533235458 wait complete. 2024-09-13T18:28:30.487 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --yes-i-really-really-mean-it 2024-09-13T18:28:30.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.521+0000 7f0a68876500 1 -- start start 2024-09-13T18:28:30.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.521+0000 7f0a68876500 1 Processor -- start 2024-09-13T18:28:30.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a68876500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637e69ed800 0x5637e6a92580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a68876500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e69ed400 0x5637e6a92b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a68876500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637e69ed000 0x5637e6a93080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a68876500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e6a23e00 con 0x5637e69ed400 2024-09-13T18:28:30.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a68876500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e6a6ea00 con 0x5637e69ed000 2024-09-13T18:28:30.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a68876500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5637e6a6e640 con 0x5637e69ed800 2024-09-13T18:28:30.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a6682f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e69ed400 0x5637e6a92b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a6682f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e69ed400 0x5637e6a92b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52422/0 (socket says 172.21.15.44:52422) 2024-09-13T18:28:30.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a6682f700 1 -- 172.21.15.44:0/1123206739 learned_addr learned my addr 172.21.15.44:0/1123206739 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:30.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a67831700 1 --2- 172.21.15.44:0/1123206739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637e69ed000 0x5637e6a93080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a67030700 1 --2- 172.21.15.44:0/1123206739 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637e69ed800 0x5637e6a92580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a6682f700 1 -- 172.21.15.44:0/1123206739 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637e69ed800 msgr2=0x5637e6a92580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:30.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a6682f700 1 --2- 172.21.15.44:0/1123206739 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637e69ed800 0x5637e6a92580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a6682f700 1 -- 172.21.15.44:0/1123206739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637e69ed000 msgr2=0x5637e6a93080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:30.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a6682f700 1 --2- 172.21.15.44:0/1123206739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637e69ed000 0x5637e6a93080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a6682f700 1 -- 172.21.15.44:0/1123206739 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637e6a109c0 con 0x5637e69ed400 2024-09-13T18:28:30.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a6682f700 1 --2- 172.21.15.44:0/1123206739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e69ed400 0x5637e6a92b00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x5637e6aff230 tx=0x5637e6ac32c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa20fec78fec77de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a6482b700 1 -- 172.21.15.44:0/1123206739 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5637e6a3d080 con 0x5637e69ed400 2024-09-13T18:28:30.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a6482b700 1 -- 172.21.15.44:0/1123206739 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5637e77d8300 con 0x5637e69ed400 2024-09-13T18:28:30.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a6482b700 1 -- 172.21.15.44:0/1123206739 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5637e6a3d600 con 0x5637e69ed400 2024-09-13T18:28:30.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a68876500 1 -- 172.21.15.44:0/1123206739 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5637e6a101a0 con 0x5637e69ed400 2024-09-13T18:28:30.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a68876500 1 -- 172.21.15.44:0/1123206739 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5637e6a109c0 con 0x5637e69ed400 2024-09-13T18:28:30.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a68876500 4 waiting for MDS map... 2024-09-13T18:28:30.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a6482b700 1 -- 172.21.15.44:0/1123206739 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x5637e6a26c40 con 0x5637e69ed400 2024-09-13T18:28:30.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a6482b700 1 -- 172.21.15.44:0/1123206739 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 16) v1 ==== 2573+0+0 (secure 0 0 0) 0x5637e6a2ef00 con 0x5637e69ed400 2024-09-13T18:28:30.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a68876500 4 Got MDS map 16 2024-09-13T18:28:30.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a68876500 10 main: JournalTool::main 2024-09-13T18:28:30.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a68876500 4 main: JournalTool: connecting to RADOS... 2024-09-13T18:28:30.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.525+0000 7f0a68876500 1 Processor -- start 2024-09-13T18:28:30.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.529+0000 7f0a68876500 1 -- start start 2024-09-13T18:28:30.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.529+0000 7f0a68876500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e6ce6400 0x5637e6a93600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.529+0000 7f0a68876500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637e6ce6800 0x5637e6a93b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.529+0000 7f0a68876500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637e6ce6c00 0x5637e6a94100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.529+0000 7f0a68876500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e6a6e500 con 0x5637e6ce6400 2024-09-13T18:28:30.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.529+0000 7f0a68876500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e6a6e3c0 con 0x5637e6ce6c00 2024-09-13T18:28:30.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.529+0000 7f0a68876500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5637e6a6e640 con 0x5637e6ce6800 2024-09-13T18:28:30.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.529+0000 7f0a67831700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e6ce6400 0x5637e6a93600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.529+0000 7f0a67831700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e6ce6400 0x5637e6a93600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52424/0 (socket says 172.21.15.44:52424) 2024-09-13T18:28:30.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.529+0000 7f0a67030700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637e6ce6800 0x5637e6a93b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.529+0000 7f0a6682f700 1 --2- 172.21.15.44:0/3011882219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637e6ce6c00 0x5637e6a94100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.529+0000 7f0a67831700 1 -- 172.21.15.44:0/3011882219 learned_addr learned my addr 172.21.15.44:0/3011882219 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:30.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.529+0000 7f0a67030700 1 -- 172.21.15.44:0/3011882219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637e6ce6c00 msgr2=0x5637e6a94100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:30.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.529+0000 7f0a67030700 1 --2- 172.21.15.44:0/3011882219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637e6ce6c00 0x5637e6a94100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.529+0000 7f0a67030700 1 -- 172.21.15.44:0/3011882219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e6ce6400 msgr2=0x5637e6a93600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:30.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.529+0000 7f0a67030700 1 --2- 172.21.15.44:0/3011882219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e6ce6400 0x5637e6a93600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.529+0000 7f0a67030700 1 -- 172.21.15.44:0/3011882219 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637e6a10b60 con 0x5637e6ce6800 2024-09-13T18:28:30.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.529+0000 7f0a67831700 1 --2- 172.21.15.44:0/3011882219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e6ce6400 0x5637e6a93600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:30.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.529+0000 7f0a6682f700 1 --2- 172.21.15.44:0/3011882219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637e6ce6c00 0x5637e6a94100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:30.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.529+0000 7f0a67030700 1 --2- 172.21.15.44:0/3011882219 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637e6ce6800 0x5637e6a93b80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x5637e6d2c780 tx=0x5637e7876b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db5a27be8a696a0e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.529+0000 7f0a62827700 1 -- 172.21.15.44:0/3011882219 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5637e6a3d080 con 0x5637e6ce6800 2024-09-13T18:28:30.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.529+0000 7f0a62827700 1 -- 172.21.15.44:0/3011882219 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5637e77d9980 con 0x5637e6ce6800 2024-09-13T18:28:30.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.529+0000 7f0a62827700 1 -- 172.21.15.44:0/3011882219 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5637e6a3d600 con 0x5637e6ce6800 2024-09-13T18:28:30.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.533+0000 7f0a68876500 1 -- 172.21.15.44:0/3011882219 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637e6ce6800 msgr2=0x5637e6a93b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.533+0000 7f0a68876500 1 --2- 172.21.15.44:0/3011882219 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637e6ce6800 0x5637e6a93b80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x5637e6d2c780 tx=0x5637e7876b40 comp rx=0 tx=0).stop 2024-09-13T18:28:30.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.533+0000 7f0a68876500 1 -- 172.21.15.44:0/3011882219 shutdown_connections 2024-09-13T18:28:30.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.533+0000 7f0a68876500 1 --2- 172.21.15.44:0/3011882219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637e6ce6c00 0x5637e6a94100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.533+0000 7f0a68876500 1 --2- 172.21.15.44:0/3011882219 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637e6ce6800 0x5637e6a93b80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.533+0000 7f0a68876500 1 --2- 172.21.15.44:0/3011882219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e6ce6400 0x5637e6a93600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.533+0000 7f0a68876500 1 -- 172.21.15.44:0/3011882219 >> 172.21.15.44:0/3011882219 conn(0x5637e69ecc00 msgr2=0x5637e6add800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:30.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.533+0000 7f0a68876500 1 -- 172.21.15.44:0/3011882219 shutdown_connections 2024-09-13T18:28:30.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.533+0000 7f0a68876500 1 -- 172.21.15.44:0/3011882219 wait complete. 2024-09-13T18:28:30.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.533+0000 7f0a68876500 1 Processor -- start 2024-09-13T18:28:30.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.533+0000 7f0a68876500 1 -- start start 2024-09-13T18:28:30.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.533+0000 7f0a68876500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637e6ce6400 0x5637e6a95180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.533+0000 7f0a68876500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637e6ce6800 0x5637e6a94c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.533+0000 7f0a68876500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e6ce6c00 0x5637e6a94680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.533+0000 7f0a68876500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e6a6e280 con 0x5637e6ce6c00 2024-09-13T18:28:30.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.533+0000 7f0a68876500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e6a6e140 con 0x5637e6ce6800 2024-09-13T18:28:30.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.533+0000 7f0a68876500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5637e6a6e000 con 0x5637e6ce6400 2024-09-13T18:28:30.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.533+0000 7f0a67831700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637e6ce6400 0x5637e6a95180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.537+0000 7f0a67030700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637e6ce6800 0x5637e6a94c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.537+0000 7f0a67831700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637e6ce6400 0x5637e6a95180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:38500/0 (socket says 172.21.15.44:38500) 2024-09-13T18:28:30.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.533+0000 7f0a6682f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e6ce6c00 0x5637e6a94680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.537+0000 7f0a67831700 1 -- 172.21.15.44:0/454728319 learned_addr learned my addr 172.21.15.44:0/454728319 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:30.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.537+0000 7f0a6682f700 1 -- 172.21.15.44:0/454728319 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637e6ce6400 msgr2=0x5637e6a95180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.537+0000 7f0a6682f700 1 --2- 172.21.15.44:0/454728319 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637e6ce6400 0x5637e6a95180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.537+0000 7f0a6682f700 1 -- 172.21.15.44:0/454728319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637e6ce6800 msgr2=0x5637e6a94c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.537+0000 7f0a6682f700 1 --2- 172.21.15.44:0/454728319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637e6ce6800 0x5637e6a94c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.537+0000 7f0a6682f700 1 -- 172.21.15.44:0/454728319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637e6a10340 con 0x5637e6ce6c00 2024-09-13T18:28:30.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.537+0000 7f0a67030700 1 --2- 172.21.15.44:0/454728319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637e6ce6800 0x5637e6a94c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:30.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.537+0000 7f0a6682f700 1 --2- 172.21.15.44:0/454728319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e6ce6c00 0x5637e6a94680 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x5637e6aff770 tx=0x5637e6ac3260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.537+0000 7f0a61024700 1 -- 172.21.15.44:0/454728319 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5637e6a3d1e0 con 0x5637e6ce6c00 2024-09-13T18:28:30.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.537+0000 7f0a61024700 1 -- 172.21.15.44:0/454728319 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5637e77d9500 con 0x5637e6ce6c00 2024-09-13T18:28:30.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.537+0000 7f0a68876500 1 -- 172.21.15.44:0/454728319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5637e6a10000 con 0x5637e6ce6c00 2024-09-13T18:28:30.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.537+0000 7f0a61024700 1 -- 172.21.15.44:0/454728319 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5637e6a3cf20 con 0x5637e6ce6c00 2024-09-13T18:28:30.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.537+0000 7f0a68876500 1 -- 172.21.15.44:0/454728319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5637e6a10ea0 con 0x5637e6ce6c00 2024-09-13T18:28:30.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.537+0000 7f0a68876500 4 main: JournalTool: resolving pool 4 2024-09-13T18:28:30.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.541+0000 7f0a61024700 1 -- 172.21.15.44:0/454728319 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x5637e6a4c840 con 0x5637e6ce6c00 2024-09-13T18:28:30.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.541+0000 7f0a61024700 1 --2- 172.21.15.44:0/454728319 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5637e6d56400 0x5637e6a95700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.541+0000 7f0a61024700 1 -- 172.21.15.44:0/454728319 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x5637e6a26a80 con 0x5637e6ce6c00 2024-09-13T18:28:30.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.541+0000 7f0a68876500 4 main: JournalTool: creating IoCtx.. 2024-09-13T18:28:30.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.541+0000 7f0a68876500 4 main: Executing for rank 0 2024-09-13T18:28:30.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.541+0000 7f0a67831700 1 --2- 172.21.15.44:0/454728319 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5637e6d56400 0x5637e6a95700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.541+0000 7f0a67831700 1 --2- 172.21.15.44:0/454728319 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5637e6d56400 0x5637e6a95700 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x5637e6d2d440 tx=0x5637e6e40c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.541+0000 7f0a68876500 1 -- start start 2024-09-13T18:28:30.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.541+0000 7f0a68876500 1 Processor -- start 2024-09-13T18:28:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.541+0000 7f0a68876500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637e6ce7400 0x5637e6a94100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.541+0000 7f0a68876500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e6ce7800 0x5637e6a93b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.541+0000 7f0a68876500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637e6d56800 0x5637e6a93600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.541+0000 7f0a68876500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e6a6f040 con 0x5637e6ce7800 2024-09-13T18:28:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.541+0000 7f0a68876500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e6a6ea00 con 0x5637e6ce7400 2024-09-13T18:28:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.541+0000 7f0a68876500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5637e6a6e000 con 0x5637e6d56800 2024-09-13T18:28:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.541+0000 7f0a67030700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e6ce7800 0x5637e6a93b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.541+0000 7f0a67030700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e6ce7800 0x5637e6a93b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52444/0 (socket says 172.21.15.44:52444) 2024-09-13T18:28:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.541+0000 7f0a67030700 1 -- 172.21.15.44:0/978326812 learned_addr learned my addr 172.21.15.44:0/978326812 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.541+0000 7f0a67831700 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637e6ce7400 0x5637e6a94100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.541+0000 7f0a6682f700 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637e6d56800 0x5637e6a93600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a67030700 1 -- 172.21.15.44:0/978326812 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637e6d56800 msgr2=0x5637e6a93600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a67030700 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637e6d56800 0x5637e6a93600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a67030700 1 -- 172.21.15.44:0/978326812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637e6ce7400 msgr2=0x5637e6a94100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a67030700 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637e6ce7400 0x5637e6a94100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a67030700 1 -- 172.21.15.44:0/978326812 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637e6d8f520 con 0x5637e6ce7800 2024-09-13T18:28:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a67030700 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e6ce7800 0x5637e6a93b80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x5637e6d943c0 tx=0x5637e6cdc120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee24b7a1a0b9d5f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a5e01e700 1 -- 172.21.15.44:0/978326812 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5637e6a3cdc0 con 0x5637e6ce7800 2024-09-13T18:28:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a5e01e700 1 -- 172.21.15.44:0/978326812 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5637e77d8300 con 0x5637e6ce7800 2024-09-13T18:28:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a5e01e700 1 -- 172.21.15.44:0/978326812 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5637e6a3d600 con 0x5637e6ce7800 2024-09-13T18:28:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a68876500 1 -- 172.21.15.44:0/978326812 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5637e6d8d860 con 0x5637e6ce7800 2024-09-13T18:28:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a68876500 1 -- 172.21.15.44:0/978326812 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5637e6d8d6c0 con 0x5637e6ce7800 2024-09-13T18:28:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a68876500 4 waiting for MDS map... 2024-09-13T18:28:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a5e01e700 1 -- 172.21.15.44:0/978326812 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x5637e6a26700 con 0x5637e6ce7800 2024-09-13T18:28:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a5e01e700 1 -- 172.21.15.44:0/978326812 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 16) v1 ==== 2573+0+0 (secure 0 0 0) 0x5637e77d1800 con 0x5637e6ce7800 2024-09-13T18:28:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a68876500 4 Got MDS map 16 2024-09-13T18:28:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a68876500 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x5637e6d56c00 0x5637e6eb4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a68876500 1 -- 172.21.15.44:0/978326812 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:1 4.f 4:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x5637e6d57000 con 0x5637e6d56c00 2024-09-13T18:28:30.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a67831700 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x5637e6d56c00 0x5637e6eb4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a67831700 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x5637e6d56c00 0x5637e6eb4000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=8bce22cae5670fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a67831700 1 -- 172.21.15.44:0/978326812 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x5637e775ab40 con 0x5637e6d56c00 2024-09-13T18:28:30.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a68876500 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5637e6d57400 0x5637e6eb4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a68876500 1 -- 172.21.15.44:0/978326812 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:2 4.14 4:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x5637e6d57800 con 0x5637e6d57400 2024-09-13T18:28:30.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a6682f700 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5637e6d57400 0x5637e6eb4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.545+0000 7f0a6682f700 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5637e6d57400 0x5637e6eb4580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=6b77ea9cedb9dedd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.549+0000 7f0a6682f700 1 -- 172.21.15.44:0/978326812 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv17 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x5637e775ad80 con 0x5637e6d57400 2024-09-13T18:28:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.549+0000 7f0a5c81b700 1 -- 172.21.15.44:0/978326812 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:3 4.14 4:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e36) v8 -- 0x5637e6e9ac00 con 0x5637e6d57400 2024-09-13T18:28:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.549+0000 7f0a5c81b700 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x5637e6e9b000 0x5637e6eb6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.549+0000 7f0a5c81b700 1 -- 172.21.15.44:0/978326812 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:4 4.1b 4:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e36) v8 -- 0x5637e6e9b400 con 0x5637e6e9b000 2024-09-13T18:28:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.549+0000 7f0a67831700 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x5637e6e9b000 0x5637e6eb6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.549+0000 7f0a6682f700 1 -- 172.21.15.44:0/978326812 <== osd.3 v2:172.21.15.44:6808/771281770 2 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv22 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x5637e775ad80 con 0x5637e6d57400 2024-09-13T18:28:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.549+0000 7f0a67831700 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x5637e6e9b000 0x5637e6eb6680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=e4d72797bf77b529 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.549+0000 7f0a67831700 1 -- 172.21.15.44:0/978326812 <== osd.4 v2:172.21.15.99:6816/2515272044 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5637e775ab40 con 0x5637e6e9b000 2024-09-13T18:28:30.557 INFO:teuthology.orchestra.run.smithi044.stdout:old journal was 4194304~52204 2024-09-13T18:28:30.557 INFO:teuthology.orchestra.run.smithi044.stdout:new journal start will be 8388608 (4142100 bytes past old end) 2024-09-13T18:28:30.557 INFO:teuthology.orchestra.run.smithi044.stdout:writing journal head 2024-09-13T18:28:30.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.549+0000 7f0a68876500 1 -- 172.21.15.44:0/978326812 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:5 4.14 4:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x5637e6d57c00 con 0x5637e6d57400 2024-09-13T18:28:30.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.553+0000 7f0a6682f700 1 -- 172.21.15.44:0/978326812 <== osd.3 v2:172.21.15.44:6808/771281770 3 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v36'32 uv32 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5637e775ad80 con 0x5637e6d57400 2024-09-13T18:28:30.559 INFO:teuthology.orchestra.run.smithi044.stdout:writing EResetJournal entry 2024-09-13T18:28:30.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.553+0000 7f0a68876500 1 -- 172.21.15.44:0/978326812 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:6 4.1b 4:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x5637e6e9b400 con 0x5637e6e9b000 2024-09-13T18:28:30.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.553+0000 7f0a68876500 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x5637e6e9b800 0x5637e6eb4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.553+0000 7f0a68876500 1 -- 172.21.15.44:0/978326812 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:7 4.b 4:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x5637e6e9bc00 con 0x5637e6e9b800 2024-09-13T18:28:30.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.553+0000 7f0a68876500 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x5637e6d57000 0x5637e6eb5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.553+0000 7f0a68876500 1 -- 172.21.15.44:0/978326812 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:8 4.1f 4:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x5637e6ec8000 con 0x5637e6d57000 2024-09-13T18:28:30.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.553+0000 7f0a68876500 1 -- 172.21.15.44:0/978326812 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:9 4.1a 4:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x5637e6ec8400 con 0x5637e6e9b000 2024-09-13T18:28:30.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.553+0000 7f0a68876500 1 -- 172.21.15.44:0/978326812 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:10 4.1e 4:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x5637e6ec8800 con 0x5637e6e9b800 2024-09-13T18:28:30.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.553+0000 7f0a68876500 1 -- 172.21.15.44:0/978326812 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:11 4.1d 4:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x5637e6ec8c00 con 0x5637e6d57400 2024-09-13T18:28:30.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.553+0000 7f0a67030700 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x5637e6e9b800 0x5637e6eb4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.553+0000 7f0a6682f700 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x5637e6d57000 0x5637e6eb5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.553+0000 7f0a67030700 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x5637e6e9b800 0x5637e6eb4b00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=5b379077ccfe8eda server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.553+0000 7f0a6682f700 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x5637e6d57000 0x5637e6eb5080 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=887e392c8bc0a3ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.553+0000 7f0a67831700 1 -- 172.21.15.44:0/978326812 <== osd.4 v2:172.21.15.99:6816/2515272044 2 ==== osd_op_reply(6 200.00000002 [delete] v36'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5637e775ab40 con 0x5637e6e9b000 2024-09-13T18:28:30.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.557+0000 7f0a6682f700 1 -- 172.21.15.44:0/978326812 <== osd.3 v2:172.21.15.44:6808/771281770 4 ==== osd_op_reply(11 200.00000007 [delete] v36'4 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5637e775ad80 con 0x5637e6d57400 2024-09-13T18:28:30.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.557+0000 7f0a67030700 1 -- 172.21.15.44:0/978326812 <== osd.0 v2:172.21.15.44:6800/2647753462 1 ==== osd_op_reply(7 200.00000003 [delete] v36'4 uv1 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5637e775b8c0 con 0x5637e6e9b800 2024-09-13T18:28:30.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.557+0000 7f0a67030700 1 -- 172.21.15.44:0/978326812 <== osd.0 v2:172.21.15.44:6800/2647753462 2 ==== osd_op_reply(10 200.00000006 [delete] v36'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5637e775b8c0 con 0x5637e6e9b800 2024-09-13T18:28:30.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.557+0000 7f0a5c81b700 1 -- 172.21.15.44:0/978326812 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:12 4.1b 4:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x5637e6d57800 con 0x5637e6e9b000 2024-09-13T18:28:30.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.557+0000 7f0a67831700 1 -- 172.21.15.44:0/978326812 <== osd.4 v2:172.21.15.99:6816/2515272044 3 ==== osd_op_reply(9 200.00000005 [delete] v36'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5637e775ab40 con 0x5637e6e9b000 2024-09-13T18:28:30.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.557+0000 7f0a6682f700 1 -- 172.21.15.44:0/978326812 <== osd.6 v2:172.21.15.99:6808/2907584318 1 ==== osd_op_reply(8 200.00000004 [delete] v36'45 uv44 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5637e775ad80 con 0x5637e6d57000 2024-09-13T18:28:30.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a67831700 1 -- 172.21.15.44:0/978326812 <== osd.4 v2:172.21.15.99:6816/2515272044 4 ==== osd_op_reply(12 200.00000002 [write 0~48] v36'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5637e775ab40 con 0x5637e6e9b000 2024-09-13T18:28:30.567 INFO:teuthology.orchestra.run.smithi044.stdout:done 2024-09-13T18:28:30.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 -- 172.21.15.44:0/978326812 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x5637e6e9b800 msgr2=0x5637e6eb4b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x5637e6e9b800 0x5637e6eb4b00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 -- 172.21.15.44:0/978326812 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x5637e6d56c00 msgr2=0x5637e6eb4000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x5637e6d56c00 0x5637e6eb4000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 -- 172.21.15.44:0/978326812 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5637e6d57400 msgr2=0x5637e6eb4580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5637e6d57400 0x5637e6eb4580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 -- 172.21.15.44:0/978326812 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x5637e6e9b000 msgr2=0x5637e6eb6680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x5637e6e9b000 0x5637e6eb6680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a67030700 1 -- 172.21.15.44:0/978326812 reap_dead start 2024-09-13T18:28:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 -- 172.21.15.44:0/978326812 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x5637e6d57000 msgr2=0x5637e6eb5080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x5637e6d57000 0x5637e6eb5080 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a67030700 1 -- 172.21.15.44:0/978326812 reap_dead start 2024-09-13T18:28:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 -- 172.21.15.44:0/978326812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e6ce7800 msgr2=0x5637e6a93b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e6ce7800 0x5637e6a93b80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x5637e6d943c0 tx=0x5637e6cdc120 comp rx=0 tx=0).stop 2024-09-13T18:28:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 -- 172.21.15.44:0/978326812 shutdown_connections 2024-09-13T18:28:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 --2- 172.21.15.44:0/978326812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e6ce7800 0x5637e6a93b80 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 -- 172.21.15.44:0/978326812 >> 172.21.15.44:0/978326812 conn(0x5637e6ce7000 msgr2=0x5637e6ade000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 -- 172.21.15.44:0/978326812 shutdown_connections 2024-09-13T18:28:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 -- 172.21.15.44:0/978326812 wait complete. 2024-09-13T18:28:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 -- 172.21.15.44:0/454728319 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5637e6d56400 msgr2=0x5637e6a95700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 --2- 172.21.15.44:0/454728319 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5637e6d56400 0x5637e6a95700 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x5637e6d2d440 tx=0x5637e6e40c00 comp rx=0 tx=0).stop 2024-09-13T18:28:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 -- 172.21.15.44:0/454728319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e6ce6c00 msgr2=0x5637e6a94680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 --2- 172.21.15.44:0/454728319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e6ce6c00 0x5637e6a94680 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x5637e6aff770 tx=0x5637e6ac3260 comp rx=0 tx=0).stop 2024-09-13T18:28:30.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 -- 172.21.15.44:0/454728319 shutdown_connections 2024-09-13T18:28:30.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 --2- 172.21.15.44:0/454728319 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5637e6d56400 0x5637e6a95700 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 --2- 172.21.15.44:0/454728319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e6ce6c00 0x5637e6a94680 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 --2- 172.21.15.44:0/454728319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637e6ce6800 0x5637e6a94c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 --2- 172.21.15.44:0/454728319 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637e6ce6400 0x5637e6a95180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 -- 172.21.15.44:0/454728319 >> 172.21.15.44:0/454728319 conn(0x5637e69ecc00 msgr2=0x5637e6add800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:30.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 -- 172.21.15.44:0/454728319 shutdown_connections 2024-09-13T18:28:30.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 -- 172.21.15.44:0/454728319 wait complete. 2024-09-13T18:28:30.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 -- 172.21.15.44:0/1123206739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e69ed400 msgr2=0x5637e6a92b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 --2- 172.21.15.44:0/1123206739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e69ed400 0x5637e6a92b00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x5637e6aff230 tx=0x5637e6ac32c0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 -- 172.21.15.44:0/1123206739 shutdown_connections 2024-09-13T18:28:30.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 --2- 172.21.15.44:0/1123206739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637e69ed000 0x5637e6a93080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 --2- 172.21.15.44:0/1123206739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637e69ed400 0x5637e6a92b00 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 --2- 172.21.15.44:0/1123206739 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637e69ed800 0x5637e6a92580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 -- 172.21.15.44:0/1123206739 >> 172.21.15.44:0/1123206739 conn(0x5637e69edc00 msgr2=0x5637e6add000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:30.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 -- 172.21.15.44:0/1123206739 shutdown_connections 2024-09-13T18:28:30.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.561+0000 7f0a68876500 1 -- 172.21.15.44:0/1123206739 wait complete. 2024-09-13T18:28:30.573 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--yes-i-really-really-mean-it'] in time 0:00:00.086278, result: old journal was 4194304~52204 new journal start will be 8388608 (4142100 bytes past old end) writing journal head writing EResetJournal entry done 2024-09-13T18:28:30.574 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-13T18:28:30.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.741+0000 7f2ec4053700 1 Processor -- start 2024-09-13T18:28:30.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.741+0000 7f2ec4053700 1 -- start start 2024-09-13T18:28:30.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.741+0000 7f2ec4053700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2ebc0cd0e0 0x7f2ebc15aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.741+0000 7f2ec4053700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ebc0cdf20 0x7f2ebc0ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.741+0000 7f2ec4053700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ebc0cda90 con 0x7f2ebc1599d0 2024-09-13T18:28:30.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.741+0000 7f2ec4053700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ebc15afe0 con 0x7f2ebc0cd0e0 2024-09-13T18:28:30.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.741+0000 7f2ec4053700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc15da40 con 0x7f2ebc0cdf20 2024-09-13T18:28:30.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.741+0000 7f2ec25f0700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ebc0cdf20 0x7f2ebc0ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.741+0000 7f2ec15ee700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2ebc0cd0e0 0x7f2ebc15aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.741+0000 7f2ec25f0700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ebc0cdf20 0x7f2ebc0ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:38522/0 (socket says 172.21.15.44:38522) 2024-09-13T18:28:30.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.741+0000 7f2ec25f0700 1 -- 172.21.15.44:0/1588559336 learned_addr learned my addr 172.21.15.44:0/1588559336 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:30.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.745+0000 7f2ec25f0700 1 -- 172.21.15.44:0/1588559336 >> v2:172.21.15.99:3300/0 conn(0x7f2ebc0cd0e0 msgr2=0x7f2ebc15aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:30.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.745+0000 7f2ec25f0700 1 --2- 172.21.15.44:0/1588559336 >> v2:172.21.15.99:3300/0 conn(0x7f2ebc0cd0e0 0x7f2ebc15aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.745+0000 7f2ec25f0700 1 -- 172.21.15.44:0/1588559336 >> v1:172.21.15.99:6789/0 conn(0x7f2ebc1599d0 legacy=0x7f2ebc0cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.745+0000 7f2ec25f0700 1 -- 172.21.15.44:0/1588559336 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc15dd20 con 0x7f2ebc0cdf20 2024-09-13T18:28:30.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.745+0000 7f2ec15ee700 1 --2- 172.21.15.44:0/1588559336 >> v2:172.21.15.99:3300/0 conn(0x7f2ebc0cd0e0 0x7f2ebc15aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:30.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.745+0000 7f2ec25f0700 1 --2- 172.21.15.44:0/1588559336 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ebc0cdf20 0x7f2ebc0ce3b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4009e50 tx=0x7f2eb400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c36ae7343139c9f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.745+0000 7f2ec0ded700 1 -- 172.21.15.44:0/1588559336 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb400e070 con 0x7f2ebc0cdf20 2024-09-13T18:28:30.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.745+0000 7f2ec0ded700 1 -- 172.21.15.44:0/1588559336 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb400b910 con 0x7f2ebc0cdf20 2024-09-13T18:28:30.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.745+0000 7f2ec0ded700 1 -- 172.21.15.44:0/1588559336 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb400bcc0 con 0x7f2ebc0cdf20 2024-09-13T18:28:30.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.745+0000 7f2ec4053700 1 -- 172.21.15.44:0/1588559336 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ebc0cdf20 msgr2=0x7f2ebc0ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.745+0000 7f2ec4053700 1 --2- 172.21.15.44:0/1588559336 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ebc0cdf20 0x7f2ebc0ce3b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4009e50 tx=0x7f2eb400b330 comp rx=0 tx=0).stop 2024-09-13T18:28:30.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.745+0000 7f2ec4053700 1 -- 172.21.15.44:0/1588559336 shutdown_connections 2024-09-13T18:28:30.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.745+0000 7f2ec4053700 1 --2- 172.21.15.44:0/1588559336 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ebc0cdf20 0x7f2ebc0ce3b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.745+0000 7f2ec4053700 1 --2- 172.21.15.44:0/1588559336 >> v2:172.21.15.99:3300/0 conn(0x7f2ebc0cd0e0 0x7f2ebc15aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.745+0000 7f2ec4053700 1 -- 172.21.15.44:0/1588559336 >> 172.21.15.44:0/1588559336 conn(0x7f2ebc0b1b00 msgr2=0x7f2ebc0b1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:30.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.745+0000 7f2ec4053700 1 -- 172.21.15.44:0/1588559336 shutdown_connections 2024-09-13T18:28:30.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.745+0000 7f2ec4053700 1 -- 172.21.15.44:0/1588559336 wait complete. 2024-09-13T18:28:30.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2ec4053700 1 Processor -- start 2024-09-13T18:28:30.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2ec4053700 1 -- start start 2024-09-13T18:28:30.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2ec4053700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ebc0cd0e0 0x7f2ebc06ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2ec4053700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ebc0cdf20 0x7f2ebc1523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2ec4053700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ebc1599d0 0x7f2ebc06aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2ec4053700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc155fe0 con 0x7f2ebc0cd0e0 2024-09-13T18:28:30.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2ec4053700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc06d020 con 0x7f2ebc1599d0 2024-09-13T18:28:30.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2ec4053700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc06d300 con 0x7f2ebc0cdf20 2024-09-13T18:28:30.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2ec1def700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ebc0cd0e0 0x7f2ebc06ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2ec1def700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ebc0cd0e0 0x7f2ebc06ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52448/0 (socket says 172.21.15.44:52448) 2024-09-13T18:28:30.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2ec1def700 1 -- 172.21.15.44:0/1368789073 learned_addr learned my addr 172.21.15.44:0/1368789073 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:30.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2ec15ee700 1 --2- 172.21.15.44:0/1368789073 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ebc0cdf20 0x7f2ebc1523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2ec25f0700 1 --2- 172.21.15.44:0/1368789073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ebc1599d0 0x7f2ebc06aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2ec1def700 1 -- 172.21.15.44:0/1368789073 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ebc0cdf20 msgr2=0x7f2ebc1523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2ec1def700 1 --2- 172.21.15.44:0/1368789073 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ebc0cdf20 0x7f2ebc1523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2ec1def700 1 -- 172.21.15.44:0/1368789073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ebc1599d0 msgr2=0x7f2ebc06aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2ec1def700 1 --2- 172.21.15.44:0/1368789073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ebc1599d0 0x7f2ebc06aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2ec1def700 1 -- 172.21.15.44:0/1368789073 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb80094b0 con 0x7f2ebc0cd0e0 2024-09-13T18:28:30.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2ec1def700 1 --2- 172.21.15.44:0/1368789073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ebc0cd0e0 0x7f2ebc06ddc0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000c500 tx=0x7f2eb000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2eae7fc700 1 -- 172.21.15.44:0/1368789073 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb00052d0 con 0x7f2ebc0cd0e0 2024-09-13T18:28:30.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2eae7fc700 1 -- 172.21.15.44:0/1368789073 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb0005430 con 0x7f2ebc0cd0e0 2024-09-13T18:28:30.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2ec4053700 1 -- 172.21.15.44:0/1368789073 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb4009b30 con 0x7f2ebc0cd0e0 2024-09-13T18:28:30.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2eae7fc700 1 -- 172.21.15.44:0/1368789073 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb00055a0 con 0x7f2ebc0cd0e0 2024-09-13T18:28:30.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.749+0000 7f2ec4053700 1 -- 172.21.15.44:0/1368789073 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ebc06d8c0 con 0x7f2ebc0cd0e0 2024-09-13T18:28:30.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.753+0000 7f2ec4053700 1 -- 172.21.15.44:0/1368789073 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ebc06d160 con 0x7f2ebc0cd0e0 2024-09-13T18:28:30.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.753+0000 7f2eae7fc700 1 -- 172.21.15.44:0/1368789073 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2eb00038e0 con 0x7f2ebc0cd0e0 2024-09-13T18:28:30.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.757+0000 7f2eae7fc700 1 --2- 172.21.15.44:0/1368789073 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2ea0066730 0x7f2ea0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.757+0000 7f2eae7fc700 1 -- 172.21.15.44:0/1368789073 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2eb0083510 con 0x7f2ebc0cd0e0 2024-09-13T18:28:30.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.757+0000 7f2ec15ee700 1 --2- 172.21.15.44:0/1368789073 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2ea0066730 0x7f2ea0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.757+0000 7f2ec15ee700 1 --2- 172.21.15.44:0/1368789073 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2ea0066730 0x7f2ea0068bf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8009d80 tx=0x7f2eb8009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.765+0000 7f2eae7fc700 1 -- 172.21.15.44:0/1368789073 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2ebc06d160 con 0x7f2ebc0cd0e0 2024-09-13T18:28:30.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:30.973+0000 7f2ec4053700 1 -- 172.21.15.44:0/1368789073 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f2ebc06d160 con 0x7f2ebc0cd0e0 2024-09-13T18:28:31.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.665+0000 7f2eae7fc700 1 -- 172.21.15.44:0/1368789073 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v18) v1 ==== 162+0+0 (secure 0 0 0) 0x7f2ebc06d160 con 0x7f2ebc0cd0e0 2024-09-13T18:28:31.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.669+0000 7f2ec4053700 1 -- 172.21.15.44:0/1368789073 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2ea0066730 msgr2=0x7f2ea0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.669+0000 7f2ec4053700 1 --2- 172.21.15.44:0/1368789073 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2ea0066730 0x7f2ea0068bf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8009d80 tx=0x7f2eb8009240 comp rx=0 tx=0).stop 2024-09-13T18:28:31.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.669+0000 7f2ec4053700 1 -- 172.21.15.44:0/1368789073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ebc0cd0e0 msgr2=0x7f2ebc06ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.669+0000 7f2ec4053700 1 --2- 172.21.15.44:0/1368789073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ebc0cd0e0 0x7f2ebc06ddc0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000c500 tx=0x7f2eb000c810 comp rx=0 tx=0).stop 2024-09-13T18:28:31.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.669+0000 7f2ec4053700 1 -- 172.21.15.44:0/1368789073 shutdown_connections 2024-09-13T18:28:31.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.669+0000 7f2ec4053700 1 --2- 172.21.15.44:0/1368789073 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2ea0066730 0x7f2ea0068bf0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.669+0000 7f2ec4053700 1 --2- 172.21.15.44:0/1368789073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ebc1599d0 0x7f2ebc06aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.669+0000 7f2ec4053700 1 --2- 172.21.15.44:0/1368789073 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ebc0cdf20 0x7f2ebc1523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.669+0000 7f2ec4053700 1 --2- 172.21.15.44:0/1368789073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ebc0cd0e0 0x7f2ebc06ddc0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.669+0000 7f2ec4053700 1 -- 172.21.15.44:0/1368789073 >> 172.21.15.44:0/1368789073 conn(0x7f2ebc0b1b00 msgr2=0x7f2ebc159f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:31.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.669+0000 7f2ec4053700 1 -- 172.21.15.44:0/1368789073 shutdown_connections 2024-09-13T18:28:31.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.669+0000 7f2ec4053700 1 -- 172.21.15.44:0/1368789073 wait complete. 2024-09-13T18:28:31.679 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-13T18:28:31.695 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:28:31.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.801+0000 7ff65eb23700 1 Processor -- start 2024-09-13T18:28:31.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.805+0000 7ff65eb23700 1 -- start start 2024-09-13T18:28:31.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.805+0000 7ff65eb23700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff658159060 0x7ff65815d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.805+0000 7ff65eb23700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff6580b38d0 0x7ff65815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.805+0000 7ff65eb23700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65815a630 con 0x7ff65806b5b0 2024-09-13T18:28:31.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.805+0000 7ff65eb23700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65815a450 con 0x7ff6580b38d0 2024-09-13T18:28:31.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.805+0000 7ff65eb23700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65806bd30 con 0x7ff658159060 2024-09-13T18:28:31.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.805+0000 7ff65e322700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff6580b38d0 0x7ff65815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.805+0000 7ff65d320700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff65806b5b0 0x7ff6580b31c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:33388/0 (socket says 172.21.15.44:33388) 2024-09-13T18:28:31.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.805+0000 7ff65d320700 1 -- 172.21.15.44:0/2193829908 learned_addr learned my addr 172.21.15.44:0/2193829908 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:31.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.805+0000 7ff65db21700 1 --2- 172.21.15.44:0/2193829908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff658159060 0x7ff65815d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.805+0000 7ff65e322700 1 -- 172.21.15.44:0/2193829908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff658159060 msgr2=0x7ff65815d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:31.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.805+0000 7ff65e322700 1 --2- 172.21.15.44:0/2193829908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff658159060 0x7ff65815d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.805+0000 7ff65e322700 1 -- 172.21.15.44:0/2193829908 >> v1:172.21.15.44:6789/0 conn(0x7ff65806b5b0 legacy=0x7ff6580b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.805+0000 7ff65e322700 1 -- 172.21.15.44:0/2193829908 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65806c010 con 0x7ff6580b38d0 2024-09-13T18:28:31.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.805+0000 7ff65e322700 1 --2- 172.21.15.44:0/2193829908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6580b38d0 0x7ff65815b0a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff650009dc0 tx=0x7ff65000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25764acadc77e7c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:31.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.805+0000 7ff65cb1f700 1 -- 172.21.15.44:0/2193829908 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65000e070 con 0x7ff6580b38d0 2024-09-13T18:28:31.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.805+0000 7ff65cb1f700 1 -- 172.21.15.44:0/2193829908 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65000bb90 con 0x7ff6580b38d0 2024-09-13T18:28:31.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.805+0000 7ff65cb1f700 1 -- 172.21.15.44:0/2193829908 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff650012430 con 0x7ff6580b38d0 2024-09-13T18:28:31.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.809+0000 7ff65eb23700 1 -- 172.21.15.44:0/2193829908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6580b38d0 msgr2=0x7ff65815b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.809+0000 7ff65eb23700 1 --2- 172.21.15.44:0/2193829908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6580b38d0 0x7ff65815b0a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff650009dc0 tx=0x7ff65000b330 comp rx=0 tx=0).stop 2024-09-13T18:28:31.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.809+0000 7ff65eb23700 1 -- 172.21.15.44:0/2193829908 shutdown_connections 2024-09-13T18:28:31.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.809+0000 7ff65eb23700 1 --2- 172.21.15.44:0/2193829908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6580b38d0 0x7ff65815b0a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.809+0000 7ff65eb23700 1 --2- 172.21.15.44:0/2193829908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff658159060 0x7ff65815d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.809+0000 7ff65eb23700 1 -- 172.21.15.44:0/2193829908 >> 172.21.15.44:0/2193829908 conn(0x7ff65806d900 msgr2=0x7ff65806dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:31.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.809+0000 7ff65eb23700 1 -- 172.21.15.44:0/2193829908 shutdown_connections 2024-09-13T18:28:31.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.809+0000 7ff65eb23700 1 -- 172.21.15.44:0/2193829908 wait complete. 2024-09-13T18:28:31.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.809+0000 7ff65eb23700 1 Processor -- start 2024-09-13T18:28:31.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.809+0000 7ff65eb23700 1 -- start start 2024-09-13T18:28:31.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.813+0000 7ff65eb23700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff65806b5b0 0x7ff658154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.813+0000 7ff65eb23700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6580b38d0 0x7ff658154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.813+0000 7ff65eb23700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff658159060 0x7ff6581f3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.813+0000 7ff65eb23700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65813e360 con 0x7ff658159060 2024-09-13T18:28:31.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.813+0000 7ff65eb23700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6581f21f0 con 0x7ff6580b38d0 2024-09-13T18:28:31.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.813+0000 7ff65eb23700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff658154dc0 con 0x7ff65806b5b0 2024-09-13T18:28:31.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.813+0000 7ff65e322700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff658159060 0x7ff6581f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.813+0000 7ff65e322700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff658159060 0x7ff6581f3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52464/0 (socket says 172.21.15.44:52464) 2024-09-13T18:28:31.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.813+0000 7ff65e322700 1 -- 172.21.15.44:0/351718233 learned_addr learned my addr 172.21.15.44:0/351718233 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:31.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.813+0000 7ff65d320700 1 --2- 172.21.15.44:0/351718233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6580b38d0 0x7ff658154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.813+0000 7ff65db21700 1 --2- 172.21.15.44:0/351718233 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff65806b5b0 0x7ff658154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.813+0000 7ff65e322700 1 -- 172.21.15.44:0/351718233 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff65806b5b0 msgr2=0x7ff658154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.813+0000 7ff65e322700 1 --2- 172.21.15.44:0/351718233 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff65806b5b0 0x7ff658154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.813+0000 7ff65e322700 1 -- 172.21.15.44:0/351718233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6580b38d0 msgr2=0x7ff658154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.813+0000 7ff65e322700 1 --2- 172.21.15.44:0/351718233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6580b38d0 0x7ff658154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.813+0000 7ff65e322700 1 -- 172.21.15.44:0/351718233 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff650009a70 con 0x7ff658159060 2024-09-13T18:28:31.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.813+0000 7ff65e322700 1 --2- 172.21.15.44:0/351718233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff658159060 0x7ff6581f3cf0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff65000b370 tx=0x7ff650004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:31.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.813+0000 7ff64e7fc700 1 -- 172.21.15.44:0/351718233 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff650012430 con 0x7ff658159060 2024-09-13T18:28:31.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.813+0000 7ff64e7fc700 1 -- 172.21.15.44:0/351718233 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff650020070 con 0x7ff658159060 2024-09-13T18:28:31.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.813+0000 7ff65eb23700 1 -- 172.21.15.44:0/351718233 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6581f18c0 con 0x7ff658159060 2024-09-13T18:28:31.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.813+0000 7ff64e7fc700 1 -- 172.21.15.44:0/351718233 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6500098f0 con 0x7ff658159060 2024-09-13T18:28:31.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.813+0000 7ff65eb23700 1 -- 172.21.15.44:0/351718233 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6581f1e80 con 0x7ff658159060 2024-09-13T18:28:31.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.813+0000 7ff65eb23700 1 -- 172.21.15.44:0/351718233 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6581f2380 con 0x7ff658159060 2024-09-13T18:28:31.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.817+0000 7ff64e7fc700 1 -- 172.21.15.44:0/351718233 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff650004040 con 0x7ff658159060 2024-09-13T18:28:31.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.817+0000 7ff64e7fc700 1 --2- 172.21.15.44:0/351718233 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff63c066760 0x7ff63c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.817+0000 7ff64e7fc700 1 -- 172.21.15.44:0/351718233 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff650022070 con 0x7ff658159060 2024-09-13T18:28:31.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.817+0000 7ff65db21700 1 --2- 172.21.15.44:0/351718233 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff63c066760 0x7ff63c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.817+0000 7ff65db21700 1 --2- 172.21.15.44:0/351718233 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff63c066760 0x7ff63c068c20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff65400bbb0 tx=0x7ff654008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:31.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:31.825+0000 7ff64e7fc700 1 -- 172.21.15.44:0/351718233 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff650053950 con 0x7ff658159060 2024-09-13T18:28:32.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:32.037+0000 7ff65eb23700 1 -- 172.21.15.44:0/351718233 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff65806a6f0 con 0x7ff658159060 2024-09-13T18:28:32.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:32.037+0000 7ff64e7fc700 1 -- 172.21.15.44:0/351718233 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4732 (secure 0 0 0) 0x7ff650056f70 con 0x7ff658159060 2024-09-13T18:28:32.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:32.045 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5191,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/2593282586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2593282586},{"type":"v1","addr":"172.21.15.99:6836","nonce":2593282586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3094334762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3094334762},{"type":"v1","addr":"172.21.15.99:6837","nonce":3094334762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1843893566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1843893566},{"type":"v1","addr":"172.21.15.44:6833","nonce":1843893566}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:28:05.062964+0000","modified":"2024-09-13T18:28:31.671084+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5580},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5580":{"gid":5580,"name":"a","rank":0,"incarnation":19,"state":"up:replay","state_seq":1,"addr":"172.21.15.44:6835/438860530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":438860530},{"type":"v1","addr":"172.21.15.44:6835","nonce":438860530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:28:32.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:32.041+0000 7ff65eb23700 1 -- 172.21.15.44:0/351718233 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff63c066760 msgr2=0x7ff63c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:32.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:32.041+0000 7ff65eb23700 1 --2- 172.21.15.44:0/351718233 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff63c066760 0x7ff63c068c20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff65400bbb0 tx=0x7ff654008040 comp rx=0 tx=0).stop 2024-09-13T18:28:32.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:32.041+0000 7ff65eb23700 1 -- 172.21.15.44:0/351718233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff658159060 msgr2=0x7ff6581f3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:32.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:32.041+0000 7ff65eb23700 1 --2- 172.21.15.44:0/351718233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff658159060 0x7ff6581f3cf0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff65000b370 tx=0x7ff650004af0 comp rx=0 tx=0).stop 2024-09-13T18:28:32.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:32.041+0000 7ff65eb23700 1 -- 172.21.15.44:0/351718233 shutdown_connections 2024-09-13T18:28:32.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:32.041+0000 7ff65eb23700 1 --2- 172.21.15.44:0/351718233 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff63c066760 0x7ff63c068c20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:32.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:32.041+0000 7ff65eb23700 1 --2- 172.21.15.44:0/351718233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff658159060 0x7ff6581f3cf0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:32.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:32.041+0000 7ff65eb23700 1 --2- 172.21.15.44:0/351718233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6580b38d0 0x7ff658154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:32.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:32.041+0000 7ff65eb23700 1 --2- 172.21.15.44:0/351718233 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff65806b5b0 0x7ff658154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:32.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:32.041+0000 7ff65eb23700 1 -- 172.21.15.44:0/351718233 >> 172.21.15.44:0/351718233 conn(0x7ff65806d900 msgr2=0x7ff65806dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:32.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:32.041+0000 7ff65eb23700 1 -- 172.21.15.44:0/351718233 shutdown_connections 2024-09-13T18:28:32.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:32.041+0000 7ff65eb23700 1 -- 172.21.15.44:0/351718233 wait complete. 2024-09-13T18:28:32.051 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 19 2024-09-13T18:28:32.469 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:28:05.062964+0000', 'modified': '2024-09-13T18:28:31.671084+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 36, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5580}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5580': {'gid': 5580, 'name': 'a', 'rank': 0, 'incarnation': 19, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.44:6835/438860530', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 438860530}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 438860530}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:28:32.469 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5580:up:replay 2024-09-13T18:28:33.470 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:28:33.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.589+0000 7f7ebb734700 1 Processor -- start 2024-09-13T18:28:33.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.589+0000 7f7ebb734700 1 -- start start 2024-09-13T18:28:33.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.589+0000 7f7ebb734700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7eb406b760 0x7f7eb40d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:33.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.589+0000 7f7ebb734700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb40b8750 con 0x7f7eb415cf30 2024-09-13T18:28:33.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.589+0000 7f7ebb734700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb40d2350 con 0x7f7eb40d0fc0 2024-09-13T18:28:33.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.589+0000 7f7ebb734700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb40d17d0 con 0x7f7eb406b760 2024-09-13T18:28:33.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.589+0000 7f7eb94d0700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7eb415cf30 0x7f7eb406b050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44700/0 (socket says 172.21.15.44:44700) 2024-09-13T18:28:33.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.589+0000 7f7eb94d0700 1 -- 172.21.15.44:0/1017263887 learned_addr learned my addr 172.21.15.44:0/1017263887 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:33.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.589+0000 7f7eb8ccf700 1 --2- 172.21.15.44:0/1017263887 >> v2:172.21.15.99:3300/0 conn(0x7f7eb406b760 0x7f7eb40d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:33.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.589+0000 7f7ea7fff700 1 -- 172.21.15.44:0/1017263887 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532169146 0 0) 0x7f7ea8001110 con 0x7f7eb415cf30 2024-09-13T18:28:33.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.589+0000 7f7ea7fff700 1 -- 172.21.15.44:0/1017263887 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ea00035d0 con 0x7f7eb415cf30 2024-09-13T18:28:33.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.589+0000 7f7eb8ccf700 1 -- 172.21.15.44:0/1017263887 >> v1:172.21.15.99:6789/0 conn(0x7f7eb40d0fc0 legacy=0x7f7eb40b64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:33.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.589+0000 7f7eb8ccf700 1 -- 172.21.15.44:0/1017263887 >> v1:172.21.15.44:6789/0 conn(0x7f7eb415cf30 legacy=0x7f7eb406b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:33.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.589+0000 7f7ea7fff700 1 -- 172.21.15.44:0/1017263887 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2031871159 0 0) 0x7f7ea00035d0 con 0x7f7eb415cf30 2024-09-13T18:28:33.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.589+0000 7f7eb8ccf700 1 -- 172.21.15.44:0/1017263887 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb40d1ab0 con 0x7f7eb406b760 2024-09-13T18:28:33.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.589+0000 7f7eb8ccf700 1 --2- 172.21.15.44:0/1017263887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7eb406b760 0x7f7eb40d0a80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009850 tx=0x7f7eb0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6678ad055fb761 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:33.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.589+0000 7f7ea7fff700 1 -- 172.21.15.44:0/1017263887 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea8001800 con 0x7f7eb406b760 2024-09-13T18:28:33.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.589+0000 7f7ea7fff700 1 -- 172.21.15.44:0/1017263887 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb0004030 con 0x7f7eb406b760 2024-09-13T18:28:33.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.589+0000 7f7ea7fff700 1 -- 172.21.15.44:0/1017263887 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb00043a0 con 0x7f7eb406b760 2024-09-13T18:28:33.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.593+0000 7f7ebb734700 1 -- 172.21.15.44:0/1017263887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7eb406b760 msgr2=0x7f7eb40d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:33.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.593+0000 7f7ebb734700 1 --2- 172.21.15.44:0/1017263887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7eb406b760 0x7f7eb40d0a80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009850 tx=0x7f7eb0009b60 comp rx=0 tx=0).stop 2024-09-13T18:28:33.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.593+0000 7f7ebb734700 1 -- 172.21.15.44:0/1017263887 shutdown_connections 2024-09-13T18:28:33.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.593+0000 7f7ebb734700 1 --2- 172.21.15.44:0/1017263887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7eb406b760 0x7f7eb40d0a80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:33.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.593+0000 7f7ebb734700 1 -- 172.21.15.44:0/1017263887 >> 172.21.15.44:0/1017263887 conn(0x7f7eb40d2e40 msgr2=0x7f7eb40d3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:33.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.593+0000 7f7ebb734700 1 -- 172.21.15.44:0/1017263887 shutdown_connections 2024-09-13T18:28:33.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.593+0000 7f7ebb734700 1 -- 172.21.15.44:0/1017263887 wait complete. 2024-09-13T18:28:33.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.593+0000 7f7ebb734700 1 Processor -- start 2024-09-13T18:28:33.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.593+0000 7f7ebb734700 1 -- start start 2024-09-13T18:28:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.593+0000 7f7ebb734700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7eb406b760 0x7f7eb4153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.593+0000 7f7ebb734700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7eb40d0fc0 0x7f7eb415ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.593+0000 7f7ebb734700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7eb415cf30 0x7f7eb41f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.593+0000 7f7ebb734700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb4154120 con 0x7f7eb40d0fc0 2024-09-13T18:28:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.593+0000 7f7ebb734700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40cbc70 con 0x7f7eb406b760 2024-09-13T18:28:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.593+0000 7f7ebb734700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40cb060 con 0x7f7eb415cf30 2024-09-13T18:28:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.597+0000 7f7eb8ccf700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7eb40d0fc0 0x7f7eb415ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.597+0000 7f7eb8ccf700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7eb40d0fc0 0x7f7eb415ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34248/0 (socket says 172.21.15.44:34248) 2024-09-13T18:28:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.597+0000 7f7eb8ccf700 1 -- 172.21.15.44:0/3875713247 learned_addr learned my addr 172.21.15.44:0/3875713247 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.597+0000 7f7eb94d0700 1 --2- 172.21.15.44:0/3875713247 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7eb406b760 0x7f7eb4153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.597+0000 7f7eb9cd1700 1 --2- 172.21.15.44:0/3875713247 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7eb415cf30 0x7f7eb41f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:33.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.597+0000 7f7eb8ccf700 1 -- 172.21.15.44:0/3875713247 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7eb415cf30 msgr2=0x7f7eb41f2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:33.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.597+0000 7f7eb8ccf700 1 --2- 172.21.15.44:0/3875713247 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7eb415cf30 0x7f7eb41f2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:33.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.597+0000 7f7eb8ccf700 1 -- 172.21.15.44:0/3875713247 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7eb406b760 msgr2=0x7f7eb4153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:33.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.597+0000 7f7eb8ccf700 1 --2- 172.21.15.44:0/3875713247 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7eb406b760 0x7f7eb4153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:33.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.597+0000 7f7eb8ccf700 1 -- 172.21.15.44:0/3875713247 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb00094b0 con 0x7f7eb40d0fc0 2024-09-13T18:28:33.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.597+0000 7f7eb9cd1700 1 --2- 172.21.15.44:0/3875713247 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7eb415cf30 0x7f7eb41f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:33.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.597+0000 7f7eb94d0700 1 --2- 172.21.15.44:0/3875713247 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7eb406b760 0x7f7eb4153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:33.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.597+0000 7f7eb8ccf700 1 --2- 172.21.15.44:0/3875713247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7eb40d0fc0 0x7f7eb415ff00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0004000 tx=0x7f7eb0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:33.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.597+0000 7f7ea5ffb700 1 -- 172.21.15.44:0/3875713247 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0003ea0 con 0x7f7eb40d0fc0 2024-09-13T18:28:33.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.597+0000 7f7ea5ffb700 1 -- 172.21.15.44:0/3875713247 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb001f070 con 0x7f7eb40d0fc0 2024-09-13T18:28:33.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.597+0000 7f7ea5ffb700 1 -- 172.21.15.44:0/3875713247 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0011a90 con 0x7f7eb40d0fc0 2024-09-13T18:28:33.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.597+0000 7f7ebb734700 1 -- 172.21.15.44:0/3875713247 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb40cb340 con 0x7f7eb40d0fc0 2024-09-13T18:28:33.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.597+0000 7f7ebb734700 1 -- 172.21.15.44:0/3875713247 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb40cb900 con 0x7f7eb40d0fc0 2024-09-13T18:28:33.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.597+0000 7f7ebb734700 1 -- 172.21.15.44:0/3875713247 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb40cbde0 con 0x7f7eb40d0fc0 2024-09-13T18:28:33.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.601+0000 7f7ea5ffb700 1 -- 172.21.15.44:0/3875713247 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7eb0011bf0 con 0x7f7eb40d0fc0 2024-09-13T18:28:33.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.601+0000 7f7ea5ffb700 1 --2- 172.21.15.44:0/3875713247 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e98066730 0x7f7e98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:33.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.601+0000 7f7ea5ffb700 1 -- 172.21.15.44:0/3875713247 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7eb0021070 con 0x7f7eb40d0fc0 2024-09-13T18:28:33.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.601+0000 7f7eb94d0700 1 --2- 172.21.15.44:0/3875713247 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e98066730 0x7f7e98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:33.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.601+0000 7f7eb94d0700 1 --2- 172.21.15.44:0/3875713247 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e98066730 0x7f7e98068bf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40b8ad0 tx=0x7f7ea8001130 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:33.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.605+0000 7f7ea5ffb700 1 -- 172.21.15.44:0/3875713247 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7eb0052bf0 con 0x7f7eb40d0fc0 2024-09-13T18:28:33.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.817+0000 7f7ebb734700 1 -- 172.21.15.44:0/3875713247 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7eb40cd1d0 con 0x7f7eb40d0fc0 2024-09-13T18:28:33.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.821+0000 7f7ea5ffb700 1 -- 172.21.15.44:0/3875713247 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4732 (secure 0 0 0) 0x7f7eb002b090 con 0x7f7eb40d0fc0 2024-09-13T18:28:33.827 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:33.827 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5191,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/2593282586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2593282586},{"type":"v1","addr":"172.21.15.99:6836","nonce":2593282586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3094334762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3094334762},{"type":"v1","addr":"172.21.15.99:6837","nonce":3094334762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1843893566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1843893566},{"type":"v1","addr":"172.21.15.44:6833","nonce":1843893566}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:28:05.062964+0000","modified":"2024-09-13T18:28:33.683646+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5580},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5580":{"gid":5580,"name":"a","rank":0,"incarnation":19,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.44:6835/438860530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":438860530},{"type":"v1","addr":"172.21.15.44:6835","nonce":438860530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:28:33.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.821+0000 7f7ebb734700 1 -- 172.21.15.44:0/3875713247 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e98066730 msgr2=0x7f7e98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:33.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.821+0000 7f7ebb734700 1 --2- 172.21.15.44:0/3875713247 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e98066730 0x7f7e98068bf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40b8ad0 tx=0x7f7ea8001130 comp rx=0 tx=0).stop 2024-09-13T18:28:33.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.821+0000 7f7ebb734700 1 -- 172.21.15.44:0/3875713247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7eb40d0fc0 msgr2=0x7f7eb415ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:33.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.821+0000 7f7ebb734700 1 --2- 172.21.15.44:0/3875713247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7eb40d0fc0 0x7f7eb415ff00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0004000 tx=0x7f7eb0004770 comp rx=0 tx=0).stop 2024-09-13T18:28:33.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.821+0000 7f7ebb734700 1 -- 172.21.15.44:0/3875713247 shutdown_connections 2024-09-13T18:28:33.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.821+0000 7f7ebb734700 1 --2- 172.21.15.44:0/3875713247 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e98066730 0x7f7e98068bf0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:33.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.821+0000 7f7ebb734700 1 --2- 172.21.15.44:0/3875713247 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7eb415cf30 0x7f7eb41f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:33.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.821+0000 7f7ebb734700 1 --2- 172.21.15.44:0/3875713247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7eb40d0fc0 0x7f7eb415ff00 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:33.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.821+0000 7f7ebb734700 1 --2- 172.21.15.44:0/3875713247 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7eb406b760 0x7f7eb4153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:33.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.821+0000 7f7ebb734700 1 -- 172.21.15.44:0/3875713247 >> 172.21.15.44:0/3875713247 conn(0x7f7eb40d2e40 msgr2=0x7f7eb40cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:33.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.821+0000 7f7ebb734700 1 -- 172.21.15.44:0/3875713247 shutdown_connections 2024-09-13T18:28:33.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:33.821+0000 7f7ebb734700 1 -- 172.21.15.44:0/3875713247 wait complete. 2024-09-13T18:28:33.830 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 21 2024-09-13T18:28:34.244 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:28:05.062964+0000', 'modified': '2024-09-13T18:28:33.683646+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 36, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5580}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5580': {'gid': 5580, 'name': 'a', 'rank': 0, 'incarnation': 19, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.44:6835/438860530', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 438860530}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 438860530}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:28:34.244 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5580:up:rejoin 2024-09-13T18:28:35.245 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:28:35.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.365+0000 7f9b1b150700 1 Processor -- start 2024-09-13T18:28:35.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.365+0000 7f9b1b150700 1 -- start start 2024-09-13T18:28:35.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.365+0000 7f9b1b150700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9b140cb6c0 0x7f9b140ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.365+0000 7f9b1b150700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9b140ce670 0x7f9b1415a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b1b150700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1415e5a0 con 0x7f9b14157750 2024-09-13T18:28:35.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b1b150700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b140ceb20 con 0x7f9b140ce670 2024-09-13T18:28:35.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b1b150700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b140b4dd0 con 0x7f9b140cb6c0 2024-09-13T18:28:35.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b18eec700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9b14157750 0x7f9b140722d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44712/0 (socket says 172.21.15.44:44712) 2024-09-13T18:28:35.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b18eec700 1 -- 172.21.15.44:0/2565927280 learned_addr learned my addr 172.21.15.44:0/2565927280 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:35.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b196ed700 1 --2- 172.21.15.44:0/2565927280 >> v2:172.21.15.44:3300/0 conn(0x7f9b140ce670 0x7f9b1415a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b13fff700 1 --2- 172.21.15.44:0/2565927280 >> v2:172.21.15.99:3300/0 conn(0x7f9b140cb6c0 0x7f9b140ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b137fe700 1 -- 172.21.15.44:0/2565927280 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837348826 0 0) 0x7f9b1415e5a0 con 0x7f9b14157750 2024-09-13T18:28:35.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b137fe700 1 -- 172.21.15.44:0/2565927280 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b040035d0 con 0x7f9b14157750 2024-09-13T18:28:35.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b196ed700 1 -- 172.21.15.44:0/2565927280 >> v2:172.21.15.99:3300/0 conn(0x7f9b140cb6c0 msgr2=0x7f9b140ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:35.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b196ed700 1 --2- 172.21.15.44:0/2565927280 >> v2:172.21.15.99:3300/0 conn(0x7f9b140cb6c0 0x7f9b140ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b196ed700 1 -- 172.21.15.44:0/2565927280 >> v1:172.21.15.44:6789/0 conn(0x7f9b14157750 legacy=0x7f9b140722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b196ed700 1 -- 172.21.15.44:0/2565927280 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b140729e0 con 0x7f9b140ce670 2024-09-13T18:28:35.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b13fff700 1 --2- 172.21.15.44:0/2565927280 >> v2:172.21.15.99:3300/0 conn(0x7f9b140cb6c0 0x7f9b140ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:35.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b196ed700 1 --2- 172.21.15.44:0/2565927280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b140ce670 0x7f9b1415a420 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9b140aeaf0 tx=0x7f9b0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1314eec33a6fb49 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:35.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b137fe700 1 -- 172.21.15.44:0/2565927280 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c00e070 con 0x7f9b140ce670 2024-09-13T18:28:35.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b137fe700 1 -- 172.21.15.44:0/2565927280 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0c00bb20 con 0x7f9b140ce670 2024-09-13T18:28:35.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b137fe700 1 -- 172.21.15.44:0/2565927280 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c012430 con 0x7f9b140ce670 2024-09-13T18:28:35.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b1b150700 1 -- 172.21.15.44:0/2565927280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b140ce670 msgr2=0x7f9b1415a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b1b150700 1 --2- 172.21.15.44:0/2565927280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b140ce670 0x7f9b1415a420 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9b140aeaf0 tx=0x7f9b0c00b330 comp rx=0 tx=0).stop 2024-09-13T18:28:35.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b1b150700 1 -- 172.21.15.44:0/2565927280 shutdown_connections 2024-09-13T18:28:35.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b1b150700 1 --2- 172.21.15.44:0/2565927280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b140ce670 0x7f9b1415a420 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b1b150700 1 --2- 172.21.15.44:0/2565927280 >> v2:172.21.15.99:3300/0 conn(0x7f9b140cb6c0 0x7f9b140ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b1b150700 1 -- 172.21.15.44:0/2565927280 >> 172.21.15.44:0/2565927280 conn(0x7f9b140cbca0 msgr2=0x7f9b140cc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:35.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b1b150700 1 -- 172.21.15.44:0/2565927280 shutdown_connections 2024-09-13T18:28:35.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.369+0000 7f9b1b150700 1 -- 172.21.15.44:0/2565927280 wait complete. 2024-09-13T18:28:35.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.373+0000 7f9b1b150700 1 Processor -- start 2024-09-13T18:28:35.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.373+0000 7f9b1b150700 1 -- start start 2024-09-13T18:28:35.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.373+0000 7f9b1b150700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b140cb6c0 0x7f9b1415cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.373+0000 7f9b1b150700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b140ce670 0x7f9b141edcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.373+0000 7f9b1b150700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b14157750 0x7f9b1415a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.373+0000 7f9b1b150700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b14151f90 con 0x7f9b140ce670 2024-09-13T18:28:35.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.373+0000 7f9b1b150700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b14152270 con 0x7f9b14157750 2024-09-13T18:28:35.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.373+0000 7f9b1b150700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b141525c0 con 0x7f9b140cb6c0 2024-09-13T18:28:35.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.373+0000 7f9b13fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b140ce670 0x7f9b141edcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.373+0000 7f9b13fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b140ce670 0x7f9b141edcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34262/0 (socket says 172.21.15.44:34262) 2024-09-13T18:28:35.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.373+0000 7f9b13fff700 1 -- 172.21.15.44:0/4236802191 learned_addr learned my addr 172.21.15.44:0/4236802191 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:35.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.373+0000 7f9b196ed700 1 --2- 172.21.15.44:0/4236802191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b14157750 0x7f9b1415a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.373+0000 7f9b18eec700 1 --2- 172.21.15.44:0/4236802191 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b140cb6c0 0x7f9b1415cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.373+0000 7f9b13fff700 1 -- 172.21.15.44:0/4236802191 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b140cb6c0 msgr2=0x7f9b1415cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.373+0000 7f9b13fff700 1 --2- 172.21.15.44:0/4236802191 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b140cb6c0 0x7f9b1415cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.373+0000 7f9b13fff700 1 -- 172.21.15.44:0/4236802191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b14157750 msgr2=0x7f9b1415a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.373+0000 7f9b13fff700 1 --2- 172.21.15.44:0/4236802191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b14157750 0x7f9b1415a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.373+0000 7f9b13fff700 1 -- 172.21.15.44:0/4236802191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b000094b0 con 0x7f9b140ce670 2024-09-13T18:28:35.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.373+0000 7f9b18eec700 1 --2- 172.21.15.44:0/4236802191 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b140cb6c0 0x7f9b1415cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:35.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.373+0000 7f9b13fff700 1 --2- 172.21.15.44:0/4236802191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b140ce670 0x7f9b141edcc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000e9b0 tx=0x7f9b0000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:35.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.377+0000 7f9b117fa700 1 -- 172.21.15.44:0/4236802191 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b00009710 con 0x7f9b140ce670 2024-09-13T18:28:35.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.377+0000 7f9b117fa700 1 -- 172.21.15.44:0/4236802191 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0000c850 con 0x7f9b140ce670 2024-09-13T18:28:35.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.377+0000 7f9b1b150700 1 -- 172.21.15.44:0/4236802191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0c009a70 con 0x7f9b140ce670 2024-09-13T18:28:35.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.377+0000 7f9b117fa700 1 -- 172.21.15.44:0/4236802191 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0000cc00 con 0x7f9b140ce670 2024-09-13T18:28:35.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.377+0000 7f9b1b150700 1 -- 172.21.15.44:0/4236802191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b14152b80 con 0x7f9b140ce670 2024-09-13T18:28:35.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.377+0000 7f9b1b150700 1 -- 172.21.15.44:0/4236802191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b14157b30 con 0x7f9b140ce670 2024-09-13T18:28:35.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.377+0000 7f9b117fa700 1 -- 172.21.15.44:0/4236802191 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9b00013470 con 0x7f9b140ce670 2024-09-13T18:28:35.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.377+0000 7f9b117fa700 1 --2- 172.21.15.44:0/4236802191 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9af8066730 0x7f9af8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.377+0000 7f9b117fa700 1 -- 172.21.15.44:0/4236802191 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9b00083f20 con 0x7f9b140ce670 2024-09-13T18:28:35.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.377+0000 7f9b18eec700 1 --2- 172.21.15.44:0/4236802191 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9af8066730 0x7f9af8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.381+0000 7f9b18eec700 1 --2- 172.21.15.44:0/4236802191 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9af8066730 0x7f9af8068bf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9b080011e0 tx=0x7f9b08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:35.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.385+0000 7f9b117fa700 1 -- 172.21.15.44:0/4236802191 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9b00051230 con 0x7f9b140ce670 2024-09-13T18:28:35.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.597+0000 7f9b1b150700 1 -- 172.21.15.44:0/4236802191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b140cc400 con 0x7f9b140ce670 2024-09-13T18:28:35.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.597+0000 7f9b117fa700 1 -- 172.21.15.44:0/4236802191 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4732 (secure 0 0 0) 0x7f9b00054850 con 0x7f9b140ce670 2024-09-13T18:28:35.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:35.605 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5191,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/2593282586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2593282586},{"type":"v1","addr":"172.21.15.99:6836","nonce":2593282586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3094334762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3094334762},{"type":"v1","addr":"172.21.15.99:6837","nonce":3094334762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1843893566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1843893566},{"type":"v1","addr":"172.21.15.44:6833","nonce":1843893566}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:28:05.062964+0000","modified":"2024-09-13T18:28:34.691940+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5580},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5580":{"gid":5580,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6835/438860530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":438860530},{"type":"v1","addr":"172.21.15.44:6835","nonce":438860530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:28:35.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.601+0000 7f9b1b150700 1 -- 172.21.15.44:0/4236802191 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9af8066730 msgr2=0x7f9af8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.601+0000 7f9b1b150700 1 --2- 172.21.15.44:0/4236802191 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9af8066730 0x7f9af8068bf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9b080011e0 tx=0x7f9b08009040 comp rx=0 tx=0).stop 2024-09-13T18:28:35.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.601+0000 7f9b1b150700 1 -- 172.21.15.44:0/4236802191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b140ce670 msgr2=0x7f9b141edcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.601+0000 7f9b1b150700 1 --2- 172.21.15.44:0/4236802191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b140ce670 0x7f9b141edcc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000e9b0 tx=0x7f9b0000ecc0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.601+0000 7f9b1b150700 1 -- 172.21.15.44:0/4236802191 shutdown_connections 2024-09-13T18:28:35.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.601+0000 7f9b1b150700 1 --2- 172.21.15.44:0/4236802191 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9af8066730 0x7f9af8068bf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.601+0000 7f9b1b150700 1 --2- 172.21.15.44:0/4236802191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b14157750 0x7f9b1415a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.601+0000 7f9b1b150700 1 --2- 172.21.15.44:0/4236802191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b140ce670 0x7f9b141edcc0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.601+0000 7f9b1b150700 1 --2- 172.21.15.44:0/4236802191 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b140cb6c0 0x7f9b1415cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.601+0000 7f9b1b150700 1 -- 172.21.15.44:0/4236802191 >> 172.21.15.44:0/4236802191 conn(0x7f9b140cbca0 msgr2=0x7f9b140c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:35.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.601+0000 7f9b1b150700 1 -- 172.21.15.44:0/4236802191 shutdown_connections 2024-09-13T18:28:35.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:35.601+0000 7f9b1b150700 1 -- 172.21.15.44:0/4236802191 wait complete. 2024-09-13T18:28:35.609 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 22 2024-09-13T18:28:35.666 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-09-13T18:28:35.657+0000 7f0c02bbc700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:28:36.023 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:28:05.062964+0000', 'modified': '2024-09-13T18:28:34.691940+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 36, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5580}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5580': {'gid': 5580, 'name': 'a', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.44:6835/438860530', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 438860530}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 438860530}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:28:36.023 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:28:36.023 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:28:36.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.141+0000 7ffbd3e3e700 1 Processor -- start 2024-09-13T18:28:36.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.141+0000 7ffbd3e3e700 1 -- start start 2024-09-13T18:28:36.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd3e3e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffbcc0cd6d0 0x7ffbcc0cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd3e3e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbcc0b39a0 con 0x7ffbcc06d760 2024-09-13T18:28:36.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd3e3e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbcc0cdff0 con 0x7ffbcc06dbf0 2024-09-13T18:28:36.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd3e3e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbcc15be50 con 0x7ffbcc0cd6d0 2024-09-13T18:28:36.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd13d9700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ffbcc06d760 0x7ffbcc0b2b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44722/0 (socket says 172.21.15.44:44722) 2024-09-13T18:28:36.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd13d9700 1 -- 172.21.15.44:0/70524198 learned_addr learned my addr 172.21.15.44:0/70524198 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:36.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd1bda700 1 --2- 172.21.15.44:0/70524198 >> v2:172.21.15.99:3300/0 conn(0x7ffbcc0cd6d0 0x7ffbcc0cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd0bd8700 1 -- 172.21.15.44:0/70524198 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400630603 0 0) 0x7ffbcc0b39a0 con 0x7ffbcc06d760 2024-09-13T18:28:36.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd0bd8700 1 -- 172.21.15.44:0/70524198 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbb80035d0 con 0x7ffbcc06d760 2024-09-13T18:28:36.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd0bd8700 1 -- 172.21.15.44:0/70524198 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589445686 0 0) 0x7ffbcc0cdff0 con 0x7ffbcc06dbf0 2024-09-13T18:28:36.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd0bd8700 1 -- 172.21.15.44:0/70524198 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbcc0b39a0 con 0x7ffbcc06dbf0 2024-09-13T18:28:36.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd1bda700 1 -- 172.21.15.44:0/70524198 >> v1:172.21.15.99:6789/0 conn(0x7ffbcc06dbf0 legacy=0x7ffbcc0b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd1bda700 1 -- 172.21.15.44:0/70524198 >> v1:172.21.15.44:6789/0 conn(0x7ffbcc06d760 legacy=0x7ffbcc0b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd1bda700 1 -- 172.21.15.44:0/70524198 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc15b1d0 con 0x7ffbcc0cd6d0 2024-09-13T18:28:36.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd1bda700 1 --2- 172.21.15.44:0/70524198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbcc0cd6d0 0x7ffbcc0cdab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0009850 tx=0x7ffbc0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d44be950367b285 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:36.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd0bd8700 1 -- 172.21.15.44:0/70524198 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0011830 con 0x7ffbcc0cd6d0 2024-09-13T18:28:36.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd0bd8700 1 -- 172.21.15.44:0/70524198 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc0011990 con 0x7ffbcc0cd6d0 2024-09-13T18:28:36.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd0bd8700 1 -- 172.21.15.44:0/70524198 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0011d00 con 0x7ffbcc0cd6d0 2024-09-13T18:28:36.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd3e3e700 1 -- 172.21.15.44:0/70524198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbcc0cd6d0 msgr2=0x7ffbcc0cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd3e3e700 1 --2- 172.21.15.44:0/70524198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbcc0cd6d0 0x7ffbcc0cdab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0009850 tx=0x7ffbc0009b60 comp rx=0 tx=0).stop 2024-09-13T18:28:36.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd3e3e700 1 -- 172.21.15.44:0/70524198 shutdown_connections 2024-09-13T18:28:36.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd3e3e700 1 --2- 172.21.15.44:0/70524198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbcc0cd6d0 0x7ffbcc0cdab0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd3e3e700 1 -- 172.21.15.44:0/70524198 >> 172.21.15.44:0/70524198 conn(0x7ffbcc0af620 msgr2=0x7ffbcc0afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:36.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd3e3e700 1 -- 172.21.15.44:0/70524198 shutdown_connections 2024-09-13T18:28:36.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.145+0000 7ffbd3e3e700 1 -- 172.21.15.44:0/70524198 wait complete. 2024-09-13T18:28:36.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.149+0000 7ffbd3e3e700 1 Processor -- start 2024-09-13T18:28:36.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.149+0000 7ffbd3e3e700 1 -- start start 2024-09-13T18:28:36.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.149+0000 7ffbd3e3e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbcc06d760 0x7ffbcc0aca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.149+0000 7ffbd3e3e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffbcc06dbf0 0x7ffbcc0a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.149+0000 7ffbd3e3e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbcc0cd6d0 0x7ffbcc0a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.149+0000 7ffbd3e3e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc0ac5f0 con 0x7ffbcc0cd6d0 2024-09-13T18:28:36.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.149+0000 7ffbd3e3e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc0ab9e0 con 0x7ffbcc06d760 2024-09-13T18:28:36.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.149+0000 7ffbd3e3e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc0abcc0 con 0x7ffbcc06dbf0 2024-09-13T18:28:36.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.149+0000 7ffbd23db700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbcc0cd6d0 0x7ffbcc0a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.149+0000 7ffbd23db700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbcc0cd6d0 0x7ffbcc0a93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34272/0 (socket says 172.21.15.44:34272) 2024-09-13T18:28:36.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.149+0000 7ffbd23db700 1 -- 172.21.15.44:0/1758154280 learned_addr learned my addr 172.21.15.44:0/1758154280 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:36.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.149+0000 7ffbd13d9700 1 --2- 172.21.15.44:0/1758154280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffbcc06dbf0 0x7ffbcc0a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.149+0000 7ffbd1bda700 1 --2- 172.21.15.44:0/1758154280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbcc06d760 0x7ffbcc0aca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.149+0000 7ffbd23db700 1 -- 172.21.15.44:0/1758154280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffbcc06dbf0 msgr2=0x7ffbcc0a8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.149+0000 7ffbd23db700 1 --2- 172.21.15.44:0/1758154280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffbcc06dbf0 0x7ffbcc0a8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.149+0000 7ffbd23db700 1 -- 172.21.15.44:0/1758154280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbcc06d760 msgr2=0x7ffbcc0aca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.149+0000 7ffbd23db700 1 --2- 172.21.15.44:0/1758154280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbcc06d760 0x7ffbcc0aca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.149+0000 7ffbd23db700 1 -- 172.21.15.44:0/1758154280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc00094b0 con 0x7ffbcc0cd6d0 2024-09-13T18:28:36.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.149+0000 7ffbd23db700 1 --2- 172.21.15.44:0/1758154280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbcc0cd6d0 0x7ffbcc0a93b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400cc20 tx=0x7ffbc400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:36.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.153+0000 7ffbbe7fc700 1 -- 172.21.15.44:0/1758154280 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4003c20 con 0x7ffbcc0cd6d0 2024-09-13T18:28:36.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.153+0000 7ffbbe7fc700 1 -- 172.21.15.44:0/1758154280 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc4003d80 con 0x7ffbcc0cd6d0 2024-09-13T18:28:36.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.153+0000 7ffbd3e3e700 1 -- 172.21.15.44:0/1758154280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbcc0abfa0 con 0x7ffbcc0cd6d0 2024-09-13T18:28:36.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.153+0000 7ffbbe7fc700 1 -- 172.21.15.44:0/1758154280 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc400ab90 con 0x7ffbcc0cd6d0 2024-09-13T18:28:36.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.153+0000 7ffbd3e3e700 1 -- 172.21.15.44:0/1758154280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbcc0acfc0 con 0x7ffbcc0cd6d0 2024-09-13T18:28:36.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.153+0000 7ffbbe7fc700 1 -- 172.21.15.44:0/1758154280 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffbc400acf0 con 0x7ffbcc0cd6d0 2024-09-13T18:28:36.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.153+0000 7ffbbe7fc700 1 --2- 172.21.15.44:0/1758154280 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ffbb0066730 0x7ffbb0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.157+0000 7ffbbe7fc700 1 -- 172.21.15.44:0/1758154280 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ffbc4084220 con 0x7ffbcc0cd6d0 2024-09-13T18:28:36.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.157+0000 7ffbd1bda700 1 --2- 172.21.15.44:0/1758154280 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ffbb0066730 0x7ffbb0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.157+0000 7ffbd1bda700 1 --2- 172.21.15.44:0/1758154280 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ffbb0066730 0x7ffbb0068bf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00090b0 tx=0x7ffbc0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:36.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.157+0000 7ffbd70ef740 1 Processor -- start 2024-09-13T18:28:36.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.157+0000 7ffbd70ef740 1 -- start start 2024-09-13T18:28:36.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.157+0000 7ffbd70ef740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xd85530 0xd85910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.157+0000 7ffbd70ef740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xdad330 0xdcefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.157+0000 7ffbd70ef740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xdcf4e0 0xdcf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.157+0000 7ffbd70ef740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0xcf2d80 con 0xdcf4e0 2024-09-13T18:28:36.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.157+0000 7ffbd70ef740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0xcf0510 con 0xd85530 2024-09-13T18:28:36.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.157+0000 7ffbd70ef740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0xcebe00 con 0xdad330 2024-09-13T18:28:36.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.157+0000 7ffbd23db700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xdcf4e0 0xdcf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.157+0000 7ffbd23db700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xdcf4e0 0xdcf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34282/0 (socket says 172.21.15.44:34282) 2024-09-13T18:28:36.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.157+0000 7ffbd1bda700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xd85530 0xd85910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.157+0000 7ffbd23db700 1 -- 172.21.15.44:0/1985423574 learned_addr learned my addr 172.21.15.44:0/1985423574 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:36.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.157+0000 7ffbd13d9700 1 --2- 172.21.15.44:0/1985423574 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xdad330 0xdcefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.161+0000 7ffbd23db700 1 -- 172.21.15.44:0/1985423574 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xdad330 msgr2=0xdcefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:36.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.161+0000 7ffbd23db700 1 --2- 172.21.15.44:0/1985423574 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xdad330 0xdcefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.161+0000 7ffbd23db700 1 -- 172.21.15.44:0/1985423574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xd85530 msgr2=0xd85910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:36.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.161+0000 7ffbd23db700 1 --2- 172.21.15.44:0/1985423574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xd85530 0xd85910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.161+0000 7ffbd23db700 1 -- 172.21.15.44:0/1985423574 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xb5e960 con 0xdcf4e0 2024-09-13T18:28:36.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.161+0000 7ffbd23db700 1 --2- 172.21.15.44:0/1985423574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xdcf4e0 0xdcf8c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ffbc40827a0 tx=0x7ffbc4054cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bd8618d06a01ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:36.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.161+0000 7ffbaf7fe700 1 -- 172.21.15.44:0/1985423574 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4055280 con 0xdcf4e0 2024-09-13T18:28:36.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.161+0000 7ffbaf7fe700 1 -- 172.21.15.44:0/1985423574 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc40590b0 con 0xdcf4e0 2024-09-13T18:28:36.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.161+0000 7ffbaf7fe700 1 -- 172.21.15.44:0/1985423574 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc405d670 con 0xdcf4e0 2024-09-13T18:28:36.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.161+0000 7ffbd70ef740 1 -- 172.21.15.44:0/1985423574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xdcf4e0 msgr2=0xdcf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.161+0000 7ffbd70ef740 1 --2- 172.21.15.44:0/1985423574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xdcf4e0 0xdcf8c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ffbc40827a0 tx=0x7ffbc4054cb0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.161+0000 7ffbd70ef740 1 -- 172.21.15.44:0/1985423574 shutdown_connections 2024-09-13T18:28:36.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.161+0000 7ffbd70ef740 1 --2- 172.21.15.44:0/1985423574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xdcf4e0 0xdcf8c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.161+0000 7ffbd70ef740 1 --2- 172.21.15.44:0/1985423574 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xdad330 0xdcefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.161+0000 7ffbd70ef740 1 --2- 172.21.15.44:0/1985423574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xd85530 0xd85910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.161+0000 7ffbd70ef740 1 -- 172.21.15.44:0/1985423574 >> 172.21.15.44:0/1985423574 conn(0xb134d0 msgr2=0xdacc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:36.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.161+0000 7ffbd70ef740 1 -- 172.21.15.44:0/1985423574 shutdown_connections 2024-09-13T18:28:36.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.161+0000 7ffbd70ef740 1 -- 172.21.15.44:0/1985423574 wait complete. 2024-09-13T18:28:36.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.161+0000 7ffbd70ef740 1 -- start start 2024-09-13T18:28:36.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.161+0000 7ffbd70ef740 1 Processor -- start 2024-09-13T18:28:36.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd70ef740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xd85530 0xdcf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd70ef740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xdad330 0xdcb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd70ef740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xdcf4e0 0xda68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd70ef740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0xca9730 con 0xd85530 2024-09-13T18:28:36.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd70ef740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0xcaf5b0 con 0xdcf4e0 2024-09-13T18:28:36.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd70ef740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0xb97aa0 con 0xdad330 2024-09-13T18:28:36.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd70ef740 10 client.0 _ll_register_callbacks cb 0xce5610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:28:36.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd1bda700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xd85530 0xdcf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd1bda700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xd85530 0xdcf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34290/0 (socket says 172.21.15.44:34290) 2024-09-13T18:28:36.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd1bda700 1 -- 172.21.15.44:0/1749498571 learned_addr learned my addr 172.21.15.44:0/1749498571 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:36.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd13d9700 1 --2- 172.21.15.44:0/1749498571 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xdad330 0xdcb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd23db700 1 --2- 172.21.15.44:0/1749498571 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xdcf4e0 0xda68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd1bda700 1 -- 172.21.15.44:0/1749498571 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xdad330 msgr2=0xdcb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:36.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd1bda700 1 --2- 172.21.15.44:0/1749498571 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xdad330 0xdcb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd1bda700 1 -- 172.21.15.44:0/1749498571 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xdcf4e0 msgr2=0xda68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:36.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd1bda700 1 --2- 172.21.15.44:0/1749498571 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xdcf4e0 0xda68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd1bda700 1 -- 172.21.15.44:0/1749498571 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbcc0acfc0 con 0xd85530 2024-09-13T18:28:36.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd1bda700 1 --2- 172.21.15.44:0/1749498571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xd85530 0xdcf8c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0b16b0 tx=0x7ffbc000e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec91aa06ec59af7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:36.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbacff9700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-13T18:28:36.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbacff9700 1 -- 172.21.15.44:0/1749498571 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc002c040 con 0xd85530 2024-09-13T18:28:36.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbacff9700 1 -- 172.21.15.44:0/1749498571 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ffbc00045a0 con 0xd85530 2024-09-13T18:28:36.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd70ef740 1 -- 172.21.15.44:0/1749498571 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xb201e0 con 0xd85530 2024-09-13T18:28:36.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbacff9700 1 -- 172.21.15.44:0/1749498571 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbc0025460 con 0xd85530 2024-09-13T18:28:36.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd70ef740 10 client.5697 fetch_fsmap learned FSMap version 22 2024-09-13T18:28:36.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd70ef740 1 -- 172.21.15.44:0/1749498571 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0xcb2220 con 0xd85530 2024-09-13T18:28:36.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbacff9700 1 -- 172.21.15.44:0/1749498571 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xb201e0 con 0xd85530 2024-09-13T18:28:36.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbacff9700 1 -- 172.21.15.44:0/1749498571 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 22) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ffbc00255c0 con 0xd85530 2024-09-13T18:28:36.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd70ef740 10 client.5697 fetch_fsmap finished waiting for FSMap version 22 2024-09-13T18:28:36.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd70ef740 10 client.5697 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:28:36.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd70ef740 20 client.5697 populate_metadata read hostname 'smithi044' 2024-09-13T18:28:36.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd70ef740 1 --2- 172.21.15.44:0/1749498571 >> [v2:172.21.15.44:6834/438860530,v1:172.21.15.44:6835/438860530] conn(0xda9e00 0xdaa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd70ef740 4 client.5697 mds_command: new command op to 5580 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:28:36.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd70ef740 1 -- 172.21.15.44:0/1749498571 --> [v2:172.21.15.44:6834/438860530,v1:172.21.15.44:6835/438860530] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xb6a460 con 0xda9e00 2024-09-13T18:28:36.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.165+0000 7ffbd13d9700 1 --2- 172.21.15.44:0/1749498571 >> [v2:172.21.15.44:6834/438860530,v1:172.21.15.44:6835/438860530] conn(0xda9e00 0xdaa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.169+0000 7ffbd13d9700 1 --2- 172.21.15.44:0/1749498571 >> [v2:172.21.15.44:6834/438860530,v1:172.21.15.44:6835/438860530] conn(0xda9e00 0xdaa1e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1df313a00b79bff server_cookie=ee1dd9ee9b29d0d3 in_seq=0 out_seq=0 2024-09-13T18:28:36.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.169+0000 7ffbacff9700 10 client.5697 ms_handle_connect on v2:172.21.15.44:6834/438860530 2024-09-13T18:28:36.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.169+0000 7ffbacff9700 1 -- 172.21.15.44:0/1749498571 <== mds.0 v2:172.21.15.44:6834/438860530 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0xb6a460 con 0xda9e00 2024-09-13T18:28:36.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.169+0000 7ffbacff9700 10 client.5697 handle_command_reply: tid=0 2024-09-13T18:28:36.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.169+0000 7ffbd70ef740 1 client.5697 shutdown 2024-09-13T18:28:36.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.169+0000 7ffbd70ef740 1 -- 172.21.15.44:0/1749498571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xd85530 msgr2=0xdcf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.169+0000 7ffbd70ef740 1 --2- 172.21.15.44:0/1749498571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xd85530 0xdcf8c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0b16b0 tx=0x7ffbc000e000 comp rx=0 tx=0).stop 2024-09-13T18:28:36.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.169+0000 7ffbd70ef740 1 -- 172.21.15.44:0/1749498571 shutdown_connections 2024-09-13T18:28:36.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.169+0000 7ffbd70ef740 1 --2- 172.21.15.44:0/1749498571 >> [v2:172.21.15.44:6834/438860530,v1:172.21.15.44:6835/438860530] conn(0xda9e00 0xdaa1e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.169+0000 7ffbd70ef740 1 --2- 172.21.15.44:0/1749498571 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xdcf4e0 0xda68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.169+0000 7ffbd70ef740 1 --2- 172.21.15.44:0/1749498571 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xdad330 0xdcb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.169+0000 7ffbacff9700 0 client.5697 ms_handle_reset on v2:172.21.15.44:6834/438860530 2024-09-13T18:28:36.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.169+0000 7ffbd70ef740 1 --2- 172.21.15.44:0/1749498571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xd85530 0xdcf8c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.169+0000 7ffbd70ef740 1 -- 172.21.15.44:0/1749498571 >> 172.21.15.44:0/1749498571 conn(0xb134d0 msgr2=0xdacc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:36.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.169+0000 7ffbd70ef740 1 -- 172.21.15.44:0/1749498571 shutdown_connections 2024-09-13T18:28:36.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.169+0000 7ffbd70ef740 1 -- 172.21.15.44:0/1749498571 wait complete. 2024-09-13T18:28:36.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.169+0000 7ffbd70ef740 20 client.5697 trim_cache size 0 max 16384 2024-09-13T18:28:36.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.189+0000 7ffbd70ef740 1 Processor -- start 2024-09-13T18:28:36.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.189+0000 7ffbd70ef740 1 -- start start 2024-09-13T18:28:36.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.189+0000 7ffbd70ef740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xd85530 0xde3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.189+0000 7ffbd70ef740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xdad330 0xde4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.189+0000 7ffbd70ef740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xdcf4e0 0xde49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.189+0000 7ffbd70ef740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0xc8a470 con 0xdcf4e0 2024-09-13T18:28:36.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.189+0000 7ffbd70ef740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0xd7b320 con 0xd85530 2024-09-13T18:28:36.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.189+0000 7ffbd70ef740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0xceb610 con 0xdad330 2024-09-13T18:28:36.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.189+0000 7ffbd23db700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xdcf4e0 0xde49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.189+0000 7ffbd23db700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xdcf4e0 0xde49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34298/0 (socket says 172.21.15.44:34298) 2024-09-13T18:28:36.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.189+0000 7ffbd23db700 1 -- 172.21.15.44:0/3955086584 learned_addr learned my addr 172.21.15.44:0/3955086584 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:36.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.189+0000 7ffbd13d9700 1 --2- 172.21.15.44:0/3955086584 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xdad330 0xde4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.189+0000 7ffbd1bda700 1 --2- 172.21.15.44:0/3955086584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xd85530 0xde3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.189+0000 7ffbd23db700 1 -- 172.21.15.44:0/3955086584 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xdad330 msgr2=0xde4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:36.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.189+0000 7ffbd23db700 1 --2- 172.21.15.44:0/3955086584 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xdad330 0xde4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.189+0000 7ffbd23db700 1 -- 172.21.15.44:0/3955086584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xd85530 msgr2=0xde3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:36.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.189+0000 7ffbd23db700 1 --2- 172.21.15.44:0/3955086584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xd85530 0xde3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.189+0000 7ffbd23db700 1 -- 172.21.15.44:0/3955086584 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xc98450 con 0xdcf4e0 2024-09-13T18:28:36.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.189+0000 7ffbd23db700 1 --2- 172.21.15.44:0/3955086584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xdcf4e0 0xde49a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4054f80 tx=0x7ffbc401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7ddb0cc37c7bd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:36.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbaffff700 1 -- 172.21.15.44:0/3955086584 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4001d20 con 0xdcf4e0 2024-09-13T18:28:36.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbaffff700 1 -- 172.21.15.44:0/3955086584 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc406ce90 con 0xdcf4e0 2024-09-13T18:28:36.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbaffff700 1 -- 172.21.15.44:0/3955086584 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4054be0 con 0xdcf4e0 2024-09-13T18:28:36.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd70ef740 1 -- 172.21.15.44:0/3955086584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xdcf4e0 msgr2=0xde49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd70ef740 1 --2- 172.21.15.44:0/3955086584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xdcf4e0 0xde49a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4054f80 tx=0x7ffbc401c000 comp rx=0 tx=0).stop 2024-09-13T18:28:36.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd70ef740 1 -- 172.21.15.44:0/3955086584 shutdown_connections 2024-09-13T18:28:36.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd70ef740 1 --2- 172.21.15.44:0/3955086584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xdcf4e0 0xde49a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd70ef740 1 --2- 172.21.15.44:0/3955086584 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xdad330 0xde4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd70ef740 1 --2- 172.21.15.44:0/3955086584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xd85530 0xde3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd70ef740 1 -- 172.21.15.44:0/3955086584 >> 172.21.15.44:0/3955086584 conn(0xb134d0 msgr2=0xda7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:36.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd70ef740 1 -- 172.21.15.44:0/3955086584 shutdown_connections 2024-09-13T18:28:36.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd70ef740 1 -- 172.21.15.44:0/3955086584 wait complete. 2024-09-13T18:28:36.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd70ef740 1 -- start start 2024-09-13T18:28:36.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd70ef740 1 Processor -- start 2024-09-13T18:28:36.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd70ef740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xd85530 0xe307b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd70ef740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xdad330 0xe31390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd70ef740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xdcf4e0 0xe318d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd70ef740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0xda8d70 con 0xdcf4e0 2024-09-13T18:28:36.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd70ef740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0xdcb790 con 0xd85530 2024-09-13T18:28:36.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd70ef740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0xde80c0 con 0xdad330 2024-09-13T18:28:36.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd70ef740 10 client.0 _ll_register_callbacks cb 0xc9dce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:28:36.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd23db700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xdcf4e0 0xe318d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd1bda700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xd85530 0xe307b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd13d9700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xdad330 0xe31390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd23db700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xdcf4e0 0xe318d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34310/0 (socket says 172.21.15.44:34310) 2024-09-13T18:28:36.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd23db700 1 -- 172.21.15.44:0/1201168281 learned_addr learned my addr 172.21.15.44:0/1201168281 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:36.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd23db700 1 -- 172.21.15.44:0/1201168281 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xdad330 msgr2=0xe31390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:36.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd23db700 1 --2- 172.21.15.44:0/1201168281 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xdad330 0xe31390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd23db700 1 -- 172.21.15.44:0/1201168281 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xd85530 msgr2=0xe307b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:36.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd23db700 1 --2- 172.21.15.44:0/1201168281 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xd85530 0xe307b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd23db700 1 -- 172.21.15.44:0/1201168281 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xb5e960 con 0xdcf4e0 2024-09-13T18:28:36.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.193+0000 7ffbd13d9700 1 --2- 172.21.15.44:0/1201168281 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xdad330 0xe31390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:36.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd23db700 1 --2- 172.21.15.44:0/1201168281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xdcf4e0 0xe318d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4054f80 tx=0x7ffbc4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d14ac18bc0b4c2e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:36.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbacff9700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-13T18:28:36.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbacff9700 1 -- 172.21.15.44:0/1201168281 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4054be0 con 0xdcf4e0 2024-09-13T18:28:36.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd70ef740 1 -- 172.21.15.44:0/1201168281 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffbc40590b0 con 0xdcf4e0 2024-09-13T18:28:36.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbacff9700 1 -- 172.21.15.44:0/1201168281 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ffbc4055280 con 0xdcf4e0 2024-09-13T18:28:36.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbacff9700 1 -- 172.21.15.44:0/1201168281 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbc405d670 con 0xdcf4e0 2024-09-13T18:28:36.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd70ef740 10 client.5703 fetch_fsmap learned FSMap version 22 2024-09-13T18:28:36.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd70ef740 1 -- 172.21.15.44:0/1201168281 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0xc8c720 con 0xdcf4e0 2024-09-13T18:28:36.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbacff9700 1 -- 172.21.15.44:0/1201168281 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc40590b0 con 0xdcf4e0 2024-09-13T18:28:36.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbacff9700 1 -- 172.21.15.44:0/1201168281 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 22) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ffbc4082280 con 0xdcf4e0 2024-09-13T18:28:36.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd70ef740 10 client.5703 fetch_fsmap finished waiting for FSMap version 22 2024-09-13T18:28:36.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd70ef740 10 client.5703 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:28:36.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd70ef740 20 client.5703 populate_metadata read hostname 'smithi044' 2024-09-13T18:28:36.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd70ef740 1 --2- 172.21.15.44:0/1201168281 >> [v2:172.21.15.44:6834/438860530,v1:172.21.15.44:6835/438860530] conn(0xe30cf0 0xe31e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd70ef740 4 client.5703 mds_command: new command op to 5580 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:28:36.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd70ef740 1 -- 172.21.15.44:0/1201168281 --> [v2:172.21.15.44:6834/438860530,v1:172.21.15.44:6835/438860530] -- command(tid 0: {"prefix": "status"}) v1 -- 0xb8f1e0 con 0xe30cf0 2024-09-13T18:28:36.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd1bda700 1 --2- 172.21.15.44:0/1201168281 >> [v2:172.21.15.44:6834/438860530,v1:172.21.15.44:6835/438860530] conn(0xe30cf0 0xe31e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd1bda700 1 --2- 172.21.15.44:0/1201168281 >> [v2:172.21.15.44:6834/438860530,v1:172.21.15.44:6835/438860530] conn(0xe30cf0 0xe31e10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa94698cc0ec2446 server_cookie=88672804374e365 in_seq=0 out_seq=0 2024-09-13T18:28:36.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbacff9700 10 client.5703 ms_handle_connect on v2:172.21.15.44:6834/438860530 2024-09-13T18:28:36.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbacff9700 1 -- 172.21.15.44:0/1201168281 <== mds.0 v2:172.21.15.44:6834/438860530 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0xb8f1e0 con 0xe30cf0 2024-09-13T18:28:36.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbacff9700 10 client.5703 handle_command_reply: tid=0 2024-09-13T18:28:36.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd70ef740 1 client.5703 shutdown 2024-09-13T18:28:36.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd70ef740 1 -- 172.21.15.44:0/1201168281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xdcf4e0 msgr2=0xe318d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd70ef740 1 --2- 172.21.15.44:0/1201168281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xdcf4e0 0xe318d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4054f80 tx=0x7ffbc4001250 comp rx=0 tx=0).stop 2024-09-13T18:28:36.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd70ef740 1 -- 172.21.15.44:0/1201168281 shutdown_connections 2024-09-13T18:28:36.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd70ef740 1 --2- 172.21.15.44:0/1201168281 >> [v2:172.21.15.44:6834/438860530,v1:172.21.15.44:6835/438860530] conn(0xe30cf0 0xe31e10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd70ef740 1 --2- 172.21.15.44:0/1201168281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xdcf4e0 0xe318d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbacff9700 0 client.5703 ms_handle_reset on v2:172.21.15.44:6834/438860530 2024-09-13T18:28:36.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd70ef740 1 --2- 172.21.15.44:0/1201168281 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xdad330 0xe31390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd70ef740 1 --2- 172.21.15.44:0/1201168281 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xd85530 0xe307b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd70ef740 1 -- 172.21.15.44:0/1201168281 >> 172.21.15.44:0/1201168281 conn(0xb134d0 msgr2=0xd7f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:36.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd70ef740 1 -- 172.21.15.44:0/1201168281 shutdown_connections 2024-09-13T18:28:36.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd70ef740 1 -- 172.21.15.44:0/1201168281 wait complete. 2024-09-13T18:28:36.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd70ef740 20 client.5703 trim_cache size 0 max 16384 2024-09-13T18:28:36.208 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:28:36.209 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "c8e1d12d-7fb9-4a33-982e-b895bb77262c", 2024-09-13T18:28:36.209 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-13T18:28:36.209 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 5580, 2024-09-13T18:28:36.209 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-13T18:28:36.209 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-13T18:28:36.209 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-13T18:28:36.209 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 4.5292943729999999, 2024-09-13T18:28:36.209 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 22, 2024-09-13T18:28:36.209 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 36, 2024-09-13T18:28:36.209 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 36, 2024-09-13T18:28:36.209 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 6.5053601619999997 2024-09-13T18:28:36.209 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:28:36.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd3e3e700 1 -- 172.21.15.44:0/1758154280 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ffbb0066730 msgr2=0x7ffbb0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd3e3e700 1 --2- 172.21.15.44:0/1758154280 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ffbb0066730 0x7ffbb0068bf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00090b0 tx=0x7ffbc0008030 comp rx=0 tx=0).stop 2024-09-13T18:28:36.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd3e3e700 1 -- 172.21.15.44:0/1758154280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbcc0cd6d0 msgr2=0x7ffbcc0a93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.197+0000 7ffbd3e3e700 1 --2- 172.21.15.44:0/1758154280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbcc0cd6d0 0x7ffbcc0a93b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400cc20 tx=0x7ffbc400cf30 comp rx=0 tx=0).stop 2024-09-13T18:28:36.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.201+0000 7ffbd3e3e700 1 -- 172.21.15.44:0/1758154280 shutdown_connections 2024-09-13T18:28:36.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.201+0000 7ffbd3e3e700 1 --2- 172.21.15.44:0/1758154280 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ffbb0066730 0x7ffbb0068bf0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.201+0000 7ffbd3e3e700 1 --2- 172.21.15.44:0/1758154280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbcc0cd6d0 0x7ffbcc0a93b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.201+0000 7ffbd3e3e700 1 --2- 172.21.15.44:0/1758154280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffbcc06dbf0 0x7ffbcc0a8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.201+0000 7ffbd3e3e700 1 --2- 172.21.15.44:0/1758154280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbcc06d760 0x7ffbcc0aca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.201+0000 7ffbd3e3e700 1 -- 172.21.15.44:0/1758154280 >> 172.21.15.44:0/1758154280 conn(0x7ffbcc0af620 msgr2=0x7ffbcc06bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:36.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.201+0000 7ffbd3e3e700 1 -- 172.21.15.44:0/1758154280 shutdown_connections 2024-09-13T18:28:36.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.201+0000 7ffbd3e3e700 1 -- 172.21.15.44:0/1758154280 wait complete. 2024-09-13T18:28:36.221 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:28:36.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.337+0000 7fc6a1c7b700 1 Processor -- start 2024-09-13T18:28:36.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.337+0000 7fc6a1c7b700 1 -- start start 2024-09-13T18:28:36.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.337+0000 7fc6a1c7b700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc69c0cb5c0 0x7fc69c0b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.337+0000 7fc6a1c7b700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69c0b5050 con 0x7fc69c0d0a10 2024-09-13T18:28:36.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.337+0000 7fc6a1c7b700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69c0ce3f0 con 0x7fc69c0cb150 2024-09-13T18:28:36.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.337+0000 7fc6a1c7b700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc69c15b3e0 con 0x7fc69c0cb5c0 2024-09-13T18:28:36.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.337+0000 7fc6a0c79700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc69c0d0a10 0x7fc69c0d0df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44730/0 (socket says 172.21.15.44:44730) 2024-09-13T18:28:36.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.337+0000 7fc6a0c79700 1 -- 172.21.15.44:0/3767858989 learned_addr learned my addr 172.21.15.44:0/3767858989 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:36.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.337+0000 7fc6a147a700 1 --2- 172.21.15.44:0/3767858989 >> v2:172.21.15.99:3300/0 conn(0x7fc69c0cb5c0 0x7fc69c0b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.337+0000 7fc69b7fe700 1 -- 172.21.15.44:0/3767858989 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 151667070 0 0) 0x7fc69c0b5050 con 0x7fc69c0d0a10 2024-09-13T18:28:36.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.337+0000 7fc69b7fe700 1 -- 172.21.15.44:0/3767858989 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6880035d0 con 0x7fc69c0d0a10 2024-09-13T18:28:36.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.337+0000 7fc6a147a700 1 -- 172.21.15.44:0/3767858989 >> v1:172.21.15.99:6789/0 conn(0x7fc69c0cb150 legacy=0x7fc69c0b57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.337+0000 7fc6a147a700 1 -- 172.21.15.44:0/3767858989 >> v1:172.21.15.44:6789/0 conn(0x7fc69c0d0a10 legacy=0x7fc69c0d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.337+0000 7fc6a147a700 1 -- 172.21.15.44:0/3767858989 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c0cbd60 con 0x7fc69c0cb5c0 2024-09-13T18:28:36.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.337+0000 7fc6a147a700 1 --2- 172.21.15.44:0/3767858989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc69c0cb5c0 0x7fc69c0b5ef0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc694009880 tx=0x7fc694009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4beccc781f4a278 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:36.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.337+0000 7fc69b7fe700 1 -- 172.21.15.44:0/3767858989 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694011830 con 0x7fc69c0cb5c0 2024-09-13T18:28:36.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.337+0000 7fc69b7fe700 1 -- 172.21.15.44:0/3767858989 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc694011990 con 0x7fc69c0cb5c0 2024-09-13T18:28:36.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.337+0000 7fc69b7fe700 1 -- 172.21.15.44:0/3767858989 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694011d20 con 0x7fc69c0cb5c0 2024-09-13T18:28:36.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.341+0000 7fc6a1c7b700 1 -- 172.21.15.44:0/3767858989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc69c0cb5c0 msgr2=0x7fc69c0b5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.341+0000 7fc6a1c7b700 1 --2- 172.21.15.44:0/3767858989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc69c0cb5c0 0x7fc69c0b5ef0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc694009880 tx=0x7fc694009b90 comp rx=0 tx=0).stop 2024-09-13T18:28:36.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.341+0000 7fc6a1c7b700 1 -- 172.21.15.44:0/3767858989 shutdown_connections 2024-09-13T18:28:36.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.341+0000 7fc6a1c7b700 1 --2- 172.21.15.44:0/3767858989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc69c0cb5c0 0x7fc69c0b5ef0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.341+0000 7fc6a1c7b700 1 -- 172.21.15.44:0/3767858989 >> 172.21.15.44:0/3767858989 conn(0x7fc69c071ee0 msgr2=0x7fc69c0722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:36.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.341+0000 7fc6a1c7b700 1 -- 172.21.15.44:0/3767858989 shutdown_connections 2024-09-13T18:28:36.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.341+0000 7fc6a1c7b700 1 -- 172.21.15.44:0/3767858989 wait complete. 2024-09-13T18:28:36.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.341+0000 7fc6a1c7b700 1 Processor -- start 2024-09-13T18:28:36.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.341+0000 7fc6a1c7b700 1 -- start start 2024-09-13T18:28:36.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.345+0000 7fc6a1c7b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc69c0cb150 0x7fc69c0c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.345+0000 7fc6a1c7b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc69c0cb5c0 0x7fc69c146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.345+0000 7fc6a1c7b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc69c0d0a10 0x7fc69c151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.345+0000 7fc6a1c7b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c0ca3c0 con 0x7fc69c0cb150 2024-09-13T18:28:36.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.345+0000 7fc6a1c7b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c146ac0 con 0x7fc69c0d0a10 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.345+0000 7fc6a1c7b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c0c8de0 con 0x7fc69c0cb5c0 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.345+0000 7fc6a0c79700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc69c0cb150 0x7fc69c0c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.345+0000 7fc6a0c79700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc69c0cb150 0x7fc69c0c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34324/0 (socket says 172.21.15.44:34324) 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.345+0000 7fc6a0c79700 1 -- 172.21.15.44:0/2437248025 learned_addr learned my addr 172.21.15.44:0/2437248025 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.345+0000 7fc6a147a700 1 --2- 172.21.15.44:0/2437248025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc69c0d0a10 0x7fc69c151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.345+0000 7fc69bfff700 1 --2- 172.21.15.44:0/2437248025 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc69c0cb5c0 0x7fc69c146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.345+0000 7fc6a0c79700 1 -- 172.21.15.44:0/2437248025 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc69c0cb5c0 msgr2=0x7fc69c146580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.345+0000 7fc6a0c79700 1 --2- 172.21.15.44:0/2437248025 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc69c0cb5c0 0x7fc69c146580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.345+0000 7fc6a0c79700 1 -- 172.21.15.44:0/2437248025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc69c0d0a10 msgr2=0x7fc69c151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.345+0000 7fc6a0c79700 1 --2- 172.21.15.44:0/2437248025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc69c0d0a10 0x7fc69c151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.345+0000 7fc6a0c79700 1 -- 172.21.15.44:0/2437248025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6940094b0 con 0x7fc69c0cb150 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.345+0000 7fc6a0c79700 1 --2- 172.21.15.44:0/2437248025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc69c0cb150 0x7fc69c0c9e80 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc68c00cbc0 tx=0x7fc68c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.345+0000 7fc6997fa700 1 -- 172.21.15.44:0/2437248025 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c00a9e0 con 0x7fc69c0cb150 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.345+0000 7fc6997fa700 1 -- 172.21.15.44:0/2437248025 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68c00ab40 con 0x7fc69c0cb150 2024-09-13T18:28:36.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.345+0000 7fc6a1c7b700 1 -- 172.21.15.44:0/2437248025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69c0c90c0 con 0x7fc69c0cb150 2024-09-13T18:28:36.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.345+0000 7fc6997fa700 1 -- 172.21.15.44:0/2437248025 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c012400 con 0x7fc69c0cb150 2024-09-13T18:28:36.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.345+0000 7fc6a1c7b700 1 -- 172.21.15.44:0/2437248025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69c0c9680 con 0x7fc69c0cb150 2024-09-13T18:28:36.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.345+0000 7fc6a1c7b700 1 -- 172.21.15.44:0/2437248025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc69c0d0df0 con 0x7fc69c0cb150 2024-09-13T18:28:36.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.349+0000 7fc6997fa700 1 -- 172.21.15.44:0/2437248025 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc68c01b3b0 con 0x7fc69c0cb150 2024-09-13T18:28:36.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.349+0000 7fc6997fa700 1 --2- 172.21.15.44:0/2437248025 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc67c066730 0x7fc67c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.349+0000 7fc6997fa700 1 -- 172.21.15.44:0/2437248025 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc68c083da0 con 0x7fc69c0cb150 2024-09-13T18:28:36.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.349+0000 7fc69bfff700 1 --2- 172.21.15.44:0/2437248025 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc67c066730 0x7fc67c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.349+0000 7fc69bfff700 1 --2- 172.21.15.44:0/2437248025 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc67c066730 0x7fc67c068bf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc69c150fb0 tx=0x7fc684009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:36.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.353+0000 7fc6997fa700 1 -- 172.21.15.44:0/2437248025 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc68c051010 con 0x7fc69c0cb150 2024-09-13T18:28:36.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.565+0000 7fc6a1c7b700 1 -- 172.21.15.44:0/2437248025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc69c158400 con 0x7fc69c0cb150 2024-09-13T18:28:36.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.565+0000 7fc6997fa700 1 -- 172.21.15.44:0/2437248025 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc68c017070 con 0x7fc69c0cb150 2024-09-13T18:28:36.572 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.569+0000 7fc6a1c7b700 1 -- 172.21.15.44:0/2437248025 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc67c066730 msgr2=0x7fc67c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.569+0000 7fc6a1c7b700 1 --2- 172.21.15.44:0/2437248025 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc67c066730 0x7fc67c068bf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc69c150fb0 tx=0x7fc684009040 comp rx=0 tx=0).stop 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.569+0000 7fc6a1c7b700 1 -- 172.21.15.44:0/2437248025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc69c0cb150 msgr2=0x7fc69c0c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.569+0000 7fc6a1c7b700 1 --2- 172.21.15.44:0/2437248025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc69c0cb150 0x7fc69c0c9e80 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc68c00cbc0 tx=0x7fc68c00cca0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.569+0000 7fc6a1c7b700 1 -- 172.21.15.44:0/2437248025 shutdown_connections 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.569+0000 7fc6a1c7b700 1 --2- 172.21.15.44:0/2437248025 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc67c066730 0x7fc67c068bf0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.569+0000 7fc6a1c7b700 1 --2- 172.21.15.44:0/2437248025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc69c0d0a10 0x7fc69c151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.569+0000 7fc6a1c7b700 1 --2- 172.21.15.44:0/2437248025 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc69c0cb5c0 0x7fc69c146580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.569+0000 7fc6a1c7b700 1 --2- 172.21.15.44:0/2437248025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc69c0cb150 0x7fc69c0c9e80 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.569+0000 7fc6a1c7b700 1 -- 172.21.15.44:0/2437248025 >> 172.21.15.44:0/2437248025 conn(0x7fc69c071ee0 msgr2=0x7fc69c0b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.569+0000 7fc6a1c7b700 1 -- 172.21.15.44:0/2437248025 shutdown_connections 2024-09-13T18:28:36.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:36.569+0000 7fc6a1c7b700 1 -- 172.21.15.44:0/2437248025 wait complete. 2024-09-13T18:28:36.588 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:28:36.588 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:28:36.588 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-13T18:28:36.588 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:28:36.588 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:36.588 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:28:36.588 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:28:36.588 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:28:36.588 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:28:36.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:36.589 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42507sec preferred_lft 42507sec 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:80:b2:e4:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi044.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 2e:69:eb:1c:57:57 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::8842:91ff:feed:2c53/64 scope link 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi044.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 2e:69:eb:1c:57:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::2c69:ebff:fe1c:5757/64 scope link 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi044.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 86:e5:07:ac:f1:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::84e5:7ff:feac:f11b/64 scope link 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:36.598 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:28:36.653 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-13T18:28:36.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:36.655 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-13T18:28:36.663 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-13T18:28:36.663 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:28:36.664 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:28:36.664 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:28:36.664 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:28:36.664 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:28:36.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:36.664 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2024-09-13T18:28:36.664 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-13T18:28:36.664 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:28:36.664 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:28:36.664 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:28:36.665 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-13T18:28:36.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:36.704 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-13T18:28:36.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:28:36.711 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:28:36.711 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:28:36.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:36.712 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-13T18:28:36.771 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:28:36.771 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:28:36.771 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:36.778 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:28:36.778 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:28:36.779 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:36.783 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:28:36.801 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:28:36.801 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:28:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:28:36.858 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:28:36.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:36.859 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:28:36.866 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:28:36.867 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:28:36.869 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:28:36.885 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:28:36.885 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:28:36.941 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:28:36.942 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:28:36.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:36.943 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:28:36.954 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2024-09-13T18:28:36.945+0000 7f8c963fc640 -1 init, newargv = 0x55f490d2f630 newargc=15 2024-09-13T18:28:36.954 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[38443]: starting ceph client 2024-09-13T18:28:36.961 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[38443]: starting fuse 2024-09-13T18:28:38.051 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:28:38.071 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:28:38.071 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:28:38.086 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:28:38.087 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:28:38.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:38.087 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:28:38.094 INFO:teuthology.orchestra.run.smithi044.stdout:52 2024-09-13T18:28:38.095 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T18:28:38.095 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:28:38.095 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2024-09-13T18:28:38.095 DEBUG:teuthology.orchestra.run.smithi044:> import re 2024-09-13T18:28:38.095 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:28:38.095 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2024-09-13T18:28:38.095 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:38.095 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2024-09-13T18:28:38.095 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:28:38.095 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2024-09-13T18:28:38.095 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:28:38.096 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:38.096 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2024-09-13T18:28:38.096 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2024-09-13T18:28:38.096 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2024-09-13T18:28:38.096 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2024-09-13T18:28:38.096 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:38.096 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2024-09-13T18:28:38.096 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:28:38.096 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:28:38.096 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:28:38.096 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2024-09-13T18:28:38.096 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2024-09-13T18:28:38.096 DEBUG:teuthology.orchestra.run.smithi044:> return f 2024-09-13T18:28:38.096 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:28:38.097 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:38.097 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.0")) 2024-09-13T18:28:38.097 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:28:38.221 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.0.38443.asok 2024-09-13T18:28:38.404 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.38443.asok 2024-09-13T18:28:38.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:38.404 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.38443.asok status 2024-09-13T18:28:38.512 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:28:38.512 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2024-09-13T18:28:38.512 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:28:38.512 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:28:38.512 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "0", 2024-09-13T18:28:38.512 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2024-09-13T18:28:38.512 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:28:38.513 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "38443", 2024-09-13T18:28:38.513 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2024-09-13T18:28:38.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:28:38.513 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2024-09-13T18:28:38.513 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2024-09-13T18:28:38.513 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 5715, 2024-09-13T18:28:38.513 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2024-09-13T18:28:38.513 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2024-09-13T18:28:38.514 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2024-09-13T18:28:38.514 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 5715 2024-09-13T18:28:38.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:28:38.514 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:28:38.514 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-13T18:28:38.514 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:28:38.514 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 629215588 2024-09-13T18:28:38.514 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:28:38.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:28:38.514 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:28:38.514 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-13T18:28:38.514 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:28:38.514 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 629215588 2024-09-13T18:28:38.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:28:38.514 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.5715 192.168.0.1:0/629215588", 2024-09-13T18:28:38.515 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/629215588", 2024-09-13T18:28:38.515 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2024-09-13T18:28:38.515 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 22, 2024-09-13T18:28:38.515 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 36, 2024-09-13T18:28:38.515 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:28:38.515 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2024-09-13T18:28:38.515 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2024-09-13T18:28:38.515 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:28:38.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:38.523 DEBUG:teuthology.orchestra.run.smithi044:> stat --file-system '--printf=%T 2024-09-13T18:28:38.523 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:38.531 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2024-09-13T18:28:38.531 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:38.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:38.532 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:38.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:38.543 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R) 2024-09-13T18:28:38.601 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-09-13T18:28:38.593+0000 7f0bff3b5700 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x100000001f7 2024-09-13T18:28:38.609 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-09-13T18:28:38.601+0000 7f0bff3b5700 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000001 2024-09-13T18:28:38.613 INFO:teuthology.orchestra.run.smithi044.stdout:.: 2024-09-13T18:28:38.613 INFO:teuthology.orchestra.run.smithi044.stdout:linkdir 2024-09-13T18:28:38.613 INFO:teuthology.orchestra.run.smithi044.stdout:rootfile 2024-09-13T18:28:38.613 INFO:teuthology.orchestra.run.smithi044.stdout:subdir 2024-09-13T18:28:38.613 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:38.613 INFO:teuthology.orchestra.run.smithi044.stdout:./linkdir: 2024-09-13T18:28:38.613 INFO:teuthology.orchestra.run.smithi044.stdout:link2 2024-09-13T18:28:38.613 INFO:teuthology.orchestra.run.smithi044.stdout:link3 2024-09-13T18:28:38.613 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:38.613 INFO:teuthology.orchestra.run.smithi044.stdout:./subdir: 2024-09-13T18:28:38.613 INFO:teuthology.orchestra.run.smithi044.stdout:subdirfile 2024-09-13T18:28:38.613 INFO:teuthology.orchestra.run.smithi044.stdout:subsubdir 2024-09-13T18:28:38.613 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:38.614 INFO:teuthology.orchestra.run.smithi044.stdout:./subdir/subsubdir: 2024-09-13T18:28:38.614 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:28:38.614 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:28:38.621 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:28:38.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.729+0000 7f99b15de700 1 Processor -- start 2024-09-13T18:28:38.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.729+0000 7f99b15de700 1 -- start start 2024-09-13T18:28:38.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.729+0000 7f99b15de700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f99ac15cec0 0x7f99ac0cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:38.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.729+0000 7f99b15de700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f99ac06b310 0x7f99ac0d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:38.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.729+0000 7f99b15de700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99ac0d21e0 con 0x7f99ac15cae0 2024-09-13T18:28:38.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.729+0000 7f99b15de700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ac0d1750 con 0x7f99ac15cec0 2024-09-13T18:28:38.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.729+0000 7f99b15de700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ac0d1940 con 0x7f99ac06b310 2024-09-13T18:28:38.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.729+0000 7f99a37fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f99ac15cec0 0x7f99ac0cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:38.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.729+0000 7f99a37fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f99ac15cec0 0x7f99ac0cf030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34328/0 (socket says 172.21.15.44:34328) 2024-09-13T18:28:38.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.729+0000 7f99a37fe700 1 -- 172.21.15.44:0/34708980 learned_addr learned my addr 172.21.15.44:0/34708980 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:38.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.733+0000 7f99b0ddd700 1 --2- 172.21.15.44:0/34708980 >> v2:172.21.15.99:3300/0 conn(0x7f99ac06b310 0x7f99ac0d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:38.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.733+0000 7f99a37fe700 1 -- 172.21.15.44:0/34708980 >> v2:172.21.15.99:3300/0 conn(0x7f99ac06b310 msgr2=0x7f99ac0d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:38.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.733+0000 7f99a37fe700 1 --2- 172.21.15.44:0/34708980 >> v2:172.21.15.99:3300/0 conn(0x7f99ac06b310 0x7f99ac0d1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:38.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.733+0000 7f99a37fe700 1 -- 172.21.15.44:0/34708980 >> v1:172.21.15.99:6789/0 conn(0x7f99ac15cae0 legacy=0x7f99ac06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:38.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.733+0000 7f99a37fe700 1 -- 172.21.15.44:0/34708980 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac0d1c20 con 0x7f99ac15cec0 2024-09-13T18:28:38.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.733+0000 7f99a37fe700 1 --2- 172.21.15.44:0/34708980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99ac15cec0 0x7f99ac0cf030 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9994009910 tx=0x7f9994009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f64df0e31532d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:38.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.733+0000 7f99ab7fe700 1 -- 172.21.15.44:0/34708980 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9994011830 con 0x7f99ac15cec0 2024-09-13T18:28:38.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.733+0000 7f99ab7fe700 1 -- 172.21.15.44:0/34708980 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9994011990 con 0x7f99ac15cec0 2024-09-13T18:28:38.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.733+0000 7f99ab7fe700 1 -- 172.21.15.44:0/34708980 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9994011d40 con 0x7f99ac15cec0 2024-09-13T18:28:38.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.733+0000 7f99b15de700 1 -- 172.21.15.44:0/34708980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99ac15cec0 msgr2=0x7f99ac0cf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:38.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.733+0000 7f99b15de700 1 --2- 172.21.15.44:0/34708980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99ac15cec0 0x7f99ac0cf030 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9994009910 tx=0x7f9994009c20 comp rx=0 tx=0).stop 2024-09-13T18:28:38.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.733+0000 7f99b15de700 1 -- 172.21.15.44:0/34708980 shutdown_connections 2024-09-13T18:28:38.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.733+0000 7f99b15de700 1 --2- 172.21.15.44:0/34708980 >> v2:172.21.15.99:3300/0 conn(0x7f99ac06b310 0x7f99ac0d1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:38.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.733+0000 7f99b15de700 1 --2- 172.21.15.44:0/34708980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99ac15cec0 0x7f99ac0cf030 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:38.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.733+0000 7f99b15de700 1 -- 172.21.15.44:0/34708980 >> 172.21.15.44:0/34708980 conn(0x7f99ac0d2c80 msgr2=0x7f99ac0d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:38.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.733+0000 7f99b15de700 1 -- 172.21.15.44:0/34708980 shutdown_connections 2024-09-13T18:28:38.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.733+0000 7f99b15de700 1 -- 172.21.15.44:0/34708980 wait complete. 2024-09-13T18:28:38.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.737+0000 7f99b15de700 1 Processor -- start 2024-09-13T18:28:38.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.737+0000 7f99b15de700 1 -- start start 2024-09-13T18:28:38.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.737+0000 7f99b15de700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99ac06b310 0x7f99ac150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:38.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.737+0000 7f99b15de700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f99ac15cae0 0x7f99ac150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:38.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.737+0000 7f99b15de700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99ac15cec0 0x7f99ac0b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:38.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.737+0000 7f99b15de700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac0cb670 con 0x7f99ac15cec0 2024-09-13T18:28:38.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.737+0000 7f99b15de700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac0cb950 con 0x7f99ac06b310 2024-09-13T18:28:38.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.737+0000 7f99b15de700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac0cbc30 con 0x7f99ac15cae0 2024-09-13T18:28:38.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.737+0000 7f99b0ddd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99ac15cec0 0x7f99ac0b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:38.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.737+0000 7f99abfff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99ac06b310 0x7f99ac150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:38.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.737+0000 7f99b0ddd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99ac15cec0 0x7f99ac0b3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34344/0 (socket says 172.21.15.44:34344) 2024-09-13T18:28:38.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.737+0000 7f99b0ddd700 1 -- 172.21.15.44:0/2658443787 learned_addr learned my addr 172.21.15.44:0/2658443787 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:38.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.737+0000 7f99a37fe700 1 --2- 172.21.15.44:0/2658443787 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f99ac15cae0 0x7f99ac150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:38.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.741+0000 7f99abfff700 1 -- 172.21.15.44:0/2658443787 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f99ac15cae0 msgr2=0x7f99ac150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:38.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.741+0000 7f99abfff700 1 --2- 172.21.15.44:0/2658443787 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f99ac15cae0 0x7f99ac150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:38.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.741+0000 7f99abfff700 1 -- 172.21.15.44:0/2658443787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99ac15cec0 msgr2=0x7f99ac0b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:38.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.741+0000 7f99abfff700 1 --2- 172.21.15.44:0/2658443787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99ac15cec0 0x7f99ac0b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:38.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.741+0000 7f99abfff700 1 -- 172.21.15.44:0/2658443787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9994009570 con 0x7f99ac06b310 2024-09-13T18:28:38.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.741+0000 7f99a37fe700 1 --2- 172.21.15.44:0/2658443787 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f99ac15cae0 0x7f99ac150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:38.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.741+0000 7f99b0ddd700 1 --2- 172.21.15.44:0/2658443787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99ac15cec0 0x7f99ac0b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:38.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.741+0000 7f99abfff700 1 --2- 172.21.15.44:0/2658443787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99ac06b310 0x7f99ac150e20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f999c00c480 tx=0x7f999c00c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:38.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.741+0000 7f99a97fa700 1 -- 172.21.15.44:0/2658443787 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c0052d0 con 0x7f99ac06b310 2024-09-13T18:28:38.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.741+0000 7f99a97fa700 1 -- 172.21.15.44:0/2658443787 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999c005430 con 0x7f99ac06b310 2024-09-13T18:28:38.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.741+0000 7f99a97fa700 1 -- 172.21.15.44:0/2658443787 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c0055a0 con 0x7f99ac06b310 2024-09-13T18:28:38.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.741+0000 7f99b15de700 1 -- 172.21.15.44:0/2658443787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99ac0cbf10 con 0x7f99ac06b310 2024-09-13T18:28:38.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.741+0000 7f99b15de700 1 -- 172.21.15.44:0/2658443787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99ac0cb190 con 0x7f99ac06b310 2024-09-13T18:28:38.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.741+0000 7f99b15de700 1 -- 172.21.15.44:0/2658443787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99ac0cc430 con 0x7f99ac06b310 2024-09-13T18:28:38.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.741+0000 7f99a97fa700 1 -- 172.21.15.44:0/2658443787 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f999c0038e0 con 0x7f99ac06b310 2024-09-13T18:28:38.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.745+0000 7f99a97fa700 1 --2- 172.21.15.44:0/2658443787 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f998c066730 0x7f998c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:38.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.745+0000 7f99a97fa700 1 -- 172.21.15.44:0/2658443787 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f999c083490 con 0x7f99ac06b310 2024-09-13T18:28:38.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.745+0000 7f99a37fe700 1 --2- 172.21.15.44:0/2658443787 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f998c066730 0x7f998c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:38.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.745+0000 7f99a37fe700 1 --2- 172.21.15.44:0/2658443787 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f998c066730 0x7f998c068bf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9994000c00 tx=0x7f9994008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:38.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.753+0000 7f99a97fa700 1 -- 172.21.15.44:0/2658443787 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f99ac0cc430 con 0x7f99ac06b310 2024-09-13T18:28:38.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.933+0000 7f99b15de700 1 -- 172.21.15.44:0/2658443787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99ac0cc430 con 0x7f99ac06b310 2024-09-13T18:28:38.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.933+0000 7f99a97fa700 1 -- 172.21.15.44:0/2658443787 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16636 (secure 0 0 0) 0x7f99ac0cc430 con 0x7f99ac06b310 2024-09-13T18:28:38.942 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:38.943 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":36,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:28:29.639664+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:28:02.951723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:28:04.057772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/939073284":"2024-09-14T18:28:29.639607+0000","172.21.15.44:6834/939073284":"2024-09-14T18:28:29.639607+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:28:38.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.937+0000 7f99b15de700 1 -- 172.21.15.44:0/2658443787 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f998c066730 msgr2=0x7f998c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:38.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.937+0000 7f99b15de700 1 --2- 172.21.15.44:0/2658443787 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f998c066730 0x7f998c068bf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9994000c00 tx=0x7f9994008030 comp rx=0 tx=0).stop 2024-09-13T18:28:38.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.937+0000 7f99b15de700 1 -- 172.21.15.44:0/2658443787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99ac06b310 msgr2=0x7f99ac150e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:38.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.937+0000 7f99b15de700 1 --2- 172.21.15.44:0/2658443787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99ac06b310 0x7f99ac150e20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f999c00c480 tx=0x7f999c00c790 comp rx=0 tx=0).stop 2024-09-13T18:28:38.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.937+0000 7f99b15de700 1 -- 172.21.15.44:0/2658443787 shutdown_connections 2024-09-13T18:28:38.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.937+0000 7f99b15de700 1 --2- 172.21.15.44:0/2658443787 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f998c066730 0x7f998c068bf0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:38.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.937+0000 7f99b15de700 1 --2- 172.21.15.44:0/2658443787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99ac15cec0 0x7f99ac0b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:38.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.937+0000 7f99b15de700 1 --2- 172.21.15.44:0/2658443787 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f99ac15cae0 0x7f99ac150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:38.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.937+0000 7f99b15de700 1 --2- 172.21.15.44:0/2658443787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99ac06b310 0x7f99ac150e20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:38.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.937+0000 7f99b15de700 1 -- 172.21.15.44:0/2658443787 >> 172.21.15.44:0/2658443787 conn(0x7f99ac0d2c80 msgr2=0x7f99ac1585c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:38.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.941+0000 7f99b15de700 1 -- 172.21.15.44:0/2658443787 shutdown_connections 2024-09-13T18:28:38.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:38.941+0000 7f99b15de700 1 -- 172.21.15.44:0/2658443787 wait complete. 2024-09-13T18:28:38.962 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:28:02.951723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:28:04.057772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:28:38.962 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:28:39.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.077+0000 7ff73759e700 1 Processor -- start 2024-09-13T18:28:39.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.077+0000 7ff73759e700 1 -- start start 2024-09-13T18:28:39.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.077+0000 7ff73759e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff73815cda0 0x7ff73806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.077+0000 7ff73759e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff73806a520 0x7ff73806a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.077+0000 7ff73759e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff73806aeb0 con 0x7ff7380ceb70 2024-09-13T18:28:39.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.077+0000 7ff73759e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff73806be40 con 0x7ff73806a520 2024-09-13T18:28:39.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.077+0000 7ff73759e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380b64f0 con 0x7ff73815cda0 2024-09-13T18:28:39.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.081+0000 7ff736d9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff73806a520 0x7ff73806a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.081+0000 7ff736d9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff73806a520 0x7ff73806a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34358/0 (socket says 172.21.15.44:34358) 2024-09-13T18:28:39.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.081+0000 7ff736d9d700 1 -- 172.21.15.44:0/661306770 learned_addr learned my addr 172.21.15.44:0/661306770 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:39.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.081+0000 7ff73659c700 1 --2- 172.21.15.44:0/661306770 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff73815cda0 0x7ff73806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.081+0000 7ff736d9d700 1 -- 172.21.15.44:0/661306770 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff73815cda0 msgr2=0x7ff73806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:39.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.081+0000 7ff736d9d700 1 --2- 172.21.15.44:0/661306770 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff73815cda0 0x7ff73806b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.081+0000 7ff736d9d700 1 -- 172.21.15.44:0/661306770 >> v1:172.21.15.99:6789/0 conn(0x7ff7380ceb70 legacy=0x7ff7380b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.081+0000 7ff736d9d700 1 -- 172.21.15.44:0/661306770 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7380b8430 con 0x7ff73806a520 2024-09-13T18:28:39.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.081+0000 7ff736d9d700 1 --2- 172.21.15.44:0/661306770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff73806a520 0x7ff73806a970 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff730009e50 tx=0x7ff73000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74898a3f1181f2fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:39.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.081+0000 7ff73559a700 1 -- 172.21.15.44:0/661306770 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73000e070 con 0x7ff73806a520 2024-09-13T18:28:39.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.081+0000 7ff73559a700 1 -- 172.21.15.44:0/661306770 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73000b910 con 0x7ff73806a520 2024-09-13T18:28:39.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.081+0000 7ff73559a700 1 -- 172.21.15.44:0/661306770 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73000bcc0 con 0x7ff73806a520 2024-09-13T18:28:39.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.081+0000 7ff73759e700 1 -- 172.21.15.44:0/661306770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff73806a520 msgr2=0x7ff73806a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.081+0000 7ff73759e700 1 --2- 172.21.15.44:0/661306770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff73806a520 0x7ff73806a970 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff730009e50 tx=0x7ff73000b330 comp rx=0 tx=0).stop 2024-09-13T18:28:39.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.081+0000 7ff73759e700 1 -- 172.21.15.44:0/661306770 shutdown_connections 2024-09-13T18:28:39.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.081+0000 7ff73759e700 1 --2- 172.21.15.44:0/661306770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff73806a520 0x7ff73806a970 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.081+0000 7ff73759e700 1 --2- 172.21.15.44:0/661306770 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff73815cda0 0x7ff73806b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.081+0000 7ff73759e700 1 -- 172.21.15.44:0/661306770 >> 172.21.15.44:0/661306770 conn(0x7ff7380d2cb0 msgr2=0x7ff7380d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:39.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.081+0000 7ff73759e700 1 -- 172.21.15.44:0/661306770 shutdown_connections 2024-09-13T18:28:39.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.081+0000 7ff73759e700 1 -- 172.21.15.44:0/661306770 wait complete. 2024-09-13T18:28:39.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.085+0000 7ff73759e700 1 Processor -- start 2024-09-13T18:28:39.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.085+0000 7ff73759e700 1 -- start start 2024-09-13T18:28:39.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.085+0000 7ff73759e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff73806a520 0x7ff73814b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.085+0000 7ff73759e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff7380ceb70 0x7ff7380c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.085+0000 7ff73759e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff73815cda0 0x7ff7380b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.085+0000 7ff73759e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73814b5a0 con 0x7ff73806a520 2024-09-13T18:28:39.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.085+0000 7ff73759e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73815f270 con 0x7ff73815cda0 2024-09-13T18:28:39.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.085+0000 7ff73759e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73815f510 con 0x7ff7380ceb70 2024-09-13T18:28:39.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.085+0000 7ff73659c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff73806a520 0x7ff73814b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.085+0000 7ff73659c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff73806a520 0x7ff73814b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34370/0 (socket says 172.21.15.44:34370) 2024-09-13T18:28:39.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.085+0000 7ff73659c700 1 -- 172.21.15.44:0/3659200875 learned_addr learned my addr 172.21.15.44:0/3659200875 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:39.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.085+0000 7ff736d9d700 1 --2- 172.21.15.44:0/3659200875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff73815cda0 0x7ff7380b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.085+0000 7ff735d9b700 1 --2- 172.21.15.44:0/3659200875 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff7380ceb70 0x7ff7380c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.085+0000 7ff73659c700 1 -- 172.21.15.44:0/3659200875 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff7380ceb70 msgr2=0x7ff7380c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.085+0000 7ff73659c700 1 --2- 172.21.15.44:0/3659200875 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff7380ceb70 0x7ff7380c72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.085+0000 7ff73659c700 1 -- 172.21.15.44:0/3659200875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff73815cda0 msgr2=0x7ff7380b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.085+0000 7ff73659c700 1 --2- 172.21.15.44:0/3659200875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff73815cda0 0x7ff7380b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.085+0000 7ff73659c700 1 -- 172.21.15.44:0/3659200875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff730009b30 con 0x7ff73806a520 2024-09-13T18:28:39.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.085+0000 7ff73659c700 1 --2- 172.21.15.44:0/3659200875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff73806a520 0x7ff73814b060 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff72800e9d0 tx=0x7ff72800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:39.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.089+0000 7ff72effd700 1 -- 172.21.15.44:0/3659200875 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff728009720 con 0x7ff73806a520 2024-09-13T18:28:39.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.089+0000 7ff72effd700 1 -- 172.21.15.44:0/3659200875 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72800ee70 con 0x7ff73806a520 2024-09-13T18:28:39.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.089+0000 7ff73759e700 1 -- 172.21.15.44:0/3659200875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff73815f7f0 con 0x7ff73806a520 2024-09-13T18:28:39.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.089+0000 7ff72effd700 1 -- 172.21.15.44:0/3659200875 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72800ca50 con 0x7ff73806a520 2024-09-13T18:28:39.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.089+0000 7ff73759e700 1 -- 172.21.15.44:0/3659200875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73815fdb0 con 0x7ff73806a520 2024-09-13T18:28:39.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.089+0000 7ff73759e700 1 -- 172.21.15.44:0/3659200875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7380cefd0 con 0x7ff73806a520 2024-09-13T18:28:39.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.089+0000 7ff72effd700 1 -- 172.21.15.44:0/3659200875 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff72800cbb0 con 0x7ff73806a520 2024-09-13T18:28:39.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.093+0000 7ff72effd700 1 --2- 172.21.15.44:0/3659200875 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff718066730 0x7ff718068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.093+0000 7ff72effd700 1 -- 172.21.15.44:0/3659200875 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff728084270 con 0x7ff73806a520 2024-09-13T18:28:39.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.093+0000 7ff735d9b700 1 --2- 172.21.15.44:0/3659200875 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff718066730 0x7ff718068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.093+0000 7ff735d9b700 1 --2- 172.21.15.44:0/3659200875 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff718066730 0x7ff718068bf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff7380cd3f0 tx=0x7ff720009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:39.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.101+0000 7ff72effd700 1 -- 172.21.15.44:0/3659200875 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff728051500 con 0x7ff73806a520 2024-09-13T18:28:39.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.273+0000 7ff73759e700 1 -- 172.21.15.44:0/3659200875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff7380b6bf0 con 0x7ff73806a520 2024-09-13T18:28:39.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.273+0000 7ff72effd700 1 -- 172.21.15.44:0/3659200875 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff72800ce60 con 0x7ff73806a520 2024-09-13T18:28:39.280 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:28:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.277+0000 7ff73759e700 1 -- 172.21.15.44:0/3659200875 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff718066730 msgr2=0x7ff718068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.277+0000 7ff73759e700 1 --2- 172.21.15.44:0/3659200875 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff718066730 0x7ff718068bf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff7380cd3f0 tx=0x7ff720009040 comp rx=0 tx=0).stop 2024-09-13T18:28:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.277+0000 7ff73759e700 1 -- 172.21.15.44:0/3659200875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff73806a520 msgr2=0x7ff73814b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.277+0000 7ff73759e700 1 --2- 172.21.15.44:0/3659200875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff73806a520 0x7ff73814b060 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff72800e9d0 tx=0x7ff72800ece0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.277+0000 7ff73759e700 1 -- 172.21.15.44:0/3659200875 shutdown_connections 2024-09-13T18:28:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.277+0000 7ff73759e700 1 --2- 172.21.15.44:0/3659200875 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff718066730 0x7ff718068bf0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.277+0000 7ff73759e700 1 --2- 172.21.15.44:0/3659200875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff73815cda0 0x7ff7380b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.277+0000 7ff73759e700 1 --2- 172.21.15.44:0/3659200875 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff7380ceb70 0x7ff7380c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.277+0000 7ff73759e700 1 --2- 172.21.15.44:0/3659200875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff73806a520 0x7ff73814b060 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.277+0000 7ff73759e700 1 -- 172.21.15.44:0/3659200875 >> 172.21.15.44:0/3659200875 conn(0x7ff7380d2cb0 msgr2=0x7ff7380d1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:39.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.277+0000 7ff73759e700 1 -- 172.21.15.44:0/3659200875 shutdown_connections 2024-09-13T18:28:39.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.277+0000 7ff73759e700 1 -- 172.21.15.44:0/3659200875 wait complete. 2024-09-13T18:28:39.295 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:28:39.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b0359e700 1 Processor -- start 2024-09-13T18:28:39.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b0359e700 1 -- start start 2024-09-13T18:28:39.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b0359e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2b0415cda0 0x7f2b0406b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b0359e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2b040ceb70 0x7f2b040b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b0359e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b040b8430 con 0x7f2b0406a520 2024-09-13T18:28:39.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b0359e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0406be40 con 0x7f2b040ceb70 2024-09-13T18:28:39.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b0359e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b040cf350 con 0x7f2b0415cda0 2024-09-13T18:28:39.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b01d9b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2b040ceb70 0x7f2b040b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b0259c700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2b0415cda0 0x7f2b0406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b01d9b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2b040ceb70 0x7f2b040b5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34372/0 (socket says 172.21.15.44:34372) 2024-09-13T18:28:39.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b01d9b700 1 -- 172.21.15.44:0/546756573 learned_addr learned my addr 172.21.15.44:0/546756573 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:39.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b01d9b700 1 -- 172.21.15.44:0/546756573 >> v2:172.21.15.99:3300/0 conn(0x7f2b0415cda0 msgr2=0x7f2b0406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:39.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b0159a700 1 -- 172.21.15.44:0/546756573 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 795522639 0 0) 0x7f2b040b8430 con 0x7f2b0406a520 2024-09-13T18:28:39.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b01d9b700 1 --2- 172.21.15.44:0/546756573 >> v2:172.21.15.99:3300/0 conn(0x7f2b0415cda0 0x7f2b0406b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b01d9b700 1 -- 172.21.15.44:0/546756573 >> v1:172.21.15.99:6789/0 conn(0x7f2b0406a520 legacy=0x7f2b0406a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b01d9b700 1 -- 172.21.15.44:0/546756573 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b040d0880 con 0x7f2b040ceb70 2024-09-13T18:28:39.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b01d9b700 1 --2- 172.21.15.44:0/546756573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b040ceb70 0x7f2b040b5de0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2b040d0800 tx=0x7f2af8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce40e888d5fc1ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:39.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b0159a700 1 -- 172.21.15.44:0/546756573 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8011830 con 0x7f2b040ceb70 2024-09-13T18:28:39.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b0159a700 1 -- 172.21.15.44:0/546756573 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af8011990 con 0x7f2b040ceb70 2024-09-13T18:28:39.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b0159a700 1 -- 172.21.15.44:0/546756573 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8011d20 con 0x7f2b040ceb70 2024-09-13T18:28:39.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b0359e700 1 -- 172.21.15.44:0/546756573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b040ceb70 msgr2=0x7f2b040b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b0359e700 1 --2- 172.21.15.44:0/546756573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b040ceb70 0x7f2b040b5de0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2b040d0800 tx=0x7f2af8009bf0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b0359e700 1 -- 172.21.15.44:0/546756573 shutdown_connections 2024-09-13T18:28:39.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b0359e700 1 --2- 172.21.15.44:0/546756573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b040ceb70 0x7f2b040b5de0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b0359e700 1 --2- 172.21.15.44:0/546756573 >> v2:172.21.15.99:3300/0 conn(0x7f2b0415cda0 0x7f2b0406b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b0359e700 1 -- 172.21.15.44:0/546756573 >> 172.21.15.44:0/546756573 conn(0x7f2b040d2cb0 msgr2=0x7f2b040d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:39.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b0359e700 1 -- 172.21.15.44:0/546756573 shutdown_connections 2024-09-13T18:28:39.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.409+0000 7f2b0359e700 1 -- 172.21.15.44:0/546756573 wait complete. 2024-09-13T18:28:39.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.413+0000 7f2b0359e700 1 Processor -- start 2024-09-13T18:28:39.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.413+0000 7f2b0359e700 1 -- start start 2024-09-13T18:28:39.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.413+0000 7f2b0359e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b0406a520 0x7f2b041606c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.413+0000 7f2b0359e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b040ceb70 0x7f2b04160c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.413+0000 7f2b0359e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b0415cda0 0x7f2b041467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.413+0000 7f2b0359e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b040c63c0 con 0x7f2b0406a520 2024-09-13T18:28:39.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.413+0000 7f2b0359e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0415d550 con 0x7f2b040ceb70 2024-09-13T18:28:39.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.413+0000 7f2b0359e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b040c8af0 con 0x7f2b0415cda0 2024-09-13T18:28:39.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.413+0000 7f2b0259c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b0406a520 0x7f2b041606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.413+0000 7f2b0259c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b0406a520 0x7f2b041606c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34382/0 (socket says 172.21.15.44:34382) 2024-09-13T18:28:39.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.413+0000 7f2b0259c700 1 -- 172.21.15.44:0/2131821116 learned_addr learned my addr 172.21.15.44:0/2131821116 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:39.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.413+0000 7f2b02d9d700 1 --2- 172.21.15.44:0/2131821116 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b0415cda0 0x7f2b041467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.413+0000 7f2b01d9b700 1 --2- 172.21.15.44:0/2131821116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b040ceb70 0x7f2b04160c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.413+0000 7f2b0259c700 1 -- 172.21.15.44:0/2131821116 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b0415cda0 msgr2=0x7f2b041467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.413+0000 7f2b0259c700 1 --2- 172.21.15.44:0/2131821116 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b0415cda0 0x7f2b041467a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.413+0000 7f2b0259c700 1 -- 172.21.15.44:0/2131821116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b040ceb70 msgr2=0x7f2b04160c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.413+0000 7f2b0259c700 1 --2- 172.21.15.44:0/2131821116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b040ceb70 0x7f2b04160c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.413+0000 7f2b0259c700 1 -- 172.21.15.44:0/2131821116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af8009570 con 0x7f2b0406a520 2024-09-13T18:28:39.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.417+0000 7f2b0259c700 1 --2- 172.21.15.44:0/2131821116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b0406a520 0x7f2b041606c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2af400ea00 tx=0x7f2af400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:39.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.417+0000 7f2af2ffd700 1 -- 172.21.15.44:0/2131821116 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af4009720 con 0x7f2b0406a520 2024-09-13T18:28:39.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.417+0000 7f2b0359e700 1 -- 172.21.15.44:0/2131821116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b040c8dd0 con 0x7f2b0406a520 2024-09-13T18:28:39.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.417+0000 7f2af2ffd700 1 -- 172.21.15.44:0/2131821116 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af400eea0 con 0x7f2b0406a520 2024-09-13T18:28:39.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.417+0000 7f2b0359e700 1 -- 172.21.15.44:0/2131821116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0415d7c0 con 0x7f2b0406a520 2024-09-13T18:28:39.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.417+0000 7f2af2ffd700 1 -- 172.21.15.44:0/2131821116 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af400ca50 con 0x7f2b0406a520 2024-09-13T18:28:39.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.417+0000 7f2b0359e700 1 -- 172.21.15.44:0/2131821116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b0406b900 con 0x7f2b0406a520 2024-09-13T18:28:39.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.417+0000 7f2af2ffd700 1 -- 172.21.15.44:0/2131821116 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2af400cbb0 con 0x7f2b0406a520 2024-09-13T18:28:39.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.417+0000 7f2af2ffd700 1 --2- 172.21.15.44:0/2131821116 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2ae4066730 0x7f2ae4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.417+0000 7f2af2ffd700 1 -- 172.21.15.44:0/2131821116 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2af40845d0 con 0x7f2b0406a520 2024-09-13T18:28:39.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.417+0000 7f2b01d9b700 1 --2- 172.21.15.44:0/2131821116 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2ae4066730 0x7f2ae4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.421+0000 7f2b01d9b700 1 --2- 172.21.15.44:0/2131821116 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2ae4066730 0x7f2ae4068bf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2af8000c00 tx=0x7f2af8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:39.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.425+0000 7f2af2ffd700 1 -- 172.21.15.44:0/2131821116 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2af40517c0 con 0x7f2b0406a520 2024-09-13T18:28:39.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.597+0000 7f2b0359e700 1 -- 172.21.15.44:0/2131821116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2b04067a90 con 0x7f2b0406a520 2024-09-13T18:28:39.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.597+0000 7f2af2ffd700 1 -- 172.21.15.44:0/2131821116 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2af4054de0 con 0x7f2b0406a520 2024-09-13T18:28:39.605 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:28:39.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.601+0000 7f2b0359e700 1 -- 172.21.15.44:0/2131821116 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2ae4066730 msgr2=0x7f2ae4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.601+0000 7f2b0359e700 1 --2- 172.21.15.44:0/2131821116 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2ae4066730 0x7f2ae4068bf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2af8000c00 tx=0x7f2af8008030 comp rx=0 tx=0).stop 2024-09-13T18:28:39.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.601+0000 7f2b0359e700 1 -- 172.21.15.44:0/2131821116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b0406a520 msgr2=0x7f2b041606c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.601+0000 7f2b0359e700 1 --2- 172.21.15.44:0/2131821116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b0406a520 0x7f2b041606c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2af400ea00 tx=0x7f2af400ed10 comp rx=0 tx=0).stop 2024-09-13T18:28:39.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.601+0000 7f2b0359e700 1 -- 172.21.15.44:0/2131821116 shutdown_connections 2024-09-13T18:28:39.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.601+0000 7f2b0359e700 1 --2- 172.21.15.44:0/2131821116 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2ae4066730 0x7f2ae4068bf0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.601+0000 7f2b0359e700 1 --2- 172.21.15.44:0/2131821116 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b0415cda0 0x7f2b041467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.601+0000 7f2b0359e700 1 --2- 172.21.15.44:0/2131821116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b040ceb70 0x7f2b04160c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.601+0000 7f2b0359e700 1 --2- 172.21.15.44:0/2131821116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b0406a520 0x7f2b041606c0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.601+0000 7f2b0359e700 1 -- 172.21.15.44:0/2131821116 >> 172.21.15.44:0/2131821116 conn(0x7f2b040d2cb0 msgr2=0x7f2b040b3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:39.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.601+0000 7f2b0359e700 1 -- 172.21.15.44:0/2131821116 shutdown_connections 2024-09-13T18:28:39.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.601+0000 7f2b0359e700 1 -- 172.21.15.44:0/2131821116 wait complete. 2024-09-13T18:28:39.620 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:28:39.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f482dc04700 1 Processor -- start 2024-09-13T18:28:39.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f482dc04700 1 -- start start 2024-09-13T18:28:39.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f482dc04700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f48200e2e60 0x7f482000b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f482dc04700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4820006eb0 0x7f482004fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f482dc04700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4820055100 con 0x7f48200532a0 2024-09-13T18:28:39.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f482dc04700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48200e3240 con 0x7f4820006eb0 2024-09-13T18:28:39.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f482dc04700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482000adf0 con 0x7f48200e2e60 2024-09-13T18:28:39.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f4827fff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f48200532a0 0x7f48200067a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44734/0 (socket says 172.21.15.44:44734) 2024-09-13T18:28:39.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f4827fff700 1 -- 172.21.15.44:0/624650415 learned_addr learned my addr 172.21.15.44:0/624650415 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:39.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f482cc02700 1 --2- 172.21.15.44:0/624650415 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f48200e2e60 0x7f482000b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f482d403700 1 --2- 172.21.15.44:0/624650415 >> v2:172.21.15.99:3300/0 conn(0x7f4820006eb0 0x7f482004fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f48277fe700 1 -- 172.21.15.44:0/624650415 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4007690927 0 0) 0x7f4820055100 con 0x7f48200532a0 2024-09-13T18:28:39.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f48277fe700 1 -- 172.21.15.44:0/624650415 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48180035d0 con 0x7f48200532a0 2024-09-13T18:28:39.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f482cc02700 1 -- 172.21.15.44:0/624650415 >> v2:172.21.15.99:3300/0 conn(0x7f4820006eb0 msgr2=0x7f482004fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:39.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f482cc02700 1 --2- 172.21.15.44:0/624650415 >> v2:172.21.15.99:3300/0 conn(0x7f4820006eb0 0x7f482004fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f482cc02700 1 -- 172.21.15.44:0/624650415 >> v1:172.21.15.44:6789/0 conn(0x7f48200532a0 legacy=0x7f48200067a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f48277fe700 1 -- 172.21.15.44:0/624650415 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3905453012 0 0) 0x7f48180035d0 con 0x7f48200532a0 2024-09-13T18:28:39.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f482cc02700 1 -- 172.21.15.44:0/624650415 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482000b0d0 con 0x7f48200e2e60 2024-09-13T18:28:39.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f482cc02700 1 --2- 172.21.15.44:0/624650415 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f48200e2e60 0x7f482000b8d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f481c009840 tx=0x7f481c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5f840c522ee289 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:39.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f48277fe700 1 -- 172.21.15.44:0/624650415 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4814001670 con 0x7f48200e2e60 2024-09-13T18:28:39.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f48277fe700 1 -- 172.21.15.44:0/624650415 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481c004030 con 0x7f48200e2e60 2024-09-13T18:28:39.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f48277fe700 1 -- 172.21.15.44:0/624650415 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c0043c0 con 0x7f48200e2e60 2024-09-13T18:28:39.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f482dc04700 1 -- 172.21.15.44:0/624650415 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f48200e2e60 msgr2=0x7f482000b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f482dc04700 1 --2- 172.21.15.44:0/624650415 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f48200e2e60 0x7f482000b8d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f481c009840 tx=0x7f481c009b50 comp rx=0 tx=0).stop 2024-09-13T18:28:39.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f482dc04700 1 -- 172.21.15.44:0/624650415 shutdown_connections 2024-09-13T18:28:39.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f482dc04700 1 --2- 172.21.15.44:0/624650415 >> v2:172.21.15.99:3300/0 conn(0x7f4820006eb0 0x7f482004fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f482dc04700 1 --2- 172.21.15.44:0/624650415 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f48200e2e60 0x7f482000b8d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f482dc04700 1 -- 172.21.15.44:0/624650415 >> 172.21.15.44:0/624650415 conn(0x7f4820055760 msgr2=0x7f4820055b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:39.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f482dc04700 1 -- 172.21.15.44:0/624650415 shutdown_connections 2024-09-13T18:28:39.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.733+0000 7f482dc04700 1 -- 172.21.15.44:0/624650415 wait complete. 2024-09-13T18:28:39.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f482dc04700 1 Processor -- start 2024-09-13T18:28:39.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f482dc04700 1 -- start start 2024-09-13T18:28:39.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f482dc04700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4820006eb0 0x7f4820035ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f482dc04700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48200532a0 0x7f48200db8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f482dc04700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48200e2e60 0x7f482003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f482dc04700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4820036160 con 0x7f48200e2e60 2024-09-13T18:28:39.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f482dc04700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48200e3e20 con 0x7f48200532a0 2024-09-13T18:28:39.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f482dc04700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48200d9100 con 0x7f4820006eb0 2024-09-13T18:28:39.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f482d403700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48200e2e60 0x7f482003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f482d403700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48200e2e60 0x7f482003a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34398/0 (socket says 172.21.15.44:34398) 2024-09-13T18:28:39.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f482d403700 1 -- 172.21.15.44:0/3235960881 learned_addr learned my addr 172.21.15.44:0/3235960881 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:39.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f482cc02700 1 --2- 172.21.15.44:0/3235960881 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4820006eb0 0x7f4820035ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f4827fff700 1 --2- 172.21.15.44:0/3235960881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48200532a0 0x7f48200db8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f482d403700 1 -- 172.21.15.44:0/3235960881 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4820006eb0 msgr2=0x7f4820035ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f482d403700 1 --2- 172.21.15.44:0/3235960881 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4820006eb0 0x7f4820035ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f482d403700 1 -- 172.21.15.44:0/3235960881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48200532a0 msgr2=0x7f48200db8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f482d403700 1 --2- 172.21.15.44:0/3235960881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48200532a0 0x7f48200db8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f482d403700 1 -- 172.21.15.44:0/3235960881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c009450 con 0x7f48200e2e60 2024-09-13T18:28:39.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f482d403700 1 --2- 172.21.15.44:0/3235960881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48200e2e60 0x7f482003a760 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4828069070 tx=0x7f48280733d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:39.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f48257fa700 1 -- 172.21.15.44:0/3235960881 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482808f070 con 0x7f48200e2e60 2024-09-13T18:28:39.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f48257fa700 1 -- 172.21.15.44:0/3235960881 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4828073ed0 con 0x7f48200e2e60 2024-09-13T18:28:39.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f482dc04700 1 -- 172.21.15.44:0/3235960881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48200e34f0 con 0x7f48200e2e60 2024-09-13T18:28:39.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f48257fa700 1 -- 172.21.15.44:0/3235960881 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4828067be0 con 0x7f48200e2e60 2024-09-13T18:28:39.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.737+0000 7f482dc04700 1 -- 172.21.15.44:0/3235960881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48200e3ab0 con 0x7f48200e2e60 2024-09-13T18:28:39.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.741+0000 7f482dc04700 1 -- 172.21.15.44:0/3235960881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4820056410 con 0x7f48200e2e60 2024-09-13T18:28:39.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.741+0000 7f48257fa700 1 -- 172.21.15.44:0/3235960881 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4828067d40 con 0x7f48200e2e60 2024-09-13T18:28:39.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.741+0000 7f48257fa700 1 --2- 172.21.15.44:0/3235960881 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f480c066730 0x7f480c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.741+0000 7f48257fa700 1 -- 172.21.15.44:0/3235960881 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f48280fdb90 con 0x7f48200e2e60 2024-09-13T18:28:39.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.741+0000 7f482cc02700 1 --2- 172.21.15.44:0/3235960881 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f480c066730 0x7f480c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.745+0000 7f482cc02700 1 --2- 172.21.15.44:0/3235960881 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f480c066730 0x7f480c068bf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f481c009790 tx=0x7f481c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:39.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.749+0000 7f48257fa700 1 -- 172.21.15.44:0/3235960881 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f48280cad80 con 0x7f48200e2e60 2024-09-13T18:28:39.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.921+0000 7f482dc04700 1 -- 172.21.15.44:0/3235960881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f48200e3f60 con 0x7f48200e2e60 2024-09-13T18:28:39.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.921+0000 7f48257fa700 1 -- 172.21.15.44:0/3235960881 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4828099020 con 0x7f48200e2e60 2024-09-13T18:28:39.928 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:28:39.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.925+0000 7f482dc04700 1 -- 172.21.15.44:0/3235960881 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f480c066730 msgr2=0x7f480c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.925+0000 7f482dc04700 1 --2- 172.21.15.44:0/3235960881 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f480c066730 0x7f480c068bf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f481c009790 tx=0x7f481c008030 comp rx=0 tx=0).stop 2024-09-13T18:28:39.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.925+0000 7f482dc04700 1 -- 172.21.15.44:0/3235960881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48200e2e60 msgr2=0x7f482003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.925+0000 7f482dc04700 1 --2- 172.21.15.44:0/3235960881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48200e2e60 0x7f482003a760 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4828069070 tx=0x7f48280733d0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.925+0000 7f482dc04700 1 -- 172.21.15.44:0/3235960881 shutdown_connections 2024-09-13T18:28:39.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.925+0000 7f482dc04700 1 --2- 172.21.15.44:0/3235960881 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f480c066730 0x7f480c068bf0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.925+0000 7f482dc04700 1 --2- 172.21.15.44:0/3235960881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48200e2e60 0x7f482003a760 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.925+0000 7f482dc04700 1 --2- 172.21.15.44:0/3235960881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48200532a0 0x7f48200db8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.925+0000 7f482dc04700 1 --2- 172.21.15.44:0/3235960881 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4820006eb0 0x7f4820035ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.925+0000 7f482dc04700 1 -- 172.21.15.44:0/3235960881 >> 172.21.15.44:0/3235960881 conn(0x7f4820055760 msgr2=0x7f4820033ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:39.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.925+0000 7f482dc04700 1 -- 172.21.15.44:0/3235960881 shutdown_connections 2024-09-13T18:28:39.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:39.925+0000 7f482dc04700 1 -- 172.21.15.44:0/3235960881 wait complete. 2024-09-13T18:28:39.948 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:28:40.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.061+0000 7f8d9f59e700 1 Processor -- start 2024-09-13T18:28:40.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.061+0000 7f8d9f59e700 1 -- start start 2024-09-13T18:28:40.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.061+0000 7f8d9f59e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8da0164290 0x7f8da0070bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.061+0000 7f8d9f59e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8da0162570 con 0x7f8da006d8c0 2024-09-13T18:28:40.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.061+0000 7f8d9f59e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8da0071240 con 0x7f8da0165160 2024-09-13T18:28:40.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.061+0000 7f8d9f59e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8da0162e60 con 0x7f8da0164290 2024-09-13T18:28:40.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.061+0000 7f8d9ed9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8da0164290 0x7f8da0070bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.061+0000 7f8d9ed9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8da0164290 0x7f8da0070bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34412/0 (socket says 172.21.15.44:34412) 2024-09-13T18:28:40.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.061+0000 7f8d9e59c700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8da006d8c0 0x7f8da0164a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44744/0 (socket says 172.21.15.44:44744) 2024-09-13T18:28:40.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.061+0000 7f8d9ed9d700 1 -- 172.21.15.44:0/1757699764 learned_addr learned my addr 172.21.15.44:0/1757699764 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:40.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.061+0000 7f8d9ed9d700 1 -- 172.21.15.44:0/1757699764 >> v1:172.21.15.99:6789/0 conn(0x7f8da0165160 legacy=0x7f8da00704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.061+0000 7f8d9ed9d700 1 -- 172.21.15.44:0/1757699764 >> v1:172.21.15.44:6789/0 conn(0x7f8da006d8c0 legacy=0x7f8da0164a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.061+0000 7f8d9ed9d700 1 -- 172.21.15.44:0/1757699764 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da01627a0 con 0x7f8da0164290 2024-09-13T18:28:40.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.061+0000 7f8d9d59a700 1 -- 172.21.15.44:0/1757699764 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749739875 0 0) 0x7f8da0162570 con 0x7f8da006d8c0 2024-09-13T18:28:40.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.061+0000 7f8d9ed9d700 1 --2- 172.21.15.44:0/1757699764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da0164290 0x7f8da0070bd0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8d98009e50 tx=0x7f8d9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40c50fdb903d73d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:40.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.061+0000 7f8d9d59a700 1 -- 172.21.15.44:0/1757699764 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9800e070 con 0x7f8da0164290 2024-09-13T18:28:40.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.061+0000 7f8d9d59a700 1 -- 172.21.15.44:0/1757699764 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9800b9c0 con 0x7f8da0164290 2024-09-13T18:28:40.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.061+0000 7f8d9d59a700 1 -- 172.21.15.44:0/1757699764 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9800bd70 con 0x7f8da0164290 2024-09-13T18:28:40.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.065+0000 7f8d9f59e700 1 -- 172.21.15.44:0/1757699764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da0164290 msgr2=0x7f8da0070bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.065+0000 7f8d9f59e700 1 --2- 172.21.15.44:0/1757699764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da0164290 0x7f8da0070bd0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8d98009e50 tx=0x7f8d9800b330 comp rx=0 tx=0).stop 2024-09-13T18:28:40.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.065+0000 7f8d9f59e700 1 -- 172.21.15.44:0/1757699764 shutdown_connections 2024-09-13T18:28:40.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.065+0000 7f8d9f59e700 1 --2- 172.21.15.44:0/1757699764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da0164290 0x7f8da0070bd0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.065+0000 7f8d9f59e700 1 -- 172.21.15.44:0/1757699764 >> 172.21.15.44:0/1757699764 conn(0x7f8da00b0e10 msgr2=0x7f8da00b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:40.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.065+0000 7f8d9f59e700 1 -- 172.21.15.44:0/1757699764 shutdown_connections 2024-09-13T18:28:40.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.065+0000 7f8d9f59e700 1 -- 172.21.15.44:0/1757699764 wait complete. 2024-09-13T18:28:40.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.065+0000 7f8d9f59e700 1 Processor -- start 2024-09-13T18:28:40.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.065+0000 7f8d9f59e700 1 -- start start 2024-09-13T18:28:40.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.065+0000 7f8d9f59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da006d8c0 0x7f8da01552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.065+0000 7f8d9f59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8da0164290 0x7f8da014dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.065+0000 7f8d9f59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8da0165160 0x7f8da015d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.065+0000 7f8d9f59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da015ec00 con 0x7f8da006d8c0 2024-09-13T18:28:40.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.065+0000 7f8d9f59e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da01580a0 con 0x7f8da0165160 2024-09-13T18:28:40.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.065+0000 7f8d9f59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da01557e0 con 0x7f8da0164290 2024-09-13T18:28:40.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.065+0000 7f8d9e59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da006d8c0 0x7f8da01552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.065+0000 7f8d9e59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da006d8c0 0x7f8da01552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34418/0 (socket says 172.21.15.44:34418) 2024-09-13T18:28:40.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.065+0000 7f8d9e59c700 1 -- 172.21.15.44:0/3600223432 learned_addr learned my addr 172.21.15.44:0/3600223432 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:40.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.065+0000 7f8d9ed9d700 1 --2- 172.21.15.44:0/3600223432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8da0165160 0x7f8da015d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.065+0000 7f8d9dd9b700 1 --2- 172.21.15.44:0/3600223432 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8da0164290 0x7f8da014dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.069+0000 7f8d9e59c700 1 -- 172.21.15.44:0/3600223432 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8da0164290 msgr2=0x7f8da014dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.069+0000 7f8d9e59c700 1 --2- 172.21.15.44:0/3600223432 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8da0164290 0x7f8da014dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.069+0000 7f8d9e59c700 1 -- 172.21.15.44:0/3600223432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8da0165160 msgr2=0x7f8da015d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.069+0000 7f8d9e59c700 1 --2- 172.21.15.44:0/3600223432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8da0165160 0x7f8da015d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.069+0000 7f8d9e59c700 1 -- 172.21.15.44:0/3600223432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d98009b30 con 0x7f8da006d8c0 2024-09-13T18:28:40.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.069+0000 7f8d9ed9d700 1 --2- 172.21.15.44:0/3600223432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8da0165160 0x7f8da015d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:40.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.069+0000 7f8d9dd9b700 1 --2- 172.21.15.44:0/3600223432 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8da0164290 0x7f8da014dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:40.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.069+0000 7f8d9e59c700 1 --2- 172.21.15.44:0/3600223432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da006d8c0 0x7f8da01552a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400c550 tx=0x7f8d9400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:40.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.069+0000 7f8d8effd700 1 -- 172.21.15.44:0/3600223432 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d94004ca0 con 0x7f8da006d8c0 2024-09-13T18:28:40.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.069+0000 7f8d8effd700 1 -- 172.21.15.44:0/3600223432 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d94004e00 con 0x7f8da006d8c0 2024-09-13T18:28:40.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.069+0000 7f8d9f59e700 1 -- 172.21.15.44:0/3600223432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da015e260 con 0x7f8da006d8c0 2024-09-13T18:28:40.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.069+0000 7f8d8effd700 1 -- 172.21.15.44:0/3600223432 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d94007310 con 0x7f8da006d8c0 2024-09-13T18:28:40.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.069+0000 7f8d9f59e700 1 -- 172.21.15.44:0/3600223432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da015e820 con 0x7f8da006d8c0 2024-09-13T18:28:40.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.069+0000 7f8d9f59e700 1 -- 172.21.15.44:0/3600223432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8da016bb30 con 0x7f8da006d8c0 2024-09-13T18:28:40.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.069+0000 7f8d8effd700 1 -- 172.21.15.44:0/3600223432 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8d94007470 con 0x7f8da006d8c0 2024-09-13T18:28:40.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.073+0000 7f8d8effd700 1 --2- 172.21.15.44:0/3600223432 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8d80066760 0x7f8d80068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.073+0000 7f8d8effd700 1 -- 172.21.15.44:0/3600223432 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8d940844a0 con 0x7f8da006d8c0 2024-09-13T18:28:40.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.073+0000 7f8d9dd9b700 1 --2- 172.21.15.44:0/3600223432 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8d80066760 0x7f8d80068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.073+0000 7f8d9dd9b700 1 --2- 172.21.15.44:0/3600223432 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8d80066760 0x7f8d80068c20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8da006d2f0 tx=0x7f8d90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:40.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.077+0000 7f8d8effd700 1 -- 172.21.15.44:0/3600223432 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8d94051920 con 0x7f8da006d8c0 2024-09-13T18:28:40.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.261+0000 7f8d9f59e700 1 -- 172.21.15.44:0/3600223432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8da0164a50 con 0x7f8da006d8c0 2024-09-13T18:28:40.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.261+0000 7f8d8effd700 1 -- 172.21.15.44:0/3600223432 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v36) v1 ==== 80+0+120 (secure 0 0 0) 0x7f8d94007720 con 0x7f8da006d8c0 2024-09-13T18:28:40.270 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/939073284 2024-09-14T18:28:29.639607+0000 2024-09-13T18:28:40.270 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6834/939073284 2024-09-14T18:28:29.639607+0000 2024-09-13T18:28:40.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.265+0000 7f8d9f59e700 1 -- 172.21.15.44:0/3600223432 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8d80066760 msgr2=0x7f8d80068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.265+0000 7f8d9f59e700 1 --2- 172.21.15.44:0/3600223432 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8d80066760 0x7f8d80068c20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8da006d2f0 tx=0x7f8d90009040 comp rx=0 tx=0).stop 2024-09-13T18:28:40.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.265+0000 7f8d9f59e700 1 -- 172.21.15.44:0/3600223432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da006d8c0 msgr2=0x7f8da01552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.265+0000 7f8d9f59e700 1 --2- 172.21.15.44:0/3600223432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da006d8c0 0x7f8da01552a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400c550 tx=0x7f8d9400c910 comp rx=0 tx=0).stop 2024-09-13T18:28:40.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.265+0000 7f8d9f59e700 1 -- 172.21.15.44:0/3600223432 shutdown_connections 2024-09-13T18:28:40.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.265+0000 7f8d9f59e700 1 --2- 172.21.15.44:0/3600223432 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8d80066760 0x7f8d80068c20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.265+0000 7f8d9f59e700 1 --2- 172.21.15.44:0/3600223432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8da0165160 0x7f8da015d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.265+0000 7f8d9f59e700 1 --2- 172.21.15.44:0/3600223432 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8da0164290 0x7f8da014dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.265+0000 7f8d9f59e700 1 --2- 172.21.15.44:0/3600223432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da006d8c0 0x7f8da01552a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.265+0000 7f8d9f59e700 1 -- 172.21.15.44:0/3600223432 >> 172.21.15.44:0/3600223432 conn(0x7f8da00b0e10 msgr2=0x7f8da0150920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:40.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.265+0000 7f8d9f59e700 1 -- 172.21.15.44:0/3600223432 shutdown_connections 2024-09-13T18:28:40.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.265+0000 7f8d9f59e700 1 -- 172.21.15.44:0/3600223432 wait complete. 2024-09-13T18:28:40.275 INFO:teuthology.orchestra.run.smithi044.stderr:listed 2 entries 2024-09-13T18:28:40.284 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:28:40.284 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:28:40.291 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:28:40.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.401+0000 7f5aaf59e700 1 Processor -- start 2024-09-13T18:28:40.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.401+0000 7f5aaf59e700 1 -- start start 2024-09-13T18:28:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aaf59e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5ab015ca00 0x7f5ab00b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aaf59e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5ab015cde0 0x7f5ab00b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aaf59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ab0070ba0 0x7f5ab0071010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aaf59e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab0071550 con 0x7f5ab015ca00 2024-09-13T18:28:40.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aaf59e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab01607f0 con 0x7f5ab015cde0 2024-09-13T18:28:40.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aaf59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab0160ad0 con 0x7f5ab0070ba0 2024-09-13T18:28:40.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aae59c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5ab015ca00 0x7f5ab00b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aa7fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5ab015cde0 0x7f5ab00b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aae59c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5ab015ca00 0x7f5ab00b44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34430/0 (socket says 172.21.15.44:34430) 2024-09-13T18:28:40.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aae59c700 1 -- 172.21.15.44:0/3337532079 learned_addr learned my addr 172.21.15.44:0/3337532079 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:40.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aaed9d700 1 --2- 172.21.15.44:0/3337532079 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ab0070ba0 0x7f5ab0071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aa7fff700 1 -- 172.21.15.44:0/3337532079 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ab0070ba0 msgr2=0x7f5ab0071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:40.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aa7fff700 1 --2- 172.21.15.44:0/3337532079 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ab0070ba0 0x7f5ab0071010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aa7fff700 1 -- 172.21.15.44:0/3337532079 >> v2:172.21.15.44:3300/0 conn(0x7f5ab015ca00 msgr2=0x7f5ab00b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:40.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aa7fff700 1 --2- 172.21.15.44:0/3337532079 >> v2:172.21.15.44:3300/0 conn(0x7f5ab015ca00 0x7f5ab00b44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aa7fff700 1 -- 172.21.15.44:0/3337532079 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab0160db0 con 0x7f5ab015cde0 2024-09-13T18:28:40.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aae59c700 1 --2- 172.21.15.44:0/3337532079 >> v2:172.21.15.44:3300/0 conn(0x7f5ab015ca00 0x7f5ab00b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:40.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aa7fff700 1 --2- 172.21.15.44:0/3337532079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ab015cde0 0x7f5ab00b4a20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0071bb0 tx=0x7f5a98009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e82b738258aea9dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:40.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aadd9b700 1 -- 172.21.15.44:0/3337532079 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a98011830 con 0x7f5ab015cde0 2024-09-13T18:28:40.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aadd9b700 1 -- 172.21.15.44:0/3337532079 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a98011990 con 0x7f5ab015cde0 2024-09-13T18:28:40.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aadd9b700 1 -- 172.21.15.44:0/3337532079 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a98011d20 con 0x7f5ab015cde0 2024-09-13T18:28:40.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aaf59e700 1 -- 172.21.15.44:0/3337532079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ab015cde0 msgr2=0x7f5ab00b4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aaf59e700 1 --2- 172.21.15.44:0/3337532079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ab015cde0 0x7f5ab00b4a20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0071bb0 tx=0x7f5a98009b30 comp rx=0 tx=0).stop 2024-09-13T18:28:40.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aaf59e700 1 -- 172.21.15.44:0/3337532079 shutdown_connections 2024-09-13T18:28:40.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aaf59e700 1 --2- 172.21.15.44:0/3337532079 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ab0070ba0 0x7f5ab0071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aaf59e700 1 --2- 172.21.15.44:0/3337532079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ab015cde0 0x7f5ab00b4a20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aaf59e700 1 --2- 172.21.15.44:0/3337532079 >> v2:172.21.15.44:3300/0 conn(0x7f5ab015ca00 0x7f5ab00b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aaf59e700 1 -- 172.21.15.44:0/3337532079 >> 172.21.15.44:0/3337532079 conn(0x7f5ab00b1630 msgr2=0x7f5ab00b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:40.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aaf59e700 1 -- 172.21.15.44:0/3337532079 shutdown_connections 2024-09-13T18:28:40.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.405+0000 7f5aaf59e700 1 -- 172.21.15.44:0/3337532079 wait complete. 2024-09-13T18:28:40.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aaf59e700 1 Processor -- start 2024-09-13T18:28:40.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aaf59e700 1 -- start start 2024-09-13T18:28:40.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aaf59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ab0070ba0 0x7f5ab01f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aaf59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ab015ca00 0x7f5ab00b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aaf59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ab015cde0 0x7f5ab015fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aaf59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab01f67c0 con 0x7f5ab015ca00 2024-09-13T18:28:40.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aaf59e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab01f6200 con 0x7f5ab0070ba0 2024-09-13T18:28:40.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aaf59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab01f64e0 con 0x7f5ab015cde0 2024-09-13T18:28:40.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aa7fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ab015ca00 0x7f5ab00b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aa7fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ab015ca00 0x7f5ab00b0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34438/0 (socket says 172.21.15.44:34438) 2024-09-13T18:28:40.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aa7fff700 1 -- 172.21.15.44:0/1662051543 learned_addr learned my addr 172.21.15.44:0/1662051543 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:40.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aae59c700 1 --2- 172.21.15.44:0/1662051543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ab0070ba0 0x7f5ab01f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aaed9d700 1 --2- 172.21.15.44:0/1662051543 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ab015cde0 0x7f5ab015fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aa7fff700 1 -- 172.21.15.44:0/1662051543 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ab015cde0 msgr2=0x7f5ab015fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aa7fff700 1 --2- 172.21.15.44:0/1662051543 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ab015cde0 0x7f5ab015fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aa7fff700 1 -- 172.21.15.44:0/1662051543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ab0070ba0 msgr2=0x7f5ab01f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aa7fff700 1 --2- 172.21.15.44:0/1662051543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ab0070ba0 0x7f5ab01f5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aa7fff700 1 -- 172.21.15.44:0/1662051543 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa0009570 con 0x7f5ab015ca00 2024-09-13T18:28:40.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aaed9d700 1 --2- 172.21.15.44:0/1662051543 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ab015cde0 0x7f5ab015fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:40.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aa7fff700 1 --2- 172.21.15.44:0/1662051543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ab015ca00 0x7f5ab00b0a00 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f5a980090b0 tx=0x7f5a98004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:40.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aa6ffd700 1 -- 172.21.15.44:0/1662051543 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a98004450 con 0x7f5ab015ca00 2024-09-13T18:28:40.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aa6ffd700 1 -- 172.21.15.44:0/1662051543 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9801e070 con 0x7f5ab015ca00 2024-09-13T18:28:40.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aa6ffd700 1 -- 172.21.15.44:0/1662051543 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a98003900 con 0x7f5ab015ca00 2024-09-13T18:28:40.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aaf59e700 1 -- 172.21.15.44:0/1662051543 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a980094b0 con 0x7f5ab015ca00 2024-09-13T18:28:40.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.409+0000 7f5aaf59e700 1 -- 172.21.15.44:0/1662051543 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab015f540 con 0x7f5ab015ca00 2024-09-13T18:28:40.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.413+0000 7f5aaf59e700 1 -- 172.21.15.44:0/1662051543 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab015f730 con 0x7f5ab015ca00 2024-09-13T18:28:40.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.413+0000 7f5aa6ffd700 1 -- 172.21.15.44:0/1662051543 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5a98003a60 con 0x7f5ab015ca00 2024-09-13T18:28:40.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.413+0000 7f5aa6ffd700 1 --2- 172.21.15.44:0/1662051543 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5a90066760 0x7f5a90068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.413+0000 7f5aa6ffd700 1 -- 172.21.15.44:0/1662051543 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5a98085420 con 0x7f5ab015ca00 2024-09-13T18:28:40.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.413+0000 7f5aae59c700 1 --2- 172.21.15.44:0/1662051543 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5a90066760 0x7f5a90068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.417+0000 7f5aae59c700 1 --2- 172.21.15.44:0/1662051543 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5a90066760 0x7f5a90068c20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00cbb50 tx=0x7f5aa00092e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:40.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.421+0000 7f5aa6ffd700 1 -- 172.21.15.44:0/1662051543 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5a98052720 con 0x7f5ab015ca00 2024-09-13T18:28:40.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.589+0000 7f5aaf59e700 1 -- 172.21.15.44:0/1662051543 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ab0071010 con 0x7f5ab015ca00 2024-09-13T18:28:40.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.593+0000 7f5aa6ffd700 1 -- 172.21.15.44:0/1662051543 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16636 (secure 0 0 0) 0x7f5a98055d40 con 0x7f5ab015ca00 2024-09-13T18:28:40.599 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:40.600 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":36,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:28:29.639664+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:28:02.951723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:28:04.057772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/939073284":"2024-09-14T18:28:29.639607+0000","172.21.15.44:6834/939073284":"2024-09-14T18:28:29.639607+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:28:40.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.597+0000 7f5aaf59e700 1 -- 172.21.15.44:0/1662051543 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5a90066760 msgr2=0x7f5a90068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.597+0000 7f5aaf59e700 1 --2- 172.21.15.44:0/1662051543 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5a90066760 0x7f5a90068c20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00cbb50 tx=0x7f5aa00092e0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.597+0000 7f5aaf59e700 1 -- 172.21.15.44:0/1662051543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ab015ca00 msgr2=0x7f5ab00b0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.597+0000 7f5aaf59e700 1 --2- 172.21.15.44:0/1662051543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ab015ca00 0x7f5ab00b0a00 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f5a980090b0 tx=0x7f5a98004770 comp rx=0 tx=0).stop 2024-09-13T18:28:40.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.597+0000 7f5aaf59e700 1 -- 172.21.15.44:0/1662051543 shutdown_connections 2024-09-13T18:28:40.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.597+0000 7f5aaf59e700 1 --2- 172.21.15.44:0/1662051543 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5a90066760 0x7f5a90068c20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.597+0000 7f5aaf59e700 1 --2- 172.21.15.44:0/1662051543 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ab015cde0 0x7f5ab015fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.597+0000 7f5aaf59e700 1 --2- 172.21.15.44:0/1662051543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ab015ca00 0x7f5ab00b0a00 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.597+0000 7f5aaf59e700 1 --2- 172.21.15.44:0/1662051543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ab0070ba0 0x7f5ab01f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.597+0000 7f5aaf59e700 1 -- 172.21.15.44:0/1662051543 >> 172.21.15.44:0/1662051543 conn(0x7f5ab00b1630 msgr2=0x7f5ab00ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:40.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.597+0000 7f5aaf59e700 1 -- 172.21.15.44:0/1662051543 shutdown_connections 2024-09-13T18:28:40.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.597+0000 7f5aaf59e700 1 -- 172.21.15.44:0/1662051543 wait complete. 2024-09-13T18:28:40.618 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:28:02.951723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:28:04.057772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:28:40.619 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:28:40.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.733+0000 7fdca49b7700 1 Processor -- start 2024-09-13T18:28:40.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.733+0000 7fdca49b7700 1 -- start start 2024-09-13T18:28:40.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.733+0000 7fdca49b7700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdca00ce270 0x7fdca015caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.733+0000 7fdca49b7700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdca015d030 0x7fdca006baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.733+0000 7fdca49b7700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca006dad0 con 0x7fdca006d6f0 2024-09-13T18:28:40.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.733+0000 7fdca49b7700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca015d4c0 con 0x7fdca015d030 2024-09-13T18:28:40.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.733+0000 7fdca49b7700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca00ae3c0 con 0x7fdca00ce270 2024-09-13T18:28:40.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.733+0000 7fdc9ed9d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fdca006d6f0 0x7fdca00adbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44758/0 (socket says 172.21.15.44:44758) 2024-09-13T18:28:40.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.733+0000 7fdc9ed9d700 1 -- 172.21.15.44:0/3059855935 learned_addr learned my addr 172.21.15.44:0/3059855935 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:40.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.733+0000 7fdc9e59c700 1 --2- 172.21.15.44:0/3059855935 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdca00ce270 0x7fdca015caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.733+0000 7fdc9f59e700 1 --2- 172.21.15.44:0/3059855935 >> v2:172.21.15.99:3300/0 conn(0x7fdca015d030 0x7fdca006baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.733+0000 7fdc9dd9b700 1 -- 172.21.15.44:0/3059855935 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3686322594 0 0) 0x7fdca006dad0 con 0x7fdca006d6f0 2024-09-13T18:28:40.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.733+0000 7fdc9dd9b700 1 -- 172.21.15.44:0/3059855935 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc880035d0 con 0x7fdca006d6f0 2024-09-13T18:28:40.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.737+0000 7fdc9e59c700 1 -- 172.21.15.44:0/3059855935 >> v2:172.21.15.99:3300/0 conn(0x7fdca015d030 msgr2=0x7fdca006baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:40.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.737+0000 7fdc9e59c700 1 --2- 172.21.15.44:0/3059855935 >> v2:172.21.15.99:3300/0 conn(0x7fdca015d030 0x7fdca006baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.737+0000 7fdc9e59c700 1 -- 172.21.15.44:0/3059855935 >> v1:172.21.15.44:6789/0 conn(0x7fdca006d6f0 legacy=0x7fdca00adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.737+0000 7fdc9e59c700 1 -- 172.21.15.44:0/3059855935 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca00705b0 con 0x7fdca00ce270 2024-09-13T18:28:40.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.737+0000 7fdc9f59e700 1 --2- 172.21.15.44:0/3059855935 >> v2:172.21.15.99:3300/0 conn(0x7fdca015d030 0x7fdca006baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:40.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.737+0000 7fdc9e59c700 1 --2- 172.21.15.44:0/3059855935 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdca00ce270 0x7fdca015caf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009850 tx=0x7fdc94009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21a13f5a3c0803cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:40.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.737+0000 7fdc9dd9b700 1 -- 172.21.15.44:0/3059855935 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94011830 con 0x7fdca00ce270 2024-09-13T18:28:40.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.737+0000 7fdc9dd9b700 1 -- 172.21.15.44:0/3059855935 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc94011990 con 0x7fdca00ce270 2024-09-13T18:28:40.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.737+0000 7fdc9dd9b700 1 -- 172.21.15.44:0/3059855935 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94011d40 con 0x7fdca00ce270 2024-09-13T18:28:40.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.737+0000 7fdca49b7700 1 -- 172.21.15.44:0/3059855935 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdca00ce270 msgr2=0x7fdca015caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.737+0000 7fdca49b7700 1 --2- 172.21.15.44:0/3059855935 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdca00ce270 0x7fdca015caf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009850 tx=0x7fdc94009b60 comp rx=0 tx=0).stop 2024-09-13T18:28:40.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.737+0000 7fdca49b7700 1 -- 172.21.15.44:0/3059855935 shutdown_connections 2024-09-13T18:28:40.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.737+0000 7fdca49b7700 1 --2- 172.21.15.44:0/3059855935 >> v2:172.21.15.99:3300/0 conn(0x7fdca015d030 0x7fdca006baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.737+0000 7fdca49b7700 1 --2- 172.21.15.44:0/3059855935 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdca00ce270 0x7fdca015caf0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.737+0000 7fdca49b7700 1 -- 172.21.15.44:0/3059855935 >> 172.21.15.44:0/3059855935 conn(0x7fdca00b0e10 msgr2=0x7fdca00b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:40.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.737+0000 7fdca49b7700 1 -- 172.21.15.44:0/3059855935 shutdown_connections 2024-09-13T18:28:40.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.737+0000 7fdca49b7700 1 -- 172.21.15.44:0/3059855935 wait complete. 2024-09-13T18:28:40.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.737+0000 7fdca49b7700 1 Processor -- start 2024-09-13T18:28:40.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.737+0000 7fdca49b7700 1 -- start start 2024-09-13T18:28:40.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.741+0000 7fdca49b7700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdca006d6f0 0x7fdca0150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.741+0000 7fdca49b7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdca00ce270 0x7fdca013c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.741+0000 7fdca49b7700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdca015d030 0x7fdca0152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.741+0000 7fdca49b7700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca0151600 con 0x7fdca00ce270 2024-09-13T18:28:40.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.741+0000 7fdca49b7700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca01518e0 con 0x7fdca006d6f0 2024-09-13T18:28:40.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.741+0000 7fdca49b7700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca0151bc0 con 0x7fdca015d030 2024-09-13T18:28:40.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.741+0000 7fdc9e59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdca00ce270 0x7fdca013c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.741+0000 7fdc9e59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdca00ce270 0x7fdca013c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34444/0 (socket says 172.21.15.44:34444) 2024-09-13T18:28:40.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.741+0000 7fdc9e59c700 1 -- 172.21.15.44:0/1317778356 learned_addr learned my addr 172.21.15.44:0/1317778356 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:40.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.741+0000 7fdc9ed9d700 1 --2- 172.21.15.44:0/1317778356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdca006d6f0 0x7fdca0150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.741+0000 7fdc9f59e700 1 --2- 172.21.15.44:0/1317778356 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdca015d030 0x7fdca0152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.741+0000 7fdc9ed9d700 1 -- 172.21.15.44:0/1317778356 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdca015d030 msgr2=0x7fdca0152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.741+0000 7fdc9ed9d700 1 --2- 172.21.15.44:0/1317778356 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdca015d030 0x7fdca0152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.741+0000 7fdc9ed9d700 1 -- 172.21.15.44:0/1317778356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdca00ce270 msgr2=0x7fdca013c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.741+0000 7fdc9ed9d700 1 --2- 172.21.15.44:0/1317778356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdca00ce270 0x7fdca013c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.741+0000 7fdc9ed9d700 1 -- 172.21.15.44:0/1317778356 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc900094b0 con 0x7fdca006d6f0 2024-09-13T18:28:40.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.741+0000 7fdc9e59c700 1 --2- 172.21.15.44:0/1317778356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdca00ce270 0x7fdca013c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:40.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.741+0000 7fdc9ed9d700 1 --2- 172.21.15.44:0/1317778356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdca006d6f0 0x7fdca0150f70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800caa0 tx=0x7fdc9800cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:40.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.741+0000 7fdc877fe700 1 -- 172.21.15.44:0/1317778356 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98007480 con 0x7fdca006d6f0 2024-09-13T18:28:40.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.741+0000 7fdc877fe700 1 -- 172.21.15.44:0/1317778356 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc980075e0 con 0x7fdca006d6f0 2024-09-13T18:28:40.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.741+0000 7fdca49b7700 1 -- 172.21.15.44:0/1317778356 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc940094b0 con 0x7fdca006d6f0 2024-09-13T18:28:40.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.741+0000 7fdc877fe700 1 -- 172.21.15.44:0/1317778356 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98007950 con 0x7fdca006d6f0 2024-09-13T18:28:40.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.741+0000 7fdca49b7700 1 -- 172.21.15.44:0/1317778356 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca0152180 con 0x7fdca006d6f0 2024-09-13T18:28:40.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.745+0000 7fdca49b7700 1 -- 172.21.15.44:0/1317778356 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca01523a0 con 0x7fdca006d6f0 2024-09-13T18:28:40.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.745+0000 7fdc877fe700 1 -- 172.21.15.44:0/1317778356 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdc9801b3b0 con 0x7fdca006d6f0 2024-09-13T18:28:40.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.745+0000 7fdc877fe700 1 --2- 172.21.15.44:0/1317778356 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdc8c066730 0x7fdc8c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.745+0000 7fdc877fe700 1 -- 172.21.15.44:0/1317778356 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fdc980839d0 con 0x7fdca006d6f0 2024-09-13T18:28:40.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.745+0000 7fdc9e59c700 1 --2- 172.21.15.44:0/1317778356 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdc8c066730 0x7fdc8c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.745+0000 7fdc9e59c700 1 --2- 172.21.15.44:0/1317778356 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdc8c066730 0x7fdc8c068bf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdca0152c70 tx=0x7fdc94008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:40.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.753+0000 7fdc877fe700 1 -- 172.21.15.44:0/1317778356 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdc98050d00 con 0x7fdca006d6f0 2024-09-13T18:28:40.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.921+0000 7fdca49b7700 1 -- 172.21.15.44:0/1317778356 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdca0151a20 con 0x7fdca006d6f0 2024-09-13T18:28:40.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.921+0000 7fdc877fe700 1 -- 172.21.15.44:0/1317778356 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdca0151a20 con 0x7fdca006d6f0 2024-09-13T18:28:40.929 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:28:40.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.925+0000 7fdca49b7700 1 -- 172.21.15.44:0/1317778356 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdc8c066730 msgr2=0x7fdc8c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.925+0000 7fdca49b7700 1 --2- 172.21.15.44:0/1317778356 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdc8c066730 0x7fdc8c068bf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdca0152c70 tx=0x7fdc94008030 comp rx=0 tx=0).stop 2024-09-13T18:28:40.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.925+0000 7fdca49b7700 1 -- 172.21.15.44:0/1317778356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdca006d6f0 msgr2=0x7fdca0150f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.925+0000 7fdca49b7700 1 --2- 172.21.15.44:0/1317778356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdca006d6f0 0x7fdca0150f70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800caa0 tx=0x7fdc9800cad0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.925+0000 7fdca49b7700 1 -- 172.21.15.44:0/1317778356 shutdown_connections 2024-09-13T18:28:40.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.925+0000 7fdca49b7700 1 --2- 172.21.15.44:0/1317778356 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdc8c066730 0x7fdc8c068bf0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.925+0000 7fdca49b7700 1 --2- 172.21.15.44:0/1317778356 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdca015d030 0x7fdca0152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.925+0000 7fdca49b7700 1 --2- 172.21.15.44:0/1317778356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdca00ce270 0x7fdca013c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.925+0000 7fdca49b7700 1 --2- 172.21.15.44:0/1317778356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdca006d6f0 0x7fdca0150f70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.925+0000 7fdca49b7700 1 -- 172.21.15.44:0/1317778356 >> 172.21.15.44:0/1317778356 conn(0x7fdca00b0e10 msgr2=0x7fdca0159b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:40.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.925+0000 7fdca49b7700 1 -- 172.21.15.44:0/1317778356 shutdown_connections 2024-09-13T18:28:40.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:40.925+0000 7fdca49b7700 1 -- 172.21.15.44:0/1317778356 wait complete. 2024-09-13T18:28:40.950 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:28:41.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.065+0000 7f9299963700 1 Processor -- start 2024-09-13T18:28:41.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.065+0000 7f9299963700 1 -- start start 2024-09-13T18:28:41.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299963700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f929415cda0 0x7f929406b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299963700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92940ceb70 0x7f92940b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299963700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f929406a520 0x7f929406a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299963700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929406be40 con 0x7f929406a520 2024-09-13T18:28:41.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299963700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92940b8430 con 0x7f929415cda0 2024-09-13T18:28:41.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299963700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929406ae90 con 0x7f92940ceb70 2024-09-13T18:28:41.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299162700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f929406a520 0x7f929406a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299162700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f929406a520 0x7f929406a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34446/0 (socket says 172.21.15.44:34446) 2024-09-13T18:28:41.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299162700 1 -- 172.21.15.44:0/26466337 learned_addr learned my addr 172.21.15.44:0/26466337 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:41.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9293fff700 1 --2- 172.21.15.44:0/26466337 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92940ceb70 0x7f92940b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9298961700 1 --2- 172.21.15.44:0/26466337 >> v2:172.21.15.99:3300/0 conn(0x7f929415cda0 0x7f929406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299162700 1 -- 172.21.15.44:0/26466337 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92940ceb70 msgr2=0x7f92940b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:41.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299162700 1 --2- 172.21.15.44:0/26466337 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92940ceb70 0x7f92940b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299162700 1 -- 172.21.15.44:0/26466337 >> v2:172.21.15.99:3300/0 conn(0x7f929415cda0 msgr2=0x7f929406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:41.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299162700 1 --2- 172.21.15.44:0/26466337 >> v2:172.21.15.99:3300/0 conn(0x7f929415cda0 0x7f929406b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299162700 1 -- 172.21.15.44:0/26466337 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92940cf350 con 0x7f929406a520 2024-09-13T18:28:41.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299162700 1 --2- 172.21.15.44:0/26466337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f929406a520 0x7f929406a950 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f92940d0800 tx=0x7f928c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7832610a863a3012 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:41.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f92937fe700 1 -- 172.21.15.44:0/26466337 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c00e070 con 0x7f929406a520 2024-09-13T18:28:41.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f92937fe700 1 -- 172.21.15.44:0/26466337 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928c00b9c0 con 0x7f929406a520 2024-09-13T18:28:41.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f92937fe700 1 -- 172.21.15.44:0/26466337 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c00bd70 con 0x7f929406a520 2024-09-13T18:28:41.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299963700 1 -- 172.21.15.44:0/26466337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f929406a520 msgr2=0x7f929406a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299963700 1 --2- 172.21.15.44:0/26466337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f929406a520 0x7f929406a950 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f92940d0800 tx=0x7f928c00b330 comp rx=0 tx=0).stop 2024-09-13T18:28:41.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299963700 1 -- 172.21.15.44:0/26466337 shutdown_connections 2024-09-13T18:28:41.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299963700 1 --2- 172.21.15.44:0/26466337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f929406a520 0x7f929406a950 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299963700 1 --2- 172.21.15.44:0/26466337 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92940ceb70 0x7f92940b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299963700 1 --2- 172.21.15.44:0/26466337 >> v2:172.21.15.99:3300/0 conn(0x7f929415cda0 0x7f929406b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299963700 1 -- 172.21.15.44:0/26466337 >> 172.21.15.44:0/26466337 conn(0x7f92940d2cb0 msgr2=0x7f92940d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:41.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299963700 1 -- 172.21.15.44:0/26466337 shutdown_connections 2024-09-13T18:28:41.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.069+0000 7f9299963700 1 -- 172.21.15.44:0/26466337 wait complete. 2024-09-13T18:28:41.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.073+0000 7f9299963700 1 Processor -- start 2024-09-13T18:28:41.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.073+0000 7f9299963700 1 -- start start 2024-09-13T18:28:41.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.073+0000 7f9299963700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f929406a520 0x7f929415ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.073+0000 7f9299963700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92940ceb70 0x7f929415b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.073+0000 7f9299963700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f929415cda0 0x7f929415b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.073+0000 7f9299963700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92941f2d00 con 0x7f92940ceb70 2024-09-13T18:28:41.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.073+0000 7f9299963700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929414a600 con 0x7f929406a520 2024-09-13T18:28:41.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.073+0000 7f9299963700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92941f2640 con 0x7f929415cda0 2024-09-13T18:28:41.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.073+0000 7f9293fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92940ceb70 0x7f929415b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.073+0000 7f9299162700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f929415cda0 0x7f929415b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.073+0000 7f9293fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92940ceb70 0x7f929415b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34458/0 (socket says 172.21.15.44:34458) 2024-09-13T18:28:41.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.073+0000 7f9293fff700 1 -- 172.21.15.44:0/3120303074 learned_addr learned my addr 172.21.15.44:0/3120303074 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:41.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.073+0000 7f9298961700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f929406a520 0x7f929415ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.077+0000 7f9293fff700 1 -- 172.21.15.44:0/3120303074 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f929415cda0 msgr2=0x7f929415b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.077+0000 7f9293fff700 1 --2- 172.21.15.44:0/3120303074 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f929415cda0 0x7f929415b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.077+0000 7f9293fff700 1 -- 172.21.15.44:0/3120303074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f929406a520 msgr2=0x7f929415ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.077+0000 7f9293fff700 1 --2- 172.21.15.44:0/3120303074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f929406a520 0x7f929415ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.077+0000 7f9293fff700 1 -- 172.21.15.44:0/3120303074 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c009b30 con 0x7f92940ceb70 2024-09-13T18:28:41.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.077+0000 7f9293fff700 1 --2- 172.21.15.44:0/3120303074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92940ceb70 0x7f929415b0d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f928400e760 tx=0x7f928400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:41.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.077+0000 7f92917fa700 1 -- 172.21.15.44:0/3120303074 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928400c070 con 0x7f92940ceb70 2024-09-13T18:28:41.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.077+0000 7f92917fa700 1 -- 172.21.15.44:0/3120303074 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9284013610 con 0x7f92940ceb70 2024-09-13T18:28:41.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.077+0000 7f9299963700 1 -- 172.21.15.44:0/3120303074 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92941f2920 con 0x7f92940ceb70 2024-09-13T18:28:41.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.077+0000 7f92917fa700 1 -- 172.21.15.44:0/3120303074 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9284013980 con 0x7f92940ceb70 2024-09-13T18:28:41.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.077+0000 7f9299963700 1 -- 172.21.15.44:0/3120303074 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92941f3120 con 0x7f92940ceb70 2024-09-13T18:28:41.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.077+0000 7f92917fa700 1 -- 172.21.15.44:0/3120303074 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9284013ae0 con 0x7f92940ceb70 2024-09-13T18:28:41.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.077+0000 7f9299963700 1 -- 172.21.15.44:0/3120303074 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92940cefd0 con 0x7f92940ceb70 2024-09-13T18:28:41.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.081+0000 7f92917fa700 1 --2- 172.21.15.44:0/3120303074 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9280066730 0x7f9280068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.081+0000 7f92917fa700 1 -- 172.21.15.44:0/3120303074 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9284083f20 con 0x7f92940ceb70 2024-09-13T18:28:41.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.081+0000 7f9298961700 1 --2- 172.21.15.44:0/3120303074 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9280066730 0x7f9280068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.081+0000 7f9298961700 1 --2- 172.21.15.44:0/3120303074 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9280066730 0x7f9280068bf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f92880079e0 tx=0x7f9288008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:41.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.085+0000 7f92917fa700 1 -- 172.21.15.44:0/3120303074 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f92840512c0 con 0x7f92940ceb70 2024-09-13T18:28:41.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.253+0000 7f9299963700 1 -- 172.21.15.44:0/3120303074 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f929406c500 con 0x7f92940ceb70 2024-09-13T18:28:41.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.253+0000 7f92917fa700 1 -- 172.21.15.44:0/3120303074 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f92840548e0 con 0x7f92940ceb70 2024-09-13T18:28:41.262 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:28:41.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.257+0000 7f9299963700 1 -- 172.21.15.44:0/3120303074 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9280066730 msgr2=0x7f9280068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.257+0000 7f9299963700 1 --2- 172.21.15.44:0/3120303074 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9280066730 0x7f9280068bf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f92880079e0 tx=0x7f9288008040 comp rx=0 tx=0).stop 2024-09-13T18:28:41.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.257+0000 7f9299963700 1 -- 172.21.15.44:0/3120303074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92940ceb70 msgr2=0x7f929415b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.257+0000 7f9299963700 1 --2- 172.21.15.44:0/3120303074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92940ceb70 0x7f929415b0d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f928400e760 tx=0x7f928400ea70 comp rx=0 tx=0).stop 2024-09-13T18:28:41.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.257+0000 7f9299963700 1 -- 172.21.15.44:0/3120303074 shutdown_connections 2024-09-13T18:28:41.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.257+0000 7f9299963700 1 --2- 172.21.15.44:0/3120303074 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9280066730 0x7f9280068bf0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.257+0000 7f9299963700 1 --2- 172.21.15.44:0/3120303074 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f929415cda0 0x7f929415b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.257+0000 7f9299963700 1 --2- 172.21.15.44:0/3120303074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92940ceb70 0x7f929415b0d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.257+0000 7f9299963700 1 --2- 172.21.15.44:0/3120303074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f929406a520 0x7f929415ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.257+0000 7f9299963700 1 -- 172.21.15.44:0/3120303074 >> 172.21.15.44:0/3120303074 conn(0x7f92940d2cb0 msgr2=0x7f92940d1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:41.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.257+0000 7f9299963700 1 -- 172.21.15.44:0/3120303074 shutdown_connections 2024-09-13T18:28:41.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.257+0000 7f9299963700 1 -- 172.21.15.44:0/3120303074 wait complete. 2024-09-13T18:28:41.280 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:28:41.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.393+0000 7f9dbffff700 1 Processor -- start 2024-09-13T18:28:41.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.393+0000 7f9dbffff700 1 -- start start 2024-09-13T18:28:41.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbffff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9dc015cda0 0x7f9dc006b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbffff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc00b8430 con 0x7f9dc006a520 2024-09-13T18:28:41.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbffff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc00cf350 con 0x7f9dc00ceb70 2024-09-13T18:28:41.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbffff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc006be40 con 0x7f9dc015cda0 2024-09-13T18:28:41.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbf7fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9dc006a520 0x7f9dc006a930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44762/0 (socket says 172.21.15.44:44762) 2024-09-13T18:28:41.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbf7fe700 1 -- 172.21.15.44:0/423461703 learned_addr learned my addr 172.21.15.44:0/423461703 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:41.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbeffd700 1 --2- 172.21.15.44:0/423461703 >> v2:172.21.15.99:3300/0 conn(0x7f9dc015cda0 0x7f9dc006b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbdffb700 1 -- 172.21.15.44:0/423461703 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130628959 0 0) 0x7f9dc00b8430 con 0x7f9dc006a520 2024-09-13T18:28:41.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbdffb700 1 -- 172.21.15.44:0/423461703 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dac0035d0 con 0x7f9dc006a520 2024-09-13T18:28:41.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbdffb700 1 -- 172.21.15.44:0/423461703 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3822600882 0 0) 0x7f9dc00cf350 con 0x7f9dc00ceb70 2024-09-13T18:28:41.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbdffb700 1 -- 172.21.15.44:0/423461703 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dc00b8430 con 0x7f9dc00ceb70 2024-09-13T18:28:41.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbdffb700 1 -- 172.21.15.44:0/423461703 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1266972559 0 0) 0x7f9dac0035d0 con 0x7f9dc006a520 2024-09-13T18:28:41.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbdffb700 1 -- 172.21.15.44:0/423461703 >> v2:172.21.15.99:3300/0 conn(0x7f9dc015cda0 msgr2=0x7f9dc006b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:41.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbdffb700 1 --2- 172.21.15.44:0/423461703 >> v2:172.21.15.99:3300/0 conn(0x7f9dc015cda0 0x7f9dc006b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbdffb700 1 -- 172.21.15.44:0/423461703 >> v1:172.21.15.99:6789/0 conn(0x7f9dc00ceb70 legacy=0x7f9dc00b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbdffb700 1 -- 172.21.15.44:0/423461703 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc00d0880 con 0x7f9dc006a520 2024-09-13T18:28:41.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbdffb700 1 -- 172.21.15.44:0/423461703 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f9db80019f0 con 0x7f9dc006a520 2024-09-13T18:28:41.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbdffb700 1 -- 172.21.15.44:0/423461703 >> v1:172.21.15.44:6789/0 conn(0x7f9dc006a520 legacy=0x7f9dc006a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbdffb700 1 --2- 172.21.15.44:0/423461703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dac003c00 0x7f9dac004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbdffb700 1 --2- 172.21.15.44:0/423461703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9dac004870 0x7f9dac004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbdffb700 1 --2- 172.21.15.44:0/423461703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dac005230 0x7f9dac00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbdffb700 1 -- 172.21.15.44:0/423461703 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac00c100 con 0x7f9dac005230 2024-09-13T18:28:41.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbdffb700 1 -- 172.21.15.44:0/423461703 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac00c240 con 0x7f9dac003c00 2024-09-13T18:28:41.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbdffb700 1 -- 172.21.15.44:0/423461703 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac00c400 con 0x7f9dac004870 2024-09-13T18:28:41.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbf7fe700 1 --2- 172.21.15.44:0/423461703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dac005230 0x7f9dac00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbeffd700 1 --2- 172.21.15.44:0/423461703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dac003c00 0x7f9dac004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbe7fc700 1 --2- 172.21.15.44:0/423461703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9dac004870 0x7f9dac004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbf7fe700 1 -- 172.21.15.44:0/423461703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9dac004870 msgr2=0x7f9dac004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:41.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbf7fe700 1 --2- 172.21.15.44:0/423461703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9dac004870 0x7f9dac004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbf7fe700 1 -- 172.21.15.44:0/423461703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dac003c00 msgr2=0x7f9dac004000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:41.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbf7fe700 1 --2- 172.21.15.44:0/423461703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dac003c00 0x7f9dac004000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbf7fe700 1 -- 172.21.15.44:0/423461703 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac0035d0 con 0x7f9dac005230 2024-09-13T18:28:41.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbf7fe700 1 -- 172.21.15.44:0/423461703 reap_dead start 2024-09-13T18:28:41.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbf7fe700 1 --2- 172.21.15.44:0/423461703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dac005230 0x7f9dac00ba30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9db800a710 tx=0x7f9dac0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f26f39c90092eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:41.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbdffb700 1 -- 172.21.15.44:0/423461703 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db80070d0 con 0x7f9dac005230 2024-09-13T18:28:41.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbdffb700 1 -- 172.21.15.44:0/423461703 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db8007230 con 0x7f9dac005230 2024-09-13T18:28:41.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbdffb700 1 -- 172.21.15.44:0/423461703 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db80075e0 con 0x7f9dac005230 2024-09-13T18:28:41.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbffff700 1 -- 172.21.15.44:0/423461703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dac005230 msgr2=0x7f9dac00ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbffff700 1 --2- 172.21.15.44:0/423461703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dac005230 0x7f9dac00ba30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9db800a710 tx=0x7f9dac0058a0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbffff700 1 -- 172.21.15.44:0/423461703 shutdown_connections 2024-09-13T18:28:41.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbffff700 1 --2- 172.21.15.44:0/423461703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dac005230 0x7f9dac00ba30 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbffff700 1 -- 172.21.15.44:0/423461703 >> 172.21.15.44:0/423461703 conn(0x7f9dc00d2cb0 msgr2=0x7f9dc00d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:41.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbffff700 1 -- 172.21.15.44:0/423461703 shutdown_connections 2024-09-13T18:28:41.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.397+0000 7f9dbffff700 1 -- 172.21.15.44:0/423461703 wait complete. 2024-09-13T18:28:41.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9dbffff700 1 Processor -- start 2024-09-13T18:28:41.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9dbffff700 1 -- start start 2024-09-13T18:28:41.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9dbffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dac005230 0x7f9dc00c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9dbffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9dc0151610 0x7f9dc015d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9dbffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dc00ca760 0x7f9dc00cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9dbffff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc0151a90 con 0x7f9dac005230 2024-09-13T18:28:41.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9dbffff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc00c8aa0 con 0x7f9dc00ca760 2024-09-13T18:28:41.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9dbffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc00cabe0 con 0x7f9dc0151610 2024-09-13T18:28:41.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9dbeffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dac005230 0x7f9dc00c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9dbeffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dac005230 0x7f9dc00c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34470/0 (socket says 172.21.15.44:34470) 2024-09-13T18:28:41.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9dbeffd700 1 -- 172.21.15.44:0/3719709193 learned_addr learned my addr 172.21.15.44:0/3719709193 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:41.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9dbf7fe700 1 --2- 172.21.15.44:0/3719709193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dc00ca760 0x7f9dc00cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9dbe7fc700 1 --2- 172.21.15.44:0/3719709193 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9dc0151610 0x7f9dc015d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9dbeffd700 1 -- 172.21.15.44:0/3719709193 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9dc0151610 msgr2=0x7f9dc015d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9dbeffd700 1 --2- 172.21.15.44:0/3719709193 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9dc0151610 0x7f9dc015d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9dbeffd700 1 -- 172.21.15.44:0/3719709193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dc00ca760 msgr2=0x7f9dc00cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9dbeffd700 1 --2- 172.21.15.44:0/3719709193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dc00ca760 0x7f9dc00cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9dbeffd700 1 -- 172.21.15.44:0/3719709193 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc00c6850 con 0x7f9dac005230 2024-09-13T18:28:41.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9dbeffd700 1 --2- 172.21.15.44:0/3719709193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dac005230 0x7f9dc00c94c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9da8011a10 tx=0x7f9da8011d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:41.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9db77fe700 1 -- 172.21.15.44:0/3719709193 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da8011ea0 con 0x7f9dac005230 2024-09-13T18:28:41.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9db77fe700 1 -- 172.21.15.44:0/3719709193 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da800f8e0 con 0x7f9dac005230 2024-09-13T18:28:41.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9dbffff700 1 -- 172.21.15.44:0/3719709193 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc00c6b30 con 0x7f9dac005230 2024-09-13T18:28:41.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9db77fe700 1 -- 172.21.15.44:0/3719709193 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da800fc70 con 0x7f9dac005230 2024-09-13T18:28:41.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.401+0000 7f9dbffff700 1 -- 172.21.15.44:0/3719709193 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc00c70f0 con 0x7f9dac005230 2024-09-13T18:28:41.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.405+0000 7f9dbffff700 1 -- 172.21.15.44:0/3719709193 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc006b900 con 0x7f9dac005230 2024-09-13T18:28:41.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.405+0000 7f9db77fe700 1 -- 172.21.15.44:0/3719709193 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9da8014440 con 0x7f9dac005230 2024-09-13T18:28:41.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.405+0000 7f9db77fe700 1 --2- 172.21.15.44:0/3719709193 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9da0066760 0x7f9da0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.405+0000 7f9db77fe700 1 -- 172.21.15.44:0/3719709193 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9da8084720 con 0x7f9dac005230 2024-09-13T18:28:41.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.405+0000 7f9dbe7fc700 1 --2- 172.21.15.44:0/3719709193 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9da0066760 0x7f9da0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.409+0000 7f9dbe7fc700 1 --2- 172.21.15.44:0/3719709193 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9da0066760 0x7f9da0068c20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00c8fa0 tx=0x7f9db0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:41.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.413+0000 7f9db77fe700 1 -- 172.21.15.44:0/3719709193 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9da8051a20 con 0x7f9dac005230 2024-09-13T18:28:41.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.585+0000 7f9dbffff700 1 -- 172.21.15.44:0/3719709193 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9dc00d3390 con 0x7f9dac005230 2024-09-13T18:28:41.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.585+0000 7f9db77fe700 1 -- 172.21.15.44:0/3719709193 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9da8055040 con 0x7f9dac005230 2024-09-13T18:28:41.592 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:28:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.585+0000 7f9dbffff700 1 -- 172.21.15.44:0/3719709193 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9da0066760 msgr2=0x7f9da0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.585+0000 7f9dbffff700 1 --2- 172.21.15.44:0/3719709193 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9da0066760 0x7f9da0068c20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00c8fa0 tx=0x7f9db0009040 comp rx=0 tx=0).stop 2024-09-13T18:28:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.585+0000 7f9dbffff700 1 -- 172.21.15.44:0/3719709193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dac005230 msgr2=0x7f9dc00c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.585+0000 7f9dbffff700 1 --2- 172.21.15.44:0/3719709193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dac005230 0x7f9dc00c94c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9da8011a10 tx=0x7f9da8011d20 comp rx=0 tx=0).stop 2024-09-13T18:28:41.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.585+0000 7f9dbffff700 1 -- 172.21.15.44:0/3719709193 shutdown_connections 2024-09-13T18:28:41.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.585+0000 7f9dbffff700 1 --2- 172.21.15.44:0/3719709193 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9da0066760 0x7f9da0068c20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.585+0000 7f9dbffff700 1 --2- 172.21.15.44:0/3719709193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dc00ca760 0x7f9dc00cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.585+0000 7f9dbffff700 1 --2- 172.21.15.44:0/3719709193 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9dc0151610 0x7f9dc015d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.585+0000 7f9dbffff700 1 --2- 172.21.15.44:0/3719709193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dac005230 0x7f9dc00c94c0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.585+0000 7f9dbffff700 1 -- 172.21.15.44:0/3719709193 >> 172.21.15.44:0/3719709193 conn(0x7f9dc00d2cb0 msgr2=0x7f9dc00b7550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:41.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.589+0000 7f9dbffff700 1 -- 172.21.15.44:0/3719709193 shutdown_connections 2024-09-13T18:28:41.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.589+0000 7f9dbffff700 1 -- 172.21.15.44:0/3719709193 wait complete. 2024-09-13T18:28:41.607 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:28:41.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.713+0000 7fe5688fa700 1 Processor -- start 2024-09-13T18:28:41.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.713+0000 7fe5688fa700 1 -- start start 2024-09-13T18:28:41.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.713+0000 7fe5688fa700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe5640712b0 0x7fe564159f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.713+0000 7fe5688fa700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe56415a460 0x7fe56406c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.713+0000 7fe5688fa700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe56415ac50 con 0x7fe5641573e0 2024-09-13T18:28:41.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.713+0000 7fe5688fa700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5640cc1b0 con 0x7fe5640712b0 2024-09-13T18:28:41.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.713+0000 7fe5688fa700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5640cb3f0 con 0x7fe56415a460 2024-09-13T18:28:41.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.713+0000 7fe56259c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe5640712b0 0x7fe564159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.713+0000 7fe56259c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe5640712b0 0x7fe564159f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34478/0 (socket says 172.21.15.44:34478) 2024-09-13T18:28:41.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.713+0000 7fe56259c700 1 -- 172.21.15.44:0/2626842256 learned_addr learned my addr 172.21.15.44:0/2626842256 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:41.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.713+0000 7fe56359e700 1 --2- 172.21.15.44:0/2626842256 >> v2:172.21.15.99:3300/0 conn(0x7fe56415a460 0x7fe56406c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.713+0000 7fe56259c700 1 -- 172.21.15.44:0/2626842256 >> v2:172.21.15.99:3300/0 conn(0x7fe56415a460 msgr2=0x7fe56406c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:41.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.713+0000 7fe56259c700 1 --2- 172.21.15.44:0/2626842256 >> v2:172.21.15.99:3300/0 conn(0x7fe56415a460 0x7fe56406c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.713+0000 7fe56259c700 1 -- 172.21.15.44:0/2626842256 >> v1:172.21.15.44:6789/0 conn(0x7fe5641573e0 legacy=0x7fe564070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.713+0000 7fe56259c700 1 -- 172.21.15.44:0/2626842256 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5640cb6d0 con 0x7fe5640712b0 2024-09-13T18:28:41.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.713+0000 7fe56259c700 1 --2- 172.21.15.44:0/2626842256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5640712b0 0x7fe564159f20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe56406b990 tx=0x7fe554009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de5e40828265f68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:41.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.713+0000 7fe561d9b700 1 -- 172.21.15.44:0/2626842256 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55400ba20 con 0x7fe5640712b0 2024-09-13T18:28:41.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.713+0000 7fe561d9b700 1 -- 172.21.15.44:0/2626842256 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55400bb80 con 0x7fe5640712b0 2024-09-13T18:28:41.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.713+0000 7fe561d9b700 1 -- 172.21.15.44:0/2626842256 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe554009e60 con 0x7fe5640712b0 2024-09-13T18:28:41.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.717+0000 7fe5688fa700 1 -- 172.21.15.44:0/2626842256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5640712b0 msgr2=0x7fe564159f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.717+0000 7fe5688fa700 1 --2- 172.21.15.44:0/2626842256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5640712b0 0x7fe564159f20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe56406b990 tx=0x7fe554009c20 comp rx=0 tx=0).stop 2024-09-13T18:28:41.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.717+0000 7fe5688fa700 1 -- 172.21.15.44:0/2626842256 shutdown_connections 2024-09-13T18:28:41.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.717+0000 7fe5688fa700 1 --2- 172.21.15.44:0/2626842256 >> v2:172.21.15.99:3300/0 conn(0x7fe56415a460 0x7fe56406c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.717+0000 7fe5688fa700 1 --2- 172.21.15.44:0/2626842256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5640712b0 0x7fe564159f20 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.717+0000 7fe5688fa700 1 -- 172.21.15.44:0/2626842256 >> 172.21.15.44:0/2626842256 conn(0x7fe5640b0e10 msgr2=0x7fe5640b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:41.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.717+0000 7fe5688fa700 1 -- 172.21.15.44:0/2626842256 shutdown_connections 2024-09-13T18:28:41.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.717+0000 7fe5688fa700 1 -- 172.21.15.44:0/2626842256 wait complete. 2024-09-13T18:28:41.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.717+0000 7fe5688fa700 1 Processor -- start 2024-09-13T18:28:41.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.717+0000 7fe5688fa700 1 -- start start 2024-09-13T18:28:41.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.717+0000 7fe5688fa700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5640712b0 0x7fe564158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.717+0000 7fe5688fa700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5641573e0 0x7fe564153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.717+0000 7fe5688fa700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe56415a460 0x7fe564154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.717+0000 7fe5688fa700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe564151e80 con 0x7fe5640712b0 2024-09-13T18:28:41.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.717+0000 7fe5688fa700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe564154830 con 0x7fe5641573e0 2024-09-13T18:28:41.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.717+0000 7fe5688fa700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5641545a0 con 0x7fe56415a460 2024-09-13T18:28:41.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.717+0000 7fe562d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5640712b0 0x7fe564158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.717+0000 7fe562d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5640712b0 0x7fe564158b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34490/0 (socket says 172.21.15.44:34490) 2024-09-13T18:28:41.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.717+0000 7fe562d9d700 1 -- 172.21.15.44:0/1335591905 learned_addr learned my addr 172.21.15.44:0/1335591905 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:41.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.721+0000 7fe56259c700 1 --2- 172.21.15.44:0/1335591905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5641573e0 0x7fe564153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.721+0000 7fe56359e700 1 --2- 172.21.15.44:0/1335591905 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe56415a460 0x7fe564154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.721+0000 7fe562d9d700 1 -- 172.21.15.44:0/1335591905 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe56415a460 msgr2=0x7fe564154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.721+0000 7fe562d9d700 1 --2- 172.21.15.44:0/1335591905 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe56415a460 0x7fe564154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.721+0000 7fe562d9d700 1 -- 172.21.15.44:0/1335591905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5641573e0 msgr2=0x7fe564153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.721+0000 7fe562d9d700 1 --2- 172.21.15.44:0/1335591905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5641573e0 0x7fe564153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.721+0000 7fe562d9d700 1 -- 172.21.15.44:0/1335591905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe554009570 con 0x7fe5640712b0 2024-09-13T18:28:41.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.721+0000 7fe56359e700 1 --2- 172.21.15.44:0/1335591905 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe56415a460 0x7fe564154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:41.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.721+0000 7fe562d9d700 1 --2- 172.21.15.44:0/1335591905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5640712b0 0x7fe564158b40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00c500 tx=0x7fe54c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:41.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.721+0000 7fe55b7fe700 1 -- 172.21.15.44:0/1335591905 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c0052d0 con 0x7fe5640712b0 2024-09-13T18:28:41.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.721+0000 7fe55b7fe700 1 -- 172.21.15.44:0/1335591905 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c005430 con 0x7fe5640712b0 2024-09-13T18:28:41.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.721+0000 7fe5688fa700 1 -- 172.21.15.44:0/1335591905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe564152060 con 0x7fe5640712b0 2024-09-13T18:28:41.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.721+0000 7fe55b7fe700 1 -- 172.21.15.44:0/1335591905 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c0055a0 con 0x7fe5640712b0 2024-09-13T18:28:41.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.721+0000 7fe5688fa700 1 -- 172.21.15.44:0/1335591905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe564152620 con 0x7fe5640712b0 2024-09-13T18:28:41.730 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-13T18:28:41.721+0000 7fc22e3c7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-13T18:28:41.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.721+0000 7fe55b7fe700 1 -- 172.21.15.44:0/1335591905 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe54c0036a0 con 0x7fe5640712b0 2024-09-13T18:28:41.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.725+0000 7fe5688fa700 1 -- 172.21.15.44:0/1335591905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5640af7e0 con 0x7fe5640712b0 2024-09-13T18:28:41.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.725+0000 7fe55b7fe700 1 --2- 172.21.15.44:0/1335591905 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe544066730 0x7fe544068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.725+0000 7fe56259c700 1 --2- 172.21.15.44:0/1335591905 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe544066730 0x7fe544068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.725+0000 7fe56259c700 1 --2- 172.21.15.44:0/1335591905 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe544066730 0x7fe544068bf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe554000c00 tx=0x7fe554008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:41.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.725+0000 7fe55b7fe700 1 -- 172.21.15.44:0/1335591905 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe54c054b00 con 0x7fe5640712b0 2024-09-13T18:28:41.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.733+0000 7fe55b7fe700 1 -- 172.21.15.44:0/1335591905 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe54c0541d0 con 0x7fe5640712b0 2024-09-13T18:28:41.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.917+0000 7fe5688fa700 1 -- 172.21.15.44:0/1335591905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe564159f20 con 0x7fe5640712b0 2024-09-13T18:28:41.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.917+0000 7fe55b7fe700 1 -- 172.21.15.44:0/1335591905 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v36) v1 ==== 80+0+120 (secure 0 0 0) 0x7fe54c053d60 con 0x7fe5640712b0 2024-09-13T18:28:41.924 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/939073284 2024-09-14T18:28:29.639607+0000 2024-09-13T18:28:41.924 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6834/939073284 2024-09-14T18:28:29.639607+0000 2024-09-13T18:28:41.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.921+0000 7fe5688fa700 1 -- 172.21.15.44:0/1335591905 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe544066730 msgr2=0x7fe544068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.921+0000 7fe5688fa700 1 --2- 172.21.15.44:0/1335591905 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe544066730 0x7fe544068bf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe554000c00 tx=0x7fe554008030 comp rx=0 tx=0).stop 2024-09-13T18:28:41.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.921+0000 7fe5688fa700 1 -- 172.21.15.44:0/1335591905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5640712b0 msgr2=0x7fe564158b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.921+0000 7fe5688fa700 1 --2- 172.21.15.44:0/1335591905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5640712b0 0x7fe564158b40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00c500 tx=0x7fe54c00c810 comp rx=0 tx=0).stop 2024-09-13T18:28:41.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.921+0000 7fe5688fa700 1 -- 172.21.15.44:0/1335591905 shutdown_connections 2024-09-13T18:28:41.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.921+0000 7fe5688fa700 1 --2- 172.21.15.44:0/1335591905 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe544066730 0x7fe544068bf0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.921+0000 7fe5688fa700 1 --2- 172.21.15.44:0/1335591905 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe56415a460 0x7fe564154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.921+0000 7fe5688fa700 1 --2- 172.21.15.44:0/1335591905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5641573e0 0x7fe564153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.921+0000 7fe5688fa700 1 --2- 172.21.15.44:0/1335591905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5640712b0 0x7fe564158b40 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.921+0000 7fe5688fa700 1 -- 172.21.15.44:0/1335591905 >> 172.21.15.44:0/1335591905 conn(0x7fe5640b0e10 msgr2=0x7fe5640af0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:41.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.921+0000 7fe5688fa700 1 -- 172.21.15.44:0/1335591905 shutdown_connections 2024-09-13T18:28:41.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:41.921+0000 7fe5688fa700 1 -- 172.21.15.44:0/1335591905 wait complete. 2024-09-13T18:28:41.930 INFO:teuthology.orchestra.run.smithi044.stderr:listed 2 entries 2024-09-13T18:28:41.944 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2024-09-13T18:28:41.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:41.944 DEBUG:teuthology.orchestra.run.smithi044:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:41.957 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[38443]: fuse finished with error 0 and tester_r 0 2024-09-13T18:28:41.958 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:28:48.061 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:28:48.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:48.061 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:28:48.070 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:28:48.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.221+0000 7fa6faaa2700 1 Processor -- start 2024-09-13T18:28:48.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.221+0000 7fa6faaa2700 1 -- start start 2024-09-13T18:28:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6faaa2700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa6f415cae0 0x7fa6f40cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6faaa2700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa6f406b310 0x7fa6f40d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6faaa2700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f40d21e0 con 0x7fa6f415cec0 2024-09-13T18:28:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6faaa2700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f40d1750 con 0x7fa6f406b310 2024-09-13T18:28:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6faaa2700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f40d1940 con 0x7fa6f415cae0 2024-09-13T18:28:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6fa2a1700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa6f406b310 0x7fa6f40d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6fa2a1700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa6f406b310 0x7fa6f40d1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59332/0 (socket says 172.21.15.44:59332) 2024-09-13T18:28:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6fa2a1700 1 -- 172.21.15.44:0/2658661588 learned_addr learned my addr 172.21.15.44:0/2658661588 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6f9aa0700 1 --2- 172.21.15.44:0/2658661588 >> v2:172.21.15.99:3300/0 conn(0x7fa6f415cae0 0x7fa6f40cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:48.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6fa2a1700 1 -- 172.21.15.44:0/2658661588 >> v2:172.21.15.99:3300/0 conn(0x7fa6f415cae0 msgr2=0x7fa6f40cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:48.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6fa2a1700 1 --2- 172.21.15.44:0/2658661588 >> v2:172.21.15.99:3300/0 conn(0x7fa6f415cae0 0x7fa6f40cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:48.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6fa2a1700 1 -- 172.21.15.44:0/2658661588 >> v1:172.21.15.99:6789/0 conn(0x7fa6f415cec0 legacy=0x7fa6f406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:48.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6fa2a1700 1 -- 172.21.15.44:0/2658661588 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f40d1c20 con 0x7fa6f406b310 2024-09-13T18:28:48.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6fa2a1700 1 --2- 172.21.15.44:0/2658661588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6f406b310 0x7fa6f40d1210 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec009e50 tx=0x7fa6ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22cd92e741c56e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:48.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6f8a9e700 1 -- 172.21.15.44:0/2658661588 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec00e070 con 0x7fa6f406b310 2024-09-13T18:28:48.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6f8a9e700 1 -- 172.21.15.44:0/2658661588 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ec003a40 con 0x7fa6f406b310 2024-09-13T18:28:48.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6f8a9e700 1 -- 172.21.15.44:0/2658661588 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec003df0 con 0x7fa6f406b310 2024-09-13T18:28:48.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6faaa2700 1 -- 172.21.15.44:0/2658661588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6f406b310 msgr2=0x7fa6f40d1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:48.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6faaa2700 1 --2- 172.21.15.44:0/2658661588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6f406b310 0x7fa6f40d1210 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec009e50 tx=0x7fa6ec00b330 comp rx=0 tx=0).stop 2024-09-13T18:28:48.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6faaa2700 1 -- 172.21.15.44:0/2658661588 shutdown_connections 2024-09-13T18:28:48.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6faaa2700 1 --2- 172.21.15.44:0/2658661588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6f406b310 0x7fa6f40d1210 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:48.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6faaa2700 1 --2- 172.21.15.44:0/2658661588 >> v2:172.21.15.99:3300/0 conn(0x7fa6f415cae0 0x7fa6f40cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:48.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6faaa2700 1 -- 172.21.15.44:0/2658661588 >> 172.21.15.44:0/2658661588 conn(0x7fa6f40d2c80 msgr2=0x7fa6f40d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:48.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6faaa2700 1 -- 172.21.15.44:0/2658661588 shutdown_connections 2024-09-13T18:28:48.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.225+0000 7fa6faaa2700 1 -- 172.21.15.44:0/2658661588 wait complete. 2024-09-13T18:28:48.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6faaa2700 1 Processor -- start 2024-09-13T18:28:48.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6faaa2700 1 -- start start 2024-09-13T18:28:48.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6faaa2700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6f406b310 0x7fa6f40aa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:48.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6faaa2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6f415cae0 0x7fa6f40cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:48.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6faaa2700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6f415cec0 0x7fa6f40abed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:48.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6faaa2700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f40ac950 con 0x7fa6f415cae0 2024-09-13T18:28:48.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6faaa2700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f40a95e0 con 0x7fa6f415cec0 2024-09-13T18:28:48.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6faaa2700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f40a97f0 con 0x7fa6f406b310 2024-09-13T18:28:48.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6f929f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6f415cae0 0x7fa6f40cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:48.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6f929f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6f415cae0 0x7fa6f40cb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59340/0 (socket says 172.21.15.44:59340) 2024-09-13T18:28:48.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6f929f700 1 -- 172.21.15.44:0/1543210819 learned_addr learned my addr 172.21.15.44:0/1543210819 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:48.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6fa2a1700 1 --2- 172.21.15.44:0/1543210819 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6f415cec0 0x7fa6f40abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:48.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6f9aa0700 1 --2- 172.21.15.44:0/1543210819 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6f406b310 0x7fa6f40aa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:48.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6f929f700 1 -- 172.21.15.44:0/1543210819 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6f406b310 msgr2=0x7fa6f40aa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:48.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6f929f700 1 --2- 172.21.15.44:0/1543210819 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6f406b310 0x7fa6f40aa5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:48.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6f929f700 1 -- 172.21.15.44:0/1543210819 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6f415cec0 msgr2=0x7fa6f40abed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:48.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6f929f700 1 --2- 172.21.15.44:0/1543210819 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6f415cec0 0x7fa6f40abed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:48.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6f929f700 1 -- 172.21.15.44:0/1543210819 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ec009b30 con 0x7fa6f415cae0 2024-09-13T18:28:48.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6f929f700 1 --2- 172.21.15.44:0/1543210819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6f415cae0 0x7fa6f40cb5f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa6e400c4e0 tx=0x7fa6e400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:48.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6ea7fc700 1 -- 172.21.15.44:0/1543210819 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4011790 con 0x7fa6f415cae0 2024-09-13T18:28:48.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6ea7fc700 1 -- 172.21.15.44:0/1543210819 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e4011910 con 0x7fa6f415cae0 2024-09-13T18:28:48.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6faaa2700 1 -- 172.21.15.44:0/1543210819 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f40a9ad0 con 0x7fa6f415cae0 2024-09-13T18:28:48.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6ea7fc700 1 -- 172.21.15.44:0/1543210819 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4011cc0 con 0x7fa6f415cae0 2024-09-13T18:28:48.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.229+0000 7fa6faaa2700 1 -- 172.21.15.44:0/1543210819 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f40aa090 con 0x7fa6f415cae0 2024-09-13T18:28:48.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.233+0000 7fa6faaa2700 1 -- 172.21.15.44:0/1543210819 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f40aa280 con 0x7fa6f415cae0 2024-09-13T18:28:48.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.233+0000 7fa6ea7fc700 1 -- 172.21.15.44:0/1543210819 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa6e401c460 con 0x7fa6f415cae0 2024-09-13T18:28:48.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.233+0000 7fa6ea7fc700 1 --2- 172.21.15.44:0/1543210819 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa6d8066730 0x7fa6d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:48.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.233+0000 7fa6ea7fc700 1 -- 172.21.15.44:0/1543210819 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa6e4083fe0 con 0x7fa6f415cae0 2024-09-13T18:28:48.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.233+0000 7fa6f9aa0700 1 --2- 172.21.15.44:0/1543210819 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa6d8066730 0x7fa6d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:48.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.233+0000 7fa6f9aa0700 1 --2- 172.21.15.44:0/1543210819 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa6d8066730 0x7fa6d8068bf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40b1850 tx=0x7fa6f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:48.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.245+0000 7fa6ea7fc700 1 -- 172.21.15.44:0/1543210819 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa6e40511f0 con 0x7fa6f415cae0 2024-09-13T18:28:48.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.453+0000 7fa6faaa2700 1 -- 172.21.15.44:0/1543210819 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa6f40b2050 con 0x7fa6f415cae0 2024-09-13T18:28:48.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.453+0000 7fa6ea7fc700 1 -- 172.21.15.44:0/1543210819 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa6e4054810 con 0x7fa6f415cae0 2024-09-13T18:28:48.461 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:28:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.457+0000 7fa6faaa2700 1 -- 172.21.15.44:0/1543210819 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa6d8066730 msgr2=0x7fa6d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.457+0000 7fa6faaa2700 1 --2- 172.21.15.44:0/1543210819 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa6d8066730 0x7fa6d8068bf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40b1850 tx=0x7fa6f0008040 comp rx=0 tx=0).stop 2024-09-13T18:28:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.457+0000 7fa6faaa2700 1 -- 172.21.15.44:0/1543210819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6f415cae0 msgr2=0x7fa6f40cb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.457+0000 7fa6faaa2700 1 --2- 172.21.15.44:0/1543210819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6f415cae0 0x7fa6f40cb5f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa6e400c4e0 tx=0x7fa6e400c7f0 comp rx=0 tx=0).stop 2024-09-13T18:28:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.457+0000 7fa6faaa2700 1 -- 172.21.15.44:0/1543210819 shutdown_connections 2024-09-13T18:28:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.457+0000 7fa6faaa2700 1 --2- 172.21.15.44:0/1543210819 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa6d8066730 0x7fa6d8068bf0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.457+0000 7fa6faaa2700 1 --2- 172.21.15.44:0/1543210819 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6f415cec0 0x7fa6f40abed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.457+0000 7fa6faaa2700 1 --2- 172.21.15.44:0/1543210819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6f415cae0 0x7fa6f40cb5f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:48.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.457+0000 7fa6faaa2700 1 --2- 172.21.15.44:0/1543210819 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6f406b310 0x7fa6f40aa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:48.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.457+0000 7fa6faaa2700 1 -- 172.21.15.44:0/1543210819 >> 172.21.15.44:0/1543210819 conn(0x7fa6f40d2c80 msgr2=0x7fa6f40b24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:48.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.457+0000 7fa6faaa2700 1 -- 172.21.15.44:0/1543210819 shutdown_connections 2024-09-13T18:28:48.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:48.457+0000 7fa6faaa2700 1 -- 172.21.15.44:0/1543210819 wait complete. 2024-09-13T18:28:48.477 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:28:48.477 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:28:48.477 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-13T18:28:48.477 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:28:48.477 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:48.477 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:28:48.477 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:28:48.477 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:28:48.477 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:28:48.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:48.477 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-13T18:28:48.485 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:28:48.485 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:28:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:28:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-13T18:28:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:48.486 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:28:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:48.486 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:28:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:48.486 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:28:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:28:48.486 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42495sec preferred_lft 42495sec 2024-09-13T18:28:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-13T18:28:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:48.487 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:28:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:48.487 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:28:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:80:b2:e4:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:28:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:48.487 INFO:teuthology.orchestra.run.smithi044.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:28:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 2e:69:eb:1c:57:57 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:28:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:48.487 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::8842:91ff:feed:2c53/64 scope link 2024-09-13T18:28:48.488 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:48.488 INFO:teuthology.orchestra.run.smithi044.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:28:48.488 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 2e:69:eb:1c:57:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:28:48.488 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::2c69:ebff:fe1c:5757/64 scope link 2024-09-13T18:28:48.488 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:48.488 INFO:teuthology.orchestra.run.smithi044.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:28:48.488 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 86:e5:07:ac:f1:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:28:48.488 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::84e5:7ff:feac:f11b/64 scope link 2024-09-13T18:28:48.488 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:48.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:48.489 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:28:48.500 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-13T18:28:48.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:48.502 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-13T18:28:48.551 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-13T18:28:48.551 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:28:48.551 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:28:48.551 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:28:48.551 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:28:48.551 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:28:48.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:48.552 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2024-09-13T18:28:48.552 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-13T18:28:48.552 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:28:48.552 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:28:48.552 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:28:48.552 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-13T18:28:48.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:48.591 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-13T18:28:48.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:28:48.597 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:28:48.598 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:28:48.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:48.598 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-13T18:28:48.615 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:28:48.615 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:28:48.615 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:48.665 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:28:48.665 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:28:48.665 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:48.672 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:28:48.688 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:28:48.688 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:28:48.704 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:28:48.705 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:28:48.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:48.706 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:28:48.711 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:28:48.711 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:28:48.756 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:28:48.774 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:28:48.775 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:28:48.784 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:28:48.785 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:28:48.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:48.785 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:28:48.844 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2024-09-13T18:28:48.837+0000 7fcdb2dc4640 -1 init, newargv = 0x564e7203cbe0 newargc=15 2024-09-13T18:28:48.845 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[38836]: starting ceph client 2024-09-13T18:28:48.852 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[38836]: starting fuse 2024-09-13T18:28:49.892 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:28:49.911 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:28:49.911 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:28:49.927 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:28:49.928 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:28:49.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:49.929 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:28:49.936 INFO:teuthology.orchestra.run.smithi044.stdout:52 2024-09-13T18:28:49.936 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T18:28:49.936 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:28:49.936 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2024-09-13T18:28:49.936 DEBUG:teuthology.orchestra.run.smithi044:> import re 2024-09-13T18:28:49.936 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:28:49.936 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2024-09-13T18:28:49.936 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:49.937 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2024-09-13T18:28:49.937 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:28:49.937 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2024-09-13T18:28:49.937 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:28:49.938 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:49.938 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2024-09-13T18:28:49.938 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2024-09-13T18:28:49.938 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2024-09-13T18:28:49.938 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2024-09-13T18:28:49.938 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:49.938 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2024-09-13T18:28:49.938 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:28:49.938 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:28:49.938 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:28:49.938 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2024-09-13T18:28:49.938 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2024-09-13T18:28:49.938 DEBUG:teuthology.orchestra.run.smithi044:> return f 2024-09-13T18:28:49.938 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:28:49.938 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:49.938 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.0")) 2024-09-13T18:28:49.939 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:28:50.022 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.0.38836.asok 2024-09-13T18:28:50.200 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.38836.asok 2024-09-13T18:28:50.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:50.200 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.38836.asok status 2024-09-13T18:28:50.352 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:28:50.353 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2024-09-13T18:28:50.353 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:28:50.353 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:28:50.353 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "0", 2024-09-13T18:28:50.353 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2024-09-13T18:28:50.353 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:28:50.353 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "38836", 2024-09-13T18:28:50.353 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2024-09-13T18:28:50.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:28:50.353 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2024-09-13T18:28:50.353 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2024-09-13T18:28:50.353 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 5793, 2024-09-13T18:28:50.353 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2024-09-13T18:28:50.354 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2024-09-13T18:28:50.354 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2024-09-13T18:28:50.354 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 5793 2024-09-13T18:28:50.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:28:50.354 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:28:50.354 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-13T18:28:50.354 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:28:50.354 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2074456058 2024-09-13T18:28:50.354 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:28:50.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:28:50.354 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:28:50.354 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-13T18:28:50.354 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:28:50.354 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2074456058 2024-09-13T18:28:50.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:28:50.355 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.5793 192.168.0.1:0/2074456058", 2024-09-13T18:28:50.355 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/2074456058", 2024-09-13T18:28:50.355 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2024-09-13T18:28:50.355 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 23, 2024-09-13T18:28:50.355 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 36, 2024-09-13T18:28:50.355 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:28:50.355 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2024-09-13T18:28:50.355 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2024-09-13T18:28:50.355 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:28:50.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:50.362 DEBUG:teuthology.orchestra.run.smithi044:> stat --file-system '--printf=%T 2024-09-13T18:28:50.362 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:50.369 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2024-09-13T18:28:50.370 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:50.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:50.370 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:50.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:50.383 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R) 2024-09-13T18:28:50.449 INFO:teuthology.orchestra.run.smithi044.stdout:.: 2024-09-13T18:28:50.449 INFO:teuthology.orchestra.run.smithi044.stdout:linkdir 2024-09-13T18:28:50.449 INFO:teuthology.orchestra.run.smithi044.stdout:rootfile 2024-09-13T18:28:50.449 INFO:teuthology.orchestra.run.smithi044.stdout:subdir 2024-09-13T18:28:50.449 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:50.449 INFO:teuthology.orchestra.run.smithi044.stdout:./linkdir: 2024-09-13T18:28:50.449 INFO:teuthology.orchestra.run.smithi044.stdout:link0 2024-09-13T18:28:50.449 INFO:teuthology.orchestra.run.smithi044.stdout:link1 2024-09-13T18:28:50.449 INFO:teuthology.orchestra.run.smithi044.stdout:link2 2024-09-13T18:28:50.449 INFO:teuthology.orchestra.run.smithi044.stdout:link3 2024-09-13T18:28:50.450 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:50.450 INFO:teuthology.orchestra.run.smithi044.stdout:./subdir: 2024-09-13T18:28:50.450 INFO:teuthology.orchestra.run.smithi044.stdout:subdirfile 2024-09-13T18:28:50.450 INFO:teuthology.orchestra.run.smithi044.stdout:subsubdir 2024-09-13T18:28:50.450 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:50.450 INFO:teuthology.orchestra.run.smithi044.stdout:./subdir/subsubdir: 2024-09-13T18:28:50.451 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:28:50.451 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:28:50.451 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-13T18:28:50.451 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:50.451 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/rootfile").st_ino) 2024-09-13T18:28:50.451 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:28:50.514 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627776 2024-09-13T18:28:50.701 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:28:50.701 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:28:50.701 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-13T18:28:50.701 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:50.701 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2024-09-13T18:28:50.701 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:28:50.770 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627777 2024-09-13T18:28:50.958 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:28:50.959 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:28:50.959 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-13T18:28:50.959 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:50.959 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir/subdirfile").st_ino) 2024-09-13T18:28:50.959 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:28:51.073 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627778 2024-09-13T18:28:51.260 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:28:51.260 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:28:51.260 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-13T18:28:51.260 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:51.261 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir/subsubdir").st_ino) 2024-09-13T18:28:51.261 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:28:51.330 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628282 2024-09-13T18:28:51.518 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:28:51.518 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:28:51.518 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-13T18:28:51.518 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:51.518 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/linkdir/link0").st_ino) 2024-09-13T18:28:51.519 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:28:51.588 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627778 2024-09-13T18:28:51.778 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:28:51.778 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:28:51.778 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-13T18:28:51.779 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:51.779 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/linkdir/link1").st_ino) 2024-09-13T18:28:51.779 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:28:51.892 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627778 2024-09-13T18:28:52.083 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:28:52.083 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:28:52.083 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-13T18:28:52.083 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:52.083 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/linkdir/link2").st_ino) 2024-09-13T18:28:52.083 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:28:52.150 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628281 2024-09-13T18:28:52.338 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:28:52.339 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:28:52.339 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-13T18:28:52.339 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:52.339 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/linkdir/link3").st_ino) 2024-09-13T18:28:52.339 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:28:52.411 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627776 2024-09-13T18:28:52.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:52.599 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch afterwards) 2024-09-13T18:28:52.658 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:28:52.659 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:28:52.659 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-13T18:28:52.659 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:28:52.659 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/afterwards").st_ino) 2024-09-13T18:28:52.659 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:28:52.729 INFO:teuthology.orchestra.run.smithi044.stdout:1099521627779 2024-09-13T18:28:52.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:52.920 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/subsubdir/subsubdirfile) 2024-09-13T18:28:52.933 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-09-13T18:28:52.925+0000 7f0bff3b5700 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x100000001fa 2024-09-13T18:28:52.937 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:28:52.937 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:28:52.956 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:28:52.977 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:28:52.977 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:28:52.977 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:28:52.985 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:28:53.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.141+0000 7f2387fff700 1 Processor -- start 2024-09-13T18:28:53.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.145+0000 7f2387fff700 1 -- start start 2024-09-13T18:28:53.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.145+0000 7f2387fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f238806fb30 0x7f23880adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:53.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.145+0000 7f2387fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f238806d150 0x7f238806d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:53.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.145+0000 7f2387fff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f238806a780 con 0x7f238806bb90 2024-09-13T18:28:53.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.145+0000 7f2387fff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f238806cd30 con 0x7f238806fb30 2024-09-13T18:28:53.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.145+0000 7f2387fff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2388159470 con 0x7f238806d150 2024-09-13T18:28:53.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.145+0000 7f2386ffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f238806fb30 0x7f23880adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:53.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.145+0000 7f237ffff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f238806bb90 0x7f23880cbf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46208/0 (socket says 172.21.15.44:46208) 2024-09-13T18:28:53.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.145+0000 7f237ffff700 1 -- 172.21.15.44:0/2970594419 learned_addr learned my addr 172.21.15.44:0/2970594419 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:53.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.145+0000 7f23877fe700 1 --2- 172.21.15.44:0/2970594419 >> v2:172.21.15.99:3300/0 conn(0x7f238806d150 0x7f238806d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:53.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.145+0000 7f2386ffd700 1 -- 172.21.15.44:0/2970594419 >> v2:172.21.15.99:3300/0 conn(0x7f238806d150 msgr2=0x7f238806d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:53.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.145+0000 7f2386ffd700 1 --2- 172.21.15.44:0/2970594419 >> v2:172.21.15.99:3300/0 conn(0x7f238806d150 0x7f238806d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:53.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.145+0000 7f23867fc700 1 -- 172.21.15.44:0/2970594419 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21479888 0 0) 0x7f238806a780 con 0x7f238806bb90 2024-09-13T18:28:53.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.145+0000 7f2386ffd700 1 -- 172.21.15.44:0/2970594419 >> v1:172.21.15.44:6789/0 conn(0x7f238806bb90 legacy=0x7f23880cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:53.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.145+0000 7f2386ffd700 1 -- 172.21.15.44:0/2970594419 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23880cc610 con 0x7f238806fb30 2024-09-13T18:28:53.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.145+0000 7f2386ffd700 1 --2- 172.21.15.44:0/2970594419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f238806fb30 0x7f23880adbd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f23880cb260 tx=0x7f2378009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2dcb053422fc3f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:53.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.145+0000 7f23867fc700 1 -- 172.21.15.44:0/2970594419 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2378011830 con 0x7f238806fb30 2024-09-13T18:28:53.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.145+0000 7f23867fc700 1 -- 172.21.15.44:0/2970594419 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2378011990 con 0x7f238806fb30 2024-09-13T18:28:53.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.145+0000 7f23867fc700 1 -- 172.21.15.44:0/2970594419 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2378011d20 con 0x7f238806fb30 2024-09-13T18:28:53.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.145+0000 7f2387fff700 1 -- 172.21.15.44:0/2970594419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f238806fb30 msgr2=0x7f23880adbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:53.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.145+0000 7f2387fff700 1 --2- 172.21.15.44:0/2970594419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f238806fb30 0x7f23880adbd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f23880cb260 tx=0x7f2378009b30 comp rx=0 tx=0).stop 2024-09-13T18:28:53.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.149+0000 7f2387fff700 1 -- 172.21.15.44:0/2970594419 shutdown_connections 2024-09-13T18:28:53.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.149+0000 7f2387fff700 1 --2- 172.21.15.44:0/2970594419 >> v2:172.21.15.99:3300/0 conn(0x7f238806d150 0x7f238806d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:53.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.149+0000 7f2387fff700 1 --2- 172.21.15.44:0/2970594419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f238806fb30 0x7f23880adbd0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:53.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.149+0000 7f2387fff700 1 -- 172.21.15.44:0/2970594419 >> 172.21.15.44:0/2970594419 conn(0x7f23880b0f00 msgr2=0x7f23880b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:53.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.149+0000 7f2387fff700 1 -- 172.21.15.44:0/2970594419 shutdown_connections 2024-09-13T18:28:53.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.149+0000 7f2387fff700 1 -- 172.21.15.44:0/2970594419 wait complete. 2024-09-13T18:28:53.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.149+0000 7f2387fff700 1 Processor -- start 2024-09-13T18:28:53.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.149+0000 7f2387fff700 1 -- start start 2024-09-13T18:28:53.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.153+0000 7f2387fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f238806bb90 0x7f2388144e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:53.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.153+0000 7f2387fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f238806d150 0x7f23880afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:53.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.153+0000 7f2387fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f238806fb30 0x7f238814e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:53.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.153+0000 7f2387fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23880ad2c0 con 0x7f238806bb90 2024-09-13T18:28:53.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.153+0000 7f2387fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2388145340 con 0x7f238806fb30 2024-09-13T18:28:53.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.153+0000 7f2387fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23880ac6b0 con 0x7f238806d150 2024-09-13T18:28:53.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.153+0000 7f2386ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f238806bb90 0x7f2388144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:53.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.153+0000 7f2386ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f238806bb90 0x7f2388144e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37144/0 (socket says 172.21.15.44:37144) 2024-09-13T18:28:53.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.153+0000 7f2386ffd700 1 -- 172.21.15.44:0/1600267675 learned_addr learned my addr 172.21.15.44:0/1600267675 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:53.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.153+0000 7f237ffff700 1 --2- 172.21.15.44:0/1600267675 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f238806d150 0x7f23880afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:53.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.153+0000 7f23877fe700 1 --2- 172.21.15.44:0/1600267675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f238806fb30 0x7f238814e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:53.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.153+0000 7f2386ffd700 1 -- 172.21.15.44:0/1600267675 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f238806d150 msgr2=0x7f23880afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:53.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.153+0000 7f2386ffd700 1 --2- 172.21.15.44:0/1600267675 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f238806d150 0x7f23880afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:53.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.153+0000 7f2386ffd700 1 -- 172.21.15.44:0/1600267675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f238806fb30 msgr2=0x7f238814e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:53.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.153+0000 7f2386ffd700 1 --2- 172.21.15.44:0/1600267675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f238806fb30 0x7f238814e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:53.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.153+0000 7f2386ffd700 1 -- 172.21.15.44:0/1600267675 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23780094b0 con 0x7f238806bb90 2024-09-13T18:28:53.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.153+0000 7f2386ffd700 1 --2- 172.21.15.44:0/1600267675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f238806bb90 0x7f2388144e00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2378000c00 tx=0x7f2378004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:53.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.153+0000 7f237f7fe700 1 -- 172.21.15.44:0/1600267675 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23780038c0 con 0x7f238806bb90 2024-09-13T18:28:53.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.153+0000 7f237f7fe700 1 -- 172.21.15.44:0/1600267675 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237801e070 con 0x7f238806bb90 2024-09-13T18:28:53.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.153+0000 7f2387fff700 1 -- 172.21.15.44:0/1600267675 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23880ac990 con 0x7f238806bb90 2024-09-13T18:28:53.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.153+0000 7f237f7fe700 1 -- 172.21.15.44:0/1600267675 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2378003c60 con 0x7f238806bb90 2024-09-13T18:28:53.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.153+0000 7f2387fff700 1 -- 172.21.15.44:0/1600267675 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23880acf50 con 0x7f238806bb90 2024-09-13T18:28:53.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.157+0000 7f2387fff700 1 -- 172.21.15.44:0/1600267675 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23880ad430 con 0x7f238806bb90 2024-09-13T18:28:53.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.157+0000 7f237f7fe700 1 -- 172.21.15.44:0/1600267675 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2378025480 con 0x7f238806bb90 2024-09-13T18:28:53.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.157+0000 7f237f7fe700 1 --2- 172.21.15.44:0/1600267675 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2368066760 0x7f2368068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:53.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.157+0000 7f237f7fe700 1 -- 172.21.15.44:0/1600267675 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2378020070 con 0x7f238806bb90 2024-09-13T18:28:53.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.157+0000 7f237ffff700 1 --2- 172.21.15.44:0/1600267675 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2368066760 0x7f2368068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:53.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.157+0000 7f237ffff700 1 --2- 172.21.15.44:0/1600267675 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2368066760 0x7f2368068c20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f23881f35c0 tx=0x7f2370007e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:53.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.165+0000 7f237f7fe700 1 -- 172.21.15.44:0/1600267675 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2378052b20 con 0x7f238806bb90 2024-09-13T18:28:53.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.337+0000 7f2387fff700 1 -- 172.21.15.44:0/1600267675 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2388066f10 con 0x7f238806bb90 2024-09-13T18:28:53.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.341+0000 7f237f7fe700 1 -- 172.21.15.44:0/1600267675 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16636 (secure 0 0 0) 0x7f2378015090 con 0x7f238806bb90 2024-09-13T18:28:53.349 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:53.349 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":36,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:28:29.639664+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:28:02.951723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:28:04.057772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/939073284":"2024-09-14T18:28:29.639607+0000","172.21.15.44:6834/939073284":"2024-09-14T18:28:29.639607+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:28:53.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.345+0000 7f2387fff700 1 -- 172.21.15.44:0/1600267675 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2368066760 msgr2=0x7f2368068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:53.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.345+0000 7f2387fff700 1 --2- 172.21.15.44:0/1600267675 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2368066760 0x7f2368068c20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f23881f35c0 tx=0x7f2370007e00 comp rx=0 tx=0).stop 2024-09-13T18:28:53.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.345+0000 7f2387fff700 1 -- 172.21.15.44:0/1600267675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f238806bb90 msgr2=0x7f2388144e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:53.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.345+0000 7f2387fff700 1 --2- 172.21.15.44:0/1600267675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f238806bb90 0x7f2388144e00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2378000c00 tx=0x7f2378004770 comp rx=0 tx=0).stop 2024-09-13T18:28:53.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.345+0000 7f2387fff700 1 -- 172.21.15.44:0/1600267675 shutdown_connections 2024-09-13T18:28:53.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.345+0000 7f2387fff700 1 --2- 172.21.15.44:0/1600267675 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2368066760 0x7f2368068c20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:53.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.345+0000 7f2387fff700 1 --2- 172.21.15.44:0/1600267675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f238806fb30 0x7f238814e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:53.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.345+0000 7f2387fff700 1 --2- 172.21.15.44:0/1600267675 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f238806d150 0x7f23880afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:53.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.345+0000 7f2387fff700 1 --2- 172.21.15.44:0/1600267675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f238806bb90 0x7f2388144e00 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:53.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.345+0000 7f2387fff700 1 -- 172.21.15.44:0/1600267675 >> 172.21.15.44:0/1600267675 conn(0x7f23880b0f00 msgr2=0x7f238814f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:53.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.345+0000 7f2387fff700 1 -- 172.21.15.44:0/1600267675 shutdown_connections 2024-09-13T18:28:53.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.345+0000 7f2387fff700 1 -- 172.21.15.44:0/1600267675 wait complete. 2024-09-13T18:28:53.364 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:28:02.951723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:28:04.057772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:28:53.364 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:28:53.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.481+0000 7f379164e700 1 Processor -- start 2024-09-13T18:28:53.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.481+0000 7f379164e700 1 -- start start 2024-09-13T18:28:53.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.481+0000 7f379164e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f378c15cda0 0x7f378c06b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:53.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.481+0000 7f379164e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f378c0ceb70 0x7f378c0b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:53.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.481+0000 7f379164e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f378c0b8430 con 0x7f378c06a520 2024-09-13T18:28:53.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.481+0000 7f379164e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f378c06be40 con 0x7f378c0ceb70 2024-09-13T18:28:53.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.481+0000 7f379164e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378c0cf350 con 0x7f378c15cda0 2024-09-13T18:28:53.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.481+0000 7f3790e4d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f378c06a520 0x7f378c0d1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46212/0 (socket says 172.21.15.44:46212) 2024-09-13T18:28:53.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.481+0000 7f3790e4d700 1 -- 172.21.15.44:0/80644630 learned_addr learned my addr 172.21.15.44:0/80644630 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:53.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.481+0000 7f378bfff700 1 --2- 172.21.15.44:0/80644630 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f378c15cda0 0x7f378c06b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:53.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.481+0000 7f37837fe700 1 --2- 172.21.15.44:0/80644630 >> v2:172.21.15.99:3300/0 conn(0x7f378c0ceb70 0x7f378c0b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:53.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.481+0000 7f378b7fe700 1 -- 172.21.15.44:0/80644630 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745061505 0 0) 0x7f378c0b8430 con 0x7f378c06a520 2024-09-13T18:28:53.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.481+0000 7f378b7fe700 1 -- 172.21.15.44:0/80644630 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37780035d0 con 0x7f378c06a520 2024-09-13T18:28:53.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.481+0000 7f378bfff700 1 -- 172.21.15.44:0/80644630 >> v2:172.21.15.99:3300/0 conn(0x7f378c0ceb70 msgr2=0x7f378c0b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:53.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.481+0000 7f378bfff700 1 --2- 172.21.15.44:0/80644630 >> v2:172.21.15.99:3300/0 conn(0x7f378c0ceb70 0x7f378c0b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:53.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.481+0000 7f378bfff700 1 -- 172.21.15.44:0/80644630 >> v1:172.21.15.44:6789/0 conn(0x7f378c06a520 legacy=0x7f378c0d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:53.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.481+0000 7f378b7fe700 1 -- 172.21.15.44:0/80644630 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1959556198 0 0) 0x7f37780035d0 con 0x7f378c06a520 2024-09-13T18:28:53.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.481+0000 7f378bfff700 1 -- 172.21.15.44:0/80644630 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378c0d0880 con 0x7f378c15cda0 2024-09-13T18:28:53.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.481+0000 7f378bfff700 1 --2- 172.21.15.44:0/80644630 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f378c15cda0 0x7f378c06b900 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f377c009850 tx=0x7f377c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41a70af7f4e71bfb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:53.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.485+0000 7f378b7fe700 1 -- 172.21.15.44:0/80644630 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37840019f0 con 0x7f378c15cda0 2024-09-13T18:28:53.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.485+0000 7f378b7fe700 1 -- 172.21.15.44:0/80644630 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c004030 con 0x7f378c15cda0 2024-09-13T18:28:53.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.485+0000 7f378b7fe700 1 -- 172.21.15.44:0/80644630 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c0043a0 con 0x7f378c15cda0 2024-09-13T18:28:53.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.485+0000 7f379164e700 1 -- 172.21.15.44:0/80644630 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f378c15cda0 msgr2=0x7f378c06b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:53.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.485+0000 7f379164e700 1 --2- 172.21.15.44:0/80644630 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f378c15cda0 0x7f378c06b900 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f377c009850 tx=0x7f377c009b60 comp rx=0 tx=0).stop 2024-09-13T18:28:53.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.485+0000 7f379164e700 1 -- 172.21.15.44:0/80644630 shutdown_connections 2024-09-13T18:28:53.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.485+0000 7f379164e700 1 --2- 172.21.15.44:0/80644630 >> v2:172.21.15.99:3300/0 conn(0x7f378c0ceb70 0x7f378c0b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:53.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.485+0000 7f379164e700 1 --2- 172.21.15.44:0/80644630 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f378c15cda0 0x7f378c06b900 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:53.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.485+0000 7f379164e700 1 -- 172.21.15.44:0/80644630 >> 172.21.15.44:0/80644630 conn(0x7f378c0d2cb0 msgr2=0x7f378c0d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:53.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.485+0000 7f379164e700 1 -- 172.21.15.44:0/80644630 shutdown_connections 2024-09-13T18:28:53.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.485+0000 7f379164e700 1 -- 172.21.15.44:0/80644630 wait complete. 2024-09-13T18:28:53.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.485+0000 7f379164e700 1 Processor -- start 2024-09-13T18:28:53.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.489+0000 7f379164e700 1 -- start start 2024-09-13T18:28:53.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.489+0000 7f379164e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f378c06a520 0x7f378c1491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:53.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.489+0000 7f379164e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f378c0ceb70 0x7f378c0c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:53.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.489+0000 7f379164e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f378c15cda0 0x7f378c15f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:53.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.489+0000 7f379164e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378c0c9930 con 0x7f378c0ceb70 2024-09-13T18:28:53.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.489+0000 7f379164e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378c0c9d80 con 0x7f378c06a520 2024-09-13T18:28:53.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.489+0000 7f379164e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378c0ca060 con 0x7f378c15cda0 2024-09-13T18:28:53.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.489+0000 7f37837fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f378c0ceb70 0x7f378c0c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:53.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.489+0000 7f37837fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f378c0ceb70 0x7f378c0c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37150/0 (socket says 172.21.15.44:37150) 2024-09-13T18:28:53.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.489+0000 7f378bfff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f378c06a520 0x7f378c1491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:53.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.489+0000 7f37837fe700 1 -- 172.21.15.44:0/2315837826 learned_addr learned my addr 172.21.15.44:0/2315837826 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:53.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.489+0000 7f3790e4d700 1 --2- 172.21.15.44:0/2315837826 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f378c15cda0 0x7f378c15f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:53.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.489+0000 7f37837fe700 1 -- 172.21.15.44:0/2315837826 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f378c15cda0 msgr2=0x7f378c15f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:53.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.489+0000 7f37837fe700 1 --2- 172.21.15.44:0/2315837826 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f378c15cda0 0x7f378c15f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:53.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.489+0000 7f37837fe700 1 -- 172.21.15.44:0/2315837826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f378c06a520 msgr2=0x7f378c1491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:53.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.489+0000 7f37837fe700 1 --2- 172.21.15.44:0/2315837826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f378c06a520 0x7f378c1491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:53.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.489+0000 7f37837fe700 1 -- 172.21.15.44:0/2315837826 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c0094b0 con 0x7f378c0ceb70 2024-09-13T18:28:53.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.489+0000 7f37837fe700 1 --2- 172.21.15.44:0/2315837826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f378c0ceb70 0x7f378c0c8f00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f377400e9a0 tx=0x7f377400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:53.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.489+0000 7f37897fa700 1 -- 172.21.15.44:0/2315837826 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774009720 con 0x7f378c0ceb70 2024-09-13T18:28:53.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.489+0000 7f37897fa700 1 -- 172.21.15.44:0/2315837826 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377400c690 con 0x7f378c0ceb70 2024-09-13T18:28:53.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.489+0000 7f379164e700 1 -- 172.21.15.44:0/2315837826 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f378c0ca340 con 0x7f378c0ceb70 2024-09-13T18:28:53.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.489+0000 7f37897fa700 1 -- 172.21.15.44:0/2315837826 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377400ca20 con 0x7f378c0ceb70 2024-09-13T18:28:53.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.489+0000 7f379164e700 1 -- 172.21.15.44:0/2315837826 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378c14f570 con 0x7f378c0ceb70 2024-09-13T18:28:53.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.493+0000 7f379164e700 1 -- 172.21.15.44:0/2315837826 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f378c066720 con 0x7f378c0ceb70 2024-09-13T18:28:53.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.493+0000 7f37897fa700 1 -- 172.21.15.44:0/2315837826 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f377400cb80 con 0x7f378c0ceb70 2024-09-13T18:28:53.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.493+0000 7f37897fa700 1 --2- 172.21.15.44:0/2315837826 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f376c066730 0x7f376c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:53.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.493+0000 7f37897fa700 1 -- 172.21.15.44:0/2315837826 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f37740841c0 con 0x7f378c0ceb70 2024-09-13T18:28:53.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.493+0000 7f378bfff700 1 --2- 172.21.15.44:0/2315837826 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f376c066730 0x7f376c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:53.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.493+0000 7f378bfff700 1 --2- 172.21.15.44:0/2315837826 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f376c066730 0x7f376c068bf0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f377c0090b0 tx=0x7f377c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:53.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.505+0000 7f37897fa700 1 -- 172.21.15.44:0/2315837826 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f37740514c0 con 0x7f378c0ceb70 2024-09-13T18:28:53.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.677+0000 7f379164e700 1 -- 172.21.15.44:0/2315837826 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f378c06b900 con 0x7f378c0ceb70 2024-09-13T18:28:53.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.677+0000 7f37897fa700 1 -- 172.21.15.44:0/2315837826 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3774054ae0 con 0x7f378c0ceb70 2024-09-13T18:28:53.685 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:28:53.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.681+0000 7f379164e700 1 -- 172.21.15.44:0/2315837826 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f376c066730 msgr2=0x7f376c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:53.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.681+0000 7f379164e700 1 --2- 172.21.15.44:0/2315837826 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f376c066730 0x7f376c068bf0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f377c0090b0 tx=0x7f377c008030 comp rx=0 tx=0).stop 2024-09-13T18:28:53.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.681+0000 7f379164e700 1 -- 172.21.15.44:0/2315837826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f378c0ceb70 msgr2=0x7f378c0c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:53.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.681+0000 7f379164e700 1 --2- 172.21.15.44:0/2315837826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f378c0ceb70 0x7f378c0c8f00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f377400e9a0 tx=0x7f377400ecb0 comp rx=0 tx=0).stop 2024-09-13T18:28:53.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.681+0000 7f379164e700 1 -- 172.21.15.44:0/2315837826 shutdown_connections 2024-09-13T18:28:53.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.681+0000 7f379164e700 1 --2- 172.21.15.44:0/2315837826 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f376c066730 0x7f376c068bf0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:53.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.681+0000 7f379164e700 1 --2- 172.21.15.44:0/2315837826 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f378c15cda0 0x7f378c15f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:53.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.681+0000 7f379164e700 1 --2- 172.21.15.44:0/2315837826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f378c0ceb70 0x7f378c0c8f00 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:53.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.681+0000 7f379164e700 1 --2- 172.21.15.44:0/2315837826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f378c06a520 0x7f378c1491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:53.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.681+0000 7f379164e700 1 -- 172.21.15.44:0/2315837826 >> 172.21.15.44:0/2315837826 conn(0x7f378c0d2cb0 msgr2=0x7f378c15b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:53.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.681+0000 7f379164e700 1 -- 172.21.15.44:0/2315837826 shutdown_connections 2024-09-13T18:28:53.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.681+0000 7f379164e700 1 -- 172.21.15.44:0/2315837826 wait complete. 2024-09-13T18:28:53.700 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:28:53.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.813+0000 7f867035c700 1 Processor -- start 2024-09-13T18:28:53.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.813+0000 7f867035c700 1 -- start start 2024-09-13T18:28:53.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f867035c700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f86680cb450 0x7f86680cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:53.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f867035c700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86680ce770 con 0x7f8668158f50 2024-09-13T18:28:53.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f867035c700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86680cbda0 con 0x7f86680b4850 2024-09-13T18:28:53.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f867035c700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866806aa20 con 0x7f86680cb450 2024-09-13T18:28:53.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f866e0f8700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8668158f50 0x7f866806a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46222/0 (socket says 172.21.15.44:46222) 2024-09-13T18:28:53.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f866e0f8700 1 -- 172.21.15.44:0/1566112196 learned_addr learned my addr 172.21.15.44:0/1566112196 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:53.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f866e8f9700 1 --2- 172.21.15.44:0/1566112196 >> v2:172.21.15.99:3300/0 conn(0x7f86680cb450 0x7f86680cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:53.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f866d0f6700 1 -- 172.21.15.44:0/1566112196 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865396115 0 0) 0x7f86680ce770 con 0x7f8668158f50 2024-09-13T18:28:53.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f866d0f6700 1 -- 172.21.15.44:0/1566112196 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86540035d0 con 0x7f8668158f50 2024-09-13T18:28:53.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f866d0f6700 1 -- 172.21.15.44:0/1566112196 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2037685792 0 0) 0x7f86680cbda0 con 0x7f86680b4850 2024-09-13T18:28:53.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f866d0f6700 1 -- 172.21.15.44:0/1566112196 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86680ce770 con 0x7f86680b4850 2024-09-13T18:28:53.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f866d0f6700 1 -- 172.21.15.44:0/1566112196 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 224688789 0 0) 0x7f86540035d0 con 0x7f8668158f50 2024-09-13T18:28:53.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f866e8f9700 1 -- 172.21.15.44:0/1566112196 >> v1:172.21.15.99:6789/0 conn(0x7f86680b4850 legacy=0x7f866806d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:53.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f866e8f9700 1 -- 172.21.15.44:0/1566112196 >> v1:172.21.15.44:6789/0 conn(0x7f8668158f50 legacy=0x7f866806a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:53.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f866e8f9700 1 -- 172.21.15.44:0/1566112196 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86680ce1b0 con 0x7f86680cb450 2024-09-13T18:28:53.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f866e8f9700 1 --2- 172.21.15.44:0/1566112196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86680cb450 0x7f86680cb860 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8660009850 tx=0x7f8660009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6ce1dafb0c81b85 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:53.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f866d0f6700 1 -- 172.21.15.44:0/1566112196 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8658001670 con 0x7f86680cb450 2024-09-13T18:28:53.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f866d0f6700 1 -- 172.21.15.44:0/1566112196 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8660004030 con 0x7f86680cb450 2024-09-13T18:28:53.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f866d0f6700 1 -- 172.21.15.44:0/1566112196 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86600043a0 con 0x7f86680cb450 2024-09-13T18:28:53.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f867035c700 1 -- 172.21.15.44:0/1566112196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86680cb450 msgr2=0x7f86680cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:53.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f867035c700 1 --2- 172.21.15.44:0/1566112196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86680cb450 0x7f86680cb860 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8660009850 tx=0x7f8660009b60 comp rx=0 tx=0).stop 2024-09-13T18:28:53.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f867035c700 1 -- 172.21.15.44:0/1566112196 shutdown_connections 2024-09-13T18:28:53.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f867035c700 1 --2- 172.21.15.44:0/1566112196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86680cb450 0x7f86680cb860 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:53.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f867035c700 1 -- 172.21.15.44:0/1566112196 >> 172.21.15.44:0/1566112196 conn(0x7f86680af620 msgr2=0x7f86680afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:53.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f867035c700 1 -- 172.21.15.44:0/1566112196 shutdown_connections 2024-09-13T18:28:53.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.817+0000 7f867035c700 1 -- 172.21.15.44:0/1566112196 wait complete. 2024-09-13T18:28:53.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.821+0000 7f867035c700 1 Processor -- start 2024-09-13T18:28:53.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.821+0000 7f867035c700 1 -- start start 2024-09-13T18:28:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.821+0000 7f867035c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86680b4850 0x7f866815bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.821+0000 7f867035c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f86680cb450 0x7f866815cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.821+0000 7f867035c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8668158f50 0x7f86680b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.821+0000 7f867035c700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86680adcf0 con 0x7f8668158f50 2024-09-13T18:28:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.821+0000 7f867035c700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866814aaa0 con 0x7f86680b4850 2024-09-13T18:28:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.821+0000 7f867035c700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866815c270 con 0x7f86680cb450 2024-09-13T18:28:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.821+0000 7f866e8f9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8668158f50 0x7f86680b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.821+0000 7f866e8f9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8668158f50 0x7f86680b1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37156/0 (socket says 172.21.15.44:37156) 2024-09-13T18:28:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.821+0000 7f866e8f9700 1 -- 172.21.15.44:0/2748749194 learned_addr learned my addr 172.21.15.44:0/2748749194 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:53.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.821+0000 7f866d8f7700 1 --2- 172.21.15.44:0/2748749194 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f86680cb450 0x7f866815cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:53.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.821+0000 7f866e0f8700 1 --2- 172.21.15.44:0/2748749194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86680b4850 0x7f866815bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:53.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.821+0000 7f866e8f9700 1 -- 172.21.15.44:0/2748749194 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f86680cb450 msgr2=0x7f866815cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:53.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.821+0000 7f866e8f9700 1 --2- 172.21.15.44:0/2748749194 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f86680cb450 0x7f866815cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:53.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.821+0000 7f866e8f9700 1 -- 172.21.15.44:0/2748749194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86680b4850 msgr2=0x7f866815bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:53.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.821+0000 7f866e8f9700 1 --2- 172.21.15.44:0/2748749194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86680b4850 0x7f866815bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:53.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.821+0000 7f866e8f9700 1 -- 172.21.15.44:0/2748749194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86600094b0 con 0x7f8668158f50 2024-09-13T18:28:53.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.821+0000 7f866e8f9700 1 --2- 172.21.15.44:0/2748749194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8668158f50 0x7f86680b1a70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f86680b16b0 tx=0x7f8660004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:53.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.825+0000 7f865effd700 1 -- 172.21.15.44:0/2748749194 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8660003c50 con 0x7f8668158f50 2024-09-13T18:28:53.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.825+0000 7f865effd700 1 -- 172.21.15.44:0/2748749194 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866001f070 con 0x7f8668158f50 2024-09-13T18:28:53.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.825+0000 7f867035c700 1 -- 172.21.15.44:0/2748749194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8668147440 con 0x7f8668158f50 2024-09-13T18:28:53.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.825+0000 7f865effd700 1 -- 172.21.15.44:0/2748749194 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8660011630 con 0x7f8668158f50 2024-09-13T18:28:53.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.825+0000 7f867035c700 1 -- 172.21.15.44:0/2748749194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866814afd0 con 0x7f8668158f50 2024-09-13T18:28:53.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.825+0000 7f867035c700 1 -- 172.21.15.44:0/2748749194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866815d7e0 con 0x7f8668158f50 2024-09-13T18:28:53.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.825+0000 7f865effd700 1 -- 172.21.15.44:0/2748749194 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8660011790 con 0x7f8668158f50 2024-09-13T18:28:53.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.825+0000 7f865effd700 1 --2- 172.21.15.44:0/2748749194 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f864c066730 0x7f864c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:53.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.829+0000 7f865effd700 1 -- 172.21.15.44:0/2748749194 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8660021070 con 0x7f8668158f50 2024-09-13T18:28:53.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.829+0000 7f866e0f8700 1 --2- 172.21.15.44:0/2748749194 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f864c066730 0x7f864c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:53.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.829+0000 7f866e0f8700 1 --2- 172.21.15.44:0/2748749194 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f864c066730 0x7f864c068bf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8658000fd0 tx=0x7f8658000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:53.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:53.837+0000 7f865effd700 1 -- 172.21.15.44:0/2748749194 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8660052d30 con 0x7f8668158f50 2024-09-13T18:28:54.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.005+0000 7f867035c700 1 -- 172.21.15.44:0/2748749194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8668066550 con 0x7f8668158f50 2024-09-13T18:28:54.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.005+0000 7f865effd700 1 -- 172.21.15.44:0/2748749194 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f866002b0a0 con 0x7f8668158f50 2024-09-13T18:28:54.012 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:28:54.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.005+0000 7f867035c700 1 -- 172.21.15.44:0/2748749194 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f864c066730 msgr2=0x7f864c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:54.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.005+0000 7f867035c700 1 --2- 172.21.15.44:0/2748749194 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f864c066730 0x7f864c068bf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8658000fd0 tx=0x7f8658000ed0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.005+0000 7f867035c700 1 -- 172.21.15.44:0/2748749194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8668158f50 msgr2=0x7f86680b1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:54.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.005+0000 7f867035c700 1 --2- 172.21.15.44:0/2748749194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8668158f50 0x7f86680b1a70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f86680b16b0 tx=0x7f8660004770 comp rx=0 tx=0).stop 2024-09-13T18:28:54.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.005+0000 7f867035c700 1 -- 172.21.15.44:0/2748749194 shutdown_connections 2024-09-13T18:28:54.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.005+0000 7f867035c700 1 --2- 172.21.15.44:0/2748749194 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f864c066730 0x7f864c068bf0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.005+0000 7f867035c700 1 --2- 172.21.15.44:0/2748749194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8668158f50 0x7f86680b1a70 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.005+0000 7f867035c700 1 --2- 172.21.15.44:0/2748749194 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f86680cb450 0x7f866815cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.005+0000 7f867035c700 1 --2- 172.21.15.44:0/2748749194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86680b4850 0x7f866815bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.005+0000 7f867035c700 1 -- 172.21.15.44:0/2748749194 >> 172.21.15.44:0/2748749194 conn(0x7f86680af620 msgr2=0x7f8668158280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:54.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.009+0000 7f867035c700 1 -- 172.21.15.44:0/2748749194 shutdown_connections 2024-09-13T18:28:54.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.009+0000 7f867035c700 1 -- 172.21.15.44:0/2748749194 wait complete. 2024-09-13T18:28:54.027 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:28:54.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.145+0000 7fcdbf59e700 1 Processor -- start 2024-09-13T18:28:54.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.145+0000 7fcdbf59e700 1 -- start start 2024-09-13T18:28:54.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.145+0000 7fcdbf59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcdc0144340 0x7fcdc006d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:54.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.145+0000 7fcdbf59e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcdc006bdb0 0x7fcdc00cd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:54.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.145+0000 7fcdbf59e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcdc015f140 0x7fcdc00cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:54.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.145+0000 7fcdbf59e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc0144720 con 0x7fcdc015f140 2024-09-13T18:28:54.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.145+0000 7fcdbf59e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc006dd40 con 0x7fcdc006bdb0 2024-09-13T18:28:54.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.145+0000 7fcdbf59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc006da60 con 0x7fcdc0144340 2024-09-13T18:28:54.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.145+0000 7fcdbed9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcdc015f140 0x7fcdc00cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:54.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.145+0000 7fcdbed9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcdc015f140 0x7fcdc00cdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37160/0 (socket says 172.21.15.44:37160) 2024-09-13T18:28:54.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.145+0000 7fcdbed9d700 1 -- 172.21.15.44:0/2505133989 learned_addr learned my addr 172.21.15.44:0/2505133989 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:54.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.145+0000 7fcdbdd9b700 1 --2- 172.21.15.44:0/2505133989 >> v2:172.21.15.99:3300/0 conn(0x7fcdc006bdb0 0x7fcdc00cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:54.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.145+0000 7fcdbe59c700 1 --2- 172.21.15.44:0/2505133989 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcdc0144340 0x7fcdc006d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:54.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.145+0000 7fcdbed9d700 1 -- 172.21.15.44:0/2505133989 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcdc0144340 msgr2=0x7fcdc006d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:54.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.145+0000 7fcdbed9d700 1 --2- 172.21.15.44:0/2505133989 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcdc0144340 0x7fcdc006d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.145+0000 7fcdbed9d700 1 -- 172.21.15.44:0/2505133989 >> v2:172.21.15.99:3300/0 conn(0x7fcdc006bdb0 msgr2=0x7fcdc00cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:54.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.145+0000 7fcdbed9d700 1 --2- 172.21.15.44:0/2505133989 >> v2:172.21.15.99:3300/0 conn(0x7fcdc006bdb0 0x7fcdc00cd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.145+0000 7fcdbed9d700 1 -- 172.21.15.44:0/2505133989 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc015e660 con 0x7fcdc015f140 2024-09-13T18:28:54.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.145+0000 7fcdbdd9b700 1 --2- 172.21.15.44:0/2505133989 >> v2:172.21.15.99:3300/0 conn(0x7fcdc006bdb0 0x7fcdc00cd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:54.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.145+0000 7fcdbed9d700 1 --2- 172.21.15.44:0/2505133989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdc015f140 0x7fcdc00cdac0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00ce100 tx=0x7fcdb8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aeabff18814bfa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:54.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.149+0000 7fcdbd59a700 1 -- 172.21.15.44:0/2505133989 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8011830 con 0x7fcdc015f140 2024-09-13T18:28:54.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.149+0000 7fcdbd59a700 1 -- 172.21.15.44:0/2505133989 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb8011990 con 0x7fcdc015f140 2024-09-13T18:28:54.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.149+0000 7fcdbd59a700 1 -- 172.21.15.44:0/2505133989 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8011d20 con 0x7fcdc015f140 2024-09-13T18:28:54.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.149+0000 7fcdbf59e700 1 -- 172.21.15.44:0/2505133989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdc015f140 msgr2=0x7fcdc00cdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:54.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.149+0000 7fcdbf59e700 1 --2- 172.21.15.44:0/2505133989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdc015f140 0x7fcdc00cdac0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00ce100 tx=0x7fcdb8009bf0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.149+0000 7fcdbf59e700 1 -- 172.21.15.44:0/2505133989 shutdown_connections 2024-09-13T18:28:54.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.149+0000 7fcdbf59e700 1 --2- 172.21.15.44:0/2505133989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdc015f140 0x7fcdc00cdac0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.149+0000 7fcdbf59e700 1 --2- 172.21.15.44:0/2505133989 >> v2:172.21.15.99:3300/0 conn(0x7fcdc006bdb0 0x7fcdc00cd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.149+0000 7fcdbf59e700 1 --2- 172.21.15.44:0/2505133989 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcdc0144340 0x7fcdc006d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.149+0000 7fcdbf59e700 1 -- 172.21.15.44:0/2505133989 >> 172.21.15.44:0/2505133989 conn(0x7fcdc00b0e10 msgr2=0x7fcdc00b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:54.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.149+0000 7fcdbf59e700 1 -- 172.21.15.44:0/2505133989 shutdown_connections 2024-09-13T18:28:54.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.149+0000 7fcdbf59e700 1 -- 172.21.15.44:0/2505133989 wait complete. 2024-09-13T18:28:54.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.149+0000 7fcdbf59e700 1 Processor -- start 2024-09-13T18:28:54.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.149+0000 7fcdbf59e700 1 -- start start 2024-09-13T18:28:54.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.149+0000 7fcdbf59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcdc006bdb0 0x7fcdc00c3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:54.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.149+0000 7fcdbf59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcdc0144340 0x7fcdc00acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:54.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.149+0000 7fcdbf59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdc015f140 0x7fcdc00cca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:54.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.149+0000 7fcdbf59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc01f5a00 con 0x7fcdc015f140 2024-09-13T18:28:54.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.153+0000 7fcdbf59e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc01f5ca0 con 0x7fcdc0144340 2024-09-13T18:28:54.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.153+0000 7fcdbf59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc01f5f80 con 0x7fcdc006bdb0 2024-09-13T18:28:54.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.153+0000 7fcdbed9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdc015f140 0x7fcdc00cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:54.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.153+0000 7fcdbed9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdc015f140 0x7fcdc00cca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37164/0 (socket says 172.21.15.44:37164) 2024-09-13T18:28:54.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.153+0000 7fcdbed9d700 1 -- 172.21.15.44:0/2886262268 learned_addr learned my addr 172.21.15.44:0/2886262268 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:54.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.153+0000 7fcdbdd9b700 1 --2- 172.21.15.44:0/2886262268 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcdc0144340 0x7fcdc00acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:54.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.153+0000 7fcdbe59c700 1 --2- 172.21.15.44:0/2886262268 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcdc006bdb0 0x7fcdc00c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:54.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.153+0000 7fcdbdd9b700 1 -- 172.21.15.44:0/2886262268 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcdc006bdb0 msgr2=0x7fcdc00c3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:54.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.153+0000 7fcdbdd9b700 1 --2- 172.21.15.44:0/2886262268 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcdc006bdb0 0x7fcdc00c3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.153+0000 7fcdbdd9b700 1 -- 172.21.15.44:0/2886262268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdc015f140 msgr2=0x7fcdc00cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:54.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.153+0000 7fcdbdd9b700 1 --2- 172.21.15.44:0/2886262268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdc015f140 0x7fcdc00cca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.153+0000 7fcdbdd9b700 1 -- 172.21.15.44:0/2886262268 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb00094b0 con 0x7fcdc0144340 2024-09-13T18:28:54.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.153+0000 7fcdbdd9b700 1 --2- 172.21.15.44:0/2886262268 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcdc0144340 0x7fcdc00acb30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcdc015e490 tx=0x7fcdb000eb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:54.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.153+0000 7fcdb6ffd700 1 -- 172.21.15.44:0/2886262268 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0004240 con 0x7fcdc0144340 2024-09-13T18:28:54.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.153+0000 7fcdb6ffd700 1 -- 172.21.15.44:0/2886262268 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb00043a0 con 0x7fcdc0144340 2024-09-13T18:28:54.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.153+0000 7fcdbf59e700 1 -- 172.21.15.44:0/2886262268 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb8009570 con 0x7fcdc0144340 2024-09-13T18:28:54.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.153+0000 7fcdb6ffd700 1 -- 172.21.15.44:0/2886262268 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb00036c0 con 0x7fcdc0144340 2024-09-13T18:28:54.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.153+0000 7fcdbf59e700 1 -- 172.21.15.44:0/2886262268 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc01f6540 con 0x7fcdc0144340 2024-09-13T18:28:54.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.153+0000 7fcdbf59e700 1 -- 172.21.15.44:0/2886262268 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc006d480 con 0x7fcdc0144340 2024-09-13T18:28:54.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.153+0000 7fcdb6ffd700 1 -- 172.21.15.44:0/2886262268 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcdb0005a40 con 0x7fcdc0144340 2024-09-13T18:28:54.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.157+0000 7fcdb6ffd700 1 --2- 172.21.15.44:0/2886262268 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcda0066760 0x7fcda0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:54.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.157+0000 7fcdb6ffd700 1 -- 172.21.15.44:0/2886262268 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fcdb0084400 con 0x7fcdc0144340 2024-09-13T18:28:54.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.157+0000 7fcdbe59c700 1 --2- 172.21.15.44:0/2886262268 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcda0066760 0x7fcda0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:54.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.157+0000 7fcdbe59c700 1 --2- 172.21.15.44:0/2886262268 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcda0066760 0x7fcda0068c20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcda80113e0 tx=0x7fcda800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:54.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.165+0000 7fcdb6ffd700 1 -- 172.21.15.44:0/2886262268 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcdb00516f0 con 0x7fcdc0144340 2024-09-13T18:28:54.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.337+0000 7fcdbf59e700 1 -- 172.21.15.44:0/2886262268 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcdc00cadf0 con 0x7fcdc0144340 2024-09-13T18:28:54.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.337+0000 7fcdb6ffd700 1 -- 172.21.15.44:0/2886262268 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcdb0054d10 con 0x7fcdc0144340 2024-09-13T18:28:54.344 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:28:54.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.337+0000 7fcdbf59e700 1 -- 172.21.15.44:0/2886262268 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcda0066760 msgr2=0x7fcda0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:54.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.337+0000 7fcdbf59e700 1 --2- 172.21.15.44:0/2886262268 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcda0066760 0x7fcda0068c20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcda80113e0 tx=0x7fcda800b040 comp rx=0 tx=0).stop 2024-09-13T18:28:54.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.337+0000 7fcdbf59e700 1 -- 172.21.15.44:0/2886262268 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcdc0144340 msgr2=0x7fcdc00acb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:54.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.337+0000 7fcdbf59e700 1 --2- 172.21.15.44:0/2886262268 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcdc0144340 0x7fcdc00acb30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcdc015e490 tx=0x7fcdb000eb70 comp rx=0 tx=0).stop 2024-09-13T18:28:54.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.341+0000 7fcdbf59e700 1 -- 172.21.15.44:0/2886262268 shutdown_connections 2024-09-13T18:28:54.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.341+0000 7fcdbf59e700 1 --2- 172.21.15.44:0/2886262268 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcda0066760 0x7fcda0068c20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.341+0000 7fcdbf59e700 1 --2- 172.21.15.44:0/2886262268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdc015f140 0x7fcdc00cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.341+0000 7fcdbf59e700 1 --2- 172.21.15.44:0/2886262268 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcdc0144340 0x7fcdc00acb30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.341+0000 7fcdbf59e700 1 --2- 172.21.15.44:0/2886262268 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcdc006bdb0 0x7fcdc00c3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.341+0000 7fcdbf59e700 1 -- 172.21.15.44:0/2886262268 >> 172.21.15.44:0/2886262268 conn(0x7fcdc00b0e10 msgr2=0x7fcdc00af660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:54.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.341+0000 7fcdbf59e700 1 -- 172.21.15.44:0/2886262268 shutdown_connections 2024-09-13T18:28:54.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.341+0000 7fcdbf59e700 1 -- 172.21.15.44:0/2886262268 wait complete. 2024-09-13T18:28:54.360 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:28:54.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.481+0000 7f8193094700 1 Processor -- start 2024-09-13T18:28:54.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.481+0000 7f8193094700 1 -- start start 2024-09-13T18:28:54.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.481+0000 7f8193094700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f818c1573e0 0x7f818c070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:54.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.481+0000 7f8193094700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f818c15a630 0x7f818c06c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:54.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.481+0000 7f8193094700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818c071540 con 0x7f818c0710e0 2024-09-13T18:28:54.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.481+0000 7f8193094700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818c0cc1b0 con 0x7f818c1573e0 2024-09-13T18:28:54.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.481+0000 7f8193094700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818c15ac50 con 0x7f818c15a630 2024-09-13T18:28:54.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.481+0000 7f8191891700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f818c0710e0 0x7f818c159f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46236/0 (socket says 172.21.15.44:46236) 2024-09-13T18:28:54.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.481+0000 7f8191891700 1 -- 172.21.15.44:0/3038551827 learned_addr learned my addr 172.21.15.44:0/3038551827 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:54.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.481+0000 7f8192092700 1 --2- 172.21.15.44:0/3038551827 >> v2:172.21.15.44:3300/0 conn(0x7f818c1573e0 0x7f818c070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:54.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.481+0000 7f8192893700 1 --2- 172.21.15.44:0/3038551827 >> v2:172.21.15.99:3300/0 conn(0x7f818c15a630 0x7f818c06c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:54.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.481+0000 7f8192092700 1 -- 172.21.15.44:0/3038551827 >> v2:172.21.15.99:3300/0 conn(0x7f818c15a630 msgr2=0x7f818c06c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:54.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.481+0000 7f8192092700 1 --2- 172.21.15.44:0/3038551827 >> v2:172.21.15.99:3300/0 conn(0x7f818c15a630 0x7f818c06c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.481+0000 7f8192092700 1 -- 172.21.15.44:0/3038551827 >> v1:172.21.15.44:6789/0 conn(0x7f818c0710e0 legacy=0x7f818c159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:54.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.481+0000 7f8191090700 1 -- 172.21.15.44:0/3038551827 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721030029 0 0) 0x7f818c071540 con 0x7f818c0710e0 2024-09-13T18:28:54.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.481+0000 7f8192092700 1 -- 172.21.15.44:0/3038551827 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c0cb3f0 con 0x7f818c1573e0 2024-09-13T18:28:54.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.481+0000 7f8192092700 1 --2- 172.21.15.44:0/3038551827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f818c1573e0 0x7f818c070ba0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f818c06b960 tx=0x7f817c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90b2525113e6ce0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:54.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.481+0000 7f8191090700 1 -- 172.21.15.44:0/3038551827 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c011830 con 0x7f818c1573e0 2024-09-13T18:28:54.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.481+0000 7f8191090700 1 -- 172.21.15.44:0/3038551827 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817c011990 con 0x7f818c1573e0 2024-09-13T18:28:54.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.481+0000 7f8191090700 1 -- 172.21.15.44:0/3038551827 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c011d40 con 0x7f818c1573e0 2024-09-13T18:28:54.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.485+0000 7f8193094700 1 -- 172.21.15.44:0/3038551827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f818c1573e0 msgr2=0x7f818c070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:54.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.485+0000 7f8193094700 1 --2- 172.21.15.44:0/3038551827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f818c1573e0 0x7f818c070ba0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f818c06b960 tx=0x7f817c009b30 comp rx=0 tx=0).stop 2024-09-13T18:28:54.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.485+0000 7f8193094700 1 -- 172.21.15.44:0/3038551827 shutdown_connections 2024-09-13T18:28:54.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.485+0000 7f8193094700 1 --2- 172.21.15.44:0/3038551827 >> v2:172.21.15.99:3300/0 conn(0x7f818c15a630 0x7f818c06c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.485+0000 7f8193094700 1 --2- 172.21.15.44:0/3038551827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f818c1573e0 0x7f818c070ba0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.485+0000 7f8193094700 1 -- 172.21.15.44:0/3038551827 >> 172.21.15.44:0/3038551827 conn(0x7f818c0b0e10 msgr2=0x7f818c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:54.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.485+0000 7f8193094700 1 -- 172.21.15.44:0/3038551827 shutdown_connections 2024-09-13T18:28:54.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.485+0000 7f8193094700 1 -- 172.21.15.44:0/3038551827 wait complete. 2024-09-13T18:28:54.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.485+0000 7f8193094700 1 Processor -- start 2024-09-13T18:28:54.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.485+0000 7f8193094700 1 -- start start 2024-09-13T18:28:54.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.485+0000 7f8193094700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f818c0710e0 0x7f818c152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:54.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.485+0000 7f8193094700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f818c15a630 0x7f818c1451c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:54.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.485+0000 7f8193094700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f818c150e30 0x7f818c0cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:54.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.485+0000 7f8193094700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c1524b0 con 0x7f818c150e30 2024-09-13T18:28:54.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.485+0000 7f8193094700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c145700 con 0x7f818c0710e0 2024-09-13T18:28:54.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.485+0000 7f8193094700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818c1518a0 con 0x7f818c15a630 2024-09-13T18:28:54.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.485+0000 7f8192893700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f818c150e30 0x7f818c0cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:54.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.485+0000 7f8192893700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f818c150e30 0x7f818c0cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37178/0 (socket says 172.21.15.44:37178) 2024-09-13T18:28:54.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.485+0000 7f8192893700 1 -- 172.21.15.44:0/1879303481 learned_addr learned my addr 172.21.15.44:0/1879303481 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:54.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.485+0000 7f8191891700 1 --2- 172.21.15.44:0/1879303481 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f818c15a630 0x7f818c1451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:54.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.485+0000 7f8192092700 1 --2- 172.21.15.44:0/1879303481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f818c0710e0 0x7f818c152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:54.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.489+0000 7f8192893700 1 -- 172.21.15.44:0/1879303481 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f818c15a630 msgr2=0x7f818c1451c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:54.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.489+0000 7f8192893700 1 --2- 172.21.15.44:0/1879303481 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f818c15a630 0x7f818c1451c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.489+0000 7f8192893700 1 -- 172.21.15.44:0/1879303481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f818c0710e0 msgr2=0x7f818c152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:54.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.489+0000 7f8192893700 1 --2- 172.21.15.44:0/1879303481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f818c0710e0 0x7f818c152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.489+0000 7f8192893700 1 -- 172.21.15.44:0/1879303481 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817c0094b0 con 0x7f818c150e30 2024-09-13T18:28:54.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.489+0000 7f8192893700 1 --2- 172.21.15.44:0/1879303481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f818c150e30 0x7f818c0cd220 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f818400d800 tx=0x7f818400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:54.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.489+0000 7f8182ffd700 1 -- 172.21.15.44:0/1879303481 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81840125f0 con 0x7f818c150e30 2024-09-13T18:28:54.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.489+0000 7f8182ffd700 1 -- 172.21.15.44:0/1879303481 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8184012790 con 0x7f818c150e30 2024-09-13T18:28:54.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.489+0000 7f8193094700 1 -- 172.21.15.44:0/1879303481 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f818c151b80 con 0x7f818c150e30 2024-09-13T18:28:54.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.489+0000 7f8182ffd700 1 -- 172.21.15.44:0/1879303481 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8184012b40 con 0x7f818c150e30 2024-09-13T18:28:54.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.489+0000 7f8193094700 1 -- 172.21.15.44:0/1879303481 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818c152140 con 0x7f818c150e30 2024-09-13T18:28:54.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.489+0000 7f8193094700 1 -- 172.21.15.44:0/1879303481 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f818c070ba0 con 0x7f818c150e30 2024-09-13T18:28:54.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.489+0000 7f8182ffd700 1 -- 172.21.15.44:0/1879303481 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8184012ca0 con 0x7f818c150e30 2024-09-13T18:28:54.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.493+0000 7f8182ffd700 1 --2- 172.21.15.44:0/1879303481 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8170066730 0x7f8170068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:54.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.493+0000 7f8182ffd700 1 -- 172.21.15.44:0/1879303481 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8184084200 con 0x7f818c150e30 2024-09-13T18:28:54.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.493+0000 7f8192092700 1 --2- 172.21.15.44:0/1879303481 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8170066730 0x7f8170068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:54.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.493+0000 7f8192092700 1 --2- 172.21.15.44:0/1879303481 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8170066730 0x7f8170068bf0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f818c0b3d00 tx=0x7f817c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:54.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.497+0000 7f8182ffd700 1 -- 172.21.15.44:0/1879303481 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8184051510 con 0x7f818c150e30 2024-09-13T18:28:54.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.677+0000 7f8193094700 1 -- 172.21.15.44:0/1879303481 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f818c1525f0 con 0x7f818c150e30 2024-09-13T18:28:54.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.677+0000 7f8182ffd700 1 -- 172.21.15.44:0/1879303481 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v36) v1 ==== 80+0+120 (secure 0 0 0) 0x7f8184054b30 con 0x7f818c150e30 2024-09-13T18:28:54.686 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/939073284 2024-09-14T18:28:29.639607+0000 2024-09-13T18:28:54.686 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6834/939073284 2024-09-14T18:28:29.639607+0000 2024-09-13T18:28:54.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.681+0000 7f8193094700 1 -- 172.21.15.44:0/1879303481 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8170066730 msgr2=0x7f8170068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:54.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.681+0000 7f8193094700 1 --2- 172.21.15.44:0/1879303481 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8170066730 0x7f8170068bf0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f818c0b3d00 tx=0x7f817c008030 comp rx=0 tx=0).stop 2024-09-13T18:28:54.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.681+0000 7f8193094700 1 -- 172.21.15.44:0/1879303481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f818c150e30 msgr2=0x7f818c0cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:54.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.681+0000 7f8193094700 1 --2- 172.21.15.44:0/1879303481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f818c150e30 0x7f818c0cd220 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f818400d800 tx=0x7f818400db10 comp rx=0 tx=0).stop 2024-09-13T18:28:54.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.681+0000 7f8193094700 1 -- 172.21.15.44:0/1879303481 shutdown_connections 2024-09-13T18:28:54.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.681+0000 7f8193094700 1 --2- 172.21.15.44:0/1879303481 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8170066730 0x7f8170068bf0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.681+0000 7f8193094700 1 --2- 172.21.15.44:0/1879303481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f818c150e30 0x7f818c0cd220 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.681+0000 7f8193094700 1 --2- 172.21.15.44:0/1879303481 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f818c15a630 0x7f818c1451c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.681+0000 7f8193094700 1 --2- 172.21.15.44:0/1879303481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f818c0710e0 0x7f818c152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:54.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.681+0000 7f8193094700 1 -- 172.21.15.44:0/1879303481 >> 172.21.15.44:0/1879303481 conn(0x7f818c0b0e10 msgr2=0x7f818c0ad710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:54.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.685+0000 7f8193094700 1 -- 172.21.15.44:0/1879303481 shutdown_connections 2024-09-13T18:28:54.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:54.685+0000 7f8193094700 1 -- 172.21.15.44:0/1879303481 wait complete. 2024-09-13T18:28:54.692 INFO:teuthology.orchestra.run.smithi044.stderr:listed 2 entries 2024-09-13T18:28:54.705 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2024-09-13T18:28:54.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:54.706 DEBUG:teuthology.orchestra.run.smithi044:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:54.716 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[38836]: fuse finished with error 0 and tester_r 0 2024-09-13T18:28:54.718 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:28:54.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:54.718 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:28:54.838 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:28:54.839 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:28:54.847 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346268k,nr_inodes=4086567,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19562 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275480k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:28:54.847 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:28:54.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:54.847 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:28:54.897 INFO:teuthology.orchestra.run.smithi099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-13T18:28:54.897 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:28:54.898 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:28:54.898 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:28:54.905 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349428k,nr_inodes=4087357,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16693 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276112k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:28:54.906 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:28:54.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:54.906 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T18:28:54.911 INFO:teuthology.orchestra.run.smithi044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T18:28:54.912 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:28:54.912 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:28:54.912 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:28:54.919 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346268k,nr_inodes=4086567,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19562 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275480k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:28:54.920 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:28:54.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:54.920 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T18:28:54.969 INFO:teuthology.orchestra.run.smithi099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T18:28:54.969 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:28:54.970 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:28:55.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d4270f700 1 Processor -- start 2024-09-13T18:28:55.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d4270f700 1 -- start start 2024-09-13T18:28:55.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d4270f700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4d3c0b2b00 0x7f4d3c06ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d4270f700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3c15bc70 con 0x7f4d3c15b890 2024-09-13T18:28:55.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d4270f700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3c0ccc20 con 0x7f4d3c0cdcc0 2024-09-13T18:28:55.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d4270f700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3c0ccf00 con 0x7f4d3c0b2b00 2024-09-13T18:28:55.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3bfff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4d3c15b890 0x7f4d3c162220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46240/0 (socket says 172.21.15.44:46240) 2024-09-13T18:28:55.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3bfff700 1 -- 172.21.15.44:0/126851010 learned_addr learned my addr 172.21.15.44:0/126851010 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:55.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3affd700 1 -- 172.21.15.44:0/126851010 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754915314 0 0) 0x7f4d3c15bc70 con 0x7f4d3c15b890 2024-09-13T18:28:55.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d40cac700 1 --2- 172.21.15.44:0/126851010 >> v2:172.21.15.99:3300/0 conn(0x7f4d3c0b2b00 0x7f4d3c06ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3affd700 1 -- 172.21.15.44:0/126851010 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d1c0035d0 con 0x7f4d3c15b890 2024-09-13T18:28:55.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3affd700 1 -- 172.21.15.44:0/126851010 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1897732626 0 0) 0x7f4d1c0035d0 con 0x7f4d3c15b890 2024-09-13T18:28:55.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3affd700 1 -- 172.21.15.44:0/126851010 >> v2:172.21.15.99:3300/0 conn(0x7f4d3c0b2b00 msgr2=0x7f4d3c06ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:55.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3affd700 1 --2- 172.21.15.44:0/126851010 >> v2:172.21.15.99:3300/0 conn(0x7f4d3c0b2b00 0x7f4d3c06ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3affd700 1 -- 172.21.15.44:0/126851010 >> v1:172.21.15.99:6789/0 conn(0x7f4d3c0cdcc0 legacy=0x7f4d3c0b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:55.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3affd700 1 -- 172.21.15.44:0/126851010 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c0cd1e0 con 0x7f4d3c15b890 2024-09-13T18:28:55.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3affd700 1 -- 172.21.15.44:0/126851010 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f4d24001670 con 0x7f4d3c15b890 2024-09-13T18:28:55.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3affd700 1 -- 172.21.15.44:0/126851010 >> v1:172.21.15.44:6789/0 conn(0x7f4d3c15b890 legacy=0x7f4d3c162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:55.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3affd700 1 --2- 172.21.15.44:0/126851010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d1c003a20 0x7f4d1c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3affd700 1 --2- 172.21.15.44:0/126851010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d1c004870 0x7f4d1c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3affd700 1 --2- 172.21.15.44:0/126851010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d1c005350 0x7f4d1c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3affd700 1 -- 172.21.15.44:0/126851010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c0ccf00 con 0x7f4d1c004870 2024-09-13T18:28:55.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3affd700 1 -- 172.21.15.44:0/126851010 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c00c220 con 0x7f4d1c005350 2024-09-13T18:28:55.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3affd700 1 -- 172.21.15.44:0/126851010 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c00c3e0 con 0x7f4d1c003a20 2024-09-13T18:28:55.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3b7fe700 1 --2- 172.21.15.44:0/126851010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d1c004870 0x7f4d1c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3bfff700 1 --2- 172.21.15.44:0/126851010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d1c003a20 0x7f4d1c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d40cac700 1 --2- 172.21.15.44:0/126851010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d1c005350 0x7f4d1c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3b7fe700 1 -- 172.21.15.44:0/126851010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d1c003a20 msgr2=0x7f4d1c003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:55.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3b7fe700 1 --2- 172.21.15.44:0/126851010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d1c003a20 0x7f4d1c003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3b7fe700 1 -- 172.21.15.44:0/126851010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d1c005350 msgr2=0x7f4d1c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:55.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3b7fe700 1 --2- 172.21.15.44:0/126851010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d1c005350 0x7f4d1c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3b7fe700 1 -- 172.21.15.44:0/126851010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c0035d0 con 0x7f4d1c004870 2024-09-13T18:28:55.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d40cac700 1 --2- 172.21.15.44:0/126851010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d1c005350 0x7f4d1c00ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:55.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d40cac700 1 -- 172.21.15.44:0/126851010 reap_dead start 2024-09-13T18:28:55.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.089+0000 7f4d3b7fe700 1 --2- 172.21.15.44:0/126851010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d1c004870 0x7f4d1c004cf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400c160 tx=0x7f4d1c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40fa1bbfc4804d1a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:55.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.093+0000 7f4d3affd700 1 -- 172.21.15.44:0/126851010 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34001d90 con 0x7f4d1c004870 2024-09-13T18:28:55.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.093+0000 7f4d3affd700 1 -- 172.21.15.44:0/126851010 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3400ccc0 con 0x7f4d1c004870 2024-09-13T18:28:55.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.093+0000 7f4d3affd700 1 -- 172.21.15.44:0/126851010 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34003c20 con 0x7f4d1c004870 2024-09-13T18:28:55.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.093+0000 7f4d4270f700 1 -- 172.21.15.44:0/126851010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d1c004870 msgr2=0x7f4d1c004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:55.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.093+0000 7f4d4270f700 1 --2- 172.21.15.44:0/126851010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d1c004870 0x7f4d1c004cf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400c160 tx=0x7f4d1c0058a0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.093+0000 7f4d4270f700 1 -- 172.21.15.44:0/126851010 shutdown_connections 2024-09-13T18:28:55.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.093+0000 7f4d4270f700 1 --2- 172.21.15.44:0/126851010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d1c004870 0x7f4d1c004cf0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.093+0000 7f4d4270f700 1 -- 172.21.15.44:0/126851010 >> 172.21.15.44:0/126851010 conn(0x7f4d3c0ce980 msgr2=0x7f4d3c0ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:55.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.093+0000 7f4d4270f700 1 -- 172.21.15.44:0/126851010 shutdown_connections 2024-09-13T18:28:55.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.093+0000 7f4d4270f700 1 -- 172.21.15.44:0/126851010 wait complete. 2024-09-13T18:28:55.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d4270f700 1 Processor -- start 2024-09-13T18:28:55.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d4270f700 1 -- start start 2024-09-13T18:28:55.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d4270f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d1c004870 0x7f4d3c14cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d4270f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d3c1fb0f0 0x7f4d3c162ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d4270f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d3c163820 0x7f4d3c163cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d4270f700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c1641f0 con 0x7f4d3c1fb0f0 2024-09-13T18:28:55.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d4270f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c14d1e0 con 0x7f4d3c163820 2024-09-13T18:28:55.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d4270f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c15cea0 con 0x7f4d1c004870 2024-09-13T18:28:55.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d3b7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d3c1fb0f0 0x7f4d3c162ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d3b7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d3c1fb0f0 0x7f4d3c162ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37188/0 (socket says 172.21.15.44:37188) 2024-09-13T18:28:55.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d3b7fe700 1 -- 172.21.15.44:0/3214369139 learned_addr learned my addr 172.21.15.44:0/3214369139 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:55.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d3bfff700 1 --2- 172.21.15.44:0/3214369139 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d1c004870 0x7f4d3c14cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d40cac700 1 --2- 172.21.15.44:0/3214369139 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d3c163820 0x7f4d3c163cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d3b7fe700 1 -- 172.21.15.44:0/3214369139 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d1c004870 msgr2=0x7f4d3c14cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:55.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d3b7fe700 1 --2- 172.21.15.44:0/3214369139 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d1c004870 0x7f4d3c14cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d3b7fe700 1 -- 172.21.15.44:0/3214369139 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d3c163820 msgr2=0x7f4d3c163cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:55.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d3b7fe700 1 --2- 172.21.15.44:0/3214369139 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d3c163820 0x7f4d3c163cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d3b7fe700 1 -- 172.21.15.44:0/3214369139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c15d120 con 0x7f4d3c1fb0f0 2024-09-13T18:28:55.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d3bfff700 1 --2- 172.21.15.44:0/3214369139 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d1c004870 0x7f4d3c14cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:55.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d40cac700 1 --2- 172.21.15.44:0/3214369139 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d3c163820 0x7f4d3c163cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:55.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d3b7fe700 1 --2- 172.21.15.44:0/3214369139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d3c1fb0f0 0x7f4d3c162ed0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4d34005040 tx=0x7f4d340014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:55.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d38ff9700 1 -- 172.21.15.44:0/3214369139 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d340052d0 con 0x7f4d3c1fb0f0 2024-09-13T18:28:55.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d38ff9700 1 -- 172.21.15.44:0/3214369139 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d34005450 con 0x7f4d3c1fb0f0 2024-09-13T18:28:55.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d4270f700 1 -- 172.21.15.44:0/3214369139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d3c15d400 con 0x7f4d3c1fb0f0 2024-09-13T18:28:55.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d38ff9700 1 -- 172.21.15.44:0/3214369139 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34005800 con 0x7f4d3c1fb0f0 2024-09-13T18:28:55.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d4270f700 1 -- 172.21.15.44:0/3214369139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d3c15d9c0 con 0x7f4d3c1fb0f0 2024-09-13T18:28:55.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.097+0000 7f4d4270f700 1 -- 172.21.15.44:0/3214369139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3c0cb290 con 0x7f4d3c1fb0f0 2024-09-13T18:28:55.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.101+0000 7f4d38ff9700 1 -- 172.21.15.44:0/3214369139 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4d34019050 con 0x7f4d3c1fb0f0 2024-09-13T18:28:55.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.101+0000 7f4d38ff9700 1 --2- 172.21.15.44:0/3214369139 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4d20066730 0x7f4d20068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.101+0000 7f4d38ff9700 1 -- 172.21.15.44:0/3214369139 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4d34085070 con 0x7f4d3c1fb0f0 2024-09-13T18:28:55.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.101+0000 7f4d3bfff700 1 --2- 172.21.15.44:0/3214369139 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4d20066730 0x7f4d20068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.101+0000 7f4d3bfff700 1 --2- 172.21.15.44:0/3214369139 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4d20066730 0x7f4d20068bf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4d24000c00 tx=0x7f4d24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:55.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.109+0000 7f4d38ff9700 1 -- 172.21.15.44:0/3214369139 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4d34052530 con 0x7f4d3c1fb0f0 2024-09-13T18:28:55.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.321+0000 7f4d4270f700 1 -- 172.21.15.44:0/3214369139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d3c0cf330 con 0x7f4d3c1fb0f0 2024-09-13T18:28:55.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.321+0000 7f4d38ff9700 1 -- 172.21.15.44:0/3214369139 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4732 (secure 0 0 0) 0x7f4d34055b50 con 0x7f4d3c1fb0f0 2024-09-13T18:28:55.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:55.330 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5191,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/2593282586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2593282586},{"type":"v1","addr":"172.21.15.99:6836","nonce":2593282586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3094334762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3094334762},{"type":"v1","addr":"172.21.15.99:6837","nonce":3094334762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1843893566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1843893566},{"type":"v1","addr":"172.21.15.44:6833","nonce":1843893566}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:28:05.062964+0000","modified":"2024-09-13T18:28:41.727358+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5580},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5580":{"gid":5580,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.44:6835/438860530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":438860530},{"type":"v1","addr":"172.21.15.44:6835","nonce":438860530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:28:55.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.325+0000 7f4d4270f700 1 -- 172.21.15.44:0/3214369139 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4d20066730 msgr2=0x7f4d20068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:55.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.325+0000 7f4d4270f700 1 --2- 172.21.15.44:0/3214369139 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4d20066730 0x7f4d20068bf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4d24000c00 tx=0x7f4d24009040 comp rx=0 tx=0).stop 2024-09-13T18:28:55.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.325+0000 7f4d4270f700 1 -- 172.21.15.44:0/3214369139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d3c1fb0f0 msgr2=0x7f4d3c162ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:55.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.325+0000 7f4d4270f700 1 --2- 172.21.15.44:0/3214369139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d3c1fb0f0 0x7f4d3c162ed0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4d34005040 tx=0x7f4d340014a0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.325+0000 7f4d4270f700 1 -- 172.21.15.44:0/3214369139 shutdown_connections 2024-09-13T18:28:55.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.325+0000 7f4d4270f700 1 --2- 172.21.15.44:0/3214369139 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4d20066730 0x7f4d20068bf0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.325+0000 7f4d4270f700 1 --2- 172.21.15.44:0/3214369139 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d3c163820 0x7f4d3c163cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.325+0000 7f4d4270f700 1 --2- 172.21.15.44:0/3214369139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d3c1fb0f0 0x7f4d3c162ed0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.325+0000 7f4d4270f700 1 --2- 172.21.15.44:0/3214369139 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d1c004870 0x7f4d3c14cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.325+0000 7f4d4270f700 1 -- 172.21.15.44:0/3214369139 >> 172.21.15.44:0/3214369139 conn(0x7f4d3c0ce980 msgr2=0x7f4d3c0afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:55.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.325+0000 7f4d4270f700 1 -- 172.21.15.44:0/3214369139 shutdown_connections 2024-09-13T18:28:55.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.325+0000 7f4d4270f700 1 -- 172.21.15.44:0/3214369139 wait complete. 2024-09-13T18:28:55.334 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 23 2024-09-13T18:28:55.345 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:28:55.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed2d9e700 1 Processor -- start 2024-09-13T18:28:55.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed2d9e700 1 -- start start 2024-09-13T18:28:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed2d9e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbecc159720 0x7fbecc06cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed2d9e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbecc0b3ae0 0x7fbecc0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed2d9e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbecc06af00 con 0x7fbecc06aa90 2024-09-13T18:28:55.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed2d9e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbecc06d690 con 0x7fbecc159720 2024-09-13T18:28:55.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed2d9e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc0cbfe0 con 0x7fbecc0b3ae0 2024-09-13T18:28:55.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed1d9c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbecc159720 0x7fbecc06cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed1d9c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbecc159720 0x7fbecc06cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37204/0 (socket says 172.21.15.44:37204) 2024-09-13T18:28:55.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed1d9c700 1 -- 172.21.15.44:0/1926081278 learned_addr learned my addr 172.21.15.44:0/1926081278 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:55.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed259d700 1 --2- 172.21.15.44:0/1926081278 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbecc0b3ae0 0x7fbecc0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed1d9c700 1 -- 172.21.15.44:0/1926081278 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbecc0b3ae0 msgr2=0x7fbecc0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:55.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed1d9c700 1 --2- 172.21.15.44:0/1926081278 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbecc0b3ae0 0x7fbecc0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed1d9c700 1 -- 172.21.15.44:0/1926081278 >> v1:172.21.15.99:6789/0 conn(0x7fbecc06aa90 legacy=0x7fbecc0b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:55.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed1d9c700 1 -- 172.21.15.44:0/1926081278 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc0cc2c0 con 0x7fbecc159720 2024-09-13T18:28:55.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed1d9c700 1 --2- 172.21.15.44:0/1926081278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbecc159720 0x7fbecc06cf90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbec0009910 tx=0x7fbec0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb36bd0ca09319fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:55.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed0d9a700 1 -- 172.21.15.44:0/1926081278 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0011830 con 0x7fbecc159720 2024-09-13T18:28:55.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed0d9a700 1 -- 172.21.15.44:0/1926081278 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec0011990 con 0x7fbecc159720 2024-09-13T18:28:55.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed0d9a700 1 -- 172.21.15.44:0/1926081278 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0011d40 con 0x7fbecc159720 2024-09-13T18:28:55.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed2d9e700 1 -- 172.21.15.44:0/1926081278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbecc159720 msgr2=0x7fbecc06cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:55.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed2d9e700 1 --2- 172.21.15.44:0/1926081278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbecc159720 0x7fbecc06cf90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbec0009910 tx=0x7fbec0009c20 comp rx=0 tx=0).stop 2024-09-13T18:28:55.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed2d9e700 1 -- 172.21.15.44:0/1926081278 shutdown_connections 2024-09-13T18:28:55.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed2d9e700 1 --2- 172.21.15.44:0/1926081278 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbecc0b3ae0 0x7fbecc0ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed2d9e700 1 --2- 172.21.15.44:0/1926081278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbecc159720 0x7fbecc06cf90 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed2d9e700 1 -- 172.21.15.44:0/1926081278 >> 172.21.15.44:0/1926081278 conn(0x7fbecc0b0f00 msgr2=0x7fbecc0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:55.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed2d9e700 1 -- 172.21.15.44:0/1926081278 shutdown_connections 2024-09-13T18:28:55.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.453+0000 7fbed2d9e700 1 -- 172.21.15.44:0/1926081278 wait complete. 2024-09-13T18:28:55.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.457+0000 7fbed2d9e700 1 Processor -- start 2024-09-13T18:28:55.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.457+0000 7fbed2d9e700 1 -- start start 2024-09-13T18:28:55.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.457+0000 7fbed2d9e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbecc06aa90 0x7fbecc15c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.457+0000 7fbed2d9e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbecc0b3ae0 0x7fbecc14e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.457+0000 7fbed2d9e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbecc159720 0x7fbecc155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.457+0000 7fbed2d9e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc15b480 con 0x7fbecc06aa90 2024-09-13T18:28:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.457+0000 7fbed2d9e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc15b6d0 con 0x7fbecc159720 2024-09-13T18:28:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.457+0000 7fbed2d9e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc15b9b0 con 0x7fbecc0b3ae0 2024-09-13T18:28:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.457+0000 7fbed1d9c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbecc06aa90 0x7fbecc15c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.457+0000 7fbed1d9c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbecc06aa90 0x7fbecc15c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37216/0 (socket says 172.21.15.44:37216) 2024-09-13T18:28:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.457+0000 7fbed1d9c700 1 -- 172.21.15.44:0/222005645 learned_addr learned my addr 172.21.15.44:0/222005645 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.457+0000 7fbed159b700 1 --2- 172.21.15.44:0/222005645 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbecc0b3ae0 0x7fbecc14e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.457+0000 7fbed259d700 1 --2- 172.21.15.44:0/222005645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbecc159720 0x7fbecc155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.457+0000 7fbed1d9c700 1 -- 172.21.15.44:0/222005645 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbecc0b3ae0 msgr2=0x7fbecc14e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.457+0000 7fbed1d9c700 1 --2- 172.21.15.44:0/222005645 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbecc0b3ae0 0x7fbecc14e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.457+0000 7fbed1d9c700 1 -- 172.21.15.44:0/222005645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbecc159720 msgr2=0x7fbecc155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.457+0000 7fbed1d9c700 1 --2- 172.21.15.44:0/222005645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbecc159720 0x7fbecc155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.457+0000 7fbed1d9c700 1 -- 172.21.15.44:0/222005645 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec0009570 con 0x7fbecc06aa90 2024-09-13T18:28:55.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.457+0000 7fbed1d9c700 1 --2- 172.21.15.44:0/222005645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbecc06aa90 0x7fbecc15c770 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbecc071e20 tx=0x7fbec0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:55.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.457+0000 7fbebe7fc700 1 -- 172.21.15.44:0/222005645 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0004510 con 0x7fbecc06aa90 2024-09-13T18:28:55.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.461+0000 7fbebe7fc700 1 -- 172.21.15.44:0/222005645 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec001e070 con 0x7fbecc06aa90 2024-09-13T18:28:55.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.461+0000 7fbed2d9e700 1 -- 172.21.15.44:0/222005645 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbecc15bc90 con 0x7fbecc06aa90 2024-09-13T18:28:55.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.461+0000 7fbebe7fc700 1 -- 172.21.15.44:0/222005645 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0003900 con 0x7fbecc06aa90 2024-09-13T18:28:55.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.461+0000 7fbed2d9e700 1 -- 172.21.15.44:0/222005645 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbecc15c250 con 0x7fbecc06aa90 2024-09-13T18:28:55.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.461+0000 7fbed2d9e700 1 -- 172.21.15.44:0/222005645 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbecc15c440 con 0x7fbecc06aa90 2024-09-13T18:28:55.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.461+0000 7fbebe7fc700 1 -- 172.21.15.44:0/222005645 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbec0003a60 con 0x7fbecc06aa90 2024-09-13T18:28:55.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.461+0000 7fbebe7fc700 1 --2- 172.21.15.44:0/222005645 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbeb0066760 0x7fbeb0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.461+0000 7fbebe7fc700 1 -- 172.21.15.44:0/222005645 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fbec0084cf0 con 0x7fbecc06aa90 2024-09-13T18:28:55.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.461+0000 7fbed159b700 1 --2- 172.21.15.44:0/222005645 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbeb0066760 0x7fbeb0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.465+0000 7fbed159b700 1 --2- 172.21.15.44:0/222005645 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbeb0066760 0x7fbeb0068c20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbecc152030 tx=0x7fbec8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:55.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.469+0000 7fbebe7fc700 1 -- 172.21.15.44:0/222005645 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbec0089070 con 0x7fbecc06aa90 2024-09-13T18:28:55.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.641+0000 7fbed2d9e700 1 -- 172.21.15.44:0/222005645 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbecc0cb550 con 0x7fbecc06aa90 2024-09-13T18:28:55.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.645+0000 7fbebe7fc700 1 -- 172.21.15.44:0/222005645 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16636 (secure 0 0 0) 0x7fbec0015090 con 0x7fbecc06aa90 2024-09-13T18:28:55.652 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:55.652 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":36,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:28:29.639664+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:28:02.951723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:28:04.057772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/939073284":"2024-09-14T18:28:29.639607+0000","172.21.15.44:6834/939073284":"2024-09-14T18:28:29.639607+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:28:55.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.649+0000 7fbed2d9e700 1 -- 172.21.15.44:0/222005645 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbeb0066760 msgr2=0x7fbeb0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:55.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.649+0000 7fbed2d9e700 1 --2- 172.21.15.44:0/222005645 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbeb0066760 0x7fbeb0068c20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbecc152030 tx=0x7fbec8009040 comp rx=0 tx=0).stop 2024-09-13T18:28:55.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.649+0000 7fbed2d9e700 1 -- 172.21.15.44:0/222005645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbecc06aa90 msgr2=0x7fbecc15c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:55.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.649+0000 7fbed2d9e700 1 --2- 172.21.15.44:0/222005645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbecc06aa90 0x7fbecc15c770 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbecc071e20 tx=0x7fbec0004770 comp rx=0 tx=0).stop 2024-09-13T18:28:55.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.649+0000 7fbed2d9e700 1 -- 172.21.15.44:0/222005645 shutdown_connections 2024-09-13T18:28:55.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.649+0000 7fbed2d9e700 1 --2- 172.21.15.44:0/222005645 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbeb0066760 0x7fbeb0068c20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.649+0000 7fbed2d9e700 1 --2- 172.21.15.44:0/222005645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbecc159720 0x7fbecc155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.649+0000 7fbed2d9e700 1 --2- 172.21.15.44:0/222005645 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbecc0b3ae0 0x7fbecc14e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.649+0000 7fbed2d9e700 1 --2- 172.21.15.44:0/222005645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbecc06aa90 0x7fbecc15c770 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.649+0000 7fbed2d9e700 1 -- 172.21.15.44:0/222005645 >> 172.21.15.44:0/222005645 conn(0x7fbecc0b0f00 msgr2=0x7fbecc06cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:55.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.649+0000 7fbed2d9e700 1 -- 172.21.15.44:0/222005645 shutdown_connections 2024-09-13T18:28:55.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.649+0000 7fbed2d9e700 1 -- 172.21.15.44:0/222005645 wait complete. 2024-09-13T18:28:55.670 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:28:02.951723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:28:04.057772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:28:55.671 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:28:55.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.785+0000 7f0b2cd82700 1 Processor -- start 2024-09-13T18:28:55.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.785+0000 7f0b2cd82700 1 -- start start 2024-09-13T18:28:55.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.789+0000 7f0b2cd82700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0b2806d8c0 0x7f0b28164a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.789+0000 7f0b2cd82700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b28164f90 0x7f0b280704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.789+0000 7f0b2cd82700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b28162570 con 0x7f0b28070a00 2024-09-13T18:28:55.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.789+0000 7f0b2cd82700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b28162e60 con 0x7f0b2806d8c0 2024-09-13T18:28:55.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.789+0000 7f0b2cd82700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b28071240 con 0x7f0b28164f90 2024-09-13T18:28:55.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.789+0000 7f0b1ffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b28164f90 0x7f0b280704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.789+0000 7f0b277fe700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0b2806d8c0 0x7f0b28164a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.789+0000 7f0b277fe700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0b2806d8c0 0x7f0b28164a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:40594/0 (socket says 172.21.15.44:40594) 2024-09-13T18:28:55.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.789+0000 7f0b1ffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b28164f90 0x7f0b280704c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:37148/0 (socket says 172.21.15.44:37148) 2024-09-13T18:28:55.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.789+0000 7f0b277fe700 1 -- 172.21.15.44:0/1451030799 learned_addr learned my addr 172.21.15.44:0/1451030799 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:55.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.789+0000 7f0b27fff700 1 --1- 172.21.15.44:0/1451030799 >> v1:172.21.15.99:6789/0 conn(0x7f0b28070a00 0x7f0b28161460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:58278/0 (socket says 172.21.15.44:58278) 2024-09-13T18:28:55.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.789+0000 7f0b277fe700 1 -- 172.21.15.44:0/1451030799 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b28164f90 msgr2=0x7f0b280704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:55.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.789+0000 7f0b277fe700 1 --2- 172.21.15.44:0/1451030799 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b28164f90 0x7f0b280704c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.789+0000 7f0b277fe700 1 -- 172.21.15.44:0/1451030799 >> v1:172.21.15.99:6789/0 conn(0x7f0b28070a00 legacy=0x7f0b28161460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:55.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.789+0000 7f0b277fe700 1 -- 172.21.15.44:0/1451030799 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b281653f0 con 0x7f0b2806d8c0 2024-09-13T18:28:55.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.789+0000 7f0b277fe700 1 --2- 172.21.15.44:0/1451030799 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b2806d8c0 0x7f0b28164a50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0b18009910 tx=0x7f0b18009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eda2cb90ff3dd0ce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:55.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.793+0000 7f0b26ffd700 1 -- 172.21.15.44:0/1451030799 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b18011830 con 0x7f0b2806d8c0 2024-09-13T18:28:55.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.793+0000 7f0b26ffd700 1 -- 172.21.15.44:0/1451030799 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b18011990 con 0x7f0b2806d8c0 2024-09-13T18:28:55.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.793+0000 7f0b26ffd700 1 -- 172.21.15.44:0/1451030799 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b18011d40 con 0x7f0b2806d8c0 2024-09-13T18:28:55.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.793+0000 7f0b2cd82700 1 -- 172.21.15.44:0/1451030799 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b2806d8c0 msgr2=0x7f0b28164a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:55.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.793+0000 7f0b2cd82700 1 --2- 172.21.15.44:0/1451030799 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b2806d8c0 0x7f0b28164a50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0b18009910 tx=0x7f0b18009c20 comp rx=0 tx=0).stop 2024-09-13T18:28:55.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.793+0000 7f0b2cd82700 1 -- 172.21.15.44:0/1451030799 shutdown_connections 2024-09-13T18:28:55.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.793+0000 7f0b2cd82700 1 --2- 172.21.15.44:0/1451030799 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b28164f90 0x7f0b280704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.793+0000 7f0b2cd82700 1 --2- 172.21.15.44:0/1451030799 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b2806d8c0 0x7f0b28164a50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.793+0000 7f0b2cd82700 1 -- 172.21.15.44:0/1451030799 >> 172.21.15.44:0/1451030799 conn(0x7f0b280b0e10 msgr2=0x7f0b280b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:55.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.793+0000 7f0b2cd82700 1 -- 172.21.15.44:0/1451030799 shutdown_connections 2024-09-13T18:28:55.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.793+0000 7f0b2cd82700 1 -- 172.21.15.44:0/1451030799 wait complete. 2024-09-13T18:28:55.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.797+0000 7f0b2cd82700 1 Processor -- start 2024-09-13T18:28:55.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.797+0000 7f0b2cd82700 1 -- start start 2024-09-13T18:28:55.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.797+0000 7f0b2cd82700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b2806d8c0 0x7f0b28149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.797+0000 7f0b2cd82700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b28070a00 0x7f0b2815aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.797+0000 7f0b2cd82700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b28164f90 0x7f0b280a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.797+0000 7f0b2cd82700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b28149f60 con 0x7f0b2806d8c0 2024-09-13T18:28:55.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.797+0000 7f0b2cd82700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b28159980 con 0x7f0b28164f90 2024-09-13T18:28:55.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.797+0000 7f0b2cd82700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b28159c60 con 0x7f0b28070a00 2024-09-13T18:28:55.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.797+0000 7f0b277fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b2806d8c0 0x7f0b28149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.797+0000 7f0b277fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b2806d8c0 0x7f0b28149a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37220/0 (socket says 172.21.15.44:37220) 2024-09-13T18:28:55.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.797+0000 7f0b277fe700 1 -- 172.21.15.44:0/271647094 learned_addr learned my addr 172.21.15.44:0/271647094 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:55.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.801+0000 7f0b1ffff700 1 --2- 172.21.15.44:0/271647094 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b28070a00 0x7f0b2815aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.801+0000 7f0b27fff700 1 --2- 172.21.15.44:0/271647094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b28164f90 0x7f0b280a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.801+0000 7f0b277fe700 1 -- 172.21.15.44:0/271647094 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b28070a00 msgr2=0x7f0b2815aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:55.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.801+0000 7f0b277fe700 1 --2- 172.21.15.44:0/271647094 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b28070a00 0x7f0b2815aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.801+0000 7f0b277fe700 1 -- 172.21.15.44:0/271647094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b28164f90 msgr2=0x7f0b280a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:55.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.801+0000 7f0b277fe700 1 --2- 172.21.15.44:0/271647094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b28164f90 0x7f0b280a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.801+0000 7f0b277fe700 1 -- 172.21.15.44:0/271647094 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b18009570 con 0x7f0b2806d8c0 2024-09-13T18:28:55.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.801+0000 7f0b1ffff700 1 --2- 172.21.15.44:0/271647094 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b28070a00 0x7f0b2815aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:55.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.801+0000 7f0b277fe700 1 --2- 172.21.15.44:0/271647094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b2806d8c0 0x7f0b28149a20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0b18000c00 tx=0x7f0b18004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:55.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.801+0000 7f0b24ff9700 1 -- 172.21.15.44:0/271647094 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b18004610 con 0x7f0b2806d8c0 2024-09-13T18:28:55.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.801+0000 7f0b24ff9700 1 -- 172.21.15.44:0/271647094 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b180036c0 con 0x7f0b2806d8c0 2024-09-13T18:28:55.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.801+0000 7f0b24ff9700 1 -- 172.21.15.44:0/271647094 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b18003a50 con 0x7f0b2806d8c0 2024-09-13T18:28:55.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.801+0000 7f0b2cd82700 1 -- 172.21.15.44:0/271647094 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b28159f40 con 0x7f0b2806d8c0 2024-09-13T18:28:55.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.801+0000 7f0b2cd82700 1 -- 172.21.15.44:0/271647094 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b2815a500 con 0x7f0b2806d8c0 2024-09-13T18:28:55.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.801+0000 7f0b2cd82700 1 -- 172.21.15.44:0/271647094 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b28164a50 con 0x7f0b2806d8c0 2024-09-13T18:28:55.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.805+0000 7f0b24ff9700 1 -- 172.21.15.44:0/271647094 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0b18003bb0 con 0x7f0b2806d8c0 2024-09-13T18:28:55.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.805+0000 7f0b24ff9700 1 --2- 172.21.15.44:0/271647094 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0b0c066730 0x7f0b0c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.805+0000 7f0b24ff9700 1 -- 172.21.15.44:0/271647094 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0b18021030 con 0x7f0b2806d8c0 2024-09-13T18:28:55.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.805+0000 7f0b1ffff700 1 --2- 172.21.15.44:0/271647094 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0b0c066730 0x7f0b0c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.805+0000 7f0b1ffff700 1 --2- 172.21.15.44:0/271647094 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0b0c066730 0x7f0b0c068bf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0b281fa180 tx=0x7f0b10008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:55.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.813+0000 7f0b24ff9700 1 -- 172.21.15.44:0/271647094 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0b18052bc0 con 0x7f0b2806d8c0 2024-09-13T18:28:55.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.989+0000 7f0b2cd82700 1 -- 172.21.15.44:0/271647094 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0b28071c70 con 0x7f0b2806d8c0 2024-09-13T18:28:55.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.989+0000 7f0b24ff9700 1 -- 172.21.15.44:0/271647094 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0b180150a0 con 0x7f0b2806d8c0 2024-09-13T18:28:55.998 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:28:56.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.993+0000 7f0b2cd82700 1 -- 172.21.15.44:0/271647094 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0b0c066730 msgr2=0x7f0b0c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.993+0000 7f0b2cd82700 1 --2- 172.21.15.44:0/271647094 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0b0c066730 0x7f0b0c068bf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0b281fa180 tx=0x7f0b10008040 comp rx=0 tx=0).stop 2024-09-13T18:28:56.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.993+0000 7f0b2cd82700 1 -- 172.21.15.44:0/271647094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b2806d8c0 msgr2=0x7f0b28149a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.993+0000 7f0b2cd82700 1 --2- 172.21.15.44:0/271647094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b2806d8c0 0x7f0b28149a20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0b18000c00 tx=0x7f0b18004770 comp rx=0 tx=0).stop 2024-09-13T18:28:56.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.993+0000 7f0b2cd82700 1 -- 172.21.15.44:0/271647094 shutdown_connections 2024-09-13T18:28:56.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.993+0000 7f0b2cd82700 1 --2- 172.21.15.44:0/271647094 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0b0c066730 0x7f0b0c068bf0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.993+0000 7f0b2cd82700 1 --2- 172.21.15.44:0/271647094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b28164f90 0x7f0b280a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.993+0000 7f0b2cd82700 1 --2- 172.21.15.44:0/271647094 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b28070a00 0x7f0b2815aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.993+0000 7f0b2cd82700 1 --2- 172.21.15.44:0/271647094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b2806d8c0 0x7f0b28149a20 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.993+0000 7f0b2cd82700 1 -- 172.21.15.44:0/271647094 >> 172.21.15.44:0/271647094 conn(0x7f0b280b0e10 msgr2=0x7f0b280af6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:56.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.993+0000 7f0b2cd82700 1 -- 172.21.15.44:0/271647094 shutdown_connections 2024-09-13T18:28:56.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:55.993+0000 7f0b2cd82700 1 -- 172.21.15.44:0/271647094 wait complete. 2024-09-13T18:28:56.011 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:28:56.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.125+0000 7f1ba4945700 1 Processor -- start 2024-09-13T18:28:56.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.125+0000 7f1ba4945700 1 -- start start 2024-09-13T18:28:56.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.125+0000 7f1ba4945700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1b98007ec0 0x7f1b98056250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.125+0000 7f1ba4945700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1b9800ca00 0x7f1b98008c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.125+0000 7f1ba4945700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b98037bf0 con 0x7f1b980df970 2024-09-13T18:28:56.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.125+0000 7f1ba4945700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b98038120 con 0x7f1b9800ca00 2024-09-13T18:28:56.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.125+0000 7f1ba4945700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b980091a0 con 0x7f1b98007ec0 2024-09-13T18:28:56.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.125+0000 7f1b9ffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1b9800ca00 0x7f1b98008c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.125+0000 7f1b9ffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1b9800ca00 0x7f1b98008c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37224/0 (socket says 172.21.15.44:37224) 2024-09-13T18:28:56.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.125+0000 7f1b9ffff700 1 -- 172.21.15.44:0/3932453991 learned_addr learned my addr 172.21.15.44:0/3932453991 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:56.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.125+0000 7f1b9effd700 1 --2- 172.21.15.44:0/3932453991 >> v2:172.21.15.99:3300/0 conn(0x7f1b98007ec0 0x7f1b98056250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.125+0000 7f1b9ffff700 1 -- 172.21.15.44:0/3932453991 >> v2:172.21.15.99:3300/0 conn(0x7f1b98007ec0 msgr2=0x7f1b98056250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:56.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.125+0000 7f1b9ffff700 1 --2- 172.21.15.44:0/3932453991 >> v2:172.21.15.99:3300/0 conn(0x7f1b98007ec0 0x7f1b98056250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.125+0000 7f1b9ffff700 1 -- 172.21.15.44:0/3932453991 >> v1:172.21.15.99:6789/0 conn(0x7f1b980df970 legacy=0x7f1b980077b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:56.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.129+0000 7f1b9ffff700 1 -- 172.21.15.44:0/3932453991 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b98037e40 con 0x7f1b9800ca00 2024-09-13T18:28:56.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.129+0000 7f1b9ffff700 1 --2- 172.21.15.44:0/3932453991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b9800ca00 0x7f1b98008c60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0063990 tx=0x7f1ba004f750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b747a26ea2e9845 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:56.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.129+0000 7f1b9e7fc700 1 -- 172.21.15.44:0/3932453991 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba00730f0 con 0x7f1b9800ca00 2024-09-13T18:28:56.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.129+0000 7f1b9e7fc700 1 -- 172.21.15.44:0/3932453991 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba008e070 con 0x7f1b9800ca00 2024-09-13T18:28:56.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.129+0000 7f1b9e7fc700 1 -- 172.21.15.44:0/3932453991 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0073450 con 0x7f1b9800ca00 2024-09-13T18:28:56.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.129+0000 7f1ba4945700 1 -- 172.21.15.44:0/3932453991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b9800ca00 msgr2=0x7f1b98008c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.129+0000 7f1ba4945700 1 --2- 172.21.15.44:0/3932453991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b9800ca00 0x7f1b98008c60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0063990 tx=0x7f1ba004f750 comp rx=0 tx=0).stop 2024-09-13T18:28:56.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.129+0000 7f1ba4945700 1 -- 172.21.15.44:0/3932453991 shutdown_connections 2024-09-13T18:28:56.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.129+0000 7f1ba4945700 1 --2- 172.21.15.44:0/3932453991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b9800ca00 0x7f1b98008c60 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.129+0000 7f1ba4945700 1 --2- 172.21.15.44:0/3932453991 >> v2:172.21.15.99:3300/0 conn(0x7f1b98007ec0 0x7f1b98056250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.129+0000 7f1ba4945700 1 -- 172.21.15.44:0/3932453991 >> 172.21.15.44:0/3932453991 conn(0x7f1b9801eaf0 msgr2=0x7f1b98055760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:56.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.129+0000 7f1ba4945700 1 -- 172.21.15.44:0/3932453991 shutdown_connections 2024-09-13T18:28:56.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.129+0000 7f1ba4945700 1 -- 172.21.15.44:0/3932453991 wait complete. 2024-09-13T18:28:56.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1ba4945700 1 Processor -- start 2024-09-13T18:28:56.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1ba4945700 1 -- start start 2024-09-13T18:28:56.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1ba4945700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b98007ec0 0x7f1b98051660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1ba4945700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b9800ca00 0x7f1b98178cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1ba4945700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b980df970 0x7f1b981791f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1ba4945700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b98051ba0 con 0x7f1b98007ec0 2024-09-13T18:28:56.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1ba4945700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9801f460 con 0x7f1b980df970 2024-09-13T18:28:56.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1ba4945700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9801ffe0 con 0x7f1b9800ca00 2024-09-13T18:28:56.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1b9f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b98007ec0 0x7f1b98051660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1b9f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b98007ec0 0x7f1b98051660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37226/0 (socket says 172.21.15.44:37226) 2024-09-13T18:28:56.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1b9f7fe700 1 -- 172.21.15.44:0/1186741266 learned_addr learned my addr 172.21.15.44:0/1186741266 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:56.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1b9effd700 1 --2- 172.21.15.44:0/1186741266 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b9800ca00 0x7f1b98178cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1b9ffff700 1 --2- 172.21.15.44:0/1186741266 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b980df970 0x7f1b981791f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1b9f7fe700 1 -- 172.21.15.44:0/1186741266 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b9800ca00 msgr2=0x7f1b98178cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1b9f7fe700 1 --2- 172.21.15.44:0/1186741266 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b9800ca00 0x7f1b98178cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1b9f7fe700 1 -- 172.21.15.44:0/1186741266 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b980df970 msgr2=0x7f1b981791f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1b9f7fe700 1 --2- 172.21.15.44:0/1186741266 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b980df970 0x7f1b981791f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1b9f7fe700 1 -- 172.21.15.44:0/1186741266 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba004f5c0 con 0x7f1b98007ec0 2024-09-13T18:28:56.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1b9f7fe700 1 --2- 172.21.15.44:0/1186741266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b98007ec0 0x7f1b98051660 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1b9400e910 tx=0x7f1b9400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:56.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1b87fff700 1 -- 172.21.15.44:0/1186741266 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b940052d0 con 0x7f1b98007ec0 2024-09-13T18:28:56.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1b87fff700 1 -- 172.21.15.44:0/1186741266 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b94005450 con 0x7f1b98007ec0 2024-09-13T18:28:56.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1ba4945700 1 -- 172.21.15.44:0/1186741266 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b9801f6b0 con 0x7f1b98007ec0 2024-09-13T18:28:56.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1b87fff700 1 -- 172.21.15.44:0/1186741266 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b94003930 con 0x7f1b98007ec0 2024-09-13T18:28:56.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.133+0000 7f1ba4945700 1 -- 172.21.15.44:0/1186741266 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9801fc70 con 0x7f1b98007ec0 2024-09-13T18:28:56.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.137+0000 7f1ba4945700 1 -- 172.21.15.44:0/1186741266 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b98056250 con 0x7f1b98007ec0 2024-09-13T18:28:56.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.137+0000 7f1b87fff700 1 -- 172.21.15.44:0/1186741266 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1b94003a90 con 0x7f1b98007ec0 2024-09-13T18:28:56.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.137+0000 7f1b87fff700 1 --2- 172.21.15.44:0/1186741266 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1b8c066730 0x7f1b8c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.137+0000 7f1b87fff700 1 -- 172.21.15.44:0/1186741266 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f1b940861b0 con 0x7f1b98007ec0 2024-09-13T18:28:56.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.137+0000 7f1b9effd700 1 --2- 172.21.15.44:0/1186741266 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1b8c066730 0x7f1b8c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.141+0000 7f1b9effd700 1 --2- 172.21.15.44:0/1186741266 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1b8c066730 0x7f1b8c068bf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1b98178c10 tx=0x7f1b90009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:56.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.145+0000 7f1b87fff700 1 -- 172.21.15.44:0/1186741266 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1b94053420 con 0x7f1b98007ec0 2024-09-13T18:28:56.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.317+0000 7f1ba4945700 1 -- 172.21.15.44:0/1186741266 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1b98037710 con 0x7f1b98007ec0 2024-09-13T18:28:56.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.317+0000 7f1b87fff700 1 -- 172.21.15.44:0/1186741266 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1b94056a40 con 0x7f1b98007ec0 2024-09-13T18:28:56.325 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:28:56.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.321+0000 7f1ba4945700 1 -- 172.21.15.44:0/1186741266 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1b8c066730 msgr2=0x7f1b8c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.321+0000 7f1ba4945700 1 --2- 172.21.15.44:0/1186741266 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1b8c066730 0x7f1b8c068bf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1b98178c10 tx=0x7f1b90009240 comp rx=0 tx=0).stop 2024-09-13T18:28:56.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.321+0000 7f1ba4945700 1 -- 172.21.15.44:0/1186741266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b98007ec0 msgr2=0x7f1b98051660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.321+0000 7f1ba4945700 1 --2- 172.21.15.44:0/1186741266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b98007ec0 0x7f1b98051660 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1b9400e910 tx=0x7f1b9400ec20 comp rx=0 tx=0).stop 2024-09-13T18:28:56.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.321+0000 7f1ba4945700 1 -- 172.21.15.44:0/1186741266 shutdown_connections 2024-09-13T18:28:56.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.321+0000 7f1ba4945700 1 --2- 172.21.15.44:0/1186741266 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1b8c066730 0x7f1b8c068bf0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.321+0000 7f1ba4945700 1 --2- 172.21.15.44:0/1186741266 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b980df970 0x7f1b981791f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.321+0000 7f1ba4945700 1 --2- 172.21.15.44:0/1186741266 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b9800ca00 0x7f1b98178cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.321+0000 7f1ba4945700 1 --2- 172.21.15.44:0/1186741266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b98007ec0 0x7f1b98051660 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.321+0000 7f1ba4945700 1 -- 172.21.15.44:0/1186741266 >> 172.21.15.44:0/1186741266 conn(0x7f1b9801eaf0 msgr2=0x7f1b98032350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:56.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.321+0000 7f1ba4945700 1 -- 172.21.15.44:0/1186741266 shutdown_connections 2024-09-13T18:28:56.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.321+0000 7f1ba4945700 1 -- 172.21.15.44:0/1186741266 wait complete. 2024-09-13T18:28:56.340 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:28:56.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.457+0000 7f85f488b700 1 Processor -- start 2024-09-13T18:28:56.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.457+0000 7f85f488b700 1 -- start start 2024-09-13T18:28:56.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85f488b700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f85f015a860 0x7f85f0071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85f488b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f85f006aba0 0x7f85f006b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85f488b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85f015e450 0x7f85f015e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85f488b700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f00b29a0 con 0x7f85f006aba0 2024-09-13T18:28:56.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85f488b700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f00cc2f0 con 0x7f85f015a860 2024-09-13T18:28:56.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85f488b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f006b550 con 0x7f85f015e450 2024-09-13T18:28:56.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85e7fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f85f006aba0 0x7f85f006b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85e7fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f85f006aba0 0x7f85f006b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37232/0 (socket says 172.21.15.44:37232) 2024-09-13T18:28:56.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85e7fff700 1 -- 172.21.15.44:0/1237547788 learned_addr learned my addr 172.21.15.44:0/1237547788 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:56.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85effff700 1 --2- 172.21.15.44:0/1237547788 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85f015e450 0x7f85f015e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85ef7fe700 1 --2- 172.21.15.44:0/1237547788 >> v2:172.21.15.99:3300/0 conn(0x7f85f015a860 0x7f85f0071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85ef7fe700 1 -- 172.21.15.44:0/1237547788 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85f015e450 msgr2=0x7f85f015e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:56.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85ef7fe700 1 --2- 172.21.15.44:0/1237547788 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85f015e450 0x7f85f015e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85ef7fe700 1 -- 172.21.15.44:0/1237547788 >> v2:172.21.15.44:3300/0 conn(0x7f85f006aba0 msgr2=0x7f85f006b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:56.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85ef7fe700 1 --2- 172.21.15.44:0/1237547788 >> v2:172.21.15.44:3300/0 conn(0x7f85f006aba0 0x7f85f006b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85ef7fe700 1 -- 172.21.15.44:0/1237547788 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f00ce880 con 0x7f85f015a860 2024-09-13T18:28:56.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85e7fff700 1 --2- 172.21.15.44:0/1237547788 >> v2:172.21.15.44:3300/0 conn(0x7f85f006aba0 0x7f85f006b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:56.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85ef7fe700 1 --2- 172.21.15.44:0/1237547788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85f015a860 0x7f85f0071dc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f85f00b2760 tx=0x7f85e0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=878a6b9b0315c261 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:56.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85eeffd700 1 -- 172.21.15.44:0/1237547788 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0011830 con 0x7f85f015a860 2024-09-13T18:28:56.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85eeffd700 1 -- 172.21.15.44:0/1237547788 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e0011990 con 0x7f85f015a860 2024-09-13T18:28:56.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85eeffd700 1 -- 172.21.15.44:0/1237547788 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0011d20 con 0x7f85f015a860 2024-09-13T18:28:56.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85f488b700 1 -- 172.21.15.44:0/1237547788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85f015a860 msgr2=0x7f85f0071dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85f488b700 1 --2- 172.21.15.44:0/1237547788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85f015a860 0x7f85f0071dc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f85f00b2760 tx=0x7f85e0009b30 comp rx=0 tx=0).stop 2024-09-13T18:28:56.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85f488b700 1 -- 172.21.15.44:0/1237547788 shutdown_connections 2024-09-13T18:28:56.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85f488b700 1 --2- 172.21.15.44:0/1237547788 >> v2:172.21.15.44:3300/0 conn(0x7f85f006aba0 0x7f85f006b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85f488b700 1 --2- 172.21.15.44:0/1237547788 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85f015e450 0x7f85f015e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85f488b700 1 --2- 172.21.15.44:0/1237547788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85f015a860 0x7f85f0071dc0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85f488b700 1 -- 172.21.15.44:0/1237547788 >> 172.21.15.44:0/1237547788 conn(0x7f85f00b1cd0 msgr2=0x7f85f00cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:56.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85f488b700 1 -- 172.21.15.44:0/1237547788 shutdown_connections 2024-09-13T18:28:56.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.461+0000 7f85f488b700 1 -- 172.21.15.44:0/1237547788 wait complete. 2024-09-13T18:28:56.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.465+0000 7f85f488b700 1 Processor -- start 2024-09-13T18:28:56.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.465+0000 7f85f488b700 1 -- start start 2024-09-13T18:28:56.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.465+0000 7f85f488b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85f006aba0 0x7f85f0141680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.465+0000 7f85f488b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85f015a860 0x7f85f00c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.465+0000 7f85f488b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85f015e450 0x7f85f01f5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.465+0000 7f85f488b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f006be50 con 0x7f85f015e450 2024-09-13T18:28:56.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.465+0000 7f85f488b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f00cb430 con 0x7f85f006aba0 2024-09-13T18:28:56.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.465+0000 7f85f488b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f00cb710 con 0x7f85f015a860 2024-09-13T18:28:56.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.469+0000 7f85e7fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85f015a860 0x7f85f00c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.469+0000 7f85effff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85f015e450 0x7f85f01f5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.469+0000 7f85e7fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85f015a860 0x7f85f00c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:37184/0 (socket says 172.21.15.44:37184) 2024-09-13T18:28:56.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.469+0000 7f85e7fff700 1 -- 172.21.15.44:0/3328296318 learned_addr learned my addr 172.21.15.44:0/3328296318 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:56.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.469+0000 7f85ef7fe700 1 --2- 172.21.15.44:0/3328296318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85f006aba0 0x7f85f0141680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.469+0000 7f85e7fff700 1 -- 172.21.15.44:0/3328296318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85f006aba0 msgr2=0x7f85f0141680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.469+0000 7f85e7fff700 1 --2- 172.21.15.44:0/3328296318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85f006aba0 0x7f85f0141680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.469+0000 7f85e7fff700 1 -- 172.21.15.44:0/3328296318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85f015e450 msgr2=0x7f85f01f5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.469+0000 7f85e7fff700 1 --2- 172.21.15.44:0/3328296318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85f015e450 0x7f85f01f5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.469+0000 7f85e7fff700 1 -- 172.21.15.44:0/3328296318 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d8009570 con 0x7f85f015a860 2024-09-13T18:28:56.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.469+0000 7f85effff700 1 --2- 172.21.15.44:0/3328296318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85f015e450 0x7f85f01f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:56.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.469+0000 7f85e7fff700 1 --2- 172.21.15.44:0/3328296318 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85f015a860 0x7f85f00c8d20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f85d8009fd0 tx=0x7f85d800ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:56.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.469+0000 7f85ecff9700 1 -- 172.21.15.44:0/3328296318 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d8004030 con 0x7f85f015a860 2024-09-13T18:28:56.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.469+0000 7f85ecff9700 1 -- 172.21.15.44:0/3328296318 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d8004190 con 0x7f85f015a860 2024-09-13T18:28:56.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.469+0000 7f85ecff9700 1 -- 172.21.15.44:0/3328296318 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d8004520 con 0x7f85f015a860 2024-09-13T18:28:56.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.469+0000 7f85f488b700 1 -- 172.21.15.44:0/3328296318 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e00094b0 con 0x7f85f015a860 2024-09-13T18:28:56.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.469+0000 7f85f488b700 1 -- 172.21.15.44:0/3328296318 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f00c9260 con 0x7f85f015a860 2024-09-13T18:28:56.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.469+0000 7f85f488b700 1 -- 172.21.15.44:0/3328296318 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f00cbc30 con 0x7f85f015a860 2024-09-13T18:28:56.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.473+0000 7f85ecff9700 1 -- 172.21.15.44:0/3328296318 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f85d80036c0 con 0x7f85f015a860 2024-09-13T18:28:56.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.473+0000 7f85ecff9700 1 --2- 172.21.15.44:0/3328296318 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f85d4066730 0x7f85d4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.473+0000 7f85ecff9700 1 -- 172.21.15.44:0/3328296318 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f85d8083fb0 con 0x7f85f015a860 2024-09-13T18:28:56.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.473+0000 7f85ef7fe700 1 --2- 172.21.15.44:0/3328296318 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f85d4066730 0x7f85d4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.473+0000 7f85ef7fe700 1 --2- 172.21.15.44:0/3328296318 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f85d4066730 0x7f85d4068bf0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f85e0000c00 tx=0x7f85e0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:56.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.481+0000 7f85ecff9700 1 -- 172.21.15.44:0/3328296318 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f85f00cbc30 con 0x7f85f015a860 2024-09-13T18:28:56.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.653+0000 7f85f488b700 1 -- 172.21.15.44:0/3328296318 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f85f00cbc30 con 0x7f85f015a860 2024-09-13T18:28:56.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.653+0000 7f85ecff9700 1 -- 172.21.15.44:0/3328296318 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f85f00cbc30 con 0x7f85f015a860 2024-09-13T18:28:56.661 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:28:56.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.657+0000 7f85f488b700 1 -- 172.21.15.44:0/3328296318 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f85d4066730 msgr2=0x7f85d4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.657+0000 7f85f488b700 1 --2- 172.21.15.44:0/3328296318 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f85d4066730 0x7f85d4068bf0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f85e0000c00 tx=0x7f85e0008030 comp rx=0 tx=0).stop 2024-09-13T18:28:56.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.657+0000 7f85f488b700 1 -- 172.21.15.44:0/3328296318 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85f015a860 msgr2=0x7f85f00c8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.657+0000 7f85f488b700 1 --2- 172.21.15.44:0/3328296318 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85f015a860 0x7f85f00c8d20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f85d8009fd0 tx=0x7f85d800ec60 comp rx=0 tx=0).stop 2024-09-13T18:28:56.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.657+0000 7f85f488b700 1 -- 172.21.15.44:0/3328296318 shutdown_connections 2024-09-13T18:28:56.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.657+0000 7f85f488b700 1 --2- 172.21.15.44:0/3328296318 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f85d4066730 0x7f85d4068bf0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.657+0000 7f85f488b700 1 --2- 172.21.15.44:0/3328296318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85f015e450 0x7f85f01f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.657+0000 7f85f488b700 1 --2- 172.21.15.44:0/3328296318 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f85f015a860 0x7f85f00c8d20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.657+0000 7f85f488b700 1 --2- 172.21.15.44:0/3328296318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85f006aba0 0x7f85f0141680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.657+0000 7f85f488b700 1 -- 172.21.15.44:0/3328296318 >> 172.21.15.44:0/3328296318 conn(0x7f85f00b1cd0 msgr2=0x7f85f015c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:56.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.657+0000 7f85f488b700 1 -- 172.21.15.44:0/3328296318 shutdown_connections 2024-09-13T18:28:56.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.657+0000 7f85f488b700 1 -- 172.21.15.44:0/3328296318 wait complete. 2024-09-13T18:28:56.677 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:28:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.781+0000 7fd5aeee6700 1 Processor -- start 2024-09-13T18:28:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.781+0000 7fd5aeee6700 1 -- start start 2024-09-13T18:28:56.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.781+0000 7fd5aeee6700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd5a815b890 0x7fd5a8162220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.781+0000 7fd5aeee6700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd5a80b2b00 0x7fd5a806ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.781+0000 7fd5aeee6700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a8162760 con 0x7fd5a80cdcc0 2024-09-13T18:28:56.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.781+0000 7fd5aeee6700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a815bc70 con 0x7fd5a80b2b00 2024-09-13T18:28:56.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.781+0000 7fd5aeee6700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a80ccc20 con 0x7fd5a815b890 2024-09-13T18:28:56.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.781+0000 7fd5ad483700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd5a80b2b00 0x7fd5a806ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.781+0000 7fd5ad483700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd5a80b2b00 0x7fd5a806ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37250/0 (socket says 172.21.15.44:37250) 2024-09-13T18:28:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.781+0000 7fd5ad483700 1 -- 172.21.15.44:0/870042265 learned_addr learned my addr 172.21.15.44:0/870042265 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.781+0000 7fd5acc82700 1 --2- 172.21.15.44:0/870042265 >> v2:172.21.15.99:3300/0 conn(0x7fd5a815b890 0x7fd5a8162220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.781+0000 7fd5ad483700 1 -- 172.21.15.44:0/870042265 >> v2:172.21.15.99:3300/0 conn(0x7fd5a815b890 msgr2=0x7fd5a8162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.781+0000 7fd5ad483700 1 --2- 172.21.15.44:0/870042265 >> v2:172.21.15.99:3300/0 conn(0x7fd5a815b890 0x7fd5a8162220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.781+0000 7fd5ad483700 1 -- 172.21.15.44:0/870042265 >> v1:172.21.15.99:6789/0 conn(0x7fd5a80cdcc0 legacy=0x7fd5a80b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.781+0000 7fd5ad483700 1 -- 172.21.15.44:0/870042265 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a80ccf00 con 0x7fd5a80b2b00 2024-09-13T18:28:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.781+0000 7fd5ad483700 1 --2- 172.21.15.44:0/870042265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5a80b2b00 0x7fd5a806ffe0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80b1750 tx=0x7fd5a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5864cf92a35d9ac3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:56.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.781+0000 7fd5a77fe700 1 -- 172.21.15.44:0/870042265 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a000e070 con 0x7fd5a80b2b00 2024-09-13T18:28:56.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.781+0000 7fd5a77fe700 1 -- 172.21.15.44:0/870042265 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a0003a40 con 0x7fd5a80b2b00 2024-09-13T18:28:56.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.781+0000 7fd5a77fe700 1 -- 172.21.15.44:0/870042265 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0003df0 con 0x7fd5a80b2b00 2024-09-13T18:28:56.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.785+0000 7fd5aeee6700 1 -- 172.21.15.44:0/870042265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5a80b2b00 msgr2=0x7fd5a806ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.785+0000 7fd5aeee6700 1 --2- 172.21.15.44:0/870042265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5a80b2b00 0x7fd5a806ffe0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80b1750 tx=0x7fd5a000b330 comp rx=0 tx=0).stop 2024-09-13T18:28:56.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.785+0000 7fd5aeee6700 1 -- 172.21.15.44:0/870042265 shutdown_connections 2024-09-13T18:28:56.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.785+0000 7fd5aeee6700 1 --2- 172.21.15.44:0/870042265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5a80b2b00 0x7fd5a806ffe0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.785+0000 7fd5aeee6700 1 --2- 172.21.15.44:0/870042265 >> v2:172.21.15.99:3300/0 conn(0x7fd5a815b890 0x7fd5a8162220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.785+0000 7fd5aeee6700 1 -- 172.21.15.44:0/870042265 >> 172.21.15.44:0/870042265 conn(0x7fd5a80ce980 msgr2=0x7fd5a80ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:56.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.785+0000 7fd5aeee6700 1 -- 172.21.15.44:0/870042265 shutdown_connections 2024-09-13T18:28:56.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.785+0000 7fd5aeee6700 1 -- 172.21.15.44:0/870042265 wait complete. 2024-09-13T18:28:56.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.785+0000 7fd5aeee6700 1 Processor -- start 2024-09-13T18:28:56.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.785+0000 7fd5aeee6700 1 -- start start 2024-09-13T18:28:56.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.789+0000 7fd5aeee6700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5a80b2b00 0x7fd5a81645c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.789+0000 7fd5aeee6700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5a80cdcc0 0x7fd5a81f6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.789+0000 7fd5aeee6700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd5a815b890 0x7fd5a81603e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.789+0000 7fd5aeee6700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a8163320 con 0x7fd5a80b2b00 2024-09-13T18:28:56.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.789+0000 7fd5aeee6700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a8151a50 con 0x7fd5a80cdcc0 2024-09-13T18:28:56.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.789+0000 7fd5aeee6700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a81635a0 con 0x7fd5a815b890 2024-09-13T18:28:56.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.789+0000 7fd5acc82700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5a80b2b00 0x7fd5a81645c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.789+0000 7fd5acc82700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5a80b2b00 0x7fd5a81645c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37256/0 (socket says 172.21.15.44:37256) 2024-09-13T18:28:56.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.789+0000 7fd5acc82700 1 -- 172.21.15.44:0/361150021 learned_addr learned my addr 172.21.15.44:0/361150021 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:56.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.789+0000 7fd5a7fff700 1 --2- 172.21.15.44:0/361150021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5a80cdcc0 0x7fd5a81f6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.789+0000 7fd5ad483700 1 --2- 172.21.15.44:0/361150021 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd5a815b890 0x7fd5a81603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.789+0000 7fd5acc82700 1 -- 172.21.15.44:0/361150021 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd5a815b890 msgr2=0x7fd5a81603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.789+0000 7fd5acc82700 1 --2- 172.21.15.44:0/361150021 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd5a815b890 0x7fd5a81603e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.789+0000 7fd5acc82700 1 -- 172.21.15.44:0/361150021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5a80cdcc0 msgr2=0x7fd5a81f6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.789+0000 7fd5acc82700 1 --2- 172.21.15.44:0/361150021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5a80cdcc0 0x7fd5a81f6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.789+0000 7fd5acc82700 1 -- 172.21.15.44:0/361150021 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a0009b30 con 0x7fd5a80b2b00 2024-09-13T18:28:56.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.789+0000 7fd5acc82700 1 --2- 172.21.15.44:0/361150021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5a80b2b00 0x7fd5a81645c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd59000d800 tx=0x7fd59000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:56.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.789+0000 7fd5a57fa700 1 -- 172.21.15.44:0/361150021 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5900125f0 con 0x7fd5a80b2b00 2024-09-13T18:28:56.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.789+0000 7fd5a57fa700 1 -- 172.21.15.44:0/361150021 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd590012750 con 0x7fd5a80b2b00 2024-09-13T18:28:56.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.789+0000 7fd5aeee6700 1 -- 172.21.15.44:0/361150021 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a8163880 con 0x7fd5a80b2b00 2024-09-13T18:28:56.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.789+0000 7fd5a57fa700 1 -- 172.21.15.44:0/361150021 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd590012ac0 con 0x7fd5a80b2b00 2024-09-13T18:28:56.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.789+0000 7fd5aeee6700 1 -- 172.21.15.44:0/361150021 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a8151d10 con 0x7fd5a80b2b00 2024-09-13T18:28:56.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.793+0000 7fd5aeee6700 1 -- 172.21.15.44:0/361150021 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a80ce100 con 0x7fd5a80b2b00 2024-09-13T18:28:56.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.793+0000 7fd5a57fa700 1 -- 172.21.15.44:0/361150021 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd590012c20 con 0x7fd5a80b2b00 2024-09-13T18:28:56.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.793+0000 7fd5a57fa700 1 --2- 172.21.15.44:0/361150021 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd588066730 0x7fd588068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.793+0000 7fd5a57fa700 1 -- 172.21.15.44:0/361150021 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd590084200 con 0x7fd5a80b2b00 2024-09-13T18:28:56.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.793+0000 7fd5a7fff700 1 --2- 172.21.15.44:0/361150021 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd588066730 0x7fd588068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.797+0000 7fd5a7fff700 1 --2- 172.21.15.44:0/361150021 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd588066730 0x7fd588068bf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80714f0 tx=0x7fd598007ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:56.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:56.801+0000 7fd5a57fa700 1 -- 172.21.15.44:0/361150021 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd590051510 con 0x7fd5a80b2b00 2024-09-13T18:28:57.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.009+0000 7fd5aeee6700 1 -- 172.21.15.44:0/361150021 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5a8070150 con 0x7fd5a80b2b00 2024-09-13T18:28:57.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.009+0000 7fd5a57fa700 1 -- 172.21.15.44:0/361150021 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4732 (secure 0 0 0) 0x7fd590054b30 con 0x7fd5a80b2b00 2024-09-13T18:28:57.016 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:57.016 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5191,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/2593282586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2593282586},{"type":"v1","addr":"172.21.15.99:6836","nonce":2593282586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3094334762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3094334762},{"type":"v1","addr":"172.21.15.99:6837","nonce":3094334762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1843893566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1843893566},{"type":"v1","addr":"172.21.15.44:6833","nonce":1843893566}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:28:05.062964+0000","modified":"2024-09-13T18:28:41.727358+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5580},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5580":{"gid":5580,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.44:6835/438860530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":438860530},{"type":"v1","addr":"172.21.15.44:6835","nonce":438860530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:28:57.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.009+0000 7fd5aeee6700 1 -- 172.21.15.44:0/361150021 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd588066730 msgr2=0x7fd588068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:57.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.009+0000 7fd5aeee6700 1 --2- 172.21.15.44:0/361150021 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd588066730 0x7fd588068bf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80714f0 tx=0x7fd598007ee0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.009+0000 7fd5aeee6700 1 -- 172.21.15.44:0/361150021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5a80b2b00 msgr2=0x7fd5a81645c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:57.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.009+0000 7fd5aeee6700 1 --2- 172.21.15.44:0/361150021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5a80b2b00 0x7fd5a81645c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd59000d800 tx=0x7fd59000db10 comp rx=0 tx=0).stop 2024-09-13T18:28:57.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.009+0000 7fd5aeee6700 1 -- 172.21.15.44:0/361150021 shutdown_connections 2024-09-13T18:28:57.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.009+0000 7fd5aeee6700 1 --2- 172.21.15.44:0/361150021 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd588066730 0x7fd588068bf0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.009+0000 7fd5aeee6700 1 --2- 172.21.15.44:0/361150021 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd5a815b890 0x7fd5a81603e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.009+0000 7fd5aeee6700 1 --2- 172.21.15.44:0/361150021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5a80cdcc0 0x7fd5a81f6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.009+0000 7fd5aeee6700 1 --2- 172.21.15.44:0/361150021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5a80b2b00 0x7fd5a81645c0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.009+0000 7fd5aeee6700 1 -- 172.21.15.44:0/361150021 >> 172.21.15.44:0/361150021 conn(0x7fd5a80ce980 msgr2=0x7fd5a8070520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:57.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.009+0000 7fd5aeee6700 1 -- 172.21.15.44:0/361150021 shutdown_connections 2024-09-13T18:28:57.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.009+0000 7fd5aeee6700 1 -- 172.21.15.44:0/361150021 wait complete. 2024-09-13T18:28:57.020 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 23 2024-09-13T18:28:57.031 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:28:57.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.133+0000 7f293ffff700 1 Processor -- start 2024-09-13T18:28:57.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.137+0000 7f293ffff700 1 -- start start 2024-09-13T18:28:57.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.137+0000 7f293ffff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2940159c80 0x7f294015a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:57.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.137+0000 7f293ffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f294006b420 0x7f29400b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:57.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.137+0000 7f293ffff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294006be50 con 0x7f294006b8b0 2024-09-13T18:28:57.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.137+0000 7f293ffff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f294015a6e0 con 0x7f294006b420 2024-09-13T18:28:57.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.137+0000 7f293ffff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f294015a8c0 con 0x7f2940159c80 2024-09-13T18:28:57.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.137+0000 7f2937fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f294006b420 0x7f29400b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:57.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.137+0000 7f2937fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f294006b420 0x7f29400b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37272/0 (socket says 172.21.15.44:37272) 2024-09-13T18:28:57.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.137+0000 7f2937fff700 1 -- 172.21.15.44:0/2291403521 learned_addr learned my addr 172.21.15.44:0/2291403521 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:57.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.137+0000 7f293effd700 1 --2- 172.21.15.44:0/2291403521 >> v2:172.21.15.99:3300/0 conn(0x7f2940159c80 0x7f294015a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:57.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.137+0000 7f2937fff700 1 -- 172.21.15.44:0/2291403521 >> v2:172.21.15.99:3300/0 conn(0x7f2940159c80 msgr2=0x7f294015a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:57.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.137+0000 7f2937fff700 1 --2- 172.21.15.44:0/2291403521 >> v2:172.21.15.99:3300/0 conn(0x7f2940159c80 0x7f294015a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.137+0000 7f2937fff700 1 -- 172.21.15.44:0/2291403521 >> v1:172.21.15.99:6789/0 conn(0x7f294006b8b0 legacy=0x7f294015cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:57.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.137+0000 7f2937fff700 1 -- 172.21.15.44:0/2291403521 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294015aba0 con 0x7f294006b420 2024-09-13T18:28:57.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.137+0000 7f2937fff700 1 --2- 172.21.15.44:0/2291403521 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f294006b420 0x7f29400b31c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f29400674b0 tx=0x7f292800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451e2dcc6c2a301c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:57.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.137+0000 7f293e7fc700 1 -- 172.21.15.44:0/2291403521 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292800dc10 con 0x7f294006b420 2024-09-13T18:28:57.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.137+0000 7f293e7fc700 1 -- 172.21.15.44:0/2291403521 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292800dd70 con 0x7f294006b420 2024-09-13T18:28:57.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.137+0000 7f293e7fc700 1 -- 172.21.15.44:0/2291403521 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2928004250 con 0x7f294006b420 2024-09-13T18:28:57.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.141+0000 7f293ffff700 1 -- 172.21.15.44:0/2291403521 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f294006b420 msgr2=0x7f29400b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:57.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.141+0000 7f293ffff700 1 --2- 172.21.15.44:0/2291403521 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f294006b420 0x7f29400b31c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f29400674b0 tx=0x7f292800bea0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.141+0000 7f293ffff700 1 -- 172.21.15.44:0/2291403521 shutdown_connections 2024-09-13T18:28:57.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.141+0000 7f293ffff700 1 --2- 172.21.15.44:0/2291403521 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f294006b420 0x7f29400b31c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.141+0000 7f293ffff700 1 --2- 172.21.15.44:0/2291403521 >> v2:172.21.15.99:3300/0 conn(0x7f2940159c80 0x7f294015a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.141+0000 7f293ffff700 1 -- 172.21.15.44:0/2291403521 >> 172.21.15.44:0/2291403521 conn(0x7f294006d900 msgr2=0x7f294006dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:57.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.141+0000 7f293ffff700 1 -- 172.21.15.44:0/2291403521 shutdown_connections 2024-09-13T18:28:57.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.141+0000 7f293ffff700 1 -- 172.21.15.44:0/2291403521 wait complete. 2024-09-13T18:28:57.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.141+0000 7f293ffff700 1 Processor -- start 2024-09-13T18:28:57.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.141+0000 7f293ffff700 1 -- start start 2024-09-13T18:28:57.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.145+0000 7f293ffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f294006b420 0x7f29401f24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:57.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.145+0000 7f293ffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f294006b8b0 0x7f2940145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:57.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.145+0000 7f293ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2940159c80 0x7f29400ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:57.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.145+0000 7f293ffff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2940146150 con 0x7f2940159c80 2024-09-13T18:28:57.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.145+0000 7f293ffff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29401524f0 con 0x7f294006b420 2024-09-13T18:28:57.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.145+0000 7f293ffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29400cbcc0 con 0x7f294006b8b0 2024-09-13T18:28:57.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.145+0000 7f293f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2940159c80 0x7f29400ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:57.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.145+0000 7f293f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2940159c80 0x7f29400ce6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37282/0 (socket says 172.21.15.44:37282) 2024-09-13T18:28:57.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.145+0000 7f293f7fe700 1 -- 172.21.15.44:0/398495818 learned_addr learned my addr 172.21.15.44:0/398495818 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:57.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.145+0000 7f293effd700 1 --2- 172.21.15.44:0/398495818 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f294006b420 0x7f29401f24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:57.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.145+0000 7f2937fff700 1 --2- 172.21.15.44:0/398495818 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f294006b8b0 0x7f2940145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:57.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.145+0000 7f293f7fe700 1 -- 172.21.15.44:0/398495818 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f294006b8b0 msgr2=0x7f2940145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:57.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.145+0000 7f293f7fe700 1 --2- 172.21.15.44:0/398495818 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f294006b8b0 0x7f2940145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.145+0000 7f293f7fe700 1 -- 172.21.15.44:0/398495818 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f294006b420 msgr2=0x7f29401f24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:57.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.145+0000 7f293f7fe700 1 --2- 172.21.15.44:0/398495818 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f294006b420 0x7f29401f24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.145+0000 7f293f7fe700 1 -- 172.21.15.44:0/398495818 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292800b820 con 0x7f2940159c80 2024-09-13T18:28:57.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.145+0000 7f293f7fe700 1 --2- 172.21.15.44:0/398495818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2940159c80 0x7f29400ce6d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f293800cb40 tx=0x7f293800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:57.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.145+0000 7f29377fe700 1 -- 172.21.15.44:0/398495818 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2938003c20 con 0x7f2940159c80 2024-09-13T18:28:57.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.145+0000 7f29377fe700 1 -- 172.21.15.44:0/398495818 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2938003d80 con 0x7f2940159c80 2024-09-13T18:28:57.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.145+0000 7f293ffff700 1 -- 172.21.15.44:0/398495818 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2940151ea0 con 0x7f2940159c80 2024-09-13T18:28:57.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.145+0000 7f29377fe700 1 -- 172.21.15.44:0/398495818 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293800aa20 con 0x7f2940159c80 2024-09-13T18:28:57.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.145+0000 7f293ffff700 1 -- 172.21.15.44:0/398495818 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29400cb830 con 0x7f2940159c80 2024-09-13T18:28:57.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.145+0000 7f293ffff700 1 -- 172.21.15.44:0/398495818 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2940151d00 con 0x7f2940159c80 2024-09-13T18:28:57.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.149+0000 7f29377fe700 1 -- 172.21.15.44:0/398495818 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f293800ab80 con 0x7f2940159c80 2024-09-13T18:28:57.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.149+0000 7f29377fe700 1 --2- 172.21.15.44:0/398495818 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2920066730 0x7f2920068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:57.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.149+0000 7f29377fe700 1 -- 172.21.15.44:0/398495818 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2938084130 con 0x7f2940159c80 2024-09-13T18:28:57.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.149+0000 7f293effd700 1 --2- 172.21.15.44:0/398495818 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2920066730 0x7f2920068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:57.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.149+0000 7f293effd700 1 --2- 172.21.15.44:0/398495818 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2920066730 0x7f2920068bf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2930009a00 tx=0x7f2930008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:57.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.157+0000 7f29377fe700 1 -- 172.21.15.44:0/398495818 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2940151d00 con 0x7f2940159c80 2024-09-13T18:28:57.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.329+0000 7f293ffff700 1 -- 172.21.15.44:0/398495818 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2940151d00 con 0x7f2940159c80 2024-09-13T18:28:57.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.333+0000 7f29377fe700 1 -- 172.21.15.44:0/398495818 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16636 (secure 0 0 0) 0x7f2940151d00 con 0x7f2940159c80 2024-09-13T18:28:57.341 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:57.342 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":36,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:28:29.639664+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:28:02.951723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:28:04.057772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/939073284":"2024-09-14T18:28:29.639607+0000","172.21.15.44:6834/939073284":"2024-09-14T18:28:29.639607+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:28:57.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.337+0000 7f293ffff700 1 -- 172.21.15.44:0/398495818 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2920066730 msgr2=0x7f2920068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.337+0000 7f293ffff700 1 --2- 172.21.15.44:0/398495818 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2920066730 0x7f2920068bf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2930009a00 tx=0x7f2930008040 comp rx=0 tx=0).stop 2024-09-13T18:28:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.337+0000 7f293ffff700 1 -- 172.21.15.44:0/398495818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2940159c80 msgr2=0x7f29400ce6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.337+0000 7f293ffff700 1 --2- 172.21.15.44:0/398495818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2940159c80 0x7f29400ce6d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f293800cb40 tx=0x7f293800ce50 comp rx=0 tx=0).stop 2024-09-13T18:28:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.337+0000 7f293ffff700 1 -- 172.21.15.44:0/398495818 shutdown_connections 2024-09-13T18:28:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.337+0000 7f293ffff700 1 --2- 172.21.15.44:0/398495818 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2920066730 0x7f2920068bf0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.337+0000 7f293ffff700 1 --2- 172.21.15.44:0/398495818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2940159c80 0x7f29400ce6d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.337+0000 7f293ffff700 1 --2- 172.21.15.44:0/398495818 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f294006b8b0 0x7f2940145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.337+0000 7f293ffff700 1 --2- 172.21.15.44:0/398495818 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f294006b420 0x7f29401f24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.337+0000 7f293ffff700 1 -- 172.21.15.44:0/398495818 >> 172.21.15.44:0/398495818 conn(0x7f294006d900 msgr2=0x7f29400aed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.337+0000 7f293ffff700 1 -- 172.21.15.44:0/398495818 shutdown_connections 2024-09-13T18:28:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.337+0000 7f293ffff700 1 -- 172.21.15.44:0/398495818 wait complete. 2024-09-13T18:28:57.356 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:28:57.357 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:28:57.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d89c1700 1 Processor -- start 2024-09-13T18:28:57.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d89c1700 1 -- start start 2024-09-13T18:28:57.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d89c1700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50d4160d90 0x7f50d40b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:57.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d89c1700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f50d40722c0 0x7f50d4161170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:57.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d89c1700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d40b4360 con 0x7f50d40ae6c0 2024-09-13T18:28:57.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d89c1700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d40b29a0 con 0x7f50d40722c0 2024-09-13T18:28:57.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d89c1700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d40b4640 con 0x7f50d4160d90 2024-09-13T18:28:57.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d259c700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f50d40ae6c0 0x7f50d4071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46252/0 (socket says 172.21.15.44:46252) 2024-09-13T18:28:57.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d259c700 1 -- 172.21.15.44:0/2711857697 learned_addr learned my addr 172.21.15.44:0/2711857697 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:57.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d359e700 1 --2- 172.21.15.44:0/2711857697 >> v2:172.21.15.99:3300/0 conn(0x7f50d40722c0 0x7f50d4161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:57.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d2d9d700 1 --2- 172.21.15.44:0/2711857697 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50d4160d90 0x7f50d40b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:57.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d1d9b700 1 -- 172.21.15.44:0/2711857697 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144108987 0 0) 0x7f50d40b4360 con 0x7f50d40ae6c0 2024-09-13T18:28:57.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d1d9b700 1 -- 172.21.15.44:0/2711857697 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50c00035d0 con 0x7f50d40ae6c0 2024-09-13T18:28:57.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d1d9b700 1 -- 172.21.15.44:0/2711857697 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1472181616 0 0) 0x7f50c00035d0 con 0x7f50d40ae6c0 2024-09-13T18:28:57.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d1d9b700 1 -- 172.21.15.44:0/2711857697 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50d4160d90 msgr2=0x7f50d40b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:57.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d1d9b700 1 --2- 172.21.15.44:0/2711857697 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50d4160d90 0x7f50d40b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d1d9b700 1 -- 172.21.15.44:0/2711857697 >> v2:172.21.15.99:3300/0 conn(0x7f50d40722c0 msgr2=0x7f50d4161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:57.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d1d9b700 1 --2- 172.21.15.44:0/2711857697 >> v2:172.21.15.99:3300/0 conn(0x7f50d40722c0 0x7f50d4161170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d1d9b700 1 -- 172.21.15.44:0/2711857697 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d40b2bb0 con 0x7f50d40ae6c0 2024-09-13T18:28:57.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d1d9b700 1 -- 172.21.15.44:0/2711857697 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f50cc0019f0 con 0x7f50d40ae6c0 2024-09-13T18:28:57.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d1d9b700 1 -- 172.21.15.44:0/2711857697 >> v1:172.21.15.44:6789/0 conn(0x7f50d40ae6c0 legacy=0x7f50d4071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:57.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d1d9b700 1 --2- 172.21.15.44:0/2711857697 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50d4160d90 0x7f50c0003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:57.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d1d9b700 1 --2- 172.21.15.44:0/2711857697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50c0003fa0 0x7f50c0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:57.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d1d9b700 1 --2- 172.21.15.44:0/2711857697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50c0004db0 0x7f50c0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:57.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d1d9b700 1 -- 172.21.15.44:0/2711857697 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d40b29a0 con 0x7f50c0004db0 2024-09-13T18:28:57.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d1d9b700 1 -- 172.21.15.44:0/2711857697 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d40b4640 con 0x7f50c0003fa0 2024-09-13T18:28:57.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d1d9b700 1 -- 172.21.15.44:0/2711857697 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c000ba30 con 0x7f50d4160d90 2024-09-13T18:28:57.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d259c700 1 --2- 172.21.15.44:0/2711857697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50c0003fa0 0x7f50c0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:57.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d359e700 1 --2- 172.21.15.44:0/2711857697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50c0004db0 0x7f50c0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:57.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d2d9d700 1 --2- 172.21.15.44:0/2711857697 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50d4160d90 0x7f50c0003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:57.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d259c700 1 -- 172.21.15.44:0/2711857697 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50d4160d90 msgr2=0x7f50c0003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:57.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d259c700 1 --2- 172.21.15.44:0/2711857697 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50d4160d90 0x7f50c0003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d259c700 1 -- 172.21.15.44:0/2711857697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50c0004db0 msgr2=0x7f50c0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:57.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d259c700 1 --2- 172.21.15.44:0/2711857697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50c0004db0 0x7f50c0005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d259c700 1 -- 172.21.15.44:0/2711857697 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c00035d0 con 0x7f50c0003fa0 2024-09-13T18:28:57.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.469+0000 7f50d359e700 1 --2- 172.21.15.44:0/2711857697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50c0004db0 0x7f50c0005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:57.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.473+0000 7f50d259c700 1 --2- 172.21.15.44:0/2711857697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50c0003fa0 0x7f50c0004870 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f50d40b42b0 tx=0x7f50c00058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a879c34f8226dd7c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:57.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.473+0000 7f50d1d9b700 1 -- 172.21.15.44:0/2711857697 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc00a340 con 0x7f50c0003fa0 2024-09-13T18:28:57.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.473+0000 7f50d1d9b700 1 -- 172.21.15.44:0/2711857697 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50cc0072d0 con 0x7f50c0003fa0 2024-09-13T18:28:57.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.473+0000 7f50d1d9b700 1 -- 172.21.15.44:0/2711857697 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc007680 con 0x7f50c0003fa0 2024-09-13T18:28:57.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.473+0000 7f50d89c1700 1 -- 172.21.15.44:0/2711857697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50c0003fa0 msgr2=0x7f50c0004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:57.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.473+0000 7f50d89c1700 1 --2- 172.21.15.44:0/2711857697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50c0003fa0 0x7f50c0004870 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f50d40b42b0 tx=0x7f50c00058a0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.473+0000 7f50d359e700 1 -- 172.21.15.44:0/2711857697 reap_dead start 2024-09-13T18:28:57.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.473+0000 7f50d89c1700 1 -- 172.21.15.44:0/2711857697 shutdown_connections 2024-09-13T18:28:57.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.473+0000 7f50d89c1700 1 -- 172.21.15.44:0/2711857697 >> 172.21.15.44:0/2711857697 conn(0x7f50d40cf910 msgr2=0x7f50d40cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:57.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.473+0000 7f50d89c1700 1 -- 172.21.15.44:0/2711857697 shutdown_connections 2024-09-13T18:28:57.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.473+0000 7f50d89c1700 1 -- 172.21.15.44:0/2711857697 wait complete. 2024-09-13T18:28:57.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.473+0000 7f50d89c1700 1 Processor -- start 2024-09-13T18:28:57.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.473+0000 7f50d89c1700 1 -- start start 2024-09-13T18:28:57.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.477+0000 7f50d89c1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50d4154d90 0x7f50d415da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:57.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.477+0000 7f50d89c1700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50d4155170 0x7f50d4157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:57.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.477+0000 7f50d89c1700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50d41576d0 0x7f50d4155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:57.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.477+0000 7f50d89c1700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d415dfc0 con 0x7f50d4154d90 2024-09-13T18:28:57.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.477+0000 7f50d89c1700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d4157b50 con 0x7f50d41576d0 2024-09-13T18:28:57.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.477+0000 7f50d89c1700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d41564b0 con 0x7f50d4155170 2024-09-13T18:28:57.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.477+0000 7f50d2d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50d4154d90 0x7f50d415da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:57.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.477+0000 7f50d2d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50d4154d90 0x7f50d415da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37290/0 (socket says 172.21.15.44:37290) 2024-09-13T18:28:57.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.477+0000 7f50d2d9d700 1 -- 172.21.15.44:0/1191179037 learned_addr learned my addr 172.21.15.44:0/1191179037 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:57.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.477+0000 7f50d359e700 1 --2- 172.21.15.44:0/1191179037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50d41576d0 0x7f50d4155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:57.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.477+0000 7f50d259c700 1 --2- 172.21.15.44:0/1191179037 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50d4155170 0x7f50d4157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:57.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.477+0000 7f50d359e700 1 -- 172.21.15.44:0/1191179037 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50d4155170 msgr2=0x7f50d4157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:57.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.477+0000 7f50d359e700 1 --2- 172.21.15.44:0/1191179037 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50d4155170 0x7f50d4157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.477+0000 7f50d359e700 1 -- 172.21.15.44:0/1191179037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50d4154d90 msgr2=0x7f50d415da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:57.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.477+0000 7f50d359e700 1 --2- 172.21.15.44:0/1191179037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50d4154d90 0x7f50d415da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.477+0000 7f50d359e700 1 -- 172.21.15.44:0/1191179037 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d406ad20 con 0x7f50d41576d0 2024-09-13T18:28:57.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.477+0000 7f50d359e700 1 --2- 172.21.15.44:0/1191179037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50d41576d0 0x7f50d4155740 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f50d40ce280 tx=0x7f50c4011eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:57.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.477+0000 7f50cb7fe700 1 -- 172.21.15.44:0/1191179037 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c401b070 con 0x7f50d41576d0 2024-09-13T18:28:57.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.477+0000 7f50cb7fe700 1 -- 172.21.15.44:0/1191179037 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c4004020 con 0x7f50d41576d0 2024-09-13T18:28:57.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.477+0000 7f50d89c1700 1 -- 172.21.15.44:0/1191179037 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d406b000 con 0x7f50d41576d0 2024-09-13T18:28:57.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.477+0000 7f50cb7fe700 1 -- 172.21.15.44:0/1191179037 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c40041d0 con 0x7f50d41576d0 2024-09-13T18:28:57.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.477+0000 7f50d89c1700 1 -- 172.21.15.44:0/1191179037 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d4155c80 con 0x7f50d41576d0 2024-09-13T18:28:57.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.477+0000 7f50d89c1700 1 -- 172.21.15.44:0/1191179037 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d406ab80 con 0x7f50d41576d0 2024-09-13T18:28:57.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.481+0000 7f50cb7fe700 1 -- 172.21.15.44:0/1191179037 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f50c4004330 con 0x7f50d41576d0 2024-09-13T18:28:57.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.481+0000 7f50cb7fe700 1 --2- 172.21.15.44:0/1191179037 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f50b4066730 0x7f50b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:57.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.481+0000 7f50cb7fe700 1 -- 172.21.15.44:0/1191179037 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f50c40841c0 con 0x7f50d41576d0 2024-09-13T18:28:57.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.481+0000 7f50d2d9d700 1 --2- 172.21.15.44:0/1191179037 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f50b4066730 0x7f50b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:57.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.485+0000 7f50d2d9d700 1 --2- 172.21.15.44:0/1191179037 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f50b4066730 0x7f50b4068bf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f50d415d800 tx=0x7f50bc009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:57.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.489+0000 7f50cb7fe700 1 -- 172.21.15.44:0/1191179037 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f50c40514f0 con 0x7f50d41576d0 2024-09-13T18:28:57.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.701+0000 7f50d89c1700 1 -- 172.21.15.44:0/1191179037 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50d406b520 con 0x7f50d41576d0 2024-09-13T18:28:57.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.701+0000 7f50cb7fe700 1 -- 172.21.15.44:0/1191179037 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4732 (secure 0 0 0) 0x7f50d406b520 con 0x7f50d41576d0 2024-09-13T18:28:57.709 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:57.709 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5191,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/2593282586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2593282586},{"type":"v1","addr":"172.21.15.99:6836","nonce":2593282586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3094334762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3094334762},{"type":"v1","addr":"172.21.15.99:6837","nonce":3094334762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1843893566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1843893566},{"type":"v1","addr":"172.21.15.44:6833","nonce":1843893566}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:28:05.062964+0000","modified":"2024-09-13T18:28:41.727358+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5580},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5580":{"gid":5580,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.44:6835/438860530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":438860530},{"type":"v1","addr":"172.21.15.44:6835","nonce":438860530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:28:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.705+0000 7f50d89c1700 1 -- 172.21.15.44:0/1191179037 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f50b4066730 msgr2=0x7f50b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.705+0000 7f50d89c1700 1 --2- 172.21.15.44:0/1191179037 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f50b4066730 0x7f50b4068bf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f50d415d800 tx=0x7f50bc009240 comp rx=0 tx=0).stop 2024-09-13T18:28:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.705+0000 7f50d89c1700 1 -- 172.21.15.44:0/1191179037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50d41576d0 msgr2=0x7f50d4155740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.705+0000 7f50d89c1700 1 --2- 172.21.15.44:0/1191179037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50d41576d0 0x7f50d4155740 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f50d40ce280 tx=0x7f50c4011eb0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.705+0000 7f50d89c1700 1 -- 172.21.15.44:0/1191179037 shutdown_connections 2024-09-13T18:28:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.705+0000 7f50d89c1700 1 --2- 172.21.15.44:0/1191179037 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f50b4066730 0x7f50b4068bf0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.705+0000 7f50d89c1700 1 --2- 172.21.15.44:0/1191179037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50d41576d0 0x7f50d4155740 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.705+0000 7f50d89c1700 1 --2- 172.21.15.44:0/1191179037 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50d4155170 0x7f50d4157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.705+0000 7f50d89c1700 1 --2- 172.21.15.44:0/1191179037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50d4154d90 0x7f50d415da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.705+0000 7f50d89c1700 1 -- 172.21.15.44:0/1191179037 >> 172.21.15.44:0/1191179037 conn(0x7f50d40cf910 msgr2=0x7f50d4071870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.705+0000 7f50d89c1700 1 -- 172.21.15.44:0/1191179037 shutdown_connections 2024-09-13T18:28:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.705+0000 7f50d89c1700 1 -- 172.21.15.44:0/1191179037 wait complete. 2024-09-13T18:28:57.714 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 23 2024-09-13T18:28:57.729 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:28:57.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.837+0000 7f6f596f4700 1 Processor -- start 2024-09-13T18:28:57.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.837+0000 7f6f596f4700 1 -- start start 2024-09-13T18:28:57.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.837+0000 7f6f596f4700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6f5415cae0 0x7f6f540cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:57.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.837+0000 7f6f596f4700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6f5406b310 0x7f6f540d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:57.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.837+0000 7f6f596f4700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f540d21e0 con 0x7f6f5415cec0 2024-09-13T18:28:57.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.837+0000 7f6f596f4700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f540d1750 con 0x7f6f5406b310 2024-09-13T18:28:57.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.837+0000 7f6f596f4700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f540d1940 con 0x7f6f5415cae0 2024-09-13T18:28:57.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.837+0000 7f6f58ef3700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6f5406b310 0x7f6f540d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:57.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.837+0000 7f6f537fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f6f5415cec0 0x7f6f5406ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46268/0 (socket says 172.21.15.44:46268) 2024-09-13T18:28:57.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.837+0000 7f6f537fe700 1 -- 172.21.15.44:0/3282596915 learned_addr learned my addr 172.21.15.44:0/3282596915 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:57.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.837+0000 7f6f53fff700 1 --2- 172.21.15.44:0/3282596915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6f5415cae0 0x7f6f540cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:57.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.837+0000 7f6f58ef3700 1 -- 172.21.15.44:0/3282596915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6f5415cae0 msgr2=0x7f6f540cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:57.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.837+0000 7f6f58ef3700 1 --2- 172.21.15.44:0/3282596915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6f5415cae0 0x7f6f540cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.837+0000 7f6f58ef3700 1 -- 172.21.15.44:0/3282596915 >> v1:172.21.15.44:6789/0 conn(0x7f6f5415cec0 legacy=0x7f6f5406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:57.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.837+0000 7f6f58ef3700 1 -- 172.21.15.44:0/3282596915 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f540d1c20 con 0x7f6f5406b310 2024-09-13T18:28:57.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.837+0000 7f6f58ef3700 1 --2- 172.21.15.44:0/3282596915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f5406b310 0x7f6f540d1210 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009850 tx=0x7f6f4c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c57dd24e7a24eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:57.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.837+0000 7f6f52ffd700 1 -- 172.21.15.44:0/3282596915 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c011830 con 0x7f6f5406b310 2024-09-13T18:28:57.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.837+0000 7f6f52ffd700 1 -- 172.21.15.44:0/3282596915 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c011990 con 0x7f6f5406b310 2024-09-13T18:28:57.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.837+0000 7f6f52ffd700 1 -- 172.21.15.44:0/3282596915 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c011d20 con 0x7f6f5406b310 2024-09-13T18:28:57.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.841+0000 7f6f596f4700 1 -- 172.21.15.44:0/3282596915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f5406b310 msgr2=0x7f6f540d1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:57.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.841+0000 7f6f596f4700 1 --2- 172.21.15.44:0/3282596915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f5406b310 0x7f6f540d1210 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009850 tx=0x7f6f4c009b60 comp rx=0 tx=0).stop 2024-09-13T18:28:57.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.841+0000 7f6f596f4700 1 -- 172.21.15.44:0/3282596915 shutdown_connections 2024-09-13T18:28:57.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.841+0000 7f6f596f4700 1 --2- 172.21.15.44:0/3282596915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f5406b310 0x7f6f540d1210 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.841+0000 7f6f596f4700 1 --2- 172.21.15.44:0/3282596915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6f5415cae0 0x7f6f540cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.841+0000 7f6f596f4700 1 -- 172.21.15.44:0/3282596915 >> 172.21.15.44:0/3282596915 conn(0x7f6f540d2c80 msgr2=0x7f6f540d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:57.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.841+0000 7f6f596f4700 1 -- 172.21.15.44:0/3282596915 shutdown_connections 2024-09-13T18:28:57.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.841+0000 7f6f596f4700 1 -- 172.21.15.44:0/3282596915 wait complete. 2024-09-13T18:28:57.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.841+0000 7f6f596f4700 1 Processor -- start 2024-09-13T18:28:57.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.841+0000 7f6f596f4700 1 -- start start 2024-09-13T18:28:57.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.841+0000 7f6f596f4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f5406b310 0x7f6f54152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:57.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.841+0000 7f6f596f4700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6f5415cae0 0x7f6f540cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:57.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.841+0000 7f6f596f4700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f5415cec0 0x7f6f54155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:57.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.841+0000 7f6f596f4700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f54152960 con 0x7f6f5406b310 2024-09-13T18:28:57.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.841+0000 7f6f596f4700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f540cccc0 con 0x7f6f5415cec0 2024-09-13T18:28:57.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.841+0000 7f6f596f4700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f54154830 con 0x7f6f5415cae0 2024-09-13T18:28:57.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.841+0000 7f6f53fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f5406b310 0x7f6f54152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:57.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.845+0000 7f6f53fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f5406b310 0x7f6f54152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37302/0 (socket says 172.21.15.44:37302) 2024-09-13T18:28:57.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.845+0000 7f6f53fff700 1 -- 172.21.15.44:0/1085149153 learned_addr learned my addr 172.21.15.44:0/1085149153 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:57.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.845+0000 7f6f537fe700 1 --2- 172.21.15.44:0/1085149153 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6f5415cae0 0x7f6f540cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:57.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.845+0000 7f6f58ef3700 1 --2- 172.21.15.44:0/1085149153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f5415cec0 0x7f6f54155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:57.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.845+0000 7f6f53fff700 1 -- 172.21.15.44:0/1085149153 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6f5415cae0 msgr2=0x7f6f540cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:57.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.845+0000 7f6f53fff700 1 --2- 172.21.15.44:0/1085149153 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6f5415cae0 0x7f6f540cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.845+0000 7f6f53fff700 1 -- 172.21.15.44:0/1085149153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f5415cec0 msgr2=0x7f6f54155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:57.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.845+0000 7f6f53fff700 1 --2- 172.21.15.44:0/1085149153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f5415cec0 0x7f6f54155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.845+0000 7f6f53fff700 1 -- 172.21.15.44:0/1085149153 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c0094b0 con 0x7f6f5406b310 2024-09-13T18:28:57.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.845+0000 7f6f53fff700 1 --2- 172.21.15.44:0/1085149153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f5406b310 0x7f6f54152420 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6f44007ef0 tx=0x7f6f4400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:57.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.845+0000 7f6f50ff9700 1 -- 172.21.15.44:0/1085149153 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4400edf0 con 0x7f6f5406b310 2024-09-13T18:28:57.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.845+0000 7f6f50ff9700 1 -- 172.21.15.44:0/1085149153 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f44014420 con 0x7f6f5406b310 2024-09-13T18:28:57.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.845+0000 7f6f596f4700 1 -- 172.21.15.44:0/1085149153 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f540cb9c0 con 0x7f6f5406b310 2024-09-13T18:28:57.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.845+0000 7f6f50ff9700 1 -- 172.21.15.44:0/1085149153 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f440147d0 con 0x7f6f5406b310 2024-09-13T18:28:57.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.845+0000 7f6f596f4700 1 -- 172.21.15.44:0/1085149153 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f540cbf80 con 0x7f6f5406b310 2024-09-13T18:28:57.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.845+0000 7f6f596f4700 1 -- 172.21.15.44:0/1085149153 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f540d1210 con 0x7f6f5406b310 2024-09-13T18:28:57.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.845+0000 7f6f50ff9700 1 -- 172.21.15.44:0/1085149153 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6f44014930 con 0x7f6f5406b310 2024-09-13T18:28:57.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.845+0000 7f6f50ff9700 1 --2- 172.21.15.44:0/1085149153 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6f38066730 0x7f6f38068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:57.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.845+0000 7f6f50ff9700 1 -- 172.21.15.44:0/1085149153 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6f44084870 con 0x7f6f5406b310 2024-09-13T18:28:57.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.849+0000 7f6f537fe700 1 --2- 172.21.15.44:0/1085149153 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6f38066730 0x7f6f38068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:57.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.849+0000 7f6f537fe700 1 --2- 172.21.15.44:0/1085149153 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6f38066730 0x7f6f38068bf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c005930 tx=0x7f6f3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:57.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:57.853+0000 7f6f50ff9700 1 -- 172.21.15.44:0/1085149153 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6f44051c10 con 0x7f6f5406b310 2024-09-13T18:28:58.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.061+0000 7f6f596f4700 1 -- 172.21.15.44:0/1085149153 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f540b1c40 con 0x7f6f5406b310 2024-09-13T18:28:58.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.065+0000 7f6f50ff9700 1 -- 172.21.15.44:0/1085149153 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4732 (secure 0 0 0) 0x7f6f44055230 con 0x7f6f5406b310 2024-09-13T18:28:58.071 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:58.071 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5191,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/2593282586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2593282586},{"type":"v1","addr":"172.21.15.99:6836","nonce":2593282586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3094334762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3094334762},{"type":"v1","addr":"172.21.15.99:6837","nonce":3094334762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1843893566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1843893566},{"type":"v1","addr":"172.21.15.44:6833","nonce":1843893566}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:28:05.062964+0000","modified":"2024-09-13T18:28:41.727358+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5580},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5580":{"gid":5580,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.44:6835/438860530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":438860530},{"type":"v1","addr":"172.21.15.44:6835","nonce":438860530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:28:58.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.065+0000 7f6f596f4700 1 -- 172.21.15.44:0/1085149153 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6f38066730 msgr2=0x7f6f38068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:58.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.065+0000 7f6f596f4700 1 --2- 172.21.15.44:0/1085149153 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6f38066730 0x7f6f38068bf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c005930 tx=0x7f6f3c009040 comp rx=0 tx=0).stop 2024-09-13T18:28:58.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.065+0000 7f6f596f4700 1 -- 172.21.15.44:0/1085149153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f5406b310 msgr2=0x7f6f54152420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:58.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.065+0000 7f6f596f4700 1 --2- 172.21.15.44:0/1085149153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f5406b310 0x7f6f54152420 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6f44007ef0 tx=0x7f6f4400e3c0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.065+0000 7f6f596f4700 1 -- 172.21.15.44:0/1085149153 shutdown_connections 2024-09-13T18:28:58.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.065+0000 7f6f596f4700 1 --2- 172.21.15.44:0/1085149153 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6f38066730 0x7f6f38068bf0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.065+0000 7f6f596f4700 1 --2- 172.21.15.44:0/1085149153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f5415cec0 0x7f6f54155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.065+0000 7f6f596f4700 1 --2- 172.21.15.44:0/1085149153 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6f5415cae0 0x7f6f540cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.065+0000 7f6f596f4700 1 --2- 172.21.15.44:0/1085149153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f5406b310 0x7f6f54152420 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.065+0000 7f6f596f4700 1 -- 172.21.15.44:0/1085149153 >> 172.21.15.44:0/1085149153 conn(0x7f6f540d2c80 msgr2=0x7f6f540b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:58.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.065+0000 7f6f596f4700 1 -- 172.21.15.44:0/1085149153 shutdown_connections 2024-09-13T18:28:58.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.065+0000 7f6f596f4700 1 -- 172.21.15.44:0/1085149153 wait complete. 2024-09-13T18:28:58.075 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 23 2024-09-13T18:28:58.086 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:28:58.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e1a21f700 1 Processor -- start 2024-09-13T18:28:58.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e1a21f700 1 -- start start 2024-09-13T18:28:58.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e1a21f700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7e1415ac40 0x7f7e1406ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:58.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e1a21f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e140adba0 0x7f7e1415ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:58.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e1a21f700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1415b020 con 0x7f7e140ad710 2024-09-13T18:28:58.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e1a21f700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e140b31e0 con 0x7f7e1415ac40 2024-09-13T18:28:58.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e1a21f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140b3df0 con 0x7f7e140adba0 2024-09-13T18:28:58.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e13fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e140adba0 0x7f7e1415ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:58.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e13fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e140adba0 0x7f7e1415ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:37274/0 (socket says 172.21.15.44:37274) 2024-09-13T18:28:58.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e137fe700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7e1415ac40 0x7f7e1406ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:58.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e13fff700 1 -- 172.21.15.44:0/3559621479 learned_addr learned my addr 172.21.15.44:0/3559621479 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:58.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e137fe700 1 -- 172.21.15.44:0/3559621479 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e140adba0 msgr2=0x7f7e1415ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:58.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e137fe700 1 --2- 172.21.15.44:0/3559621479 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e140adba0 0x7f7e1415ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e137fe700 1 -- 172.21.15.44:0/3559621479 >> v1:172.21.15.99:6789/0 conn(0x7f7e140ad710 legacy=0x7f7e1415e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:58.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e137fe700 1 -- 172.21.15.44:0/3559621479 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1406a6f0 con 0x7f7e1415ac40 2024-09-13T18:28:58.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e13fff700 1 --2- 172.21.15.44:0/3559621479 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e140adba0 0x7f7e1415ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:58.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e137fe700 1 --2- 172.21.15.44:0/3559621479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e1415ac40 0x7f7e1406ad00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009d90 tx=0x7f7e0400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5fffa6a19266f1c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:58.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e127fc700 1 -- 172.21.15.44:0/3559621479 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0400e070 con 0x7f7e1415ac40 2024-09-13T18:28:58.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e127fc700 1 -- 172.21.15.44:0/3559621479 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0400bb20 con 0x7f7e1415ac40 2024-09-13T18:28:58.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e127fc700 1 -- 172.21.15.44:0/3559621479 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04012430 con 0x7f7e1415ac40 2024-09-13T18:28:58.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e1a21f700 1 -- 172.21.15.44:0/3559621479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e1415ac40 msgr2=0x7f7e1406ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:58.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e1a21f700 1 --2- 172.21.15.44:0/3559621479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e1415ac40 0x7f7e1406ad00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009d90 tx=0x7f7e0400b330 comp rx=0 tx=0).stop 2024-09-13T18:28:58.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e1a21f700 1 -- 172.21.15.44:0/3559621479 shutdown_connections 2024-09-13T18:28:58.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e1a21f700 1 --2- 172.21.15.44:0/3559621479 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e140adba0 0x7f7e1415ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e1a21f700 1 --2- 172.21.15.44:0/3559621479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e1415ac40 0x7f7e1406ad00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e1a21f700 1 -- 172.21.15.44:0/3559621479 >> 172.21.15.44:0/3559621479 conn(0x7f7e140ce980 msgr2=0x7f7e140ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:58.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e1a21f700 1 -- 172.21.15.44:0/3559621479 shutdown_connections 2024-09-13T18:28:58.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.197+0000 7f7e1a21f700 1 -- 172.21.15.44:0/3559621479 wait complete. 2024-09-13T18:28:58.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e1a21f700 1 Processor -- start 2024-09-13T18:28:58.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e1a21f700 1 -- start start 2024-09-13T18:28:58.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e1a21f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e140ad710 0x7f7e1414c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:58.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e1a21f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e140adba0 0x7f7e1415d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:58.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e1a21f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e1415ac40 0x7f7e1415d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:58.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e1a21f700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1413bee0 con 0x7f7e140ad710 2024-09-13T18:28:58.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e1a21f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e14153030 con 0x7f7e140adba0 2024-09-13T18:28:58.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e1a21f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e14153310 con 0x7f7e1415ac40 2024-09-13T18:28:58.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e137fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e140ad710 0x7f7e1414c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:58.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e137fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e140ad710 0x7f7e1414c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37310/0 (socket says 172.21.15.44:37310) 2024-09-13T18:28:58.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e137fe700 1 -- 172.21.15.44:0/1094646333 learned_addr learned my addr 172.21.15.44:0/1094646333 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:58.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e12ffd700 1 --2- 172.21.15.44:0/1094646333 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e140adba0 0x7f7e1415d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:58.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e13fff700 1 --2- 172.21.15.44:0/1094646333 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e1415ac40 0x7f7e1415d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:58.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e137fe700 1 -- 172.21.15.44:0/1094646333 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e1415ac40 msgr2=0x7f7e1415d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:58.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e137fe700 1 --2- 172.21.15.44:0/1094646333 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e1415ac40 0x7f7e1415d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e137fe700 1 -- 172.21.15.44:0/1094646333 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e140adba0 msgr2=0x7f7e1415d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:58.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e137fe700 1 --2- 172.21.15.44:0/1094646333 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e140adba0 0x7f7e1415d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e137fe700 1 -- 172.21.15.44:0/1094646333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c009570 con 0x7f7e140ad710 2024-09-13T18:28:58.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e137fe700 1 --2- 172.21.15.44:0/1094646333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e140ad710 0x7f7e1414c490 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7e04014040 tx=0x7f7e04004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:58.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e0bfff700 1 -- 172.21.15.44:0/1094646333 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04012430 con 0x7f7e140ad710 2024-09-13T18:28:58.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e0bfff700 1 -- 172.21.15.44:0/1094646333 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e04020070 con 0x7f7e140ad710 2024-09-13T18:28:58.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e1a21f700 1 -- 172.21.15.44:0/1094646333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e04009a70 con 0x7f7e140ad710 2024-09-13T18:28:58.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e0bfff700 1 -- 172.21.15.44:0/1094646333 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04004280 con 0x7f7e140ad710 2024-09-13T18:28:58.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.201+0000 7f7e1a21f700 1 -- 172.21.15.44:0/1094646333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1413c430 con 0x7f7e140ad710 2024-09-13T18:28:58.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.205+0000 7f7e1a21f700 1 -- 172.21.15.44:0/1094646333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1406d340 con 0x7f7e140ad710 2024-09-13T18:28:58.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.205+0000 7f7e0bfff700 1 -- 172.21.15.44:0/1094646333 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7e040043e0 con 0x7f7e140ad710 2024-09-13T18:28:58.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.205+0000 7f7e0bfff700 1 --2- 172.21.15.44:0/1094646333 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7df4066760 0x7f7df4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:58.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.205+0000 7f7e0bfff700 1 -- 172.21.15.44:0/1094646333 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7e04022070 con 0x7f7e140ad710 2024-09-13T18:28:58.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.205+0000 7f7e12ffd700 1 --2- 172.21.15.44:0/1094646333 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7df4066760 0x7f7df4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:58.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.209+0000 7f7e12ffd700 1 --2- 172.21.15.44:0/1094646333 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7df4066760 0x7f7df4068c20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7e141560d0 tx=0x7f7dfc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:58.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.213+0000 7f7e0bfff700 1 -- 172.21.15.44:0/1094646333 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7e04053120 con 0x7f7e140ad710 2024-09-13T18:28:58.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.389+0000 7f7e1a21f700 1 -- 172.21.15.44:0/1094646333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e140adff0 con 0x7f7e140ad710 2024-09-13T18:28:58.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.393+0000 7f7e0bfff700 1 -- 172.21.15.44:0/1094646333 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16636 (secure 0 0 0) 0x7f7e04056740 con 0x7f7e140ad710 2024-09-13T18:28:58.399 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:28:58.399 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":36,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:28:29.639664+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:28:02.951723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:28:04.057772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/939073284":"2024-09-14T18:28:29.639607+0000","172.21.15.44:6834/939073284":"2024-09-14T18:28:29.639607+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:28:58.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.393+0000 7f7e1a21f700 1 -- 172.21.15.44:0/1094646333 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7df4066760 msgr2=0x7f7df4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:58.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.393+0000 7f7e1a21f700 1 --2- 172.21.15.44:0/1094646333 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7df4066760 0x7f7df4068c20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7e141560d0 tx=0x7f7dfc009040 comp rx=0 tx=0).stop 2024-09-13T18:28:58.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.393+0000 7f7e1a21f700 1 -- 172.21.15.44:0/1094646333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e140ad710 msgr2=0x7f7e1414c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:58.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.393+0000 7f7e1a21f700 1 --2- 172.21.15.44:0/1094646333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e140ad710 0x7f7e1414c490 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7e04014040 tx=0x7f7e04004af0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.393+0000 7f7e1a21f700 1 -- 172.21.15.44:0/1094646333 shutdown_connections 2024-09-13T18:28:58.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.393+0000 7f7e1a21f700 1 --2- 172.21.15.44:0/1094646333 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7df4066760 0x7f7df4068c20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.393+0000 7f7e1a21f700 1 --2- 172.21.15.44:0/1094646333 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e1415ac40 0x7f7e1415d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.393+0000 7f7e1a21f700 1 --2- 172.21.15.44:0/1094646333 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e140adba0 0x7f7e1415d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.393+0000 7f7e1a21f700 1 --2- 172.21.15.44:0/1094646333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e140ad710 0x7f7e1414c490 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.393+0000 7f7e1a21f700 1 -- 172.21.15.44:0/1094646333 >> 172.21.15.44:0/1094646333 conn(0x7f7e140ce980 msgr2=0x7f7e14156260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:58.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.393+0000 7f7e1a21f700 1 -- 172.21.15.44:0/1094646333 shutdown_connections 2024-09-13T18:28:58.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.393+0000 7f7e1a21f700 1 -- 172.21.15.44:0/1094646333 wait complete. 2024-09-13T18:28:58.415 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:28:58.423 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:28:58.425 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:28:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.529+0000 7f9ceccf9700 1 Processor -- start 2024-09-13T18:28:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.529+0000 7f9ceccf9700 1 -- start start 2024-09-13T18:28:58.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.529+0000 7f9ceccf9700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9ce806ccf0 0x7f9ce8159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:58.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.529+0000 7f9ceccf9700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9ce80720d0 0x7f9ce815af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:58.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.529+0000 7f9ceccf9700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce80724d0 con 0x7f9ce8070ba0 2024-09-13T18:28:58.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.529+0000 7f9ceccf9700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce8071030 con 0x7f9ce80720d0 2024-09-13T18:28:58.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.529+0000 7f9ceccf9700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce8071310 con 0x7f9ce806ccf0 2024-09-13T18:28:58.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.529+0000 7f9ce7fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9ce80720d0 0x7f9ce815af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:58.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.529+0000 7f9ce6ffd700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9ce8070ba0 0x7f9ce806d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46274/0 (socket says 172.21.15.44:46274) 2024-09-13T18:28:58.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.529+0000 7f9ce6ffd700 1 -- 172.21.15.44:0/3561894862 learned_addr learned my addr 172.21.15.44:0/3561894862 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:58.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.529+0000 7f9ce77fe700 1 --2- 172.21.15.44:0/3561894862 >> v2:172.21.15.99:3300/0 conn(0x7f9ce806ccf0 0x7f9ce8159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:58.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.529+0000 7f9ce7fff700 1 -- 172.21.15.44:0/3561894862 >> v2:172.21.15.99:3300/0 conn(0x7f9ce806ccf0 msgr2=0x7f9ce8159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:58.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.529+0000 7f9ce7fff700 1 --2- 172.21.15.44:0/3561894862 >> v2:172.21.15.99:3300/0 conn(0x7f9ce806ccf0 0x7f9ce8159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.529+0000 7f9ce7fff700 1 -- 172.21.15.44:0/3561894862 >> v1:172.21.15.44:6789/0 conn(0x7f9ce8070ba0 legacy=0x7f9ce806d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:58.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.529+0000 7f9ce67fc700 1 -- 172.21.15.44:0/3561894862 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210914963 0 0) 0x7f9ce80724d0 con 0x7f9ce8070ba0 2024-09-13T18:28:58.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.529+0000 7f9ce7fff700 1 -- 172.21.15.44:0/3561894862 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce80715f0 con 0x7f9ce80720d0 2024-09-13T18:28:58.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.529+0000 7f9ce7fff700 1 --2- 172.21.15.44:0/3561894862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ce80720d0 0x7f9ce815af90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80727d0 tx=0x7f9ce000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990dd4dd51ef4911 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:58.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.529+0000 7f9ce67fc700 1 -- 172.21.15.44:0/3561894862 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce000e070 con 0x7f9ce80720d0 2024-09-13T18:28:58.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.529+0000 7f9ce67fc700 1 -- 172.21.15.44:0/3561894862 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce000bb20 con 0x7f9ce80720d0 2024-09-13T18:28:58.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.529+0000 7f9ce67fc700 1 -- 172.21.15.44:0/3561894862 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0012430 con 0x7f9ce80720d0 2024-09-13T18:28:58.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.533+0000 7f9ceccf9700 1 -- 172.21.15.44:0/3561894862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ce80720d0 msgr2=0x7f9ce815af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:58.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.533+0000 7f9ceccf9700 1 --2- 172.21.15.44:0/3561894862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ce80720d0 0x7f9ce815af90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80727d0 tx=0x7f9ce000b330 comp rx=0 tx=0).stop 2024-09-13T18:28:58.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.533+0000 7f9ceccf9700 1 -- 172.21.15.44:0/3561894862 shutdown_connections 2024-09-13T18:28:58.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.533+0000 7f9ceccf9700 1 --2- 172.21.15.44:0/3561894862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ce80720d0 0x7f9ce815af90 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.533+0000 7f9ceccf9700 1 --2- 172.21.15.44:0/3561894862 >> v2:172.21.15.99:3300/0 conn(0x7f9ce806ccf0 0x7f9ce8159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.533+0000 7f9ceccf9700 1 -- 172.21.15.44:0/3561894862 >> 172.21.15.44:0/3561894862 conn(0x7f9ce80cfad0 msgr2=0x7f9ce80cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:58.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.533+0000 7f9ceccf9700 1 -- 172.21.15.44:0/3561894862 shutdown_connections 2024-09-13T18:28:58.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.533+0000 7f9ceccf9700 1 -- 172.21.15.44:0/3561894862 wait complete. 2024-09-13T18:28:58.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.533+0000 7f9ceccf9700 1 Processor -- start 2024-09-13T18:28:58.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.533+0000 7f9ceccf9700 1 -- start start 2024-09-13T18:28:58.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.533+0000 7f9ceccf9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ce806ccf0 0x7f9ce814f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:58.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.533+0000 7f9ceccf9700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ce80720d0 0x7f9ce8150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:58.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.533+0000 7f9ceccf9700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ce80ce0b0 0x7f9ce80ce530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:58.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.533+0000 7f9ceccf9700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce8154110 con 0x7f9ce806ccf0 2024-09-13T18:28:58.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.533+0000 7f9ceccf9700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce80ceb20 con 0x7f9ce80720d0 2024-09-13T18:28:58.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.533+0000 7f9ceccf9700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce81537e0 con 0x7f9ce80ce0b0 2024-09-13T18:28:58.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.533+0000 7f9ce77fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ce806ccf0 0x7f9ce814f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:58.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.533+0000 7f9ce77fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ce806ccf0 0x7f9ce814f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37332/0 (socket says 172.21.15.44:37332) 2024-09-13T18:28:58.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.533+0000 7f9ce77fe700 1 -- 172.21.15.44:0/2824226119 learned_addr learned my addr 172.21.15.44:0/2824226119 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:58.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.533+0000 7f9ce6ffd700 1 --2- 172.21.15.44:0/2824226119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ce80720d0 0x7f9ce8150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:58.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.533+0000 7f9ce7fff700 1 --2- 172.21.15.44:0/2824226119 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ce80ce0b0 0x7f9ce80ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:58.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.537+0000 7f9ce77fe700 1 -- 172.21.15.44:0/2824226119 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ce80ce0b0 msgr2=0x7f9ce80ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:58.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.537+0000 7f9ce77fe700 1 --2- 172.21.15.44:0/2824226119 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ce80ce0b0 0x7f9ce80ce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.537+0000 7f9ce77fe700 1 -- 172.21.15.44:0/2824226119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ce80720d0 msgr2=0x7f9ce8150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:58.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.537+0000 7f9ce77fe700 1 --2- 172.21.15.44:0/2824226119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ce80720d0 0x7f9ce8150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.537+0000 7f9ce77fe700 1 -- 172.21.15.44:0/2824226119 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce0009a70 con 0x7f9ce806ccf0 2024-09-13T18:28:58.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.537+0000 7f9ce77fe700 1 --2- 172.21.15.44:0/2824226119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ce806ccf0 0x7f9ce814f4c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000ed40 tx=0x7f9cd000d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:58.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.537+0000 7f9cdffff700 1 -- 172.21.15.44:0/2824226119 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd000dd90 con 0x7f9ce806ccf0 2024-09-13T18:28:58.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.537+0000 7f9cdffff700 1 -- 172.21.15.44:0/2824226119 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd0010440 con 0x7f9ce806ccf0 2024-09-13T18:28:58.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.537+0000 7f9ceccf9700 1 -- 172.21.15.44:0/2824226119 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce8153ac0 con 0x7f9ce806ccf0 2024-09-13T18:28:58.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.537+0000 7f9cdffff700 1 -- 172.21.15.44:0/2824226119 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd00107b0 con 0x7f9ce806ccf0 2024-09-13T18:28:58.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.537+0000 7f9ceccf9700 1 -- 172.21.15.44:0/2824226119 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce80cd390 con 0x7f9ce806ccf0 2024-09-13T18:28:58.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.537+0000 7f9cdffff700 1 -- 172.21.15.44:0/2824226119 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9cd0010910 con 0x7f9ce806ccf0 2024-09-13T18:28:58.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.537+0000 7f9ceccf9700 1 -- 172.21.15.44:0/2824226119 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce80b39b0 con 0x7f9ce806ccf0 2024-09-13T18:28:58.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.541+0000 7f9cdffff700 1 --2- 172.21.15.44:0/2824226119 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9cc8066730 0x7f9cc8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:58.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.541+0000 7f9cdffff700 1 -- 172.21.15.44:0/2824226119 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9cd0084900 con 0x7f9ce806ccf0 2024-09-13T18:28:58.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.541+0000 7f9ce6ffd700 1 --2- 172.21.15.44:0/2824226119 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9cc8066730 0x7f9cc8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:58.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.541+0000 7f9ce6ffd700 1 --2- 172.21.15.44:0/2824226119 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9cc8066730 0x7f9cc8068bf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80af580 tx=0x7f9cd8007e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:58.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.549+0000 7f9cdffff700 1 -- 172.21.15.44:0/2824226119 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9cd0051c10 con 0x7f9ce806ccf0 2024-09-13T18:28:58.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.757+0000 7f9ceccf9700 1 -- 172.21.15.44:0/2824226119 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9ce8158100 con 0x7f9ce806ccf0 2024-09-13T18:28:58.767 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-13T18:28:58.761+0000 7fc22bbc2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:28:58.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.773+0000 7f9cdffff700 1 -- 172.21.15.44:0/2824226119 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9cd0055230 con 0x7f9ce806ccf0 2024-09-13T18:28:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.777+0000 7f9ceccf9700 1 -- 172.21.15.44:0/2824226119 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9cc8066730 msgr2=0x7f9cc8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.777+0000 7f9ceccf9700 1 --2- 172.21.15.44:0/2824226119 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9cc8066730 0x7f9cc8068bf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80af580 tx=0x7f9cd8007e00 comp rx=0 tx=0).stop 2024-09-13T18:28:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.777+0000 7f9ceccf9700 1 -- 172.21.15.44:0/2824226119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ce806ccf0 msgr2=0x7f9ce814f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.777+0000 7f9ceccf9700 1 --2- 172.21.15.44:0/2824226119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ce806ccf0 0x7f9ce814f4c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000ed40 tx=0x7f9cd000d630 comp rx=0 tx=0).stop 2024-09-13T18:28:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.777+0000 7f9ceccf9700 1 -- 172.21.15.44:0/2824226119 shutdown_connections 2024-09-13T18:28:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.777+0000 7f9ceccf9700 1 --2- 172.21.15.44:0/2824226119 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9cc8066730 0x7f9cc8068bf0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.777+0000 7f9ceccf9700 1 --2- 172.21.15.44:0/2824226119 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ce80ce0b0 0x7f9ce80ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.777+0000 7f9ceccf9700 1 --2- 172.21.15.44:0/2824226119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ce80720d0 0x7f9ce8150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.777+0000 7f9ceccf9700 1 --2- 172.21.15.44:0/2824226119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ce806ccf0 0x7f9ce814f4c0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.777+0000 7f9ceccf9700 1 -- 172.21.15.44:0/2824226119 >> 172.21.15.44:0/2824226119 conn(0x7f9ce80cfad0 msgr2=0x7f9ce806bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.777+0000 7f9ceccf9700 1 -- 172.21.15.44:0/2824226119 shutdown_connections 2024-09-13T18:28:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.777+0000 7f9ceccf9700 1 -- 172.21.15.44:0/2824226119 wait complete. 2024-09-13T18:28:58.787 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:28:58.789 INFO:tasks.ceph.mds.a.smithi044.stderr: -4916> 2024-09-13T18:28:35.657+0000 7f0c02bbc700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:28:58.790 INFO:tasks.ceph.mds.a.smithi044.stderr: -4400> 2024-09-13T18:28:38.593+0000 7f0bff3b5700 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x100000001f7 2024-09-13T18:28:58.791 INFO:tasks.ceph.mds.a.smithi044.stderr: -3972> 2024-09-13T18:28:38.601+0000 7f0bff3b5700 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000001 2024-09-13T18:28:58.795 INFO:tasks.ceph.mds.a.smithi044.stderr: -1764> 2024-09-13T18:28:52.925+0000 7f0bff3b5700 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x100000001fa 2024-09-13T18:28:58.800 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:28:58.825 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-13T18:28:58.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.909+0000 7efe93fff700 1 Processor -- start 2024-09-13T18:28:58.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.909+0000 7efe93fff700 1 -- start start 2024-09-13T18:28:58.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.909+0000 7efe93fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efe9415cda0 0x7efe9406b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:58.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.909+0000 7efe93fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efe9406a520 0x7efe9406a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:58.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.909+0000 7efe93fff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe940b8430 con 0x7efe940ceb70 2024-09-13T18:28:58.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.909+0000 7efe93fff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe9406be40 con 0x7efe9415cda0 2024-09-13T18:28:58.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.909+0000 7efe93fff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe940b64f0 con 0x7efe9406a520 2024-09-13T18:28:58.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.909+0000 7efe927fc700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7efe940ceb70 0x7efe940b5de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46286/0 (socket says 172.21.15.44:46286) 2024-09-13T18:28:58.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.909+0000 7efe92ffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efe9415cda0 0x7efe9406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:58.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.909+0000 7efe927fc700 1 -- 172.21.15.44:0/990077825 learned_addr learned my addr 172.21.15.44:0/990077825 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:58.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.909+0000 7efe937fe700 1 --2- 172.21.15.44:0/990077825 >> v2:172.21.15.99:3300/0 conn(0x7efe9406a520 0x7efe9406a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:58.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.909+0000 7efe92ffd700 1 -- 172.21.15.44:0/990077825 >> v2:172.21.15.99:3300/0 conn(0x7efe9406a520 msgr2=0x7efe9406a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:58.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.909+0000 7efe92ffd700 1 --2- 172.21.15.44:0/990077825 >> v2:172.21.15.99:3300/0 conn(0x7efe9406a520 0x7efe9406a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.909+0000 7efe92ffd700 1 -- 172.21.15.44:0/990077825 >> v1:172.21.15.44:6789/0 conn(0x7efe940ceb70 legacy=0x7efe940b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:58.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.909+0000 7efe92ffd700 1 -- 172.21.15.44:0/990077825 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9406ae70 con 0x7efe9415cda0 2024-09-13T18:28:58.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.909+0000 7efe91ffb700 1 -- 172.21.15.44:0/990077825 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2688005085 0 0) 0x7efe940b8430 con 0x7efe940ceb70 2024-09-13T18:28:58.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.909+0000 7efe937fe700 1 --2- 172.21.15.44:0/990077825 >> v2:172.21.15.99:3300/0 conn(0x7efe9406a520 0x7efe9406a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:58.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.909+0000 7efe92ffd700 1 --2- 172.21.15.44:0/990077825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9415cda0 0x7efe9406b900 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7efe940d2c60 tx=0x7efe84009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec7616c8c8075ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:58.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.909+0000 7efe91ffb700 1 -- 172.21.15.44:0/990077825 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe84011830 con 0x7efe9415cda0 2024-09-13T18:28:58.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.909+0000 7efe91ffb700 1 -- 172.21.15.44:0/990077825 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe84011990 con 0x7efe9415cda0 2024-09-13T18:28:58.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.909+0000 7efe91ffb700 1 -- 172.21.15.44:0/990077825 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe84011d40 con 0x7efe9415cda0 2024-09-13T18:28:58.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.913+0000 7efe93fff700 1 -- 172.21.15.44:0/990077825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9415cda0 msgr2=0x7efe9406b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:58.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.913+0000 7efe93fff700 1 --2- 172.21.15.44:0/990077825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9415cda0 0x7efe9406b900 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7efe940d2c60 tx=0x7efe84009b30 comp rx=0 tx=0).stop 2024-09-13T18:28:58.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.913+0000 7efe93fff700 1 -- 172.21.15.44:0/990077825 shutdown_connections 2024-09-13T18:28:58.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.913+0000 7efe93fff700 1 --2- 172.21.15.44:0/990077825 >> v2:172.21.15.99:3300/0 conn(0x7efe9406a520 0x7efe9406a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.913+0000 7efe93fff700 1 --2- 172.21.15.44:0/990077825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9415cda0 0x7efe9406b900 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.913+0000 7efe93fff700 1 -- 172.21.15.44:0/990077825 >> 172.21.15.44:0/990077825 conn(0x7efe940d2cb0 msgr2=0x7efe940d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:58.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.913+0000 7efe93fff700 1 -- 172.21.15.44:0/990077825 shutdown_connections 2024-09-13T18:28:58.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.913+0000 7efe93fff700 1 -- 172.21.15.44:0/990077825 wait complete. 2024-09-13T18:28:58.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.913+0000 7efe93fff700 1 Processor -- start 2024-09-13T18:28:58.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.913+0000 7efe93fff700 1 -- start start 2024-09-13T18:28:58.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.917+0000 7efe93fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9406a520 0x7efe9414e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:58.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.917+0000 7efe93fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe940ceb70 0x7efe941e7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:58.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.917+0000 7efe93fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe9415cda0 0x7efe941e7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:58.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.917+0000 7efe93fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9414ff30 con 0x7efe9406a520 2024-09-13T18:28:58.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.917+0000 7efe93fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe940c9f20 con 0x7efe9415cda0 2024-09-13T18:28:58.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.917+0000 7efe93fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe94151200 con 0x7efe940ceb70 2024-09-13T18:28:58.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.917+0000 7efe92ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9406a520 0x7efe9414e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:58.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.917+0000 7efe92ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9406a520 0x7efe9414e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37380/0 (socket says 172.21.15.44:37380) 2024-09-13T18:28:58.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.917+0000 7efe92ffd700 1 -- 172.21.15.44:0/3582100373 learned_addr learned my addr 172.21.15.44:0/3582100373 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:58.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.917+0000 7efe937fe700 1 --2- 172.21.15.44:0/3582100373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe9415cda0 0x7efe941e7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:58.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.917+0000 7efe927fc700 1 --2- 172.21.15.44:0/3582100373 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe940ceb70 0x7efe941e7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:58.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.917+0000 7efe92ffd700 1 -- 172.21.15.44:0/3582100373 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe940ceb70 msgr2=0x7efe941e7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:58.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.917+0000 7efe92ffd700 1 --2- 172.21.15.44:0/3582100373 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe940ceb70 0x7efe941e7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.917+0000 7efe92ffd700 1 -- 172.21.15.44:0/3582100373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe9415cda0 msgr2=0x7efe941e7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:58.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.917+0000 7efe92ffd700 1 --2- 172.21.15.44:0/3582100373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe9415cda0 0x7efe941e7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:58.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.917+0000 7efe92ffd700 1 -- 172.21.15.44:0/3582100373 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe840094b0 con 0x7efe9406a520 2024-09-13T18:28:58.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.917+0000 7efe937fe700 1 --2- 172.21.15.44:0/3582100373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe9415cda0 0x7efe941e7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:58.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.917+0000 7efe92ffd700 1 --2- 172.21.15.44:0/3582100373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9406a520 0x7efe9414e650 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efe84000c00 tx=0x7efe84004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:58.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.917+0000 7efe7b7fe700 1 -- 172.21.15.44:0/3582100373 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe840036c0 con 0x7efe9406a520 2024-09-13T18:28:58.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.917+0000 7efe7b7fe700 1 -- 172.21.15.44:0/3582100373 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8401e070 con 0x7efe9406a520 2024-09-13T18:28:58.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.917+0000 7efe93fff700 1 -- 172.21.15.44:0/3582100373 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe941590e0 con 0x7efe9406a520 2024-09-13T18:28:58.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.917+0000 7efe7b7fe700 1 -- 172.21.15.44:0/3582100373 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe84003a80 con 0x7efe9406a520 2024-09-13T18:28:58.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.917+0000 7efe93fff700 1 -- 172.21.15.44:0/3582100373 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe94151730 con 0x7efe9406a520 2024-09-13T18:28:58.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.921+0000 7efe93fff700 1 -- 172.21.15.44:0/3582100373 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe940d1120 con 0x7efe9406a520 2024-09-13T18:28:58.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.921+0000 7efe7b7fe700 1 -- 172.21.15.44:0/3582100373 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efe84003be0 con 0x7efe9406a520 2024-09-13T18:28:58.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.921+0000 7efe7b7fe700 1 --2- 172.21.15.44:0/3582100373 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe80066760 0x7efe80068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:58.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.921+0000 7efe7b7fe700 1 -- 172.21.15.44:0/3582100373 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7efe84085280 con 0x7efe9406a520 2024-09-13T18:28:58.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.921+0000 7efe927fc700 1 --2- 172.21.15.44:0/3582100373 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe80066760 0x7efe80068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:58.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.921+0000 7efe927fc700 1 --2- 172.21.15.44:0/3582100373 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe80066760 0x7efe80068c20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efe94150780 tx=0x7efe88007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:58.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:58.929+0000 7efe7b7fe700 1 -- 172.21.15.44:0/3582100373 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efe840524b0 con 0x7efe9406a520 2024-09-13T18:28:59.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.133+0000 7efe93fff700 1 -- 172.21.15.44:0/3582100373 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efe940cd200 con 0x7efe9406a520 2024-09-13T18:28:59.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.821+0000 7efe7b7fe700 1 -- 172.21.15.44:0/3582100373 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7efe84055ad0 con 0x7efe9406a520 2024-09-13T18:28:59.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.825+0000 7efe93fff700 1 -- 172.21.15.44:0/3582100373 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe80066760 msgr2=0x7efe80068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:59.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.825+0000 7efe93fff700 1 --2- 172.21.15.44:0/3582100373 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe80066760 0x7efe80068c20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efe94150780 tx=0x7efe88007c00 comp rx=0 tx=0).stop 2024-09-13T18:28:59.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.825+0000 7efe93fff700 1 -- 172.21.15.44:0/3582100373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9406a520 msgr2=0x7efe9414e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:59.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.825+0000 7efe93fff700 1 --2- 172.21.15.44:0/3582100373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9406a520 0x7efe9414e650 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efe84000c00 tx=0x7efe84004770 comp rx=0 tx=0).stop 2024-09-13T18:28:59.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.825+0000 7efe93fff700 1 -- 172.21.15.44:0/3582100373 shutdown_connections 2024-09-13T18:28:59.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.825+0000 7efe93fff700 1 --2- 172.21.15.44:0/3582100373 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe80066760 0x7efe80068c20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:59.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.825+0000 7efe93fff700 1 --2- 172.21.15.44:0/3582100373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe9415cda0 0x7efe941e7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:59.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.825+0000 7efe93fff700 1 --2- 172.21.15.44:0/3582100373 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe940ceb70 0x7efe941e7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:59.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.825+0000 7efe93fff700 1 --2- 172.21.15.44:0/3582100373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9406a520 0x7efe9414e650 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:59.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.825+0000 7efe93fff700 1 -- 172.21.15.44:0/3582100373 >> 172.21.15.44:0/3582100373 conn(0x7efe940d2cb0 msgr2=0x7efe940b2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:59.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.825+0000 7efe93fff700 1 -- 172.21.15.44:0/3582100373 shutdown_connections 2024-09-13T18:28:59.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.825+0000 7efe93fff700 1 -- 172.21.15.44:0/3582100373 wait complete. 2024-09-13T18:28:59.851 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:28:59.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.969+0000 7fa9affff700 1 Processor -- start 2024-09-13T18:28:59.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.969+0000 7fa9affff700 1 -- start start 2024-09-13T18:28:59.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.969+0000 7fa9affff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa9b00b5da0 0x7fa9b01614a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:59.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.969+0000 7fa9affff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b006aa30 con 0x7fa9b00ce710 2024-09-13T18:28:59.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.969+0000 7fa9affff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b00b61b0 con 0x7fa9b00ceaf0 2024-09-13T18:28:59.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.969+0000 7fa9affff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b00d0660 con 0x7fa9b00b5da0 2024-09-13T18:28:59.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.969+0000 7fa9aeffd700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa9b00ce710 0x7fa9b00cff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46290/0 (socket says 172.21.15.44:46290) 2024-09-13T18:28:59.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.969+0000 7fa9aeffd700 1 -- 172.21.15.44:0/696280893 learned_addr learned my addr 172.21.15.44:0/696280893 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:28:59.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.969+0000 7fa9af7fe700 1 --2- 172.21.15.44:0/696280893 >> v2:172.21.15.99:3300/0 conn(0x7fa9b00b5da0 0x7fa9b01614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:59.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.969+0000 7fa9adffb700 1 -- 172.21.15.44:0/696280893 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 785159724 0 0) 0x7fa9b006aa30 con 0x7fa9b00ce710 2024-09-13T18:28:59.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.969+0000 7fa9adffb700 1 -- 172.21.15.44:0/696280893 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa99c0035d0 con 0x7fa9b00ce710 2024-09-13T18:28:59.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.969+0000 7fa9af7fe700 1 -- 172.21.15.44:0/696280893 >> v1:172.21.15.99:6789/0 conn(0x7fa9b00ceaf0 legacy=0x7fa9b0160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:59.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.969+0000 7fa9af7fe700 1 -- 172.21.15.44:0/696280893 >> v1:172.21.15.44:6789/0 conn(0x7fa9b00ce710 legacy=0x7fa9b00cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:59.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.969+0000 7fa9af7fe700 1 -- 172.21.15.44:0/696280893 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b00b1e60 con 0x7fa9b00b5da0 2024-09-13T18:28:59.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.969+0000 7fa9af7fe700 1 --2- 172.21.15.44:0/696280893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b00b5da0 0x7fa9b01614a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009d90 tx=0x7fa9a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=913aa836ff0b2569 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:59.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.969+0000 7fa9adffb700 1 -- 172.21.15.44:0/696280893 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a000e070 con 0x7fa9b00b5da0 2024-09-13T18:28:59.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.969+0000 7fa9adffb700 1 -- 172.21.15.44:0/696280893 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a000bb20 con 0x7fa9b00b5da0 2024-09-13T18:28:59.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.969+0000 7fa9adffb700 1 -- 172.21.15.44:0/696280893 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0012430 con 0x7fa9b00b5da0 2024-09-13T18:28:59.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.973+0000 7fa9affff700 1 -- 172.21.15.44:0/696280893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b00b5da0 msgr2=0x7fa9b01614a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:59.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.973+0000 7fa9affff700 1 --2- 172.21.15.44:0/696280893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b00b5da0 0x7fa9b01614a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009d90 tx=0x7fa9a000b330 comp rx=0 tx=0).stop 2024-09-13T18:28:59.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.973+0000 7fa9affff700 1 -- 172.21.15.44:0/696280893 shutdown_connections 2024-09-13T18:28:59.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.973+0000 7fa9affff700 1 --2- 172.21.15.44:0/696280893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b00b5da0 0x7fa9b01614a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:59.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.973+0000 7fa9affff700 1 -- 172.21.15.44:0/696280893 >> 172.21.15.44:0/696280893 conn(0x7fa9b00d3260 msgr2=0x7fa9b00cf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:59.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.973+0000 7fa9affff700 1 -- 172.21.15.44:0/696280893 shutdown_connections 2024-09-13T18:28:59.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.973+0000 7fa9affff700 1 -- 172.21.15.44:0/696280893 wait complete. 2024-09-13T18:28:59.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.973+0000 7fa9affff700 1 Processor -- start 2024-09-13T18:28:59.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.973+0000 7fa9affff700 1 -- start start 2024-09-13T18:28:59.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.977+0000 7fa9affff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9b00b5da0 0x7fa9b00cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:59.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.977+0000 7fa9affff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b00ce710 0x7fa9b00a9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:59.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.977+0000 7fa9affff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9b00ceaf0 0x7fa9b00d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:59.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.977+0000 7fa9affff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b00ccbc0 con 0x7fa9b00b5da0 2024-09-13T18:28:59.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.977+0000 7fa9affff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b00cb210 con 0x7fa9b00ce710 2024-09-13T18:28:59.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.977+0000 7fa9affff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b00ca870 con 0x7fa9b00ceaf0 2024-09-13T18:28:59.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.977+0000 7fa9aeffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9b00b5da0 0x7fa9b00cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:59.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.977+0000 7fa9aeffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9b00b5da0 0x7fa9b00cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37382/0 (socket says 172.21.15.44:37382) 2024-09-13T18:28:59.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.977+0000 7fa9aeffd700 1 -- 172.21.15.44:0/2013174094 learned_addr learned my addr 172.21.15.44:0/2013174094 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:28:59.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.977+0000 7fa9ae7fc700 1 --2- 172.21.15.44:0/2013174094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b00ce710 0x7fa9b00a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:59.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.977+0000 7fa9af7fe700 1 --2- 172.21.15.44:0/2013174094 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9b00ceaf0 0x7fa9b00d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:59.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.977+0000 7fa9aeffd700 1 -- 172.21.15.44:0/2013174094 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9b00ceaf0 msgr2=0x7fa9b00d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:59.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.977+0000 7fa9aeffd700 1 --2- 172.21.15.44:0/2013174094 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9b00ceaf0 0x7fa9b00d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:59.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.977+0000 7fa9aeffd700 1 -- 172.21.15.44:0/2013174094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b00ce710 msgr2=0x7fa9b00a9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:59.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.977+0000 7fa9aeffd700 1 --2- 172.21.15.44:0/2013174094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b00ce710 0x7fa9b00a9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:59.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.977+0000 7fa9aeffd700 1 -- 172.21.15.44:0/2013174094 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a0009a70 con 0x7fa9b00b5da0 2024-09-13T18:28:59.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.977+0000 7fa9aeffd700 1 --2- 172.21.15.44:0/2013174094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9b00b5da0 0x7fa9b00cc350 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800c700 tx=0x7fa9a800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:59.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.977+0000 7fa9a7fff700 1 -- 172.21.15.44:0/2013174094 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8005d90 con 0x7fa9b00b5da0 2024-09-13T18:28:59.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.977+0000 7fa9a7fff700 1 -- 172.21.15.44:0/2013174094 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a80070d0 con 0x7fa9b00b5da0 2024-09-13T18:28:59.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.977+0000 7fa9a7fff700 1 -- 172.21.15.44:0/2013174094 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8007480 con 0x7fa9b00b5da0 2024-09-13T18:28:59.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.977+0000 7fa9affff700 1 -- 172.21.15.44:0/2013174094 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b00cab50 con 0x7fa9b00b5da0 2024-09-13T18:28:59.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.977+0000 7fa9affff700 1 -- 172.21.15.44:0/2013174094 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b00cc890 con 0x7fa9b00b5da0 2024-09-13T18:28:59.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.977+0000 7fa9affff700 1 -- 172.21.15.44:0/2013174094 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b00cff50 con 0x7fa9b00b5da0 2024-09-13T18:28:59.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.981+0000 7fa9a7fff700 1 -- 172.21.15.44:0/2013174094 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa9a80075e0 con 0x7fa9b00b5da0 2024-09-13T18:28:59.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.981+0000 7fa9a7fff700 1 --2- 172.21.15.44:0/2013174094 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa990066730 0x7fa990068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:59.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.981+0000 7fa9a7fff700 1 -- 172.21.15.44:0/2013174094 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fa9a8083950 con 0x7fa9b00b5da0 2024-09-13T18:28:59.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.981+0000 7fa9ae7fc700 1 --2- 172.21.15.44:0/2013174094 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa990066730 0x7fa990068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:59.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.981+0000 7fa9ae7fc700 1 --2- 172.21.15.44:0/2013174094 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa990066730 0x7fa990068bf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00ca660 tx=0x7fa998009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:59.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:28:59.989+0000 7fa9a7fff700 1 -- 172.21.15.44:0/2013174094 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa9a8050d80 con 0x7fa9b00b5da0 2024-09-13T18:29:00.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.161+0000 7fa9affff700 1 -- 172.21.15.44:0/2013174094 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa9b01604a0 con 0x7fa9b00b5da0 2024-09-13T18:29:00.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.841+0000 7fa9a7fff700 1 -- 172.21.15.44:0/2013174094 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa9a80170d0 con 0x7fa9b00b5da0 2024-09-13T18:29:00.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.845+0000 7fa9affff700 1 -- 172.21.15.44:0/2013174094 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa990066730 msgr2=0x7fa990068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:00.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.845+0000 7fa9affff700 1 --2- 172.21.15.44:0/2013174094 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa990066730 0x7fa990068bf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00ca660 tx=0x7fa998009040 comp rx=0 tx=0).stop 2024-09-13T18:29:00.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.845+0000 7fa9affff700 1 -- 172.21.15.44:0/2013174094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9b00b5da0 msgr2=0x7fa9b00cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:00.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.845+0000 7fa9affff700 1 --2- 172.21.15.44:0/2013174094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9b00b5da0 0x7fa9b00cc350 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800c700 tx=0x7fa9a800ca10 comp rx=0 tx=0).stop 2024-09-13T18:29:00.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.845+0000 7fa9affff700 1 -- 172.21.15.44:0/2013174094 shutdown_connections 2024-09-13T18:29:00.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.845+0000 7fa9affff700 1 --2- 172.21.15.44:0/2013174094 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa990066730 0x7fa990068bf0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:00.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.845+0000 7fa9affff700 1 --2- 172.21.15.44:0/2013174094 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9b00ceaf0 0x7fa9b00d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:00.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.845+0000 7fa9affff700 1 --2- 172.21.15.44:0/2013174094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b00ce710 0x7fa9b00a9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:00.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.845+0000 7fa9affff700 1 --2- 172.21.15.44:0/2013174094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9b00b5da0 0x7fa9b00cc350 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:00.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.845+0000 7fa9affff700 1 -- 172.21.15.44:0/2013174094 >> 172.21.15.44:0/2013174094 conn(0x7fa9b00d3260 msgr2=0x7fa9b00cda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:00.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.849+0000 7fa9affff700 1 -- 172.21.15.44:0/2013174094 shutdown_connections 2024-09-13T18:29:00.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.849+0000 7fa9affff700 1 -- 172.21.15.44:0/2013174094 wait complete. 2024-09-13T18:29:00.856 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:29:00.871 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:29:00.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.981+0000 7f6d76135700 1 Processor -- start 2024-09-13T18:29:00.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.981+0000 7f6d76135700 1 -- start start 2024-09-13T18:29:00.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.981+0000 7f6d76135700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6d7006ccf0 0x7f6d70159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:00.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.981+0000 7f6d76135700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6d700720d0 0x7f6d7015af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:00.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.981+0000 7f6d76135700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d700724d0 con 0x7f6d70070ba0 2024-09-13T18:29:00.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.981+0000 7f6d76135700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d70071030 con 0x7f6d700720d0 2024-09-13T18:29:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.981+0000 7f6d76135700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d70071310 con 0x7f6d7006ccf0 2024-09-13T18:29:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.981+0000 7f6d74932700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f6d70070ba0 0x7f6d7006d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46292/0 (socket says 172.21.15.44:46292) 2024-09-13T18:29:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.981+0000 7f6d74932700 1 -- 172.21.15.44:0/1456212405 learned_addr learned my addr 172.21.15.44:0/1456212405 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:29:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.981+0000 7f6d75934700 1 --2- 172.21.15.44:0/1456212405 >> v2:172.21.15.44:3300/0 conn(0x7f6d700720d0 0x7f6d7015af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d75133700 1 --2- 172.21.15.44:0/1456212405 >> v2:172.21.15.99:3300/0 conn(0x7f6d7006ccf0 0x7f6d70159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d67fff700 1 -- 172.21.15.44:0/1456212405 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495869468 0 0) 0x7f6d700724d0 con 0x7f6d70070ba0 2024-09-13T18:29:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d67fff700 1 -- 172.21.15.44:0/1456212405 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d5c0035d0 con 0x7f6d70070ba0 2024-09-13T18:29:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d75934700 1 -- 172.21.15.44:0/1456212405 >> v2:172.21.15.99:3300/0 conn(0x7f6d7006ccf0 msgr2=0x7f6d70159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d75934700 1 --2- 172.21.15.44:0/1456212405 >> v2:172.21.15.99:3300/0 conn(0x7f6d7006ccf0 0x7f6d70159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d75934700 1 -- 172.21.15.44:0/1456212405 >> v1:172.21.15.44:6789/0 conn(0x7f6d70070ba0 legacy=0x7f6d7006d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:00.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d75934700 1 -- 172.21.15.44:0/1456212405 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d700715f0 con 0x7f6d700720d0 2024-09-13T18:29:00.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d75934700 1 --2- 172.21.15.44:0/1456212405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d700720d0 0x7f6d7015af90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6d700727d0 tx=0x7f6d68009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=968a551c4d8c95c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:00.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d67fff700 1 -- 172.21.15.44:0/1456212405 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d68011830 con 0x7f6d700720d0 2024-09-13T18:29:00.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d67fff700 1 -- 172.21.15.44:0/1456212405 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d68011990 con 0x7f6d700720d0 2024-09-13T18:29:00.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d67fff700 1 -- 172.21.15.44:0/1456212405 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d68011d20 con 0x7f6d700720d0 2024-09-13T18:29:00.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d76135700 1 -- 172.21.15.44:0/1456212405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d700720d0 msgr2=0x7f6d7015af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:00.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d76135700 1 --2- 172.21.15.44:0/1456212405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d700720d0 0x7f6d7015af90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6d700727d0 tx=0x7f6d68009b30 comp rx=0 tx=0).stop 2024-09-13T18:29:00.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d76135700 1 -- 172.21.15.44:0/1456212405 shutdown_connections 2024-09-13T18:29:00.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d76135700 1 --2- 172.21.15.44:0/1456212405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d700720d0 0x7f6d7015af90 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:00.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d76135700 1 --2- 172.21.15.44:0/1456212405 >> v2:172.21.15.99:3300/0 conn(0x7f6d7006ccf0 0x7f6d70159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:00.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d76135700 1 -- 172.21.15.44:0/1456212405 >> 172.21.15.44:0/1456212405 conn(0x7f6d700cfad0 msgr2=0x7f6d700cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:00.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d76135700 1 -- 172.21.15.44:0/1456212405 shutdown_connections 2024-09-13T18:29:00.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d76135700 1 -- 172.21.15.44:0/1456212405 wait complete. 2024-09-13T18:29:00.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d76135700 1 Processor -- start 2024-09-13T18:29:00.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d76135700 1 -- start start 2024-09-13T18:29:00.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d76135700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d7006ccf0 0x7f6d700ce880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:00.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d76135700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6d700720d0 0x7f6d7015be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:00.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d76135700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d70150530 0x7f6d7014b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d76135700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7014cfc0 con 0x7f6d7006ccf0 2024-09-13T18:29:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d76135700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7014d2a0 con 0x7f6d70150530 2024-09-13T18:29:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d76135700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d70146380 con 0x7f6d700720d0 2024-09-13T18:29:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.985+0000 7f6d75133700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d7006ccf0 0x7f6d700ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.989+0000 7f6d75133700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d7006ccf0 0x7f6d700ce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37402/0 (socket says 172.21.15.44:37402) 2024-09-13T18:29:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.989+0000 7f6d75133700 1 -- 172.21.15.44:0/4098206241 learned_addr learned my addr 172.21.15.44:0/4098206241 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.989+0000 7f6d75934700 1 --2- 172.21.15.44:0/4098206241 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d70150530 0x7f6d7014b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.989+0000 7f6d74932700 1 --2- 172.21.15.44:0/4098206241 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6d700720d0 0x7f6d7015be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.989+0000 7f6d75133700 1 -- 172.21.15.44:0/4098206241 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6d700720d0 msgr2=0x7f6d7015be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.989+0000 7f6d75133700 1 --2- 172.21.15.44:0/4098206241 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6d700720d0 0x7f6d7015be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.989+0000 7f6d75133700 1 -- 172.21.15.44:0/4098206241 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d70150530 msgr2=0x7f6d7014b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.989+0000 7f6d75133700 1 --2- 172.21.15.44:0/4098206241 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d70150530 0x7f6d7014b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:00.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.989+0000 7f6d75133700 1 -- 172.21.15.44:0/4098206241 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d680094b0 con 0x7f6d7006ccf0 2024-09-13T18:29:00.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.989+0000 7f6d75133700 1 --2- 172.21.15.44:0/4098206241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d7006ccf0 0x7f6d700ce880 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c007ef0 tx=0x7f6d6c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:00.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.989+0000 7f6d65ffb700 1 -- 172.21.15.44:0/4098206241 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c00edf0 con 0x7f6d7006ccf0 2024-09-13T18:29:00.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.989+0000 7f6d65ffb700 1 -- 172.21.15.44:0/4098206241 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6c014420 con 0x7f6d7006ccf0 2024-09-13T18:29:00.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.989+0000 7f6d76135700 1 -- 172.21.15.44:0/4098206241 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d70146660 con 0x7f6d7006ccf0 2024-09-13T18:29:00.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.989+0000 7f6d65ffb700 1 -- 172.21.15.44:0/4098206241 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c0147d0 con 0x7f6d7006ccf0 2024-09-13T18:29:00.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.989+0000 7f6d76135700 1 -- 172.21.15.44:0/4098206241 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d7015c390 con 0x7f6d7006ccf0 2024-09-13T18:29:00.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.989+0000 7f6d76135700 1 -- 172.21.15.44:0/4098206241 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d7014d4c0 con 0x7f6d7006ccf0 2024-09-13T18:29:00.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.989+0000 7f6d65ffb700 1 -- 172.21.15.44:0/4098206241 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6d6c014930 con 0x7f6d7006ccf0 2024-09-13T18:29:01.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.989+0000 7f6d65ffb700 1 --2- 172.21.15.44:0/4098206241 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6d54066730 0x7f6d54068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:01.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.989+0000 7f6d65ffb700 1 -- 172.21.15.44:0/4098206241 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5443+0+0 (secure 0 0 0) 0x7f6d6c0847a0 con 0x7f6d7006ccf0 2024-09-13T18:29:01.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.989+0000 7f6d74932700 1 --2- 172.21.15.44:0/4098206241 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6d54066730 0x7f6d54068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:01.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.993+0000 7f6d74932700 1 --2- 172.21.15.44:0/4098206241 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6d54066730 0x7f6d54068bf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6d701581b0 tx=0x7f6d60007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:01.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:00.997+0000 7f6d65ffb700 1 -- 172.21.15.44:0/4098206241 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6d6c051c10 con 0x7f6d7006ccf0 2024-09-13T18:29:01.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.173+0000 7f6d76135700 1 -- 172.21.15.44:0/4098206241 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6d700b39b0 con 0x7f6d7006ccf0 2024-09-13T18:29:01.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.845+0000 7f6d65ffb700 1 -- 172.21.15.44:0/4098206241 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6d6c055230 con 0x7f6d7006ccf0 2024-09-13T18:29:01.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.853+0000 7f6d76135700 1 -- 172.21.15.44:0/4098206241 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6d54066730 msgr2=0x7f6d54068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:01.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.853+0000 7f6d76135700 1 --2- 172.21.15.44:0/4098206241 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6d54066730 0x7f6d54068bf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6d701581b0 tx=0x7f6d60007de0 comp rx=0 tx=0).stop 2024-09-13T18:29:01.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.853+0000 7f6d76135700 1 -- 172.21.15.44:0/4098206241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d7006ccf0 msgr2=0x7f6d700ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:01.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.853+0000 7f6d76135700 1 --2- 172.21.15.44:0/4098206241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d7006ccf0 0x7f6d700ce880 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c007ef0 tx=0x7f6d6c00e3c0 comp rx=0 tx=0).stop 2024-09-13T18:29:01.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.853+0000 7f6d76135700 1 -- 172.21.15.44:0/4098206241 shutdown_connections 2024-09-13T18:29:01.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.853+0000 7f6d76135700 1 --2- 172.21.15.44:0/4098206241 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6d54066730 0x7f6d54068bf0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:01.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.853+0000 7f6d76135700 1 --2- 172.21.15.44:0/4098206241 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d70150530 0x7f6d7014b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:01.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.853+0000 7f6d76135700 1 --2- 172.21.15.44:0/4098206241 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6d700720d0 0x7f6d7015be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:01.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.853+0000 7f6d76135700 1 --2- 172.21.15.44:0/4098206241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d7006ccf0 0x7f6d700ce880 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:01.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.853+0000 7f6d76135700 1 -- 172.21.15.44:0/4098206241 >> 172.21.15.44:0/4098206241 conn(0x7f6d700cfad0 msgr2=0x7f6d7014d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:01.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.853+0000 7f6d76135700 1 -- 172.21.15.44:0/4098206241 shutdown_connections 2024-09-13T18:29:01.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.853+0000 7f6d76135700 1 -- 172.21.15.44:0/4098206241 wait complete. 2024-09-13T18:29:01.861 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2024-09-13T18:29:01.873 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:29:01.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.977+0000 7f9259a38700 1 Processor -- start 2024-09-13T18:29:01.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.977+0000 7f9259a38700 1 -- start start 2024-09-13T18:29:01.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.981+0000 7f9259a38700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9254159080 0x7f92540caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:01.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.981+0000 7f9259a38700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92540cb0d0 0x7f92540cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:01.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.981+0000 7f9259a38700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925415d800 con 0x7f9254159460 2024-09-13T18:29:01.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.981+0000 7f9259a38700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92540ca640 con 0x7f9254159080 2024-09-13T18:29:01.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.981+0000 7f9259a38700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925415cc10 con 0x7f92540cb0d0 2024-09-13T18:29:01.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.981+0000 7f9258a36700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9254159080 0x7f92540caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:01.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.981+0000 7f9258a36700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9254159080 0x7f92540caa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45318/0 (socket says 172.21.15.44:45318) 2024-09-13T18:29:01.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.981+0000 7f9258a36700 1 -- 172.21.15.44:0/1591813139 learned_addr learned my addr 172.21.15.44:0/1591813139 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:01.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.981+0000 7f924bfff700 1 --2- 172.21.15.44:0/1591813139 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92540cb0d0 0x7f92540cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:01.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.981+0000 7f9258a36700 1 -- 172.21.15.44:0/1591813139 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92540cb0d0 msgr2=0x7f92540cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:01.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.981+0000 7f9258a36700 1 --2- 172.21.15.44:0/1591813139 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92540cb0d0 0x7f92540cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:01.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.981+0000 7f9258a36700 1 -- 172.21.15.44:0/1591813139 >> v1:172.21.15.99:6789/0 conn(0x7f9254159460 legacy=0x7f9254070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:01.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.981+0000 7f9258a36700 1 -- 172.21.15.44:0/1591813139 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925415ced0 con 0x7f9254159080 2024-09-13T18:29:01.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.981+0000 7f9258a36700 1 --2- 172.21.15.44:0/1591813139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9254159080 0x7f92540caa00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9250009910 tx=0x7f9250009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5b2ad7774873ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:01.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.981+0000 7f924b7fe700 1 -- 172.21.15.44:0/1591813139 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250011830 con 0x7f9254159080 2024-09-13T18:29:01.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.981+0000 7f924b7fe700 1 -- 172.21.15.44:0/1591813139 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9250011990 con 0x7f9254159080 2024-09-13T18:29:01.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.981+0000 7f924b7fe700 1 -- 172.21.15.44:0/1591813139 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250011d40 con 0x7f9254159080 2024-09-13T18:29:01.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.985+0000 7f9259a38700 1 -- 172.21.15.44:0/1591813139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9254159080 msgr2=0x7f92540caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:01.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.985+0000 7f9259a38700 1 --2- 172.21.15.44:0/1591813139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9254159080 0x7f92540caa00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9250009910 tx=0x7f9250009c20 comp rx=0 tx=0).stop 2024-09-13T18:29:01.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.985+0000 7f9259a38700 1 -- 172.21.15.44:0/1591813139 shutdown_connections 2024-09-13T18:29:01.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.985+0000 7f9259a38700 1 --2- 172.21.15.44:0/1591813139 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92540cb0d0 0x7f92540cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:01.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.985+0000 7f9259a38700 1 --2- 172.21.15.44:0/1591813139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9254159080 0x7f92540caa00 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:01.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.985+0000 7f9259a38700 1 -- 172.21.15.44:0/1591813139 >> 172.21.15.44:0/1591813139 conn(0x7f92540cba60 msgr2=0x7f92540cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:01.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.985+0000 7f9259a38700 1 -- 172.21.15.44:0/1591813139 shutdown_connections 2024-09-13T18:29:01.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.985+0000 7f9259a38700 1 -- 172.21.15.44:0/1591813139 wait complete. 2024-09-13T18:29:01.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.985+0000 7f9259a38700 1 Processor -- start 2024-09-13T18:29:01.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.985+0000 7f9259a38700 1 -- start start 2024-09-13T18:29:01.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f9259a38700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92540cb0d0 0x7f92540c7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:01.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f9259a38700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9254159080 0x7f92540cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:01.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f9259a38700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9254159460 0x7f92540cd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:01.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f9259a38700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92541f44e0 con 0x7f9254159460 2024-09-13T18:29:01.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f9259a38700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92541f4970 con 0x7f9254159080 2024-09-13T18:29:01.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f9259a38700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92541f3bb0 con 0x7f92540cb0d0 2024-09-13T18:29:01.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f9258a36700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92540cb0d0 0x7f92540c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:01.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f9259237700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9254159460 0x7f92540cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:01.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f9258a36700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92540cb0d0 0x7f92540c7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:44630/0 (socket says 172.21.15.44:44630) 2024-09-13T18:29:01.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f9258a36700 1 -- 172.21.15.44:0/504122390 learned_addr learned my addr 172.21.15.44:0/504122390 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:01.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f924bfff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9254159080 0x7f92540cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:01.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f9258a36700 1 -- 172.21.15.44:0/504122390 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9254159080 msgr2=0x7f92540cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:01.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f9258a36700 1 --2- 172.21.15.44:0/504122390 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9254159080 0x7f92540cd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:01.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f9258a36700 1 -- 172.21.15.44:0/504122390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9254159460 msgr2=0x7f92540cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:01.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f9258a36700 1 --2- 172.21.15.44:0/504122390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9254159460 0x7f92540cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:01.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f9258a36700 1 -- 172.21.15.44:0/504122390 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9250009570 con 0x7f92540cb0d0 2024-09-13T18:29:01.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f9259237700 1 --2- 172.21.15.44:0/504122390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9254159460 0x7f92540cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:01.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f9258a36700 1 --2- 172.21.15.44:0/504122390 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92540cb0d0 0x7f92540c7130 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9250000c00 tx=0x7f9250004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:01.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f92497fa700 1 -- 172.21.15.44:0/504122390 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250004510 con 0x7f92540cb0d0 2024-09-13T18:29:01.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f92497fa700 1 -- 172.21.15.44:0/504122390 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92500036c0 con 0x7f92540cb0d0 2024-09-13T18:29:01.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f92497fa700 1 -- 172.21.15.44:0/504122390 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250003a70 con 0x7f92540cb0d0 2024-09-13T18:29:01.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f9259a38700 1 -- 172.21.15.44:0/504122390 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92541f3e90 con 0x7f92540cb0d0 2024-09-13T18:29:01.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f9259a38700 1 -- 172.21.15.44:0/504122390 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92540c7bf0 con 0x7f92540cb0d0 2024-09-13T18:29:01.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.989+0000 7f9259a38700 1 -- 172.21.15.44:0/504122390 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92540b4f30 con 0x7f92540cb0d0 2024-09-13T18:29:01.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.993+0000 7f92497fa700 1 -- 172.21.15.44:0/504122390 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9250003bd0 con 0x7f92540cb0d0 2024-09-13T18:29:02.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.993+0000 7f92497fa700 1 --2- 172.21.15.44:0/504122390 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9240066730 0x7f9240068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:02.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.993+0000 7f92497fa700 1 -- 172.21.15.44:0/504122390 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9250021030 con 0x7f92540cb0d0 2024-09-13T18:29:02.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.993+0000 7f924bfff700 1 --2- 172.21.15.44:0/504122390 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9240066730 0x7f9240068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:02.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:01.993+0000 7f924bfff700 1 --2- 172.21.15.44:0/504122390 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9240066730 0x7f9240068bf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9254153de0 tx=0x7f924400a350 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:02.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.005+0000 7f92497fa700 1 -- 172.21.15.44:0/504122390 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9250052c70 con 0x7f92540cb0d0 2024-09-13T18:29:02.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.173+0000 7f9259a38700 1 -- 172.21.15.44:0/504122390 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f92541f3cf0 con 0x7f92540cb0d0 2024-09-13T18:29:02.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.181+0000 7f92497fa700 1 -- 172.21.15.44:0/504122390 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f92541f3cf0 con 0x7f92540cb0d0 2024-09-13T18:29:02.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.185+0000 7f9259a38700 1 -- 172.21.15.44:0/504122390 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9240066730 msgr2=0x7f9240068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:02.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.185+0000 7f9259a38700 1 --2- 172.21.15.44:0/504122390 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9240066730 0x7f9240068bf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9254153de0 tx=0x7f924400a350 comp rx=0 tx=0).stop 2024-09-13T18:29:02.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.185+0000 7f9259a38700 1 -- 172.21.15.44:0/504122390 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92540cb0d0 msgr2=0x7f92540c7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:02.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.185+0000 7f9259a38700 1 --2- 172.21.15.44:0/504122390 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92540cb0d0 0x7f92540c7130 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9250000c00 tx=0x7f9250004770 comp rx=0 tx=0).stop 2024-09-13T18:29:02.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.185+0000 7f9259a38700 1 -- 172.21.15.44:0/504122390 shutdown_connections 2024-09-13T18:29:02.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.185+0000 7f9259a38700 1 --2- 172.21.15.44:0/504122390 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9240066730 0x7f9240068bf0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.185+0000 7f9259a38700 1 --2- 172.21.15.44:0/504122390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9254159460 0x7f92540cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.185+0000 7f9259a38700 1 --2- 172.21.15.44:0/504122390 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9254159080 0x7f92540cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.185+0000 7f9259a38700 1 --2- 172.21.15.44:0/504122390 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92540cb0d0 0x7f92540c7130 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.185+0000 7f9259a38700 1 -- 172.21.15.44:0/504122390 >> 172.21.15.44:0/504122390 conn(0x7f92540cba60 msgr2=0x7f92540b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:02.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.185+0000 7f9259a38700 1 -- 172.21.15.44:0/504122390 shutdown_connections 2024-09-13T18:29:02.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.185+0000 7f9259a38700 1 -- 172.21.15.44:0/504122390 wait complete. 2024-09-13T18:29:02.207 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty' 2024-09-13T18:29:02.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.313+0000 7f9ab4822700 1 Processor -- start 2024-09-13T18:29:02.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.313+0000 7f9ab4822700 1 -- start start 2024-09-13T18:29:02.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.313+0000 7f9ab4822700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9ab015a8e0 0x7f9ab006ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:02.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.313+0000 7f9ab4822700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9ab00d0780 0x7f9ab00d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:02.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.313+0000 7f9ab4822700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab015ce50 con 0x7f9ab00b5c00 2024-09-13T18:29:02.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.313+0000 7f9ab4822700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab015e2f0 con 0x7f9ab015a8e0 2024-09-13T18:29:02.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.313+0000 7f9ab4822700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab00d1150 con 0x7f9ab00d0780 2024-09-13T18:29:02.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.313+0000 7f9aaf7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9ab015a8e0 0x7f9ab006ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:02.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.313+0000 7f9aaf7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9ab015a8e0 0x7f9ab006ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45328/0 (socket says 172.21.15.44:45328) 2024-09-13T18:29:02.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.313+0000 7f9aaf7fe700 1 -- 172.21.15.44:0/3568634803 learned_addr learned my addr 172.21.15.44:0/3568634803 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:02.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.313+0000 7f9aaf7fe700 1 -- 172.21.15.44:0/3568634803 >> v2:172.21.15.99:3300/0 conn(0x7f9ab00d0780 msgr2=0x7f9ab00d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:02.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.313+0000 7f9aaeffd700 1 --2- 172.21.15.44:0/3568634803 >> v2:172.21.15.99:3300/0 conn(0x7f9ab00d0780 0x7f9ab00d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:02.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.313+0000 7f9aaf7fe700 1 --2- 172.21.15.44:0/3568634803 >> v2:172.21.15.99:3300/0 conn(0x7f9ab00d0780 0x7f9ab00d0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.313+0000 7f9aaf7fe700 1 -- 172.21.15.44:0/3568634803 >> v1:172.21.15.99:6789/0 conn(0x7f9ab00b5c00 legacy=0x7f9ab00b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:02.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.313+0000 7f9aaf7fe700 1 -- 172.21.15.44:0/3568634803 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab015c240 con 0x7f9ab015a8e0 2024-09-13T18:29:02.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.313+0000 7f9aaeffd700 1 --2- 172.21.15.44:0/3568634803 >> v2:172.21.15.99:3300/0 conn(0x7f9ab00d0780 0x7f9ab00d0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:02.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.313+0000 7f9aaf7fe700 1 --2- 172.21.15.44:0/3568634803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ab015a8e0 0x7f9ab006ebb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00d06d0 tx=0x7f9aa0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2318496d966513 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:02.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.317+0000 7f9aae7fc700 1 -- 172.21.15.44:0/3568634803 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0004230 con 0x7f9ab015a8e0 2024-09-13T18:29:02.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.317+0000 7f9aae7fc700 1 -- 172.21.15.44:0/3568634803 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa0004390 con 0x7f9ab015a8e0 2024-09-13T18:29:02.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.317+0000 7f9aae7fc700 1 -- 172.21.15.44:0/3568634803 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa00036c0 con 0x7f9ab015a8e0 2024-09-13T18:29:02.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.317+0000 7f9ab4822700 1 -- 172.21.15.44:0/3568634803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ab015a8e0 msgr2=0x7f9ab006ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:02.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.317+0000 7f9ab4822700 1 --2- 172.21.15.44:0/3568634803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ab015a8e0 0x7f9ab006ebb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00d06d0 tx=0x7f9aa0009bf0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.317+0000 7f9ab4822700 1 -- 172.21.15.44:0/3568634803 shutdown_connections 2024-09-13T18:29:02.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.317+0000 7f9ab4822700 1 --2- 172.21.15.44:0/3568634803 >> v2:172.21.15.99:3300/0 conn(0x7f9ab00d0780 0x7f9ab00d0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.317+0000 7f9ab4822700 1 --2- 172.21.15.44:0/3568634803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ab015a8e0 0x7f9ab006ebb0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.317+0000 7f9ab4822700 1 -- 172.21.15.44:0/3568634803 >> 172.21.15.44:0/3568634803 conn(0x7f9ab006a730 msgr2=0x7f9ab0071d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:02.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.317+0000 7f9ab4822700 1 -- 172.21.15.44:0/3568634803 shutdown_connections 2024-09-13T18:29:02.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.317+0000 7f9ab4822700 1 -- 172.21.15.44:0/3568634803 wait complete. 2024-09-13T18:29:02.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.317+0000 7f9ab4822700 1 Processor -- start 2024-09-13T18:29:02.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.317+0000 7f9ab4822700 1 -- start start 2024-09-13T18:29:02.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.317+0000 7f9ab4822700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ab00b5c00 0x7f9ab0159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:02.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.317+0000 7f9ab4822700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ab00d0780 0x7f9ab0156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:02.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.321+0000 7f9ab4822700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ab015a8e0 0x7f9ab01f2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:02.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.321+0000 7f9ab4822700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab01f3340 con 0x7f9ab015a8e0 2024-09-13T18:29:02.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.321+0000 7f9ab4822700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab0156550 con 0x7f9ab00b5c00 2024-09-13T18:29:02.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.321+0000 7f9ab4822700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab01f2840 con 0x7f9ab00d0780 2024-09-13T18:29:02.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.321+0000 7f9aaffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ab015a8e0 0x7f9ab01f2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:02.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.321+0000 7f9aaf7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ab00b5c00 0x7f9ab0159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:02.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.321+0000 7f9aaffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ab015a8e0 0x7f9ab01f2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45344/0 (socket says 172.21.15.44:45344) 2024-09-13T18:29:02.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.321+0000 7f9aaffff700 1 -- 172.21.15.44:0/2428003678 learned_addr learned my addr 172.21.15.44:0/2428003678 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:02.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.321+0000 7f9aaeffd700 1 --2- 172.21.15.44:0/2428003678 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ab00d0780 0x7f9ab0156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:02.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.321+0000 7f9aaf7fe700 1 -- 172.21.15.44:0/2428003678 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ab00d0780 msgr2=0x7f9ab0156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:02.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.321+0000 7f9aaf7fe700 1 --2- 172.21.15.44:0/2428003678 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ab00d0780 0x7f9ab0156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.321+0000 7f9aaf7fe700 1 -- 172.21.15.44:0/2428003678 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ab015a8e0 msgr2=0x7f9ab01f2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:02.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.321+0000 7f9aaf7fe700 1 --2- 172.21.15.44:0/2428003678 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ab015a8e0 0x7f9ab01f2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.321+0000 7f9aaf7fe700 1 -- 172.21.15.44:0/2428003678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa0009570 con 0x7f9ab00b5c00 2024-09-13T18:29:02.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.321+0000 7f9aaf7fe700 1 --2- 172.21.15.44:0/2428003678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ab00b5c00 0x7f9ab0159ce0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0015000 tx=0x7f9aa0004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:02.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.321+0000 7f9aa7fff700 1 -- 172.21.15.44:0/2428003678 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa000b660 con 0x7f9ab00b5c00 2024-09-13T18:29:02.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.321+0000 7f9aa7fff700 1 -- 172.21.15.44:0/2428003678 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa000b7c0 con 0x7f9ab00b5c00 2024-09-13T18:29:02.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.321+0000 7f9ab4822700 1 -- 172.21.15.44:0/2428003678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab01f2aa0 con 0x7f9ab00b5c00 2024-09-13T18:29:02.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.321+0000 7f9aa7fff700 1 -- 172.21.15.44:0/2428003678 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa000bb70 con 0x7f9ab00b5c00 2024-09-13T18:29:02.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.321+0000 7f9ab4822700 1 -- 172.21.15.44:0/2428003678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab01f3060 con 0x7f9ab00b5c00 2024-09-13T18:29:02.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.321+0000 7f9ab4822700 1 -- 172.21.15.44:0/2428003678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab015acc0 con 0x7f9ab00b5c00 2024-09-13T18:29:02.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.325+0000 7f9aa7fff700 1 -- 172.21.15.44:0/2428003678 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9aa000bcd0 con 0x7f9ab00b5c00 2024-09-13T18:29:02.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.325+0000 7f9aa7fff700 1 --2- 172.21.15.44:0/2428003678 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9a90066730 0x7f9a90068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:02.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.325+0000 7f9aa7fff700 1 -- 172.21.15.44:0/2428003678 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9aa00856d0 con 0x7f9ab00b5c00 2024-09-13T18:29:02.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.325+0000 7f9aaeffd700 1 --2- 172.21.15.44:0/2428003678 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9a90066730 0x7f9a90068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:02.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.325+0000 7f9aaeffd700 1 --2- 172.21.15.44:0/2428003678 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9a90066730 0x7f9a90068bf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00cb450 tx=0x7f9a98007810 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:02.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.333+0000 7f9aa7fff700 1 -- 172.21.15.44:0/2428003678 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9aa0052c50 con 0x7f9ab00b5c00 2024-09-13T18:29:02.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.565+0000 7f9ab4822700 1 -- 172.21.15.44:0/2428003678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty"]} v 0) v1 -- 0x7f9ab00cb1a0 con 0x7f9ab00b5c00 2024-09-13T18:29:02.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.857+0000 7f9aa7fff700 1 -- 172.21.15.44:0/2428003678 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty"]}]=0 v130) v1 ==== 150+0+0 (secure 0 0 0) 0x7f9aa0056270 con 0x7f9ab00b5c00 2024-09-13T18:29:02.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.861+0000 7f9ab4822700 1 -- 172.21.15.44:0/2428003678 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9a90066730 msgr2=0x7f9a90068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.861+0000 7f9ab4822700 1 --2- 172.21.15.44:0/2428003678 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9a90066730 0x7f9a90068bf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00cb450 tx=0x7f9a98007810 comp rx=0 tx=0).stop 2024-09-13T18:29:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.861+0000 7f9ab4822700 1 -- 172.21.15.44:0/2428003678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ab00b5c00 msgr2=0x7f9ab0159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.861+0000 7f9ab4822700 1 --2- 172.21.15.44:0/2428003678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ab00b5c00 0x7f9ab0159ce0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0015000 tx=0x7f9aa0004770 comp rx=0 tx=0).stop 2024-09-13T18:29:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.861+0000 7f9ab4822700 1 -- 172.21.15.44:0/2428003678 shutdown_connections 2024-09-13T18:29:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.861+0000 7f9ab4822700 1 --2- 172.21.15.44:0/2428003678 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9a90066730 0x7f9a90068bf0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.861+0000 7f9ab4822700 1 --2- 172.21.15.44:0/2428003678 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ab015a8e0 0x7f9ab01f2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.861+0000 7f9ab4822700 1 --2- 172.21.15.44:0/2428003678 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ab00d0780 0x7f9ab0156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.861+0000 7f9ab4822700 1 --2- 172.21.15.44:0/2428003678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ab00b5c00 0x7f9ab0159ce0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.861+0000 7f9ab4822700 1 -- 172.21.15.44:0/2428003678 >> 172.21.15.44:0/2428003678 conn(0x7f9ab006a730 msgr2=0x7f9ab00b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.865+0000 7f9ab4822700 1 -- 172.21.15.44:0/2428003678 shutdown_connections 2024-09-13T18:29:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:02.865+0000 7f9ab4822700 1 -- 172.21.15.44:0/2428003678 wait complete. 2024-09-13T18:29:02.889 INFO:tasks.cephfs_test_runner:That when some dentries in the journal but nothing is in ... ok 2024-09-13T18:29:02.889 INFO:tasks.cephfs_test_runner:Starting test: test_journal_smoke (tasks.cephfs.test_journal_repair.TestJournalRepair) 2024-09-13T18:29:02.889 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:29:03.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.001+0000 7fb8aa698700 1 Processor -- start 2024-09-13T18:29:03.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.001+0000 7fb8aa698700 1 -- start start 2024-09-13T18:29:03.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8aa698700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb8a4159770 0x7fb8a406ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8aa698700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a40cb5b0 con 0x7fb8a406e970 2024-09-13T18:29:03.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8aa698700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a40cb890 con 0x7fb8a406c3d0 2024-09-13T18:29:03.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8aa698700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a406b3d0 con 0x7fb8a4159770 2024-09-13T18:29:03.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8a8e95700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb8a406e970 0x7fb8a406bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56466/0 (socket says 172.21.15.44:56466) 2024-09-13T18:29:03.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8a8e95700 1 -- 172.21.15.44:0/285151990 learned_addr learned my addr 172.21.15.44:0/285151990 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:29:03.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb89bfff700 1 -- 172.21.15.44:0/285151990 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458004497 0 0) 0x7fb8a40cb5b0 con 0x7fb8a406e970 2024-09-13T18:29:03.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb89bfff700 1 -- 172.21.15.44:0/285151990 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8900035d0 con 0x7fb8a406e970 2024-09-13T18:29:03.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8a9696700 1 --2- 172.21.15.44:0/285151990 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb8a4159770 0x7fb8a406ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb89bfff700 1 -- 172.21.15.44:0/285151990 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3445416949 0 0) 0x7fb8900035d0 con 0x7fb8a406e970 2024-09-13T18:29:03.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb89bfff700 1 -- 172.21.15.44:0/285151990 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb8a4159770 msgr2=0x7fb8a406ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:03.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb89bfff700 1 --2- 172.21.15.44:0/285151990 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb8a4159770 0x7fb8a406ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb89bfff700 1 -- 172.21.15.44:0/285151990 >> v1:172.21.15.99:6789/0 conn(0x7fb8a406c3d0 legacy=0x7fb8a4070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:03.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb89bfff700 1 -- 172.21.15.44:0/285151990 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a406a3b0 con 0x7fb8a406e970 2024-09-13T18:29:03.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb89bfff700 1 -- 172.21.15.44:0/285151990 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7fb8a0001670 con 0x7fb8a406e970 2024-09-13T18:29:03.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb89bfff700 1 -- 172.21.15.44:0/285151990 >> v1:172.21.15.44:6789/0 conn(0x7fb8a406e970 legacy=0x7fb8a406bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb89bfff700 1 --2- 172.21.15.44:0/285151990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb890003a50 0x7fb890003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb89bfff700 1 --2- 172.21.15.44:0/285151990 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb890004870 0x7fb890004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb89bfff700 1 --2- 172.21.15.44:0/285151990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb890005230 0x7fb89000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb89bfff700 1 -- 172.21.15.44:0/285151990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a406b3d0 con 0x7fb890005230 2024-09-13T18:29:03.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb89bfff700 1 -- 172.21.15.44:0/285151990 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89000c100 con 0x7fb890003a50 2024-09-13T18:29:03.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb89bfff700 1 -- 172.21.15.44:0/285151990 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89000c290 con 0x7fb890004870 2024-09-13T18:29:03.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8a9696700 1 --2- 172.21.15.44:0/285151990 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb8a4159770 0x7fb8a406ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:03.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8a9e97700 1 --2- 172.21.15.44:0/285151990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb890005230 0x7fb89000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8a8e95700 1 --2- 172.21.15.44:0/285151990 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb890004870 0x7fb890004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8a9e97700 1 -- 172.21.15.44:0/285151990 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb890004870 msgr2=0x7fb890004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:03.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8a9e97700 1 --2- 172.21.15.44:0/285151990 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb890004870 0x7fb890004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8a9e97700 1 -- 172.21.15.44:0/285151990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb890003a50 msgr2=0x7fb890003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:03.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8a9e97700 1 --2- 172.21.15.44:0/285151990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb890003a50 0x7fb890003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8a9e97700 1 -- 172.21.15.44:0/285151990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8900035d0 con 0x7fb890005230 2024-09-13T18:29:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8a8e95700 1 --2- 172.21.15.44:0/285151990 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb890004870 0x7fb890004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8a9e97700 1 --2- 172.21.15.44:0/285151990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb890005230 0x7fb89000ba30 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb8940016e0 tx=0x7fb8900058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519d8cae36890e9c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb89bfff700 1 -- 172.21.15.44:0/285151990 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894001180 con 0x7fb890005230 2024-09-13T18:29:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb89bfff700 1 -- 172.21.15.44:0/285151990 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8940052d0 con 0x7fb890005230 2024-09-13T18:29:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb89bfff700 1 -- 172.21.15.44:0/285151990 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8940036c0 con 0x7fb890005230 2024-09-13T18:29:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8aa698700 1 -- 172.21.15.44:0/285151990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb890005230 msgr2=0x7fb89000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8aa698700 1 --2- 172.21.15.44:0/285151990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb890005230 0x7fb89000ba30 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb8940016e0 tx=0x7fb8900058a0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8a9e97700 1 -- 172.21.15.44:0/285151990 reap_dead start 2024-09-13T18:29:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8aa698700 1 -- 172.21.15.44:0/285151990 shutdown_connections 2024-09-13T18:29:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8aa698700 1 -- 172.21.15.44:0/285151990 >> 172.21.15.44:0/285151990 conn(0x7fb8a406d900 msgr2=0x7fb8a406dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8aa698700 1 -- 172.21.15.44:0/285151990 shutdown_connections 2024-09-13T18:29:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.005+0000 7fb8aa698700 1 -- 172.21.15.44:0/285151990 wait complete. 2024-09-13T18:29:03.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb8aa698700 1 Processor -- start 2024-09-13T18:29:03.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb8aa698700 1 -- start start 2024-09-13T18:29:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb8aa698700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8a414cd10 0x7fb8a40cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb8aa698700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8a40ce070 0x7fb8a40afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb8aa698700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb8a40cc4d0 0x7fb8a40b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb8aa698700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40cd6a0 con 0x7fb8a40ce070 2024-09-13T18:29:03.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb8aa698700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a414d0f0 con 0x7fb8a414cd10 2024-09-13T18:29:03.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb8aa698700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40cca90 con 0x7fb8a40cc4d0 2024-09-13T18:29:03.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb8a8e95700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8a40ce070 0x7fb8a40afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb8a8e95700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8a40ce070 0x7fb8a40afb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45366/0 (socket says 172.21.15.44:45366) 2024-09-13T18:29:03.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb8a8e95700 1 -- 172.21.15.44:0/1065455084 learned_addr learned my addr 172.21.15.44:0/1065455084 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:03.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb8a9e97700 1 --2- 172.21.15.44:0/1065455084 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb8a40cc4d0 0x7fb8a40b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb8a9696700 1 --2- 172.21.15.44:0/1065455084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8a414cd10 0x7fb8a40cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb8a8e95700 1 -- 172.21.15.44:0/1065455084 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb8a40cc4d0 msgr2=0x7fb8a40b00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb8a8e95700 1 --2- 172.21.15.44:0/1065455084 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb8a40cc4d0 0x7fb8a40b00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb8a8e95700 1 -- 172.21.15.44:0/1065455084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8a414cd10 msgr2=0x7fb8a40cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb8a8e95700 1 --2- 172.21.15.44:0/1065455084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8a414cd10 0x7fb8a40cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb8a8e95700 1 -- 172.21.15.44:0/1065455084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a40ccd70 con 0x7fb8a40ce070 2024-09-13T18:29:03.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb8a8e95700 1 --2- 172.21.15.44:0/1065455084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8a40ce070 0x7fb8a40afb70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb8a000eaf0 tx=0x7fb8a000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:03.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb899ffb700 1 -- 172.21.15.44:0/1065455084 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0005e50 con 0x7fb8a40ce070 2024-09-13T18:29:03.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb899ffb700 1 -- 172.21.15.44:0/1065455084 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a000c7e0 con 0x7fb8a40ce070 2024-09-13T18:29:03.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb899ffb700 1 -- 172.21.15.44:0/1065455084 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a000cb50 con 0x7fb8a40ce070 2024-09-13T18:29:03.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb8aa698700 1 -- 172.21.15.44:0/1065455084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a40cd050 con 0x7fb8a40ce070 2024-09-13T18:29:03.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb8aa698700 1 -- 172.21.15.44:0/1065455084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a40b3370 con 0x7fb8a40ce070 2024-09-13T18:29:03.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.009+0000 7fb8aa698700 1 -- 172.21.15.44:0/1065455084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a406cbb0 con 0x7fb8a40ce070 2024-09-13T18:29:03.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.013+0000 7fb899ffb700 1 -- 172.21.15.44:0/1065455084 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb8a000ccb0 con 0x7fb8a40ce070 2024-09-13T18:29:03.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.013+0000 7fb899ffb700 1 --2- 172.21.15.44:0/1065455084 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb888066760 0x7fb888068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.013+0000 7fb899ffb700 1 -- 172.21.15.44:0/1065455084 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb8a0084820 con 0x7fb8a40ce070 2024-09-13T18:29:03.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.013+0000 7fb8a9696700 1 --2- 172.21.15.44:0/1065455084 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb888066760 0x7fb888068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.013+0000 7fb8a9696700 1 --2- 172.21.15.44:0/1065455084 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb888066760 0x7fb888068c20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb8a404ef50 tx=0x7fb89c009850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:03.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.017+0000 7fb899ffb700 1 -- 172.21.15.44:0/1065455084 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb8a0051e10 con 0x7fb8a40ce070 2024-09-13T18:29:03.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.189+0000 7fb8aa698700 1 -- 172.21.15.44:0/1065455084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8a406ae90 con 0x7fb8a40ce070 2024-09-13T18:29:03.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.189+0000 7fb899ffb700 1 -- 172.21.15.44:0/1065455084 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+13052 (secure 0 0 0) 0x7fb8a0055430 con 0x7fb8a40ce070 2024-09-13T18:29:03.198 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:29:03.199 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":39,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:29:01.841165+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/438860530":"2024-09-14T18:28:58.764748+0000","172.21.15.44:6834/438860530":"2024-09-14T18:28:58.764748+0000","172.21.15.44:6835/939073284":"2024-09-14T18:28:29.639607+0000","172.21.15.44:6834/939073284":"2024-09-14T18:28:29.639607+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:29:03.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.193+0000 7fb8aa698700 1 -- 172.21.15.44:0/1065455084 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb888066760 msgr2=0x7fb888068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.193+0000 7fb8aa698700 1 --2- 172.21.15.44:0/1065455084 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb888066760 0x7fb888068c20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb8a404ef50 tx=0x7fb89c009850 comp rx=0 tx=0).stop 2024-09-13T18:29:03.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.193+0000 7fb8aa698700 1 -- 172.21.15.44:0/1065455084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8a40ce070 msgr2=0x7fb8a40afb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.193+0000 7fb8aa698700 1 --2- 172.21.15.44:0/1065455084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8a40ce070 0x7fb8a40afb70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb8a000eaf0 tx=0x7fb8a000ee00 comp rx=0 tx=0).stop 2024-09-13T18:29:03.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.193+0000 7fb8aa698700 1 -- 172.21.15.44:0/1065455084 shutdown_connections 2024-09-13T18:29:03.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.193+0000 7fb8aa698700 1 --2- 172.21.15.44:0/1065455084 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb888066760 0x7fb888068c20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.193+0000 7fb8aa698700 1 --2- 172.21.15.44:0/1065455084 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb8a40cc4d0 0x7fb8a40b00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.193+0000 7fb8aa698700 1 --2- 172.21.15.44:0/1065455084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8a40ce070 0x7fb8a40afb70 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.193+0000 7fb8aa698700 1 --2- 172.21.15.44:0/1065455084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8a414cd10 0x7fb8a40cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.193+0000 7fb8aa698700 1 -- 172.21.15.44:0/1065455084 >> 172.21.15.44:0/1065455084 conn(0x7fb8a406d900 msgr2=0x7fb8a4070320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:03.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.193+0000 7fb8aa698700 1 -- 172.21.15.44:0/1065455084 shutdown_connections 2024-09-13T18:29:03.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.193+0000 7fb8aa698700 1 -- 172.21.15.44:0/1065455084 wait complete. 2024-09-13T18:29:03.213 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:29:03.213 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:29:03.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.325+0000 7f3a67fff700 1 Processor -- start 2024-09-13T18:29:03.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.325+0000 7f3a67fff700 1 -- start start 2024-09-13T18:29:03.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a67fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3a6815cc20 0x7f3a680d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a67fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3a680d15a0 0x7f3a6806ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a67fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3a6806b1d0 0x7f3a680cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a67fff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a680b5bb0 con 0x7f3a6815cc20 2024-09-13T18:29:03.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a67fff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a6806b640 con 0x7f3a6806b1d0 2024-09-13T18:29:03.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a67fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680cf1d0 con 0x7f3a680d15a0 2024-09-13T18:29:03.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a66ffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3a6815cc20 0x7f3a680d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a66ffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3a6815cc20 0x7f3a680d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45374/0 (socket says 172.21.15.44:45374) 2024-09-13T18:29:03.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a66ffd700 1 -- 172.21.15.44:0/1161466717 learned_addr learned my addr 172.21.15.44:0/1161466717 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:03.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a667fc700 1 --2- 172.21.15.44:0/1161466717 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3a680d15a0 0x7f3a6806ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a677fe700 1 --2- 172.21.15.44:0/1161466717 >> v2:172.21.15.99:3300/0 conn(0x7f3a6806b1d0 0x7f3a680cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a66ffd700 1 -- 172.21.15.44:0/1161466717 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3a680d15a0 msgr2=0x7f3a6806ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:03.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a66ffd700 1 --2- 172.21.15.44:0/1161466717 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3a680d15a0 0x7f3a6806ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a66ffd700 1 -- 172.21.15.44:0/1161466717 >> v2:172.21.15.99:3300/0 conn(0x7f3a6806b1d0 msgr2=0x7f3a680cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:03.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a66ffd700 1 --2- 172.21.15.44:0/1161466717 >> v2:172.21.15.99:3300/0 conn(0x7f3a6806b1d0 0x7f3a680cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a66ffd700 1 -- 172.21.15.44:0/1161466717 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a680d1b50 con 0x7f3a6815cc20 2024-09-13T18:29:03.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a677fe700 1 --2- 172.21.15.44:0/1161466717 >> v2:172.21.15.99:3300/0 conn(0x7f3a6806b1d0 0x7f3a680cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:03.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a66ffd700 1 --2- 172.21.15.44:0/1161466717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a6815cc20 0x7f3a680d1060 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3a680cf4e0 tx=0x7f3a5c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce25a718db6882d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:03.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a65ffb700 1 -- 172.21.15.44:0/1161466717 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c011830 con 0x7f3a6815cc20 2024-09-13T18:29:03.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a65ffb700 1 -- 172.21.15.44:0/1161466717 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c011990 con 0x7f3a6815cc20 2024-09-13T18:29:03.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a65ffb700 1 -- 172.21.15.44:0/1161466717 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c011d20 con 0x7f3a6815cc20 2024-09-13T18:29:03.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a67fff700 1 -- 172.21.15.44:0/1161466717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a6815cc20 msgr2=0x7f3a680d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a67fff700 1 --2- 172.21.15.44:0/1161466717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a6815cc20 0x7f3a680d1060 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3a680cf4e0 tx=0x7f3a5c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a67fff700 1 -- 172.21.15.44:0/1161466717 shutdown_connections 2024-09-13T18:29:03.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a67fff700 1 --2- 172.21.15.44:0/1161466717 >> v2:172.21.15.99:3300/0 conn(0x7f3a6806b1d0 0x7f3a680cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a67fff700 1 --2- 172.21.15.44:0/1161466717 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3a680d15a0 0x7f3a6806ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a67fff700 1 --2- 172.21.15.44:0/1161466717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a6815cc20 0x7f3a680d1060 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a67fff700 1 -- 172.21.15.44:0/1161466717 >> 172.21.15.44:0/1161466717 conn(0x7f3a680d2ab0 msgr2=0x7f3a680d2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:03.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a67fff700 1 -- 172.21.15.44:0/1161466717 shutdown_connections 2024-09-13T18:29:03.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.329+0000 7f3a67fff700 1 -- 172.21.15.44:0/1161466717 wait complete. 2024-09-13T18:29:03.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.333+0000 7f3a67fff700 1 Processor -- start 2024-09-13T18:29:03.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.333+0000 7f3a67fff700 1 -- start start 2024-09-13T18:29:03.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.333+0000 7f3a67fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a6806b1d0 0x7f3a680ab560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.333+0000 7f3a67fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a680d15a0 0x7f3a680aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.333+0000 7f3a67fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3a6815cc20 0x7f3a681f25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.333+0000 7f3a67fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680ac750 con 0x7f3a680d15a0 2024-09-13T18:29:03.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.333+0000 7f3a67fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680abb40 con 0x7f3a6806b1d0 2024-09-13T18:29:03.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.333+0000 7f3a67fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680abe20 con 0x7f3a6815cc20 2024-09-13T18:29:03.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.333+0000 7f3a667fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a680d15a0 0x7f3a680aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.333+0000 7f3a667fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a680d15a0 0x7f3a680aaba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45384/0 (socket says 172.21.15.44:45384) 2024-09-13T18:29:03.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.333+0000 7f3a667fc700 1 -- 172.21.15.44:0/2399049711 learned_addr learned my addr 172.21.15.44:0/2399049711 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:03.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.333+0000 7f3a66ffd700 1 --2- 172.21.15.44:0/2399049711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a6806b1d0 0x7f3a680ab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.333+0000 7f3a677fe700 1 --2- 172.21.15.44:0/2399049711 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3a6815cc20 0x7f3a681f25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.333+0000 7f3a667fc700 1 -- 172.21.15.44:0/2399049711 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3a6815cc20 msgr2=0x7f3a681f25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.333+0000 7f3a667fc700 1 --2- 172.21.15.44:0/2399049711 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3a6815cc20 0x7f3a681f25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.333+0000 7f3a667fc700 1 -- 172.21.15.44:0/2399049711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a6806b1d0 msgr2=0x7f3a680ab560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.333+0000 7f3a667fc700 1 --2- 172.21.15.44:0/2399049711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a6806b1d0 0x7f3a680ab560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.333+0000 7f3a667fc700 1 -- 172.21.15.44:0/2399049711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c009570 con 0x7f3a680d15a0 2024-09-13T18:29:03.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.333+0000 7f3a66ffd700 1 --2- 172.21.15.44:0/2399049711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a6806b1d0 0x7f3a680ab560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:03.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.337+0000 7f3a667fc700 1 --2- 172.21.15.44:0/2399049711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a680d15a0 0x7f3a680aaba0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800e9d0 tx=0x7f3a5800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:03.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.337+0000 7f3a4ffff700 1 -- 172.21.15.44:0/2399049711 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a58009730 con 0x7f3a680d15a0 2024-09-13T18:29:03.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.337+0000 7f3a4ffff700 1 -- 172.21.15.44:0/2399049711 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5800c850 con 0x7f3a680d15a0 2024-09-13T18:29:03.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.337+0000 7f3a4ffff700 1 -- 172.21.15.44:0/2399049711 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5800cbe0 con 0x7f3a680d15a0 2024-09-13T18:29:03.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.337+0000 7f3a67fff700 1 -- 172.21.15.44:0/2399049711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a680ac100 con 0x7f3a680d15a0 2024-09-13T18:29:03.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.337+0000 7f3a67fff700 1 -- 172.21.15.44:0/2399049711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a680ab0e0 con 0x7f3a680d15a0 2024-09-13T18:29:03.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.337+0000 7f3a4ffff700 1 -- 172.21.15.44:0/2399049711 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3a5800cd40 con 0x7f3a680d15a0 2024-09-13T18:29:03.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.337+0000 7f3a67fff700 1 -- 172.21.15.44:0/2399049711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a680ac900 con 0x7f3a680d15a0 2024-09-13T18:29:03.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.337+0000 7f3a4ffff700 1 --2- 172.21.15.44:0/2399049711 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3a54066730 0x7f3a54068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.337+0000 7f3a4ffff700 1 -- 172.21.15.44:0/2399049711 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3a58084380 con 0x7f3a680d15a0 2024-09-13T18:29:03.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.337+0000 7f3a66ffd700 1 --2- 172.21.15.44:0/2399049711 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3a54066730 0x7f3a54068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.341+0000 7f3a66ffd700 1 --2- 172.21.15.44:0/2399049711 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3a54066730 0x7f3a54068bf0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c000c00 tx=0x7f3a5c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:03.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.345+0000 7f3a4ffff700 1 -- 172.21.15.44:0/2399049711 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3a680ac900 con 0x7f3a680d15a0 2024-09-13T18:29:03.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.509+0000 7f3a67fff700 1 -- 172.21.15.44:0/2399049711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a6806ac90 con 0x7f3a680d15a0 2024-09-13T18:29:03.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.509+0000 7f3a4ffff700 1 -- 172.21.15.44:0/2399049711 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a58017020 con 0x7f3a680d15a0 2024-09-13T18:29:03.517 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:29:03.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.513+0000 7f3a67fff700 1 -- 172.21.15.44:0/2399049711 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3a54066730 msgr2=0x7f3a54068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.513+0000 7f3a67fff700 1 --2- 172.21.15.44:0/2399049711 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3a54066730 0x7f3a54068bf0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c000c00 tx=0x7f3a5c008030 comp rx=0 tx=0).stop 2024-09-13T18:29:03.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.513+0000 7f3a67fff700 1 -- 172.21.15.44:0/2399049711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a680d15a0 msgr2=0x7f3a680aaba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.513+0000 7f3a67fff700 1 --2- 172.21.15.44:0/2399049711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a680d15a0 0x7f3a680aaba0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800e9d0 tx=0x7f3a5800ed90 comp rx=0 tx=0).stop 2024-09-13T18:29:03.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.513+0000 7f3a67fff700 1 -- 172.21.15.44:0/2399049711 shutdown_connections 2024-09-13T18:29:03.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.513+0000 7f3a67fff700 1 --2- 172.21.15.44:0/2399049711 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3a54066730 0x7f3a54068bf0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.513+0000 7f3a67fff700 1 --2- 172.21.15.44:0/2399049711 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3a6815cc20 0x7f3a681f25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.513+0000 7f3a67fff700 1 --2- 172.21.15.44:0/2399049711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a680d15a0 0x7f3a680aaba0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.513+0000 7f3a67fff700 1 --2- 172.21.15.44:0/2399049711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a6806b1d0 0x7f3a680ab560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.513+0000 7f3a67fff700 1 -- 172.21.15.44:0/2399049711 >> 172.21.15.44:0/2399049711 conn(0x7f3a680d2ab0 msgr2=0x7f3a680b70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:03.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.513+0000 7f3a67fff700 1 -- 172.21.15.44:0/2399049711 shutdown_connections 2024-09-13T18:29:03.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.513+0000 7f3a67fff700 1 -- 172.21.15.44:0/2399049711 wait complete. 2024-09-13T18:29:03.532 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke' 2024-09-13T18:29:03.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.633+0000 7f4e56b84700 1 Processor -- start 2024-09-13T18:29:03.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.633+0000 7f4e56b84700 1 -- start start 2024-09-13T18:29:03.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.633+0000 7f4e56b84700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4e50160eb0 0x7f4e50165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.633+0000 7f4e56b84700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4e501619a0 0x7f4e500b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.633+0000 7f4e56b84700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e500b3d60 con 0x7f4e500b33d0 2024-09-13T18:29:03.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.633+0000 7f4e56b84700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e50161df0 con 0x7f4e501619a0 2024-09-13T18:29:03.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.633+0000 7f4e56b84700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e50071f30 con 0x7f4e50160eb0 2024-09-13T18:29:03.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.633+0000 7f4e56383700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4e501619a0 0x7f4e500b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.633+0000 7f4e56383700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4e501619a0 0x7f4e500b3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45400/0 (socket says 172.21.15.44:45400) 2024-09-13T18:29:03.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.633+0000 7f4e56383700 1 -- 172.21.15.44:0/1826837226 learned_addr learned my addr 172.21.15.44:0/1826837226 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:03.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.633+0000 7f4e55b82700 1 --2- 172.21.15.44:0/1826837226 >> v2:172.21.15.99:3300/0 conn(0x7f4e50160eb0 0x7f4e50165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.637+0000 7f4e56383700 1 -- 172.21.15.44:0/1826837226 >> v2:172.21.15.99:3300/0 conn(0x7f4e50160eb0 msgr2=0x7f4e50165590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:03.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.637+0000 7f4e56383700 1 --2- 172.21.15.44:0/1826837226 >> v2:172.21.15.99:3300/0 conn(0x7f4e50160eb0 0x7f4e50165590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.637+0000 7f4e56383700 1 -- 172.21.15.44:0/1826837226 >> v1:172.21.15.99:6789/0 conn(0x7f4e500b33d0 legacy=0x7f4e50161290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:03.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.637+0000 7f4e56383700 1 -- 172.21.15.44:0/1826837226 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e501622e0 con 0x7f4e501619a0 2024-09-13T18:29:03.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.637+0000 7f4e56383700 1 --2- 172.21.15.44:0/1826837226 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e501619a0 0x7f4e500b3820 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4e500b33a0 tx=0x7f4e40009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e6aad6c61ec39 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:03.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.637+0000 7f4e54b80700 1 -- 172.21.15.44:0/1826837226 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e40004230 con 0x7f4e501619a0 2024-09-13T18:29:03.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.637+0000 7f4e54b80700 1 -- 172.21.15.44:0/1826837226 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e40004390 con 0x7f4e501619a0 2024-09-13T18:29:03.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.637+0000 7f4e54b80700 1 -- 172.21.15.44:0/1826837226 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e400036c0 con 0x7f4e501619a0 2024-09-13T18:29:03.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.637+0000 7f4e56b84700 1 -- 172.21.15.44:0/1826837226 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e501619a0 msgr2=0x7f4e500b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.637+0000 7f4e56b84700 1 --2- 172.21.15.44:0/1826837226 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e501619a0 0x7f4e500b3820 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4e500b33a0 tx=0x7f4e40009bf0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.637+0000 7f4e56b84700 1 -- 172.21.15.44:0/1826837226 shutdown_connections 2024-09-13T18:29:03.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.637+0000 7f4e56b84700 1 --2- 172.21.15.44:0/1826837226 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e501619a0 0x7f4e500b3820 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.637+0000 7f4e56b84700 1 --2- 172.21.15.44:0/1826837226 >> v2:172.21.15.99:3300/0 conn(0x7f4e50160eb0 0x7f4e50165590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.637+0000 7f4e56b84700 1 -- 172.21.15.44:0/1826837226 >> 172.21.15.44:0/1826837226 conn(0x7f4e500b0f00 msgr2=0x7f4e500b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:03.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.637+0000 7f4e56b84700 1 -- 172.21.15.44:0/1826837226 shutdown_connections 2024-09-13T18:29:03.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.637+0000 7f4e56b84700 1 -- 172.21.15.44:0/1826837226 wait complete. 2024-09-13T18:29:03.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.637+0000 7f4e56b84700 1 Processor -- start 2024-09-13T18:29:03.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.637+0000 7f4e56b84700 1 -- start start 2024-09-13T18:29:03.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.641+0000 7f4e56b84700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e500b33d0 0x7f4e500a9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.641+0000 7f4e56b84700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4e50160eb0 0x7f4e5014bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.641+0000 7f4e56b84700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e501619a0 0x7f4e50163920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.641+0000 7f4e56b84700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5014d280 con 0x7f4e501619a0 2024-09-13T18:29:03.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.641+0000 7f4e56b84700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5014c670 con 0x7f4e500b33d0 2024-09-13T18:29:03.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.641+0000 7f4e56b84700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5014c950 con 0x7f4e50160eb0 2024-09-13T18:29:03.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.641+0000 7f4e56383700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e501619a0 0x7f4e50163920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.641+0000 7f4e56383700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e501619a0 0x7f4e50163920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45410/0 (socket says 172.21.15.44:45410) 2024-09-13T18:29:03.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.641+0000 7f4e56383700 1 -- 172.21.15.44:0/2659443952 learned_addr learned my addr 172.21.15.44:0/2659443952 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:03.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.641+0000 7f4e55b82700 1 --2- 172.21.15.44:0/2659443952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e500b33d0 0x7f4e500a9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.641+0000 7f4e55381700 1 --2- 172.21.15.44:0/2659443952 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4e50160eb0 0x7f4e5014bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.641+0000 7f4e56383700 1 -- 172.21.15.44:0/2659443952 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4e50160eb0 msgr2=0x7f4e5014bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.641+0000 7f4e56383700 1 --2- 172.21.15.44:0/2659443952 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4e50160eb0 0x7f4e5014bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.641+0000 7f4e56383700 1 -- 172.21.15.44:0/2659443952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e500b33d0 msgr2=0x7f4e500a9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.641+0000 7f4e56383700 1 --2- 172.21.15.44:0/2659443952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e500b33d0 0x7f4e500a9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.641+0000 7f4e56383700 1 -- 172.21.15.44:0/2659443952 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e40009570 con 0x7f4e501619a0 2024-09-13T18:29:03.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.641+0000 7f4e56383700 1 --2- 172.21.15.44:0/2659443952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e501619a0 0x7f4e50163920 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4e40004000 tx=0x7f4e40004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:03.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.641+0000 7f4e4e7fc700 1 -- 172.21.15.44:0/2659443952 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4000b660 con 0x7f4e501619a0 2024-09-13T18:29:03.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.641+0000 7f4e4e7fc700 1 -- 172.21.15.44:0/2659443952 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4000b7c0 con 0x7f4e501619a0 2024-09-13T18:29:03.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.641+0000 7f4e56b84700 1 -- 172.21.15.44:0/2659443952 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5014cc30 con 0x7f4e501619a0 2024-09-13T18:29:03.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.641+0000 7f4e4e7fc700 1 -- 172.21.15.44:0/2659443952 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4000bb70 con 0x7f4e501619a0 2024-09-13T18:29:03.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.641+0000 7f4e56b84700 1 -- 172.21.15.44:0/2659443952 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5014c210 con 0x7f4e501619a0 2024-09-13T18:29:03.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.641+0000 7f4e56b84700 1 -- 172.21.15.44:0/2659443952 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5014d430 con 0x7f4e501619a0 2024-09-13T18:29:03.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.645+0000 7f4e4e7fc700 1 -- 172.21.15.44:0/2659443952 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4e40021070 con 0x7f4e501619a0 2024-09-13T18:29:03.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.645+0000 7f4e4e7fc700 1 --2- 172.21.15.44:0/2659443952 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4e3c066730 0x7f4e3c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.645+0000 7f4e4e7fc700 1 -- 172.21.15.44:0/2659443952 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4e40085510 con 0x7f4e501619a0 2024-09-13T18:29:03.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.645+0000 7f4e55b82700 1 --2- 172.21.15.44:0/2659443952 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4e3c066730 0x7f4e3c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.645+0000 7f4e55b82700 1 --2- 172.21.15.44:0/2659443952 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4e3c066730 0x7f4e3c068bf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4e48003c30 tx=0x7f4e480098d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:03.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.649+0000 7f4e4e7fc700 1 -- 172.21.15.44:0/2659443952 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4e5014d430 con 0x7f4e501619a0 2024-09-13T18:29:03.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:03.889+0000 7f4e56b84700 1 -- 172.21.15.44:0/2659443952 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke"]} v 0) v1 -- 0x7f4e500b3d60 con 0x7f4e501619a0 2024-09-13T18:29:04.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:04.865+0000 7f4e4e7fc700 1 -- 172.21.15.44:0/2659443952 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke"]}]=0 v132) v1 ==== 151+0+0 (secure 0 0 0) 0x7f4e500b3d60 con 0x7f4e501619a0 2024-09-13T18:29:04.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:04.869+0000 7f4e56b84700 1 -- 172.21.15.44:0/2659443952 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4e3c066730 msgr2=0x7f4e3c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:04.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:04.869+0000 7f4e56b84700 1 --2- 172.21.15.44:0/2659443952 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4e3c066730 0x7f4e3c068bf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4e48003c30 tx=0x7f4e480098d0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:04.869+0000 7f4e56b84700 1 -- 172.21.15.44:0/2659443952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e501619a0 msgr2=0x7f4e50163920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:04.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:04.869+0000 7f4e56b84700 1 --2- 172.21.15.44:0/2659443952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e501619a0 0x7f4e50163920 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4e40004000 tx=0x7f4e40004770 comp rx=0 tx=0).stop 2024-09-13T18:29:04.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:04.869+0000 7f4e56b84700 1 -- 172.21.15.44:0/2659443952 shutdown_connections 2024-09-13T18:29:04.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:04.869+0000 7f4e56b84700 1 --2- 172.21.15.44:0/2659443952 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4e3c066730 0x7f4e3c068bf0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:04.869+0000 7f4e56b84700 1 --2- 172.21.15.44:0/2659443952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e501619a0 0x7f4e50163920 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:04.869+0000 7f4e56b84700 1 --2- 172.21.15.44:0/2659443952 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4e50160eb0 0x7f4e5014bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:04.869+0000 7f4e56b84700 1 --2- 172.21.15.44:0/2659443952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e500b33d0 0x7f4e500a9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:04.869+0000 7f4e56b84700 1 -- 172.21.15.44:0/2659443952 >> 172.21.15.44:0/2659443952 conn(0x7f4e500b0f00 msgr2=0x7f4e500cb580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:04.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:04.869+0000 7f4e56b84700 1 -- 172.21.15.44:0/2659443952 shutdown_connections 2024-09-13T18:29:04.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:04.869+0000 7f4e56b84700 1 -- 172.21.15.44:0/2659443952 wait complete. 2024-09-13T18:29:04.894 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:29:05.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.025+0000 7f821f59e700 1 Processor -- start 2024-09-13T18:29:05.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.025+0000 7f821f59e700 1 -- start start 2024-09-13T18:29:05.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.029+0000 7f821f59e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f82200ce2d0 0x7f82200b2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.029+0000 7f821f59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82200b26b0 0x7f82200703b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.029+0000 7f821f59e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f822006dfb0 con 0x7f822006dbd0 2024-09-13T18:29:05.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.029+0000 7f821f59e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82200b2ee0 con 0x7f82200ce2d0 2024-09-13T18:29:05.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.029+0000 7f821f59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82200b31c0 con 0x7f82200b26b0 2024-09-13T18:29:05.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.029+0000 7f8217fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f82200ce2d0 0x7f82200b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.029+0000 7f821ed9d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82200b26b0 0x7f82200703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.029+0000 7f8217fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f82200ce2d0 0x7f82200b2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:36042/0 (socket says 172.21.15.44:36042) 2024-09-13T18:29:05.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.029+0000 7f8217fff700 1 -- 172.21.15.44:0/1480369014 learned_addr learned my addr 172.21.15.44:0/1480369014 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:05.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.029+0000 7f821e59c700 1 --1- 172.21.15.44:0/1480369014 >> v1:172.21.15.99:6789/0 conn(0x7f822006dbd0 0x7f82200cdbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:36522/0 (socket says 172.21.15.44:36522) 2024-09-13T18:29:05.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.029+0000 7f821ed9d700 1 -- 172.21.15.44:0/1480369014 >> v2:172.21.15.99:3300/0 conn(0x7f82200ce2d0 msgr2=0x7f82200b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:05.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.029+0000 7f821ed9d700 1 --2- 172.21.15.44:0/1480369014 >> v2:172.21.15.99:3300/0 conn(0x7f82200ce2d0 0x7f82200b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.029+0000 7f821ed9d700 1 -- 172.21.15.44:0/1480369014 >> v1:172.21.15.99:6789/0 conn(0x7f822006dbd0 legacy=0x7f82200cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.029+0000 7f821ed9d700 1 -- 172.21.15.44:0/1480369014 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82200b34a0 con 0x7f82200b26b0 2024-09-13T18:29:05.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.029+0000 7f821ed9d700 1 --2- 172.21.15.44:0/1480369014 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82200b26b0 0x7f82200703b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8218009d90 tx=0x7f821800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3ba86b426dc75b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:05.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.029+0000 7f821dd9b700 1 -- 172.21.15.44:0/1480369014 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821800e070 con 0x7f82200b26b0 2024-09-13T18:29:05.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.029+0000 7f821dd9b700 1 -- 172.21.15.44:0/1480369014 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821800bb20 con 0x7f82200b26b0 2024-09-13T18:29:05.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.029+0000 7f821dd9b700 1 -- 172.21.15.44:0/1480369014 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8218012430 con 0x7f82200b26b0 2024-09-13T18:29:05.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.033+0000 7f821f59e700 1 -- 172.21.15.44:0/1480369014 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82200b26b0 msgr2=0x7f82200703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.033+0000 7f821f59e700 1 --2- 172.21.15.44:0/1480369014 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82200b26b0 0x7f82200703b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8218009d90 tx=0x7f821800b330 comp rx=0 tx=0).stop 2024-09-13T18:29:05.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.033+0000 7f821f59e700 1 -- 172.21.15.44:0/1480369014 shutdown_connections 2024-09-13T18:29:05.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.033+0000 7f821f59e700 1 --2- 172.21.15.44:0/1480369014 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82200b26b0 0x7f82200703b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.033+0000 7f821f59e700 1 --2- 172.21.15.44:0/1480369014 >> v2:172.21.15.99:3300/0 conn(0x7f82200ce2d0 0x7f82200b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.033+0000 7f821f59e700 1 -- 172.21.15.44:0/1480369014 >> 172.21.15.44:0/1480369014 conn(0x7f82200cba60 msgr2=0x7f82200cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:05.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.033+0000 7f821f59e700 1 -- 172.21.15.44:0/1480369014 shutdown_connections 2024-09-13T18:29:05.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.033+0000 7f821f59e700 1 -- 172.21.15.44:0/1480369014 wait complete. 2024-09-13T18:29:05.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.033+0000 7f821f59e700 1 Processor -- start 2024-09-13T18:29:05.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.037+0000 7f821f59e700 1 -- start start 2024-09-13T18:29:05.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.037+0000 7f821f59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f822006dbd0 0x7f8220154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.037+0000 7f821f59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82200b26b0 0x7f8220159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.037+0000 7f821f59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82200ce2d0 0x7f8220159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.037+0000 7f821f59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82201430c0 con 0x7f822006dbd0 2024-09-13T18:29:05.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.037+0000 7f821f59e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82201f2000 con 0x7f82200b26b0 2024-09-13T18:29:05.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.037+0000 7f821e59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f822006dbd0 0x7f8220154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.037+0000 7f821f59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8220143360 con 0x7f82200ce2d0 2024-09-13T18:29:05.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.037+0000 7f821e59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f822006dbd0 0x7f8220154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45424/0 (socket says 172.21.15.44:45424) 2024-09-13T18:29:05.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.037+0000 7f821e59c700 1 -- 172.21.15.44:0/552723038 learned_addr learned my addr 172.21.15.44:0/552723038 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:05.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.037+0000 7f821ed9d700 1 --2- 172.21.15.44:0/552723038 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82200ce2d0 0x7f8220159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.037+0000 7f8217fff700 1 --2- 172.21.15.44:0/552723038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82200b26b0 0x7f8220159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.037+0000 7f821e59c700 1 -- 172.21.15.44:0/552723038 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82200ce2d0 msgr2=0x7f8220159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.037+0000 7f821e59c700 1 --2- 172.21.15.44:0/552723038 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82200ce2d0 0x7f8220159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.037+0000 7f821e59c700 1 -- 172.21.15.44:0/552723038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82200b26b0 msgr2=0x7f8220159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.037+0000 7f821e59c700 1 --2- 172.21.15.44:0/552723038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82200b26b0 0x7f8220159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.037+0000 7f821e59c700 1 -- 172.21.15.44:0/552723038 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8218009a70 con 0x7f822006dbd0 2024-09-13T18:29:05.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.037+0000 7f821e59c700 1 --2- 172.21.15.44:0/552723038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f822006dbd0 0x7f8220154a20 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f821000c700 tx=0x7f821000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:05.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.037+0000 7f8216ffd700 1 -- 172.21.15.44:0/552723038 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8210005cd0 con 0x7f822006dbd0 2024-09-13T18:29:05.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.041+0000 7f8216ffd700 1 -- 172.21.15.44:0/552723038 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8210005e30 con 0x7f822006dbd0 2024-09-13T18:29:05.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.041+0000 7f821f59e700 1 -- 172.21.15.44:0/552723038 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8220143640 con 0x7f822006dbd0 2024-09-13T18:29:05.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.041+0000 7f8216ffd700 1 -- 172.21.15.44:0/552723038 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82100072d0 con 0x7f822006dbd0 2024-09-13T18:29:05.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.041+0000 7f821f59e700 1 -- 172.21.15.44:0/552723038 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8220143c00 con 0x7f822006dbd0 2024-09-13T18:29:05.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.041+0000 7f821f59e700 1 -- 172.21.15.44:0/552723038 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f822006d5a0 con 0x7f822006dbd0 2024-09-13T18:29:05.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.041+0000 7f8216ffd700 1 -- 172.21.15.44:0/552723038 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8210007430 con 0x7f822006dbd0 2024-09-13T18:29:05.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.041+0000 7f8216ffd700 1 --2- 172.21.15.44:0/552723038 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8200066730 0x7f8200068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.041+0000 7f8216ffd700 1 -- 172.21.15.44:0/552723038 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8210083070 con 0x7f822006dbd0 2024-09-13T18:29:05.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.045+0000 7f8217fff700 1 --2- 172.21.15.44:0/552723038 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8200066730 0x7f8200068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.045+0000 7f8217fff700 1 --2- 172.21.15.44:0/552723038 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8200066730 0x7f8200068bf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f822015d770 tx=0x7f82080092e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:05.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.053+0000 7f8216ffd700 1 -- 172.21.15.44:0/552723038 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f82100507c0 con 0x7f822006dbd0 2024-09-13T18:29:05.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.229+0000 7f821f59e700 1 -- 172.21.15.44:0/552723038 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f82200b20f0 con 0x7f822006dbd0 2024-09-13T18:29:05.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.241+0000 7f8216ffd700 1 -- 172.21.15.44:0/552723038 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f82100170c0 con 0x7f822006dbd0 2024-09-13T18:29:05.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.241+0000 7f821f59e700 1 -- 172.21.15.44:0/552723038 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8200066730 msgr2=0x7f8200068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.241+0000 7f821f59e700 1 --2- 172.21.15.44:0/552723038 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8200066730 0x7f8200068bf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f822015d770 tx=0x7f82080092e0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.241+0000 7f821f59e700 1 -- 172.21.15.44:0/552723038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f822006dbd0 msgr2=0x7f8220154a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.241+0000 7f821f59e700 1 --2- 172.21.15.44:0/552723038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f822006dbd0 0x7f8220154a20 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f821000c700 tx=0x7f821000ca10 comp rx=0 tx=0).stop 2024-09-13T18:29:05.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.241+0000 7f821f59e700 1 -- 172.21.15.44:0/552723038 shutdown_connections 2024-09-13T18:29:05.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.241+0000 7f821f59e700 1 --2- 172.21.15.44:0/552723038 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8200066730 0x7f8200068bf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.241+0000 7f821f59e700 1 --2- 172.21.15.44:0/552723038 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82200ce2d0 0x7f8220159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.241+0000 7f821f59e700 1 --2- 172.21.15.44:0/552723038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82200b26b0 0x7f8220159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.241+0000 7f821f59e700 1 --2- 172.21.15.44:0/552723038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f822006dbd0 0x7f8220154a20 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.241+0000 7f821f59e700 1 -- 172.21.15.44:0/552723038 >> 172.21.15.44:0/552723038 conn(0x7f82200cba60 msgr2=0x7f822015dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:05.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.241+0000 7f821f59e700 1 -- 172.21.15.44:0/552723038 shutdown_connections 2024-09-13T18:29:05.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.241+0000 7f821f59e700 1 -- 172.21.15.44:0/552723038 wait complete. 2024-09-13T18:29:05.266 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:29:05.266 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:29:05.283 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:29:05.305 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:29:05.305 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:29:05.305 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:29:05.312 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349428k,nr_inodes=4087357,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16693 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276112k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:29:05.313 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:29:05.313 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:29:05.356 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346268k,nr_inodes=4086567,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19562 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275480k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:29:05.356 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:29:05.356 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:29:05.363 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349428k,nr_inodes=4087357,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16693 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276112k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:29:05.363 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:29:05.363 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:29:05.370 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346268k,nr_inodes=4086567,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19562 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275480k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:29:05.370 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:29:05.371 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:29:05.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe39091d700 1 Processor -- start 2024-09-13T18:29:05.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe39091d700 1 -- start start 2024-09-13T18:29:05.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe39091d700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe38c15ac40 0x7fe38c06ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe39091d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe38c0ad710 0x7fe38c0adba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe39091d700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe38c15b020 con 0x7fe38c15e730 2024-09-13T18:29:05.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe39091d700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe38c0b31e0 con 0x7fe38c0ad710 2024-09-13T18:29:05.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe39091d700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe38c0ae0e0 con 0x7fe38c15ac40 2024-09-13T18:29:05.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe381d9b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe38c0ad710 0x7fe38c0adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe381d9b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe38c0ad710 0x7fe38c0adba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45440/0 (socket says 172.21.15.44:45440) 2024-09-13T18:29:05.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe381d9b700 1 -- 172.21.15.44:0/157813297 learned_addr learned my addr 172.21.15.44:0/157813297 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:05.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe38a59c700 1 --2- 172.21.15.44:0/157813297 >> v2:172.21.15.99:3300/0 conn(0x7fe38c15ac40 0x7fe38c06ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe381d9b700 1 -- 172.21.15.44:0/157813297 >> v2:172.21.15.99:3300/0 conn(0x7fe38c15ac40 msgr2=0x7fe38c06ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:05.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe381d9b700 1 --2- 172.21.15.44:0/157813297 >> v2:172.21.15.99:3300/0 conn(0x7fe38c15ac40 0x7fe38c06ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe381d9b700 1 -- 172.21.15.44:0/157813297 >> v1:172.21.15.44:6789/0 conn(0x7fe38c15e730 legacy=0x7fe38c15eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:05.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe381d9b700 1 -- 172.21.15.44:0/157813297 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38c06a6f0 con 0x7fe38c0ad710 2024-09-13T18:29:05.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe38a59c700 1 --2- 172.21.15.44:0/157813297 >> v2:172.21.15.99:3300/0 conn(0x7fe38c15ac40 0x7fe38c06ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:05.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe381d9b700 1 --2- 172.21.15.44:0/157813297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe38c0ad710 0x7fe38c0adba0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe38c071fc0 tx=0x7fe374009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf8371e4ff7fb6a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe389d9b700 1 -- 172.21.15.44:0/157813297 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37400b8a0 con 0x7fe38c0ad710 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe389d9b700 1 -- 172.21.15.44:0/157813297 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37400ba00 con 0x7fe38c0ad710 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe389d9b700 1 -- 172.21.15.44:0/157813297 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37400bd90 con 0x7fe38c0ad710 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe39091d700 1 -- 172.21.15.44:0/157813297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe38c0ad710 msgr2=0x7fe38c0adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe39091d700 1 --2- 172.21.15.44:0/157813297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe38c0ad710 0x7fe38c0adba0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe38c071fc0 tx=0x7fe374009bf0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe39091d700 1 -- 172.21.15.44:0/157813297 shutdown_connections 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe39091d700 1 --2- 172.21.15.44:0/157813297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe38c0ad710 0x7fe38c0adba0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe39091d700 1 --2- 172.21.15.44:0/157813297 >> v2:172.21.15.99:3300/0 conn(0x7fe38c15ac40 0x7fe38c06ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.525+0000 7fe39091d700 1 -- 172.21.15.44:0/157813297 >> 172.21.15.44:0/157813297 conn(0x7fe38c0ce980 msgr2=0x7fe38c0ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.529+0000 7fe39091d700 1 -- 172.21.15.44:0/157813297 shutdown_connections 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.529+0000 7fe39091d700 1 -- 172.21.15.44:0/157813297 wait complete. 2024-09-13T18:29:05.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.529+0000 7fe39091d700 1 Processor -- start 2024-09-13T18:29:05.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.529+0000 7fe39091d700 1 -- start start 2024-09-13T18:29:05.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.533+0000 7fe39091d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe38c0ad710 0x7fe38c14f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.533+0000 7fe39091d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe38c15ac40 0x7fe38c159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.533+0000 7fe39091d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe38c15e730 0x7fe38c15d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.533+0000 7fe39091d700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c157a90 con 0x7fe38c15ac40 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.533+0000 7fe39091d700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c157300 con 0x7fe38c0ad710 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.533+0000 7fe39091d700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c14fad0 con 0x7fe38c15e730 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.533+0000 7fe381d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe38c15ac40 0x7fe38c159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.533+0000 7fe381d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe38c15ac40 0x7fe38c159e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45448/0 (socket says 172.21.15.44:45448) 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.533+0000 7fe381d9b700 1 -- 172.21.15.44:0/1224693288 learned_addr learned my addr 172.21.15.44:0/1224693288 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.533+0000 7fe38a59c700 1 --2- 172.21.15.44:0/1224693288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe38c0ad710 0x7fe38c14f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.533+0000 7fe38ad9d700 1 --2- 172.21.15.44:0/1224693288 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe38c15e730 0x7fe38c15d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.533+0000 7fe381d9b700 1 -- 172.21.15.44:0/1224693288 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe38c15e730 msgr2=0x7fe38c15d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.533+0000 7fe381d9b700 1 --2- 172.21.15.44:0/1224693288 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe38c15e730 0x7fe38c15d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.533+0000 7fe381d9b700 1 -- 172.21.15.44:0/1224693288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe38c0ad710 msgr2=0x7fe38c14f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.533+0000 7fe381d9b700 1 --2- 172.21.15.44:0/1224693288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe38c0ad710 0x7fe38c14f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.533+0000 7fe381d9b700 1 -- 172.21.15.44:0/1224693288 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe374009570 con 0x7fe38c15ac40 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.533+0000 7fe38a59c700 1 --2- 172.21.15.44:0/1224693288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe38c0ad710 0x7fe38c14f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.533+0000 7fe381d9b700 1 --2- 172.21.15.44:0/1224693288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe38c15ac40 0x7fe38c159e90 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe374014040 tx=0x7fe374004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.533+0000 7fe3837fe700 1 -- 172.21.15.44:0/1224693288 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe374004610 con 0x7fe38c15ac40 2024-09-13T18:29:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.533+0000 7fe3837fe700 1 -- 172.21.15.44:0/1224693288 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37401e070 con 0x7fe38c15ac40 2024-09-13T18:29:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.533+0000 7fe39091d700 1 -- 172.21.15.44:0/1224693288 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38c152e80 con 0x7fe38c15ac40 2024-09-13T18:29:05.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.533+0000 7fe3837fe700 1 -- 172.21.15.44:0/1224693288 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe374003d30 con 0x7fe38c15ac40 2024-09-13T18:29:05.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.533+0000 7fe39091d700 1 -- 172.21.15.44:0/1224693288 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38c153210 con 0x7fe38c15ac40 2024-09-13T18:29:05.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.537+0000 7fe39091d700 1 -- 172.21.15.44:0/1224693288 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe38c06d950 con 0x7fe38c15ac40 2024-09-13T18:29:05.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.537+0000 7fe3837fe700 1 -- 172.21.15.44:0/1224693288 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe374011420 con 0x7fe38c15ac40 2024-09-13T18:29:05.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.537+0000 7fe3837fe700 1 --2- 172.21.15.44:0/1224693288 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe36c066730 0x7fe36c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.537+0000 7fe3837fe700 1 -- 172.21.15.44:0/1224693288 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fe374020070 con 0x7fe38c15ac40 2024-09-13T18:29:05.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.537+0000 7fe38a59c700 1 --2- 172.21.15.44:0/1224693288 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe36c066730 0x7fe36c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.537+0000 7fe38a59c700 1 --2- 172.21.15.44:0/1224693288 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe36c066730 0x7fe36c068bf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe37c006fd0 tx=0x7fe37c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:05.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.545+0000 7fe3837fe700 1 -- 172.21.15.44:0/1224693288 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe374052d80 con 0x7fe38c15ac40 2024-09-13T18:29:05.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.761+0000 7fe39091d700 1 -- 172.21.15.44:0/1224693288 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe38c06cd20 con 0x7fe38c15ac40 2024-09-13T18:29:05.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.761+0000 7fe3837fe700 1 -- 172.21.15.44:0/1224693288 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fe374015de0 con 0x7fe38c15ac40 2024-09-13T18:29:05.768 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:29:05.768 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5191,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/2593282586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2593282586},{"type":"v1","addr":"172.21.15.99:6836","nonce":2593282586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3094334762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3094334762},{"type":"v1","addr":"172.21.15.99:6837","nonce":3094334762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1843893566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1843893566},{"type":"v1","addr":"172.21.15.44:6833","nonce":1843893566}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5901,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2464919083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2464919083},{"type":"v1","addr":"172.21.15.44:6835","nonce":2464919083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[]} 2024-09-13T18:29:05.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.761+0000 7fe39091d700 1 -- 172.21.15.44:0/1224693288 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe36c066730 msgr2=0x7fe36c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.761+0000 7fe39091d700 1 --2- 172.21.15.44:0/1224693288 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe36c066730 0x7fe36c068bf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe37c006fd0 tx=0x7fe37c008040 comp rx=0 tx=0).stop 2024-09-13T18:29:05.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.761+0000 7fe39091d700 1 -- 172.21.15.44:0/1224693288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe38c15ac40 msgr2=0x7fe38c159e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.761+0000 7fe39091d700 1 --2- 172.21.15.44:0/1224693288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe38c15ac40 0x7fe38c159e90 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe374014040 tx=0x7fe374004770 comp rx=0 tx=0).stop 2024-09-13T18:29:05.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.765+0000 7fe39091d700 1 -- 172.21.15.44:0/1224693288 shutdown_connections 2024-09-13T18:29:05.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.765+0000 7fe39091d700 1 --2- 172.21.15.44:0/1224693288 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe36c066730 0x7fe36c068bf0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.765+0000 7fe39091d700 1 --2- 172.21.15.44:0/1224693288 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe38c15e730 0x7fe38c15d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.765+0000 7fe39091d700 1 --2- 172.21.15.44:0/1224693288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe38c15ac40 0x7fe38c159e90 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.765+0000 7fe39091d700 1 --2- 172.21.15.44:0/1224693288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe38c0ad710 0x7fe38c14f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.765+0000 7fe39091d700 1 -- 172.21.15.44:0/1224693288 >> 172.21.15.44:0/1224693288 conn(0x7fe38c0ce980 msgr2=0x7fe38c0cb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:05.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.765+0000 7fe39091d700 1 -- 172.21.15.44:0/1224693288 shutdown_connections 2024-09-13T18:29:05.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.765+0000 7fe39091d700 1 -- 172.21.15.44:0/1224693288 wait complete. 2024-09-13T18:29:05.772 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 25 2024-09-13T18:29:05.784 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:29:05.784 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:29:05.784 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:29:05.785 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:29:05.785 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:29:05.785 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:29:05.785 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:29:05.785 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:29:05.786 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:29:05.786 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:29:05.786 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:29:05.786 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:29:05.786 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:29:05.786 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:29:05.786 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:29:05.787 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:29:05.800 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:29:05.800 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:29:05.802 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:29:05.802 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:29:05.803 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:29:05.803 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:29:05.804 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:29:05.804 DEBUG:teuthology.parallel:result is None 2024-09-13T18:29:05.805 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:29:05.805 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:29:05.807 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:29:05.807 DEBUG:teuthology.parallel:result is None 2024-09-13T18:29:05.845 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:29:05.845 DEBUG:teuthology.parallel:result is None 2024-09-13T18:29:05.846 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:29:05.846 DEBUG:teuthology.parallel:result is None 2024-09-13T18:29:05.846 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:29:05.887 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-13T18:29:05.899 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-13T18:29:05.929 INFO:tasks.ceph.mds.b.smithi099.stdout:starting mds.b at 2024-09-13T18:29:05.931 INFO:tasks.ceph.mds.d.smithi099.stdout:starting mds.d at 2024-09-13T18:29:05.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.949+0000 7fd241107700 1 Processor -- start 2024-09-13T18:29:05.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.949+0000 7fd241107700 1 -- start start 2024-09-13T18:29:05.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.949+0000 7fd241107700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd23c13e320 0x7fd23c13e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.949+0000 7fd241107700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd23c13ef10 0x7fd23c06a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.949+0000 7fd241107700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c0b2c20 con 0x7fd23c0b3cc0 2024-09-13T18:29:05.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.949+0000 7fd241107700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c0b38a0 con 0x7fd23c13ef10 2024-09-13T18:29:05.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.949+0000 7fd241107700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0b2f00 con 0x7fd23c13e320 2024-09-13T18:29:05.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.949+0000 7fd23b59e700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd23c0b3cc0 0x7fd23c13c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56508/0 (socket says 172.21.15.44:56508) 2024-09-13T18:29:05.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.949+0000 7fd23b59e700 1 -- 172.21.15.44:0/2724364841 learned_addr learned my addr 172.21.15.44:0/2724364841 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:29:05.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.949+0000 7fd23a59c700 1 --2- 172.21.15.44:0/2724364841 >> v2:172.21.15.99:3300/0 conn(0x7fd23c13ef10 0x7fd23c06a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.949+0000 7fd23ad9d700 1 --2- 172.21.15.44:0/2724364841 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd23c13e320 0x7fd23c13e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.949+0000 7fd239d9b700 1 -- 172.21.15.44:0/2724364841 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 49799056 0 0) 0x7fd23c0b2c20 con 0x7fd23c0b3cc0 2024-09-13T18:29:05.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.949+0000 7fd239d9b700 1 -- 172.21.15.44:0/2724364841 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2280035d0 con 0x7fd23c0b3cc0 2024-09-13T18:29:05.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.949+0000 7fd23a59c700 1 -- 172.21.15.44:0/2724364841 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd23c13e320 msgr2=0x7fd23c13e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:05.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.949+0000 7fd23a59c700 1 --2- 172.21.15.44:0/2724364841 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd23c13e320 0x7fd23c13e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.949+0000 7fd23a59c700 1 -- 172.21.15.44:0/2724364841 >> v1:172.21.15.44:6789/0 conn(0x7fd23c0b3cc0 legacy=0x7fd23c13c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.949+0000 7fd23a59c700 1 -- 172.21.15.44:0/2724364841 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c0b31e0 con 0x7fd23c13ef10 2024-09-13T18:29:05.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.949+0000 7fd23ad9d700 1 --2- 172.21.15.44:0/2724364841 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd23c13e320 0x7fd23c13e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:05.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.949+0000 7fd23a59c700 1 --2- 172.21.15.44:0/2724364841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd23c13ef10 0x7fd23c06a4a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd224009850 tx=0x7fd224009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=581938505f1cd9bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:05.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.949+0000 7fd239d9b700 1 -- 172.21.15.44:0/2724364841 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd224011830 con 0x7fd23c13ef10 2024-09-13T18:29:05.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.949+0000 7fd239d9b700 1 -- 172.21.15.44:0/2724364841 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd224011990 con 0x7fd23c13ef10 2024-09-13T18:29:05.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.949+0000 7fd239d9b700 1 -- 172.21.15.44:0/2724364841 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd224011d00 con 0x7fd23c13ef10 2024-09-13T18:29:05.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.953+0000 7fd241107700 1 -- 172.21.15.44:0/2724364841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd23c13ef10 msgr2=0x7fd23c06a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.953+0000 7fd241107700 1 --2- 172.21.15.44:0/2724364841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd23c13ef10 0x7fd23c06a4a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd224009850 tx=0x7fd224009b60 comp rx=0 tx=0).stop 2024-09-13T18:29:05.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.953+0000 7fd241107700 1 -- 172.21.15.44:0/2724364841 shutdown_connections 2024-09-13T18:29:05.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.953+0000 7fd241107700 1 --2- 172.21.15.44:0/2724364841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd23c13ef10 0x7fd23c06a4a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.953+0000 7fd241107700 1 --2- 172.21.15.44:0/2724364841 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd23c13e320 0x7fd23c13e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.953+0000 7fd241107700 1 -- 172.21.15.44:0/2724364841 >> 172.21.15.44:0/2724364841 conn(0x7fd23c0af5d0 msgr2=0x7fd23c0af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:05.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.953+0000 7fd241107700 1 -- 172.21.15.44:0/2724364841 shutdown_connections 2024-09-13T18:29:05.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.953+0000 7fd241107700 1 -- 172.21.15.44:0/2724364841 wait complete. 2024-09-13T18:29:05.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.953+0000 7fd241107700 1 Processor -- start 2024-09-13T18:29:05.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd241107700 1 -- start start 2024-09-13T18:29:05.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd241107700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd23c0b3cc0 0x7fd23c153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd241107700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd23c13e320 0x7fd23c152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd241107700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd23c13ef10 0x7fd23c13b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd241107700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c140d20 con 0x7fd23c13ef10 2024-09-13T18:29:05.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd241107700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c1531d0 con 0x7fd23c13e320 2024-09-13T18:29:05.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd241107700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c153470 con 0x7fd23c0b3cc0 2024-09-13T18:29:05.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd23b59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd23c13ef10 0x7fd23c13b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd23b59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd23c13ef10 0x7fd23c13b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45492/0 (socket says 172.21.15.44:45492) 2024-09-13T18:29:05.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd23b59e700 1 -- 172.21.15.44:0/2563686391 learned_addr learned my addr 172.21.15.44:0/2563686391 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:05.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd23a59c700 1 --2- 172.21.15.44:0/2563686391 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd23c13e320 0x7fd23c152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd23ad9d700 1 --2- 172.21.15.44:0/2563686391 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd23c0b3cc0 0x7fd23c153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd23b59e700 1 -- 172.21.15.44:0/2563686391 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd23c0b3cc0 msgr2=0x7fd23c153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd23b59e700 1 --2- 172.21.15.44:0/2563686391 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd23c0b3cc0 0x7fd23c153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd23b59e700 1 -- 172.21.15.44:0/2563686391 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd23c13e320 msgr2=0x7fd23c152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd23b59e700 1 --2- 172.21.15.44:0/2563686391 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd23c13e320 0x7fd23c152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd23b59e700 1 -- 172.21.15.44:0/2563686391 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23400ab80 con 0x7fd23c13ef10 2024-09-13T18:29:05.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd23b59e700 1 --2- 172.21.15.44:0/2563686391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd23c13ef10 0x7fd23c13b140 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00c4f0 tx=0x7fd22c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:05.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd2337fe700 1 -- 172.21.15.44:0/2563686391 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c005d90 con 0x7fd23c13ef10 2024-09-13T18:29:05.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd2337fe700 1 -- 172.21.15.44:0/2563686391 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c0070d0 con 0x7fd23c13ef10 2024-09-13T18:29:05.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd241107700 1 -- 172.21.15.44:0/2563686391 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2240094b0 con 0x7fd23c13ef10 2024-09-13T18:29:05.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd2337fe700 1 -- 172.21.15.44:0/2563686391 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c007460 con 0x7fd23c13ef10 2024-09-13T18:29:05.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd241107700 1 -- 172.21.15.44:0/2563686391 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c140940 con 0x7fd23c13ef10 2024-09-13T18:29:05.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.957+0000 7fd241107700 1 -- 172.21.15.44:0/2563686391 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23c140e60 con 0x7fd23c13ef10 2024-09-13T18:29:05.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.961+0000 7fd2337fe700 1 -- 172.21.15.44:0/2563686391 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd22c0075c0 con 0x7fd23c13ef10 2024-09-13T18:29:05.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.961+0000 7fd2337fe700 1 --2- 172.21.15.44:0/2563686391 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd21c066760 0x7fd21c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.961+0000 7fd2337fe700 1 -- 172.21.15.44:0/2563686391 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd22c083220 con 0x7fd23c13ef10 2024-09-13T18:29:05.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.961+0000 7fd23ad9d700 1 --2- 172.21.15.44:0/2563686391 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd21c066760 0x7fd21c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.961+0000 7fd23ad9d700 1 --2- 172.21.15.44:0/2563686391 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd21c066760 0x7fd21c068c20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd234008490 tx=0x7fd23400a860 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:05.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:05.965+0000 7fd2337fe700 1 -- 172.21.15.44:0/2563686391 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd23c140e60 con 0x7fd23c13ef10 2024-09-13T18:29:06.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:06.149+0000 7fd241107700 1 -- 172.21.15.44:0/2563686391 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd23c140e60 con 0x7fd23c13ef10 2024-09-13T18:29:06.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:06.969+0000 7fd2337fe700 1 -- 172.21.15.44:0/2563686391 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v44) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd23c140e60 con 0x7fd23c13ef10 2024-09-13T18:29:06.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:06.973+0000 7fd241107700 1 -- 172.21.15.44:0/2563686391 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd21c066760 msgr2=0x7fd21c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:06.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:06.973+0000 7fd241107700 1 --2- 172.21.15.44:0/2563686391 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd21c066760 0x7fd21c068c20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd234008490 tx=0x7fd23400a860 comp rx=0 tx=0).stop 2024-09-13T18:29:06.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:06.973+0000 7fd241107700 1 -- 172.21.15.44:0/2563686391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd23c13ef10 msgr2=0x7fd23c13b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:06.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:06.973+0000 7fd241107700 1 --2- 172.21.15.44:0/2563686391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd23c13ef10 0x7fd23c13b140 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00c4f0 tx=0x7fd22c00c800 comp rx=0 tx=0).stop 2024-09-13T18:29:06.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:06.973+0000 7fd241107700 1 -- 172.21.15.44:0/2563686391 shutdown_connections 2024-09-13T18:29:06.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:06.973+0000 7fd241107700 1 --2- 172.21.15.44:0/2563686391 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd21c066760 0x7fd21c068c20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:06.973+0000 7fd241107700 1 --2- 172.21.15.44:0/2563686391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd23c13ef10 0x7fd23c13b140 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:06.973+0000 7fd241107700 1 --2- 172.21.15.44:0/2563686391 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd23c13e320 0x7fd23c152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:06.973+0000 7fd241107700 1 --2- 172.21.15.44:0/2563686391 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd23c0b3cc0 0x7fd23c153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:06.973+0000 7fd241107700 1 -- 172.21.15.44:0/2563686391 >> 172.21.15.44:0/2563686391 conn(0x7fd23c0af5d0 msgr2=0x7fd23c1582e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:06.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:06.973+0000 7fd241107700 1 -- 172.21.15.44:0/2563686391 shutdown_connections 2024-09-13T18:29:06.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:06.973+0000 7fd241107700 1 -- 172.21.15.44:0/2563686391 wait complete. 2024-09-13T18:29:06.978 INFO:teuthology.orchestra.run.smithi044.stderr: removed all blocklist entries 2024-09-13T18:29:06.993 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:29:07.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.153+0000 7f83dc9ed700 1 Processor -- start 2024-09-13T18:29:07.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.153+0000 7f83dc9ed700 1 -- start start 2024-09-13T18:29:07.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.153+0000 7f83dc9ed700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f83d815cae0 0x7f83d80cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.153+0000 7f83dc9ed700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f83d815cec0 0x7f83d80d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.153+0000 7f83dc9ed700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83d806ac00 0x7f83d806b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.153+0000 7f83dc9ed700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d80d1750 con 0x7f83d815cae0 2024-09-13T18:29:07.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.153+0000 7f83dc9ed700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d806b590 con 0x7f83d815cec0 2024-09-13T18:29:07.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.153+0000 7f83dc9ed700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d80d21e0 con 0x7f83d806ac00 2024-09-13T18:29:07.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.153+0000 7f83d6d9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f83d815cae0 0x7f83d80cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.153+0000 7f83d6d9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f83d815cae0 0x7f83d80cf030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45500/0 (socket says 172.21.15.44:45500) 2024-09-13T18:29:07.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.153+0000 7f83d6d9d700 1 -- 172.21.15.44:0/388107028 learned_addr learned my addr 172.21.15.44:0/388107028 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:07.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.153+0000 7f83d659c700 1 --2- 172.21.15.44:0/388107028 >> v2:172.21.15.99:3300/0 conn(0x7f83d815cec0 0x7f83d80d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.153+0000 7f83d759e700 1 --2- 172.21.15.44:0/388107028 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83d806ac00 0x7f83d806b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.153+0000 7f83d6d9d700 1 -- 172.21.15.44:0/388107028 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83d806ac00 msgr2=0x7f83d806b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:07.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.153+0000 7f83d6d9d700 1 --2- 172.21.15.44:0/388107028 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83d806ac00 0x7f83d806b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.153+0000 7f83d6d9d700 1 -- 172.21.15.44:0/388107028 >> v2:172.21.15.99:3300/0 conn(0x7f83d815cec0 msgr2=0x7f83d80d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:07.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.153+0000 7f83d6d9d700 1 --2- 172.21.15.44:0/388107028 >> v2:172.21.15.99:3300/0 conn(0x7f83d815cec0 0x7f83d80d1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.153+0000 7f83d6d9d700 1 -- 172.21.15.44:0/388107028 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d80d1940 con 0x7f83d815cae0 2024-09-13T18:29:07.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.153+0000 7f83d759e700 1 --2- 172.21.15.44:0/388107028 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83d806ac00 0x7f83d806b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:07.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.157+0000 7f83d6d9d700 1 --2- 172.21.15.44:0/388107028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83d815cae0 0x7f83d80cf030 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f83c8009e50 tx=0x7f83c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41d90cf71a9748c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:07.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.157+0000 7f83d5d9b700 1 -- 172.21.15.44:0/388107028 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c800e070 con 0x7f83d815cae0 2024-09-13T18:29:07.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.157+0000 7f83d5d9b700 1 -- 172.21.15.44:0/388107028 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c800b8d0 con 0x7f83d815cae0 2024-09-13T18:29:07.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.157+0000 7f83d5d9b700 1 -- 172.21.15.44:0/388107028 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c800bc80 con 0x7f83d815cae0 2024-09-13T18:29:07.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.157+0000 7f83dc9ed700 1 -- 172.21.15.44:0/388107028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83d815cae0 msgr2=0x7f83d80cf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.157+0000 7f83dc9ed700 1 --2- 172.21.15.44:0/388107028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83d815cae0 0x7f83d80cf030 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f83c8009e50 tx=0x7f83c800b330 comp rx=0 tx=0).stop 2024-09-13T18:29:07.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.157+0000 7f83dc9ed700 1 -- 172.21.15.44:0/388107028 shutdown_connections 2024-09-13T18:29:07.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.157+0000 7f83dc9ed700 1 --2- 172.21.15.44:0/388107028 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83d806ac00 0x7f83d806b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.157+0000 7f83dc9ed700 1 --2- 172.21.15.44:0/388107028 >> v2:172.21.15.99:3300/0 conn(0x7f83d815cec0 0x7f83d80d1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.157+0000 7f83dc9ed700 1 --2- 172.21.15.44:0/388107028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83d815cae0 0x7f83d80cf030 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.157+0000 7f83dc9ed700 1 -- 172.21.15.44:0/388107028 >> 172.21.15.44:0/388107028 conn(0x7f83d80d2c80 msgr2=0x7f83d80d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:07.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.157+0000 7f83dc9ed700 1 -- 172.21.15.44:0/388107028 shutdown_connections 2024-09-13T18:29:07.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.157+0000 7f83dc9ed700 1 -- 172.21.15.44:0/388107028 wait complete. 2024-09-13T18:29:07.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.157+0000 7f83dc9ed700 1 Processor -- start 2024-09-13T18:29:07.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.157+0000 7f83dc9ed700 1 -- start start 2024-09-13T18:29:07.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.161+0000 7f83dc9ed700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83d806ac00 0x7f83d8151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.161+0000 7f83dc9ed700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83d815cae0 0x7f83d815f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.161+0000 7f83dc9ed700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83d815cec0 0x7f83d8159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.161+0000 7f83dc9ed700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d815fd30 con 0x7f83d815cae0 2024-09-13T18:29:07.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.161+0000 7f83dc9ed700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d8155f40 con 0x7f83d806ac00 2024-09-13T18:29:07.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.161+0000 7f83dc9ed700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d8156220 con 0x7f83d815cec0 2024-09-13T18:29:07.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.161+0000 7f83d659c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83d815cae0 0x7f83d815f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.161+0000 7f83d659c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83d815cae0 0x7f83d815f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45514/0 (socket says 172.21.15.44:45514) 2024-09-13T18:29:07.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.161+0000 7f83d659c700 1 -- 172.21.15.44:0/2443082377 learned_addr learned my addr 172.21.15.44:0/2443082377 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:07.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.161+0000 7f83d6d9d700 1 --2- 172.21.15.44:0/2443082377 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83d806ac00 0x7f83d8151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.161+0000 7f83d759e700 1 --2- 172.21.15.44:0/2443082377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83d815cec0 0x7f83d8159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.161+0000 7f83d659c700 1 -- 172.21.15.44:0/2443082377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83d815cec0 msgr2=0x7f83d8159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.161+0000 7f83d659c700 1 --2- 172.21.15.44:0/2443082377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83d815cec0 0x7f83d8159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.161+0000 7f83d659c700 1 -- 172.21.15.44:0/2443082377 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83d806ac00 msgr2=0x7f83d8151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.161+0000 7f83d659c700 1 --2- 172.21.15.44:0/2443082377 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83d806ac00 0x7f83d8151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.161+0000 7f83d659c700 1 -- 172.21.15.44:0/2443082377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c8009b30 con 0x7f83d815cae0 2024-09-13T18:29:07.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.161+0000 7f83d659c700 1 --2- 172.21.15.44:0/2443082377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83d815cae0 0x7f83d815f4e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00e9d0 tx=0x7f83cc00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:07.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.161+0000 7f83bf7fe700 1 -- 172.21.15.44:0/2443082377 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc009720 con 0x7f83d815cae0 2024-09-13T18:29:07.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.161+0000 7f83bf7fe700 1 -- 172.21.15.44:0/2443082377 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83cc00ee70 con 0x7f83d815cae0 2024-09-13T18:29:07.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.161+0000 7f83dc9ed700 1 -- 172.21.15.44:0/2443082377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d8156500 con 0x7f83d815cae0 2024-09-13T18:29:07.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.161+0000 7f83bf7fe700 1 -- 172.21.15.44:0/2443082377 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc00ca50 con 0x7f83d815cae0 2024-09-13T18:29:07.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.161+0000 7f83dc9ed700 1 -- 172.21.15.44:0/2443082377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d8155bf0 con 0x7f83d815cae0 2024-09-13T18:29:07.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.161+0000 7f83dc9ed700 1 -- 172.21.15.44:0/2443082377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d806b050 con 0x7f83d815cae0 2024-09-13T18:29:07.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.165+0000 7f83bf7fe700 1 -- 172.21.15.44:0/2443082377 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f83cc00cbb0 con 0x7f83d815cae0 2024-09-13T18:29:07.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.165+0000 7f83bf7fe700 1 --2- 172.21.15.44:0/2443082377 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f83c4066730 0x7f83c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.165+0000 7f83bf7fe700 1 -- 172.21.15.44:0/2443082377 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f83cc083ec0 con 0x7f83d815cae0 2024-09-13T18:29:07.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.165+0000 7f83d6d9d700 1 --2- 172.21.15.44:0/2443082377 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f83c4066730 0x7f83c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.165+0000 7f83d6d9d700 1 --2- 172.21.15.44:0/2443082377 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f83c4066730 0x7f83c4068bf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f83c800b370 tx=0x7f83c8009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:07.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.173+0000 7f83bf7fe700 1 -- 172.21.15.44:0/2443082377 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f83cc051500 con 0x7f83d815cae0 2024-09-13T18:29:07.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.405+0000 7f83dc9ed700 1 -- 172.21.15.44:0/2443082377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f83d80d0f50 con 0x7f83d815cae0 2024-09-13T18:29:07.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.405+0000 7f83bf7fe700 1 -- 172.21.15.44:0/2443082377 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f83cc00ce60 con 0x7f83d815cae0 2024-09-13T18:29:07.410 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:29:07.410 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:29:07.411 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_dump": [ 2024-09-13T18:29:07.411 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:29:07.411 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.a", 2024-09-13T18:29:07.411 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rmm4/RGxAAtGPYfgzYpmE4yHhoggZJ8Q==", 2024-09-13T18:29:07.411 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:29:07.411 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:29:07.411 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:29:07.411 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:29:07.411 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:29:07.411 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:29:07.412 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:29:07.412 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:29:07.412 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.b", 2024-09-13T18:29:07.412 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rm8qC+JhAAhdkL3zbxM9+GI8+khy+cSg==", 2024-09-13T18:29:07.412 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:29:07.412 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:29:07.412 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:29:07.412 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:29:07.412 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:29:07.412 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:29:07.412 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:29:07.412 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:29:07.412 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.c", 2024-09-13T18:29:07.412 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rmr/OCIhAAvBF106ILl0AZlzCZ+S990Q==", 2024-09-13T18:29:07.413 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:29:07.413 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:29:07.413 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:29:07.413 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:29:07.413 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:29:07.413 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:29:07.413 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:29:07.413 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:29:07.413 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.d", 2024-09-13T18:29:07.413 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+RmSHbxKRAAAGsAWnIPUDUk3Y0aYryf+w==", 2024-09-13T18:29:07.413 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:29:07.413 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:29:07.413 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:29:07.413 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:29:07.414 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:29:07.414 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:29:07.414 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:29:07.414 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:29:07.414 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.0", 2024-09-13T18:29:07.414 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC6g+Rmw8xKHxAArYof7SeFMvQGq5AnVMbiog==", 2024-09-13T18:29:07.414 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:29:07.414 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:29:07.414 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:29:07.414 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:29:07.414 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:29:07.414 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:29:07.414 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:29:07.415 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.1", 2024-09-13T18:29:07.415 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC9g+RmLRFsMxAAC0SXlbIRvFc3byOy742GSg==", 2024-09-13T18:29:07.415 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:29:07.415 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:29:07.415 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:29:07.415 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:29:07.415 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:29:07.415 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:29:07.415 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:29:07.415 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.2", 2024-09-13T18:29:07.415 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDAg+RmvbTXNxAAyoLLo9RMD7817x8cdlYjWg==", 2024-09-13T18:29:07.415 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:29:07.415 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:29:07.415 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:29:07.415 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:29:07.416 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:29:07.416 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:29:07.416 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:29:07.416 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.3", 2024-09-13T18:29:07.416 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDDg+Rm4/jKOhAAYVOXNUkd3Z9CXAzbxJw34g==", 2024-09-13T18:29:07.416 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:29:07.416 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:29:07.416 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:29:07.416 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:29:07.416 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:29:07.416 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:29:07.416 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:29:07.416 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.4", 2024-09-13T18:29:07.416 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDJg+RmEZwhJBAAqtUZtMmRzRulAa6cnyvSmQ==", 2024-09-13T18:29:07.417 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:29:07.417 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:29:07.417 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:29:07.417 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:29:07.417 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:29:07.417 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:29:07.417 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:29:07.417 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.5", 2024-09-13T18:29:07.417 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDMg+RmCqBKKRAA7oP48mScYw7mkNGahg+ptw==", 2024-09-13T18:29:07.417 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:29:07.417 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:29:07.417 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:29:07.417 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:29:07.417 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:29:07.418 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:29:07.418 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:29:07.418 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.6", 2024-09-13T18:29:07.418 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDPg+RmbjDyLxAAIRb9i9TtRsDg+M9SnEegug==", 2024-09-13T18:29:07.418 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:29:07.418 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:29:07.418 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:29:07.418 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:29:07.418 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:29:07.418 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:29:07.418 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:29:07.418 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.7", 2024-09-13T18:29:07.418 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDSg+RmA4v7NhAAVe6GV0DVksIWiq6KQvMgVg==", 2024-09-13T18:29:07.419 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:29:07.419 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:29:07.419 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:29:07.419 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:29:07.419 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:29:07.419 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:29:07.419 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:29:07.419 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.0", 2024-09-13T18:29:07.419 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rm7FEGMBAAosZ34edcGJmTiY8UhPtung==", 2024-09-13T18:29:07.419 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:29:07.419 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:29:07.419 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow r", 2024-09-13T18:29:07.419 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:29:07.420 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:29:07.420 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:29:07.420 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:29:07.420 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.1", 2024-09-13T18:29:07.420 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rmpu2zNhAAc0mOfL8c/MYij8KYpvsjRw==", 2024-09-13T18:29:07.420 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:29:07.420 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:29:07.420 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-13T18:29:07.420 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-13T18:29:07.420 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-13T18:29:07.420 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:29:07.420 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:29:07.420 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:29:07.421 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.2", 2024-09-13T18:29:07.421 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rm0xw5MxAAWu4i4+IAjW5QzQwiILs6bg==", 2024-09-13T18:29:07.421 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:29:07.421 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:29:07.421 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-13T18:29:07.421 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-13T18:29:07.421 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-13T18:29:07.421 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:29:07.421 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:29:07.421 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:29:07.421 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.3", 2024-09-13T18:29:07.421 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+RmZdTZORAA26aYb0Nz0g+rRBG+zAu/EQ==", 2024-09-13T18:29:07.421 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:29:07.422 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:29:07.422 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-13T18:29:07.422 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-13T18:29:07.422 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-13T18:29:07.422 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:29:07.422 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:29:07.422 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:29:07.422 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.admin", 2024-09-13T18:29:07.422 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+RmVt6IDBAALp4ZMLL2ehaE9O4vCSZzxQ==", 2024-09-13T18:29:07.422 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:29:07.422 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-13T18:29:07.422 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:29:07.422 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:29:07.423 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:29:07.423 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:29:07.423 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:29:07.423 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:29:07.423 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.x", 2024-09-13T18:29:07.423 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+RmBmEBGBAARTj0TQ0laAEW0n888vMZrA==", 2024-09-13T18:29:07.423 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:29:07.423 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-13T18:29:07.423 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-13T18:29:07.423 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:29:07.423 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:29:07.423 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:29:07.423 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:29:07.423 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.y", 2024-09-13T18:29:07.424 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rm1KSoFBAALCTzYRRxF7MPxQHL3ETGqQ==", 2024-09-13T18:29:07.424 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:29:07.424 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-13T18:29:07.424 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-13T18:29:07.424 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:29:07.424 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:29:07.424 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:29:07.424 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-13T18:29:07.424 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:29:07.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.409+0000 7f83dc9ed700 1 -- 172.21.15.44:0/2443082377 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f83c4066730 msgr2=0x7f83c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.409+0000 7f83dc9ed700 1 --2- 172.21.15.44:0/2443082377 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f83c4066730 0x7f83c4068bf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f83c800b370 tx=0x7f83c8009000 comp rx=0 tx=0).stop 2024-09-13T18:29:07.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.409+0000 7f83dc9ed700 1 -- 172.21.15.44:0/2443082377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83d815cae0 msgr2=0x7f83d815f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.409+0000 7f83dc9ed700 1 --2- 172.21.15.44:0/2443082377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83d815cae0 0x7f83d815f4e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00e9d0 tx=0x7f83cc00ece0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.409+0000 7f83dc9ed700 1 -- 172.21.15.44:0/2443082377 shutdown_connections 2024-09-13T18:29:07.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.409+0000 7f83dc9ed700 1 --2- 172.21.15.44:0/2443082377 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f83c4066730 0x7f83c4068bf0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.413+0000 7f83dc9ed700 1 --2- 172.21.15.44:0/2443082377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83d815cec0 0x7f83d8159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.413+0000 7f83dc9ed700 1 --2- 172.21.15.44:0/2443082377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83d815cae0 0x7f83d815f4e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.413+0000 7f83dc9ed700 1 --2- 172.21.15.44:0/2443082377 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83d806ac00 0x7f83d8151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.413+0000 7f83dc9ed700 1 -- 172.21.15.44:0/2443082377 >> 172.21.15.44:0/2443082377 conn(0x7f83d80d2c80 msgr2=0x7f83d80cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:07.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.413+0000 7f83dc9ed700 1 -- 172.21.15.44:0/2443082377 shutdown_connections 2024-09-13T18:29:07.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.413+0000 7f83dc9ed700 1 -- 172.21.15.44:0/2443082377 wait complete. 2024-09-13T18:29:07.433 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:29:07.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.537+0000 7f9d5f59e700 1 Processor -- start 2024-09-13T18:29:07.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.537+0000 7f9d5f59e700 1 -- start start 2024-09-13T18:29:07.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5f59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d600ae180 0x7f9d6015d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5f59e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9d600acf80 0x7f9d600ad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5f59e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d6015d820 con 0x7f9d60157040 2024-09-13T18:29:07.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5f59e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d6015d630 con 0x7f9d600acf80 2024-09-13T18:29:07.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5f59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6015e0c0 con 0x7f9d600ae180 2024-09-13T18:29:07.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5e59c700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9d60157040 0x7f9d600b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56524/0 (socket says 172.21.15.44:56524) 2024-09-13T18:29:07.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5e59c700 1 -- 172.21.15.44:0/3330347101 learned_addr learned my addr 172.21.15.44:0/3330347101 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:29:07.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5ed9d700 1 --2- 172.21.15.44:0/3330347101 >> v2:172.21.15.44:3300/0 conn(0x7f9d600acf80 0x7f9d600ad3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5dd9b700 1 --2- 172.21.15.44:0/3330347101 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d600ae180 0x7f9d6015d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5d59a700 1 -- 172.21.15.44:0/3330347101 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998886319 0 0) 0x7f9d6015d820 con 0x7f9d60157040 2024-09-13T18:29:07.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5d59a700 1 -- 172.21.15.44:0/3330347101 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d4c0035d0 con 0x7f9d60157040 2024-09-13T18:29:07.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5dd9b700 1 -- 172.21.15.44:0/3330347101 >> v2:172.21.15.44:3300/0 conn(0x7f9d600acf80 msgr2=0x7f9d600ad3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:07.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5dd9b700 1 --2- 172.21.15.44:0/3330347101 >> v2:172.21.15.44:3300/0 conn(0x7f9d600acf80 0x7f9d600ad3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5dd9b700 1 -- 172.21.15.44:0/3330347101 >> v1:172.21.15.44:6789/0 conn(0x7f9d60157040 legacy=0x7f9d600b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5dd9b700 1 -- 172.21.15.44:0/3330347101 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6015db00 con 0x7f9d600ae180 2024-09-13T18:29:07.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5ed9d700 1 --2- 172.21.15.44:0/3330347101 >> v2:172.21.15.44:3300/0 conn(0x7f9d600acf80 0x7f9d600ad3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:07.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5dd9b700 1 --2- 172.21.15.44:0/3330347101 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d600ae180 0x7f9d6015d0f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9d50009850 tx=0x7f9d50009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=355a42711c17c1b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:07.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5d59a700 1 -- 172.21.15.44:0/3330347101 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d50011830 con 0x7f9d600ae180 2024-09-13T18:29:07.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5d59a700 1 -- 172.21.15.44:0/3330347101 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d50011990 con 0x7f9d600ae180 2024-09-13T18:29:07.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5d59a700 1 -- 172.21.15.44:0/3330347101 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d50011d40 con 0x7f9d600ae180 2024-09-13T18:29:07.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5f59e700 1 -- 172.21.15.44:0/3330347101 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d600ae180 msgr2=0x7f9d6015d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5f59e700 1 --2- 172.21.15.44:0/3330347101 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d600ae180 0x7f9d6015d0f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9d50009850 tx=0x7f9d50009b60 comp rx=0 tx=0).stop 2024-09-13T18:29:07.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5f59e700 1 -- 172.21.15.44:0/3330347101 shutdown_connections 2024-09-13T18:29:07.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5f59e700 1 --2- 172.21.15.44:0/3330347101 >> v2:172.21.15.44:3300/0 conn(0x7f9d600acf80 0x7f9d600ad3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5f59e700 1 --2- 172.21.15.44:0/3330347101 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d600ae180 0x7f9d6015d0f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5f59e700 1 -- 172.21.15.44:0/3330347101 >> 172.21.15.44:0/3330347101 conn(0x7f9d600cf910 msgr2=0x7f9d600cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:07.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5f59e700 1 -- 172.21.15.44:0/3330347101 shutdown_connections 2024-09-13T18:29:07.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.541+0000 7f9d5f59e700 1 -- 172.21.15.44:0/3330347101 wait complete. 2024-09-13T18:29:07.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.545+0000 7f9d5f59e700 1 Processor -- start 2024-09-13T18:29:07.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.545+0000 7f9d5f59e700 1 -- start start 2024-09-13T18:29:07.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.545+0000 7f9d5f59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d600acf80 0x7f9d600b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.545+0000 7f9d5f59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d600ae180 0x7f9d6006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.545+0000 7f9d5f59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d60157040 0x7f9d6006dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.545+0000 7f9d5f59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d60157680 con 0x7f9d600ae180 2024-09-13T18:29:07.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.545+0000 7f9d5f59e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d60158650 con 0x7f9d60157040 2024-09-13T18:29:07.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.545+0000 7f9d5f59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6006e190 con 0x7f9d600acf80 2024-09-13T18:29:07.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.545+0000 7f9d5dd9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d600ae180 0x7f9d6006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.545+0000 7f9d5e59c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d600acf80 0x7f9d600b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.545+0000 7f9d5dd9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d600ae180 0x7f9d6006d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45542/0 (socket says 172.21.15.44:45542) 2024-09-13T18:29:07.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.545+0000 7f9d5dd9b700 1 -- 172.21.15.44:0/2111325641 learned_addr learned my addr 172.21.15.44:0/2111325641 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:07.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.545+0000 7f9d5ed9d700 1 --2- 172.21.15.44:0/2111325641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d60157040 0x7f9d6006dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.545+0000 7f9d5dd9b700 1 -- 172.21.15.44:0/2111325641 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d600acf80 msgr2=0x7f9d600b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.545+0000 7f9d5dd9b700 1 --2- 172.21.15.44:0/2111325641 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d600acf80 0x7f9d600b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.545+0000 7f9d5dd9b700 1 -- 172.21.15.44:0/2111325641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d60157040 msgr2=0x7f9d6006dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.545+0000 7f9d5dd9b700 1 --2- 172.21.15.44:0/2111325641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d60157040 0x7f9d6006dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.545+0000 7f9d5dd9b700 1 -- 172.21.15.44:0/2111325641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d58009a70 con 0x7f9d600ae180 2024-09-13T18:29:07.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.545+0000 7f9d5dd9b700 1 --2- 172.21.15.44:0/2111325641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d600ae180 0x7f9d6006d710 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9d600ae110 tx=0x7f9d50004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:07.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.549+0000 7f9d56ffd700 1 -- 172.21.15.44:0/2111325641 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d500042c0 con 0x7f9d600ae180 2024-09-13T18:29:07.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.549+0000 7f9d56ffd700 1 -- 172.21.15.44:0/2111325641 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5001f070 con 0x7f9d600ae180 2024-09-13T18:29:07.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.549+0000 7f9d5f59e700 1 -- 172.21.15.44:0/2111325641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d500094b0 con 0x7f9d600ae180 2024-09-13T18:29:07.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.549+0000 7f9d56ffd700 1 -- 172.21.15.44:0/2111325641 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d500036c0 con 0x7f9d600ae180 2024-09-13T18:29:07.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.549+0000 7f9d5f59e700 1 -- 172.21.15.44:0/2111325641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d60157e50 con 0x7f9d600ae180 2024-09-13T18:29:07.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.549+0000 7f9d5f59e700 1 -- 172.21.15.44:0/2111325641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d601579a0 con 0x7f9d600ae180 2024-09-13T18:29:07.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.549+0000 7f9d56ffd700 1 -- 172.21.15.44:0/2111325641 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9d50021030 con 0x7f9d600ae180 2024-09-13T18:29:07.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.549+0000 7f9d56ffd700 1 --2- 172.21.15.44:0/2111325641 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9d40066730 0x7f9d40068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.549+0000 7f9d56ffd700 1 -- 172.21.15.44:0/2111325641 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9d50084fa0 con 0x7f9d600ae180 2024-09-13T18:29:07.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.549+0000 7f9d5e59c700 1 --2- 172.21.15.44:0/2111325641 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9d40066730 0x7f9d40068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.553+0000 7f9d5e59c700 1 --2- 172.21.15.44:0/2111325641 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9d40066730 0x7f9d40068bf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9d48007fd0 tx=0x7f9d48007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:07.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.561+0000 7f9d56ffd700 1 -- 172.21.15.44:0/2111325641 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9d500b6db0 con 0x7f9d600ae180 2024-09-13T18:29:07.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.733+0000 7f9d5f59e700 1 -- 172.21.15.44:0/2111325641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d6015d0f0 con 0x7f9d600ae180 2024-09-13T18:29:07.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.733+0000 7f9d56ffd700 1 -- 172.21.15.44:0/2111325641 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12797 (secure 0 0 0) 0x7f9d50015090 con 0x7f9d600ae180 2024-09-13T18:29:07.737 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:29:07.737 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":44,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:29:06.957889+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:29:07.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.737+0000 7f9d5f59e700 1 -- 172.21.15.44:0/2111325641 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9d40066730 msgr2=0x7f9d40068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.737+0000 7f9d5f59e700 1 --2- 172.21.15.44:0/2111325641 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9d40066730 0x7f9d40068bf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9d48007fd0 tx=0x7f9d48007de0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.737+0000 7f9d5f59e700 1 -- 172.21.15.44:0/2111325641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d600ae180 msgr2=0x7f9d6006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.737+0000 7f9d5f59e700 1 --2- 172.21.15.44:0/2111325641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d600ae180 0x7f9d6006d710 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9d600ae110 tx=0x7f9d50004770 comp rx=0 tx=0).stop 2024-09-13T18:29:07.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.737+0000 7f9d5f59e700 1 -- 172.21.15.44:0/2111325641 shutdown_connections 2024-09-13T18:29:07.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.737+0000 7f9d5f59e700 1 --2- 172.21.15.44:0/2111325641 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9d40066730 0x7f9d40068bf0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.737+0000 7f9d5f59e700 1 --2- 172.21.15.44:0/2111325641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d60157040 0x7f9d6006dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.737+0000 7f9d5f59e700 1 --2- 172.21.15.44:0/2111325641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d600ae180 0x7f9d6006d710 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.737+0000 7f9d5f59e700 1 --2- 172.21.15.44:0/2111325641 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d600acf80 0x7f9d600b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.737+0000 7f9d5f59e700 1 -- 172.21.15.44:0/2111325641 >> 172.21.15.44:0/2111325641 conn(0x7f9d600cf910 msgr2=0x7f9d600cfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:07.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.737+0000 7f9d5f59e700 1 -- 172.21.15.44:0/2111325641 shutdown_connections 2024-09-13T18:29:07.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.737+0000 7f9d5f59e700 1 -- 172.21.15.44:0/2111325641 wait complete. 2024-09-13T18:29:07.753 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:29:07.754 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:29:07.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.873+0000 7f34e95ad700 1 Processor -- start 2024-09-13T18:29:07.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.873+0000 7f34e95ad700 1 -- start start 2024-09-13T18:29:07.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.877+0000 7f34e95ad700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f34e41573e0 0x7f34e4070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.877+0000 7f34e95ad700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f34e415a630 0x7f34e406c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.877+0000 7f34e95ad700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e4071540 con 0x7f34e40710e0 2024-09-13T18:29:07.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.877+0000 7f34e95ad700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e40cc1b0 con 0x7f34e415a630 2024-09-13T18:29:07.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.877+0000 7f34e95ad700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e415ac50 con 0x7f34e41573e0 2024-09-13T18:29:07.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.877+0000 7f34e3fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f34e41573e0 0x7f34e4070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.877+0000 7f34e8dac700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f34e415a630 0x7f34e406c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.877+0000 7f34e37fe700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f34e40710e0 0x7f34e4159f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:36550/0 (socket says 172.21.15.44:36550) 2024-09-13T18:29:07.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.877+0000 7f34e37fe700 1 -- 172.21.15.44:0/2677395920 learned_addr learned my addr 172.21.15.44:0/2677395920 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:29:07.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.877+0000 7f34e3fff700 1 -- 172.21.15.44:0/2677395920 >> v2:172.21.15.99:3300/0 conn(0x7f34e415a630 msgr2=0x7f34e406c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:07.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.877+0000 7f34e3fff700 1 --2- 172.21.15.44:0/2677395920 >> v2:172.21.15.99:3300/0 conn(0x7f34e415a630 0x7f34e406c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.877+0000 7f34e3fff700 1 -- 172.21.15.44:0/2677395920 >> v1:172.21.15.99:6789/0 conn(0x7f34e40710e0 legacy=0x7f34e4159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.877+0000 7f34e3fff700 1 -- 172.21.15.44:0/2677395920 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e40cb3f0 con 0x7f34e41573e0 2024-09-13T18:29:07.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.877+0000 7f34e3fff700 1 --2- 172.21.15.44:0/2677395920 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f34e41573e0 0x7f34e4070ba0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009880 tx=0x7f34d4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af5a99d78cec7fda server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:07.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.881+0000 7f34e2ffd700 1 -- 172.21.15.44:0/2677395920 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d4011830 con 0x7f34e41573e0 2024-09-13T18:29:07.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.881+0000 7f34e2ffd700 1 -- 172.21.15.44:0/2677395920 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d4011990 con 0x7f34e41573e0 2024-09-13T18:29:07.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.881+0000 7f34e2ffd700 1 -- 172.21.15.44:0/2677395920 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d4011d20 con 0x7f34e41573e0 2024-09-13T18:29:07.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.881+0000 7f34e95ad700 1 -- 172.21.15.44:0/2677395920 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f34e41573e0 msgr2=0x7f34e4070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.881+0000 7f34e95ad700 1 --2- 172.21.15.44:0/2677395920 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f34e41573e0 0x7f34e4070ba0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009880 tx=0x7f34d4009b90 comp rx=0 tx=0).stop 2024-09-13T18:29:07.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.881+0000 7f34e95ad700 1 -- 172.21.15.44:0/2677395920 shutdown_connections 2024-09-13T18:29:07.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.881+0000 7f34e95ad700 1 --2- 172.21.15.44:0/2677395920 >> v2:172.21.15.99:3300/0 conn(0x7f34e415a630 0x7f34e406c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.881+0000 7f34e95ad700 1 --2- 172.21.15.44:0/2677395920 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f34e41573e0 0x7f34e4070ba0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.881+0000 7f34e95ad700 1 -- 172.21.15.44:0/2677395920 >> 172.21.15.44:0/2677395920 conn(0x7f34e40b0e10 msgr2=0x7f34e40b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:07.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.881+0000 7f34e95ad700 1 -- 172.21.15.44:0/2677395920 shutdown_connections 2024-09-13T18:29:07.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.881+0000 7f34e95ad700 1 -- 172.21.15.44:0/2677395920 wait complete. 2024-09-13T18:29:07.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e95ad700 1 Processor -- start 2024-09-13T18:29:07.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e95ad700 1 -- start start 2024-09-13T18:29:07.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e95ad700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e40710e0 0x7f34e4158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e95ad700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e41573e0 0x7f34e4148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e95ad700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f34e415a630 0x7f34e4148e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e95ad700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e41f3c40 con 0x7f34e41573e0 2024-09-13T18:29:07.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e95ad700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e41f3fd0 con 0x7f34e40710e0 2024-09-13T18:29:07.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e95ad700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e4159010 con 0x7f34e415a630 2024-09-13T18:29:07.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e37fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e41573e0 0x7f34e4148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e37fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e41573e0 0x7f34e4148910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45556/0 (socket says 172.21.15.44:45556) 2024-09-13T18:29:07.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e37fe700 1 -- 172.21.15.44:0/2618242526 learned_addr learned my addr 172.21.15.44:0/2618242526 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:07.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e8dac700 1 --2- 172.21.15.44:0/2618242526 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f34e415a630 0x7f34e4148e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e3fff700 1 --2- 172.21.15.44:0/2618242526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e40710e0 0x7f34e4158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e37fe700 1 -- 172.21.15.44:0/2618242526 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f34e415a630 msgr2=0x7f34e4148e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e37fe700 1 --2- 172.21.15.44:0/2618242526 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f34e415a630 0x7f34e4148e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e37fe700 1 -- 172.21.15.44:0/2618242526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e40710e0 msgr2=0x7f34e4158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e37fe700 1 --2- 172.21.15.44:0/2618242526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e40710e0 0x7f34e4158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e37fe700 1 -- 172.21.15.44:0/2618242526 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d40094b0 con 0x7f34e41573e0 2024-09-13T18:29:07.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e3fff700 1 --2- 172.21.15.44:0/2618242526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e40710e0 0x7f34e4158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:07.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e37fe700 1 --2- 172.21.15.44:0/2618242526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e41573e0 0x7f34e4148910 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f34d800c580 tx=0x7f34d800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:07.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e0ff9700 1 -- 172.21.15.44:0/2618242526 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d8005d90 con 0x7f34e41573e0 2024-09-13T18:29:07.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e0ff9700 1 -- 172.21.15.44:0/2618242526 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d80070d0 con 0x7f34e41573e0 2024-09-13T18:29:07.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e95ad700 1 -- 172.21.15.44:0/2618242526 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e4159840 con 0x7f34e41573e0 2024-09-13T18:29:07.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e0ff9700 1 -- 172.21.15.44:0/2618242526 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d8007440 con 0x7f34e41573e0 2024-09-13T18:29:07.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.885+0000 7f34e95ad700 1 -- 172.21.15.44:0/2618242526 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e4159560 con 0x7f34e41573e0 2024-09-13T18:29:07.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.889+0000 7f34e95ad700 1 -- 172.21.15.44:0/2618242526 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e406c8e0 con 0x7f34e41573e0 2024-09-13T18:29:07.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.889+0000 7f34e0ff9700 1 -- 172.21.15.44:0/2618242526 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f34d80075a0 con 0x7f34e41573e0 2024-09-13T18:29:07.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.889+0000 7f34e0ff9700 1 --2- 172.21.15.44:0/2618242526 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f34d0066760 0x7f34d0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.889+0000 7f34e0ff9700 1 -- 172.21.15.44:0/2618242526 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f34d8083160 con 0x7f34e41573e0 2024-09-13T18:29:07.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.889+0000 7f34e3fff700 1 --2- 172.21.15.44:0/2618242526 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f34d0066760 0x7f34d0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.889+0000 7f34e3fff700 1 --2- 172.21.15.44:0/2618242526 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f34d0066760 0x7f34d0068c20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009850 tx=0x7f34d4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:07.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:07.897+0000 7f34e0ff9700 1 -- 172.21.15.44:0/2618242526 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f34d80508c0 con 0x7f34e41573e0 2024-09-13T18:29:08.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.069+0000 7f34e95ad700 1 -- 172.21.15.44:0/2618242526 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f34e406c3e0 con 0x7f34e41573e0 2024-09-13T18:29:08.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.069+0000 7f34e0ff9700 1 -- 172.21.15.44:0/2618242526 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f34d8053ee0 con 0x7f34e41573e0 2024-09-13T18:29:08.072 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:29:08.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.073+0000 7f34e95ad700 1 -- 172.21.15.44:0/2618242526 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f34d0066760 msgr2=0x7f34d0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.073+0000 7f34e95ad700 1 --2- 172.21.15.44:0/2618242526 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f34d0066760 0x7f34d0068c20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009850 tx=0x7f34d4008030 comp rx=0 tx=0).stop 2024-09-13T18:29:08.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.073+0000 7f34e95ad700 1 -- 172.21.15.44:0/2618242526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e41573e0 msgr2=0x7f34e4148910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.073+0000 7f34e95ad700 1 --2- 172.21.15.44:0/2618242526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e41573e0 0x7f34e4148910 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f34d800c580 tx=0x7f34d800c890 comp rx=0 tx=0).stop 2024-09-13T18:29:08.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.073+0000 7f34e95ad700 1 -- 172.21.15.44:0/2618242526 shutdown_connections 2024-09-13T18:29:08.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.073+0000 7f34e95ad700 1 --2- 172.21.15.44:0/2618242526 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f34d0066760 0x7f34d0068c20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.073+0000 7f34e95ad700 1 --2- 172.21.15.44:0/2618242526 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f34e415a630 0x7f34e4148e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.073+0000 7f34e95ad700 1 --2- 172.21.15.44:0/2618242526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e41573e0 0x7f34e4148910 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.073+0000 7f34e95ad700 1 --2- 172.21.15.44:0/2618242526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e40710e0 0x7f34e4158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.073+0000 7f34e95ad700 1 -- 172.21.15.44:0/2618242526 >> 172.21.15.44:0/2618242526 conn(0x7f34e40b0e10 msgr2=0x7f34e415ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:08.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.073+0000 7f34e95ad700 1 -- 172.21.15.44:0/2618242526 shutdown_connections 2024-09-13T18:29:08.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.073+0000 7f34e95ad700 1 -- 172.21.15.44:0/2618242526 wait complete. 2024-09-13T18:29:08.088 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:29:08.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.197+0000 7f676dbd3700 1 Processor -- start 2024-09-13T18:29:08.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.197+0000 7f676dbd3700 1 -- start start 2024-09-13T18:29:08.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.197+0000 7f676dbd3700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f676815b890 0x7f6768162220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.197+0000 7f676dbd3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f67680cdcc0 0x7f67680b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.197+0000 7f676dbd3700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67680b2dc0 con 0x7f67680b2930 2024-09-13T18:29:08.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.197+0000 7f676dbd3700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6768162760 con 0x7f676815b890 2024-09-13T18:29:08.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.197+0000 7f676dbd3700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676815bc70 con 0x7f67680cdcc0 2024-09-13T18:29:08.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.197+0000 7f6766ffd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f67680cdcc0 0x7f67680b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.197+0000 7f6766ffd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f67680cdcc0 0x7f67680b23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:44806/0 (socket says 172.21.15.44:44806) 2024-09-13T18:29:08.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.197+0000 7f6766ffd700 1 -- 172.21.15.44:0/2999081409 learned_addr learned my addr 172.21.15.44:0/2999081409 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:08.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.197+0000 7f67677fe700 1 --2- 172.21.15.44:0/2999081409 >> v2:172.21.15.99:3300/0 conn(0x7f676815b890 0x7f6768162220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.197+0000 7f6766ffd700 1 -- 172.21.15.44:0/2999081409 >> v2:172.21.15.99:3300/0 conn(0x7f676815b890 msgr2=0x7f6768162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:08.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.197+0000 7f6766ffd700 1 --2- 172.21.15.44:0/2999081409 >> v2:172.21.15.99:3300/0 conn(0x7f676815b890 0x7f6768162220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.197+0000 7f6766ffd700 1 -- 172.21.15.44:0/2999081409 >> v1:172.21.15.99:6789/0 conn(0x7f67680b2930 legacy=0x7f676806ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.197+0000 7f6766ffd700 1 -- 172.21.15.44:0/2999081409 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67680ccc20 con 0x7f67680cdcc0 2024-09-13T18:29:08.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.197+0000 7f67677fe700 1 --2- 172.21.15.44:0/2999081409 >> v2:172.21.15.99:3300/0 conn(0x7f676815b890 0x7f6768162220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:08.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.197+0000 7f6766ffd700 1 --2- 172.21.15.44:0/2999081409 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f67680cdcc0 0x7f67680b23f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6758009910 tx=0x7f6758009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0a758cc12d2c10 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:08.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.197+0000 7f67667fc700 1 -- 172.21.15.44:0/2999081409 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758011830 con 0x7f67680cdcc0 2024-09-13T18:29:08.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.197+0000 7f67667fc700 1 -- 172.21.15.44:0/2999081409 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6758011990 con 0x7f67680cdcc0 2024-09-13T18:29:08.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.197+0000 7f67667fc700 1 -- 172.21.15.44:0/2999081409 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758011d40 con 0x7f67680cdcc0 2024-09-13T18:29:08.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f676dbd3700 1 -- 172.21.15.44:0/2999081409 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f67680cdcc0 msgr2=0x7f67680b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f676dbd3700 1 --2- 172.21.15.44:0/2999081409 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f67680cdcc0 0x7f67680b23f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6758009910 tx=0x7f6758009c20 comp rx=0 tx=0).stop 2024-09-13T18:29:08.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f676dbd3700 1 -- 172.21.15.44:0/2999081409 shutdown_connections 2024-09-13T18:29:08.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f676dbd3700 1 --2- 172.21.15.44:0/2999081409 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f67680cdcc0 0x7f67680b23f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f676dbd3700 1 --2- 172.21.15.44:0/2999081409 >> v2:172.21.15.99:3300/0 conn(0x7f676815b890 0x7f6768162220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f676dbd3700 1 -- 172.21.15.44:0/2999081409 >> 172.21.15.44:0/2999081409 conn(0x7f67680ce980 msgr2=0x7f67680ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:08.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f676dbd3700 1 -- 172.21.15.44:0/2999081409 shutdown_connections 2024-09-13T18:29:08.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f676dbd3700 1 -- 172.21.15.44:0/2999081409 wait complete. 2024-09-13T18:29:08.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f676dbd3700 1 Processor -- start 2024-09-13T18:29:08.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f676dbd3700 1 -- start start 2024-09-13T18:29:08.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f676dbd3700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67680b2930 0x7f67681fac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f676dbd3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67680cdcc0 0x7f676814aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f676dbd3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f676815b890 0x7f67681f6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f676dbd3700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67681fa230 con 0x7f67680cdcc0 2024-09-13T18:29:08.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f676dbd3700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67681fa780 con 0x7f67680b2930 2024-09-13T18:29:08.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f676dbd3700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67681fb150 con 0x7f676815b890 2024-09-13T18:29:08.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f6766ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67680cdcc0 0x7f676814aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f67677fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67680b2930 0x7f67681fac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f6766ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67680cdcc0 0x7f676814aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45572/0 (socket says 172.21.15.44:45572) 2024-09-13T18:29:08.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f6766ffd700 1 -- 172.21.15.44:0/1628017476 learned_addr learned my addr 172.21.15.44:0/1628017476 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:08.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f6767fff700 1 --2- 172.21.15.44:0/1628017476 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f676815b890 0x7f67681f6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f6766ffd700 1 -- 172.21.15.44:0/1628017476 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f676815b890 msgr2=0x7f67681f6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f6766ffd700 1 --2- 172.21.15.44:0/1628017476 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f676815b890 0x7f67681f6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f6766ffd700 1 -- 172.21.15.44:0/1628017476 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67680b2930 msgr2=0x7f67681fac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f6766ffd700 1 --2- 172.21.15.44:0/1628017476 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67680b2930 0x7f67681fac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.201+0000 7f6766ffd700 1 -- 172.21.15.44:0/1628017476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67500094b0 con 0x7f67680cdcc0 2024-09-13T18:29:08.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.205+0000 7f6766ffd700 1 --2- 172.21.15.44:0/1628017476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67680cdcc0 0x7f676814aac0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f676815bdb0 tx=0x7f6758004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:08.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.205+0000 7f675ffff700 1 -- 172.21.15.44:0/1628017476 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758004510 con 0x7f67680cdcc0 2024-09-13T18:29:08.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.205+0000 7f675ffff700 1 -- 172.21.15.44:0/1628017476 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67580036c0 con 0x7f67680cdcc0 2024-09-13T18:29:08.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.205+0000 7f676dbd3700 1 -- 172.21.15.44:0/1628017476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6758009570 con 0x7f67680cdcc0 2024-09-13T18:29:08.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.205+0000 7f675ffff700 1 -- 172.21.15.44:0/1628017476 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758003a70 con 0x7f67680cdcc0 2024-09-13T18:29:08.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.205+0000 7f676dbd3700 1 -- 172.21.15.44:0/1628017476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67681f7970 con 0x7f67680cdcc0 2024-09-13T18:29:08.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.205+0000 7f676dbd3700 1 -- 172.21.15.44:0/1628017476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67680cd1a0 con 0x7f67680cdcc0 2024-09-13T18:29:08.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.205+0000 7f675ffff700 1 -- 172.21.15.44:0/1628017476 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6758003bd0 con 0x7f67680cdcc0 2024-09-13T18:29:08.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.205+0000 7f675ffff700 1 --2- 172.21.15.44:0/1628017476 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6748066730 0x7f6748068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.209+0000 7f675ffff700 1 -- 172.21.15.44:0/1628017476 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6758021030 con 0x7f67680cdcc0 2024-09-13T18:29:08.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.209+0000 7f67677fe700 1 --2- 172.21.15.44:0/1628017476 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6748066730 0x7f6748068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.209+0000 7f67677fe700 1 --2- 172.21.15.44:0/1628017476 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6748066730 0x7f6748068bf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6750009ce0 tx=0x7f6750009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:08.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.217+0000 7f675ffff700 1 -- 172.21.15.44:0/1628017476 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6758052ac0 con 0x7f67680cdcc0 2024-09-13T18:29:08.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.389+0000 7f676dbd3700 1 -- 172.21.15.44:0/1628017476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f676806e070 con 0x7f67680cdcc0 2024-09-13T18:29:08.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.393+0000 7f675ffff700 1 -- 172.21.15.44:0/1628017476 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v44) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6758015060 con 0x7f67680cdcc0 2024-09-13T18:29:08.395 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:29:08.395 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-09-13T18:29:08.395 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:29:08.395 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2024-09-13T18:29:08.395 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2024-09-13T18:29:08.395 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:29:08.395 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-09-13T18:29:08.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.393+0000 7f676dbd3700 1 -- 172.21.15.44:0/1628017476 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6748066730 msgr2=0x7f6748068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.393+0000 7f676dbd3700 1 --2- 172.21.15.44:0/1628017476 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6748066730 0x7f6748068bf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6750009ce0 tx=0x7f6750009240 comp rx=0 tx=0).stop 2024-09-13T18:29:08.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.393+0000 7f676dbd3700 1 -- 172.21.15.44:0/1628017476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67680cdcc0 msgr2=0x7f676814aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.393+0000 7f676dbd3700 1 --2- 172.21.15.44:0/1628017476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67680cdcc0 0x7f676814aac0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f676815bdb0 tx=0x7f6758004770 comp rx=0 tx=0).stop 2024-09-13T18:29:08.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.393+0000 7f676dbd3700 1 -- 172.21.15.44:0/1628017476 shutdown_connections 2024-09-13T18:29:08.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.393+0000 7f676dbd3700 1 --2- 172.21.15.44:0/1628017476 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6748066730 0x7f6748068bf0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.393+0000 7f676dbd3700 1 --2- 172.21.15.44:0/1628017476 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f676815b890 0x7f67681f6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.393+0000 7f676dbd3700 1 --2- 172.21.15.44:0/1628017476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67680cdcc0 0x7f676814aac0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.393+0000 7f676dbd3700 1 --2- 172.21.15.44:0/1628017476 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67680b2930 0x7f67681fac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.393+0000 7f676dbd3700 1 -- 172.21.15.44:0/1628017476 >> 172.21.15.44:0/1628017476 conn(0x7f67680ce980 msgr2=0x7f67680ae690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:08.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.393+0000 7f676dbd3700 1 -- 172.21.15.44:0/1628017476 shutdown_connections 2024-09-13T18:29:08.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.393+0000 7f676dbd3700 1 -- 172.21.15.44:0/1628017476 wait complete. 2024-09-13T18:29:08.409 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:29:08.410 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:29:08.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.525+0000 7fef3359e700 1 Processor -- start 2024-09-13T18:29:08.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.525+0000 7fef3359e700 1 -- start start 2024-09-13T18:29:08.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef3359e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef340ce710 0x7fef340b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef3359e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3406aa30 con 0x7fef340ceaf0 2024-09-13T18:29:08.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef3359e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef340b1e60 con 0x7fef34160d90 2024-09-13T18:29:08.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef3359e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef340d0660 con 0x7fef340ce710 2024-09-13T18:29:08.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef29d9b700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fef340ceaf0 0x7fef340cff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56532/0 (socket says 172.21.15.44:56532) 2024-09-13T18:29:08.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef29d9b700 1 -- 172.21.15.44:0/1118458845 learned_addr learned my addr 172.21.15.44:0/1118458845 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:29:08.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef3259c700 1 --2- 172.21.15.44:0/1118458845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef340ce710 0x7fef340b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef31d9b700 1 -- 172.21.15.44:0/1118458845 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672424056 0 0) 0x7fef3406aa30 con 0x7fef340ceaf0 2024-09-13T18:29:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef31d9b700 1 -- 172.21.15.44:0/1118458845 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef200035d0 con 0x7fef340ceaf0 2024-09-13T18:29:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef31d9b700 1 -- 172.21.15.44:0/1118458845 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4002325761 0 0) 0x7fef340b1e60 con 0x7fef34160d90 2024-09-13T18:29:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef3259c700 1 -- 172.21.15.44:0/1118458845 >> v1:172.21.15.99:6789/0 conn(0x7fef34160d90 legacy=0x7fef341611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef3259c700 1 -- 172.21.15.44:0/1118458845 >> v1:172.21.15.44:6789/0 conn(0x7fef340ceaf0 legacy=0x7fef340cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef3259c700 1 -- 172.21.15.44:0/1118458845 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef340b18a0 con 0x7fef340ce710 2024-09-13T18:29:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef3259c700 1 --2- 172.21.15.44:0/1118458845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef340ce710 0x7fef340b5da0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fef24009880 tx=0x7fef24009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35f9db49f570fc0e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef31d9b700 1 -- 172.21.15.44:0/1118458845 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c001670 con 0x7fef340ce710 2024-09-13T18:29:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef31d9b700 1 -- 172.21.15.44:0/1118458845 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef24010590 con 0x7fef340ce710 2024-09-13T18:29:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef31d9b700 1 -- 172.21.15.44:0/1118458845 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24010940 con 0x7fef340ce710 2024-09-13T18:29:08.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef3359e700 1 -- 172.21.15.44:0/1118458845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef340ce710 msgr2=0x7fef340b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef3359e700 1 --2- 172.21.15.44:0/1118458845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef340ce710 0x7fef340b5da0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fef24009880 tx=0x7fef24009b90 comp rx=0 tx=0).stop 2024-09-13T18:29:08.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef3359e700 1 -- 172.21.15.44:0/1118458845 shutdown_connections 2024-09-13T18:29:08.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef3359e700 1 --2- 172.21.15.44:0/1118458845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef340ce710 0x7fef340b5da0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef3359e700 1 -- 172.21.15.44:0/1118458845 >> 172.21.15.44:0/1118458845 conn(0x7fef340d3260 msgr2=0x7fef340cf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:08.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef3359e700 1 -- 172.21.15.44:0/1118458845 shutdown_connections 2024-09-13T18:29:08.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.529+0000 7fef3359e700 1 -- 172.21.15.44:0/1118458845 wait complete. 2024-09-13T18:29:08.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.533+0000 7fef3359e700 1 Processor -- start 2024-09-13T18:29:08.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.533+0000 7fef3359e700 1 -- start start 2024-09-13T18:29:08.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.533+0000 7fef3359e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef340ce710 0x7fef34152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.533+0000 7fef3359e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef340ceaf0 0x7fef3415fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.533+0000 7fef3359e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef34160d90 0x7fef341601e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.533+0000 7fef3359e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef340ca840 con 0x7fef34160d90 2024-09-13T18:29:08.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.533+0000 7fef3359e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef34157370 con 0x7fef340ceaf0 2024-09-13T18:29:08.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.533+0000 7fef3359e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef34157650 con 0x7fef340ce710 2024-09-13T18:29:08.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.533+0000 7fef32d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef34160d90 0x7fef341601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.533+0000 7fef32d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef34160d90 0x7fef341601e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45584/0 (socket says 172.21.15.44:45584) 2024-09-13T18:29:08.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.533+0000 7fef32d9d700 1 -- 172.21.15.44:0/3612460924 learned_addr learned my addr 172.21.15.44:0/3612460924 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:08.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.533+0000 7fef3259c700 1 --2- 172.21.15.44:0/3612460924 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef340ce710 0x7fef34152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.533+0000 7fef29d9b700 1 --2- 172.21.15.44:0/3612460924 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef340ceaf0 0x7fef3415fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.533+0000 7fef32d9d700 1 -- 172.21.15.44:0/3612460924 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef340ce710 msgr2=0x7fef34152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.533+0000 7fef32d9d700 1 --2- 172.21.15.44:0/3612460924 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef340ce710 0x7fef34152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.533+0000 7fef32d9d700 1 -- 172.21.15.44:0/3612460924 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef340ceaf0 msgr2=0x7fef3415fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.533+0000 7fef32d9d700 1 --2- 172.21.15.44:0/3612460924 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef340ceaf0 0x7fef3415fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.533+0000 7fef32d9d700 1 -- 172.21.15.44:0/3612460924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef240094b0 con 0x7fef34160d90 2024-09-13T18:29:08.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.533+0000 7fef32d9d700 1 --2- 172.21.15.44:0/3612460924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef34160d90 0x7fef341601e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00cc10 tx=0x7fef2c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:08.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.533+0000 7fef2b7fe700 1 -- 172.21.15.44:0/3612460924 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c003e50 con 0x7fef34160d90 2024-09-13T18:29:08.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.533+0000 7fef2b7fe700 1 -- 172.21.15.44:0/3612460924 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2c00a650 con 0x7fef34160d90 2024-09-13T18:29:08.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.533+0000 7fef3359e700 1 -- 172.21.15.44:0/3612460924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef34157930 con 0x7fef34160d90 2024-09-13T18:29:08.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.533+0000 7fef2b7fe700 1 -- 172.21.15.44:0/3612460924 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c00aa00 con 0x7fef34160d90 2024-09-13T18:29:08.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.537+0000 7fef3359e700 1 -- 172.21.15.44:0/3612460924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef34156f90 con 0x7fef34160d90 2024-09-13T18:29:08.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.537+0000 7fef3359e700 1 -- 172.21.15.44:0/3612460924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef340cac90 con 0x7fef34160d90 2024-09-13T18:29:08.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.537+0000 7fef2b7fe700 1 -- 172.21.15.44:0/3612460924 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fef2c00ab60 con 0x7fef34160d90 2024-09-13T18:29:08.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.537+0000 7fef2b7fe700 1 --2- 172.21.15.44:0/3612460924 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef14066730 0x7fef14068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.537+0000 7fef2b7fe700 1 -- 172.21.15.44:0/3612460924 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fef2c083880 con 0x7fef34160d90 2024-09-13T18:29:08.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.537+0000 7fef3259c700 1 --2- 172.21.15.44:0/3612460924 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef14066730 0x7fef14068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.541+0000 7fef3259c700 1 --2- 172.21.15.44:0/3612460924 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef14066730 0x7fef14068bf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fef240097d0 tx=0x7fef24010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:08.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.545+0000 7fef2b7fe700 1 -- 172.21.15.44:0/3612460924 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fef340cac90 con 0x7fef34160d90 2024-09-13T18:29:08.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.713+0000 7fef3359e700 1 -- 172.21.15.44:0/3612460924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fef340cac90 con 0x7fef34160d90 2024-09-13T18:29:08.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.889+0000 7fef2b7fe700 1 -- 172.21.15.44:0/3612460924 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v45) v1 ==== 138+0+0 (secure 0 0 0) 0x7fef340cac90 con 0x7fef34160d90 2024-09-13T18:29:08.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.897+0000 7fef3359e700 1 -- 172.21.15.44:0/3612460924 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef14066730 msgr2=0x7fef14068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.897+0000 7fef3359e700 1 --2- 172.21.15.44:0/3612460924 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef14066730 0x7fef14068bf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fef240097d0 tx=0x7fef24010000 comp rx=0 tx=0).stop 2024-09-13T18:29:08.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.897+0000 7fef3359e700 1 -- 172.21.15.44:0/3612460924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef34160d90 msgr2=0x7fef341601e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.897+0000 7fef3359e700 1 --2- 172.21.15.44:0/3612460924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef34160d90 0x7fef341601e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00cc10 tx=0x7fef2c00cf20 comp rx=0 tx=0).stop 2024-09-13T18:29:08.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.897+0000 7fef3359e700 1 -- 172.21.15.44:0/3612460924 shutdown_connections 2024-09-13T18:29:08.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.897+0000 7fef3359e700 1 --2- 172.21.15.44:0/3612460924 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef14066730 0x7fef14068bf0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.897+0000 7fef3359e700 1 --2- 172.21.15.44:0/3612460924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef34160d90 0x7fef341601e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.897+0000 7fef3359e700 1 --2- 172.21.15.44:0/3612460924 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef340ceaf0 0x7fef3415fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.897+0000 7fef3359e700 1 --2- 172.21.15.44:0/3612460924 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef340ce710 0x7fef34152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.897+0000 7fef3359e700 1 -- 172.21.15.44:0/3612460924 >> 172.21.15.44:0/3612460924 conn(0x7fef340d3260 msgr2=0x7fef340b26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:08.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.897+0000 7fef3359e700 1 -- 172.21.15.44:0/3612460924 shutdown_connections 2024-09-13T18:29:08.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:08.897+0000 7fef3359e700 1 -- 172.21.15.44:0/3612460924 wait complete. 2024-09-13T18:29:08.904 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2024-09-13T18:29:08.918 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:29:09.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.033+0000 7fb36c93c700 1 Processor -- start 2024-09-13T18:29:09.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.033+0000 7fb36c93c700 1 -- start start 2024-09-13T18:29:09.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.033+0000 7fb36c93c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb3681433e0 0x7fb36815a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.033+0000 7fb36c93c700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb36815b290 0x7fb36815b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.033+0000 7fb36c93c700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb36806c950 con 0x7fb36806a310 2024-09-13T18:29:09.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.033+0000 7fb36c93c700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb36806cc30 con 0x7fb3681433e0 2024-09-13T18:29:09.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.033+0000 7fb36c93c700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb36806cf10 con 0x7fb36815b290 2024-09-13T18:29:09.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.033+0000 7fb365d9b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb3681433e0 0x7fb36815a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.033+0000 7fb365d9b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb3681433e0 0x7fb36815a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45588/0 (socket says 172.21.15.44:45588) 2024-09-13T18:29:09.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.033+0000 7fb365d9b700 1 -- 172.21.15.44:0/2777311294 learned_addr learned my addr 172.21.15.44:0/2777311294 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:09.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.033+0000 7fb366d9d700 1 --2- 172.21.15.44:0/2777311294 >> v2:172.21.15.99:3300/0 conn(0x7fb36815b290 0x7fb36815b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb365d9b700 1 -- 172.21.15.44:0/2777311294 >> v2:172.21.15.99:3300/0 conn(0x7fb36815b290 msgr2=0x7fb36815b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:09.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb365d9b700 1 --2- 172.21.15.44:0/2777311294 >> v2:172.21.15.99:3300/0 conn(0x7fb36815b290 0x7fb36815b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb365d9b700 1 -- 172.21.15.44:0/2777311294 >> v1:172.21.15.99:6789/0 conn(0x7fb36806a310 legacy=0x7fb36806a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:09.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb365d9b700 1 -- 172.21.15.44:0/2777311294 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36806d1f0 con 0x7fb3681433e0 2024-09-13T18:29:09.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb365d9b700 1 --2- 172.21.15.44:0/2777311294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3681433e0 0x7fb36815a940 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb3680ce960 tx=0x7fb350009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe8fe88139cf389 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:09.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb36559a700 1 -- 172.21.15.44:0/2777311294 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35000f8a0 con 0x7fb3681433e0 2024-09-13T18:29:09.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb36559a700 1 -- 172.21.15.44:0/2777311294 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35000fa00 con 0x7fb3681433e0 2024-09-13T18:29:09.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb36559a700 1 -- 172.21.15.44:0/2777311294 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35000fd90 con 0x7fb3681433e0 2024-09-13T18:29:09.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb36c93c700 1 -- 172.21.15.44:0/2777311294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3681433e0 msgr2=0x7fb36815a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:09.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb36c93c700 1 --2- 172.21.15.44:0/2777311294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3681433e0 0x7fb36815a940 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb3680ce960 tx=0x7fb350009bf0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb36c93c700 1 -- 172.21.15.44:0/2777311294 shutdown_connections 2024-09-13T18:29:09.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb36c93c700 1 --2- 172.21.15.44:0/2777311294 >> v2:172.21.15.99:3300/0 conn(0x7fb36815b290 0x7fb36815b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb36c93c700 1 --2- 172.21.15.44:0/2777311294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3681433e0 0x7fb36815a940 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb36c93c700 1 -- 172.21.15.44:0/2777311294 >> 172.21.15.44:0/2777311294 conn(0x7fb3680af620 msgr2=0x7fb3680afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:09.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb36c93c700 1 -- 172.21.15.44:0/2777311294 shutdown_connections 2024-09-13T18:29:09.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb36c93c700 1 -- 172.21.15.44:0/2777311294 wait complete. 2024-09-13T18:29:09.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb36c93c700 1 Processor -- start 2024-09-13T18:29:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb36c93c700 1 -- start start 2024-09-13T18:29:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb36c93c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb36806a310 0x7fb3681424b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb36c93c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3681433e0 0x7fb3680cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb36c93c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb36815b290 0x7fb368070e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb36c93c700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680cb990 con 0x7fb3681433e0 2024-09-13T18:29:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb36c93c700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680cbbc0 con 0x7fb36815b290 2024-09-13T18:29:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb36c93c700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680cbea0 con 0x7fb36806a310 2024-09-13T18:29:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb365d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3681433e0 0x7fb3680cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb365d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3681433e0 0x7fb3680cb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45592/0 (socket says 172.21.15.44:45592) 2024-09-13T18:29:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb365d9b700 1 -- 172.21.15.44:0/201717605 learned_addr learned my addr 172.21.15.44:0/201717605 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb366d9d700 1 --2- 172.21.15.44:0/201717605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb36815b290 0x7fb368070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.037+0000 7fb36659c700 1 --2- 172.21.15.44:0/201717605 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb36806a310 0x7fb3681424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.041+0000 7fb365d9b700 1 -- 172.21.15.44:0/201717605 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb36806a310 msgr2=0x7fb3681424b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:09.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.041+0000 7fb365d9b700 1 --2- 172.21.15.44:0/201717605 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb36806a310 0x7fb3681424b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.041+0000 7fb365d9b700 1 -- 172.21.15.44:0/201717605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb36815b290 msgr2=0x7fb368070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:09.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.041+0000 7fb365d9b700 1 --2- 172.21.15.44:0/201717605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb36815b290 0x7fb368070e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.041+0000 7fb365d9b700 1 -- 172.21.15.44:0/201717605 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb350009570 con 0x7fb3681433e0 2024-09-13T18:29:09.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.041+0000 7fb36659c700 1 --2- 172.21.15.44:0/201717605 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb36806a310 0x7fb3681424b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:09.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.041+0000 7fb365d9b700 1 --2- 172.21.15.44:0/201717605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3681433e0 0x7fb3680cb450 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb3680b16b0 tx=0x7fb350004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:09.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.041+0000 7fb35effd700 1 -- 172.21.15.44:0/201717605 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3500038c0 con 0x7fb3681433e0 2024-09-13T18:29:09.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.041+0000 7fb35effd700 1 -- 172.21.15.44:0/201717605 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35000fd80 con 0x7fb3681433e0 2024-09-13T18:29:09.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.041+0000 7fb35effd700 1 -- 172.21.15.44:0/201717605 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb350003c60 con 0x7fb3681433e0 2024-09-13T18:29:09.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.041+0000 7fb36c93c700 1 -- 172.21.15.44:0/201717605 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3680cc180 con 0x7fb3681433e0 2024-09-13T18:29:09.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.041+0000 7fb36c93c700 1 -- 172.21.15.44:0/201717605 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3680cc740 con 0x7fb3681433e0 2024-09-13T18:29:09.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.041+0000 7fb36c93c700 1 -- 172.21.15.44:0/201717605 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb36815a940 con 0x7fb3681433e0 2024-09-13T18:29:09.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.041+0000 7fb35effd700 1 -- 172.21.15.44:0/201717605 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb350019400 con 0x7fb3681433e0 2024-09-13T18:29:09.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.045+0000 7fb35effd700 1 --2- 172.21.15.44:0/201717605 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb348066730 0x7fb348068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.045+0000 7fb35effd700 1 -- 172.21.15.44:0/201717605 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fb3500858a0 con 0x7fb3681433e0 2024-09-13T18:29:09.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.045+0000 7fb36659c700 1 --2- 172.21.15.44:0/201717605 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb348066730 0x7fb348068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.045+0000 7fb36659c700 1 --2- 172.21.15.44:0/201717605 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb348066730 0x7fb348068bf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb3580017a0 tx=0x7fb358009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:09.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.053+0000 7fb35effd700 1 -- 172.21.15.44:0/201717605 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb350052e80 con 0x7fb3681433e0 2024-09-13T18:29:09.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.217+0000 7fb36c93c700 1 -- 172.21.15.44:0/201717605 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb3680b4970 con 0x7fb3681433e0 2024-09-13T18:29:09.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.905+0000 7fb35effd700 1 -- 172.21.15.44:0/201717605 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v46) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb3500564a0 con 0x7fb3681433e0 2024-09-13T18:29:09.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.917+0000 7fb36c93c700 1 -- 172.21.15.44:0/201717605 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb348066730 msgr2=0x7fb348068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:09.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.917+0000 7fb36c93c700 1 --2- 172.21.15.44:0/201717605 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb348066730 0x7fb348068bf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb3580017a0 tx=0x7fb358009040 comp rx=0 tx=0).stop 2024-09-13T18:29:09.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.917+0000 7fb36c93c700 1 -- 172.21.15.44:0/201717605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3681433e0 msgr2=0x7fb3680cb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:09.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.917+0000 7fb36c93c700 1 --2- 172.21.15.44:0/201717605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3681433e0 0x7fb3680cb450 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb3680b16b0 tx=0x7fb350004770 comp rx=0 tx=0).stop 2024-09-13T18:29:09.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.917+0000 7fb36c93c700 1 -- 172.21.15.44:0/201717605 shutdown_connections 2024-09-13T18:29:09.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.917+0000 7fb36c93c700 1 --2- 172.21.15.44:0/201717605 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb348066730 0x7fb348068bf0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.917+0000 7fb36c93c700 1 --2- 172.21.15.44:0/201717605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb36815b290 0x7fb368070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.917+0000 7fb36c93c700 1 --2- 172.21.15.44:0/201717605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3681433e0 0x7fb3680cb450 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.917+0000 7fb36c93c700 1 --2- 172.21.15.44:0/201717605 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb36806a310 0x7fb3681424b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.917+0000 7fb36c93c700 1 -- 172.21.15.44:0/201717605 >> 172.21.15.44:0/201717605 conn(0x7fb3680af620 msgr2=0x7fb3680ad6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:09.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.917+0000 7fb36c93c700 1 -- 172.21.15.44:0/201717605 shutdown_connections 2024-09-13T18:29:09.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:09.917+0000 7fb36c93c700 1 -- 172.21.15.44:0/201717605 wait complete. 2024-09-13T18:29:09.923 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2024-09-13T18:29:09.935 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:29:10.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.049+0000 7f54cb5c5700 1 Processor -- start 2024-09-13T18:29:10.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.049+0000 7f54cb5c5700 1 -- start start 2024-09-13T18:29:10.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.049+0000 7f54cb5c5700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f54c4159110 0x7f54c406a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.049+0000 7f54cb5c5700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f54c406e3f0 0x7f54c406e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.049+0000 7f54cb5c5700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c41595a0 con 0x7f54c40ceb60 2024-09-13T18:29:10.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.049+0000 7f54cb5c5700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c406edc0 con 0x7f54c406e3f0 2024-09-13T18:29:10.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.049+0000 7f54cb5c5700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40cef40 con 0x7f54c4159110 2024-09-13T18:29:10.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.049+0000 7f54c9b62700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f54c406e3f0 0x7f54c406e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.049+0000 7f54c9b62700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f54c406e3f0 0x7f54c406e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45594/0 (socket says 172.21.15.44:45594) 2024-09-13T18:29:10.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.049+0000 7f54c9b62700 1 -- 172.21.15.44:0/2538031440 learned_addr learned my addr 172.21.15.44:0/2538031440 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:10.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.049+0000 7f54c8b60700 1 --2- 172.21.15.44:0/2538031440 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f54c4159110 0x7f54c406a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.053+0000 7f54c9b62700 1 -- 172.21.15.44:0/2538031440 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f54c4159110 msgr2=0x7f54c406a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:10.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.053+0000 7f54c9b62700 1 --2- 172.21.15.44:0/2538031440 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f54c4159110 0x7f54c406a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.053+0000 7f54c9b62700 1 -- 172.21.15.44:0/2538031440 >> v1:172.21.15.99:6789/0 conn(0x7f54c40ceb60 legacy=0x7f54c40b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.053+0000 7f54c9b62700 1 -- 172.21.15.44:0/2538031440 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c415a5c0 con 0x7f54c406e3f0 2024-09-13T18:29:10.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.053+0000 7f54c9b62700 1 --2- 172.21.15.44:0/2538031440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54c406e3f0 0x7f54c406e880 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009910 tx=0x7f54c0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959a7892ca5c787e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:10.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.053+0000 7f54bbfff700 1 -- 172.21.15.44:0/2538031440 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c0011830 con 0x7f54c406e3f0 2024-09-13T18:29:10.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.053+0000 7f54bbfff700 1 -- 172.21.15.44:0/2538031440 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c0011990 con 0x7f54c406e3f0 2024-09-13T18:29:10.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.053+0000 7f54bbfff700 1 -- 172.21.15.44:0/2538031440 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c0011d40 con 0x7f54c406e3f0 2024-09-13T18:29:10.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.053+0000 7f54cb5c5700 1 -- 172.21.15.44:0/2538031440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54c406e3f0 msgr2=0x7f54c406e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.053+0000 7f54cb5c5700 1 --2- 172.21.15.44:0/2538031440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54c406e3f0 0x7f54c406e880 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009910 tx=0x7f54c0009c20 comp rx=0 tx=0).stop 2024-09-13T18:29:10.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.053+0000 7f54cb5c5700 1 -- 172.21.15.44:0/2538031440 shutdown_connections 2024-09-13T18:29:10.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.053+0000 7f54cb5c5700 1 --2- 172.21.15.44:0/2538031440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54c406e3f0 0x7f54c406e880 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.053+0000 7f54cb5c5700 1 --2- 172.21.15.44:0/2538031440 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f54c4159110 0x7f54c406a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.053+0000 7f54cb5c5700 1 -- 172.21.15.44:0/2538031440 >> 172.21.15.44:0/2538031440 conn(0x7f54c406d900 msgr2=0x7f54c406dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:10.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.053+0000 7f54cb5c5700 1 -- 172.21.15.44:0/2538031440 shutdown_connections 2024-09-13T18:29:10.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.053+0000 7f54cb5c5700 1 -- 172.21.15.44:0/2538031440 wait complete. 2024-09-13T18:29:10.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.053+0000 7f54cb5c5700 1 Processor -- start 2024-09-13T18:29:10.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54cb5c5700 1 -- start start 2024-09-13T18:29:10.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54cb5c5700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f54c406e3f0 0x7f54c41ef270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54cb5c5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54c40ceb60 0x7f54c41f0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54cb5c5700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54c4159110 0x7f54c41eceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54cb5c5700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c41f0970 con 0x7f54c40ceb60 2024-09-13T18:29:10.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54cb5c5700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40cdea0 con 0x7f54c4159110 2024-09-13T18:29:10.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54cb5c5700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c41f0ba0 con 0x7f54c406e3f0 2024-09-13T18:29:10.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54c8b60700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54c40ceb60 0x7f54c41f0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54c8b60700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54c40ceb60 0x7f54c41f0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45606/0 (socket says 172.21.15.44:45606) 2024-09-13T18:29:10.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54c8b60700 1 -- 172.21.15.44:0/3068093163 learned_addr learned my addr 172.21.15.44:0/3068093163 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:10.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54c9b62700 1 --2- 172.21.15.44:0/3068093163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54c4159110 0x7f54c41eceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54c9361700 1 --2- 172.21.15.44:0/3068093163 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f54c406e3f0 0x7f54c41ef270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54c9361700 1 -- 172.21.15.44:0/3068093163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54c4159110 msgr2=0x7f54c41eceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54c9361700 1 --2- 172.21.15.44:0/3068093163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54c4159110 0x7f54c41eceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54c9361700 1 -- 172.21.15.44:0/3068093163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54c40ceb60 msgr2=0x7f54c41f0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54c9361700 1 --2- 172.21.15.44:0/3068093163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54c40ceb60 0x7f54c41f0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54c9361700 1 -- 172.21.15.44:0/3068093163 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c0009570 con 0x7f54c406e3f0 2024-09-13T18:29:10.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54c9b62700 1 --2- 172.21.15.44:0/3068093163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54c4159110 0x7f54c41eceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:10.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54c8b60700 1 --2- 172.21.15.44:0/3068093163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54c40ceb60 0x7f54c41f0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:10.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54c9361700 1 --2- 172.21.15.44:0/3068093163 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f54c406e3f0 0x7f54c41ef270 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00cbb0 tx=0x7f54bc00cec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:10.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54b9ffb700 1 -- 172.21.15.44:0/3068093163 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc003c20 con 0x7f54c406e3f0 2024-09-13T18:29:10.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54b9ffb700 1 -- 172.21.15.44:0/3068093163 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54bc003d80 con 0x7f54c406e3f0 2024-09-13T18:29:10.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54cb5c5700 1 -- 172.21.15.44:0/3068093163 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c41f0e80 con 0x7f54c406e3f0 2024-09-13T18:29:10.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54b9ffb700 1 -- 172.21.15.44:0/3068093163 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc00aae0 con 0x7f54c406e3f0 2024-09-13T18:29:10.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.057+0000 7f54cb5c5700 1 -- 172.21.15.44:0/3068093163 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c41f1440 con 0x7f54c406e3f0 2024-09-13T18:29:10.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.061+0000 7f54cb5c5700 1 -- 172.21.15.44:0/3068093163 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c415a0a0 con 0x7f54c406e3f0 2024-09-13T18:29:10.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.061+0000 7f54b9ffb700 1 -- 172.21.15.44:0/3068093163 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f54bc00ac40 con 0x7f54c406e3f0 2024-09-13T18:29:10.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.061+0000 7f54b9ffb700 1 --2- 172.21.15.44:0/3068093163 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f54a8066730 0x7f54a8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.061+0000 7f54b9ffb700 1 -- 172.21.15.44:0/3068093163 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f54bc084ba0 con 0x7f54c406e3f0 2024-09-13T18:29:10.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.065+0000 7f54c8b60700 1 --2- 172.21.15.44:0/3068093163 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f54a8066730 0x7f54a8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.065+0000 7f54c8b60700 1 --2- 172.21.15.44:0/3068093163 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f54a8066730 0x7f54a8068bf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f54c40ad330 tx=0x7f54b4009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:10.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.069+0000 7f54b9ffb700 1 -- 172.21.15.44:0/3068093163 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f54bc051ed0 con 0x7f54c406e3f0 2024-09-13T18:29:10.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.281+0000 7f54cb5c5700 1 -- 172.21.15.44:0/3068093163 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f54c406a6e0 con 0x7f54c406e3f0 2024-09-13T18:29:10.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.293+0000 7f54b9ffb700 1 -- 172.21.15.44:0/3068093163 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v27) v1 ==== 172+0+0 (secure 0 0 0) 0x7f54bc0554f0 con 0x7f54c406e3f0 2024-09-13T18:29:10.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.305+0000 7f54cb5c5700 1 -- 172.21.15.44:0/3068093163 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f54a8066730 msgr2=0x7f54a8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.305+0000 7f54cb5c5700 1 --2- 172.21.15.44:0/3068093163 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f54a8066730 0x7f54a8068bf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f54c40ad330 tx=0x7f54b4009240 comp rx=0 tx=0).stop 2024-09-13T18:29:10.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.305+0000 7f54cb5c5700 1 -- 172.21.15.44:0/3068093163 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f54c406e3f0 msgr2=0x7f54c41ef270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.305+0000 7f54cb5c5700 1 --2- 172.21.15.44:0/3068093163 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f54c406e3f0 0x7f54c41ef270 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00cbb0 tx=0x7f54bc00cec0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.305+0000 7f54cb5c5700 1 -- 172.21.15.44:0/3068093163 shutdown_connections 2024-09-13T18:29:10.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.305+0000 7f54cb5c5700 1 --2- 172.21.15.44:0/3068093163 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f54a8066730 0x7f54a8068bf0 secure :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f54c40ad330 tx=0x7f54b4009240 comp rx=0 tx=0).stop 2024-09-13T18:29:10.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.305+0000 7f54cb5c5700 1 --2- 172.21.15.44:0/3068093163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54c4159110 0x7f54c41eceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.305+0000 7f54cb5c5700 1 --2- 172.21.15.44:0/3068093163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54c40ceb60 0x7f54c41f0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.305+0000 7f54cb5c5700 1 --2- 172.21.15.44:0/3068093163 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f54c406e3f0 0x7f54c41ef270 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00cbb0 tx=0x7f54bc00cec0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.305+0000 7f54cb5c5700 1 -- 172.21.15.44:0/3068093163 >> 172.21.15.44:0/3068093163 conn(0x7f54c406d900 msgr2=0x7f54c40b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:10.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.305+0000 7f54cb5c5700 1 -- 172.21.15.44:0/3068093163 shutdown_connections 2024-09-13T18:29:10.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.305+0000 7f54cb5c5700 1 -- 172.21.15.44:0/3068093163 wait complete. 2024-09-13T18:29:10.318 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 6 and data pool 7 2024-09-13T18:29:10.333 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:29:10.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e44f2700 1 Processor -- start 2024-09-13T18:29:10.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e44f2700 1 -- start start 2024-09-13T18:29:10.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e44f2700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f47dc15ac40 0x7f47dc06ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e44f2700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47dc15f550 con 0x7f47dc0adba0 2024-09-13T18:29:10.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e44f2700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47dc15b020 con 0x7f47dc0ad710 2024-09-13T18:29:10.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e44f2700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47dc0b31e0 con 0x7f47dc15ac40 2024-09-13T18:29:10.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e2a8f700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f47dc0adba0 0x7f47dc15ee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56540/0 (socket says 172.21.15.44:56540) 2024-09-13T18:29:10.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e2a8f700 1 -- 172.21.15.44:0/3149895586 learned_addr learned my addr 172.21.15.44:0/3149895586 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:29:10.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e228e700 1 --2- 172.21.15.44:0/3149895586 >> v2:172.21.15.99:3300/0 conn(0x7f47dc15ac40 0x7f47dc06ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e128c700 1 -- 172.21.15.44:0/3149895586 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085442766 0 0) 0x7f47dc15f550 con 0x7f47dc0adba0 2024-09-13T18:29:10.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e128c700 1 -- 172.21.15.44:0/3149895586 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47c80035d0 con 0x7f47dc0adba0 2024-09-13T18:29:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e128c700 1 -- 172.21.15.44:0/3149895586 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 772013333 0 0) 0x7f47c80035d0 con 0x7f47dc0adba0 2024-09-13T18:29:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e128c700 1 -- 172.21.15.44:0/3149895586 >> v2:172.21.15.99:3300/0 conn(0x7f47dc15ac40 msgr2=0x7f47dc06ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e128c700 1 --2- 172.21.15.44:0/3149895586 >> v2:172.21.15.99:3300/0 conn(0x7f47dc15ac40 0x7f47dc06ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e128c700 1 -- 172.21.15.44:0/3149895586 >> v1:172.21.15.99:6789/0 conn(0x7f47dc0ad710 legacy=0x7f47dc15e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e128c700 1 -- 172.21.15.44:0/3149895586 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47dc06a6f0 con 0x7f47dc0adba0 2024-09-13T18:29:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e128c700 1 -- 172.21.15.44:0/3149895586 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f47d8001670 con 0x7f47dc0adba0 2024-09-13T18:29:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e128c700 1 -- 172.21.15.44:0/3149895586 >> v1:172.21.15.44:6789/0 conn(0x7f47dc0adba0 legacy=0x7f47dc15ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e128c700 1 --2- 172.21.15.44:0/3149895586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c8003a20 0x7f47c8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e128c700 1 --2- 172.21.15.44:0/3149895586 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47c8004870 0x7f47c8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e128c700 1 --2- 172.21.15.44:0/3149895586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47c8005230 0x7f47c800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e128c700 1 -- 172.21.15.44:0/3149895586 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc0b31e0 con 0x7f47c8003a20 2024-09-13T18:29:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e128c700 1 -- 172.21.15.44:0/3149895586 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c800c180 con 0x7f47c8005230 2024-09-13T18:29:10.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e128c700 1 -- 172.21.15.44:0/3149895586 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c800c340 con 0x7f47c8004870 2024-09-13T18:29:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e228e700 1 --2- 172.21.15.44:0/3149895586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c8003a20 0x7f47c8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e2a8f700 1 --2- 172.21.15.44:0/3149895586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47c8005230 0x7f47c800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.433+0000 7f47e1a8d700 1 --2- 172.21.15.44:0/3149895586 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47c8004870 0x7f47c8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.437+0000 7f47e2a8f700 1 -- 172.21.15.44:0/3149895586 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47c8004870 msgr2=0x7f47c8004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.437+0000 7f47e2a8f700 1 --2- 172.21.15.44:0/3149895586 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47c8004870 0x7f47c8004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.437+0000 7f47e2a8f700 1 -- 172.21.15.44:0/3149895586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c8003a20 msgr2=0x7f47c8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.437+0000 7f47e2a8f700 1 --2- 172.21.15.44:0/3149895586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c8003a20 0x7f47c8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.437+0000 7f47e2a8f700 1 -- 172.21.15.44:0/3149895586 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c80035d0 con 0x7f47c8005230 2024-09-13T18:29:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.437+0000 7f47e228e700 1 --2- 172.21.15.44:0/3149895586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c8003a20 0x7f47c8003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.437+0000 7f47e2a8f700 1 -- 172.21.15.44:0/3149895586 reap_dead start 2024-09-13T18:29:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.437+0000 7f47e2a8f700 1 --2- 172.21.15.44:0/3149895586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47c8005230 0x7f47c800ba30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f47d800c2f0 tx=0x7f47c80058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d19de5fa6457116a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.437+0000 7f47e128c700 1 -- 172.21.15.44:0/3149895586 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d800ce30 con 0x7f47c8005230 2024-09-13T18:29:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.437+0000 7f47e128c700 1 -- 172.21.15.44:0/3149895586 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d8005980 con 0x7f47c8005230 2024-09-13T18:29:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.437+0000 7f47e128c700 1 -- 172.21.15.44:0/3149895586 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d8005d30 con 0x7f47c8005230 2024-09-13T18:29:10.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.437+0000 7f47e44f2700 1 -- 172.21.15.44:0/3149895586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47c8005230 msgr2=0x7f47c800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.437+0000 7f47e44f2700 1 --2- 172.21.15.44:0/3149895586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47c8005230 0x7f47c800ba30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f47d800c2f0 tx=0x7f47c80058a0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.437+0000 7f47e44f2700 1 -- 172.21.15.44:0/3149895586 shutdown_connections 2024-09-13T18:29:10.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.437+0000 7f47e44f2700 1 --2- 172.21.15.44:0/3149895586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47c8005230 0x7f47c800ba30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.437+0000 7f47e44f2700 1 -- 172.21.15.44:0/3149895586 >> 172.21.15.44:0/3149895586 conn(0x7f47dc0ce980 msgr2=0x7f47dc0ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:10.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.437+0000 7f47e44f2700 1 -- 172.21.15.44:0/3149895586 shutdown_connections 2024-09-13T18:29:10.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.437+0000 7f47e44f2700 1 -- 172.21.15.44:0/3149895586 wait complete. 2024-09-13T18:29:10.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.437+0000 7f47e44f2700 1 Processor -- start 2024-09-13T18:29:10.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.437+0000 7f47e44f2700 1 -- start start 2024-09-13T18:29:10.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47e44f2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c8005230 0x7f47dc141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47e44f2700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47dc144b80 0x7f47dc1eff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47e44f2700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47dc1554a0 0x7f47dc155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47e44f2700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc1420b0 con 0x7f47c8005230 2024-09-13T18:29:10.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47e44f2700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc1587c0 con 0x7f47dc1554a0 2024-09-13T18:29:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47e44f2700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc15da60 con 0x7f47dc144b80 2024-09-13T18:29:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47e228e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c8005230 0x7f47dc141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47e228e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c8005230 0x7f47dc141ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45632/0 (socket says 172.21.15.44:45632) 2024-09-13T18:29:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47e228e700 1 -- 172.21.15.44:0/1731222214 learned_addr learned my addr 172.21.15.44:0/1731222214 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47e2a8f700 1 --2- 172.21.15.44:0/1731222214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47dc1554a0 0x7f47dc155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47e1a8d700 1 --2- 172.21.15.44:0/1731222214 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47dc144b80 0x7f47dc1eff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47e228e700 1 -- 172.21.15.44:0/1731222214 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47dc144b80 msgr2=0x7f47dc1eff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47e228e700 1 --2- 172.21.15.44:0/1731222214 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47dc144b80 0x7f47dc1eff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47e228e700 1 -- 172.21.15.44:0/1731222214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47dc1554a0 msgr2=0x7f47dc155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47e228e700 1 --2- 172.21.15.44:0/1731222214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47dc1554a0 0x7f47dc155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47e228e700 1 -- 172.21.15.44:0/1731222214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47dc15dc70 con 0x7f47c8005230 2024-09-13T18:29:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47e1a8d700 1 --2- 172.21.15.44:0/1731222214 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47dc144b80 0x7f47dc1eff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:10.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47e228e700 1 --2- 172.21.15.44:0/1731222214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c8005230 0x7f47dc141ad0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f47d400f490 tx=0x7f47d400f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47d2ffd700 1 -- 172.21.15.44:0/1731222214 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d400e040 con 0x7f47c8005230 2024-09-13T18:29:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47d2ffd700 1 -- 172.21.15.44:0/1731222214 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d400f040 con 0x7f47c8005230 2024-09-13T18:29:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47d2ffd700 1 -- 172.21.15.44:0/1731222214 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4003c60 con 0x7f47c8005230 2024-09-13T18:29:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47e44f2700 1 -- 172.21.15.44:0/1731222214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47dc15df50 con 0x7f47c8005230 2024-09-13T18:29:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47e44f2700 1 -- 172.21.15.44:0/1731222214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47dc158370 con 0x7f47c8005230 2024-09-13T18:29:10.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.441+0000 7f47e44f2700 1 -- 172.21.15.44:0/1731222214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47dc06d950 con 0x7f47c8005230 2024-09-13T18:29:10.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.445+0000 7f47d2ffd700 1 -- 172.21.15.44:0/1731222214 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f47d4004020 con 0x7f47c8005230 2024-09-13T18:29:10.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.445+0000 7f47d2ffd700 1 --2- 172.21.15.44:0/1731222214 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f47c0066730 0x7f47c0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.445+0000 7f47d2ffd700 1 -- 172.21.15.44:0/1731222214 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47d4084b10 con 0x7f47c8005230 2024-09-13T18:29:10.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.445+0000 7f47e1a8d700 1 --2- 172.21.15.44:0/1731222214 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f47c0066730 0x7f47c0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.445+0000 7f47e1a8d700 1 --2- 172.21.15.44:0/1731222214 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f47c0066730 0x7f47c0068bf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f47dc14fe50 tx=0x7f47cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.453+0000 7f47d2ffd700 1 -- 172.21.15.44:0/1731222214 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f47d4051de0 con 0x7f47c8005230 2024-09-13T18:29:10.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.629+0000 7f47e44f2700 1 -- 172.21.15.44:0/1731222214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47dc0b1bd0 con 0x7f47c8005230 2024-09-13T18:29:10.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.629+0000 7f47d2ffd700 1 -- 172.21.15.44:0/1731222214 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16466 (secure 0 0 0) 0x7f47d4022020 con 0x7f47c8005230 2024-09-13T18:29:10.634 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:29:10.634 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":47,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:29:10.282821+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:29:08.754284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:29:09.262346+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:29:10.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.633+0000 7f47e44f2700 1 -- 172.21.15.44:0/1731222214 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f47c0066730 msgr2=0x7f47c0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.633+0000 7f47e44f2700 1 --2- 172.21.15.44:0/1731222214 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f47c0066730 0x7f47c0068bf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f47dc14fe50 tx=0x7f47cc009040 comp rx=0 tx=0).stop 2024-09-13T18:29:10.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.633+0000 7f47e44f2700 1 -- 172.21.15.44:0/1731222214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c8005230 msgr2=0x7f47dc141ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.633+0000 7f47e44f2700 1 --2- 172.21.15.44:0/1731222214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c8005230 0x7f47dc141ad0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f47d400f490 tx=0x7f47d400f7a0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.633+0000 7f47e44f2700 1 -- 172.21.15.44:0/1731222214 shutdown_connections 2024-09-13T18:29:10.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.633+0000 7f47e44f2700 1 --2- 172.21.15.44:0/1731222214 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f47c0066730 0x7f47c0068bf0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.633+0000 7f47e44f2700 1 --2- 172.21.15.44:0/1731222214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47dc1554a0 0x7f47dc155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.633+0000 7f47e44f2700 1 --2- 172.21.15.44:0/1731222214 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47dc144b80 0x7f47dc1eff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.633+0000 7f47e44f2700 1 --2- 172.21.15.44:0/1731222214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c8005230 0x7f47dc141ad0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.633+0000 7f47e44f2700 1 -- 172.21.15.44:0/1731222214 >> 172.21.15.44:0/1731222214 conn(0x7f47dc0ce980 msgr2=0x7f47dc06c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:10.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.633+0000 7f47e44f2700 1 -- 172.21.15.44:0/1731222214 shutdown_connections 2024-09-13T18:29:10.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.633+0000 7f47e44f2700 1 -- 172.21.15.44:0/1731222214 wait complete. 2024-09-13T18:29:10.650 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:29:10.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.757+0000 7f39ad1a5700 1 Processor -- start 2024-09-13T18:29:10.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.757+0000 7f39ad1a5700 1 -- start start 2024-09-13T18:29:10.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.757+0000 7f39ad1a5700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f39a8159720 0x7f39a806cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.757+0000 7f39ad1a5700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a806af00 con 0x7f39a80b3ae0 2024-09-13T18:29:10.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.757+0000 7f39ad1a5700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a806d690 con 0x7f39a806aa90 2024-09-13T18:29:10.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.757+0000 7f39ad1a5700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a80cbfe0 con 0x7f39a8159720 2024-09-13T18:29:10.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.757+0000 7f39ac9a4700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f39a80b3ae0 0x7f39a80ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56544/0 (socket says 172.21.15.44:56544) 2024-09-13T18:29:10.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.757+0000 7f39ac9a4700 1 -- 172.21.15.44:0/1902260516 learned_addr learned my addr 172.21.15.44:0/1902260516 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:29:10.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.757+0000 7f39a7fff700 1 --2- 172.21.15.44:0/1902260516 >> v2:172.21.15.99:3300/0 conn(0x7f39a8159720 0x7f39a806cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.757+0000 7f39a6ffd700 1 -- 172.21.15.44:0/1902260516 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002676415 0 0) 0x7f39a806af00 con 0x7f39a80b3ae0 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.757+0000 7f39a6ffd700 1 -- 172.21.15.44:0/1902260516 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39940035d0 con 0x7f39a80b3ae0 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.757+0000 7f39a6ffd700 1 -- 172.21.15.44:0/1902260516 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 495741999 0 0) 0x7f39940035d0 con 0x7f39a80b3ae0 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.757+0000 7f39a6ffd700 1 -- 172.21.15.44:0/1902260516 >> v2:172.21.15.99:3300/0 conn(0x7f39a8159720 msgr2=0x7f39a806cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.757+0000 7f39a6ffd700 1 --2- 172.21.15.44:0/1902260516 >> v2:172.21.15.99:3300/0 conn(0x7f39a8159720 0x7f39a806cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.757+0000 7f39a6ffd700 1 -- 172.21.15.44:0/1902260516 >> v1:172.21.15.99:6789/0 conn(0x7f39a806aa90 legacy=0x7f39a80b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.757+0000 7f39a6ffd700 1 -- 172.21.15.44:0/1902260516 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a80cc2c0 con 0x7f39a80b3ae0 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.757+0000 7f39a6ffd700 1 -- 172.21.15.44:0/1902260516 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f39a00019f0 con 0x7f39a80b3ae0 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.757+0000 7f39a6ffd700 1 -- 172.21.15.44:0/1902260516 >> v1:172.21.15.44:6789/0 conn(0x7f39a80b3ae0 legacy=0x7f39a80ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.757+0000 7f39a6ffd700 1 --2- 172.21.15.44:0/1902260516 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3994003a20 0x7f3994003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39a6ffd700 1 --2- 172.21.15.44:0/1902260516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3994004420 0x7f39940048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39a6ffd700 1 --2- 172.21.15.44:0/1902260516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3994005190 0x7f399400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39a6ffd700 1 -- 172.21.15.44:0/1902260516 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a80cbfe0 con 0x7f3994005190 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39a6ffd700 1 -- 172.21.15.44:0/1902260516 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399400c0d0 con 0x7f3994004420 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39a6ffd700 1 -- 172.21.15.44:0/1902260516 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399400c290 con 0x7f3994003a20 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39ac9a4700 1 --2- 172.21.15.44:0/1902260516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3994005190 0x7f399400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39a7fff700 1 --2- 172.21.15.44:0/1902260516 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3994003a20 0x7f3994003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39a77fe700 1 --2- 172.21.15.44:0/1902260516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3994004420 0x7f39940048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39ac9a4700 1 -- 172.21.15.44:0/1902260516 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3994003a20 msgr2=0x7f3994003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39ac9a4700 1 --2- 172.21.15.44:0/1902260516 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3994003a20 0x7f3994003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39ac9a4700 1 -- 172.21.15.44:0/1902260516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3994004420 msgr2=0x7f39940048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39ac9a4700 1 --2- 172.21.15.44:0/1902260516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3994004420 0x7f39940048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39ac9a4700 1 -- 172.21.15.44:0/1902260516 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39940035d0 con 0x7f3994005190 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39ac9a4700 1 -- 172.21.15.44:0/1902260516 reap_dead start 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39ac9a4700 1 --2- 172.21.15.44:0/1902260516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3994005190 0x7f399400ba30 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f39a000a830 tx=0x7f39940058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21d6736885483bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39a6ffd700 1 -- 172.21.15.44:0/1902260516 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a00072d0 con 0x7f3994005190 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39a6ffd700 1 -- 172.21.15.44:0/1902260516 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a000ae90 con 0x7f3994005190 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39a6ffd700 1 -- 172.21.15.44:0/1902260516 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0007650 con 0x7f3994005190 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39ad1a5700 1 -- 172.21.15.44:0/1902260516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3994005190 msgr2=0x7f399400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39ad1a5700 1 --2- 172.21.15.44:0/1902260516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3994005190 0x7f399400ba30 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f39a000a830 tx=0x7f39940058a0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39ad1a5700 1 -- 172.21.15.44:0/1902260516 shutdown_connections 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39ad1a5700 1 --2- 172.21.15.44:0/1902260516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3994005190 0x7f399400ba30 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39ad1a5700 1 -- 172.21.15.44:0/1902260516 >> 172.21.15.44:0/1902260516 conn(0x7f39a80b0f00 msgr2=0x7f39a80b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39ad1a5700 1 -- 172.21.15.44:0/1902260516 shutdown_connections 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.761+0000 7f39ad1a5700 1 -- 172.21.15.44:0/1902260516 wait complete. 2024-09-13T18:29:10.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.765+0000 7f39ad1a5700 1 Processor -- start 2024-09-13T18:29:10.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.765+0000 7f39ad1a5700 1 -- start start 2024-09-13T18:29:10.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.765+0000 7f39ad1a5700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3994005190 0x7f39a81472e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.765+0000 7f39ad1a5700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39a815c0f0 0x7f39a815c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.765+0000 7f39ad1a5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39a80af750 0x7f39a80afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.765+0000 7f39ad1a5700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a8147820 con 0x7f39a80af750 2024-09-13T18:29:10.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.765+0000 7f39ad1a5700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a80b0140 con 0x7f39a815c0f0 2024-09-13T18:29:10.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.765+0000 7f39ad1a5700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a815cab0 con 0x7f3994005190 2024-09-13T18:29:10.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.765+0000 7f39ac9a4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39a80af750 0x7f39a80afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.765+0000 7f39ac9a4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39a80af750 0x7f39a80afc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45656/0 (socket says 172.21.15.44:45656) 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.765+0000 7f39ac9a4700 1 -- 172.21.15.44:0/1148940134 learned_addr learned my addr 172.21.15.44:0/1148940134 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.765+0000 7f39a7fff700 1 --2- 172.21.15.44:0/1148940134 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3994005190 0x7f39a81472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.765+0000 7f39a77fe700 1 --2- 172.21.15.44:0/1148940134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39a815c0f0 0x7f39a815c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.765+0000 7f39ac9a4700 1 -- 172.21.15.44:0/1148940134 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3994005190 msgr2=0x7f39a81472e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.765+0000 7f39ac9a4700 1 --2- 172.21.15.44:0/1148940134 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3994005190 0x7f39a81472e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.765+0000 7f39ac9a4700 1 -- 172.21.15.44:0/1148940134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39a815c0f0 msgr2=0x7f39a815c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.765+0000 7f39ac9a4700 1 --2- 172.21.15.44:0/1148940134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39a815c0f0 0x7f39a815c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.765+0000 7f39ac9a4700 1 -- 172.21.15.44:0/1148940134 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a8147a10 con 0x7f39a80af750 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.769+0000 7f39ac9a4700 1 --2- 172.21.15.44:0/1148940134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39a80af750 0x7f39a80afc00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f39a806e000 tx=0x7f39a0001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.769+0000 7f39a4ff9700 1 -- 172.21.15.44:0/1148940134 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0024030 con 0x7f39a80af750 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.769+0000 7f39a4ff9700 1 -- 172.21.15.44:0/1148940134 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a00019d0 con 0x7f39a80af750 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.769+0000 7f39ad1a5700 1 -- 172.21.15.44:0/1148940134 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a8153c90 con 0x7f39a80af750 2024-09-13T18:29:10.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.769+0000 7f39a4ff9700 1 -- 172.21.15.44:0/1148940134 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a001f670 con 0x7f39a80af750 2024-09-13T18:29:10.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.769+0000 7f39ad1a5700 1 -- 172.21.15.44:0/1148940134 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a8147f60 con 0x7f39a80af750 2024-09-13T18:29:10.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.769+0000 7f39ad1a5700 1 -- 172.21.15.44:0/1148940134 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a80b33d0 con 0x7f39a80af750 2024-09-13T18:29:10.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.769+0000 7f39a4ff9700 1 -- 172.21.15.44:0/1148940134 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f39a0027070 con 0x7f39a80af750 2024-09-13T18:29:10.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.769+0000 7f39a4ff9700 1 --2- 172.21.15.44:0/1148940134 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3988066760 0x7f3988068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.769+0000 7f39a4ff9700 1 -- 172.21.15.44:0/1148940134 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39a0025070 con 0x7f39a80af750 2024-09-13T18:29:10.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.769+0000 7f39a7fff700 1 --2- 172.21.15.44:0/1148940134 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3988066760 0x7f3988068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.773+0000 7f39a7fff700 1 --2- 172.21.15.44:0/1148940134 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3988066760 0x7f3988068c20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3990009bf0 tx=0x7f3990009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:10.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.777+0000 7f39a4ff9700 1 -- 172.21.15.44:0/1148940134 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f39a0053170 con 0x7f39a80af750 2024-09-13T18:29:10.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.949+0000 7f39ad1a5700 1 -- 172.21.15.44:0/1148940134 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39a80cb550 con 0x7f39a80af750 2024-09-13T18:29:10.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.953+0000 7f39a4ff9700 1 -- 172.21.15.44:0/1148940134 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16466 (secure 0 0 0) 0x7f39a0018090 con 0x7f39a80af750 2024-09-13T18:29:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:29:10.957 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":47,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:29:10.282821+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:29:08.754284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:29:09.262346+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:29:10.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.957+0000 7f39ad1a5700 1 -- 172.21.15.44:0/1148940134 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3988066760 msgr2=0x7f3988068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.957+0000 7f39ad1a5700 1 --2- 172.21.15.44:0/1148940134 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3988066760 0x7f3988068c20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3990009bf0 tx=0x7f3990009240 comp rx=0 tx=0).stop 2024-09-13T18:29:10.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.957+0000 7f39ad1a5700 1 -- 172.21.15.44:0/1148940134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39a80af750 msgr2=0x7f39a80afc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.957+0000 7f39ad1a5700 1 --2- 172.21.15.44:0/1148940134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39a80af750 0x7f39a80afc00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f39a806e000 tx=0x7f39a0001d80 comp rx=0 tx=0).stop 2024-09-13T18:29:10.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.957+0000 7f39ad1a5700 1 -- 172.21.15.44:0/1148940134 shutdown_connections 2024-09-13T18:29:10.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.957+0000 7f39ad1a5700 1 --2- 172.21.15.44:0/1148940134 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3988066760 0x7f3988068c20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.957+0000 7f39ad1a5700 1 --2- 172.21.15.44:0/1148940134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39a80af750 0x7f39a80afc00 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.957+0000 7f39ad1a5700 1 --2- 172.21.15.44:0/1148940134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39a815c0f0 0x7f39a815c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.957+0000 7f39ad1a5700 1 --2- 172.21.15.44:0/1148940134 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3994005190 0x7f39a81472e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.957+0000 7f39ad1a5700 1 -- 172.21.15.44:0/1148940134 >> 172.21.15.44:0/1148940134 conn(0x7f39a80b0f00 msgr2=0x7f39a80b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:10.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.957+0000 7f39ad1a5700 1 -- 172.21.15.44:0/1148940134 shutdown_connections 2024-09-13T18:29:10.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:10.957+0000 7f39ad1a5700 1 -- 172.21.15.44:0/1148940134 wait complete. 2024-09-13T18:29:10.972 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:29:11.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.088+0000 7fa3d1c2b700 1 Processor -- start 2024-09-13T18:29:11.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.088+0000 7fa3d1c2b700 1 -- start start 2024-09-13T18:29:11.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.088+0000 7fa3d1c2b700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa3cc146160 0x7fa3cc0cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:11.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.088+0000 7fa3d1c2b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa3cc0ad980 0x7fa3cc070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:11.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.088+0000 7fa3d1c2b700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3cc0ae000 con 0x7fa3cc0ce130 2024-09-13T18:29:11.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.088+0000 7fa3d1c2b700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3cc0cc820 con 0x7fa3cc0ad980 2024-09-13T18:29:11.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.092+0000 7fa3d1c2b700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3cc070070 con 0x7fa3cc146160 2024-09-13T18:29:11.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.092+0000 7fa3d142a700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa3cc0ad980 0x7fa3cc070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:11.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.092+0000 7fa3d142a700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa3cc0ad980 0x7fa3cc070b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45672/0 (socket says 172.21.15.44:45672) 2024-09-13T18:29:11.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.092+0000 7fa3d142a700 1 -- 172.21.15.44:0/1458686831 learned_addr learned my addr 172.21.15.44:0/1458686831 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:11.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.092+0000 7fa3d0c29700 1 --2- 172.21.15.44:0/1458686831 >> v2:172.21.15.99:3300/0 conn(0x7fa3cc146160 0x7fa3cc0cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:11.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.092+0000 7fa3d142a700 1 -- 172.21.15.44:0/1458686831 >> v2:172.21.15.99:3300/0 conn(0x7fa3cc146160 msgr2=0x7fa3cc0cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:11.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.092+0000 7fa3d142a700 1 --2- 172.21.15.44:0/1458686831 >> v2:172.21.15.99:3300/0 conn(0x7fa3cc146160 0x7fa3cc0cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:11.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.092+0000 7fa3d142a700 1 -- 172.21.15.44:0/1458686831 >> v1:172.21.15.99:6789/0 conn(0x7fa3cc0ce130 legacy=0x7fa3cc0ad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:11.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.092+0000 7fa3d142a700 1 -- 172.21.15.44:0/1458686831 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc070350 con 0x7fa3cc0ad980 2024-09-13T18:29:11.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.092+0000 7fa3d142a700 1 --2- 172.21.15.44:0/1458686831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3cc0ad980 0x7fa3cc070b50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc0b3bf0 tx=0x7fa3c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c6dd246ea5a82ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:11.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.092+0000 7fa3cb7fe700 1 -- 172.21.15.44:0/1458686831 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c400e070 con 0x7fa3cc0ad980 2024-09-13T18:29:11.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.092+0000 7fa3cb7fe700 1 -- 172.21.15.44:0/1458686831 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c400b9c0 con 0x7fa3cc0ad980 2024-09-13T18:29:11.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.092+0000 7fa3cb7fe700 1 -- 172.21.15.44:0/1458686831 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c400bd70 con 0x7fa3cc0ad980 2024-09-13T18:29:11.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.092+0000 7fa3d1c2b700 1 -- 172.21.15.44:0/1458686831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3cc0ad980 msgr2=0x7fa3cc070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:11.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.092+0000 7fa3d1c2b700 1 --2- 172.21.15.44:0/1458686831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3cc0ad980 0x7fa3cc070b50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc0b3bf0 tx=0x7fa3c400b330 comp rx=0 tx=0).stop 2024-09-13T18:29:11.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.092+0000 7fa3d1c2b700 1 -- 172.21.15.44:0/1458686831 shutdown_connections 2024-09-13T18:29:11.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.092+0000 7fa3d1c2b700 1 --2- 172.21.15.44:0/1458686831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3cc0ad980 0x7fa3cc070b50 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:11.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.092+0000 7fa3d1c2b700 1 --2- 172.21.15.44:0/1458686831 >> v2:172.21.15.99:3300/0 conn(0x7fa3cc146160 0x7fa3cc0cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:11.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.092+0000 7fa3d1c2b700 1 -- 172.21.15.44:0/1458686831 >> 172.21.15.44:0/1458686831 conn(0x7fa3cc0b0e10 msgr2=0x7fa3cc0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:11.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.092+0000 7fa3d1c2b700 1 -- 172.21.15.44:0/1458686831 shutdown_connections 2024-09-13T18:29:11.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.092+0000 7fa3d1c2b700 1 -- 172.21.15.44:0/1458686831 wait complete. 2024-09-13T18:29:11.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3d1c2b700 1 Processor -- start 2024-09-13T18:29:11.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3d1c2b700 1 -- start start 2024-09-13T18:29:11.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3d1c2b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa3cc0ad980 0x7fa3cc15c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:11.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3d1c2b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3cc0ce130 0x7fa3cc13c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:11.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3d1c2b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3cc146160 0x7fa3cc13d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:11.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3d1c2b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc13f110 con 0x7fa3cc146160 2024-09-13T18:29:11.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3d1c2b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc141bd0 con 0x7fa3cc0ce130 2024-09-13T18:29:11.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3d1c2b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc15d130 con 0x7fa3cc0ad980 2024-09-13T18:29:11.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3d142a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3cc146160 0x7fa3cc13d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:11.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3d142a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3cc146160 0x7fa3cc13d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45684/0 (socket says 172.21.15.44:45684) 2024-09-13T18:29:11.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3d142a700 1 -- 172.21.15.44:0/3500762844 learned_addr learned my addr 172.21.15.44:0/3500762844 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:11.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3cbfff700 1 --2- 172.21.15.44:0/3500762844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3cc0ce130 0x7fa3cc13c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:11.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3d0c29700 1 --2- 172.21.15.44:0/3500762844 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa3cc0ad980 0x7fa3cc15c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:11.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3d142a700 1 -- 172.21.15.44:0/3500762844 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa3cc0ad980 msgr2=0x7fa3cc15c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:11.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3d142a700 1 --2- 172.21.15.44:0/3500762844 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa3cc0ad980 0x7fa3cc15c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:11.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3d142a700 1 -- 172.21.15.44:0/3500762844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3cc0ce130 msgr2=0x7fa3cc13c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:11.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3d142a700 1 --2- 172.21.15.44:0/3500762844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3cc0ce130 0x7fa3cc13c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:11.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3d142a700 1 -- 172.21.15.44:0/3500762844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c4009b30 con 0x7fa3cc146160 2024-09-13T18:29:11.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3cbfff700 1 --2- 172.21.15.44:0/3500762844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3cc0ce130 0x7fa3cc13c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:11.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3d142a700 1 --2- 172.21.15.44:0/3500762844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3cc146160 0x7fa3cc13d8a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa3c400b370 tx=0x7fa3c4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:11.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3c97fa700 1 -- 172.21.15.44:0/3500762844 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c40099b0 con 0x7fa3cc146160 2024-09-13T18:29:11.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3c97fa700 1 -- 172.21.15.44:0/3500762844 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c40092e0 con 0x7fa3cc146160 2024-09-13T18:29:11.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3d1c2b700 1 -- 172.21.15.44:0/3500762844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3cc13ea70 con 0x7fa3cc146160 2024-09-13T18:29:11.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3c97fa700 1 -- 172.21.15.44:0/3500762844 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c401c640 con 0x7fa3cc146160 2024-09-13T18:29:11.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3d1c2b700 1 -- 172.21.15.44:0/3500762844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3cc13cd10 con 0x7fa3cc146160 2024-09-13T18:29:11.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.096+0000 7fa3d1c2b700 1 -- 172.21.15.44:0/3500762844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3cc13f250 con 0x7fa3cc146160 2024-09-13T18:29:11.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.100+0000 7fa3c97fa700 1 -- 172.21.15.44:0/3500762844 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa3c401c7a0 con 0x7fa3cc146160 2024-09-13T18:29:11.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.100+0000 7fa3c97fa700 1 --2- 172.21.15.44:0/3500762844 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa3b0066730 0x7fa3b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:11.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.100+0000 7fa3c97fa700 1 -- 172.21.15.44:0/3500762844 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3c4085b50 con 0x7fa3cc146160 2024-09-13T18:29:11.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.100+0000 7fa3d0c29700 1 --2- 172.21.15.44:0/3500762844 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa3b0066730 0x7fa3b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:11.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.100+0000 7fa3d0c29700 1 --2- 172.21.15.44:0/3500762844 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa3b0066730 0x7fa3b0068bf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000b9d0 tx=0x7fa3c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:11.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.112+0000 7fa3c97fa700 1 -- 172.21.15.44:0/3500762844 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa3cc13f250 con 0x7fa3cc146160 2024-09-13T18:29:11.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:11.320+0000 7fa3d1c2b700 1 -- 172.21.15.44:0/3500762844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa3cc13f250 con 0x7fa3cc146160 2024-09-13T18:29:11.889 INFO:tasks.ceph.mds.c.smithi044.stderr:2024-09-13T18:29:11.884+0000 7f09fd002700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:29:12.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.308+0000 7fa3c97fa700 1 -- 172.21.15.44:0/3500762844 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v30) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa3cc13f250 con 0x7fa3cc146160 2024-09-13T18:29:12.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.316+0000 7fa3d1c2b700 1 -- 172.21.15.44:0/3500762844 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa3b0066730 msgr2=0x7fa3b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.316+0000 7fa3d1c2b700 1 --2- 172.21.15.44:0/3500762844 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa3b0066730 0x7fa3b0068bf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000b9d0 tx=0x7fa3c0008040 comp rx=0 tx=0).stop 2024-09-13T18:29:12.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.316+0000 7fa3d1c2b700 1 -- 172.21.15.44:0/3500762844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3cc146160 msgr2=0x7fa3cc13d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.316+0000 7fa3d1c2b700 1 --2- 172.21.15.44:0/3500762844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3cc146160 0x7fa3cc13d8a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa3c400b370 tx=0x7fa3c4004af0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.316+0000 7fa3d1c2b700 1 -- 172.21.15.44:0/3500762844 shutdown_connections 2024-09-13T18:29:12.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.316+0000 7fa3d1c2b700 1 --2- 172.21.15.44:0/3500762844 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa3b0066730 0x7fa3b0068bf0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.316+0000 7fa3d1c2b700 1 --2- 172.21.15.44:0/3500762844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3cc146160 0x7fa3cc13d8a0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.316+0000 7fa3d1c2b700 1 --2- 172.21.15.44:0/3500762844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3cc0ce130 0x7fa3cc13c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.316+0000 7fa3d1c2b700 1 --2- 172.21.15.44:0/3500762844 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa3cc0ad980 0x7fa3cc15c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.316+0000 7fa3d1c2b700 1 -- 172.21.15.44:0/3500762844 >> 172.21.15.44:0/3500762844 conn(0x7fa3cc0b0e10 msgr2=0x7fa3cc06a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:12.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.316+0000 7fa3d1c2b700 1 -- 172.21.15.44:0/3500762844 shutdown_connections 2024-09-13T18:29:12.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.316+0000 7fa3d1c2b700 1 -- 172.21.15.44:0/3500762844 wait complete. 2024-09-13T18:29:12.336 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:29:12.337 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:29:12.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.460+0000 7fc343fff700 1 Processor -- start 2024-09-13T18:29:12.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.460+0000 7fc343fff700 1 -- start start 2024-09-13T18:29:12.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.460+0000 7fc343fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc34415cda0 0x7fc34406b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.460+0000 7fc343fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc3440ceb70 0x7fc3440b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.460+0000 7fc343fff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3440b8430 con 0x7fc34406a520 2024-09-13T18:29:12.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.460+0000 7fc343fff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34406be40 con 0x7fc3440ceb70 2024-09-13T18:29:12.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.460+0000 7fc343fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3440cf350 con 0x7fc34415cda0 2024-09-13T18:29:12.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.460+0000 7fc3427fc700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc3440ceb70 0x7fc3440b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.460+0000 7fc3437fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc34406a520 0x7fc3440d1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60352/0 (socket says 172.21.15.44:60352) 2024-09-13T18:29:12.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.460+0000 7fc3427fc700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc3440ceb70 0x7fc3440b5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55732/0 (socket says 172.21.15.44:55732) 2024-09-13T18:29:12.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.460+0000 7fc3437fe700 1 -- 172.21.15.44:0/1397002859 learned_addr learned my addr 172.21.15.44:0/1397002859 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:29:12.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.464+0000 7fc342ffd700 1 --2- 172.21.15.44:0/1397002859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc34415cda0 0x7fc34406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.464+0000 7fc3427fc700 1 -- 172.21.15.44:0/1397002859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc34415cda0 msgr2=0x7fc34406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:12.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.464+0000 7fc3427fc700 1 --2- 172.21.15.44:0/1397002859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc34415cda0 0x7fc34406b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.464+0000 7fc3427fc700 1 -- 172.21.15.44:0/1397002859 >> v1:172.21.15.44:6789/0 conn(0x7fc34406a520 legacy=0x7fc3440d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:12.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.464+0000 7fc3427fc700 1 -- 172.21.15.44:0/1397002859 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3440d0880 con 0x7fc3440ceb70 2024-09-13T18:29:12.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.464+0000 7fc3427fc700 1 --2- 172.21.15.44:0/1397002859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3440ceb70 0x7fc3440b5de0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009850 tx=0x7fc32c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9346b4d7c0fd310d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:12.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.464+0000 7fc341ffb700 1 -- 172.21.15.44:0/1397002859 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c011830 con 0x7fc3440ceb70 2024-09-13T18:29:12.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.464+0000 7fc341ffb700 1 -- 172.21.15.44:0/1397002859 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32c011990 con 0x7fc3440ceb70 2024-09-13T18:29:12.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.464+0000 7fc341ffb700 1 -- 172.21.15.44:0/1397002859 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c011d20 con 0x7fc3440ceb70 2024-09-13T18:29:12.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.464+0000 7fc343fff700 1 -- 172.21.15.44:0/1397002859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3440ceb70 msgr2=0x7fc3440b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.464+0000 7fc343fff700 1 --2- 172.21.15.44:0/1397002859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3440ceb70 0x7fc3440b5de0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009850 tx=0x7fc32c009b60 comp rx=0 tx=0).stop 2024-09-13T18:29:12.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.464+0000 7fc343fff700 1 -- 172.21.15.44:0/1397002859 shutdown_connections 2024-09-13T18:29:12.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.464+0000 7fc343fff700 1 --2- 172.21.15.44:0/1397002859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3440ceb70 0x7fc3440b5de0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.464+0000 7fc343fff700 1 --2- 172.21.15.44:0/1397002859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc34415cda0 0x7fc34406b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.464+0000 7fc343fff700 1 -- 172.21.15.44:0/1397002859 >> 172.21.15.44:0/1397002859 conn(0x7fc3440d2cb0 msgr2=0x7fc3440d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:12.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.464+0000 7fc343fff700 1 -- 172.21.15.44:0/1397002859 shutdown_connections 2024-09-13T18:29:12.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.464+0000 7fc343fff700 1 -- 172.21.15.44:0/1397002859 wait complete. 2024-09-13T18:29:12.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc343fff700 1 Processor -- start 2024-09-13T18:29:12.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc343fff700 1 -- start start 2024-09-13T18:29:12.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc343fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc34406a520 0x7fc3440cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc343fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3440ceb70 0x7fc3440c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc343fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc34415cda0 0x7fc3440c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc343fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3440c8790 con 0x7fc3440ceb70 2024-09-13T18:29:12.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc343fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3440c7830 con 0x7fc34415cda0 2024-09-13T18:29:12.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc343fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3441f5fe0 con 0x7fc34406a520 2024-09-13T18:29:12.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc3427fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3440ceb70 0x7fc3440c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc3427fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3440ceb70 0x7fc3440c7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55748/0 (socket says 172.21.15.44:55748) 2024-09-13T18:29:12.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc3427fc700 1 -- 172.21.15.44:0/1489430768 learned_addr learned my addr 172.21.15.44:0/1489430768 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:12.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc342ffd700 1 --2- 172.21.15.44:0/1489430768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc34406a520 0x7fc3440cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc3437fe700 1 --2- 172.21.15.44:0/1489430768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc34415cda0 0x7fc3440c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc3427fc700 1 -- 172.21.15.44:0/1489430768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc34406a520 msgr2=0x7fc3440cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc3427fc700 1 --2- 172.21.15.44:0/1489430768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc34406a520 0x7fc3440cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc3427fc700 1 -- 172.21.15.44:0/1489430768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc34415cda0 msgr2=0x7fc3440c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc3427fc700 1 --2- 172.21.15.44:0/1489430768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc34415cda0 0x7fc3440c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc3427fc700 1 -- 172.21.15.44:0/1489430768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32c0094b0 con 0x7fc3440ceb70 2024-09-13T18:29:12.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc3437fe700 1 --2- 172.21.15.44:0/1489430768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc34415cda0 0x7fc3440c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:12.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc3427fc700 1 --2- 172.21.15.44:0/1489430768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3440ceb70 0x7fc3440c7d10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc32c000c00 tx=0x7fc32c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:12.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc33b7fe700 1 -- 172.21.15.44:0/1489430768 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c004480 con 0x7fc3440ceb70 2024-09-13T18:29:12.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc33b7fe700 1 -- 172.21.15.44:0/1489430768 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32c01f070 con 0x7fc3440ceb70 2024-09-13T18:29:12.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc343fff700 1 -- 172.21.15.44:0/1489430768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3441f62c0 con 0x7fc3440ceb70 2024-09-13T18:29:12.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc33b7fe700 1 -- 172.21.15.44:0/1489430768 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c003900 con 0x7fc3440ceb70 2024-09-13T18:29:12.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.468+0000 7fc343fff700 1 -- 172.21.15.44:0/1489430768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3441f6880 con 0x7fc3440ceb70 2024-09-13T18:29:12.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.472+0000 7fc33b7fe700 1 -- 172.21.15.44:0/1489430768 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc32c021030 con 0x7fc3440ceb70 2024-09-13T18:29:12.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.472+0000 7fc343fff700 1 -- 172.21.15.44:0/1489430768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3440c79d0 con 0x7fc3440ceb70 2024-09-13T18:29:12.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.472+0000 7fc33b7fe700 1 --2- 172.21.15.44:0/1489430768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc324066730 0x7fc324068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.472+0000 7fc33b7fe700 1 -- 172.21.15.44:0/1489430768 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc32c085510 con 0x7fc3440ceb70 2024-09-13T18:29:12.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.472+0000 7fc342ffd700 1 --2- 172.21.15.44:0/1489430768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc324066730 0x7fc324068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.472+0000 7fc342ffd700 1 --2- 172.21.15.44:0/1489430768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc324066730 0x7fc324068bf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc344160660 tx=0x7fc334008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:12.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.480+0000 7fc33b7fe700 1 -- 172.21.15.44:0/1489430768 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc32c052910 con 0x7fc3440ceb70 2024-09-13T18:29:12.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:12.688+0000 7fc343fff700 1 -- 172.21.15.44:0/1489430768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc34406b900 con 0x7fc3440ceb70 2024-09-13T18:29:13.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.312+0000 7fc33b7fe700 1 -- 172.21.15.44:0/1489430768 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc32c083e60 con 0x7fc3440ceb70 2024-09-13T18:29:13.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.316+0000 7fc343fff700 1 -- 172.21.15.44:0/1489430768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc324066730 msgr2=0x7fc324068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.316+0000 7fc343fff700 1 --2- 172.21.15.44:0/1489430768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc324066730 0x7fc324068bf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc344160660 tx=0x7fc334008040 comp rx=0 tx=0).stop 2024-09-13T18:29:13.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.316+0000 7fc343fff700 1 -- 172.21.15.44:0/1489430768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3440ceb70 msgr2=0x7fc3440c7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.316+0000 7fc343fff700 1 --2- 172.21.15.44:0/1489430768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3440ceb70 0x7fc3440c7d10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc32c000c00 tx=0x7fc32c004770 comp rx=0 tx=0).stop 2024-09-13T18:29:13.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.316+0000 7fc343fff700 1 -- 172.21.15.44:0/1489430768 shutdown_connections 2024-09-13T18:29:13.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.316+0000 7fc343fff700 1 --2- 172.21.15.44:0/1489430768 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc324066730 0x7fc324068bf0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.316+0000 7fc343fff700 1 --2- 172.21.15.44:0/1489430768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc34415cda0 0x7fc3440c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.316+0000 7fc343fff700 1 --2- 172.21.15.44:0/1489430768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3440ceb70 0x7fc3440c7d10 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.316+0000 7fc343fff700 1 --2- 172.21.15.44:0/1489430768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc34406a520 0x7fc3440cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.316+0000 7fc343fff700 1 -- 172.21.15.44:0/1489430768 >> 172.21.15.44:0/1489430768 conn(0x7fc3440d2cb0 msgr2=0x7fc34415be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:13.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.316+0000 7fc343fff700 1 -- 172.21.15.44:0/1489430768 shutdown_connections 2024-09-13T18:29:13.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.316+0000 7fc343fff700 1 -- 172.21.15.44:0/1489430768 wait complete. 2024-09-13T18:29:13.342 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:29:13.343 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:29:13.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.464+0000 7fef33b6e700 1 Processor -- start 2024-09-13T18:29:13.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.464+0000 7fef33b6e700 1 -- start start 2024-09-13T18:29:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.464+0000 7fef33b6e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fef2c15b890 0x7fef2c162220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.464+0000 7fef33b6e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fef2c0b2b00 0x7fef2c06ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.464+0000 7fef33b6e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef2c162760 con 0x7fef2c0cdcc0 2024-09-13T18:29:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.464+0000 7fef33b6e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef2c15bc70 con 0x7fef2c0b2b00 2024-09-13T18:29:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.464+0000 7fef33b6e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef2c0ccc20 con 0x7fef2c15b890 2024-09-13T18:29:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.464+0000 7fef31109700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fef2c0cdcc0 0x7fef2c0b23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60368/0 (socket says 172.21.15.44:60368) 2024-09-13T18:29:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.464+0000 7fef31109700 1 -- 172.21.15.44:0/1735845605 learned_addr learned my addr 172.21.15.44:0/1735845605 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:29:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.464+0000 7fef3210b700 1 --2- 172.21.15.44:0/1735845605 >> v2:172.21.15.44:3300/0 conn(0x7fef2c0b2b00 0x7fef2c06ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.464+0000 7fef3190a700 1 --2- 172.21.15.44:0/1735845605 >> v2:172.21.15.99:3300/0 conn(0x7fef2c15b890 0x7fef2c162220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.464+0000 7fef30908700 1 -- 172.21.15.44:0/1735845605 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104559166 0 0) 0x7fef2c162760 con 0x7fef2c0cdcc0 2024-09-13T18:29:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.464+0000 7fef30908700 1 -- 172.21.15.44:0/1735845605 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef180035d0 con 0x7fef2c0cdcc0 2024-09-13T18:29:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.464+0000 7fef3210b700 1 -- 172.21.15.44:0/1735845605 >> v2:172.21.15.99:3300/0 conn(0x7fef2c15b890 msgr2=0x7fef2c162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.464+0000 7fef3210b700 1 --2- 172.21.15.44:0/1735845605 >> v2:172.21.15.99:3300/0 conn(0x7fef2c15b890 0x7fef2c162220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.464+0000 7fef3210b700 1 -- 172.21.15.44:0/1735845605 >> v1:172.21.15.44:6789/0 conn(0x7fef2c0cdcc0 legacy=0x7fef2c0b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.464+0000 7fef3210b700 1 -- 172.21.15.44:0/1735845605 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2c0ccf00 con 0x7fef2c0b2b00 2024-09-13T18:29:13.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.464+0000 7fef3210b700 1 --2- 172.21.15.44:0/1735845605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef2c0b2b00 0x7fef2c06ffe0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0b1750 tx=0x7fef2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1118cd31a22bf7ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:13.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.464+0000 7fef30908700 1 -- 172.21.15.44:0/1735845605 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2400e070 con 0x7fef2c0b2b00 2024-09-13T18:29:13.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.464+0000 7fef30908700 1 -- 172.21.15.44:0/1735845605 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2400bb20 con 0x7fef2c0b2b00 2024-09-13T18:29:13.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.464+0000 7fef30908700 1 -- 172.21.15.44:0/1735845605 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2400be90 con 0x7fef2c0b2b00 2024-09-13T18:29:13.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.468+0000 7fef33b6e700 1 -- 172.21.15.44:0/1735845605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef2c0b2b00 msgr2=0x7fef2c06ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.468+0000 7fef33b6e700 1 --2- 172.21.15.44:0/1735845605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef2c0b2b00 0x7fef2c06ffe0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0b1750 tx=0x7fef2400b330 comp rx=0 tx=0).stop 2024-09-13T18:29:13.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.468+0000 7fef33b6e700 1 -- 172.21.15.44:0/1735845605 shutdown_connections 2024-09-13T18:29:13.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.468+0000 7fef33b6e700 1 --2- 172.21.15.44:0/1735845605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef2c0b2b00 0x7fef2c06ffe0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.468+0000 7fef33b6e700 1 --2- 172.21.15.44:0/1735845605 >> v2:172.21.15.99:3300/0 conn(0x7fef2c15b890 0x7fef2c162220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.468+0000 7fef33b6e700 1 -- 172.21.15.44:0/1735845605 >> 172.21.15.44:0/1735845605 conn(0x7fef2c0ce980 msgr2=0x7fef2c0ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:13.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.468+0000 7fef33b6e700 1 -- 172.21.15.44:0/1735845605 shutdown_connections 2024-09-13T18:29:13.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.468+0000 7fef33b6e700 1 -- 172.21.15.44:0/1735845605 wait complete. 2024-09-13T18:29:13.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.468+0000 7fef33b6e700 1 Processor -- start 2024-09-13T18:29:13.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.468+0000 7fef33b6e700 1 -- start start 2024-09-13T18:29:13.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.468+0000 7fef33b6e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef2c0b2b00 0x7fef2c15e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef33b6e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef2c0cdcc0 0x7fef2c1f6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef33b6e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef2c15b890 0x7fef2c160510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef33b6e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c06b670 con 0x7fef2c0b2b00 2024-09-13T18:29:13.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef33b6e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c15a9c0 con 0x7fef2c0cdcc0 2024-09-13T18:29:13.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef33b6e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c06b930 con 0x7fef2c15b890 2024-09-13T18:29:13.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef3190a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef2c0b2b00 0x7fef2c15e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef3190a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef2c0b2b00 0x7fef2c15e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55778/0 (socket says 172.21.15.44:55778) 2024-09-13T18:29:13.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef3190a700 1 -- 172.21.15.44:0/3816801514 learned_addr learned my addr 172.21.15.44:0/3816801514 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:13.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef31109700 1 --2- 172.21.15.44:0/3816801514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef2c0cdcc0 0x7fef2c1f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef3210b700 1 --2- 172.21.15.44:0/3816801514 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef2c15b890 0x7fef2c160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef3190a700 1 -- 172.21.15.44:0/3816801514 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef2c15b890 msgr2=0x7fef2c160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef3190a700 1 --2- 172.21.15.44:0/3816801514 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef2c15b890 0x7fef2c160510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef3190a700 1 -- 172.21.15.44:0/3816801514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef2c0cdcc0 msgr2=0x7fef2c1f6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef3190a700 1 --2- 172.21.15.44:0/3816801514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef2c0cdcc0 0x7fef2c1f6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef3190a700 1 -- 172.21.15.44:0/3816801514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef24009a70 con 0x7fef2c0b2b00 2024-09-13T18:29:13.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef31109700 1 --2- 172.21.15.44:0/3816801514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef2c0cdcc0 0x7fef2c1f6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:13.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef3190a700 1 --2- 172.21.15.44:0/3816801514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef2c0b2b00 0x7fef2c15e760 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fef2000e840 tx=0x7fef2000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:13.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef1e7fc700 1 -- 172.21.15.44:0/3816801514 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef200095a0 con 0x7fef2c0b2b00 2024-09-13T18:29:13.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef1e7fc700 1 -- 172.21.15.44:0/3816801514 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef20013680 con 0x7fef2c0b2b00 2024-09-13T18:29:13.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef33b6e700 1 -- 172.21.15.44:0/3816801514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef2c06bc10 con 0x7fef2c0b2b00 2024-09-13T18:29:13.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef1e7fc700 1 -- 172.21.15.44:0/3816801514 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef200139f0 con 0x7fef2c0b2b00 2024-09-13T18:29:13.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef33b6e700 1 -- 172.21.15.44:0/3816801514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2c06d0a0 con 0x7fef2c0b2b00 2024-09-13T18:29:13.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef33b6e700 1 -- 172.21.15.44:0/3816801514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef2c0ce120 con 0x7fef2c0b2b00 2024-09-13T18:29:13.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.472+0000 7fef1e7fc700 1 -- 172.21.15.44:0/3816801514 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fef20013b50 con 0x7fef2c0b2b00 2024-09-13T18:29:13.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.476+0000 7fef1e7fc700 1 --2- 172.21.15.44:0/3816801514 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef10066730 0x7fef10068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.476+0000 7fef1e7fc700 1 -- 172.21.15.44:0/3816801514 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef200840c0 con 0x7fef2c0b2b00 2024-09-13T18:29:13.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.476+0000 7fef31109700 1 --2- 172.21.15.44:0/3816801514 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef10066730 0x7fef10068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.476+0000 7fef31109700 1 --2- 172.21.15.44:0/3816801514 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef10066730 0x7fef10068bf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0caab0 tx=0x7fef28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:13.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.480+0000 7fef1e7fc700 1 -- 172.21.15.44:0/3816801514 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fef200513b0 con 0x7fef2c0b2b00 2024-09-13T18:29:13.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.692+0000 7fef33b6e700 1 -- 172.21.15.44:0/3816801514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef2c0ae600 con 0x7fef2c0b2b00 2024-09-13T18:29:13.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.692+0000 7fef1e7fc700 1 -- 172.21.15.44:0/3816801514 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4734 (secure 0 0 0) 0x7fef200549d0 con 0x7fef2c0b2b00 2024-09-13T18:29:13.696 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:29:13.696 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":31,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5447,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2081931615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2081931615},{"type":"v1","addr":"172.21.15.99:6835","nonce":2081931615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5887,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/2337853364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2337853364},{"type":"v1","addr":"172.21.15.99:6837","nonce":2337853364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5976,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3567136594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3567136594},{"type":"v1","addr":"172.21.15.44:6833","nonce":3567136594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:29:10.283572+0000","modified":"2024-09-13T18:29:13.308606+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5982":{"gid":5982,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3200882245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3200882245},{"type":"v1","addr":"172.21.15.44:6835","nonce":3200882245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:29:13.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.692+0000 7fef33b6e700 1 -- 172.21.15.44:0/3816801514 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef10066730 msgr2=0x7fef10068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.692+0000 7fef33b6e700 1 --2- 172.21.15.44:0/3816801514 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef10066730 0x7fef10068bf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0caab0 tx=0x7fef28009040 comp rx=0 tx=0).stop 2024-09-13T18:29:13.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.692+0000 7fef33b6e700 1 -- 172.21.15.44:0/3816801514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef2c0b2b00 msgr2=0x7fef2c15e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.692+0000 7fef33b6e700 1 --2- 172.21.15.44:0/3816801514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef2c0b2b00 0x7fef2c15e760 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fef2000e840 tx=0x7fef2000eb50 comp rx=0 tx=0).stop 2024-09-13T18:29:13.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.692+0000 7fef33b6e700 1 -- 172.21.15.44:0/3816801514 shutdown_connections 2024-09-13T18:29:13.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.692+0000 7fef33b6e700 1 --2- 172.21.15.44:0/3816801514 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef10066730 0x7fef10068bf0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.692+0000 7fef33b6e700 1 --2- 172.21.15.44:0/3816801514 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fef2c15b890 0x7fef2c160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.692+0000 7fef33b6e700 1 --2- 172.21.15.44:0/3816801514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef2c0cdcc0 0x7fef2c1f6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.692+0000 7fef33b6e700 1 --2- 172.21.15.44:0/3816801514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef2c0b2b00 0x7fef2c15e760 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.692+0000 7fef33b6e700 1 -- 172.21.15.44:0/3816801514 >> 172.21.15.44:0/3816801514 conn(0x7fef2c0ce980 msgr2=0x7fef2c071430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:13.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.692+0000 7fef33b6e700 1 -- 172.21.15.44:0/3816801514 shutdown_connections 2024-09-13T18:29:13.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.692+0000 7fef33b6e700 1 -- 172.21.15.44:0/3816801514 wait complete. 2024-09-13T18:29:13.700 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 31 2024-09-13T18:29:13.711 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:29:13.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.824+0000 7f054ab2f700 1 Processor -- start 2024-09-13T18:29:13.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.824+0000 7f054ab2f700 1 -- start start 2024-09-13T18:29:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.824+0000 7f054ab2f700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f054406acc0 0x7f054415ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.824+0000 7f054ab2f700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054413dcb0 con 0x7f05440b3ae0 2024-09-13T18:29:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.824+0000 7f054ab2f700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054413ffd0 con 0x7f054406bbf0 2024-09-13T18:29:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.824+0000 7f054ab2f700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f054406b110 con 0x7f054406acc0 2024-09-13T18:29:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.824+0000 7f054932c700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f05440b3ae0 0x7f054406a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60374/0 (socket says 172.21.15.44:60374) 2024-09-13T18:29:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.824+0000 7f054932c700 1 -- 172.21.15.44:0/1103543089 learned_addr learned my addr 172.21.15.44:0/1103543089 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:29:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.824+0000 7f054a32e700 1 --2- 172.21.15.44:0/1103543089 >> v2:172.21.15.44:3300/0 conn(0x7f054406acc0 0x7f054415ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.824+0000 7f0548b2b700 1 -- 172.21.15.44:0/1103543089 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960784110 0 0) 0x7f054413dcb0 con 0x7f05440b3ae0 2024-09-13T18:29:13.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.824+0000 7f0548b2b700 1 -- 172.21.15.44:0/1103543089 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05300035d0 con 0x7f05440b3ae0 2024-09-13T18:29:13.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.824+0000 7f054a32e700 1 -- 172.21.15.44:0/1103543089 >> v1:172.21.15.99:6789/0 conn(0x7f054406bbf0 legacy=0x7f05440b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.824+0000 7f0548b2b700 1 -- 172.21.15.44:0/1103543089 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1416996009 0 0) 0x7f05300035d0 con 0x7f05440b3ae0 2024-09-13T18:29:13.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.828+0000 7f054a32e700 1 -- 172.21.15.44:0/1103543089 >> v1:172.21.15.44:6789/0 conn(0x7f05440b3ae0 legacy=0x7f054406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.828+0000 7f054a32e700 1 -- 172.21.15.44:0/1103543089 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0544140220 con 0x7f054406acc0 2024-09-13T18:29:13.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.828+0000 7f054a32e700 1 --2- 172.21.15.44:0/1103543089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054406acc0 0x7f054415ae50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f053c009850 tx=0x7f053c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b211071a32ebaf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:13.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.828+0000 7f0548b2b700 1 -- 172.21.15.44:0/1103543089 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05400019f0 con 0x7f054406acc0 2024-09-13T18:29:13.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.828+0000 7f0548b2b700 1 -- 172.21.15.44:0/1103543089 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053c004030 con 0x7f054406acc0 2024-09-13T18:29:13.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.828+0000 7f0548b2b700 1 -- 172.21.15.44:0/1103543089 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c0043c0 con 0x7f054406acc0 2024-09-13T18:29:13.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.828+0000 7f054ab2f700 1 -- 172.21.15.44:0/1103543089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054406acc0 msgr2=0x7f054415ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.828+0000 7f054ab2f700 1 --2- 172.21.15.44:0/1103543089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054406acc0 0x7f054415ae50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f053c009850 tx=0x7f053c009b60 comp rx=0 tx=0).stop 2024-09-13T18:29:13.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.828+0000 7f054ab2f700 1 -- 172.21.15.44:0/1103543089 shutdown_connections 2024-09-13T18:29:13.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.828+0000 7f054ab2f700 1 --2- 172.21.15.44:0/1103543089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054406acc0 0x7f054415ae50 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.828+0000 7f054ab2f700 1 -- 172.21.15.44:0/1103543089 >> 172.21.15.44:0/1103543089 conn(0x7f05440b0f00 msgr2=0x7f05440b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:13.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.828+0000 7f054ab2f700 1 -- 172.21.15.44:0/1103543089 shutdown_connections 2024-09-13T18:29:13.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.828+0000 7f054ab2f700 1 -- 172.21.15.44:0/1103543089 wait complete. 2024-09-13T18:29:13.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.828+0000 7f054ab2f700 1 Processor -- start 2024-09-13T18:29:13.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.828+0000 7f054ab2f700 1 -- start start 2024-09-13T18:29:13.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f054ab2f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f054406acc0 0x7f05441565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f054ab2f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054406bbf0 0x7f05441340b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f054ab2f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f05440b3ae0 0x7f0544157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f054ab2f700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05441577e0 con 0x7f054406bbf0 2024-09-13T18:29:13.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f054ab2f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0544156bd0 con 0x7f054406acc0 2024-09-13T18:29:13.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f054ab2f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0544156eb0 con 0x7f05440b3ae0 2024-09-13T18:29:13.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f054932c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054406bbf0 0x7f05441340b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f0549b2d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f054406acc0 0x7f05441565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f054a32e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f05440b3ae0 0x7f0544157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f0549b2d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f054406acc0 0x7f05441565f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:60920/0 (socket says 172.21.15.44:60920) 2024-09-13T18:29:13.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f0549b2d700 1 -- 172.21.15.44:0/2355610151 learned_addr learned my addr 172.21.15.44:0/2355610151 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:13.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f054932c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054406bbf0 0x7f05441340b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55798/0 (socket says 172.21.15.44:55798) 2024-09-13T18:29:13.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f054932c700 1 -- 172.21.15.44:0/2355610151 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f05440b3ae0 msgr2=0x7f0544157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f054932c700 1 --2- 172.21.15.44:0/2355610151 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f05440b3ae0 0x7f0544157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f054932c700 1 -- 172.21.15.44:0/2355610151 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f054406acc0 msgr2=0x7f05441565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f054932c700 1 --2- 172.21.15.44:0/2355610151 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f054406acc0 0x7f05441565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f054932c700 1 -- 172.21.15.44:0/2355610151 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c0094b0 con 0x7f054406bbf0 2024-09-13T18:29:13.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f0549b2d700 1 --2- 172.21.15.44:0/2355610151 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f054406acc0 0x7f05441565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:13.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f054932c700 1 --2- 172.21.15.44:0/2355610151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054406bbf0 0x7f05441340b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0540001560 tx=0x7f054000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:13.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f05367fc700 1 -- 172.21.15.44:0/2355610151 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054000ab00 con 0x7f054406bbf0 2024-09-13T18:29:13.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f05367fc700 1 -- 172.21.15.44:0/2355610151 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054000ac80 con 0x7f054406bbf0 2024-09-13T18:29:13.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f054ab2f700 1 -- 172.21.15.44:0/2355610151 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0544157190 con 0x7f054406bbf0 2024-09-13T18:29:13.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f05367fc700 1 -- 172.21.15.44:0/2355610151 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05400070d0 con 0x7f054406bbf0 2024-09-13T18:29:13.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.832+0000 7f054ab2f700 1 -- 172.21.15.44:0/2355610151 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0544154ce0 con 0x7f054406bbf0 2024-09-13T18:29:13.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.836+0000 7f054ab2f700 1 -- 172.21.15.44:0/2355610151 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0544140aa0 con 0x7f054406bbf0 2024-09-13T18:29:13.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.836+0000 7f05367fc700 1 -- 172.21.15.44:0/2355610151 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0540007230 con 0x7f054406bbf0 2024-09-13T18:29:13.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.836+0000 7f05367fc700 1 --2- 172.21.15.44:0/2355610151 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0528066760 0x7f0528068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.836+0000 7f05367fc700 1 -- 172.21.15.44:0/2355610151 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0540083c70 con 0x7f054406bbf0 2024-09-13T18:29:13.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.836+0000 7f0549b2d700 1 --2- 172.21.15.44:0/2355610151 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0528066760 0x7f0528068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.836+0000 7f0549b2d700 1 --2- 172.21.15.44:0/2355610151 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0528066760 0x7f0528068c20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0544144310 tx=0x7f0538009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:13.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:13.844+0000 7f05367fc700 1 -- 172.21.15.44:0/2355610151 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0544140aa0 con 0x7f054406bbf0 2024-09-13T18:29:14.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.024+0000 7f054ab2f700 1 -- 172.21.15.44:0/2355610151 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0544140aa0 con 0x7f054406bbf0 2024-09-13T18:29:14.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.028+0000 7f05367fc700 1 -- 172.21.15.44:0/2355610151 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16453 (secure 0 0 0) 0x7f0544140aa0 con 0x7f054406bbf0 2024-09-13T18:29:14.032 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:29:14.032 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":48,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:29:11.287200+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:29:08.754284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:29:09.262346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:29:14.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.028+0000 7f054ab2f700 1 -- 172.21.15.44:0/2355610151 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0528066760 msgr2=0x7f0528068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.028+0000 7f054ab2f700 1 --2- 172.21.15.44:0/2355610151 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0528066760 0x7f0528068c20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0544144310 tx=0x7f0538009040 comp rx=0 tx=0).stop 2024-09-13T18:29:14.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.028+0000 7f054ab2f700 1 -- 172.21.15.44:0/2355610151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054406bbf0 msgr2=0x7f05441340b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.028+0000 7f054ab2f700 1 --2- 172.21.15.44:0/2355610151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054406bbf0 0x7f05441340b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0540001560 tx=0x7f054000cf70 comp rx=0 tx=0).stop 2024-09-13T18:29:14.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.028+0000 7f054ab2f700 1 -- 172.21.15.44:0/2355610151 shutdown_connections 2024-09-13T18:29:14.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.028+0000 7f054ab2f700 1 --2- 172.21.15.44:0/2355610151 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0528066760 0x7f0528068c20 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.028+0000 7f054ab2f700 1 --2- 172.21.15.44:0/2355610151 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f05440b3ae0 0x7f0544157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.028+0000 7f054ab2f700 1 --2- 172.21.15.44:0/2355610151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054406bbf0 0x7f05441340b0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.028+0000 7f054ab2f700 1 --2- 172.21.15.44:0/2355610151 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f054406acc0 0x7f05441565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.028+0000 7f054ab2f700 1 -- 172.21.15.44:0/2355610151 >> 172.21.15.44:0/2355610151 conn(0x7f05440b0f00 msgr2=0x7f05440aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:14.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.028+0000 7f054ab2f700 1 -- 172.21.15.44:0/2355610151 shutdown_connections 2024-09-13T18:29:14.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.028+0000 7f054ab2f700 1 -- 172.21.15.44:0/2355610151 wait complete. 2024-09-13T18:29:14.048 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:29:14.048 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:29:14.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2ab88cd700 1 Processor -- start 2024-09-13T18:29:14.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2ab88cd700 1 -- start start 2024-09-13T18:29:14.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2ab88cd700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2ab40b3ae0 0x7f2ab406a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2ab88cd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ab406aaf0 0x7f2ab415e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2ab88cd700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab413dcb0 con 0x7f2ab406bbf0 2024-09-13T18:29:14.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2ab88cd700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab415be60 con 0x7f2ab40b3ae0 2024-09-13T18:29:14.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2ab88cd700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab413ffd0 con 0x7f2ab406aaf0 2024-09-13T18:29:14.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2aaaffd700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2ab40b3ae0 0x7f2ab406a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2aaaffd700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2ab40b3ae0 0x7f2ab406a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:60926/0 (socket says 172.21.15.44:60926) 2024-09-13T18:29:14.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2aaaffd700 1 -- 172.21.15.44:0/110467399 learned_addr learned my addr 172.21.15.44:0/110467399 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:14.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2ab37fe700 1 --1- 172.21.15.44:0/110467399 >> v1:172.21.15.99:6789/0 conn(0x7f2ab406bbf0 0x7f2ab40b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:45782/0 (socket says 172.21.15.44:45782) 2024-09-13T18:29:14.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2ab3fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ab406aaf0 0x7f2ab415e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2aaaffd700 1 -- 172.21.15.44:0/110467399 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ab406aaf0 msgr2=0x7f2ab415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:14.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2aaaffd700 1 --2- 172.21.15.44:0/110467399 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ab406aaf0 0x7f2ab415e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2aaaffd700 1 -- 172.21.15.44:0/110467399 >> v1:172.21.15.99:6789/0 conn(0x7f2ab406bbf0 legacy=0x7f2ab40b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2aaaffd700 1 -- 172.21.15.44:0/110467399 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab4140220 con 0x7f2ab40b3ae0 2024-09-13T18:29:14.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2aaaffd700 1 --2- 172.21.15.44:0/110467399 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ab40b3ae0 0x7f2ab406a5b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c009910 tx=0x7f2a9c009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91d69bfff9df7923 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:14.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2ab2ffd700 1 -- 172.21.15.44:0/110467399 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c011830 con 0x7f2ab40b3ae0 2024-09-13T18:29:14.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2ab2ffd700 1 -- 172.21.15.44:0/110467399 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c011990 con 0x7f2ab40b3ae0 2024-09-13T18:29:14.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2ab2ffd700 1 -- 172.21.15.44:0/110467399 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c011d40 con 0x7f2ab40b3ae0 2024-09-13T18:29:14.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2ab88cd700 1 -- 172.21.15.44:0/110467399 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ab40b3ae0 msgr2=0x7f2ab406a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2ab88cd700 1 --2- 172.21.15.44:0/110467399 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ab40b3ae0 0x7f2ab406a5b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c009910 tx=0x7f2a9c009c20 comp rx=0 tx=0).stop 2024-09-13T18:29:14.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2ab88cd700 1 -- 172.21.15.44:0/110467399 shutdown_connections 2024-09-13T18:29:14.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2ab88cd700 1 --2- 172.21.15.44:0/110467399 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ab406aaf0 0x7f2ab415e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2ab88cd700 1 --2- 172.21.15.44:0/110467399 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ab40b3ae0 0x7f2ab406a5b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2ab88cd700 1 -- 172.21.15.44:0/110467399 >> 172.21.15.44:0/110467399 conn(0x7f2ab40b0f00 msgr2=0x7f2ab40b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:14.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2ab88cd700 1 -- 172.21.15.44:0/110467399 shutdown_connections 2024-09-13T18:29:14.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.164+0000 7f2ab88cd700 1 -- 172.21.15.44:0/110467399 wait complete. 2024-09-13T18:29:14.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab88cd700 1 Processor -- start 2024-09-13T18:29:14.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab88cd700 1 -- start start 2024-09-13T18:29:14.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab88cd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ab406aaf0 0x7f2ab40cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab88cd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ab406bbf0 0x7f2ab41545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab88cd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ab40b3ae0 0x7f2ab413efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab88cd700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab40cc610 con 0x7f2ab40b3ae0 2024-09-13T18:29:14.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab88cd700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab40cba00 con 0x7f2ab406bbf0 2024-09-13T18:29:14.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab88cd700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab40cbce0 con 0x7f2ab406aaf0 2024-09-13T18:29:14.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab3fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ab40b3ae0 0x7f2ab413efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab3fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ab40b3ae0 0x7f2ab413efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55806/0 (socket says 172.21.15.44:55806) 2024-09-13T18:29:14.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab3fff700 1 -- 172.21.15.44:0/980477872 learned_addr learned my addr 172.21.15.44:0/980477872 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:14.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2aaaffd700 1 --2- 172.21.15.44:0/980477872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ab406bbf0 0x7f2ab41545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab37fe700 1 --2- 172.21.15.44:0/980477872 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ab406aaf0 0x7f2ab40cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab3fff700 1 -- 172.21.15.44:0/980477872 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ab406aaf0 msgr2=0x7f2ab40cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab3fff700 1 --2- 172.21.15.44:0/980477872 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ab406aaf0 0x7f2ab40cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab3fff700 1 -- 172.21.15.44:0/980477872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ab406bbf0 msgr2=0x7f2ab41545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab3fff700 1 --2- 172.21.15.44:0/980477872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ab406bbf0 0x7f2ab41545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab3fff700 1 -- 172.21.15.44:0/980477872 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9c009570 con 0x7f2ab40b3ae0 2024-09-13T18:29:14.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2aaaffd700 1 --2- 172.21.15.44:0/980477872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ab406bbf0 0x7f2ab41545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:14.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab37fe700 1 --2- 172.21.15.44:0/980477872 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ab406aaf0 0x7f2ab40cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:14.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab3fff700 1 --2- 172.21.15.44:0/980477872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ab40b3ae0 0x7f2ab413efc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00efc0 tx=0x7f2aac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:14.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab0ff9700 1 -- 172.21.15.44:0/980477872 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac009ba0 con 0x7f2ab40b3ae0 2024-09-13T18:29:14.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab0ff9700 1 -- 172.21.15.44:0/980477872 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aac00f040 con 0x7f2ab40b3ae0 2024-09-13T18:29:14.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab88cd700 1 -- 172.21.15.44:0/980477872 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab40cbfc0 con 0x7f2ab40b3ae0 2024-09-13T18:29:14.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab0ff9700 1 -- 172.21.15.44:0/980477872 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac014480 con 0x7f2ab40b3ae0 2024-09-13T18:29:14.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.168+0000 7f2ab88cd700 1 -- 172.21.15.44:0/980477872 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab413bbd0 con 0x7f2ab40b3ae0 2024-09-13T18:29:14.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.172+0000 7f2ab88cd700 1 -- 172.21.15.44:0/980477872 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab40b3950 con 0x7f2ab40b3ae0 2024-09-13T18:29:14.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.172+0000 7f2ab0ff9700 1 -- 172.21.15.44:0/980477872 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2aac0145e0 con 0x7f2ab40b3ae0 2024-09-13T18:29:14.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.172+0000 7f2ab0ff9700 1 --2- 172.21.15.44:0/980477872 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2a94066730 0x7f2a94068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.172+0000 7f2ab0ff9700 1 -- 172.21.15.44:0/980477872 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2aac084a70 con 0x7f2ab40b3ae0 2024-09-13T18:29:14.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.172+0000 7f2ab37fe700 1 --2- 172.21.15.44:0/980477872 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2a94066730 0x7f2a94068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.172+0000 7f2ab37fe700 1 --2- 172.21.15.44:0/980477872 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2a94066730 0x7f2a94068bf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4000f60 tx=0x7f2aa4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:14.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.176+0000 7f2ab0ff9700 1 -- 172.21.15.44:0/980477872 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2aac051d40 con 0x7f2ab40b3ae0 2024-09-13T18:29:14.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.348+0000 7f2ab88cd700 1 -- 172.21.15.44:0/980477872 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ab4140ac0 con 0x7f2a94066730 2024-09-13T18:29:14.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.368+0000 7f2ab0ff9700 1 -- 172.21.15.44:0/980477872 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277137 (secure 0 0 0) 0x7f2aa40058c0 con 0x7f2a94066730 2024-09-13T18:29:14.375 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:29:14.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.372+0000 7f2ab88cd700 1 -- 172.21.15.44:0/980477872 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2a94066730 msgr2=0x7f2a94068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.372+0000 7f2ab88cd700 1 --2- 172.21.15.44:0/980477872 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2a94066730 0x7f2a94068bf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4000f60 tx=0x7f2aa4009040 comp rx=0 tx=0).stop 2024-09-13T18:29:14.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.372+0000 7f2ab88cd700 1 -- 172.21.15.44:0/980477872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ab40b3ae0 msgr2=0x7f2ab413efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.372+0000 7f2ab88cd700 1 --2- 172.21.15.44:0/980477872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ab40b3ae0 0x7f2ab413efc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00efc0 tx=0x7f2aac00c3a0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.372+0000 7f2ab88cd700 1 -- 172.21.15.44:0/980477872 shutdown_connections 2024-09-13T18:29:14.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.372+0000 7f2ab88cd700 1 --2- 172.21.15.44:0/980477872 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2a94066730 0x7f2a94068bf0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.372+0000 7f2ab88cd700 1 --2- 172.21.15.44:0/980477872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ab40b3ae0 0x7f2ab413efc0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.372+0000 7f2ab88cd700 1 --2- 172.21.15.44:0/980477872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ab406bbf0 0x7f2ab41545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.372+0000 7f2ab88cd700 1 --2- 172.21.15.44:0/980477872 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ab406aaf0 0x7f2ab40cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.372+0000 7f2ab88cd700 1 -- 172.21.15.44:0/980477872 >> 172.21.15.44:0/980477872 conn(0x7f2ab40b0f00 msgr2=0x7f2ab4071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:14.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.372+0000 7f2ab88cd700 1 -- 172.21.15.44:0/980477872 shutdown_connections 2024-09-13T18:29:14.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.372+0000 7f2ab88cd700 1 -- 172.21.15.44:0/980477872 wait complete. 2024-09-13T18:29:14.379 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:29:14.392 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2024-09-13T18:29:12.363586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":221452,"kb_used_data":5228,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753268,"statfs":{"total":773094113280,"available":772867346432,"internally_reserved":0,"allocated":5353472,"data_stored":2851587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001166"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897751+0000","last_change":"2024-09-13T18:29:08.897751+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897751+0000","last_undegraded":"2024-09-13T18:29:08.897751+0000","last_fullsized":"2024-09-13T18:29:08.897751+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:24.270758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.900289+0000","last_change":"2024-09-13T18:29:08.900289+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.900289+0000","last_undegraded":"2024-09-13T18:29:08.900289+0000","last_fullsized":"2024-09-13T18:29:08.900289+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:47.472350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.893741+0000","last_change":"2024-09-13T18:29:08.893741+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.893741+0000","last_undegraded":"2024-09-13T18:29:08.893741+0000","last_fullsized":"2024-09-13T18:29:08.893741+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:09.962065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.898034+0000","last_change":"2024-09-13T18:29:08.898034+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.898034+0000","last_undegraded":"2024-09-13T18:29:08.898034+0000","last_fullsized":"2024-09-13T18:29:08.898034+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:00.837327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.898425+0000","last_change":"2024-09-13T18:29:08.898425+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.898425+0000","last_undegraded":"2024-09-13T18:29:08.898425+0000","last_fullsized":"2024-09-13T18:29:08.898425+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:25.197012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.900165+0000","last_change":"2024-09-13T18:29:08.900165+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.900165+0000","last_undegraded":"2024-09-13T18:29:08.900165+0000","last_fullsized":"2024-09-13T18:29:08.900165+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:09.004250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.890301+0000","last_change":"2024-09-13T18:29:08.890301+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.890301+0000","last_undegraded":"2024-09-13T18:29:08.890301+0000","last_fullsized":"2024-09-13T18:29:08.890301+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:26.481517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.905393+0000","last_change":"2024-09-13T18:29:08.905393+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.905393+0000","last_undegraded":"2024-09-13T18:29:08.905393+0000","last_fullsized":"2024-09-13T18:29:08.905393+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:24.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.899250+0000","last_change":"2024-09-13T18:29:08.899250+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.899250+0000","last_undegraded":"2024-09-13T18:29:08.899250+0000","last_fullsized":"2024-09-13T18:29:08.899250+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:32.352134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.904159+0000","last_change":"2024-09-13T18:29:08.904159+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.904159+0000","last_undegraded":"2024-09-13T18:29:08.904159+0000","last_fullsized":"2024-09-13T18:29:08.904159+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:47.472350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.898335+0000","last_change":"2024-09-13T18:29:08.898335+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.898335+0000","last_undegraded":"2024-09-13T18:29:08.898335+0000","last_fullsized":"2024-09-13T18:29:08.898335+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:24.270758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.903849+0000","last_change":"2024-09-13T18:29:08.903849+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.903849+0000","last_undegraded":"2024-09-13T18:29:08.903849+0000","last_fullsized":"2024-09-13T18:29:08.903849+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:14.350641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897694+0000","last_change":"2024-09-13T18:29:08.897694+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897694+0000","last_undegraded":"2024-09-13T18:29:08.897694+0000","last_fullsized":"2024-09-13T18:29:08.897694+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:41.337959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897291+0000","last_change":"2024-09-13T18:29:08.897291+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897291+0000","last_undegraded":"2024-09-13T18:29:08.897291+0000","last_fullsized":"2024-09-13T18:29:08.897291+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:25.197012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897011+0000","last_change":"2024-09-13T18:29:08.897011+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897011+0000","last_undegraded":"2024-09-13T18:29:08.897011+0000","last_fullsized":"2024-09-13T18:29:08.897011+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:32.449968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.904902+0000","last_change":"2024-09-13T18:29:08.904902+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.904902+0000","last_undegraded":"2024-09-13T18:29:08.904902+0000","last_fullsized":"2024-09-13T18:29:08.904902+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:05.424273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.903924+0000","last_change":"2024-09-13T18:29:08.903924+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.903924+0000","last_undegraded":"2024-09-13T18:29:08.903924+0000","last_fullsized":"2024-09-13T18:29:08.903924+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:14.045917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.899114+0000","last_change":"2024-09-13T18:29:08.899114+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.899114+0000","last_undegraded":"2024-09-13T18:29:08.899114+0000","last_fullsized":"2024-09-13T18:29:08.899114+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:52.127760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.890145+0000","last_change":"2024-09-13T18:29:08.890145+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.890145+0000","last_undegraded":"2024-09-13T18:29:08.890145+0000","last_fullsized":"2024-09-13T18:29:08.890145+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:09.962065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897179+0000","last_change":"2024-09-13T18:29:08.897179+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897179+0000","last_undegraded":"2024-09-13T18:29:08.897179+0000","last_fullsized":"2024-09-13T18:29:08.897179+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:00.837327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.896829+0000","last_change":"2024-09-13T18:29:08.896829+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.896829+0000","last_undegraded":"2024-09-13T18:29:08.896829+0000","last_fullsized":"2024-09-13T18:29:08.896829+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:43.676401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.890301+0000","last_change":"2024-09-13T18:29:08.890301+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.890301+0000","last_undegraded":"2024-09-13T18:29:08.890301+0000","last_fullsized":"2024-09-13T18:29:08.890301+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:03.701094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.904010+0000","last_change":"2024-09-13T18:29:08.904010+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.904010+0000","last_undegraded":"2024-09-13T18:29:08.904010+0000","last_fullsized":"2024-09-13T18:29:08.904010+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:37.970067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897136+0000","last_change":"2024-09-13T18:29:08.897136+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897136+0000","last_undegraded":"2024-09-13T18:29:08.897136+0000","last_fullsized":"2024-09-13T18:29:08.897136+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:43.676401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897260+0000","last_change":"2024-09-13T18:29:08.897260+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897260+0000","last_undegraded":"2024-09-13T18:29:08.897260+0000","last_fullsized":"2024-09-13T18:29:08.897260+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:32.068323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897830+0000","last_change":"2024-09-13T18:29:08.897830+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897830+0000","last_undegraded":"2024-09-13T18:29:08.897830+0000","last_fullsized":"2024-09-13T18:29:08.897830+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:12.384532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.894130+0000","last_change":"2024-09-13T18:29:08.894130+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.894130+0000","last_undegraded":"2024-09-13T18:29:08.894130+0000","last_fullsized":"2024-09-13T18:29:08.894130+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:03.701094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897198+0000","last_change":"2024-09-13T18:29:08.897198+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897198+0000","last_undegraded":"2024-09-13T18:29:08.897198+0000","last_fullsized":"2024-09-13T18:29:08.897198+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:15.435159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.899413+0000","last_change":"2024-09-13T18:29:08.899413+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.899413+0000","last_undegraded":"2024-09-13T18:29:08.899413+0000","last_fullsized":"2024-09-13T18:29:08.899413+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:37.970067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.893882+0000","last_change":"2024-09-13T18:29:08.893882+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.893882+0000","last_undegraded":"2024-09-13T18:29:08.893882+0000","last_fullsized":"2024-09-13T18:29:08.893882+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:42.514279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.904080+0000","last_change":"2024-09-13T18:29:08.904080+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.904080+0000","last_undegraded":"2024-09-13T18:29:08.904080+0000","last_fullsized":"2024-09-13T18:29:08.904080+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:32.352134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.890574+0000","last_change":"2024-09-13T18:29:08.890574+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.890574+0000","last_undegraded":"2024-09-13T18:29:08.890574+0000","last_fullsized":"2024-09-13T18:29:08.890574+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:08.869484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:29:06.968329+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:29:06.968329+0000","last_peered":"2024-09-13T18:29:06.968329+0000","last_clean":"2024-09-13T18:29:06.968329+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:29:06.968329+0000","last_undegraded":"2024-09-13T18:29:06.968329+0000","last_fullsized":"2024-09-13T18:29:06.968329+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28116,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343724,"statfs":{"total":96636764160,"available":96607973376,"internally_reserved":0,"allocated":1122304,"data_stored":802860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.77100000000000002,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1240000000000001,"5min":1.163,"15min":1.163},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.79300000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.91200000000000003,"15min":0.91400000000000003},"min":{"1min":0.65800000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.157,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.97199999999999998,"15min":0.97399999999999998},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.177,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.0209999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85899999999999999,"15min":0.85999999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.056},{"interface":"front","average":{"1min":0.872,"5min":0.92200000000000004,"15min":0.93000000000000005},"min":{"1min":0.57899999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.127,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.0800000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.89700000000000002,"15min":0.90000000000000002},"min":{"1min":0.67500000000000004,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.099,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.88400000000000001,"15min":0.87},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.117,"5min":1.125,"15min":1.125},"last":0.85199999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.88900000000000001,"15min":0.90500000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1739999999999999,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.996,"5min":1.0449999999999999,"15min":1.0529999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.2110000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.1559999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.95999999999999996,"15min":0.95599999999999996},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.302,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":1.1870000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0449999999999999,"15min":1.0549999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.274,"5min":1.502,"15min":1.502},"last":1.2929999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.0940000000000001,"15min":1.1160000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.161,"5min":2.077,"15min":2.077},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0589999999999999,"15min":1.0629999999999999},"min":{"1min":0.72199999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.2210000000000001,"5min":1.55,"15min":1.55},"last":1.224}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27536,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":516096,"data_stored":206675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.61499999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.216,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.258}]},{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.83399999999999996,"15min":0.82999999999999996},"min":{"1min":0.58499999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.83599999999999997,"15min":0.82399999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82799999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.81799999999999995,"15min":0.81200000000000006},"min":{"1min":0.54200000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2010000000000001,"5min":1.254,"15min":1.254},"last":1.1379999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.86499999999999999,"15min":0.86899999999999999},"min":{"1min":0.56799999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":1.111}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.86199999999999999,"15min":0.85699999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.125,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.96099999999999997,"15min":0.96699999999999997},"min":{"1min":0.70099999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2070000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.018}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.89900000000000002,"15min":0.90100000000000002},"min":{"1min":0.622,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.165,"5min":1.248,"15min":1.248},"last":1.206},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0029999999999999,"15min":1.01},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.95099999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.05,"15min":1.046},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98899999999999999,"15min":0.99199999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.333}]},{"osd":7,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.002,"15min":1.016},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.256,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.117,"15min":1.1160000000000001},"min":{"1min":0.94999999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.3160000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.236}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":516096,"data_stored":206675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.85699999999999998,"15min":0.86099999999999999},"min":{"1min":0.61899999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1259999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.88900000000000001,"15min":0.89700000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0820000000000001,"5min":1.482,"15min":1.482},"last":0.69599999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80500000000000005,"15min":0.80100000000000005},"min":{"1min":0.65900000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1559999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.95399999999999996,"15min":0.96599999999999997},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1000000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.45200000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.96999999999999997,"15min":0.97499999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0900000000000001,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.627},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.024,"15min":1.032},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.2529999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.65300000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.95699999999999996,"15min":0.97099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1499999999999999,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.96299999999999997,"15min":0.97299999999999998},"min":{"1min":0.59899999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.157,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.55300000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.97299999999999998,"15min":0.999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1160000000000001,"5min":1.304,"15min":1.304},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.89200000000000002,"5min":1.04,"15min":1.0649999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.1799999999999999,"5min":1.542,"15min":1.542},"last":0.77700000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.0449999999999999,"15min":1.0600000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.224,"5min":1.698,"15min":1.698},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.1719999999999999,"15min":1.1879999999999999},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.2010000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.88}]},{"osd":7,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.1990000000000001,"15min":1.2230000000000001},"min":{"1min":0.76100000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.2709999999999999,"5min":1.847,"15min":1.847},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.046,"5min":1.161,"15min":1.1799999999999999},"min":{"1min":0.81299999999999994,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.3149999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.747}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":516096,"data_stored":206675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.92700000000000005,"15min":0.93799999999999994},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1220000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.996,"15min":1.002},"min":{"1min":0.59499999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.111,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.78500000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0389999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.86399999999999999,"15min":0.86899999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1220000000000001,"5min":1.254,"15min":1.254},"last":0.73999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.86399999999999999,"15min":0.88100000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.61499999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.59899999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.996,"15min":1.0029999999999999},"min":{"1min":0.64900000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.24,"5min":1.639,"15min":1.639},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0049999999999999,"15min":1.008},"min":{"1min":0.72899999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1970000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.1319999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.98799999999999999,"15min":1.0109999999999999},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1419999999999999,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.123,"15min":1.1399999999999999},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.2150000000000001,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.84999999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.89400000000000002,"15min":0.89600000000000002},"min":{"1min":0.70899999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":1.04},{"interface":"front","average":{"1min":1.032,"5min":1.1080000000000001,"15min":1.121},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.21,"5min":1.794,"15min":1.794},"last":0.877}]},{"osd":7,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":1.077,"15min":1.1020000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.145,"5min":1.669,"15min":1.669},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.76800000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2390000000000001,"5min":1.282,"15min":1.282},"last":1.0840000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":528384,"data_stored":212492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.69299999999999995,"15min":0.70699999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.84499999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.70199999999999996,"15min":0.69599999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.51300000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.71799999999999997,"15min":0.72799999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.875,"5min":1.165,"15min":1.165},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.83799999999999997,"15min":0.85299999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.042,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0369999999999999,"5min":1.333,"15min":1.333},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.90800000000000003,"15min":0.91900000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.214,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.56399999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.97799999999999998,"15min":0.99199999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.1080000000000001,"5min":1.165,"15min":1.165},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.052,"15min":1.0669999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.79700000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.1919999999999999,"15min":1.2190000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.355,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.997,"5min":1.131,"15min":1.153},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.3049999999999999,"5min":1.718,"15min":1.718},"last":0.53600000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.1419999999999999,"15min":1.1599999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.4159999999999999,"5min":1.47,"15min":1.47},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.246,"15min":1.2729999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.4510000000000001,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.77900000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.123,"15min":1.129},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.752},{"interface":"front","average":{"1min":1.083,"5min":1.1910000000000001,"15min":1.2090000000000001},"min":{"1min":0.76800000000000002,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.385,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.69699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":516096,"data_stored":206675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68100000000000005,"15min":0.68200000000000005},"min":{"1min":0.432,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94999999999999996,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81499999999999995,"15min":0.82499999999999996},"min":{"1min":0.48399999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0429999999999999,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.85299999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.72399999999999998,"15min":0.73599999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92100000000000004,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.749,"15min":0.75600000000000001},"min":{"1min":0.49299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94599999999999995,"5min":1.206,"15min":1.206},"last":1.0549999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68100000000000005,"15min":0.67500000000000004},"min":{"1min":0.54600000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.03,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.86699999999999999,"15min":0.871},"min":{"1min":0.53100000000000003,"5min":0.433,"15min":0.433},"max":{"1min":1.2509999999999999,"5min":1.548,"15min":1.548},"last":1.1579999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.98099999999999998,"15min":0.98899999999999999},"min":{"1min":0.755,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2509999999999999,"5min":1.401,"15min":1.401},"last":1.288},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0680000000000001,"15min":1.083},"min":{"1min":0.70099999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3260000000000001,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.2529999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.92900000000000005,"15min":0.92700000000000005},"min":{"1min":0.67800000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0680000000000001,"15min":1.073},"min":{"1min":0.81799999999999995,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.5840000000000001,"5min":1.869,"15min":1.869},"last":1.3959999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.125,"15min":1.133},"min":{"1min":0.75900000000000001,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.3879999999999999,"5min":2.762,"15min":2.762},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0569999999999999,"15min":1.0609999999999999},"min":{"1min":0.78100000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.393,"5min":1.988,"15min":1.988},"last":1.097}]},{"osd":7,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.1819999999999999,"15min":1.1919999999999999},"min":{"1min":0.79900000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4319999999999999,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.0820000000000001,"15min":1.0760000000000001},"min":{"1min":0.81399999999999995,"5min":0.746,"15min":0.746},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.2230000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":516096,"data_stored":206675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.629,"15min":0.63},"min":{"1min":0.41699999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.131,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.72599999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.49399999999999999,"5min":0.373,"15min":0.373},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.228,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.67900000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79200000000000004,"15min":0.78400000000000003},"min":{"1min":0.54900000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.871},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.80600000000000005,"15min":0.81100000000000005},"min":{"1min":0.53300000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2090000000000001,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.58599999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.96499999999999997,"15min":0.97099999999999997},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.327,"5min":1.524,"15min":1.524},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98099999999999998,"15min":0.98199999999999998},"min":{"1min":0.80700000000000005,"5min":0.747,"15min":0.747},"max":{"1min":1.147,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.994}]},{"osd":5,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.97999999999999998,"15min":0.97399999999999998},"min":{"1min":0.79000000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.2909999999999999,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":2.0960000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.079,"15min":1.085},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.367,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":2.7280000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0920000000000001,"15min":1.105},"min":{"1min":0.76100000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.3420000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.0980000000000001,"15min":1.1020000000000001},"min":{"1min":0.93000000000000005,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.2829999999999999,"5min":1.869,"15min":1.869},"last":2.0489999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.085,"15min":1.087},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.26,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":2.5579999999999998},{"interface":"front","average":{"1min":1.097,"5min":1.1319999999999999,"15min":1.1379999999999999},"min":{"1min":0.82899999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.403,"5min":1.72,"15min":1.72},"last":0.94899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1122304,"data_stored":802860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.52500000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71599999999999997,"15min":0.70999999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94599999999999995,"5min":1.083,"15min":1.083},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.72699999999999998,"15min":0.72099999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.746}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.63900000000000001,"15min":0.629},"min":{"1min":0.56699999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.83399999999999996,"15min":0.83099999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.63}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.96599999999999997,"15min":0.97499999999999998},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.222,"5min":1.302,"15min":1.302},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.91700000000000004,"15min":0.90500000000000003},"min":{"1min":0.70199999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.97799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.97699999999999998,"15min":0.96999999999999997},"min":{"1min":0.746,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.079},{"interface":"front","average":{"1min":1.127,"5min":1.0700000000000001,"15min":1.0600000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.67600000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.109,"15min":1.099},"min":{"1min":0.95199999999999996,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.1279999999999999,"15min":1.135},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.2949999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.0289999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.1259999999999999,"15min":1.1339999999999999},"min":{"1min":0.82899999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.054,"15min":1.044},"min":{"1min":0.878,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.28,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.85299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:29:14.398 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:29:14.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.508+0000 7f5057fd8700 1 Processor -- start 2024-09-13T18:29:14.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.508+0000 7f5057fd8700 1 -- start start 2024-09-13T18:29:14.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.508+0000 7f5057fd8700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f505015d600 0x7f505015da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.508+0000 7f5057fd8700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f505006fd60 0x7f5050070170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.508+0000 7f5057fd8700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5050154490 con 0x7f50501540b0 2024-09-13T18:29:14.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.508+0000 7f5057fd8700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505015dfb0 con 0x7f505015d600 2024-09-13T18:29:14.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.508+0000 7f5057fd8700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505015c260 con 0x7f505006fd60 2024-09-13T18:29:14.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.508+0000 7f5055d74700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f50501540b0 0x7f505015bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60380/0 (socket says 172.21.15.44:60380) 2024-09-13T18:29:14.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.508+0000 7f5055d74700 1 -- 172.21.15.44:0/691055029 learned_addr learned my addr 172.21.15.44:0/691055029 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:29:14.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.508+0000 7f5056575700 1 --2- 172.21.15.44:0/691055029 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f505006fd60 0x7f5050070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.508+0000 7f5055573700 1 --2- 172.21.15.44:0/691055029 >> v2:172.21.15.99:3300/0 conn(0x7f505015d600 0x7f505015da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.508+0000 7f5054d72700 1 -- 172.21.15.44:0/691055029 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437760675 0 0) 0x7f5050154490 con 0x7f50501540b0 2024-09-13T18:29:14.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.508+0000 7f5054d72700 1 -- 172.21.15.44:0/691055029 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f503c0035d0 con 0x7f50501540b0 2024-09-13T18:29:14.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.512+0000 7f5056575700 1 -- 172.21.15.44:0/691055029 >> v2:172.21.15.99:3300/0 conn(0x7f505015d600 msgr2=0x7f505015da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:14.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.512+0000 7f5056575700 1 --2- 172.21.15.44:0/691055029 >> v2:172.21.15.99:3300/0 conn(0x7f505015d600 0x7f505015da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.512+0000 7f5056575700 1 -- 172.21.15.44:0/691055029 >> v1:172.21.15.44:6789/0 conn(0x7f50501540b0 legacy=0x7f505015bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.512+0000 7f5056575700 1 -- 172.21.15.44:0/691055029 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505015c530 con 0x7f505006fd60 2024-09-13T18:29:14.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.512+0000 7f5055573700 1 --2- 172.21.15.44:0/691055029 >> v2:172.21.15.99:3300/0 conn(0x7f505015d600 0x7f505015da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:14.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.512+0000 7f5056575700 1 --2- 172.21.15.44:0/691055029 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f505006fd60 0x7f5050070170 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5048009d90 tx=0x7f504800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8148ca269e7e72c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:14.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.512+0000 7f5054d72700 1 -- 172.21.15.44:0/691055029 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504800e070 con 0x7f505006fd60 2024-09-13T18:29:14.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.512+0000 7f5054d72700 1 -- 172.21.15.44:0/691055029 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504800bb20 con 0x7f505006fd60 2024-09-13T18:29:14.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.512+0000 7f5054d72700 1 -- 172.21.15.44:0/691055029 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504800be90 con 0x7f505006fd60 2024-09-13T18:29:14.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.512+0000 7f5057fd8700 1 -- 172.21.15.44:0/691055029 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f505006fd60 msgr2=0x7f5050070170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.512+0000 7f5057fd8700 1 --2- 172.21.15.44:0/691055029 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f505006fd60 0x7f5050070170 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5048009d90 tx=0x7f504800b330 comp rx=0 tx=0).stop 2024-09-13T18:29:14.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.512+0000 7f5057fd8700 1 -- 172.21.15.44:0/691055029 shutdown_connections 2024-09-13T18:29:14.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.512+0000 7f5057fd8700 1 --2- 172.21.15.44:0/691055029 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f505006fd60 0x7f5050070170 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.512+0000 7f5057fd8700 1 --2- 172.21.15.44:0/691055029 >> v2:172.21.15.99:3300/0 conn(0x7f505015d600 0x7f505015da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.512+0000 7f5057fd8700 1 -- 172.21.15.44:0/691055029 >> 172.21.15.44:0/691055029 conn(0x7f50500ce980 msgr2=0x7f50500ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:14.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.512+0000 7f5057fd8700 1 -- 172.21.15.44:0/691055029 shutdown_connections 2024-09-13T18:29:14.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.512+0000 7f5057fd8700 1 -- 172.21.15.44:0/691055029 wait complete. 2024-09-13T18:29:14.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f5057fd8700 1 Processor -- start 2024-09-13T18:29:14.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f5057fd8700 1 -- start start 2024-09-13T18:29:14.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f5057fd8700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f505006fd60 0x7f505014f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f5057fd8700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50501540b0 0x7f5050143cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f5057fd8700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f505015d600 0x7f505014e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f5057fd8700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505014fc30 con 0x7f505015d600 2024-09-13T18:29:14.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f5057fd8700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5050150480 con 0x7f505006fd60 2024-09-13T18:29:14.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f5057fd8700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50500b3c10 con 0x7f50501540b0 2024-09-13T18:29:14.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f5056575700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f505015d600 0x7f505014e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f5056575700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f505015d600 0x7f505014e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55808/0 (socket says 172.21.15.44:55808) 2024-09-13T18:29:14.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f5056575700 1 -- 172.21.15.44:0/2188659174 learned_addr learned my addr 172.21.15.44:0/2188659174 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:14.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f5055573700 1 --2- 172.21.15.44:0/2188659174 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50501540b0 0x7f5050143cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f5055d74700 1 --2- 172.21.15.44:0/2188659174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f505006fd60 0x7f505014f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f5056575700 1 -- 172.21.15.44:0/2188659174 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50501540b0 msgr2=0x7f5050143cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f5056575700 1 --2- 172.21.15.44:0/2188659174 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50501540b0 0x7f5050143cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f5056575700 1 -- 172.21.15.44:0/2188659174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f505006fd60 msgr2=0x7f505014f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f5056575700 1 --2- 172.21.15.44:0/2188659174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f505006fd60 0x7f505014f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f5056575700 1 -- 172.21.15.44:0/2188659174 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50400094b0 con 0x7f505015d600 2024-09-13T18:29:14.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f5056575700 1 --2- 172.21.15.44:0/2188659174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f505015d600 0x7f505014e1a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f5048014040 tx=0x7f5048004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:14.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f50467fc700 1 -- 172.21.15.44:0/2188659174 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5048007000 con 0x7f505015d600 2024-09-13T18:29:14.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f50467fc700 1 -- 172.21.15.44:0/2188659174 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5048012860 con 0x7f505015d600 2024-09-13T18:29:14.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f5057fd8700 1 -- 172.21.15.44:0/2188659174 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5048009a70 con 0x7f505015d600 2024-09-13T18:29:14.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f50467fc700 1 -- 172.21.15.44:0/2188659174 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5048012c10 con 0x7f505015d600 2024-09-13T18:29:14.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.516+0000 7f5057fd8700 1 -- 172.21.15.44:0/2188659174 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5050151180 con 0x7f505015d600 2024-09-13T18:29:14.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.520+0000 7f5057fd8700 1 -- 172.21.15.44:0/2188659174 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5050150d00 con 0x7f505015d600 2024-09-13T18:29:14.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.520+0000 7f50467fc700 1 -- 172.21.15.44:0/2188659174 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f504801c400 con 0x7f505015d600 2024-09-13T18:29:14.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.520+0000 7f50467fc700 1 --2- 172.21.15.44:0/2188659174 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5034066760 0x7f5034068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.520+0000 7f50467fc700 1 -- 172.21.15.44:0/2188659174 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5048086270 con 0x7f505015d600 2024-09-13T18:29:14.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.520+0000 7f5055d74700 1 --2- 172.21.15.44:0/2188659174 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5034066760 0x7f5034068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.520+0000 7f5055d74700 1 --2- 172.21.15.44:0/2188659174 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5034066760 0x7f5034068c20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f504c005930 tx=0x7f504c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:14.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.528+0000 7f50467fc700 1 -- 172.21.15.44:0/2188659174 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5050150d00 con 0x7f505015d600 2024-09-13T18:29:14.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.696+0000 7f5057fd8700 1 -- 172.21.15.44:0/2188659174 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f505015cdd0 con 0x7f5034066760 2024-09-13T18:29:14.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.712+0000 7f50467fc700 1 -- 172.21.15.44:0/2188659174 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277137 (secure 0 0 0) 0x7f504c001c50 con 0x7f5034066760 2024-09-13T18:29:14.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:29:14.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.716+0000 7f5057fd8700 1 -- 172.21.15.44:0/2188659174 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5034066760 msgr2=0x7f5034068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.716+0000 7f5057fd8700 1 --2- 172.21.15.44:0/2188659174 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5034066760 0x7f5034068c20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f504c005930 tx=0x7f504c009040 comp rx=0 tx=0).stop 2024-09-13T18:29:14.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.716+0000 7f5057fd8700 1 -- 172.21.15.44:0/2188659174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f505015d600 msgr2=0x7f505014e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.716+0000 7f5057fd8700 1 --2- 172.21.15.44:0/2188659174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f505015d600 0x7f505014e1a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f5048014040 tx=0x7f5048004af0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.716+0000 7f5057fd8700 1 -- 172.21.15.44:0/2188659174 shutdown_connections 2024-09-13T18:29:14.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.716+0000 7f5057fd8700 1 --2- 172.21.15.44:0/2188659174 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5034066760 0x7f5034068c20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.716+0000 7f5057fd8700 1 --2- 172.21.15.44:0/2188659174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f505015d600 0x7f505014e1a0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.716+0000 7f5057fd8700 1 --2- 172.21.15.44:0/2188659174 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50501540b0 0x7f5050143cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.716+0000 7f5057fd8700 1 --2- 172.21.15.44:0/2188659174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f505006fd60 0x7f505014f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.716+0000 7f5057fd8700 1 -- 172.21.15.44:0/2188659174 >> 172.21.15.44:0/2188659174 conn(0x7f50500ce980 msgr2=0x7f50500ae630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:14.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.716+0000 7f5057fd8700 1 -- 172.21.15.44:0/2188659174 shutdown_connections 2024-09-13T18:29:14.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.716+0000 7f5057fd8700 1 -- 172.21.15.44:0/2188659174 wait complete. 2024-09-13T18:29:14.725 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:29:14.737 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-09-13T18:29:14.365814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":221452,"kb_used_data":5228,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753268,"statfs":{"total":773094113280,"available":772867346432,"internally_reserved":0,"allocated":5353472,"data_stored":2851587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.479359"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897751+0000","last_change":"2024-09-13T18:29:08.897751+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897751+0000","last_undegraded":"2024-09-13T18:29:08.897751+0000","last_fullsized":"2024-09-13T18:29:08.897751+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:24.270758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.900289+0000","last_change":"2024-09-13T18:29:08.900289+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.900289+0000","last_undegraded":"2024-09-13T18:29:08.900289+0000","last_fullsized":"2024-09-13T18:29:08.900289+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:47.472350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.893741+0000","last_change":"2024-09-13T18:29:08.893741+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.893741+0000","last_undegraded":"2024-09-13T18:29:08.893741+0000","last_fullsized":"2024-09-13T18:29:08.893741+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:09.962065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.898034+0000","last_change":"2024-09-13T18:29:08.898034+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.898034+0000","last_undegraded":"2024-09-13T18:29:08.898034+0000","last_fullsized":"2024-09-13T18:29:08.898034+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:00.837327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.898425+0000","last_change":"2024-09-13T18:29:08.898425+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.898425+0000","last_undegraded":"2024-09-13T18:29:08.898425+0000","last_fullsized":"2024-09-13T18:29:08.898425+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:25.197012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.900165+0000","last_change":"2024-09-13T18:29:08.900165+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.900165+0000","last_undegraded":"2024-09-13T18:29:08.900165+0000","last_fullsized":"2024-09-13T18:29:08.900165+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:09.004250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.890301+0000","last_change":"2024-09-13T18:29:08.890301+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.890301+0000","last_undegraded":"2024-09-13T18:29:08.890301+0000","last_fullsized":"2024-09-13T18:29:08.890301+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:26.481517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.905393+0000","last_change":"2024-09-13T18:29:08.905393+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.905393+0000","last_undegraded":"2024-09-13T18:29:08.905393+0000","last_fullsized":"2024-09-13T18:29:08.905393+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:24.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.899250+0000","last_change":"2024-09-13T18:29:08.899250+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.899250+0000","last_undegraded":"2024-09-13T18:29:08.899250+0000","last_fullsized":"2024-09-13T18:29:08.899250+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:32.352134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.904159+0000","last_change":"2024-09-13T18:29:08.904159+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.904159+0000","last_undegraded":"2024-09-13T18:29:08.904159+0000","last_fullsized":"2024-09-13T18:29:08.904159+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:47.472350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.898335+0000","last_change":"2024-09-13T18:29:08.898335+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.898335+0000","last_undegraded":"2024-09-13T18:29:08.898335+0000","last_fullsized":"2024-09-13T18:29:08.898335+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:24.270758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.903849+0000","last_change":"2024-09-13T18:29:08.903849+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.903849+0000","last_undegraded":"2024-09-13T18:29:08.903849+0000","last_fullsized":"2024-09-13T18:29:08.903849+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:14.350641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897694+0000","last_change":"2024-09-13T18:29:08.897694+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897694+0000","last_undegraded":"2024-09-13T18:29:08.897694+0000","last_fullsized":"2024-09-13T18:29:08.897694+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:41.337959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897291+0000","last_change":"2024-09-13T18:29:08.897291+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897291+0000","last_undegraded":"2024-09-13T18:29:08.897291+0000","last_fullsized":"2024-09-13T18:29:08.897291+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:25.197012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897011+0000","last_change":"2024-09-13T18:29:08.897011+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897011+0000","last_undegraded":"2024-09-13T18:29:08.897011+0000","last_fullsized":"2024-09-13T18:29:08.897011+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:32.449968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.904902+0000","last_change":"2024-09-13T18:29:08.904902+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.904902+0000","last_undegraded":"2024-09-13T18:29:08.904902+0000","last_fullsized":"2024-09-13T18:29:08.904902+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:05.424273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.903924+0000","last_change":"2024-09-13T18:29:08.903924+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.903924+0000","last_undegraded":"2024-09-13T18:29:08.903924+0000","last_fullsized":"2024-09-13T18:29:08.903924+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:14.045917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.899114+0000","last_change":"2024-09-13T18:29:08.899114+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.899114+0000","last_undegraded":"2024-09-13T18:29:08.899114+0000","last_fullsized":"2024-09-13T18:29:08.899114+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:52.127760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.890145+0000","last_change":"2024-09-13T18:29:08.890145+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.890145+0000","last_undegraded":"2024-09-13T18:29:08.890145+0000","last_fullsized":"2024-09-13T18:29:08.890145+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:09.962065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897179+0000","last_change":"2024-09-13T18:29:08.897179+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897179+0000","last_undegraded":"2024-09-13T18:29:08.897179+0000","last_fullsized":"2024-09-13T18:29:08.897179+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:00.837327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.896829+0000","last_change":"2024-09-13T18:29:08.896829+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.896829+0000","last_undegraded":"2024-09-13T18:29:08.896829+0000","last_fullsized":"2024-09-13T18:29:08.896829+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:43.676401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.890301+0000","last_change":"2024-09-13T18:29:08.890301+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.890301+0000","last_undegraded":"2024-09-13T18:29:08.890301+0000","last_fullsized":"2024-09-13T18:29:08.890301+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:03.701094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.904010+0000","last_change":"2024-09-13T18:29:08.904010+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.904010+0000","last_undegraded":"2024-09-13T18:29:08.904010+0000","last_fullsized":"2024-09-13T18:29:08.904010+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:37.970067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897136+0000","last_change":"2024-09-13T18:29:08.897136+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897136+0000","last_undegraded":"2024-09-13T18:29:08.897136+0000","last_fullsized":"2024-09-13T18:29:08.897136+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:43.676401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897260+0000","last_change":"2024-09-13T18:29:08.897260+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897260+0000","last_undegraded":"2024-09-13T18:29:08.897260+0000","last_fullsized":"2024-09-13T18:29:08.897260+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:32.068323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897830+0000","last_change":"2024-09-13T18:29:08.897830+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897830+0000","last_undegraded":"2024-09-13T18:29:08.897830+0000","last_fullsized":"2024-09-13T18:29:08.897830+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:12.384532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.894130+0000","last_change":"2024-09-13T18:29:08.894130+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.894130+0000","last_undegraded":"2024-09-13T18:29:08.894130+0000","last_fullsized":"2024-09-13T18:29:08.894130+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:03.701094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897198+0000","last_change":"2024-09-13T18:29:08.897198+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897198+0000","last_undegraded":"2024-09-13T18:29:08.897198+0000","last_fullsized":"2024-09-13T18:29:08.897198+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:15.435159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.899413+0000","last_change":"2024-09-13T18:29:08.899413+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.899413+0000","last_undegraded":"2024-09-13T18:29:08.899413+0000","last_fullsized":"2024-09-13T18:29:08.899413+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:37.970067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.893882+0000","last_change":"2024-09-13T18:29:08.893882+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.893882+0000","last_undegraded":"2024-09-13T18:29:08.893882+0000","last_fullsized":"2024-09-13T18:29:08.893882+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:42.514279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.904080+0000","last_change":"2024-09-13T18:29:08.904080+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.904080+0000","last_undegraded":"2024-09-13T18:29:08.904080+0000","last_fullsized":"2024-09-13T18:29:08.904080+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:32.352134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.890574+0000","last_change":"2024-09-13T18:29:08.890574+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.890574+0000","last_undegraded":"2024-09-13T18:29:08.890574+0000","last_fullsized":"2024-09-13T18:29:08.890574+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:08.869484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:29:06.968329+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:29:06.968329+0000","last_peered":"2024-09-13T18:29:06.968329+0000","last_clean":"2024-09-13T18:29:06.968329+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:29:06.968329+0000","last_undegraded":"2024-09-13T18:29:06.968329+0000","last_fullsized":"2024-09-13T18:29:06.968329+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28116,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343724,"statfs":{"total":96636764160,"available":96607973376,"internally_reserved":0,"allocated":1122304,"data_stored":802860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.77100000000000002,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1240000000000001,"5min":1.163,"15min":1.163},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.79300000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.91200000000000003,"15min":0.91400000000000003},"min":{"1min":0.65800000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.157,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.97199999999999998,"15min":0.97399999999999998},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.177,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.0209999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85899999999999999,"15min":0.85999999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.056},{"interface":"front","average":{"1min":0.872,"5min":0.92200000000000004,"15min":0.93000000000000005},"min":{"1min":0.57899999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.127,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.0800000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.89700000000000002,"15min":0.90000000000000002},"min":{"1min":0.67500000000000004,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.099,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.88400000000000001,"15min":0.87},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.117,"5min":1.125,"15min":1.125},"last":0.85199999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.88900000000000001,"15min":0.90500000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1739999999999999,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.996,"5min":1.0449999999999999,"15min":1.0529999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.2110000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.1559999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.95999999999999996,"15min":0.95599999999999996},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.302,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":1.1870000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0449999999999999,"15min":1.0549999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.274,"5min":1.502,"15min":1.502},"last":1.2929999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.0940000000000001,"15min":1.1160000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.161,"5min":2.077,"15min":2.077},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0589999999999999,"15min":1.0629999999999999},"min":{"1min":0.72199999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.2210000000000001,"5min":1.55,"15min":1.55},"last":1.224}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27536,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":516096,"data_stored":206675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.61499999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.216,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.258}]},{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.83399999999999996,"15min":0.82999999999999996},"min":{"1min":0.58499999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.83599999999999997,"15min":0.82399999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82799999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.81799999999999995,"15min":0.81200000000000006},"min":{"1min":0.54200000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2010000000000001,"5min":1.254,"15min":1.254},"last":1.1379999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.86499999999999999,"15min":0.86899999999999999},"min":{"1min":0.56799999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":1.111}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.86199999999999999,"15min":0.85699999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.125,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.96099999999999997,"15min":0.96699999999999997},"min":{"1min":0.70099999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2070000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.018}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.89900000000000002,"15min":0.90100000000000002},"min":{"1min":0.622,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.165,"5min":1.248,"15min":1.248},"last":1.206},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0029999999999999,"15min":1.01},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.95099999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.05,"15min":1.046},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98899999999999999,"15min":0.99199999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.333}]},{"osd":7,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.002,"15min":1.016},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.256,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.117,"15min":1.1160000000000001},"min":{"1min":0.94999999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.3160000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.236}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":516096,"data_stored":206675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.85699999999999998,"15min":0.86099999999999999},"min":{"1min":0.61899999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1259999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.88900000000000001,"15min":0.89700000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0820000000000001,"5min":1.482,"15min":1.482},"last":0.69599999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80500000000000005,"15min":0.80100000000000005},"min":{"1min":0.65900000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1559999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.95399999999999996,"15min":0.96599999999999997},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1000000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.45200000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.96999999999999997,"15min":0.97499999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0900000000000001,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.627},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.024,"15min":1.032},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.2529999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.65300000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.95699999999999996,"15min":0.97099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1499999999999999,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.96299999999999997,"15min":0.97299999999999998},"min":{"1min":0.59899999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.157,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.55300000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.97299999999999998,"15min":0.999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1160000000000001,"5min":1.304,"15min":1.304},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.89200000000000002,"5min":1.04,"15min":1.0649999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.1799999999999999,"5min":1.542,"15min":1.542},"last":0.77700000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.0449999999999999,"15min":1.0600000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.224,"5min":1.698,"15min":1.698},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.1719999999999999,"15min":1.1879999999999999},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.2010000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.88}]},{"osd":7,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.1990000000000001,"15min":1.2230000000000001},"min":{"1min":0.76100000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.2709999999999999,"5min":1.847,"15min":1.847},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.046,"5min":1.161,"15min":1.1799999999999999},"min":{"1min":0.81299999999999994,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.3149999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.747}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":516096,"data_stored":206675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.92700000000000005,"15min":0.93799999999999994},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1220000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.996,"15min":1.002},"min":{"1min":0.59499999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.111,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.78500000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0389999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.86399999999999999,"15min":0.86899999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1220000000000001,"5min":1.254,"15min":1.254},"last":0.73999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.86399999999999999,"15min":0.88100000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.61499999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.59899999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.996,"15min":1.0029999999999999},"min":{"1min":0.64900000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.24,"5min":1.639,"15min":1.639},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0049999999999999,"15min":1.008},"min":{"1min":0.72899999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1970000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.1319999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.98799999999999999,"15min":1.0109999999999999},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1419999999999999,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.123,"15min":1.1399999999999999},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.2150000000000001,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.84999999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.89400000000000002,"15min":0.89600000000000002},"min":{"1min":0.70899999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":1.04},{"interface":"front","average":{"1min":1.032,"5min":1.1080000000000001,"15min":1.121},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.21,"5min":1.794,"15min":1.794},"last":0.877}]},{"osd":7,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":1.077,"15min":1.1020000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.145,"5min":1.669,"15min":1.669},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.76800000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2390000000000001,"5min":1.282,"15min":1.282},"last":1.0840000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":528384,"data_stored":212492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.69299999999999995,"15min":0.70699999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.84499999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.70199999999999996,"15min":0.69599999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.51300000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.71799999999999997,"15min":0.72799999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.875,"5min":1.165,"15min":1.165},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.83799999999999997,"15min":0.85299999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.042,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0369999999999999,"5min":1.333,"15min":1.333},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.90800000000000003,"15min":0.91900000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.214,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.56399999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.97799999999999998,"15min":0.99199999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.1080000000000001,"5min":1.165,"15min":1.165},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.052,"15min":1.0669999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.79700000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.1919999999999999,"15min":1.2190000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.355,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.997,"5min":1.131,"15min":1.153},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.3049999999999999,"5min":1.718,"15min":1.718},"last":0.53600000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.1419999999999999,"15min":1.1599999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.4159999999999999,"5min":1.47,"15min":1.47},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.246,"15min":1.2729999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.4510000000000001,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.77900000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.123,"15min":1.129},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.752},{"interface":"front","average":{"1min":1.083,"5min":1.1910000000000001,"15min":1.2090000000000001},"min":{"1min":0.76800000000000002,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.385,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.69699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":516096,"data_stored":206675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68100000000000005,"15min":0.68200000000000005},"min":{"1min":0.432,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94999999999999996,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81499999999999995,"15min":0.82499999999999996},"min":{"1min":0.48399999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0429999999999999,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.85299999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.72399999999999998,"15min":0.73599999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92100000000000004,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.749,"15min":0.75600000000000001},"min":{"1min":0.49299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94599999999999995,"5min":1.206,"15min":1.206},"last":1.0549999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68100000000000005,"15min":0.67500000000000004},"min":{"1min":0.54600000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.03,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.86699999999999999,"15min":0.871},"min":{"1min":0.53100000000000003,"5min":0.433,"15min":0.433},"max":{"1min":1.2509999999999999,"5min":1.548,"15min":1.548},"last":1.1579999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.98099999999999998,"15min":0.98899999999999999},"min":{"1min":0.755,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2509999999999999,"5min":1.401,"15min":1.401},"last":1.288},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0680000000000001,"15min":1.083},"min":{"1min":0.70099999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3260000000000001,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.2529999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.92900000000000005,"15min":0.92700000000000005},"min":{"1min":0.67800000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0680000000000001,"15min":1.073},"min":{"1min":0.81799999999999995,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.5840000000000001,"5min":1.869,"15min":1.869},"last":1.3959999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.125,"15min":1.133},"min":{"1min":0.75900000000000001,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.3879999999999999,"5min":2.762,"15min":2.762},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0569999999999999,"15min":1.0609999999999999},"min":{"1min":0.78100000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.393,"5min":1.988,"15min":1.988},"last":1.097}]},{"osd":7,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.1819999999999999,"15min":1.1919999999999999},"min":{"1min":0.79900000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4319999999999999,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.0820000000000001,"15min":1.0760000000000001},"min":{"1min":0.81399999999999995,"5min":0.746,"15min":0.746},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.2230000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":516096,"data_stored":206675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.629,"15min":0.63},"min":{"1min":0.41699999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.131,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.72599999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.49399999999999999,"5min":0.373,"15min":0.373},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.228,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.67900000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79200000000000004,"15min":0.78400000000000003},"min":{"1min":0.54900000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.871},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.80600000000000005,"15min":0.81100000000000005},"min":{"1min":0.53300000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2090000000000001,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.58599999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.96499999999999997,"15min":0.97099999999999997},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.327,"5min":1.524,"15min":1.524},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98099999999999998,"15min":0.98199999999999998},"min":{"1min":0.80700000000000005,"5min":0.747,"15min":0.747},"max":{"1min":1.147,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.994}]},{"osd":5,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.97999999999999998,"15min":0.97399999999999998},"min":{"1min":0.79000000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.2909999999999999,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":2.0960000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.079,"15min":1.085},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.367,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":2.7280000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0920000000000001,"15min":1.105},"min":{"1min":0.76100000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.3420000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.0980000000000001,"15min":1.1020000000000001},"min":{"1min":0.93000000000000005,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.2829999999999999,"5min":1.869,"15min":1.869},"last":2.0489999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.085,"15min":1.087},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.26,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":2.5579999999999998},{"interface":"front","average":{"1min":1.097,"5min":1.1319999999999999,"15min":1.1379999999999999},"min":{"1min":0.82899999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.403,"5min":1.72,"15min":1.72},"last":0.94899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1122304,"data_stored":802860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.52500000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71599999999999997,"15min":0.70999999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94599999999999995,"5min":1.083,"15min":1.083},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.72699999999999998,"15min":0.72099999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.746}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.63900000000000001,"15min":0.629},"min":{"1min":0.56699999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.83399999999999996,"15min":0.83099999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.63}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.96599999999999997,"15min":0.97499999999999998},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.222,"5min":1.302,"15min":1.302},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.91700000000000004,"15min":0.90500000000000003},"min":{"1min":0.70199999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.97799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.97699999999999998,"15min":0.96999999999999997},"min":{"1min":0.746,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.079},{"interface":"front","average":{"1min":1.127,"5min":1.0700000000000001,"15min":1.0600000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.67600000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.109,"15min":1.099},"min":{"1min":0.95199999999999996,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.1279999999999999,"15min":1.135},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.2949999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.0289999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.1259999999999999,"15min":1.1339999999999999},"min":{"1min":0.82899999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.054,"15min":1.044},"min":{"1min":0.878,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.28,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.85299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:29:14.742 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:29:14.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.856+0000 7f23db6aa700 1 Processor -- start 2024-09-13T18:29:14.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.856+0000 7f23db6aa700 1 -- start start 2024-09-13T18:29:14.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.856+0000 7f23db6aa700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f23d4159100 0x7f23d40b1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.856+0000 7f23db6aa700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f23d4070830 0x7f23d40cd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.856+0000 7f23db6aa700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d40b2c30 con 0x7f23d41594e0 2024-09-13T18:29:14.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.856+0000 7f23db6aa700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d40b37d0 con 0x7f23d4159100 2024-09-13T18:29:14.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.856+0000 7f23db6aa700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d40b2020 con 0x7f23d4070830 2024-09-13T18:29:14.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.856+0000 7f23d8c45700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f23d41594e0 0x7f23d40b30c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60384/0 (socket says 172.21.15.44:60384) 2024-09-13T18:29:14.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.856+0000 7f23d8c45700 1 -- 172.21.15.44:0/801468549 learned_addr learned my addr 172.21.15.44:0/801468549 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:29:14.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.856+0000 7f23d9446700 1 --2- 172.21.15.44:0/801468549 >> v2:172.21.15.44:3300/0 conn(0x7f23d4159100 0x7f23d40b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.856+0000 7f23d9c47700 1 --2- 172.21.15.44:0/801468549 >> v2:172.21.15.99:3300/0 conn(0x7f23d4070830 0x7f23d40cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.856+0000 7f23cbfff700 1 -- 172.21.15.44:0/801468549 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630065129 0 0) 0x7f23d40b2c30 con 0x7f23d41594e0 2024-09-13T18:29:14.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.856+0000 7f23cbfff700 1 -- 172.21.15.44:0/801468549 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23bc0035d0 con 0x7f23d41594e0 2024-09-13T18:29:14.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.856+0000 7f23d9446700 1 -- 172.21.15.44:0/801468549 >> v2:172.21.15.99:3300/0 conn(0x7f23d4070830 msgr2=0x7f23d40cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:14.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.856+0000 7f23d9446700 1 --2- 172.21.15.44:0/801468549 >> v2:172.21.15.99:3300/0 conn(0x7f23d4070830 0x7f23d40cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.856+0000 7f23cbfff700 1 -- 172.21.15.44:0/801468549 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3075918357 0 0) 0x7f23bc0035d0 con 0x7f23d41594e0 2024-09-13T18:29:14.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.856+0000 7f23d9446700 1 -- 172.21.15.44:0/801468549 >> v1:172.21.15.44:6789/0 conn(0x7f23d41594e0 legacy=0x7f23d40b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.856+0000 7f23d9446700 1 -- 172.21.15.44:0/801468549 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d40b2300 con 0x7f23d4159100 2024-09-13T18:29:14.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.856+0000 7f23d9446700 1 --2- 172.21.15.44:0/801468549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23d4159100 0x7f23d40b1990 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f23d40cfa80 tx=0x7f23c4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fefda42b00574d1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:14.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.856+0000 7f23cbfff700 1 -- 172.21.15.44:0/801468549 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d00019f0 con 0x7f23d4159100 2024-09-13T18:29:14.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.856+0000 7f23cbfff700 1 -- 172.21.15.44:0/801468549 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c4004030 con 0x7f23d4159100 2024-09-13T18:29:14.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.856+0000 7f23cbfff700 1 -- 172.21.15.44:0/801468549 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c40043a0 con 0x7f23d4159100 2024-09-13T18:29:14.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.860+0000 7f23db6aa700 1 -- 172.21.15.44:0/801468549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23d4159100 msgr2=0x7f23d40b1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.860+0000 7f23db6aa700 1 --2- 172.21.15.44:0/801468549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23d4159100 0x7f23d40b1990 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f23d40cfa80 tx=0x7f23c4009b30 comp rx=0 tx=0).stop 2024-09-13T18:29:14.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.860+0000 7f23db6aa700 1 -- 172.21.15.44:0/801468549 shutdown_connections 2024-09-13T18:29:14.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.860+0000 7f23db6aa700 1 --2- 172.21.15.44:0/801468549 >> v2:172.21.15.99:3300/0 conn(0x7f23d4070830 0x7f23d40cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.860+0000 7f23db6aa700 1 --2- 172.21.15.44:0/801468549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23d4159100 0x7f23d40b1990 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.860+0000 7f23db6aa700 1 -- 172.21.15.44:0/801468549 >> 172.21.15.44:0/801468549 conn(0x7f23d40ce980 msgr2=0x7f23d40ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:14.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.860+0000 7f23db6aa700 1 -- 172.21.15.44:0/801468549 shutdown_connections 2024-09-13T18:29:14.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.860+0000 7f23db6aa700 1 -- 172.21.15.44:0/801468549 wait complete. 2024-09-13T18:29:14.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.860+0000 7f23db6aa700 1 Processor -- start 2024-09-13T18:29:14.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23db6aa700 1 -- start start 2024-09-13T18:29:14.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23db6aa700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23d4070830 0x7f23d415b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23db6aa700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23d4159100 0x7f23d414f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23db6aa700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23d41594e0 0x7f23d4152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23db6aa700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d4153260 con 0x7f23d41594e0 2024-09-13T18:29:14.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23db6aa700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d40aca60 con 0x7f23d4070830 2024-09-13T18:29:14.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23db6aa700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d40acd40 con 0x7f23d4159100 2024-09-13T18:29:14.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23d9c47700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23d41594e0 0x7f23d4152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23d9c47700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23d41594e0 0x7f23d4152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55830/0 (socket says 172.21.15.44:55830) 2024-09-13T18:29:14.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23d9c47700 1 -- 172.21.15.44:0/1374985585 learned_addr learned my addr 172.21.15.44:0/1374985585 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:14.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23d9446700 1 --2- 172.21.15.44:0/1374985585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23d4070830 0x7f23d415b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23d8c45700 1 --2- 172.21.15.44:0/1374985585 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23d4159100 0x7f23d414f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23d9c47700 1 -- 172.21.15.44:0/1374985585 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23d4159100 msgr2=0x7f23d414f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23d9c47700 1 --2- 172.21.15.44:0/1374985585 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23d4159100 0x7f23d414f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23d9c47700 1 -- 172.21.15.44:0/1374985585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23d4070830 msgr2=0x7f23d415b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23d9c47700 1 --2- 172.21.15.44:0/1374985585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23d4070830 0x7f23d415b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23d9c47700 1 -- 172.21.15.44:0/1374985585 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c40094b0 con 0x7f23d41594e0 2024-09-13T18:29:14.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23d8c45700 1 --2- 172.21.15.44:0/1374985585 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23d4159100 0x7f23d414f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:14.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23d9c47700 1 --2- 172.21.15.44:0/1374985585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23d41594e0 0x7f23d4152d20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00eb60 tx=0x7f23cc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:14.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23c9ffb700 1 -- 172.21.15.44:0/1374985585 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc009740 con 0x7f23d41594e0 2024-09-13T18:29:14.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23c9ffb700 1 -- 172.21.15.44:0/1374985585 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc00c850 con 0x7f23d41594e0 2024-09-13T18:29:14.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23db6aa700 1 -- 172.21.15.44:0/1374985585 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d40ad020 con 0x7f23d41594e0 2024-09-13T18:29:14.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23c9ffb700 1 -- 172.21.15.44:0/1374985585 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc00cbe0 con 0x7f23d41594e0 2024-09-13T18:29:14.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.864+0000 7f23db6aa700 1 -- 172.21.15.44:0/1374985585 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d40ad5e0 con 0x7f23d41594e0 2024-09-13T18:29:14.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.868+0000 7f23db6aa700 1 -- 172.21.15.44:0/1374985585 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d40ad800 con 0x7f23d41594e0 2024-09-13T18:29:14.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.868+0000 7f23c9ffb700 1 -- 172.21.15.44:0/1374985585 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f23cc00cd40 con 0x7f23d41594e0 2024-09-13T18:29:14.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.868+0000 7f23c9ffb700 1 --2- 172.21.15.44:0/1374985585 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f23c0066730 0x7f23c0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.868+0000 7f23c9ffb700 1 -- 172.21.15.44:0/1374985585 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23cc0841a0 con 0x7f23d41594e0 2024-09-13T18:29:14.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.868+0000 7f23d9446700 1 --2- 172.21.15.44:0/1374985585 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f23c0066730 0x7f23c0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.872+0000 7f23d9446700 1 --2- 172.21.15.44:0/1374985585 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f23c0066730 0x7f23c0068bf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f23c40090b0 tx=0x7f23c4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:14.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:14.880+0000 7f23c9ffb700 1 -- 172.21.15.44:0/1374985585 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f23cc051500 con 0x7f23d41594e0 2024-09-13T18:29:15.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.040+0000 7f23db6aa700 1 -- 172.21.15.44:0/1374985585 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23d4070cc0 con 0x7f23c0066730 2024-09-13T18:29:15.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.056+0000 7f23c9ffb700 1 -- 172.21.15.44:0/1374985585 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277137 (secure 0 0 0) 0x7f23c401f040 con 0x7f23c0066730 2024-09-13T18:29:15.066 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:29:15.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.064+0000 7f23db6aa700 1 -- 172.21.15.44:0/1374985585 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f23c0066730 msgr2=0x7f23c0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.064+0000 7f23db6aa700 1 --2- 172.21.15.44:0/1374985585 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f23c0066730 0x7f23c0068bf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f23c40090b0 tx=0x7f23c4008030 comp rx=0 tx=0).stop 2024-09-13T18:29:15.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.064+0000 7f23db6aa700 1 -- 172.21.15.44:0/1374985585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23d41594e0 msgr2=0x7f23d4152d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.064+0000 7f23db6aa700 1 --2- 172.21.15.44:0/1374985585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23d41594e0 0x7f23d4152d20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00eb60 tx=0x7f23cc00ee70 comp rx=0 tx=0).stop 2024-09-13T18:29:15.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.064+0000 7f23db6aa700 1 -- 172.21.15.44:0/1374985585 shutdown_connections 2024-09-13T18:29:15.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.064+0000 7f23db6aa700 1 --2- 172.21.15.44:0/1374985585 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f23c0066730 0x7f23c0068bf0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.064+0000 7f23db6aa700 1 --2- 172.21.15.44:0/1374985585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23d41594e0 0x7f23d4152d20 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.064+0000 7f23db6aa700 1 --2- 172.21.15.44:0/1374985585 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23d4159100 0x7f23d414f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.064+0000 7f23db6aa700 1 --2- 172.21.15.44:0/1374985585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23d4070830 0x7f23d415b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.064+0000 7f23db6aa700 1 -- 172.21.15.44:0/1374985585 >> 172.21.15.44:0/1374985585 conn(0x7f23d40ce980 msgr2=0x7f23d415bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:15.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.064+0000 7f23db6aa700 1 -- 172.21.15.44:0/1374985585 shutdown_connections 2024-09-13T18:29:15.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.064+0000 7f23db6aa700 1 -- 172.21.15.44:0/1374985585 wait complete. 2024-09-13T18:29:15.069 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:29:15.082 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-09-13T18:29:14.365814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":221452,"kb_used_data":5228,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753268,"statfs":{"total":773094113280,"available":772867346432,"internally_reserved":0,"allocated":5353472,"data_stored":2851587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.479359"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897751+0000","last_change":"2024-09-13T18:29:08.897751+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897751+0000","last_undegraded":"2024-09-13T18:29:08.897751+0000","last_fullsized":"2024-09-13T18:29:08.897751+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:24.270758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.900289+0000","last_change":"2024-09-13T18:29:08.900289+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.900289+0000","last_undegraded":"2024-09-13T18:29:08.900289+0000","last_fullsized":"2024-09-13T18:29:08.900289+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:47.472350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.893741+0000","last_change":"2024-09-13T18:29:08.893741+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.893741+0000","last_undegraded":"2024-09-13T18:29:08.893741+0000","last_fullsized":"2024-09-13T18:29:08.893741+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:09.962065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.898034+0000","last_change":"2024-09-13T18:29:08.898034+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.898034+0000","last_undegraded":"2024-09-13T18:29:08.898034+0000","last_fullsized":"2024-09-13T18:29:08.898034+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:00.837327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.898425+0000","last_change":"2024-09-13T18:29:08.898425+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.898425+0000","last_undegraded":"2024-09-13T18:29:08.898425+0000","last_fullsized":"2024-09-13T18:29:08.898425+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:25.197012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.900165+0000","last_change":"2024-09-13T18:29:08.900165+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.900165+0000","last_undegraded":"2024-09-13T18:29:08.900165+0000","last_fullsized":"2024-09-13T18:29:08.900165+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:09.004250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.890301+0000","last_change":"2024-09-13T18:29:08.890301+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.890301+0000","last_undegraded":"2024-09-13T18:29:08.890301+0000","last_fullsized":"2024-09-13T18:29:08.890301+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:26.481517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.905393+0000","last_change":"2024-09-13T18:29:08.905393+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.905393+0000","last_undegraded":"2024-09-13T18:29:08.905393+0000","last_fullsized":"2024-09-13T18:29:08.905393+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:24.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.899250+0000","last_change":"2024-09-13T18:29:08.899250+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.899250+0000","last_undegraded":"2024-09-13T18:29:08.899250+0000","last_fullsized":"2024-09-13T18:29:08.899250+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:32.352134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.904159+0000","last_change":"2024-09-13T18:29:08.904159+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.904159+0000","last_undegraded":"2024-09-13T18:29:08.904159+0000","last_fullsized":"2024-09-13T18:29:08.904159+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:47.472350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.898335+0000","last_change":"2024-09-13T18:29:08.898335+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.898335+0000","last_undegraded":"2024-09-13T18:29:08.898335+0000","last_fullsized":"2024-09-13T18:29:08.898335+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:24.270758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.903849+0000","last_change":"2024-09-13T18:29:08.903849+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.903849+0000","last_undegraded":"2024-09-13T18:29:08.903849+0000","last_fullsized":"2024-09-13T18:29:08.903849+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:14.350641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897694+0000","last_change":"2024-09-13T18:29:08.897694+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897694+0000","last_undegraded":"2024-09-13T18:29:08.897694+0000","last_fullsized":"2024-09-13T18:29:08.897694+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:41.337959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897291+0000","last_change":"2024-09-13T18:29:08.897291+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897291+0000","last_undegraded":"2024-09-13T18:29:08.897291+0000","last_fullsized":"2024-09-13T18:29:08.897291+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:25.197012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897011+0000","last_change":"2024-09-13T18:29:08.897011+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897011+0000","last_undegraded":"2024-09-13T18:29:08.897011+0000","last_fullsized":"2024-09-13T18:29:08.897011+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:32.449968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.904902+0000","last_change":"2024-09-13T18:29:08.904902+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.904902+0000","last_undegraded":"2024-09-13T18:29:08.904902+0000","last_fullsized":"2024-09-13T18:29:08.904902+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:05.424273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.903924+0000","last_change":"2024-09-13T18:29:08.903924+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.903924+0000","last_undegraded":"2024-09-13T18:29:08.903924+0000","last_fullsized":"2024-09-13T18:29:08.903924+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:14.045917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.899114+0000","last_change":"2024-09-13T18:29:08.899114+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.899114+0000","last_undegraded":"2024-09-13T18:29:08.899114+0000","last_fullsized":"2024-09-13T18:29:08.899114+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:52.127760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.890145+0000","last_change":"2024-09-13T18:29:08.890145+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.890145+0000","last_undegraded":"2024-09-13T18:29:08.890145+0000","last_fullsized":"2024-09-13T18:29:08.890145+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:09.962065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897179+0000","last_change":"2024-09-13T18:29:08.897179+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897179+0000","last_undegraded":"2024-09-13T18:29:08.897179+0000","last_fullsized":"2024-09-13T18:29:08.897179+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:00.837327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.896829+0000","last_change":"2024-09-13T18:29:08.896829+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.896829+0000","last_undegraded":"2024-09-13T18:29:08.896829+0000","last_fullsized":"2024-09-13T18:29:08.896829+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:43.676401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.890301+0000","last_change":"2024-09-13T18:29:08.890301+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.890301+0000","last_undegraded":"2024-09-13T18:29:08.890301+0000","last_fullsized":"2024-09-13T18:29:08.890301+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:03.701094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.904010+0000","last_change":"2024-09-13T18:29:08.904010+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.904010+0000","last_undegraded":"2024-09-13T18:29:08.904010+0000","last_fullsized":"2024-09-13T18:29:08.904010+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:37.970067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897136+0000","last_change":"2024-09-13T18:29:08.897136+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897136+0000","last_undegraded":"2024-09-13T18:29:08.897136+0000","last_fullsized":"2024-09-13T18:29:08.897136+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:43.676401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897260+0000","last_change":"2024-09-13T18:29:08.897260+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897260+0000","last_undegraded":"2024-09-13T18:29:08.897260+0000","last_fullsized":"2024-09-13T18:29:08.897260+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:32.068323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897830+0000","last_change":"2024-09-13T18:29:08.897830+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897830+0000","last_undegraded":"2024-09-13T18:29:08.897830+0000","last_fullsized":"2024-09-13T18:29:08.897830+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:12.384532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.894130+0000","last_change":"2024-09-13T18:29:08.894130+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.894130+0000","last_undegraded":"2024-09-13T18:29:08.894130+0000","last_fullsized":"2024-09-13T18:29:08.894130+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:03.701094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897198+0000","last_change":"2024-09-13T18:29:08.897198+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897198+0000","last_undegraded":"2024-09-13T18:29:08.897198+0000","last_fullsized":"2024-09-13T18:29:08.897198+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:15.435159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.899413+0000","last_change":"2024-09-13T18:29:08.899413+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.899413+0000","last_undegraded":"2024-09-13T18:29:08.899413+0000","last_fullsized":"2024-09-13T18:29:08.899413+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:37.970067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.893882+0000","last_change":"2024-09-13T18:29:08.893882+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.893882+0000","last_undegraded":"2024-09-13T18:29:08.893882+0000","last_fullsized":"2024-09-13T18:29:08.893882+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:42.514279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.904080+0000","last_change":"2024-09-13T18:29:08.904080+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.904080+0000","last_undegraded":"2024-09-13T18:29:08.904080+0000","last_fullsized":"2024-09-13T18:29:08.904080+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:32.352134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.890574+0000","last_change":"2024-09-13T18:29:08.890574+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.890574+0000","last_undegraded":"2024-09-13T18:29:08.890574+0000","last_fullsized":"2024-09-13T18:29:08.890574+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:08.869484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:29:06.968329+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:29:06.968329+0000","last_peered":"2024-09-13T18:29:06.968329+0000","last_clean":"2024-09-13T18:29:06.968329+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:29:06.968329+0000","last_undegraded":"2024-09-13T18:29:06.968329+0000","last_fullsized":"2024-09-13T18:29:06.968329+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28116,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343724,"statfs":{"total":96636764160,"available":96607973376,"internally_reserved":0,"allocated":1122304,"data_stored":802860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.77100000000000002,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1240000000000001,"5min":1.163,"15min":1.163},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.79300000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.91200000000000003,"15min":0.91400000000000003},"min":{"1min":0.65800000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.157,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.97199999999999998,"15min":0.97399999999999998},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.177,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.0209999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85899999999999999,"15min":0.85999999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.056},{"interface":"front","average":{"1min":0.872,"5min":0.92200000000000004,"15min":0.93000000000000005},"min":{"1min":0.57899999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.127,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.0800000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.89700000000000002,"15min":0.90000000000000002},"min":{"1min":0.67500000000000004,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.099,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.88400000000000001,"15min":0.87},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.117,"5min":1.125,"15min":1.125},"last":0.85199999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.88900000000000001,"15min":0.90500000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1739999999999999,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.996,"5min":1.0449999999999999,"15min":1.0529999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.2110000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.1559999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.95999999999999996,"15min":0.95599999999999996},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.302,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":1.1870000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0449999999999999,"15min":1.0549999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.274,"5min":1.502,"15min":1.502},"last":1.2929999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.0940000000000001,"15min":1.1160000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.161,"5min":2.077,"15min":2.077},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0589999999999999,"15min":1.0629999999999999},"min":{"1min":0.72199999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.2210000000000001,"5min":1.55,"15min":1.55},"last":1.224}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27536,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":516096,"data_stored":206675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.61499999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.216,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.258}]},{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.83399999999999996,"15min":0.82999999999999996},"min":{"1min":0.58499999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.83599999999999997,"15min":0.82399999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82799999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.81799999999999995,"15min":0.81200000000000006},"min":{"1min":0.54200000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2010000000000001,"5min":1.254,"15min":1.254},"last":1.1379999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.86499999999999999,"15min":0.86899999999999999},"min":{"1min":0.56799999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":1.111}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.86199999999999999,"15min":0.85699999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.125,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.96099999999999997,"15min":0.96699999999999997},"min":{"1min":0.70099999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2070000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.018}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.89900000000000002,"15min":0.90100000000000002},"min":{"1min":0.622,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.165,"5min":1.248,"15min":1.248},"last":1.206},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0029999999999999,"15min":1.01},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.95099999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.05,"15min":1.046},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98899999999999999,"15min":0.99199999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.333}]},{"osd":7,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.002,"15min":1.016},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.256,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.117,"15min":1.1160000000000001},"min":{"1min":0.94999999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.3160000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.236}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":516096,"data_stored":206675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.85699999999999998,"15min":0.86099999999999999},"min":{"1min":0.61899999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1259999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.88900000000000001,"15min":0.89700000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0820000000000001,"5min":1.482,"15min":1.482},"last":0.69599999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80500000000000005,"15min":0.80100000000000005},"min":{"1min":0.65900000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1559999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.95399999999999996,"15min":0.96599999999999997},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1000000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.45200000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.96999999999999997,"15min":0.97499999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0900000000000001,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.627},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.024,"15min":1.032},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.2529999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.65300000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.95699999999999996,"15min":0.97099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1499999999999999,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.96299999999999997,"15min":0.97299999999999998},"min":{"1min":0.59899999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.157,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.55300000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.97299999999999998,"15min":0.999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1160000000000001,"5min":1.304,"15min":1.304},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.89200000000000002,"5min":1.04,"15min":1.0649999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.1799999999999999,"5min":1.542,"15min":1.542},"last":0.77700000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.0449999999999999,"15min":1.0600000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.224,"5min":1.698,"15min":1.698},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.1719999999999999,"15min":1.1879999999999999},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.2010000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.88}]},{"osd":7,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.1990000000000001,"15min":1.2230000000000001},"min":{"1min":0.76100000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.2709999999999999,"5min":1.847,"15min":1.847},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.046,"5min":1.161,"15min":1.1799999999999999},"min":{"1min":0.81299999999999994,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.3149999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.747}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":516096,"data_stored":206675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.92700000000000005,"15min":0.93799999999999994},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1220000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.996,"15min":1.002},"min":{"1min":0.59499999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.111,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.78500000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0389999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.86399999999999999,"15min":0.86899999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1220000000000001,"5min":1.254,"15min":1.254},"last":0.73999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.86399999999999999,"15min":0.88100000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.61499999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.59899999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.996,"15min":1.0029999999999999},"min":{"1min":0.64900000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.24,"5min":1.639,"15min":1.639},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0049999999999999,"15min":1.008},"min":{"1min":0.72899999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1970000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.1319999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.98799999999999999,"15min":1.0109999999999999},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1419999999999999,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.123,"15min":1.1399999999999999},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.2150000000000001,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.84999999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.89400000000000002,"15min":0.89600000000000002},"min":{"1min":0.70899999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":1.04},{"interface":"front","average":{"1min":1.032,"5min":1.1080000000000001,"15min":1.121},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.21,"5min":1.794,"15min":1.794},"last":0.877}]},{"osd":7,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":1.077,"15min":1.1020000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.145,"5min":1.669,"15min":1.669},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.76800000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2390000000000001,"5min":1.282,"15min":1.282},"last":1.0840000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":528384,"data_stored":212492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.69299999999999995,"15min":0.70699999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.84499999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.70199999999999996,"15min":0.69599999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.51300000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.71799999999999997,"15min":0.72799999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.875,"5min":1.165,"15min":1.165},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.83799999999999997,"15min":0.85299999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.042,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0369999999999999,"5min":1.333,"15min":1.333},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.90800000000000003,"15min":0.91900000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.214,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.56399999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.97799999999999998,"15min":0.99199999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.1080000000000001,"5min":1.165,"15min":1.165},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.052,"15min":1.0669999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.79700000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.1919999999999999,"15min":1.2190000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.355,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.997,"5min":1.131,"15min":1.153},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.3049999999999999,"5min":1.718,"15min":1.718},"last":0.53600000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.1419999999999999,"15min":1.1599999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.4159999999999999,"5min":1.47,"15min":1.47},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.246,"15min":1.2729999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.4510000000000001,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.77900000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.123,"15min":1.129},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.752},{"interface":"front","average":{"1min":1.083,"5min":1.1910000000000001,"15min":1.2090000000000001},"min":{"1min":0.76800000000000002,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.385,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.69699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":516096,"data_stored":206675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68100000000000005,"15min":0.68200000000000005},"min":{"1min":0.432,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94999999999999996,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81499999999999995,"15min":0.82499999999999996},"min":{"1min":0.48399999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0429999999999999,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.85299999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.72399999999999998,"15min":0.73599999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92100000000000004,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.749,"15min":0.75600000000000001},"min":{"1min":0.49299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94599999999999995,"5min":1.206,"15min":1.206},"last":1.0549999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68100000000000005,"15min":0.67500000000000004},"min":{"1min":0.54600000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.03,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.86699999999999999,"15min":0.871},"min":{"1min":0.53100000000000003,"5min":0.433,"15min":0.433},"max":{"1min":1.2509999999999999,"5min":1.548,"15min":1.548},"last":1.1579999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.98099999999999998,"15min":0.98899999999999999},"min":{"1min":0.755,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2509999999999999,"5min":1.401,"15min":1.401},"last":1.288},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0680000000000001,"15min":1.083},"min":{"1min":0.70099999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3260000000000001,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.2529999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.92900000000000005,"15min":0.92700000000000005},"min":{"1min":0.67800000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0680000000000001,"15min":1.073},"min":{"1min":0.81799999999999995,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.5840000000000001,"5min":1.869,"15min":1.869},"last":1.3959999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.125,"15min":1.133},"min":{"1min":0.75900000000000001,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.3879999999999999,"5min":2.762,"15min":2.762},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0569999999999999,"15min":1.0609999999999999},"min":{"1min":0.78100000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.393,"5min":1.988,"15min":1.988},"last":1.097}]},{"osd":7,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.1819999999999999,"15min":1.1919999999999999},"min":{"1min":0.79900000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4319999999999999,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.0820000000000001,"15min":1.0760000000000001},"min":{"1min":0.81399999999999995,"5min":0.746,"15min":0.746},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.2230000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":516096,"data_stored":206675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.629,"15min":0.63},"min":{"1min":0.41699999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.131,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.72599999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.49399999999999999,"5min":0.373,"15min":0.373},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.228,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.67900000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79200000000000004,"15min":0.78400000000000003},"min":{"1min":0.54900000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.871},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.80600000000000005,"15min":0.81100000000000005},"min":{"1min":0.53300000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2090000000000001,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.58599999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.96499999999999997,"15min":0.97099999999999997},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.327,"5min":1.524,"15min":1.524},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98099999999999998,"15min":0.98199999999999998},"min":{"1min":0.80700000000000005,"5min":0.747,"15min":0.747},"max":{"1min":1.147,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.994}]},{"osd":5,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.97999999999999998,"15min":0.97399999999999998},"min":{"1min":0.79000000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.2909999999999999,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":2.0960000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.079,"15min":1.085},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.367,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":2.7280000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0920000000000001,"15min":1.105},"min":{"1min":0.76100000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.3420000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.0980000000000001,"15min":1.1020000000000001},"min":{"1min":0.93000000000000005,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.2829999999999999,"5min":1.869,"15min":1.869},"last":2.0489999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.085,"15min":1.087},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.26,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":2.5579999999999998},{"interface":"front","average":{"1min":1.097,"5min":1.1319999999999999,"15min":1.1379999999999999},"min":{"1min":0.82899999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.403,"5min":1.72,"15min":1.72},"last":0.94899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1122304,"data_stored":802860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.52500000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71599999999999997,"15min":0.70999999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94599999999999995,"5min":1.083,"15min":1.083},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.72699999999999998,"15min":0.72099999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.746}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.63900000000000001,"15min":0.629},"min":{"1min":0.56699999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.83399999999999996,"15min":0.83099999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.63}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.96599999999999997,"15min":0.97499999999999998},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.222,"5min":1.302,"15min":1.302},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.91700000000000004,"15min":0.90500000000000003},"min":{"1min":0.70199999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.97799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.97699999999999998,"15min":0.96999999999999997},"min":{"1min":0.746,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.079},{"interface":"front","average":{"1min":1.127,"5min":1.0700000000000001,"15min":1.0600000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.67600000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.109,"15min":1.099},"min":{"1min":0.95199999999999996,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.1279999999999999,"15min":1.135},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.2949999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.0289999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.1259999999999999,"15min":1.1339999999999999},"min":{"1min":0.82899999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.054,"15min":1.044},"min":{"1min":0.878,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.28,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.85299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:29:15.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2024-09-13T18:29:15.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2024-09-13T18:29:15.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2024-09-13T18:29:15.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2024-09-13T18:29:15.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2024-09-13T18:29:15.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2024-09-13T18:29:15.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2024-09-13T18:29:15.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2024-09-13T18:29:15.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2024-09-13T18:29:15.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2024-09-13T18:29:15.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2024-09-13T18:29:15.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2024-09-13T18:29:15.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2024-09-13T18:29:15.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2024-09-13T18:29:15.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2024-09-13T18:29:15.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2024-09-13T18:29:15.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2024-09-13T18:29:15.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2024-09-13T18:29:15.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2024-09-13T18:29:15.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2024-09-13T18:29:15.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2024-09-13T18:29:15.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2024-09-13T18:29:15.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2024-09-13T18:29:15.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2024-09-13T18:29:15.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2024-09-13T18:29:15.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2024-09-13T18:29:15.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2024-09-13T18:29:15.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2024-09-13T18:29:15.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2024-09-13T18:29:15.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2024-09-13T18:29:15.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2024-09-13T18:29:15.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2024-09-13T18:29:15.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2024-09-13T18:29:15.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2024-09-13T18:29:15.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.897751+0000', 'last_change': '2024-09-13T18:29:08.897751+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.897751+0000', 'last_undegraded': '2024-09-13T18:29:08.897751+0000', 'last_fullsized': '2024-09-13T18:29:08.897751+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:48:24.270758+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:29:15.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2024-09-13T18:29:15.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.150 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2024-09-13T18:29:15.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.900289+0000', 'last_change': '2024-09-13T18:29:08.900289+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.900289+0000', 'last_undegraded': '2024-09-13T18:29:08.900289+0000', 'last_fullsized': '2024-09-13T18:29:08.900289+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:16:47.472350+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:29:15.150 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2024-09-13T18:29:15.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.150 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2024-09-13T18:29:15.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.893741+0000', 'last_change': '2024-09-13T18:29:08.893741+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.893741+0000', 'last_undegraded': '2024-09-13T18:29:08.893741+0000', 'last_fullsized': '2024-09-13T18:29:08.893741+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:52:09.962065+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:29:15.150 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2024-09-13T18:29:15.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.151 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2024-09-13T18:29:15.151 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.898034+0000', 'last_change': '2024-09-13T18:29:08.898034+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.898034+0000', 'last_undegraded': '2024-09-13T18:29:08.898034+0000', 'last_fullsized': '2024-09-13T18:29:08.898034+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:29:00.837327+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:29:15.151 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2024-09-13T18:29:15.151 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.151 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2024-09-13T18:29:15.151 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.898425+0000', 'last_change': '2024-09-13T18:29:08.898425+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.898425+0000', 'last_undegraded': '2024-09-13T18:29:08.898425+0000', 'last_fullsized': '2024-09-13T18:29:08.898425+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:04:25.197012+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:29:15.151 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2024-09-13T18:29:15.151 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.151 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2024-09-13T18:29:15.151 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.900165+0000', 'last_change': '2024-09-13T18:29:08.900165+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.900165+0000', 'last_undegraded': '2024-09-13T18:29:08.900165+0000', 'last_fullsized': '2024-09-13T18:29:08.900165+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:36:09.004250+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:29:15.151 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2024-09-13T18:29:15.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2024-09-13T18:29:15.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.890301+0000', 'last_change': '2024-09-13T18:29:08.890301+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.890301+0000', 'last_undegraded': '2024-09-13T18:29:08.890301+0000', 'last_fullsized': '2024-09-13T18:29:08.890301+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:55:26.481517+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:29:15.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2024-09-13T18:29:15.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2024-09-13T18:29:15.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.905393+0000', 'last_change': '2024-09-13T18:29:08.905393+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.905393+0000', 'last_undegraded': '2024-09-13T18:29:08.905393+0000', 'last_fullsized': '2024-09-13T18:29:08.905393+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:41:24.724220+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:29:15.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2024-09-13T18:29:15.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2024-09-13T18:29:15.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.899250+0000', 'last_change': '2024-09-13T18:29:08.899250+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.899250+0000', 'last_undegraded': '2024-09-13T18:29:08.899250+0000', 'last_fullsized': '2024-09-13T18:29:08.899250+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:32:32.352134+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:29:15.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2024-09-13T18:29:15.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2024-09-13T18:29:15.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.904159+0000', 'last_change': '2024-09-13T18:29:08.904159+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.904159+0000', 'last_undegraded': '2024-09-13T18:29:08.904159+0000', 'last_fullsized': '2024-09-13T18:29:08.904159+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:16:47.472350+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:29:15.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2024-09-13T18:29:15.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2024-09-13T18:29:15.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.898335+0000', 'last_change': '2024-09-13T18:29:08.898335+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.898335+0000', 'last_undegraded': '2024-09-13T18:29:08.898335+0000', 'last_fullsized': '2024-09-13T18:29:08.898335+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:48:24.270758+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:29:15.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2024-09-13T18:29:15.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2024-09-13T18:29:15.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.903849+0000', 'last_change': '2024-09-13T18:29:08.903849+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.903849+0000', 'last_undegraded': '2024-09-13T18:29:08.903849+0000', 'last_fullsized': '2024-09-13T18:29:08.903849+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:51:14.350641+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:29:15.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2024-09-13T18:29:15.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2024-09-13T18:29:15.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.897694+0000', 'last_change': '2024-09-13T18:29:08.897694+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.897694+0000', 'last_undegraded': '2024-09-13T18:29:08.897694+0000', 'last_fullsized': '2024-09-13T18:29:08.897694+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:29:41.337959+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:29:15.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2024-09-13T18:29:15.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2024-09-13T18:29:15.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.897291+0000', 'last_change': '2024-09-13T18:29:08.897291+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.897291+0000', 'last_undegraded': '2024-09-13T18:29:08.897291+0000', 'last_fullsized': '2024-09-13T18:29:08.897291+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:04:25.197012+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:29:15.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2024-09-13T18:29:15.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2024-09-13T18:29:15.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.897011+0000', 'last_change': '2024-09-13T18:29:08.897011+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.897011+0000', 'last_undegraded': '2024-09-13T18:29:08.897011+0000', 'last_fullsized': '2024-09-13T18:29:08.897011+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T06:21:32.449968+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:29:15.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2024-09-13T18:29:15.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2024-09-13T18:29:15.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.904902+0000', 'last_change': '2024-09-13T18:29:08.904902+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.904902+0000', 'last_undegraded': '2024-09-13T18:29:08.904902+0000', 'last_fullsized': '2024-09-13T18:29:08.904902+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:15:05.424273+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:29:15.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2024-09-13T18:29:15.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2024-09-13T18:29:15.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.903924+0000', 'last_change': '2024-09-13T18:29:08.903924+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.903924+0000', 'last_undegraded': '2024-09-13T18:29:08.903924+0000', 'last_fullsized': '2024-09-13T18:29:08.903924+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:05:14.045917+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:29:15.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2024-09-13T18:29:15.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2024-09-13T18:29:15.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.899114+0000', 'last_change': '2024-09-13T18:29:08.899114+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.899114+0000', 'last_undegraded': '2024-09-13T18:29:08.899114+0000', 'last_fullsized': '2024-09-13T18:29:08.899114+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:13:52.127760+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:29:15.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2024-09-13T18:29:15.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2024-09-13T18:29:15.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.890145+0000', 'last_change': '2024-09-13T18:29:08.890145+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.890145+0000', 'last_undegraded': '2024-09-13T18:29:08.890145+0000', 'last_fullsized': '2024-09-13T18:29:08.890145+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:52:09.962065+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:29:15.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2024-09-13T18:29:15.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2024-09-13T18:29:15.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.897179+0000', 'last_change': '2024-09-13T18:29:08.897179+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.897179+0000', 'last_undegraded': '2024-09-13T18:29:08.897179+0000', 'last_fullsized': '2024-09-13T18:29:08.897179+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:29:00.837327+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:29:15.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2024-09-13T18:29:15.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2024-09-13T18:29:15.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.896829+0000', 'last_change': '2024-09-13T18:29:08.896829+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.896829+0000', 'last_undegraded': '2024-09-13T18:29:08.896829+0000', 'last_fullsized': '2024-09-13T18:29:08.896829+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:54:43.676401+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:29:15.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2024-09-13T18:29:15.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2024-09-13T18:29:15.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.890301+0000', 'last_change': '2024-09-13T18:29:08.890301+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.890301+0000', 'last_undegraded': '2024-09-13T18:29:08.890301+0000', 'last_fullsized': '2024-09-13T18:29:08.890301+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:08:03.701094+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:29:15.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2024-09-13T18:29:15.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2024-09-13T18:29:15.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.904010+0000', 'last_change': '2024-09-13T18:29:08.904010+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.904010+0000', 'last_undegraded': '2024-09-13T18:29:08.904010+0000', 'last_fullsized': '2024-09-13T18:29:08.904010+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:54:37.970067+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:29:15.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2024-09-13T18:29:15.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2024-09-13T18:29:15.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.897136+0000', 'last_change': '2024-09-13T18:29:08.897136+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.897136+0000', 'last_undegraded': '2024-09-13T18:29:08.897136+0000', 'last_fullsized': '2024-09-13T18:29:08.897136+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:54:43.676401+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:29:15.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2024-09-13T18:29:15.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2024-09-13T18:29:15.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.897260+0000', 'last_change': '2024-09-13T18:29:08.897260+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.897260+0000', 'last_undegraded': '2024-09-13T18:29:08.897260+0000', 'last_fullsized': '2024-09-13T18:29:08.897260+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:07:32.068323+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:29:15.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2024-09-13T18:29:15.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2024-09-13T18:29:15.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.897830+0000', 'last_change': '2024-09-13T18:29:08.897830+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.897830+0000', 'last_undegraded': '2024-09-13T18:29:08.897830+0000', 'last_fullsized': '2024-09-13T18:29:08.897830+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:55:12.384532+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:29:15.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2024-09-13T18:29:15.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2024-09-13T18:29:15.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.894130+0000', 'last_change': '2024-09-13T18:29:08.894130+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.894130+0000', 'last_undegraded': '2024-09-13T18:29:08.894130+0000', 'last_fullsized': '2024-09-13T18:29:08.894130+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:08:03.701094+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:29:15.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2024-09-13T18:29:15.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2024-09-13T18:29:15.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.897198+0000', 'last_change': '2024-09-13T18:29:08.897198+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.897198+0000', 'last_undegraded': '2024-09-13T18:29:08.897198+0000', 'last_fullsized': '2024-09-13T18:29:08.897198+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T06:14:15.435159+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:29:15.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2024-09-13T18:29:15.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2024-09-13T18:29:15.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.899413+0000', 'last_change': '2024-09-13T18:29:08.899413+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.899413+0000', 'last_undegraded': '2024-09-13T18:29:08.899413+0000', 'last_fullsized': '2024-09-13T18:29:08.899413+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:54:37.970067+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:29:15.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2024-09-13T18:29:15.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2024-09-13T18:29:15.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.893882+0000', 'last_change': '2024-09-13T18:29:08.893882+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.893882+0000', 'last_undegraded': '2024-09-13T18:29:08.893882+0000', 'last_fullsized': '2024-09-13T18:29:08.893882+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:29:42.514279+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:29:15.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2024-09-13T18:29:15.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2024-09-13T18:29:15.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.904080+0000', 'last_change': '2024-09-13T18:29:08.904080+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.904080+0000', 'last_undegraded': '2024-09-13T18:29:08.904080+0000', 'last_fullsized': '2024-09-13T18:29:08.904080+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:32:32.352134+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:29:15.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2024-09-13T18:29:15.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:09.886784+0000', 'last_change': '2024-09-13T18:29:09.886784+0000', 'last_active': '2024-09-13T18:29:09.886784+0000', 'last_peered': '2024-09-13T18:29:09.886784+0000', 'last_clean': '2024-09-13T18:29:09.886784+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:09.886784+0000', 'last_undegraded': '2024-09-13T18:29:09.886784+0000', 'last_fullsized': '2024-09-13T18:29:09.886784+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:09.886784+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:15.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2024-09-13T18:29:15.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:29:08.890574+0000', 'last_change': '2024-09-13T18:29:08.890574+0000', 'last_active': '2024-09-13T18:29:08.877547+0000', 'last_peered': '2024-09-13T18:29:08.877547+0000', 'last_clean': '2024-09-13T18:29:08.877547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:08.890574+0000', 'last_undegraded': '2024-09-13T18:29:08.890574+0000', 'last_fullsized': '2024-09-13T18:29:08.890574+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:08.877547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:44:08.869484+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:29:15.161 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:29:15.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.280+0000 7f3eba9cf700 1 Processor -- start 2024-09-13T18:29:15.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.280+0000 7f3eba9cf700 1 -- start start 2024-09-13T18:29:15.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.280+0000 7f3eba9cf700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3eb4159720 0x7f3eb406cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.280+0000 7f3eba9cf700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb406aed0 con 0x7f3eb40b3ae0 2024-09-13T18:29:15.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.280+0000 7f3eba9cf700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb406d690 con 0x7f3eb406aa90 2024-09-13T18:29:15.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.280+0000 7f3eba9cf700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40cbfe0 con 0x7f3eb4159720 2024-09-13T18:29:15.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.280+0000 7f3eba1ce700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3eb40b3ae0 0x7f3eb40ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60390/0 (socket says 172.21.15.44:60390) 2024-09-13T18:29:15.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.280+0000 7f3eba1ce700 1 -- 172.21.15.44:0/573966199 learned_addr learned my addr 172.21.15.44:0/573966199 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:29:15.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.280+0000 7f3eb99cd700 1 --2- 172.21.15.44:0/573966199 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3eb4159720 0x7f3eb406cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.280+0000 7f3eb89cb700 1 -- 172.21.15.44:0/573966199 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623476233 0 0) 0x7f3eb406aed0 con 0x7f3eb40b3ae0 2024-09-13T18:29:15.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb89cb700 1 -- 172.21.15.44:0/573966199 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ea00057e0 con 0x7f3eb40b3ae0 2024-09-13T18:29:15.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb89cb700 1 -- 172.21.15.44:0/573966199 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415022157 0 0) 0x7f3eb406d690 con 0x7f3eb406aa90 2024-09-13T18:29:15.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb89cb700 1 -- 172.21.15.44:0/573966199 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3eb406aed0 con 0x7f3eb406aa90 2024-09-13T18:29:15.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb89cb700 1 -- 172.21.15.44:0/573966199 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 984735768 0 0) 0x7f3ea00057e0 con 0x7f3eb40b3ae0 2024-09-13T18:29:15.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb89cb700 1 -- 172.21.15.44:0/573966199 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3eb4159720 msgr2=0x7f3eb406cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:15.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb89cb700 1 --2- 172.21.15.44:0/573966199 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3eb4159720 0x7f3eb406cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb89cb700 1 -- 172.21.15.44:0/573966199 >> v1:172.21.15.99:6789/0 conn(0x7f3eb406aa90 legacy=0x7f3eb40b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb89cb700 1 -- 172.21.15.44:0/573966199 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb40cc2c0 con 0x7f3eb40b3ae0 2024-09-13T18:29:15.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb89cb700 1 -- 172.21.15.44:0/573966199 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f3eac0019f0 con 0x7f3eb40b3ae0 2024-09-13T18:29:15.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb89cb700 1 -- 172.21.15.44:0/573966199 >> v1:172.21.15.44:6789/0 conn(0x7f3eb40b3ae0 legacy=0x7f3eb40ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb89cb700 1 --2- 172.21.15.44:0/573966199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ea0005df0 0x7f3ea00061f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb89cb700 1 --2- 172.21.15.44:0/573966199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ea0006a80 0x7f3ea0006f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb89cb700 1 --2- 172.21.15.44:0/573966199 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3ea0007440 0x7f3ea000dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb89cb700 1 -- 172.21.15.44:0/573966199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40cbfe0 con 0x7f3ea0006a80 2024-09-13T18:29:15.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb89cb700 1 -- 172.21.15.44:0/573966199 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea000e2b0 con 0x7f3ea0005df0 2024-09-13T18:29:15.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb89cb700 1 -- 172.21.15.44:0/573966199 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea000e470 con 0x7f3ea0007440 2024-09-13T18:29:15.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb99cd700 1 --2- 172.21.15.44:0/573966199 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3eb4159720 0x7f3eb406cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:15.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb91cc700 1 --2- 172.21.15.44:0/573966199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ea0006a80 0x7f3ea0006f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb99cd700 1 --2- 172.21.15.44:0/573966199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ea0005df0 0x7f3ea00061f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eba1ce700 1 --2- 172.21.15.44:0/573966199 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3ea0007440 0x7f3ea000dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb91cc700 1 -- 172.21.15.44:0/573966199 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3ea0007440 msgr2=0x7f3ea000dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:15.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb91cc700 1 --2- 172.21.15.44:0/573966199 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3ea0007440 0x7f3ea000dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb91cc700 1 -- 172.21.15.44:0/573966199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ea0005df0 msgr2=0x7f3ea00061f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:15.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb91cc700 1 --2- 172.21.15.44:0/573966199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ea0005df0 0x7f3ea00061f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb91cc700 1 -- 172.21.15.44:0/573966199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea00057e0 con 0x7f3ea0006a80 2024-09-13T18:29:15.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb99cd700 1 --2- 172.21.15.44:0/573966199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ea0005df0 0x7f3ea00061f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:15.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb91cc700 1 --2- 172.21.15.44:0/573966199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ea0006a80 0x7f3ea0006f00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40ae190 tx=0x7f3ea0007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1096d145fc9fb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:15.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb89cb700 1 -- 172.21.15.44:0/573966199 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4001440 con 0x7f3ea0006a80 2024-09-13T18:29:15.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb89cb700 1 -- 172.21.15.44:0/573966199 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea40052d0 con 0x7f3ea0006a80 2024-09-13T18:29:15.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eb89cb700 1 -- 172.21.15.44:0/573966199 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4001d50 con 0x7f3ea0006a80 2024-09-13T18:29:15.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eba9cf700 1 -- 172.21.15.44:0/573966199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ea0006a80 msgr2=0x7f3ea0006f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eba9cf700 1 --2- 172.21.15.44:0/573966199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ea0006a80 0x7f3ea0006f00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40ae190 tx=0x7f3ea0007ab0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eba1ce700 1 -- 172.21.15.44:0/573966199 reap_dead start 2024-09-13T18:29:15.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eba9cf700 1 -- 172.21.15.44:0/573966199 shutdown_connections 2024-09-13T18:29:15.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eba9cf700 1 -- 172.21.15.44:0/573966199 >> 172.21.15.44:0/573966199 conn(0x7f3eb40b0f00 msgr2=0x7f3eb40b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:15.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eba9cf700 1 -- 172.21.15.44:0/573966199 shutdown_connections 2024-09-13T18:29:15.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.284+0000 7f3eba9cf700 1 -- 172.21.15.44:0/573966199 wait complete. 2024-09-13T18:29:15.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.288+0000 7f3eba9cf700 1 Processor -- start 2024-09-13T18:29:15.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.288+0000 7f3eba9cf700 1 -- start start 2024-09-13T18:29:15.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.288+0000 7f3eba9cf700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3ea0006a80 0x7f3eb415c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.288+0000 7f3eba9cf700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3eb41f2b00 0x7f3eb4155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.288+0000 7f3eba9cf700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3eb40ac8c0 0x7f3eb40acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.288+0000 7f3eba9cf700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40ad280 con 0x7f3eb41f2b00 2024-09-13T18:29:15.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.288+0000 7f3eba9cf700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb41f3020 con 0x7f3eb40ac8c0 2024-09-13T18:29:15.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.288+0000 7f3eba9cf700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb41f3300 con 0x7f3ea0006a80 2024-09-13T18:29:15.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.288+0000 7f3eb91cc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3eb41f2b00 0x7f3eb4155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.288+0000 7f3eb91cc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3eb41f2b00 0x7f3eb4155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55844/0 (socket says 172.21.15.44:55844) 2024-09-13T18:29:15.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.288+0000 7f3eb91cc700 1 -- 172.21.15.44:0/27036698 learned_addr learned my addr 172.21.15.44:0/27036698 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:15.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.288+0000 7f3eb99cd700 1 --2- 172.21.15.44:0/27036698 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3ea0006a80 0x7f3eb415c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.288+0000 7f3eba1ce700 1 --2- 172.21.15.44:0/27036698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3eb40ac8c0 0x7f3eb40acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.292+0000 7f3eb91cc700 1 -- 172.21.15.44:0/27036698 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3ea0006a80 msgr2=0x7f3eb415c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.292+0000 7f3eb91cc700 1 --2- 172.21.15.44:0/27036698 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3ea0006a80 0x7f3eb415c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.292+0000 7f3eb91cc700 1 -- 172.21.15.44:0/27036698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3eb40ac8c0 msgr2=0x7f3eb40acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.292+0000 7f3eb91cc700 1 --2- 172.21.15.44:0/27036698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3eb40ac8c0 0x7f3eb40acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.292+0000 7f3eb91cc700 1 -- 172.21.15.44:0/27036698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb41f35e0 con 0x7f3eb41f2b00 2024-09-13T18:29:15.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.292+0000 7f3eb91cc700 1 --2- 172.21.15.44:0/27036698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3eb41f2b00 0x7f3eb4155070 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400c3c0 tx=0x7f3ea40012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:15.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.292+0000 7f3eaa7fc700 1 -- 172.21.15.44:0/27036698 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4001d50 con 0x7f3eb41f2b00 2024-09-13T18:29:15.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.292+0000 7f3eaa7fc700 1 -- 172.21.15.44:0/27036698 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea4006e70 con 0x7f3eb41f2b00 2024-09-13T18:29:15.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.292+0000 7f3eba9cf700 1 -- 172.21.15.44:0/27036698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb41f38c0 con 0x7f3eb41f2b00 2024-09-13T18:29:15.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.292+0000 7f3eaa7fc700 1 -- 172.21.15.44:0/27036698 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4007260 con 0x7f3eb41f2b00 2024-09-13T18:29:15.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.292+0000 7f3eba9cf700 1 -- 172.21.15.44:0/27036698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb41555b0 con 0x7f3eb41f2b00 2024-09-13T18:29:15.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.292+0000 7f3eba9cf700 1 -- 172.21.15.44:0/27036698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb4159b00 con 0x7f3eb41f2b00 2024-09-13T18:29:15.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.292+0000 7f3eaa7fc700 1 -- 172.21.15.44:0/27036698 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3ea40073c0 con 0x7f3eb41f2b00 2024-09-13T18:29:15.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.296+0000 7f3eaa7fc700 1 --2- 172.21.15.44:0/27036698 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3e98066730 0x7f3e98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.296+0000 7f3eaa7fc700 1 -- 172.21.15.44:0/27036698 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ea4084fb0 con 0x7f3eb41f2b00 2024-09-13T18:29:15.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.296+0000 7f3eb99cd700 1 --2- 172.21.15.44:0/27036698 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3e98066730 0x7f3e98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.296+0000 7f3eb99cd700 1 --2- 172.21.15.44:0/27036698 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3e98066730 0x7f3e98068bf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4071cb0 tx=0x7f3eb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:15.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.300+0000 7f3eaa7fc700 1 -- 172.21.15.44:0/27036698 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3ea40b6db0 con 0x7f3eb41f2b00 2024-09-13T18:29:15.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.536+0000 7f3eba9cf700 1 -- 172.21.15.44:0/27036698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f3eb40b33d0 con 0x7f3eb41f2b00 2024-09-13T18:29:15.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.536+0000 7f3eaa7fc700 1 -- 172.21.15.44:0/27036698 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1269 (secure 0 0 0) 0x7f3ea40524d0 con 0x7f3eb41f2b00 2024-09-13T18:29:15.542 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:29:15.542 INFO:teuthology.orchestra.run.smithi044.stdout:{"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":158,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":48,"num_osds":8,"num_up_osds":8,"osd_up_since":1726252008,"num_in_osds":8,"osd_in_since":1726251999,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":226766848,"bytes_avail":772867346432,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":31,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5982}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-09-13T18:29:00.360424+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T18:29:15.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.540+0000 7f3eba9cf700 1 -- 172.21.15.44:0/27036698 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3e98066730 msgr2=0x7f3e98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.540+0000 7f3eba9cf700 1 --2- 172.21.15.44:0/27036698 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3e98066730 0x7f3e98068bf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4071cb0 tx=0x7f3eb0008040 comp rx=0 tx=0).stop 2024-09-13T18:29:15.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.540+0000 7f3eba9cf700 1 -- 172.21.15.44:0/27036698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3eb41f2b00 msgr2=0x7f3eb4155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.540+0000 7f3eba9cf700 1 --2- 172.21.15.44:0/27036698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3eb41f2b00 0x7f3eb4155070 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400c3c0 tx=0x7f3ea40012d0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.540+0000 7f3eba9cf700 1 -- 172.21.15.44:0/27036698 shutdown_connections 2024-09-13T18:29:15.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.540+0000 7f3eba9cf700 1 --2- 172.21.15.44:0/27036698 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3e98066730 0x7f3e98068bf0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.540+0000 7f3eba9cf700 1 --2- 172.21.15.44:0/27036698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3eb40ac8c0 0x7f3eb40acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.540+0000 7f3eba9cf700 1 --2- 172.21.15.44:0/27036698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3eb41f2b00 0x7f3eb4155070 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.540+0000 7f3eba9cf700 1 --2- 172.21.15.44:0/27036698 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3ea0006a80 0x7f3eb415c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.540+0000 7f3eba9cf700 1 -- 172.21.15.44:0/27036698 >> 172.21.15.44:0/27036698 conn(0x7f3eb40b0f00 msgr2=0x7f3eb40af880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:15.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.540+0000 7f3eba9cf700 1 -- 172.21.15.44:0/27036698 shutdown_connections 2024-09-13T18:29:15.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.540+0000 7f3eba9cf700 1 -- 172.21.15.44:0/27036698 wait complete. 2024-09-13T18:29:15.558 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T18:29:15.558 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:29:15.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.664+0000 7feaad3cd700 1 Processor -- start 2024-09-13T18:29:15.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.664+0000 7feaad3cd700 1 -- start start 2024-09-13T18:29:15.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.664+0000 7feaad3cd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feaa815cae0 0x7feaa80cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.664+0000 7feaad3cd700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7feaa815cec0 0x7feaa80d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.664+0000 7feaad3cd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7feaa806ac00 0x7feaa806b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.664+0000 7feaad3cd700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa80d1750 con 0x7feaa806ac00 2024-09-13T18:29:15.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.664+0000 7feaad3cd700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa806b5b0 con 0x7feaa815cec0 2024-09-13T18:29:15.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.664+0000 7feaad3cd700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa80d21e0 con 0x7feaa815cae0 2024-09-13T18:29:15.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.664+0000 7feaacbcc700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7feaa806ac00 0x7feaa806b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.664+0000 7feaacbcc700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7feaa806ac00 0x7feaa806b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55856/0 (socket says 172.21.15.44:55856) 2024-09-13T18:29:15.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.664+0000 7feaacbcc700 1 -- 172.21.15.44:0/3205875399 learned_addr learned my addr 172.21.15.44:0/3205875399 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:15.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.664+0000 7feaa77fe700 1 --2- 172.21.15.44:0/3205875399 >> v2:172.21.15.99:3300/0 conn(0x7feaa815cec0 0x7feaa80d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.664+0000 7feaa7fff700 1 --2- 172.21.15.44:0/3205875399 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feaa815cae0 0x7feaa80cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaacbcc700 1 -- 172.21.15.44:0/3205875399 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feaa815cae0 msgr2=0x7feaa80cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:15.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaacbcc700 1 --2- 172.21.15.44:0/3205875399 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feaa815cae0 0x7feaa80cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaacbcc700 1 -- 172.21.15.44:0/3205875399 >> v2:172.21.15.99:3300/0 conn(0x7feaa815cec0 msgr2=0x7feaa80d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:15.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaacbcc700 1 --2- 172.21.15.44:0/3205875399 >> v2:172.21.15.99:3300/0 conn(0x7feaa815cec0 0x7feaa80d1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaacbcc700 1 -- 172.21.15.44:0/3205875399 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa80d1940 con 0x7feaa806ac00 2024-09-13T18:29:15.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaacbcc700 1 --2- 172.21.15.44:0/3205875399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa806ac00 0x7feaa806b070 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7feaa80d3ce0 tx=0x7feaa000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ae623194ab2488 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:15.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaa6ffd700 1 -- 172.21.15.44:0/3205875399 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa000e070 con 0x7feaa806ac00 2024-09-13T18:29:15.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaa6ffd700 1 -- 172.21.15.44:0/3205875399 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa000b8d0 con 0x7feaa806ac00 2024-09-13T18:29:15.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaa6ffd700 1 -- 172.21.15.44:0/3205875399 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa000bc80 con 0x7feaa806ac00 2024-09-13T18:29:15.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaad3cd700 1 -- 172.21.15.44:0/3205875399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa806ac00 msgr2=0x7feaa806b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaad3cd700 1 --2- 172.21.15.44:0/3205875399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa806ac00 0x7feaa806b070 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7feaa80d3ce0 tx=0x7feaa000b330 comp rx=0 tx=0).stop 2024-09-13T18:29:15.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaad3cd700 1 -- 172.21.15.44:0/3205875399 shutdown_connections 2024-09-13T18:29:15.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaad3cd700 1 --2- 172.21.15.44:0/3205875399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa806ac00 0x7feaa806b070 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaad3cd700 1 --2- 172.21.15.44:0/3205875399 >> v2:172.21.15.99:3300/0 conn(0x7feaa815cec0 0x7feaa80d1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaad3cd700 1 --2- 172.21.15.44:0/3205875399 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feaa815cae0 0x7feaa80cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaad3cd700 1 -- 172.21.15.44:0/3205875399 >> 172.21.15.44:0/3205875399 conn(0x7feaa80d2c80 msgr2=0x7feaa80d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:15.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaad3cd700 1 -- 172.21.15.44:0/3205875399 shutdown_connections 2024-09-13T18:29:15.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaad3cd700 1 -- 172.21.15.44:0/3205875399 wait complete. 2024-09-13T18:29:15.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaad3cd700 1 Processor -- start 2024-09-13T18:29:15.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaad3cd700 1 -- start start 2024-09-13T18:29:15.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaad3cd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feaa806ac00 0x7feaa8159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaad3cd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa815cae0 0x7feaa8151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaad3cd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feaa815cec0 0x7feaa815ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaad3cd700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa8159cd0 con 0x7feaa815cae0 2024-09-13T18:29:15.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaad3cd700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa8152050 con 0x7feaa806ac00 2024-09-13T18:29:15.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaad3cd700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa8157ca0 con 0x7feaa815cec0 2024-09-13T18:29:15.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.668+0000 7feaa77fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa815cae0 0x7feaa8151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.672+0000 7feaa77fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa815cae0 0x7feaa8151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55868/0 (socket says 172.21.15.44:55868) 2024-09-13T18:29:15.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.672+0000 7feaa77fe700 1 -- 172.21.15.44:0/3674906821 learned_addr learned my addr 172.21.15.44:0/3674906821 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:15.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.672+0000 7feaa7fff700 1 --2- 172.21.15.44:0/3674906821 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feaa806ac00 0x7feaa8159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.672+0000 7feaacbcc700 1 --2- 172.21.15.44:0/3674906821 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feaa815cec0 0x7feaa815ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.672+0000 7feaa77fe700 1 -- 172.21.15.44:0/3674906821 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feaa815cec0 msgr2=0x7feaa815ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.672+0000 7feaa77fe700 1 --2- 172.21.15.44:0/3674906821 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feaa815cec0 0x7feaa815ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.672+0000 7feaa77fe700 1 -- 172.21.15.44:0/3674906821 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feaa806ac00 msgr2=0x7feaa8159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.672+0000 7feaa77fe700 1 --2- 172.21.15.44:0/3674906821 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feaa806ac00 0x7feaa8159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.672+0000 7feaa77fe700 1 -- 172.21.15.44:0/3674906821 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa0009b30 con 0x7feaa815cae0 2024-09-13T18:29:15.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.672+0000 7feaacbcc700 1 --2- 172.21.15.44:0/3674906821 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feaa815cec0 0x7feaa815ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:15.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.672+0000 7feaa7fff700 1 --2- 172.21.15.44:0/3674906821 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feaa806ac00 0x7feaa8159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:15.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.672+0000 7feaa77fe700 1 --2- 172.21.15.44:0/3674906821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa815cae0 0x7feaa8151b10 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fea9000e9a0 tx=0x7fea9000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:15.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.672+0000 7feaa4ff9700 1 -- 172.21.15.44:0/3674906821 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea90009720 con 0x7feaa815cae0 2024-09-13T18:29:15.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.672+0000 7feaa4ff9700 1 -- 172.21.15.44:0/3674906821 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9000c7f0 con 0x7feaa815cae0 2024-09-13T18:29:15.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.672+0000 7feaa4ff9700 1 -- 172.21.15.44:0/3674906821 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9000cba0 con 0x7feaa815cae0 2024-09-13T18:29:15.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.672+0000 7feaad3cd700 1 -- 172.21.15.44:0/3674906821 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa8157f80 con 0x7feaa815cae0 2024-09-13T18:29:15.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.672+0000 7feaad3cd700 1 -- 172.21.15.44:0/3674906821 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa80b4000 con 0x7feaa815cae0 2024-09-13T18:29:15.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.672+0000 7feaad3cd700 1 -- 172.21.15.44:0/3674906821 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa80b41c0 con 0x7feaa815cae0 2024-09-13T18:29:15.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.672+0000 7feaa4ff9700 1 -- 172.21.15.44:0/3674906821 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fea9000cd00 con 0x7feaa815cae0 2024-09-13T18:29:15.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.672+0000 7feaa4ff9700 1 --2- 172.21.15.44:0/3674906821 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fea88066730 0x7fea88068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.676+0000 7feaa4ff9700 1 -- 172.21.15.44:0/3674906821 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea900841e0 con 0x7feaa815cae0 2024-09-13T18:29:15.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.676+0000 7feaa7fff700 1 --2- 172.21.15.44:0/3674906821 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fea88066730 0x7fea88068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.676+0000 7feaa7fff700 1 --2- 172.21.15.44:0/3674906821 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fea88066730 0x7fea88068bf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fea98009bc0 tx=0x7fea98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:15.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.680+0000 7feaa4ff9700 1 -- 172.21.15.44:0/3674906821 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fea90051550 con 0x7feaa815cae0 2024-09-13T18:29:15.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.852+0000 7feaad3cd700 1 -- 172.21.15.44:0/3674906821 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feaa80d3060 con 0x7fea88066730 2024-09-13T18:29:15.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.868+0000 7feaa4ff9700 1 -- 172.21.15.44:0/3674906821 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277137 (secure 0 0 0) 0x7feaa80d3060 con 0x7fea88066730 2024-09-13T18:29:15.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:29:15.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.876+0000 7feaad3cd700 1 -- 172.21.15.44:0/3674906821 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fea88066730 msgr2=0x7fea88068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.876+0000 7feaad3cd700 1 --2- 172.21.15.44:0/3674906821 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fea88066730 0x7fea88068bf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fea98009bc0 tx=0x7fea98008040 comp rx=0 tx=0).stop 2024-09-13T18:29:15.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.876+0000 7feaad3cd700 1 -- 172.21.15.44:0/3674906821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa815cae0 msgr2=0x7feaa8151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.876+0000 7feaad3cd700 1 --2- 172.21.15.44:0/3674906821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa815cae0 0x7feaa8151b10 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fea9000e9a0 tx=0x7fea9000ed60 comp rx=0 tx=0).stop 2024-09-13T18:29:15.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.876+0000 7feaad3cd700 1 -- 172.21.15.44:0/3674906821 shutdown_connections 2024-09-13T18:29:15.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.876+0000 7feaad3cd700 1 --2- 172.21.15.44:0/3674906821 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fea88066730 0x7fea88068bf0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.876+0000 7feaad3cd700 1 --2- 172.21.15.44:0/3674906821 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feaa815cec0 0x7feaa815ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.876+0000 7feaad3cd700 1 --2- 172.21.15.44:0/3674906821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa815cae0 0x7feaa8151b10 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.876+0000 7feaad3cd700 1 --2- 172.21.15.44:0/3674906821 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feaa806ac00 0x7feaa8159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.876+0000 7feaad3cd700 1 -- 172.21.15.44:0/3674906821 >> 172.21.15.44:0/3674906821 conn(0x7feaa80d2c80 msgr2=0x7feaa80cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:15.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.876+0000 7feaad3cd700 1 -- 172.21.15.44:0/3674906821 shutdown_connections 2024-09-13T18:29:15.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:15.876+0000 7feaad3cd700 1 -- 172.21.15.44:0/3674906821 wait complete. 2024-09-13T18:29:15.881 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:29:15.894 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-09-13T18:29:14.365814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":221452,"kb_used_data":5228,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753268,"statfs":{"total":773094113280,"available":772867346432,"internally_reserved":0,"allocated":5353472,"data_stored":2851587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.479359"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897751+0000","last_change":"2024-09-13T18:29:08.897751+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897751+0000","last_undegraded":"2024-09-13T18:29:08.897751+0000","last_fullsized":"2024-09-13T18:29:08.897751+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:24.270758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.900289+0000","last_change":"2024-09-13T18:29:08.900289+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.900289+0000","last_undegraded":"2024-09-13T18:29:08.900289+0000","last_fullsized":"2024-09-13T18:29:08.900289+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:47.472350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.893741+0000","last_change":"2024-09-13T18:29:08.893741+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.893741+0000","last_undegraded":"2024-09-13T18:29:08.893741+0000","last_fullsized":"2024-09-13T18:29:08.893741+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:09.962065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.898034+0000","last_change":"2024-09-13T18:29:08.898034+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.898034+0000","last_undegraded":"2024-09-13T18:29:08.898034+0000","last_fullsized":"2024-09-13T18:29:08.898034+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:00.837327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.898425+0000","last_change":"2024-09-13T18:29:08.898425+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.898425+0000","last_undegraded":"2024-09-13T18:29:08.898425+0000","last_fullsized":"2024-09-13T18:29:08.898425+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:25.197012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.900165+0000","last_change":"2024-09-13T18:29:08.900165+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.900165+0000","last_undegraded":"2024-09-13T18:29:08.900165+0000","last_fullsized":"2024-09-13T18:29:08.900165+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:09.004250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.890301+0000","last_change":"2024-09-13T18:29:08.890301+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.890301+0000","last_undegraded":"2024-09-13T18:29:08.890301+0000","last_fullsized":"2024-09-13T18:29:08.890301+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:26.481517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.905393+0000","last_change":"2024-09-13T18:29:08.905393+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.905393+0000","last_undegraded":"2024-09-13T18:29:08.905393+0000","last_fullsized":"2024-09-13T18:29:08.905393+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:24.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.899250+0000","last_change":"2024-09-13T18:29:08.899250+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.899250+0000","last_undegraded":"2024-09-13T18:29:08.899250+0000","last_fullsized":"2024-09-13T18:29:08.899250+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:32.352134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.904159+0000","last_change":"2024-09-13T18:29:08.904159+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.904159+0000","last_undegraded":"2024-09-13T18:29:08.904159+0000","last_fullsized":"2024-09-13T18:29:08.904159+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:47.472350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.898335+0000","last_change":"2024-09-13T18:29:08.898335+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.898335+0000","last_undegraded":"2024-09-13T18:29:08.898335+0000","last_fullsized":"2024-09-13T18:29:08.898335+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:24.270758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.903849+0000","last_change":"2024-09-13T18:29:08.903849+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.903849+0000","last_undegraded":"2024-09-13T18:29:08.903849+0000","last_fullsized":"2024-09-13T18:29:08.903849+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:14.350641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897694+0000","last_change":"2024-09-13T18:29:08.897694+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897694+0000","last_undegraded":"2024-09-13T18:29:08.897694+0000","last_fullsized":"2024-09-13T18:29:08.897694+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:41.337959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897291+0000","last_change":"2024-09-13T18:29:08.897291+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897291+0000","last_undegraded":"2024-09-13T18:29:08.897291+0000","last_fullsized":"2024-09-13T18:29:08.897291+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:25.197012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897011+0000","last_change":"2024-09-13T18:29:08.897011+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897011+0000","last_undegraded":"2024-09-13T18:29:08.897011+0000","last_fullsized":"2024-09-13T18:29:08.897011+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:32.449968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.904902+0000","last_change":"2024-09-13T18:29:08.904902+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.904902+0000","last_undegraded":"2024-09-13T18:29:08.904902+0000","last_fullsized":"2024-09-13T18:29:08.904902+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:05.424273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.903924+0000","last_change":"2024-09-13T18:29:08.903924+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.903924+0000","last_undegraded":"2024-09-13T18:29:08.903924+0000","last_fullsized":"2024-09-13T18:29:08.903924+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:14.045917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.899114+0000","last_change":"2024-09-13T18:29:08.899114+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.899114+0000","last_undegraded":"2024-09-13T18:29:08.899114+0000","last_fullsized":"2024-09-13T18:29:08.899114+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:52.127760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.890145+0000","last_change":"2024-09-13T18:29:08.890145+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.890145+0000","last_undegraded":"2024-09-13T18:29:08.890145+0000","last_fullsized":"2024-09-13T18:29:08.890145+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:09.962065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897179+0000","last_change":"2024-09-13T18:29:08.897179+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897179+0000","last_undegraded":"2024-09-13T18:29:08.897179+0000","last_fullsized":"2024-09-13T18:29:08.897179+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:00.837327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.896829+0000","last_change":"2024-09-13T18:29:08.896829+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.896829+0000","last_undegraded":"2024-09-13T18:29:08.896829+0000","last_fullsized":"2024-09-13T18:29:08.896829+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:43.676401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.890301+0000","last_change":"2024-09-13T18:29:08.890301+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.890301+0000","last_undegraded":"2024-09-13T18:29:08.890301+0000","last_fullsized":"2024-09-13T18:29:08.890301+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:03.701094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.904010+0000","last_change":"2024-09-13T18:29:08.904010+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.904010+0000","last_undegraded":"2024-09-13T18:29:08.904010+0000","last_fullsized":"2024-09-13T18:29:08.904010+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:37.970067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897136+0000","last_change":"2024-09-13T18:29:08.897136+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897136+0000","last_undegraded":"2024-09-13T18:29:08.897136+0000","last_fullsized":"2024-09-13T18:29:08.897136+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:43.676401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897260+0000","last_change":"2024-09-13T18:29:08.897260+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897260+0000","last_undegraded":"2024-09-13T18:29:08.897260+0000","last_fullsized":"2024-09-13T18:29:08.897260+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:32.068323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897830+0000","last_change":"2024-09-13T18:29:08.897830+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897830+0000","last_undegraded":"2024-09-13T18:29:08.897830+0000","last_fullsized":"2024-09-13T18:29:08.897830+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:12.384532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.894130+0000","last_change":"2024-09-13T18:29:08.894130+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.894130+0000","last_undegraded":"2024-09-13T18:29:08.894130+0000","last_fullsized":"2024-09-13T18:29:08.894130+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:03.701094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.897198+0000","last_change":"2024-09-13T18:29:08.897198+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.897198+0000","last_undegraded":"2024-09-13T18:29:08.897198+0000","last_fullsized":"2024-09-13T18:29:08.897198+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:15.435159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.899413+0000","last_change":"2024-09-13T18:29:08.899413+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.899413+0000","last_undegraded":"2024-09-13T18:29:08.899413+0000","last_fullsized":"2024-09-13T18:29:08.899413+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:37.970067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.893882+0000","last_change":"2024-09-13T18:29:08.893882+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.893882+0000","last_undegraded":"2024-09-13T18:29:08.893882+0000","last_fullsized":"2024-09-13T18:29:08.893882+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:42.514279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.904080+0000","last_change":"2024-09-13T18:29:08.904080+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.904080+0000","last_undegraded":"2024-09-13T18:29:08.904080+0000","last_fullsized":"2024-09-13T18:29:08.904080+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:32.352134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:09.886784+0000","last_change":"2024-09-13T18:29:09.886784+0000","last_active":"2024-09-13T18:29:09.886784+0000","last_peered":"2024-09-13T18:29:09.886784+0000","last_clean":"2024-09-13T18:29:09.886784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:09.886784+0000","last_undegraded":"2024-09-13T18:29:09.886784+0000","last_fullsized":"2024-09-13T18:29:09.886784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2024-09-13T18:29:08.890574+0000","last_change":"2024-09-13T18:29:08.890574+0000","last_active":"2024-09-13T18:29:08.877547+0000","last_peered":"2024-09-13T18:29:08.877547+0000","last_clean":"2024-09-13T18:29:08.877547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:08.890574+0000","last_undegraded":"2024-09-13T18:29:08.890574+0000","last_fullsized":"2024-09-13T18:29:08.890574+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:08.869484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:29:06.968329+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:29:06.968329+0000","last_peered":"2024-09-13T18:29:06.968329+0000","last_clean":"2024-09-13T18:29:06.968329+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:29:06.968329+0000","last_undegraded":"2024-09-13T18:29:06.968329+0000","last_fullsized":"2024-09-13T18:29:06.968329+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28116,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343724,"statfs":{"total":96636764160,"available":96607973376,"internally_reserved":0,"allocated":1122304,"data_stored":802860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.77100000000000002,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1240000000000001,"5min":1.163,"15min":1.163},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.79300000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.91200000000000003,"15min":0.91400000000000003},"min":{"1min":0.65800000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.157,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.97199999999999998,"15min":0.97399999999999998},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.177,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.0209999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85899999999999999,"15min":0.85999999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.056},{"interface":"front","average":{"1min":0.872,"5min":0.92200000000000004,"15min":0.93000000000000005},"min":{"1min":0.57899999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.127,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.0800000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.89700000000000002,"15min":0.90000000000000002},"min":{"1min":0.67500000000000004,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.099,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.88400000000000001,"15min":0.87},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.117,"5min":1.125,"15min":1.125},"last":0.85199999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.88900000000000001,"15min":0.90500000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1739999999999999,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.996,"5min":1.0449999999999999,"15min":1.0529999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.2110000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.1559999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.95999999999999996,"15min":0.95599999999999996},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.302,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":1.1870000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0449999999999999,"15min":1.0549999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.274,"5min":1.502,"15min":1.502},"last":1.2929999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.0940000000000001,"15min":1.1160000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.161,"5min":2.077,"15min":2.077},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0589999999999999,"15min":1.0629999999999999},"min":{"1min":0.72199999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.2210000000000001,"5min":1.55,"15min":1.55},"last":1.224}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27536,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":516096,"data_stored":206675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.61499999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.216,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.258}]},{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.83399999999999996,"15min":0.82999999999999996},"min":{"1min":0.58499999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.83599999999999997,"15min":0.82399999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82799999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.81799999999999995,"15min":0.81200000000000006},"min":{"1min":0.54200000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2010000000000001,"5min":1.254,"15min":1.254},"last":1.1379999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.86499999999999999,"15min":0.86899999999999999},"min":{"1min":0.56799999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":1.111}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.86199999999999999,"15min":0.85699999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.125,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.96099999999999997,"15min":0.96699999999999997},"min":{"1min":0.70099999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2070000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.018}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.89900000000000002,"15min":0.90100000000000002},"min":{"1min":0.622,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.165,"5min":1.248,"15min":1.248},"last":1.206},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0029999999999999,"15min":1.01},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.95099999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.05,"15min":1.046},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98899999999999999,"15min":0.99199999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.333}]},{"osd":7,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.002,"15min":1.016},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.256,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.117,"15min":1.1160000000000001},"min":{"1min":0.94999999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.3160000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.236}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":516096,"data_stored":206675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.85699999999999998,"15min":0.86099999999999999},"min":{"1min":0.61899999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1259999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.88900000000000001,"15min":0.89700000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0820000000000001,"5min":1.482,"15min":1.482},"last":0.69599999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80500000000000005,"15min":0.80100000000000005},"min":{"1min":0.65900000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1559999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.95399999999999996,"15min":0.96599999999999997},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1000000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.45200000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.96999999999999997,"15min":0.97499999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0900000000000001,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.627},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.024,"15min":1.032},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.2529999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.65300000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.95699999999999996,"15min":0.97099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1499999999999999,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.96299999999999997,"15min":0.97299999999999998},"min":{"1min":0.59899999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.157,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.55300000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.97299999999999998,"15min":0.999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1160000000000001,"5min":1.304,"15min":1.304},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.89200000000000002,"5min":1.04,"15min":1.0649999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.1799999999999999,"5min":1.542,"15min":1.542},"last":0.77700000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.0449999999999999,"15min":1.0600000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.224,"5min":1.698,"15min":1.698},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.1719999999999999,"15min":1.1879999999999999},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.2010000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.88}]},{"osd":7,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.1990000000000001,"15min":1.2230000000000001},"min":{"1min":0.76100000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.2709999999999999,"5min":1.847,"15min":1.847},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.046,"5min":1.161,"15min":1.1799999999999999},"min":{"1min":0.81299999999999994,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.3149999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.747}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":516096,"data_stored":206675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.92700000000000005,"15min":0.93799999999999994},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1220000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.996,"15min":1.002},"min":{"1min":0.59499999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.111,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.78500000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0389999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.86399999999999999,"15min":0.86899999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1220000000000001,"5min":1.254,"15min":1.254},"last":0.73999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.86399999999999999,"15min":0.88100000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.61499999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.59899999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.996,"15min":1.0029999999999999},"min":{"1min":0.64900000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.24,"5min":1.639,"15min":1.639},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0049999999999999,"15min":1.008},"min":{"1min":0.72899999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1970000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.1319999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.98799999999999999,"15min":1.0109999999999999},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1419999999999999,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.123,"15min":1.1399999999999999},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.2150000000000001,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.84999999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.89400000000000002,"15min":0.89600000000000002},"min":{"1min":0.70899999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":1.04},{"interface":"front","average":{"1min":1.032,"5min":1.1080000000000001,"15min":1.121},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.21,"5min":1.794,"15min":1.794},"last":0.877}]},{"osd":7,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":1.077,"15min":1.1020000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.145,"5min":1.669,"15min":1.669},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.76800000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2390000000000001,"5min":1.282,"15min":1.282},"last":1.0840000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":528384,"data_stored":212492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.69299999999999995,"15min":0.70699999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.84499999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.70199999999999996,"15min":0.69599999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.51300000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.71799999999999997,"15min":0.72799999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.875,"5min":1.165,"15min":1.165},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.83799999999999997,"15min":0.85299999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.042,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0369999999999999,"5min":1.333,"15min":1.333},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.90800000000000003,"15min":0.91900000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.214,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.56399999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.97799999999999998,"15min":0.99199999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.1080000000000001,"5min":1.165,"15min":1.165},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.052,"15min":1.0669999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.79700000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.1919999999999999,"15min":1.2190000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.355,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.997,"5min":1.131,"15min":1.153},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.3049999999999999,"5min":1.718,"15min":1.718},"last":0.53600000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.1419999999999999,"15min":1.1599999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.4159999999999999,"5min":1.47,"15min":1.47},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.246,"15min":1.2729999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.4510000000000001,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.77900000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.123,"15min":1.129},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.752},{"interface":"front","average":{"1min":1.083,"5min":1.1910000000000001,"15min":1.2090000000000001},"min":{"1min":0.76800000000000002,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.385,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.69699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":516096,"data_stored":206675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68100000000000005,"15min":0.68200000000000005},"min":{"1min":0.432,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94999999999999996,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81499999999999995,"15min":0.82499999999999996},"min":{"1min":0.48399999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0429999999999999,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.85299999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.72399999999999998,"15min":0.73599999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92100000000000004,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.749,"15min":0.75600000000000001},"min":{"1min":0.49299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94599999999999995,"5min":1.206,"15min":1.206},"last":1.0549999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68100000000000005,"15min":0.67500000000000004},"min":{"1min":0.54600000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.03,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.86699999999999999,"15min":0.871},"min":{"1min":0.53100000000000003,"5min":0.433,"15min":0.433},"max":{"1min":1.2509999999999999,"5min":1.548,"15min":1.548},"last":1.1579999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.98099999999999998,"15min":0.98899999999999999},"min":{"1min":0.755,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2509999999999999,"5min":1.401,"15min":1.401},"last":1.288},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0680000000000001,"15min":1.083},"min":{"1min":0.70099999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3260000000000001,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.2529999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.92900000000000005,"15min":0.92700000000000005},"min":{"1min":0.67800000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0680000000000001,"15min":1.073},"min":{"1min":0.81799999999999995,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.5840000000000001,"5min":1.869,"15min":1.869},"last":1.3959999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.125,"15min":1.133},"min":{"1min":0.75900000000000001,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.3879999999999999,"5min":2.762,"15min":2.762},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0569999999999999,"15min":1.0609999999999999},"min":{"1min":0.78100000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.393,"5min":1.988,"15min":1.988},"last":1.097}]},{"osd":7,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.1819999999999999,"15min":1.1919999999999999},"min":{"1min":0.79900000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4319999999999999,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.0820000000000001,"15min":1.0760000000000001},"min":{"1min":0.81399999999999995,"5min":0.746,"15min":0.746},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.2230000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":516096,"data_stored":206675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.629,"15min":0.63},"min":{"1min":0.41699999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.131,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.72599999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.49399999999999999,"5min":0.373,"15min":0.373},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.228,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.67900000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79200000000000004,"15min":0.78400000000000003},"min":{"1min":0.54900000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.871},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.80600000000000005,"15min":0.81100000000000005},"min":{"1min":0.53300000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2090000000000001,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.58599999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.96499999999999997,"15min":0.97099999999999997},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.327,"5min":1.524,"15min":1.524},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98099999999999998,"15min":0.98199999999999998},"min":{"1min":0.80700000000000005,"5min":0.747,"15min":0.747},"max":{"1min":1.147,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.994}]},{"osd":5,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.97999999999999998,"15min":0.97399999999999998},"min":{"1min":0.79000000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.2909999999999999,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":2.0960000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.079,"15min":1.085},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.367,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":2.7280000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0920000000000001,"15min":1.105},"min":{"1min":0.76100000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.3420000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.0980000000000001,"15min":1.1020000000000001},"min":{"1min":0.93000000000000005,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.2829999999999999,"5min":1.869,"15min":1.869},"last":2.0489999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.085,"15min":1.087},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.26,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":2.5579999999999998},{"interface":"front","average":{"1min":1.097,"5min":1.1319999999999999,"15min":1.1379999999999999},"min":{"1min":0.82899999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.403,"5min":1.72,"15min":1.72},"last":0.94899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1122304,"data_stored":802860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.52500000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71599999999999997,"15min":0.70999999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94599999999999995,"5min":1.083,"15min":1.083},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.72699999999999998,"15min":0.72099999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.746}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.63900000000000001,"15min":0.629},"min":{"1min":0.56699999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.83399999999999996,"15min":0.83099999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.63}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.96599999999999997,"15min":0.97499999999999998},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.222,"5min":1.302,"15min":1.302},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.91700000000000004,"15min":0.90500000000000003},"min":{"1min":0.70199999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.97799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.97699999999999998,"15min":0.96999999999999997},"min":{"1min":0.746,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.079},{"interface":"front","average":{"1min":1.127,"5min":1.0700000000000001,"15min":1.0600000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.67600000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.109,"15min":1.099},"min":{"1min":0.95199999999999996,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.1279999999999999,"15min":1.135},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.2949999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.0289999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.1259999999999999,"15min":1.1339999999999999},"min":{"1min":0.82899999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.054,"15min":1.044},"min":{"1min":0.878,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.28,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.85299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:29:18.900 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:29:19.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.020+0000 7f3cf535c700 1 Processor -- start 2024-09-13T18:29:19.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.020+0000 7f3cf535c700 1 -- start start 2024-09-13T18:29:19.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.020+0000 7f3cf535c700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3cf0165590 0x7f3cf01619a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.020+0000 7f3cf535c700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf0071f30 con 0x7f3cf00b3ae0 2024-09-13T18:29:19.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.020+0000 7f3cf535c700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf01622e0 con 0x7f3cf0160eb0 2024-09-13T18:29:19.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.020+0000 7f3cf535c700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf0162000 con 0x7f3cf0165590 2024-09-13T18:29:19.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.020+0000 7f3cef7fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3cf00b3ae0 0x7f3cf0161290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60394/0 (socket says 172.21.15.44:60394) 2024-09-13T18:29:19.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.020+0000 7f3cef7fe700 1 -- 172.21.15.44:0/2432503395 learned_addr learned my addr 172.21.15.44:0/2432503395 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:29:19.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.024+0000 7f3cf4b5b700 1 --2- 172.21.15.44:0/2432503395 >> v2:172.21.15.99:3300/0 conn(0x7f3cf0165590 0x7f3cf01619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.024+0000 7f3ceeffd700 1 -- 172.21.15.44:0/2432503395 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4138765934 0 0) 0x7f3cf0071f30 con 0x7f3cf00b3ae0 2024-09-13T18:29:19.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.024+0000 7f3ceeffd700 1 -- 172.21.15.44:0/2432503395 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cdc0035d0 con 0x7f3cf00b3ae0 2024-09-13T18:29:19.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.024+0000 7f3ceeffd700 1 -- 172.21.15.44:0/2432503395 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2000512618 0 0) 0x7f3cdc0035d0 con 0x7f3cf00b3ae0 2024-09-13T18:29:19.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.024+0000 7f3cf4b5b700 1 -- 172.21.15.44:0/2432503395 >> v1:172.21.15.99:6789/0 conn(0x7f3cf0160eb0 legacy=0x7f3cf00b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.024+0000 7f3cf4b5b700 1 -- 172.21.15.44:0/2432503395 >> v1:172.21.15.44:6789/0 conn(0x7f3cf00b3ae0 legacy=0x7f3cf0161290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.024+0000 7f3cf4b5b700 1 -- 172.21.15.44:0/2432503395 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf0164ab0 con 0x7f3cf0165590 2024-09-13T18:29:19.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.024+0000 7f3cf4b5b700 1 --2- 172.21.15.44:0/2432503395 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cf0165590 0x7f3cf01619a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8009d90 tx=0x7f3ce800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc353465e134c9da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:19.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.024+0000 7f3ceeffd700 1 -- 172.21.15.44:0/2432503395 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce800e070 con 0x7f3cf0165590 2024-09-13T18:29:19.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.024+0000 7f3ceeffd700 1 -- 172.21.15.44:0/2432503395 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce8003a40 con 0x7f3cf0165590 2024-09-13T18:29:19.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.024+0000 7f3ceeffd700 1 -- 172.21.15.44:0/2432503395 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8001670 con 0x7f3cf0165590 2024-09-13T18:29:19.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.024+0000 7f3cf535c700 1 -- 172.21.15.44:0/2432503395 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cf0165590 msgr2=0x7f3cf01619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.024+0000 7f3cf535c700 1 --2- 172.21.15.44:0/2432503395 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cf0165590 0x7f3cf01619a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8009d90 tx=0x7f3ce800b330 comp rx=0 tx=0).stop 2024-09-13T18:29:19.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.024+0000 7f3cf535c700 1 -- 172.21.15.44:0/2432503395 shutdown_connections 2024-09-13T18:29:19.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.024+0000 7f3cf535c700 1 --2- 172.21.15.44:0/2432503395 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cf0165590 0x7f3cf01619a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.024+0000 7f3cf535c700 1 -- 172.21.15.44:0/2432503395 >> 172.21.15.44:0/2432503395 conn(0x7f3cf00b0f00 msgr2=0x7f3cf00b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:19.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.024+0000 7f3cf535c700 1 -- 172.21.15.44:0/2432503395 shutdown_connections 2024-09-13T18:29:19.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.024+0000 7f3cf535c700 1 -- 172.21.15.44:0/2432503395 wait complete. 2024-09-13T18:29:19.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.028+0000 7f3cf535c700 1 Processor -- start 2024-09-13T18:29:19.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.028+0000 7f3cf535c700 1 -- start start 2024-09-13T18:29:19.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.028+0000 7f3cf535c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cf00b3ae0 0x7f3cf00adf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.028+0000 7f3cf535c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3cf0160eb0 0x7f3cf00a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.028+0000 7f3cf535c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cf0165590 0x7f3cf015f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.028+0000 7f3cf535c700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf00aa140 con 0x7f3cf0165590 2024-09-13T18:29:19.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.028+0000 7f3cf535c700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf00aced0 con 0x7f3cf00b3ae0 2024-09-13T18:29:19.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.028+0000 7f3cf535c700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf00ad1b0 con 0x7f3cf0160eb0 2024-09-13T18:29:19.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.028+0000 7f3cf4b5b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cf0165590 0x7f3cf015f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.028+0000 7f3cf4b5b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cf0165590 0x7f3cf015f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55872/0 (socket says 172.21.15.44:55872) 2024-09-13T18:29:19.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.028+0000 7f3cf4b5b700 1 -- 172.21.15.44:0/494457952 learned_addr learned my addr 172.21.15.44:0/494457952 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:19.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.028+0000 7f3ceffff700 1 --2- 172.21.15.44:0/494457952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cf00b3ae0 0x7f3cf00adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.028+0000 7f3cef7fe700 1 --2- 172.21.15.44:0/494457952 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3cf0160eb0 0x7f3cf00a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.028+0000 7f3cf4b5b700 1 -- 172.21.15.44:0/494457952 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3cf0160eb0 msgr2=0x7f3cf00a9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.028+0000 7f3cf4b5b700 1 --2- 172.21.15.44:0/494457952 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3cf0160eb0 0x7f3cf00a9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.028+0000 7f3cf4b5b700 1 -- 172.21.15.44:0/494457952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cf00b3ae0 msgr2=0x7f3cf00adf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.028+0000 7f3cf4b5b700 1 --2- 172.21.15.44:0/494457952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cf00b3ae0 0x7f3cf00adf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.028+0000 7f3cf4b5b700 1 -- 172.21.15.44:0/494457952 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce8009a70 con 0x7f3cf0165590 2024-09-13T18:29:19.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.028+0000 7f3cf4b5b700 1 --2- 172.21.15.44:0/494457952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cf0165590 0x7f3cf015f620 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3ce800b370 tx=0x7f3ce8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:19.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.028+0000 7f3cecff9700 1 -- 172.21.15.44:0/494457952 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8009430 con 0x7f3cf0165590 2024-09-13T18:29:19.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.028+0000 7f3cecff9700 1 -- 172.21.15.44:0/494457952 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce8004600 con 0x7f3cf0165590 2024-09-13T18:29:19.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.028+0000 7f3cf535c700 1 -- 172.21.15.44:0/494457952 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf00ad490 con 0x7f3cf0165590 2024-09-13T18:29:19.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.028+0000 7f3cecff9700 1 -- 172.21.15.44:0/494457952 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8012450 con 0x7f3cf0165590 2024-09-13T18:29:19.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.032+0000 7f3cf535c700 1 -- 172.21.15.44:0/494457952 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf00ada50 con 0x7f3cf0165590 2024-09-13T18:29:19.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.032+0000 7f3cf535c700 1 -- 172.21.15.44:0/494457952 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf00adc40 con 0x7f3cf0165590 2024-09-13T18:29:19.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.032+0000 7f3cecff9700 1 -- 172.21.15.44:0/494457952 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3ce80125b0 con 0x7f3cf0165590 2024-09-13T18:29:19.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.032+0000 7f3cecff9700 1 --2- 172.21.15.44:0/494457952 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3cd0066730 0x7f3cd0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.036+0000 7f3cecff9700 1 -- 172.21.15.44:0/494457952 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ce8085950 con 0x7f3cf0165590 2024-09-13T18:29:19.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.036+0000 7f3ceffff700 1 --2- 172.21.15.44:0/494457952 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3cd0066730 0x7f3cd0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.036+0000 7f3ceffff700 1 --2- 172.21.15.44:0/494457952 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3cd0066730 0x7f3cd0068bf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0007fd0 tx=0x7f3ce0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:19.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.040+0000 7f3cecff9700 1 -- 172.21.15.44:0/494457952 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3ce8052d30 con 0x7f3cf0165590 2024-09-13T18:29:19.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.208+0000 7f3cf535c700 1 -- 172.21.15.44:0/494457952 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3cf0165070 con 0x7f3cd0066730 2024-09-13T18:29:19.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.224+0000 7f3cecff9700 1 -- 172.21.15.44:0/494457952 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287982 (secure 0 0 0) 0x7f3ce000f690 con 0x7f3cd0066730 2024-09-13T18:29:19.235 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:29:19.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.232+0000 7f3cf535c700 1 -- 172.21.15.44:0/494457952 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3cd0066730 msgr2=0x7f3cd0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.232+0000 7f3cf535c700 1 --2- 172.21.15.44:0/494457952 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3cd0066730 0x7f3cd0068bf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0007fd0 tx=0x7f3ce0009040 comp rx=0 tx=0).stop 2024-09-13T18:29:19.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.232+0000 7f3cf535c700 1 -- 172.21.15.44:0/494457952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cf0165590 msgr2=0x7f3cf015f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.232+0000 7f3cf535c700 1 --2- 172.21.15.44:0/494457952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cf0165590 0x7f3cf015f620 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3ce800b370 tx=0x7f3ce8004af0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.232+0000 7f3cf535c700 1 -- 172.21.15.44:0/494457952 shutdown_connections 2024-09-13T18:29:19.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.232+0000 7f3cf535c700 1 --2- 172.21.15.44:0/494457952 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3cd0066730 0x7f3cd0068bf0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.232+0000 7f3cf535c700 1 --2- 172.21.15.44:0/494457952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cf0165590 0x7f3cf015f620 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.232+0000 7f3cf535c700 1 --2- 172.21.15.44:0/494457952 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3cf0160eb0 0x7f3cf00a9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.232+0000 7f3cf535c700 1 --2- 172.21.15.44:0/494457952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cf00b3ae0 0x7f3cf00adf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.232+0000 7f3cf535c700 1 -- 172.21.15.44:0/494457952 >> 172.21.15.44:0/494457952 conn(0x7f3cf00b0f00 msgr2=0x7f3cf00b2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:19.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.232+0000 7f3cf535c700 1 -- 172.21.15.44:0/494457952 shutdown_connections 2024-09-13T18:29:19.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.232+0000 7f3cf535c700 1 -- 172.21.15.44:0/494457952 wait complete. 2024-09-13T18:29:19.239 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:29:19.252 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":116,"stamp":"2024-09-13T18:29:18.367295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221812,"kb_used_data":5640,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752908,"statfs":{"total":773094113280,"available":772866977792,"internally_reserved":0,"allocated":5775360,"data_stored":3040132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.080253"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.337145+0000","last_change":"2024-09-13T18:29:10.314569+0000","last_active":"2024-09-13T18:29:11.337145+0000","last_peered":"2024-09-13T18:29:11.337145+0000","last_clean":"2024-09-13T18:29:11.337145+0000","last_became_active":"2024-09-13T18:29:10.314290+0000","last_became_peered":"2024-09-13T18:29:10.314290+0000","last_unstale":"2024-09-13T18:29:11.337145+0000","last_undegraded":"2024-09-13T18:29:11.337145+0000","last_fullsized":"2024-09-13T18:29:11.337145+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:35.269368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.300911+0000","last_change":"2024-09-13T18:29:10.312829+0000","last_active":"2024-09-13T18:29:11.300911+0000","last_peered":"2024-09-13T18:29:11.300911+0000","last_clean":"2024-09-13T18:29:11.300911+0000","last_became_active":"2024-09-13T18:29:10.312132+0000","last_became_peered":"2024-09-13T18:29:10.312132+0000","last_unstale":"2024-09-13T18:29:11.300911+0000","last_undegraded":"2024-09-13T18:29:11.300911+0000","last_fullsized":"2024-09-13T18:29:11.300911+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:02.551705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.336949+0000","last_change":"2024-09-13T18:29:10.321676+0000","last_active":"2024-09-13T18:29:11.336949+0000","last_peered":"2024-09-13T18:29:11.336949+0000","last_clean":"2024-09-13T18:29:11.336949+0000","last_became_active":"2024-09-13T18:29:10.321418+0000","last_became_peered":"2024-09-13T18:29:10.321418+0000","last_unstale":"2024-09-13T18:29:11.336949+0000","last_undegraded":"2024-09-13T18:29:11.336949+0000","last_fullsized":"2024-09-13T18:29:11.336949+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:13.393769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.338115+0000","last_change":"2024-09-13T18:29:10.315453+0000","last_active":"2024-09-13T18:29:11.338115+0000","last_peered":"2024-09-13T18:29:11.338115+0000","last_clean":"2024-09-13T18:29:11.338115+0000","last_became_active":"2024-09-13T18:29:10.315194+0000","last_became_peered":"2024-09-13T18:29:10.315194+0000","last_unstale":"2024-09-13T18:29:11.338115+0000","last_undegraded":"2024-09-13T18:29:11.338115+0000","last_fullsized":"2024-09-13T18:29:11.338115+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:36.726154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.300250+0000","last_change":"2024-09-13T18:29:10.313330+0000","last_active":"2024-09-13T18:29:11.300250+0000","last_peered":"2024-09-13T18:29:11.300250+0000","last_clean":"2024-09-13T18:29:11.300250+0000","last_became_active":"2024-09-13T18:29:10.313002+0000","last_became_peered":"2024-09-13T18:29:10.313002+0000","last_unstale":"2024-09-13T18:29:11.300250+0000","last_undegraded":"2024-09-13T18:29:11.300250+0000","last_fullsized":"2024-09-13T18:29:11.300250+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:36.726154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.302733+0000","last_change":"2024-09-13T18:29:10.317190+0000","last_active":"2024-09-13T18:29:11.302733+0000","last_peered":"2024-09-13T18:29:11.302733+0000","last_clean":"2024-09-13T18:29:11.302733+0000","last_became_active":"2024-09-13T18:29:10.316886+0000","last_became_peered":"2024-09-13T18:29:10.316886+0000","last_unstale":"2024-09-13T18:29:11.302733+0000","last_undegraded":"2024-09-13T18:29:11.302733+0000","last_fullsized":"2024-09-13T18:29:11.302733+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:05.848632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.336369+0000","last_change":"2024-09-13T18:29:10.304025+0000","last_active":"2024-09-13T18:29:11.336369+0000","last_peered":"2024-09-13T18:29:11.336369+0000","last_clean":"2024-09-13T18:29:11.336369+0000","last_became_active":"2024-09-13T18:29:10.303786+0000","last_became_peered":"2024-09-13T18:29:10.303786+0000","last_unstale":"2024-09-13T18:29:11.336369+0000","last_undegraded":"2024-09-13T18:29:11.336369+0000","last_fullsized":"2024-09-13T18:29:11.336369+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:11.867682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.336874+0000","last_change":"2024-09-13T18:29:10.312588+0000","last_active":"2024-09-13T18:29:11.336874+0000","last_peered":"2024-09-13T18:29:11.336874+0000","last_clean":"2024-09-13T18:29:11.336874+0000","last_became_active":"2024-09-13T18:29:10.312388+0000","last_became_peered":"2024-09-13T18:29:10.312388+0000","last_unstale":"2024-09-13T18:29:11.336874+0000","last_undegraded":"2024-09-13T18:29:11.336874+0000","last_fullsized":"2024-09-13T18:29:11.336874+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:02.678407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.338366+0000","last_change":"2024-09-13T18:29:10.310019+0000","last_active":"2024-09-13T18:29:11.338366+0000","last_peered":"2024-09-13T18:29:11.338366+0000","last_clean":"2024-09-13T18:29:11.338366+0000","last_became_active":"2024-09-13T18:29:10.309702+0000","last_became_peered":"2024-09-13T18:29:10.309702+0000","last_unstale":"2024-09-13T18:29:11.338366+0000","last_undegraded":"2024-09-13T18:29:11.338366+0000","last_fullsized":"2024-09-13T18:29:11.338366+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:13.393769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.338155+0000","last_change":"2024-09-13T18:29:10.311651+0000","last_active":"2024-09-13T18:29:11.338155+0000","last_peered":"2024-09-13T18:29:11.338155+0000","last_clean":"2024-09-13T18:29:11.338155+0000","last_became_active":"2024-09-13T18:29:10.311370+0000","last_became_peered":"2024-09-13T18:29:10.311370+0000","last_unstale":"2024-09-13T18:29:11.338155+0000","last_undegraded":"2024-09-13T18:29:11.338155+0000","last_fullsized":"2024-09-13T18:29:11.338155+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:33.459205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.338046+0000","last_change":"2024-09-13T18:29:10.310165+0000","last_active":"2024-09-13T18:29:11.338046+0000","last_peered":"2024-09-13T18:29:11.338046+0000","last_clean":"2024-09-13T18:29:11.338046+0000","last_became_active":"2024-09-13T18:29:10.309934+0000","last_became_peered":"2024-09-13T18:29:10.309934+0000","last_unstale":"2024-09-13T18:29:11.338046+0000","last_undegraded":"2024-09-13T18:29:11.338046+0000","last_fullsized":"2024-09-13T18:29:11.338046+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:09.878721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.300507+0000","last_change":"2024-09-13T18:29:10.321537+0000","last_active":"2024-09-13T18:29:11.300507+0000","last_peered":"2024-09-13T18:29:11.300507+0000","last_clean":"2024-09-13T18:29:11.300507+0000","last_became_active":"2024-09-13T18:29:10.321243+0000","last_became_peered":"2024-09-13T18:29:10.321243+0000","last_unstale":"2024-09-13T18:29:11.300507+0000","last_undegraded":"2024-09-13T18:29:11.300507+0000","last_fullsized":"2024-09-13T18:29:11.300507+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:33.459205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.337363+0000","last_change":"2024-09-13T18:29:10.322897+0000","last_active":"2024-09-13T18:29:11.337363+0000","last_peered":"2024-09-13T18:29:11.337363+0000","last_clean":"2024-09-13T18:29:11.337363+0000","last_became_active":"2024-09-13T18:29:10.322566+0000","last_became_peered":"2024-09-13T18:29:10.322566+0000","last_unstale":"2024-09-13T18:29:11.337363+0000","last_undegraded":"2024-09-13T18:29:11.337363+0000","last_fullsized":"2024-09-13T18:29:11.337363+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:38.979304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.337059+0000","last_change":"2024-09-13T18:29:10.320672+0000","last_active":"2024-09-13T18:29:11.337059+0000","last_peered":"2024-09-13T18:29:11.337059+0000","last_clean":"2024-09-13T18:29:11.337059+0000","last_became_active":"2024-09-13T18:29:10.320452+0000","last_became_peered":"2024-09-13T18:29:10.320452+0000","last_unstale":"2024-09-13T18:29:11.337059+0000","last_undegraded":"2024-09-13T18:29:11.337059+0000","last_fullsized":"2024-09-13T18:29:11.337059+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:55.274586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.302749+0000","last_change":"2024-09-13T18:29:10.310000+0000","last_active":"2024-09-13T18:29:11.302749+0000","last_peered":"2024-09-13T18:29:11.302749+0000","last_clean":"2024-09-13T18:29:11.302749+0000","last_became_active":"2024-09-13T18:29:10.309137+0000","last_became_peered":"2024-09-13T18:29:10.309137+0000","last_unstale":"2024-09-13T18:29:11.302749+0000","last_undegraded":"2024-09-13T18:29:11.302749+0000","last_fullsized":"2024-09-13T18:29:11.302749+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:16.266849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.336443+0000","last_change":"2024-09-13T18:29:10.314126+0000","last_active":"2024-09-13T18:29:11.336443+0000","last_peered":"2024-09-13T18:29:11.336443+0000","last_clean":"2024-09-13T18:29:11.336443+0000","last_became_active":"2024-09-13T18:29:10.313882+0000","last_became_peered":"2024-09-13T18:29:10.313882+0000","last_unstale":"2024-09-13T18:29:11.336443+0000","last_undegraded":"2024-09-13T18:29:11.336443+0000","last_fullsized":"2024-09-13T18:29:11.336443+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:26.206248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.337496+0000","last_change":"2024-09-13T18:29:10.312937+0000","last_active":"2024-09-13T18:29:11.337496+0000","last_peered":"2024-09-13T18:29:11.337496+0000","last_clean":"2024-09-13T18:29:11.337496+0000","last_became_active":"2024-09-13T18:29:10.312658+0000","last_became_peered":"2024-09-13T18:29:10.312658+0000","last_unstale":"2024-09-13T18:29:11.337496+0000","last_undegraded":"2024-09-13T18:29:11.337496+0000","last_fullsized":"2024-09-13T18:29:11.337496+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:04.710331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.336956+0000","last_change":"2024-09-13T18:29:10.311779+0000","last_active":"2024-09-13T18:29:11.336956+0000","last_peered":"2024-09-13T18:29:11.336956+0000","last_clean":"2024-09-13T18:29:11.336956+0000","last_became_active":"2024-09-13T18:29:10.311509+0000","last_became_peered":"2024-09-13T18:29:10.311509+0000","last_unstale":"2024-09-13T18:29:11.336956+0000","last_undegraded":"2024-09-13T18:29:11.336956+0000","last_fullsized":"2024-09-13T18:29:11.336956+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:01.846564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.338922+0000","last_change":"2024-09-13T18:29:10.311618+0000","last_active":"2024-09-13T18:29:11.338922+0000","last_peered":"2024-09-13T18:29:11.338922+0000","last_clean":"2024-09-13T18:29:11.338922+0000","last_became_active":"2024-09-13T18:29:10.311181+0000","last_became_peered":"2024-09-13T18:29:10.311181+0000","last_unstale":"2024-09-13T18:29:11.338922+0000","last_undegraded":"2024-09-13T18:29:11.338922+0000","last_fullsized":"2024-09-13T18:29:11.338922+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:01.846564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.337500+0000","last_change":"2024-09-13T18:29:10.320726+0000","last_active":"2024-09-13T18:29:11.337500+0000","last_peered":"2024-09-13T18:29:11.337500+0000","last_clean":"2024-09-13T18:29:11.337500+0000","last_became_active":"2024-09-13T18:29:10.320508+0000","last_became_peered":"2024-09-13T18:29:10.320508+0000","last_unstale":"2024-09-13T18:29:11.337500+0000","last_undegraded":"2024-09-13T18:29:11.337500+0000","last_fullsized":"2024-09-13T18:29:11.337500+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:48.481586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.302679+0000","last_change":"2024-09-13T18:29:10.313106+0000","last_active":"2024-09-13T18:29:11.302679+0000","last_peered":"2024-09-13T18:29:11.302679+0000","last_clean":"2024-09-13T18:29:11.302679+0000","last_became_active":"2024-09-13T18:29:10.312866+0000","last_became_peered":"2024-09-13T18:29:10.312866+0000","last_unstale":"2024-09-13T18:29:11.302679+0000","last_undegraded":"2024-09-13T18:29:11.302679+0000","last_fullsized":"2024-09-13T18:29:11.302679+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:57.089353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.337244+0000","last_change":"2024-09-13T18:29:10.312302+0000","last_active":"2024-09-13T18:29:11.337244+0000","last_peered":"2024-09-13T18:29:11.337244+0000","last_clean":"2024-09-13T18:29:11.337244+0000","last_became_active":"2024-09-13T18:29:10.311975+0000","last_became_peered":"2024-09-13T18:29:10.311975+0000","last_unstale":"2024-09-13T18:29:11.337244+0000","last_undegraded":"2024-09-13T18:29:11.337244+0000","last_fullsized":"2024-09-13T18:29:11.337244+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:02.551705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.337215+0000","last_change":"2024-09-13T18:29:10.315475+0000","last_active":"2024-09-13T18:29:11.337215+0000","last_peered":"2024-09-13T18:29:11.337215+0000","last_clean":"2024-09-13T18:29:11.337215+0000","last_became_active":"2024-09-13T18:29:10.315147+0000","last_became_peered":"2024-09-13T18:29:10.315147+0000","last_unstale":"2024-09-13T18:29:11.337215+0000","last_undegraded":"2024-09-13T18:29:11.337215+0000","last_fullsized":"2024-09-13T18:29:11.337215+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:16.444395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.336663+0000","last_change":"2024-09-13T18:29:10.315400+0000","last_active":"2024-09-13T18:29:11.336663+0000","last_peered":"2024-09-13T18:29:11.336663+0000","last_clean":"2024-09-13T18:29:11.336663+0000","last_became_active":"2024-09-13T18:29:10.315075+0000","last_became_peered":"2024-09-13T18:29:10.315075+0000","last_unstale":"2024-09-13T18:29:11.336663+0000","last_undegraded":"2024-09-13T18:29:11.336663+0000","last_fullsized":"2024-09-13T18:29:11.336663+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:53.948934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.339044+0000","last_change":"2024-09-13T18:29:10.318339+0000","last_active":"2024-09-13T18:29:11.339044+0000","last_peered":"2024-09-13T18:29:11.339044+0000","last_clean":"2024-09-13T18:29:11.339044+0000","last_became_active":"2024-09-13T18:29:10.318027+0000","last_became_peered":"2024-09-13T18:29:10.318027+0000","last_unstale":"2024-09-13T18:29:11.339044+0000","last_undegraded":"2024-09-13T18:29:11.339044+0000","last_fullsized":"2024-09-13T18:29:11.339044+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:10.971302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.337601+0000","last_change":"2024-09-13T18:29:10.323632+0000","last_active":"2024-09-13T18:29:11.337601+0000","last_peered":"2024-09-13T18:29:11.337601+0000","last_clean":"2024-09-13T18:29:11.337601+0000","last_became_active":"2024-09-13T18:29:10.323403+0000","last_became_peered":"2024-09-13T18:29:10.323403+0000","last_unstale":"2024-09-13T18:29:11.337601+0000","last_undegraded":"2024-09-13T18:29:11.337601+0000","last_fullsized":"2024-09-13T18:29:11.337601+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:53.136997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.336968+0000","last_change":"2024-09-13T18:29:10.308840+0000","last_active":"2024-09-13T18:29:11.336968+0000","last_peered":"2024-09-13T18:29:11.336968+0000","last_clean":"2024-09-13T18:29:11.336968+0000","last_became_active":"2024-09-13T18:29:10.308547+0000","last_became_peered":"2024-09-13T18:29:10.308547+0000","last_unstale":"2024-09-13T18:29:11.336968+0000","last_undegraded":"2024-09-13T18:29:11.336968+0000","last_fullsized":"2024-09-13T18:29:11.336968+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:08.566530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.300674+0000","last_change":"2024-09-13T18:29:10.321498+0000","last_active":"2024-09-13T18:29:11.300674+0000","last_peered":"2024-09-13T18:29:11.300674+0000","last_clean":"2024-09-13T18:29:11.300674+0000","last_became_active":"2024-09-13T18:29:10.321208+0000","last_became_peered":"2024-09-13T18:29:10.321208+0000","last_unstale":"2024-09-13T18:29:11.300674+0000","last_undegraded":"2024-09-13T18:29:11.300674+0000","last_fullsized":"2024-09-13T18:29:11.300674+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:33.077559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.337868+0000","last_change":"2024-09-13T18:29:10.318426+0000","last_active":"2024-09-13T18:29:11.337868+0000","last_peered":"2024-09-13T18:29:11.337868+0000","last_clean":"2024-09-13T18:29:11.337868+0000","last_became_active":"2024-09-13T18:29:10.318134+0000","last_became_peered":"2024-09-13T18:29:10.318134+0000","last_unstale":"2024-09-13T18:29:11.337868+0000","last_undegraded":"2024-09-13T18:29:11.337868+0000","last_fullsized":"2024-09-13T18:29:11.337868+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:52.630440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.336002+0000","last_change":"2024-09-13T18:29:10.304818+0000","last_active":"2024-09-13T18:29:11.336002+0000","last_peered":"2024-09-13T18:29:11.336002+0000","last_clean":"2024-09-13T18:29:11.336002+0000","last_became_active":"2024-09-13T18:29:10.304583+0000","last_became_peered":"2024-09-13T18:29:10.304583+0000","last_unstale":"2024-09-13T18:29:11.336002+0000","last_undegraded":"2024-09-13T18:29:11.336002+0000","last_fullsized":"2024-09-13T18:29:11.336002+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:10.971302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.302997+0000","last_change":"2024-09-13T18:29:10.308687+0000","last_active":"2024-09-13T18:29:11.302997+0000","last_peered":"2024-09-13T18:29:11.302997+0000","last_clean":"2024-09-13T18:29:11.302997+0000","last_became_active":"2024-09-13T18:29:10.308393+0000","last_became_peered":"2024-09-13T18:29:10.308393+0000","last_unstale":"2024-09-13T18:29:11.302997+0000","last_undegraded":"2024-09-13T18:29:11.302997+0000","last_fullsized":"2024-09-13T18:29:11.302997+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:23.620659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.337305+0000","last_change":"2024-09-13T18:29:10.320191+0000","last_active":"2024-09-13T18:29:11.337305+0000","last_peered":"2024-09-13T18:29:11.337305+0000","last_clean":"2024-09-13T18:29:11.337305+0000","last_became_active":"2024-09-13T18:29:10.319961+0000","last_became_peered":"2024-09-13T18:29:10.319961+0000","last_unstale":"2024-09-13T18:29:11.337305+0000","last_undegraded":"2024-09-13T18:29:11.337305+0000","last_fullsized":"2024-09-13T18:29:11.337305+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:17.139740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.303648+0000","last_change":"2024-09-13T18:29:10.301766+0000","last_active":"2024-09-13T18:29:11.303648+0000","last_peered":"2024-09-13T18:29:11.303648+0000","last_clean":"2024-09-13T18:29:11.303648+0000","last_became_active":"2024-09-13T18:29:10.301382+0000","last_became_peered":"2024-09-13T18:29:10.301382+0000","last_unstale":"2024-09-13T18:29:11.303648+0000","last_undegraded":"2024-09-13T18:29:11.303648+0000","last_fullsized":"2024-09-13T18:29:11.303648+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:01.846564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.314176+0000","last_change":"2024-09-13T18:29:09.914643+0000","last_active":"2024-09-13T18:29:10.314176+0000","last_peered":"2024-09-13T18:29:10.314176+0000","last_clean":"2024-09-13T18:29:10.314176+0000","last_became_active":"2024-09-13T18:29:09.914348+0000","last_became_peered":"2024-09-13T18:29:09.914348+0000","last_unstale":"2024-09-13T18:29:10.314176+0000","last_undegraded":"2024-09-13T18:29:10.314176+0000","last_fullsized":"2024-09-13T18:29:10.314176+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:24.270758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.338610+0000","last_change":"2024-09-13T18:29:10.309195+0000","last_active":"2024-09-13T18:29:11.338610+0000","last_peered":"2024-09-13T18:29:11.338610+0000","last_clean":"2024-09-13T18:29:11.338610+0000","last_became_active":"2024-09-13T18:29:10.308949+0000","last_became_peered":"2024-09-13T18:29:10.308949+0000","last_unstale":"2024-09-13T18:29:11.338610+0000","last_undegraded":"2024-09-13T18:29:11.338610+0000","last_fullsized":"2024-09-13T18:29:11.338610+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:25.279994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.312616+0000","last_change":"2024-09-13T18:29:09.915162+0000","last_active":"2024-09-13T18:29:10.312616+0000","last_peered":"2024-09-13T18:29:10.312616+0000","last_clean":"2024-09-13T18:29:10.312616+0000","last_became_active":"2024-09-13T18:29:09.914782+0000","last_became_peered":"2024-09-13T18:29:09.914782+0000","last_unstale":"2024-09-13T18:29:10.312616+0000","last_undegraded":"2024-09-13T18:29:10.312616+0000","last_fullsized":"2024-09-13T18:29:10.312616+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:47.472350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.300758+0000","last_change":"2024-09-13T18:29:10.309439+0000","last_active":"2024-09-13T18:29:11.300758+0000","last_peered":"2024-09-13T18:29:11.300758+0000","last_clean":"2024-09-13T18:29:11.300758+0000","last_became_active":"2024-09-13T18:29:10.308168+0000","last_became_peered":"2024-09-13T18:29:10.308168+0000","last_unstale":"2024-09-13T18:29:11.300758+0000","last_undegraded":"2024-09-13T18:29:11.300758+0000","last_fullsized":"2024-09-13T18:29:11.300758+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:42.347196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.313028+0000","last_change":"2024-09-13T18:29:09.915697+0000","last_active":"2024-09-13T18:29:10.313028+0000","last_peered":"2024-09-13T18:29:10.313028+0000","last_clean":"2024-09-13T18:29:10.313028+0000","last_became_active":"2024-09-13T18:29:09.915409+0000","last_became_peered":"2024-09-13T18:29:09.915409+0000","last_unstale":"2024-09-13T18:29:10.313028+0000","last_undegraded":"2024-09-13T18:29:10.313028+0000","last_fullsized":"2024-09-13T18:29:10.313028+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:09.962065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.302743+0000","last_change":"2024-09-13T18:29:10.310489+0000","last_active":"2024-09-13T18:29:11.302743+0000","last_peered":"2024-09-13T18:29:11.302743+0000","last_clean":"2024-09-13T18:29:11.302743+0000","last_became_active":"2024-09-13T18:29:10.310217+0000","last_became_peered":"2024-09-13T18:29:10.310217+0000","last_unstale":"2024-09-13T18:29:11.302743+0000","last_undegraded":"2024-09-13T18:29:11.302743+0000","last_fullsized":"2024-09-13T18:29:11.302743+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:25.279994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.314096+0000","last_change":"2024-09-13T18:29:09.910352+0000","last_active":"2024-09-13T18:29:10.314096+0000","last_peered":"2024-09-13T18:29:10.314096+0000","last_clean":"2024-09-13T18:29:10.314096+0000","last_became_active":"2024-09-13T18:29:09.910067+0000","last_became_peered":"2024-09-13T18:29:09.910067+0000","last_unstale":"2024-09-13T18:29:10.314096+0000","last_undegraded":"2024-09-13T18:29:10.314096+0000","last_fullsized":"2024-09-13T18:29:10.314096+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:00.837327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.336191+0000","last_change":"2024-09-13T18:29:10.309049+0000","last_active":"2024-09-13T18:29:11.336191+0000","last_peered":"2024-09-13T18:29:11.336191+0000","last_clean":"2024-09-13T18:29:11.336191+0000","last_became_active":"2024-09-13T18:29:10.308809+0000","last_became_peered":"2024-09-13T18:29:10.308809+0000","last_unstale":"2024-09-13T18:29:11.336191+0000","last_undegraded":"2024-09-13T18:29:11.336191+0000","last_fullsized":"2024-09-13T18:29:11.336191+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:16.444395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.316713+0000","last_change":"2024-09-13T18:29:09.911517+0000","last_active":"2024-09-13T18:29:10.316713+0000","last_peered":"2024-09-13T18:29:10.316713+0000","last_clean":"2024-09-13T18:29:10.316713+0000","last_became_active":"2024-09-13T18:29:09.911256+0000","last_became_peered":"2024-09-13T18:29:09.911256+0000","last_unstale":"2024-09-13T18:29:10.316713+0000","last_undegraded":"2024-09-13T18:29:10.316713+0000","last_fullsized":"2024-09-13T18:29:10.316713+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:25.197012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.336879+0000","last_change":"2024-09-13T18:29:10.324095+0000","last_active":"2024-09-13T18:29:11.336879+0000","last_peered":"2024-09-13T18:29:11.336879+0000","last_clean":"2024-09-13T18:29:11.336879+0000","last_became_active":"2024-09-13T18:29:10.323879+0000","last_became_peered":"2024-09-13T18:29:10.323879+0000","last_unstale":"2024-09-13T18:29:11.336879+0000","last_undegraded":"2024-09-13T18:29:11.336879+0000","last_fullsized":"2024-09-13T18:29:11.336879+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:15.320936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.309956+0000","last_change":"2024-09-13T18:29:09.915780+0000","last_active":"2024-09-13T18:29:10.309956+0000","last_peered":"2024-09-13T18:29:10.309956+0000","last_clean":"2024-09-13T18:29:10.309956+0000","last_became_active":"2024-09-13T18:29:09.915045+0000","last_became_peered":"2024-09-13T18:29:09.915045+0000","last_unstale":"2024-09-13T18:29:10.309956+0000","last_undegraded":"2024-09-13T18:29:10.309956+0000","last_fullsized":"2024-09-13T18:29:10.309956+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:09.004250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.337042+0000","last_change":"2024-09-13T18:29:10.312157+0000","last_active":"2024-09-13T18:29:11.337042+0000","last_peered":"2024-09-13T18:29:11.337042+0000","last_clean":"2024-09-13T18:29:11.337042+0000","last_became_active":"2024-09-13T18:29:10.311897+0000","last_became_peered":"2024-09-13T18:29:10.311897+0000","last_unstale":"2024-09-13T18:29:11.337042+0000","last_undegraded":"2024-09-13T18:29:11.337042+0000","last_fullsized":"2024-09-13T18:29:11.337042+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:18.749173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.298761+0000","last_change":"2024-09-13T18:29:09.906099+0000","last_active":"2024-09-13T18:29:10.298761+0000","last_peered":"2024-09-13T18:29:10.298761+0000","last_clean":"2024-09-13T18:29:10.298761+0000","last_became_active":"2024-09-13T18:29:09.905761+0000","last_became_peered":"2024-09-13T18:29:09.905761+0000","last_unstale":"2024-09-13T18:29:10.298761+0000","last_undegraded":"2024-09-13T18:29:10.298761+0000","last_fullsized":"2024-09-13T18:29:10.298761+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:26.481517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.336646+0000","last_change":"2024-09-13T18:29:10.315606+0000","last_active":"2024-09-13T18:29:11.336646+0000","last_peered":"2024-09-13T18:29:11.336646+0000","last_clean":"2024-09-13T18:29:11.336646+0000","last_became_active":"2024-09-13T18:29:10.315251+0000","last_became_peered":"2024-09-13T18:29:10.315251+0000","last_unstale":"2024-09-13T18:29:11.336646+0000","last_undegraded":"2024-09-13T18:29:11.336646+0000","last_fullsized":"2024-09-13T18:29:11.336646+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:13.393769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.307552+0000","last_change":"2024-09-13T18:29:09.916102+0000","last_active":"2024-09-13T18:29:10.307552+0000","last_peered":"2024-09-13T18:29:10.307552+0000","last_clean":"2024-09-13T18:29:10.307552+0000","last_became_active":"2024-09-13T18:29:09.915793+0000","last_became_peered":"2024-09-13T18:29:09.915793+0000","last_unstale":"2024-09-13T18:29:10.307552+0000","last_undegraded":"2024-09-13T18:29:10.307552+0000","last_fullsized":"2024-09-13T18:29:10.307552+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:24.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.337198+0000","last_change":"2024-09-13T18:29:10.311810+0000","last_active":"2024-09-13T18:29:11.337198+0000","last_peered":"2024-09-13T18:29:11.337198+0000","last_clean":"2024-09-13T18:29:11.337198+0000","last_became_active":"2024-09-13T18:29:10.311544+0000","last_became_peered":"2024-09-13T18:29:10.311544+0000","last_unstale":"2024-09-13T18:29:11.337198+0000","last_undegraded":"2024-09-13T18:29:11.337198+0000","last_fullsized":"2024-09-13T18:29:11.337198+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:53.948934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.301547+0000","last_change":"2024-09-13T18:29:09.912560+0000","last_active":"2024-09-13T18:29:10.301547+0000","last_peered":"2024-09-13T18:29:10.301547+0000","last_clean":"2024-09-13T18:29:10.301547+0000","last_became_active":"2024-09-13T18:29:09.912270+0000","last_became_peered":"2024-09-13T18:29:09.912270+0000","last_unstale":"2024-09-13T18:29:10.301547+0000","last_undegraded":"2024-09-13T18:29:10.301547+0000","last_fullsized":"2024-09-13T18:29:10.301547+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:32.352134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.337223+0000","last_change":"2024-09-13T18:29:10.306752+0000","last_active":"2024-09-13T18:29:11.337223+0000","last_peered":"2024-09-13T18:29:11.337223+0000","last_clean":"2024-09-13T18:29:11.337223+0000","last_became_active":"2024-09-13T18:29:10.306491+0000","last_became_peered":"2024-09-13T18:29:10.306491+0000","last_unstale":"2024-09-13T18:29:11.337223+0000","last_undegraded":"2024-09-13T18:29:11.337223+0000","last_fullsized":"2024-09-13T18:29:11.337223+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:02.678407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.308024+0000","last_change":"2024-09-13T18:29:09.915532+0000","last_active":"2024-09-13T18:29:10.308024+0000","last_peered":"2024-09-13T18:29:10.308024+0000","last_clean":"2024-09-13T18:29:10.308024+0000","last_became_active":"2024-09-13T18:29:09.913021+0000","last_became_peered":"2024-09-13T18:29:09.913021+0000","last_unstale":"2024-09-13T18:29:10.308024+0000","last_undegraded":"2024-09-13T18:29:10.308024+0000","last_fullsized":"2024-09-13T18:29:10.308024+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:47.472350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.303957+0000","last_change":"2024-09-13T18:29:10.323302+0000","last_active":"2024-09-13T18:29:11.303957+0000","last_peered":"2024-09-13T18:29:11.303957+0000","last_clean":"2024-09-13T18:29:11.303957+0000","last_became_active":"2024-09-13T18:29:10.323052+0000","last_became_peered":"2024-09-13T18:29:10.323052+0000","last_unstale":"2024-09-13T18:29:11.303957+0000","last_undegraded":"2024-09-13T18:29:11.303957+0000","last_fullsized":"2024-09-13T18:29:11.303957+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:11.090395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.307080+0000","last_change":"2024-09-13T18:29:09.917941+0000","last_active":"2024-09-13T18:29:10.307080+0000","last_peered":"2024-09-13T18:29:10.307080+0000","last_clean":"2024-09-13T18:29:10.307080+0000","last_became_active":"2024-09-13T18:29:09.917675+0000","last_became_peered":"2024-09-13T18:29:09.917675+0000","last_unstale":"2024-09-13T18:29:10.307080+0000","last_undegraded":"2024-09-13T18:29:10.307080+0000","last_fullsized":"2024-09-13T18:29:10.307080+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:24.270758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.336443+0000","last_change":"2024-09-13T18:29:10.301635+0000","last_active":"2024-09-13T18:29:11.336443+0000","last_peered":"2024-09-13T18:29:11.336443+0000","last_clean":"2024-09-13T18:29:11.336443+0000","last_became_active":"2024-09-13T18:29:10.301368+0000","last_became_peered":"2024-09-13T18:29:10.301368+0000","last_unstale":"2024-09-13T18:29:11.336443+0000","last_undegraded":"2024-09-13T18:29:11.336443+0000","last_fullsized":"2024-09-13T18:29:11.336443+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:06:18.525101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.330364+0000","last_change":"2024-09-13T18:29:09.917659+0000","last_active":"2024-09-13T18:29:10.330364+0000","last_peered":"2024-09-13T18:29:10.330364+0000","last_clean":"2024-09-13T18:29:10.330364+0000","last_became_active":"2024-09-13T18:29:09.917372+0000","last_became_peered":"2024-09-13T18:29:09.917372+0000","last_unstale":"2024-09-13T18:29:10.330364+0000","last_undegraded":"2024-09-13T18:29:10.330364+0000","last_fullsized":"2024-09-13T18:29:10.330364+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:14.350641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.337875+0000","last_change":"2024-09-13T18:29:10.313628+0000","last_active":"2024-09-13T18:29:11.337875+0000","last_peered":"2024-09-13T18:29:11.337875+0000","last_clean":"2024-09-13T18:29:11.337875+0000","last_became_active":"2024-09-13T18:29:10.313346+0000","last_became_peered":"2024-09-13T18:29:10.313346+0000","last_unstale":"2024-09-13T18:29:11.337875+0000","last_undegraded":"2024-09-13T18:29:11.337875+0000","last_fullsized":"2024-09-13T18:29:11.337875+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:04.710331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.313859+0000","last_change":"2024-09-13T18:29:09.916717+0000","last_active":"2024-09-13T18:29:10.313859+0000","last_peered":"2024-09-13T18:29:10.313859+0000","last_clean":"2024-09-13T18:29:10.313859+0000","last_became_active":"2024-09-13T18:29:09.916452+0000","last_became_peered":"2024-09-13T18:29:09.916452+0000","last_unstale":"2024-09-13T18:29:10.313859+0000","last_undegraded":"2024-09-13T18:29:10.313859+0000","last_fullsized":"2024-09-13T18:29:10.313859+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:41.337959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.337887+0000","last_change":"2024-09-13T18:29:10.320446+0000","last_active":"2024-09-13T18:29:11.337887+0000","last_peered":"2024-09-13T18:29:11.337887+0000","last_clean":"2024-09-13T18:29:11.337887+0000","last_became_active":"2024-09-13T18:29:10.320204+0000","last_became_peered":"2024-09-13T18:29:10.320204+0000","last_unstale":"2024-09-13T18:29:11.337887+0000","last_undegraded":"2024-09-13T18:29:11.337887+0000","last_fullsized":"2024-09-13T18:29:11.337887+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:12.024393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.290742+0000","last_change":"2024-09-13T18:29:09.908717+0000","last_active":"2024-09-13T18:29:10.290742+0000","last_peered":"2024-09-13T18:29:10.290742+0000","last_clean":"2024-09-13T18:29:10.290742+0000","last_became_active":"2024-09-13T18:29:09.908417+0000","last_became_peered":"2024-09-13T18:29:09.908417+0000","last_unstale":"2024-09-13T18:29:10.290742+0000","last_undegraded":"2024-09-13T18:29:10.290742+0000","last_fullsized":"2024-09-13T18:29:10.290742+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:25.197012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.302402+0000","last_change":"2024-09-13T18:29:10.320673+0000","last_active":"2024-09-13T18:29:11.302402+0000","last_peered":"2024-09-13T18:29:11.302402+0000","last_clean":"2024-09-13T18:29:11.302402+0000","last_became_active":"2024-09-13T18:29:10.320404+0000","last_became_peered":"2024-09-13T18:29:10.320404+0000","last_unstale":"2024-09-13T18:29:11.302402+0000","last_undegraded":"2024-09-13T18:29:11.302402+0000","last_fullsized":"2024-09-13T18:29:11.302402+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:17.777269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.297750+0000","last_change":"2024-09-13T18:29:09.916977+0000","last_active":"2024-09-13T18:29:10.297750+0000","last_peered":"2024-09-13T18:29:10.297750+0000","last_clean":"2024-09-13T18:29:10.297750+0000","last_became_active":"2024-09-13T18:29:09.916717+0000","last_became_peered":"2024-09-13T18:29:09.916717+0000","last_unstale":"2024-09-13T18:29:10.297750+0000","last_undegraded":"2024-09-13T18:29:10.297750+0000","last_fullsized":"2024-09-13T18:29:10.297750+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:32.449968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.336502+0000","last_change":"2024-09-13T18:29:10.315647+0000","last_active":"2024-09-13T18:29:11.336502+0000","last_peered":"2024-09-13T18:29:11.336502+0000","last_clean":"2024-09-13T18:29:11.336502+0000","last_became_active":"2024-09-13T18:29:10.314059+0000","last_became_peered":"2024-09-13T18:29:10.314059+0000","last_unstale":"2024-09-13T18:29:11.336502+0000","last_undegraded":"2024-09-13T18:29:11.336502+0000","last_fullsized":"2024-09-13T18:29:11.336502+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:15.802477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":19,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.316196+0000","last_change":"2024-09-13T18:29:09.915499+0000","last_active":"2024-09-13T18:29:10.316196+0000","last_peered":"2024-09-13T18:29:10.316196+0000","last_clean":"2024-09-13T18:29:10.316196+0000","last_became_active":"2024-09-13T18:29:09.913295+0000","last_became_peered":"2024-09-13T18:29:09.913295+0000","last_unstale":"2024-09-13T18:29:10.316196+0000","last_undegraded":"2024-09-13T18:29:10.316196+0000","last_fullsized":"2024-09-13T18:29:10.316196+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:05.424273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.337589+0000","last_change":"2024-09-13T18:29:10.323096+0000","last_active":"2024-09-13T18:29:11.337589+0000","last_peered":"2024-09-13T18:29:11.337589+0000","last_clean":"2024-09-13T18:29:11.337589+0000","last_became_active":"2024-09-13T18:29:10.322493+0000","last_became_peered":"2024-09-13T18:29:10.322493+0000","last_unstale":"2024-09-13T18:29:11.337589+0000","last_undegraded":"2024-09-13T18:29:11.337589+0000","last_fullsized":"2024-09-13T18:29:11.337589+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:04.265742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.319277+0000","last_change":"2024-09-13T18:29:09.909900+0000","last_active":"2024-09-13T18:29:10.319277+0000","last_peered":"2024-09-13T18:29:10.319277+0000","last_clean":"2024-09-13T18:29:10.319277+0000","last_became_active":"2024-09-13T18:29:09.909431+0000","last_became_peered":"2024-09-13T18:29:09.909431+0000","last_unstale":"2024-09-13T18:29:10.319277+0000","last_undegraded":"2024-09-13T18:29:10.319277+0000","last_fullsized":"2024-09-13T18:29:10.319277+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:14.045917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.338556+0000","last_change":"2024-09-13T18:29:10.311652+0000","last_active":"2024-09-13T18:29:11.338556+0000","last_peered":"2024-09-13T18:29:11.338556+0000","last_clean":"2024-09-13T18:29:11.338556+0000","last_became_active":"2024-09-13T18:29:10.311355+0000","last_became_peered":"2024-09-13T18:29:10.311355+0000","last_unstale":"2024-09-13T18:29:11.338556+0000","last_undegraded":"2024-09-13T18:29:11.338556+0000","last_fullsized":"2024-09-13T18:29:11.338556+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:26.206248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.317835+0000","last_change":"2024-09-13T18:29:09.915384+0000","last_active":"2024-09-13T18:29:10.317835+0000","last_peered":"2024-09-13T18:29:10.317835+0000","last_clean":"2024-09-13T18:29:10.317835+0000","last_became_active":"2024-09-13T18:29:09.915089+0000","last_became_peered":"2024-09-13T18:29:09.915089+0000","last_unstale":"2024-09-13T18:29:10.317835+0000","last_undegraded":"2024-09-13T18:29:10.317835+0000","last_fullsized":"2024-09-13T18:29:10.317835+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:52.127760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.338385+0000","last_change":"2024-09-13T18:29:10.308389+0000","last_active":"2024-09-13T18:29:11.338385+0000","last_peered":"2024-09-13T18:29:11.338385+0000","last_clean":"2024-09-13T18:29:11.338385+0000","last_became_active":"2024-09-13T18:29:10.308066+0000","last_became_peered":"2024-09-13T18:29:10.308066+0000","last_unstale":"2024-09-13T18:29:11.338385+0000","last_undegraded":"2024-09-13T18:29:11.338385+0000","last_fullsized":"2024-09-13T18:29:11.338385+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:09.878721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.318283+0000","last_change":"2024-09-13T18:29:09.903221+0000","last_active":"2024-09-13T18:29:10.318283+0000","last_peered":"2024-09-13T18:29:10.318283+0000","last_clean":"2024-09-13T18:29:10.318283+0000","last_became_active":"2024-09-13T18:29:09.902609+0000","last_became_peered":"2024-09-13T18:29:09.902609+0000","last_unstale":"2024-09-13T18:29:10.318283+0000","last_undegraded":"2024-09-13T18:29:10.318283+0000","last_fullsized":"2024-09-13T18:29:10.318283+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:09.962065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.338714+0000","last_change":"2024-09-13T18:29:10.318513+0000","last_active":"2024-09-13T18:29:11.338714+0000","last_peered":"2024-09-13T18:29:11.338714+0000","last_clean":"2024-09-13T18:29:11.338714+0000","last_became_active":"2024-09-13T18:29:10.318190+0000","last_became_peered":"2024-09-13T18:29:10.318190+0000","last_unstale":"2024-09-13T18:29:11.338714+0000","last_undegraded":"2024-09-13T18:29:11.338714+0000","last_fullsized":"2024-09-13T18:29:11.338714+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:44.685638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.300063+0000","last_change":"2024-09-13T18:29:09.915469+0000","last_active":"2024-09-13T18:29:10.300063+0000","last_peered":"2024-09-13T18:29:10.300063+0000","last_clean":"2024-09-13T18:29:10.300063+0000","last_became_active":"2024-09-13T18:29:09.915143+0000","last_became_peered":"2024-09-13T18:29:09.915143+0000","last_unstale":"2024-09-13T18:29:10.300063+0000","last_undegraded":"2024-09-13T18:29:10.300063+0000","last_fullsized":"2024-09-13T18:29:10.300063+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:00.837327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.302927+0000","last_change":"2024-09-13T18:29:10.320016+0000","last_active":"2024-09-13T18:29:11.302927+0000","last_peered":"2024-09-13T18:29:11.302927+0000","last_clean":"2024-09-13T18:29:11.302927+0000","last_became_active":"2024-09-13T18:29:10.319773+0000","last_became_peered":"2024-09-13T18:29:10.319773+0000","last_unstale":"2024-09-13T18:29:11.302927+0000","last_undegraded":"2024-09-13T18:29:11.302927+0000","last_fullsized":"2024-09-13T18:29:11.302927+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:39.485384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.319282+0000","last_change":"2024-09-13T18:29:09.912462+0000","last_active":"2024-09-13T18:29:10.319282+0000","last_peered":"2024-09-13T18:29:10.319282+0000","last_clean":"2024-09-13T18:29:10.319282+0000","last_became_active":"2024-09-13T18:29:09.912216+0000","last_became_peered":"2024-09-13T18:29:09.912216+0000","last_unstale":"2024-09-13T18:29:10.319282+0000","last_undegraded":"2024-09-13T18:29:10.319282+0000","last_fullsized":"2024-09-13T18:29:10.319282+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:43.676401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.302499+0000","last_change":"2024-09-13T18:29:10.313245+0000","last_active":"2024-09-13T18:29:11.302499+0000","last_peered":"2024-09-13T18:29:11.302499+0000","last_clean":"2024-09-13T18:29:11.302499+0000","last_became_active":"2024-09-13T18:29:10.312835+0000","last_became_peered":"2024-09-13T18:29:10.312835+0000","last_unstale":"2024-09-13T18:29:11.302499+0000","last_undegraded":"2024-09-13T18:29:11.302499+0000","last_fullsized":"2024-09-13T18:29:11.302499+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:13.393769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.298929+0000","last_change":"2024-09-13T18:29:09.913631+0000","last_active":"2024-09-13T18:29:10.298929+0000","last_peered":"2024-09-13T18:29:10.298929+0000","last_clean":"2024-09-13T18:29:10.298929+0000","last_became_active":"2024-09-13T18:29:09.913354+0000","last_became_peered":"2024-09-13T18:29:09.913354+0000","last_unstale":"2024-09-13T18:29:10.298929+0000","last_undegraded":"2024-09-13T18:29:10.298929+0000","last_fullsized":"2024-09-13T18:29:10.298929+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:03.701094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.337391+0000","last_change":"2024-09-13T18:29:10.319824+0000","last_active":"2024-09-13T18:29:11.337391+0000","last_peered":"2024-09-13T18:29:11.337391+0000","last_clean":"2024-09-13T18:29:11.337391+0000","last_became_active":"2024-09-13T18:29:10.319475+0000","last_became_peered":"2024-09-13T18:29:10.319475+0000","last_unstale":"2024-09-13T18:29:11.337391+0000","last_undegraded":"2024-09-13T18:29:11.337391+0000","last_fullsized":"2024-09-13T18:29:11.337391+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:48.833597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.307587+0000","last_change":"2024-09-13T18:29:09.911687+0000","last_active":"2024-09-13T18:29:10.307587+0000","last_peered":"2024-09-13T18:29:10.307587+0000","last_clean":"2024-09-13T18:29:10.307587+0000","last_became_active":"2024-09-13T18:29:09.911405+0000","last_became_peered":"2024-09-13T18:29:09.911405+0000","last_unstale":"2024-09-13T18:29:10.307587+0000","last_undegraded":"2024-09-13T18:29:10.307587+0000","last_fullsized":"2024-09-13T18:29:10.307587+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:37.970067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.336853+0000","last_change":"2024-09-13T18:29:10.309880+0000","last_active":"2024-09-13T18:29:11.336853+0000","last_peered":"2024-09-13T18:29:11.336853+0000","last_clean":"2024-09-13T18:29:11.336853+0000","last_became_active":"2024-09-13T18:29:10.309614+0000","last_became_peered":"2024-09-13T18:29:10.309614+0000","last_unstale":"2024-09-13T18:29:11.336853+0000","last_undegraded":"2024-09-13T18:29:11.336853+0000","last_fullsized":"2024-09-13T18:29:11.336853+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:04.710331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.290487+0000","last_change":"2024-09-13T18:29:09.909116+0000","last_active":"2024-09-13T18:29:10.290487+0000","last_peered":"2024-09-13T18:29:10.290487+0000","last_clean":"2024-09-13T18:29:10.290487+0000","last_became_active":"2024-09-13T18:29:09.908866+0000","last_became_peered":"2024-09-13T18:29:09.908866+0000","last_unstale":"2024-09-13T18:29:10.290487+0000","last_undegraded":"2024-09-13T18:29:10.290487+0000","last_fullsized":"2024-09-13T18:29:10.290487+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:43.676401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.338814+0000","last_change":"2024-09-13T18:29:10.311379+0000","last_active":"2024-09-13T18:29:11.338814+0000","last_peered":"2024-09-13T18:29:11.338814+0000","last_clean":"2024-09-13T18:29:11.338814+0000","last_became_active":"2024-09-13T18:29:10.311092+0000","last_became_peered":"2024-09-13T18:29:10.311092+0000","last_unstale":"2024-09-13T18:29:11.338814+0000","last_undegraded":"2024-09-13T18:29:11.338814+0000","last_fullsized":"2024-09-13T18:29:11.338814+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:27.490753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.296505+0000","last_change":"2024-09-13T18:29:09.917934+0000","last_active":"2024-09-13T18:29:10.296505+0000","last_peered":"2024-09-13T18:29:10.296505+0000","last_clean":"2024-09-13T18:29:10.296505+0000","last_became_active":"2024-09-13T18:29:09.917637+0000","last_became_peered":"2024-09-13T18:29:09.917637+0000","last_unstale":"2024-09-13T18:29:10.296505+0000","last_undegraded":"2024-09-13T18:29:10.296505+0000","last_fullsized":"2024-09-13T18:29:10.296505+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:32.068323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.338251+0000","last_change":"2024-09-13T18:29:10.313556+0000","last_active":"2024-09-13T18:29:11.338251+0000","last_peered":"2024-09-13T18:29:11.338251+0000","last_clean":"2024-09-13T18:29:11.338251+0000","last_became_active":"2024-09-13T18:29:10.313116+0000","last_became_peered":"2024-09-13T18:29:10.313116+0000","last_unstale":"2024-09-13T18:29:11.338251+0000","last_undegraded":"2024-09-13T18:29:11.338251+0000","last_fullsized":"2024-09-13T18:29:11.338251+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:33.077559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.291634+0000","last_change":"2024-09-13T18:29:09.918450+0000","last_active":"2024-09-13T18:29:10.291634+0000","last_peered":"2024-09-13T18:29:10.291634+0000","last_clean":"2024-09-13T18:29:10.291634+0000","last_became_active":"2024-09-13T18:29:09.918185+0000","last_became_peered":"2024-09-13T18:29:09.918185+0000","last_unstale":"2024-09-13T18:29:10.291634+0000","last_undegraded":"2024-09-13T18:29:10.291634+0000","last_fullsized":"2024-09-13T18:29:10.291634+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:12.384532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.336685+0000","last_change":"2024-09-13T18:29:10.321483+0000","last_active":"2024-09-13T18:29:11.336685+0000","last_peered":"2024-09-13T18:29:11.336685+0000","last_clean":"2024-09-13T18:29:11.336685+0000","last_became_active":"2024-09-13T18:29:10.321241+0000","last_became_peered":"2024-09-13T18:29:10.321241+0000","last_unstale":"2024-09-13T18:29:11.336685+0000","last_undegraded":"2024-09-13T18:29:11.336685+0000","last_fullsized":"2024-09-13T18:29:11.336685+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:18.749173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.292498+0000","last_change":"2024-09-13T18:29:09.912718+0000","last_active":"2024-09-13T18:29:10.292498+0000","last_peered":"2024-09-13T18:29:10.292498+0000","last_clean":"2024-09-13T18:29:10.292498+0000","last_became_active":"2024-09-13T18:29:09.912417+0000","last_became_peered":"2024-09-13T18:29:09.912417+0000","last_unstale":"2024-09-13T18:29:10.292498+0000","last_undegraded":"2024-09-13T18:29:10.292498+0000","last_fullsized":"2024-09-13T18:29:10.292498+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:03.701094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.303111+0000","last_change":"2024-09-13T18:29:10.300581+0000","last_active":"2024-09-13T18:29:11.303111+0000","last_peered":"2024-09-13T18:29:11.303111+0000","last_clean":"2024-09-13T18:29:11.303111+0000","last_became_active":"2024-09-13T18:29:10.300306+0000","last_became_peered":"2024-09-13T18:29:10.300306+0000","last_unstale":"2024-09-13T18:29:11.303111+0000","last_undegraded":"2024-09-13T18:29:11.303111+0000","last_fullsized":"2024-09-13T18:29:11.303111+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:18.013025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.291700+0000","last_change":"2024-09-13T18:29:09.913621+0000","last_active":"2024-09-13T18:29:10.291700+0000","last_peered":"2024-09-13T18:29:10.291700+0000","last_clean":"2024-09-13T18:29:10.291700+0000","last_became_active":"2024-09-13T18:29:09.913035+0000","last_became_peered":"2024-09-13T18:29:09.913035+0000","last_unstale":"2024-09-13T18:29:10.291700+0000","last_undegraded":"2024-09-13T18:29:10.291700+0000","last_fullsized":"2024-09-13T18:29:10.291700+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:15.435159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.302958+0000","last_change":"2024-09-13T18:29:10.323469+0000","last_active":"2024-09-13T18:29:11.302958+0000","last_peered":"2024-09-13T18:29:11.302958+0000","last_clean":"2024-09-13T18:29:11.302958+0000","last_became_active":"2024-09-13T18:29:10.323125+0000","last_became_peered":"2024-09-13T18:29:10.323125+0000","last_unstale":"2024-09-13T18:29:11.302958+0000","last_undegraded":"2024-09-13T18:29:11.302958+0000","last_fullsized":"2024-09-13T18:29:11.302958+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:16.692751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.301386+0000","last_change":"2024-09-13T18:29:09.912543+0000","last_active":"2024-09-13T18:29:10.301386+0000","last_peered":"2024-09-13T18:29:10.301386+0000","last_clean":"2024-09-13T18:29:10.301386+0000","last_became_active":"2024-09-13T18:29:09.912275+0000","last_became_peered":"2024-09-13T18:29:09.912275+0000","last_unstale":"2024-09-13T18:29:10.301386+0000","last_undegraded":"2024-09-13T18:29:10.301386+0000","last_fullsized":"2024-09-13T18:29:10.301386+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:37.970067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.299724+0000","last_change":"2024-09-13T18:29:10.306512+0000","last_active":"2024-09-13T18:29:11.299724+0000","last_peered":"2024-09-13T18:29:11.299724+0000","last_clean":"2024-09-13T18:29:11.299724+0000","last_became_active":"2024-09-13T18:29:10.306213+0000","last_became_peered":"2024-09-13T18:29:10.306213+0000","last_unstale":"2024-09-13T18:29:11.299724+0000","last_undegraded":"2024-09-13T18:29:11.299724+0000","last_fullsized":"2024-09-13T18:29:11.299724+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:12.024393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.292084+0000","last_change":"2024-09-13T18:29:09.913465+0000","last_active":"2024-09-13T18:29:10.292084+0000","last_peered":"2024-09-13T18:29:10.292084+0000","last_clean":"2024-09-13T18:29:10.292084+0000","last_became_active":"2024-09-13T18:29:09.913124+0000","last_became_peered":"2024-09-13T18:29:09.913124+0000","last_unstale":"2024-09-13T18:29:10.292084+0000","last_undegraded":"2024-09-13T18:29:10.292084+0000","last_fullsized":"2024-09-13T18:29:10.292084+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:42.514279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.336078+0000","last_change":"2024-09-13T18:29:10.303146+0000","last_active":"2024-09-13T18:29:11.336078+0000","last_peered":"2024-09-13T18:29:11.336078+0000","last_clean":"2024-09-13T18:29:11.336078+0000","last_became_active":"2024-09-13T18:29:10.302881+0000","last_became_peered":"2024-09-13T18:29:10.302881+0000","last_unstale":"2024-09-13T18:29:11.336078+0000","last_undegraded":"2024-09-13T18:29:11.336078+0000","last_fullsized":"2024-09-13T18:29:11.336078+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:43.523515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.307777+0000","last_change":"2024-09-13T18:29:09.916766+0000","last_active":"2024-09-13T18:29:10.307777+0000","last_peered":"2024-09-13T18:29:10.307777+0000","last_clean":"2024-09-13T18:29:10.307777+0000","last_became_active":"2024-09-13T18:29:09.916316+0000","last_became_peered":"2024-09-13T18:29:09.916316+0000","last_unstale":"2024-09-13T18:29:10.307777+0000","last_undegraded":"2024-09-13T18:29:10.307777+0000","last_fullsized":"2024-09-13T18:29:10.307777+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:32.352134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:29:11.338148+0000","last_change":"2024-09-13T18:29:10.316361+0000","last_active":"2024-09-13T18:29:11.338148+0000","last_peered":"2024-09-13T18:29:11.338148+0000","last_clean":"2024-09-13T18:29:11.338148+0000","last_became_active":"2024-09-13T18:29:10.316068+0000","last_became_peered":"2024-09-13T18:29:10.316068+0000","last_unstale":"2024-09-13T18:29:11.338148+0000","last_undegraded":"2024-09-13T18:29:11.338148+0000","last_fullsized":"2024-09-13T18:29:11.338148+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:09.886784+0000","last_clean_scrub_stamp":"2024-09-13T18:29:09.886784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:44.685638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.310363+0000","last_change":"2024-09-13T18:29:09.906681+0000","last_active":"2024-09-13T18:29:10.310363+0000","last_peered":"2024-09-13T18:29:10.310363+0000","last_clean":"2024-09-13T18:29:10.310363+0000","last_became_active":"2024-09-13T18:29:09.906375+0000","last_became_peered":"2024-09-13T18:29:09.906375+0000","last_unstale":"2024-09-13T18:29:10.310363+0000","last_undegraded":"2024-09-13T18:29:10.310363+0000","last_fullsized":"2024-09-13T18:29:10.310363+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:08.877547+0000","last_clean_scrub_stamp":"2024-09-13T18:29:08.877547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:08.869484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:29:10.290484+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:29:10.290484+0000","last_peered":"2024-09-13T18:29:10.290484+0000","last_clean":"2024-09-13T18:29:10.290484+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:29:10.290484+0000","last_undegraded":"2024-09-13T18:29:10.290484+0000","last_fullsized":"2024-09-13T18:29:10.290484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28160,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343680,"statfs":{"total":96636764160,"available":96607928320,"internally_reserved":0,"allocated":1163264,"data_stored":822292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.77100000000000002,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1240000000000001,"5min":1.163,"15min":1.163},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.72499999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.91200000000000003,"15min":0.91400000000000003},"min":{"1min":0.65800000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.157,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.97199999999999998,"15min":0.97399999999999998},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.177,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.96999999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85899999999999999,"15min":0.85999999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.872,"5min":0.92200000000000004,"15min":0.93000000000000005},"min":{"1min":0.57899999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.127,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.76200000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.89700000000000002,"15min":0.90000000000000002},"min":{"1min":0.67500000000000004,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.099,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.88400000000000001,"15min":0.87},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.117,"5min":1.125,"15min":1.125},"last":1.127}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.88900000000000001,"15min":0.90500000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1739999999999999,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.624},{"interface":"front","average":{"1min":0.996,"5min":1.0449999999999999,"15min":1.0529999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.2110000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.0049999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.95999999999999996,"15min":0.95599999999999996},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.302,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":1.036},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0449999999999999,"15min":1.0549999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.274,"5min":1.502,"15min":1.502},"last":1.0600000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.0940000000000001,"15min":1.1160000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.161,"5min":2.077,"15min":2.077},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0589999999999999,"15min":1.0629999999999999},"min":{"1min":0.72199999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.2210000000000001,"5min":1.55,"15min":1.55},"last":1.081}]}]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":573440,"data_stored":232506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.61499999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.216,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.048},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.84199999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.83399999999999996,"15min":0.82999999999999996},"min":{"1min":0.58499999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.83599999999999997,"15min":0.82399999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.76500000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.81799999999999995,"15min":0.81200000000000006},"min":{"1min":0.54200000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2010000000000001,"5min":1.254,"15min":1.254},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.86499999999999999,"15min":0.86899999999999999},"min":{"1min":0.56799999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.95999999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.86199999999999999,"15min":0.85699999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.125,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.874},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.96099999999999997,"15min":0.96699999999999997},"min":{"1min":0.70099999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2070000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.92800000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.89900000000000002,"15min":0.90100000000000002},"min":{"1min":0.622,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.165,"5min":1.248,"15min":1.248},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0029999999999999,"15min":1.01},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.98599999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.05,"15min":1.046},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.105},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98899999999999999,"15min":0.99199999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.0149999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.002,"15min":1.016},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.256,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.117,"15min":1.1160000000000001},"min":{"1min":0.94999999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.3160000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.1499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":569344,"data_stored":231904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.85699999999999998,"15min":0.86099999999999999},"min":{"1min":0.61899999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1259999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.75},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.88900000000000001,"15min":0.89700000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0820000000000001,"5min":1.482,"15min":1.482},"last":0.623}]},{"osd":1,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80500000000000005,"15min":0.80100000000000005},"min":{"1min":0.65900000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1559999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.95399999999999996,"15min":0.96599999999999997},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1000000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.96999999999999997,"15min":0.97499999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0900000000000001,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.024,"15min":1.032},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.2529999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.70099999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.95699999999999996,"15min":0.97099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1499999999999999,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.96299999999999997,"15min":0.97299999999999998},"min":{"1min":0.59899999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.157,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.95499999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.97299999999999998,"15min":0.999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1160000000000001,"5min":1.304,"15min":1.304},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.89200000000000002,"5min":1.04,"15min":1.0649999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.1799999999999999,"5min":1.542,"15min":1.542},"last":0.92200000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.0449999999999999,"15min":1.0600000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.224,"5min":1.698,"15min":1.698},"last":1.163},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.1719999999999999,"15min":1.1879999999999999},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.2010000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.01}]},{"osd":7,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.1990000000000001,"15min":1.2230000000000001},"min":{"1min":0.76100000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.2709999999999999,"5min":1.847,"15min":1.847},"last":1.038},{"interface":"front","average":{"1min":1.046,"5min":1.161,"15min":1.1799999999999999},"min":{"1min":0.81299999999999994,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.3149999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.079}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":577536,"data_stored":233398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.92700000000000005,"15min":0.93799999999999994},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1220000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.996,"15min":1.002},"min":{"1min":0.59499999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.111,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.95999999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0389999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.86399999999999999,"15min":0.86899999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1220000000000001,"5min":1.254,"15min":1.254},"last":0.66900000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.86399999999999999,"15min":0.88100000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.629},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.61499999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.85699999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.996,"15min":1.0029999999999999},"min":{"1min":0.64900000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.24,"5min":1.639,"15min":1.639},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0049999999999999,"15min":1.008},"min":{"1min":0.72899999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1970000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.97999999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.98799999999999999,"15min":1.0109999999999999},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1419999999999999,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.123,"15min":1.1399999999999999},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.2150000000000001,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.91500000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.89400000000000002,"15min":0.89600000000000002},"min":{"1min":0.70899999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.1080000000000001,"15min":1.121},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.21,"5min":1.794,"15min":1.794},"last":1.0509999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":1.077,"15min":1.1020000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.145,"5min":1.669,"15min":1.669},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.76800000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2390000000000001,"5min":1.282,"15min":1.282},"last":0.79500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":577536,"data_stored":232472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.69299999999999995,"15min":0.70699999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.84499999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.627},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.70199999999999996,"15min":0.69599999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.44400000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.71799999999999997,"15min":0.72799999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.875,"5min":1.165,"15min":1.165},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.83799999999999997,"15min":0.85299999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.042,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0369999999999999,"5min":1.333,"15min":1.333},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.90800000000000003,"15min":0.91900000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.214,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.97799999999999998,"15min":0.99199999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.1080000000000001,"5min":1.165,"15min":1.165},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.052,"15min":1.0669999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.95599999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.1919999999999999,"15min":1.2190000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.355,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.083},{"interface":"front","average":{"1min":0.997,"5min":1.131,"15min":1.153},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.3049999999999999,"5min":1.718,"15min":1.718},"last":0.88400000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.1419999999999999,"15min":1.1599999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.4159999999999999,"5min":1.47,"15min":1.47},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.083,"5min":1.246,"15min":1.2729999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.4510000000000001,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.91900000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:28:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.123,"15min":1.129},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.113},{"interface":"front","average":{"1min":1.083,"5min":1.1910000000000001,"15min":1.2090000000000001},"min":{"1min":0.76800000000000002,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.385,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.0209999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":581632,"data_stored":233420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68100000000000005,"15min":0.68200000000000005},"min":{"1min":0.432,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94999999999999996,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81499999999999995,"15min":0.82499999999999996},"min":{"1min":0.48399999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0429999999999999,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.499}]},{"osd":1,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.72399999999999998,"15min":0.73599999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92100000000000004,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.749,"15min":0.75600000000000001},"min":{"1min":0.49299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94599999999999995,"5min":1.206,"15min":1.206},"last":0.626}]},{"osd":3,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68100000000000005,"15min":0.67500000000000004},"min":{"1min":0.54600000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.03,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.86699999999999999,"15min":0.871},"min":{"1min":0.53100000000000003,"5min":0.433,"15min":0.433},"max":{"1min":1.2509999999999999,"5min":1.548,"15min":1.548},"last":0.79400000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.98099999999999998,"15min":0.98899999999999999},"min":{"1min":0.755,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2509999999999999,"5min":1.401,"15min":1.401},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0680000000000001,"15min":1.083},"min":{"1min":0.70099999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3260000000000001,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.82799999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.92900000000000005,"15min":0.92700000000000005},"min":{"1min":0.67800000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0680000000000001,"15min":1.073},"min":{"1min":0.81799999999999995,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.5840000000000001,"5min":1.869,"15min":1.869},"last":0.90500000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.125,"15min":1.133},"min":{"1min":0.75900000000000001,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.3879999999999999,"5min":2.762,"15min":2.762},"last":1.02},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0569999999999999,"15min":1.0609999999999999},"min":{"1min":0.78100000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.393,"5min":1.988,"15min":1.988},"last":1.085}]},{"osd":7,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.1819999999999999,"15min":1.1919999999999999},"min":{"1min":0.79900000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4319999999999999,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.121,"5min":1.0820000000000001,"15min":1.0760000000000001},"min":{"1min":0.81399999999999995,"5min":0.746,"15min":0.746},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.002}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":569344,"data_stored":231904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.629,"15min":0.63},"min":{"1min":0.41699999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.131,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.74299999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.49399999999999999,"5min":0.373,"15min":0.373},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.228,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.628}]},{"osd":3,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79200000000000004,"15min":0.78400000000000003},"min":{"1min":0.54900000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.80600000000000005,"15min":0.81100000000000005},"min":{"1min":0.53300000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2090000000000001,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.84499999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.96499999999999997,"15min":0.97099999999999997},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.327,"5min":1.524,"15min":1.524},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98099999999999998,"15min":0.98199999999999998},"min":{"1min":0.80700000000000005,"5min":0.747,"15min":0.747},"max":{"1min":1.147,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.82899999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.97999999999999998,"15min":0.97399999999999998},"min":{"1min":0.79000000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.2909999999999999,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.079,"15min":1.085},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.367,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0920000000000001,"15min":1.105},"min":{"1min":0.76100000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.3420000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.0980000000000001,"15min":1.1020000000000001},"min":{"1min":0.93000000000000005,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.2829999999999999,"5min":1.869,"15min":1.869},"last":1.1160000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.085,"15min":1.087},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.26,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.097,"5min":1.1319999999999999,"15min":1.1379999999999999},"min":{"1min":0.82899999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.403,"5min":1.72,"15min":1.72},"last":1.0429999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1163264,"data_stored":822236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.52500000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.505},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.74299999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71599999999999997,"15min":0.70999999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94599999999999995,"5min":1.083,"15min":1.083},"last":0.623},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.72699999999999998,"15min":0.72099999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.84499999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.63900000000000001,"15min":0.629},"min":{"1min":0.56699999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.83399999999999996,"15min":0.83099999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.67700000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.96599999999999997,"15min":0.97499999999999998},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.222,"5min":1.302,"15min":1.302},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.91700000000000004,"15min":0.90500000000000003},"min":{"1min":0.70199999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.97699999999999998,"15min":0.96999999999999997},"min":{"1min":0.746,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.127,"5min":1.0700000000000001,"15min":1.0600000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.96299999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.109,"15min":1.099},"min":{"1min":0.95199999999999996,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.085,"5min":1.1279999999999999,"15min":1.135},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.2949999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.198}]},{"osd":7,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.1259999999999999,"15min":1.1339999999999999},"min":{"1min":0.82899999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.25},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.054,"15min":1.044},"min":{"1min":0.878,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.28,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.98399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:29:19.257 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:29:19.257 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:29:19.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.384+0000 7ff6f1375700 1 Processor -- start 2024-09-13T18:29:19.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.384+0000 7ff6f1375700 1 -- start start 2024-09-13T18:29:19.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.384+0000 7ff6f1375700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff6ec0ce2d0 0x7ff6ec0caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.384+0000 7ff6f1375700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6ec15d800 con 0x7ff6ec159080 2024-09-13T18:29:19.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.384+0000 7ff6f1375700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6ec15cc10 con 0x7ff6ec0cb0d0 2024-09-13T18:29:19.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.384+0000 7ff6f1375700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6ec15ced0 con 0x7ff6ec0ce2d0 2024-09-13T18:29:19.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.384+0000 7ff6ebfff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff6ec159080 0x7ff6ec0cdbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60408/0 (socket says 172.21.15.44:60408) 2024-09-13T18:29:19.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.384+0000 7ff6ebfff700 1 -- 172.21.15.44:0/1643036110 learned_addr learned my addr 172.21.15.44:0/1643036110 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:29:19.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.384+0000 7ff6eb7fe700 1 --2- 172.21.15.44:0/1643036110 >> v2:172.21.15.99:3300/0 conn(0x7ff6ec0ce2d0 0x7ff6ec0caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.384+0000 7ff6eaffd700 1 -- 172.21.15.44:0/1643036110 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 191711392 0 0) 0x7ff6ec15d800 con 0x7ff6ec159080 2024-09-13T18:29:19.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.384+0000 7ff6eaffd700 1 -- 172.21.15.44:0/1643036110 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6d40035d0 con 0x7ff6ec159080 2024-09-13T18:29:19.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.384+0000 7ff6eaffd700 1 -- 172.21.15.44:0/1643036110 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2739102960 0 0) 0x7ff6d40035d0 con 0x7ff6ec159080 2024-09-13T18:29:19.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.384+0000 7ff6eaffd700 1 -- 172.21.15.44:0/1643036110 >> v2:172.21.15.99:3300/0 conn(0x7ff6ec0ce2d0 msgr2=0x7ff6ec0caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:19.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.384+0000 7ff6eaffd700 1 --2- 172.21.15.44:0/1643036110 >> v2:172.21.15.99:3300/0 conn(0x7ff6ec0ce2d0 0x7ff6ec0caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.384+0000 7ff6eaffd700 1 -- 172.21.15.44:0/1643036110 >> v1:172.21.15.99:6789/0 conn(0x7ff6ec0cb0d0 legacy=0x7ff6ec0c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.384+0000 7ff6eaffd700 1 -- 172.21.15.44:0/1643036110 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec15d1b0 con 0x7ff6ec159080 2024-09-13T18:29:19.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.384+0000 7ff6eaffd700 1 -- 172.21.15.44:0/1643036110 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7ff6dc001670 con 0x7ff6ec159080 2024-09-13T18:29:19.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.384+0000 7ff6eaffd700 1 -- 172.21.15.44:0/1643036110 >> v1:172.21.15.44:6789/0 conn(0x7ff6ec159080 legacy=0x7ff6ec0cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.384+0000 7ff6eaffd700 1 --2- 172.21.15.44:0/1643036110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6d4003a20 0x7ff6d4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.384+0000 7ff6eaffd700 1 --2- 172.21.15.44:0/1643036110 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff6d4004870 0x7ff6d4004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.384+0000 7ff6eaffd700 1 --2- 172.21.15.44:0/1643036110 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6d4005230 0x7ff6d400cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6eaffd700 1 -- 172.21.15.44:0/1643036110 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec15ced0 con 0x7ff6d4003a20 2024-09-13T18:29:19.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6eaffd700 1 -- 172.21.15.44:0/1643036110 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d400d2e0 con 0x7ff6d4005230 2024-09-13T18:29:19.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6eaffd700 1 -- 172.21.15.44:0/1643036110 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d400d4a0 con 0x7ff6d4004870 2024-09-13T18:29:19.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6ebfff700 1 --2- 172.21.15.44:0/1643036110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6d4003a20 0x7ff6d4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6eb7fe700 1 --2- 172.21.15.44:0/1643036110 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff6d4004870 0x7ff6d4004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6f0b74700 1 --2- 172.21.15.44:0/1643036110 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6d4005230 0x7ff6d400cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6ebfff700 1 -- 172.21.15.44:0/1643036110 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff6d4004870 msgr2=0x7ff6d4004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:19.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6ebfff700 1 --2- 172.21.15.44:0/1643036110 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff6d4004870 0x7ff6d4004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6ebfff700 1 -- 172.21.15.44:0/1643036110 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6d4005230 msgr2=0x7ff6d400cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:19.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6ebfff700 1 --2- 172.21.15.44:0/1643036110 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6d4005230 0x7ff6d400cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6f0b74700 1 -- 172.21.15.44:0/1643036110 reap_dead start 2024-09-13T18:29:19.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6ebfff700 1 -- 172.21.15.44:0/1643036110 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d40035d0 con 0x7ff6d4003a20 2024-09-13T18:29:19.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6ebfff700 1 --2- 172.21.15.44:0/1643036110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6d4003a20 0x7ff6d4003e40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00c320 tx=0x7ff6d40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3f23bdad8b0003 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:19.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6eaffd700 1 -- 172.21.15.44:0/1643036110 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc007c30 con 0x7ff6d4003a20 2024-09-13T18:29:19.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6eaffd700 1 -- 172.21.15.44:0/1643036110 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6dc00ce80 con 0x7ff6d4003a20 2024-09-13T18:29:19.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6eaffd700 1 -- 172.21.15.44:0/1643036110 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc005bc0 con 0x7ff6d4003a20 2024-09-13T18:29:19.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6f1375700 1 -- 172.21.15.44:0/1643036110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6d4003a20 msgr2=0x7ff6d4003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6f1375700 1 --2- 172.21.15.44:0/1643036110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6d4003a20 0x7ff6d4003e40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00c320 tx=0x7ff6d40058a0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6f1375700 1 -- 172.21.15.44:0/1643036110 shutdown_connections 2024-09-13T18:29:19.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6f1375700 1 --2- 172.21.15.44:0/1643036110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6d4003a20 0x7ff6d4003e40 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6f1375700 1 -- 172.21.15.44:0/1643036110 >> 172.21.15.44:0/1643036110 conn(0x7ff6ec0cba60 msgr2=0x7ff6ec0cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:19.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6f1375700 1 -- 172.21.15.44:0/1643036110 shutdown_connections 2024-09-13T18:29:19.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6f1375700 1 -- 172.21.15.44:0/1643036110 wait complete. 2024-09-13T18:29:19.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6f1375700 1 Processor -- start 2024-09-13T18:29:19.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.388+0000 7ff6f1375700 1 -- start start 2024-09-13T18:29:19.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6f1375700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6d4003a20 0x7ff6ec15a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6f1375700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff6ec149880 0x7ff6ec0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6f1375700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6ec149ce0 0x7ff6ec0cd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6f1375700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec1e5cf0 con 0x7ff6d4003a20 2024-09-13T18:29:19.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6f1375700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec1e5070 con 0x7ff6ec149ce0 2024-09-13T18:29:19.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6f1375700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec1e5350 con 0x7ff6ec149880 2024-09-13T18:29:19.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6ebfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6d4003a20 0x7ff6ec15a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6ebfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6d4003a20 0x7ff6ec15a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55896/0 (socket says 172.21.15.44:55896) 2024-09-13T18:29:19.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6ebfff700 1 -- 172.21.15.44:0/3939334688 learned_addr learned my addr 172.21.15.44:0/3939334688 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:19.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6eb7fe700 1 --2- 172.21.15.44:0/3939334688 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff6ec149880 0x7ff6ec0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6f0b74700 1 --2- 172.21.15.44:0/3939334688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6ec149ce0 0x7ff6ec0cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6ebfff700 1 -- 172.21.15.44:0/3939334688 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff6ec149880 msgr2=0x7ff6ec0cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6ebfff700 1 --2- 172.21.15.44:0/3939334688 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff6ec149880 0x7ff6ec0cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6ebfff700 1 -- 172.21.15.44:0/3939334688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6ec149ce0 msgr2=0x7ff6ec0cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6ebfff700 1 --2- 172.21.15.44:0/3939334688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6ec149ce0 0x7ff6ec0cd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6ebfff700 1 -- 172.21.15.44:0/3939334688 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec1e5630 con 0x7ff6d4003a20 2024-09-13T18:29:19.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6f0b74700 1 --2- 172.21.15.44:0/3939334688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6ec149ce0 0x7ff6ec0cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:19.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6ebfff700 1 --2- 172.21.15.44:0/3939334688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6d4003a20 0x7ff6ec15a340 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc000c00 tx=0x7ff6dc001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:19.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6e8ff9700 1 -- 172.21.15.44:0/3939334688 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc004da0 con 0x7ff6d4003a20 2024-09-13T18:29:19.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6e8ff9700 1 -- 172.21.15.44:0/3939334688 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6dc0070d0 con 0x7ff6d4003a20 2024-09-13T18:29:19.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6f1375700 1 -- 172.21.15.44:0/3939334688 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6ec1e5910 con 0x7ff6d4003a20 2024-09-13T18:29:19.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6e8ff9700 1 -- 172.21.15.44:0/3939334688 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc007480 con 0x7ff6d4003a20 2024-09-13T18:29:19.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6f1375700 1 -- 172.21.15.44:0/3939334688 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ec1e62f0 con 0x7ff6d4003a20 2024-09-13T18:29:19.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6f1375700 1 -- 172.21.15.44:0/3939334688 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6ec1e5f60 con 0x7ff6d4003a20 2024-09-13T18:29:19.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.392+0000 7ff6e8ff9700 1 -- 172.21.15.44:0/3939334688 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff6dc0075e0 con 0x7ff6d4003a20 2024-09-13T18:29:19.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.396+0000 7ff6e8ff9700 1 --2- 172.21.15.44:0/3939334688 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff6d8066730 0x7ff6d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.396+0000 7ff6e8ff9700 1 -- 172.21.15.44:0/3939334688 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6dc084e30 con 0x7ff6d4003a20 2024-09-13T18:29:19.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.396+0000 7ff6eb7fe700 1 --2- 172.21.15.44:0/3939334688 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff6d8066730 0x7ff6d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.396+0000 7ff6eb7fe700 1 --2- 172.21.15.44:0/3939334688 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff6d8066730 0x7ff6d8068bf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec14a1a0 tx=0x7ff6e0009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:19.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.400+0000 7ff6e8ff9700 1 -- 172.21.15.44:0/3939334688 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff6dc052230 con 0x7ff6d4003a20 2024-09-13T18:29:19.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.632+0000 7ff6f1375700 1 -- 172.21.15.44:0/3939334688 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff6ec0caa00 con 0x7ff6d4003a20 2024-09-13T18:29:19.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.640+0000 7ff6e8ff9700 1 -- 172.21.15.44:0/3939334688 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff6dc055850 con 0x7ff6d4003a20 2024-09-13T18:29:19.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.644+0000 7ff6f1375700 1 -- 172.21.15.44:0/3939334688 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff6d8066730 msgr2=0x7ff6d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.644+0000 7ff6f1375700 1 --2- 172.21.15.44:0/3939334688 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff6d8066730 0x7ff6d8068bf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec14a1a0 tx=0x7ff6e0009240 comp rx=0 tx=0).stop 2024-09-13T18:29:19.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.644+0000 7ff6f1375700 1 -- 172.21.15.44:0/3939334688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6d4003a20 msgr2=0x7ff6ec15a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.644+0000 7ff6f1375700 1 --2- 172.21.15.44:0/3939334688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6d4003a20 0x7ff6ec15a340 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc000c00 tx=0x7ff6dc001a00 comp rx=0 tx=0).stop 2024-09-13T18:29:19.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.644+0000 7ff6f1375700 1 -- 172.21.15.44:0/3939334688 shutdown_connections 2024-09-13T18:29:19.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.644+0000 7ff6f1375700 1 --2- 172.21.15.44:0/3939334688 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff6d8066730 0x7ff6d8068bf0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.644+0000 7ff6f1375700 1 --2- 172.21.15.44:0/3939334688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6ec149ce0 0x7ff6ec0cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.644+0000 7ff6f1375700 1 --2- 172.21.15.44:0/3939334688 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff6ec149880 0x7ff6ec0cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.644+0000 7ff6f1375700 1 --2- 172.21.15.44:0/3939334688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6d4003a20 0x7ff6ec15a340 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.644+0000 7ff6f1375700 1 -- 172.21.15.44:0/3939334688 >> 172.21.15.44:0/3939334688 conn(0x7ff6ec0cba60 msgr2=0x7ff6ec071540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:19.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.644+0000 7ff6f1375700 1 -- 172.21.15.44:0/3939334688 shutdown_connections 2024-09-13T18:29:19.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.644+0000 7ff6f1375700 1 -- 172.21.15.44:0/3939334688 wait complete. 2024-09-13T18:29:19.648 INFO:teuthology.orchestra.run.smithi044.stderr:updated caps for client.0 2024-09-13T18:29:19.661 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:29:19.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.768+0000 7f50b483c700 1 Processor -- start 2024-09-13T18:29:19.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.768+0000 7f50b483c700 1 -- start start 2024-09-13T18:29:19.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.772+0000 7f50b483c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f50b00b3ae0 0x7f50b006a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.772+0000 7f50b483c700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b013dcb0 con 0x7f50b006aaf0 2024-09-13T18:29:19.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.772+0000 7f50b483c700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b015be60 con 0x7f50b006bbf0 2024-09-13T18:29:19.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.772+0000 7f50b483c700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b013ffd0 con 0x7f50b00b3ae0 2024-09-13T18:29:19.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.772+0000 7f50aeffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f50b00b3ae0 0x7f50b006a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.772+0000 7f50affff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f50b006aaf0 0x7f50b015e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60418/0 (socket says 172.21.15.44:60418) 2024-09-13T18:29:19.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.772+0000 7f50affff700 1 -- 172.21.15.44:0/3582359341 learned_addr learned my addr 172.21.15.44:0/3582359341 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:29:19.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.772+0000 7f50aeffd700 1 -- 172.21.15.44:0/3582359341 >> v1:172.21.15.99:6789/0 conn(0x7f50b006bbf0 legacy=0x7f50b00b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.772+0000 7f50aeffd700 1 -- 172.21.15.44:0/3582359341 >> v1:172.21.15.44:6789/0 conn(0x7f50b006aaf0 legacy=0x7f50b015e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.772+0000 7f50aeffd700 1 -- 172.21.15.44:0/3582359341 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b0140220 con 0x7f50b00b3ae0 2024-09-13T18:29:19.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.772+0000 7f50aeffd700 1 --2- 172.21.15.44:0/3582359341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50b00b3ae0 0x7f50b006a5b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009850 tx=0x7f50a4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2609bba079d40836 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:19.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.772+0000 7f50ae7fc700 1 -- 172.21.15.44:0/3582359341 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a4004230 con 0x7f50b00b3ae0 2024-09-13T18:29:19.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.772+0000 7f50ae7fc700 1 -- 172.21.15.44:0/3582359341 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a4004390 con 0x7f50b00b3ae0 2024-09-13T18:29:19.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.772+0000 7f50ae7fc700 1 -- 172.21.15.44:0/3582359341 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a40036c0 con 0x7f50b00b3ae0 2024-09-13T18:29:19.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.772+0000 7f50b483c700 1 -- 172.21.15.44:0/3582359341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50b00b3ae0 msgr2=0x7f50b006a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.772+0000 7f50b483c700 1 --2- 172.21.15.44:0/3582359341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50b00b3ae0 0x7f50b006a5b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009850 tx=0x7f50a4009b60 comp rx=0 tx=0).stop 2024-09-13T18:29:19.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.772+0000 7f50b483c700 1 -- 172.21.15.44:0/3582359341 shutdown_connections 2024-09-13T18:29:19.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.772+0000 7f50b483c700 1 --2- 172.21.15.44:0/3582359341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50b00b3ae0 0x7f50b006a5b0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.772+0000 7f50b483c700 1 -- 172.21.15.44:0/3582359341 >> 172.21.15.44:0/3582359341 conn(0x7f50b00b0f00 msgr2=0x7f50b00b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:19.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.772+0000 7f50b483c700 1 -- 172.21.15.44:0/3582359341 shutdown_connections 2024-09-13T18:29:19.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.772+0000 7f50b483c700 1 -- 172.21.15.44:0/3582359341 wait complete. 2024-09-13T18:29:19.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.776+0000 7f50b483c700 1 Processor -- start 2024-09-13T18:29:19.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.776+0000 7f50b483c700 1 -- start start 2024-09-13T18:29:19.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.776+0000 7f50b483c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50b006aaf0 0x7f50b013a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.776+0000 7f50b483c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50b006bbf0 0x7f50b0155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.776+0000 7f50b483c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50b00b3ae0 0x7f50b0071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.776+0000 7f50b483c700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b0157020 con 0x7f50b00b3ae0 2024-09-13T18:29:19.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.776+0000 7f50b483c700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b01564a0 con 0x7f50b006aaf0 2024-09-13T18:29:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.776+0000 7f50b483c700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b0156780 con 0x7f50b006bbf0 2024-09-13T18:29:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.776+0000 7f50affff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50b00b3ae0 0x7f50b0071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.776+0000 7f50affff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50b00b3ae0 0x7f50b0071050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55918/0 (socket says 172.21.15.44:55918) 2024-09-13T18:29:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.776+0000 7f50affff700 1 -- 172.21.15.44:0/2259733956 learned_addr learned my addr 172.21.15.44:0/2259733956 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.776+0000 7f50aeffd700 1 --2- 172.21.15.44:0/2259733956 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50b006bbf0 0x7f50b0155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.776+0000 7f50af7fe700 1 --2- 172.21.15.44:0/2259733956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50b006aaf0 0x7f50b013a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.776+0000 7f50affff700 1 -- 172.21.15.44:0/2259733956 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50b006bbf0 msgr2=0x7f50b0155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.780+0000 7f50affff700 1 --2- 172.21.15.44:0/2259733956 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50b006bbf0 0x7f50b0155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.780+0000 7f50affff700 1 -- 172.21.15.44:0/2259733956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50b006aaf0 msgr2=0x7f50b013a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.780+0000 7f50affff700 1 --2- 172.21.15.44:0/2259733956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50b006aaf0 0x7f50b013a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.780+0000 7f50affff700 1 -- 172.21.15.44:0/2259733956 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a40094b0 con 0x7f50b00b3ae0 2024-09-13T18:29:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.780+0000 7f50af7fe700 1 --2- 172.21.15.44:0/2259733956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50b006aaf0 0x7f50b013a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:19.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.780+0000 7f50affff700 1 --2- 172.21.15.44:0/2259733956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50b00b3ae0 0x7f50b0071050 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f50a8002000 tx=0x7f50a800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:19.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.780+0000 7f5097fff700 1 -- 172.21.15.44:0/2259733956 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a800ad40 con 0x7f50b00b3ae0 2024-09-13T18:29:19.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.780+0000 7f5097fff700 1 -- 172.21.15.44:0/2259733956 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a80070d0 con 0x7f50b00b3ae0 2024-09-13T18:29:19.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.780+0000 7f50b483c700 1 -- 172.21.15.44:0/2259733956 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b0156a60 con 0x7f50b00b3ae0 2024-09-13T18:29:19.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.780+0000 7f5097fff700 1 -- 172.21.15.44:0/2259733956 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a800aea0 con 0x7f50b00b3ae0 2024-09-13T18:29:19.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.780+0000 7f50b483c700 1 -- 172.21.15.44:0/2259733956 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b013a5c0 con 0x7f50b00b3ae0 2024-09-13T18:29:19.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.780+0000 7f50b483c700 1 -- 172.21.15.44:0/2259733956 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b006af40 con 0x7f50b00b3ae0 2024-09-13T18:29:19.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.780+0000 7f5097fff700 1 -- 172.21.15.44:0/2259733956 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f50a8007480 con 0x7f50b00b3ae0 2024-09-13T18:29:19.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.784+0000 7f5097fff700 1 --2- 172.21.15.44:0/2259733956 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f509c066730 0x7f509c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.784+0000 7f5097fff700 1 -- 172.21.15.44:0/2259733956 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50a8083ff0 con 0x7f50b00b3ae0 2024-09-13T18:29:19.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.784+0000 7f50af7fe700 1 --2- 172.21.15.44:0/2259733956 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f509c066730 0x7f509c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.784+0000 7f50af7fe700 1 --2- 172.21.15.44:0/2259733956 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f509c066730 0x7f509c068bf0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f50b0158720 tx=0x7f50a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:19.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:19.792+0000 7f5097fff700 1 -- 172.21.15.44:0/2259733956 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f50a80513f0 con 0x7f50b00b3ae0 2024-09-13T18:29:20.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.004+0000 7f50b483c700 1 -- 172.21.15.44:0/2259733956 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50b0067b70 con 0x7f50b00b3ae0 2024-09-13T18:29:20.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.004+0000 7f5097fff700 1 -- 172.21.15.44:0/2259733956 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f50a8054a10 con 0x7f50b00b3ae0 2024-09-13T18:29:20.008 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:29:20.008 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":31,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5447,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2081931615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2081931615},{"type":"v1","addr":"172.21.15.99:6835","nonce":2081931615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5887,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/2337853364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2337853364},{"type":"v1","addr":"172.21.15.99:6837","nonce":2337853364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5976,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3567136594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3567136594},{"type":"v1","addr":"172.21.15.44:6833","nonce":3567136594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:29:10.283572+0000","modified":"2024-09-13T18:29:13.308606+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5982":{"gid":5982,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3200882245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3200882245},{"type":"v1","addr":"172.21.15.44:6835","nonce":3200882245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:29:20.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.004+0000 7f50b483c700 1 -- 172.21.15.44:0/2259733956 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f509c066730 msgr2=0x7f509c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:20.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.004+0000 7f50b483c700 1 --2- 172.21.15.44:0/2259733956 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f509c066730 0x7f509c068bf0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f50b0158720 tx=0x7f50a0009040 comp rx=0 tx=0).stop 2024-09-13T18:29:20.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.004+0000 7f50b483c700 1 -- 172.21.15.44:0/2259733956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50b00b3ae0 msgr2=0x7f50b0071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:20.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.004+0000 7f50b483c700 1 --2- 172.21.15.44:0/2259733956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50b00b3ae0 0x7f50b0071050 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f50a8002000 tx=0x7f50a800a340 comp rx=0 tx=0).stop 2024-09-13T18:29:20.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.004+0000 7f50b483c700 1 -- 172.21.15.44:0/2259733956 shutdown_connections 2024-09-13T18:29:20.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.004+0000 7f50b483c700 1 --2- 172.21.15.44:0/2259733956 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f509c066730 0x7f509c068bf0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.004+0000 7f50b483c700 1 --2- 172.21.15.44:0/2259733956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50b00b3ae0 0x7f50b0071050 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.004+0000 7f50b483c700 1 --2- 172.21.15.44:0/2259733956 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50b006bbf0 0x7f50b0155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.004+0000 7f50b483c700 1 --2- 172.21.15.44:0/2259733956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50b006aaf0 0x7f50b013a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.004+0000 7f50b483c700 1 -- 172.21.15.44:0/2259733956 >> 172.21.15.44:0/2259733956 conn(0x7f50b00b0f00 msgr2=0x7f50b0066110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:20.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.008+0000 7f50b483c700 1 -- 172.21.15.44:0/2259733956 shutdown_connections 2024-09-13T18:29:20.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.008+0000 7f50b483c700 1 -- 172.21.15.44:0/2259733956 wait complete. 2024-09-13T18:29:20.012 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 31 2024-09-13T18:29:20.426 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:29:10.283572+0000', 'modified': '2024-09-13T18:29:13.308606+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5982}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5982': {'gid': 5982, 'name': 'c', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.44:6835/3200882245', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 3200882245}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 3200882245}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:29:20.426 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:29:20.426 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:29:20.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5dffff700 1 Processor -- start 2024-09-13T18:29:20.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5dffff700 1 -- start start 2024-09-13T18:29:20.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5dffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5e015a770 0x7fc5e00b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5dffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5e006dec0 0x7fc5e006e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5dffff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e00cd440 con 0x7fc5e00d0350 2024-09-13T18:29:20.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5dffff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e006e890 con 0x7fc5e006dec0 2024-09-13T18:29:20.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5dffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e00cd6b0 con 0x7fc5e015a770 2024-09-13T18:29:20.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5df7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5e006dec0 0x7fc5e006e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5df7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5e006dec0 0x7fc5e006e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55926/0 (socket says 172.21.15.44:55926) 2024-09-13T18:29:20.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5df7fe700 1 -- 172.21.15.44:0/2524104467 learned_addr learned my addr 172.21.15.44:0/2524104467 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:20.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5deffd700 1 --2- 172.21.15.44:0/2524104467 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5e015a770 0x7fc5e00b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5df7fe700 1 -- 172.21.15.44:0/2524104467 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5e015a770 msgr2=0x7fc5e00b5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:20.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5df7fe700 1 --2- 172.21.15.44:0/2524104467 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5e015a770 0x7fc5e00b5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5df7fe700 1 -- 172.21.15.44:0/2524104467 >> v1:172.21.15.99:6789/0 conn(0x7fc5e00d0350 legacy=0x7fc5e00ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:20.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5df7fe700 1 -- 172.21.15.44:0/2524104467 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e00cd990 con 0x7fc5e006dec0 2024-09-13T18:29:20.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5df7fe700 1 --2- 172.21.15.44:0/2524104467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5e006dec0 0x7fc5e006e350 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009910 tx=0x7fc5d8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfca589dfc16d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:20.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5ddffb700 1 -- 172.21.15.44:0/2524104467 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8004230 con 0x7fc5e006dec0 2024-09-13T18:29:20.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5ddffb700 1 -- 172.21.15.44:0/2524104467 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d8004390 con 0x7fc5e006dec0 2024-09-13T18:29:20.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5ddffb700 1 -- 172.21.15.44:0/2524104467 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8009e60 con 0x7fc5e006dec0 2024-09-13T18:29:20.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5dffff700 1 -- 172.21.15.44:0/2524104467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5e006dec0 msgr2=0x7fc5e006e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:20.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5dffff700 1 --2- 172.21.15.44:0/2524104467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5e006dec0 0x7fc5e006e350 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009910 tx=0x7fc5d8009c20 comp rx=0 tx=0).stop 2024-09-13T18:29:20.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5dffff700 1 -- 172.21.15.44:0/2524104467 shutdown_connections 2024-09-13T18:29:20.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5dffff700 1 --2- 172.21.15.44:0/2524104467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5e006dec0 0x7fc5e006e350 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5dffff700 1 --2- 172.21.15.44:0/2524104467 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5e015a770 0x7fc5e00b5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5dffff700 1 -- 172.21.15.44:0/2524104467 >> 172.21.15.44:0/2524104467 conn(0x7fc5e0071d00 msgr2=0x7fc5e00720e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:20.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5dffff700 1 -- 172.21.15.44:0/2524104467 shutdown_connections 2024-09-13T18:29:20.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.548+0000 7fc5dffff700 1 -- 172.21.15.44:0/2524104467 wait complete. 2024-09-13T18:29:20.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5dffff700 1 Processor -- start 2024-09-13T18:29:20.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5dffff700 1 -- start start 2024-09-13T18:29:20.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5dffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e006dec0 0x7fc5e0144540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5dffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5e00d0350 0x7fc5e015cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5dffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5e015a770 0x7fc5e015b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5dffff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e015bf90 con 0x7fc5e00d0350 2024-09-13T18:29:20.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5dffff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e014f550 con 0x7fc5e006dec0 2024-09-13T18:29:20.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5dffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e014f830 con 0x7fc5e015a770 2024-09-13T18:29:20.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5de7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5e00d0350 0x7fc5e015cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5de7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5e00d0350 0x7fc5e015cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55930/0 (socket says 172.21.15.44:55930) 2024-09-13T18:29:20.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5de7fc700 1 -- 172.21.15.44:0/3286180349 learned_addr learned my addr 172.21.15.44:0/3286180349 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:20.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5deffd700 1 --2- 172.21.15.44:0/3286180349 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e006dec0 0x7fc5e0144540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5df7fe700 1 --2- 172.21.15.44:0/3286180349 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5e015a770 0x7fc5e015b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5de7fc700 1 -- 172.21.15.44:0/3286180349 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5e015a770 msgr2=0x7fc5e015b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:20.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5de7fc700 1 --2- 172.21.15.44:0/3286180349 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5e015a770 0x7fc5e015b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5de7fc700 1 -- 172.21.15.44:0/3286180349 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e006dec0 msgr2=0x7fc5e0144540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:20.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5de7fc700 1 --2- 172.21.15.44:0/3286180349 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e006dec0 0x7fc5e0144540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5de7fc700 1 -- 172.21.15.44:0/3286180349 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d8009570 con 0x7fc5e00d0350 2024-09-13T18:29:20.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5df7fe700 1 --2- 172.21.15.44:0/3286180349 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5e015a770 0x7fc5e015b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:20.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5de7fc700 1 --2- 172.21.15.44:0/3286180349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5e00d0350 0x7fc5e015cf00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc5d000c550 tx=0x7fc5d000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:20.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5d77fe700 1 -- 172.21.15.44:0/3286180349 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d0011790 con 0x7fc5e00d0350 2024-09-13T18:29:20.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5d77fe700 1 -- 172.21.15.44:0/3286180349 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d00118f0 con 0x7fc5e00d0350 2024-09-13T18:29:20.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5dffff700 1 -- 172.21.15.44:0/3286180349 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e014fb10 con 0x7fc5e00d0350 2024-09-13T18:29:20.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.552+0000 7fc5d77fe700 1 -- 172.21.15.44:0/3286180349 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d0011ca0 con 0x7fc5e00d0350 2024-09-13T18:29:20.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.556+0000 7fc5dffff700 1 -- 172.21.15.44:0/3286180349 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e01524c0 con 0x7fc5e00d0350 2024-09-13T18:29:20.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.556+0000 7fc5d77fe700 1 -- 172.21.15.44:0/3286180349 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc5d001c460 con 0x7fc5e00d0350 2024-09-13T18:29:20.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.556+0000 7fc5d77fe700 1 --2- 172.21.15.44:0/3286180349 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc5c0066730 0x7fc5c0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.556+0000 7fc5d77fe700 1 -- 172.21.15.44:0/3286180349 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5d0083da0 con 0x7fc5e00d0350 2024-09-13T18:29:20.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.556+0000 7fc5deffd700 1 --2- 172.21.15.44:0/3286180349 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc5c0066730 0x7fc5c0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.560+0000 7fc5deffd700 1 --2- 172.21.15.44:0/3286180349 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc5c0066730 0x7fc5c0068bf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009a80 tx=0x7fc5c8003a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:20.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.560+0000 7fc5e8726740 1 Processor -- start 2024-09-13T18:29:20.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.560+0000 7fc5e8726740 1 -- start start 2024-09-13T18:29:20.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5e8726740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2445230 0x2445610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5e8726740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x2423e90 0x240d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5e8726740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x2445b50 0x240ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5e8726740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x236cd80 con 0x2445230 2024-09-13T18:29:20.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5e8726740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x236a510 con 0x2423e90 2024-09-13T18:29:20.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5e8726740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x2365e00 con 0x2445b50 2024-09-13T18:29:20.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5deffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2445230 0x2445610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5df7fe700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x2445b50 0x240ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5deffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2445230 0x2445610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55940/0 (socket says 172.21.15.44:55940) 2024-09-13T18:29:20.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5de7fc700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x2423e90 0x240d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5deffd700 1 -- 172.21.15.44:0/4263798590 learned_addr learned my addr 172.21.15.44:0/4263798590 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:20.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5deffd700 1 -- 172.21.15.44:0/4263798590 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x2445b50 msgr2=0x240ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:20.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5deffd700 1 --2- 172.21.15.44:0/4263798590 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x2445b50 0x240ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5deffd700 1 -- 172.21.15.44:0/4263798590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x2423e90 msgr2=0x240d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:20.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5deffd700 1 --2- 172.21.15.44:0/4263798590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x2423e90 0x240d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5deffd700 1 -- 172.21.15.44:0/4263798590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x21d8960 con 0x2445230 2024-09-13T18:29:20.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5deffd700 1 --2- 172.21.15.44:0/4263798590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2445230 0x2445610 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8004870 tx=0x7fc5c8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52518d5a06e9450d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:20.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5d4ff9700 1 -- 172.21.15.44:0/4263798590 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8021400 con 0x2445230 2024-09-13T18:29:20.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5d4ff9700 1 -- 172.21.15.44:0/4263798590 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c8021560 con 0x2445230 2024-09-13T18:29:20.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5d4ff9700 1 -- 172.21.15.44:0/4263798590 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c80218d0 con 0x2445230 2024-09-13T18:29:20.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5e8726740 1 -- 172.21.15.44:0/4263798590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2445230 msgr2=0x2445610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:20.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5e8726740 1 --2- 172.21.15.44:0/4263798590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2445230 0x2445610 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8004870 tx=0x7fc5c8012000 comp rx=0 tx=0).stop 2024-09-13T18:29:20.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5e8726740 1 -- 172.21.15.44:0/4263798590 shutdown_connections 2024-09-13T18:29:20.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5e8726740 1 --2- 172.21.15.44:0/4263798590 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x2445b50 0x240ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5e8726740 1 --2- 172.21.15.44:0/4263798590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x2423e90 0x240d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5e8726740 1 --2- 172.21.15.44:0/4263798590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2445230 0x2445610 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5e8726740 1 -- 172.21.15.44:0/4263798590 >> 172.21.15.44:0/4263798590 conn(0x218d4d0 msgr2=0x2426e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:20.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5e8726740 1 -- 172.21.15.44:0/4263798590 shutdown_connections 2024-09-13T18:29:20.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5e8726740 1 -- 172.21.15.44:0/4263798590 wait complete. 2024-09-13T18:29:20.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5e8726740 1 -- start start 2024-09-13T18:29:20.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.564+0000 7fc5e8726740 1 Processor -- start 2024-09-13T18:29:20.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5e8726740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2423e90 0x2444a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5e8726740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x2445230 0x240ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5e8726740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x2445b50 0x243d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5e8726740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x2323730 con 0x2423e90 2024-09-13T18:29:20.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5e8726740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x23295b0 con 0x2445b50 2024-09-13T18:29:20.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5e8726740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x2211aa0 con 0x2445230 2024-09-13T18:29:20.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5e8726740 10 client.0 _ll_register_callbacks cb 0x235f610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:29:20.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5deffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2423e90 0x2444a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5deffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2423e90 0x2444a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55948/0 (socket says 172.21.15.44:55948) 2024-09-13T18:29:20.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5deffd700 1 -- 172.21.15.44:0/750023904 learned_addr learned my addr 172.21.15.44:0/750023904 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:20.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5df7fe700 1 --2- 172.21.15.44:0/750023904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x2445b50 0x243d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5de7fc700 1 --2- 172.21.15.44:0/750023904 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x2445230 0x240ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5deffd700 1 -- 172.21.15.44:0/750023904 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x2445230 msgr2=0x240ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:20.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5deffd700 1 --2- 172.21.15.44:0/750023904 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x2445230 0x240ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5deffd700 1 -- 172.21.15.44:0/750023904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x2445b50 msgr2=0x243d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:20.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5deffd700 1 --2- 172.21.15.44:0/750023904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x2445b50 0x243d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5deffd700 1 -- 172.21.15.44:0/750023904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c80045b0 con 0x2423e90 2024-09-13T18:29:20.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5df7fe700 1 --2- 172.21.15.44:0/750023904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x2445b50 0x243d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:20.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5deffd700 1 --2- 172.21.15.44:0/750023904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2423e90 0x2444a00 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8003dc0 tx=0x7fc5c8004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34450750eeb34954 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:20.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-13T18:29:20.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5bdffb700 1 -- 172.21.15.44:0/750023904 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8021400 con 0x2423e90 2024-09-13T18:29:20.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5bdffb700 1 -- 172.21.15.44:0/750023904 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5c802c440 con 0x2423e90 2024-09-13T18:29:20.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5e8726740 1 -- 172.21.15.44:0/750023904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x219a1e0 con 0x2423e90 2024-09-13T18:29:20.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5bdffb700 1 -- 172.21.15.44:0/750023904 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5c8004960 con 0x2423e90 2024-09-13T18:29:20.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5e8726740 10 client.6147 fetch_fsmap learned FSMap version 31 2024-09-13T18:29:20.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5e8726740 1 -- 172.21.15.44:0/750023904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x232c220 con 0x2423e90 2024-09-13T18:29:20.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5bdffb700 1 -- 172.21.15.44:0/750023904 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x219a1e0 con 0x2423e90 2024-09-13T18:29:20.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5bdffb700 1 -- 172.21.15.44:0/750023904 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 31) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc5c802c600 con 0x2423e90 2024-09-13T18:29:20.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5e8726740 10 client.6147 fetch_fsmap finished waiting for FSMap version 31 2024-09-13T18:29:20.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5e8726740 10 client.6147 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:29:20.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5e8726740 20 client.6147 populate_metadata read hostname 'smithi044' 2024-09-13T18:29:20.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5e8726740 1 --2- 172.21.15.44:0/750023904 >> [v2:172.21.15.44:6834/3200882245,v1:172.21.15.44:6835/3200882245] conn(0x23fe050 0x23fae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5e8726740 4 client.6147 mds_command: new command op to 5982 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:29:20.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5e8726740 1 -- 172.21.15.44:0/750023904 --> [v2:172.21.15.44:6834/3200882245,v1:172.21.15.44:6835/3200882245] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x21e4460 con 0x23fe050 2024-09-13T18:29:20.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5de7fc700 1 --2- 172.21.15.44:0/750023904 >> [v2:172.21.15.44:6834/3200882245,v1:172.21.15.44:6835/3200882245] conn(0x23fe050 0x23fae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5bdffb700 10 client.6147 ms_handle_connect on v2:172.21.15.44:6834/3200882245 2024-09-13T18:29:20.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.568+0000 7fc5de7fc700 1 --2- 172.21.15.44:0/750023904 >> [v2:172.21.15.44:6834/3200882245,v1:172.21.15.44:6835/3200882245] conn(0x23fe050 0x23fae10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9d4e576e8f9a954 server_cookie=c3f74cf131deea2a in_seq=0 out_seq=0 2024-09-13T18:29:20.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.572+0000 7fc5bdffb700 1 -- 172.21.15.44:0/750023904 <== mds.0 v2:172.21.15.44:6834/3200882245 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x21e4460 con 0x23fe050 2024-09-13T18:29:20.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.572+0000 7fc5bdffb700 10 client.6147 handle_command_reply: tid=0 2024-09-13T18:29:20.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.572+0000 7fc5e8726740 1 client.6147 shutdown 2024-09-13T18:29:20.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.572+0000 7fc5e8726740 1 -- 172.21.15.44:0/750023904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2423e90 msgr2=0x2444a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:20.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.572+0000 7fc5e8726740 1 --2- 172.21.15.44:0/750023904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2423e90 0x2444a00 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8003dc0 tx=0x7fc5c8004b60 comp rx=0 tx=0).stop 2024-09-13T18:29:20.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.572+0000 7fc5e8726740 1 -- 172.21.15.44:0/750023904 shutdown_connections 2024-09-13T18:29:20.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.572+0000 7fc5e8726740 1 --2- 172.21.15.44:0/750023904 >> [v2:172.21.15.44:6834/3200882245,v1:172.21.15.44:6835/3200882245] conn(0x23fe050 0x23fae10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.572+0000 7fc5e8726740 1 --2- 172.21.15.44:0/750023904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x2445b50 0x243d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.572+0000 7fc5bdffb700 0 client.6147 ms_handle_reset on v2:172.21.15.44:6834/3200882245 2024-09-13T18:29:20.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.572+0000 7fc5e8726740 1 --2- 172.21.15.44:0/750023904 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x2445230 0x240ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.572+0000 7fc5e8726740 1 --2- 172.21.15.44:0/750023904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2423e90 0x2444a00 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.572+0000 7fc5e8726740 1 -- 172.21.15.44:0/750023904 >> 172.21.15.44:0/750023904 conn(0x218d4d0 msgr2=0x243e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:20.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.572+0000 7fc5e8726740 1 -- 172.21.15.44:0/750023904 shutdown_connections 2024-09-13T18:29:20.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.572+0000 7fc5e8726740 1 -- 172.21.15.44:0/750023904 wait complete. 2024-09-13T18:29:20.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.572+0000 7fc5e8726740 20 client.6147 trim_cache size 0 max 16384 2024-09-13T18:29:20.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.592+0000 7fc5e8726740 1 Processor -- start 2024-09-13T18:29:20.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.592+0000 7fc5e8726740 1 -- start start 2024-09-13T18:29:20.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.592+0000 7fc5e8726740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x23fe050 0x243d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.592+0000 7fc5e8726740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2445230 0x24402b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.592+0000 7fc5e8726740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x2445b50 0x24407f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.592+0000 7fc5e8726740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x232f8d0 con 0x2445230 2024-09-13T18:29:20.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.592+0000 7fc5e8726740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x2394ec0 con 0x23fe050 2024-09-13T18:29:20.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.592+0000 7fc5e8726740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x230c560 con 0x2445b50 2024-09-13T18:29:20.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5de7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2445230 0x24402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5deffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x23fe050 0x243d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5de7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2445230 0x24402b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55952/0 (socket says 172.21.15.44:55952) 2024-09-13T18:29:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5de7fc700 1 -- 172.21.15.44:0/4012420070 learned_addr learned my addr 172.21.15.44:0/4012420070 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5df7fe700 1 --2- 172.21.15.44:0/4012420070 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x2445b50 0x24407f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5deffd700 1 -- 172.21.15.44:0/4012420070 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x2445b50 msgr2=0x24407f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5deffd700 1 --2- 172.21.15.44:0/4012420070 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x2445b50 0x24407f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5deffd700 1 -- 172.21.15.44:0/4012420070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2445230 msgr2=0x24402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5deffd700 1 --2- 172.21.15.44:0/4012420070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2445230 0x24402b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5deffd700 1 -- 172.21.15.44:0/4012420070 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2312450 con 0x23fe050 2024-09-13T18:29:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5de7fc700 1 --2- 172.21.15.44:0/4012420070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2445230 0x24402b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5deffd700 1 --2- 172.21.15.44:0/4012420070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x23fe050 0x243d8a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc5c80169e0 tx=0x7fc5c8029000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd877237389c8c35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5d57fa700 1 -- 172.21.15.44:0/4012420070 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8021400 con 0x23fe050 2024-09-13T18:29:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5d57fa700 1 -- 172.21.15.44:0/4012420070 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c801a070 con 0x23fe050 2024-09-13T18:29:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5d57fa700 1 -- 172.21.15.44:0/4012420070 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c80219b0 con 0x23fe050 2024-09-13T18:29:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5e8726740 1 -- 172.21.15.44:0/4012420070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x23fe050 msgr2=0x243d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5e8726740 1 --2- 172.21.15.44:0/4012420070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x23fe050 0x243d8a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc5c80169e0 tx=0x7fc5c8029000 comp rx=0 tx=0).stop 2024-09-13T18:29:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5e8726740 1 -- 172.21.15.44:0/4012420070 shutdown_connections 2024-09-13T18:29:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5e8726740 1 --2- 172.21.15.44:0/4012420070 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x2445b50 0x24407f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5e8726740 1 --2- 172.21.15.44:0/4012420070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2445230 0x24402b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5e8726740 1 --2- 172.21.15.44:0/4012420070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x23fe050 0x243d8a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5e8726740 1 -- 172.21.15.44:0/4012420070 >> 172.21.15.44:0/4012420070 conn(0x218d4d0 msgr2=0x24230d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5e8726740 1 -- 172.21.15.44:0/4012420070 shutdown_connections 2024-09-13T18:29:20.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.596+0000 7fc5e8726740 1 -- 172.21.15.44:0/4012420070 wait complete. 2024-09-13T18:29:20.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5e8726740 1 -- start start 2024-09-13T18:29:20.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5e8726740 1 Processor -- start 2024-09-13T18:29:20.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5e8726740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x23fe050 0x244a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5e8726740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x2445230 0x2449e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5e8726740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2445b50 0x24a5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5e8726740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x2464470 con 0x2445b50 2024-09-13T18:29:20.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5e8726740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x244b4a0 con 0x2445230 2024-09-13T18:29:20.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5e8726740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x23fb0f0 con 0x23fe050 2024-09-13T18:29:20.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5e8726740 10 client.0 _ll_register_callbacks cb 0x2317ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:29:20.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5df7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2445b50 0x24a5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5df7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2445b50 0x24a5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55960/0 (socket says 172.21.15.44:55960) 2024-09-13T18:29:20.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5df7fe700 1 -- 172.21.15.44:0/3798694024 learned_addr learned my addr 172.21.15.44:0/3798694024 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:20.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5deffd700 1 --2- 172.21.15.44:0/3798694024 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x23fe050 0x244a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5de7fc700 1 --2- 172.21.15.44:0/3798694024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x2445230 0x2449e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5df7fe700 1 -- 172.21.15.44:0/3798694024 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x23fe050 msgr2=0x244a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:20.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5df7fe700 1 --2- 172.21.15.44:0/3798694024 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x23fe050 0x244a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5df7fe700 1 -- 172.21.15.44:0/3798694024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x2445230 msgr2=0x2449e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:20.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5df7fe700 1 --2- 172.21.15.44:0/3798694024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x2445230 0x2449e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5df7fe700 1 -- 172.21.15.44:0/3798694024 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e01524c0 con 0x2445b50 2024-09-13T18:29:20.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5df7fe700 1 --2- 172.21.15.44:0/3798694024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2445b50 0x24a5c30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009150 tx=0x7fc5d80047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f770754e928ce423 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:20.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-13T18:29:20.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5bdffb700 1 -- 172.21.15.44:0/3798694024 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8021070 con 0x2445b50 2024-09-13T18:29:20.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5bdffb700 1 -- 172.21.15.44:0/3798694024 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5d800bc30 con 0x2445b50 2024-09-13T18:29:20.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.600+0000 7fc5e8726740 1 -- 172.21.15.44:0/3798694024 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc5c8021560 con 0x2445b50 2024-09-13T18:29:20.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5bdffb700 1 -- 172.21.15.44:0/3798694024 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5d800bdf0 con 0x2445b50 2024-09-13T18:29:20.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5e8726740 10 client.6153 fetch_fsmap learned FSMap version 31 2024-09-13T18:29:20.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5e8726740 1 -- 172.21.15.44:0/3798694024 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x232c220 con 0x2445b50 2024-09-13T18:29:20.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5bdffb700 1 -- 172.21.15.44:0/3798694024 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c8021560 con 0x2445b50 2024-09-13T18:29:20.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5bdffb700 1 -- 172.21.15.44:0/3798694024 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 31) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc5d8018070 con 0x2445b50 2024-09-13T18:29:20.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5e8726740 10 client.6153 fetch_fsmap finished waiting for FSMap version 31 2024-09-13T18:29:20.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5e8726740 10 client.6153 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:29:20.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5e8726740 20 client.6153 populate_metadata read hostname 'smithi044' 2024-09-13T18:29:20.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5e8726740 1 --2- 172.21.15.44:0/3798694024 >> [v2:172.21.15.44:6834/3200882245,v1:172.21.15.44:6835/3200882245] conn(0x24a7620 0x2447f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5e8726740 4 client.6153 mds_command: new command op to 5982 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:29:20.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5e8726740 1 -- 172.21.15.44:0/3798694024 --> [v2:172.21.15.44:6834/3200882245,v1:172.21.15.44:6835/3200882245] -- command(tid 0: {"prefix": "status"}) v1 -- 0x22091e0 con 0x24a7620 2024-09-13T18:29:20.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5deffd700 1 --2- 172.21.15.44:0/3798694024 >> [v2:172.21.15.44:6834/3200882245,v1:172.21.15.44:6835/3200882245] conn(0x24a7620 0x2447f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5bdffb700 10 client.6153 ms_handle_connect on v2:172.21.15.44:6834/3200882245 2024-09-13T18:29:20.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5deffd700 1 --2- 172.21.15.44:0/3798694024 >> [v2:172.21.15.44:6834/3200882245,v1:172.21.15.44:6835/3200882245] conn(0x24a7620 0x2447f40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d380f97c22f5fb48 server_cookie=5c42326d8af20162 in_seq=0 out_seq=0 2024-09-13T18:29:20.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5bdffb700 1 -- 172.21.15.44:0/3798694024 <== mds.0 v2:172.21.15.44:6834/3200882245 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x22091e0 con 0x24a7620 2024-09-13T18:29:20.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5bdffb700 10 client.6153 handle_command_reply: tid=0 2024-09-13T18:29:20.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5e8726740 1 client.6153 shutdown 2024-09-13T18:29:20.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5e8726740 1 -- 172.21.15.44:0/3798694024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2445b50 msgr2=0x24a5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:20.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5e8726740 1 --2- 172.21.15.44:0/3798694024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2445b50 0x24a5c30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009150 tx=0x7fc5d80047e0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5e8726740 1 -- 172.21.15.44:0/3798694024 shutdown_connections 2024-09-13T18:29:20.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5e8726740 1 --2- 172.21.15.44:0/3798694024 >> [v2:172.21.15.44:6834/3200882245,v1:172.21.15.44:6835/3200882245] conn(0x24a7620 0x2447f40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5e8726740 1 --2- 172.21.15.44:0/3798694024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2445b50 0x24a5c30 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5bdffb700 0 client.6153 ms_handle_reset on v2:172.21.15.44:6834/3200882245 2024-09-13T18:29:20.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5e8726740 1 --2- 172.21.15.44:0/3798694024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x2445230 0x2449e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5e8726740 1 --2- 172.21.15.44:0/3798694024 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x23fe050 0x244a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5e8726740 1 -- 172.21.15.44:0/3798694024 >> 172.21.15.44:0/3798694024 conn(0x218d4d0 msgr2=0x243c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:20.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5e8726740 1 -- 172.21.15.44:0/3798694024 shutdown_connections 2024-09-13T18:29:20.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5e8726740 1 -- 172.21.15.44:0/3798694024 wait complete. 2024-09-13T18:29:20.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.604+0000 7fc5e8726740 20 client.6153 trim_cache size 0 max 16384 2024-09-13T18:29:20.614 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:29:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "c8e1d12d-7fb9-4a33-982e-b895bb77262c", 2024-09-13T18:29:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-13T18:29:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 5982, 2024-09-13T18:29:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-13T18:29:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-13T18:29:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-13T18:29:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 10.319688040000001, 2024-09-13T18:29:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 31, 2024-09-13T18:29:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 48, 2024-09-13T18:29:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 48, 2024-09-13T18:29:20.614 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 14.707816823 2024-09-13T18:29:20.615 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:29:20.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.608+0000 7fc5dffff700 1 -- 172.21.15.44:0/3286180349 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc5c0066730 msgr2=0x7fc5c0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:20.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.608+0000 7fc5dffff700 1 --2- 172.21.15.44:0/3286180349 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc5c0066730 0x7fc5c0068bf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009a80 tx=0x7fc5c8003a40 comp rx=0 tx=0).stop 2024-09-13T18:29:20.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.608+0000 7fc5dffff700 1 -- 172.21.15.44:0/3286180349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5e00d0350 msgr2=0x7fc5e015cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:20.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.608+0000 7fc5dffff700 1 --2- 172.21.15.44:0/3286180349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5e00d0350 0x7fc5e015cf00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc5d000c550 tx=0x7fc5d000c910 comp rx=0 tx=0).stop 2024-09-13T18:29:20.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.608+0000 7fc5dffff700 1 -- 172.21.15.44:0/3286180349 shutdown_connections 2024-09-13T18:29:20.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.608+0000 7fc5dffff700 1 --2- 172.21.15.44:0/3286180349 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc5c0066730 0x7fc5c0068bf0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.608+0000 7fc5dffff700 1 --2- 172.21.15.44:0/3286180349 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5e015a770 0x7fc5e015b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.608+0000 7fc5dffff700 1 --2- 172.21.15.44:0/3286180349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5e00d0350 0x7fc5e015cf00 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.608+0000 7fc5dffff700 1 --2- 172.21.15.44:0/3286180349 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e006dec0 0x7fc5e0144540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.608+0000 7fc5dffff700 1 -- 172.21.15.44:0/3286180349 >> 172.21.15.44:0/3286180349 conn(0x7fc5e0071d00 msgr2=0x7fc5e00b3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:20.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.608+0000 7fc5dffff700 1 -- 172.21.15.44:0/3286180349 shutdown_connections 2024-09-13T18:29:20.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.608+0000 7fc5dffff700 1 -- 172.21.15.44:0/3286180349 wait complete. 2024-09-13T18:29:20.627 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:29:20.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc36f29700 1 Processor -- start 2024-09-13T18:29:20.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc36f29700 1 -- start start 2024-09-13T18:29:20.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc36f29700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc300722c0 0x7fbc3006c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc36f29700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbc300b29a0 0x7fbc300b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc36f29700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc300b3710 con 0x7fbc30153da0 2024-09-13T18:29:20.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc36f29700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3015abb0 con 0x7fbc300b29a0 2024-09-13T18:29:20.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc36f29700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3006be30 con 0x7fbc300722c0 2024-09-13T18:29:20.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc35f27700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fbc30153da0 0x7fbc30071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60434/0 (socket says 172.21.15.44:60434) 2024-09-13T18:29:20.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc35f27700 1 -- 172.21.15.44:0/3790705632 learned_addr learned my addr 172.21.15.44:0/3790705632 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:29:20.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc35726700 1 --2- 172.21.15.44:0/3790705632 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc300722c0 0x7fbc3006c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc36728700 1 --2- 172.21.15.44:0/3790705632 >> v2:172.21.15.99:3300/0 conn(0x7fbc300b29a0 0x7fbc300b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc34f25700 1 -- 172.21.15.44:0/3790705632 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3395048886 0 0) 0x7fbc300b3710 con 0x7fbc30153da0 2024-09-13T18:29:20.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc34f25700 1 -- 172.21.15.44:0/3790705632 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc1c0035d0 con 0x7fbc30153da0 2024-09-13T18:29:20.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc34f25700 1 -- 172.21.15.44:0/3790705632 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2976953458 0 0) 0x7fbc1c0035d0 con 0x7fbc30153da0 2024-09-13T18:29:20.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc34f25700 1 -- 172.21.15.44:0/3790705632 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc300722c0 msgr2=0x7fbc3006c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:20.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc34f25700 1 --2- 172.21.15.44:0/3790705632 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc300722c0 0x7fbc3006c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc34f25700 1 -- 172.21.15.44:0/3790705632 >> v2:172.21.15.99:3300/0 conn(0x7fbc300b29a0 msgr2=0x7fbc300b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:20.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc34f25700 1 --2- 172.21.15.44:0/3790705632 >> v2:172.21.15.99:3300/0 conn(0x7fbc300b29a0 0x7fbc300b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc34f25700 1 -- 172.21.15.44:0/3790705632 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3006c110 con 0x7fbc30153da0 2024-09-13T18:29:20.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc34f25700 1 -- 172.21.15.44:0/3790705632 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7fbc2c001670 con 0x7fbc30153da0 2024-09-13T18:29:20.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc34f25700 1 -- 172.21.15.44:0/3790705632 >> v1:172.21.15.44:6789/0 conn(0x7fbc30153da0 legacy=0x7fbc30071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:20.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc34f25700 1 --2- 172.21.15.44:0/3790705632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc1c003a20 0x7fbc1c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc34f25700 1 --2- 172.21.15.44:0/3790705632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc1c004870 0x7fbc1c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc34f25700 1 --2- 172.21.15.44:0/3790705632 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc300722c0 0x7fbc1c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc34f25700 1 -- 172.21.15.44:0/3790705632 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3015abb0 con 0x7fbc1c004870 2024-09-13T18:29:20.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc34f25700 1 -- 172.21.15.44:0/3790705632 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3006be30 con 0x7fbc1c003a20 2024-09-13T18:29:20.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc34f25700 1 -- 172.21.15.44:0/3790705632 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1c00ba30 con 0x7fbc300722c0 2024-09-13T18:29:20.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc35726700 1 --2- 172.21.15.44:0/3790705632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc1c004870 0x7fbc1c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc35f27700 1 --2- 172.21.15.44:0/3790705632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc1c003a20 0x7fbc1c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc35726700 1 -- 172.21.15.44:0/3790705632 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc300722c0 msgr2=0x7fbc1c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:20.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc35726700 1 --2- 172.21.15.44:0/3790705632 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc300722c0 0x7fbc1c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc35726700 1 -- 172.21.15.44:0/3790705632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc1c003a20 msgr2=0x7fbc1c003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:20.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc35726700 1 --2- 172.21.15.44:0/3790705632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc1c003a20 0x7fbc1c003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc35726700 1 -- 172.21.15.44:0/3790705632 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1c0035d0 con 0x7fbc1c004870 2024-09-13T18:29:20.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc35f27700 1 --2- 172.21.15.44:0/3790705632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc1c003a20 0x7fbc1c003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:20.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc35726700 1 --2- 172.21.15.44:0/3790705632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc1c004870 0x7fbc1c004cf0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fbc20009b40 tx=0x7fbc1c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=607f58758f155db1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:20.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc34f25700 1 -- 172.21.15.44:0/3790705632 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2000e6c0 con 0x7fbc1c004870 2024-09-13T18:29:20.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc34f25700 1 -- 172.21.15.44:0/3790705632 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2000e820 con 0x7fbc1c004870 2024-09-13T18:29:20.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.744+0000 7fbc34f25700 1 -- 172.21.15.44:0/3790705632 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2000eb90 con 0x7fbc1c004870 2024-09-13T18:29:20.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.748+0000 7fbc36f29700 1 -- 172.21.15.44:0/3790705632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc1c004870 msgr2=0x7fbc1c004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:20.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.748+0000 7fbc36f29700 1 --2- 172.21.15.44:0/3790705632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc1c004870 0x7fbc1c004cf0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fbc20009b40 tx=0x7fbc1c0058a0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.748+0000 7fbc36728700 1 -- 172.21.15.44:0/3790705632 reap_dead start 2024-09-13T18:29:20.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.748+0000 7fbc36f29700 1 -- 172.21.15.44:0/3790705632 shutdown_connections 2024-09-13T18:29:20.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.748+0000 7fbc36f29700 1 -- 172.21.15.44:0/3790705632 >> 172.21.15.44:0/3790705632 conn(0x7fbc300cf910 msgr2=0x7fbc300cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:20.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.748+0000 7fbc36f29700 1 -- 172.21.15.44:0/3790705632 shutdown_connections 2024-09-13T18:29:20.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.748+0000 7fbc36f29700 1 -- 172.21.15.44:0/3790705632 wait complete. 2024-09-13T18:29:20.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.748+0000 7fbc36f29700 1 Processor -- start 2024-09-13T18:29:20.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.748+0000 7fbc36f29700 1 -- start start 2024-09-13T18:29:20.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.752+0000 7fbc36f29700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc301f3880 0x7fbc301e3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.752+0000 7fbc36f29700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc301e3bb0 0x7fbc30159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.752+0000 7fbc36f29700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc3015a350 0x7fbc3015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.752+0000 7fbc36f29700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc301e4d60 con 0x7fbc301e3bb0 2024-09-13T18:29:20.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.752+0000 7fbc36f29700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc30151ad0 con 0x7fbc3015a350 2024-09-13T18:29:20.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.752+0000 7fbc36f29700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3015a7d0 con 0x7fbc301f3880 2024-09-13T18:29:20.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.752+0000 7fbc35726700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc301e3bb0 0x7fbc30159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.752+0000 7fbc35726700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc301e3bb0 0x7fbc30159e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55964/0 (socket says 172.21.15.44:55964) 2024-09-13T18:29:20.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.752+0000 7fbc35f27700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc301f3880 0x7fbc301e3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.752+0000 7fbc35726700 1 -- 172.21.15.44:0/3031994390 learned_addr learned my addr 172.21.15.44:0/3031994390 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:29:20.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.752+0000 7fbc36728700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc3015a350 0x7fbc3015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.752+0000 7fbc35726700 1 -- 172.21.15.44:0/3031994390 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc301f3880 msgr2=0x7fbc301e3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:20.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.752+0000 7fbc35726700 1 --2- 172.21.15.44:0/3031994390 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc301f3880 0x7fbc301e3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.752+0000 7fbc35726700 1 -- 172.21.15.44:0/3031994390 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc3015a350 msgr2=0x7fbc3015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:20.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.752+0000 7fbc35726700 1 --2- 172.21.15.44:0/3031994390 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc3015a350 0x7fbc3015bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.752+0000 7fbc35726700 1 -- 172.21.15.44:0/3031994390 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc301f2f60 con 0x7fbc301e3bb0 2024-09-13T18:29:20.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.752+0000 7fbc35726700 1 --2- 172.21.15.44:0/3031994390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc301e3bb0 0x7fbc30159e10 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fbc20016000 tx=0x7fbc200047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:20.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.752+0000 7fbc267fc700 1 -- 172.21.15.44:0/3031994390 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2000e6c0 con 0x7fbc301e3bb0 2024-09-13T18:29:20.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.752+0000 7fbc267fc700 1 -- 172.21.15.44:0/3031994390 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc20003af0 con 0x7fbc301e3bb0 2024-09-13T18:29:20.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.752+0000 7fbc36f29700 1 -- 172.21.15.44:0/3031994390 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc301e41e0 con 0x7fbc301e3bb0 2024-09-13T18:29:20.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.752+0000 7fbc267fc700 1 -- 172.21.15.44:0/3031994390 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc20003ea0 con 0x7fbc301e3bb0 2024-09-13T18:29:20.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.752+0000 7fbc36f29700 1 -- 172.21.15.44:0/3031994390 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc301e47a0 con 0x7fbc301e3bb0 2024-09-13T18:29:20.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.756+0000 7fbc36f29700 1 -- 172.21.15.44:0/3031994390 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc30072a30 con 0x7fbc301e3bb0 2024-09-13T18:29:20.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.756+0000 7fbc267fc700 1 -- 172.21.15.44:0/3031994390 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbc20013470 con 0x7fbc301e3bb0 2024-09-13T18:29:20.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.756+0000 7fbc267fc700 1 --2- 172.21.15.44:0/3031994390 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbc14066760 0x7fbc14068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.756+0000 7fbc267fc700 1 -- 172.21.15.44:0/3031994390 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc20085260 con 0x7fbc301e3bb0 2024-09-13T18:29:20.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.756+0000 7fbc35f27700 1 --2- 172.21.15.44:0/3031994390 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbc14066760 0x7fbc14068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.756+0000 7fbc35f27700 1 --2- 172.21.15.44:0/3031994390 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbc14066760 0x7fbc14068c20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c001eb0 tx=0x7fbc2c007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:20.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.760+0000 7fbc267fc700 1 -- 172.21.15.44:0/3031994390 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbc20052840 con 0x7fbc301e3bb0 2024-09-13T18:29:20.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.976+0000 7fbc36f29700 1 -- 172.21.15.44:0/3031994390 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbc300b2e10 con 0x7fbc301e3bb0 2024-09-13T18:29:20.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.976+0000 7fbc267fc700 1 -- 172.21.15.44:0/3031994390 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbc20000e60 con 0x7fbc301e3bb0 2024-09-13T18:29:20.981 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:29:20.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.980+0000 7fbc36f29700 1 -- 172.21.15.44:0/3031994390 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbc14066760 msgr2=0x7fbc14068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:20.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.980+0000 7fbc36f29700 1 --2- 172.21.15.44:0/3031994390 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbc14066760 0x7fbc14068c20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c001eb0 tx=0x7fbc2c007040 comp rx=0 tx=0).stop 2024-09-13T18:29:20.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.980+0000 7fbc36f29700 1 -- 172.21.15.44:0/3031994390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc301e3bb0 msgr2=0x7fbc30159e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:20.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.980+0000 7fbc36f29700 1 --2- 172.21.15.44:0/3031994390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc301e3bb0 0x7fbc30159e10 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fbc20016000 tx=0x7fbc200047e0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.980+0000 7fbc36f29700 1 -- 172.21.15.44:0/3031994390 shutdown_connections 2024-09-13T18:29:20.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.980+0000 7fbc36f29700 1 --2- 172.21.15.44:0/3031994390 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbc14066760 0x7fbc14068c20 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.980+0000 7fbc36f29700 1 --2- 172.21.15.44:0/3031994390 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc3015a350 0x7fbc3015bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.980+0000 7fbc36f29700 1 --2- 172.21.15.44:0/3031994390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc301e3bb0 0x7fbc30159e10 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.980+0000 7fbc36f29700 1 --2- 172.21.15.44:0/3031994390 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc301f3880 0x7fbc301e3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.980+0000 7fbc36f29700 1 -- 172.21.15.44:0/3031994390 >> 172.21.15.44:0/3031994390 conn(0x7fbc300cf910 msgr2=0x7fbc30071270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:20.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.980+0000 7fbc36f29700 1 -- 172.21.15.44:0/3031994390 shutdown_connections 2024-09-13T18:29:20.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:29:20.980+0000 7fbc36f29700 1 -- 172.21.15.44:0/3031994390 wait complete. 2024-09-13T18:29:20.996 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:29:20.996 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:29:20.996 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-13T18:29:20.997 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:29:20.997 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:29:20.997 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:29:20.997 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:29:20.997 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:29:20.997 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:29:20.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:20.997 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-13T18:29:21.005 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:29:21.006 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:29:21.006 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:29:21.006 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:21.006 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-13T18:29:21.006 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:21.006 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:29:21.006 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-13T18:29:21.006 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:29:21.006 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:29:21.006 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:29:21.006 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:29:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:29:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42463sec preferred_lft 42463sec 2024-09-13T18:29:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-13T18:29:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:21.007 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:29:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:29:21.007 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:29:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:80:b2:e4:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:29:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:29:21.007 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:21.007 INFO:teuthology.orchestra.run.smithi044.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:29:21.008 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 2e:69:eb:1c:57:57 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:29:21.008 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:29:21.008 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:21.008 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::8842:91ff:feed:2c53/64 scope link 2024-09-13T18:29:21.008 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:21.008 INFO:teuthology.orchestra.run.smithi044.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:29:21.008 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 2e:69:eb:1c:57:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:29:21.008 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::2c69:ebff:fe1c:5757/64 scope link 2024-09-13T18:29:21.008 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:21.008 INFO:teuthology.orchestra.run.smithi044.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:29:21.008 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 86:e5:07:ac:f1:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:29:21.008 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::84e5:7ff:feac:f11b/64 scope link 2024-09-13T18:29:21.009 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:21.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:21.009 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:29:21.021 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-13T18:29:21.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:21.023 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-13T18:29:21.075 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-13T18:29:21.075 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:29:21.075 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:29:21.075 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:29:21.075 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:29:21.075 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:29:21.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:21.076 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2024-09-13T18:29:21.076 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-13T18:29:21.076 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:29:21.076 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:29:21.076 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:29:21.076 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-13T18:29:21.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:21.116 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-13T18:29:21.123 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:29:21.124 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:29:21.124 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:29:21.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:21.124 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-13T18:29:21.136 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:29:21.136 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:29:21.137 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:29:21.185 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:29:21.185 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:29:21.185 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:29:21.190 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:29:21.206 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:29:21.206 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:29:21.260 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:29:21.261 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:29:21.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:21.262 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:29:21.268 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:29:21.268 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:29:21.270 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:29:21.286 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:29:21.286 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:29:21.342 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:29:21.342 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:29:21.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:21.343 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:29:21.361 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2024-09-13T18:29:21.356+0000 7f3b1c559640 -1 init, newargv = 0x5598f14c25b0 newargc=15 2024-09-13T18:29:21.361 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[40426]: starting ceph client 2024-09-13T18:29:21.369 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[40426]: starting fuse 2024-09-13T18:29:22.450 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:29:22.467 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:29:22.468 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:29:22.484 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:29:22.485 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:29:22.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:22.486 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:29:22.537 INFO:teuthology.orchestra.run.smithi044.stdout:52 2024-09-13T18:29:22.537 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T18:29:22.537 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:29:22.537 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2024-09-13T18:29:22.538 DEBUG:teuthology.orchestra.run.smithi044:> import re 2024-09-13T18:29:22.538 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:29:22.538 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2024-09-13T18:29:22.538 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:29:22.538 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2024-09-13T18:29:22.538 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:29:22.538 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2024-09-13T18:29:22.538 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:29:22.538 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:29:22.538 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2024-09-13T18:29:22.538 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2024-09-13T18:29:22.538 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2024-09-13T18:29:22.538 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2024-09-13T18:29:22.539 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:29:22.539 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2024-09-13T18:29:22.539 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:29:22.539 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:29:22.539 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:29:22.539 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2024-09-13T18:29:22.539 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2024-09-13T18:29:22.539 DEBUG:teuthology.orchestra.run.smithi044:> return f 2024-09-13T18:29:22.539 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:29:22.539 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:29:22.539 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.0")) 2024-09-13T18:29:22.539 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:29:22.623 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.0.40426.asok 2024-09-13T18:29:22.811 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.40426.asok 2024-09-13T18:29:22.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:22.811 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.40426.asok status 2024-09-13T18:29:22.911 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:29:22.911 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2024-09-13T18:29:22.911 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:29:22.911 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:29:22.911 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "0", 2024-09-13T18:29:22.911 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2024-09-13T18:29:22.911 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:29:22.911 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "40426", 2024-09-13T18:29:22.911 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2024-09-13T18:29:22.911 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:29:22.912 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2024-09-13T18:29:22.912 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2024-09-13T18:29:22.912 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 6165, 2024-09-13T18:29:22.912 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2024-09-13T18:29:22.912 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2024-09-13T18:29:22.912 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2024-09-13T18:29:22.912 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 6165 2024-09-13T18:29:22.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:29:22.912 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:29:22.912 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-13T18:29:22.912 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:29:22.912 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3993750366 2024-09-13T18:29:22.912 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:29:22.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:29:22.913 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:29:22.913 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-13T18:29:22.913 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:29:22.913 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3993750366 2024-09-13T18:29:22.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:29:22.913 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.6165 192.168.0.1:0/3993750366", 2024-09-13T18:29:22.913 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/3993750366", 2024-09-13T18:29:22.913 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2024-09-13T18:29:22.913 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 31, 2024-09-13T18:29:22.913 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 48, 2024-09-13T18:29:22.913 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:29:22.913 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2024-09-13T18:29:22.914 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2024-09-13T18:29:22.914 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:29:22.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:22.921 DEBUG:teuthology.orchestra.run.smithi044:> stat --file-system '--printf=%T 2024-09-13T18:29:22.921 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:29:22.926 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2024-09-13T18:29:22.927 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:29:22.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:22.927 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:29:22.938 INFO:tasks.workunit:Pulling workunits from ref 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:29:22.939 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T18:29:22.939 DEBUG:teuthology.orchestra.run.smithi044:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:29:22.948 INFO:teuthology.orchestra.run.smithi044.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-13T18:29:22.948 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-13T18:29:22.948 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 34h/52d Inode: 1 Links: 2 2024-09-13T18:29:22.948 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:29:22.948 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T18:29:22.948 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-13 18:29:10.288653032 +0000 2024-09-13T18:29:22.948 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-13 18:29:22.935137498 +0000 2024-09-13T18:29:22.948 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: - 2024-09-13T18:29:22.948 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-13T18:29:22.949 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-13T18:29:22.977 INFO:tasks.workunit:timeout=1h 2024-09-13T18:29:22.977 INFO:tasks.workunit:cleanup=True 2024-09-13T18:29:22.978 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:29:22.985 INFO:tasks.workunit.client.0.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T18:29:28.494 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:29:28.496 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:29:58.550 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:29:58.553 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:30:27.410 INFO:tasks.workunit.client.0.smithi044.stderr:Note: switching to '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'. 2024-09-13T18:30:27.411 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-13T18:30:27.411 INFO:tasks.workunit.client.0.smithi044.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T18:30:27.411 INFO:tasks.workunit.client.0.smithi044.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T18:30:27.411 INFO:tasks.workunit.client.0.smithi044.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T18:30:27.411 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-13T18:30:27.411 INFO:tasks.workunit.client.0.smithi044.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T18:30:27.411 INFO:tasks.workunit.client.0.smithi044.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T18:30:27.411 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-13T18:30:27.412 INFO:tasks.workunit.client.0.smithi044.stderr: git switch -c 2024-09-13T18:30:27.412 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-13T18:30:27.412 INFO:tasks.workunit.client.0.smithi044.stderr:Or undo this operation with: 2024-09-13T18:30:27.412 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-13T18:30:27.412 INFO:tasks.workunit.client.0.smithi044.stderr: git switch - 2024-09-13T18:30:27.412 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-13T18:30:27.412 INFO:tasks.workunit.client.0.smithi044.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T18:30:27.412 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-13T18:30:27.412 INFO:tasks.workunit.client.0.smithi044.stderr:HEAD is now at 6c6b083f148 Merge PR #56690 into wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:30:27.416 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T18:30:27.447 INFO:tasks.workunit.client.0.smithi044.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T18:30:27.450 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:30:27.450 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T18:30:28.282 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T18:30:28.369 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T18:30:28.435 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:30:28.437 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:30:28.438 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T18:30:28.501 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:30:28.507 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:30:28.507 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T18:30:28.514 INFO:tasks.workunit:Running workunits matching fs/misc/trivial_sync.sh on client.0... 2024-09-13T18:30:28.515 INFO:tasks.workunit:Running workunit fs/misc/trivial_sync.sh... 2024-09-13T18:30:28.515 DEBUG:teuthology.orchestra.run.smithi044:workunit test fs/misc/trivial_sync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 1h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/trivial_sync.sh 2024-09-13T18:30:28.602 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:30:28.604 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:30:30.805 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T18:30:30.805 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T18:30:30.854 INFO:tasks.workunit:Stopping ['fs/misc/trivial_sync.sh'] on client.0... 2024-09-13T18:30:30.854 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T18:30:31.123 DEBUG:teuthology.parallel:result is None 2024-09-13T18:30:31.124 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T18:30:31.145 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T18:30:31.145 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:30:31.145 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:30:31.153 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:30:31.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.307+0000 7f2141cf9700 1 Processor -- start 2024-09-13T18:30:31.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.307+0000 7f2141cf9700 1 -- start start 2024-09-13T18:30:31.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2141cf9700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f213c159720 0x7f213c06cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2141cf9700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f213c06aa90 0x7f213c0b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2141cf9700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f213c0b3910 0x7f213c070c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2141cf9700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f213c0b3da0 con 0x7f213c159720 2024-09-13T18:30:31.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2141cf9700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f213c06aed0 con 0x7f213c0b3910 2024-09-13T18:30:31.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2141cf9700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213c06d690 con 0x7f213c06aa90 2024-09-13T18:30:31.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2140cf7700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f213c159720 0x7f213c06cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2140cf7700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f213c159720 0x7f213c06cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58770/0 (socket says 172.21.15.44:58770) 2024-09-13T18:30:31.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2140cf7700 1 -- 172.21.15.44:0/925385054 learned_addr learned my addr 172.21.15.44:0/925385054 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:30:31.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f21414f8700 1 --2- 172.21.15.44:0/925385054 >> v2:172.21.15.99:3300/0 conn(0x7f213c0b3910 0x7f213c070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f213bfff700 1 --2- 172.21.15.44:0/925385054 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f213c06aa90 0x7f213c0b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2140cf7700 1 -- 172.21.15.44:0/925385054 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f213c06aa90 msgr2=0x7f213c0b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:31.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2140cf7700 1 --2- 172.21.15.44:0/925385054 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f213c06aa90 0x7f213c0b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2140cf7700 1 -- 172.21.15.44:0/925385054 >> v2:172.21.15.99:3300/0 conn(0x7f213c0b3910 msgr2=0x7f213c070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:31.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2140cf7700 1 --2- 172.21.15.44:0/925385054 >> v2:172.21.15.99:3300/0 conn(0x7f213c0b3910 0x7f213c070c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2140cf7700 1 -- 172.21.15.44:0/925385054 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213c0cbfe0 con 0x7f213c159720 2024-09-13T18:30:31.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2140cf7700 1 --2- 172.21.15.44:0/925385054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f213c159720 0x7f213c06cf90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f213c06b470 tx=0x7f2130009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae94d1991e48a17e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:31.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f213b7fe700 1 -- 172.21.15.44:0/925385054 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2130011830 con 0x7f213c159720 2024-09-13T18:30:31.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f213b7fe700 1 -- 172.21.15.44:0/925385054 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2130011990 con 0x7f213c159720 2024-09-13T18:30:31.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f213b7fe700 1 -- 172.21.15.44:0/925385054 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2130011d20 con 0x7f213c159720 2024-09-13T18:30:31.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2141cf9700 1 -- 172.21.15.44:0/925385054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f213c159720 msgr2=0x7f213c06cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:31.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2141cf9700 1 --2- 172.21.15.44:0/925385054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f213c159720 0x7f213c06cf90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f213c06b470 tx=0x7f2130009bf0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2141cf9700 1 -- 172.21.15.44:0/925385054 shutdown_connections 2024-09-13T18:30:31.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2141cf9700 1 --2- 172.21.15.44:0/925385054 >> v2:172.21.15.99:3300/0 conn(0x7f213c0b3910 0x7f213c070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2141cf9700 1 --2- 172.21.15.44:0/925385054 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f213c06aa90 0x7f213c0b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2141cf9700 1 --2- 172.21.15.44:0/925385054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f213c159720 0x7f213c06cf90 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2141cf9700 1 -- 172.21.15.44:0/925385054 >> 172.21.15.44:0/925385054 conn(0x7f213c0b0f00 msgr2=0x7f213c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:31.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2141cf9700 1 -- 172.21.15.44:0/925385054 shutdown_connections 2024-09-13T18:30:31.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.311+0000 7f2141cf9700 1 -- 172.21.15.44:0/925385054 wait complete. 2024-09-13T18:30:31.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.315+0000 7f2141cf9700 1 Processor -- start 2024-09-13T18:30:31.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.315+0000 7f2141cf9700 1 -- start start 2024-09-13T18:30:31.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.315+0000 7f2141cf9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f213c06aa90 0x7f213c1e4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.315+0000 7f2141cf9700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f213c0b3910 0x7f213c1e5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.315+0000 7f2141cf9700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f213c159720 0x7f213c1504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.315+0000 7f2141cf9700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213c14e520 con 0x7f213c06aa90 2024-09-13T18:30:31.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.315+0000 7f2141cf9700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213c150a20 con 0x7f213c0b3910 2024-09-13T18:30:31.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.315+0000 7f2141cf9700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213c14f720 con 0x7f213c159720 2024-09-13T18:30:31.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.315+0000 7f2140cf7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f213c06aa90 0x7f213c1e4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.315+0000 7f2140cf7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f213c06aa90 0x7f213c1e4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58776/0 (socket says 172.21.15.44:58776) 2024-09-13T18:30:31.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.315+0000 7f2140cf7700 1 -- 172.21.15.44:0/2847745853 learned_addr learned my addr 172.21.15.44:0/2847745853 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:30:31.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.315+0000 7f21414f8700 1 --2- 172.21.15.44:0/2847745853 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f213c159720 0x7f213c1504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.315+0000 7f213bfff700 1 --2- 172.21.15.44:0/2847745853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f213c0b3910 0x7f213c1e5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.315+0000 7f2140cf7700 1 -- 172.21.15.44:0/2847745853 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f213c159720 msgr2=0x7f213c1504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:31.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.315+0000 7f2140cf7700 1 --2- 172.21.15.44:0/2847745853 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f213c159720 0x7f213c1504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.315+0000 7f2140cf7700 1 -- 172.21.15.44:0/2847745853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f213c0b3910 msgr2=0x7f213c1e5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:31.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.315+0000 7f2140cf7700 1 --2- 172.21.15.44:0/2847745853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f213c0b3910 0x7f213c1e5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.315+0000 7f2140cf7700 1 -- 172.21.15.44:0/2847745853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2130009570 con 0x7f213c06aa90 2024-09-13T18:30:31.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.315+0000 7f2140cf7700 1 --2- 172.21.15.44:0/2847745853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f213c06aa90 0x7f213c1e4820 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2130000c00 tx=0x7f2130004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:31.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.315+0000 7f21397fa700 1 -- 172.21.15.44:0/2847745853 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2130004450 con 0x7f213c06aa90 2024-09-13T18:30:31.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.315+0000 7f21397fa700 1 -- 172.21.15.44:0/2847745853 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213001e070 con 0x7f213c06aa90 2024-09-13T18:30:31.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.315+0000 7f2141cf9700 1 -- 172.21.15.44:0/2847745853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f213c14fa00 con 0x7f213c06aa90 2024-09-13T18:30:31.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.315+0000 7f21397fa700 1 -- 172.21.15.44:0/2847745853 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21300038c0 con 0x7f213c06aa90 2024-09-13T18:30:31.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.319+0000 7f2141cf9700 1 -- 172.21.15.44:0/2847745853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213c14ffc0 con 0x7f213c06aa90 2024-09-13T18:30:31.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.319+0000 7f2141cf9700 1 -- 172.21.15.44:0/2847745853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f213c0b33d0 con 0x7f213c06aa90 2024-09-13T18:30:31.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.319+0000 7f21397fa700 1 -- 172.21.15.44:0/2847745853 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2130003a20 con 0x7f213c06aa90 2024-09-13T18:30:31.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.319+0000 7f21397fa700 1 --2- 172.21.15.44:0/2847745853 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2128066760 0x7f2128068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.319+0000 7f21397fa700 1 -- 172.21.15.44:0/2847745853 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2130020070 con 0x7f213c06aa90 2024-09-13T18:30:31.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.319+0000 7f213bfff700 1 --2- 172.21.15.44:0/2847745853 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2128066760 0x7f2128068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.323+0000 7f213bfff700 1 --2- 172.21.15.44:0/2847745853 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2128066760 0x7f2128068c20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f213c1e47b0 tx=0x7f212c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:31.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.327+0000 7f21397fa700 1 -- 172.21.15.44:0/2847745853 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2130052ab0 con 0x7f213c06aa90 2024-09-13T18:30:31.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.507+0000 7f2141cf9700 1 -- 172.21.15.44:0/2847745853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f213c0cb550 con 0x7f213c06aa90 2024-09-13T18:30:31.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.507+0000 7f21397fa700 1 -- 172.21.15.44:0/2847745853 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f2130015090 con 0x7f213c06aa90 2024-09-13T18:30:31.514 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:30:31.514 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":50,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:29:43.702475+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:29:08.754284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:29:09.262346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.1b","mappings":[{"from":0,"to":5}]},{"pgid":"7.3c","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:30:31.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.511+0000 7f2141cf9700 1 -- 172.21.15.44:0/2847745853 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2128066760 msgr2=0x7f2128068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:31.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.511+0000 7f2141cf9700 1 --2- 172.21.15.44:0/2847745853 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2128066760 0x7f2128068c20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f213c1e47b0 tx=0x7f212c009240 comp rx=0 tx=0).stop 2024-09-13T18:30:31.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.511+0000 7f2141cf9700 1 -- 172.21.15.44:0/2847745853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f213c06aa90 msgr2=0x7f213c1e4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:31.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.511+0000 7f2141cf9700 1 --2- 172.21.15.44:0/2847745853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f213c06aa90 0x7f213c1e4820 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2130000c00 tx=0x7f2130004770 comp rx=0 tx=0).stop 2024-09-13T18:30:31.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.511+0000 7f2141cf9700 1 -- 172.21.15.44:0/2847745853 shutdown_connections 2024-09-13T18:30:31.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.511+0000 7f2141cf9700 1 --2- 172.21.15.44:0/2847745853 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2128066760 0x7f2128068c20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.511+0000 7f2141cf9700 1 --2- 172.21.15.44:0/2847745853 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f213c159720 0x7f213c1504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.511+0000 7f2141cf9700 1 --2- 172.21.15.44:0/2847745853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f213c0b3910 0x7f213c1e5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.511+0000 7f2141cf9700 1 --2- 172.21.15.44:0/2847745853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f213c06aa90 0x7f213c1e4820 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.511+0000 7f2141cf9700 1 -- 172.21.15.44:0/2847745853 >> 172.21.15.44:0/2847745853 conn(0x7f213c0b0f00 msgr2=0x7f213c1e1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:31.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.511+0000 7f2141cf9700 1 -- 172.21.15.44:0/2847745853 shutdown_connections 2024-09-13T18:30:31.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.511+0000 7f2141cf9700 1 -- 172.21.15.44:0/2847745853 wait complete. 2024-09-13T18:30:31.530 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:29:08.754284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:29:09.262346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:30:31.530 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:30:31.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.647+0000 7fddec8c9700 1 Processor -- start 2024-09-13T18:30:31.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.647+0000 7fddec8c9700 1 -- start start 2024-09-13T18:30:31.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.647+0000 7fddec8c9700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdde80712b0 0x7fdde8159f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.647+0000 7fddec8c9700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdde815a460 0x7fdde806c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.647+0000 7fddec8c9700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde815ac50 con 0x7fdde81573e0 2024-09-13T18:30:31.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.647+0000 7fddec8c9700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde80cc1b0 con 0x7fdde80712b0 2024-09-13T18:30:31.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.647+0000 7fddec8c9700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde80cb3f0 con 0x7fdde815a460 2024-09-13T18:30:31.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.647+0000 7fdde77fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fdde81573e0 0x7fdde8070ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46568/0 (socket says 172.21.15.44:46568) 2024-09-13T18:30:31.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.647+0000 7fdde77fe700 1 -- 172.21.15.44:0/1581197071 learned_addr learned my addr 172.21.15.44:0/1581197071 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:30:31.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.647+0000 7fdde6ffd700 1 --2- 172.21.15.44:0/1581197071 >> v2:172.21.15.44:3300/0 conn(0x7fdde80712b0 0x7fdde8159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.647+0000 7fdde7fff700 1 --2- 172.21.15.44:0/1581197071 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdde815a460 0x7fdde806c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.647+0000 7fdde6ffd700 1 -- 172.21.15.44:0/1581197071 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdde815a460 msgr2=0x7fdde806c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:31.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.647+0000 7fdde6ffd700 1 --2- 172.21.15.44:0/1581197071 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdde815a460 0x7fdde806c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.647+0000 7fdde6ffd700 1 -- 172.21.15.44:0/1581197071 >> v1:172.21.15.44:6789/0 conn(0x7fdde81573e0 legacy=0x7fdde8070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:31.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.647+0000 7fdde6ffd700 1 -- 172.21.15.44:0/1581197071 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde80cb6d0 con 0x7fdde80712b0 2024-09-13T18:30:31.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.647+0000 7fdde7fff700 1 --2- 172.21.15.44:0/1581197071 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdde815a460 0x7fdde806c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:31.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.647+0000 7fdde6ffd700 1 --2- 172.21.15.44:0/1581197071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdde80712b0 0x7fdde8159f20 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009850 tx=0x7fddd0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51819f92e45fc2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:31.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.647+0000 7fdde67fc700 1 -- 172.21.15.44:0/1581197071 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0011830 con 0x7fdde80712b0 2024-09-13T18:30:31.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.647+0000 7fdde67fc700 1 -- 172.21.15.44:0/1581197071 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd0011990 con 0x7fdde80712b0 2024-09-13T18:30:31.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.647+0000 7fdde67fc700 1 -- 172.21.15.44:0/1581197071 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0011d20 con 0x7fdde80712b0 2024-09-13T18:30:31.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fddec8c9700 1 -- 172.21.15.44:0/1581197071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdde80712b0 msgr2=0x7fdde8159f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:31.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fddec8c9700 1 --2- 172.21.15.44:0/1581197071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdde80712b0 0x7fdde8159f20 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009850 tx=0x7fddd0009b60 comp rx=0 tx=0).stop 2024-09-13T18:30:31.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fddec8c9700 1 -- 172.21.15.44:0/1581197071 shutdown_connections 2024-09-13T18:30:31.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fddec8c9700 1 --2- 172.21.15.44:0/1581197071 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdde815a460 0x7fdde806c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fddec8c9700 1 --2- 172.21.15.44:0/1581197071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdde80712b0 0x7fdde8159f20 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fddec8c9700 1 -- 172.21.15.44:0/1581197071 >> 172.21.15.44:0/1581197071 conn(0x7fdde80b0e10 msgr2=0x7fdde80b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:31.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fddec8c9700 1 -- 172.21.15.44:0/1581197071 shutdown_connections 2024-09-13T18:30:31.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fddec8c9700 1 -- 172.21.15.44:0/1581197071 wait complete. 2024-09-13T18:30:31.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fddec8c9700 1 Processor -- start 2024-09-13T18:30:31.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fddec8c9700 1 -- start start 2024-09-13T18:30:31.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fddec8c9700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdde80712b0 0x7fdde81f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fddec8c9700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdde81573e0 0x7fdde814f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fddec8c9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdde815a460 0x7fdde81535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fddec8c9700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde81f1e60 con 0x7fdde815a460 2024-09-13T18:30:31.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fddec8c9700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde814fa90 con 0x7fdde80712b0 2024-09-13T18:30:31.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fddec8c9700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde814fcf0 con 0x7fdde81573e0 2024-09-13T18:30:31.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fdde7fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdde815a460 0x7fdde81535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fdde7fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdde815a460 0x7fdde81535a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58796/0 (socket says 172.21.15.44:58796) 2024-09-13T18:30:31.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fdde7fff700 1 -- 172.21.15.44:0/1617411456 learned_addr learned my addr 172.21.15.44:0/1617411456 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:30:31.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fdde6ffd700 1 --2- 172.21.15.44:0/1617411456 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdde81573e0 0x7fdde814f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fdde77fe700 1 --2- 172.21.15.44:0/1617411456 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdde80712b0 0x7fdde81f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fdde7fff700 1 -- 172.21.15.44:0/1617411456 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdde81573e0 msgr2=0x7fdde814f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:31.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fdde7fff700 1 --2- 172.21.15.44:0/1617411456 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdde81573e0 0x7fdde814f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fdde7fff700 1 -- 172.21.15.44:0/1617411456 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdde80712b0 msgr2=0x7fdde81f1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:31.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fdde7fff700 1 --2- 172.21.15.44:0/1617411456 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdde80712b0 0x7fdde81f1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fdde7fff700 1 -- 172.21.15.44:0/1617411456 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd00094b0 con 0x7fdde815a460 2024-09-13T18:30:31.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.651+0000 7fdde7fff700 1 --2- 172.21.15.44:0/1617411456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdde815a460 0x7fdde81535a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fdde0007df0 tx=0x7fdde000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:31.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.655+0000 7fdddffff700 1 -- 172.21.15.44:0/1617411456 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde000ddd0 con 0x7fdde815a460 2024-09-13T18:30:31.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.655+0000 7fdddffff700 1 -- 172.21.15.44:0/1617411456 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde000f040 con 0x7fdde815a460 2024-09-13T18:30:31.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.655+0000 7fddec8c9700 1 -- 172.21.15.44:0/1617411456 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde814ffd0 con 0x7fdde815a460 2024-09-13T18:30:31.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.655+0000 7fdddffff700 1 -- 172.21.15.44:0/1617411456 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0003c80 con 0x7fdde815a460 2024-09-13T18:30:31.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.655+0000 7fddec8c9700 1 -- 172.21.15.44:0/1617411456 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde8150590 con 0x7fdde815a460 2024-09-13T18:30:31.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.655+0000 7fddec8c9700 1 -- 172.21.15.44:0/1617411456 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde806bce0 con 0x7fdde815a460 2024-09-13T18:30:31.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.655+0000 7fdddffff700 1 -- 172.21.15.44:0/1617411456 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdde0004030 con 0x7fdde815a460 2024-09-13T18:30:31.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.655+0000 7fdddffff700 1 --2- 172.21.15.44:0/1617411456 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fddc8066730 0x7fddc8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.655+0000 7fdddffff700 1 -- 172.21.15.44:0/1617411456 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fdde0084250 con 0x7fdde815a460 2024-09-13T18:30:31.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.659+0000 7fdde77fe700 1 --2- 172.21.15.44:0/1617411456 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fddc8066730 0x7fddc8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.659+0000 7fdde77fe700 1 --2- 172.21.15.44:0/1617411456 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fddc8066730 0x7fddc8068bf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fddd8005930 tx=0x7fddd8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:31.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.663+0000 7fdddffff700 1 -- 172.21.15.44:0/1617411456 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdde0051640 con 0x7fdde815a460 2024-09-13T18:30:31.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.835+0000 7fddec8c9700 1 -- 172.21.15.44:0/1617411456 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdde80cb080 con 0x7fdde815a460 2024-09-13T18:30:31.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.835+0000 7fdddffff700 1 -- 172.21.15.44:0/1617411456 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdde0054c60 con 0x7fdde815a460 2024-09-13T18:30:31.842 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:30:31.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.839+0000 7fddec8c9700 1 -- 172.21.15.44:0/1617411456 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fddc8066730 msgr2=0x7fddc8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:31.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.839+0000 7fddec8c9700 1 --2- 172.21.15.44:0/1617411456 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fddc8066730 0x7fddc8068bf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fddd8005930 tx=0x7fddd8009040 comp rx=0 tx=0).stop 2024-09-13T18:30:31.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.839+0000 7fddec8c9700 1 -- 172.21.15.44:0/1617411456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdde815a460 msgr2=0x7fdde81535a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:31.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.839+0000 7fddec8c9700 1 --2- 172.21.15.44:0/1617411456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdde815a460 0x7fdde81535a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fdde0007df0 tx=0x7fdde000d3b0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.839+0000 7fddec8c9700 1 -- 172.21.15.44:0/1617411456 shutdown_connections 2024-09-13T18:30:31.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.839+0000 7fddec8c9700 1 --2- 172.21.15.44:0/1617411456 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fddc8066730 0x7fddc8068bf0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.839+0000 7fddec8c9700 1 --2- 172.21.15.44:0/1617411456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdde815a460 0x7fdde81535a0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.839+0000 7fddec8c9700 1 --2- 172.21.15.44:0/1617411456 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdde81573e0 0x7fdde814f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.839+0000 7fddec8c9700 1 --2- 172.21.15.44:0/1617411456 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdde80712b0 0x7fdde81f1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.839+0000 7fddec8c9700 1 -- 172.21.15.44:0/1617411456 >> 172.21.15.44:0/1617411456 conn(0x7fdde80b0e10 msgr2=0x7fdde806aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:31.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.839+0000 7fddec8c9700 1 -- 172.21.15.44:0/1617411456 shutdown_connections 2024-09-13T18:30:31.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.839+0000 7fddec8c9700 1 -- 172.21.15.44:0/1617411456 wait complete. 2024-09-13T18:30:31.862 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:30:31.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.979+0000 7fe81be16700 1 Processor -- start 2024-09-13T18:30:31.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.979+0000 7fe81be16700 1 -- start start 2024-09-13T18:30:31.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.979+0000 7fe81be16700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe81415cda0 0x7fe8140d1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.979+0000 7fe81be16700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe8140b5e00 0x7fe8140b6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.979+0000 7fe81be16700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8140b6780 0x7fe81406a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.979+0000 7fe81be16700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8140cde50 con 0x7fe8140b5e00 2024-09-13T18:30:31.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.979+0000 7fe81be16700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8140d0880 con 0x7fe81415cda0 2024-09-13T18:30:31.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.979+0000 7fe81be16700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8140d16e0 con 0x7fe8140b6780 2024-09-13T18:30:31.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.979+0000 7fe8193b1700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe8140b5e00 0x7fe8140b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.979+0000 7fe8193b1700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe8140b5e00 0x7fe8140b6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36160/0 (socket says 172.21.15.44:36160) 2024-09-13T18:30:31.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.979+0000 7fe8193b1700 1 -- 172.21.15.44:0/1585115294 learned_addr learned my addr 172.21.15.44:0/1585115294 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:30:31.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.979+0000 7fe819bb2700 1 --2- 172.21.15.44:0/1585115294 >> v2:172.21.15.99:3300/0 conn(0x7fe81415cda0 0x7fe8140d1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.979+0000 7fe81a3b3700 1 --2- 172.21.15.44:0/1585115294 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8140b6780 0x7fe81406a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.979+0000 7fe8193b1700 1 -- 172.21.15.44:0/1585115294 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8140b6780 msgr2=0x7fe81406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:31.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.979+0000 7fe8193b1700 1 --2- 172.21.15.44:0/1585115294 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8140b6780 0x7fe81406a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.979+0000 7fe8193b1700 1 -- 172.21.15.44:0/1585115294 >> v2:172.21.15.99:3300/0 conn(0x7fe81415cda0 msgr2=0x7fe8140d1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:31.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.979+0000 7fe8193b1700 1 --2- 172.21.15.44:0/1585115294 >> v2:172.21.15.99:3300/0 conn(0x7fe81415cda0 0x7fe8140d1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.979+0000 7fe8193b1700 1 -- 172.21.15.44:0/1585115294 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8140d0ad0 con 0x7fe8140b5e00 2024-09-13T18:30:31.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.983+0000 7fe8193b1700 1 --2- 172.21.15.44:0/1585115294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8140b5e00 0x7fe8140b6240 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe8140d0830 tx=0x7fe804009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a98085a1c6dfaa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:31.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.983+0000 7fe818bb0700 1 -- 172.21.15.44:0/1585115294 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804011830 con 0x7fe8140b5e00 2024-09-13T18:30:31.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.983+0000 7fe818bb0700 1 -- 172.21.15.44:0/1585115294 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe804011990 con 0x7fe8140b5e00 2024-09-13T18:30:31.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.983+0000 7fe818bb0700 1 -- 172.21.15.44:0/1585115294 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804011d20 con 0x7fe8140b5e00 2024-09-13T18:30:31.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.983+0000 7fe81be16700 1 -- 172.21.15.44:0/1585115294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8140b5e00 msgr2=0x7fe8140b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:31.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.983+0000 7fe81be16700 1 --2- 172.21.15.44:0/1585115294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8140b5e00 0x7fe8140b6240 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe8140d0830 tx=0x7fe804009bf0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.983+0000 7fe81be16700 1 -- 172.21.15.44:0/1585115294 shutdown_connections 2024-09-13T18:30:31.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.983+0000 7fe81be16700 1 --2- 172.21.15.44:0/1585115294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8140b5e00 0x7fe8140b6240 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.983+0000 7fe81be16700 1 --2- 172.21.15.44:0/1585115294 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8140b6780 0x7fe81406a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.983+0000 7fe81be16700 1 --2- 172.21.15.44:0/1585115294 >> v2:172.21.15.99:3300/0 conn(0x7fe81415cda0 0x7fe8140d1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.983+0000 7fe81be16700 1 -- 172.21.15.44:0/1585115294 >> 172.21.15.44:0/1585115294 conn(0x7fe8140d2cb0 msgr2=0x7fe8140d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:31.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.983+0000 7fe81be16700 1 -- 172.21.15.44:0/1585115294 shutdown_connections 2024-09-13T18:30:31.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.983+0000 7fe81be16700 1 -- 172.21.15.44:0/1585115294 wait complete. 2024-09-13T18:30:31.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.987+0000 7fe81be16700 1 Processor -- start 2024-09-13T18:30:31.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.987+0000 7fe81be16700 1 -- start start 2024-09-13T18:30:31.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.987+0000 7fe81be16700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8140b5e00 0x7fe814152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.987+0000 7fe81be16700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8140b6780 0x7fe814156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.987+0000 7fe81be16700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe81415cda0 0x7fe814158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.987+0000 7fe81be16700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8141581e0 con 0x7fe8140b6780 2024-09-13T18:30:31.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.987+0000 7fe81be16700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8141575d0 con 0x7fe81415cda0 2024-09-13T18:30:31.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.987+0000 7fe81be16700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8141578b0 con 0x7fe8140b5e00 2024-09-13T18:30:31.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.987+0000 7fe8193b1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8140b6780 0x7fe814156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.987+0000 7fe8193b1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8140b6780 0x7fe814156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36176/0 (socket says 172.21.15.44:36176) 2024-09-13T18:30:31.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.987+0000 7fe8193b1700 1 -- 172.21.15.44:0/1896424769 learned_addr learned my addr 172.21.15.44:0/1896424769 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:30:31.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.987+0000 7fe81a3b3700 1 --2- 172.21.15.44:0/1896424769 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe81415cda0 0x7fe814158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.987+0000 7fe819bb2700 1 --2- 172.21.15.44:0/1896424769 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8140b5e00 0x7fe814152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.987+0000 7fe8193b1700 1 -- 172.21.15.44:0/1896424769 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8140b5e00 msgr2=0x7fe814152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:31.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.987+0000 7fe8193b1700 1 --2- 172.21.15.44:0/1896424769 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8140b5e00 0x7fe814152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.987+0000 7fe8193b1700 1 -- 172.21.15.44:0/1896424769 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe81415cda0 msgr2=0x7fe814158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:31.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.987+0000 7fe8193b1700 1 --2- 172.21.15.44:0/1896424769 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe81415cda0 0x7fe814158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.987+0000 7fe8193b1700 1 -- 172.21.15.44:0/1896424769 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe804009570 con 0x7fe8140b6780 2024-09-13T18:30:31.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.991+0000 7fe8193b1700 1 --2- 172.21.15.44:0/1896424769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8140b6780 0x7fe814156c60 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe804000c00 tx=0x7fe804004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:31.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.991+0000 7fe80a7fc700 1 -- 172.21.15.44:0/1896424769 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804004450 con 0x7fe8140b6780 2024-09-13T18:30:31.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.991+0000 7fe80a7fc700 1 -- 172.21.15.44:0/1896424769 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80401e070 con 0x7fe8140b6780 2024-09-13T18:30:31.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.991+0000 7fe81be16700 1 -- 172.21.15.44:0/1896424769 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe814157b90 con 0x7fe8140b6780 2024-09-13T18:30:31.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.991+0000 7fe80a7fc700 1 -- 172.21.15.44:0/1896424769 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804003900 con 0x7fe8140b6780 2024-09-13T18:30:31.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.991+0000 7fe81be16700 1 -- 172.21.15.44:0/1896424769 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8141533f0 con 0x7fe8140b6780 2024-09-13T18:30:31.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.991+0000 7fe81be16700 1 -- 172.21.15.44:0/1896424769 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe814158390 con 0x7fe8140b6780 2024-09-13T18:30:31.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.991+0000 7fe80a7fc700 1 -- 172.21.15.44:0/1896424769 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe804003a60 con 0x7fe8140b6780 2024-09-13T18:30:31.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.991+0000 7fe80a7fc700 1 --2- 172.21.15.44:0/1896424769 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe7f8066730 0x7fe7f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.991+0000 7fe80a7fc700 1 -- 172.21.15.44:0/1896424769 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe804020070 con 0x7fe8140b6780 2024-09-13T18:30:31.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.991+0000 7fe819bb2700 1 --2- 172.21.15.44:0/1896424769 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe7f8066730 0x7fe7f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.995+0000 7fe819bb2700 1 --2- 172.21.15.44:0/1896424769 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe7f8066730 0x7fe7f8068bf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe810009b70 tx=0x7fe810009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:32.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:31.999+0000 7fe80a7fc700 1 -- 172.21.15.44:0/1896424769 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe814158390 con 0x7fe8140b6780 2024-09-13T18:30:32.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.171+0000 7fe81be16700 1 -- 172.21.15.44:0/1896424769 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe8140b6240 con 0x7fe8140b6780 2024-09-13T18:30:32.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.171+0000 7fe80a7fc700 1 -- 172.21.15.44:0/1896424769 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe8040527a0 con 0x7fe8140b6780 2024-09-13T18:30:32.176 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:30:32.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.171+0000 7fe81be16700 1 -- 172.21.15.44:0/1896424769 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe7f8066730 msgr2=0x7fe7f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:32.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.171+0000 7fe81be16700 1 --2- 172.21.15.44:0/1896424769 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe7f8066730 0x7fe7f8068bf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe810009b70 tx=0x7fe810009240 comp rx=0 tx=0).stop 2024-09-13T18:30:32.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.171+0000 7fe81be16700 1 -- 172.21.15.44:0/1896424769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8140b6780 msgr2=0x7fe814156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:32.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.171+0000 7fe81be16700 1 --2- 172.21.15.44:0/1896424769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8140b6780 0x7fe814156c60 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe804000c00 tx=0x7fe804004770 comp rx=0 tx=0).stop 2024-09-13T18:30:32.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.171+0000 7fe81be16700 1 -- 172.21.15.44:0/1896424769 shutdown_connections 2024-09-13T18:30:32.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.171+0000 7fe81be16700 1 --2- 172.21.15.44:0/1896424769 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe7f8066730 0x7fe7f8068bf0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.171+0000 7fe81be16700 1 --2- 172.21.15.44:0/1896424769 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe81415cda0 0x7fe814158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.171+0000 7fe81be16700 1 --2- 172.21.15.44:0/1896424769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8140b6780 0x7fe814156c60 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.171+0000 7fe81be16700 1 --2- 172.21.15.44:0/1896424769 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8140b5e00 0x7fe814152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.171+0000 7fe81be16700 1 -- 172.21.15.44:0/1896424769 >> 172.21.15.44:0/1896424769 conn(0x7fe8140d2cb0 msgr2=0x7fe81415a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:32.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.175+0000 7fe81be16700 1 -- 172.21.15.44:0/1896424769 shutdown_connections 2024-09-13T18:30:32.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.175+0000 7fe81be16700 1 -- 172.21.15.44:0/1896424769 wait complete. 2024-09-13T18:30:32.192 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:30:32.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.307+0000 7fbd8d32f700 1 Processor -- start 2024-09-13T18:30:32.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.307+0000 7fbd8d32f700 1 -- start start 2024-09-13T18:30:32.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.307+0000 7fbd8d32f700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbd8815cda0 0x7fbd8806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:32.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.307+0000 7fbd8d32f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd8806a520 0x7fbd8806a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:32.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.307+0000 7fbd8d32f700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd880b8430 con 0x7fbd880ceb70 2024-09-13T18:30:32.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.307+0000 7fbd8d32f700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8806be40 con 0x7fbd8815cda0 2024-09-13T18:30:32.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.307+0000 7fbd8d32f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd880b64f0 con 0x7fbd8806a520 2024-09-13T18:30:32.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.307+0000 7fbd87fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbd8815cda0 0x7fbd8806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:32.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.307+0000 7fbd87fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbd8815cda0 0x7fbd8806b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36190/0 (socket says 172.21.15.44:36190) 2024-09-13T18:30:32.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.307+0000 7fbd87fff700 1 -- 172.21.15.44:0/3540205717 learned_addr learned my addr 172.21.15.44:0/3540205717 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:30:32.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.307+0000 7fbd8cb2e700 1 --2- 172.21.15.44:0/3540205717 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd8806a520 0x7fbd8806a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:32.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.307+0000 7fbd877fe700 1 -- 172.21.15.44:0/3540205717 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3355499843 0 0) 0x7fbd880b8430 con 0x7fbd880ceb70 2024-09-13T18:30:32.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.307+0000 7fbd877fe700 1 -- 172.21.15.44:0/3540205717 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd740035d0 con 0x7fbd880ceb70 2024-09-13T18:30:32.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.311+0000 7fbd87fff700 1 -- 172.21.15.44:0/3540205717 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd8806a520 msgr2=0x7fbd8806a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:32.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.311+0000 7fbd87fff700 1 --2- 172.21.15.44:0/3540205717 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd8806a520 0x7fbd8806a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.311+0000 7fbd87fff700 1 -- 172.21.15.44:0/3540205717 >> v1:172.21.15.99:6789/0 conn(0x7fbd880ceb70 legacy=0x7fbd880b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:32.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.311+0000 7fbd87fff700 1 -- 172.21.15.44:0/3540205717 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8806ae90 con 0x7fbd8815cda0 2024-09-13T18:30:32.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.311+0000 7fbd8cb2e700 1 --2- 172.21.15.44:0/3540205717 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd8806a520 0x7fbd8806a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:30:32.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.311+0000 7fbd87fff700 1 --2- 172.21.15.44:0/3540205717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd8815cda0 0x7fbd8806b900 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fbd78009910 tx=0x7fbd78009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b56674efdf2c5e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:32.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.311+0000 7fbd877fe700 1 -- 172.21.15.44:0/3540205717 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd78011830 con 0x7fbd8815cda0 2024-09-13T18:30:32.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.311+0000 7fbd877fe700 1 -- 172.21.15.44:0/3540205717 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd78011990 con 0x7fbd8815cda0 2024-09-13T18:30:32.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.311+0000 7fbd877fe700 1 -- 172.21.15.44:0/3540205717 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd78011d00 con 0x7fbd8815cda0 2024-09-13T18:30:32.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.311+0000 7fbd8d32f700 1 -- 172.21.15.44:0/3540205717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd8815cda0 msgr2=0x7fbd8806b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:32.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.311+0000 7fbd8d32f700 1 --2- 172.21.15.44:0/3540205717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd8815cda0 0x7fbd8806b900 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fbd78009910 tx=0x7fbd78009c20 comp rx=0 tx=0).stop 2024-09-13T18:30:32.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.311+0000 7fbd8d32f700 1 -- 172.21.15.44:0/3540205717 shutdown_connections 2024-09-13T18:30:32.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.311+0000 7fbd8d32f700 1 --2- 172.21.15.44:0/3540205717 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd8806a520 0x7fbd8806a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.311+0000 7fbd8d32f700 1 --2- 172.21.15.44:0/3540205717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd8815cda0 0x7fbd8806b900 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.311+0000 7fbd8d32f700 1 -- 172.21.15.44:0/3540205717 >> 172.21.15.44:0/3540205717 conn(0x7fbd880d2cb0 msgr2=0x7fbd880d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:32.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.311+0000 7fbd8d32f700 1 -- 172.21.15.44:0/3540205717 shutdown_connections 2024-09-13T18:30:32.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.311+0000 7fbd8d32f700 1 -- 172.21.15.44:0/3540205717 wait complete. 2024-09-13T18:30:32.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.315+0000 7fbd8d32f700 1 Processor -- start 2024-09-13T18:30:32.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.315+0000 7fbd8d32f700 1 -- start start 2024-09-13T18:30:32.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.315+0000 7fbd8d32f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd8806a520 0x7fbd881568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:32.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.315+0000 7fbd8d32f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd880ceb70 0x7fbd881f59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:32.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.315+0000 7fbd8d32f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd8815cda0 0x7fbd881f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:32.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.315+0000 7fbd8d32f700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd881f22d0 con 0x7fbd8806a520 2024-09-13T18:30:32.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.315+0000 7fbd8d32f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd880c7050 con 0x7fbd8815cda0 2024-09-13T18:30:32.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.315+0000 7fbd8d32f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd88157210 con 0x7fbd880ceb70 2024-09-13T18:30:32.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.315+0000 7fbd87fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd8806a520 0x7fbd881568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:32.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.315+0000 7fbd87fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd8806a520 0x7fbd881568e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36194/0 (socket says 172.21.15.44:36194) 2024-09-13T18:30:32.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.315+0000 7fbd87fff700 1 -- 172.21.15.44:0/780008495 learned_addr learned my addr 172.21.15.44:0/780008495 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:30:32.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.315+0000 7fbd7ffff700 1 --2- 172.21.15.44:0/780008495 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd880ceb70 0x7fbd881f59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:32.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.315+0000 7fbd8cb2e700 1 --2- 172.21.15.44:0/780008495 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd8815cda0 0x7fbd881f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:32.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.319+0000 7fbd87fff700 1 -- 172.21.15.44:0/780008495 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd880ceb70 msgr2=0x7fbd881f59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:32.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.319+0000 7fbd87fff700 1 --2- 172.21.15.44:0/780008495 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd880ceb70 0x7fbd881f59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.319+0000 7fbd87fff700 1 -- 172.21.15.44:0/780008495 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd8815cda0 msgr2=0x7fbd881f5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:32.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.319+0000 7fbd87fff700 1 --2- 172.21.15.44:0/780008495 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd8815cda0 0x7fbd881f5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.319+0000 7fbd87fff700 1 -- 172.21.15.44:0/780008495 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd80009a70 con 0x7fbd8806a520 2024-09-13T18:30:32.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.319+0000 7fbd8cb2e700 1 --2- 172.21.15.44:0/780008495 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd8815cda0 0x7fbd881f5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:32.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.319+0000 7fbd7ffff700 1 --2- 172.21.15.44:0/780008495 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd880ceb70 0x7fbd881f59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:32.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.319+0000 7fbd87fff700 1 --2- 172.21.15.44:0/780008495 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd8806a520 0x7fbd881568e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fbd880b85c0 tx=0x7fbd78004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:32.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.319+0000 7fbd857fa700 1 -- 172.21.15.44:0/780008495 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd78004510 con 0x7fbd8806a520 2024-09-13T18:30:32.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.319+0000 7fbd857fa700 1 -- 172.21.15.44:0/780008495 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7801e070 con 0x7fbd8806a520 2024-09-13T18:30:32.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.319+0000 7fbd8d32f700 1 -- 172.21.15.44:0/780008495 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd78009570 con 0x7fbd8806a520 2024-09-13T18:30:32.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.319+0000 7fbd857fa700 1 -- 172.21.15.44:0/780008495 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd780038e0 con 0x7fbd8806a520 2024-09-13T18:30:32.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.319+0000 7fbd8d32f700 1 -- 172.21.15.44:0/780008495 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd881577d0 con 0x7fbd8806a520 2024-09-13T18:30:32.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.319+0000 7fbd8d32f700 1 -- 172.21.15.44:0/780008495 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd880d1120 con 0x7fbd8806a520 2024-09-13T18:30:32.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.323+0000 7fbd857fa700 1 -- 172.21.15.44:0/780008495 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbd78003a40 con 0x7fbd8806a520 2024-09-13T18:30:32.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.323+0000 7fbd857fa700 1 --2- 172.21.15.44:0/780008495 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbd68066780 0x7fbd68068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:32.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.323+0000 7fbd857fa700 1 -- 172.21.15.44:0/780008495 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fbd78020070 con 0x7fbd8806a520 2024-09-13T18:30:32.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.323+0000 7fbd7ffff700 1 --2- 172.21.15.44:0/780008495 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbd68066780 0x7fbd68068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:32.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.323+0000 7fbd7ffff700 1 --2- 172.21.15.44:0/780008495 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbd68066780 0x7fbd68068c40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbd88144a80 tx=0x7fbd70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:32.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.331+0000 7fbd857fa700 1 -- 172.21.15.44:0/780008495 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbd780529b0 con 0x7fbd8806a520 2024-09-13T18:30:32.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.499+0000 7fbd8d32f700 1 -- 172.21.15.44:0/780008495 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd880b5f80 con 0x7fbd8806a520 2024-09-13T18:30:32.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.499+0000 7fbd857fa700 1 -- 172.21.15.44:0/780008495 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbd78055fd0 con 0x7fbd8806a520 2024-09-13T18:30:32.504 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:30:32.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.499+0000 7fbd8d32f700 1 -- 172.21.15.44:0/780008495 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbd68066780 msgr2=0x7fbd68068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:32.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.499+0000 7fbd8d32f700 1 --2- 172.21.15.44:0/780008495 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbd68066780 0x7fbd68068c40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbd88144a80 tx=0x7fbd70009040 comp rx=0 tx=0).stop 2024-09-13T18:30:32.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.499+0000 7fbd8d32f700 1 -- 172.21.15.44:0/780008495 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd8806a520 msgr2=0x7fbd881568e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:32.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.499+0000 7fbd8d32f700 1 --2- 172.21.15.44:0/780008495 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd8806a520 0x7fbd881568e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fbd880b85c0 tx=0x7fbd78004770 comp rx=0 tx=0).stop 2024-09-13T18:30:32.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.499+0000 7fbd8d32f700 1 -- 172.21.15.44:0/780008495 shutdown_connections 2024-09-13T18:30:32.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.499+0000 7fbd8d32f700 1 --2- 172.21.15.44:0/780008495 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbd68066780 0x7fbd68068c40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.499+0000 7fbd8d32f700 1 --2- 172.21.15.44:0/780008495 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd8815cda0 0x7fbd881f5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.499+0000 7fbd8d32f700 1 --2- 172.21.15.44:0/780008495 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd880ceb70 0x7fbd881f59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.499+0000 7fbd8d32f700 1 --2- 172.21.15.44:0/780008495 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd8806a520 0x7fbd881568e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.499+0000 7fbd8d32f700 1 -- 172.21.15.44:0/780008495 >> 172.21.15.44:0/780008495 conn(0x7fbd880d2cb0 msgr2=0x7fbd880d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:32.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.499+0000 7fbd8d32f700 1 -- 172.21.15.44:0/780008495 shutdown_connections 2024-09-13T18:30:32.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.499+0000 7fbd8d32f700 1 -- 172.21.15.44:0/780008495 wait complete. 2024-09-13T18:30:32.520 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:30:32.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f69864f1700 1 Processor -- start 2024-09-13T18:30:32.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f69864f1700 1 -- start start 2024-09-13T18:30:32.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f69864f1700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69800cdc90 0x7f698006d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:32.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f69864f1700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6980144720 con 0x7f698006bdb0 2024-09-13T18:30:32.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f69864f1700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698006dd40 con 0x7f6980144340 2024-09-13T18:30:32.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f69864f1700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698006da60 con 0x7f69800cdc90 2024-09-13T18:30:32.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6985cf0700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f698006bdb0 0x7f698006fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42164/0 (socket says 172.21.15.44:42164) 2024-09-13T18:30:32.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6985cf0700 1 -- 172.21.15.44:0/3358829946 learned_addr learned my addr 172.21.15.44:0/3358829946 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:30:32.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6984cee700 1 --2- 172.21.15.44:0/3358829946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69800cdc90 0x7f698006d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:32.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6977fff700 1 -- 172.21.15.44:0/3358829946 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159274274 0 0) 0x7f6980144720 con 0x7f698006bdb0 2024-09-13T18:30:32.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6977fff700 1 -- 172.21.15.44:0/3358829946 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f696c0035d0 con 0x7f698006bdb0 2024-09-13T18:30:32.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6977fff700 1 -- 172.21.15.44:0/3358829946 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760300092 0 0) 0x7f698006dd40 con 0x7f6980144340 2024-09-13T18:30:32.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6977fff700 1 -- 172.21.15.44:0/3358829946 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6980144720 con 0x7f6980144340 2024-09-13T18:30:32.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6977fff700 1 -- 172.21.15.44:0/3358829946 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 519885837 0 0) 0x7f696c0035d0 con 0x7f698006bdb0 2024-09-13T18:30:32.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6977fff700 1 -- 172.21.15.44:0/3358829946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69800cdc90 msgr2=0x7f698006d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:32.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6977fff700 1 --2- 172.21.15.44:0/3358829946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69800cdc90 0x7f698006d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6977fff700 1 -- 172.21.15.44:0/3358829946 >> v1:172.21.15.99:6789/0 conn(0x7f6980144340 legacy=0x7f69800cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:32.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6977fff700 1 -- 172.21.15.44:0/3358829946 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698015e660 con 0x7f698006bdb0 2024-09-13T18:30:32.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6977fff700 1 -- 172.21.15.44:0/3358829946 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f69780019f0 con 0x7f698006bdb0 2024-09-13T18:30:32.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6984cee700 1 --2- 172.21.15.44:0/3358829946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69800cdc90 0x7f698006d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:30:32.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6977fff700 1 -- 172.21.15.44:0/3358829946 >> v1:172.21.15.44:6789/0 conn(0x7f698006bdb0 legacy=0x7f698006fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:32.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6977fff700 1 --2- 172.21.15.44:0/3358829946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f696c003be0 0x7f696c003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:32.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6977fff700 1 --2- 172.21.15.44:0/3358829946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69800cdc90 0x7f696c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:32.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6977fff700 1 --2- 172.21.15.44:0/3358829946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f696c004db0 0x7f696c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:32.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6977fff700 1 -- 172.21.15.44:0/3358829946 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698006da60 con 0x7f696c003be0 2024-09-13T18:30:32.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6977fff700 1 -- 172.21.15.44:0/3358829946 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c00bb10 con 0x7f696c004db0 2024-09-13T18:30:32.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6977fff700 1 -- 172.21.15.44:0/3358829946 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696c00bcd0 con 0x7f69800cdc90 2024-09-13T18:30:32.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f69854ef700 1 --2- 172.21.15.44:0/3358829946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f696c003be0 0x7f696c003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:32.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6984cee700 1 --2- 172.21.15.44:0/3358829946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69800cdc90 0x7f696c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:32.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6985cf0700 1 --2- 172.21.15.44:0/3358829946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f696c004db0 0x7f696c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:32.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f69854ef700 1 -- 172.21.15.44:0/3358829946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69800cdc90 msgr2=0x7f696c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:32.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f69854ef700 1 --2- 172.21.15.44:0/3358829946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69800cdc90 0x7f696c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f69854ef700 1 -- 172.21.15.44:0/3358829946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f696c004db0 msgr2=0x7f696c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:32.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f69854ef700 1 --2- 172.21.15.44:0/3358829946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f696c004db0 0x7f696c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f69854ef700 1 -- 172.21.15.44:0/3358829946 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69700094b0 con 0x7f696c003be0 2024-09-13T18:30:32.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6984cee700 1 --2- 172.21.15.44:0/3358829946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69800cdc90 0x7f696c004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:32.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f69854ef700 1 --2- 172.21.15.44:0/3358829946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f696c003be0 0x7f696c003fc0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f697c001960 tx=0x7f696c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4081b76006566a84 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:32.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6977fff700 1 -- 172.21.15.44:0/3358829946 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c001450 con 0x7f696c003be0 2024-09-13T18:30:32.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6977fff700 1 -- 172.21.15.44:0/3358829946 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c0052f0 con 0x7f696c003be0 2024-09-13T18:30:32.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.627+0000 7f6977fff700 1 -- 172.21.15.44:0/3358829946 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c0036a0 con 0x7f696c003be0 2024-09-13T18:30:32.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.631+0000 7f69864f1700 1 -- 172.21.15.44:0/3358829946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f696c003be0 msgr2=0x7f696c003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:32.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.631+0000 7f69864f1700 1 --2- 172.21.15.44:0/3358829946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f696c003be0 0x7f696c003fc0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f697c001960 tx=0x7f696c0058a0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.631+0000 7f6985cf0700 1 -- 172.21.15.44:0/3358829946 reap_dead start 2024-09-13T18:30:32.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.631+0000 7f69864f1700 1 -- 172.21.15.44:0/3358829946 shutdown_connections 2024-09-13T18:30:32.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.631+0000 7f69864f1700 1 -- 172.21.15.44:0/3358829946 >> 172.21.15.44:0/3358829946 conn(0x7f69800b0e10 msgr2=0x7f69800b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:32.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.631+0000 7f69864f1700 1 -- 172.21.15.44:0/3358829946 shutdown_connections 2024-09-13T18:30:32.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.631+0000 7f69864f1700 1 -- 172.21.15.44:0/3358829946 wait complete. 2024-09-13T18:30:32.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.631+0000 7f69864f1700 1 Processor -- start 2024-09-13T18:30:32.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.631+0000 7f69864f1700 1 -- start start 2024-09-13T18:30:32.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.635+0000 7f69864f1700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f696c003be0 0x7f698013d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:32.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.635+0000 7f69864f1700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6980140160 0x7f69801405e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:32.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.635+0000 7f69864f1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69800ac270 0x7f69800ac6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:32.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.635+0000 7f69864f1700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6980140b20 con 0x7f69800ac270 2024-09-13T18:30:32.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.635+0000 7f69864f1700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698013d550 con 0x7f696c003be0 2024-09-13T18:30:32.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.635+0000 7f69864f1700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698013dab0 con 0x7f6980140160 2024-09-13T18:30:32.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.635+0000 7f6985cf0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69800ac270 0x7f69800ac6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:32.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.635+0000 7f6985cf0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69800ac270 0x7f69800ac6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36206/0 (socket says 172.21.15.44:36206) 2024-09-13T18:30:32.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.635+0000 7f6985cf0700 1 -- 172.21.15.44:0/2649989484 learned_addr learned my addr 172.21.15.44:0/2649989484 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:30:32.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.635+0000 7f69854ef700 1 --2- 172.21.15.44:0/2649989484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f696c003be0 0x7f698013d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:32.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.635+0000 7f6984cee700 1 --2- 172.21.15.44:0/2649989484 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6980140160 0x7f69801405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:32.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.635+0000 7f6985cf0700 1 -- 172.21.15.44:0/2649989484 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6980140160 msgr2=0x7f69801405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:32.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.635+0000 7f6985cf0700 1 --2- 172.21.15.44:0/2649989484 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6980140160 0x7f69801405e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.635+0000 7f6985cf0700 1 -- 172.21.15.44:0/2649989484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f696c003be0 msgr2=0x7f698013d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:32.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.635+0000 7f6985cf0700 1 --2- 172.21.15.44:0/2649989484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f696c003be0 0x7f698013d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.635+0000 7f6985cf0700 1 -- 172.21.15.44:0/2649989484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69800ad010 con 0x7f69800ac270 2024-09-13T18:30:32.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.635+0000 7f6985cf0700 1 --2- 172.21.15.44:0/2649989484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69800ac270 0x7f69800ac6f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6978001460 tx=0x7f69780089e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:32.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.635+0000 7f6975ffb700 1 -- 172.21.15.44:0/2649989484 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697800f5f0 con 0x7f69800ac270 2024-09-13T18:30:32.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.635+0000 7f6975ffb700 1 -- 172.21.15.44:0/2649989484 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697800f770 con 0x7f69800ac270 2024-09-13T18:30:32.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.635+0000 7f69864f1700 1 -- 172.21.15.44:0/2649989484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698013dd50 con 0x7f69800ac270 2024-09-13T18:30:32.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.635+0000 7f6975ffb700 1 -- 172.21.15.44:0/2649989484 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697800fb20 con 0x7f69800ac270 2024-09-13T18:30:32.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.635+0000 7f69864f1700 1 -- 172.21.15.44:0/2649989484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69800ad2f0 con 0x7f69800ac270 2024-09-13T18:30:32.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.635+0000 7f69864f1700 1 -- 172.21.15.44:0/2649989484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698013e270 con 0x7f69800ac270 2024-09-13T18:30:32.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.639+0000 7f6975ffb700 1 -- 172.21.15.44:0/2649989484 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f697800fc80 con 0x7f69800ac270 2024-09-13T18:30:32.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.639+0000 7f6975ffb700 1 --2- 172.21.15.44:0/2649989484 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6964066760 0x7f6964068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:32.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.639+0000 7f6975ffb700 1 -- 172.21.15.44:0/2649989484 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6978083c10 con 0x7f69800ac270 2024-09-13T18:30:32.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.639+0000 7f69854ef700 1 --2- 172.21.15.44:0/2649989484 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6964066760 0x7f6964068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:32.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.639+0000 7f69854ef700 1 --2- 172.21.15.44:0/2649989484 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6964066760 0x7f6964068c20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f697c015040 tx=0x7f697c00a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:32.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.647+0000 7f6975ffb700 1 -- 172.21.15.44:0/2649989484 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f698013e270 con 0x7f69800ac270 2024-09-13T18:30:32.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.835+0000 7f69864f1700 1 -- 172.21.15.44:0/2649989484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f698013e270 con 0x7f69800ac270 2024-09-13T18:30:32.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.835+0000 7f6975ffb700 1 -- 172.21.15.44:0/2649989484 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v50) v1 ==== 80+0+0 (secure 0 0 0) 0x7f698013e270 con 0x7f69800ac270 2024-09-13T18:30:32.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.839+0000 7f69864f1700 1 -- 172.21.15.44:0/2649989484 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6964066760 msgr2=0x7f6964068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:32.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.839+0000 7f69864f1700 1 --2- 172.21.15.44:0/2649989484 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6964066760 0x7f6964068c20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f697c015040 tx=0x7f697c00a000 comp rx=0 tx=0).stop 2024-09-13T18:30:32.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.839+0000 7f69864f1700 1 -- 172.21.15.44:0/2649989484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69800ac270 msgr2=0x7f69800ac6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:32.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.839+0000 7f69864f1700 1 --2- 172.21.15.44:0/2649989484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69800ac270 0x7f69800ac6f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6978001460 tx=0x7f69780089e0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.839+0000 7f69864f1700 1 -- 172.21.15.44:0/2649989484 shutdown_connections 2024-09-13T18:30:32.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.839+0000 7f69864f1700 1 --2- 172.21.15.44:0/2649989484 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6964066760 0x7f6964068c20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.839+0000 7f69864f1700 1 --2- 172.21.15.44:0/2649989484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69800ac270 0x7f69800ac6f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.839+0000 7f69864f1700 1 --2- 172.21.15.44:0/2649989484 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6980140160 0x7f69801405e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.839+0000 7f69864f1700 1 --2- 172.21.15.44:0/2649989484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f696c003be0 0x7f698013d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.839+0000 7f69864f1700 1 -- 172.21.15.44:0/2649989484 >> 172.21.15.44:0/2649989484 conn(0x7f69800b0e10 msgr2=0x7f698006fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:32.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.839+0000 7f69864f1700 1 -- 172.21.15.44:0/2649989484 shutdown_connections 2024-09-13T18:30:32.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.839+0000 7f69864f1700 1 -- 172.21.15.44:0/2649989484 wait complete. 2024-09-13T18:30:32.847 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-13T18:30:32.862 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:30:32.862 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:30:32.868 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:30:32.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.979+0000 7f5eed849700 1 Processor -- start 2024-09-13T18:30:32.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.979+0000 7f5eed849700 1 -- start start 2024-09-13T18:30:32.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.979+0000 7f5eed849700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ee815cd80 0x7f5ee806baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:32.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.979+0000 7f5eed849700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5ee806b170 0x7f5ee80ce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:32.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.979+0000 7f5eed849700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee815d160 con 0x7f5ee806a640 2024-09-13T18:30:32.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.979+0000 7f5eed849700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee80d1570 con 0x7f5ee806b170 2024-09-13T18:30:32.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.979+0000 7f5eed849700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80d25b0 con 0x7f5ee815cd80 2024-09-13T18:30:32.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.979+0000 7f5eed048700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5ee806b170 0x7f5ee80ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:32.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.979+0000 7f5eed048700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5ee806b170 0x7f5ee80ce240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36210/0 (socket says 172.21.15.44:36210) 2024-09-13T18:30:32.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.979+0000 7f5eed048700 1 -- 172.21.15.44:0/2704723197 learned_addr learned my addr 172.21.15.44:0/2704723197 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:30:32.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.979+0000 7f5eec847700 1 --2- 172.21.15.44:0/2704723197 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ee815cd80 0x7f5ee806baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:32.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.983+0000 7f5eed048700 1 -- 172.21.15.44:0/2704723197 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ee815cd80 msgr2=0x7f5ee806baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:32.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.983+0000 7f5eed048700 1 --2- 172.21.15.44:0/2704723197 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ee815cd80 0x7f5ee806baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.983+0000 7f5eed048700 1 -- 172.21.15.44:0/2704723197 >> v1:172.21.15.99:6789/0 conn(0x7f5ee806a640 legacy=0x7f5ee806aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:32.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.983+0000 7f5eed048700 1 -- 172.21.15.44:0/2704723197 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee80d2120 con 0x7f5ee806b170 2024-09-13T18:30:32.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.983+0000 7f5eed048700 1 --2- 172.21.15.44:0/2704723197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ee806b170 0x7f5ee80ce240 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009e50 tx=0x7f5ee000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=630833b752d745b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:32.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.983+0000 7f5ee77fe700 1 -- 172.21.15.44:0/2704723197 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee000e070 con 0x7f5ee806b170 2024-09-13T18:30:32.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.983+0000 7f5ee77fe700 1 -- 172.21.15.44:0/2704723197 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee000b910 con 0x7f5ee806b170 2024-09-13T18:30:32.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.983+0000 7f5ee77fe700 1 -- 172.21.15.44:0/2704723197 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee000bcc0 con 0x7f5ee806b170 2024-09-13T18:30:32.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.983+0000 7f5eed849700 1 -- 172.21.15.44:0/2704723197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ee806b170 msgr2=0x7f5ee80ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:32.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.983+0000 7f5eed849700 1 --2- 172.21.15.44:0/2704723197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ee806b170 0x7f5ee80ce240 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009e50 tx=0x7f5ee000b330 comp rx=0 tx=0).stop 2024-09-13T18:30:32.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.983+0000 7f5eed849700 1 -- 172.21.15.44:0/2704723197 shutdown_connections 2024-09-13T18:30:32.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.983+0000 7f5eed849700 1 --2- 172.21.15.44:0/2704723197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ee806b170 0x7f5ee80ce240 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.983+0000 7f5eed849700 1 --2- 172.21.15.44:0/2704723197 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ee815cd80 0x7f5ee806baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.983+0000 7f5eed849700 1 -- 172.21.15.44:0/2704723197 >> 172.21.15.44:0/2704723197 conn(0x7f5ee80d30b0 msgr2=0x7f5ee80d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:32.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.983+0000 7f5eed849700 1 -- 172.21.15.44:0/2704723197 shutdown_connections 2024-09-13T18:30:32.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.983+0000 7f5eed849700 1 -- 172.21.15.44:0/2704723197 wait complete. 2024-09-13T18:30:32.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.983+0000 7f5eed849700 1 Processor -- start 2024-09-13T18:30:32.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.987+0000 7f5eed849700 1 -- start start 2024-09-13T18:30:32.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.987+0000 7f5eed849700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ee806a640 0x7f5ee814af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:32.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.987+0000 7f5eed849700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ee806b170 0x7f5ee81e7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:32.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.987+0000 7f5eed849700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ee815cd80 0x7f5ee80b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:32.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.987+0000 7f5eed849700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee81e6d70 con 0x7f5ee815cd80 2024-09-13T18:30:32.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.987+0000 7f5eed849700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee81e7050 con 0x7f5ee806a640 2024-09-13T18:30:32.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.987+0000 7f5eed849700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee81e7330 con 0x7f5ee806b170 2024-09-13T18:30:32.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.987+0000 7f5eed048700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ee815cd80 0x7f5ee80b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:32.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.987+0000 7f5eed048700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ee815cd80 0x7f5ee80b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36220/0 (socket says 172.21.15.44:36220) 2024-09-13T18:30:32.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.987+0000 7f5eed048700 1 -- 172.21.15.44:0/823528830 learned_addr learned my addr 172.21.15.44:0/823528830 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:30:32.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.987+0000 7f5eec847700 1 --2- 172.21.15.44:0/823528830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ee806a640 0x7f5ee814af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:32.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.987+0000 7f5ee7fff700 1 --2- 172.21.15.44:0/823528830 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ee806b170 0x7f5ee81e7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:32.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.987+0000 7f5eed048700 1 -- 172.21.15.44:0/823528830 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ee806b170 msgr2=0x7f5ee81e7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:32.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.987+0000 7f5eed048700 1 --2- 172.21.15.44:0/823528830 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ee806b170 0x7f5ee81e7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.987+0000 7f5eed048700 1 -- 172.21.15.44:0/823528830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ee806a640 msgr2=0x7f5ee814af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:32.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.987+0000 7f5eed048700 1 --2- 172.21.15.44:0/823528830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ee806a640 0x7f5ee814af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:32.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.987+0000 7f5eed048700 1 -- 172.21.15.44:0/823528830 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee0009b30 con 0x7f5ee815cd80 2024-09-13T18:30:32.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.987+0000 7f5eed048700 1 --2- 172.21.15.44:0/823528830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ee815cd80 0x7f5ee80b3940 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0012000 tx=0x7f5ee0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:32.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.987+0000 7f5ee57fa700 1 -- 172.21.15.44:0/823528830 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee00048c0 con 0x7f5ee815cd80 2024-09-13T18:30:32.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.987+0000 7f5ee57fa700 1 -- 172.21.15.44:0/823528830 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee00092e0 con 0x7f5ee815cd80 2024-09-13T18:30:32.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.987+0000 7f5eed849700 1 -- 172.21.15.44:0/823528830 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee81e7610 con 0x7f5ee815cd80 2024-09-13T18:30:32.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.987+0000 7f5ee57fa700 1 -- 172.21.15.44:0/823528830 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee001c660 con 0x7f5ee815cd80 2024-09-13T18:30:32.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.987+0000 7f5eed849700 1 -- 172.21.15.44:0/823528830 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee814b4c0 con 0x7f5ee815cd80 2024-09-13T18:30:32.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.991+0000 7f5ee57fa700 1 -- 172.21.15.44:0/823528830 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5ee001c7c0 con 0x7f5ee815cd80 2024-09-13T18:30:32.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.991+0000 7f5ee57fa700 1 --2- 172.21.15.44:0/823528830 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5ed4066730 0x7f5ed4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:32.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.991+0000 7f5ee57fa700 1 -- 172.21.15.44:0/823528830 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5ee00856c0 con 0x7f5ee815cd80 2024-09-13T18:30:32.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.991+0000 7f5eec847700 1 --2- 172.21.15.44:0/823528830 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5ed4066730 0x7f5ed4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:32.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.991+0000 7f5eed849700 1 -- 172.21.15.44:0/823528830 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee806baa0 con 0x7f5ee815cd80 2024-09-13T18:30:33.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.991+0000 7f5eec847700 1 --2- 172.21.15.44:0/823528830 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5ed4066730 0x7f5ed4068bf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009b50 tx=0x7f5edc009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:33.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:32.999+0000 7f5ee57fa700 1 -- 172.21.15.44:0/823528830 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5ee00529f0 con 0x7f5ee815cd80 2024-09-13T18:30:33.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.183+0000 7f5eed849700 1 -- 172.21.15.44:0/823528830 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ee80d3630 con 0x7f5ee815cd80 2024-09-13T18:30:33.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.183+0000 7f5ee57fa700 1 -- 172.21.15.44:0/823528830 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f5ee0056010 con 0x7f5ee815cd80 2024-09-13T18:30:33.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:30:33.190 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":50,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:29:43.702475+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:29:08.754284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:29:09.262346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.1b","mappings":[{"from":0,"to":5}]},{"pgid":"7.3c","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:30:33.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.187+0000 7f5eed849700 1 -- 172.21.15.44:0/823528830 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5ed4066730 msgr2=0x7f5ed4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:33.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.187+0000 7f5eed849700 1 --2- 172.21.15.44:0/823528830 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5ed4066730 0x7f5ed4068bf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009b50 tx=0x7f5edc009240 comp rx=0 tx=0).stop 2024-09-13T18:30:33.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.187+0000 7f5eed849700 1 -- 172.21.15.44:0/823528830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ee815cd80 msgr2=0x7f5ee80b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:33.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.187+0000 7f5eed849700 1 --2- 172.21.15.44:0/823528830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ee815cd80 0x7f5ee80b3940 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0012000 tx=0x7f5ee0004af0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.187+0000 7f5eed849700 1 -- 172.21.15.44:0/823528830 shutdown_connections 2024-09-13T18:30:33.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.187+0000 7f5eed849700 1 --2- 172.21.15.44:0/823528830 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5ed4066730 0x7f5ed4068bf0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.187+0000 7f5eed849700 1 --2- 172.21.15.44:0/823528830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ee815cd80 0x7f5ee80b3940 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.187+0000 7f5eed849700 1 --2- 172.21.15.44:0/823528830 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ee806b170 0x7f5ee81e7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.187+0000 7f5eed849700 1 --2- 172.21.15.44:0/823528830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ee806a640 0x7f5ee814af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.187+0000 7f5eed849700 1 -- 172.21.15.44:0/823528830 >> 172.21.15.44:0/823528830 conn(0x7f5ee80d30b0 msgr2=0x7f5ee815f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:33.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.187+0000 7f5eed849700 1 -- 172.21.15.44:0/823528830 shutdown_connections 2024-09-13T18:30:33.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.187+0000 7f5eed849700 1 -- 172.21.15.44:0/823528830 wait complete. 2024-09-13T18:30:33.210 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:29:08.754284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:29:09.262346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:30:33.210 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:30:33.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.323+0000 7f782bfff700 1 Processor -- start 2024-09-13T18:30:33.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.323+0000 7f782bfff700 1 -- start start 2024-09-13T18:30:33.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.323+0000 7f782bfff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f782c070bf0 0x7f782c0b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:33.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.323+0000 7f782bfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f782c06d4e0 0x7f782c072120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:33.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.323+0000 7f782bfff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782c072660 con 0x7f782c159760 2024-09-13T18:30:33.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.323+0000 7f782bfff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782c071d00 con 0x7f782c070bf0 2024-09-13T18:30:33.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.323+0000 7f782bfff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782c071080 con 0x7f782c06d4e0 2024-09-13T18:30:33.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.323+0000 7f782a7fc700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f782c070bf0 0x7f782c0b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:33.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.323+0000 7f782a7fc700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f782c070bf0 0x7f782c0b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36224/0 (socket says 172.21.15.44:36224) 2024-09-13T18:30:33.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.323+0000 7f782a7fc700 1 -- 172.21.15.44:0/2574628872 learned_addr learned my addr 172.21.15.44:0/2574628872 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:30:33.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.323+0000 7f782affd700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f782c159760 0x7f782c06cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:43080/0 (socket says 172.21.15.44:43080) 2024-09-13T18:30:33.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.323+0000 7f782b7fe700 1 --2- 172.21.15.44:0/2574628872 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f782c06d4e0 0x7f782c072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:33.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.323+0000 7f782a7fc700 1 -- 172.21.15.44:0/2574628872 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f782c06d4e0 msgr2=0x7f782c072120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:33.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.323+0000 7f782a7fc700 1 --2- 172.21.15.44:0/2574628872 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f782c06d4e0 0x7f782c072120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.323+0000 7f782a7fc700 1 -- 172.21.15.44:0/2574628872 >> v1:172.21.15.99:6789/0 conn(0x7f782c159760 legacy=0x7f782c06cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:33.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.323+0000 7f782a7fc700 1 -- 172.21.15.44:0/2574628872 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782c071360 con 0x7f782c070bf0 2024-09-13T18:30:33.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.323+0000 7f782a7fc700 1 --2- 172.21.15.44:0/2574628872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f782c070bf0 0x7f782c0b46a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7820009910 tx=0x7f7820009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f425fb2f02877528 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:33.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.323+0000 7f7829ffb700 1 -- 172.21.15.44:0/2574628872 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7820011830 con 0x7f782c070bf0 2024-09-13T18:30:33.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.323+0000 7f7829ffb700 1 -- 172.21.15.44:0/2574628872 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7820011990 con 0x7f782c070bf0 2024-09-13T18:30:33.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.323+0000 7f7829ffb700 1 -- 172.21.15.44:0/2574628872 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7820011d40 con 0x7f782c070bf0 2024-09-13T18:30:33.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.327+0000 7f782bfff700 1 -- 172.21.15.44:0/2574628872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f782c070bf0 msgr2=0x7f782c0b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:33.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.327+0000 7f782bfff700 1 --2- 172.21.15.44:0/2574628872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f782c070bf0 0x7f782c0b46a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7820009910 tx=0x7f7820009c20 comp rx=0 tx=0).stop 2024-09-13T18:30:33.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.327+0000 7f782bfff700 1 -- 172.21.15.44:0/2574628872 shutdown_connections 2024-09-13T18:30:33.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.327+0000 7f782bfff700 1 --2- 172.21.15.44:0/2574628872 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f782c06d4e0 0x7f782c072120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.327+0000 7f782bfff700 1 --2- 172.21.15.44:0/2574628872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f782c070bf0 0x7f782c0b46a0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.327+0000 7f782bfff700 1 -- 172.21.15.44:0/2574628872 >> 172.21.15.44:0/2574628872 conn(0x7f782c0b1810 msgr2=0x7f782c0b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:33.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.327+0000 7f782bfff700 1 -- 172.21.15.44:0/2574628872 shutdown_connections 2024-09-13T18:30:33.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.327+0000 7f782bfff700 1 -- 172.21.15.44:0/2574628872 wait complete. 2024-09-13T18:30:33.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.327+0000 7f782bfff700 1 Processor -- start 2024-09-13T18:30:33.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.327+0000 7f782bfff700 1 -- start start 2024-09-13T18:30:33.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.331+0000 7f782bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f782c06d4e0 0x7f782c1ec500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:33.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.331+0000 7f782bfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f782c159760 0x7f782c1f2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:33.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.331+0000 7f782bfff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f782c1eeef0 0x7f782c141d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:33.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.331+0000 7f782bfff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c1f3490 con 0x7f782c06d4e0 2024-09-13T18:30:33.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.331+0000 7f782bfff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c141a70 con 0x7f782c1eeef0 2024-09-13T18:30:33.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.331+0000 7f782bfff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782c142250 con 0x7f782c159760 2024-09-13T18:30:33.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.331+0000 7f782affd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f782c06d4e0 0x7f782c1ec500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:33.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.331+0000 7f782affd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f782c06d4e0 0x7f782c1ec500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36232/0 (socket says 172.21.15.44:36232) 2024-09-13T18:30:33.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.331+0000 7f782affd700 1 -- 172.21.15.44:0/645202905 learned_addr learned my addr 172.21.15.44:0/645202905 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:30:33.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.331+0000 7f782b7fe700 1 --2- 172.21.15.44:0/645202905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f782c1eeef0 0x7f782c141d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:33.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.331+0000 7f782a7fc700 1 --2- 172.21.15.44:0/645202905 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f782c159760 0x7f782c1f2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:33.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.331+0000 7f782affd700 1 -- 172.21.15.44:0/645202905 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f782c159760 msgr2=0x7f782c1f2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:33.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.331+0000 7f782affd700 1 --2- 172.21.15.44:0/645202905 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f782c159760 0x7f782c1f2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.331+0000 7f782affd700 1 -- 172.21.15.44:0/645202905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f782c1eeef0 msgr2=0x7f782c141d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:33.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.331+0000 7f782affd700 1 --2- 172.21.15.44:0/645202905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f782c1eeef0 0x7f782c141d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.331+0000 7f782affd700 1 -- 172.21.15.44:0/645202905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7820009570 con 0x7f782c06d4e0 2024-09-13T18:30:33.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.331+0000 7f782affd700 1 --2- 172.21.15.44:0/645202905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f782c06d4e0 0x7f782c1ec500 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f781c00e700 tx=0x7f781c00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:33.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.331+0000 7f7813fff700 1 -- 172.21.15.44:0/645202905 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c005cd0 con 0x7f782c06d4e0 2024-09-13T18:30:33.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.331+0000 7f7813fff700 1 -- 172.21.15.44:0/645202905 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781c005e30 con 0x7f782c06d4e0 2024-09-13T18:30:33.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.331+0000 7f782bfff700 1 -- 172.21.15.44:0/645202905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782c1ef380 con 0x7f782c06d4e0 2024-09-13T18:30:33.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.331+0000 7f7813fff700 1 -- 172.21.15.44:0/645202905 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c0072b0 con 0x7f782c06d4e0 2024-09-13T18:30:33.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.331+0000 7f782bfff700 1 -- 172.21.15.44:0/645202905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782c1ef940 con 0x7f782c06d4e0 2024-09-13T18:30:33.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.335+0000 7f782bfff700 1 -- 172.21.15.44:0/645202905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782c15ae30 con 0x7f782c06d4e0 2024-09-13T18:30:33.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.335+0000 7f7813fff700 1 -- 172.21.15.44:0/645202905 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f781c007410 con 0x7f782c06d4e0 2024-09-13T18:30:33.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.335+0000 7f7813fff700 1 --2- 172.21.15.44:0/645202905 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7818066730 0x7f7818068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:33.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.335+0000 7f7813fff700 1 -- 172.21.15.44:0/645202905 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f781c086220 con 0x7f782c06d4e0 2024-09-13T18:30:33.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.335+0000 7f782a7fc700 1 --2- 172.21.15.44:0/645202905 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7818066730 0x7f7818068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:33.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.335+0000 7f782a7fc700 1 --2- 172.21.15.44:0/645202905 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7818066730 0x7f7818068bf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7820000c00 tx=0x7f7820008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:33.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.339+0000 7f7813fff700 1 -- 172.21.15.44:0/645202905 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f781c053550 con 0x7f782c06d4e0 2024-09-13T18:30:33.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.515+0000 7f782bfff700 1 -- 172.21.15.44:0/645202905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f782c143d70 con 0x7f782c06d4e0 2024-09-13T18:30:33.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.515+0000 7f7813fff700 1 -- 172.21.15.44:0/645202905 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f781c056b70 con 0x7f782c06d4e0 2024-09-13T18:30:33.521 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:30:33.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.515+0000 7f782bfff700 1 -- 172.21.15.44:0/645202905 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7818066730 msgr2=0x7f7818068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:33.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.515+0000 7f782bfff700 1 --2- 172.21.15.44:0/645202905 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7818066730 0x7f7818068bf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7820000c00 tx=0x7f7820008030 comp rx=0 tx=0).stop 2024-09-13T18:30:33.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.515+0000 7f782bfff700 1 -- 172.21.15.44:0/645202905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f782c06d4e0 msgr2=0x7f782c1ec500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:33.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.515+0000 7f782bfff700 1 --2- 172.21.15.44:0/645202905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f782c06d4e0 0x7f782c1ec500 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f781c00e700 tx=0x7f781c00ea10 comp rx=0 tx=0).stop 2024-09-13T18:30:33.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.515+0000 7f782bfff700 1 -- 172.21.15.44:0/645202905 shutdown_connections 2024-09-13T18:30:33.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.515+0000 7f782bfff700 1 --2- 172.21.15.44:0/645202905 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7818066730 0x7f7818068bf0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.515+0000 7f782bfff700 1 --2- 172.21.15.44:0/645202905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f782c1eeef0 0x7f782c141d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.515+0000 7f782bfff700 1 --2- 172.21.15.44:0/645202905 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f782c159760 0x7f782c1f2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.519+0000 7f782bfff700 1 --2- 172.21.15.44:0/645202905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f782c06d4e0 0x7f782c1ec500 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.519+0000 7f782bfff700 1 -- 172.21.15.44:0/645202905 >> 172.21.15.44:0/645202905 conn(0x7f782c0b1810 msgr2=0x7f782c06cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:33.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.519+0000 7f782bfff700 1 -- 172.21.15.44:0/645202905 shutdown_connections 2024-09-13T18:30:33.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.519+0000 7f782bfff700 1 -- 172.21.15.44:0/645202905 wait complete. 2024-09-13T18:30:33.536 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:30:33.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.651+0000 7f6a76ba2700 1 Processor -- start 2024-09-13T18:30:33.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.651+0000 7f6a76ba2700 1 -- start start 2024-09-13T18:30:33.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.651+0000 7f6a76ba2700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6a7015cda0 0x7f6a700d1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:33.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.651+0000 7f6a76ba2700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6a700b5e00 0x7f6a700b6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:33.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.651+0000 7f6a76ba2700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a700b6780 0x7f6a7006a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:33.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.651+0000 7f6a76ba2700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a700cde50 con 0x7f6a7015cda0 2024-09-13T18:30:33.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.651+0000 7f6a76ba2700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a700d0880 con 0x7f6a700b5e00 2024-09-13T18:30:33.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.651+0000 7f6a76ba2700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a700d16e0 con 0x7f6a700b6780 2024-09-13T18:30:33.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.651+0000 7f6a7493e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6a7015cda0 0x7f6a700d1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:33.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.651+0000 7f6a7513f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a700b6780 0x7f6a7006a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:33.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.651+0000 7f6a7493e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6a7015cda0 0x7f6a700d1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36242/0 (socket says 172.21.15.44:36242) 2024-09-13T18:30:33.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.651+0000 7f6a7493e700 1 -- 172.21.15.44:0/3771504304 learned_addr learned my addr 172.21.15.44:0/3771504304 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:30:33.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.651+0000 7f6a6ffff700 1 --2- 172.21.15.44:0/3771504304 >> v2:172.21.15.99:3300/0 conn(0x7f6a700b5e00 0x7f6a700b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:33.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.655+0000 7f6a7493e700 1 -- 172.21.15.44:0/3771504304 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a700b6780 msgr2=0x7f6a7006a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:33.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.655+0000 7f6a7493e700 1 --2- 172.21.15.44:0/3771504304 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a700b6780 0x7f6a7006a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.655+0000 7f6a7493e700 1 -- 172.21.15.44:0/3771504304 >> v2:172.21.15.99:3300/0 conn(0x7f6a700b5e00 msgr2=0x7f6a700b6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:33.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.655+0000 7f6a7493e700 1 --2- 172.21.15.44:0/3771504304 >> v2:172.21.15.99:3300/0 conn(0x7f6a700b5e00 0x7f6a700b6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.655+0000 7f6a7493e700 1 -- 172.21.15.44:0/3771504304 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a700d0ad0 con 0x7f6a7015cda0 2024-09-13T18:30:33.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.655+0000 7f6a7513f700 1 --2- 172.21.15.44:0/3771504304 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a700b6780 0x7f6a7006a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:30:33.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.655+0000 7f6a7493e700 1 --2- 172.21.15.44:0/3771504304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a7015cda0 0x7f6a700d1b70 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6a7006c470 tx=0x7f6a64009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e5e201371bda1d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:33.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.655+0000 7f6a6f7fe700 1 -- 172.21.15.44:0/3771504304 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a64011830 con 0x7f6a7015cda0 2024-09-13T18:30:33.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.655+0000 7f6a6f7fe700 1 -- 172.21.15.44:0/3771504304 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a64011990 con 0x7f6a7015cda0 2024-09-13T18:30:33.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.655+0000 7f6a6f7fe700 1 -- 172.21.15.44:0/3771504304 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a64011d20 con 0x7f6a7015cda0 2024-09-13T18:30:33.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.655+0000 7f6a76ba2700 1 -- 172.21.15.44:0/3771504304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a7015cda0 msgr2=0x7f6a700d1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:33.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.655+0000 7f6a76ba2700 1 --2- 172.21.15.44:0/3771504304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a7015cda0 0x7f6a700d1b70 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6a7006c470 tx=0x7f6a64009bf0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.655+0000 7f6a76ba2700 1 -- 172.21.15.44:0/3771504304 shutdown_connections 2024-09-13T18:30:33.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.655+0000 7f6a76ba2700 1 --2- 172.21.15.44:0/3771504304 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a700b6780 0x7f6a7006a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.655+0000 7f6a76ba2700 1 --2- 172.21.15.44:0/3771504304 >> v2:172.21.15.99:3300/0 conn(0x7f6a700b5e00 0x7f6a700b6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.655+0000 7f6a76ba2700 1 --2- 172.21.15.44:0/3771504304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a7015cda0 0x7f6a700d1b70 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.655+0000 7f6a76ba2700 1 -- 172.21.15.44:0/3771504304 >> 172.21.15.44:0/3771504304 conn(0x7f6a700d2cb0 msgr2=0x7f6a700d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:33.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.655+0000 7f6a76ba2700 1 -- 172.21.15.44:0/3771504304 shutdown_connections 2024-09-13T18:30:33.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.655+0000 7f6a76ba2700 1 -- 172.21.15.44:0/3771504304 wait complete. 2024-09-13T18:30:33.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a76ba2700 1 Processor -- start 2024-09-13T18:30:33.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a76ba2700 1 -- start start 2024-09-13T18:30:33.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a76ba2700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a700b5e00 0x7f6a70152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:33.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a76ba2700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a700b6780 0x7f6a70156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:33.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a76ba2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a7015cda0 0x7f6a700ce260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:33.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a76ba2700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a701f3330 con 0x7f6a7015cda0 2024-09-13T18:30:33.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a76ba2700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a701f3050 con 0x7f6a700b5e00 2024-09-13T18:30:33.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a76ba2700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a70155660 con 0x7f6a700b6780 2024-09-13T18:30:33.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a7513f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a7015cda0 0x7f6a700ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:33.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a7513f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a7015cda0 0x7f6a700ce260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36258/0 (socket says 172.21.15.44:36258) 2024-09-13T18:30:33.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a7513f700 1 -- 172.21.15.44:0/965926800 learned_addr learned my addr 172.21.15.44:0/965926800 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:30:33.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a7493e700 1 --2- 172.21.15.44:0/965926800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a700b5e00 0x7f6a70152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:33.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a6ffff700 1 --2- 172.21.15.44:0/965926800 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a700b6780 0x7f6a70156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:33.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a7513f700 1 -- 172.21.15.44:0/965926800 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a700b6780 msgr2=0x7f6a70156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:33.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a7513f700 1 --2- 172.21.15.44:0/965926800 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a700b6780 0x7f6a70156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a7513f700 1 -- 172.21.15.44:0/965926800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a700b5e00 msgr2=0x7f6a70152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:33.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a7513f700 1 --2- 172.21.15.44:0/965926800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a700b5e00 0x7f6a70152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a7513f700 1 -- 172.21.15.44:0/965926800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a68009a70 con 0x7f6a7015cda0 2024-09-13T18:30:33.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a7513f700 1 --2- 172.21.15.44:0/965926800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a7015cda0 0x7f6a700ce260 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800efb0 tx=0x7f6a6800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:33.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a6d7fa700 1 -- 172.21.15.44:0/965926800 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6800cc90 con 0x7f6a7015cda0 2024-09-13T18:30:33.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a6d7fa700 1 -- 172.21.15.44:0/965926800 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6800f040 con 0x7f6a7015cda0 2024-09-13T18:30:33.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a6d7fa700 1 -- 172.21.15.44:0/965926800 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a68014480 con 0x7f6a7015cda0 2024-09-13T18:30:33.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a76ba2700 1 -- 172.21.15.44:0/965926800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a64009570 con 0x7f6a7015cda0 2024-09-13T18:30:33.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.659+0000 7f6a76ba2700 1 -- 172.21.15.44:0/965926800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a70155c20 con 0x7f6a7015cda0 2024-09-13T18:30:33.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.663+0000 7f6a76ba2700 1 -- 172.21.15.44:0/965926800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a70155e40 con 0x7f6a7015cda0 2024-09-13T18:30:33.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.663+0000 7f6a6d7fa700 1 -- 172.21.15.44:0/965926800 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6a680145e0 con 0x7f6a7015cda0 2024-09-13T18:30:33.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.663+0000 7f6a6d7fa700 1 --2- 172.21.15.44:0/965926800 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6a5c066730 0x7f6a5c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:33.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.663+0000 7f6a6d7fa700 1 -- 172.21.15.44:0/965926800 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6a680849d0 con 0x7f6a7015cda0 2024-09-13T18:30:33.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.663+0000 7f6a7493e700 1 --2- 172.21.15.44:0/965926800 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6a5c066730 0x7f6a5c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:33.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.667+0000 7f6a7493e700 1 --2- 172.21.15.44:0/965926800 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6a5c066730 0x7f6a5c068bf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6a64000c00 tx=0x7f6a64008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:33.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.675+0000 7f6a6d7fa700 1 -- 172.21.15.44:0/965926800 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6a68051d00 con 0x7f6a7015cda0 2024-09-13T18:30:33.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.847+0000 7f6a76ba2700 1 -- 172.21.15.44:0/965926800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6a700b6240 con 0x7f6a7015cda0 2024-09-13T18:30:33.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.847+0000 7f6a6d7fa700 1 -- 172.21.15.44:0/965926800 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6a680180a0 con 0x7f6a7015cda0 2024-09-13T18:30:33.854 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:30:33.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.851+0000 7f6a76ba2700 1 -- 172.21.15.44:0/965926800 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6a5c066730 msgr2=0x7f6a5c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:33.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.851+0000 7f6a76ba2700 1 --2- 172.21.15.44:0/965926800 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6a5c066730 0x7f6a5c068bf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6a64000c00 tx=0x7f6a64008030 comp rx=0 tx=0).stop 2024-09-13T18:30:33.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.851+0000 7f6a76ba2700 1 -- 172.21.15.44:0/965926800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a7015cda0 msgr2=0x7f6a700ce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:33.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.851+0000 7f6a76ba2700 1 --2- 172.21.15.44:0/965926800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a7015cda0 0x7f6a700ce260 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800efb0 tx=0x7f6a6800c3a0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.851+0000 7f6a76ba2700 1 -- 172.21.15.44:0/965926800 shutdown_connections 2024-09-13T18:30:33.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.851+0000 7f6a76ba2700 1 --2- 172.21.15.44:0/965926800 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6a5c066730 0x7f6a5c068bf0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.851+0000 7f6a76ba2700 1 --2- 172.21.15.44:0/965926800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a7015cda0 0x7f6a700ce260 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.851+0000 7f6a76ba2700 1 --2- 172.21.15.44:0/965926800 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a700b6780 0x7f6a70156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.851+0000 7f6a76ba2700 1 --2- 172.21.15.44:0/965926800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a700b5e00 0x7f6a70152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.851+0000 7f6a76ba2700 1 -- 172.21.15.44:0/965926800 >> 172.21.15.44:0/965926800 conn(0x7f6a700d2cb0 msgr2=0x7f6a7015a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:33.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.851+0000 7f6a76ba2700 1 -- 172.21.15.44:0/965926800 shutdown_connections 2024-09-13T18:30:33.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.851+0000 7f6a76ba2700 1 -- 172.21.15.44:0/965926800 wait complete. 2024-09-13T18:30:33.869 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:30:33.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.987+0000 7f60888a1700 1 Processor -- start 2024-09-13T18:30:33.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.987+0000 7f60888a1700 1 -- start start 2024-09-13T18:30:33.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f60888a1700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f60840cf360 0x7f60840ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:33.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f60888a1700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60840b4590 con 0x7f60840b3f20 2024-09-13T18:30:33.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f60888a1700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60840b4870 con 0x7f60840adf20 2024-09-13T18:30:33.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f60888a1700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60840cf740 con 0x7f60840cf360 2024-09-13T18:30:33.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f6083fff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f60840b3f20 0x7f6084071590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42172/0 (socket says 172.21.15.44:42172) 2024-09-13T18:30:33.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f6083fff700 1 -- 172.21.15.44:0/256676144 learned_addr learned my addr 172.21.15.44:0/256676144 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:30:33.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f60837fe700 1 --2- 172.21.15.44:0/256676144 >> v2:172.21.15.99:3300/0 conn(0x7f60840cf360 0x7f60840ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:33.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f6082ffd700 1 -- 172.21.15.44:0/256676144 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928331482 0 0) 0x7f60840b4590 con 0x7f60840b3f20 2024-09-13T18:30:33.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f6082ffd700 1 -- 172.21.15.44:0/256676144 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60700035d0 con 0x7f60840b3f20 2024-09-13T18:30:33.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f6082ffd700 1 -- 172.21.15.44:0/256676144 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 135594493 0 0) 0x7f60840b4870 con 0x7f60840adf20 2024-09-13T18:30:33.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f6082ffd700 1 -- 172.21.15.44:0/256676144 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60840b4590 con 0x7f60840adf20 2024-09-13T18:30:34.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f6082ffd700 1 -- 172.21.15.44:0/256676144 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2477606428 0 0) 0x7f60700035d0 con 0x7f60840b3f20 2024-09-13T18:30:34.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f6082ffd700 1 -- 172.21.15.44:0/256676144 >> v2:172.21.15.99:3300/0 conn(0x7f60840cf360 msgr2=0x7f60840ad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:34.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f6082ffd700 1 --2- 172.21.15.44:0/256676144 >> v2:172.21.15.99:3300/0 conn(0x7f60840cf360 0x7f60840ad9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f6082ffd700 1 -- 172.21.15.44:0/256676144 >> v1:172.21.15.99:6789/0 conn(0x7f60840adf20 legacy=0x7f60840b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f6082ffd700 1 -- 172.21.15.44:0/256676144 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6084070d90 con 0x7f60840b3f20 2024-09-13T18:30:34.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f6082ffd700 1 -- 172.21.15.44:0/256676144 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f607c0019f0 con 0x7f60840b3f20 2024-09-13T18:30:34.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f6082ffd700 1 -- 172.21.15.44:0/256676144 >> v1:172.21.15.44:6789/0 conn(0x7f60840b3f20 legacy=0x7f6084071590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f6082ffd700 1 --2- 172.21.15.44:0/256676144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6070003bb0 0x7f6070003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f6082ffd700 1 --2- 172.21.15.44:0/256676144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6070004870 0x7f6070004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f6082ffd700 1 --2- 172.21.15.44:0/256676144 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6070005230 0x7f607000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f6082ffd700 1 -- 172.21.15.44:0/256676144 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60840cf740 con 0x7f6070003bb0 2024-09-13T18:30:34.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f6082ffd700 1 -- 172.21.15.44:0/256676144 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607000c050 con 0x7f6070004870 2024-09-13T18:30:34.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f60837fe700 1 --2- 172.21.15.44:0/256676144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6070003bb0 0x7f6070003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f6082ffd700 1 -- 172.21.15.44:0/256676144 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607000c210 con 0x7f6070005230 2024-09-13T18:30:34.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f607bfff700 1 --2- 172.21.15.44:0/256676144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6070004870 0x7f6070004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f6083fff700 1 --2- 172.21.15.44:0/256676144 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6070005230 0x7f607000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f60837fe700 1 -- 172.21.15.44:0/256676144 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6070005230 msgr2=0x7f607000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:34.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f60837fe700 1 --2- 172.21.15.44:0/256676144 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6070005230 0x7f607000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f60837fe700 1 -- 172.21.15.44:0/256676144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6070004870 msgr2=0x7f6070004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:34.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f60837fe700 1 --2- 172.21.15.44:0/256676144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6070004870 0x7f6070004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f60837fe700 1 -- 172.21.15.44:0/256676144 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60700035d0 con 0x7f6070003bb0 2024-09-13T18:30:34.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f6083fff700 1 --2- 172.21.15.44:0/256676144 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6070005230 0x7f607000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:34.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f6083fff700 1 -- 172.21.15.44:0/256676144 reap_dead start 2024-09-13T18:30:34.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f60837fe700 1 --2- 172.21.15.44:0/256676144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6070003bb0 0x7f6070003f90 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6074009b70 tx=0x7f60700058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f38a2f1e1c11c49e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:34.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.991+0000 7f6082ffd700 1 -- 172.21.15.44:0/256676144 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607400e6c0 con 0x7f6070003bb0 2024-09-13T18:30:34.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.995+0000 7f6082ffd700 1 -- 172.21.15.44:0/256676144 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607400e820 con 0x7f6070003bb0 2024-09-13T18:30:34.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.995+0000 7f6082ffd700 1 -- 172.21.15.44:0/256676144 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607400eb90 con 0x7f6070003bb0 2024-09-13T18:30:34.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.995+0000 7f60888a1700 1 -- 172.21.15.44:0/256676144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6070003bb0 msgr2=0x7f6070003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.995+0000 7f60888a1700 1 --2- 172.21.15.44:0/256676144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6070003bb0 0x7f6070003f90 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6074009b70 tx=0x7f60700058a0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.995+0000 7f60888a1700 1 -- 172.21.15.44:0/256676144 shutdown_connections 2024-09-13T18:30:34.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.995+0000 7f60888a1700 1 --2- 172.21.15.44:0/256676144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6070003bb0 0x7f6070003f90 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.995+0000 7f60888a1700 1 -- 172.21.15.44:0/256676144 >> 172.21.15.44:0/256676144 conn(0x7f60840b1810 msgr2=0x7f60840b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:34.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.995+0000 7f60888a1700 1 -- 172.21.15.44:0/256676144 shutdown_connections 2024-09-13T18:30:34.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.995+0000 7f60888a1700 1 -- 172.21.15.44:0/256676144 wait complete. 2024-09-13T18:30:34.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f60888a1700 1 Processor -- start 2024-09-13T18:30:34.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f60888a1700 1 -- start start 2024-09-13T18:30:34.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f60888a1700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6070003bb0 0x7f608414f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f60888a1700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6084158210 0x7f6084158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f60888a1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60840b05e0 0x7f60840b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f60888a1700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60840b4b50 con 0x7f60840b05e0 2024-09-13T18:30:34.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f60888a1700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60840b0fa0 con 0x7f6084158210 2024-09-13T18:30:34.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f60888a1700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6084159d00 con 0x7f6070003bb0 2024-09-13T18:30:34.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f6083fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60840b05e0 0x7f60840b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f6083fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60840b05e0 0x7f60840b0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36272/0 (socket says 172.21.15.44:36272) 2024-09-13T18:30:34.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f6083fff700 1 -- 172.21.15.44:0/3621625623 learned_addr learned my addr 172.21.15.44:0/3621625623 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:30:34.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f607bfff700 1 --2- 172.21.15.44:0/3621625623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6084158210 0x7f6084158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f60837fe700 1 --2- 172.21.15.44:0/3621625623 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6070003bb0 0x7f608414f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f6083fff700 1 -- 172.21.15.44:0/3621625623 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6070003bb0 msgr2=0x7f608414f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f6083fff700 1 --2- 172.21.15.44:0/3621625623 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6070003bb0 0x7f608414f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f6083fff700 1 -- 172.21.15.44:0/3621625623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6084158210 msgr2=0x7f6084158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f6083fff700 1 --2- 172.21.15.44:0/3621625623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6084158210 0x7f6084158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f6083fff700 1 -- 172.21.15.44:0/3621625623 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6084158c60 con 0x7f60840b05e0 2024-09-13T18:30:34.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f6083fff700 1 --2- 172.21.15.44:0/3621625623 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60840b05e0 0x7f60840b0a60 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f607c004ca0 tx=0x7f607c008be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:34.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f6080ff9700 1 -- 172.21.15.44:0/3621625623 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c006830 con 0x7f60840b05e0 2024-09-13T18:30:34.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f6080ff9700 1 -- 172.21.15.44:0/3621625623 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607c006990 con 0x7f60840b05e0 2024-09-13T18:30:34.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f60888a1700 1 -- 172.21.15.44:0/3621625623 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6084158f40 con 0x7f60840b05e0 2024-09-13T18:30:34.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f6080ff9700 1 -- 172.21.15.44:0/3621625623 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c006d00 con 0x7f60840b05e0 2024-09-13T18:30:34.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:33.999+0000 7f60888a1700 1 -- 172.21.15.44:0/3621625623 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6084159500 con 0x7f60840b05e0 2024-09-13T18:30:34.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.003+0000 7f60888a1700 1 -- 172.21.15.44:0/3621625623 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f608415d1c0 con 0x7f60840b05e0 2024-09-13T18:30:34.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.003+0000 7f6080ff9700 1 -- 172.21.15.44:0/3621625623 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f607c01e3b0 con 0x7f60840b05e0 2024-09-13T18:30:34.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.007+0000 7f6080ff9700 1 --2- 172.21.15.44:0/3621625623 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6064066760 0x7f6064068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.007+0000 7f6080ff9700 1 -- 172.21.15.44:0/3621625623 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f607c0848b0 con 0x7f60840b05e0 2024-09-13T18:30:34.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.007+0000 7f60837fe700 1 --2- 172.21.15.44:0/3621625623 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6064066760 0x7f6064068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.007+0000 7f60837fe700 1 --2- 172.21.15.44:0/3621625623 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6064066760 0x7f6064068c20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f60740090b0 tx=0x7f607401e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:34.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.015+0000 7f6080ff9700 1 -- 172.21.15.44:0/3621625623 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f607c0555c0 con 0x7f60840b05e0 2024-09-13T18:30:34.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.183+0000 7f60888a1700 1 -- 172.21.15.44:0/3621625623 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f608414f850 con 0x7f60840b05e0 2024-09-13T18:30:34.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.183+0000 7f6080ff9700 1 -- 172.21.15.44:0/3621625623 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7f607c01a020 con 0x7f60840b05e0 2024-09-13T18:30:34.188 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:30:34.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.183+0000 7f60888a1700 1 -- 172.21.15.44:0/3621625623 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6064066760 msgr2=0x7f6064068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.183+0000 7f60888a1700 1 --2- 172.21.15.44:0/3621625623 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6064066760 0x7f6064068c20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f60740090b0 tx=0x7f607401e040 comp rx=0 tx=0).stop 2024-09-13T18:30:34.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.183+0000 7f60888a1700 1 -- 172.21.15.44:0/3621625623 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60840b05e0 msgr2=0x7f60840b0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.183+0000 7f60888a1700 1 --2- 172.21.15.44:0/3621625623 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60840b05e0 0x7f60840b0a60 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f607c004ca0 tx=0x7f607c008be0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.183+0000 7f60888a1700 1 -- 172.21.15.44:0/3621625623 shutdown_connections 2024-09-13T18:30:34.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.183+0000 7f60888a1700 1 --2- 172.21.15.44:0/3621625623 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6064066760 0x7f6064068c20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.183+0000 7f60888a1700 1 --2- 172.21.15.44:0/3621625623 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60840b05e0 0x7f60840b0a60 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.183+0000 7f60888a1700 1 --2- 172.21.15.44:0/3621625623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6084158210 0x7f6084158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.183+0000 7f60888a1700 1 --2- 172.21.15.44:0/3621625623 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6070003bb0 0x7f608414f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.183+0000 7f60888a1700 1 -- 172.21.15.44:0/3621625623 >> 172.21.15.44:0/3621625623 conn(0x7f60840b1810 msgr2=0x7f60840b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:34.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.187+0000 7f60888a1700 1 -- 172.21.15.44:0/3621625623 shutdown_connections 2024-09-13T18:30:34.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.187+0000 7f60888a1700 1 -- 172.21.15.44:0/3621625623 wait complete. 2024-09-13T18:30:34.204 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:30:34.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.315+0000 7fb65a7d9700 1 Processor -- start 2024-09-13T18:30:34.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.315+0000 7fb65a7d9700 1 -- start start 2024-09-13T18:30:34.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.315+0000 7fb65a7d9700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb64c0e0b00 0x7fb64c035950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.315+0000 7fb65a7d9700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb64c0516c0 con 0x7fb64c00be50 2024-09-13T18:30:34.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.315+0000 7fb65a7d9700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb64c055710 con 0x7fb64c054b90 2024-09-13T18:30:34.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.315+0000 7fb65a7d9700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64c00c290 con 0x7fb64c0e0b00 2024-09-13T18:30:34.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb658fd6700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb64c00be50 0x7fb64c056f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42174/0 (socket says 172.21.15.44:42174) 2024-09-13T18:30:34.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb658fd6700 1 -- 172.21.15.44:0/3263174719 learned_addr learned my addr 172.21.15.44:0/3263174719 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:30:34.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb6597d7700 1 --2- 172.21.15.44:0/3263174719 >> v2:172.21.15.99:3300/0 conn(0x7fb64c0e0b00 0x7fb64c035950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb64bfff700 1 -- 172.21.15.44:0/3263174719 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122063950 0 0) 0x7fb64c0516c0 con 0x7fb64c00be50 2024-09-13T18:30:34.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb64bfff700 1 -- 172.21.15.44:0/3263174719 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6400035d0 con 0x7fb64c00be50 2024-09-13T18:30:34.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb64bfff700 1 -- 172.21.15.44:0/3263174719 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461947028 0 0) 0x7fb64c055710 con 0x7fb64c054b90 2024-09-13T18:30:34.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb64bfff700 1 -- 172.21.15.44:0/3263174719 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb64c0516c0 con 0x7fb64c054b90 2024-09-13T18:30:34.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb64bfff700 1 -- 172.21.15.44:0/3263174719 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2802270181 0 0) 0x7fb6400035d0 con 0x7fb64c00be50 2024-09-13T18:30:34.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb64bfff700 1 -- 172.21.15.44:0/3263174719 >> v2:172.21.15.99:3300/0 conn(0x7fb64c0e0b00 msgr2=0x7fb64c035950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:34.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb64bfff700 1 --2- 172.21.15.44:0/3263174719 >> v2:172.21.15.99:3300/0 conn(0x7fb64c0e0b00 0x7fb64c035950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb64bfff700 1 -- 172.21.15.44:0/3263174719 >> v1:172.21.15.99:6789/0 conn(0x7fb64c054b90 legacy=0x7fb64c055000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb64bfff700 1 -- 172.21.15.44:0/3263174719 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64c0545d0 con 0x7fb64c00be50 2024-09-13T18:30:34.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb64bfff700 1 -- 172.21.15.44:0/3263174719 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7fb650001670 con 0x7fb64c00be50 2024-09-13T18:30:34.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb64bfff700 1 -- 172.21.15.44:0/3263174719 >> v1:172.21.15.44:6789/0 conn(0x7fb64c00be50 legacy=0x7fb64c056f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb64bfff700 1 --2- 172.21.15.44:0/3263174719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb640003bb0 0x7fb640003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb64bfff700 1 --2- 172.21.15.44:0/3263174719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb640004870 0x7fb640004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb64bfff700 1 --2- 172.21.15.44:0/3263174719 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb640005230 0x7fb64000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb64bfff700 1 -- 172.21.15.44:0/3263174719 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c00c290 con 0x7fb640004870 2024-09-13T18:30:34.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb64bfff700 1 -- 172.21.15.44:0/3263174719 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64000c020 con 0x7fb640003bb0 2024-09-13T18:30:34.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb64bfff700 1 -- 172.21.15.44:0/3263174719 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64000c1e0 con 0x7fb640005230 2024-09-13T18:30:34.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb6597d7700 1 --2- 172.21.15.44:0/3263174719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb640003bb0 0x7fb640003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb658fd6700 1 --2- 172.21.15.44:0/3263174719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb640004870 0x7fb640004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb659fd8700 1 --2- 172.21.15.44:0/3263174719 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb640005230 0x7fb64000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb658fd6700 1 -- 172.21.15.44:0/3263174719 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb640005230 msgr2=0x7fb64000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:34.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb658fd6700 1 --2- 172.21.15.44:0/3263174719 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb640005230 0x7fb64000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb658fd6700 1 -- 172.21.15.44:0/3263174719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb640003bb0 msgr2=0x7fb640003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:34.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb658fd6700 1 --2- 172.21.15.44:0/3263174719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb640003bb0 0x7fb640003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb658fd6700 1 -- 172.21.15.44:0/3263174719 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6400035d0 con 0x7fb640004870 2024-09-13T18:30:34.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb659fd8700 1 -- 172.21.15.44:0/3263174719 reap_dead start 2024-09-13T18:30:34.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb6597d7700 1 --2- 172.21.15.44:0/3263174719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb640003bb0 0x7fb640003fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:30:34.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb658fd6700 1 --2- 172.21.15.44:0/3263174719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb640004870 0x7fb640004cf0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb650001eb0 tx=0x7fb6400058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6f171ad0f24d48 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:34.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb64bfff700 1 -- 172.21.15.44:0/3263174719 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65000cd80 con 0x7fb640004870 2024-09-13T18:30:34.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb64bfff700 1 -- 172.21.15.44:0/3263174719 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb650005980 con 0x7fb640004870 2024-09-13T18:30:34.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb64bfff700 1 -- 172.21.15.44:0/3263174719 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb650005d30 con 0x7fb640004870 2024-09-13T18:30:34.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb65a7d9700 1 -- 172.21.15.44:0/3263174719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb640004870 msgr2=0x7fb640004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb65a7d9700 1 --2- 172.21.15.44:0/3263174719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb640004870 0x7fb640004cf0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb650001eb0 tx=0x7fb6400058a0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb65a7d9700 1 -- 172.21.15.44:0/3263174719 shutdown_connections 2024-09-13T18:30:34.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb65a7d9700 1 --2- 172.21.15.44:0/3263174719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb640004870 0x7fb640004cf0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb65a7d9700 1 -- 172.21.15.44:0/3263174719 >> 172.21.15.44:0/3263174719 conn(0x7fb64c01fbf0 msgr2=0x7fb64c056860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:34.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb65a7d9700 1 -- 172.21.15.44:0/3263174719 shutdown_connections 2024-09-13T18:30:34.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.319+0000 7fb65a7d9700 1 -- 172.21.15.44:0/3263174719 wait complete. 2024-09-13T18:30:34.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb65a7d9700 1 Processor -- start 2024-09-13T18:30:34.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb65a7d9700 1 -- start start 2024-09-13T18:30:34.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb65a7d9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb640004870 0x7fb64c0d6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb65a7d9700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb64c037210 0x7fb64c0396b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb65a7d9700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb64c037690 0x7fb64c039bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb65a7d9700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c037bf0 con 0x7fb640004870 2024-09-13T18:30:34.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb65a7d9700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c037ed0 con 0x7fb64c037690 2024-09-13T18:30:34.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb65a7d9700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c0381b0 con 0x7fb64c037210 2024-09-13T18:30:34.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb6597d7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb640004870 0x7fb64c0d6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb6597d7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb640004870 0x7fb64c0d6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36288/0 (socket says 172.21.15.44:36288) 2024-09-13T18:30:34.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb6597d7700 1 -- 172.21.15.44:0/1085533490 learned_addr learned my addr 172.21.15.44:0/1085533490 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:30:34.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb658fd6700 1 --2- 172.21.15.44:0/1085533490 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb64c037210 0x7fb64c0396b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb659fd8700 1 --2- 172.21.15.44:0/1085533490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb64c037690 0x7fb64c039bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb6597d7700 1 -- 172.21.15.44:0/1085533490 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb64c037210 msgr2=0x7fb64c0396b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb6597d7700 1 --2- 172.21.15.44:0/1085533490 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb64c037210 0x7fb64c0396b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb6597d7700 1 -- 172.21.15.44:0/1085533490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb64c037690 msgr2=0x7fb64c039bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb6597d7700 1 --2- 172.21.15.44:0/1085533490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb64c037690 0x7fb64c039bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb6597d7700 1 -- 172.21.15.44:0/1085533490 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64c038490 con 0x7fb640004870 2024-09-13T18:30:34.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb6597d7700 1 --2- 172.21.15.44:0/1085533490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb640004870 0x7fb64c0d6330 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb644011bd0 tx=0x7fb644011ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:34.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb649ffb700 1 -- 172.21.15.44:0/1085533490 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb644005a40 con 0x7fb640004870 2024-09-13T18:30:34.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb649ffb700 1 -- 172.21.15.44:0/1085533490 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb644005ba0 con 0x7fb640004870 2024-09-13T18:30:34.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb65a7d9700 1 -- 172.21.15.44:0/1085533490 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb64c038770 con 0x7fb640004870 2024-09-13T18:30:34.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb649ffb700 1 -- 172.21.15.44:0/1085533490 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb644004020 con 0x7fb640004870 2024-09-13T18:30:34.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.323+0000 7fb65a7d9700 1 -- 172.21.15.44:0/1085533490 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb64c03bfd0 con 0x7fb640004870 2024-09-13T18:30:34.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.327+0000 7fb65a7d9700 1 -- 172.21.15.44:0/1085533490 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64c056f70 con 0x7fb640004870 2024-09-13T18:30:34.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.327+0000 7fb649ffb700 1 -- 172.21.15.44:0/1085533490 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb644004180 con 0x7fb640004870 2024-09-13T18:30:34.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.327+0000 7fb649ffb700 1 --2- 172.21.15.44:0/1085533490 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb638066760 0x7fb638068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.327+0000 7fb649ffb700 1 -- 172.21.15.44:0/1085533490 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb644084410 con 0x7fb640004870 2024-09-13T18:30:34.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.327+0000 7fb658fd6700 1 --2- 172.21.15.44:0/1085533490 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb638066760 0x7fb638068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.327+0000 7fb658fd6700 1 --2- 172.21.15.44:0/1085533490 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb638066760 0x7fb638068c20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb64c033d90 tx=0x7fb65000a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:34.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.335+0000 7fb649ffb700 1 -- 172.21.15.44:0/1085533490 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb6440516a0 con 0x7fb640004870 2024-09-13T18:30:34.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.523+0000 7fb65a7d9700 1 -- 172.21.15.44:0/1085533490 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb64c038900 con 0x7fb640004870 2024-09-13T18:30:34.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.523+0000 7fb649ffb700 1 -- 172.21.15.44:0/1085533490 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v50) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb644022080 con 0x7fb640004870 2024-09-13T18:30:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.527+0000 7fb65a7d9700 1 -- 172.21.15.44:0/1085533490 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb638066760 msgr2=0x7fb638068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.527+0000 7fb65a7d9700 1 --2- 172.21.15.44:0/1085533490 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb638066760 0x7fb638068c20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb64c033d90 tx=0x7fb65000a000 comp rx=0 tx=0).stop 2024-09-13T18:30:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.527+0000 7fb65a7d9700 1 -- 172.21.15.44:0/1085533490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb640004870 msgr2=0x7fb64c0d6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.527+0000 7fb65a7d9700 1 --2- 172.21.15.44:0/1085533490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb640004870 0x7fb64c0d6330 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb644011bd0 tx=0x7fb644011ee0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.527+0000 7fb65a7d9700 1 -- 172.21.15.44:0/1085533490 shutdown_connections 2024-09-13T18:30:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.527+0000 7fb65a7d9700 1 --2- 172.21.15.44:0/1085533490 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb638066760 0x7fb638068c20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.527+0000 7fb65a7d9700 1 --2- 172.21.15.44:0/1085533490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb64c037690 0x7fb64c039bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.527+0000 7fb65a7d9700 1 --2- 172.21.15.44:0/1085533490 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb64c037210 0x7fb64c0396b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.527+0000 7fb65a7d9700 1 --2- 172.21.15.44:0/1085533490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb640004870 0x7fb64c0d6330 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.527+0000 7fb65a7d9700 1 -- 172.21.15.44:0/1085533490 >> 172.21.15.44:0/1085533490 conn(0x7fb64c01fbf0 msgr2=0x7fb64c0e20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:34.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.527+0000 7fb65a7d9700 1 -- 172.21.15.44:0/1085533490 shutdown_connections 2024-09-13T18:30:34.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.527+0000 7fb65a7d9700 1 -- 172.21.15.44:0/1085533490 wait complete. 2024-09-13T18:30:34.534 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-13T18:30:34.546 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2024-09-13T18:30:34.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:34.546 DEBUG:teuthology.orchestra.run.smithi044:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:30:34.559 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[40426]: fuse finished with error 0 and tester_r 0 2024-09-13T18:30:34.560 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:30:34.637 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:30:34.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:34.637 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:30:34.643 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:30:34.643 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:30:34.650 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346268k,nr_inodes=4086567,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19562 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275480k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:30:34.650 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.1 is not mounted at ubuntu@smithi099.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1 2024-09-13T18:30:34.650 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:30:34.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:34.651 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:30:34.656 INFO:teuthology.orchestra.run.smithi099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-13T18:30:34.657 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:30:34.657 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:30:34.658 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:30:34.693 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349428k,nr_inodes=4087357,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16693 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276112k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:30:34.693 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.2 is not mounted at ubuntu@smithi044.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2 2024-09-13T18:30:34.693 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:30:34.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:34.694 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T18:30:34.700 INFO:teuthology.orchestra.run.smithi044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T18:30:34.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:30:34.701 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:30:34.701 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:30:34.708 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346268k,nr_inodes=4086567,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19562 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275480k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:30:34.708 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.3 is not mounted at ubuntu@smithi099.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3 2024-09-13T18:30:34.708 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:30:34.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:34.708 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T18:30:34.715 INFO:teuthology.orchestra.run.smithi099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T18:30:34.715 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:30:34.716 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:30:34.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.839+0000 7fb56532a700 1 Processor -- start 2024-09-13T18:30:34.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.839+0000 7fb56532a700 1 -- start start 2024-09-13T18:30:34.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.839+0000 7fb56532a700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb5600b4880 0x7fb560070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.839+0000 7fb56532a700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb560070860 0x7fb5600c8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.839+0000 7fb56532a700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5600cdbc0 con 0x7fb5600c8950 2024-09-13T18:30:34.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.839+0000 7fb56532a700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb560070cd0 con 0x7fb5600b4880 2024-09-13T18:30:34.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.839+0000 7fb56532a700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5600cde60 con 0x7fb560070860 2024-09-13T18:30:34.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.839+0000 7fb55ffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb5600b4880 0x7fb560070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.839+0000 7fb55ffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb5600b4880 0x7fb560070320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36294/0 (socket says 172.21.15.44:36294) 2024-09-13T18:30:34.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.839+0000 7fb55ffff700 1 -- 172.21.15.44:0/3205726145 learned_addr learned my addr 172.21.15.44:0/3205726145 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:30:34.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.839+0000 7fb55f7fe700 1 --2- 172.21.15.44:0/3205726145 >> v2:172.21.15.99:3300/0 conn(0x7fb560070860 0x7fb5600c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.843+0000 7fb55ffff700 1 -- 172.21.15.44:0/3205726145 >> v2:172.21.15.99:3300/0 conn(0x7fb560070860 msgr2=0x7fb5600c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:34.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.843+0000 7fb55ffff700 1 --2- 172.21.15.44:0/3205726145 >> v2:172.21.15.99:3300/0 conn(0x7fb560070860 0x7fb5600c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.843+0000 7fb55ffff700 1 -- 172.21.15.44:0/3205726145 >> v1:172.21.15.99:6789/0 conn(0x7fb5600c8950 legacy=0x7fb560160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.843+0000 7fb55effd700 1 -- 172.21.15.44:0/3205726145 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950919338 0 0) 0x7fb5600cdbc0 con 0x7fb5600c8950 2024-09-13T18:30:34.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.843+0000 7fb55ffff700 1 -- 172.21.15.44:0/3205726145 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5600ce140 con 0x7fb5600b4880 2024-09-13T18:30:34.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.843+0000 7fb55ffff700 1 --2- 172.21.15.44:0/3205726145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5600b4880 0x7fb560070320 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb560072000 tx=0x7fb55000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ff4bc6099608ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:34.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.843+0000 7fb55effd700 1 -- 172.21.15.44:0/3205726145 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55000e070 con 0x7fb5600b4880 2024-09-13T18:30:34.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.843+0000 7fb55effd700 1 -- 172.21.15.44:0/3205726145 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55000b910 con 0x7fb5600b4880 2024-09-13T18:30:34.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.843+0000 7fb55effd700 1 -- 172.21.15.44:0/3205726145 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55000bcc0 con 0x7fb5600b4880 2024-09-13T18:30:34.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.843+0000 7fb56532a700 1 -- 172.21.15.44:0/3205726145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5600b4880 msgr2=0x7fb560070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.843+0000 7fb56532a700 1 --2- 172.21.15.44:0/3205726145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5600b4880 0x7fb560070320 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb560072000 tx=0x7fb55000b330 comp rx=0 tx=0).stop 2024-09-13T18:30:34.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.843+0000 7fb56532a700 1 -- 172.21.15.44:0/3205726145 shutdown_connections 2024-09-13T18:30:34.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.843+0000 7fb56532a700 1 --2- 172.21.15.44:0/3205726145 >> v2:172.21.15.99:3300/0 conn(0x7fb560070860 0x7fb5600c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.843+0000 7fb56532a700 1 --2- 172.21.15.44:0/3205726145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5600b4880 0x7fb560070320 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.843+0000 7fb56532a700 1 -- 172.21.15.44:0/3205726145 >> 172.21.15.44:0/3205726145 conn(0x7fb5600cba60 msgr2=0x7fb5600cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:34.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.843+0000 7fb56532a700 1 -- 172.21.15.44:0/3205726145 shutdown_connections 2024-09-13T18:30:34.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.843+0000 7fb56532a700 1 -- 172.21.15.44:0/3205726145 wait complete. 2024-09-13T18:30:34.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb56532a700 1 Processor -- start 2024-09-13T18:30:34.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb56532a700 1 -- start start 2024-09-13T18:30:34.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb56532a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb560070860 0x7fb56006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb56532a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb5600b4880 0x7fb56006a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb56532a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5600c8950 0x7fb5601591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb56532a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56006a850 con 0x7fb560070860 2024-09-13T18:30:34.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb56532a700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb560159720 con 0x7fb5600c8950 2024-09-13T18:30:34.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb56532a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56006aa80 con 0x7fb5600b4880 2024-09-13T18:30:34.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb55ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb560070860 0x7fb56006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb55ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb560070860 0x7fb56006dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36304/0 (socket says 172.21.15.44:36304) 2024-09-13T18:30:34.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb55ffff700 1 -- 172.21.15.44:0/2995634117 learned_addr learned my addr 172.21.15.44:0/2995634117 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:30:34.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb55f7fe700 1 --2- 172.21.15.44:0/2995634117 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb5600b4880 0x7fb56006a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb564b29700 1 --2- 172.21.15.44:0/2995634117 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5600c8950 0x7fb5601591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb55ffff700 1 -- 172.21.15.44:0/2995634117 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb5600b4880 msgr2=0x7fb56006a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb55ffff700 1 --2- 172.21.15.44:0/2995634117 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb5600b4880 0x7fb56006a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb55ffff700 1 -- 172.21.15.44:0/2995634117 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5600c8950 msgr2=0x7fb5601591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb55ffff700 1 --2- 172.21.15.44:0/2995634117 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5600c8950 0x7fb5601591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb55ffff700 1 -- 172.21.15.44:0/2995634117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb550009b30 con 0x7fb560070860 2024-09-13T18:30:34.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb55ffff700 1 --2- 172.21.15.44:0/2995634117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb560070860 0x7fb56006dd50 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb56004e760 tx=0x7fb550004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:34.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb55cff9700 1 -- 172.21.15.44:0/2995634117 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5500048c0 con 0x7fb560070860 2024-09-13T18:30:34.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb55cff9700 1 -- 172.21.15.44:0/2995634117 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5500092e0 con 0x7fb560070860 2024-09-13T18:30:34.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb56532a700 1 -- 172.21.15.44:0/2995634117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb56006ad60 con 0x7fb560070860 2024-09-13T18:30:34.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb55cff9700 1 -- 172.21.15.44:0/2995634117 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55001c680 con 0x7fb560070860 2024-09-13T18:30:34.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.847+0000 7fb56532a700 1 -- 172.21.15.44:0/2995634117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb56006b320 con 0x7fb560070860 2024-09-13T18:30:34.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.851+0000 7fb56532a700 1 -- 172.21.15.44:0/2995634117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5600b4c60 con 0x7fb560070860 2024-09-13T18:30:34.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.851+0000 7fb55cff9700 1 -- 172.21.15.44:0/2995634117 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb55001c7e0 con 0x7fb560070860 2024-09-13T18:30:34.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.851+0000 7fb55cff9700 1 --2- 172.21.15.44:0/2995634117 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb540066730 0x7fb540068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.851+0000 7fb55cff9700 1 -- 172.21.15.44:0/2995634117 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb550085a70 con 0x7fb560070860 2024-09-13T18:30:34.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.851+0000 7fb55f7fe700 1 --2- 172.21.15.44:0/2995634117 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb540066730 0x7fb540068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.855+0000 7fb55f7fe700 1 --2- 172.21.15.44:0/2995634117 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb540066730 0x7fb540068bf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb5601429e0 tx=0x7fb548009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:34.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:34.863+0000 7fb55cff9700 1 -- 172.21.15.44:0/2995634117 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb550052db0 con 0x7fb560070860 2024-09-13T18:30:35.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:35.067+0000 7fb56532a700 1 -- 172.21.15.44:0/2995634117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb56015c900 con 0x7fb560070860 2024-09-13T18:30:35.076 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-13T18:30:35.071+0000 7fc22bbc2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:30:35.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:35.087+0000 7fb55cff9700 1 -- 172.21.15.44:0/2995634117 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb5500563d0 con 0x7fb560070860 2024-09-13T18:30:35.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:35.091+0000 7fb56532a700 1 -- 172.21.15.44:0/2995634117 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb540066730 msgr2=0x7fb540068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:35.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:35.091+0000 7fb56532a700 1 --2- 172.21.15.44:0/2995634117 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb540066730 0x7fb540068bf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb5601429e0 tx=0x7fb548009240 comp rx=0 tx=0).stop 2024-09-13T18:30:35.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:35.091+0000 7fb56532a700 1 -- 172.21.15.44:0/2995634117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb560070860 msgr2=0x7fb56006dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:35.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:35.091+0000 7fb56532a700 1 --2- 172.21.15.44:0/2995634117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb560070860 0x7fb56006dd50 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb56004e760 tx=0x7fb550004af0 comp rx=0 tx=0).stop 2024-09-13T18:30:35.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:35.091+0000 7fb56532a700 1 -- 172.21.15.44:0/2995634117 shutdown_connections 2024-09-13T18:30:35.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:35.091+0000 7fb56532a700 1 --2- 172.21.15.44:0/2995634117 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb540066730 0x7fb540068bf0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:35.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:35.091+0000 7fb56532a700 1 --2- 172.21.15.44:0/2995634117 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5600c8950 0x7fb5601591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:35.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:35.091+0000 7fb56532a700 1 --2- 172.21.15.44:0/2995634117 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb5600b4880 0x7fb56006a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:35.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:35.091+0000 7fb56532a700 1 --2- 172.21.15.44:0/2995634117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb560070860 0x7fb56006dd50 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:35.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:35.091+0000 7fb56532a700 1 -- 172.21.15.44:0/2995634117 >> 172.21.15.44:0/2995634117 conn(0x7fb5600cba60 msgr2=0x7fb5600b3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:35.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:35.091+0000 7fb56532a700 1 -- 172.21.15.44:0/2995634117 shutdown_connections 2024-09-13T18:30:35.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:30:35.091+0000 7fb56532a700 1 -- 172.21.15.44:0/2995634117 wait complete. 2024-09-13T18:30:35.098 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:30:35.098 INFO:tasks.ceph.mds.c.smithi044.stderr: -9253> 2024-09-13T18:29:11.884+0000 7f09fd002700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:30:35.114 INFO:tasks.workunit:Pulling workunits from ref 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:30:35.114 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T18:30:35.114 DEBUG:teuthology.orchestra.run.smithi044:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:30:35.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:30:35.122 INFO:teuthology.orchestra.run.smithi044.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-13T18:30:35.122 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:30:35.128 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-13T18:30:35.128 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-13T18:30:35.135 INFO:tasks.workunit:timeout=1h 2024-09-13T18:30:35.135 INFO:tasks.workunit:cleanup=True 2024-09-13T18:30:35.135 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:30:35.142 INFO:tasks.workunit.client.0.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T18:30:35.148 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-13T18:30:59.000 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:30:59.002 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:31:29.050 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:31:29.053 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:31:42.517 INFO:tasks.workunit.client.0.smithi044.stderr:Note: switching to '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'. 2024-09-13T18:31:42.517 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-13T18:31:42.517 INFO:tasks.workunit.client.0.smithi044.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T18:31:42.517 INFO:tasks.workunit.client.0.smithi044.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T18:31:42.517 INFO:tasks.workunit.client.0.smithi044.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T18:31:42.517 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-13T18:31:42.517 INFO:tasks.workunit.client.0.smithi044.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T18:31:42.517 INFO:tasks.workunit.client.0.smithi044.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T18:31:42.517 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-13T18:31:42.518 INFO:tasks.workunit.client.0.smithi044.stderr: git switch -c 2024-09-13T18:31:42.518 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-13T18:31:42.518 INFO:tasks.workunit.client.0.smithi044.stderr:Or undo this operation with: 2024-09-13T18:31:42.518 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-13T18:31:42.518 INFO:tasks.workunit.client.0.smithi044.stderr: git switch - 2024-09-13T18:31:42.518 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-13T18:31:42.518 INFO:tasks.workunit.client.0.smithi044.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T18:31:42.518 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-13T18:31:42.518 INFO:tasks.workunit.client.0.smithi044.stderr:HEAD is now at 6c6b083f148 Merge PR #56690 into wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:31:42.523 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T18:31:42.531 INFO:tasks.workunit.client.0.smithi044.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T18:31:42.534 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:31:42.534 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T18:31:42.610 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T18:31:42.679 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T18:31:42.738 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:31:42.739 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:31:42.740 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T18:31:42.795 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:31:42.801 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:31:42.802 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T18:31:42.807 INFO:tasks.workunit:Running workunits matching suites/cephfs_journal_tool_smoke.sh on client.0... 2024-09-13T18:31:42.809 INFO:tasks.workunit:Running workunit suites/cephfs_journal_tool_smoke.sh... 2024-09-13T18:31:42.809 DEBUG:teuthology.orchestra.run.smithi044:workunit test suites/cephfs_journal_tool_smoke.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 1h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/cephfs_journal_tool_smoke.sh 2024-09-13T18:31:42.823 INFO:tasks.workunit.client.0.smithi044.stderr:+ export 'BIN=cephfs-journal-tool --rank=cephfs:0' 2024-09-13T18:31:42.823 INFO:tasks.workunit.client.0.smithi044.stderr:+ BIN='cephfs-journal-tool --rank=cephfs:0' 2024-09-13T18:31:42.823 INFO:tasks.workunit.client.0.smithi044.stderr:+ export JOURNAL_FILE=/tmp/journal.bin 2024-09-13T18:31:42.823 INFO:tasks.workunit.client.0.smithi044.stderr:+ JOURNAL_FILE=/tmp/journal.bin 2024-09-13T18:31:42.824 INFO:tasks.workunit.client.0.smithi044.stderr:+ export JSON_OUTPUT=/tmp/json.tmp 2024-09-13T18:31:42.824 INFO:tasks.workunit.client.0.smithi044.stderr:+ JSON_OUTPUT=/tmp/json.tmp 2024-09-13T18:31:42.824 INFO:tasks.workunit.client.0.smithi044.stderr:+ export BINARY_OUTPUT=/tmp/binary.tmp 2024-09-13T18:31:42.824 INFO:tasks.workunit.client.0.smithi044.stderr:+ BINARY_OUTPUT=/tmp/binary.tmp 2024-09-13T18:31:42.824 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' -d /tmp/binary.tmp ']' 2024-09-13T18:31:42.824 INFO:tasks.workunit.client.0.smithi044.stderr:+ echo 'Testing that export/import cycle preserves state' 2024-09-13T18:31:42.824 INFO:tasks.workunit.client.0.smithi044.stdout:Testing that export/import cycle preserves state 2024-09-13T18:31:42.824 INFO:tasks.workunit.client.0.smithi044.stderr:++ cephfs-journal-tool --rank=cephfs:0 header get 2024-09-13T18:31:42.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5d8d8500 1 -- start start 2024-09-13T18:31:42.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5d8d8500 1 Processor -- start 2024-09-13T18:31:42.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5d8d8500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572026a5000 0x55720274a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5d8d8500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572026a5400 0x55720274ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5d8d8500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5572026a5800 0x55720274b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5d8d8500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572026dbe00 con 0x5572026a5400 2024-09-13T18:31:42.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5d8d8500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557202726780 con 0x5572026a5000 2024-09-13T18:31:42.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5d8d8500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x557202726640 con 0x5572026a5800 2024-09-13T18:31:42.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5b891700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572026a5400 0x55720274ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5b891700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572026a5400 0x55720274ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59574/0 (socket says 172.21.15.44:59574) 2024-09-13T18:31:42.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5b891700 1 -- 172.21.15.44:0/89011075 learned_addr learned my addr 172.21.15.44:0/89011075 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:42.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5c893700 1 --2- 172.21.15.44:0/89011075 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5572026a5800 0x55720274b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5c092700 1 --2- 172.21.15.44:0/89011075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572026a5000 0x55720274a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5b891700 1 -- 172.21.15.44:0/89011075 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5572026a5800 msgr2=0x55720274b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:42.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5b891700 1 --2- 172.21.15.44:0/89011075 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5572026a5800 0x55720274b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5b891700 1 -- 172.21.15.44:0/89011075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572026a5000 msgr2=0x55720274a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:42.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5b891700 1 --2- 172.21.15.44:0/89011075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572026a5000 0x55720274a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5b891700 1 -- 172.21.15.44:0/89011075 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572026c89c0 con 0x5572026a5400 2024-09-13T18:31:42.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5c092700 1 --2- 172.21.15.44:0/89011075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572026a5000 0x55720274a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:42.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5b891700 1 --2- 172.21.15.44:0/89011075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572026a5400 0x55720274ab00 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x5572027ff4a0 tx=0x557203488480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ef4897f354207c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:42.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5988d700 1 -- 172.21.15.44:0/89011075 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5572026f5600 con 0x5572026a5400 2024-09-13T18:31:42.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5988d700 1 -- 172.21.15.44:0/89011075 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5572026f0900 con 0x5572026a5400 2024-09-13T18:31:42.863 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5988d700 1 -- 172.21.15.44:0/89011075 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5572026f51e0 con 0x5572026a5400 2024-09-13T18:31:42.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5d8d8500 1 -- 172.21.15.44:0/89011075 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572026c8b60 con 0x5572026a5400 2024-09-13T18:31:42.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5d8d8500 1 -- 172.21.15.44:0/89011075 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5572026c8340 con 0x5572026a5400 2024-09-13T18:31:42.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5988d700 1 -- 172.21.15.44:0/89011075 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x5572026dec40 con 0x5572026a5400 2024-09-13T18:31:42.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.853+0000 7f4b5988d700 1 -- 172.21.15.44:0/89011075 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x5572029a6300 con 0x5572026a5400 2024-09-13T18:31:42.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.857+0000 7f4b5d8d8500 1 Processor -- start 2024-09-13T18:31:42.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.857+0000 7f4b5d8d8500 1 -- start start 2024-09-13T18:31:42.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.857+0000 7f4b5d8d8500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5572029f0400 0x55720274b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.857+0000 7f4b5d8d8500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572029f0800 0x55720274bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.857+0000 7f4b5d8d8500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572029f0c00 0x55720274c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.857+0000 7f4b5d8d8500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557202726500 con 0x5572029f0c00 2024-09-13T18:31:42.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.857+0000 7f4b5d8d8500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572027263c0 con 0x5572029f0800 2024-09-13T18:31:42.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.857+0000 7f4b5d8d8500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x557202726780 con 0x5572029f0400 2024-09-13T18:31:42.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.857+0000 7f4b5b891700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572029f0c00 0x55720274c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.857+0000 7f4b5b891700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572029f0c00 0x55720274c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59582/0 (socket says 172.21.15.44:59582) 2024-09-13T18:31:42.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.857+0000 7f4b5b891700 1 -- 172.21.15.44:0/962605357 learned_addr learned my addr 172.21.15.44:0/962605357 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:42.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.857+0000 7f4b5c893700 1 --2- 172.21.15.44:0/962605357 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5572029f0400 0x55720274b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.857+0000 7f4b5c092700 1 --2- 172.21.15.44:0/962605357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572029f0800 0x55720274bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.857+0000 7f4b5b891700 1 -- 172.21.15.44:0/962605357 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5572029f0400 msgr2=0x55720274b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:42.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.857+0000 7f4b5b891700 1 --2- 172.21.15.44:0/962605357 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5572029f0400 0x55720274b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.857+0000 7f4b5b891700 1 -- 172.21.15.44:0/962605357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572029f0800 msgr2=0x55720274bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:42.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.857+0000 7f4b5b891700 1 --2- 172.21.15.44:0/962605357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572029f0800 0x55720274bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.857+0000 7f4b5b891700 1 -- 172.21.15.44:0/962605357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572026c8000 con 0x5572029f0c00 2024-09-13T18:31:42.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.857+0000 7f4b5c092700 1 --2- 172.21.15.44:0/962605357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572029f0800 0x55720274bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:42.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b5b891700 1 --2- 172.21.15.44:0/962605357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572029f0c00 0x55720274c100 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x5572029aa390 tx=0x5572034882a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a036bc50524bb58 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:42.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b57889700 1 -- 172.21.15.44:0/962605357 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5572026f4f20 con 0x5572029f0c00 2024-09-13T18:31:42.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b57889700 1 -- 172.21.15.44:0/962605357 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557203493680 con 0x5572029f0c00 2024-09-13T18:31:42.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b57889700 1 -- 172.21.15.44:0/962605357 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5572026f5600 con 0x5572029f0c00 2024-09-13T18:31:42.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b5d8d8500 1 -- 172.21.15.44:0/962605357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572029f0c00 msgr2=0x55720274c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b5d8d8500 1 --2- 172.21.15.44:0/962605357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572029f0c00 0x55720274c100 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x5572029aa390 tx=0x5572034882a0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b5d8d8500 1 -- 172.21.15.44:0/962605357 shutdown_connections 2024-09-13T18:31:42.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b5d8d8500 1 --2- 172.21.15.44:0/962605357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572029f0c00 0x55720274c100 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b5d8d8500 1 --2- 172.21.15.44:0/962605357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572029f0800 0x55720274bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b5d8d8500 1 --2- 172.21.15.44:0/962605357 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5572029f0400 0x55720274b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b5d8d8500 1 -- 172.21.15.44:0/962605357 >> 172.21.15.44:0/962605357 conn(0x5572029f0000 msgr2=0x557202761800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:42.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b5d8d8500 1 -- 172.21.15.44:0/962605357 shutdown_connections 2024-09-13T18:31:42.870 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b5d8d8500 1 -- 172.21.15.44:0/962605357 wait complete. 2024-09-13T18:31:42.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b5d8d8500 1 Processor -- start 2024-09-13T18:31:42.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b5d8d8500 1 -- start start 2024-09-13T18:31:42.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b5d8d8500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5572029f0400 0x55720274d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b5d8d8500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572029f0800 0x55720274cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b5d8d8500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572029f0c00 0x55720274c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b5d8d8500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557202726280 con 0x5572029f0800 2024-09-13T18:31:42.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b5d8d8500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557202726140 con 0x5572029f0c00 2024-09-13T18:31:42.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b5d8d8500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x557202726000 con 0x5572029f0400 2024-09-13T18:31:42.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b5c092700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572029f0800 0x55720274cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b5c092700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572029f0800 0x55720274cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59596/0 (socket says 172.21.15.44:59596) 2024-09-13T18:31:42.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b5c092700 1 -- 172.21.15.44:0/2934744207 learned_addr learned my addr 172.21.15.44:0/2934744207 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:42.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b5c893700 1 --2- 172.21.15.44:0/2934744207 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5572029f0400 0x55720274d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.861+0000 7f4b5b891700 1 --2- 172.21.15.44:0/2934744207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572029f0c00 0x55720274c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.873 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.865+0000 7f4b5c092700 1 -- 172.21.15.44:0/2934744207 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5572029f0400 msgr2=0x55720274d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.865+0000 7f4b5c092700 1 --2- 172.21.15.44:0/2934744207 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5572029f0400 0x55720274d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.865+0000 7f4b5c092700 1 -- 172.21.15.44:0/2934744207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572029f0c00 msgr2=0x55720274c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.865+0000 7f4b5c092700 1 --2- 172.21.15.44:0/2934744207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572029f0c00 0x55720274c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.865+0000 7f4b5c092700 1 -- 172.21.15.44:0/2934744207 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572026c89c0 con 0x5572029f0800 2024-09-13T18:31:42.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.865+0000 7f4b5c092700 1 --2- 172.21.15.44:0/2934744207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572029f0800 0x55720274cc00 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x5572029ab560 tx=0x557203488000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:42.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.865+0000 7f4b56086700 1 -- 172.21.15.44:0/2934744207 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5572026f5080 con 0x5572029f0800 2024-09-13T18:31:42.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.865+0000 7f4b56086700 1 -- 172.21.15.44:0/2934744207 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557203492180 con 0x5572029f0800 2024-09-13T18:31:42.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.865+0000 7f4b5d8d8500 1 -- 172.21.15.44:0/2934744207 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5572026c8b60 con 0x5572029f0800 2024-09-13T18:31:42.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.865+0000 7f4b56086700 1 -- 172.21.15.44:0/2934744207 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5572026f4f20 con 0x5572029f0800 2024-09-13T18:31:42.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.865+0000 7f4b5d8d8500 1 -- 172.21.15.44:0/2934744207 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572026c8340 con 0x5572029f0800 2024-09-13T18:31:42.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.865+0000 7f4b56086700 1 -- 172.21.15.44:0/2934744207 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x557202704840 con 0x5572029f0800 2024-09-13T18:31:42.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b56086700 1 --2- 172.21.15.44:0/2934744207 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5572029f1800 0x55720274d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b56086700 1 -- 172.21.15.44:0/2934744207 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x5572026dea80 con 0x5572029f0800 2024-09-13T18:31:42.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5d8d8500 1 --2- 172.21.15.44:0/2934744207 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5572029f1c00 0x55720274c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5c893700 1 --2- 172.21.15.44:0/2934744207 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5572029f1800 0x55720274d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5d8d8500 1 -- 172.21.15.44:0/2934744207 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x557202afc000 con 0x5572029f1c00 2024-09-13T18:31:42.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5b891700 1 --2- 172.21.15.44:0/2934744207 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5572029f1c00 0x55720274c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5b891700 1 --2- 172.21.15.44:0/2934744207 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5572029f1c00 0x55720274c100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:42.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5c893700 1 --2- 172.21.15.44:0/2934744207 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5572029f1800 0x55720274d700 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x5572027fe900 tx=0x5572029b1ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:42.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5b891700 1 -- 172.21.15.44:0/2934744207 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x557203520b40 con 0x5572029f1c00 2024-09-13T18:31:42.877 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5d8d8500 1 -- 172.21.15.44:0/2934744207 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x557202afc400 con 0x5572029f1c00 2024-09-13T18:31:42.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5b891700 1 -- 172.21.15.44:0/2934744207 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv12 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x557203520b40 con 0x5572029f1c00 2024-09-13T18:31:42.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5d8d8500 1 -- 172.21.15.44:0/2934744207 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5572029f1c00 msgr2=0x55720274c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5d8d8500 1 --2- 172.21.15.44:0/2934744207 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5572029f1c00 0x55720274c100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.878 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5d8d8500 1 -- 172.21.15.44:0/2934744207 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5572029f1800 msgr2=0x55720274d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5d8d8500 1 --2- 172.21.15.44:0/2934744207 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5572029f1800 0x55720274d700 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x5572027fe900 tx=0x5572029b1ec0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5d8d8500 1 -- 172.21.15.44:0/2934744207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572029f0800 msgr2=0x55720274cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5d8d8500 1 --2- 172.21.15.44:0/2934744207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572029f0800 0x55720274cc00 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x5572029ab560 tx=0x557203488000 comp rx=0 tx=0).stop 2024-09-13T18:31:42.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5c092700 1 -- 172.21.15.44:0/2934744207 reap_dead start 2024-09-13T18:31:42.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5d8d8500 1 -- 172.21.15.44:0/2934744207 shutdown_connections 2024-09-13T18:31:42.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5d8d8500 1 -- 172.21.15.44:0/2934744207 >> 172.21.15.44:0/2934744207 conn(0x5572029f0000 msgr2=0x557202761800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:42.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5d8d8500 1 -- 172.21.15.44:0/2934744207 shutdown_connections 2024-09-13T18:31:42.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5d8d8500 1 -- 172.21.15.44:0/2934744207 wait complete. 2024-09-13T18:31:42.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5d8d8500 1 -- 172.21.15.44:0/89011075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572026a5400 msgr2=0x55720274ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5d8d8500 1 --2- 172.21.15.44:0/89011075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572026a5400 0x55720274ab00 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x5572027ff4a0 tx=0x557203488480 comp rx=0 tx=0).stop 2024-09-13T18:31:42.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5d8d8500 1 -- 172.21.15.44:0/89011075 shutdown_connections 2024-09-13T18:31:42.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5d8d8500 1 --2- 172.21.15.44:0/89011075 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5572026a5800 0x55720274b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5d8d8500 1 --2- 172.21.15.44:0/89011075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572026a5400 0x55720274ab00 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5d8d8500 1 --2- 172.21.15.44:0/89011075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572026a5000 0x55720274a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5d8d8500 1 -- 172.21.15.44:0/89011075 >> 172.21.15.44:0/89011075 conn(0x5572026a4c00 msgr2=0x557202761000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:42.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5d8d8500 1 -- 172.21.15.44:0/89011075 shutdown_connections 2024-09-13T18:31:42.881 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.869+0000 7f4b5d8d8500 1 -- 172.21.15.44:0/89011075 wait complete. 2024-09-13T18:31:42.882 INFO:tasks.workunit.client.0.smithi044.stderr:+ HEADER_STATE='{ 2024-09-13T18:31:42.882 INFO:tasks.workunit.client.0.smithi044.stderr: "magic": "ceph fs volume v011", 2024-09-13T18:31:42.882 INFO:tasks.workunit.client.0.smithi044.stderr: "write_pos": 4200138, 2024-09-13T18:31:42.882 INFO:tasks.workunit.client.0.smithi044.stderr: "expire_pos": 4194304, 2024-09-13T18:31:42.882 INFO:tasks.workunit.client.0.smithi044.stderr: "trimmed_pos": 4194304, 2024-09-13T18:31:42.883 INFO:tasks.workunit.client.0.smithi044.stderr: "stream_format": 1, 2024-09-13T18:31:42.883 INFO:tasks.workunit.client.0.smithi044.stderr: "layout": { 2024-09-13T18:31:42.883 INFO:tasks.workunit.client.0.smithi044.stderr: "stripe_unit": 4194304, 2024-09-13T18:31:42.883 INFO:tasks.workunit.client.0.smithi044.stderr: "stripe_count": 1, 2024-09-13T18:31:42.883 INFO:tasks.workunit.client.0.smithi044.stderr: "object_size": 4194304, 2024-09-13T18:31:42.883 INFO:tasks.workunit.client.0.smithi044.stderr: "pool_id": 6, 2024-09-13T18:31:42.883 INFO:tasks.workunit.client.0.smithi044.stderr: "pool_ns": "" 2024-09-13T18:31:42.883 INFO:tasks.workunit.client.0.smithi044.stderr: } 2024-09-13T18:31:42.883 INFO:tasks.workunit.client.0.smithi044.stderr:}' 2024-09-13T18:31:42.883 INFO:tasks.workunit.client.0.smithi044.stderr:++ cephfs-journal-tool --rank=cephfs:0 event get list 2024-09-13T18:31:42.920 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f47069de500 1 -- start start 2024-09-13T18:31:42.920 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f47069de500 1 Processor -- start 2024-09-13T18:31:42.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f47069de500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560e35775000 0x560e3581ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f47069de500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e35775800 0x560e3581b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f47069de500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560e35775c00 0x560e3581b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f47069de500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e357abe00 con 0x560e35775800 2024-09-13T18:31:42.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f47069de500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e357f6a00 con 0x560e35775000 2024-09-13T18:31:42.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f47069de500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e357f6780 con 0x560e35775c00 2024-09-13T18:31:42.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f4704997700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e35775800 0x560e3581b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f4705999700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560e35775c00 0x560e3581b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f4704997700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e35775800 0x560e3581b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59626/0 (socket says 172.21.15.44:59626) 2024-09-13T18:31:42.923 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f4704997700 1 -- 172.21.15.44:0/3153813470 learned_addr learned my addr 172.21.15.44:0/3153813470 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:42.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f4705198700 1 --2- 172.21.15.44:0/3153813470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560e35775000 0x560e3581ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f4704997700 1 -- 172.21.15.44:0/3153813470 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560e35775c00 msgr2=0x560e3581b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:42.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f4704997700 1 --2- 172.21.15.44:0/3153813470 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560e35775c00 0x560e3581b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f4704997700 1 -- 172.21.15.44:0/3153813470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560e35775000 msgr2=0x560e3581ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:42.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f4704997700 1 --2- 172.21.15.44:0/3153813470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560e35775000 0x560e3581ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f4704997700 1 -- 172.21.15.44:0/3153813470 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e357989c0 con 0x560e35775800 2024-09-13T18:31:42.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f4704997700 1 --2- 172.21.15.44:0/3153813470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e35775800 0x560e3581b080 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x560e35849320 tx=0x560e3584b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d8a5de9b84241e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:42.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f4702993700 1 -- 172.21.15.44:0/3153813470 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560e357c5080 con 0x560e35775800 2024-09-13T18:31:42.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f4702993700 1 -- 172.21.15.44:0/3153813470 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560e3655a300 con 0x560e35775800 2024-09-13T18:31:42.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f4702993700 1 -- 172.21.15.44:0/3153813470 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560e357c5600 con 0x560e35775800 2024-09-13T18:31:42.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f47069de500 1 -- 172.21.15.44:0/3153813470 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e357981a0 con 0x560e35775800 2024-09-13T18:31:42.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f47069de500 1 -- 172.21.15.44:0/3153813470 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x560e357989c0 con 0x560e35775800 2024-09-13T18:31:42.926 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.913+0000 7f4702993700 1 -- 172.21.15.44:0/3153813470 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x560e357aec40 con 0x560e35775800 2024-09-13T18:31:42.926 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f4702993700 1 -- 172.21.15.44:0/3153813470 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x560e357b6f00 con 0x560e35775800 2024-09-13T18:31:42.926 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f47069de500 1 Processor -- start 2024-09-13T18:31:42.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f47069de500 1 -- start start 2024-09-13T18:31:42.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f47069de500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e35aac400 0x560e3581bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f47069de500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560e35aac800 0x560e3581c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f47069de500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560e35aacc00 0x560e3581c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f47069de500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e357f6640 con 0x560e35aac400 2024-09-13T18:31:42.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f47069de500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e357f6500 con 0x560e35aacc00 2024-09-13T18:31:42.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f47069de500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e357f6780 con 0x560e35aac800 2024-09-13T18:31:42.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f4705999700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e35aac400 0x560e3581bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f4705999700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e35aac400 0x560e3581bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59628/0 (socket says 172.21.15.44:59628) 2024-09-13T18:31:42.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f4705999700 1 -- 172.21.15.44:0/3979606122 learned_addr learned my addr 172.21.15.44:0/3979606122 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:42.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f4704997700 1 --2- 172.21.15.44:0/3979606122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560e35aacc00 0x560e3581c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f4705198700 1 --2- 172.21.15.44:0/3979606122 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560e35aac800 0x560e3581c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.927 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f4705999700 1 -- 172.21.15.44:0/3979606122 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560e35aac800 msgr2=0x560e3581c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:42.928 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f4705999700 1 --2- 172.21.15.44:0/3979606122 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560e35aac800 0x560e3581c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.928 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f4705999700 1 -- 172.21.15.44:0/3979606122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560e35aacc00 msgr2=0x560e3581c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:42.928 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f4705999700 1 --2- 172.21.15.44:0/3979606122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560e35aacc00 0x560e3581c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.928 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f4705999700 1 -- 172.21.15.44:0/3979606122 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e35798b60 con 0x560e35aac400 2024-09-13T18:31:42.928 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f4704997700 1 --2- 172.21.15.44:0/3979606122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560e35aacc00 0x560e3581c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:42.928 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f4705999700 1 --2- 172.21.15.44:0/3979606122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e35aac400 0x560e3581bb80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x560e35a6e2d0 tx=0x560e35ad8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e536c4eb48a7f11 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:42.929 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f470098f700 1 -- 172.21.15.44:0/3979606122 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560e357c5080 con 0x560e35aac400 2024-09-13T18:31:42.929 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f470098f700 1 -- 172.21.15.44:0/3979606122 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560e3655aa80 con 0x560e35aac400 2024-09-13T18:31:42.929 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.917+0000 7f470098f700 1 -- 172.21.15.44:0/3979606122 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560e357c5600 con 0x560e35aac400 2024-09-13T18:31:42.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.921+0000 7f47069de500 1 -- 172.21.15.44:0/3979606122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e35aac400 msgr2=0x560e3581bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.921+0000 7f47069de500 1 --2- 172.21.15.44:0/3979606122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e35aac400 0x560e3581bb80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x560e35a6e2d0 tx=0x560e35ad8000 comp rx=0 tx=0).stop 2024-09-13T18:31:42.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.921+0000 7f47069de500 1 -- 172.21.15.44:0/3979606122 shutdown_connections 2024-09-13T18:31:42.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.921+0000 7f47069de500 1 --2- 172.21.15.44:0/3979606122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560e35aacc00 0x560e3581c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.921+0000 7f47069de500 1 --2- 172.21.15.44:0/3979606122 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560e35aac800 0x560e3581c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.921+0000 7f47069de500 1 --2- 172.21.15.44:0/3979606122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e35aac400 0x560e3581bb80 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.921+0000 7f47069de500 1 -- 172.21.15.44:0/3979606122 >> 172.21.15.44:0/3979606122 conn(0x560e35aac000 msgr2=0x560e35831800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:42.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.921+0000 7f47069de500 1 -- 172.21.15.44:0/3979606122 shutdown_connections 2024-09-13T18:31:42.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.921+0000 7f47069de500 1 -- 172.21.15.44:0/3979606122 wait complete. 2024-09-13T18:31:42.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.921+0000 7f47069de500 1 Processor -- start 2024-09-13T18:31:42.930 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.921+0000 7f47069de500 1 -- start start 2024-09-13T18:31:42.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f47069de500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560e35aac400 0x560e3581bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f47069de500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560e35aac800 0x560e3581c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f47069de500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e35aacc00 0x560e3581c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f47069de500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e357f6a00 con 0x560e35aacc00 2024-09-13T18:31:42.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f47069de500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e357f63c0 con 0x560e35aac400 2024-09-13T18:31:42.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f47069de500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e357f6280 con 0x560e35aac800 2024-09-13T18:31:42.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f4704997700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e35aacc00 0x560e3581c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.933 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f4704997700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e35aacc00 0x560e3581c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59630/0 (socket says 172.21.15.44:59630) 2024-09-13T18:31:42.934 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f4704997700 1 -- 172.21.15.44:0/3627222032 learned_addr learned my addr 172.21.15.44:0/3627222032 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:42.934 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f4705999700 1 --2- 172.21.15.44:0/3627222032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560e35aac400 0x560e3581bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.934 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f4705198700 1 --2- 172.21.15.44:0/3627222032 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560e35aac800 0x560e3581c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.934 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f4704997700 1 -- 172.21.15.44:0/3627222032 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560e35aac800 msgr2=0x560e3581c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.934 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f4704997700 1 --2- 172.21.15.44:0/3627222032 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560e35aac800 0x560e3581c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.934 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f4704997700 1 -- 172.21.15.44:0/3627222032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560e35aac400 msgr2=0x560e3581bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.934 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f4704997700 1 --2- 172.21.15.44:0/3627222032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560e35aac400 0x560e3581bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.934 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f4704997700 1 -- 172.21.15.44:0/3627222032 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e35798340 con 0x560e35aacc00 2024-09-13T18:31:42.934 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f4705999700 1 --2- 172.21.15.44:0/3627222032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560e35aac400 0x560e3581bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:42.934 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f4705198700 1 --2- 172.21.15.44:0/3627222032 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560e35aac800 0x560e3581c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:42.934 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f4704997700 1 --2- 172.21.15.44:0/3627222032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e35aacc00 0x560e3581c680 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x560e35849770 tx=0x560e3584a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:42.934 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f46ff18c700 1 -- 172.21.15.44:0/3627222032 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560e357c51e0 con 0x560e35aacc00 2024-09-13T18:31:42.934 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f46ff18c700 1 -- 172.21.15.44:0/3627222032 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560e3655ac00 con 0x560e35aacc00 2024-09-13T18:31:42.935 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f47069de500 1 -- 172.21.15.44:0/3627222032 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560e35798000 con 0x560e35aacc00 2024-09-13T18:31:42.935 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f46ff18c700 1 -- 172.21.15.44:0/3627222032 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560e357c4f20 con 0x560e35aacc00 2024-09-13T18:31:42.935 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f47069de500 1 -- 172.21.15.44:0/3627222032 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e35798ea0 con 0x560e35aacc00 2024-09-13T18:31:42.935 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.925+0000 7f46ff18c700 1 -- 172.21.15.44:0/3627222032 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x560e357d4b00 con 0x560e35aacc00 2024-09-13T18:31:42.936 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.929+0000 7f46ff18c700 1 --2- 172.21.15.44:0/3627222032 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x560e35aad800 0x560e3581d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.936 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.929+0000 7f46ff18c700 1 -- 172.21.15.44:0/3627222032 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x560e357aea80 con 0x560e35aacc00 2024-09-13T18:31:42.936 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.929+0000 7f4705999700 1 --2- 172.21.15.44:0/3627222032 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x560e35aad800 0x560e3581d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.937 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.929+0000 7f47069de500 1 --2- 172.21.15.44:0/3627222032 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x560e35aadc00 0x560e3581cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.937 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.929+0000 7f47069de500 1 -- 172.21.15.44:0/3627222032 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x560e35bd8000 con 0x560e35aadc00 2024-09-13T18:31:42.937 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.929+0000 7f4705198700 1 --2- 172.21.15.44:0/3627222032 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x560e35aadc00 0x560e3581cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.937 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.929+0000 7f4705999700 1 --2- 172.21.15.44:0/3627222032 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x560e35aad800 0x560e3581d700 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x560e35a6e2d0 tx=0x560e3584a1e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:42.937 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.929+0000 7f4705198700 1 --2- 172.21.15.44:0/3627222032 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x560e35aadc00 0x560e3581cc00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:42.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.929+0000 7f4705198700 1 -- 172.21.15.44:0/3627222032 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x560e365ecb40 con 0x560e35aadc00 2024-09-13T18:31:42.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.929+0000 7f47069de500 1 -- 172.21.15.44:0/3627222032 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x560e35bd8400 con 0x560e35aadc00 2024-09-13T18:31:42.938 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.929+0000 7f4705198700 1 -- 172.21.15.44:0/3627222032 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv12 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x560e365ecb40 con 0x560e35aadc00 2024-09-13T18:31:42.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.929+0000 7f47069de500 1 -- 172.21.15.44:0/3627222032 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x560e35bd8800 con 0x560e35aadc00 2024-09-13T18:31:42.939 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f4705198700 1 -- 172.21.15.44:0/3627222032 <== osd.2 v2:172.21.15.44:6817/3180763837 3 ==== osd_op_reply(3 200.00000001 [read 0~31930 out=31930b] v0'0 uv19 ondisk = 0) v8 ==== 156+0+31930 (crc 0 0 0) 0x560e365ecb40 con 0x560e35aadc00 2024-09-13T18:31:42.940 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 --2- 172.21.15.44:0/3627222032 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x560e35bd8c00 0x560e3581d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.940 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 -- 172.21.15.44:0/3627222032 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x560e35bd9000 con 0x560e35bd8c00 2024-09-13T18:31:42.940 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f4705999700 1 --2- 172.21.15.44:0/3627222032 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x560e35bd8c00 0x560e3581d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.940 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f4705999700 1 --2- 172.21.15.44:0/3627222032 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x560e35bd8c00 0x560e3581d180 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:42.942 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f4705999700 1 -- 172.21.15.44:0/3627222032 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x560e35bef200 con 0x560e35bd8c00 2024-09-13T18:31:42.942 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 -- 172.21.15.44:0/3627222032 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x560e35aadc00 msgr2=0x560e3581cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.942 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 --2- 172.21.15.44:0/3627222032 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x560e35aadc00 0x560e3581cc00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.942 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 -- 172.21.15.44:0/3627222032 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x560e35bd8c00 msgr2=0x560e3581d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.942 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 --2- 172.21.15.44:0/3627222032 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x560e35bd8c00 0x560e3581d180 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.942 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 -- 172.21.15.44:0/3627222032 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x560e35aad800 msgr2=0x560e3581d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.942 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 --2- 172.21.15.44:0/3627222032 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x560e35aad800 0x560e3581d700 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x560e35a6e2d0 tx=0x560e3584a1e0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.942 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f4705198700 1 -- 172.21.15.44:0/3627222032 reap_dead start 2024-09-13T18:31:42.942 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 -- 172.21.15.44:0/3627222032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e35aacc00 msgr2=0x560e3581c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.942 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 --2- 172.21.15.44:0/3627222032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e35aacc00 0x560e3581c680 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x560e35849770 tx=0x560e3584a120 comp rx=0 tx=0).stop 2024-09-13T18:31:42.942 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 -- 172.21.15.44:0/3627222032 shutdown_connections 2024-09-13T18:31:42.943 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 --2- 172.21.15.44:0/3627222032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e35aacc00 0x560e3581c680 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.943 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 -- 172.21.15.44:0/3627222032 >> 172.21.15.44:0/3627222032 conn(0x560e35aac000 msgr2=0x560e35831800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:42.943 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 -- 172.21.15.44:0/3627222032 shutdown_connections 2024-09-13T18:31:42.943 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 -- 172.21.15.44:0/3627222032 wait complete. 2024-09-13T18:31:42.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 -- 172.21.15.44:0/3153813470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e35775800 msgr2=0x560e3581b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 --2- 172.21.15.44:0/3153813470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e35775800 0x560e3581b080 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x560e35849320 tx=0x560e3584b8c0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 -- 172.21.15.44:0/3153813470 shutdown_connections 2024-09-13T18:31:42.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 --2- 172.21.15.44:0/3153813470 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560e35775c00 0x560e3581b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 --2- 172.21.15.44:0/3153813470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e35775800 0x560e3581b080 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 --2- 172.21.15.44:0/3153813470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560e35775000 0x560e3581ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 -- 172.21.15.44:0/3153813470 >> 172.21.15.44:0/3153813470 conn(0x560e35774c00 msgr2=0x560e35831000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:42.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 -- 172.21.15.44:0/3153813470 shutdown_connections 2024-09-13T18:31:42.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.933+0000 7f47069de500 1 -- 172.21.15.44:0/3153813470 wait complete. 2024-09-13T18:31:42.947 INFO:tasks.workunit.client.0.smithi044.stderr:+ EVENT_LIST='2024-09-13T18:29:10.293432+0000 0x400000 SUBTREEMAP: () 2024-09-13T18:31:42.947 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:29:21.363645+0000 0x40037c SESSION: () 2024-09-13T18:31:42.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:29:22.936002+0000 0x400536 UPDATE: (setattr) 2024-09-13T18:31:42.948 INFO:tasks.workunit.client.0.smithi044.stderr: / 2024-09-13T18:31:42.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:29:22.967852+0000 0x400865 UPDATE: (mkdir) 2024-09-13T18:31:42.948 INFO:tasks.workunit.client.0.smithi044.stderr: client.0 2024-09-13T18:31:42.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:29:28.364947+0000 0x401045 UPDATE: (cap update) 2024-09-13T18:31:42.948 INFO:tasks.workunit.client.0.smithi044.stderr: client.0 2024-09-13T18:31:42.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:28.563856+0000 0x4016ca UPDATE: (mkdir) 2024-09-13T18:31:42.948 INFO:tasks.workunit.client.0.smithi044.stderr: client.0/tmp 2024-09-13T18:31:42.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:28.583132+0000 0x4021e8 UPDATE: (mkdir) 2024-09-13T18:31:42.948 INFO:tasks.workunit.client.0.smithi044.stderr: tmp/foo 2024-09-13T18:31:42.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:28.585974+0000 0x402ab8 UPDATE: (openc) 2024-09-13T18:31:42.948 INFO:tasks.workunit.client.0.smithi044.stderr: tmp/bar 2024-09-13T18:31:42.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:30.837213+0000 0x40325a UPDATE: (unlink_local) 2024-09-13T18:31:42.949 INFO:tasks.workunit.client.0.smithi044.stderr: stray1/10000000002 2024-09-13T18:31:42.949 INFO:tasks.workunit.client.0.smithi044.stderr: client.0/tmp/foo 2024-09-13T18:31:42.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:30.839608+0000 0x40445d UPDATE: (unlink_local) 2024-09-13T18:31:42.949 INFO:tasks.workunit.client.0.smithi044.stderr: stray1/10000000003 2024-09-13T18:31:42.949 INFO:tasks.workunit.client.0.smithi044.stderr: tmp/bar 2024-09-13T18:31:42.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:30.840036+0000 0x4050e6 UPDATE: (cap update) 2024-09-13T18:31:42.949 INFO:tasks.workunit.client.0.smithi044.stderr: stray1/10000000003 2024-09-13T18:31:42.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:30.850629+0000 0x405883 UPDATE: (unlink_local) 2024-09-13T18:31:42.949 INFO:tasks.workunit.client.0.smithi044.stderr: stray1/10000000001 2024-09-13T18:31:42.949 INFO:tasks.workunit.client.0.smithi044.stderr: client.0/tmp 2024-09-13T18:31:42.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:31.142141+0000 0x4064eb UPDATE: (unlink_local) 2024-09-13T18:31:42.949 INFO:tasks.workunit.client.0.smithi044.stderr: client.0 2024-09-13T18:31:42.949 INFO:tasks.workunit.client.0.smithi044.stderr: stray1/10000000000 2024-09-13T18:31:42.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:33.381287+0000 0x40704a UPDATE: (purge_stray) 2024-09-13T18:31:42.950 INFO:tasks.workunit.client.0.smithi044.stderr: 10000000001 2024-09-13T18:31:42.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:33.381436+0000 0x4072a1 UPDATE: (purge_stray) 2024-09-13T18:31:42.950 INFO:tasks.workunit.client.0.smithi044.stderr: 10000000002 2024-09-13T18:31:42.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:33.381586+0000 0x4074f8 UPDATE: (purge_stray) 2024-09-13T18:31:42.950 INFO:tasks.workunit.client.0.smithi044.stderr: 10000000003 2024-09-13T18:31:42.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:34.563185+0000 0x40774f UPDATE: (scatter_writebehind) 2024-09-13T18:31:42.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:34.564890+0000 0x407bc1 SESSION: () 2024-09-13T18:31:42.950 INFO:tasks.workunit.client.0.smithi044.stderr:0.000000 0x407c6e PURGED: ()' 2024-09-13T18:31:42.950 INFO:tasks.workunit.client.0.smithi044.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal export /tmp/journal.bin 2024-09-13T18:31:42.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.977+0000 7f9b24728500 1 -- start start 2024-09-13T18:31:42.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b24728500 1 Processor -- start 2024-09-13T18:31:42.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b24728500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c33cdd9800 0x55c33ce7e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b24728500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33cdd9400 0x55c33ce7eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b24728500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c33cdd9000 0x55c33ce7f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b24728500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c33ce5aa00 con 0x55c33cdd9400 2024-09-13T18:31:42.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b24728500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c33ce0fe00 con 0x55c33cdd9800 2024-09-13T18:31:42.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b24728500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c33ce5a640 con 0x55c33cdd9000 2024-09-13T18:31:42.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b226e1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33cdd9400 0x55c33ce7eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b226e1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33cdd9400 0x55c33ce7eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59658/0 (socket says 172.21.15.44:59658) 2024-09-13T18:31:42.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b226e1700 1 -- 172.21.15.44:0/733832964 learned_addr learned my addr 172.21.15.44:0/733832964 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:42.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b236e3700 1 --2- 172.21.15.44:0/733832964 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c33cdd9000 0x55c33ce7f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.991 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b22ee2700 1 --2- 172.21.15.44:0/733832964 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c33cdd9800 0x55c33ce7e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b226e1700 1 -- 172.21.15.44:0/733832964 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c33cdd9000 msgr2=0x55c33ce7f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:42.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b226e1700 1 --2- 172.21.15.44:0/733832964 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c33cdd9000 0x55c33ce7f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b226e1700 1 -- 172.21.15.44:0/733832964 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c33cdd9800 msgr2=0x55c33ce7e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:42.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b226e1700 1 --2- 172.21.15.44:0/733832964 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c33cdd9800 0x55c33ce7e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b226e1700 1 -- 172.21.15.44:0/733832964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c33cdfc9c0 con 0x55c33cdd9400 2024-09-13T18:31:42.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b22ee2700 1 --2- 172.21.15.44:0/733832964 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c33cdd9800 0x55c33ce7e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:42.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b236e3700 1 --2- 172.21.15.44:0/733832964 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c33cdd9000 0x55c33ce7f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:42.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b226e1700 1 --2- 172.21.15.44:0/733832964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33cdd9400 0x55c33ce7eb00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x55c33cead380 tx=0x55c33dc52180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a585fa4ce7d23696 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:42.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b206dd700 1 -- 172.21.15.44:0/733832964 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c33ce29600 con 0x55c33cdd9400 2024-09-13T18:31:42.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b206dd700 1 -- 172.21.15.44:0/733832964 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c33ce24900 con 0x55c33cdd9400 2024-09-13T18:31:42.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b206dd700 1 -- 172.21.15.44:0/733832964 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c33ce291e0 con 0x55c33cdd9400 2024-09-13T18:31:42.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b24728500 1 -- 172.21.15.44:0/733832964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c33cdfcb60 con 0x55c33cdd9400 2024-09-13T18:31:42.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b24728500 1 -- 172.21.15.44:0/733832964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55c33cdfc340 con 0x55c33cdd9400 2024-09-13T18:31:42.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b206dd700 1 -- 172.21.15.44:0/733832964 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x55c33ce12c40 con 0x55c33cdd9400 2024-09-13T18:31:42.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.981+0000 7f9b206dd700 1 -- 172.21.15.44:0/733832964 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x55c33dc62900 con 0x55c33cdd9400 2024-09-13T18:31:42.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b24728500 1 Processor -- start 2024-09-13T18:31:42.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b24728500 1 -- start start 2024-09-13T18:31:42.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b24728500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c33dc5c400 0x55c33ce7f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.995 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b24728500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c33dc5c800 0x55c33ce7fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b24728500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33dc5cc00 0x55c33ce80100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b24728500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c33ce5a500 con 0x55c33dc5cc00 2024-09-13T18:31:42.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b24728500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c33ce5a3c0 con 0x55c33dc5c800 2024-09-13T18:31:42.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b24728500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c33ce5a280 con 0x55c33dc5c400 2024-09-13T18:31:42.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b226e1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33dc5cc00 0x55c33ce80100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b226e1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33dc5cc00 0x55c33ce80100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59672/0 (socket says 172.21.15.44:59672) 2024-09-13T18:31:42.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b226e1700 1 -- 172.21.15.44:0/1432209004 learned_addr learned my addr 172.21.15.44:0/1432209004 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:42.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b22ee2700 1 --2- 172.21.15.44:0/1432209004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c33dc5c800 0x55c33ce7fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b236e3700 1 --2- 172.21.15.44:0/1432209004 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c33dc5c400 0x55c33ce7f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b226e1700 1 -- 172.21.15.44:0/1432209004 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c33dc5c400 msgr2=0x55c33ce7f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:42.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b226e1700 1 --2- 172.21.15.44:0/1432209004 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c33dc5c400 0x55c33ce7f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.996 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b226e1700 1 -- 172.21.15.44:0/1432209004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c33dc5c800 msgr2=0x55c33ce7fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:42.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b226e1700 1 --2- 172.21.15.44:0/1432209004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c33dc5c800 0x55c33ce7fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b226e1700 1 -- 172.21.15.44:0/1432209004 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c33cdfc000 con 0x55c33dc5cc00 2024-09-13T18:31:42.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b226e1700 1 --2- 172.21.15.44:0/1432209004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33dc5cc00 0x55c33ce80100 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x55c33cead7d0 tx=0x55c33dc52060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161be32aa94f03c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:42.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b1e6d9700 1 -- 172.21.15.44:0/1432209004 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c33ce28f20 con 0x55c33dc5cc00 2024-09-13T18:31:42.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b1e6d9700 1 -- 172.21.15.44:0/1432209004 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c33cf39680 con 0x55c33dc5cc00 2024-09-13T18:31:42.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b1e6d9700 1 -- 172.21.15.44:0/1432209004 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c33ce29600 con 0x55c33dc5cc00 2024-09-13T18:31:42.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b24728500 1 -- 172.21.15.44:0/1432209004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33dc5cc00 msgr2=0x55c33ce80100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b24728500 1 --2- 172.21.15.44:0/1432209004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33dc5cc00 0x55c33ce80100 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x55c33cead7d0 tx=0x55c33dc52060 comp rx=0 tx=0).stop 2024-09-13T18:31:42.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b24728500 1 -- 172.21.15.44:0/1432209004 shutdown_connections 2024-09-13T18:31:42.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b24728500 1 --2- 172.21.15.44:0/1432209004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33dc5cc00 0x55c33ce80100 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b24728500 1 --2- 172.21.15.44:0/1432209004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c33dc5c800 0x55c33ce7fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b24728500 1 --2- 172.21.15.44:0/1432209004 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c33dc5c400 0x55c33ce7f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.997 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.985+0000 7f9b24728500 1 -- 172.21.15.44:0/1432209004 >> 172.21.15.44:0/1432209004 conn(0x55c33cdd8c00 msgr2=0x55c33ce95800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:42.998 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.989+0000 7f9b24728500 1 -- 172.21.15.44:0/1432209004 shutdown_connections 2024-09-13T18:31:42.998 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.989+0000 7f9b24728500 1 -- 172.21.15.44:0/1432209004 wait complete. 2024-09-13T18:31:43.000 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.989+0000 7f9b24728500 1 Processor -- start 2024-09-13T18:31:43.000 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.989+0000 7f9b24728500 1 -- start start 2024-09-13T18:31:43.000 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.989+0000 7f9b24728500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c33dc5c400 0x55c33ce81180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.000 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.989+0000 7f9b24728500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c33dc5c800 0x55c33ce80c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.000 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.989+0000 7f9b24728500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33dc5cc00 0x55c33ce80680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.000 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.989+0000 7f9b24728500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c33ce5aa00 con 0x55c33dc5cc00 2024-09-13T18:31:43.000 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.989+0000 7f9b24728500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c33ce5a280 con 0x55c33dc5c800 2024-09-13T18:31:43.000 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.989+0000 7f9b24728500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c33ce5a3c0 con 0x55c33dc5c400 2024-09-13T18:31:43.000 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.989+0000 7f9b226e1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33dc5cc00 0x55c33ce80680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.000 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.989+0000 7f9b226e1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33dc5cc00 0x55c33ce80680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59676/0 (socket says 172.21.15.44:59676) 2024-09-13T18:31:43.000 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.989+0000 7f9b226e1700 1 -- 172.21.15.44:0/561161096 learned_addr learned my addr 172.21.15.44:0/561161096 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.001 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.989+0000 7f9b236e3700 1 --2- 172.21.15.44:0/561161096 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c33dc5c400 0x55c33ce81180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.001 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.989+0000 7f9b22ee2700 1 --2- 172.21.15.44:0/561161096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c33dc5c800 0x55c33ce80c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.001 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.989+0000 7f9b226e1700 1 -- 172.21.15.44:0/561161096 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c33dc5c400 msgr2=0x55c33ce81180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.001 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.989+0000 7f9b226e1700 1 --2- 172.21.15.44:0/561161096 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c33dc5c400 0x55c33ce81180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.001 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.989+0000 7f9b226e1700 1 -- 172.21.15.44:0/561161096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c33dc5c800 msgr2=0x55c33ce80c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.001 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.989+0000 7f9b226e1700 1 --2- 172.21.15.44:0/561161096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c33dc5c800 0x55c33ce80c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.001 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.989+0000 7f9b226e1700 1 -- 172.21.15.44:0/561161096 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c33cdfc9c0 con 0x55c33dc5cc00 2024-09-13T18:31:43.001 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.993+0000 7f9b226e1700 1 --2- 172.21.15.44:0/561161096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33dc5cc00 0x55c33ce80680 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x55c33cead770 tx=0x55c33d0dacc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.001 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.993+0000 7f9b1ced6700 1 -- 172.21.15.44:0/561161096 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c33ce291e0 con 0x55c33dc5cc00 2024-09-13T18:31:43.001 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.993+0000 7f9b1ced6700 1 -- 172.21.15.44:0/561161096 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c33cf38d80 con 0x55c33dc5cc00 2024-09-13T18:31:43.001 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.993+0000 7f9b24728500 1 -- 172.21.15.44:0/561161096 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c33cdfcb60 con 0x55c33dc5cc00 2024-09-13T18:31:43.001 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.993+0000 7f9b1ced6700 1 -- 172.21.15.44:0/561161096 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c33ce28dc0 con 0x55c33dc5cc00 2024-09-13T18:31:43.001 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.993+0000 7f9b24728500 1 -- 172.21.15.44:0/561161096 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c33cdfc340 con 0x55c33dc5cc00 2024-09-13T18:31:43.002 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.993+0000 7f9b1ced6700 1 -- 172.21.15.44:0/561161096 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x55c33ce38b00 con 0x55c33dc5cc00 2024-09-13T18:31:43.003 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.993+0000 7f9b1ced6700 1 --2- 172.21.15.44:0/561161096 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55c33d134400 0x55c33ce81700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.003 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.997+0000 7f9b1ced6700 1 -- 172.21.15.44:0/561161096 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x55c33ce12a80 con 0x55c33dc5cc00 2024-09-13T18:31:43.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.997+0000 7f9b236e3700 1 --2- 172.21.15.44:0/561161096 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55c33d134400 0x55c33ce81700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.997+0000 7f9b24728500 1 --2- 172.21.15.44:0/561161096 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55c33dc5d000 0x55c33ce80100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.997+0000 7f9b24728500 1 -- 172.21.15.44:0/561161096 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55c33dc5d400 con 0x55c33dc5d000 2024-09-13T18:31:43.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.997+0000 7f9b22ee2700 1 --2- 172.21.15.44:0/561161096 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55c33dc5d000 0x55c33ce80100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.004 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.997+0000 7f9b236e3700 1 --2- 172.21.15.44:0/561161096 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55c33d134400 0x55c33ce81700 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55c33ceac870 tx=0x55c33d0dad80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.997+0000 7f9b22ee2700 1 --2- 172.21.15.44:0/561161096 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55c33dc5d000 0x55c33ce80100 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.997+0000 7f9b22ee2700 1 -- 172.21.15.44:0/561161096 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55c33dc48b40 con 0x55c33dc5d000 2024-09-13T18:31:43.005 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.997+0000 7f9b24728500 1 -- 172.21.15.44:0/561161096 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55c33dc5d800 con 0x55c33dc5d000 2024-09-13T18:31:43.006 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.997+0000 7f9b22ee2700 1 -- 172.21.15.44:0/561161096 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv12 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55c33dc48b40 con 0x55c33dc5d000 2024-09-13T18:31:43.006 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.997+0000 7f9b24728500 1 -- 172.21.15.44:0/561161096 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55c33d134800 con 0x55c33dc5d000 2024-09-13T18:31:43.006 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.997+0000 7f9b22ee2700 1 -- 172.21.15.44:0/561161096 <== osd.2 v2:172.21.15.44:6817/3180763837 3 ==== osd_op_reply(3 200.00000001 [read 0~31930 out=31930b] v0'0 uv19 ondisk = 0) v8 ==== 156+0+31930 (crc 0 0 0) 0x55c33dc48b40 con 0x55c33dc5d000 2024-09-13T18:31:43.007 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.997+0000 7f9b24728500 1 --2- 172.21.15.44:0/561161096 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55c33d134c00 0x55c33ce7fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.007 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.997+0000 7f9b24728500 1 -- 172.21.15.44:0/561161096 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55c33d135000 con 0x55c33d134c00 2024-09-13T18:31:43.007 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:42.997+0000 7f9b236e3700 1 --2- 172.21.15.44:0/561161096 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55c33d134c00 0x55c33ce7fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.007 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.001+0000 7f9b236e3700 1 --2- 172.21.15.44:0/561161096 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55c33d134c00 0x55c33ce7fb80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.007 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.001+0000 7f9b236e3700 1 -- 172.21.15.44:0/561161096 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55c33d24f200 con 0x55c33d134c00 2024-09-13T18:31:43.009 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.001+0000 7f9b24728500 1 -- start start 2024-09-13T18:31:43.009 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.001+0000 7f9b24728500 1 Processor -- start 2024-09-13T18:31:43.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.001+0000 7f9b24728500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33d135800 0x55c33ce7f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.001+0000 7f9b24728500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c33dc5d400 0x55c33d2a2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.001+0000 7f9b24728500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c33dc5d800 0x55c33d2a2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.001+0000 7f9b24728500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c33ce5a640 con 0x55c33d135800 2024-09-13T18:31:43.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.001+0000 7f9b24728500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c33ce5a140 con 0x55c33dc5d400 2024-09-13T18:31:43.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.001+0000 7f9b24728500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c33ce5a3c0 con 0x55c33dc5d800 2024-09-13T18:31:43.011 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.001+0000 7f9b226e1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33d135800 0x55c33ce7f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.012 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.001+0000 7f9b226e1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33d135800 0x55c33ce7f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59686/0 (socket says 172.21.15.44:59686) 2024-09-13T18:31:43.012 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.001+0000 7f9b226e1700 1 -- 172.21.15.44:0/1983262973 learned_addr learned my addr 172.21.15.44:0/1983262973 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.012 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.001+0000 7f9b22ee2700 1 --2- 172.21.15.44:0/1983262973 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c33dc5d800 0x55c33d2a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.012 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.001+0000 7f9b236e3700 1 --2- 172.21.15.44:0/1983262973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c33dc5d400 0x55c33d2a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.012 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.001+0000 7f9b226e1700 1 -- 172.21.15.44:0/1983262973 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c33dc5d800 msgr2=0x55c33d2a2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.012 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.001+0000 7f9b226e1700 1 --2- 172.21.15.44:0/1983262973 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c33dc5d800 0x55c33d2a2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.012 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.001+0000 7f9b226e1700 1 -- 172.21.15.44:0/1983262973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c33dc5d400 msgr2=0x55c33d2a2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.012 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.001+0000 7f9b226e1700 1 --2- 172.21.15.44:0/1983262973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c33dc5d400 0x55c33d2a2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.012 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.001+0000 7f9b226e1700 1 -- 172.21.15.44:0/1983262973 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c33d177860 con 0x55c33d135800 2024-09-13T18:31:43.012 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.001+0000 7f9b226e1700 1 --2- 172.21.15.44:0/1983262973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33d135800 0x55c33ce7f600 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x55c33d1891d0 tx=0x55c33d250c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d12849ea937bc451 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.014 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.005+0000 7f9b19ed0700 1 -- 172.21.15.44:0/1983262973 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c33ce286e0 con 0x55c33d135800 2024-09-13T18:31:43.015 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.005+0000 7f9b19ed0700 1 -- 172.21.15.44:0/1983262973 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c33cf38a80 con 0x55c33d135800 2024-09-13T18:31:43.015 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.005+0000 7f9b19ed0700 1 -- 172.21.15.44:0/1983262973 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c33ce289a0 con 0x55c33d135800 2024-09-13T18:31:43.015 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.005+0000 7f9b24728500 1 -- 172.21.15.44:0/1983262973 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c33d1776c0 con 0x55c33d135800 2024-09-13T18:31:43.015 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.005+0000 7f9b24728500 1 -- 172.21.15.44:0/1983262973 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55c33d175a00 con 0x55c33d135800 2024-09-13T18:31:43.015 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.005+0000 7f9b19ed0700 1 -- 172.21.15.44:0/1983262973 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x55c33ce128c0 con 0x55c33d135800 2024-09-13T18:31:43.015 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.005+0000 7f9b19ed0700 1 -- 172.21.15.44:0/1983262973 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x55c33d2ae300 con 0x55c33d135800 2024-09-13T18:31:43.015 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.005+0000 7f9b24728500 1 --2- 172.21.15.44:0/1983262973 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55c33d2c6000 0x55c33d2a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.015 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.005+0000 7f9b24728500 1 -- 172.21.15.44:0/1983262973 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55c33d2c6400 con 0x55c33d2c6000 2024-09-13T18:31:43.015 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.005+0000 7f9b236e3700 1 --2- 172.21.15.44:0/1983262973 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55c33d2c6000 0x55c33d2a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.015 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.005+0000 7f9b236e3700 1 --2- 172.21.15.44:0/1983262973 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55c33d2c6000 0x55c33d2a2b00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=803d2acbde96d068 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.015 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.005+0000 7f9b236e3700 1 -- 172.21.15.44:0/1983262973 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55c33d24f200 con 0x55c33d2c6000 2024-09-13T18:31:43.015 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.005+0000 7f9b24728500 1 -- 172.21.15.44:0/1983262973 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55c33d2c6800 con 0x55c33d2c6000 2024-09-13T18:31:43.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.005+0000 7f9b236e3700 1 -- 172.21.15.44:0/1983262973 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv12 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55c33d24f200 con 0x55c33d2c6000 2024-09-13T18:31:43.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.005+0000 7f9b186cd700 1 -- 172.21.15.44:0/1983262973 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e51) v8 -- 0x55c33d135000 con 0x55c33d2c6000 2024-09-13T18:31:43.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.005+0000 7f9b186cd700 1 --2- 172.21.15.44:0/1983262973 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55c33d2c6400 0x55c33d2a4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.005+0000 7f9b186cd700 1 -- 172.21.15.44:0/1983262973 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e51) v8 -- 0x55c33d2d4000 con 0x55c33d2c6400 2024-09-13T18:31:43.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.005+0000 7f9b22ee2700 1 --2- 172.21.15.44:0/1983262973 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55c33d2c6400 0x55c33d2a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.005+0000 7f9b236e3700 1 -- 172.21.15.44:0/1983262973 <== osd.2 v2:172.21.15.44:6817/3180763837 3 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv19 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x55c33d24f200 con 0x55c33d2c6000 2024-09-13T18:31:43.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.005+0000 7f9b22ee2700 1 --2- 172.21.15.44:0/1983262973 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55c33d2c6400 0x55c33d2a4680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=87fbd5d82d3baf77 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.016 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.005+0000 7f9b22ee2700 1 -- 172.21.15.44:0/1983262973 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55c33dc48b40 con 0x55c33d2c6400 2024-09-13T18:31:43.017 INFO:tasks.workunit.client.0.smithi044.stdout:journal is 4194304~31930 2024-09-13T18:31:43.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 -- 172.21.15.44:0/1983262973 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:5 6.14 6:2e2fa760:::200.00000001:head [read 0~31930] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55c33d2c6c00 con 0x55c33d2c6000 2024-09-13T18:31:43.017 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b236e3700 1 -- 172.21.15.44:0/1983262973 <== osd.2 v2:172.21.15.44:6817/3180763837 4 ==== osd_op_reply(5 200.00000001 [read 0~31930 out=31930b] v0'0 uv19 ondisk = 0) v8 ==== 156+0+31930 (crc 0 0 0) 0x55c33d24f200 con 0x55c33d2c6000 2024-09-13T18:31:43.018 INFO:tasks.workunit.client.0.smithi044.stdout:wrote 31930 bytes at offset 4194304 to /tmp/journal.bin 2024-09-13T18:31:43.018 INFO:tasks.workunit.client.0.smithi044.stdout:NOTE: this is a _sparse_ file; you can 2024-09-13T18:31:43.018 INFO:tasks.workunit.client.0.smithi044.stdout: $ tar cSzf /tmp/journal.bin.tgz /tmp/journal.bin 2024-09-13T18:31:43.018 INFO:tasks.workunit.client.0.smithi044.stdout: to efficiently compress it while preserving sparseness. 2024-09-13T18:31:43.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 -- 172.21.15.44:0/1983262973 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55c33d2c6000 msgr2=0x55c33d2a2b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 --2- 172.21.15.44:0/1983262973 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55c33d2c6000 0x55c33d2a2b00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 -- 172.21.15.44:0/1983262973 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55c33d2c6400 msgr2=0x55c33d2a4680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 --2- 172.21.15.44:0/1983262973 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55c33d2c6400 0x55c33d2a4680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 -- 172.21.15.44:0/1983262973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33d135800 msgr2=0x55c33ce7f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 --2- 172.21.15.44:0/1983262973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33d135800 0x55c33ce7f600 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x55c33d1891d0 tx=0x55c33d250c60 comp rx=0 tx=0).stop 2024-09-13T18:31:43.020 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b22ee2700 1 -- 172.21.15.44:0/1983262973 reap_dead start 2024-09-13T18:31:43.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 -- 172.21.15.44:0/1983262973 shutdown_connections 2024-09-13T18:31:43.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 -- 172.21.15.44:0/1983262973 >> 172.21.15.44:0/1983262973 conn(0x55c33d135400 msgr2=0x55c33ce96000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 -- 172.21.15.44:0/1983262973 shutdown_connections 2024-09-13T18:31:43.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 -- 172.21.15.44:0/1983262973 wait complete. 2024-09-13T18:31:43.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 -- 172.21.15.44:0/561161096 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55c33dc5d000 msgr2=0x55c33ce80100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 --2- 172.21.15.44:0/561161096 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55c33dc5d000 0x55c33ce80100 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 -- 172.21.15.44:0/561161096 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55c33d134c00 msgr2=0x55c33ce7fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 --2- 172.21.15.44:0/561161096 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55c33d134c00 0x55c33ce7fb80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 -- 172.21.15.44:0/561161096 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55c33d134400 msgr2=0x55c33ce81700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 --2- 172.21.15.44:0/561161096 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55c33d134400 0x55c33ce81700 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55c33ceac870 tx=0x55c33d0dad80 comp rx=0 tx=0).stop 2024-09-13T18:31:43.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 -- 172.21.15.44:0/561161096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33dc5cc00 msgr2=0x55c33ce80680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b22ee2700 1 -- 172.21.15.44:0/561161096 reap_dead start 2024-09-13T18:31:43.021 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 --2- 172.21.15.44:0/561161096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33dc5cc00 0x55c33ce80680 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x55c33cead770 tx=0x55c33d0dacc0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 -- 172.21.15.44:0/561161096 shutdown_connections 2024-09-13T18:31:43.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 --2- 172.21.15.44:0/561161096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33dc5cc00 0x55c33ce80680 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 -- 172.21.15.44:0/561161096 >> 172.21.15.44:0/561161096 conn(0x55c33cdd8c00 msgr2=0x55c33ce95800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 -- 172.21.15.44:0/561161096 shutdown_connections 2024-09-13T18:31:43.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 -- 172.21.15.44:0/561161096 wait complete. 2024-09-13T18:31:43.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 -- 172.21.15.44:0/733832964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33cdd9400 msgr2=0x55c33ce7eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 --2- 172.21.15.44:0/733832964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33cdd9400 0x55c33ce7eb00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x55c33cead380 tx=0x55c33dc52180 comp rx=0 tx=0).stop 2024-09-13T18:31:43.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 -- 172.21.15.44:0/733832964 shutdown_connections 2024-09-13T18:31:43.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 --2- 172.21.15.44:0/733832964 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c33cdd9000 0x55c33ce7f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 --2- 172.21.15.44:0/733832964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c33cdd9400 0x55c33ce7eb00 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 --2- 172.21.15.44:0/733832964 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c33cdd9800 0x55c33ce7e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 -- 172.21.15.44:0/733832964 >> 172.21.15.44:0/733832964 conn(0x55c33cdd9c00 msgr2=0x55c33ce95000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 -- 172.21.15.44:0/733832964 shutdown_connections 2024-09-13T18:31:43.022 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.009+0000 7f9b24728500 1 -- 172.21.15.44:0/733832964 wait complete. 2024-09-13T18:31:43.023 INFO:tasks.workunit.client.0.smithi044.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal import /tmp/journal.bin 2024-09-13T18:31:43.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.053+0000 7f8b86204500 1 -- start start 2024-09-13T18:31:43.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.053+0000 7f8b86204500 1 Processor -- start 2024-09-13T18:31:43.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.053+0000 7f8b86204500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e73d309800 0x55e73d3ae580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.053+0000 7f8b86204500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d309400 0x55e73d3aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.053+0000 7f8b86204500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e73d309000 0x55e73d3af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.063 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.053+0000 7f8b86204500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e73d38a780 con 0x55e73d309400 2024-09-13T18:31:43.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.053+0000 7f8b86204500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e73d38aa00 con 0x55e73d309800 2024-09-13T18:31:43.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.053+0000 7f8b86204500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e73d38a640 con 0x55e73d309000 2024-09-13T18:31:43.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.053+0000 7f8b841bd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d309400 0x55e73d3aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.053+0000 7f8b841bd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d309400 0x55e73d3aeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59700/0 (socket says 172.21.15.44:59700) 2024-09-13T18:31:43.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.053+0000 7f8b841bd700 1 -- 172.21.15.44:0/25805154 learned_addr learned my addr 172.21.15.44:0/25805154 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.053+0000 7f8b851bf700 1 --2- 172.21.15.44:0/25805154 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e73d309000 0x55e73d3af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.053+0000 7f8b849be700 1 --2- 172.21.15.44:0/25805154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e73d309800 0x55e73d3ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.057+0000 7f8b841bd700 1 -- 172.21.15.44:0/25805154 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e73d309000 msgr2=0x55e73d3af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.057+0000 7f8b841bd700 1 --2- 172.21.15.44:0/25805154 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e73d309000 0x55e73d3af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.057+0000 7f8b841bd700 1 -- 172.21.15.44:0/25805154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e73d309800 msgr2=0x55e73d3ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.057+0000 7f8b841bd700 1 --2- 172.21.15.44:0/25805154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e73d309800 0x55e73d3ae580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.057+0000 7f8b841bd700 1 -- 172.21.15.44:0/25805154 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e73d32c9c0 con 0x55e73d309400 2024-09-13T18:31:43.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.057+0000 7f8b851bf700 1 --2- 172.21.15.44:0/25805154 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e73d309000 0x55e73d3af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:43.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.057+0000 7f8b841bd700 1 --2- 172.21.15.44:0/25805154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d309400 0x55e73d3aeb00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x55e73d3dd2c0 tx=0x55e73d3df8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9250703c74b1c89d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.057+0000 7f8b821b9700 1 -- 172.21.15.44:0/25805154 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e73d359080 con 0x55e73d309400 2024-09-13T18:31:43.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.057+0000 7f8b821b9700 1 -- 172.21.15.44:0/25805154 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e73d354180 con 0x55e73d309400 2024-09-13T18:31:43.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.057+0000 7f8b86204500 1 -- 172.21.15.44:0/25805154 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e73d32c1a0 con 0x55e73d309400 2024-09-13T18:31:43.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.057+0000 7f8b86204500 1 -- 172.21.15.44:0/25805154 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55e73d32c9c0 con 0x55e73d309400 2024-09-13T18:31:43.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.057+0000 7f8b821b9700 1 -- 172.21.15.44:0/25805154 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e73d359600 con 0x55e73d309400 2024-09-13T18:31:43.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.057+0000 7f8b821b9700 1 -- 172.21.15.44:0/25805154 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x55e73d342c40 con 0x55e73d309400 2024-09-13T18:31:43.066 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.057+0000 7f8b821b9700 1 -- 172.21.15.44:0/25805154 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x55e73d34af00 con 0x55e73d309400 2024-09-13T18:31:43.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.057+0000 7f8b86204500 1 Processor -- start 2024-09-13T18:31:43.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.057+0000 7f8b86204500 1 -- start start 2024-09-13T18:31:43.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b86204500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e73d5fe800 0x55e73d3af600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b86204500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d5fec00 0x55e73d3afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b86204500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e73d5ff000 0x55e73d3b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b86204500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e73d33fe00 con 0x55e73d5fec00 2024-09-13T18:31:43.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b86204500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e73d38aa00 con 0x55e73d5ff000 2024-09-13T18:31:43.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b86204500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e73d38a780 con 0x55e73d5fe800 2024-09-13T18:31:43.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b849be700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d5fec00 0x55e73d3afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b849be700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d5fec00 0x55e73d3afb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59704/0 (socket says 172.21.15.44:59704) 2024-09-13T18:31:43.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b849be700 1 -- 172.21.15.44:0/4036395801 learned_addr learned my addr 172.21.15.44:0/4036395801 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b851bf700 1 --2- 172.21.15.44:0/4036395801 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e73d5fe800 0x55e73d3af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b841bd700 1 --2- 172.21.15.44:0/4036395801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e73d5ff000 0x55e73d3b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.070 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b849be700 1 -- 172.21.15.44:0/4036395801 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e73d5fe800 msgr2=0x55e73d3af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.070 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b849be700 1 --2- 172.21.15.44:0/4036395801 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e73d5fe800 0x55e73d3af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.070 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b849be700 1 -- 172.21.15.44:0/4036395801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e73d5ff000 msgr2=0x55e73d3b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.070 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b849be700 1 --2- 172.21.15.44:0/4036395801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e73d5ff000 0x55e73d3b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b849be700 1 -- 172.21.15.44:0/4036395801 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e73d32cb60 con 0x55e73d5fec00 2024-09-13T18:31:43.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b841bd700 1 --2- 172.21.15.44:0/4036395801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e73d5ff000 0x55e73d3b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:43.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b849be700 1 --2- 172.21.15.44:0/4036395801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d5fec00 0x55e73d3afb80 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x55e73d614690 tx=0x55e73d66a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75820a2602ca21c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b801b5700 1 -- 172.21.15.44:0/4036395801 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e73d359080 con 0x55e73d5fec00 2024-09-13T18:31:43.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b801b5700 1 -- 172.21.15.44:0/4036395801 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e73d354900 con 0x55e73d5fec00 2024-09-13T18:31:43.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b801b5700 1 -- 172.21.15.44:0/4036395801 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e73d359600 con 0x55e73d5fec00 2024-09-13T18:31:43.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b86204500 1 -- 172.21.15.44:0/4036395801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d5fec00 msgr2=0x55e73d3afb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b86204500 1 --2- 172.21.15.44:0/4036395801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d5fec00 0x55e73d3afb80 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x55e73d614690 tx=0x55e73d66a000 comp rx=0 tx=0).stop 2024-09-13T18:31:43.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b86204500 1 -- 172.21.15.44:0/4036395801 shutdown_connections 2024-09-13T18:31:43.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b86204500 1 --2- 172.21.15.44:0/4036395801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e73d5ff000 0x55e73d3b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b86204500 1 --2- 172.21.15.44:0/4036395801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d5fec00 0x55e73d3afb80 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b86204500 1 --2- 172.21.15.44:0/4036395801 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e73d5fe800 0x55e73d3af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b86204500 1 -- 172.21.15.44:0/4036395801 >> 172.21.15.44:0/4036395801 conn(0x55e73d308c00 msgr2=0x55e73d3c5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b86204500 1 -- 172.21.15.44:0/4036395801 shutdown_connections 2024-09-13T18:31:43.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b86204500 1 -- 172.21.15.44:0/4036395801 wait complete. 2024-09-13T18:31:43.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b86204500 1 Processor -- start 2024-09-13T18:31:43.072 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b86204500 1 -- start start 2024-09-13T18:31:43.073 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b86204500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d5fe800 0x55e73d3b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b86204500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e73d5fec00 0x55e73d3b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b86204500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e73d5ff000 0x55e73d3b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b86204500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e73d38a500 con 0x55e73d5fe800 2024-09-13T18:31:43.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b86204500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e73d38a3c0 con 0x55e73d5fec00 2024-09-13T18:31:43.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b86204500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e73d38a280 con 0x55e73d5ff000 2024-09-13T18:31:43.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b851bf700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d5fe800 0x55e73d3b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b851bf700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d5fe800 0x55e73d3b1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59706/0 (socket says 172.21.15.44:59706) 2024-09-13T18:31:43.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.061+0000 7f8b851bf700 1 -- 172.21.15.44:0/1452647374 learned_addr learned my addr 172.21.15.44:0/1452647374 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.065+0000 7f8b849be700 1 --2- 172.21.15.44:0/1452647374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e73d5fec00 0x55e73d3b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.065+0000 7f8b841bd700 1 --2- 172.21.15.44:0/1452647374 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e73d5ff000 0x55e73d3b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.065+0000 7f8b851bf700 1 -- 172.21.15.44:0/1452647374 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e73d5ff000 msgr2=0x55e73d3b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.065+0000 7f8b851bf700 1 --2- 172.21.15.44:0/1452647374 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e73d5ff000 0x55e73d3b0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.065+0000 7f8b851bf700 1 -- 172.21.15.44:0/1452647374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e73d5fec00 msgr2=0x55e73d3b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.065+0000 7f8b851bf700 1 --2- 172.21.15.44:0/1452647374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e73d5fec00 0x55e73d3b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.065+0000 7f8b851bf700 1 -- 172.21.15.44:0/1452647374 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e73d32c340 con 0x55e73d5fe800 2024-09-13T18:31:43.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.065+0000 7f8b851bf700 1 --2- 172.21.15.44:0/1452647374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d5fe800 0x55e73d3b1180 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x55e73d615350 tx=0x55e73d66ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.065+0000 7f8b7e9b2700 1 -- 172.21.15.44:0/1452647374 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e73d359080 con 0x55e73d5fe800 2024-09-13T18:31:43.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.065+0000 7f8b7e9b2700 1 -- 172.21.15.44:0/1452647374 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e73e0f3800 con 0x55e73d5fe800 2024-09-13T18:31:43.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.065+0000 7f8b86204500 1 -- 172.21.15.44:0/1452647374 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e73d32c000 con 0x55e73d5fe800 2024-09-13T18:31:43.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.065+0000 7f8b7e9b2700 1 -- 172.21.15.44:0/1452647374 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e73d359600 con 0x55e73d5fe800 2024-09-13T18:31:43.075 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.065+0000 7f8b86204500 1 -- 172.21.15.44:0/1452647374 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e73d32cea0 con 0x55e73d5fe800 2024-09-13T18:31:43.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.065+0000 7f8b7e9b2700 1 -- 172.21.15.44:0/1452647374 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x55e73d368840 con 0x55e73d5fe800 2024-09-13T18:31:43.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.065+0000 7f8b7e9b2700 1 --2- 172.21.15.44:0/1452647374 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55e73d67cc00 0x55e73d3b1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.065+0000 7f8b7e9b2700 1 -- 172.21.15.44:0/1452647374 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x55e73d342a80 con 0x55e73d5fe800 2024-09-13T18:31:43.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.065+0000 7f8b849be700 1 --2- 172.21.15.44:0/1452647374 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55e73d67cc00 0x55e73d3b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.069+0000 7f8b849be700 1 --2- 172.21.15.44:0/1452647374 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55e73d67cc00 0x55e73d3b1700 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55e73d614690 tx=0x55e73e1920c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.069+0000 7f8b86204500 1 -- start start 2024-09-13T18:31:43.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.069+0000 7f8b86204500 1 Processor -- start 2024-09-13T18:31:43.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.069+0000 7f8b86204500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d5ff800 0x55e73d3b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.069+0000 7f8b86204500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e73d5ffc00 0x55e73d3afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.069+0000 7f8b86204500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e73d67d000 0x55e73d3af600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.069+0000 7f8b86204500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e73d38a3c0 con 0x55e73d5ff800 2024-09-13T18:31:43.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.069+0000 7f8b86204500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e73d38a780 con 0x55e73d67d000 2024-09-13T18:31:43.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.069+0000 7f8b86204500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e73d38aa00 con 0x55e73d5ffc00 2024-09-13T18:31:43.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.069+0000 7f8b851bf700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d5ff800 0x55e73d3b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.069+0000 7f8b851bf700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d5ff800 0x55e73d3b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59716/0 (socket says 172.21.15.44:59716) 2024-09-13T18:31:43.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.069+0000 7f8b851bf700 1 -- 172.21.15.44:0/4128630512 learned_addr learned my addr 172.21.15.44:0/4128630512 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.069+0000 7f8b849be700 1 --2- 172.21.15.44:0/4128630512 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e73d5ffc00 0x55e73d3afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.069+0000 7f8b841bd700 1 --2- 172.21.15.44:0/4128630512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e73d67d000 0x55e73d3af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.069+0000 7f8b851bf700 1 -- 172.21.15.44:0/4128630512 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e73d5ffc00 msgr2=0x55e73d3afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.069+0000 7f8b851bf700 1 --2- 172.21.15.44:0/4128630512 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e73d5ffc00 0x55e73d3afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.069+0000 7f8b851bf700 1 -- 172.21.15.44:0/4128630512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e73d67d000 msgr2=0x55e73d3af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.069+0000 7f8b851bf700 1 --2- 172.21.15.44:0/4128630512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e73d67d000 0x55e73d3af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.080 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.069+0000 7f8b851bf700 1 -- 172.21.15.44:0/4128630512 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e73d6af860 con 0x55e73d5ff800 2024-09-13T18:31:43.081 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.073+0000 7f8b851bf700 1 --2- 172.21.15.44:0/4128630512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d5ff800 0x55e73d3b0100 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x55e73d6b9290 tx=0x55e73d66b620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9e7a58726b0824 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.073+0000 7f8b7b9ac700 1 -- 172.21.15.44:0/4128630512 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e73d358420 con 0x55e73d5ff800 2024-09-13T18:31:43.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.073+0000 7f8b7b9ac700 1 -- 172.21.15.44:0/4128630512 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e73e0f3c80 con 0x55e73d5ff800 2024-09-13T18:31:43.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.073+0000 7f8b86204500 1 -- 172.21.15.44:0/4128630512 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e73d6adba0 con 0x55e73d5ff800 2024-09-13T18:31:43.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.073+0000 7f8b86204500 1 -- 172.21.15.44:0/4128630512 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55e73d6ada00 con 0x55e73d5ff800 2024-09-13T18:31:43.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.073+0000 7f8b7b9ac700 1 -- 172.21.15.44:0/4128630512 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e73d3586e0 con 0x55e73d5ff800 2024-09-13T18:31:43.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.073+0000 7f8b7b9ac700 1 -- 172.21.15.44:0/4128630512 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x55e73d3428c0 con 0x55e73d5ff800 2024-09-13T18:31:43.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.073+0000 7f8b7b9ac700 1 -- 172.21.15.44:0/4128630512 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x55e73d672900 con 0x55e73d5ff800 2024-09-13T18:31:43.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.073+0000 7f8b86204500 1 --2- 172.21.15.44:0/4128630512 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55e73d67d400 0x55e73d7d0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.073+0000 7f8b86204500 1 -- 172.21.15.44:0/4128630512 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55e73d67d800 con 0x55e73d67d400 2024-09-13T18:31:43.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.073+0000 7f8b849be700 1 --2- 172.21.15.44:0/4128630512 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55e73d67d400 0x55e73d7d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.073+0000 7f8b849be700 1 --2- 172.21.15.44:0/4128630512 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55e73d67d400 0x55e73d7d0000 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=f02a3728867173b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.082 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.073+0000 7f8b849be700 1 -- 172.21.15.44:0/4128630512 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55e73e0e8b40 con 0x55e73d67d400 2024-09-13T18:31:43.083 INFO:tasks.workunit.client.0.smithi044.stdout:undump /tmp/journal.bin 2024-09-13T18:31:43.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.073+0000 7f8b86204500 1 -- 172.21.15.44:0/4128630512 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55e73d67dc00 con 0x55e73d67d400 2024-09-13T18:31:43.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.073+0000 7f8b849be700 1 -- 172.21.15.44:0/4128630512 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv12 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55e73e0e8b40 con 0x55e73d67d400 2024-09-13T18:31:43.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.073+0000 7f8b7a1a9700 1 -- 172.21.15.44:0/4128630512 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e51) v8 -- 0x55e73d67d800 con 0x55e73d67d400 2024-09-13T18:31:43.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.073+0000 7f8b7a1a9700 1 --2- 172.21.15.44:0/4128630512 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55e73d67dc00 0x55e73d7d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.073+0000 7f8b7a1a9700 1 -- 172.21.15.44:0/4128630512 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e51) v8 -- 0x55e73d7dc000 con 0x55e73d67dc00 2024-09-13T18:31:43.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.073+0000 7f8b841bd700 1 --2- 172.21.15.44:0/4128630512 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55e73d67dc00 0x55e73d7d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.073+0000 7f8b849be700 1 -- 172.21.15.44:0/4128630512 <== osd.2 v2:172.21.15.44:6817/3180763837 3 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv19 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x55e73e0e8b40 con 0x55e73d67d400 2024-09-13T18:31:43.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.073+0000 7f8b841bd700 1 --2- 172.21.15.44:0/4128630512 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55e73d67dc00 0x55e73d7d2680 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=3fcd26e56c357395 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.084 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.073+0000 7f8b841bd700 1 -- 172.21.15.44:0/4128630512 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55e73e0e8d80 con 0x55e73d67dc00 2024-09-13T18:31:43.085 INFO:tasks.workunit.client.0.smithi044.stdout:start 4194304 len 31930 write_pos 4200138 format 1 trimmed_pos 4194304 stripe_unit 4194304 stripe_count 1 object_size 4194304 2024-09-13T18:31:43.085 INFO:tasks.workunit.client.0.smithi044.stdout:writing header 200.00000000 2024-09-13T18:31:43.085 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.073+0000 7f8b86204500 1 -- 172.21.15.44:0/4128630512 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:5 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x55e73d7dcc00 con 0x55e73d67d400 2024-09-13T18:31:43.086 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.077+0000 7f8b849be700 1 -- 172.21.15.44:0/4128630512 <== osd.2 v2:172.21.15.44:6817/3180763837 4 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v51'20 uv20 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55e73e0e8b40 con 0x55e73d67d400 2024-09-13T18:31:43.087 INFO:tasks.workunit.client.0.smithi044.stdout:Purging 2 objects from 1 2024-09-13T18:31:43.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.077+0000 7f8b86204500 1 -- 172.21.15.44:0/4128630512 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:6 6.14 6:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x55e73d7dd000 con 0x55e73d67d400 2024-09-13T18:31:43.087 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.077+0000 7f8b86204500 1 -- 172.21.15.44:0/4128630512 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:7 6.1b 6:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x55e73d7dd400 con 0x55e73d67dc00 2024-09-13T18:31:43.088 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.081+0000 7f8b841bd700 1 -- 172.21.15.44:0/4128630512 <== osd.3 v2:172.21.15.44:6808/771281770 2 ==== osd_op_reply(7 200.00000002 [delete] v51'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55e73e0e8d80 con 0x55e73d67dc00 2024-09-13T18:31:43.089 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.081+0000 7f8b849be700 1 -- 172.21.15.44:0/4128630512 <== osd.2 v2:172.21.15.44:6817/3180763837 5 ==== osd_op_reply(6 200.00000001 [delete] v51'21 uv21 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55e73e0e8b40 con 0x55e73d67d400 2024-09-13T18:31:43.089 INFO:tasks.workunit.client.0.smithi044.stdout: writing 4194304~31930 2024-09-13T18:31:43.090 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.081+0000 7f8b86204500 1 -- 172.21.15.44:0/4128630512 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:8 6.14 6:2e2fa760:::200.00000001:head [write 0~31930 in=31930b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x55e73d7dd800 con 0x55e73d67d400 2024-09-13T18:31:43.092 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b849be700 1 -- 172.21.15.44:0/4128630512 <== osd.2 v2:172.21.15.44:6817/3180763837 6 ==== osd_op_reply(8 200.00000001 [write 0~31930] v51'22 uv22 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55e73e0e8b40 con 0x55e73d67d400 2024-09-13T18:31:43.092 INFO:tasks.workunit.client.0.smithi044.stdout:done. 2024-09-13T18:31:43.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 -- 172.21.15.44:0/4128630512 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55e73d67d400 msgr2=0x55e73d7d0000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 --2- 172.21.15.44:0/4128630512 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55e73d67d400 0x55e73d7d0000 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 -- 172.21.15.44:0/4128630512 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55e73d67dc00 msgr2=0x55e73d7d2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 --2- 172.21.15.44:0/4128630512 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55e73d67dc00 0x55e73d7d2680 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 -- 172.21.15.44:0/4128630512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d5ff800 msgr2=0x55e73d3b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 --2- 172.21.15.44:0/4128630512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d5ff800 0x55e73d3b0100 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x55e73d6b9290 tx=0x55e73d66b620 comp rx=0 tx=0).stop 2024-09-13T18:31:43.094 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b841bd700 1 -- 172.21.15.44:0/4128630512 reap_dead start 2024-09-13T18:31:43.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 -- 172.21.15.44:0/4128630512 shutdown_connections 2024-09-13T18:31:43.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 -- 172.21.15.44:0/4128630512 >> 172.21.15.44:0/4128630512 conn(0x55e73d5ff400 msgr2=0x55e73d3c6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 -- 172.21.15.44:0/4128630512 shutdown_connections 2024-09-13T18:31:43.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 -- 172.21.15.44:0/4128630512 wait complete. 2024-09-13T18:31:43.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 -- 172.21.15.44:0/1452647374 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55e73d67cc00 msgr2=0x55e73d3b1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 --2- 172.21.15.44:0/1452647374 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55e73d67cc00 0x55e73d3b1700 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55e73d614690 tx=0x55e73e1920c0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 -- 172.21.15.44:0/1452647374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d5fe800 msgr2=0x55e73d3b1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 --2- 172.21.15.44:0/1452647374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d5fe800 0x55e73d3b1180 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x55e73d615350 tx=0x55e73d66ad20 comp rx=0 tx=0).stop 2024-09-13T18:31:43.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 -- 172.21.15.44:0/1452647374 shutdown_connections 2024-09-13T18:31:43.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 --2- 172.21.15.44:0/1452647374 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55e73d67cc00 0x55e73d3b1700 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 --2- 172.21.15.44:0/1452647374 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e73d5ff000 0x55e73d3b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 --2- 172.21.15.44:0/1452647374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e73d5fec00 0x55e73d3b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 --2- 172.21.15.44:0/1452647374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d5fe800 0x55e73d3b1180 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.095 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 -- 172.21.15.44:0/1452647374 >> 172.21.15.44:0/1452647374 conn(0x55e73d308c00 msgr2=0x55e73d3c5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 -- 172.21.15.44:0/1452647374 shutdown_connections 2024-09-13T18:31:43.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 -- 172.21.15.44:0/1452647374 wait complete. 2024-09-13T18:31:43.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 -- 172.21.15.44:0/25805154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d309400 msgr2=0x55e73d3aeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 --2- 172.21.15.44:0/25805154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d309400 0x55e73d3aeb00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x55e73d3dd2c0 tx=0x55e73d3df8c0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 -- 172.21.15.44:0/25805154 shutdown_connections 2024-09-13T18:31:43.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 --2- 172.21.15.44:0/25805154 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e73d309000 0x55e73d3af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 --2- 172.21.15.44:0/25805154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e73d309400 0x55e73d3aeb00 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 --2- 172.21.15.44:0/25805154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e73d309800 0x55e73d3ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 -- 172.21.15.44:0/25805154 >> 172.21.15.44:0/25805154 conn(0x55e73d309c00 msgr2=0x55e73d3c5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 -- 172.21.15.44:0/25805154 shutdown_connections 2024-09-13T18:31:43.096 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.085+0000 7f8b86204500 1 -- 172.21.15.44:0/25805154 wait complete. 2024-09-13T18:31:43.098 INFO:tasks.workunit.client.0.smithi044.stderr:++ cephfs-journal-tool --rank=cephfs:0 header get 2024-09-13T18:31:43.136 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.129+0000 7fe55a47e500 1 -- start start 2024-09-13T18:31:43.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.129+0000 7fe55a47e500 1 Processor -- start 2024-09-13T18:31:43.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.129+0000 7fe55a47e500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c577ce7800 0x55c577d8c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.129+0000 7fe55a47e500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c577ce7400 0x55c577d8cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.129+0000 7fe55a47e500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c577ce7000 0x55c577d8d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.129+0000 7fe55a47e500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c577d1de00 con 0x55c577ce7000 2024-09-13T18:31:43.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.129+0000 7fe55a47e500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c577d68a00 con 0x55c577ce7400 2024-09-13T18:31:43.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.129+0000 7fe55a47e500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c577d68640 con 0x55c577ce7800 2024-09-13T18:31:43.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.129+0000 7fe559439700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c577ce7000 0x55c577d8d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.129+0000 7fe559439700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c577ce7000 0x55c577d8d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59730/0 (socket says 172.21.15.44:59730) 2024-09-13T18:31:43.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.129+0000 7fe558c38700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c577ce7800 0x55c577d8c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.129+0000 7fe558437700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c577ce7400 0x55c577d8cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.129+0000 7fe559439700 1 -- 172.21.15.44:0/4264526941 learned_addr learned my addr 172.21.15.44:0/4264526941 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.129+0000 7fe559439700 1 -- 172.21.15.44:0/4264526941 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c577ce7800 msgr2=0x55c577d8c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.129+0000 7fe559439700 1 --2- 172.21.15.44:0/4264526941 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c577ce7800 0x55c577d8c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.129+0000 7fe559439700 1 -- 172.21.15.44:0/4264526941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c577ce7400 msgr2=0x55c577d8cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.129+0000 7fe559439700 1 --2- 172.21.15.44:0/4264526941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c577ce7400 0x55c577d8cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.129+0000 7fe559439700 1 -- 172.21.15.44:0/4264526941 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c577d0a9c0 con 0x55c577ce7000 2024-09-13T18:31:43.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.129+0000 7fe558437700 1 --2- 172.21.15.44:0/4264526941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c577ce7400 0x55c577d8cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:43.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.129+0000 7fe559439700 1 --2- 172.21.15.44:0/4264526941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c577ce7000 0x55c577d8d080 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x55c577dbb260 tx=0x55c577dbd8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4676b28e9bafd791 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.133+0000 7fe556433700 1 -- 172.21.15.44:0/4264526941 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c577d37080 con 0x55c577ce7000 2024-09-13T18:31:43.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.133+0000 7fe556433700 1 -- 172.21.15.44:0/4264526941 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c577d32900 con 0x55c577ce7000 2024-09-13T18:31:43.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.133+0000 7fe55a47e500 1 -- 172.21.15.44:0/4264526941 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c577d0a1a0 con 0x55c577ce7000 2024-09-13T18:31:43.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.133+0000 7fe55a47e500 1 -- 172.21.15.44:0/4264526941 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55c577d0a9c0 con 0x55c577ce7000 2024-09-13T18:31:43.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.133+0000 7fe556433700 1 -- 172.21.15.44:0/4264526941 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c577d37600 con 0x55c577ce7000 2024-09-13T18:31:43.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.133+0000 7fe556433700 1 -- 172.21.15.44:0/4264526941 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x55c577d20c40 con 0x55c577ce7000 2024-09-13T18:31:43.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.133+0000 7fe556433700 1 -- 172.21.15.44:0/4264526941 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x55c577d28f00 con 0x55c577ce7000 2024-09-13T18:31:43.141 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.133+0000 7fe55a47e500 1 Processor -- start 2024-09-13T18:31:43.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.133+0000 7fe55a47e500 1 -- start start 2024-09-13T18:31:43.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.133+0000 7fe55a47e500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c577fe2800 0x55c577d8d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.133+0000 7fe55a47e500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c577fe2c00 0x55c577d8db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.133+0000 7fe55a47e500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c577fe3000 0x55c577d8e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.133+0000 7fe55a47e500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c577d68500 con 0x55c577fe2800 2024-09-13T18:31:43.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe55a47e500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c577d683c0 con 0x55c577fe3000 2024-09-13T18:31:43.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe55a47e500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c577d68640 con 0x55c577fe2c00 2024-09-13T18:31:43.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe558437700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c577fe2800 0x55c577d8d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe558437700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c577fe2800 0x55c577d8d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59746/0 (socket says 172.21.15.44:59746) 2024-09-13T18:31:43.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe558437700 1 -- 172.21.15.44:0/1996353681 learned_addr learned my addr 172.21.15.44:0/1996353681 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.144 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe558c38700 1 --2- 172.21.15.44:0/1996353681 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c577fe2c00 0x55c577d8db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe558437700 1 -- 172.21.15.44:0/1996353681 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c577fe2c00 msgr2=0x55c577d8db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe558437700 1 --2- 172.21.15.44:0/1996353681 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c577fe2c00 0x55c577d8db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe558437700 1 -- 172.21.15.44:0/1996353681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c577fe3000 msgr2=0x55c577d8e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe558437700 1 --2- 172.21.15.44:0/1996353681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c577fe3000 0x55c577d8e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe558437700 1 -- 172.21.15.44:0/1996353681 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c577d0ab60 con 0x55c577fe2800 2024-09-13T18:31:43.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe558437700 1 --2- 172.21.15.44:0/1996353681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c577fe2800 0x55c577d8d600 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x55c57803a120 tx=0x55c577fd0120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1e5878de0eef3a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe55442f700 1 -- 172.21.15.44:0/1996353681 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c577d37080 con 0x55c577fe2800 2024-09-13T18:31:43.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe55442f700 1 -- 172.21.15.44:0/1996353681 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c577e4b200 con 0x55c577fe2800 2024-09-13T18:31:43.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe55442f700 1 -- 172.21.15.44:0/1996353681 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c577d37600 con 0x55c577fe2800 2024-09-13T18:31:43.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe55a47e500 1 -- 172.21.15.44:0/1996353681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c577fe2800 msgr2=0x55c577d8d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe55a47e500 1 --2- 172.21.15.44:0/1996353681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c577fe2800 0x55c577d8d600 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x55c57803a120 tx=0x55c577fd0120 comp rx=0 tx=0).stop 2024-09-13T18:31:43.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe55a47e500 1 -- 172.21.15.44:0/1996353681 shutdown_connections 2024-09-13T18:31:43.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe55a47e500 1 --2- 172.21.15.44:0/1996353681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c577fe3000 0x55c577d8e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe55a47e500 1 --2- 172.21.15.44:0/1996353681 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c577fe2c00 0x55c577d8db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe55a47e500 1 --2- 172.21.15.44:0/1996353681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c577fe2800 0x55c577d8d600 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe55a47e500 1 -- 172.21.15.44:0/1996353681 >> 172.21.15.44:0/1996353681 conn(0x55c577ce6c00 msgr2=0x55c577da3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe55a47e500 1 -- 172.21.15.44:0/1996353681 shutdown_connections 2024-09-13T18:31:43.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.137+0000 7fe55a47e500 1 -- 172.21.15.44:0/1996353681 wait complete. 2024-09-13T18:31:43.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe55a47e500 1 Processor -- start 2024-09-13T18:31:43.148 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe55a47e500 1 -- start start 2024-09-13T18:31:43.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe55a47e500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c577fe2800 0x55c577d8f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe55a47e500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c577fe2c00 0x55c577d8ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe55a47e500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c577fe3000 0x55c577d8e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe55a47e500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c577d68280 con 0x55c577fe2c00 2024-09-13T18:31:43.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe55a47e500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c577d68140 con 0x55c577fe3000 2024-09-13T18:31:43.151 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe55a47e500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c577d68000 con 0x55c577fe2800 2024-09-13T18:31:43.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe558c38700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c577fe2c00 0x55c577d8ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe558c38700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c577fe2c00 0x55c577d8ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59758/0 (socket says 172.21.15.44:59758) 2024-09-13T18:31:43.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe558c38700 1 -- 172.21.15.44:0/1699072664 learned_addr learned my addr 172.21.15.44:0/1699072664 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe558437700 1 --2- 172.21.15.44:0/1699072664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c577fe3000 0x55c577d8e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe558437700 1 --2- 172.21.15.44:0/1699072664 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c577fe2800 0x55c577d8f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe558c38700 1 -- 172.21.15.44:0/1699072664 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c577fe2800 msgr2=0x55c577d8f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe558c38700 1 --2- 172.21.15.44:0/1699072664 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c577fe2800 0x55c577d8f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe558c38700 1 -- 172.21.15.44:0/1699072664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c577fe3000 msgr2=0x55c577d8e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe558c38700 1 --2- 172.21.15.44:0/1699072664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c577fe3000 0x55c577d8e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe558c38700 1 -- 172.21.15.44:0/1699072664 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c577d0a340 con 0x55c577fe2c00 2024-09-13T18:31:43.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe558437700 1 --2- 172.21.15.44:0/1699072664 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c577fe2800 0x55c577d8f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:43.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe558c38700 1 --2- 172.21.15.44:0/1699072664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c577fe2c00 0x55c577d8ec00 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x55c57803b500 tx=0x55c577fd0240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.152 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe552c2c700 1 -- 172.21.15.44:0/1699072664 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c577d37080 con 0x55c577fe2c00 2024-09-13T18:31:43.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe552c2c700 1 -- 172.21.15.44:0/1699072664 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c577e4b080 con 0x55c577fe2c00 2024-09-13T18:31:43.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe55a47e500 1 -- 172.21.15.44:0/1699072664 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c577d0a000 con 0x55c577fe2c00 2024-09-13T18:31:43.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe552c2c700 1 -- 172.21.15.44:0/1699072664 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c577d37600 con 0x55c577fe2c00 2024-09-13T18:31:43.153 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.141+0000 7fe55a47e500 1 -- 172.21.15.44:0/1699072664 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c577d0aea0 con 0x55c577fe2c00 2024-09-13T18:31:43.154 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.145+0000 7fe552c2c700 1 -- 172.21.15.44:0/1699072664 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x55c577d46840 con 0x55c577fe2c00 2024-09-13T18:31:43.154 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.145+0000 7fe552c2c700 1 --2- 172.21.15.44:0/1699072664 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55c578a56800 0x55c577d8f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.154 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.145+0000 7fe552c2c700 1 -- 172.21.15.44:0/1699072664 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x55c577d20a80 con 0x55c577fe2c00 2024-09-13T18:31:43.154 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.145+0000 7fe55a47e500 1 --2- 172.21.15.44:0/1699072664 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55c577fe3400 0x55c577d8e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.154 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.145+0000 7fe55a47e500 1 -- 172.21.15.44:0/1699072664 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55c577fe3800 con 0x55c577fe3400 2024-09-13T18:31:43.154 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.145+0000 7fe558437700 1 --2- 172.21.15.44:0/1699072664 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55c578a56800 0x55c577d8f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.154 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.145+0000 7fe558437700 1 --2- 172.21.15.44:0/1699072664 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55c577fe3400 0x55c577d8e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.155 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe558437700 1 --2- 172.21.15.44:0/1699072664 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55c578a56800 0x55c577d8f700 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55c57803a210 tx=0x55c577fd13e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.155 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe558437700 1 --2- 172.21.15.44:0/1699072664 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55c577fe3400 0x55c577d8e100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe558437700 1 -- 172.21.15.44:0/1699072664 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55c578b64b40 con 0x55c577fe3400 2024-09-13T18:31:43.156 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe55a47e500 1 -- 172.21.15.44:0/1699072664 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55c577fe3c00 con 0x55c577fe3400 2024-09-13T18:31:43.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe558437700 1 -- 172.21.15.44:0/1699072664 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55c578b64b40 con 0x55c577fe3400 2024-09-13T18:31:43.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe55a47e500 1 -- 172.21.15.44:0/1699072664 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55c577fe3400 msgr2=0x55c577d8e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe55a47e500 1 --2- 172.21.15.44:0/1699072664 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55c577fe3400 0x55c577d8e100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe55a47e500 1 -- 172.21.15.44:0/1699072664 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55c578a56800 msgr2=0x55c577d8f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe55a47e500 1 --2- 172.21.15.44:0/1699072664 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55c578a56800 0x55c577d8f700 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55c57803a210 tx=0x55c577fd13e0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe55a47e500 1 -- 172.21.15.44:0/1699072664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c577fe2c00 msgr2=0x55c577d8ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe55a47e500 1 --2- 172.21.15.44:0/1699072664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c577fe2c00 0x55c577d8ec00 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x55c57803b500 tx=0x55c577fd0240 comp rx=0 tx=0).stop 2024-09-13T18:31:43.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe558c38700 1 -- 172.21.15.44:0/1699072664 reap_dead start 2024-09-13T18:31:43.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe55a47e500 1 -- 172.21.15.44:0/1699072664 shutdown_connections 2024-09-13T18:31:43.158 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe55a47e500 1 -- 172.21.15.44:0/1699072664 >> 172.21.15.44:0/1699072664 conn(0x55c577ce6c00 msgr2=0x55c577da4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe55a47e500 1 -- 172.21.15.44:0/1699072664 shutdown_connections 2024-09-13T18:31:43.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe55a47e500 1 -- 172.21.15.44:0/1699072664 wait complete. 2024-09-13T18:31:43.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe55a47e500 1 -- 172.21.15.44:0/4264526941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c577ce7000 msgr2=0x55c577d8d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe55a47e500 1 --2- 172.21.15.44:0/4264526941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c577ce7000 0x55c577d8d080 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x55c577dbb260 tx=0x55c577dbd8c0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe55a47e500 1 -- 172.21.15.44:0/4264526941 shutdown_connections 2024-09-13T18:31:43.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe55a47e500 1 --2- 172.21.15.44:0/4264526941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c577ce7000 0x55c577d8d080 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe55a47e500 1 --2- 172.21.15.44:0/4264526941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c577ce7400 0x55c577d8cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe55a47e500 1 --2- 172.21.15.44:0/4264526941 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c577ce7800 0x55c577d8c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe55a47e500 1 -- 172.21.15.44:0/4264526941 >> 172.21.15.44:0/4264526941 conn(0x55c577ce7c00 msgr2=0x55c577da3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe55a47e500 1 -- 172.21.15.44:0/4264526941 shutdown_connections 2024-09-13T18:31:43.159 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.149+0000 7fe55a47e500 1 -- 172.21.15.44:0/4264526941 wait complete. 2024-09-13T18:31:43.161 INFO:tasks.workunit.client.0.smithi044.stderr:+ NEW_HEADER_STATE='{ 2024-09-13T18:31:43.161 INFO:tasks.workunit.client.0.smithi044.stderr: "magic": "ceph fs volume v011", 2024-09-13T18:31:43.161 INFO:tasks.workunit.client.0.smithi044.stderr: "write_pos": 4200138, 2024-09-13T18:31:43.161 INFO:tasks.workunit.client.0.smithi044.stderr: "expire_pos": 4194304, 2024-09-13T18:31:43.161 INFO:tasks.workunit.client.0.smithi044.stderr: "trimmed_pos": 4194304, 2024-09-13T18:31:43.161 INFO:tasks.workunit.client.0.smithi044.stderr: "stream_format": 1, 2024-09-13T18:31:43.161 INFO:tasks.workunit.client.0.smithi044.stderr: "layout": { 2024-09-13T18:31:43.161 INFO:tasks.workunit.client.0.smithi044.stderr: "stripe_unit": 4194304, 2024-09-13T18:31:43.161 INFO:tasks.workunit.client.0.smithi044.stderr: "stripe_count": 1, 2024-09-13T18:31:43.162 INFO:tasks.workunit.client.0.smithi044.stderr: "object_size": 4194304, 2024-09-13T18:31:43.162 INFO:tasks.workunit.client.0.smithi044.stderr: "pool_id": 6, 2024-09-13T18:31:43.162 INFO:tasks.workunit.client.0.smithi044.stderr: "pool_ns": "" 2024-09-13T18:31:43.162 INFO:tasks.workunit.client.0.smithi044.stderr: } 2024-09-13T18:31:43.162 INFO:tasks.workunit.client.0.smithi044.stderr:}' 2024-09-13T18:31:43.162 INFO:tasks.workunit.client.0.smithi044.stderr:++ cephfs-journal-tool --rank=cephfs:0 event get list 2024-09-13T18:31:43.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.193+0000 7f2e0909f500 1 -- start start 2024-09-13T18:31:43.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.193+0000 7f2e0909f500 1 Processor -- start 2024-09-13T18:31:43.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.193+0000 7f2e0909f500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56286cfad800 0x56286d052580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.193+0000 7f2e0909f500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56286cfad400 0x56286d052b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.193+0000 7f2e0909f500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56286cfad000 0x56286d053080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.193+0000 7f2e0909f500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286d02e780 con 0x56286cfad000 2024-09-13T18:31:43.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.193+0000 7f2e0909f500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286d02ea00 con 0x56286cfad400 2024-09-13T18:31:43.203 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.193+0000 7f2e0909f500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x56286d02e640 con 0x56286cfad800 2024-09-13T18:31:43.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.193+0000 7f2e0805a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56286cfad000 0x56286d053080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.193+0000 7f2e0805a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56286cfad000 0x56286d053080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59772/0 (socket says 172.21.15.44:59772) 2024-09-13T18:31:43.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.193+0000 7f2e0805a700 1 -- 172.21.15.44:0/254705735 learned_addr learned my addr 172.21.15.44:0/254705735 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.193+0000 7f2e07859700 1 --2- 172.21.15.44:0/254705735 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56286cfad800 0x56286d052580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.193+0000 7f2e07058700 1 --2- 172.21.15.44:0/254705735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56286cfad400 0x56286d052b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.197+0000 7f2e0805a700 1 -- 172.21.15.44:0/254705735 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56286cfad800 msgr2=0x56286d052580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.197+0000 7f2e0805a700 1 --2- 172.21.15.44:0/254705735 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56286cfad800 0x56286d052580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.197+0000 7f2e0805a700 1 -- 172.21.15.44:0/254705735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56286cfad400 msgr2=0x56286d052b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.197+0000 7f2e0805a700 1 --2- 172.21.15.44:0/254705735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56286cfad400 0x56286d052b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.197+0000 7f2e0805a700 1 -- 172.21.15.44:0/254705735 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56286cfd09c0 con 0x56286cfad000 2024-09-13T18:31:43.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.197+0000 7f2e07058700 1 --2- 172.21.15.44:0/254705735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56286cfad400 0x56286d052b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:43.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.197+0000 7f2e0805a700 1 --2- 172.21.15.44:0/254705735 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56286cfad000 0x56286d053080 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x56286d0812f0 tx=0x56286de36120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78457fbed4776dd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.197+0000 7f2e05054700 1 -- 172.21.15.44:0/254705735 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56286cffd600 con 0x56286cfad000 2024-09-13T18:31:43.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.197+0000 7f2e05054700 1 -- 172.21.15.44:0/254705735 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56286cff8900 con 0x56286cfad000 2024-09-13T18:31:43.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.197+0000 7f2e05054700 1 -- 172.21.15.44:0/254705735 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56286cffd1e0 con 0x56286cfad000 2024-09-13T18:31:43.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.197+0000 7f2e0909f500 1 -- 172.21.15.44:0/254705735 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56286cfd0b60 con 0x56286cfad000 2024-09-13T18:31:43.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.197+0000 7f2e0909f500 1 -- 172.21.15.44:0/254705735 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x56286cfd0340 con 0x56286cfad000 2024-09-13T18:31:43.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.197+0000 7f2e05054700 1 -- 172.21.15.44:0/254705735 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x56286cfe6c40 con 0x56286cfad000 2024-09-13T18:31:43.206 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.197+0000 7f2e05054700 1 -- 172.21.15.44:0/254705735 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x56286d2b4000 con 0x56286cfad000 2024-09-13T18:31:43.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.197+0000 7f2e0909f500 1 Processor -- start 2024-09-13T18:31:43.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.197+0000 7f2e0909f500 1 -- start start 2024-09-13T18:31:43.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e0909f500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56286d2a2800 0x56286d053600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e0909f500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56286d2a2c00 0x56286d053b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e0909f500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56286d2a3000 0x56286d054100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e0909f500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286cfe3e00 con 0x56286d2a2800 2024-09-13T18:31:43.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e0909f500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286d02ea00 con 0x56286d2a3000 2024-09-13T18:31:43.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e0909f500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x56286d02e500 con 0x56286d2a2c00 2024-09-13T18:31:43.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e07058700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56286d2a2800 0x56286d053600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e07058700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56286d2a2800 0x56286d053600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59776/0 (socket says 172.21.15.44:59776) 2024-09-13T18:31:43.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e07058700 1 -- 172.21.15.44:0/3635221212 learned_addr learned my addr 172.21.15.44:0/3635221212 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e07058700 1 --2- 172.21.15.44:0/3635221212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56286d2a3000 0x56286d054100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e07859700 1 --2- 172.21.15.44:0/3635221212 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56286d2a2c00 0x56286d053b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e07058700 1 -- 172.21.15.44:0/3635221212 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56286d2a2c00 msgr2=0x56286d053b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e07058700 1 --2- 172.21.15.44:0/3635221212 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56286d2a2c00 0x56286d053b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e07058700 1 -- 172.21.15.44:0/3635221212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56286d2a3000 msgr2=0x56286d054100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e07058700 1 --2- 172.21.15.44:0/3635221212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56286d2a3000 0x56286d054100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e07058700 1 -- 172.21.15.44:0/3635221212 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56286cfd0000 con 0x56286d2a2800 2024-09-13T18:31:43.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e07058700 1 --2- 172.21.15.44:0/3635221212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56286d2a2800 0x56286d053600 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x56286d2be660 tx=0x56286d073ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=860d389403c86bd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e03050700 1 -- 172.21.15.44:0/3635221212 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56286cffd080 con 0x56286d2a2800 2024-09-13T18:31:43.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e03050700 1 -- 172.21.15.44:0/3635221212 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56286dda0780 con 0x56286d2a2800 2024-09-13T18:31:43.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e03050700 1 -- 172.21.15.44:0/3635221212 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56286cffd600 con 0x56286d2a2800 2024-09-13T18:31:43.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e0909f500 1 -- 172.21.15.44:0/3635221212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56286d2a2800 msgr2=0x56286d053600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e0909f500 1 --2- 172.21.15.44:0/3635221212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56286d2a2800 0x56286d053600 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x56286d2be660 tx=0x56286d073ec0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e0909f500 1 -- 172.21.15.44:0/3635221212 shutdown_connections 2024-09-13T18:31:43.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e0909f500 1 --2- 172.21.15.44:0/3635221212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56286d2a3000 0x56286d054100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e0909f500 1 --2- 172.21.15.44:0/3635221212 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56286d2a2c00 0x56286d053b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e0909f500 1 --2- 172.21.15.44:0/3635221212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56286d2a2800 0x56286d053600 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e0909f500 1 -- 172.21.15.44:0/3635221212 >> 172.21.15.44:0/3635221212 conn(0x56286cfacc00 msgr2=0x56286d069800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e0909f500 1 -- 172.21.15.44:0/3635221212 shutdown_connections 2024-09-13T18:31:43.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.201+0000 7f2e0909f500 1 -- 172.21.15.44:0/3635221212 wait complete. 2024-09-13T18:31:43.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e0909f500 1 Processor -- start 2024-09-13T18:31:43.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e0909f500 1 -- start start 2024-09-13T18:31:43.214 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e0909f500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56286d2a2800 0x56286d055180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e0909f500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56286d2a2c00 0x56286d054c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e0909f500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56286d2a3000 0x56286d054680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e0909f500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286d02e3c0 con 0x56286d2a2800 2024-09-13T18:31:43.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e0909f500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286d02e280 con 0x56286d2a3000 2024-09-13T18:31:43.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e0909f500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x56286d02e140 con 0x56286d2a2c00 2024-09-13T18:31:43.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e07058700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56286d2a2800 0x56286d055180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e07058700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56286d2a2800 0x56286d055180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59780/0 (socket says 172.21.15.44:59780) 2024-09-13T18:31:43.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e07058700 1 -- 172.21.15.44:0/1372065812 learned_addr learned my addr 172.21.15.44:0/1372065812 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e07859700 1 --2- 172.21.15.44:0/1372065812 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56286d2a2c00 0x56286d054c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e07058700 1 --2- 172.21.15.44:0/1372065812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56286d2a3000 0x56286d054680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e07058700 1 -- 172.21.15.44:0/1372065812 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56286d2a2c00 msgr2=0x56286d054c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e07058700 1 --2- 172.21.15.44:0/1372065812 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56286d2a2c00 0x56286d054c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e07058700 1 -- 172.21.15.44:0/1372065812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56286d2a3000 msgr2=0x56286d054680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e07058700 1 --2- 172.21.15.44:0/1372065812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56286d2a3000 0x56286d054680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e07058700 1 -- 172.21.15.44:0/1372065812 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56286cfd01a0 con 0x56286d2a2800 2024-09-13T18:31:43.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e07058700 1 --2- 172.21.15.44:0/1372065812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56286d2a2800 0x56286d055180 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x56286d2be8d0 tx=0x56286d073f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e0184d700 1 -- 172.21.15.44:0/1372065812 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56286cffd1e0 con 0x56286d2a2800 2024-09-13T18:31:43.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e0184d700 1 -- 172.21.15.44:0/1372065812 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56286cff8480 con 0x56286d2a2800 2024-09-13T18:31:43.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e0909f500 1 -- 172.21.15.44:0/1372065812 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56286cfd0000 con 0x56286d2a2800 2024-09-13T18:31:43.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e0184d700 1 -- 172.21.15.44:0/1372065812 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56286cffcdc0 con 0x56286d2a2800 2024-09-13T18:31:43.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.205+0000 7f2e0909f500 1 -- 172.21.15.44:0/1372065812 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56286cfd09c0 con 0x56286d2a2800 2024-09-13T18:31:43.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.209+0000 7f2e0184d700 1 -- 172.21.15.44:0/1372065812 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x56286d00c840 con 0x56286d2a2800 2024-09-13T18:31:43.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.209+0000 7f2e0184d700 1 --2- 172.21.15.44:0/1372065812 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x56286d31ac00 0x56286d055700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.209+0000 7f2e0184d700 1 -- 172.21.15.44:0/1372065812 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x56286cfe6a80 con 0x56286d2a2800 2024-09-13T18:31:43.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.209+0000 7f2e0909f500 1 --2- 172.21.15.44:0/1372065812 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x56286d2a3400 0x56286d054100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.209+0000 7f2e0909f500 1 -- 172.21.15.44:0/1372065812 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x56286d2a3800 con 0x56286d2a3400 2024-09-13T18:31:43.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.209+0000 7f2e07859700 1 --2- 172.21.15.44:0/1372065812 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x56286d31ac00 0x56286d055700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.218 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.209+0000 7f2e07058700 1 --2- 172.21.15.44:0/1372065812 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x56286d2a3400 0x56286d054100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.209+0000 7f2e07058700 1 --2- 172.21.15.44:0/1372065812 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x56286d2a3400 0x56286d054100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.209+0000 7f2e07859700 1 --2- 172.21.15.44:0/1372065812 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x56286d31ac00 0x56286d055700 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x56286d0808a0 tx=0x56286d2c5c80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e07058700 1 -- 172.21.15.44:0/1372065812 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x56286dd96b40 con 0x56286d2a3400 2024-09-13T18:31:43.219 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e0909f500 1 -- 172.21.15.44:0/1372065812 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x56286d2a3c00 con 0x56286d2a3400 2024-09-13T18:31:43.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e07058700 1 -- 172.21.15.44:0/1372065812 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x56286dd96b40 con 0x56286d2a3400 2024-09-13T18:31:43.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e0909f500 1 -- 172.21.15.44:0/1372065812 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x56286d31b000 con 0x56286d2a3400 2024-09-13T18:31:43.220 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e07058700 1 -- 172.21.15.44:0/1372065812 <== osd.2 v2:172.21.15.44:6817/3180763837 3 ==== osd_op_reply(3 200.00000001 [read 0~31930 out=31930b] v0'0 uv22 ondisk = 0) v8 ==== 156+0+31930 (crc 0 0 0) 0x56286dd96b40 con 0x56286d2a3400 2024-09-13T18:31:43.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e0909f500 1 --2- 172.21.15.44:0/1372065812 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x56286d31b400 0x56286d053b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e0909f500 1 -- 172.21.15.44:0/1372065812 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x56286d31b800 con 0x56286d31b400 2024-09-13T18:31:43.221 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e0805a700 1 --2- 172.21.15.44:0/1372065812 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x56286d31b400 0x56286d053b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e0805a700 1 --2- 172.21.15.44:0/1372065812 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x56286d31b400 0x56286d053b80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.222 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e0805a700 1 -- 172.21.15.44:0/1372065812 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56286d41b200 con 0x56286d31b400 2024-09-13T18:31:43.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e0909f500 1 -- 172.21.15.44:0/1372065812 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x56286d2a3400 msgr2=0x56286d054100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e0909f500 1 --2- 172.21.15.44:0/1372065812 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x56286d2a3400 0x56286d054100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e0909f500 1 -- 172.21.15.44:0/1372065812 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x56286d31b400 msgr2=0x56286d053b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e0909f500 1 --2- 172.21.15.44:0/1372065812 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x56286d31b400 0x56286d053b80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e0909f500 1 -- 172.21.15.44:0/1372065812 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x56286d31ac00 msgr2=0x56286d055700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e0909f500 1 --2- 172.21.15.44:0/1372065812 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x56286d31ac00 0x56286d055700 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x56286d0808a0 tx=0x56286d2c5c80 comp rx=0 tx=0).stop 2024-09-13T18:31:43.223 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e0909f500 1 -- 172.21.15.44:0/1372065812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56286d2a2800 msgr2=0x56286d055180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e0909f500 1 --2- 172.21.15.44:0/1372065812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56286d2a2800 0x56286d055180 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x56286d2be8d0 tx=0x56286d073f20 comp rx=0 tx=0).stop 2024-09-13T18:31:43.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e07859700 1 -- 172.21.15.44:0/1372065812 reap_dead start 2024-09-13T18:31:43.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e0909f500 1 -- 172.21.15.44:0/1372065812 shutdown_connections 2024-09-13T18:31:43.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e0909f500 1 --2- 172.21.15.44:0/1372065812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56286d2a2800 0x56286d055180 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e0909f500 1 -- 172.21.15.44:0/1372065812 >> 172.21.15.44:0/1372065812 conn(0x56286cfacc00 msgr2=0x56286d069800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e0909f500 1 -- 172.21.15.44:0/1372065812 shutdown_connections 2024-09-13T18:31:43.224 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.213+0000 7f2e0909f500 1 -- 172.21.15.44:0/1372065812 wait complete. 2024-09-13T18:31:43.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.217+0000 7f2e0909f500 1 -- 172.21.15.44:0/254705735 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56286cfad000 msgr2=0x56286d053080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.217+0000 7f2e0909f500 1 --2- 172.21.15.44:0/254705735 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56286cfad000 0x56286d053080 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x56286d0812f0 tx=0x56286de36120 comp rx=0 tx=0).stop 2024-09-13T18:31:43.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.217+0000 7f2e0909f500 1 -- 172.21.15.44:0/254705735 shutdown_connections 2024-09-13T18:31:43.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.217+0000 7f2e0909f500 1 --2- 172.21.15.44:0/254705735 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56286cfad000 0x56286d053080 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.217+0000 7f2e0909f500 1 --2- 172.21.15.44:0/254705735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56286cfad400 0x56286d052b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.217+0000 7f2e0909f500 1 --2- 172.21.15.44:0/254705735 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56286cfad800 0x56286d052580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.217+0000 7f2e0909f500 1 -- 172.21.15.44:0/254705735 >> 172.21.15.44:0/254705735 conn(0x56286cfadc00 msgr2=0x56286d069000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.217+0000 7f2e0909f500 1 -- 172.21.15.44:0/254705735 shutdown_connections 2024-09-13T18:31:43.225 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.217+0000 7f2e0909f500 1 -- 172.21.15.44:0/254705735 wait complete. 2024-09-13T18:31:43.228 INFO:tasks.workunit.client.0.smithi044.stderr:+ NEW_EVENT_LIST='2024-09-13T18:29:10.293432+0000 0x400000 SUBTREEMAP: () 2024-09-13T18:31:43.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:29:21.363645+0000 0x40037c SESSION: () 2024-09-13T18:31:43.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:29:22.936002+0000 0x400536 UPDATE: (setattr) 2024-09-13T18:31:43.228 INFO:tasks.workunit.client.0.smithi044.stderr: / 2024-09-13T18:31:43.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:29:22.967852+0000 0x400865 UPDATE: (mkdir) 2024-09-13T18:31:43.228 INFO:tasks.workunit.client.0.smithi044.stderr: client.0 2024-09-13T18:31:43.228 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:29:28.364947+0000 0x401045 UPDATE: (cap update) 2024-09-13T18:31:43.228 INFO:tasks.workunit.client.0.smithi044.stderr: client.0 2024-09-13T18:31:43.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:28.563856+0000 0x4016ca UPDATE: (mkdir) 2024-09-13T18:31:43.229 INFO:tasks.workunit.client.0.smithi044.stderr: client.0/tmp 2024-09-13T18:31:43.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:28.583132+0000 0x4021e8 UPDATE: (mkdir) 2024-09-13T18:31:43.229 INFO:tasks.workunit.client.0.smithi044.stderr: tmp/foo 2024-09-13T18:31:43.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:28.585974+0000 0x402ab8 UPDATE: (openc) 2024-09-13T18:31:43.229 INFO:tasks.workunit.client.0.smithi044.stderr: tmp/bar 2024-09-13T18:31:43.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:30.837213+0000 0x40325a UPDATE: (unlink_local) 2024-09-13T18:31:43.229 INFO:tasks.workunit.client.0.smithi044.stderr: stray1/10000000002 2024-09-13T18:31:43.229 INFO:tasks.workunit.client.0.smithi044.stderr: client.0/tmp/foo 2024-09-13T18:31:43.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:30.839608+0000 0x40445d UPDATE: (unlink_local) 2024-09-13T18:31:43.229 INFO:tasks.workunit.client.0.smithi044.stderr: stray1/10000000003 2024-09-13T18:31:43.229 INFO:tasks.workunit.client.0.smithi044.stderr: tmp/bar 2024-09-13T18:31:43.229 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:30.840036+0000 0x4050e6 UPDATE: (cap update) 2024-09-13T18:31:43.229 INFO:tasks.workunit.client.0.smithi044.stderr: stray1/10000000003 2024-09-13T18:31:43.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:30.850629+0000 0x405883 UPDATE: (unlink_local) 2024-09-13T18:31:43.230 INFO:tasks.workunit.client.0.smithi044.stderr: stray1/10000000001 2024-09-13T18:31:43.230 INFO:tasks.workunit.client.0.smithi044.stderr: client.0/tmp 2024-09-13T18:31:43.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:31.142141+0000 0x4064eb UPDATE: (unlink_local) 2024-09-13T18:31:43.230 INFO:tasks.workunit.client.0.smithi044.stderr: client.0 2024-09-13T18:31:43.230 INFO:tasks.workunit.client.0.smithi044.stderr: stray1/10000000000 2024-09-13T18:31:43.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:33.381287+0000 0x40704a UPDATE: (purge_stray) 2024-09-13T18:31:43.230 INFO:tasks.workunit.client.0.smithi044.stderr: 10000000001 2024-09-13T18:31:43.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:33.381436+0000 0x4072a1 UPDATE: (purge_stray) 2024-09-13T18:31:43.230 INFO:tasks.workunit.client.0.smithi044.stderr: 10000000002 2024-09-13T18:31:43.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:33.381586+0000 0x4074f8 UPDATE: (purge_stray) 2024-09-13T18:31:43.230 INFO:tasks.workunit.client.0.smithi044.stderr: 10000000003 2024-09-13T18:31:43.230 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:34.563185+0000 0x40774f UPDATE: (scatter_writebehind) 2024-09-13T18:31:43.231 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:34.564890+0000 0x407bc1 SESSION: () 2024-09-13T18:31:43.231 INFO:tasks.workunit.client.0.smithi044.stderr:0.000000 0x407c6e PURGED: ()' 2024-09-13T18:31:43.231 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' '!' '{ 2024-09-13T18:31:43.231 INFO:tasks.workunit.client.0.smithi044.stderr: "magic": "ceph fs volume v011", 2024-09-13T18:31:43.231 INFO:tasks.workunit.client.0.smithi044.stderr: "write_pos": 4200138, 2024-09-13T18:31:43.231 INFO:tasks.workunit.client.0.smithi044.stderr: "expire_pos": 4194304, 2024-09-13T18:31:43.231 INFO:tasks.workunit.client.0.smithi044.stderr: "trimmed_pos": 4194304, 2024-09-13T18:31:43.231 INFO:tasks.workunit.client.0.smithi044.stderr: "stream_format": 1, 2024-09-13T18:31:43.231 INFO:tasks.workunit.client.0.smithi044.stderr: "layout": { 2024-09-13T18:31:43.231 INFO:tasks.workunit.client.0.smithi044.stderr: "stripe_unit": 4194304, 2024-09-13T18:31:43.231 INFO:tasks.workunit.client.0.smithi044.stderr: "stripe_count": 1, 2024-09-13T18:31:43.231 INFO:tasks.workunit.client.0.smithi044.stderr: "object_size": 4194304, 2024-09-13T18:31:43.231 INFO:tasks.workunit.client.0.smithi044.stderr: "pool_id": 6, 2024-09-13T18:31:43.232 INFO:tasks.workunit.client.0.smithi044.stderr: "pool_ns": "" 2024-09-13T18:31:43.232 INFO:tasks.workunit.client.0.smithi044.stderr: } 2024-09-13T18:31:43.232 INFO:tasks.workunit.client.0.smithi044.stderr:}' = '{ 2024-09-13T18:31:43.232 INFO:tasks.workunit.client.0.smithi044.stderr: "magic": "ceph fs volume v011", 2024-09-13T18:31:43.232 INFO:tasks.workunit.client.0.smithi044.stderr: "write_pos": 4200138, 2024-09-13T18:31:43.232 INFO:tasks.workunit.client.0.smithi044.stderr: "expire_pos": 4194304, 2024-09-13T18:31:43.232 INFO:tasks.workunit.client.0.smithi044.stderr: "trimmed_pos": 4194304, 2024-09-13T18:31:43.232 INFO:tasks.workunit.client.0.smithi044.stderr: "stream_format": 1, 2024-09-13T18:31:43.232 INFO:tasks.workunit.client.0.smithi044.stderr: "layout": { 2024-09-13T18:31:43.232 INFO:tasks.workunit.client.0.smithi044.stderr: "stripe_unit": 4194304, 2024-09-13T18:31:43.232 INFO:tasks.workunit.client.0.smithi044.stderr: "stripe_count": 1, 2024-09-13T18:31:43.232 INFO:tasks.workunit.client.0.smithi044.stderr: "object_size": 4194304, 2024-09-13T18:31:43.232 INFO:tasks.workunit.client.0.smithi044.stderr: "pool_id": 6, 2024-09-13T18:31:43.233 INFO:tasks.workunit.client.0.smithi044.stderr: "pool_ns": "" 2024-09-13T18:31:43.233 INFO:tasks.workunit.client.0.smithi044.stderr: } 2024-09-13T18:31:43.233 INFO:tasks.workunit.client.0.smithi044.stderr:}' ']' 2024-09-13T18:31:43.233 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' '!' '2024-09-13T18:29:10.293432+0000 0x400000 SUBTREEMAP: () 2024-09-13T18:31:43.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:29:21.363645+0000 0x40037c SESSION: () 2024-09-13T18:31:43.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:29:22.936002+0000 0x400536 UPDATE: (setattr) 2024-09-13T18:31:43.233 INFO:tasks.workunit.client.0.smithi044.stderr: / 2024-09-13T18:31:43.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:29:22.967852+0000 0x400865 UPDATE: (mkdir) 2024-09-13T18:31:43.233 INFO:tasks.workunit.client.0.smithi044.stderr: client.0 2024-09-13T18:31:43.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:29:28.364947+0000 0x401045 UPDATE: (cap update) 2024-09-13T18:31:43.233 INFO:tasks.workunit.client.0.smithi044.stderr: client.0 2024-09-13T18:31:43.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:28.563856+0000 0x4016ca UPDATE: (mkdir) 2024-09-13T18:31:43.233 INFO:tasks.workunit.client.0.smithi044.stderr: client.0/tmp 2024-09-13T18:31:43.233 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:28.583132+0000 0x4021e8 UPDATE: (mkdir) 2024-09-13T18:31:43.234 INFO:tasks.workunit.client.0.smithi044.stderr: tmp/foo 2024-09-13T18:31:43.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:28.585974+0000 0x402ab8 UPDATE: (openc) 2024-09-13T18:31:43.234 INFO:tasks.workunit.client.0.smithi044.stderr: tmp/bar 2024-09-13T18:31:43.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:30.837213+0000 0x40325a UPDATE: (unlink_local) 2024-09-13T18:31:43.234 INFO:tasks.workunit.client.0.smithi044.stderr: stray1/10000000002 2024-09-13T18:31:43.234 INFO:tasks.workunit.client.0.smithi044.stderr: client.0/tmp/foo 2024-09-13T18:31:43.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:30.839608+0000 0x40445d UPDATE: (unlink_local) 2024-09-13T18:31:43.234 INFO:tasks.workunit.client.0.smithi044.stderr: stray1/10000000003 2024-09-13T18:31:43.234 INFO:tasks.workunit.client.0.smithi044.stderr: tmp/bar 2024-09-13T18:31:43.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:30.840036+0000 0x4050e6 UPDATE: (cap update) 2024-09-13T18:31:43.234 INFO:tasks.workunit.client.0.smithi044.stderr: stray1/10000000003 2024-09-13T18:31:43.234 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:30.850629+0000 0x405883 UPDATE: (unlink_local) 2024-09-13T18:31:43.234 INFO:tasks.workunit.client.0.smithi044.stderr: stray1/10000000001 2024-09-13T18:31:43.234 INFO:tasks.workunit.client.0.smithi044.stderr: client.0/tmp 2024-09-13T18:31:43.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:31.142141+0000 0x4064eb UPDATE: (unlink_local) 2024-09-13T18:31:43.235 INFO:tasks.workunit.client.0.smithi044.stderr: client.0 2024-09-13T18:31:43.235 INFO:tasks.workunit.client.0.smithi044.stderr: stray1/10000000000 2024-09-13T18:31:43.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:33.381287+0000 0x40704a UPDATE: (purge_stray) 2024-09-13T18:31:43.235 INFO:tasks.workunit.client.0.smithi044.stderr: 10000000001 2024-09-13T18:31:43.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:33.381436+0000 0x4072a1 UPDATE: (purge_stray) 2024-09-13T18:31:43.235 INFO:tasks.workunit.client.0.smithi044.stderr: 10000000002 2024-09-13T18:31:43.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:33.381586+0000 0x4074f8 UPDATE: (purge_stray) 2024-09-13T18:31:43.235 INFO:tasks.workunit.client.0.smithi044.stderr: 10000000003 2024-09-13T18:31:43.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:34.563185+0000 0x40774f UPDATE: (scatter_writebehind) 2024-09-13T18:31:43.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:34.564890+0000 0x407bc1 SESSION: () 2024-09-13T18:31:43.235 INFO:tasks.workunit.client.0.smithi044.stderr:0.000000 0x407c6e PURGED: ()' = '2024-09-13T18:29:10.293432+0000 0x400000 SUBTREEMAP: () 2024-09-13T18:31:43.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:29:21.363645+0000 0x40037c SESSION: () 2024-09-13T18:31:43.235 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:29:22.936002+0000 0x400536 UPDATE: (setattr) 2024-09-13T18:31:43.236 INFO:tasks.workunit.client.0.smithi044.stderr: / 2024-09-13T18:31:43.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:29:22.967852+0000 0x400865 UPDATE: (mkdir) 2024-09-13T18:31:43.236 INFO:tasks.workunit.client.0.smithi044.stderr: client.0 2024-09-13T18:31:43.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:29:28.364947+0000 0x401045 UPDATE: (cap update) 2024-09-13T18:31:43.236 INFO:tasks.workunit.client.0.smithi044.stderr: client.0 2024-09-13T18:31:43.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:28.563856+0000 0x4016ca UPDATE: (mkdir) 2024-09-13T18:31:43.236 INFO:tasks.workunit.client.0.smithi044.stderr: client.0/tmp 2024-09-13T18:31:43.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:28.583132+0000 0x4021e8 UPDATE: (mkdir) 2024-09-13T18:31:43.236 INFO:tasks.workunit.client.0.smithi044.stderr: tmp/foo 2024-09-13T18:31:43.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:28.585974+0000 0x402ab8 UPDATE: (openc) 2024-09-13T18:31:43.236 INFO:tasks.workunit.client.0.smithi044.stderr: tmp/bar 2024-09-13T18:31:43.236 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:30.837213+0000 0x40325a UPDATE: (unlink_local) 2024-09-13T18:31:43.236 INFO:tasks.workunit.client.0.smithi044.stderr: stray1/10000000002 2024-09-13T18:31:43.237 INFO:tasks.workunit.client.0.smithi044.stderr: client.0/tmp/foo 2024-09-13T18:31:43.237 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:30.839608+0000 0x40445d UPDATE: (unlink_local) 2024-09-13T18:31:43.237 INFO:tasks.workunit.client.0.smithi044.stderr: stray1/10000000003 2024-09-13T18:31:43.237 INFO:tasks.workunit.client.0.smithi044.stderr: tmp/bar 2024-09-13T18:31:43.237 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:30.840036+0000 0x4050e6 UPDATE: (cap update) 2024-09-13T18:31:43.237 INFO:tasks.workunit.client.0.smithi044.stderr: stray1/10000000003 2024-09-13T18:31:43.237 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:30.850629+0000 0x405883 UPDATE: (unlink_local) 2024-09-13T18:31:43.237 INFO:tasks.workunit.client.0.smithi044.stderr: stray1/10000000001 2024-09-13T18:31:43.237 INFO:tasks.workunit.client.0.smithi044.stderr: client.0/tmp 2024-09-13T18:31:43.237 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:31.142141+0000 0x4064eb UPDATE: (unlink_local) 2024-09-13T18:31:43.237 INFO:tasks.workunit.client.0.smithi044.stderr: client.0 2024-09-13T18:31:43.237 INFO:tasks.workunit.client.0.smithi044.stderr: stray1/10000000000 2024-09-13T18:31:43.237 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:33.381287+0000 0x40704a UPDATE: (purge_stray) 2024-09-13T18:31:43.237 INFO:tasks.workunit.client.0.smithi044.stderr: 10000000001 2024-09-13T18:31:43.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:33.381436+0000 0x4072a1 UPDATE: (purge_stray) 2024-09-13T18:31:43.238 INFO:tasks.workunit.client.0.smithi044.stderr: 10000000002 2024-09-13T18:31:43.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:33.381586+0000 0x4074f8 UPDATE: (purge_stray) 2024-09-13T18:31:43.238 INFO:tasks.workunit.client.0.smithi044.stderr: 10000000003 2024-09-13T18:31:43.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:34.563185+0000 0x40774f UPDATE: (scatter_writebehind) 2024-09-13T18:31:43.238 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:30:34.564890+0000 0x407bc1 SESSION: () 2024-09-13T18:31:43.238 INFO:tasks.workunit.client.0.smithi044.stderr:0.000000 0x407c6e PURGED: ()' ']' 2024-09-13T18:31:43.238 INFO:tasks.workunit.client.0.smithi044.stdout:Testing 'journal' commands... 2024-09-13T18:31:43.238 INFO:tasks.workunit.client.0.smithi044.stderr:+ echo 'Testing '\''journal'\'' commands...' 2024-09-13T18:31:43.239 INFO:tasks.workunit.client.0.smithi044.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal inspect 2024-09-13T18:31:43.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.257+0000 7fb8f4c57500 1 -- start start 2024-09-13T18:31:43.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.257+0000 7fb8f4c57500 1 Processor -- start 2024-09-13T18:31:43.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.261+0000 7fb8f4c57500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aa3a4af800 0x55aa3a554580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.261+0000 7fb8f4c57500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa3a4af400 0x55aa3a554b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.261+0000 7fb8f4c57500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55aa3a4af000 0x55aa3a555080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.261+0000 7fb8f4c57500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa3a530a00 con 0x55aa3a4af400 2024-09-13T18:31:43.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.261+0000 7fb8f4c57500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa3a530780 con 0x55aa3a4af800 2024-09-13T18:31:43.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.261+0000 7fb8f4c57500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa3a530640 con 0x55aa3a4af000 2024-09-13T18:31:43.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.261+0000 7fb8f2c10700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa3a4af400 0x55aa3a554b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.261+0000 7fb8f3411700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aa3a4af800 0x55aa3a554580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.261+0000 7fb8f3c12700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55aa3a4af000 0x55aa3a555080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.261+0000 7fb8f3411700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aa3a4af800 0x55aa3a554580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:47438/0 (socket says 172.21.15.44:47438) 2024-09-13T18:31:43.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.261+0000 7fb8f3411700 1 -- 172.21.15.44:0/72469685 learned_addr learned my addr 172.21.15.44:0/72469685 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.261+0000 7fb8f3411700 1 -- 172.21.15.44:0/72469685 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55aa3a4af000 msgr2=0x55aa3a555080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.261+0000 7fb8f3411700 1 --2- 172.21.15.44:0/72469685 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55aa3a4af000 0x55aa3a555080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.261+0000 7fb8f3411700 1 -- 172.21.15.44:0/72469685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa3a4af400 msgr2=0x55aa3a554b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.271 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.261+0000 7fb8f3411700 1 --2- 172.21.15.44:0/72469685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa3a4af400 0x55aa3a554b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.261+0000 7fb8f3411700 1 -- 172.21.15.44:0/72469685 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa3a4d29c0 con 0x55aa3a4af800 2024-09-13T18:31:43.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.261+0000 7fb8f3411700 1 --2- 172.21.15.44:0/72469685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aa3a4af800 0x55aa3a554580 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x55aa3a583380 tx=0x55aa3b328120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9e610a21707146a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.261+0000 7fb8f0c0c700 1 -- 172.21.15.44:0/72469685 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55aa3a4ff600 con 0x55aa3a4af800 2024-09-13T18:31:43.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.261+0000 7fb8f0c0c700 1 -- 172.21.15.44:0/72469685 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55aa3a4fa180 con 0x55aa3a4af800 2024-09-13T18:31:43.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.261+0000 7fb8f0c0c700 1 -- 172.21.15.44:0/72469685 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55aa3a4ff1e0 con 0x55aa3a4af800 2024-09-13T18:31:43.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.261+0000 7fb8f4c57500 1 -- 172.21.15.44:0/72469685 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aa3a4d2b60 con 0x55aa3a4af800 2024-09-13T18:31:43.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.261+0000 7fb8f4c57500 1 -- 172.21.15.44:0/72469685 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55aa3a4d2340 con 0x55aa3a4af800 2024-09-13T18:31:43.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8f0c0c700 1 -- 172.21.15.44:0/72469685 <== mon.1 v2:172.21.15.99:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x55aa3a4e8c40 con 0x55aa3a4af800 2024-09-13T18:31:43.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8f0c0c700 1 -- 172.21.15.44:0/72469685 <== mon.1 v2:172.21.15.99:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x55aa3b336900 con 0x55aa3a4af800 2024-09-13T18:31:43.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8f4c57500 1 Processor -- start 2024-09-13T18:31:43.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8f4c57500 1 -- start start 2024-09-13T18:31:43.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8f4c57500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa3b338400 0x55aa3a555600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8f4c57500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aa3b338800 0x55aa3a555b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8f4c57500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55aa3b338c00 0x55aa3a556100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8f4c57500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa3a4e5e00 con 0x55aa3b338400 2024-09-13T18:31:43.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8f4c57500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa3a530a00 con 0x55aa3b338800 2024-09-13T18:31:43.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8f4c57500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa3a530500 con 0x55aa3b338c00 2024-09-13T18:31:43.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8f3c12700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa3b338400 0x55aa3a555600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8f2c10700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55aa3b338c00 0x55aa3a556100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8f3411700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aa3b338800 0x55aa3a555b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8f3c12700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa3b338400 0x55aa3a555600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59806/0 (socket says 172.21.15.44:59806) 2024-09-13T18:31:43.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8f3c12700 1 -- 172.21.15.44:0/3319811613 learned_addr learned my addr 172.21.15.44:0/3319811613 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8f3c12700 1 -- 172.21.15.44:0/3319811613 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55aa3b338c00 msgr2=0x55aa3a556100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8f3c12700 1 --2- 172.21.15.44:0/3319811613 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55aa3b338c00 0x55aa3a556100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8f3c12700 1 -- 172.21.15.44:0/3319811613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aa3b338800 msgr2=0x55aa3a555b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8f3c12700 1 --2- 172.21.15.44:0/3319811613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aa3b338800 0x55aa3a555b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8f3c12700 1 -- 172.21.15.44:0/3319811613 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa3a4d2000 con 0x55aa3b338400 2024-09-13T18:31:43.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8f3411700 1 --2- 172.21.15.44:0/3319811613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aa3b338800 0x55aa3a555b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:43.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8f3c12700 1 --2- 172.21.15.44:0/3319811613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa3b338400 0x55aa3a555600 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x55aa3a7aa7e0 tx=0x55aa3a5858c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc875cf483b56edf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8eec08700 1 -- 172.21.15.44:0/3319811613 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55aa3a4ff080 con 0x55aa3b338400 2024-09-13T18:31:43.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8eec08700 1 -- 172.21.15.44:0/3319811613 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55aa3a4fa480 con 0x55aa3b338400 2024-09-13T18:31:43.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.265+0000 7fb8eec08700 1 -- 172.21.15.44:0/3319811613 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55aa3a4ff600 con 0x55aa3b338400 2024-09-13T18:31:43.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.269+0000 7fb8f4c57500 1 -- 172.21.15.44:0/3319811613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa3b338400 msgr2=0x55aa3a555600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.269+0000 7fb8f4c57500 1 --2- 172.21.15.44:0/3319811613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa3b338400 0x55aa3a555600 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x55aa3a7aa7e0 tx=0x55aa3a5858c0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.269+0000 7fb8f4c57500 1 -- 172.21.15.44:0/3319811613 shutdown_connections 2024-09-13T18:31:43.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.269+0000 7fb8f4c57500 1 --2- 172.21.15.44:0/3319811613 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55aa3b338c00 0x55aa3a556100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.269+0000 7fb8f4c57500 1 --2- 172.21.15.44:0/3319811613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aa3b338800 0x55aa3a555b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.269+0000 7fb8f4c57500 1 --2- 172.21.15.44:0/3319811613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa3b338400 0x55aa3a555600 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.269+0000 7fb8f4c57500 1 -- 172.21.15.44:0/3319811613 >> 172.21.15.44:0/3319811613 conn(0x55aa3a4aec00 msgr2=0x55aa3a56b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.269+0000 7fb8f4c57500 1 -- 172.21.15.44:0/3319811613 shutdown_connections 2024-09-13T18:31:43.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.269+0000 7fb8f4c57500 1 -- 172.21.15.44:0/3319811613 wait complete. 2024-09-13T18:31:43.278 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.269+0000 7fb8f4c57500 1 Processor -- start 2024-09-13T18:31:43.278 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.269+0000 7fb8f4c57500 1 -- start start 2024-09-13T18:31:43.280 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.269+0000 7fb8f4c57500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55aa3b338400 0x55aa3a557180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.280 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.269+0000 7fb8f4c57500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa3b338800 0x55aa3a556c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.280 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.273+0000 7fb8f4c57500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aa3b338c00 0x55aa3a556680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.280 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.273+0000 7fb8f4c57500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa3a5303c0 con 0x55aa3b338800 2024-09-13T18:31:43.280 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.273+0000 7fb8f4c57500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa3a530280 con 0x55aa3b338c00 2024-09-13T18:31:43.280 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.273+0000 7fb8f4c57500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa3a530140 con 0x55aa3b338400 2024-09-13T18:31:43.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.273+0000 7fb8f3411700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa3b338800 0x55aa3a556c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.273+0000 7fb8f3411700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa3b338800 0x55aa3a556c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59812/0 (socket says 172.21.15.44:59812) 2024-09-13T18:31:43.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.273+0000 7fb8f3411700 1 -- 172.21.15.44:0/859882717 learned_addr learned my addr 172.21.15.44:0/859882717 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.273+0000 7fb8f2c10700 1 --2- 172.21.15.44:0/859882717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aa3b338c00 0x55aa3a556680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.273+0000 7fb8f3c12700 1 --2- 172.21.15.44:0/859882717 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55aa3b338400 0x55aa3a557180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.273+0000 7fb8f3411700 1 -- 172.21.15.44:0/859882717 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55aa3b338400 msgr2=0x55aa3a557180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.273+0000 7fb8f3411700 1 --2- 172.21.15.44:0/859882717 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55aa3b338400 0x55aa3a557180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.273+0000 7fb8f3411700 1 -- 172.21.15.44:0/859882717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aa3b338c00 msgr2=0x55aa3a556680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.273+0000 7fb8f3411700 1 --2- 172.21.15.44:0/859882717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aa3b338c00 0x55aa3a556680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.273+0000 7fb8f3411700 1 -- 172.21.15.44:0/859882717 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa3a4d21a0 con 0x55aa3b338800 2024-09-13T18:31:43.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.273+0000 7fb8f3c12700 1 --2- 172.21.15.44:0/859882717 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55aa3b338400 0x55aa3a557180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:43.281 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.273+0000 7fb8f3411700 1 --2- 172.21.15.44:0/859882717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa3b338800 0x55aa3a556c00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x55aa3a7ab4d0 tx=0x55aa3b328060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.273+0000 7fb8ed405700 1 -- 172.21.15.44:0/859882717 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55aa3a4fef20 con 0x55aa3b338800 2024-09-13T18:31:43.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.273+0000 7fb8ed405700 1 -- 172.21.15.44:0/859882717 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55aa3b298d80 con 0x55aa3b338800 2024-09-13T18:31:43.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.273+0000 7fb8f4c57500 1 -- 172.21.15.44:0/859882717 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55aa3a4d2000 con 0x55aa3b338800 2024-09-13T18:31:43.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.273+0000 7fb8ed405700 1 -- 172.21.15.44:0/859882717 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55aa3a4ff080 con 0x55aa3b338800 2024-09-13T18:31:43.282 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.273+0000 7fb8f4c57500 1 -- 172.21.15.44:0/859882717 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aa3a4d29c0 con 0x55aa3b338800 2024-09-13T18:31:43.283 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.277+0000 7fb8ed405700 1 -- 172.21.15.44:0/859882717 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x55aa3a50e840 con 0x55aa3b338800 2024-09-13T18:31:43.284 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.277+0000 7fb8ed405700 1 --2- 172.21.15.44:0/859882717 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55aa3a81c400 0x55aa3a557700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.284 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.277+0000 7fb8ed405700 1 -- 172.21.15.44:0/859882717 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x55aa3a4e8a80 con 0x55aa3b338800 2024-09-13T18:31:43.285 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.277+0000 7fb8f3c12700 1 --2- 172.21.15.44:0/859882717 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55aa3a81c400 0x55aa3a557700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.285 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.277+0000 7fb8f4c57500 1 --2- 172.21.15.44:0/859882717 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55aa3b339000 0x55aa3a556100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.285 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.277+0000 7fb8f4c57500 1 -- 172.21.15.44:0/859882717 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55aa3b339400 con 0x55aa3b339000 2024-09-13T18:31:43.285 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.277+0000 7fb8f2c10700 1 --2- 172.21.15.44:0/859882717 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55aa3b339000 0x55aa3a556100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.277+0000 7fb8f3c12700 1 --2- 172.21.15.44:0/859882717 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55aa3a81c400 0x55aa3a557700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55aa3a7aa7e0 tx=0x55aa3a5840c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.277+0000 7fb8f2c10700 1 --2- 172.21.15.44:0/859882717 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55aa3b339000 0x55aa3a556100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.277+0000 7fb8f2c10700 1 -- 172.21.15.44:0/859882717 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55aa3b292b40 con 0x55aa3b339000 2024-09-13T18:31:43.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.277+0000 7fb8f4c57500 1 -- 172.21.15.44:0/859882717 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55aa3b339800 con 0x55aa3b339000 2024-09-13T18:31:43.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.277+0000 7fb8f2c10700 1 -- 172.21.15.44:0/859882717 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55aa3b292b40 con 0x55aa3b339000 2024-09-13T18:31:43.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.277+0000 7fb8f4c57500 1 -- 172.21.15.44:0/859882717 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55aa3a81c800 con 0x55aa3b339000 2024-09-13T18:31:43.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.277+0000 7fb8f2c10700 1 -- 172.21.15.44:0/859882717 <== osd.2 v2:172.21.15.44:6817/3180763837 3 ==== osd_op_reply(3 200.00000001 [read 0~31930 out=31930b] v0'0 uv22 ondisk = 0) v8 ==== 156+0+31930 (crc 0 0 0) 0x55aa3b292b40 con 0x55aa3b339000 2024-09-13T18:31:43.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 --2- 172.21.15.44:0/859882717 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55aa3a81cc00 0x55aa3a555b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 -- 172.21.15.44:0/859882717 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55aa3a81d000 con 0x55aa3a81cc00 2024-09-13T18:31:43.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f3c12700 1 --2- 172.21.15.44:0/859882717 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55aa3a81cc00 0x55aa3a555b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f3c12700 1 --2- 172.21.15.44:0/859882717 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55aa3a81cc00 0x55aa3a555b80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.289 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f3c12700 1 -- 172.21.15.44:0/859882717 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55aa3a91b200 con 0x55aa3a81cc00 2024-09-13T18:31:43.289 INFO:tasks.workunit.client.0.smithi044.stdout:Overall journal integrity: OK 2024-09-13T18:31:43.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 -- 172.21.15.44:0/859882717 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55aa3b339000 msgr2=0x55aa3a556100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 --2- 172.21.15.44:0/859882717 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55aa3b339000 0x55aa3a556100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 -- 172.21.15.44:0/859882717 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55aa3a81cc00 msgr2=0x55aa3a555b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 --2- 172.21.15.44:0/859882717 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55aa3a81cc00 0x55aa3a555b80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 -- 172.21.15.44:0/859882717 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55aa3a81c400 msgr2=0x55aa3a557700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 --2- 172.21.15.44:0/859882717 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55aa3a81c400 0x55aa3a557700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55aa3a7aa7e0 tx=0x55aa3a5840c0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 -- 172.21.15.44:0/859882717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa3b338800 msgr2=0x55aa3a556c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 --2- 172.21.15.44:0/859882717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa3b338800 0x55aa3a556c00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x55aa3a7ab4d0 tx=0x55aa3b328060 comp rx=0 tx=0).stop 2024-09-13T18:31:43.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f2c10700 1 -- 172.21.15.44:0/859882717 reap_dead start 2024-09-13T18:31:43.291 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 -- 172.21.15.44:0/859882717 shutdown_connections 2024-09-13T18:31:43.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 --2- 172.21.15.44:0/859882717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa3b338800 0x55aa3a556c00 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 -- 172.21.15.44:0/859882717 >> 172.21.15.44:0/859882717 conn(0x55aa3a4aec00 msgr2=0x55aa3a56b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 -- 172.21.15.44:0/859882717 shutdown_connections 2024-09-13T18:31:43.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 -- 172.21.15.44:0/859882717 wait complete. 2024-09-13T18:31:43.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 -- 172.21.15.44:0/72469685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aa3a4af800 msgr2=0x55aa3a554580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 --2- 172.21.15.44:0/72469685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aa3a4af800 0x55aa3a554580 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x55aa3a583380 tx=0x55aa3b328120 comp rx=0 tx=0).stop 2024-09-13T18:31:43.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 -- 172.21.15.44:0/72469685 shutdown_connections 2024-09-13T18:31:43.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 --2- 172.21.15.44:0/72469685 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55aa3a4af000 0x55aa3a555080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 --2- 172.21.15.44:0/72469685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa3a4af400 0x55aa3a554b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 --2- 172.21.15.44:0/72469685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aa3a4af800 0x55aa3a554580 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 -- 172.21.15.44:0/72469685 >> 172.21.15.44:0/72469685 conn(0x55aa3a4afc00 msgr2=0x55aa3a56b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 -- 172.21.15.44:0/72469685 shutdown_connections 2024-09-13T18:31:43.292 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.281+0000 7fb8f4c57500 1 -- 172.21.15.44:0/72469685 wait complete. 2024-09-13T18:31:43.294 INFO:tasks.workunit.client.0.smithi044.stderr:+ cephfs-journal-tool --rank=cephfs:0 header get 2024-09-13T18:31:43.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.325+0000 7f22a82f0500 1 -- start start 2024-09-13T18:31:43.334 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.325+0000 7f22a82f0500 1 Processor -- start 2024-09-13T18:31:43.335 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a82f0500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594904af800 0x559490554580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a82f0500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594904af400 0x559490554b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a82f0500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594904af000 0x559490555080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a82f0500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x559490530a00 con 0x5594904af400 2024-09-13T18:31:43.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a82f0500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559490530780 con 0x5594904af000 2024-09-13T18:31:43.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a82f0500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x559490530640 con 0x5594904af800 2024-09-13T18:31:43.337 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a62a9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594904af400 0x559490554b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a62a9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594904af400 0x559490554b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59826/0 (socket says 172.21.15.44:59826) 2024-09-13T18:31:43.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a62a9700 1 -- 172.21.15.44:0/663371049 learned_addr learned my addr 172.21.15.44:0/663371049 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a6aaa700 1 --2- 172.21.15.44:0/663371049 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594904af800 0x559490554580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a72ab700 1 --2- 172.21.15.44:0/663371049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594904af000 0x559490555080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a62a9700 1 -- 172.21.15.44:0/663371049 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594904af800 msgr2=0x559490554580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a62a9700 1 --2- 172.21.15.44:0/663371049 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594904af800 0x559490554580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a62a9700 1 -- 172.21.15.44:0/663371049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594904af000 msgr2=0x559490555080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a62a9700 1 --2- 172.21.15.44:0/663371049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594904af000 0x559490555080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a62a9700 1 -- 172.21.15.44:0/663371049 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594904d29c0 con 0x5594904af400 2024-09-13T18:31:43.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a62a9700 1 --2- 172.21.15.44:0/663371049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594904af400 0x559490554b00 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x5594905832f0 tx=0x559491336120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a604519eb3066acc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a42a5700 1 -- 172.21.15.44:0/663371049 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5594904ff600 con 0x5594904af400 2024-09-13T18:31:43.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a42a5700 1 -- 172.21.15.44:0/663371049 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5594904fa900 con 0x5594904af400 2024-09-13T18:31:43.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a42a5700 1 -- 172.21.15.44:0/663371049 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5594904ff1e0 con 0x5594904af400 2024-09-13T18:31:43.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a82f0500 1 -- 172.21.15.44:0/663371049 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5594904d2b60 con 0x5594904af400 2024-09-13T18:31:43.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a82f0500 1 -- 172.21.15.44:0/663371049 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5594904d2340 con 0x5594904af400 2024-09-13T18:31:43.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a42a5700 1 -- 172.21.15.44:0/663371049 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x5594904e8c40 con 0x5594904af400 2024-09-13T18:31:43.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.329+0000 7f22a42a5700 1 -- 172.21.15.44:0/663371049 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x55949129e000 con 0x5594904af400 2024-09-13T18:31:43.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a82f0500 1 Processor -- start 2024-09-13T18:31:43.340 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a82f0500 1 -- start start 2024-09-13T18:31:43.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a82f0500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559491338400 0x559490555600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a82f0500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559491338800 0x559490555b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a82f0500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559491338c00 0x559490556100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a82f0500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594904e5e00 con 0x559491338800 2024-09-13T18:31:43.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a82f0500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559490530780 con 0x559491338400 2024-09-13T18:31:43.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a82f0500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x559490530500 con 0x559491338c00 2024-09-13T18:31:43.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a6aaa700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559491338800 0x559490555b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a6aaa700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559491338800 0x559490555b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59832/0 (socket says 172.21.15.44:59832) 2024-09-13T18:31:43.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a72ab700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559491338400 0x559490555600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a62a9700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559491338c00 0x559490556100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a6aaa700 1 -- 172.21.15.44:0/4038176232 learned_addr learned my addr 172.21.15.44:0/4038176232 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a62a9700 1 -- 172.21.15.44:0/4038176232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559491338400 msgr2=0x559490555600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a62a9700 1 --2- 172.21.15.44:0/4038176232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559491338400 0x559490555600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a62a9700 1 -- 172.21.15.44:0/4038176232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559491338800 msgr2=0x559490555b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a62a9700 1 --2- 172.21.15.44:0/4038176232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559491338800 0x559490555b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a62a9700 1 -- 172.21.15.44:0/4038176232 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594904d2000 con 0x559491338c00 2024-09-13T18:31:43.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a6aaa700 1 --2- 172.21.15.44:0/4038176232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559491338800 0x559490555b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:43.343 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a62a9700 1 --2- 172.21.15.44:0/4038176232 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559491338c00 0x559490556100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x559490583680 tx=0x559490584060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=350cfdc4fb9de3a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a22a1700 1 -- 172.21.15.44:0/4038176232 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5594904fef20 con 0x559491338c00 2024-09-13T18:31:43.344 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a22a1700 1 -- 172.21.15.44:0/4038176232 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5594912a2c00 con 0x559491338c00 2024-09-13T18:31:43.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a22a1700 1 -- 172.21.15.44:0/4038176232 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5594904ff600 con 0x559491338c00 2024-09-13T18:31:43.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a82f0500 1 -- 172.21.15.44:0/4038176232 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559491338c00 msgr2=0x559490556100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a82f0500 1 --2- 172.21.15.44:0/4038176232 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559491338c00 0x559490556100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x559490583680 tx=0x559490584060 comp rx=0 tx=0).stop 2024-09-13T18:31:43.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a82f0500 1 -- 172.21.15.44:0/4038176232 shutdown_connections 2024-09-13T18:31:43.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a82f0500 1 --2- 172.21.15.44:0/4038176232 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559491338c00 0x559490556100 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a82f0500 1 --2- 172.21.15.44:0/4038176232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559491338800 0x559490555b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a82f0500 1 --2- 172.21.15.44:0/4038176232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559491338400 0x559490555600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.333+0000 7f22a82f0500 1 -- 172.21.15.44:0/4038176232 >> 172.21.15.44:0/4038176232 conn(0x5594904aec00 msgr2=0x55949056b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a82f0500 1 -- 172.21.15.44:0/4038176232 shutdown_connections 2024-09-13T18:31:43.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a82f0500 1 -- 172.21.15.44:0/4038176232 wait complete. 2024-09-13T18:31:43.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a82f0500 1 Processor -- start 2024-09-13T18:31:43.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a82f0500 1 -- start start 2024-09-13T18:31:43.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a82f0500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559491338400 0x559490557180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a82f0500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559491338800 0x559490556c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a82f0500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559491338c00 0x559490556680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a82f0500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594905303c0 con 0x559491338800 2024-09-13T18:31:43.347 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a82f0500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559490530280 con 0x559491338c00 2024-09-13T18:31:43.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a82f0500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x559490530140 con 0x559491338400 2024-09-13T18:31:43.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a6aaa700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559491338800 0x559490556c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a6aaa700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559491338800 0x559490556c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59840/0 (socket says 172.21.15.44:59840) 2024-09-13T18:31:43.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a6aaa700 1 -- 172.21.15.44:0/3947641791 learned_addr learned my addr 172.21.15.44:0/3947641791 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a72ab700 1 --2- 172.21.15.44:0/3947641791 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559491338400 0x559490557180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a62a9700 1 --2- 172.21.15.44:0/3947641791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559491338c00 0x559490556680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a6aaa700 1 -- 172.21.15.44:0/3947641791 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559491338400 msgr2=0x559490557180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a6aaa700 1 --2- 172.21.15.44:0/3947641791 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559491338400 0x559490557180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a6aaa700 1 -- 172.21.15.44:0/3947641791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559491338c00 msgr2=0x559490556680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a6aaa700 1 --2- 172.21.15.44:0/3947641791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559491338c00 0x559490556680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a6aaa700 1 -- 172.21.15.44:0/3947641791 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594904d29c0 con 0x559491338800 2024-09-13T18:31:43.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a72ab700 1 --2- 172.21.15.44:0/3947641791 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559491338400 0x559490557180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:43.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a6aaa700 1 --2- 172.21.15.44:0/3947641791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559491338800 0x559490556c00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x5594907a9290 tx=0x5594905858c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a0a9e700 1 -- 172.21.15.44:0/3947641791 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5594904ff080 con 0x559491338800 2024-09-13T18:31:43.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.337+0000 7f22a0a9e700 1 -- 172.21.15.44:0/3947641791 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5594912a3980 con 0x559491338800 2024-09-13T18:31:43.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.341+0000 7f22a82f0500 1 -- 172.21.15.44:0/3947641791 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5594904d2b60 con 0x559491338800 2024-09-13T18:31:43.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.341+0000 7f22a0a9e700 1 -- 172.21.15.44:0/3947641791 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5594904fef20 con 0x559491338800 2024-09-13T18:31:43.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.341+0000 7f22a82f0500 1 -- 172.21.15.44:0/3947641791 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5594904d2ea0 con 0x559491338800 2024-09-13T18:31:43.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.341+0000 7f22a0a9e700 1 -- 172.21.15.44:0/3947641791 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x55949050e840 con 0x559491338800 2024-09-13T18:31:43.350 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.341+0000 7f22a0a9e700 1 --2- 172.21.15.44:0/3947641791 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559490818400 0x559490557700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.350 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.341+0000 7f22a0a9e700 1 -- 172.21.15.44:0/3947641791 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x5594904e8a80 con 0x559491338800 2024-09-13T18:31:43.350 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.341+0000 7f22a82f0500 1 --2- 172.21.15.44:0/3947641791 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x559491339000 0x559490556100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.341+0000 7f22a82f0500 1 -- 172.21.15.44:0/3947641791 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x559491339400 con 0x559491339000 2024-09-13T18:31:43.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.341+0000 7f22a72ab700 1 --2- 172.21.15.44:0/3947641791 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559490818400 0x559490557700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.341+0000 7f22a62a9700 1 --2- 172.21.15.44:0/3947641791 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x559491339000 0x559490556100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.341+0000 7f22a62a9700 1 --2- 172.21.15.44:0/3947641791 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x559491339000 0x559490556100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.341+0000 7f22a72ab700 1 --2- 172.21.15.44:0/3947641791 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559490818400 0x559490557700 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x5594905828a0 tx=0x5594907adec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.345+0000 7f22a62a9700 1 -- 172.21.15.44:0/3947641791 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55949121cb40 con 0x559491339000 2024-09-13T18:31:43.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.345+0000 7f22a82f0500 1 -- 172.21.15.44:0/3947641791 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x559491339800 con 0x559491339000 2024-09-13T18:31:43.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.345+0000 7f22a62a9700 1 -- 172.21.15.44:0/3947641791 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55949121cb40 con 0x559491339000 2024-09-13T18:31:43.352 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-13T18:31:43.353 INFO:tasks.workunit.client.0.smithi044.stdout: "magic": "ceph fs volume v011", 2024-09-13T18:31:43.353 INFO:tasks.workunit.client.0.smithi044.stdout: "write_pos": 4200138, 2024-09-13T18:31:43.353 INFO:tasks.workunit.client.0.smithi044.stdout: "expire_pos": 4194304, 2024-09-13T18:31:43.353 INFO:tasks.workunit.client.0.smithi044.stdout: "trimmed_pos": 4194304, 2024-09-13T18:31:43.353 INFO:tasks.workunit.client.0.smithi044.stdout: "stream_format": 1, 2024-09-13T18:31:43.353 INFO:tasks.workunit.client.0.smithi044.stdout: "layout": { 2024-09-13T18:31:43.353 INFO:tasks.workunit.client.0.smithi044.stdout: "stripe_unit": 4194304, 2024-09-13T18:31:43.353 INFO:tasks.workunit.client.0.smithi044.stdout: "stripe_count": 1, 2024-09-13T18:31:43.353 INFO:tasks.workunit.client.0.smithi044.stdout: "object_size": 4194304, 2024-09-13T18:31:43.353 INFO:tasks.workunit.client.0.smithi044.stdout: "pool_id": 6, 2024-09-13T18:31:43.353 INFO:tasks.workunit.client.0.smithi044.stdout: "pool_ns": "" 2024-09-13T18:31:43.353 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-13T18:31:43.354 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-13T18:31:43.354 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-13T18:31:43.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.345+0000 7f22a82f0500 1 -- 172.21.15.44:0/3947641791 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x559491339000 msgr2=0x559490556100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.345+0000 7f22a82f0500 1 --2- 172.21.15.44:0/3947641791 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x559491339000 0x559490556100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.345+0000 7f22a82f0500 1 -- 172.21.15.44:0/3947641791 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559490818400 msgr2=0x559490557700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.345+0000 7f22a82f0500 1 --2- 172.21.15.44:0/3947641791 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559490818400 0x559490557700 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x5594905828a0 tx=0x5594907adec0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.345+0000 7f22a82f0500 1 -- 172.21.15.44:0/3947641791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559491338800 msgr2=0x559490556c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.345+0000 7f22a82f0500 1 --2- 172.21.15.44:0/3947641791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559491338800 0x559490556c00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x5594907a9290 tx=0x5594905858c0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.345+0000 7f22a6aaa700 1 -- 172.21.15.44:0/3947641791 reap_dead start 2024-09-13T18:31:43.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.345+0000 7f22a82f0500 1 -- 172.21.15.44:0/3947641791 shutdown_connections 2024-09-13T18:31:43.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.345+0000 7f22a82f0500 1 -- 172.21.15.44:0/3947641791 >> 172.21.15.44:0/3947641791 conn(0x5594904aec00 msgr2=0x55949056b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.345+0000 7f22a82f0500 1 -- 172.21.15.44:0/3947641791 shutdown_connections 2024-09-13T18:31:43.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.345+0000 7f22a82f0500 1 -- 172.21.15.44:0/3947641791 wait complete. 2024-09-13T18:31:43.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.345+0000 7f22a82f0500 1 -- 172.21.15.44:0/663371049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594904af400 msgr2=0x559490554b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.345+0000 7f22a82f0500 1 --2- 172.21.15.44:0/663371049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594904af400 0x559490554b00 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x5594905832f0 tx=0x559491336120 comp rx=0 tx=0).stop 2024-09-13T18:31:43.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.345+0000 7f22a82f0500 1 -- 172.21.15.44:0/663371049 shutdown_connections 2024-09-13T18:31:43.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.345+0000 7f22a82f0500 1 --2- 172.21.15.44:0/663371049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594904af000 0x559490555080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.345+0000 7f22a82f0500 1 --2- 172.21.15.44:0/663371049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594904af400 0x559490554b00 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.345+0000 7f22a82f0500 1 --2- 172.21.15.44:0/663371049 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594904af800 0x559490554580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.345+0000 7f22a82f0500 1 -- 172.21.15.44:0/663371049 >> 172.21.15.44:0/663371049 conn(0x5594904afc00 msgr2=0x55949056b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.345+0000 7f22a82f0500 1 -- 172.21.15.44:0/663371049 shutdown_connections 2024-09-13T18:31:43.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.345+0000 7f22a82f0500 1 -- 172.21.15.44:0/663371049 wait complete. 2024-09-13T18:31:43.357 INFO:tasks.workunit.client.0.smithi044.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal export /tmp/journal.bin 2024-09-13T18:31:43.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.389+0000 7f7e910b4500 1 -- start start 2024-09-13T18:31:43.399 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.393+0000 7f7e910b4500 1 Processor -- start 2024-09-13T18:31:43.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.393+0000 7f7e910b4500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558e824a5800 0x558e8254a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.393+0000 7f7e910b4500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e824a5400 0x558e8254ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.393+0000 7f7e910b4500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e824a5000 0x558e8254b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.393+0000 7f7e910b4500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e82526a00 con 0x558e824a5400 2024-09-13T18:31:43.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.393+0000 7f7e910b4500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e824dbe00 con 0x558e824a5000 2024-09-13T18:31:43.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.393+0000 7f7e910b4500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e82526640 con 0x558e824a5800 2024-09-13T18:31:43.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.393+0000 7f7e8f06d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e824a5400 0x558e8254ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.393+0000 7f7e8f06d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e824a5400 0x558e8254ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59862/0 (socket says 172.21.15.44:59862) 2024-09-13T18:31:43.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.393+0000 7f7e8f06d700 1 -- 172.21.15.44:0/4106852975 learned_addr learned my addr 172.21.15.44:0/4106852975 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.393+0000 7f7e9006f700 1 --2- 172.21.15.44:0/4106852975 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e824a5000 0x558e8254b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.393+0000 7f7e8f86e700 1 --2- 172.21.15.44:0/4106852975 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558e824a5800 0x558e8254a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.393+0000 7f7e8f06d700 1 -- 172.21.15.44:0/4106852975 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558e824a5800 msgr2=0x558e8254a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.393+0000 7f7e8f06d700 1 --2- 172.21.15.44:0/4106852975 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558e824a5800 0x558e8254a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.393+0000 7f7e8f06d700 1 -- 172.21.15.44:0/4106852975 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e824a5000 msgr2=0x558e8254b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.393+0000 7f7e8f06d700 1 --2- 172.21.15.44:0/4106852975 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e824a5000 0x558e8254b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.393+0000 7f7e8f06d700 1 -- 172.21.15.44:0/4106852975 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e824c89c0 con 0x558e824a5400 2024-09-13T18:31:43.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.393+0000 7f7e8f06d700 1 --2- 172.21.15.44:0/4106852975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e824a5400 0x558e8254ab00 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x558e82579380 tx=0x558e8257b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a36babdf58dde4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.393+0000 7f7e8d069700 1 -- 172.21.15.44:0/4106852975 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558e824f5080 con 0x558e824a5400 2024-09-13T18:31:43.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.393+0000 7f7e8d069700 1 -- 172.21.15.44:0/4106852975 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558e8327e300 con 0x558e824a5400 2024-09-13T18:31:43.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.393+0000 7f7e8d069700 1 -- 172.21.15.44:0/4106852975 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558e824f5600 con 0x558e824a5400 2024-09-13T18:31:43.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.393+0000 7f7e910b4500 1 -- 172.21.15.44:0/4106852975 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e824c81a0 con 0x558e824a5400 2024-09-13T18:31:43.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.393+0000 7f7e910b4500 1 -- 172.21.15.44:0/4106852975 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x558e824c8b60 con 0x558e824a5400 2024-09-13T18:31:43.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.397+0000 7f7e8d069700 1 -- 172.21.15.44:0/4106852975 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x558e824dec40 con 0x558e824a5400 2024-09-13T18:31:43.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.397+0000 7f7e8d069700 1 -- 172.21.15.44:0/4106852975 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x558e824e6f00 con 0x558e824a5400 2024-09-13T18:31:43.408 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.397+0000 7f7e910b4500 1 Processor -- start 2024-09-13T18:31:43.408 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.397+0000 7f7e910b4500 1 -- start start 2024-09-13T18:31:43.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.397+0000 7f7e910b4500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558e8332e400 0x558e8254b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.397+0000 7f7e910b4500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e8332e800 0x558e8254bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.397+0000 7f7e910b4500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e8332ec00 0x558e8254c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.397+0000 7f7e910b4500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e82526500 con 0x558e8332ec00 2024-09-13T18:31:43.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.397+0000 7f7e910b4500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e825263c0 con 0x558e8332e800 2024-09-13T18:31:43.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.397+0000 7f7e910b4500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e82526280 con 0x558e8332e400 2024-09-13T18:31:43.410 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e8f06d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e8332ec00 0x558e8254c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e9006f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558e8332e400 0x558e8254b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e8f86e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e8332e800 0x558e8254bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e9006f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558e8332e400 0x558e8254b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:58292/0 (socket says 172.21.15.44:58292) 2024-09-13T18:31:43.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e9006f700 1 -- 172.21.15.44:0/3970426278 learned_addr learned my addr 172.21.15.44:0/3970426278 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e8f06d700 1 -- 172.21.15.44:0/3970426278 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558e8332e400 msgr2=0x558e8254b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e8f06d700 1 --2- 172.21.15.44:0/3970426278 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558e8332e400 0x558e8254b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e8f06d700 1 -- 172.21.15.44:0/3970426278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e8332e800 msgr2=0x558e8254bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e8f06d700 1 --2- 172.21.15.44:0/3970426278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e8332e800 0x558e8254bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e8f06d700 1 -- 172.21.15.44:0/3970426278 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e824c8340 con 0x558e8332ec00 2024-09-13T18:31:43.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e8f06d700 1 --2- 172.21.15.44:0/3970426278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e8332ec00 0x558e8254c100 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x558e82579bf0 tx=0x558e8257a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46cc8ef1247cc78 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e8b065700 1 -- 172.21.15.44:0/3970426278 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558e824f51e0 con 0x558e8332ec00 2024-09-13T18:31:43.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e8b065700 1 -- 172.21.15.44:0/3970426278 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558e8327f800 con 0x558e8332ec00 2024-09-13T18:31:43.411 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e8b065700 1 -- 172.21.15.44:0/3970426278 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558e824f4f20 con 0x558e8332ec00 2024-09-13T18:31:43.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e910b4500 1 -- 172.21.15.44:0/3970426278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e8332ec00 msgr2=0x558e8254c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e910b4500 1 --2- 172.21.15.44:0/3970426278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e8332ec00 0x558e8254c100 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x558e82579bf0 tx=0x558e8257a120 comp rx=0 tx=0).stop 2024-09-13T18:31:43.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e910b4500 1 -- 172.21.15.44:0/3970426278 shutdown_connections 2024-09-13T18:31:43.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e910b4500 1 --2- 172.21.15.44:0/3970426278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e8332ec00 0x558e8254c100 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e910b4500 1 --2- 172.21.15.44:0/3970426278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e8332e800 0x558e8254bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e910b4500 1 --2- 172.21.15.44:0/3970426278 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558e8332e400 0x558e8254b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e910b4500 1 -- 172.21.15.44:0/3970426278 >> 172.21.15.44:0/3970426278 conn(0x558e824a4c00 msgr2=0x558e82561800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e910b4500 1 -- 172.21.15.44:0/3970426278 shutdown_connections 2024-09-13T18:31:43.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e910b4500 1 -- 172.21.15.44:0/3970426278 wait complete. 2024-09-13T18:31:43.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e910b4500 1 Processor -- start 2024-09-13T18:31:43.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e910b4500 1 -- start start 2024-09-13T18:31:43.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e910b4500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e8332e400 0x558e8254d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e910b4500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e8332e800 0x558e8254cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e910b4500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558e8332ec00 0x558e8254c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e910b4500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e82526a00 con 0x558e8332e400 2024-09-13T18:31:43.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e910b4500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e82526280 con 0x558e8332e800 2024-09-13T18:31:43.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e910b4500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e82526640 con 0x558e8332ec00 2024-09-13T18:31:43.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e9006f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e8332e400 0x558e8254d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e9006f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e8332e400 0x558e8254d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59886/0 (socket says 172.21.15.44:59886) 2024-09-13T18:31:43.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e9006f700 1 -- 172.21.15.44:0/42949822 learned_addr learned my addr 172.21.15.44:0/42949822 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e8f86e700 1 --2- 172.21.15.44:0/42949822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e8332e800 0x558e8254cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e8f06d700 1 --2- 172.21.15.44:0/42949822 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558e8332ec00 0x558e8254c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.401+0000 7f7e9006f700 1 -- 172.21.15.44:0/42949822 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558e8332ec00 msgr2=0x558e8254c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.405+0000 7f7e9006f700 1 --2- 172.21.15.44:0/42949822 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558e8332ec00 0x558e8254c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.405+0000 7f7e9006f700 1 -- 172.21.15.44:0/42949822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e8332e800 msgr2=0x558e8254cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.405+0000 7f7e9006f700 1 --2- 172.21.15.44:0/42949822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e8332e800 0x558e8254cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.405+0000 7f7e9006f700 1 -- 172.21.15.44:0/42949822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e824c89c0 con 0x558e8332e400 2024-09-13T18:31:43.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.405+0000 7f7e8f86e700 1 --2- 172.21.15.44:0/42949822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e8332e800 0x558e8254cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:43.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.405+0000 7f7e8f06d700 1 --2- 172.21.15.44:0/42949822 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558e8332ec00 0x558e8254c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:43.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.405+0000 7f7e9006f700 1 --2- 172.21.15.44:0/42949822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e8332e400 0x558e8254d180 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x558e832852f0 tx=0x558e827f2b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.405+0000 7f7e89862700 1 -- 172.21.15.44:0/42949822 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558e824f51e0 con 0x558e8332e400 2024-09-13T18:31:43.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.405+0000 7f7e89862700 1 -- 172.21.15.44:0/42949822 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558e824f0180 con 0x558e8332e400 2024-09-13T18:31:43.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.405+0000 7f7e89862700 1 -- 172.21.15.44:0/42949822 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558e824f4f20 con 0x558e8332e400 2024-09-13T18:31:43.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.405+0000 7f7e910b4500 1 -- 172.21.15.44:0/42949822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558e824c81a0 con 0x558e8332e400 2024-09-13T18:31:43.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.405+0000 7f7e910b4500 1 -- 172.21.15.44:0/42949822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e824c8b60 con 0x558e8332e400 2024-09-13T18:31:43.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.405+0000 7f7e89862700 1 -- 172.21.15.44:0/42949822 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x558e82504b00 con 0x558e8332e400 2024-09-13T18:31:43.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.405+0000 7f7e89862700 1 --2- 172.21.15.44:0/42949822 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x558e82822400 0x558e8254d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.405+0000 7f7e89862700 1 -- 172.21.15.44:0/42949822 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x558e824dea80 con 0x558e8332e400 2024-09-13T18:31:43.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.405+0000 7f7e910b4500 1 --2- 172.21.15.44:0/42949822 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x558e8332f000 0x558e8254c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.405+0000 7f7e910b4500 1 -- 172.21.15.44:0/42949822 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x558e8332f400 con 0x558e8332f000 2024-09-13T18:31:43.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.405+0000 7f7e8f06d700 1 --2- 172.21.15.44:0/42949822 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x558e8332f000 0x558e8254c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.405+0000 7f7e8f86e700 1 --2- 172.21.15.44:0/42949822 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x558e82822400 0x558e8254d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.417 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.405+0000 7f7e8f06d700 1 --2- 172.21.15.44:0/42949822 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x558e8332f000 0x558e8254c100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.409+0000 7f7e8f86e700 1 --2- 172.21.15.44:0/42949822 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x558e82822400 0x558e8254d700 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x558e82578840 tx=0x558e827f3e60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.409+0000 7f7e8f06d700 1 -- 172.21.15.44:0/42949822 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x558e83314b40 con 0x558e8332f000 2024-09-13T18:31:43.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.409+0000 7f7e910b4500 1 -- 172.21.15.44:0/42949822 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x558e8332f800 con 0x558e8332f000 2024-09-13T18:31:43.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.409+0000 7f7e8f06d700 1 -- 172.21.15.44:0/42949822 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x558e83314b40 con 0x558e8332f000 2024-09-13T18:31:43.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.409+0000 7f7e910b4500 1 -- 172.21.15.44:0/42949822 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x558e82822800 con 0x558e8332f000 2024-09-13T18:31:43.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.409+0000 7f7e8f06d700 1 -- 172.21.15.44:0/42949822 <== osd.2 v2:172.21.15.44:6817/3180763837 3 ==== osd_op_reply(3 200.00000001 [read 0~31930 out=31930b] v0'0 uv22 ondisk = 0) v8 ==== 156+0+31930 (crc 0 0 0) 0x558e83314b40 con 0x558e8332f000 2024-09-13T18:31:43.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.409+0000 7f7e910b4500 1 --2- 172.21.15.44:0/42949822 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x558e82822c00 0x558e8254bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.409+0000 7f7e910b4500 1 -- 172.21.15.44:0/42949822 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x558e82823000 con 0x558e82822c00 2024-09-13T18:31:43.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.409+0000 7f7e9006f700 1 --2- 172.21.15.44:0/42949822 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x558e82822c00 0x558e8254bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.409+0000 7f7e9006f700 1 --2- 172.21.15.44:0/42949822 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x558e82822c00 0x558e8254bb80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.409+0000 7f7e9006f700 1 -- 172.21.15.44:0/42949822 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x558e8291b200 con 0x558e82822c00 2024-09-13T18:31:43.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.413+0000 7f7e910b4500 1 -- start start 2024-09-13T18:31:43.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.413+0000 7f7e910b4500 1 Processor -- start 2024-09-13T18:31:43.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.413+0000 7f7e910b4500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558e82823800 0x558e8254b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.413+0000 7f7e910b4500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e82823c00 0x558e82974000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.413+0000 7f7e910b4500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e82822800 0x558e82974580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.413+0000 7f7e910b4500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e82526140 con 0x558e82823c00 2024-09-13T18:31:43.423 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.413+0000 7f7e910b4500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e824dbe00 con 0x558e82822800 2024-09-13T18:31:43.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.413+0000 7f7e910b4500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e82526280 con 0x558e82823800 2024-09-13T18:31:43.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.413+0000 7f7e9006f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e82823c00 0x558e82974000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.413+0000 7f7e8f06d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558e82823800 0x558e8254b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.413+0000 7f7e9006f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e82823c00 0x558e82974000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59894/0 (socket says 172.21.15.44:59894) 2024-09-13T18:31:43.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.413+0000 7f7e9006f700 1 -- 172.21.15.44:0/1195928051 learned_addr learned my addr 172.21.15.44:0/1195928051 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.413+0000 7f7e8f86e700 1 --2- 172.21.15.44:0/1195928051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e82822800 0x558e82974580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.413+0000 7f7e9006f700 1 -- 172.21.15.44:0/1195928051 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558e82823800 msgr2=0x558e8254b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.413+0000 7f7e9006f700 1 --2- 172.21.15.44:0/1195928051 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558e82823800 0x558e8254b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.413+0000 7f7e9006f700 1 -- 172.21.15.44:0/1195928051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e82822800 msgr2=0x558e82974580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.413+0000 7f7e9006f700 1 --2- 172.21.15.44:0/1195928051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e82822800 0x558e82974580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.413+0000 7f7e9006f700 1 -- 172.21.15.44:0/1195928051 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e8284f860 con 0x558e82823c00 2024-09-13T18:31:43.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.417+0000 7f7e9006f700 1 --2- 172.21.15.44:0/1195928051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e82823c00 0x558e82974000 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x558e8285d260 tx=0x558e827f3440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0b7bd651b0fd4f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.417+0000 7f7e8685c700 1 -- 172.21.15.44:0/1195928051 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558e824f5080 con 0x558e82823c00 2024-09-13T18:31:43.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.417+0000 7f7e8685c700 1 -- 172.21.15.44:0/1195928051 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558e824f0180 con 0x558e82823c00 2024-09-13T18:31:43.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.417+0000 7f7e8685c700 1 -- 172.21.15.44:0/1195928051 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558e824f46e0 con 0x558e82823c00 2024-09-13T18:31:43.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.417+0000 7f7e910b4500 1 -- 172.21.15.44:0/1195928051 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e8284f6c0 con 0x558e82823c00 2024-09-13T18:31:43.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.417+0000 7f7e910b4500 1 -- 172.21.15.44:0/1195928051 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x558e8284f520 con 0x558e82823c00 2024-09-13T18:31:43.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.417+0000 7f7e8685c700 1 -- 172.21.15.44:0/1195928051 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x558e824de8c0 con 0x558e82823c00 2024-09-13T18:31:43.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.417+0000 7f7e8685c700 1 -- 172.21.15.44:0/1195928051 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x558e82969200 con 0x558e82823c00 2024-09-13T18:31:43.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.417+0000 7f7e910b4500 1 --2- 172.21.15.44:0/1195928051 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x558e8332f400 0x558e82974b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.427 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.417+0000 7f7e910b4500 1 -- 172.21.15.44:0/1195928051 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x558e8332f800 con 0x558e8332f400 2024-09-13T18:31:43.427 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.417+0000 7f7e8f06d700 1 --2- 172.21.15.44:0/1195928051 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x558e8332f400 0x558e82974b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.427 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.417+0000 7f7e8f06d700 1 --2- 172.21.15.44:0/1195928051 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x558e8332f400 0x558e82974b00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=21792850aca77e67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.427 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.417+0000 7f7e8f06d700 1 -- 172.21.15.44:0/1195928051 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x558e83314b40 con 0x558e8332f400 2024-09-13T18:31:43.427 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.417+0000 7f7e910b4500 1 -- 172.21.15.44:0/1195928051 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x558e82996000 con 0x558e8332f400 2024-09-13T18:31:43.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.417+0000 7f7e8f06d700 1 -- 172.21.15.44:0/1195928051 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x558e83314b40 con 0x558e8332f400 2024-09-13T18:31:43.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.417+0000 7f7e85059700 1 -- 172.21.15.44:0/1195928051 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e51) v8 -- 0x558e82998000 con 0x558e8332f400 2024-09-13T18:31:43.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.417+0000 7f7e85059700 1 --2- 172.21.15.44:0/1195928051 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x558e82998400 0x558e82976680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.417+0000 7f7e85059700 1 -- 172.21.15.44:0/1195928051 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e51) v8 -- 0x558e82998800 con 0x558e82998400 2024-09-13T18:31:43.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e8f86e700 1 --2- 172.21.15.44:0/1195928051 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x558e82998400 0x558e82976680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e8f06d700 1 -- 172.21.15.44:0/1195928051 <== osd.2 v2:172.21.15.44:6817/3180763837 3 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv22 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x558e83314b40 con 0x558e8332f400 2024-09-13T18:31:43.428 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e8f86e700 1 --2- 172.21.15.44:0/1195928051 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x558e82998400 0x558e82976680 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=736eff5baac36199 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.429 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e8f86e700 1 -- 172.21.15.44:0/1195928051 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x558e8291b8c0 con 0x558e82998400 2024-09-13T18:31:43.429 INFO:tasks.workunit.client.0.smithi044.stdout:journal is 4194304~31930 2024-09-13T18:31:43.429 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e910b4500 1 -- 172.21.15.44:0/1195928051 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:5 6.14 6:2e2fa760:::200.00000001:head [read 0~31930] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x558e82996400 con 0x558e8332f400 2024-09-13T18:31:43.430 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e8f06d700 1 -- 172.21.15.44:0/1195928051 <== osd.2 v2:172.21.15.44:6817/3180763837 4 ==== osd_op_reply(5 200.00000001 [read 0~31930 out=31930b] v0'0 uv22 ondisk = 0) v8 ==== 156+0+31930 (crc 0 0 0) 0x558e83314b40 con 0x558e8332f400 2024-09-13T18:31:43.430 INFO:tasks.workunit.client.0.smithi044.stdout:wrote 31930 bytes at offset 4194304 to /tmp/journal.bin 2024-09-13T18:31:43.430 INFO:tasks.workunit.client.0.smithi044.stdout:NOTE: this is a _sparse_ file; you can 2024-09-13T18:31:43.430 INFO:tasks.workunit.client.0.smithi044.stdout: $ tar cSzf /tmp/journal.bin.tgz /tmp/journal.bin 2024-09-13T18:31:43.430 INFO:tasks.workunit.client.0.smithi044.stdout: to efficiently compress it while preserving sparseness. 2024-09-13T18:31:43.432 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e910b4500 1 -- 172.21.15.44:0/1195928051 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x558e8332f400 msgr2=0x558e82974b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.432 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e910b4500 1 --2- 172.21.15.44:0/1195928051 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x558e8332f400 0x558e82974b00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.432 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e910b4500 1 -- 172.21.15.44:0/1195928051 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x558e82998400 msgr2=0x558e82976680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.432 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e910b4500 1 --2- 172.21.15.44:0/1195928051 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x558e82998400 0x558e82976680 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.432 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e910b4500 1 -- 172.21.15.44:0/1195928051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e82823c00 msgr2=0x558e82974000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e910b4500 1 --2- 172.21.15.44:0/1195928051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e82823c00 0x558e82974000 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x558e8285d260 tx=0x558e827f3440 comp rx=0 tx=0).stop 2024-09-13T18:31:43.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e8f86e700 1 -- 172.21.15.44:0/1195928051 reap_dead start 2024-09-13T18:31:43.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e910b4500 1 -- 172.21.15.44:0/1195928051 shutdown_connections 2024-09-13T18:31:43.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e910b4500 1 -- 172.21.15.44:0/1195928051 >> 172.21.15.44:0/1195928051 conn(0x558e82823400 msgr2=0x558e82562000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e910b4500 1 -- 172.21.15.44:0/1195928051 shutdown_connections 2024-09-13T18:31:43.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e910b4500 1 -- 172.21.15.44:0/1195928051 wait complete. 2024-09-13T18:31:43.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e910b4500 1 -- 172.21.15.44:0/42949822 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x558e8332f000 msgr2=0x558e8254c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e910b4500 1 --2- 172.21.15.44:0/42949822 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x558e8332f000 0x558e8254c100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e910b4500 1 -- 172.21.15.44:0/42949822 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x558e82822c00 msgr2=0x558e8254bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e910b4500 1 --2- 172.21.15.44:0/42949822 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x558e82822c00 0x558e8254bb80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e910b4500 1 -- 172.21.15.44:0/42949822 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x558e82822400 msgr2=0x558e8254d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e910b4500 1 --2- 172.21.15.44:0/42949822 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x558e82822400 0x558e8254d700 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x558e82578840 tx=0x558e827f3e60 comp rx=0 tx=0).stop 2024-09-13T18:31:43.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e910b4500 1 -- 172.21.15.44:0/42949822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e8332e400 msgr2=0x558e8254d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e910b4500 1 --2- 172.21.15.44:0/42949822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e8332e400 0x558e8254d180 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x558e832852f0 tx=0x558e827f2b40 comp rx=0 tx=0).stop 2024-09-13T18:31:43.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e8f86e700 1 -- 172.21.15.44:0/42949822 reap_dead start 2024-09-13T18:31:43.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e8f86e700 1 -- 172.21.15.44:0/42949822 reap_dead start 2024-09-13T18:31:43.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e910b4500 1 -- 172.21.15.44:0/42949822 shutdown_connections 2024-09-13T18:31:43.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e910b4500 1 -- 172.21.15.44:0/42949822 >> 172.21.15.44:0/42949822 conn(0x558e824a4c00 msgr2=0x558e82561800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e910b4500 1 -- 172.21.15.44:0/42949822 shutdown_connections 2024-09-13T18:31:43.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.421+0000 7f7e910b4500 1 -- 172.21.15.44:0/42949822 wait complete. 2024-09-13T18:31:43.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.425+0000 7f7e910b4500 1 -- 172.21.15.44:0/4106852975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e824a5400 msgr2=0x558e8254ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.425+0000 7f7e910b4500 1 --2- 172.21.15.44:0/4106852975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e824a5400 0x558e8254ab00 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x558e82579380 tx=0x558e8257b8c0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.425+0000 7f7e910b4500 1 -- 172.21.15.44:0/4106852975 shutdown_connections 2024-09-13T18:31:43.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.425+0000 7f7e910b4500 1 --2- 172.21.15.44:0/4106852975 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e824a5000 0x558e8254b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.425+0000 7f7e910b4500 1 --2- 172.21.15.44:0/4106852975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e824a5400 0x558e8254ab00 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.425+0000 7f7e910b4500 1 --2- 172.21.15.44:0/4106852975 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558e824a5800 0x558e8254a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.425+0000 7f7e910b4500 1 -- 172.21.15.44:0/4106852975 >> 172.21.15.44:0/4106852975 conn(0x558e824a5c00 msgr2=0x558e82561000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.434 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.425+0000 7f7e910b4500 1 -- 172.21.15.44:0/4106852975 shutdown_connections 2024-09-13T18:31:43.435 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.425+0000 7f7e910b4500 1 -- 172.21.15.44:0/4106852975 wait complete. 2024-09-13T18:31:43.436 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' '!' -s /tmp/journal.bin ']' 2024-09-13T18:31:43.436 INFO:tasks.workunit.client.0.smithi044.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal reset --yes-i-really-really-mean-it 2024-09-13T18:31:43.478 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.469+0000 7f108b41c500 1 -- start start 2024-09-13T18:31:43.478 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.469+0000 7f108b41c500 1 Processor -- start 2024-09-13T18:31:43.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.469+0000 7f108b41c500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f020a1800 0x556f02146580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.469+0000 7f108b41c500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556f020a1400 0x556f02146b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.469+0000 7f108b41c500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x556f020a1000 0x556f02147080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.469+0000 7f108b41c500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f02122a00 con 0x556f020a1800 2024-09-13T18:31:43.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.469+0000 7f108b41c500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f02122780 con 0x556f020a1400 2024-09-13T18:31:43.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.469+0000 7f108b41c500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x556f02122640 con 0x556f020a1000 2024-09-13T18:31:43.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.469+0000 7f1089bd6700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f020a1800 0x556f02146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.469+0000 7f1089bd6700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f020a1800 0x556f02146580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59904/0 (socket says 172.21.15.44:59904) 2024-09-13T18:31:43.479 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.469+0000 7f10893d5700 1 --2- 172.21.15.44:0/21776542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556f020a1400 0x556f02146b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.480 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.469+0000 7f1089bd6700 1 -- 172.21.15.44:0/21776542 learned_addr learned my addr 172.21.15.44:0/21776542 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.480 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.469+0000 7f108a3d7700 1 --2- 172.21.15.44:0/21776542 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x556f020a1000 0x556f02147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.473+0000 7f1089bd6700 1 -- 172.21.15.44:0/21776542 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x556f020a1000 msgr2=0x556f02147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.473+0000 7f1089bd6700 1 --2- 172.21.15.44:0/21776542 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x556f020a1000 0x556f02147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.473+0000 7f1089bd6700 1 -- 172.21.15.44:0/21776542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556f020a1400 msgr2=0x556f02146b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.473+0000 7f1089bd6700 1 --2- 172.21.15.44:0/21776542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556f020a1400 0x556f02146b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.473+0000 7f1089bd6700 1 -- 172.21.15.44:0/21776542 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f020c49c0 con 0x556f020a1800 2024-09-13T18:31:43.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.473+0000 7f1089bd6700 1 --2- 172.21.15.44:0/21776542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f020a1800 0x556f02146580 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x556f021b7260 tx=0x556f0238c120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac03b3581dda9d12 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.473+0000 7f10873d1700 1 -- 172.21.15.44:0/21776542 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556f020f1600 con 0x556f020a1800 2024-09-13T18:31:43.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.473+0000 7f10873d1700 1 -- 172.21.15.44:0/21776542 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556f020ec900 con 0x556f020a1800 2024-09-13T18:31:43.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.473+0000 7f10873d1700 1 -- 172.21.15.44:0/21776542 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556f020f11e0 con 0x556f020a1800 2024-09-13T18:31:43.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.473+0000 7f108b41c500 1 -- 172.21.15.44:0/21776542 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556f020c4b60 con 0x556f020a1800 2024-09-13T18:31:43.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.473+0000 7f108b41c500 1 -- 172.21.15.44:0/21776542 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x556f020c4340 con 0x556f020a1800 2024-09-13T18:31:43.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.473+0000 7f10873d1700 1 -- 172.21.15.44:0/21776542 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x556f020dac40 con 0x556f020a1800 2024-09-13T18:31:43.482 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.473+0000 7f10873d1700 1 -- 172.21.15.44:0/21776542 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x556f02e6e900 con 0x556f020a1800 2024-09-13T18:31:43.483 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.473+0000 7f108b41c500 1 Processor -- start 2024-09-13T18:31:43.483 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.473+0000 7f108b41c500 1 -- start start 2024-09-13T18:31:43.483 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.473+0000 7f108b41c500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556f0239c400 0x556f02147600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.483 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.473+0000 7f108b41c500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x556f0239c800 0x556f02147b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.473+0000 7f108b41c500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f0239cc00 0x556f02148100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.473+0000 7f108b41c500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f020d7e00 con 0x556f0239cc00 2024-09-13T18:31:43.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.473+0000 7f108b41c500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f02122780 con 0x556f0239c400 2024-09-13T18:31:43.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.473+0000 7f108b41c500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x556f02122500 con 0x556f0239c800 2024-09-13T18:31:43.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f10893d5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f0239cc00 0x556f02148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f10893d5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f0239cc00 0x556f02148100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59914/0 (socket says 172.21.15.44:59914) 2024-09-13T18:31:43.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f10893d5700 1 -- 172.21.15.44:0/3222453279 learned_addr learned my addr 172.21.15.44:0/3222453279 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f108a3d7700 1 --2- 172.21.15.44:0/3222453279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556f0239c400 0x556f02147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f1089bd6700 1 --2- 172.21.15.44:0/3222453279 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x556f0239c800 0x556f02147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f10893d5700 1 -- 172.21.15.44:0/3222453279 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x556f0239c800 msgr2=0x556f02147b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f10893d5700 1 --2- 172.21.15.44:0/3222453279 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x556f0239c800 0x556f02147b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f10893d5700 1 -- 172.21.15.44:0/3222453279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556f0239c400 msgr2=0x556f02147600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f10893d5700 1 --2- 172.21.15.44:0/3222453279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556f0239c400 0x556f02147600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f10893d5700 1 -- 172.21.15.44:0/3222453279 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f020c4000 con 0x556f0239cc00 2024-09-13T18:31:43.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f10893d5700 1 --2- 172.21.15.44:0/3222453279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f0239cc00 0x556f02148100 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x556f023f2900 tx=0x556f02177860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4a0b4d0732788f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f10853cd700 1 -- 172.21.15.44:0/3222453279 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556f020f1080 con 0x556f0239cc00 2024-09-13T18:31:43.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f10853cd700 1 -- 172.21.15.44:0/3222453279 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556f02e82780 con 0x556f0239cc00 2024-09-13T18:31:43.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f10853cd700 1 -- 172.21.15.44:0/3222453279 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556f020f1600 con 0x556f0239cc00 2024-09-13T18:31:43.486 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f108b41c500 1 -- 172.21.15.44:0/3222453279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f0239cc00 msgr2=0x556f02148100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f108b41c500 1 --2- 172.21.15.44:0/3222453279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f0239cc00 0x556f02148100 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x556f023f2900 tx=0x556f02177860 comp rx=0 tx=0).stop 2024-09-13T18:31:43.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f108b41c500 1 -- 172.21.15.44:0/3222453279 shutdown_connections 2024-09-13T18:31:43.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f108b41c500 1 --2- 172.21.15.44:0/3222453279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f0239cc00 0x556f02148100 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f108b41c500 1 --2- 172.21.15.44:0/3222453279 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x556f0239c800 0x556f02147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f108b41c500 1 --2- 172.21.15.44:0/3222453279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556f0239c400 0x556f02147600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f108b41c500 1 -- 172.21.15.44:0/3222453279 >> 172.21.15.44:0/3222453279 conn(0x556f020a0c00 msgr2=0x556f021ad800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f108b41c500 1 -- 172.21.15.44:0/3222453279 shutdown_connections 2024-09-13T18:31:43.487 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f108b41c500 1 -- 172.21.15.44:0/3222453279 wait complete. 2024-09-13T18:31:43.488 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.477+0000 7f108b41c500 1 Processor -- start 2024-09-13T18:31:43.488 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.481+0000 7f108b41c500 1 -- start start 2024-09-13T18:31:43.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.481+0000 7f108b41c500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f0239c400 0x556f02149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.481+0000 7f108b41c500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556f0239c800 0x556f02148c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.481+0000 7f108b41c500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x556f0239cc00 0x556f02148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.481+0000 7f108b41c500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f021223c0 con 0x556f0239c400 2024-09-13T18:31:43.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.481+0000 7f108b41c500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f02122280 con 0x556f0239c800 2024-09-13T18:31:43.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.481+0000 7f108b41c500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x556f02122140 con 0x556f0239cc00 2024-09-13T18:31:43.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.481+0000 7f108a3d7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f0239c400 0x556f02149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.481+0000 7f108a3d7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f0239c400 0x556f02149180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59930/0 (socket says 172.21.15.44:59930) 2024-09-13T18:31:43.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.481+0000 7f108a3d7700 1 -- 172.21.15.44:0/1296230509 learned_addr learned my addr 172.21.15.44:0/1296230509 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.481+0000 7f1089bd6700 1 --2- 172.21.15.44:0/1296230509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556f0239c800 0x556f02148c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.481+0000 7f10893d5700 1 --2- 172.21.15.44:0/1296230509 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x556f0239cc00 0x556f02148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.481+0000 7f108a3d7700 1 -- 172.21.15.44:0/1296230509 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x556f0239cc00 msgr2=0x556f02148680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.481+0000 7f108a3d7700 1 --2- 172.21.15.44:0/1296230509 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x556f0239cc00 0x556f02148680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.481+0000 7f108a3d7700 1 -- 172.21.15.44:0/1296230509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556f0239c800 msgr2=0x556f02148c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.481+0000 7f108a3d7700 1 --2- 172.21.15.44:0/1296230509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556f0239c800 0x556f02148c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.491 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.481+0000 7f108a3d7700 1 -- 172.21.15.44:0/1296230509 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f020c41a0 con 0x556f0239c400 2024-09-13T18:31:43.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.481+0000 7f108a3d7700 1 --2- 172.21.15.44:0/1296230509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f0239c400 0x556f02149180 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x556f023f3710 tx=0x556f023b6c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.481+0000 7f1083bca700 1 -- 172.21.15.44:0/1296230509 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556f020f1080 con 0x556f0239c400 2024-09-13T18:31:43.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.481+0000 7f1083bca700 1 -- 172.21.15.44:0/1296230509 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556f02e83680 con 0x556f0239c400 2024-09-13T18:31:43.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.481+0000 7f108b41c500 1 -- 172.21.15.44:0/1296230509 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556f020c4000 con 0x556f0239c400 2024-09-13T18:31:43.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.481+0000 7f1083bca700 1 -- 172.21.15.44:0/1296230509 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556f020f1600 con 0x556f0239c400 2024-09-13T18:31:43.492 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.481+0000 7f108b41c500 1 -- 172.21.15.44:0/1296230509 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556f020c49c0 con 0x556f0239c400 2024-09-13T18:31:43.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.485+0000 7f1083bca700 1 -- 172.21.15.44:0/1296230509 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x556f02100840 con 0x556f0239c400 2024-09-13T18:31:43.494 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.485+0000 7f1083bca700 1 --2- 172.21.15.44:0/1296230509 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x556f0241e400 0x556f02149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.494 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.485+0000 7f1083bca700 1 -- 172.21.15.44:0/1296230509 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x556f020daa80 con 0x556f0239c400 2024-09-13T18:31:43.494 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.485+0000 7f1089bd6700 1 --2- 172.21.15.44:0/1296230509 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x556f0241e400 0x556f02149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.485+0000 7f1089bd6700 1 --2- 172.21.15.44:0/1296230509 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x556f0241e400 0x556f02149700 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x556f023f2630 tx=0x556f021760c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.489+0000 7f108b41c500 1 -- start start 2024-09-13T18:31:43.496 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.489+0000 7f108b41c500 1 Processor -- start 2024-09-13T18:31:43.498 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.489+0000 7f108b41c500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f0239d400 0x556f02148100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.489+0000 7f108b41c500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x556f0239d800 0x556f02147b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.489+0000 7f108b41c500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556f0241e800 0x556f02147600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.489+0000 7f108b41c500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f02122140 con 0x556f0239d400 2024-09-13T18:31:43.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.489+0000 7f108b41c500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f02122280 con 0x556f0241e800 2024-09-13T18:31:43.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.489+0000 7f108b41c500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x556f02122500 con 0x556f0239d800 2024-09-13T18:31:43.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.489+0000 7f108a3d7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f0239d400 0x556f02148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.489+0000 7f108a3d7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f0239d400 0x556f02148100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59932/0 (socket says 172.21.15.44:59932) 2024-09-13T18:31:43.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.489+0000 7f108a3d7700 1 -- 172.21.15.44:0/1366597603 learned_addr learned my addr 172.21.15.44:0/1366597603 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.489+0000 7f1089bd6700 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x556f0239d800 0x556f02147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.489+0000 7f10893d5700 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556f0241e800 0x556f02147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.489+0000 7f108a3d7700 1 -- 172.21.15.44:0/1366597603 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x556f0239d800 msgr2=0x556f02147b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.489+0000 7f108a3d7700 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x556f0239d800 0x556f02147b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.489+0000 7f108a3d7700 1 -- 172.21.15.44:0/1366597603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556f0241e800 msgr2=0x556f02147600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.489+0000 7f108a3d7700 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556f0241e800 0x556f02147600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.489+0000 7f108a3d7700 1 -- 172.21.15.44:0/1366597603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f0244d860 con 0x556f0239d400 2024-09-13T18:31:43.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.489+0000 7f108a3d7700 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f0239d400 0x556f02148100 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x556f024b91a0 tx=0x556f023b7500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6f38572dfe90c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.489+0000 7f1080bc4700 1 -- 172.21.15.44:0/1366597603 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556f020f0420 con 0x556f0239d400 2024-09-13T18:31:43.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.489+0000 7f1080bc4700 1 -- 172.21.15.44:0/1366597603 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556f02e82600 con 0x556f0239d400 2024-09-13T18:31:43.501 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.493+0000 7f1080bc4700 1 -- 172.21.15.44:0/1366597603 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556f020f06e0 con 0x556f0239d400 2024-09-13T18:31:43.502 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.493+0000 7f108b41c500 1 -- 172.21.15.44:0/1366597603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556f0244d6c0 con 0x556f0239d400 2024-09-13T18:31:43.502 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.493+0000 7f108b41c500 1 -- 172.21.15.44:0/1366597603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x556f0244d520 con 0x556f0239d400 2024-09-13T18:31:43.502 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.493+0000 7f1080bc4700 1 -- 172.21.15.44:0/1366597603 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x556f020da8c0 con 0x556f0239d400 2024-09-13T18:31:43.502 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.493+0000 7f1080bc4700 1 -- 172.21.15.44:0/1366597603 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x556f02406900 con 0x556f0239d400 2024-09-13T18:31:43.502 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.493+0000 7f108b41c500 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x556f0241ec00 0x556f02568000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.502 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.493+0000 7f108b41c500 1 -- 172.21.15.44:0/1366597603 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x556f0241f000 con 0x556f0241ec00 2024-09-13T18:31:43.502 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.493+0000 7f1089bd6700 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x556f0241ec00 0x556f02568000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.502 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.493+0000 7f1089bd6700 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x556f0241ec00 0x556f02568000 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=9013201beef7fb6c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.502 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.493+0000 7f1089bd6700 1 -- 172.21.15.44:0/1366597603 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x556f02f14b40 con 0x556f0241ec00 2024-09-13T18:31:43.502 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.493+0000 7f108b41c500 1 -- 172.21.15.44:0/1366597603 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x556f0241f400 con 0x556f0241ec00 2024-09-13T18:31:43.503 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.493+0000 7f1089bd6700 1 -- 172.21.15.44:0/1366597603 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x556f02f14b40 con 0x556f0241ec00 2024-09-13T18:31:43.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.493+0000 7f107f3c1700 1 -- 172.21.15.44:0/1366597603 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e51) v8 -- 0x556f02558800 con 0x556f0241ec00 2024-09-13T18:31:43.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.493+0000 7f107f3c1700 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x556f02558c00 0x556f0256a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.493+0000 7f107f3c1700 1 -- 172.21.15.44:0/1366597603 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e51) v8 -- 0x556f02559000 con 0x556f02558c00 2024-09-13T18:31:43.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.493+0000 7f10893d5700 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x556f02558c00 0x556f0256a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.493+0000 7f1089bd6700 1 -- 172.21.15.44:0/1366597603 <== osd.2 v2:172.21.15.44:6817/3180763837 3 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv22 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x556f02f14b40 con 0x556f0241ec00 2024-09-13T18:31:43.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.493+0000 7f10893d5700 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x556f02558c00 0x556f0256a680 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=6c78386a5fa085cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.497+0000 7f10893d5700 1 -- 172.21.15.44:0/1366597603 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x556f02f14d80 con 0x556f02558c00 2024-09-13T18:31:43.504 INFO:tasks.workunit.client.0.smithi044.stdout:old journal was 4194304~31930 2024-09-13T18:31:43.504 INFO:tasks.workunit.client.0.smithi044.stdout:new journal start will be 8388608 (4162374 bytes past old end) 2024-09-13T18:31:43.505 INFO:tasks.workunit.client.0.smithi044.stdout:writing journal head 2024-09-13T18:31:43.505 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.497+0000 7f108b41c500 1 -- 172.21.15.44:0/1366597603 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:5 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x556f0241f800 con 0x556f0241ec00 2024-09-13T18:31:43.506 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.497+0000 7f1089bd6700 1 -- 172.21.15.44:0/1366597603 <== osd.2 v2:172.21.15.44:6817/3180763837 4 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v51'23 uv23 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556f02f14b40 con 0x556f0241ec00 2024-09-13T18:31:43.507 INFO:tasks.workunit.client.0.smithi044.stdout:writing EResetJournal entry 2024-09-13T18:31:43.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.497+0000 7f108b41c500 1 -- 172.21.15.44:0/1366597603 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:6 6.1b 6:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x556f0241fc00 con 0x556f02558c00 2024-09-13T18:31:43.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.497+0000 7f108b41c500 1 -- 172.21.15.44:0/1366597603 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:7 6.b 6:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x556f02558800 con 0x556f02558c00 2024-09-13T18:31:43.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.497+0000 7f108b41c500 1 -- 172.21.15.44:0/1366597603 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:8 6.1f 6:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x556f02559400 con 0x556f02558c00 2024-09-13T18:31:43.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.497+0000 7f108b41c500 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x556f02559800 0x556f02568580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.497+0000 7f108b41c500 1 -- 172.21.15.44:0/1366597603 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:9 6.1a 6:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x556f02559c00 con 0x556f02559800 2024-09-13T18:31:43.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.497+0000 7f108b41c500 1 -- 172.21.15.44:0/1366597603 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:10 6.1e 6:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x556f0241f000 con 0x556f02559800 2024-09-13T18:31:43.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.497+0000 7f108b41c500 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x556f0241f400 0x556f02568b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.497+0000 7f108b41c500 1 -- 172.21.15.44:0/1366597603 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:11 6.1d 6:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x556f0241fc00 con 0x556f0241f400 2024-09-13T18:31:43.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.497+0000 7f1089bd6700 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x556f0241f400 0x556f02568b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.501+0000 7f108a3d7700 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x556f02559800 0x556f02568580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.501+0000 7f1089bd6700 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x556f0241f400 0x556f02568b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=ad2cfaac93497a30 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.501+0000 7f108a3d7700 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x556f02559800 0x556f02568580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=dd683e3dd7ff2b85 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.501+0000 7f10893d5700 1 -- 172.21.15.44:0/1366597603 <== osd.3 v2:172.21.15.44:6808/771281770 2 ==== osd_op_reply(8 200.00000004 [delete] v51'5 uv3 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x556f02f14d80 con 0x556f02558c00 2024-09-13T18:31:43.509 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.501+0000 7f10893d5700 1 -- 172.21.15.44:0/1366597603 <== osd.3 v2:172.21.15.44:6808/771281770 3 ==== osd_op_reply(6 200.00000002 [delete] v51'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x556f02f14d80 con 0x556f02558c00 2024-09-13T18:31:43.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.501+0000 7f10893d5700 1 -- 172.21.15.44:0/1366597603 <== osd.3 v2:172.21.15.44:6808/771281770 4 ==== osd_op_reply(7 200.00000003 [delete] v51'4 uv1 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x556f02f14d80 con 0x556f02558c00 2024-09-13T18:31:43.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.501+0000 7f107f3c1700 1 -- 172.21.15.44:0/1366597603 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:12 6.1b 6:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x556f02582000 con 0x556f02558c00 2024-09-13T18:31:43.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.501+0000 7f1089bd6700 1 -- 172.21.15.44:0/1366597603 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== osd_op_reply(11 200.00000007 [delete] v51'4 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x556f02f14b40 con 0x556f0241f400 2024-09-13T18:31:43.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.505+0000 7f108a3d7700 1 -- 172.21.15.44:0/1366597603 <== osd.4 v2:172.21.15.99:6816/2515272044 1 ==== osd_op_reply(9 200.00000005 [delete] v51'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x556f02f158c0 con 0x556f02559800 2024-09-13T18:31:43.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.505+0000 7f108a3d7700 1 -- 172.21.15.44:0/1366597603 <== osd.4 v2:172.21.15.99:6816/2515272044 2 ==== osd_op_reply(10 200.00000006 [delete] v51'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x556f02f158c0 con 0x556f02559800 2024-09-13T18:31:43.514 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.505+0000 7f10893d5700 1 -- 172.21.15.44:0/1366597603 <== osd.3 v2:172.21.15.44:6808/771281770 5 ==== osd_op_reply(12 200.00000002 [write 0~48] v51'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x556f02f14d80 con 0x556f02558c00 2024-09-13T18:31:43.514 INFO:tasks.workunit.client.0.smithi044.stdout:done 2024-09-13T18:31:43.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.505+0000 7f108b41c500 1 -- 172.21.15.44:0/1366597603 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x556f0241f400 msgr2=0x556f02568b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.505+0000 7f108b41c500 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x556f0241f400 0x556f02568b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.505+0000 7f108b41c500 1 -- 172.21.15.44:0/1366597603 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x556f0241ec00 msgr2=0x556f02568000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.505+0000 7f108b41c500 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x556f0241ec00 0x556f02568000 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.505+0000 7f108b41c500 1 -- 172.21.15.44:0/1366597603 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x556f02558c00 msgr2=0x556f0256a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.505+0000 7f108b41c500 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x556f02558c00 0x556f0256a680 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.505+0000 7f108b41c500 1 -- 172.21.15.44:0/1366597603 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x556f02559800 msgr2=0x556f02568580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.505+0000 7f108b41c500 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x556f02559800 0x556f02568580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.505+0000 7f10893d5700 1 -- 172.21.15.44:0/1366597603 reap_dead start 2024-09-13T18:31:43.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.505+0000 7f108b41c500 1 -- 172.21.15.44:0/1366597603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f0239d400 msgr2=0x556f02148100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.517 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.505+0000 7f108b41c500 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f0239d400 0x556f02148100 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x556f024b91a0 tx=0x556f023b7500 comp rx=0 tx=0).stop 2024-09-13T18:31:43.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.505+0000 7f108b41c500 1 -- 172.21.15.44:0/1366597603 shutdown_connections 2024-09-13T18:31:43.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.505+0000 7f108b41c500 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x556f02559800 0x556f02568580 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.505+0000 7f108b41c500 1 --2- 172.21.15.44:0/1366597603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f0239d400 0x556f02148100 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.505+0000 7f108b41c500 1 -- 172.21.15.44:0/1366597603 >> 172.21.15.44:0/1366597603 conn(0x556f0239d000 msgr2=0x556f021ae000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.505+0000 7f108b41c500 1 -- 172.21.15.44:0/1366597603 shutdown_connections 2024-09-13T18:31:43.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.505+0000 7f108b41c500 1 -- 172.21.15.44:0/1366597603 wait complete. 2024-09-13T18:31:43.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.505+0000 7f108b41c500 1 -- 172.21.15.44:0/1296230509 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x556f0241e400 msgr2=0x556f02149700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.509+0000 7f108b41c500 1 --2- 172.21.15.44:0/1296230509 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x556f0241e400 0x556f02149700 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x556f023f2630 tx=0x556f021760c0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.509+0000 7f108b41c500 1 -- 172.21.15.44:0/1296230509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f0239c400 msgr2=0x556f02149180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.509+0000 7f108b41c500 1 --2- 172.21.15.44:0/1296230509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f0239c400 0x556f02149180 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x556f023f3710 tx=0x556f023b6c00 comp rx=0 tx=0).stop 2024-09-13T18:31:43.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.509+0000 7f108b41c500 1 -- 172.21.15.44:0/1296230509 shutdown_connections 2024-09-13T18:31:43.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.509+0000 7f108b41c500 1 --2- 172.21.15.44:0/1296230509 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x556f0241e400 0x556f02149700 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.509+0000 7f108b41c500 1 --2- 172.21.15.44:0/1296230509 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x556f0239cc00 0x556f02148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.518 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.509+0000 7f108b41c500 1 --2- 172.21.15.44:0/1296230509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556f0239c800 0x556f02148c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.509+0000 7f108b41c500 1 --2- 172.21.15.44:0/1296230509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f0239c400 0x556f02149180 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.509+0000 7f108b41c500 1 -- 172.21.15.44:0/1296230509 >> 172.21.15.44:0/1296230509 conn(0x556f020a0c00 msgr2=0x556f021ad800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.509+0000 7f108b41c500 1 -- 172.21.15.44:0/1296230509 shutdown_connections 2024-09-13T18:31:43.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.509+0000 7f108b41c500 1 -- 172.21.15.44:0/1296230509 wait complete. 2024-09-13T18:31:43.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.509+0000 7f108b41c500 1 -- 172.21.15.44:0/21776542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f020a1800 msgr2=0x556f02146580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.509+0000 7f108b41c500 1 --2- 172.21.15.44:0/21776542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f020a1800 0x556f02146580 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x556f021b7260 tx=0x556f0238c120 comp rx=0 tx=0).stop 2024-09-13T18:31:43.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.509+0000 7f108b41c500 1 -- 172.21.15.44:0/21776542 shutdown_connections 2024-09-13T18:31:43.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.509+0000 7f108b41c500 1 --2- 172.21.15.44:0/21776542 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x556f020a1000 0x556f02147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.509+0000 7f108b41c500 1 --2- 172.21.15.44:0/21776542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556f020a1400 0x556f02146b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.509+0000 7f108b41c500 1 --2- 172.21.15.44:0/21776542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f020a1800 0x556f02146580 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.509+0000 7f108b41c500 1 -- 172.21.15.44:0/21776542 >> 172.21.15.44:0/21776542 conn(0x556f020a1c00 msgr2=0x556f021ad000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.509+0000 7f108b41c500 1 -- 172.21.15.44:0/21776542 shutdown_connections 2024-09-13T18:31:43.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.509+0000 7f108b41c500 1 -- 172.21.15.44:0/21776542 wait complete. 2024-09-13T18:31:43.520 INFO:tasks.workunit.client.0.smithi044.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal inspect 2024-09-13T18:31:43.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff9356c5500 1 -- start start 2024-09-13T18:31:43.560 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff9356c5500 1 Processor -- start 2024-09-13T18:31:43.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff9356c5500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e1034d7800 0x55e10357c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff9356c5500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1034d7400 0x55e10357cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff9356c5500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e1034d7000 0x55e10357d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff9356c5500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e10350de00 con 0x55e1034d7400 2024-09-13T18:31:43.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff9356c5500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e103558a00 con 0x55e1034d7800 2024-09-13T18:31:43.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff9356c5500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e103558640 con 0x55e1034d7000 2024-09-13T18:31:43.563 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff93367e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1034d7400 0x55e10357cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff93367e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1034d7400 0x55e10357cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59950/0 (socket says 172.21.15.44:59950) 2024-09-13T18:31:43.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff93367e700 1 -- 172.21.15.44:0/2114701517 learned_addr learned my addr 172.21.15.44:0/2114701517 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff933e7f700 1 --2- 172.21.15.44:0/2114701517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e1034d7800 0x55e10357c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff934680700 1 --2- 172.21.15.44:0/2114701517 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e1034d7000 0x55e10357d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff93367e700 1 -- 172.21.15.44:0/2114701517 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e1034d7000 msgr2=0x55e10357d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff93367e700 1 --2- 172.21.15.44:0/2114701517 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e1034d7000 0x55e10357d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff93367e700 1 -- 172.21.15.44:0/2114701517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e1034d7800 msgr2=0x55e10357c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff93367e700 1 --2- 172.21.15.44:0/2114701517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e1034d7800 0x55e10357c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff93367e700 1 -- 172.21.15.44:0/2114701517 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1034fa9c0 con 0x55e1034d7400 2024-09-13T18:31:43.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff934680700 1 --2- 172.21.15.44:0/2114701517 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e1034d7000 0x55e10357d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:43.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff93367e700 1 --2- 172.21.15.44:0/2114701517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1034d7400 0x55e10357cb00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x55e1035ab350 tx=0x55e10434e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5719f8a377bee9b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff93167a700 1 -- 172.21.15.44:0/2114701517 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e103527600 con 0x55e1034d7400 2024-09-13T18:31:43.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff93167a700 1 -- 172.21.15.44:0/2114701517 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e103522180 con 0x55e1034d7400 2024-09-13T18:31:43.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff93167a700 1 -- 172.21.15.44:0/2114701517 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e1035271e0 con 0x55e1034d7400 2024-09-13T18:31:43.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff9356c5500 1 -- 172.21.15.44:0/2114701517 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e1034fab60 con 0x55e1034d7400 2024-09-13T18:31:43.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.553+0000 7ff9356c5500 1 -- 172.21.15.44:0/2114701517 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55e1034fa340 con 0x55e1034d7400 2024-09-13T18:31:43.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff93167a700 1 -- 172.21.15.44:0/2114701517 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x55e103510c40 con 0x55e1034d7400 2024-09-13T18:31:43.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff93167a700 1 -- 172.21.15.44:0/2114701517 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x55e10434a900 con 0x55e1034d7400 2024-09-13T18:31:43.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff9356c5500 1 Processor -- start 2024-09-13T18:31:43.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff9356c5500 1 -- start start 2024-09-13T18:31:43.566 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff9356c5500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e10435e400 0x55e10357d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff9356c5500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e10435e800 0x55e10357db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff9356c5500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e10435ec00 0x55e10357e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff9356c5500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e103558500 con 0x55e10435e800 2024-09-13T18:31:43.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff9356c5500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1035583c0 con 0x55e10435e400 2024-09-13T18:31:43.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff9356c5500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e103558a00 con 0x55e10435ec00 2024-09-13T18:31:43.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff933e7f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e10435e800 0x55e10357db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff93367e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e10435ec00 0x55e10357e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff934680700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e10435e400 0x55e10357d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff93367e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e10435ec00 0x55e10357e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:58350/0 (socket says 172.21.15.44:58350) 2024-09-13T18:31:43.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff93367e700 1 -- 172.21.15.44:0/210193407 learned_addr learned my addr 172.21.15.44:0/210193407 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff93367e700 1 -- 172.21.15.44:0/210193407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e10435e400 msgr2=0x55e10357d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff93367e700 1 --2- 172.21.15.44:0/210193407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e10435e400 0x55e10357d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.567 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff93367e700 1 -- 172.21.15.44:0/210193407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e10435e800 msgr2=0x55e10357db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff93367e700 1 --2- 172.21.15.44:0/210193407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e10435e800 0x55e10357db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff93367e700 1 -- 172.21.15.44:0/210193407 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1034fa000 con 0x55e10435ec00 2024-09-13T18:31:43.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff933e7f700 1 --2- 172.21.15.44:0/210193407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e10435e800 0x55e10357db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:43.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff93367e700 1 --2- 172.21.15.44:0/210193407 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e10435ec00 0x55e10357e100 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55e1037d66f0 tx=0x55e10434e060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2afa88c7206a0de8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff92f676700 1 -- 172.21.15.44:0/210193407 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e103526f20 con 0x55e10435ec00 2024-09-13T18:31:43.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff92f676700 1 -- 172.21.15.44:0/210193407 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e1042c3800 con 0x55e10435ec00 2024-09-13T18:31:43.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.557+0000 7ff92f676700 1 -- 172.21.15.44:0/210193407 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e103527600 con 0x55e10435ec00 2024-09-13T18:31:43.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff9356c5500 1 -- 172.21.15.44:0/210193407 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e10435ec00 msgr2=0x55e10357e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff9356c5500 1 --2- 172.21.15.44:0/210193407 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e10435ec00 0x55e10357e100 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55e1037d66f0 tx=0x55e10434e060 comp rx=0 tx=0).stop 2024-09-13T18:31:43.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff9356c5500 1 -- 172.21.15.44:0/210193407 shutdown_connections 2024-09-13T18:31:43.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff9356c5500 1 --2- 172.21.15.44:0/210193407 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e10435ec00 0x55e10357e100 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.570 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff9356c5500 1 --2- 172.21.15.44:0/210193407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e10435e800 0x55e10357db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff9356c5500 1 --2- 172.21.15.44:0/210193407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e10435e400 0x55e10357d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff9356c5500 1 -- 172.21.15.44:0/210193407 >> 172.21.15.44:0/210193407 conn(0x55e1034d6c00 msgr2=0x55e103593800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff9356c5500 1 -- 172.21.15.44:0/210193407 shutdown_connections 2024-09-13T18:31:43.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff9356c5500 1 -- 172.21.15.44:0/210193407 wait complete. 2024-09-13T18:31:43.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff9356c5500 1 Processor -- start 2024-09-13T18:31:43.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff9356c5500 1 -- start start 2024-09-13T18:31:43.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff9356c5500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e10435e400 0x55e10357f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff9356c5500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e10435e800 0x55e10357ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff9356c5500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e10435ec00 0x55e10357e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff9356c5500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e103558280 con 0x55e10435e800 2024-09-13T18:31:43.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff9356c5500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e103558140 con 0x55e10435e400 2024-09-13T18:31:43.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff9356c5500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e103558000 con 0x55e10435ec00 2024-09-13T18:31:43.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff933e7f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e10435e800 0x55e10357ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.572 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff933e7f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e10435e800 0x55e10357ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59968/0 (socket says 172.21.15.44:59968) 2024-09-13T18:31:43.572 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff933e7f700 1 -- 172.21.15.44:0/2666058312 learned_addr learned my addr 172.21.15.44:0/2666058312 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.572 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff934680700 1 --2- 172.21.15.44:0/2666058312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e10435e400 0x55e10357f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.572 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff93367e700 1 --2- 172.21.15.44:0/2666058312 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e10435ec00 0x55e10357e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff933e7f700 1 -- 172.21.15.44:0/2666058312 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e10435ec00 msgr2=0x55e10357e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff933e7f700 1 --2- 172.21.15.44:0/2666058312 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e10435ec00 0x55e10357e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff933e7f700 1 -- 172.21.15.44:0/2666058312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e10435e400 msgr2=0x55e10357f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff933e7f700 1 --2- 172.21.15.44:0/2666058312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e10435e400 0x55e10357f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff933e7f700 1 -- 172.21.15.44:0/2666058312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1034fa9c0 con 0x55e10435e800 2024-09-13T18:31:43.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.561+0000 7ff933e7f700 1 --2- 172.21.15.44:0/2666058312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e10435e800 0x55e10357ec00 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x55e1037d72c0 tx=0x55e1035ad8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.565+0000 7ff92de73700 1 -- 172.21.15.44:0/2666058312 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e103527080 con 0x55e10435e800 2024-09-13T18:31:43.573 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.565+0000 7ff9356c5500 1 -- 172.21.15.44:0/2666058312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e1034fab60 con 0x55e10435e800 2024-09-13T18:31:43.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.565+0000 7ff9356c5500 1 -- 172.21.15.44:0/2666058312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e1034faea0 con 0x55e10435e800 2024-09-13T18:31:43.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.565+0000 7ff92de73700 1 -- 172.21.15.44:0/2666058312 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e103522480 con 0x55e10435e800 2024-09-13T18:31:43.574 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.565+0000 7ff92de73700 1 -- 172.21.15.44:0/2666058312 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e103526f20 con 0x55e10435e800 2024-09-13T18:31:43.575 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.565+0000 7ff92de73700 1 -- 172.21.15.44:0/2666058312 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x55e103536840 con 0x55e10435e800 2024-09-13T18:31:43.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.569+0000 7ff92de73700 1 --2- 172.21.15.44:0/2666058312 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55e10435a400 0x55e10357f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.569+0000 7ff92de73700 1 -- 172.21.15.44:0/2666058312 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x55e103510a80 con 0x55e10435e800 2024-09-13T18:31:43.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.569+0000 7ff9356c5500 1 --2- 172.21.15.44:0/2666058312 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55e10435f000 0x55e10357e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.569+0000 7ff9356c5500 1 -- 172.21.15.44:0/2666058312 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55e10435f400 con 0x55e10435f000 2024-09-13T18:31:43.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.569+0000 7ff934680700 1 --2- 172.21.15.44:0/2666058312 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55e10435a400 0x55e10357f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.569+0000 7ff93367e700 1 --2- 172.21.15.44:0/2666058312 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55e10435f000 0x55e10357e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.569+0000 7ff934680700 1 --2- 172.21.15.44:0/2666058312 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55e10435a400 0x55e10357f700 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55e1035aa7b0 tx=0x55e1037dbf80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.577 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.569+0000 7ff93367e700 1 --2- 172.21.15.44:0/2666058312 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55e10435f000 0x55e10357e100 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.569+0000 7ff93367e700 1 -- 172.21.15.44:0/2666058312 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55e104244b40 con 0x55e10435f000 2024-09-13T18:31:43.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.569+0000 7ff9356c5500 1 -- 172.21.15.44:0/2666058312 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55e10435f800 con 0x55e10435f000 2024-09-13T18:31:43.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.569+0000 7ff93367e700 1 -- 172.21.15.44:0/2666058312 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv23 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55e104244b40 con 0x55e10435f000 2024-09-13T18:31:43.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.569+0000 7ff9356c5500 1 --2- 172.21.15.44:0/2666058312 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55e10435a800 0x55e10357db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.569+0000 7ff9356c5500 1 -- 172.21.15.44:0/2666058312 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:3 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55e10435ac00 con 0x55e10435a800 2024-09-13T18:31:43.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.569+0000 7ff934680700 1 --2- 172.21.15.44:0/2666058312 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55e10435a800 0x55e10357db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.569+0000 7ff934680700 1 --2- 172.21.15.44:0/2666058312 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55e10435a800 0x55e10357db80 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.580 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff934680700 1 -- 172.21.15.44:0/2666058312 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(3 200.00000002 [read 0~48 out=48b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+48 (crc 0 0 0) 0x55e104244d80 con 0x55e10435a800 2024-09-13T18:31:43.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff9356c5500 1 -- 172.21.15.44:0/2666058312 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:4 6.b 6:d5c7a900:::200.00000003:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55e10435b000 con 0x55e10435a800 2024-09-13T18:31:43.581 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff934680700 1 -- 172.21.15.44:0/2666058312 <== osd.3 v2:172.21.15.44:6808/771281770 2 ==== osd_op_reply(4 200.00000003 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55e104244d80 con 0x55e10435a800 2024-09-13T18:31:43.581 INFO:tasks.workunit.client.0.smithi044.stdout:Overall journal integrity: OK 2024-09-13T18:31:43.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff9356c5500 1 -- 172.21.15.44:0/2666058312 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55e10435f000 msgr2=0x55e10357e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff9356c5500 1 --2- 172.21.15.44:0/2666058312 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55e10435f000 0x55e10357e100 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff9356c5500 1 -- 172.21.15.44:0/2666058312 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55e10435a800 msgr2=0x55e10357db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff9356c5500 1 --2- 172.21.15.44:0/2666058312 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55e10435a800 0x55e10357db80 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff9356c5500 1 -- 172.21.15.44:0/2666058312 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55e10435a400 msgr2=0x55e10357f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff9356c5500 1 --2- 172.21.15.44:0/2666058312 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55e10435a400 0x55e10357f700 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55e1035aa7b0 tx=0x55e1037dbf80 comp rx=0 tx=0).stop 2024-09-13T18:31:43.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff9356c5500 1 -- 172.21.15.44:0/2666058312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e10435e800 msgr2=0x55e10357ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff9356c5500 1 --2- 172.21.15.44:0/2666058312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e10435e800 0x55e10357ec00 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x55e1037d72c0 tx=0x55e1035ad8c0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff933e7f700 1 -- 172.21.15.44:0/2666058312 reap_dead start 2024-09-13T18:31:43.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff933e7f700 1 -- 172.21.15.44:0/2666058312 reap_dead start 2024-09-13T18:31:43.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff9356c5500 1 -- 172.21.15.44:0/2666058312 shutdown_connections 2024-09-13T18:31:43.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff9356c5500 1 -- 172.21.15.44:0/2666058312 >> 172.21.15.44:0/2666058312 conn(0x55e1034d6c00 msgr2=0x55e103593800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff9356c5500 1 -- 172.21.15.44:0/2666058312 shutdown_connections 2024-09-13T18:31:43.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff9356c5500 1 -- 172.21.15.44:0/2666058312 wait complete. 2024-09-13T18:31:43.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff9356c5500 1 -- 172.21.15.44:0/2114701517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1034d7400 msgr2=0x55e10357cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff9356c5500 1 --2- 172.21.15.44:0/2114701517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1034d7400 0x55e10357cb00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x55e1035ab350 tx=0x55e10434e180 comp rx=0 tx=0).stop 2024-09-13T18:31:43.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff9356c5500 1 -- 172.21.15.44:0/2114701517 shutdown_connections 2024-09-13T18:31:43.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff9356c5500 1 --2- 172.21.15.44:0/2114701517 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e1034d7000 0x55e10357d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff9356c5500 1 --2- 172.21.15.44:0/2114701517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1034d7400 0x55e10357cb00 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff9356c5500 1 --2- 172.21.15.44:0/2114701517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e1034d7800 0x55e10357c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff9356c5500 1 -- 172.21.15.44:0/2114701517 >> 172.21.15.44:0/2114701517 conn(0x55e1034d7c00 msgr2=0x55e103593000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff9356c5500 1 -- 172.21.15.44:0/2114701517 shutdown_connections 2024-09-13T18:31:43.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.573+0000 7ff9356c5500 1 -- 172.21.15.44:0/2114701517 wait complete. 2024-09-13T18:31:43.586 INFO:tasks.workunit.client.0.smithi044.stderr:+ cephfs-journal-tool --rank=cephfs:0 header get 2024-09-13T18:31:43.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.617+0000 7f0d95a54500 1 -- start start 2024-09-13T18:31:43.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.617+0000 7f0d95a54500 1 Processor -- start 2024-09-13T18:31:43.626 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.617+0000 7f0d95a54500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d213943800 0x55d2139e8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.626 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.617+0000 7f0d95a54500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d213943400 0x55d2139e8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.626 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.617+0000 7f0d95a54500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d213943000 0x55d2139e9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.626 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.617+0000 7f0d95a54500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2139c4640 con 0x55d213943400 2024-09-13T18:31:43.626 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.617+0000 7f0d95a54500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2139c4780 con 0x55d213943800 2024-09-13T18:31:43.626 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.617+0000 7f0d95a54500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2139c4a00 con 0x55d213943000 2024-09-13T18:31:43.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.617+0000 7f0d93a0d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d213943400 0x55d2139e8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.617+0000 7f0d93a0d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d213943400 0x55d2139e8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59976/0 (socket says 172.21.15.44:59976) 2024-09-13T18:31:43.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.617+0000 7f0d9420e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d213943800 0x55d2139e8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.617+0000 7f0d93a0d700 1 -- 172.21.15.44:0/4275347866 learned_addr learned my addr 172.21.15.44:0/4275347866 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.627 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.617+0000 7f0d94a0f700 1 --2- 172.21.15.44:0/4275347866 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d213943000 0x55d2139e9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.617+0000 7f0d94a0f700 1 -- 172.21.15.44:0/4275347866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d213943800 msgr2=0x55d2139e8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.617+0000 7f0d94a0f700 1 --2- 172.21.15.44:0/4275347866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d213943800 0x55d2139e8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.617+0000 7f0d94a0f700 1 -- 172.21.15.44:0/4275347866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d213943400 msgr2=0x55d2139e8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.617+0000 7f0d94a0f700 1 --2- 172.21.15.44:0/4275347866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d213943400 0x55d2139e8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.617+0000 7f0d94a0f700 1 -- 172.21.15.44:0/4275347866 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2139669c0 con 0x55d213943000 2024-09-13T18:31:43.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.617+0000 7f0d94a0f700 1 --2- 172.21.15.44:0/4275347866 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d213943000 0x55d2139e9080 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55d213a352c0 tx=0x55d2147cc120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3b6f730736607e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.621+0000 7f0d91a09700 1 -- 172.21.15.44:0/4275347866 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d213993600 con 0x55d213943000 2024-09-13T18:31:43.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.621+0000 7f0d91a09700 1 -- 172.21.15.44:0/4275347866 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d21398e900 con 0x55d213943000 2024-09-13T18:31:43.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.621+0000 7f0d91a09700 1 -- 172.21.15.44:0/4275347866 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d2139931e0 con 0x55d213943000 2024-09-13T18:31:43.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.621+0000 7f0d95a54500 1 -- 172.21.15.44:0/4275347866 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d213966340 con 0x55d213943000 2024-09-13T18:31:43.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.621+0000 7f0d95a54500 1 -- 172.21.15.44:0/4275347866 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55d213966000 con 0x55d213943000 2024-09-13T18:31:43.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.621+0000 7f0d91a09700 1 -- 172.21.15.44:0/4275347866 <== mon.2 v2:172.21.15.99:3301/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x55d21397cc40 con 0x55d213943000 2024-09-13T18:31:43.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.621+0000 7f0d91a09700 1 -- 172.21.15.44:0/4275347866 <== mon.2 v2:172.21.15.99:3301/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x55d214724900 con 0x55d213943000 2024-09-13T18:31:43.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.621+0000 7f0d95a54500 1 Processor -- start 2024-09-13T18:31:43.630 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.621+0000 7f0d95a54500 1 -- start start 2024-09-13T18:31:43.632 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d95a54500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d213c32400 0x55d2139e9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d95a54500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d213c32800 0x55d2139e9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d95a54500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d213c32c00 0x55d2139ea100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d95a54500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d213979e00 con 0x55d213c32400 2024-09-13T18:31:43.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d95a54500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2139c4640 con 0x55d213c32c00 2024-09-13T18:31:43.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d95a54500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2139c4a00 con 0x55d213c32800 2024-09-13T18:31:43.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d93a0d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d213c32400 0x55d2139e9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d93a0d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d213c32400 0x55d2139e9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59978/0 (socket says 172.21.15.44:59978) 2024-09-13T18:31:43.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d93a0d700 1 -- 172.21.15.44:0/3736482323 learned_addr learned my addr 172.21.15.44:0/3736482323 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d9420e700 1 --2- 172.21.15.44:0/3736482323 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d213c32800 0x55d2139e9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d93a0d700 1 --2- 172.21.15.44:0/3736482323 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d213c32c00 0x55d2139ea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d93a0d700 1 -- 172.21.15.44:0/3736482323 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d213c32800 msgr2=0x55d2139e9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d93a0d700 1 --2- 172.21.15.44:0/3736482323 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d213c32800 0x55d2139e9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.633 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d93a0d700 1 -- 172.21.15.44:0/3736482323 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d213c32c00 msgr2=0x55d2139ea100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.634 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d93a0d700 1 --2- 172.21.15.44:0/3736482323 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d213c32c00 0x55d2139ea100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.634 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d93a0d700 1 -- 172.21.15.44:0/3736482323 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d213966ea0 con 0x55d213c32400 2024-09-13T18:31:43.634 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d93a0d700 1 --2- 172.21.15.44:0/3736482323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d213c32400 0x55d2139e9600 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x55d213c8a720 tx=0x55d213a09ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8af7d666fe921e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d8fa05700 1 -- 172.21.15.44:0/3736482323 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d213993600 con 0x55d213c32400 2024-09-13T18:31:43.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d8fa05700 1 -- 172.21.15.44:0/3736482323 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d213a16780 con 0x55d213c32400 2024-09-13T18:31:43.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d8fa05700 1 -- 172.21.15.44:0/3736482323 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d2139931e0 con 0x55d213c32400 2024-09-13T18:31:43.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d95a54500 1 -- 172.21.15.44:0/3736482323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d213c32400 msgr2=0x55d2139e9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d95a54500 1 --2- 172.21.15.44:0/3736482323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d213c32400 0x55d2139e9600 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x55d213c8a720 tx=0x55d213a09ec0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.636 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d95a54500 1 -- 172.21.15.44:0/3736482323 shutdown_connections 2024-09-13T18:31:43.636 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d95a54500 1 --2- 172.21.15.44:0/3736482323 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d213c32c00 0x55d2139ea100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.636 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d95a54500 1 --2- 172.21.15.44:0/3736482323 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d213c32800 0x55d2139e9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.636 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d95a54500 1 --2- 172.21.15.44:0/3736482323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d213c32400 0x55d2139e9600 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.636 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d95a54500 1 -- 172.21.15.44:0/3736482323 >> 172.21.15.44:0/3736482323 conn(0x55d213942c00 msgr2=0x55d2139ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.636 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d95a54500 1 -- 172.21.15.44:0/3736482323 shutdown_connections 2024-09-13T18:31:43.636 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d95a54500 1 -- 172.21.15.44:0/3736482323 wait complete. 2024-09-13T18:31:43.636 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.625+0000 7f0d95a54500 1 Processor -- start 2024-09-13T18:31:43.636 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.629+0000 7f0d95a54500 1 -- start start 2024-09-13T18:31:43.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.629+0000 7f0d95a54500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d213c32400 0x55d2139eb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.629+0000 7f0d95a54500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d213c32800 0x55d2139eac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.629+0000 7f0d95a54500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d213c32c00 0x55d2139ea680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.629+0000 7f0d95a54500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2139c4500 con 0x55d213c32c00 2024-09-13T18:31:43.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.629+0000 7f0d95a54500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2139c43c0 con 0x55d213c32400 2024-09-13T18:31:43.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.629+0000 7f0d95a54500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2139c4280 con 0x55d213c32800 2024-09-13T18:31:43.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.629+0000 7f0d93a0d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d213c32c00 0x55d2139ea680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.629+0000 7f0d93a0d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d213c32c00 0x55d2139ea680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59986/0 (socket says 172.21.15.44:59986) 2024-09-13T18:31:43.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.629+0000 7f0d93a0d700 1 -- 172.21.15.44:0/2699867897 learned_addr learned my addr 172.21.15.44:0/2699867897 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.629+0000 7f0d9420e700 1 --2- 172.21.15.44:0/2699867897 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d213c32800 0x55d2139eac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.629+0000 7f0d93a0d700 1 --2- 172.21.15.44:0/2699867897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d213c32400 0x55d2139eb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.629+0000 7f0d93a0d700 1 -- 172.21.15.44:0/2699867897 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d213c32800 msgr2=0x55d2139eac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.629+0000 7f0d93a0d700 1 --2- 172.21.15.44:0/2699867897 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d213c32800 0x55d2139eac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.629+0000 7f0d93a0d700 1 -- 172.21.15.44:0/2699867897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d213c32400 msgr2=0x55d2139eb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.629+0000 7f0d93a0d700 1 --2- 172.21.15.44:0/2699867897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d213c32400 0x55d2139eb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.629+0000 7f0d93a0d700 1 -- 172.21.15.44:0/2699867897 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2139661a0 con 0x55d213c32c00 2024-09-13T18:31:43.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.629+0000 7f0d93a0d700 1 --2- 172.21.15.44:0/2699867897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d213c32c00 0x55d2139ea680 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x55d213c8a990 tx=0x55d213a09f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.629+0000 7f0d8e202700 1 -- 172.21.15.44:0/2699867897 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d213993600 con 0x55d213c32c00 2024-09-13T18:31:43.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.629+0000 7f0d8e202700 1 -- 172.21.15.44:0/2699867897 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d213a16a80 con 0x55d213c32c00 2024-09-13T18:31:43.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.629+0000 7f0d95a54500 1 -- 172.21.15.44:0/2699867897 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d213966ea0 con 0x55d213c32c00 2024-09-13T18:31:43.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.629+0000 7f0d8e202700 1 -- 172.21.15.44:0/2699867897 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d2139931e0 con 0x55d213c32c00 2024-09-13T18:31:43.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.629+0000 7f0d95a54500 1 -- 172.21.15.44:0/2699867897 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d213966b60 con 0x55d213c32c00 2024-09-13T18:31:43.640 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.633+0000 7f0d8e202700 1 -- 172.21.15.44:0/2699867897 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x55d2139a2840 con 0x55d213c32c00 2024-09-13T18:31:43.641 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.633+0000 7f0d8e202700 1 --2- 172.21.15.44:0/2699867897 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55d213cae400 0x55d2139eb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.642 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.633+0000 7f0d8e202700 1 -- 172.21.15.44:0/2699867897 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x55d21397ca80 con 0x55d213c32c00 2024-09-13T18:31:43.642 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.633+0000 7f0d9420e700 1 --2- 172.21.15.44:0/2699867897 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55d213cae400 0x55d2139eb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.642 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.633+0000 7f0d95a54500 1 --2- 172.21.15.44:0/2699867897 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55d213c33000 0x55d2139ea100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.642 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.633+0000 7f0d95a54500 1 -- 172.21.15.44:0/2699867897 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55d213c33400 con 0x55d213c33000 2024-09-13T18:31:43.642 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.633+0000 7f0d93a0d700 1 --2- 172.21.15.44:0/2699867897 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55d213c33000 0x55d2139ea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.633+0000 7f0d93a0d700 1 --2- 172.21.15.44:0/2699867897 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55d213c33000 0x55d2139ea100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.633+0000 7f0d9420e700 1 --2- 172.21.15.44:0/2699867897 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55d213cae400 0x55d2139eb700 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55d213a346f0 tx=0x55d213c3fc80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.637+0000 7f0d93a0d700 1 -- 172.21.15.44:0/2699867897 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55d2147c8b40 con 0x55d213c33000 2024-09-13T18:31:43.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.637+0000 7f0d95a54500 1 -- 172.21.15.44:0/2699867897 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55d213c33800 con 0x55d213c33000 2024-09-13T18:31:43.644 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.637+0000 7f0d93a0d700 1 -- 172.21.15.44:0/2699867897 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv23 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55d2147c8b40 con 0x55d213c33000 2024-09-13T18:31:43.644 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-13T18:31:43.644 INFO:tasks.workunit.client.0.smithi044.stdout: "magic": "ceph fs volume v011", 2024-09-13T18:31:43.644 INFO:tasks.workunit.client.0.smithi044.stdout: "write_pos": 8388608, 2024-09-13T18:31:43.644 INFO:tasks.workunit.client.0.smithi044.stdout: "expire_pos": 8388608, 2024-09-13T18:31:43.644 INFO:tasks.workunit.client.0.smithi044.stdout: "trimmed_pos": 8388608, 2024-09-13T18:31:43.645 INFO:tasks.workunit.client.0.smithi044.stdout: "stream_format": 1, 2024-09-13T18:31:43.645 INFO:tasks.workunit.client.0.smithi044.stdout: "layout": { 2024-09-13T18:31:43.645 INFO:tasks.workunit.client.0.smithi044.stdout: "stripe_unit": 4194304, 2024-09-13T18:31:43.645 INFO:tasks.workunit.client.0.smithi044.stdout: "stripe_count": 1, 2024-09-13T18:31:43.645 INFO:tasks.workunit.client.0.smithi044.stdout: "object_size": 4194304, 2024-09-13T18:31:43.645 INFO:tasks.workunit.client.0.smithi044.stdout: "pool_id": 6, 2024-09-13T18:31:43.645 INFO:tasks.workunit.client.0.smithi044.stdout: "pool_ns": "" 2024-09-13T18:31:43.645 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-13T18:31:43.645 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-13T18:31:43.645 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-13T18:31:43.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.637+0000 7f0d95a54500 1 -- 172.21.15.44:0/2699867897 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55d213c33000 msgr2=0x55d2139ea100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.637+0000 7f0d95a54500 1 --2- 172.21.15.44:0/2699867897 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55d213c33000 0x55d2139ea100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.637+0000 7f0d95a54500 1 -- 172.21.15.44:0/2699867897 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55d213cae400 msgr2=0x55d2139eb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.637+0000 7f0d95a54500 1 --2- 172.21.15.44:0/2699867897 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55d213cae400 0x55d2139eb700 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55d213a346f0 tx=0x55d213c3fc80 comp rx=0 tx=0).stop 2024-09-13T18:31:43.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.637+0000 7f0d95a54500 1 -- 172.21.15.44:0/2699867897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d213c32c00 msgr2=0x55d2139ea680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.637+0000 7f0d95a54500 1 --2- 172.21.15.44:0/2699867897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d213c32c00 0x55d2139ea680 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x55d213c8a990 tx=0x55d213a09f20 comp rx=0 tx=0).stop 2024-09-13T18:31:43.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.637+0000 7f0d9420e700 1 -- 172.21.15.44:0/2699867897 reap_dead start 2024-09-13T18:31:43.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.637+0000 7f0d95a54500 1 -- 172.21.15.44:0/2699867897 shutdown_connections 2024-09-13T18:31:43.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.637+0000 7f0d95a54500 1 -- 172.21.15.44:0/2699867897 >> 172.21.15.44:0/2699867897 conn(0x55d213942c00 msgr2=0x55d2139ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.637+0000 7f0d95a54500 1 -- 172.21.15.44:0/2699867897 shutdown_connections 2024-09-13T18:31:43.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.637+0000 7f0d95a54500 1 -- 172.21.15.44:0/2699867897 wait complete. 2024-09-13T18:31:43.647 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.637+0000 7f0d95a54500 1 -- 172.21.15.44:0/4275347866 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d213943000 msgr2=0x55d2139e9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.637+0000 7f0d95a54500 1 --2- 172.21.15.44:0/4275347866 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d213943000 0x55d2139e9080 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55d213a352c0 tx=0x55d2147cc120 comp rx=0 tx=0).stop 2024-09-13T18:31:43.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.637+0000 7f0d95a54500 1 -- 172.21.15.44:0/4275347866 shutdown_connections 2024-09-13T18:31:43.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.637+0000 7f0d95a54500 1 --2- 172.21.15.44:0/4275347866 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d213943000 0x55d2139e9080 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.637+0000 7f0d95a54500 1 --2- 172.21.15.44:0/4275347866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d213943400 0x55d2139e8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.637+0000 7f0d95a54500 1 --2- 172.21.15.44:0/4275347866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d213943800 0x55d2139e8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.637+0000 7f0d95a54500 1 -- 172.21.15.44:0/4275347866 >> 172.21.15.44:0/4275347866 conn(0x55d213943c00 msgr2=0x55d2139ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.637+0000 7f0d95a54500 1 -- 172.21.15.44:0/4275347866 shutdown_connections 2024-09-13T18:31:43.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.637+0000 7f0d95a54500 1 -- 172.21.15.44:0/4275347866 wait complete. 2024-09-13T18:31:43.649 INFO:tasks.workunit.client.0.smithi044.stdout:Rolling back journal to original state... 2024-09-13T18:31:43.649 INFO:tasks.workunit.client.0.smithi044.stderr:+ echo 'Rolling back journal to original state...' 2024-09-13T18:31:43.649 INFO:tasks.workunit.client.0.smithi044.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal import /tmp/journal.bin 2024-09-13T18:31:43.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.681+0000 7ff64117e500 1 -- start start 2024-09-13T18:31:43.689 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.681+0000 7ff64117e500 1 Processor -- start 2024-09-13T18:31:43.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.681+0000 7ff64117e500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560801a3b800 0x560801ae0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.691 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.681+0000 7ff64117e500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560801a3b400 0x560801ae0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.681+0000 7ff64117e500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560801a3b000 0x560801ae1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.681+0000 7ff64117e500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x560801abca00 con 0x560801a3b000 2024-09-13T18:31:43.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.681+0000 7ff64117e500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x560801abc780 con 0x560801a3b400 2024-09-13T18:31:43.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.681+0000 7ff64117e500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x560801abc640 con 0x560801a3b800 2024-09-13T18:31:43.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.681+0000 7ff640139700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560801a3b000 0x560801ae1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.681+0000 7ff63f938700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560801a3b800 0x560801ae0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.681+0000 7ff63f137700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560801a3b400 0x560801ae0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.685+0000 7ff640139700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560801a3b000 0x560801ae1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60004/0 (socket says 172.21.15.44:60004) 2024-09-13T18:31:43.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.685+0000 7ff640139700 1 -- 172.21.15.44:0/1788743378 learned_addr learned my addr 172.21.15.44:0/1788743378 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.692 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.685+0000 7ff63f938700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560801a3b800 0x560801ae0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:58394/0 (socket says 172.21.15.44:58394) 2024-09-13T18:31:43.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.685+0000 7ff640139700 1 -- 172.21.15.44:0/1788743378 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560801a3b800 msgr2=0x560801ae0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.685+0000 7ff640139700 1 --2- 172.21.15.44:0/1788743378 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560801a3b800 0x560801ae0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.685+0000 7ff640139700 1 -- 172.21.15.44:0/1788743378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560801a3b400 msgr2=0x560801ae0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.685+0000 7ff640139700 1 --2- 172.21.15.44:0/1788743378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560801a3b400 0x560801ae0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.685+0000 7ff640139700 1 -- 172.21.15.44:0/1788743378 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560801a5e9c0 con 0x560801a3b000 2024-09-13T18:31:43.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.685+0000 7ff63f137700 1 --2- 172.21.15.44:0/1788743378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560801a3b400 0x560801ae0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:43.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.685+0000 7ff640139700 1 --2- 172.21.15.44:0/1788743378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560801a3b000 0x560801ae1080 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x560801b0f290 tx=0x5608028b8120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6510cf7e510b2455 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.685+0000 7ff63d133700 1 -- 172.21.15.44:0/1788743378 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560801a8b600 con 0x560801a3b000 2024-09-13T18:31:43.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.685+0000 7ff63d133700 1 -- 172.21.15.44:0/1788743378 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560801a86180 con 0x560801a3b000 2024-09-13T18:31:43.694 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.685+0000 7ff63d133700 1 -- 172.21.15.44:0/1788743378 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560801a8b1e0 con 0x560801a3b000 2024-09-13T18:31:43.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.685+0000 7ff64117e500 1 -- 172.21.15.44:0/1788743378 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560801a5eb60 con 0x560801a3b000 2024-09-13T18:31:43.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.685+0000 7ff64117e500 1 -- 172.21.15.44:0/1788743378 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x560801a5e340 con 0x560801a3b000 2024-09-13T18:31:43.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.685+0000 7ff63d133700 1 -- 172.21.15.44:0/1788743378 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x560801a74c40 con 0x560801a3b000 2024-09-13T18:31:43.695 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.685+0000 7ff63d133700 1 -- 172.21.15.44:0/1788743378 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x560802816900 con 0x560801a3b000 2024-09-13T18:31:43.696 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.685+0000 7ff64117e500 1 Processor -- start 2024-09-13T18:31:43.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.685+0000 7ff64117e500 1 -- start start 2024-09-13T18:31:43.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff64117e500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5608028c4800 0x560801ae1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff64117e500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608028c4c00 0x560801ae1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff64117e500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608028c5000 0x560801ae2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff64117e500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x560801a71e00 con 0x5608028c4c00 2024-09-13T18:31:43.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff64117e500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x560801abc780 con 0x5608028c5000 2024-09-13T18:31:43.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff64117e500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x560801abc500 con 0x5608028c4800 2024-09-13T18:31:43.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff63f938700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608028c4c00 0x560801ae1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff63f137700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608028c5000 0x560801ae2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff63f938700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608028c4c00 0x560801ae1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60016/0 (socket says 172.21.15.44:60016) 2024-09-13T18:31:43.697 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff63f938700 1 -- 172.21.15.44:0/314098616 learned_addr learned my addr 172.21.15.44:0/314098616 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff63f137700 1 --2- 172.21.15.44:0/314098616 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5608028c4800 0x560801ae1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff63f938700 1 -- 172.21.15.44:0/314098616 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5608028c4800 msgr2=0x560801ae1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff63f938700 1 --2- 172.21.15.44:0/314098616 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5608028c4800 0x560801ae1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff63f938700 1 -- 172.21.15.44:0/314098616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608028c5000 msgr2=0x560801ae2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff63f938700 1 --2- 172.21.15.44:0/314098616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608028c5000 0x560801ae2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff63f938700 1 -- 172.21.15.44:0/314098616 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560801a5e000 con 0x5608028c4c00 2024-09-13T18:31:43.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff63f137700 1 --2- 172.21.15.44:0/314098616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608028c5000 0x560801ae2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:43.698 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff63f938700 1 --2- 172.21.15.44:0/314098616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608028c4c00 0x560801ae1b80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x560801d8e210 tx=0x560801d3ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723b36855205d082 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff63b12f700 1 -- 172.21.15.44:0/314098616 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560801a8b600 con 0x5608028c4c00 2024-09-13T18:31:43.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff63b12f700 1 -- 172.21.15.44:0/314098616 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560801a86900 con 0x5608028c4c00 2024-09-13T18:31:43.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff63b12f700 1 -- 172.21.15.44:0/314098616 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560801a8b1e0 con 0x5608028c4c00 2024-09-13T18:31:43.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff64117e500 1 -- 172.21.15.44:0/314098616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608028c4c00 msgr2=0x560801ae1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff64117e500 1 --2- 172.21.15.44:0/314098616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608028c4c00 0x560801ae1b80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x560801d8e210 tx=0x560801d3ec00 comp rx=0 tx=0).stop 2024-09-13T18:31:43.701 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff64117e500 1 -- 172.21.15.44:0/314098616 shutdown_connections 2024-09-13T18:31:43.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff64117e500 1 --2- 172.21.15.44:0/314098616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608028c5000 0x560801ae2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff64117e500 1 --2- 172.21.15.44:0/314098616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608028c4c00 0x560801ae1b80 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff64117e500 1 --2- 172.21.15.44:0/314098616 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5608028c4800 0x560801ae1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff64117e500 1 -- 172.21.15.44:0/314098616 >> 172.21.15.44:0/314098616 conn(0x560801a3ac00 msgr2=0x560801af7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff64117e500 1 -- 172.21.15.44:0/314098616 shutdown_connections 2024-09-13T18:31:43.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff64117e500 1 -- 172.21.15.44:0/314098616 wait complete. 2024-09-13T18:31:43.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff64117e500 1 Processor -- start 2024-09-13T18:31:43.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.689+0000 7ff64117e500 1 -- start start 2024-09-13T18:31:43.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.693+0000 7ff64117e500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608028c4800 0x560801ae3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.693+0000 7ff64117e500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608028c4c00 0x560801ae2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.693+0000 7ff64117e500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5608028c5000 0x560801ae2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.693+0000 7ff64117e500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x560801abc3c0 con 0x5608028c4c00 2024-09-13T18:31:43.702 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.693+0000 7ff64117e500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x560801abc280 con 0x5608028c4800 2024-09-13T18:31:43.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.693+0000 7ff64117e500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x560801abc140 con 0x5608028c5000 2024-09-13T18:31:43.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.693+0000 7ff63f938700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608028c4c00 0x560801ae2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.693+0000 7ff63f938700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608028c4c00 0x560801ae2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60022/0 (socket says 172.21.15.44:60022) 2024-09-13T18:31:43.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.693+0000 7ff63f938700 1 -- 172.21.15.44:0/1709776318 learned_addr learned my addr 172.21.15.44:0/1709776318 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.693+0000 7ff63f137700 1 --2- 172.21.15.44:0/1709776318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608028c4800 0x560801ae3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.693+0000 7ff63f137700 1 --2- 172.21.15.44:0/1709776318 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5608028c5000 0x560801ae2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.693+0000 7ff63f938700 1 -- 172.21.15.44:0/1709776318 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5608028c5000 msgr2=0x560801ae2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.693+0000 7ff63f938700 1 --2- 172.21.15.44:0/1709776318 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5608028c5000 0x560801ae2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.693+0000 7ff63f938700 1 -- 172.21.15.44:0/1709776318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608028c4800 msgr2=0x560801ae3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.693+0000 7ff63f938700 1 --2- 172.21.15.44:0/1709776318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608028c4800 0x560801ae3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.693+0000 7ff63f938700 1 -- 172.21.15.44:0/1709776318 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560801a5e9c0 con 0x5608028c4c00 2024-09-13T18:31:43.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.693+0000 7ff63f137700 1 --2- 172.21.15.44:0/1709776318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608028c4800 0x560801ae3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:43.703 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.693+0000 7ff63f938700 1 --2- 172.21.15.44:0/1709776318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608028c4c00 0x560801ae2c00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x560801d8f4d0 tx=0x560801b101e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.693+0000 7ff63992c700 1 -- 172.21.15.44:0/1709776318 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560801a8adc0 con 0x5608028c4c00 2024-09-13T18:31:43.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.693+0000 7ff63992c700 1 -- 172.21.15.44:0/1709776318 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560801a86180 con 0x5608028c4c00 2024-09-13T18:31:43.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.693+0000 7ff64117e500 1 -- 172.21.15.44:0/1709776318 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560801a5eb60 con 0x5608028c4c00 2024-09-13T18:31:43.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.693+0000 7ff63992c700 1 -- 172.21.15.44:0/1709776318 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560801a8b600 con 0x5608028c4c00 2024-09-13T18:31:43.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.693+0000 7ff64117e500 1 -- 172.21.15.44:0/1709776318 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560801a5eea0 con 0x5608028c4c00 2024-09-13T18:31:43.704 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.697+0000 7ff63992c700 1 -- 172.21.15.44:0/1709776318 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x560801a9a840 con 0x5608028c4c00 2024-09-13T18:31:43.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.697+0000 7ff63992c700 1 --2- 172.21.15.44:0/1709776318 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x560801da6800 0x560801ae3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.697+0000 7ff63992c700 1 -- 172.21.15.44:0/1709776318 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x560801a74a80 con 0x5608028c4c00 2024-09-13T18:31:43.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.697+0000 7ff63f137700 1 --2- 172.21.15.44:0/1709776318 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x560801da6800 0x560801ae3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.705 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.697+0000 7ff63f137700 1 --2- 172.21.15.44:0/1709776318 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x560801da6800 0x560801ae3700 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x560801d8f320 tx=0x560801b100c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.697+0000 7ff64117e500 1 -- start start 2024-09-13T18:31:43.706 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.697+0000 7ff64117e500 1 Processor -- start 2024-09-13T18:31:43.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff64117e500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608028c5800 0x560801ae2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff64117e500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5608028c5c00 0x560801ae1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff64117e500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560801da6c00 0x560801ae1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff64117e500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x560801abc140 con 0x5608028c5800 2024-09-13T18:31:43.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff64117e500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x560801abc280 con 0x560801da6c00 2024-09-13T18:31:43.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff64117e500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x560801abc500 con 0x5608028c5c00 2024-09-13T18:31:43.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff640139700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608028c5800 0x560801ae2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff640139700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608028c5800 0x560801ae2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60026/0 (socket says 172.21.15.44:60026) 2024-09-13T18:31:43.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff640139700 1 -- 172.21.15.44:0/2287828317 learned_addr learned my addr 172.21.15.44:0/2287828317 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.709 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff63f938700 1 --2- 172.21.15.44:0/2287828317 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5608028c5c00 0x560801ae1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff63f137700 1 --2- 172.21.15.44:0/2287828317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560801da6c00 0x560801ae1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff640139700 1 -- 172.21.15.44:0/2287828317 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5608028c5c00 msgr2=0x560801ae1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff640139700 1 --2- 172.21.15.44:0/2287828317 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5608028c5c00 0x560801ae1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff640139700 1 -- 172.21.15.44:0/2287828317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560801da6c00 msgr2=0x560801ae1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff640139700 1 --2- 172.21.15.44:0/2287828317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560801da6c00 0x560801ae1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff640139700 1 -- 172.21.15.44:0/2287828317 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560801ddb6c0 con 0x5608028c5800 2024-09-13T18:31:43.710 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff640139700 1 --2- 172.21.15.44:0/2287828317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608028c5800 0x560801ae2100 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x560801e55290 tx=0x5608028b8060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb880959b21f441a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.711 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff636926700 1 -- 172.21.15.44:0/2287828317 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560801a8af20 con 0x5608028c5800 2024-09-13T18:31:43.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff636926700 1 -- 172.21.15.44:0/2287828317 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56080282ac00 con 0x5608028c5800 2024-09-13T18:31:43.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff636926700 1 -- 172.21.15.44:0/2287828317 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560801a8a6e0 con 0x5608028c5800 2024-09-13T18:31:43.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff64117e500 1 -- 172.21.15.44:0/2287828317 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560801ddb520 con 0x5608028c5800 2024-09-13T18:31:43.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff64117e500 1 -- 172.21.15.44:0/2287828317 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x560801dd9860 con 0x5608028c5800 2024-09-13T18:31:43.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff636926700 1 -- 172.21.15.44:0/2287828317 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x560801a748c0 con 0x5608028c5800 2024-09-13T18:31:43.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff636926700 1 -- 172.21.15.44:0/2287828317 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x560801ef6600 con 0x5608028c5800 2024-09-13T18:31:43.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff64117e500 1 --2- 172.21.15.44:0/2287828317 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x560801da7000 0x560801f06000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff64117e500 1 -- 172.21.15.44:0/2287828317 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x560801da7400 con 0x560801da7000 2024-09-13T18:31:43.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff63f938700 1 --2- 172.21.15.44:0/2287828317 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x560801da7000 0x560801f06000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.701+0000 7ff63f938700 1 --2- 172.21.15.44:0/2287828317 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x560801da7000 0x560801f06000 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=c5330ccca051b361 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.712 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.705+0000 7ff63f938700 1 -- 172.21.15.44:0/2287828317 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x560802824b40 con 0x560801da7000 2024-09-13T18:31:43.713 INFO:tasks.workunit.client.0.smithi044.stdout:undump /tmp/journal.bin 2024-09-13T18:31:43.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.705+0000 7ff64117e500 1 -- 172.21.15.44:0/2287828317 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x560801da7800 con 0x560801da7000 2024-09-13T18:31:43.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.705+0000 7ff63f938700 1 -- 172.21.15.44:0/2287828317 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv23 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x560802824b40 con 0x560801da7000 2024-09-13T18:31:43.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.705+0000 7ff635123700 1 --2- 172.21.15.44:0/2287828317 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x560801eec800 0x560801f08680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.705+0000 7ff635123700 1 -- 172.21.15.44:0/2287828317 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:3 6.1b 6:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e51) v8 -- 0x560801eecc00 con 0x560801eec800 2024-09-13T18:31:43.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.705+0000 7ff63f137700 1 --2- 172.21.15.44:0/2287828317 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x560801eec800 0x560801f08680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.705+0000 7ff63f137700 1 --2- 172.21.15.44:0/2287828317 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x560801eec800 0x560801f08680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=379dcea6d45ded9f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.714 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.705+0000 7ff63f137700 1 -- 172.21.15.44:0/2287828317 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(3 200.00000002 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x560802824d80 con 0x560801eec800 2024-09-13T18:31:43.714 INFO:tasks.workunit.client.0.smithi044.stdout:start 4194304 len 31930 write_pos 4200138 format 1 trimmed_pos 4194304 stripe_unit 4194304 stripe_count 1 object_size 4194304 2024-09-13T18:31:43.714 INFO:tasks.workunit.client.0.smithi044.stdout:writing header 200.00000000 2024-09-13T18:31:43.715 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.705+0000 7ff64117e500 1 -- 172.21.15.44:0/2287828317 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:4 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x560801da7c00 con 0x560801da7000 2024-09-13T18:31:43.716 INFO:tasks.workunit.client.0.smithi044.stdout:Purging 2 objects from 1 2024-09-13T18:31:43.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.709+0000 7ff63f938700 1 -- 172.21.15.44:0/2287828317 <== osd.2 v2:172.21.15.44:6817/3180763837 3 ==== osd_op_reply(4 200.00000000 [writefull 0~90] v51'24 uv24 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x560802824b40 con 0x560801da7000 2024-09-13T18:31:43.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.709+0000 7ff64117e500 1 -- 172.21.15.44:0/2287828317 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:5 6.14 6:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x560801eed400 con 0x560801da7000 2024-09-13T18:31:43.717 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.709+0000 7ff64117e500 1 -- 172.21.15.44:0/2287828317 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:6 6.1b 6:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x560801eed800 con 0x560801eec800 2024-09-13T18:31:43.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.709+0000 7ff63f938700 1 -- 172.21.15.44:0/2287828317 <== osd.2 v2:172.21.15.44:6817/3180763837 4 ==== osd_op_reply(5 200.00000001 [delete] v51'25 uv25 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x560802824b40 con 0x560801da7000 2024-09-13T18:31:43.719 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.713+0000 7ff63f137700 1 -- 172.21.15.44:0/2287828317 <== osd.3 v2:172.21.15.44:6808/771281770 2 ==== osd_op_reply(6 200.00000002 [delete] v51'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x560802824d80 con 0x560801eec800 2024-09-13T18:31:43.720 INFO:tasks.workunit.client.0.smithi044.stdout: writing 4194304~31930 2024-09-13T18:31:43.720 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.713+0000 7ff64117e500 1 -- 172.21.15.44:0/2287828317 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:7 6.14 6:2e2fa760:::200.00000001:head [write 0~31930 in=31930b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x560801eedc00 con 0x560801da7000 2024-09-13T18:31:43.722 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.713+0000 7ff63f938700 1 -- 172.21.15.44:0/2287828317 <== osd.2 v2:172.21.15.44:6817/3180763837 5 ==== osd_op_reply(7 200.00000001 [write 0~31930] v51'26 uv26 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x560802824b40 con 0x560801da7000 2024-09-13T18:31:43.723 INFO:tasks.workunit.client.0.smithi044.stdout:done. 2024-09-13T18:31:43.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.713+0000 7ff64117e500 1 -- 172.21.15.44:0/2287828317 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x560801da7000 msgr2=0x560801f06000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.713+0000 7ff64117e500 1 --2- 172.21.15.44:0/2287828317 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x560801da7000 0x560801f06000 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.713+0000 7ff64117e500 1 -- 172.21.15.44:0/2287828317 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x560801eec800 msgr2=0x560801f08680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.713+0000 7ff64117e500 1 --2- 172.21.15.44:0/2287828317 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x560801eec800 0x560801f08680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.724 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.713+0000 7ff64117e500 1 -- 172.21.15.44:0/2287828317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608028c5800 msgr2=0x560801ae2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.713+0000 7ff64117e500 1 --2- 172.21.15.44:0/2287828317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608028c5800 0x560801ae2100 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x560801e55290 tx=0x5608028b8060 comp rx=0 tx=0).stop 2024-09-13T18:31:43.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.713+0000 7ff63f137700 1 -- 172.21.15.44:0/2287828317 reap_dead start 2024-09-13T18:31:43.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.713+0000 7ff64117e500 1 -- 172.21.15.44:0/2287828317 shutdown_connections 2024-09-13T18:31:43.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.713+0000 7ff64117e500 1 -- 172.21.15.44:0/2287828317 >> 172.21.15.44:0/2287828317 conn(0x5608028c5400 msgr2=0x560801af8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.717+0000 7ff64117e500 1 -- 172.21.15.44:0/2287828317 shutdown_connections 2024-09-13T18:31:43.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.717+0000 7ff64117e500 1 -- 172.21.15.44:0/2287828317 wait complete. 2024-09-13T18:31:43.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.717+0000 7ff64117e500 1 -- 172.21.15.44:0/1709776318 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x560801da6800 msgr2=0x560801ae3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.717+0000 7ff64117e500 1 --2- 172.21.15.44:0/1709776318 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x560801da6800 0x560801ae3700 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x560801d8f320 tx=0x560801b100c0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.717+0000 7ff64117e500 1 -- 172.21.15.44:0/1709776318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608028c4c00 msgr2=0x560801ae2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.717+0000 7ff64117e500 1 --2- 172.21.15.44:0/1709776318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608028c4c00 0x560801ae2c00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x560801d8f4d0 tx=0x560801b101e0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.717+0000 7ff64117e500 1 -- 172.21.15.44:0/1709776318 shutdown_connections 2024-09-13T18:31:43.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.717+0000 7ff64117e500 1 --2- 172.21.15.44:0/1709776318 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x560801da6800 0x560801ae3700 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.717+0000 7ff64117e500 1 --2- 172.21.15.44:0/1709776318 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5608028c5000 0x560801ae2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.717+0000 7ff64117e500 1 --2- 172.21.15.44:0/1709776318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608028c4c00 0x560801ae2c00 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.717+0000 7ff64117e500 1 --2- 172.21.15.44:0/1709776318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608028c4800 0x560801ae3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.717+0000 7ff64117e500 1 -- 172.21.15.44:0/1709776318 >> 172.21.15.44:0/1709776318 conn(0x560801a3ac00 msgr2=0x560801af7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.717+0000 7ff64117e500 1 -- 172.21.15.44:0/1709776318 shutdown_connections 2024-09-13T18:31:43.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.717+0000 7ff64117e500 1 -- 172.21.15.44:0/1709776318 wait complete. 2024-09-13T18:31:43.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.717+0000 7ff64117e500 1 -- 172.21.15.44:0/1788743378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560801a3b000 msgr2=0x560801ae1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.717+0000 7ff64117e500 1 --2- 172.21.15.44:0/1788743378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560801a3b000 0x560801ae1080 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x560801b0f290 tx=0x5608028b8120 comp rx=0 tx=0).stop 2024-09-13T18:31:43.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.717+0000 7ff64117e500 1 -- 172.21.15.44:0/1788743378 shutdown_connections 2024-09-13T18:31:43.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.717+0000 7ff64117e500 1 --2- 172.21.15.44:0/1788743378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560801a3b000 0x560801ae1080 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.717+0000 7ff64117e500 1 --2- 172.21.15.44:0/1788743378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560801a3b400 0x560801ae0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.717+0000 7ff64117e500 1 --2- 172.21.15.44:0/1788743378 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560801a3b800 0x560801ae0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.717+0000 7ff64117e500 1 -- 172.21.15.44:0/1788743378 >> 172.21.15.44:0/1788743378 conn(0x560801a3bc00 msgr2=0x560801af7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.717+0000 7ff64117e500 1 -- 172.21.15.44:0/1788743378 shutdown_connections 2024-09-13T18:31:43.727 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.717+0000 7ff64117e500 1 -- 172.21.15.44:0/1788743378 wait complete. 2024-09-13T18:31:43.729 INFO:tasks.workunit.client.0.smithi044.stdout:Testing 'header' commands... 2024-09-13T18:31:43.729 INFO:tasks.workunit.client.0.smithi044.stderr:+ echo 'Testing '\''header'\'' commands...' 2024-09-13T18:31:43.729 INFO:tasks.workunit.client.0.smithi044.stderr:+ cephfs-journal-tool --rank=cephfs:0 header get 2024-09-13T18:31:43.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.761+0000 7fd439fa7500 1 -- start start 2024-09-13T18:31:43.769 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.761+0000 7fd439fa7500 1 Processor -- start 2024-09-13T18:31:43.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.761+0000 7fd439fa7500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5626269d7800 0x562626a7c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.770 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.761+0000 7fd439fa7500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5626269d7400 0x562626a7cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.761+0000 7fd439fa7500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626269d7000 0x562626a7d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.761+0000 7fd439fa7500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x562626a58780 con 0x5626269d7000 2024-09-13T18:31:43.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.761+0000 7fd439fa7500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x562626a58a00 con 0x5626269d7400 2024-09-13T18:31:43.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.761+0000 7fd439fa7500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x562626a58640 con 0x5626269d7800 2024-09-13T18:31:43.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.761+0000 7fd438f62700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626269d7000 0x562626a7d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.761+0000 7fd438f62700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626269d7000 0x562626a7d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60042/0 (socket says 172.21.15.44:60042) 2024-09-13T18:31:43.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.761+0000 7fd438f62700 1 -- 172.21.15.44:0/1828971382 learned_addr learned my addr 172.21.15.44:0/1828971382 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.761+0000 7fd437f60700 1 --2- 172.21.15.44:0/1828971382 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5626269d7400 0x562626a7cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.761+0000 7fd438761700 1 --2- 172.21.15.44:0/1828971382 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5626269d7800 0x562626a7c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.761+0000 7fd438f62700 1 -- 172.21.15.44:0/1828971382 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5626269d7800 msgr2=0x562626a7c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.761+0000 7fd438f62700 1 --2- 172.21.15.44:0/1828971382 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5626269d7800 0x562626a7c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.771 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.761+0000 7fd438f62700 1 -- 172.21.15.44:0/1828971382 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5626269d7400 msgr2=0x562626a7cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.761+0000 7fd438f62700 1 --2- 172.21.15.44:0/1828971382 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5626269d7400 0x562626a7cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.761+0000 7fd438f62700 1 -- 172.21.15.44:0/1828971382 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626269fa9c0 con 0x5626269d7000 2024-09-13T18:31:43.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.761+0000 7fd438f62700 1 --2- 172.21.15.44:0/1828971382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626269d7000 0x562626a7d080 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x562626aab320 tx=0x562627850120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e120bff855b71ebf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd435f5c700 1 -- 172.21.15.44:0/1828971382 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562626a27600 con 0x5626269d7000 2024-09-13T18:31:43.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd435f5c700 1 -- 172.21.15.44:0/1828971382 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562626a22900 con 0x5626269d7000 2024-09-13T18:31:43.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd439fa7500 1 -- 172.21.15.44:0/1828971382 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5626269fab60 con 0x5626269d7000 2024-09-13T18:31:43.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd439fa7500 1 -- 172.21.15.44:0/1828971382 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5626269fa340 con 0x5626269d7000 2024-09-13T18:31:43.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd435f5c700 1 -- 172.21.15.44:0/1828971382 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562626a271e0 con 0x5626269d7000 2024-09-13T18:31:43.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd435f5c700 1 -- 172.21.15.44:0/1828971382 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x562626a10c40 con 0x5626269d7000 2024-09-13T18:31:43.773 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd435f5c700 1 -- 172.21.15.44:0/1828971382 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x5626277c2900 con 0x5626269d7000 2024-09-13T18:31:43.775 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd439fa7500 1 Processor -- start 2024-09-13T18:31:43.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd439fa7500 1 -- start start 2024-09-13T18:31:43.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd439fa7500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562627860400 0x562626a7d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd439fa7500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562627860800 0x562626a7db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd439fa7500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562627860c00 0x562626a7e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd439fa7500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x562626a0de00 con 0x562627860800 2024-09-13T18:31:43.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd439fa7500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x562626a58a00 con 0x562627860c00 2024-09-13T18:31:43.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd439fa7500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x562626a58500 con 0x562627860400 2024-09-13T18:31:43.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd438761700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562627860800 0x562626a7db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd438761700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562627860800 0x562626a7db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60054/0 (socket says 172.21.15.44:60054) 2024-09-13T18:31:43.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd438761700 1 -- 172.21.15.44:0/2611291849 learned_addr learned my addr 172.21.15.44:0/2611291849 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.776 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd437f60700 1 --2- 172.21.15.44:0/2611291849 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562627860400 0x562626a7d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd437f60700 1 --2- 172.21.15.44:0/2611291849 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562627860c00 0x562626a7e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd438761700 1 -- 172.21.15.44:0/2611291849 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562627860400 msgr2=0x562626a7d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd438761700 1 --2- 172.21.15.44:0/2611291849 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562627860400 0x562626a7d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd438761700 1 -- 172.21.15.44:0/2611291849 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562627860c00 msgr2=0x562626a7e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd438761700 1 --2- 172.21.15.44:0/2611291849 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562627860c00 0x562626a7e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd438761700 1 -- 172.21.15.44:0/2611291849 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626269fa000 con 0x562627860800 2024-09-13T18:31:43.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.765+0000 7fd437f60700 1 --2- 172.21.15.44:0/2611291849 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562627860c00 0x562626a7e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:43.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd438761700 1 --2- 172.21.15.44:0/2611291849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562627860800 0x562626a7db80 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x562626ce0660 tx=0x562626ce4c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d700037727d2873 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd433f58700 1 -- 172.21.15.44:0/2611291849 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562626a27600 con 0x562627860800 2024-09-13T18:31:43.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd433f58700 1 -- 172.21.15.44:0/2611291849 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5626277b6600 con 0x562627860800 2024-09-13T18:31:43.777 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd433f58700 1 -- 172.21.15.44:0/2611291849 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562626a271e0 con 0x562627860800 2024-09-13T18:31:43.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd439fa7500 1 -- 172.21.15.44:0/2611291849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562627860800 msgr2=0x562626a7db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd439fa7500 1 --2- 172.21.15.44:0/2611291849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562627860800 0x562626a7db80 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x562626ce0660 tx=0x562626ce4c00 comp rx=0 tx=0).stop 2024-09-13T18:31:43.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd439fa7500 1 -- 172.21.15.44:0/2611291849 shutdown_connections 2024-09-13T18:31:43.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd439fa7500 1 --2- 172.21.15.44:0/2611291849 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562627860c00 0x562626a7e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd439fa7500 1 --2- 172.21.15.44:0/2611291849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562627860800 0x562626a7db80 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd439fa7500 1 --2- 172.21.15.44:0/2611291849 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562627860400 0x562626a7d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd439fa7500 1 -- 172.21.15.44:0/2611291849 >> 172.21.15.44:0/2611291849 conn(0x5626269d6c00 msgr2=0x562626a93800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd439fa7500 1 -- 172.21.15.44:0/2611291849 shutdown_connections 2024-09-13T18:31:43.780 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd439fa7500 1 -- 172.21.15.44:0/2611291849 wait complete. 2024-09-13T18:31:43.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd439fa7500 1 Processor -- start 2024-09-13T18:31:43.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd439fa7500 1 -- start start 2024-09-13T18:31:43.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd439fa7500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562627860400 0x562626a7f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd439fa7500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562627860800 0x562626a7ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd439fa7500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562627860c00 0x562626a7e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd439fa7500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x562626a583c0 con 0x562627860800 2024-09-13T18:31:43.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd439fa7500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x562626a58280 con 0x562627860400 2024-09-13T18:31:43.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd439fa7500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x562626a58140 con 0x562627860c00 2024-09-13T18:31:43.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd438761700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562627860800 0x562626a7ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd438761700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562627860800 0x562626a7ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60070/0 (socket says 172.21.15.44:60070) 2024-09-13T18:31:43.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd438761700 1 -- 172.21.15.44:0/2905235793 learned_addr learned my addr 172.21.15.44:0/2905235793 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd437f60700 1 --2- 172.21.15.44:0/2905235793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562627860400 0x562626a7f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd437f60700 1 --2- 172.21.15.44:0/2905235793 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562627860c00 0x562626a7e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd438761700 1 -- 172.21.15.44:0/2905235793 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562627860c00 msgr2=0x562626a7e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd438761700 1 --2- 172.21.15.44:0/2905235793 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562627860c00 0x562626a7e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd438761700 1 -- 172.21.15.44:0/2905235793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562627860400 msgr2=0x562626a7f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd438761700 1 --2- 172.21.15.44:0/2905235793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562627860400 0x562626a7f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd438761700 1 -- 172.21.15.44:0/2905235793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626269fa9c0 con 0x562627860800 2024-09-13T18:31:43.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd437f60700 1 --2- 172.21.15.44:0/2905235793 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562627860c00 0x562626a7e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:43.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd438761700 1 --2- 172.21.15.44:0/2905235793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562627860800 0x562626a7ec00 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x562626ce1320 tx=0x562626aad8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd432755700 1 -- 172.21.15.44:0/2905235793 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562626a26dc0 con 0x562627860800 2024-09-13T18:31:43.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd432755700 1 -- 172.21.15.44:0/2905235793 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5626277b6900 con 0x562627860800 2024-09-13T18:31:43.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.769+0000 7fd439fa7500 1 -- 172.21.15.44:0/2905235793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5626269fab60 con 0x562627860800 2024-09-13T18:31:43.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.773+0000 7fd432755700 1 -- 172.21.15.44:0/2905235793 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562626a27600 con 0x562627860800 2024-09-13T18:31:43.782 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.773+0000 7fd439fa7500 1 -- 172.21.15.44:0/2905235793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5626269fa340 con 0x562627860800 2024-09-13T18:31:43.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.773+0000 7fd432755700 1 -- 172.21.15.44:0/2905235793 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x562626a36840 con 0x562627860800 2024-09-13T18:31:43.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.773+0000 7fd432755700 1 --2- 172.21.15.44:0/2905235793 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x562626d4c400 0x562626a7f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.783 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.773+0000 7fd432755700 1 -- 172.21.15.44:0/2905235793 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x562626a10a80 con 0x562627860800 2024-09-13T18:31:43.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd439fa7500 1 --2- 172.21.15.44:0/2905235793 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x562627861000 0x562626a7e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd437f60700 1 --2- 172.21.15.44:0/2905235793 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x562626d4c400 0x562626a7f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd439fa7500 1 -- 172.21.15.44:0/2905235793 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x562627861400 con 0x562627861000 2024-09-13T18:31:43.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd437f60700 1 --2- 172.21.15.44:0/2905235793 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x562627861000 0x562626a7e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.784 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd437f60700 1 --2- 172.21.15.44:0/2905235793 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x562626d4c400 0x562626a7f700 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x562626a2d710 tx=0x562626aac0c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd437f60700 1 --2- 172.21.15.44:0/2905235793 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x562627861000 0x562626a7e100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd437f60700 1 -- 172.21.15.44:0/2905235793 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x56262784cb40 con 0x562627861000 2024-09-13T18:31:43.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd439fa7500 1 -- 172.21.15.44:0/2905235793 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x562627861800 con 0x562627861000 2024-09-13T18:31:43.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd437f60700 1 -- 172.21.15.44:0/2905235793 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv24 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x56262784cb40 con 0x562627861000 2024-09-13T18:31:43.786 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-13T18:31:43.786 INFO:tasks.workunit.client.0.smithi044.stdout: "magic": "ceph fs volume v011", 2024-09-13T18:31:43.786 INFO:tasks.workunit.client.0.smithi044.stdout: "write_pos": 4200138, 2024-09-13T18:31:43.786 INFO:tasks.workunit.client.0.smithi044.stdout: "expire_pos": 4194304, 2024-09-13T18:31:43.786 INFO:tasks.workunit.client.0.smithi044.stdout: "trimmed_pos": 4194304, 2024-09-13T18:31:43.786 INFO:tasks.workunit.client.0.smithi044.stdout: "stream_format": 1, 2024-09-13T18:31:43.786 INFO:tasks.workunit.client.0.smithi044.stdout: "layout": { 2024-09-13T18:31:43.786 INFO:tasks.workunit.client.0.smithi044.stdout: "stripe_unit": 4194304, 2024-09-13T18:31:43.786 INFO:tasks.workunit.client.0.smithi044.stdout: "stripe_count": 1, 2024-09-13T18:31:43.786 INFO:tasks.workunit.client.0.smithi044.stdout: "object_size": 4194304, 2024-09-13T18:31:43.786 INFO:tasks.workunit.client.0.smithi044.stdout: "pool_id": 6, 2024-09-13T18:31:43.786 INFO:tasks.workunit.client.0.smithi044.stdout: "pool_ns": "" 2024-09-13T18:31:43.787 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-13T18:31:43.787 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-13T18:31:43.787 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-13T18:31:43.788 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd439fa7500 1 -- 172.21.15.44:0/2905235793 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x562627861000 msgr2=0x562626a7e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.788 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd439fa7500 1 --2- 172.21.15.44:0/2905235793 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x562627861000 0x562626a7e100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.788 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd439fa7500 1 -- 172.21.15.44:0/2905235793 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x562626d4c400 msgr2=0x562626a7f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.788 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd439fa7500 1 --2- 172.21.15.44:0/2905235793 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x562626d4c400 0x562626a7f700 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x562626a2d710 tx=0x562626aac0c0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.788 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd439fa7500 1 -- 172.21.15.44:0/2905235793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562627860800 msgr2=0x562626a7ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.788 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd439fa7500 1 --2- 172.21.15.44:0/2905235793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562627860800 0x562626a7ec00 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x562626ce1320 tx=0x562626aad8c0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd438761700 1 -- 172.21.15.44:0/2905235793 reap_dead start 2024-09-13T18:31:43.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd439fa7500 1 -- 172.21.15.44:0/2905235793 shutdown_connections 2024-09-13T18:31:43.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd439fa7500 1 -- 172.21.15.44:0/2905235793 >> 172.21.15.44:0/2905235793 conn(0x5626269d6c00 msgr2=0x562626a93800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd439fa7500 1 -- 172.21.15.44:0/2905235793 shutdown_connections 2024-09-13T18:31:43.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd439fa7500 1 -- 172.21.15.44:0/2905235793 wait complete. 2024-09-13T18:31:43.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd439fa7500 1 -- 172.21.15.44:0/1828971382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626269d7000 msgr2=0x562626a7d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd439fa7500 1 --2- 172.21.15.44:0/1828971382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626269d7000 0x562626a7d080 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x562626aab320 tx=0x562627850120 comp rx=0 tx=0).stop 2024-09-13T18:31:43.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd439fa7500 1 -- 172.21.15.44:0/1828971382 shutdown_connections 2024-09-13T18:31:43.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd439fa7500 1 --2- 172.21.15.44:0/1828971382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626269d7000 0x562626a7d080 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd439fa7500 1 --2- 172.21.15.44:0/1828971382 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5626269d7400 0x562626a7cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd439fa7500 1 --2- 172.21.15.44:0/1828971382 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5626269d7800 0x562626a7c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd439fa7500 1 -- 172.21.15.44:0/1828971382 >> 172.21.15.44:0/1828971382 conn(0x5626269d7c00 msgr2=0x562626a93000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.789 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd439fa7500 1 -- 172.21.15.44:0/1828971382 shutdown_connections 2024-09-13T18:31:43.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.777+0000 7fd439fa7500 1 -- 172.21.15.44:0/1828971382 wait complete. 2024-09-13T18:31:43.791 INFO:tasks.workunit.client.0.smithi044.stderr:+ cephfs-journal-tool --rank=cephfs:0 header set write_pos 123 2024-09-13T18:31:43.830 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.821+0000 7fa565620500 1 -- start start 2024-09-13T18:31:43.830 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.821+0000 7fa565620500 1 Processor -- start 2024-09-13T18:31:43.831 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.821+0000 7fa565620500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568bccb1800 0x5568bcd56580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.821+0000 7fa565620500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5568bccb1400 0x5568bcd56b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.821+0000 7fa565620500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5568bccb1000 0x5568bcd57080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.821+0000 7fa565620500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568bcd32780 con 0x5568bccb1800 2024-09-13T18:31:43.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.821+0000 7fa565620500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568bcd32a00 con 0x5568bccb1000 2024-09-13T18:31:43.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.821+0000 7fa565620500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5568bcd32640 con 0x5568bccb1400 2024-09-13T18:31:43.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.821+0000 7fa563dda700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568bccb1800 0x5568bcd56580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.821+0000 7fa563dda700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568bccb1800 0x5568bcd56580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60078/0 (socket says 172.21.15.44:60078) 2024-09-13T18:31:43.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.821+0000 7fa563dda700 1 -- 172.21.15.44:0/1301347929 learned_addr learned my addr 172.21.15.44:0/1301347929 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.821+0000 7fa5645db700 1 --2- 172.21.15.44:0/1301347929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5568bccb1000 0x5568bcd57080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.821+0000 7fa5635d9700 1 --2- 172.21.15.44:0/1301347929 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5568bccb1400 0x5568bcd56b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.832 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa563dda700 1 -- 172.21.15.44:0/1301347929 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5568bccb1400 msgr2=0x5568bcd56b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.833 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa563dda700 1 --2- 172.21.15.44:0/1301347929 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5568bccb1400 0x5568bcd56b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.833 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa563dda700 1 -- 172.21.15.44:0/1301347929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5568bccb1000 msgr2=0x5568bcd57080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.833 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa563dda700 1 --2- 172.21.15.44:0/1301347929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5568bccb1000 0x5568bcd57080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.833 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa563dda700 1 -- 172.21.15.44:0/1301347929 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568bccd49c0 con 0x5568bccb1800 2024-09-13T18:31:43.833 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa563dda700 1 --2- 172.21.15.44:0/1301347929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568bccb1800 0x5568bcd56580 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x5568bcd852f0 tx=0x5568bdb34120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f7050de2fefbbf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa5615d5700 1 -- 172.21.15.44:0/1301347929 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5568bcd01600 con 0x5568bccb1800 2024-09-13T18:31:43.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa5615d5700 1 -- 172.21.15.44:0/1301347929 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5568bccfc180 con 0x5568bccb1800 2024-09-13T18:31:43.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa565620500 1 -- 172.21.15.44:0/1301347929 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568bccd4b60 con 0x5568bccb1800 2024-09-13T18:31:43.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa565620500 1 -- 172.21.15.44:0/1301347929 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5568bccd4340 con 0x5568bccb1800 2024-09-13T18:31:43.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa5615d5700 1 -- 172.21.15.44:0/1301347929 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5568bcd011e0 con 0x5568bccb1800 2024-09-13T18:31:43.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa5615d5700 1 -- 172.21.15.44:0/1301347929 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x5568bcceac40 con 0x5568bccb1800 2024-09-13T18:31:43.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa5615d5700 1 -- 172.21.15.44:0/1301347929 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x5568bcfa4900 con 0x5568bccb1800 2024-09-13T18:31:43.834 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa565620500 1 Processor -- start 2024-09-13T18:31:43.835 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa565620500 1 -- start start 2024-09-13T18:31:43.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa565620500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568bcfaa400 0x5568bcd57600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa565620500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5568bcfaa800 0x5568bcd57b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa565620500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5568bcfaac00 0x5568bcd58100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa565620500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568bcce7e00 con 0x5568bcfaa400 2024-09-13T18:31:43.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa565620500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568bcd32a00 con 0x5568bcfaa800 2024-09-13T18:31:43.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa565620500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5568bcd32500 con 0x5568bcfaac00 2024-09-13T18:31:43.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa5645db700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568bcfaa400 0x5568bcd57600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa5645db700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568bcfaa400 0x5568bcd57600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60094/0 (socket says 172.21.15.44:60094) 2024-09-13T18:31:43.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa5645db700 1 -- 172.21.15.44:0/3688744179 learned_addr learned my addr 172.21.15.44:0/3688744179 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa563dda700 1 --2- 172.21.15.44:0/3688744179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5568bcfaa800 0x5568bcd57b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.825+0000 7fa5635d9700 1 --2- 172.21.15.44:0/3688744179 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5568bcfaac00 0x5568bcd58100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.829+0000 7fa5645db700 1 -- 172.21.15.44:0/3688744179 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5568bcfaac00 msgr2=0x5568bcd58100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.837 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.829+0000 7fa5645db700 1 --2- 172.21.15.44:0/3688744179 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5568bcfaac00 0x5568bcd58100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.838 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.829+0000 7fa5645db700 1 -- 172.21.15.44:0/3688744179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5568bcfaa800 msgr2=0x5568bcd57b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.838 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.829+0000 7fa5645db700 1 --2- 172.21.15.44:0/3688744179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5568bcfaa800 0x5568bcd57b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.838 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.829+0000 7fa5645db700 1 -- 172.21.15.44:0/3688744179 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568bccd4000 con 0x5568bcfaa400 2024-09-13T18:31:43.838 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.829+0000 7fa5645db700 1 --2- 172.21.15.44:0/3688744179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568bcfaa400 0x5568bcd57600 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x5568bcfc0660 tx=0x5568bcfc4c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b5d48920544d0d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.838 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.829+0000 7fa55f5d1700 1 -- 172.21.15.44:0/3688744179 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5568bcd01600 con 0x5568bcfaa400 2024-09-13T18:31:43.838 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.829+0000 7fa55f5d1700 1 -- 172.21.15.44:0/3688744179 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5568bccfc900 con 0x5568bcfaa400 2024-09-13T18:31:43.838 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.829+0000 7fa55f5d1700 1 -- 172.21.15.44:0/3688744179 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5568bcd011e0 con 0x5568bcfaa400 2024-09-13T18:31:43.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.829+0000 7fa565620500 1 -- 172.21.15.44:0/3688744179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568bcfaa400 msgr2=0x5568bcd57600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.829+0000 7fa565620500 1 --2- 172.21.15.44:0/3688744179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568bcfaa400 0x5568bcd57600 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x5568bcfc0660 tx=0x5568bcfc4c00 comp rx=0 tx=0).stop 2024-09-13T18:31:43.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.829+0000 7fa565620500 1 -- 172.21.15.44:0/3688744179 shutdown_connections 2024-09-13T18:31:43.839 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.829+0000 7fa565620500 1 --2- 172.21.15.44:0/3688744179 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5568bcfaac00 0x5568bcd58100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.829+0000 7fa565620500 1 --2- 172.21.15.44:0/3688744179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5568bcfaa800 0x5568bcd57b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.829+0000 7fa565620500 1 --2- 172.21.15.44:0/3688744179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568bcfaa400 0x5568bcd57600 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.829+0000 7fa565620500 1 -- 172.21.15.44:0/3688744179 >> 172.21.15.44:0/3688744179 conn(0x5568bccb0c00 msgr2=0x5568bcd6d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.829+0000 7fa565620500 1 -- 172.21.15.44:0/3688744179 shutdown_connections 2024-09-13T18:31:43.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.829+0000 7fa565620500 1 -- 172.21.15.44:0/3688744179 wait complete. 2024-09-13T18:31:43.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.829+0000 7fa565620500 1 Processor -- start 2024-09-13T18:31:43.840 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.829+0000 7fa565620500 1 -- start start 2024-09-13T18:31:43.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.833+0000 7fa565620500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5568bcfaa400 0x5568bcd59180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.833+0000 7fa565620500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568bcfaa800 0x5568bcd58c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.833+0000 7fa565620500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5568bcfaac00 0x5568bcd58680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.833+0000 7fa565620500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568bcd323c0 con 0x5568bcfaa800 2024-09-13T18:31:43.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.833+0000 7fa565620500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568bcd32280 con 0x5568bcfaac00 2024-09-13T18:31:43.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.833+0000 7fa565620500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5568bcd32140 con 0x5568bcfaa400 2024-09-13T18:31:43.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.833+0000 7fa563dda700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568bcfaa800 0x5568bcd58c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.833+0000 7fa563dda700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568bcfaa800 0x5568bcd58c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60102/0 (socket says 172.21.15.44:60102) 2024-09-13T18:31:43.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.833+0000 7fa563dda700 1 -- 172.21.15.44:0/1243631543 learned_addr learned my addr 172.21.15.44:0/1243631543 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.833+0000 7fa5645db700 1 --2- 172.21.15.44:0/1243631543 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5568bcfaa400 0x5568bcd59180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.833+0000 7fa5635d9700 1 --2- 172.21.15.44:0/1243631543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5568bcfaac00 0x5568bcd58680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.833+0000 7fa563dda700 1 -- 172.21.15.44:0/1243631543 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5568bcfaa400 msgr2=0x5568bcd59180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.842 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.833+0000 7fa563dda700 1 --2- 172.21.15.44:0/1243631543 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5568bcfaa400 0x5568bcd59180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.833+0000 7fa563dda700 1 -- 172.21.15.44:0/1243631543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5568bcfaac00 msgr2=0x5568bcd58680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.833+0000 7fa563dda700 1 --2- 172.21.15.44:0/1243631543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5568bcfaac00 0x5568bcd58680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.833+0000 7fa563dda700 1 -- 172.21.15.44:0/1243631543 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568bccd49c0 con 0x5568bcfaa800 2024-09-13T18:31:43.843 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.833+0000 7fa563dda700 1 --2- 172.21.15.44:0/1243631543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568bcfaa800 0x5568bcd58c00 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x5568bcfc13e0 tx=0x5568bdb34060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.833+0000 7fa55ddce700 1 -- 172.21.15.44:0/1243631543 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5568bcd00f20 con 0x5568bcfaa800 2024-09-13T18:31:43.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.833+0000 7fa55ddce700 1 -- 172.21.15.44:0/1243631543 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5568bda98d80 con 0x5568bcfaa800 2024-09-13T18:31:43.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.833+0000 7fa565620500 1 -- 172.21.15.44:0/1243631543 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5568bccd4b60 con 0x5568bcfaa800 2024-09-13T18:31:43.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.833+0000 7fa55ddce700 1 -- 172.21.15.44:0/1243631543 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5568bcd01600 con 0x5568bcfaa800 2024-09-13T18:31:43.844 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.833+0000 7fa565620500 1 -- 172.21.15.44:0/1243631543 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568bccd4340 con 0x5568bcfaa800 2024-09-13T18:31:43.845 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.837+0000 7fa55ddce700 1 -- 172.21.15.44:0/1243631543 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x5568bcd10840 con 0x5568bcfaa800 2024-09-13T18:31:43.845 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.837+0000 7fa55ddce700 1 --2- 172.21.15.44:0/1243631543 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5568bd02a400 0x5568bcd59700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.837+0000 7fa55ddce700 1 -- 172.21.15.44:0/1243631543 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x5568bcceaa80 con 0x5568bcfaa800 2024-09-13T18:31:43.846 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.837+0000 7fa5645db700 1 --2- 172.21.15.44:0/1243631543 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5568bd02a400 0x5568bcd59700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.837+0000 7fa565620500 1 --2- 172.21.15.44:0/1243631543 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5568bcfab000 0x5568bcd58100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.837+0000 7fa565620500 1 -- 172.21.15.44:0/1243631543 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5568bcfab400 con 0x5568bcfab000 2024-09-13T18:31:43.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.837+0000 7fa5635d9700 1 --2- 172.21.15.44:0/1243631543 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5568bcfab000 0x5568bcd58100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.837+0000 7fa5645db700 1 --2- 172.21.15.44:0/1243631543 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5568bd02a400 0x5568bcd59700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x5568bcfc0660 tx=0x5568bcd878c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.847 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.841+0000 7fa5635d9700 1 --2- 172.21.15.44:0/1243631543 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5568bcfab000 0x5568bcd58100 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.841+0000 7fa5635d9700 1 -- 172.21.15.44:0/1243631543 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x5568bdb26b40 con 0x5568bcfab000 2024-09-13T18:31:43.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.841+0000 7fa565620500 1 -- 172.21.15.44:0/1243631543 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5568bcfab800 con 0x5568bcfab000 2024-09-13T18:31:43.848 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.841+0000 7fa5635d9700 1 -- 172.21.15.44:0/1243631543 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv24 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x5568bdb26b40 con 0x5568bcfab000 2024-09-13T18:31:43.849 INFO:tasks.workunit.client.0.smithi044.stdout:Updating write_pos 0x4016ca -> 0x7b 2024-09-13T18:31:43.849 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.841+0000 7fa565620500 1 -- 172.21.15.44:0/1243631543 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:3 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5568bd02a800 con 0x5568bcfab000 2024-09-13T18:31:43.854 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.845+0000 7fa5635d9700 1 -- 172.21.15.44:0/1243631543 <== osd.2 v2:172.21.15.44:6817/3180763837 3 ==== osd_op_reply(3 200.00000000 [writefull 0~90] v51'27 uv27 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5568bdb26b40 con 0x5568bcfab000 2024-09-13T18:31:43.854 INFO:tasks.workunit.client.0.smithi044.stdout:Successfully updated header. 2024-09-13T18:31:43.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.845+0000 7fa565620500 1 -- 172.21.15.44:0/1243631543 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5568bcfab000 msgr2=0x5568bcd58100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.845+0000 7fa565620500 1 --2- 172.21.15.44:0/1243631543 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5568bcfab000 0x5568bcd58100 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.845+0000 7fa565620500 1 -- 172.21.15.44:0/1243631543 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5568bd02a400 msgr2=0x5568bcd59700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.845+0000 7fa565620500 1 --2- 172.21.15.44:0/1243631543 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5568bd02a400 0x5568bcd59700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x5568bcfc0660 tx=0x5568bcd878c0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.845+0000 7fa565620500 1 -- 172.21.15.44:0/1243631543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568bcfaa800 msgr2=0x5568bcd58c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.845+0000 7fa565620500 1 --2- 172.21.15.44:0/1243631543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568bcfaa800 0x5568bcd58c00 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x5568bcfc13e0 tx=0x5568bdb34060 comp rx=0 tx=0).stop 2024-09-13T18:31:43.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.845+0000 7fa5635d9700 1 -- 172.21.15.44:0/1243631543 reap_dead start 2024-09-13T18:31:43.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.845+0000 7fa565620500 1 -- 172.21.15.44:0/1243631543 shutdown_connections 2024-09-13T18:31:43.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.845+0000 7fa565620500 1 -- 172.21.15.44:0/1243631543 >> 172.21.15.44:0/1243631543 conn(0x5568bccb0c00 msgr2=0x5568bcd6d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.845+0000 7fa565620500 1 -- 172.21.15.44:0/1243631543 shutdown_connections 2024-09-13T18:31:43.856 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.845+0000 7fa565620500 1 -- 172.21.15.44:0/1243631543 wait complete. 2024-09-13T18:31:43.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.845+0000 7fa565620500 1 -- 172.21.15.44:0/1301347929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568bccb1800 msgr2=0x5568bcd56580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.845+0000 7fa565620500 1 --2- 172.21.15.44:0/1301347929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568bccb1800 0x5568bcd56580 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x5568bcd852f0 tx=0x5568bdb34120 comp rx=0 tx=0).stop 2024-09-13T18:31:43.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.845+0000 7fa565620500 1 -- 172.21.15.44:0/1301347929 shutdown_connections 2024-09-13T18:31:43.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.845+0000 7fa565620500 1 --2- 172.21.15.44:0/1301347929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5568bccb1000 0x5568bcd57080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.845+0000 7fa565620500 1 --2- 172.21.15.44:0/1301347929 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5568bccb1400 0x5568bcd56b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.845+0000 7fa565620500 1 --2- 172.21.15.44:0/1301347929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568bccb1800 0x5568bcd56580 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.845+0000 7fa565620500 1 -- 172.21.15.44:0/1301347929 >> 172.21.15.44:0/1301347929 conn(0x5568bccb1c00 msgr2=0x5568bcd6d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.849+0000 7fa565620500 1 -- 172.21.15.44:0/1301347929 shutdown_connections 2024-09-13T18:31:43.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.849+0000 7fa565620500 1 -- 172.21.15.44:0/1301347929 wait complete. 2024-09-13T18:31:43.859 INFO:tasks.workunit.client.0.smithi044.stderr:+ cephfs-journal-tool --rank=cephfs:0 header set expire_pos 123 2024-09-13T18:31:43.899 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7125b3a500 1 -- start start 2024-09-13T18:31:43.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7125b3a500 1 Processor -- start 2024-09-13T18:31:43.900 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7125b3a500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b04fff800 0x557b050a4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7125b3a500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b04fff400 0x557b050a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7125b3a500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b04fff000 0x557b050a5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7125b3a500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b05080780 con 0x557b04fff000 2024-09-13T18:31:43.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7125b3a500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b05080a00 con 0x557b04fff400 2024-09-13T18:31:43.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7125b3a500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b05080640 con 0x557b04fff800 2024-09-13T18:31:43.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7124af5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b04fff000 0x557b050a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f71242f4700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b04fff800 0x557b050a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7124af5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b04fff000 0x557b050a5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60112/0 (socket says 172.21.15.44:60112) 2024-09-13T18:31:43.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7124af5700 1 -- 172.21.15.44:0/3259576411 learned_addr learned my addr 172.21.15.44:0/3259576411 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.901 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7123af3700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b04fff400 0x557b050a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7124af5700 1 -- 172.21.15.44:0/3259576411 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b04fff800 msgr2=0x557b050a4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7124af5700 1 --2- 172.21.15.44:0/3259576411 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b04fff800 0x557b050a4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7124af5700 1 -- 172.21.15.44:0/3259576411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b04fff400 msgr2=0x557b050a4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7124af5700 1 --2- 172.21.15.44:0/3259576411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b04fff400 0x557b050a4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7124af5700 1 -- 172.21.15.44:0/3259576411 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b050229c0 con 0x557b04fff000 2024-09-13T18:31:43.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7124af5700 1 --2- 172.21.15.44:0/3259576411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b04fff000 0x557b050a5080 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x557b050d3290 tx=0x557b050d58c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c63724d9854eb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7121aef700 1 -- 172.21.15.44:0/3259576411 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557b0504f080 con 0x557b04fff000 2024-09-13T18:31:43.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7121aef700 1 -- 172.21.15.44:0/3259576411 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557b05df2300 con 0x557b04fff000 2024-09-13T18:31:43.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7121aef700 1 -- 172.21.15.44:0/3259576411 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557b0504f600 con 0x557b04fff000 2024-09-13T18:31:43.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7125b3a500 1 -- 172.21.15.44:0/3259576411 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b050221a0 con 0x557b04fff000 2024-09-13T18:31:43.903 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7125b3a500 1 -- 172.21.15.44:0/3259576411 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x557b050229c0 con 0x557b04fff000 2024-09-13T18:31:43.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7121aef700 1 -- 172.21.15.44:0/3259576411 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x557b05038c40 con 0x557b04fff000 2024-09-13T18:31:43.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.893+0000 7f7121aef700 1 -- 172.21.15.44:0/3259576411 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x557b05040f00 con 0x557b04fff000 2024-09-13T18:31:43.904 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.897+0000 7f7125b3a500 1 Processor -- start 2024-09-13T18:31:43.905 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.897+0000 7f7125b3a500 1 -- start start 2024-09-13T18:31:43.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.897+0000 7f7125b3a500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b05e88400 0x557b050a5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.907 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.897+0000 7f7125b3a500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b05e88800 0x557b050a5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.897+0000 7f7125b3a500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b05e88c00 0x557b050a6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.897+0000 7f7125b3a500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b05035e00 con 0x557b05e88800 2024-09-13T18:31:43.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.897+0000 7f7125b3a500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b05080a00 con 0x557b05e88400 2024-09-13T18:31:43.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.897+0000 7f7125b3a500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b05080780 con 0x557b05e88c00 2024-09-13T18:31:43.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.897+0000 7f71242f4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b05e88800 0x557b050a5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.897+0000 7f7123af3700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b05e88400 0x557b050a5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.897+0000 7f71242f4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b05e88800 0x557b050a5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60124/0 (socket says 172.21.15.44:60124) 2024-09-13T18:31:43.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.897+0000 7f71242f4700 1 -- 172.21.15.44:0/1448500352 learned_addr learned my addr 172.21.15.44:0/1448500352 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.897+0000 7f7123af3700 1 --2- 172.21.15.44:0/1448500352 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b05e88c00 0x557b050a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.901+0000 7f71242f4700 1 -- 172.21.15.44:0/1448500352 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b05e88c00 msgr2=0x557b050a6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.901+0000 7f71242f4700 1 --2- 172.21.15.44:0/1448500352 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b05e88c00 0x557b050a6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.908 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.901+0000 7f71242f4700 1 -- 172.21.15.44:0/1448500352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b05e88400 msgr2=0x557b050a5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.901+0000 7f71242f4700 1 --2- 172.21.15.44:0/1448500352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b05e88400 0x557b050a5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.909 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.901+0000 7f71242f4700 1 -- 172.21.15.44:0/1448500352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b05022b60 con 0x557b05e88800 2024-09-13T18:31:43.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.901+0000 7f71242f4700 1 --2- 172.21.15.44:0/1448500352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b05e88800 0x557b050a5b80 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x557b052f8900 tx=0x557b050d41e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8dcb02f9e1949c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.901+0000 7f711faeb700 1 -- 172.21.15.44:0/1448500352 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557b0504f080 con 0x557b05e88800 2024-09-13T18:31:43.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.901+0000 7f711faeb700 1 -- 172.21.15.44:0/1448500352 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557b0504a480 con 0x557b05e88800 2024-09-13T18:31:43.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.901+0000 7f711faeb700 1 -- 172.21.15.44:0/1448500352 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557b0504f600 con 0x557b05e88800 2024-09-13T18:31:43.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.901+0000 7f7125b3a500 1 -- 172.21.15.44:0/1448500352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b05e88800 msgr2=0x557b050a5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.901+0000 7f7125b3a500 1 --2- 172.21.15.44:0/1448500352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b05e88800 0x557b050a5b80 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x557b052f8900 tx=0x557b050d41e0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.901+0000 7f7125b3a500 1 -- 172.21.15.44:0/1448500352 shutdown_connections 2024-09-13T18:31:43.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.901+0000 7f7125b3a500 1 --2- 172.21.15.44:0/1448500352 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b05e88c00 0x557b050a6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.901+0000 7f7125b3a500 1 --2- 172.21.15.44:0/1448500352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b05e88800 0x557b050a5b80 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.910 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.901+0000 7f7125b3a500 1 --2- 172.21.15.44:0/1448500352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b05e88400 0x557b050a5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.911 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.901+0000 7f7125b3a500 1 -- 172.21.15.44:0/1448500352 >> 172.21.15.44:0/1448500352 conn(0x557b04ffec00 msgr2=0x557b050bb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.911 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.901+0000 7f7125b3a500 1 -- 172.21.15.44:0/1448500352 shutdown_connections 2024-09-13T18:31:43.911 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.901+0000 7f7125b3a500 1 -- 172.21.15.44:0/1448500352 wait complete. 2024-09-13T18:31:43.912 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.901+0000 7f7125b3a500 1 Processor -- start 2024-09-13T18:31:43.912 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.901+0000 7f7125b3a500 1 -- start start 2024-09-13T18:31:43.912 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.905+0000 7f7125b3a500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b05e88400 0x557b050a7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.912 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.905+0000 7f7125b3a500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b05e88800 0x557b050a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.912 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.905+0000 7f7125b3a500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b05e88c00 0x557b050a6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.912 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.905+0000 7f7125b3a500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b05080500 con 0x557b05e88800 2024-09-13T18:31:43.912 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.905+0000 7f7125b3a500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b050803c0 con 0x557b05e88c00 2024-09-13T18:31:43.912 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.905+0000 7f7125b3a500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b05080280 con 0x557b05e88400 2024-09-13T18:31:43.912 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.905+0000 7f71242f4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b05e88800 0x557b050a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.905+0000 7f71242f4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b05e88800 0x557b050a6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60136/0 (socket says 172.21.15.44:60136) 2024-09-13T18:31:43.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.905+0000 7f71242f4700 1 -- 172.21.15.44:0/3567761474 learned_addr learned my addr 172.21.15.44:0/3567761474 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.905+0000 7f7123af3700 1 --2- 172.21.15.44:0/3567761474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b05e88c00 0x557b050a6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.913 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.905+0000 7f7123af3700 1 --2- 172.21.15.44:0/3567761474 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b05e88400 0x557b050a7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.905+0000 7f71242f4700 1 -- 172.21.15.44:0/3567761474 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b05e88400 msgr2=0x557b050a7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.905+0000 7f71242f4700 1 --2- 172.21.15.44:0/3567761474 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b05e88400 0x557b050a7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.905+0000 7f71242f4700 1 -- 172.21.15.44:0/3567761474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b05e88c00 msgr2=0x557b050a6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.905+0000 7f71242f4700 1 --2- 172.21.15.44:0/3567761474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b05e88c00 0x557b050a6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.905+0000 7f71242f4700 1 -- 172.21.15.44:0/3567761474 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b05022340 con 0x557b05e88800 2024-09-13T18:31:43.914 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.905+0000 7f7123af3700 1 --2- 172.21.15.44:0/3567761474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b05e88c00 0x557b050a6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:43.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.905+0000 7f71242f4700 1 --2- 172.21.15.44:0/3567761474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b05e88800 0x557b050a6c00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x557b052f95c0 tx=0x557b05e7c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.905+0000 7f711e2e8700 1 -- 172.21.15.44:0/3567761474 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557b0504edc0 con 0x557b05e88800 2024-09-13T18:31:43.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.905+0000 7f711e2e8700 1 -- 172.21.15.44:0/3567761474 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557b05df2780 con 0x557b05e88800 2024-09-13T18:31:43.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.905+0000 7f7125b3a500 1 -- 172.21.15.44:0/3567761474 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557b05022000 con 0x557b05e88800 2024-09-13T18:31:43.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.905+0000 7f711e2e8700 1 -- 172.21.15.44:0/3567761474 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557b0504f080 con 0x557b05e88800 2024-09-13T18:31:43.915 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.905+0000 7f7125b3a500 1 -- 172.21.15.44:0/3567761474 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b05022ea0 con 0x557b05e88800 2024-09-13T18:31:43.916 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.909+0000 7f711e2e8700 1 -- 172.21.15.44:0/3567761474 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x557b0505e840 con 0x557b05e88800 2024-09-13T18:31:43.917 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.909+0000 7f711e2e8700 1 --2- 172.21.15.44:0/3567761474 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x557b05372800 0x557b050a7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.917 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.909+0000 7f711e2e8700 1 -- 172.21.15.44:0/3567761474 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x557b05038a80 con 0x557b05e88800 2024-09-13T18:31:43.917 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.909+0000 7f7125b3a500 1 --2- 172.21.15.44:0/3567761474 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x557b05e89000 0x557b050a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.917 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.909+0000 7f7125b3a500 1 -- 172.21.15.44:0/3567761474 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x557b05e89400 con 0x557b05e89000 2024-09-13T18:31:43.917 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.909+0000 7f7123af3700 1 --2- 172.21.15.44:0/3567761474 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x557b05372800 0x557b050a7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.918 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.909+0000 7f7123af3700 1 --2- 172.21.15.44:0/3567761474 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x557b05e89000 0x557b050a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.918 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.909+0000 7f7123af3700 1 --2- 172.21.15.44:0/3567761474 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x557b05e89000 0x557b050a6100 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.909+0000 7f7123af3700 1 --2- 172.21.15.44:0/3567761474 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x557b05372800 0x557b050a7700 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x557b050d2720 tx=0x557b05363080 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.909+0000 7f7123af3700 1 -- 172.21.15.44:0/3567761474 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x557b05df0b40 con 0x557b05e89000 2024-09-13T18:31:43.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.909+0000 7f7125b3a500 1 -- 172.21.15.44:0/3567761474 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x557b05e89800 con 0x557b05e89000 2024-09-13T18:31:43.919 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.913+0000 7f7123af3700 1 -- 172.21.15.44:0/3567761474 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv27 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x557b05df0b40 con 0x557b05e89000 2024-09-13T18:31:43.920 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.913+0000 7f7125b3a500 -1 Header is invalid (inconsistent offsets) 2024-09-13T18:31:43.920 INFO:tasks.workunit.client.0.smithi044.stdout:Updating expire_pos 0x400000 -> 0x7b 2024-09-13T18:31:43.920 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.913+0000 7f7125b3a500 1 -- 172.21.15.44:0/3567761474 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:3 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x557b05372c00 con 0x557b05e89000 2024-09-13T18:31:43.923 INFO:tasks.workunit.client.0.smithi044.stdout:Successfully updated header. 2024-09-13T18:31:43.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.913+0000 7f7123af3700 1 -- 172.21.15.44:0/3567761474 <== osd.2 v2:172.21.15.44:6817/3180763837 3 ==== osd_op_reply(3 200.00000000 [writefull 0~90] v51'28 uv28 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x557b05df0b40 con 0x557b05e89000 2024-09-13T18:31:43.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.913+0000 7f7125b3a500 1 -- 172.21.15.44:0/3567761474 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x557b05e89000 msgr2=0x557b050a6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.913+0000 7f7125b3a500 1 --2- 172.21.15.44:0/3567761474 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x557b05e89000 0x557b050a6100 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.924 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.913+0000 7f7125b3a500 1 -- 172.21.15.44:0/3567761474 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x557b05372800 msgr2=0x557b050a7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.913+0000 7f7125b3a500 1 --2- 172.21.15.44:0/3567761474 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x557b05372800 0x557b050a7700 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x557b050d2720 tx=0x557b05363080 comp rx=0 tx=0).stop 2024-09-13T18:31:43.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.913+0000 7f7125b3a500 1 -- 172.21.15.44:0/3567761474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b05e88800 msgr2=0x557b050a6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.913+0000 7f7125b3a500 1 --2- 172.21.15.44:0/3567761474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b05e88800 0x557b050a6c00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x557b052f95c0 tx=0x557b05e7c000 comp rx=0 tx=0).stop 2024-09-13T18:31:43.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.913+0000 7f71242f4700 1 -- 172.21.15.44:0/3567761474 reap_dead start 2024-09-13T18:31:43.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.913+0000 7f7125b3a500 1 -- 172.21.15.44:0/3567761474 shutdown_connections 2024-09-13T18:31:43.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.913+0000 7f7125b3a500 1 -- 172.21.15.44:0/3567761474 >> 172.21.15.44:0/3567761474 conn(0x557b04ffec00 msgr2=0x557b050bb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.913+0000 7f7125b3a500 1 -- 172.21.15.44:0/3567761474 shutdown_connections 2024-09-13T18:31:43.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.917+0000 7f7125b3a500 1 -- 172.21.15.44:0/3567761474 wait complete. 2024-09-13T18:31:43.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.917+0000 7f7125b3a500 1 -- 172.21.15.44:0/3259576411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b04fff000 msgr2=0x557b050a5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.917+0000 7f7125b3a500 1 --2- 172.21.15.44:0/3259576411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b04fff000 0x557b050a5080 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x557b050d3290 tx=0x557b050d58c0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.917+0000 7f7125b3a500 1 -- 172.21.15.44:0/3259576411 shutdown_connections 2024-09-13T18:31:43.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.917+0000 7f7125b3a500 1 --2- 172.21.15.44:0/3259576411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b04fff000 0x557b050a5080 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.917+0000 7f7125b3a500 1 --2- 172.21.15.44:0/3259576411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b04fff400 0x557b050a4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.925 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.917+0000 7f7125b3a500 1 --2- 172.21.15.44:0/3259576411 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b04fff800 0x557b050a4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.926 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.917+0000 7f7125b3a500 1 -- 172.21.15.44:0/3259576411 >> 172.21.15.44:0/3259576411 conn(0x557b04fffc00 msgr2=0x557b050bb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.926 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.917+0000 7f7125b3a500 1 -- 172.21.15.44:0/3259576411 shutdown_connections 2024-09-13T18:31:43.926 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.917+0000 7f7125b3a500 1 -- 172.21.15.44:0/3259576411 wait complete. 2024-09-13T18:31:43.928 INFO:tasks.workunit.client.0.smithi044.stderr:+ cephfs-journal-tool --rank=cephfs:0 header set trimmed_pos 123 2024-09-13T18:31:43.971 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.961+0000 7fced1f3d500 1 -- start start 2024-09-13T18:31:43.971 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.961+0000 7fced1f3d500 1 Processor -- start 2024-09-13T18:31:43.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fced1f3d500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fe18911800 0x55fe189b6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fced1f3d500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fe18911400 0x55fe189b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fced1f3d500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe18911000 0x55fe189b7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.973 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fced1f3d500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe18947e00 con 0x55fe18911000 2024-09-13T18:31:43.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fced1f3d500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe18992a00 con 0x55fe18911800 2024-09-13T18:31:43.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fced1f3d500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fe18992640 con 0x55fe18911400 2024-09-13T18:31:43.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fced0ef8700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe18911000 0x55fe189b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fced06f7700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fe18911800 0x55fe189b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fced0ef8700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe18911000 0x55fe189b7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60140/0 (socket says 172.21.15.44:60140) 2024-09-13T18:31:43.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fced06f7700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fe18911800 0x55fe189b6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:47762/0 (socket says 172.21.15.44:47762) 2024-09-13T18:31:43.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fced0ef8700 1 -- 172.21.15.44:0/1626183246 learned_addr learned my addr 172.21.15.44:0/1626183246 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.974 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fcecfef6700 1 --2- 172.21.15.44:0/1626183246 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fe18911400 0x55fe189b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fced0ef8700 1 -- 172.21.15.44:0/1626183246 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fe18911400 msgr2=0x55fe189b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fced0ef8700 1 --2- 172.21.15.44:0/1626183246 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fe18911400 0x55fe189b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fced0ef8700 1 -- 172.21.15.44:0/1626183246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fe18911800 msgr2=0x55fe189b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.975 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fced0ef8700 1 --2- 172.21.15.44:0/1626183246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fe18911800 0x55fe189b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fced0ef8700 1 -- 172.21.15.44:0/1626183246 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe189349c0 con 0x55fe18911000 2024-09-13T18:31:43.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fced0ef8700 1 --2- 172.21.15.44:0/1626183246 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe18911000 0x55fe189b7080 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x55fe189e52c0 tx=0x55fe1978c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c0910d1fe5e772 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fcecdef2700 1 -- 172.21.15.44:0/1626183246 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fe18961600 con 0x55fe18911000 2024-09-13T18:31:43.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fcecdef2700 1 -- 172.21.15.44:0/1626183246 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fe196f8000 con 0x55fe18911000 2024-09-13T18:31:43.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fcecdef2700 1 -- 172.21.15.44:0/1626183246 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fe189611e0 con 0x55fe18911000 2024-09-13T18:31:43.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fced1f3d500 1 -- 172.21.15.44:0/1626183246 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fe18934b60 con 0x55fe18911000 2024-09-13T18:31:43.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fced1f3d500 1 -- 172.21.15.44:0/1626183246 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55fe18934340 con 0x55fe18911000 2024-09-13T18:31:43.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fcecdef2700 1 -- 172.21.15.44:0/1626183246 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x55fe1894ac40 con 0x55fe18911000 2024-09-13T18:31:43.976 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.965+0000 7fcecdef2700 1 -- 172.21.15.44:0/1626183246 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x55fe19700900 con 0x55fe18911000 2024-09-13T18:31:43.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.969+0000 7fced1f3d500 1 Processor -- start 2024-09-13T18:31:43.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.969+0000 7fced1f3d500 1 -- start start 2024-09-13T18:31:43.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.969+0000 7fced1f3d500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fe18c06400 0x55fe189b7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.969+0000 7fced1f3d500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe18c06800 0x55fe189b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.969+0000 7fced1f3d500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fe18c06c00 0x55fe189b8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.969+0000 7fced1f3d500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe18992500 con 0x55fe18c06800 2024-09-13T18:31:43.977 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.969+0000 7fced1f3d500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe189923c0 con 0x55fe18c06400 2024-09-13T18:31:43.978 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.969+0000 7fced1f3d500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fe18992a00 con 0x55fe18c06c00 2024-09-13T18:31:43.979 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.969+0000 7fced06f7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe18c06800 0x55fe189b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.979 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.969+0000 7fced06f7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe18c06800 0x55fe189b7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60156/0 (socket says 172.21.15.44:60156) 2024-09-13T18:31:43.979 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.969+0000 7fced06f7700 1 -- 172.21.15.44:0/2069144451 learned_addr learned my addr 172.21.15.44:0/2069144451 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.979 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.969+0000 7fcecfef6700 1 --2- 172.21.15.44:0/2069144451 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fe18c06c00 0x55fe189b8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.979 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.969+0000 7fcecfef6700 1 --2- 172.21.15.44:0/2069144451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fe18c06400 0x55fe189b7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.979 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.969+0000 7fced06f7700 1 -- 172.21.15.44:0/2069144451 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fe18c06c00 msgr2=0x55fe189b8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.979 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.969+0000 7fced06f7700 1 --2- 172.21.15.44:0/2069144451 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fe18c06c00 0x55fe189b8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.979 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.969+0000 7fced06f7700 1 -- 172.21.15.44:0/2069144451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fe18c06400 msgr2=0x55fe189b7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.980 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.969+0000 7fced06f7700 1 --2- 172.21.15.44:0/2069144451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fe18c06400 0x55fe189b7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.980 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.969+0000 7fced06f7700 1 -- 172.21.15.44:0/2069144451 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe18934000 con 0x55fe18c06800 2024-09-13T18:31:43.980 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.969+0000 7fcecfef6700 1 --2- 172.21.15.44:0/2069144451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fe18c06400 0x55fe189b7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:43.980 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.969+0000 7fced06f7700 1 --2- 172.21.15.44:0/2069144451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe18c06800 0x55fe189b7b80 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x55fe18c166f0 tx=0x55fe189e78c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67443d52c51ca384 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.980 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.969+0000 7fcecbeee700 1 -- 172.21.15.44:0/2069144451 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fe18961080 con 0x55fe18c06800 2024-09-13T18:31:43.980 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.969+0000 7fcecbeee700 1 -- 172.21.15.44:0/2069144451 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fe196f8f00 con 0x55fe18c06800 2024-09-13T18:31:43.980 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.969+0000 7fcecbeee700 1 -- 172.21.15.44:0/2069144451 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fe18961600 con 0x55fe18c06800 2024-09-13T18:31:43.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fced1f3d500 1 -- 172.21.15.44:0/2069144451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe18c06800 msgr2=0x55fe189b7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fced1f3d500 1 --2- 172.21.15.44:0/2069144451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe18c06800 0x55fe189b7b80 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x55fe18c166f0 tx=0x55fe189e78c0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fced1f3d500 1 -- 172.21.15.44:0/2069144451 shutdown_connections 2024-09-13T18:31:43.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fced1f3d500 1 --2- 172.21.15.44:0/2069144451 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fe18c06c00 0x55fe189b8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fced1f3d500 1 --2- 172.21.15.44:0/2069144451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe18c06800 0x55fe189b7b80 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fced1f3d500 1 --2- 172.21.15.44:0/2069144451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fe18c06400 0x55fe189b7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fced1f3d500 1 -- 172.21.15.44:0/2069144451 >> 172.21.15.44:0/2069144451 conn(0x55fe18910c00 msgr2=0x55fe189cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fced1f3d500 1 -- 172.21.15.44:0/2069144451 shutdown_connections 2024-09-13T18:31:43.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fced1f3d500 1 -- 172.21.15.44:0/2069144451 wait complete. 2024-09-13T18:31:43.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fced1f3d500 1 Processor -- start 2024-09-13T18:31:43.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fced1f3d500 1 -- start start 2024-09-13T18:31:43.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fced1f3d500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe18c06400 0x55fe189b7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.982 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fced1f3d500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fe18c06c00 0x55fe189b8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fced1f3d500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fe18c07000 0x55fe189b8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fced1f3d500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe18992280 con 0x55fe18c06400 2024-09-13T18:31:43.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fced1f3d500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe18992140 con 0x55fe18c06c00 2024-09-13T18:31:43.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fced1f3d500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fe18992000 con 0x55fe18c07000 2024-09-13T18:31:43.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fcecfef6700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe18c06400 0x55fe189b7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fcecfef6700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe18c06400 0x55fe189b7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60172/0 (socket says 172.21.15.44:60172) 2024-09-13T18:31:43.983 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fcecfef6700 1 -- 172.21.15.44:0/2789804984 learned_addr learned my addr 172.21.15.44:0/2789804984 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:43.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fcecfef6700 1 --2- 172.21.15.44:0/2789804984 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fe18c07000 0x55fe189b8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fced06f7700 1 --2- 172.21.15.44:0/2789804984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fe18c06c00 0x55fe189b8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fcecfef6700 1 -- 172.21.15.44:0/2789804984 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fe18c07000 msgr2=0x55fe189b8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fcecfef6700 1 --2- 172.21.15.44:0/2789804984 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fe18c07000 0x55fe189b8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.984 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fcecfef6700 1 -- 172.21.15.44:0/2789804984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fe18c06c00 msgr2=0x55fe189b8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fcecfef6700 1 --2- 172.21.15.44:0/2789804984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fe18c06c00 0x55fe189b8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fcecfef6700 1 -- 172.21.15.44:0/2789804984 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe189341a0 con 0x55fe18c06400 2024-09-13T18:31:43.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fced06f7700 1 --2- 172.21.15.44:0/2789804984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fe18c06c00 0x55fe189b8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:43.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fcecfef6700 1 --2- 172.21.15.44:0/2789804984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe18c06400 0x55fe189b7600 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x55fe18c174a0 tx=0x55fe1978c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fceca6eb700 1 -- 172.21.15.44:0/2789804984 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fe18961080 con 0x55fe18c06400 2024-09-13T18:31:43.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fceca6eb700 1 -- 172.21.15.44:0/2789804984 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fe196f8000 con 0x55fe18c06400 2024-09-13T18:31:43.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fced1f3d500 1 -- 172.21.15.44:0/2789804984 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fe18934000 con 0x55fe18c06400 2024-09-13T18:31:43.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fceca6eb700 1 -- 172.21.15.44:0/2789804984 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fe18961600 con 0x55fe18c06400 2024-09-13T18:31:43.985 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.973+0000 7fced1f3d500 1 -- 172.21.15.44:0/2789804984 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fe189349c0 con 0x55fe18c06400 2024-09-13T18:31:43.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.977+0000 7fceca6eb700 1 -- 172.21.15.44:0/2789804984 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x55fe18970840 con 0x55fe18c06400 2024-09-13T18:31:43.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.977+0000 7fceca6eb700 1 --2- 172.21.15.44:0/2789804984 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55fe18c92400 0x55fe189b9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.977+0000 7fceca6eb700 1 -- 172.21.15.44:0/2789804984 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x55fe1894aa80 con 0x55fe18c06400 2024-09-13T18:31:43.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.977+0000 7fced1f3d500 1 --2- 172.21.15.44:0/2789804984 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55fe18c07400 0x55fe189b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.986 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.977+0000 7fced1f3d500 1 -- 172.21.15.44:0/2789804984 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55fe18c07800 con 0x55fe18c07400 2024-09-13T18:31:43.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.977+0000 7fced06f7700 1 --2- 172.21.15.44:0/2789804984 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55fe18c92400 0x55fe189b9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.987 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.977+0000 7fcecfef6700 1 --2- 172.21.15.44:0/2789804984 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55fe18c07400 0x55fe189b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.977+0000 7fcecfef6700 1 --2- 172.21.15.44:0/2789804984 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55fe18c07400 0x55fe189b8c00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.981+0000 7fced06f7700 1 --2- 172.21.15.44:0/2789804984 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55fe18c92400 0x55fe189b9700 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x55fe18c17200 tx=0x55fe189e60c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.981+0000 7fcecfef6700 1 -- 172.21.15.44:0/2789804984 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55fe196f6b40 con 0x55fe18c07400 2024-09-13T18:31:43.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.981+0000 7fced1f3d500 1 -- 172.21.15.44:0/2789804984 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55fe18c92800 con 0x55fe18c07400 2024-09-13T18:31:43.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.981+0000 7fcecfef6700 1 -- 172.21.15.44:0/2789804984 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv28 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55fe196f6b40 con 0x55fe18c07400 2024-09-13T18:31:43.988 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.981+0000 7fced1f3d500 -1 Header is invalid (inconsistent offsets) 2024-09-13T18:31:43.989 INFO:tasks.workunit.client.0.smithi044.stdout:Updating trimmed_pos 0x400000 -> 0x7b 2024-09-13T18:31:43.989 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.981+0000 7fced1f3d500 1 -- 172.21.15.44:0/2789804984 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:3 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x55fe18c92c00 con 0x55fe18c07400 2024-09-13T18:31:43.990 INFO:tasks.workunit.client.0.smithi044.stdout:Successfully updated header. 2024-09-13T18:31:43.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.981+0000 7fcecfef6700 1 -- 172.21.15.44:0/2789804984 <== osd.2 v2:172.21.15.44:6817/3180763837 3 ==== osd_op_reply(3 200.00000000 [writefull 0~90] v51'29 uv29 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55fe196f6b40 con 0x55fe18c07400 2024-09-13T18:31:43.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.981+0000 7fced1f3d500 1 -- 172.21.15.44:0/2789804984 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55fe18c07400 msgr2=0x55fe189b8c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.981+0000 7fced1f3d500 1 --2- 172.21.15.44:0/2789804984 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55fe18c07400 0x55fe189b8c00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.981+0000 7fced1f3d500 1 -- 172.21.15.44:0/2789804984 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55fe18c92400 msgr2=0x55fe189b9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.981+0000 7fced1f3d500 1 --2- 172.21.15.44:0/2789804984 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55fe18c92400 0x55fe189b9700 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x55fe18c17200 tx=0x55fe189e60c0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.981+0000 7fced1f3d500 1 -- 172.21.15.44:0/2789804984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe18c06400 msgr2=0x55fe189b7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.992 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.981+0000 7fced1f3d500 1 --2- 172.21.15.44:0/2789804984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe18c06400 0x55fe189b7600 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x55fe18c174a0 tx=0x55fe1978c180 comp rx=0 tx=0).stop 2024-09-13T18:31:43.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.981+0000 7fced06f7700 1 -- 172.21.15.44:0/2789804984 reap_dead start 2024-09-13T18:31:43.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.981+0000 7fced1f3d500 1 -- 172.21.15.44:0/2789804984 shutdown_connections 2024-09-13T18:31:43.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.981+0000 7fced1f3d500 1 -- 172.21.15.44:0/2789804984 >> 172.21.15.44:0/2789804984 conn(0x55fe18910c00 msgr2=0x55fe189cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.981+0000 7fced1f3d500 1 -- 172.21.15.44:0/2789804984 shutdown_connections 2024-09-13T18:31:43.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.981+0000 7fced1f3d500 1 -- 172.21.15.44:0/2789804984 wait complete. 2024-09-13T18:31:43.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.985+0000 7fced1f3d500 1 -- 172.21.15.44:0/1626183246 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe18911000 msgr2=0x55fe189b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.985+0000 7fced1f3d500 1 --2- 172.21.15.44:0/1626183246 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe18911000 0x55fe189b7080 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x55fe189e52c0 tx=0x55fe1978c240 comp rx=0 tx=0).stop 2024-09-13T18:31:43.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.985+0000 7fced1f3d500 1 -- 172.21.15.44:0/1626183246 shutdown_connections 2024-09-13T18:31:43.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.985+0000 7fced1f3d500 1 --2- 172.21.15.44:0/1626183246 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe18911000 0x55fe189b7080 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.985+0000 7fced1f3d500 1 --2- 172.21.15.44:0/1626183246 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fe18911400 0x55fe189b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.985+0000 7fced1f3d500 1 --2- 172.21.15.44:0/1626183246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fe18911800 0x55fe189b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.985+0000 7fced1f3d500 1 -- 172.21.15.44:0/1626183246 >> 172.21.15.44:0/1626183246 conn(0x55fe18911c00 msgr2=0x55fe189cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.985+0000 7fced1f3d500 1 -- 172.21.15.44:0/1626183246 shutdown_connections 2024-09-13T18:31:43.993 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:43.985+0000 7fced1f3d500 1 -- 172.21.15.44:0/1626183246 wait complete. 2024-09-13T18:31:43.996 INFO:tasks.workunit.client.0.smithi044.stdout:Rolling back journal to original state... 2024-09-13T18:31:43.997 INFO:tasks.workunit.client.0.smithi044.stderr:+ echo 'Rolling back journal to original state...' 2024-09-13T18:31:43.997 INFO:tasks.workunit.client.0.smithi044.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal import /tmp/journal.bin 2024-09-13T18:31:44.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.029+0000 7ff624c9e500 1 -- start start 2024-09-13T18:31:44.038 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.029+0000 7ff624c9e500 1 Processor -- start 2024-09-13T18:31:44.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff624c9e500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594f5b5d800 0x5594f5c02580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff624c9e500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f5b5d400 0x5594f5c02b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff624c9e500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f5b5d000 0x5594f5c03080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff624c9e500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f5bdea00 con 0x5594f5b5d000 2024-09-13T18:31:44.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff624c9e500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f5bde780 con 0x5594f5b5d400 2024-09-13T18:31:44.040 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff624c9e500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594f5bde640 con 0x5594f5b5d800 2024-09-13T18:31:44.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff623c59700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f5b5d000 0x5594f5c03080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff623c59700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f5b5d000 0x5594f5c03080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60180/0 (socket says 172.21.15.44:60180) 2024-09-13T18:31:44.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff623458700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594f5b5d800 0x5594f5c02580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff623c59700 1 -- 172.21.15.44:0/1755843259 learned_addr learned my addr 172.21.15.44:0/1755843259 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.041 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff622c57700 1 --2- 172.21.15.44:0/1755843259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f5b5d400 0x5594f5c02b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff623c59700 1 -- 172.21.15.44:0/1755843259 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594f5b5d800 msgr2=0x5594f5c02580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff623c59700 1 --2- 172.21.15.44:0/1755843259 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594f5b5d800 0x5594f5c02580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.042 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff623c59700 1 -- 172.21.15.44:0/1755843259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f5b5d400 msgr2=0x5594f5c02b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff623c59700 1 --2- 172.21.15.44:0/1755843259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f5b5d400 0x5594f5c02b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff623c59700 1 -- 172.21.15.44:0/1755843259 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594f5b809c0 con 0x5594f5b5d000 2024-09-13T18:31:44.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff623c59700 1 --2- 172.21.15.44:0/1755843259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f5b5d000 0x5594f5c03080 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x5594f5c312f0 tx=0x5594f69dc120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f30f74a32b413b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff620c53700 1 -- 172.21.15.44:0/1755843259 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5594f5bad600 con 0x5594f5b5d000 2024-09-13T18:31:44.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff620c53700 1 -- 172.21.15.44:0/1755843259 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5594f5ba8900 con 0x5594f5b5d000 2024-09-13T18:31:44.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff624c9e500 1 -- 172.21.15.44:0/1755843259 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5594f5b80b60 con 0x5594f5b5d000 2024-09-13T18:31:44.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff624c9e500 1 -- 172.21.15.44:0/1755843259 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5594f5b80340 con 0x5594f5b5d000 2024-09-13T18:31:44.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff620c53700 1 -- 172.21.15.44:0/1755843259 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5594f5bad1e0 con 0x5594f5b5d000 2024-09-13T18:31:44.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff620c53700 1 -- 172.21.15.44:0/1755843259 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x5594f5b96c40 con 0x5594f5b5d000 2024-09-13T18:31:44.043 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.033+0000 7ff620c53700 1 -- 172.21.15.44:0/1755843259 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x5594f5e46900 con 0x5594f5b5d000 2024-09-13T18:31:44.044 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.037+0000 7ff624c9e500 1 Processor -- start 2024-09-13T18:31:44.044 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.037+0000 7ff624c9e500 1 -- start start 2024-09-13T18:31:44.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.037+0000 7ff624c9e500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f69e6400 0x5594f5c03600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.037+0000 7ff624c9e500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594f69e6800 0x5594f5c03b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.037+0000 7ff624c9e500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f69e6c00 0x5594f5c04100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.045 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.037+0000 7ff624c9e500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f5b93e00 con 0x5594f69e6c00 2024-09-13T18:31:44.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.037+0000 7ff624c9e500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f5bde780 con 0x5594f69e6400 2024-09-13T18:31:44.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.037+0000 7ff624c9e500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594f5bde500 con 0x5594f69e6800 2024-09-13T18:31:44.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.037+0000 7ff622c57700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f69e6c00 0x5594f5c04100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.037+0000 7ff622c57700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f69e6c00 0x5594f5c04100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60196/0 (socket says 172.21.15.44:60196) 2024-09-13T18:31:44.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.037+0000 7ff623458700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594f69e6800 0x5594f5c03b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.037+0000 7ff622c57700 1 -- 172.21.15.44:0/3570504175 learned_addr learned my addr 172.21.15.44:0/3570504175 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.046 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.037+0000 7ff622c57700 1 --2- 172.21.15.44:0/3570504175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f69e6400 0x5594f5c03600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.047 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.037+0000 7ff622c57700 1 -- 172.21.15.44:0/3570504175 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594f69e6800 msgr2=0x5594f5c03b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.037+0000 7ff622c57700 1 --2- 172.21.15.44:0/3570504175 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594f69e6800 0x5594f5c03b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.037+0000 7ff622c57700 1 -- 172.21.15.44:0/3570504175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f69e6400 msgr2=0x5594f5c03600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.037+0000 7ff622c57700 1 --2- 172.21.15.44:0/3570504175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f69e6400 0x5594f5c03600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.037+0000 7ff622c57700 1 -- 172.21.15.44:0/3570504175 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594f5b80000 con 0x5594f69e6c00 2024-09-13T18:31:44.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.037+0000 7ff622c57700 1 --2- 172.21.15.44:0/3570504175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f69e6c00 0x5594f5c04100 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x5594f5e626c0 tx=0x5594f5e66cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897d4bb2dbf7985 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.037+0000 7ff61ec4f700 1 -- 172.21.15.44:0/3570504175 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5594f5bad600 con 0x5594f69e6c00 2024-09-13T18:31:44.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.037+0000 7ff61ec4f700 1 -- 172.21.15.44:0/3570504175 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5594f5ba8900 con 0x5594f69e6c00 2024-09-13T18:31:44.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.037+0000 7ff61ec4f700 1 -- 172.21.15.44:0/3570504175 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5594f5bad1e0 con 0x5594f69e6c00 2024-09-13T18:31:44.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.041+0000 7ff624c9e500 1 -- 172.21.15.44:0/3570504175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f69e6c00 msgr2=0x5594f5c04100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.041+0000 7ff624c9e500 1 --2- 172.21.15.44:0/3570504175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f69e6c00 0x5594f5c04100 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x5594f5e626c0 tx=0x5594f5e66cc0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.041+0000 7ff624c9e500 1 -- 172.21.15.44:0/3570504175 shutdown_connections 2024-09-13T18:31:44.048 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.041+0000 7ff624c9e500 1 --2- 172.21.15.44:0/3570504175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f69e6c00 0x5594f5c04100 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.041+0000 7ff624c9e500 1 --2- 172.21.15.44:0/3570504175 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594f69e6800 0x5594f5c03b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.041+0000 7ff624c9e500 1 --2- 172.21.15.44:0/3570504175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f69e6400 0x5594f5c03600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.041+0000 7ff624c9e500 1 -- 172.21.15.44:0/3570504175 >> 172.21.15.44:0/3570504175 conn(0x5594f5b5cc00 msgr2=0x5594f5c19800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.041+0000 7ff624c9e500 1 -- 172.21.15.44:0/3570504175 shutdown_connections 2024-09-13T18:31:44.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.041+0000 7ff624c9e500 1 -- 172.21.15.44:0/3570504175 wait complete. 2024-09-13T18:31:44.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.041+0000 7ff624c9e500 1 Processor -- start 2024-09-13T18:31:44.049 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.041+0000 7ff624c9e500 1 -- start start 2024-09-13T18:31:44.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.041+0000 7ff624c9e500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f69e6400 0x5594f5c05180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.041+0000 7ff624c9e500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f69e6800 0x5594f5c04c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.041+0000 7ff624c9e500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594f69e6c00 0x5594f5c04680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.041+0000 7ff624c9e500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f5bde3c0 con 0x5594f69e6400 2024-09-13T18:31:44.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.041+0000 7ff624c9e500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f5bde280 con 0x5594f69e6800 2024-09-13T18:31:44.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.041+0000 7ff624c9e500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594f5bde140 con 0x5594f69e6c00 2024-09-13T18:31:44.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.041+0000 7ff622c57700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f69e6400 0x5594f5c05180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.051 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.041+0000 7ff622c57700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f69e6400 0x5594f5c05180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60208/0 (socket says 172.21.15.44:60208) 2024-09-13T18:31:44.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.041+0000 7ff622c57700 1 -- 172.21.15.44:0/1056256663 learned_addr learned my addr 172.21.15.44:0/1056256663 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.041+0000 7ff623458700 1 --2- 172.21.15.44:0/1056256663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f69e6800 0x5594f5c04c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.052 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.041+0000 7ff622c57700 1 --2- 172.21.15.44:0/1056256663 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594f69e6c00 0x5594f5c04680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.053 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.045+0000 7ff622c57700 1 -- 172.21.15.44:0/1056256663 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594f69e6c00 msgr2=0x5594f5c04680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.053 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.045+0000 7ff622c57700 1 --2- 172.21.15.44:0/1056256663 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594f69e6c00 0x5594f5c04680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.053 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.045+0000 7ff622c57700 1 -- 172.21.15.44:0/1056256663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f69e6800 msgr2=0x5594f5c04c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.053 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.045+0000 7ff622c57700 1 --2- 172.21.15.44:0/1056256663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f69e6800 0x5594f5c04c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.045+0000 7ff622c57700 1 -- 172.21.15.44:0/1056256663 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594f5b809c0 con 0x5594f69e6400 2024-09-13T18:31:44.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.045+0000 7ff622c57700 1 --2- 172.21.15.44:0/1056256663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f69e6400 0x5594f5c05180 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x5594f5e63380 tx=0x5594f69dc0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.045+0000 7ff61d44c700 1 -- 172.21.15.44:0/1056256663 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5594f5bacdc0 con 0x5594f69e6400 2024-09-13T18:31:44.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.045+0000 7ff61d44c700 1 -- 172.21.15.44:0/1056256663 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5594f6947680 con 0x5594f69e6400 2024-09-13T18:31:44.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.045+0000 7ff61d44c700 1 -- 172.21.15.44:0/1056256663 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5594f5bad600 con 0x5594f69e6400 2024-09-13T18:31:44.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.045+0000 7ff624c9e500 1 -- 172.21.15.44:0/1056256663 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5594f5b80b60 con 0x5594f69e6400 2024-09-13T18:31:44.054 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.045+0000 7ff624c9e500 1 -- 172.21.15.44:0/1056256663 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5594f5b80ea0 con 0x5594f69e6400 2024-09-13T18:31:44.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.045+0000 7ff61d44c700 1 -- 172.21.15.44:0/1056256663 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x5594f5bbc840 con 0x5594f69e6400 2024-09-13T18:31:44.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.045+0000 7ff61d44c700 1 --2- 172.21.15.44:0/1056256663 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5594f5ede400 0x5594f5c05700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.045+0000 7ff61d44c700 1 -- 172.21.15.44:0/1056256663 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x5594f5b96a80 con 0x5594f69e6400 2024-09-13T18:31:44.055 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.045+0000 7ff623458700 1 --2- 172.21.15.44:0/1056256663 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5594f5ede400 0x5594f5c05700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff623458700 1 --2- 172.21.15.44:0/1056256663 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5594f5ede400 0x5594f5c05700 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x5594f5bb3a40 tx=0x5594f5c338c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff624c9e500 1 -- start start 2024-09-13T18:31:44.056 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff624c9e500 1 Processor -- start 2024-09-13T18:31:44.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff624c9e500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594f69e7400 0x5594f5c04100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff624c9e500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f69e7800 0x5594f5c03b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff624c9e500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f5ede800 0x5594f5c03600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff624c9e500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f5bde140 con 0x5594f69e7800 2024-09-13T18:31:44.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff624c9e500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f5bde280 con 0x5594f5ede800 2024-09-13T18:31:44.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff624c9e500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594f5bde500 con 0x5594f69e7400 2024-09-13T18:31:44.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff623458700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f69e7800 0x5594f5c03b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff622c57700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f5ede800 0x5594f5c03600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.058 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff623458700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f69e7800 0x5594f5c03b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60210/0 (socket says 172.21.15.44:60210) 2024-09-13T18:31:44.059 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff622c57700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f5ede800 0x5594f5c03600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:47812/0 (socket says 172.21.15.44:47812) 2024-09-13T18:31:44.059 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff623458700 1 -- 172.21.15.44:0/599517610 learned_addr learned my addr 172.21.15.44:0/599517610 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.059 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff623c59700 1 --2- 172.21.15.44:0/599517610 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594f69e7400 0x5594f5c04100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.060 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff623458700 1 -- 172.21.15.44:0/599517610 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594f69e7400 msgr2=0x5594f5c04100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff623458700 1 --2- 172.21.15.44:0/599517610 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594f69e7400 0x5594f5c04100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff623458700 1 -- 172.21.15.44:0/599517610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f5ede800 msgr2=0x5594f5c03600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff623458700 1 --2- 172.21.15.44:0/599517610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f5ede800 0x5594f5c03600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff623458700 1 -- 172.21.15.44:0/599517610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594f5f09ba0 con 0x5594f69e7800 2024-09-13T18:31:44.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff623458700 1 --2- 172.21.15.44:0/599517610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f69e7800 0x5594f5c03b80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x5594f5f92de0 tx=0x5594f5c32120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d6c33c6200313e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff61a446700 1 -- 172.21.15.44:0/599517610 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5594f5bad080 con 0x5594f69e7800 2024-09-13T18:31:44.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff61a446700 1 -- 172.21.15.44:0/599517610 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5594f6946180 con 0x5594f69e7800 2024-09-13T18:31:44.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff61a446700 1 -- 172.21.15.44:0/599517610 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5594f5bac6e0 con 0x5594f69e7800 2024-09-13T18:31:44.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff624c9e500 1 -- 172.21.15.44:0/599517610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5594f5f09a00 con 0x5594f69e7800 2024-09-13T18:31:44.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.049+0000 7ff624c9e500 1 -- 172.21.15.44:0/599517610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5594f5f09860 con 0x5594f69e7800 2024-09-13T18:31:44.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.053+0000 7ff61a446700 1 -- 172.21.15.44:0/599517610 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x5594f5b968c0 con 0x5594f69e7800 2024-09-13T18:31:44.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.053+0000 7ff61a446700 1 -- 172.21.15.44:0/599517610 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x5594f6026900 con 0x5594f69e7800 2024-09-13T18:31:44.061 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.053+0000 7ff624c9e500 1 --2- 172.21.15.44:0/599517610 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5594f5edec00 0x5594f6034000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.053+0000 7ff624c9e500 1 -- 172.21.15.44:0/599517610 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5594f5edf000 con 0x5594f5edec00 2024-09-13T18:31:44.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.053+0000 7ff623c59700 1 --2- 172.21.15.44:0/599517610 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5594f5edec00 0x5594f6034000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.053+0000 7ff623c59700 1 --2- 172.21.15.44:0/599517610 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5594f5edec00 0x5594f6034000 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=92fc0330f27d617a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.062 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.053+0000 7ff623c59700 1 -- 172.21.15.44:0/599517610 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x5594f6940b40 con 0x5594f5edec00 2024-09-13T18:31:44.062 INFO:tasks.workunit.client.0.smithi044.stdout:undump /tmp/journal.bin 2024-09-13T18:31:44.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.053+0000 7ff624c9e500 1 -- 172.21.15.44:0/599517610 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5594f5edf400 con 0x5594f5edec00 2024-09-13T18:31:44.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.053+0000 7ff623c59700 1 -- 172.21.15.44:0/599517610 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv29 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x5594f6940b40 con 0x5594f5edec00 2024-09-13T18:31:44.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.053+0000 7ff618c43700 1 -- 172.21.15.44:0/599517610 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:3 6.14 6:292cf221:::200.00000000:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e51) v8 -- 0x5594f601a400 con 0x5594f5edec00 2024-09-13T18:31:44.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.053+0000 7ff618c43700 1 -- 172.21.15.44:0/599517610 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:4 6.14 6:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e51) v8 -- 0x5594f601a800 con 0x5594f5edec00 2024-09-13T18:31:44.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.053+0000 7ff623c59700 1 -- 172.21.15.44:0/599517610 <== osd.2 v2:172.21.15.44:6817/3180763837 3 ==== osd_op_reply(3 200.00000000 [stat out=16b] v0'0 uv29 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x5594f6940b40 con 0x5594f5edec00 2024-09-13T18:31:44.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.053+0000 7ff623c59700 1 -- 172.21.15.44:0/599517610 <== osd.2 v2:172.21.15.44:6817/3180763837 4 ==== osd_op_reply(4 200.00000001 [stat out=16b] v0'0 uv26 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x5594f6940b40 con 0x5594f5edec00 2024-09-13T18:31:44.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.053+0000 7ff618c43700 1 --2- 172.21.15.44:0/599517610 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5594f601ac00 0x5594f6036680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.053+0000 7ff618c43700 1 -- 172.21.15.44:0/599517610 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:5 6.1b 6:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e51) v8 -- 0x5594f601a400 con 0x5594f601ac00 2024-09-13T18:31:44.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.053+0000 7ff622c57700 1 --2- 172.21.15.44:0/599517610 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5594f601ac00 0x5594f6036680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.057+0000 7ff622c57700 1 --2- 172.21.15.44:0/599517610 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5594f601ac00 0x5594f6036680 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=d68e350e4a452e43 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.064 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.057+0000 7ff622c57700 1 -- 172.21.15.44:0/599517610 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(5 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5594f6940d80 con 0x5594f601ac00 2024-09-13T18:31:44.065 INFO:tasks.workunit.client.0.smithi044.stdout:start 4194304 len 31930 write_pos 4200138 format 1 trimmed_pos 4194304 stripe_unit 4194304 stripe_count 1 object_size 4194304 2024-09-13T18:31:44.065 INFO:tasks.workunit.client.0.smithi044.stdout:writing header 200.00000000 2024-09-13T18:31:44.065 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.057+0000 7ff624c9e500 1 -- 172.21.15.44:0/599517610 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:6 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5594f5edf800 con 0x5594f5edec00 2024-09-13T18:31:44.068 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.061+0000 7ff623c59700 1 -- 172.21.15.44:0/599517610 <== osd.2 v2:172.21.15.44:6817/3180763837 5 ==== osd_op_reply(6 200.00000000 [writefull 0~90] v51'30 uv30 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5594f6940b40 con 0x5594f5edec00 2024-09-13T18:31:44.068 INFO:tasks.workunit.client.0.smithi044.stdout:Purging 2 objects from 1 2024-09-13T18:31:44.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.061+0000 7ff624c9e500 1 -- 172.21.15.44:0/599517610 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:7 6.14 6:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5594f5edfc00 con 0x5594f5edec00 2024-09-13T18:31:44.069 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.061+0000 7ff624c9e500 1 -- 172.21.15.44:0/599517610 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:8 6.1b 6:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5594f601b000 con 0x5594f601ac00 2024-09-13T18:31:44.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.061+0000 7ff623c59700 1 -- 172.21.15.44:0/599517610 <== osd.2 v2:172.21.15.44:6817/3180763837 6 ==== osd_op_reply(7 200.00000001 [delete] v51'31 uv31 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5594f6940b40 con 0x5594f5edec00 2024-09-13T18:31:44.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.061+0000 7ff622c57700 1 -- 172.21.15.44:0/599517610 <== osd.3 v2:172.21.15.44:6808/771281770 2 ==== osd_op_reply(8 200.00000002 [delete] v51'6 uv5 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5594f6940d80 con 0x5594f601ac00 2024-09-13T18:31:44.071 INFO:tasks.workunit.client.0.smithi044.stdout: writing 4194304~31930 2024-09-13T18:31:44.071 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.061+0000 7ff624c9e500 1 -- 172.21.15.44:0/599517610 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:9 6.14 6:2e2fa760:::200.00000001:head [write 0~31930 in=31930b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5594f601b400 con 0x5594f5edec00 2024-09-13T18:31:44.074 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.065+0000 7ff623c59700 1 -- 172.21.15.44:0/599517610 <== osd.2 v2:172.21.15.44:6817/3180763837 7 ==== osd_op_reply(9 200.00000001 [write 0~31930] v51'32 uv32 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5594f6940b40 con 0x5594f5edec00 2024-09-13T18:31:44.074 INFO:tasks.workunit.client.0.smithi044.stdout:done. 2024-09-13T18:31:44.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.065+0000 7ff624c9e500 1 -- 172.21.15.44:0/599517610 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5594f5edec00 msgr2=0x5594f6034000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.065+0000 7ff624c9e500 1 --2- 172.21.15.44:0/599517610 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5594f5edec00 0x5594f6034000 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.065+0000 7ff624c9e500 1 -- 172.21.15.44:0/599517610 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5594f601ac00 msgr2=0x5594f6036680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.065+0000 7ff624c9e500 1 --2- 172.21.15.44:0/599517610 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5594f601ac00 0x5594f6036680 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.065+0000 7ff624c9e500 1 -- 172.21.15.44:0/599517610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f69e7800 msgr2=0x5594f5c03b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.065+0000 7ff624c9e500 1 --2- 172.21.15.44:0/599517610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f69e7800 0x5594f5c03b80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x5594f5f92de0 tx=0x5594f5c32120 comp rx=0 tx=0).stop 2024-09-13T18:31:44.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.065+0000 7ff624c9e500 1 -- 172.21.15.44:0/599517610 shutdown_connections 2024-09-13T18:31:44.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.065+0000 7ff622c57700 1 -- 172.21.15.44:0/599517610 reap_dead start 2024-09-13T18:31:44.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.065+0000 7ff624c9e500 1 --2- 172.21.15.44:0/599517610 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5594f5edec00 0x5594f6034000 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.065+0000 7ff624c9e500 1 --2- 172.21.15.44:0/599517610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f5ede800 0x5594f5c03600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.065+0000 7ff624c9e500 1 --2- 172.21.15.44:0/599517610 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5594f601ac00 0x5594f6036680 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.076 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.065+0000 7ff624c9e500 1 --2- 172.21.15.44:0/599517610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f69e7800 0x5594f5c03b80 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.065+0000 7ff624c9e500 1 --2- 172.21.15.44:0/599517610 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594f69e7400 0x5594f5c04100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.065+0000 7ff624c9e500 1 -- 172.21.15.44:0/599517610 >> 172.21.15.44:0/599517610 conn(0x5594f69e7000 msgr2=0x5594f5c1a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.065+0000 7ff624c9e500 1 -- 172.21.15.44:0/599517610 shutdown_connections 2024-09-13T18:31:44.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.065+0000 7ff624c9e500 1 -- 172.21.15.44:0/599517610 wait complete. 2024-09-13T18:31:44.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.065+0000 7ff624c9e500 1 -- 172.21.15.44:0/1056256663 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5594f5ede400 msgr2=0x5594f5c05700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.065+0000 7ff624c9e500 1 --2- 172.21.15.44:0/1056256663 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5594f5ede400 0x5594f5c05700 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x5594f5bb3a40 tx=0x5594f5c338c0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.069+0000 7ff624c9e500 1 -- 172.21.15.44:0/1056256663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f69e6400 msgr2=0x5594f5c05180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.069+0000 7ff624c9e500 1 --2- 172.21.15.44:0/1056256663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f69e6400 0x5594f5c05180 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x5594f5e63380 tx=0x5594f69dc0c0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.069+0000 7ff624c9e500 1 -- 172.21.15.44:0/1056256663 shutdown_connections 2024-09-13T18:31:44.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.069+0000 7ff624c9e500 1 --2- 172.21.15.44:0/1056256663 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5594f5ede400 0x5594f5c05700 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.069+0000 7ff624c9e500 1 --2- 172.21.15.44:0/1056256663 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594f69e6c00 0x5594f5c04680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.069+0000 7ff624c9e500 1 --2- 172.21.15.44:0/1056256663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f69e6800 0x5594f5c04c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.069+0000 7ff624c9e500 1 --2- 172.21.15.44:0/1056256663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f69e6400 0x5594f5c05180 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.077 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.069+0000 7ff624c9e500 1 -- 172.21.15.44:0/1056256663 >> 172.21.15.44:0/1056256663 conn(0x5594f5b5cc00 msgr2=0x5594f5c19800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.069+0000 7ff624c9e500 1 -- 172.21.15.44:0/1056256663 shutdown_connections 2024-09-13T18:31:44.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.069+0000 7ff624c9e500 1 -- 172.21.15.44:0/1056256663 wait complete. 2024-09-13T18:31:44.078 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.069+0000 7ff624c9e500 1 -- 172.21.15.44:0/1755843259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f5b5d000 msgr2=0x5594f5c03080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.069+0000 7ff624c9e500 1 --2- 172.21.15.44:0/1755843259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f5b5d000 0x5594f5c03080 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x5594f5c312f0 tx=0x5594f69dc120 comp rx=0 tx=0).stop 2024-09-13T18:31:44.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.069+0000 7ff624c9e500 1 -- 172.21.15.44:0/1755843259 shutdown_connections 2024-09-13T18:31:44.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.069+0000 7ff624c9e500 1 --2- 172.21.15.44:0/1755843259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f5b5d000 0x5594f5c03080 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.069+0000 7ff624c9e500 1 --2- 172.21.15.44:0/1755843259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594f5b5d400 0x5594f5c02b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.069+0000 7ff624c9e500 1 --2- 172.21.15.44:0/1755843259 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5594f5b5d800 0x5594f5c02580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.069+0000 7ff624c9e500 1 -- 172.21.15.44:0/1755843259 >> 172.21.15.44:0/1755843259 conn(0x5594f5b5dc00 msgr2=0x5594f5c19000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.069+0000 7ff624c9e500 1 -- 172.21.15.44:0/1755843259 shutdown_connections 2024-09-13T18:31:44.079 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.069+0000 7ff624c9e500 1 -- 172.21.15.44:0/1755843259 wait complete. 2024-09-13T18:31:44.081 INFO:tasks.workunit.client.0.smithi044.stdout:Testing 'event' commands... 2024-09-13T18:31:44.081 INFO:tasks.workunit.client.0.smithi044.stderr:+ echo 'Testing '\''event'\'' commands...' 2024-09-13T18:31:44.081 INFO:tasks.workunit.client.0.smithi044.stderr:+ cephfs-journal-tool --rank=cephfs:0 event get summary 2024-09-13T18:31:44.122 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.113+0000 7f2bdbb89500 1 -- start start 2024-09-13T18:31:44.122 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.113+0000 7f2bdbb89500 1 Processor -- start 2024-09-13T18:31:44.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bdbb89500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56096dafb800 0x56096dba0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bdbb89500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56096dafb400 0x56096dba0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bdbb89500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56096dafb000 0x56096dba1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bdbb89500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56096db7ca00 con 0x56096dafb800 2024-09-13T18:31:44.124 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bdbb89500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56096db7c780 con 0x56096dafb400 2024-09-13T18:31:44.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bdbb89500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x56096db7c640 con 0x56096dafb000 2024-09-13T18:31:44.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bda343700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56096dafb800 0x56096dba0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bda343700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56096dafb800 0x56096dba0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60234/0 (socket says 172.21.15.44:60234) 2024-09-13T18:31:44.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bda343700 1 -- 172.21.15.44:0/2986001874 learned_addr learned my addr 172.21.15.44:0/2986001874 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bd9b42700 1 --2- 172.21.15.44:0/2986001874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56096dafb400 0x56096dba0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.125 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bdab44700 1 --2- 172.21.15.44:0/2986001874 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56096dafb000 0x56096dba1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bda343700 1 -- 172.21.15.44:0/2986001874 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56096dafb000 msgr2=0x56096dba1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bda343700 1 --2- 172.21.15.44:0/2986001874 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56096dafb000 0x56096dba1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.126 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bda343700 1 -- 172.21.15.44:0/2986001874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56096dafb400 msgr2=0x56096dba0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bda343700 1 --2- 172.21.15.44:0/2986001874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56096dafb400 0x56096dba0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bda343700 1 -- 172.21.15.44:0/2986001874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56096db1e9c0 con 0x56096dafb800 2024-09-13T18:31:44.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bd9b42700 1 --2- 172.21.15.44:0/2986001874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56096dafb400 0x56096dba0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:44.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bda343700 1 --2- 172.21.15.44:0/2986001874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56096dafb800 0x56096dba0580 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x56096dbcf290 tx=0x56096e978120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e414ea97a21b1262 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bd7b3e700 1 -- 172.21.15.44:0/2986001874 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56096db4b600 con 0x56096dafb800 2024-09-13T18:31:44.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bd7b3e700 1 -- 172.21.15.44:0/2986001874 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56096db46900 con 0x56096dafb800 2024-09-13T18:31:44.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bd7b3e700 1 -- 172.21.15.44:0/2986001874 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56096db4b1e0 con 0x56096dafb800 2024-09-13T18:31:44.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bdbb89500 1 -- 172.21.15.44:0/2986001874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56096db1eb60 con 0x56096dafb800 2024-09-13T18:31:44.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bdbb89500 1 -- 172.21.15.44:0/2986001874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x56096db1e340 con 0x56096dafb800 2024-09-13T18:31:44.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bd7b3e700 1 -- 172.21.15.44:0/2986001874 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x56096db34c40 con 0x56096dafb800 2024-09-13T18:31:44.127 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.117+0000 7f2bd7b3e700 1 -- 172.21.15.44:0/2986001874 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x56096ddf2000 con 0x56096dafb800 2024-09-13T18:31:44.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.121+0000 7f2bdbb89500 1 Processor -- start 2024-09-13T18:31:44.128 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.121+0000 7f2bdbb89500 1 -- start start 2024-09-13T18:31:44.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.121+0000 7f2bdbb89500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56096e984400 0x56096dba1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.121+0000 7f2bdbb89500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56096e984800 0x56096dba1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.130 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.121+0000 7f2bdbb89500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56096e984c00 0x56096dba2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.121+0000 7f2bdbb89500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56096db31e00 con 0x56096e984800 2024-09-13T18:31:44.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.121+0000 7f2bdbb89500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56096db7c780 con 0x56096e984c00 2024-09-13T18:31:44.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.121+0000 7f2bdbb89500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x56096db7c500 con 0x56096e984400 2024-09-13T18:31:44.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.121+0000 7f2bda343700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56096e984800 0x56096dba1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.121+0000 7f2bda343700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56096e984800 0x56096dba1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60250/0 (socket says 172.21.15.44:60250) 2024-09-13T18:31:44.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.121+0000 7f2bda343700 1 -- 172.21.15.44:0/1122467787 learned_addr learned my addr 172.21.15.44:0/1122467787 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.121+0000 7f2bdab44700 1 --2- 172.21.15.44:0/1122467787 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56096e984400 0x56096dba1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.121+0000 7f2bd9b42700 1 --2- 172.21.15.44:0/1122467787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56096e984c00 0x56096dba2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.121+0000 7f2bda343700 1 -- 172.21.15.44:0/1122467787 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56096e984400 msgr2=0x56096dba1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.121+0000 7f2bda343700 1 --2- 172.21.15.44:0/1122467787 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56096e984400 0x56096dba1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.121+0000 7f2bda343700 1 -- 172.21.15.44:0/1122467787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56096e984c00 msgr2=0x56096dba2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.121+0000 7f2bda343700 1 --2- 172.21.15.44:0/1122467787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56096e984c00 0x56096dba2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.131 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.121+0000 7f2bda343700 1 -- 172.21.15.44:0/1122467787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56096db1e000 con 0x56096e984800 2024-09-13T18:31:44.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.121+0000 7f2bda343700 1 --2- 172.21.15.44:0/1122467787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56096e984800 0x56096dba1b80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x56096de4e6f0 tx=0x56096e978060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dbfc6c8bc2abe75 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.132 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.121+0000 7f2bd5b3a700 1 -- 172.21.15.44:0/1122467787 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56096db4af20 con 0x56096e984800 2024-09-13T18:31:44.133 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.121+0000 7f2bd5b3a700 1 -- 172.21.15.44:0/1122467787 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56096e8e2c00 con 0x56096e984800 2024-09-13T18:31:44.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.121+0000 7f2bd5b3a700 1 -- 172.21.15.44:0/1122467787 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56096db4b600 con 0x56096e984800 2024-09-13T18:31:44.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bdbb89500 1 -- 172.21.15.44:0/1122467787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56096e984800 msgr2=0x56096dba1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bdbb89500 1 --2- 172.21.15.44:0/1122467787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56096e984800 0x56096dba1b80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x56096de4e6f0 tx=0x56096e978060 comp rx=0 tx=0).stop 2024-09-13T18:31:44.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bdbb89500 1 -- 172.21.15.44:0/1122467787 shutdown_connections 2024-09-13T18:31:44.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bdbb89500 1 --2- 172.21.15.44:0/1122467787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56096e984c00 0x56096dba2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bdbb89500 1 --2- 172.21.15.44:0/1122467787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56096e984800 0x56096dba1b80 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bdbb89500 1 --2- 172.21.15.44:0/1122467787 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56096e984400 0x56096dba1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bdbb89500 1 -- 172.21.15.44:0/1122467787 >> 172.21.15.44:0/1122467787 conn(0x56096dafac00 msgr2=0x56096dbb7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bdbb89500 1 -- 172.21.15.44:0/1122467787 shutdown_connections 2024-09-13T18:31:44.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bdbb89500 1 -- 172.21.15.44:0/1122467787 wait complete. 2024-09-13T18:31:44.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bdbb89500 1 Processor -- start 2024-09-13T18:31:44.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bdbb89500 1 -- start start 2024-09-13T18:31:44.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bdbb89500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56096e984400 0x56096dba3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.134 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bdbb89500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56096e984800 0x56096dba2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bdbb89500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56096e984c00 0x56096dba2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bdbb89500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56096db7c3c0 con 0x56096e984c00 2024-09-13T18:31:44.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bdbb89500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56096db7c280 con 0x56096e984800 2024-09-13T18:31:44.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bdbb89500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x56096db7c140 con 0x56096e984400 2024-09-13T18:31:44.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bd9b42700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56096e984c00 0x56096dba2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bdab44700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56096e984400 0x56096dba3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bdab44700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56096e984400 0x56096dba3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:58628/0 (socket says 172.21.15.44:58628) 2024-09-13T18:31:44.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bdab44700 1 -- 172.21.15.44:0/1107244931 learned_addr learned my addr 172.21.15.44:0/1107244931 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bd9b42700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56096e984c00 0x56096dba2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60262/0 (socket says 172.21.15.44:60262) 2024-09-13T18:31:44.135 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bda343700 1 --2- 172.21.15.44:0/1107244931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56096e984800 0x56096dba2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.136 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bd9b42700 1 -- 172.21.15.44:0/1107244931 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56096e984400 msgr2=0x56096dba3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.136 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bd9b42700 1 --2- 172.21.15.44:0/1107244931 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56096e984400 0x56096dba3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bd9b42700 1 -- 172.21.15.44:0/1107244931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56096e984800 msgr2=0x56096dba2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bd9b42700 1 --2- 172.21.15.44:0/1107244931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56096e984800 0x56096dba2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bd9b42700 1 -- 172.21.15.44:0/1107244931 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56096db1e9c0 con 0x56096e984c00 2024-09-13T18:31:44.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bdab44700 1 --2- 172.21.15.44:0/1107244931 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56096e984400 0x56096dba3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:44.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bd9b42700 1 --2- 172.21.15.44:0/1107244931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56096e984c00 0x56096dba2680 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x56096de4f4d0 tx=0x56096de02e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bd4337700 1 -- 172.21.15.44:0/1107244931 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56096db4af20 con 0x56096e984c00 2024-09-13T18:31:44.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bd4337700 1 -- 172.21.15.44:0/1107244931 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56096e8e3800 con 0x56096e984c00 2024-09-13T18:31:44.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bdbb89500 1 -- 172.21.15.44:0/1107244931 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56096db1eb60 con 0x56096e984c00 2024-09-13T18:31:44.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bd4337700 1 -- 172.21.15.44:0/1107244931 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56096db4b600 con 0x56096e984c00 2024-09-13T18:31:44.137 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.125+0000 7f2bdbb89500 1 -- 172.21.15.44:0/1107244931 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56096db1e340 con 0x56096e984c00 2024-09-13T18:31:44.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.129+0000 7f2bd4337700 1 -- 172.21.15.44:0/1107244931 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x56096db5a840 con 0x56096e984c00 2024-09-13T18:31:44.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.129+0000 7f2bd4337700 1 --2- 172.21.15.44:0/1107244931 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x56096de60800 0x56096dba3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.129+0000 7f2bd4337700 1 -- 172.21.15.44:0/1107244931 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x56096db34a80 con 0x56096e984c00 2024-09-13T18:31:44.138 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.129+0000 7f2bdbb89500 1 --2- 172.21.15.44:0/1107244931 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x56096e985000 0x56096dba2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.129+0000 7f2bdbb89500 1 -- 172.21.15.44:0/1107244931 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x56096e985400 con 0x56096e985000 2024-09-13T18:31:44.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.129+0000 7f2bdab44700 1 --2- 172.21.15.44:0/1107244931 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x56096de60800 0x56096dba3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.129+0000 7f2bda343700 1 --2- 172.21.15.44:0/1107244931 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x56096e985000 0x56096dba2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.129+0000 7f2bdab44700 1 --2- 172.21.15.44:0/1107244931 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x56096de60800 0x56096dba3700 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x56096de4f410 tx=0x56096dbd18c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.139 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.129+0000 7f2bda343700 1 --2- 172.21.15.44:0/1107244931 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x56096e985000 0x56096dba2100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.133+0000 7f2bda343700 1 -- 172.21.15.44:0/1107244931 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x56096dc5eb40 con 0x56096e985000 2024-09-13T18:31:44.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.133+0000 7f2bdbb89500 1 -- 172.21.15.44:0/1107244931 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x56096e985800 con 0x56096e985000 2024-09-13T18:31:44.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.133+0000 7f2bda343700 1 -- 172.21.15.44:0/1107244931 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv30 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x56096dc5eb40 con 0x56096e985000 2024-09-13T18:31:44.140 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.133+0000 7f2bdbb89500 1 -- 172.21.15.44:0/1107244931 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x56096de60c00 con 0x56096e985000 2024-09-13T18:31:44.142 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.133+0000 7f2bda343700 1 -- 172.21.15.44:0/1107244931 <== osd.2 v2:172.21.15.44:6817/3180763837 3 ==== osd_op_reply(3 200.00000001 [read 0~31930 out=31930b] v0'0 uv32 ondisk = 0) v8 ==== 156+0+31930 (crc 0 0 0) 0x56096dc5eb40 con 0x56096e985000 2024-09-13T18:31:44.143 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.133+0000 7f2bdbb89500 1 --2- 172.21.15.44:0/1107244931 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x56096de61000 0x56096dba1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.143 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.133+0000 7f2bdbb89500 1 -- 172.21.15.44:0/1107244931 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x56096de61400 con 0x56096de61000 2024-09-13T18:31:44.143 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.133+0000 7f2bdab44700 1 --2- 172.21.15.44:0/1107244931 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x56096de61000 0x56096dba1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.143 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdab44700 1 --2- 172.21.15.44:0/1107244931 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x56096de61000 0x56096dba1b80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.143 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdab44700 1 -- 172.21.15.44:0/1107244931 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56096df59200 con 0x56096de61000 2024-09-13T18:31:44.144 INFO:tasks.workunit.client.0.smithi044.stdout:Events by type: 2024-09-13T18:31:44.144 INFO:tasks.workunit.client.0.smithi044.stdout: PURGED: 1 2024-09-13T18:31:44.144 INFO:tasks.workunit.client.0.smithi044.stdout: SESSION: 2 2024-09-13T18:31:44.144 INFO:tasks.workunit.client.0.smithi044.stdout: SUBTREEMAP: 1 2024-09-13T18:31:44.144 INFO:tasks.workunit.client.0.smithi044.stdout: UPDATE: 15 2024-09-13T18:31:44.144 INFO:tasks.workunit.client.0.smithi044.stdout:Errors: 0 2024-09-13T18:31:44.145 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdbb89500 1 -- 172.21.15.44:0/1107244931 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x56096e985000 msgr2=0x56096dba2100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdbb89500 1 --2- 172.21.15.44:0/1107244931 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x56096e985000 0x56096dba2100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdbb89500 1 -- 172.21.15.44:0/1107244931 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x56096de61000 msgr2=0x56096dba1b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdbb89500 1 --2- 172.21.15.44:0/1107244931 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x56096de61000 0x56096dba1b80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdbb89500 1 -- 172.21.15.44:0/1107244931 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x56096de60800 msgr2=0x56096dba3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdbb89500 1 --2- 172.21.15.44:0/1107244931 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x56096de60800 0x56096dba3700 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x56096de4f410 tx=0x56096dbd18c0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdbb89500 1 -- 172.21.15.44:0/1107244931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56096e984c00 msgr2=0x56096dba2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bd9b42700 1 -- 172.21.15.44:0/1107244931 reap_dead start 2024-09-13T18:31:44.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdbb89500 1 --2- 172.21.15.44:0/1107244931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56096e984c00 0x56096dba2680 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x56096de4f4d0 tx=0x56096de02e40 comp rx=0 tx=0).stop 2024-09-13T18:31:44.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdbb89500 1 -- 172.21.15.44:0/1107244931 shutdown_connections 2024-09-13T18:31:44.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdbb89500 1 --2- 172.21.15.44:0/1107244931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56096e984c00 0x56096dba2680 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdbb89500 1 -- 172.21.15.44:0/1107244931 >> 172.21.15.44:0/1107244931 conn(0x56096dafac00 msgr2=0x56096dbb7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.146 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdbb89500 1 -- 172.21.15.44:0/1107244931 shutdown_connections 2024-09-13T18:31:44.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdbb89500 1 -- 172.21.15.44:0/1107244931 wait complete. 2024-09-13T18:31:44.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdbb89500 1 -- 172.21.15.44:0/2986001874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56096dafb800 msgr2=0x56096dba0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdbb89500 1 --2- 172.21.15.44:0/2986001874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56096dafb800 0x56096dba0580 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x56096dbcf290 tx=0x56096e978120 comp rx=0 tx=0).stop 2024-09-13T18:31:44.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdbb89500 1 -- 172.21.15.44:0/2986001874 shutdown_connections 2024-09-13T18:31:44.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdbb89500 1 --2- 172.21.15.44:0/2986001874 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56096dafb000 0x56096dba1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdbb89500 1 --2- 172.21.15.44:0/2986001874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56096dafb400 0x56096dba0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdbb89500 1 --2- 172.21.15.44:0/2986001874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56096dafb800 0x56096dba0580 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdbb89500 1 -- 172.21.15.44:0/2986001874 >> 172.21.15.44:0/2986001874 conn(0x56096dafbc00 msgr2=0x56096dbb7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdbb89500 1 -- 172.21.15.44:0/2986001874 shutdown_connections 2024-09-13T18:31:44.147 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.137+0000 7f2bdbb89500 1 -- 172.21.15.44:0/2986001874 wait complete. 2024-09-13T18:31:44.148 INFO:tasks.workunit.client.0.smithi044.stderr:+ cephfs-journal-tool --rank=cephfs:0 event get --type=UPDATE --path=/ --inode=0 --frag=0x100 summary 2024-09-13T18:31:44.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.185+0000 7f2492082500 1 -- start start 2024-09-13T18:31:44.194 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.185+0000 7f2492082500 1 Processor -- start 2024-09-13T18:31:44.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.185+0000 7f2492082500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa8d5ff800 0x55fa8d6a4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.185+0000 7f2492082500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fa8d5ff400 0x55fa8d6a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.185+0000 7f2492082500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fa8d5ff000 0x55fa8d6a5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.185+0000 7f2492082500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8d680a00 con 0x55fa8d5ff000 2024-09-13T18:31:44.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.185+0000 7f2492082500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8d680780 con 0x55fa8d5ff800 2024-09-13T18:31:44.195 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.185+0000 7f2492082500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa8d680640 con 0x55fa8d5ff400 2024-09-13T18:31:44.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.189+0000 7f249103d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fa8d5ff000 0x55fa8d6a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.189+0000 7f249083c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa8d5ff800 0x55fa8d6a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.189+0000 7f249083c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa8d5ff800 0x55fa8d6a4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:47852/0 (socket says 172.21.15.44:47852) 2024-09-13T18:31:44.197 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.189+0000 7f249083c700 1 -- 172.21.15.44:0/1848937469 learned_addr learned my addr 172.21.15.44:0/1848937469 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.189+0000 7f249003b700 1 --2- 172.21.15.44:0/1848937469 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fa8d5ff400 0x55fa8d6a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.189+0000 7f249103d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fa8d5ff000 0x55fa8d6a5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60278/0 (socket says 172.21.15.44:60278) 2024-09-13T18:31:44.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.189+0000 7f249083c700 1 -- 172.21.15.44:0/1848937469 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fa8d5ff400 msgr2=0x55fa8d6a4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.189+0000 7f249083c700 1 --2- 172.21.15.44:0/1848937469 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fa8d5ff400 0x55fa8d6a4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.189+0000 7f249083c700 1 -- 172.21.15.44:0/1848937469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fa8d5ff000 msgr2=0x55fa8d6a5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.189+0000 7f249083c700 1 --2- 172.21.15.44:0/1848937469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fa8d5ff000 0x55fa8d6a5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.189+0000 7f249083c700 1 -- 172.21.15.44:0/1848937469 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa8d6229c0 con 0x55fa8d5ff800 2024-09-13T18:31:44.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.189+0000 7f249083c700 1 --2- 172.21.15.44:0/1848937469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa8d5ff800 0x55fa8d6a4580 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55fa8d6d3290 tx=0x55fa8d6d58c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=211639066f9b32f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.189+0000 7f248e037700 1 -- 172.21.15.44:0/1848937469 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa8d64f080 con 0x55fa8d5ff800 2024-09-13T18:31:44.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.189+0000 7f248e037700 1 -- 172.21.15.44:0/1848937469 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fa8e3f4480 con 0x55fa8d5ff800 2024-09-13T18:31:44.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.189+0000 7f248e037700 1 -- 172.21.15.44:0/1848937469 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa8d64f600 con 0x55fa8d5ff800 2024-09-13T18:31:44.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.189+0000 7f2492082500 1 -- 172.21.15.44:0/1848937469 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa8d6221a0 con 0x55fa8d5ff800 2024-09-13T18:31:44.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.189+0000 7f2492082500 1 -- 172.21.15.44:0/1848937469 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55fa8d6229c0 con 0x55fa8d5ff800 2024-09-13T18:31:44.198 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.189+0000 7f248e037700 1 -- 172.21.15.44:0/1848937469 <== mon.1 v2:172.21.15.99:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x55fa8d638c40 con 0x55fa8d5ff800 2024-09-13T18:31:44.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.189+0000 7f248e037700 1 -- 172.21.15.44:0/1848937469 <== mon.1 v2:172.21.15.99:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x55fa8d640f00 con 0x55fa8d5ff800 2024-09-13T18:31:44.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.189+0000 7f2492082500 1 Processor -- start 2024-09-13T18:31:44.199 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.189+0000 7f2492082500 1 -- start start 2024-09-13T18:31:44.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f2492082500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fa8e488400 0x55fa8d6a5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f2492082500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa8e488800 0x55fa8d6a5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f2492082500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fa8e488c00 0x55fa8d6a6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f2492082500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8d635e00 con 0x55fa8e488c00 2024-09-13T18:31:44.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f2492082500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8d680a00 con 0x55fa8e488800 2024-09-13T18:31:44.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f2492082500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa8d680780 con 0x55fa8e488400 2024-09-13T18:31:44.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f249003b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fa8e488c00 0x55fa8d6a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.201 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f249083c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa8e488800 0x55fa8d6a5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f249003b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fa8e488c00 0x55fa8d6a6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60286/0 (socket says 172.21.15.44:60286) 2024-09-13T18:31:44.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f249083c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa8e488800 0x55fa8d6a5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:47862/0 (socket says 172.21.15.44:47862) 2024-09-13T18:31:44.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f249003b700 1 -- 172.21.15.44:0/3062657513 learned_addr learned my addr 172.21.15.44:0/3062657513 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.202 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f249103d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fa8e488400 0x55fa8d6a5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f249083c700 1 -- 172.21.15.44:0/3062657513 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fa8e488400 msgr2=0x55fa8d6a5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f249083c700 1 --2- 172.21.15.44:0/3062657513 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fa8e488400 0x55fa8d6a5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f249083c700 1 -- 172.21.15.44:0/3062657513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fa8e488c00 msgr2=0x55fa8d6a6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f249083c700 1 --2- 172.21.15.44:0/3062657513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fa8e488c00 0x55fa8d6a6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f249083c700 1 -- 172.21.15.44:0/3062657513 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa8d622b60 con 0x55fa8e488800 2024-09-13T18:31:44.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f249003b700 1 --2- 172.21.15.44:0/3062657513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fa8e488c00 0x55fa8d6a6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:44.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f249083c700 1 --2- 172.21.15.44:0/3062657513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa8e488800 0x55fa8d6a5b80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55fa8d6d3830 tx=0x55fa8d6d4120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2755258870d25e9a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f248c033700 1 -- 172.21.15.44:0/3062657513 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa8d64f1e0 con 0x55fa8e488800 2024-09-13T18:31:44.204 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f248c033700 1 -- 172.21.15.44:0/3062657513 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fa8e3f4900 con 0x55fa8e488800 2024-09-13T18:31:44.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f248c033700 1 -- 172.21.15.44:0/3062657513 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa8d64ef20 con 0x55fa8e488800 2024-09-13T18:31:44.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f2492082500 1 -- 172.21.15.44:0/3062657513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa8e488800 msgr2=0x55fa8d6a5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f2492082500 1 --2- 172.21.15.44:0/3062657513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa8e488800 0x55fa8d6a5b80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55fa8d6d3830 tx=0x55fa8d6d4120 comp rx=0 tx=0).stop 2024-09-13T18:31:44.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f2492082500 1 -- 172.21.15.44:0/3062657513 shutdown_connections 2024-09-13T18:31:44.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f2492082500 1 --2- 172.21.15.44:0/3062657513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fa8e488c00 0x55fa8d6a6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f2492082500 1 --2- 172.21.15.44:0/3062657513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa8e488800 0x55fa8d6a5b80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f2492082500 1 --2- 172.21.15.44:0/3062657513 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fa8e488400 0x55fa8d6a5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f2492082500 1 -- 172.21.15.44:0/3062657513 >> 172.21.15.44:0/3062657513 conn(0x55fa8d5fec00 msgr2=0x55fa8d6bb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f2492082500 1 -- 172.21.15.44:0/3062657513 shutdown_connections 2024-09-13T18:31:44.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.193+0000 7f2492082500 1 -- 172.21.15.44:0/3062657513 wait complete. 2024-09-13T18:31:44.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f2492082500 1 Processor -- start 2024-09-13T18:31:44.205 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f2492082500 1 -- start start 2024-09-13T18:31:44.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f2492082500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fa8e488400 0x55fa8d6a7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f2492082500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa8e488800 0x55fa8d6a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f2492082500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fa8e488c00 0x55fa8d6a6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f2492082500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8d680500 con 0x55fa8e488400 2024-09-13T18:31:44.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f2492082500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8d6803c0 con 0x55fa8e488800 2024-09-13T18:31:44.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f2492082500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa8d680280 con 0x55fa8e488c00 2024-09-13T18:31:44.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f249103d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fa8e488400 0x55fa8d6a7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f249103d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fa8e488400 0x55fa8d6a7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60300/0 (socket says 172.21.15.44:60300) 2024-09-13T18:31:44.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f249103d700 1 -- 172.21.15.44:0/3423447379 learned_addr learned my addr 172.21.15.44:0/3423447379 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f249083c700 1 --2- 172.21.15.44:0/3423447379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa8e488800 0x55fa8d6a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.207 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f249003b700 1 --2- 172.21.15.44:0/3423447379 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fa8e488c00 0x55fa8d6a6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f249103d700 1 -- 172.21.15.44:0/3423447379 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fa8e488c00 msgr2=0x55fa8d6a6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f249103d700 1 --2- 172.21.15.44:0/3423447379 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fa8e488c00 0x55fa8d6a6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f249103d700 1 -- 172.21.15.44:0/3423447379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa8e488800 msgr2=0x55fa8d6a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f249103d700 1 --2- 172.21.15.44:0/3423447379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa8e488800 0x55fa8d6a6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f249103d700 1 -- 172.21.15.44:0/3423447379 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa8d6221a0 con 0x55fa8e488400 2024-09-13T18:31:44.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f249103d700 1 --2- 172.21.15.44:0/3423447379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fa8e488400 0x55fa8d6a7180 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x55fa8d9012c0 tx=0x55fa8d950b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f248a830700 1 -- 172.21.15.44:0/3423447379 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa8d64f1e0 con 0x55fa8e488400 2024-09-13T18:31:44.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f2492082500 1 -- 172.21.15.44:0/3423447379 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fa8d6229c0 con 0x55fa8e488400 2024-09-13T18:31:44.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f248a830700 1 -- 172.21.15.44:0/3423447379 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fa8d64a180 con 0x55fa8e488400 2024-09-13T18:31:44.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f2492082500 1 -- 172.21.15.44:0/3423447379 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa8d622b60 con 0x55fa8e488400 2024-09-13T18:31:44.208 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.197+0000 7f248a830700 1 -- 172.21.15.44:0/3423447379 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa8d64ef20 con 0x55fa8e488400 2024-09-13T18:31:44.209 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.201+0000 7f248a830700 1 -- 172.21.15.44:0/3423447379 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x55fa8d65e840 con 0x55fa8e488400 2024-09-13T18:31:44.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.201+0000 7f248a830700 1 --2- 172.21.15.44:0/3423447379 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55fa8d974400 0x55fa8d6a7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.201+0000 7f248a830700 1 -- 172.21.15.44:0/3423447379 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x55fa8d638a80 con 0x55fa8e488400 2024-09-13T18:31:44.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.201+0000 7f2492082500 1 --2- 172.21.15.44:0/3423447379 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55fa8e489000 0x55fa8d6a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.201+0000 7f2492082500 1 -- 172.21.15.44:0/3423447379 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55fa8e489400 con 0x55fa8e489000 2024-09-13T18:31:44.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.201+0000 7f249083c700 1 --2- 172.21.15.44:0/3423447379 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55fa8d974400 0x55fa8d6a7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.210 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.201+0000 7f249003b700 1 --2- 172.21.15.44:0/3423447379 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55fa8e489000 0x55fa8d6a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.201+0000 7f249003b700 1 --2- 172.21.15.44:0/3423447379 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55fa8e489000 0x55fa8d6a6100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.201+0000 7f249083c700 1 --2- 172.21.15.44:0/3423447379 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55fa8d974400 0x55fa8d6a7700 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x55fa8d6d3830 tx=0x55fa8d951ce0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.201+0000 7f249003b700 1 -- 172.21.15.44:0/3423447379 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55fa8e3deb40 con 0x55fa8e489000 2024-09-13T18:31:44.211 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.201+0000 7f2492082500 1 -- 172.21.15.44:0/3423447379 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55fa8e489800 con 0x55fa8e489000 2024-09-13T18:31:44.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f249003b700 1 -- 172.21.15.44:0/3423447379 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv30 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55fa8e3deb40 con 0x55fa8e489000 2024-09-13T18:31:44.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 -- 172.21.15.44:0/3423447379 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55fa8d974800 con 0x55fa8e489000 2024-09-13T18:31:44.212 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f249003b700 1 -- 172.21.15.44:0/3423447379 <== osd.2 v2:172.21.15.44:6817/3180763837 3 ==== osd_op_reply(3 200.00000001 [read 0~31930 out=31930b] v0'0 uv32 ondisk = 0) v8 ==== 156+0+31930 (crc 0 0 0) 0x55fa8e3deb40 con 0x55fa8e489000 2024-09-13T18:31:44.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 --2- 172.21.15.44:0/3423447379 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55fa8d974c00 0x55fa8d6a5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 -- 172.21.15.44:0/3423447379 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55fa8d975000 con 0x55fa8d974c00 2024-09-13T18:31:44.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f249103d700 1 --2- 172.21.15.44:0/3423447379 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55fa8d974c00 0x55fa8d6a5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f249103d700 1 --2- 172.21.15.44:0/3423447379 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55fa8d974c00 0x55fa8d6a5b80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.213 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f249103d700 1 -- 172.21.15.44:0/3423447379 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55fa8e3dfb00 con 0x55fa8d974c00 2024-09-13T18:31:44.214 INFO:tasks.workunit.client.0.smithi044.stdout:Events by type: 2024-09-13T18:31:44.214 INFO:tasks.workunit.client.0.smithi044.stdout: UPDATE: 5 2024-09-13T18:31:44.214 INFO:tasks.workunit.client.0.smithi044.stdout:Errors: 0 2024-09-13T18:31:44.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 -- 172.21.15.44:0/3423447379 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55fa8e489000 msgr2=0x55fa8d6a6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 --2- 172.21.15.44:0/3423447379 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55fa8e489000 0x55fa8d6a6100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 -- 172.21.15.44:0/3423447379 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55fa8d974c00 msgr2=0x55fa8d6a5b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 --2- 172.21.15.44:0/3423447379 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55fa8d974c00 0x55fa8d6a5b80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 -- 172.21.15.44:0/3423447379 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55fa8d974400 msgr2=0x55fa8d6a7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 --2- 172.21.15.44:0/3423447379 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55fa8d974400 0x55fa8d6a7700 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x55fa8d6d3830 tx=0x55fa8d951ce0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.215 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 -- 172.21.15.44:0/3423447379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fa8e488400 msgr2=0x55fa8d6a7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 --2- 172.21.15.44:0/3423447379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fa8e488400 0x55fa8d6a7180 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x55fa8d9012c0 tx=0x55fa8d950b40 comp rx=0 tx=0).stop 2024-09-13T18:31:44.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f249003b700 1 -- 172.21.15.44:0/3423447379 reap_dead start 2024-09-13T18:31:44.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 -- 172.21.15.44:0/3423447379 shutdown_connections 2024-09-13T18:31:44.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 --2- 172.21.15.44:0/3423447379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fa8e488400 0x55fa8d6a7180 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 -- 172.21.15.44:0/3423447379 >> 172.21.15.44:0/3423447379 conn(0x55fa8d5fec00 msgr2=0x55fa8d6bb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 -- 172.21.15.44:0/3423447379 shutdown_connections 2024-09-13T18:31:44.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 -- 172.21.15.44:0/3423447379 wait complete. 2024-09-13T18:31:44.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 -- 172.21.15.44:0/1848937469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa8d5ff800 msgr2=0x55fa8d6a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 --2- 172.21.15.44:0/1848937469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa8d5ff800 0x55fa8d6a4580 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55fa8d6d3290 tx=0x55fa8d6d58c0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 -- 172.21.15.44:0/1848937469 shutdown_connections 2024-09-13T18:31:44.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 --2- 172.21.15.44:0/1848937469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fa8d5ff000 0x55fa8d6a5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 --2- 172.21.15.44:0/1848937469 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fa8d5ff400 0x55fa8d6a4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.216 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 --2- 172.21.15.44:0/1848937469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fa8d5ff800 0x55fa8d6a4580 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 -- 172.21.15.44:0/1848937469 >> 172.21.15.44:0/1848937469 conn(0x55fa8d5ffc00 msgr2=0x55fa8d6bb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 -- 172.21.15.44:0/1848937469 shutdown_connections 2024-09-13T18:31:44.217 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.205+0000 7f2492082500 1 -- 172.21.15.44:0/1848937469 wait complete. 2024-09-13T18:31:44.218 INFO:tasks.workunit.client.0.smithi044.stderr:+ cephfs-journal-tool --rank=cephfs:0 event get json --path /tmp/json.tmp 2024-09-13T18:31:44.259 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ce4e4500 1 -- start start 2024-09-13T18:31:44.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ce4e4500 1 Processor -- start 2024-09-13T18:31:44.260 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ce4e4500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558519dc5800 0x558519e6a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ce4e4500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558519dc5400 0x558519e6ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ce4e4500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558519dc5000 0x558519e6b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ce4e4500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x558519e46780 con 0x558519dc5800 2024-09-13T18:31:44.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ce4e4500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558519e46a00 con 0x558519dc5400 2024-09-13T18:31:44.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ce4e4500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x558519e46640 con 0x558519dc5000 2024-09-13T18:31:44.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ccc9e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558519dc5800 0x558519e6a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ccc9e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558519dc5800 0x558519e6a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60322/0 (socket says 172.21.15.44:60322) 2024-09-13T18:31:44.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ccc9e700 1 -- 172.21.15.44:0/4032372749 learned_addr learned my addr 172.21.15.44:0/4032372749 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7cd49f700 1 --2- 172.21.15.44:0/4032372749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558519dc5000 0x558519e6b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.261 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7cc49d700 1 --2- 172.21.15.44:0/4032372749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558519dc5400 0x558519e6ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ccc9e700 1 -- 172.21.15.44:0/4032372749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558519dc5000 msgr2=0x558519e6b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ccc9e700 1 --2- 172.21.15.44:0/4032372749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558519dc5000 0x558519e6b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ccc9e700 1 -- 172.21.15.44:0/4032372749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558519dc5400 msgr2=0x558519e6ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ccc9e700 1 --2- 172.21.15.44:0/4032372749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558519dc5400 0x558519e6ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ccc9e700 1 -- 172.21.15.44:0/4032372749 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558519de89c0 con 0x558519dc5800 2024-09-13T18:31:44.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ccc9e700 1 --2- 172.21.15.44:0/4032372749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558519dc5800 0x558519e6a580 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x558519e992f0 tx=0x55851ab34120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9432ddbede6a769 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ca499700 1 -- 172.21.15.44:0/4032372749 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558519e15600 con 0x558519dc5800 2024-09-13T18:31:44.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ca499700 1 -- 172.21.15.44:0/4032372749 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558519e10180 con 0x558519dc5800 2024-09-13T18:31:44.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/4032372749 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558519de8b60 con 0x558519dc5800 2024-09-13T18:31:44.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/4032372749 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x558519de8340 con 0x558519dc5800 2024-09-13T18:31:44.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ca499700 1 -- 172.21.15.44:0/4032372749 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558519e151e0 con 0x558519dc5800 2024-09-13T18:31:44.263 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ca499700 1 -- 172.21.15.44:0/4032372749 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x558519dfec40 con 0x558519dc5800 2024-09-13T18:31:44.264 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.253+0000 7fd7ca499700 1 -- 172.21.15.44:0/4032372749 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x55851ac4c900 con 0x558519dc5800 2024-09-13T18:31:44.264 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.257+0000 7fd7ce4e4500 1 Processor -- start 2024-09-13T18:31:44.264 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.257+0000 7fd7ce4e4500 1 -- start start 2024-09-13T18:31:44.266 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.257+0000 7fd7ce4e4500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55851a0b6400 0x558519e6b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.266 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.257+0000 7fd7ce4e4500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55851a0b6800 0x558519e6bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.257+0000 7fd7ce4e4500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55851a0b6c00 0x558519e6c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.257+0000 7fd7ce4e4500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x558519dfbe00 con 0x55851a0b6400 2024-09-13T18:31:44.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.257+0000 7fd7ce4e4500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558519e46a00 con 0x55851a0b6800 2024-09-13T18:31:44.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.257+0000 7fd7ce4e4500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x558519e46500 con 0x55851a0b6c00 2024-09-13T18:31:44.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.257+0000 7fd7cd49f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55851a0b6400 0x558519e6b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.257+0000 7fd7cd49f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55851a0b6400 0x558519e6b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60326/0 (socket says 172.21.15.44:60326) 2024-09-13T18:31:44.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.257+0000 7fd7cd49f700 1 -- 172.21.15.44:0/3661004681 learned_addr learned my addr 172.21.15.44:0/3661004681 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.257+0000 7fd7ccc9e700 1 --2- 172.21.15.44:0/3661004681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55851a0b6800 0x558519e6bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.267 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.257+0000 7fd7cc49d700 1 --2- 172.21.15.44:0/3661004681 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55851a0b6c00 0x558519e6c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.268 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.257+0000 7fd7cd49f700 1 -- 172.21.15.44:0/3661004681 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55851a0b6c00 msgr2=0x558519e6c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.268 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.257+0000 7fd7cd49f700 1 --2- 172.21.15.44:0/3661004681 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55851a0b6c00 0x558519e6c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.268 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.257+0000 7fd7cd49f700 1 -- 172.21.15.44:0/3661004681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55851a0b6800 msgr2=0x558519e6bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.268 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.257+0000 7fd7cd49f700 1 --2- 172.21.15.44:0/3661004681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55851a0b6800 0x558519e6bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.268 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.257+0000 7fd7cd49f700 1 -- 172.21.15.44:0/3661004681 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558519de8000 con 0x55851a0b6400 2024-09-13T18:31:44.268 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7cd49f700 1 --2- 172.21.15.44:0/3661004681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55851a0b6400 0x558519e6b600 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x55851abac8d0 tx=0x55851a0ccc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9fb45ea978dba1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.268 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7c8495700 1 -- 172.21.15.44:0/3661004681 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558519e15600 con 0x55851a0b6400 2024-09-13T18:31:44.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7c8495700 1 -- 172.21.15.44:0/3661004681 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558519e10900 con 0x55851a0b6400 2024-09-13T18:31:44.269 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7c8495700 1 -- 172.21.15.44:0/3661004681 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558519e151e0 con 0x55851a0b6400 2024-09-13T18:31:44.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/3661004681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55851a0b6400 msgr2=0x558519e6b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7ce4e4500 1 --2- 172.21.15.44:0/3661004681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55851a0b6400 0x558519e6b600 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x55851abac8d0 tx=0x55851a0ccc00 comp rx=0 tx=0).stop 2024-09-13T18:31:44.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/3661004681 shutdown_connections 2024-09-13T18:31:44.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7ce4e4500 1 --2- 172.21.15.44:0/3661004681 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55851a0b6c00 0x558519e6c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7ce4e4500 1 --2- 172.21.15.44:0/3661004681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55851a0b6800 0x558519e6bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7ce4e4500 1 --2- 172.21.15.44:0/3661004681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55851a0b6400 0x558519e6b600 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/3661004681 >> 172.21.15.44:0/3661004681 conn(0x558519dc4c00 msgr2=0x558519e81800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/3661004681 shutdown_connections 2024-09-13T18:31:44.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/3661004681 wait complete. 2024-09-13T18:31:44.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7ce4e4500 1 Processor -- start 2024-09-13T18:31:44.270 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7ce4e4500 1 -- start start 2024-09-13T18:31:44.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7ce4e4500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55851a0b6400 0x558519e6d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7ce4e4500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55851a0b6800 0x558519e6cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7ce4e4500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55851a0b6c00 0x558519e6c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.272 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7ce4e4500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x558519e463c0 con 0x55851a0b6800 2024-09-13T18:31:44.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7ce4e4500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558519e46280 con 0x55851a0b6c00 2024-09-13T18:31:44.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7ce4e4500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x558519e46140 con 0x55851a0b6400 2024-09-13T18:31:44.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7ccc9e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55851a0b6800 0x558519e6cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7ccc9e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55851a0b6800 0x558519e6cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60330/0 (socket says 172.21.15.44:60330) 2024-09-13T18:31:44.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7ccc9e700 1 -- 172.21.15.44:0/2695720300 learned_addr learned my addr 172.21.15.44:0/2695720300 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7cc49d700 1 --2- 172.21.15.44:0/2695720300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55851a0b6c00 0x558519e6c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.261+0000 7fd7cd49f700 1 --2- 172.21.15.44:0/2695720300 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55851a0b6400 0x558519e6d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.265+0000 7fd7ccc9e700 1 -- 172.21.15.44:0/2695720300 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55851a0b6400 msgr2=0x558519e6d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.265+0000 7fd7ccc9e700 1 --2- 172.21.15.44:0/2695720300 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55851a0b6400 0x558519e6d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.265+0000 7fd7ccc9e700 1 -- 172.21.15.44:0/2695720300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55851a0b6c00 msgr2=0x558519e6c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.265+0000 7fd7ccc9e700 1 --2- 172.21.15.44:0/2695720300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55851a0b6c00 0x558519e6c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.265+0000 7fd7ccc9e700 1 -- 172.21.15.44:0/2695720300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558519de89c0 con 0x55851a0b6800 2024-09-13T18:31:44.273 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.265+0000 7fd7ccc9e700 1 --2- 172.21.15.44:0/2695720300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55851a0b6800 0x558519e6cc00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x55851abac1e0 tx=0x55851ab34060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.265+0000 7fd7c6c92700 1 -- 172.21.15.44:0/2695720300 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558519e14f20 con 0x55851a0b6800 2024-09-13T18:31:44.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.265+0000 7fd7c6c92700 1 -- 172.21.15.44:0/2695720300 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55851abb6c00 con 0x55851a0b6800 2024-09-13T18:31:44.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.265+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/2695720300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558519de8b60 con 0x55851a0b6800 2024-09-13T18:31:44.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.265+0000 7fd7c6c92700 1 -- 172.21.15.44:0/2695720300 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558519e15600 con 0x55851a0b6800 2024-09-13T18:31:44.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.265+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/2695720300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558519de8ea0 con 0x55851a0b6800 2024-09-13T18:31:44.274 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.265+0000 7fd7c6c92700 1 -- 172.21.15.44:0/2695720300 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x558519e24840 con 0x55851a0b6800 2024-09-13T18:31:44.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.265+0000 7fd7c6c92700 1 --2- 172.21.15.44:0/2695720300 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55851a134400 0x558519e6d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.265+0000 7fd7c6c92700 1 -- 172.21.15.44:0/2695720300 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x558519dfea80 con 0x55851a0b6800 2024-09-13T18:31:44.275 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.269+0000 7fd7ce4e4500 1 --2- 172.21.15.44:0/2695720300 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55851a0b7000 0x558519e6c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.269+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/2695720300 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55851a0b7400 con 0x55851a0b7000 2024-09-13T18:31:44.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.269+0000 7fd7cd49f700 1 --2- 172.21.15.44:0/2695720300 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55851a134400 0x558519e6d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.276 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.269+0000 7fd7cc49d700 1 --2- 172.21.15.44:0/2695720300 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55851a0b7000 0x558519e6c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.269+0000 7fd7cc49d700 1 --2- 172.21.15.44:0/2695720300 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55851a0b7000 0x558519e6c100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.269+0000 7fd7cd49f700 1 --2- 172.21.15.44:0/2695720300 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55851a134400 0x558519e6d700 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x55851abac8d0 tx=0x558519e9b8c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.269+0000 7fd7cc49d700 1 -- 172.21.15.44:0/2695720300 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55851aba2b40 con 0x55851a0b7000 2024-09-13T18:31:44.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.269+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/2695720300 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55851a0b7800 con 0x55851a0b7000 2024-09-13T18:31:44.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.269+0000 7fd7cc49d700 1 -- 172.21.15.44:0/2695720300 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv30 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55851aba2b40 con 0x55851a0b7000 2024-09-13T18:31:44.277 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.269+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/2695720300 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55851a134800 con 0x55851a0b7000 2024-09-13T18:31:44.278 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.269+0000 7fd7cc49d700 1 -- 172.21.15.44:0/2695720300 <== osd.2 v2:172.21.15.44:6817/3180763837 3 ==== osd_op_reply(3 200.00000001 [read 0~31930 out=31930b] v0'0 uv32 ondisk = 0) v8 ==== 156+0+31930 (crc 0 0 0) 0x55851aba2b40 con 0x55851a0b7000 2024-09-13T18:31:44.278 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.269+0000 7fd7ce4e4500 1 --2- 172.21.15.44:0/2695720300 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55851a134c00 0x558519e6bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.278 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.269+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/2695720300 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x55851a135000 con 0x55851a134c00 2024-09-13T18:31:44.278 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.269+0000 7fd7cd49f700 1 --2- 172.21.15.44:0/2695720300 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55851a134c00 0x558519e6bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.279 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.269+0000 7fd7cd49f700 1 --2- 172.21.15.44:0/2695720300 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55851a134c00 0x558519e6bb80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.279 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.269+0000 7fd7cd49f700 1 -- 172.21.15.44:0/2695720300 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55851a229200 con 0x55851a134c00 2024-09-13T18:31:44.286 INFO:tasks.workunit.client.0.smithi044.stderr:Wrote output to JSON file '/tmp/json.tmp' 2024-09-13T18:31:44.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.277+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/2695720300 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55851a0b7000 msgr2=0x558519e6c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.277+0000 7fd7ce4e4500 1 --2- 172.21.15.44:0/2695720300 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x55851a0b7000 0x558519e6c100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.286 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.277+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/2695720300 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55851a134c00 msgr2=0x558519e6bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.277+0000 7fd7ce4e4500 1 --2- 172.21.15.44:0/2695720300 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55851a134c00 0x558519e6bb80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.277+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/2695720300 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55851a134400 msgr2=0x558519e6d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.277+0000 7fd7ce4e4500 1 --2- 172.21.15.44:0/2695720300 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55851a134400 0x558519e6d700 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x55851abac8d0 tx=0x558519e9b8c0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.277+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/2695720300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55851a0b6800 msgr2=0x558519e6cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.277+0000 7fd7cc49d700 1 -- 172.21.15.44:0/2695720300 reap_dead start 2024-09-13T18:31:44.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.277+0000 7fd7ce4e4500 1 --2- 172.21.15.44:0/2695720300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55851a0b6800 0x558519e6cc00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x55851abac1e0 tx=0x55851ab34060 comp rx=0 tx=0).stop 2024-09-13T18:31:44.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.277+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/2695720300 shutdown_connections 2024-09-13T18:31:44.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.277+0000 7fd7ce4e4500 1 --2- 172.21.15.44:0/2695720300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55851a0b6800 0x558519e6cc00 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.287 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.277+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/2695720300 >> 172.21.15.44:0/2695720300 conn(0x558519dc4c00 msgr2=0x558519e81800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.277+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/2695720300 shutdown_connections 2024-09-13T18:31:44.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.277+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/2695720300 wait complete. 2024-09-13T18:31:44.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.277+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/4032372749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558519dc5800 msgr2=0x558519e6a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.277+0000 7fd7ce4e4500 1 --2- 172.21.15.44:0/4032372749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558519dc5800 0x558519e6a580 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x558519e992f0 tx=0x55851ab34120 comp rx=0 tx=0).stop 2024-09-13T18:31:44.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.277+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/4032372749 shutdown_connections 2024-09-13T18:31:44.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.277+0000 7fd7ce4e4500 1 --2- 172.21.15.44:0/4032372749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x558519dc5000 0x558519e6b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.277+0000 7fd7ce4e4500 1 --2- 172.21.15.44:0/4032372749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558519dc5400 0x558519e6ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.277+0000 7fd7ce4e4500 1 --2- 172.21.15.44:0/4032372749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558519dc5800 0x558519e6a580 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.277+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/4032372749 >> 172.21.15.44:0/4032372749 conn(0x558519dc5c00 msgr2=0x558519e81000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.277+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/4032372749 shutdown_connections 2024-09-13T18:31:44.288 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.277+0000 7fd7ce4e4500 1 -- 172.21.15.44:0/4032372749 wait complete. 2024-09-13T18:31:44.290 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' '!' -s /tmp/json.tmp ']' 2024-09-13T18:31:44.290 INFO:tasks.workunit.client.0.smithi044.stderr:+ cephfs-journal-tool --rank=cephfs:0 event get binary --path /tmp/binary.tmp 2024-09-13T18:31:44.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.325+0000 7f1847d58500 1 -- start start 2024-09-13T18:31:44.333 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.325+0000 7f1847d58500 1 Processor -- start 2024-09-13T18:31:44.335 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.325+0000 7f1847d58500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557acc60f800 0x557acc6b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.325+0000 7f1847d58500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557acc60f400 0x557acc6b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.325+0000 7f1847d58500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557acc60f000 0x557acc6b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.325+0000 7f1847d58500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557acc690780 con 0x557acc60f400 2024-09-13T18:31:44.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.325+0000 7f1847d58500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557acc690a00 con 0x557acc60f800 2024-09-13T18:31:44.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.325+0000 7f1847d58500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x557acc690640 con 0x557acc60f000 2024-09-13T18:31:44.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.329+0000 7f1845d11700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557acc60f400 0x557acc6b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.329+0000 7f1845d11700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557acc60f400 0x557acc6b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60338/0 (socket says 172.21.15.44:60338) 2024-09-13T18:31:44.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.329+0000 7f1845d11700 1 -- 172.21.15.44:0/1578249962 learned_addr learned my addr 172.21.15.44:0/1578249962 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.336 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.329+0000 7f1846512700 1 --2- 172.21.15.44:0/1578249962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557acc60f800 0x557acc6b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.337 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.329+0000 7f1846d13700 1 --2- 172.21.15.44:0/1578249962 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557acc60f000 0x557acc6b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.329+0000 7f1845d11700 1 -- 172.21.15.44:0/1578249962 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557acc60f000 msgr2=0x557acc6b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.329+0000 7f1845d11700 1 --2- 172.21.15.44:0/1578249962 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557acc60f000 0x557acc6b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.329+0000 7f1845d11700 1 -- 172.21.15.44:0/1578249962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557acc60f800 msgr2=0x557acc6b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.338 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.329+0000 7f1845d11700 1 --2- 172.21.15.44:0/1578249962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557acc60f800 0x557acc6b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.329+0000 7f1845d11700 1 -- 172.21.15.44:0/1578249962 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557acc6329c0 con 0x557acc60f400 2024-09-13T18:31:44.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.329+0000 7f1845d11700 1 --2- 172.21.15.44:0/1578249962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557acc60f400 0x557acc6b4b00 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x557acc6e3290 tx=0x557acc6e4180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec35dadfd6bdec0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.329+0000 7f1843d0d700 1 -- 172.21.15.44:0/1578249962 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557acc65f080 con 0x557acc60f400 2024-09-13T18:31:44.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.329+0000 7f1843d0d700 1 -- 172.21.15.44:0/1578249962 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557acd3fe180 con 0x557acc60f400 2024-09-13T18:31:44.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.329+0000 7f1843d0d700 1 -- 172.21.15.44:0/1578249962 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557acc65f600 con 0x557acc60f400 2024-09-13T18:31:44.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.329+0000 7f1847d58500 1 -- 172.21.15.44:0/1578249962 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557acc6321a0 con 0x557acc60f400 2024-09-13T18:31:44.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.329+0000 7f1847d58500 1 -- 172.21.15.44:0/1578249962 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x557acc6329c0 con 0x557acc60f400 2024-09-13T18:31:44.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.329+0000 7f1843d0d700 1 -- 172.21.15.44:0/1578249962 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x557acc648c40 con 0x557acc60f400 2024-09-13T18:31:44.339 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.329+0000 7f1843d0d700 1 -- 172.21.15.44:0/1578249962 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x557acc650f00 con 0x557acc60f400 2024-09-13T18:31:44.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.329+0000 7f1847d58500 1 Processor -- start 2024-09-13T18:31:44.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1847d58500 1 -- start start 2024-09-13T18:31:44.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1847d58500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557acd498400 0x557acc6b5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1847d58500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557acd498800 0x557acc6b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1847d58500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557acd498c00 0x557acc6b6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1847d58500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557acc645e00 con 0x557acd498800 2024-09-13T18:31:44.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1847d58500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557acc690a00 con 0x557acd498400 2024-09-13T18:31:44.341 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1847d58500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x557acc690780 con 0x557acd498c00 2024-09-13T18:31:44.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1846512700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557acd498800 0x557acc6b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1846512700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557acd498800 0x557acc6b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60348/0 (socket says 172.21.15.44:60348) 2024-09-13T18:31:44.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1846512700 1 -- 172.21.15.44:0/909470068 learned_addr learned my addr 172.21.15.44:0/909470068 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1846d13700 1 --2- 172.21.15.44:0/909470068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557acd498400 0x557acc6b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1845d11700 1 --2- 172.21.15.44:0/909470068 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557acd498c00 0x557acc6b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1846512700 1 -- 172.21.15.44:0/909470068 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557acd498c00 msgr2=0x557acc6b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1846512700 1 --2- 172.21.15.44:0/909470068 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557acd498c00 0x557acc6b6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1846512700 1 -- 172.21.15.44:0/909470068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557acd498400 msgr2=0x557acc6b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1846512700 1 --2- 172.21.15.44:0/909470068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557acd498400 0x557acc6b5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1846512700 1 -- 172.21.15.44:0/909470068 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557acc632b60 con 0x557acd498800 2024-09-13T18:31:44.342 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1846512700 1 --2- 172.21.15.44:0/909470068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557acd498800 0x557acc6b5b80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x557acc908690 tx=0x557acc966000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df96e5cf593b1251 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1841d09700 1 -- 172.21.15.44:0/909470068 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557acc65f080 con 0x557acd498800 2024-09-13T18:31:44.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1841d09700 1 -- 172.21.15.44:0/909470068 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557acc65a900 con 0x557acd498800 2024-09-13T18:31:44.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1841d09700 1 -- 172.21.15.44:0/909470068 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557acc65f600 con 0x557acd498800 2024-09-13T18:31:44.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1847d58500 1 -- 172.21.15.44:0/909470068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557acd498800 msgr2=0x557acc6b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1847d58500 1 --2- 172.21.15.44:0/909470068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557acd498800 0x557acc6b5b80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x557acc908690 tx=0x557acc966000 comp rx=0 tx=0).stop 2024-09-13T18:31:44.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1847d58500 1 -- 172.21.15.44:0/909470068 shutdown_connections 2024-09-13T18:31:44.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1847d58500 1 --2- 172.21.15.44:0/909470068 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557acd498c00 0x557acc6b6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1847d58500 1 --2- 172.21.15.44:0/909470068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557acd498800 0x557acc6b5b80 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1847d58500 1 --2- 172.21.15.44:0/909470068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557acd498400 0x557acc6b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1847d58500 1 -- 172.21.15.44:0/909470068 >> 172.21.15.44:0/909470068 conn(0x557acc60ec00 msgr2=0x557acc6cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.345 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1847d58500 1 -- 172.21.15.44:0/909470068 shutdown_connections 2024-09-13T18:31:44.346 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.333+0000 7f1847d58500 1 -- 172.21.15.44:0/909470068 wait complete. 2024-09-13T18:31:44.346 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.337+0000 7f1847d58500 1 Processor -- start 2024-09-13T18:31:44.346 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.337+0000 7f1847d58500 1 -- start start 2024-09-13T18:31:44.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.337+0000 7f1847d58500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557acd498400 0x557acc6b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.337+0000 7f1847d58500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557acd498800 0x557acc6b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.337+0000 7f1847d58500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557acd498c00 0x557acc6b6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.337+0000 7f1847d58500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557acc690500 con 0x557acd498400 2024-09-13T18:31:44.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.337+0000 7f1847d58500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557acc6903c0 con 0x557acd498c00 2024-09-13T18:31:44.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.337+0000 7f1847d58500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x557acc690280 con 0x557acd498800 2024-09-13T18:31:44.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.337+0000 7f1846d13700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557acd498400 0x557acc6b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.337+0000 7f1846d13700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557acd498400 0x557acc6b7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60360/0 (socket says 172.21.15.44:60360) 2024-09-13T18:31:44.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.337+0000 7f1846d13700 1 -- 172.21.15.44:0/4203550805 learned_addr learned my addr 172.21.15.44:0/4203550805 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.337+0000 7f1846512700 1 --2- 172.21.15.44:0/4203550805 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557acd498800 0x557acc6b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.337+0000 7f1845d11700 1 --2- 172.21.15.44:0/4203550805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557acd498c00 0x557acc6b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.348 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.337+0000 7f1846d13700 1 -- 172.21.15.44:0/4203550805 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557acd498800 msgr2=0x557acc6b6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.337+0000 7f1846d13700 1 --2- 172.21.15.44:0/4203550805 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557acd498800 0x557acc6b6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.337+0000 7f1846d13700 1 -- 172.21.15.44:0/4203550805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557acd498c00 msgr2=0x557acc6b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.337+0000 7f1846d13700 1 --2- 172.21.15.44:0/4203550805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557acd498c00 0x557acc6b6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.337+0000 7f1846d13700 1 -- 172.21.15.44:0/4203550805 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557acc632340 con 0x557acd498400 2024-09-13T18:31:44.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.337+0000 7f1846d13700 1 --2- 172.21.15.44:0/4203550805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557acd498400 0x557acc6b7180 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x557acc909350 tx=0x557acc966d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.337+0000 7f1840506700 1 -- 172.21.15.44:0/4203550805 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557acc65f080 con 0x557acd498400 2024-09-13T18:31:44.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.337+0000 7f1840506700 1 -- 172.21.15.44:0/4203550805 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557acd3ff800 con 0x557acd498400 2024-09-13T18:31:44.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.337+0000 7f1847d58500 1 -- 172.21.15.44:0/4203550805 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557acc632000 con 0x557acd498400 2024-09-13T18:31:44.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.337+0000 7f1840506700 1 -- 172.21.15.44:0/4203550805 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557acc65f600 con 0x557acd498400 2024-09-13T18:31:44.349 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.341+0000 7f1847d58500 1 -- 172.21.15.44:0/4203550805 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557acc632ea0 con 0x557acd498400 2024-09-13T18:31:44.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.341+0000 7f1840506700 1 -- 172.21.15.44:0/4203550805 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x557acc66e840 con 0x557acd498400 2024-09-13T18:31:44.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.341+0000 7f1840506700 1 --2- 172.21.15.44:0/4203550805 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x557acc97a400 0x557acc6b7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.341+0000 7f1840506700 1 -- 172.21.15.44:0/4203550805 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x557acc648a80 con 0x557acd498400 2024-09-13T18:31:44.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.341+0000 7f1847d58500 1 --2- 172.21.15.44:0/4203550805 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x557acd499000 0x557acc6b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.341+0000 7f1847d58500 1 -- 172.21.15.44:0/4203550805 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x557acd499400 con 0x557acd499000 2024-09-13T18:31:44.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.341+0000 7f1846512700 1 --2- 172.21.15.44:0/4203550805 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x557acc97a400 0x557acc6b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.341+0000 7f1845d11700 1 --2- 172.21.15.44:0/4203550805 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x557acd499000 0x557acc6b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.351 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.341+0000 7f1845d11700 1 --2- 172.21.15.44:0/4203550805 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x557acd499000 0x557acc6b6100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.341+0000 7f1846512700 1 --2- 172.21.15.44:0/4203550805 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x557acc97a400 0x557acc6b7700 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x557acc908690 tx=0x557acd37e0c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.341+0000 7f1845d11700 1 -- 172.21.15.44:0/4203550805 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x557acd3ecb40 con 0x557acd499000 2024-09-13T18:31:44.352 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.341+0000 7f1847d58500 1 -- 172.21.15.44:0/4203550805 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x557acd499800 con 0x557acd499000 2024-09-13T18:31:44.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.345+0000 7f1845d11700 1 -- 172.21.15.44:0/4203550805 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv30 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x557acd3ecb40 con 0x557acd499000 2024-09-13T18:31:44.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.345+0000 7f1847d58500 1 -- 172.21.15.44:0/4203550805 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x557acc97a800 con 0x557acd499000 2024-09-13T18:31:44.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.345+0000 7f1845d11700 1 -- 172.21.15.44:0/4203550805 <== osd.2 v2:172.21.15.44:6817/3180763837 3 ==== osd_op_reply(3 200.00000001 [read 0~31930 out=31930b] v0'0 uv32 ondisk = 0) v8 ==== 156+0+31930 (crc 0 0 0) 0x557acd3ecb40 con 0x557acd499000 2024-09-13T18:31:44.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.345+0000 7f1847d58500 1 --2- 172.21.15.44:0/4203550805 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x557acc97ac00 0x557acc6b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.345+0000 7f1847d58500 1 -- 172.21.15.44:0/4203550805 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x557acc97b000 con 0x557acc97ac00 2024-09-13T18:31:44.353 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.345+0000 7f1846d13700 1 --2- 172.21.15.44:0/4203550805 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x557acc97ac00 0x557acc6b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.345+0000 7f1846d13700 1 --2- 172.21.15.44:0/4203550805 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x557acc97ac00 0x557acc6b5b80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.354 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.345+0000 7f1846d13700 1 -- 172.21.15.44:0/4203550805 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x557acca73200 con 0x557acc97ac00 2024-09-13T18:31:44.355 INFO:tasks.workunit.client.0.smithi044.stderr:Wrote output to binary files in directory '/tmp/binary.tmp' 2024-09-13T18:31:44.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.345+0000 7f1847d58500 1 -- 172.21.15.44:0/4203550805 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x557acd499000 msgr2=0x557acc6b6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.345+0000 7f1847d58500 1 --2- 172.21.15.44:0/4203550805 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x557acd499000 0x557acc6b6100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.345+0000 7f1847d58500 1 -- 172.21.15.44:0/4203550805 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x557acc97ac00 msgr2=0x557acc6b5b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.345+0000 7f1847d58500 1 --2- 172.21.15.44:0/4203550805 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x557acc97ac00 0x557acc6b5b80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.345+0000 7f1847d58500 1 -- 172.21.15.44:0/4203550805 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x557acc97a400 msgr2=0x557acc6b7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.345+0000 7f1847d58500 1 --2- 172.21.15.44:0/4203550805 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x557acc97a400 0x557acc6b7700 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x557acc908690 tx=0x557acd37e0c0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.345+0000 7f1847d58500 1 -- 172.21.15.44:0/4203550805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557acd498400 msgr2=0x557acc6b7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.345+0000 7f1846512700 1 -- 172.21.15.44:0/4203550805 reap_dead start 2024-09-13T18:31:44.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.345+0000 7f1847d58500 1 --2- 172.21.15.44:0/4203550805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557acd498400 0x557acc6b7180 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x557acc909350 tx=0x557acc966d20 comp rx=0 tx=0).stop 2024-09-13T18:31:44.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.345+0000 7f1847d58500 1 -- 172.21.15.44:0/4203550805 shutdown_connections 2024-09-13T18:31:44.355 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.345+0000 7f1847d58500 1 --2- 172.21.15.44:0/4203550805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557acd498400 0x557acc6b7180 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.345+0000 7f1847d58500 1 -- 172.21.15.44:0/4203550805 >> 172.21.15.44:0/4203550805 conn(0x557acc60ec00 msgr2=0x557acc6cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.345+0000 7f1847d58500 1 -- 172.21.15.44:0/4203550805 shutdown_connections 2024-09-13T18:31:44.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.345+0000 7f1847d58500 1 -- 172.21.15.44:0/4203550805 wait complete. 2024-09-13T18:31:44.356 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.349+0000 7f1847d58500 1 -- 172.21.15.44:0/1578249962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557acc60f400 msgr2=0x557acc6b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.349+0000 7f1847d58500 1 --2- 172.21.15.44:0/1578249962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557acc60f400 0x557acc6b4b00 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x557acc6e3290 tx=0x557acc6e4180 comp rx=0 tx=0).stop 2024-09-13T18:31:44.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.349+0000 7f1847d58500 1 -- 172.21.15.44:0/1578249962 shutdown_connections 2024-09-13T18:31:44.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.349+0000 7f1847d58500 1 --2- 172.21.15.44:0/1578249962 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557acc60f000 0x557acc6b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.349+0000 7f1847d58500 1 --2- 172.21.15.44:0/1578249962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557acc60f400 0x557acc6b4b00 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.349+0000 7f1847d58500 1 --2- 172.21.15.44:0/1578249962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557acc60f800 0x557acc6b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.349+0000 7f1847d58500 1 -- 172.21.15.44:0/1578249962 >> 172.21.15.44:0/1578249962 conn(0x557acc60fc00 msgr2=0x557acc6cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.349+0000 7f1847d58500 1 -- 172.21.15.44:0/1578249962 shutdown_connections 2024-09-13T18:31:44.357 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.349+0000 7f1847d58500 1 -- 172.21.15.44:0/1578249962 wait complete. 2024-09-13T18:31:44.360 INFO:tasks.workunit.client.0.smithi044.stderr:+ '[' '!' -s /tmp/binary.tmp ']' 2024-09-13T18:31:44.360 INFO:tasks.workunit.client.0.smithi044.stderr:+ cephfs-journal-tool --rank=cephfs:0 event recover_dentries summary 2024-09-13T18:31:44.401 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.393+0000 7fcfaaf9b500 1 -- start start 2024-09-13T18:31:44.402 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.393+0000 7fcfaaf9b500 1 Processor -- start 2024-09-13T18:31:44.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.393+0000 7fcfaaf9b500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5587eec33800 0x5587eecd8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.393+0000 7fcfaaf9b500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587eec33400 0x5587eecd8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.393+0000 7fcfaaf9b500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5587eec33000 0x5587eecd9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.405 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.393+0000 7fcfaaf9b500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587eecb4a00 con 0x5587eec33800 2024-09-13T18:31:44.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.393+0000 7fcfaaf9b500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587eecb4780 con 0x5587eec33400 2024-09-13T18:31:44.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.393+0000 7fcfaaf9b500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5587eecb4640 con 0x5587eec33000 2024-09-13T18:31:44.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.393+0000 7fcfa9755700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5587eec33800 0x5587eecd8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.393+0000 7fcfa8f54700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587eec33400 0x5587eecd8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.393+0000 7fcfa9755700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5587eec33800 0x5587eecd8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60370/0 (socket says 172.21.15.44:60370) 2024-09-13T18:31:44.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.393+0000 7fcfa9755700 1 -- 172.21.15.44:0/1063260696 learned_addr learned my addr 172.21.15.44:0/1063260696 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.393+0000 7fcfa9f56700 1 --2- 172.21.15.44:0/1063260696 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5587eec33000 0x5587eecd9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.406 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.393+0000 7fcfa9755700 1 -- 172.21.15.44:0/1063260696 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5587eec33000 msgr2=0x5587eecd9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.393+0000 7fcfa9755700 1 --2- 172.21.15.44:0/1063260696 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5587eec33000 0x5587eecd9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.393+0000 7fcfa9755700 1 -- 172.21.15.44:0/1063260696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587eec33400 msgr2=0x5587eecd8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.393+0000 7fcfa9755700 1 --2- 172.21.15.44:0/1063260696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587eec33400 0x5587eecd8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.393+0000 7fcfa9755700 1 -- 172.21.15.44:0/1063260696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587eec569c0 con 0x5587eec33800 2024-09-13T18:31:44.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.393+0000 7fcfa9f56700 1 --2- 172.21.15.44:0/1063260696 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5587eec33000 0x5587eecd9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:44.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.397+0000 7fcfa9755700 1 --2- 172.21.15.44:0/1063260696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5587eec33800 0x5587eecd8580 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x5587eed07380 tx=0x5587ef9a2120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77bcbd84318b58de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.397+0000 7fcfa6f50700 1 -- 172.21.15.44:0/1063260696 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5587eec83600 con 0x5587eec33800 2024-09-13T18:31:44.407 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.397+0000 7fcfa6f50700 1 -- 172.21.15.44:0/1063260696 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5587eec7e180 con 0x5587eec33800 2024-09-13T18:31:44.408 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.397+0000 7fcfa6f50700 1 -- 172.21.15.44:0/1063260696 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5587eec831e0 con 0x5587eec33800 2024-09-13T18:31:44.408 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.397+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1063260696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5587eec56b60 con 0x5587eec33800 2024-09-13T18:31:44.408 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.397+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1063260696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5587eec56340 con 0x5587eec33800 2024-09-13T18:31:44.408 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.397+0000 7fcfa6f50700 1 -- 172.21.15.44:0/1063260696 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x5587eec6cc40 con 0x5587eec33800 2024-09-13T18:31:44.408 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.397+0000 7fcfa6f50700 1 -- 172.21.15.44:0/1063260696 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x5587efab8900 con 0x5587eec33800 2024-09-13T18:31:44.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.397+0000 7fcfaaf9b500 1 Processor -- start 2024-09-13T18:31:44.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.397+0000 7fcfaaf9b500 1 -- start start 2024-09-13T18:31:44.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfaaf9b500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587efabc400 0x5587eecd9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfaaf9b500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5587efabc800 0x5587eecd9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.412 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfaaf9b500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5587efabcc00 0x5587eecda100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfaaf9b500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587eec69e00 con 0x5587efabc800 2024-09-13T18:31:44.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfaaf9b500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587eecb4780 con 0x5587efabc400 2024-09-13T18:31:44.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfaaf9b500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5587eecb4500 con 0x5587efabcc00 2024-09-13T18:31:44.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfa9755700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5587efabc800 0x5587eecd9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfa9755700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5587efabc800 0x5587eecd9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60378/0 (socket says 172.21.15.44:60378) 2024-09-13T18:31:44.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfa9755700 1 -- 172.21.15.44:0/2196424713 learned_addr learned my addr 172.21.15.44:0/2196424713 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfa8f54700 1 --2- 172.21.15.44:0/2196424713 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5587efabcc00 0x5587eecda100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.413 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfa9f56700 1 --2- 172.21.15.44:0/2196424713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587efabc400 0x5587eecd9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfa9755700 1 -- 172.21.15.44:0/2196424713 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5587efabcc00 msgr2=0x5587eecda100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfa9755700 1 --2- 172.21.15.44:0/2196424713 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5587efabcc00 0x5587eecda100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfa9755700 1 -- 172.21.15.44:0/2196424713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587efabc400 msgr2=0x5587eecd9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfa9755700 1 --2- 172.21.15.44:0/2196424713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587efabc400 0x5587eecd9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfa9755700 1 -- 172.21.15.44:0/2196424713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587eec56000 con 0x5587efabc800 2024-09-13T18:31:44.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfa9f56700 1 --2- 172.21.15.44:0/2196424713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587efabc400 0x5587eecd9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:44.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfa9755700 1 --2- 172.21.15.44:0/2196424713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5587efabc800 0x5587eecd9b80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x5587efa205d0 tx=0x5587ef9a2060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943aba6a6660c5e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.414 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfa4f4c700 1 -- 172.21.15.44:0/2196424713 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5587eec82f20 con 0x5587efabc800 2024-09-13T18:31:44.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfa4f4c700 1 -- 172.21.15.44:0/2196424713 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5587efa28f00 con 0x5587efabc800 2024-09-13T18:31:44.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfa4f4c700 1 -- 172.21.15.44:0/2196424713 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5587eec83600 con 0x5587efabc800 2024-09-13T18:31:44.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/2196424713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5587efabc800 msgr2=0x5587eecd9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfaaf9b500 1 --2- 172.21.15.44:0/2196424713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5587efabc800 0x5587eecd9b80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x5587efa205d0 tx=0x5587ef9a2060 comp rx=0 tx=0).stop 2024-09-13T18:31:44.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/2196424713 shutdown_connections 2024-09-13T18:31:44.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfaaf9b500 1 --2- 172.21.15.44:0/2196424713 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5587efabcc00 0x5587eecda100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfaaf9b500 1 --2- 172.21.15.44:0/2196424713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5587efabc800 0x5587eecd9b80 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfaaf9b500 1 --2- 172.21.15.44:0/2196424713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587efabc400 0x5587eecd9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/2196424713 >> 172.21.15.44:0/2196424713 conn(0x5587eec32c00 msgr2=0x5587eecef800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/2196424713 shutdown_connections 2024-09-13T18:31:44.415 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.401+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/2196424713 wait complete. 2024-09-13T18:31:44.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.405+0000 7fcfaaf9b500 1 Processor -- start 2024-09-13T18:31:44.416 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.405+0000 7fcfaaf9b500 1 -- start start 2024-09-13T18:31:44.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.405+0000 7fcfaaf9b500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5587efabc400 0x5587eecdb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.405+0000 7fcfaaf9b500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5587efabc800 0x5587eecdac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.405+0000 7fcfaaf9b500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587efabcc00 0x5587eecda680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.405+0000 7fcfaaf9b500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587eecb43c0 con 0x5587efabc800 2024-09-13T18:31:44.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.405+0000 7fcfaaf9b500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587eecb4280 con 0x5587efabcc00 2024-09-13T18:31:44.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.405+0000 7fcfaaf9b500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5587eecb4140 con 0x5587efabc400 2024-09-13T18:31:44.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.405+0000 7fcfa9755700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5587efabc800 0x5587eecdac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.405+0000 7fcfa9755700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5587efabc800 0x5587eecdac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60392/0 (socket says 172.21.15.44:60392) 2024-09-13T18:31:44.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.405+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 learned_addr learned my addr 172.21.15.44:0/1356865742 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.405+0000 7fcfa8f54700 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587efabcc00 0x5587eecda680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.405+0000 7fcfa9f56700 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5587efabc400 0x5587eecdb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.418 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.405+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5587efabc400 msgr2=0x5587eecdb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.405+0000 7fcfa9755700 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5587efabc400 0x5587eecdb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.405+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587efabcc00 msgr2=0x5587eecda680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.405+0000 7fcfa9755700 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587efabcc00 0x5587eecda680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.405+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587eec569c0 con 0x5587efabc800 2024-09-13T18:31:44.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.405+0000 7fcfa8f54700 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587efabcc00 0x5587eecda680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:44.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.405+0000 7fcfa9755700 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5587efabc800 0x5587eecdac00 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x5587efa20840 tx=0x5587eef36c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.405+0000 7fcfa3749700 1 -- 172.21.15.44:0/1356865742 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5587eec831e0 con 0x5587efabc800 2024-09-13T18:31:44.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.405+0000 7fcfa3749700 1 -- 172.21.15.44:0/1356865742 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5587efa28600 con 0x5587efabc800 2024-09-13T18:31:44.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.409+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5587eec56b60 con 0x5587efabc800 2024-09-13T18:31:44.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.409+0000 7fcfa3749700 1 -- 172.21.15.44:0/1356865742 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5587eec82dc0 con 0x5587efabc800 2024-09-13T18:31:44.419 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.409+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5587eec56340 con 0x5587efabc800 2024-09-13T18:31:44.420 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.409+0000 7fcfa3749700 1 -- 172.21.15.44:0/1356865742 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x5587eec92840 con 0x5587efabc800 2024-09-13T18:31:44.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.409+0000 7fcfa3749700 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5587eef98800 0x5587eecdb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.409+0000 7fcfa3749700 1 -- 172.21.15.44:0/1356865742 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x5587eec6ca80 con 0x5587efabc800 2024-09-13T18:31:44.421 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.409+0000 7fcfaaf9b500 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5587efabd000 0x5587eecda100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.409+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587efabd400 con 0x5587efabd000 2024-09-13T18:31:44.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.409+0000 7fcfa9f56700 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5587eef98800 0x5587eecdb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.409+0000 7fcfa8f54700 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5587efabd000 0x5587eecda100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.413+0000 7fcfa8f54700 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5587efabd000 0x5587eecda100 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.413+0000 7fcfa9f56700 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5587eef98800 0x5587eecdb700 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x5587eec89740 tx=0x5587eed098c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.413+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x5587efa26b40 con 0x5587efabd000 2024-09-13T18:31:44.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.413+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587efabd800 con 0x5587efabd000 2024-09-13T18:31:44.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.413+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv30 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x5587efa26b40 con 0x5587efabd000 2024-09-13T18:31:44.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.413+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef98c00 con 0x5587efabd000 2024-09-13T18:31:44.422 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.413+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.2 v2:172.21.15.44:6817/3180763837 3 ==== osd_op_reply(3 200.00000001 [read 0~31930 out=31930b] v0'0 uv32 ondisk = 0) v8 ==== 156+0+31930 (crc 0 0 0) 0x5587efa26b40 con 0x5587efabd000 2024-09-13T18:31:44.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.413+0000 7fcfaaf9b500 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5587eef99000 0x5587eecd9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.413+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef99400 con 0x5587eef99000 2024-09-13T18:31:44.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.413+0000 7fcfa9f56700 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5587eef99000 0x5587eecd9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.413+0000 7fcfa9f56700 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5587eef99000 0x5587eecd9b80 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.413+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.413+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:5 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef99800 con 0x5587eef99000 2024-09-13T18:31:44.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.417+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 2 ==== osd_op_reply(5 1.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.417+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:6 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef99c00 con 0x5587eef99000 2024-09-13T18:31:44.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.417+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 3 ==== osd_op_reply(6 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.424 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.417+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:7 6.13 6:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef99400 con 0x5587eef99000 2024-09-13T18:31:44.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.417+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 4 ==== osd_op_reply(7 100.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.417+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:8 6.13 6:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef99800 con 0x5587eef99000 2024-09-13T18:31:44.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.417+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 5 ==== osd_op_reply(8 100.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+4 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.425 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.417+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:9 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef98c00 con 0x5587efabd000 2024-09-13T18:31:44.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.417+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.2 v2:172.21.15.44:6817/3180763837 4 ==== osd_op_reply(9 1.00000000.inode [read 0~582 out=582b] v0'0 uv2 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x5587efa26b40 con 0x5587efabd000 2024-09-13T18:31:44.426 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.417+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:10 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587efabd400 con 0x5587efabd000 2024-09-13T18:31:44.429 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.421+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.2 v2:172.21.15.44:6817/3180763837 5 ==== osd_op_reply(10 1.00000000.inode [writefull 0~582] v51'33 uv33 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x5587efa26b40 con 0x5587efabd000 2024-09-13T18:31:44.429 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.421+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:11 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587efabd800 con 0x5587eef99000 2024-09-13T18:31:44.429 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.421+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 6 ==== osd_op_reply(11 1.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.429 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.421+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:12 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef99c00 con 0x5587eef99000 2024-09-13T18:31:44.432 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.425+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 7 ==== osd_op_reply(12 1.00000000 [omap-set-header] v51'6 uv6 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.432 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.425+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:13 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef99400 con 0x5587eef99000 2024-09-13T18:31:44.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.425+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 8 ==== osd_op_reply(13 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.433 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.425+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:14 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=525b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef99800 con 0x5587eef99000 2024-09-13T18:31:44.436 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.429+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 9 ==== osd_op_reply(14 1.00000000 [omap-set-vals] v51'7 uv7 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.436 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.429+0000 7fcfaaf9b500 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x5587eef99c00 0x5587eecd9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.436 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.429+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:15 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef99400 con 0x5587eef99c00 2024-09-13T18:31:44.436 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.429+0000 7fcfa9755700 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x5587eef99c00 0x5587eecd9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.436 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.429+0000 7fcfa9755700 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x5587eef99c00 0x5587eecd9600 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.429+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 1 ==== osd_op_reply(15 10000000000.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.437 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.429+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:16 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef99800 con 0x5587eef99c00 2024-09-13T18:31:44.440 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.433+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 2 ==== osd_op_reply(16 10000000000.00000000 [omap-set-header] v51'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.440 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.433+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:17 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587efabd800 con 0x5587eef99c00 2024-09-13T18:31:44.441 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.433+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 3 ==== osd_op_reply(17 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.441 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.433+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:18 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2000 con 0x5587efabd000 2024-09-13T18:31:44.441 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.433+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.2 v2:172.21.15.44:6817/3180763837 6 ==== osd_op_reply(18 1.00000000.inode [read 0~582 out=582b] v0'0 uv33 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x5587efa26b40 con 0x5587efabd000 2024-09-13T18:31:44.441 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.433+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:19 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2400 con 0x5587efabd000 2024-09-13T18:31:44.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.437+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.2 v2:172.21.15.44:6817/3180763837 7 ==== osd_op_reply(19 1.00000000.inode [writefull 0~582] v51'34 uv34 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x5587efa26b40 con 0x5587efabd000 2024-09-13T18:31:44.444 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.437+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:20 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2800 con 0x5587eef99000 2024-09-13T18:31:44.445 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.437+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 10 ==== osd_op_reply(20 1.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.445 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.437+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:21 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2c00 con 0x5587eef99000 2024-09-13T18:31:44.447 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.441+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 11 ==== osd_op_reply(21 1.00000000 [omap-set-header] v51'8 uv8 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.447 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.441+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:22 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3000 con 0x5587eef99000 2024-09-13T18:31:44.448 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.441+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 12 ==== osd_op_reply(22 1.00000000 [omap-get-vals-by-keys out=525b] v0'0 uv8 ondisk = 0) v8 ==== 154+0+525 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.448 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.441+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:23 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=525b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3400 con 0x5587eef99000 2024-09-13T18:31:44.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.441+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 13 ==== osd_op_reply(23 1.00000000 [omap-set-vals] v51'9 uv9 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.441+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:24 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3800 con 0x5587efabd000 2024-09-13T18:31:44.451 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.445+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.2 v2:172.21.15.44:6817/3180763837 8 ==== osd_op_reply(24 1.00000000.inode [read 0~582 out=582b] v0'0 uv34 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x5587efa26b40 con 0x5587efabd000 2024-09-13T18:31:44.452 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.445+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:25 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3c00 con 0x5587efabd000 2024-09-13T18:31:44.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.445+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.2 v2:172.21.15.44:6817/3180763837 9 ==== osd_op_reply(25 1.00000000.inode [writefull 0~582] v51'35 uv35 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x5587efa26b40 con 0x5587efabd000 2024-09-13T18:31:44.454 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.445+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:26 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2000 con 0x5587eef99000 2024-09-13T18:31:44.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.445+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 14 ==== osd_op_reply(26 1.00000000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.455 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.445+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:27 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2400 con 0x5587eef99000 2024-09-13T18:31:44.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.449+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 15 ==== osd_op_reply(27 1.00000000 [omap-set-header] v51'10 uv10 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.449+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:28 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587efabd400 con 0x5587eef99000 2024-09-13T18:31:44.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.449+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 16 ==== osd_op_reply(28 1.00000000 [omap-get-vals-by-keys out=525b] v0'0 uv10 ondisk = 0) v8 ==== 154+0+525 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.458 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.449+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:29 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=525b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef98c00 con 0x5587eef99000 2024-09-13T18:31:44.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.453+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 17 ==== osd_op_reply(29 1.00000000 [omap-set-vals] v51'11 uv11 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.461 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.453+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:30 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2800 con 0x5587eef99c00 2024-09-13T18:31:44.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.453+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 4 ==== osd_op_reply(30 10000000000.00000000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.462 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.453+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:31 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2c00 con 0x5587eef99c00 2024-09-13T18:31:44.464 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.457+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 5 ==== osd_op_reply(31 10000000000.00000000 [omap-set-header] v51'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.465 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.457+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:32 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3000 con 0x5587eef99c00 2024-09-13T18:31:44.465 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.457+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 6 ==== osd_op_reply(32 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.465 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.457+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:33 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=520b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3400 con 0x5587eef99c00 2024-09-13T18:31:44.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.461+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 7 ==== osd_op_reply(33 10000000000.00000000 [omap-set-vals] v51'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.468 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.461+0000 7fcfaaf9b500 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x5587ef0a2000 0x5587ef0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.461+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:34 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2800 con 0x5587ef0a2000 2024-09-13T18:31:44.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.461+0000 7fcfa8f54700 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x5587ef0a2000 0x5587ef0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.469 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.461+0000 7fcfa8f54700 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x5587ef0a2000 0x5587ef0ae000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.461+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.5 v2:172.21.15.99:6800/827163121 1 ==== osd_op_reply(34 10000000001.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5587efa26b40 con 0x5587ef0a2000 2024-09-13T18:31:44.470 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.461+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:35 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587efabd800 con 0x5587ef0a2000 2024-09-13T18:31:44.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.465+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.5 v2:172.21.15.99:6800/827163121 2 ==== osd_op_reply(35 10000000001.00000000 [omap-set-header] v51'4 uv4 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5587efa26b40 con 0x5587ef0a2000 2024-09-13T18:31:44.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.465+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:36 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef99400 con 0x5587ef0a2000 2024-09-13T18:31:44.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.465+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.5 v2:172.21.15.99:6800/827163121 3 ==== osd_op_reply(36 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x5587efa26b40 con 0x5587ef0a2000 2024-09-13T18:31:44.473 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.465+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:37 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef99800 con 0x5587efabd000 2024-09-13T18:31:44.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.465+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.2 v2:172.21.15.44:6817/3180763837 10 ==== osd_op_reply(37 1.00000000.inode [read 0~582 out=582b] v0'0 uv35 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x5587efa26b40 con 0x5587efabd000 2024-09-13T18:31:44.474 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.465+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:38 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef99400 con 0x5587efabd000 2024-09-13T18:31:44.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.469+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.2 v2:172.21.15.44:6817/3180763837 11 ==== osd_op_reply(38 1.00000000.inode [writefull 0~582] v51'36 uv36 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x5587efa26b40 con 0x5587efabd000 2024-09-13T18:31:44.477 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.469+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:39 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587efabd800 con 0x5587eef99c00 2024-09-13T18:31:44.478 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.469+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 8 ==== osd_op_reply(39 10000000000.00000000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.478 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.469+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:40 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3800 con 0x5587eef99c00 2024-09-13T18:31:44.480 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.473+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 9 ==== osd_op_reply(40 10000000000.00000000 [omap-set-header] v51'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.473+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:41 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3c00 con 0x5587eef99c00 2024-09-13T18:31:44.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.473+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 10 ==== osd_op_reply(41 10000000000.00000000 [omap-get-vals-by-keys out=520b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+520 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.481 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.473+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:42 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=520b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2800 con 0x5587eef99c00 2024-09-13T18:31:44.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.477+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 11 ==== osd_op_reply(42 10000000000.00000000 [omap-set-vals] v51'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.484 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.477+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:43 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2c00 con 0x5587ef0a2000 2024-09-13T18:31:44.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.477+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.5 v2:172.21.15.99:6800/827163121 4 ==== osd_op_reply(43 10000000001.00000000 [omap-get-header out=274b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5587efa26b40 con 0x5587ef0a2000 2024-09-13T18:31:44.485 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.477+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:44 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3000 con 0x5587ef0a2000 2024-09-13T18:31:44.489 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.481+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.5 v2:172.21.15.99:6800/827163121 5 ==== osd_op_reply(44 10000000001.00000000 [omap-set-header] v51'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5587efa26b40 con 0x5587ef0a2000 2024-09-13T18:31:44.489 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.481+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:45 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3400 con 0x5587ef0a2000 2024-09-13T18:31:44.489 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.481+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.5 v2:172.21.15.99:6800/827163121 6 ==== osd_op_reply(45 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x5587efa26b40 con 0x5587ef0a2000 2024-09-13T18:31:44.490 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.481+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:46 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-vals in=520b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3800 con 0x5587ef0a2000 2024-09-13T18:31:44.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.485+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.5 v2:172.21.15.99:6800/827163121 7 ==== osd_op_reply(46 10000000001.00000000 [omap-set-vals] v51'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5587efa26b40 con 0x5587ef0a2000 2024-09-13T18:31:44.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.485+0000 7fcfaaf9b500 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x5587efabd800 0x5587ef0ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.493 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.485+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- osd_op(unknown.0.0:47 6.12 6:4bec3886:::10000000002.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2c00 con 0x5587efabd800 2024-09-13T18:31:44.494 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.485+0000 7fcfa9f56700 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x5587efabd800 0x5587ef0ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.494 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.485+0000 7fcfa9f56700 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x5587efabd800 0x5587ef0ae580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.485+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.7 v2:172.21.15.99:6824/2245335901 1 ==== osd_op_reply(47 10000000002.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587efabd800 2024-09-13T18:31:44.495 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.485+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- osd_op(unknown.0.0:48 6.12 6:4bec3886:::10000000002.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3000 con 0x5587efabd800 2024-09-13T18:31:44.498 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.489+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.7 v2:172.21.15.99:6824/2245335901 2 ==== osd_op_reply(48 10000000002.00000000 [omap-set-header] v51'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587efabd800 2024-09-13T18:31:44.498 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.489+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- osd_op(unknown.0.0:49 6.12 6:4bec3886:::10000000002.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3400 con 0x5587efabd800 2024-09-13T18:31:44.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.493+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.7 v2:172.21.15.99:6824/2245335901 3 ==== osd_op_reply(49 10000000002.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x5587ef099200 con 0x5587efabd800 2024-09-13T18:31:44.499 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.493+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:50 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3800 con 0x5587eef99c00 2024-09-13T18:31:44.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.493+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 12 ==== osd_op_reply(50 10000000000.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.500 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.493+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:51 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef99800 con 0x5587eef99c00 2024-09-13T18:31:44.503 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.493+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 13 ==== osd_op_reply(51 10000000000.00000000 [omap-set-header] v51'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.503 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.493+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:52 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef99400 con 0x5587eef99c00 2024-09-13T18:31:44.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.497+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 14 ==== osd_op_reply(52 10000000000.00000000 [omap-get-vals-by-keys out=520b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+520 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.504 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.497+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:53 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=520b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2400 con 0x5587eef99c00 2024-09-13T18:31:44.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.497+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 15 ==== osd_op_reply(53 10000000000.00000000 [omap-set-vals] v51'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.507 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.497+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:54 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2c00 con 0x5587ef0a2000 2024-09-13T18:31:44.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.501+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.5 v2:172.21.15.99:6800/827163121 8 ==== osd_op_reply(54 10000000001.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5587efa26b40 con 0x5587ef0a2000 2024-09-13T18:31:44.508 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.501+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:55 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3000 con 0x5587ef0a2000 2024-09-13T18:31:44.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.501+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.5 v2:172.21.15.99:6800/827163121 9 ==== osd_op_reply(55 10000000001.00000000 [omap-set-header] v51'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5587efa26b40 con 0x5587ef0a2000 2024-09-13T18:31:44.511 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.501+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:56 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3400 con 0x5587ef0a2000 2024-09-13T18:31:44.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.505+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.5 v2:172.21.15.99:6800/827163121 10 ==== osd_op_reply(56 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x5587efa26b40 con 0x5587ef0a2000 2024-09-13T18:31:44.512 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.505+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:57 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-vals in=558b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef98c00 con 0x5587ef0a2000 2024-09-13T18:31:44.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.509+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.5 v2:172.21.15.99:6800/827163121 11 ==== osd_op_reply(57 10000000001.00000000 [omap-set-vals] v51'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5587efa26b40 con 0x5587ef0a2000 2024-09-13T18:31:44.515 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.509+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:58 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587efabd400 con 0x5587eef99000 2024-09-13T18:31:44.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.509+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 18 ==== osd_op_reply(58 1.00000000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.516 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.509+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:59 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3c00 con 0x5587eef99000 2024-09-13T18:31:44.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.509+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 19 ==== osd_op_reply(59 1.00000000 [omap-set-header] v51'12 uv12 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.519 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.509+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:60 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2800 con 0x5587eef99000 2024-09-13T18:31:44.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.513+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 20 ==== osd_op_reply(60 1.00000000 [omap-get-vals-by-keys out=525b] v0'0 uv12 ondisk = 0) v8 ==== 154+0+525 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.520 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.513+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:61 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=525b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3800 con 0x5587eef99000 2024-09-13T18:31:44.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.517+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 21 ==== osd_op_reply(61 1.00000000 [omap-set-vals] v51'13 uv13 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.523 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.517+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:62 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2400 con 0x5587eef99c00 2024-09-13T18:31:44.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.517+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 16 ==== osd_op_reply(62 10000000000.00000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.525 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.517+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:63 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef99800 con 0x5587eef99c00 2024-09-13T18:31:44.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.517+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 17 ==== osd_op_reply(63 10000000000.00000000 [omap-set-header] v51'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.527 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.517+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:64 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef99400 con 0x5587eef99c00 2024-09-13T18:31:44.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.521+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 18 ==== osd_op_reply(64 10000000000.00000000 [omap-get-vals-by-keys out=520b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+520 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.528 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.521+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:65 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=520b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0ca000 con 0x5587eef99c00 2024-09-13T18:31:44.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.521+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 19 ==== osd_op_reply(65 10000000000.00000000 [omap-set-vals] v51'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.521+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:66 6.13 6:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0ca400 con 0x5587eef99000 2024-09-13T18:31:44.531 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.525+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 22 ==== osd_op_reply(66 100.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.532 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.525+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:67 6.13 6:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0ca800 con 0x5587eef99000 2024-09-13T18:31:44.534 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.525+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 23 ==== osd_op_reply(67 100.00000000 [omap-set-header] v51'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.525+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:68 6.13 6:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cac00 con 0x5587eef99000 2024-09-13T18:31:44.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.529+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 24 ==== osd_op_reply(68 100.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+523 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.535 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.529+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:69 6.13 6:cd5a64a3:::100.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cb000 con 0x5587eef99000 2024-09-13T18:31:44.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.529+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 25 ==== osd_op_reply(69 100.00000000 [omap-set-vals] v51'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.529+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:70 6.10 6:09401a81:::601.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cb400 con 0x5587eef99c00 2024-09-13T18:31:44.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.529+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 20 ==== osd_op_reply(70 601.00000000 [omap-get-header out=274b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.538 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.529+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:71 6.10 6:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cb800 con 0x5587eef99c00 2024-09-13T18:31:44.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.533+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 21 ==== osd_op_reply(71 601.00000000 [omap-set-header] v51'18 uv18 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.533+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:72 6.10 6:09401a81:::601.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cbc00 con 0x5587eef99c00 2024-09-13T18:31:44.541 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.533+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 22 ==== osd_op_reply(72 601.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv18 ondisk = 0) v8 ==== 156+0+4 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.542 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.533+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:73 6.10 6:09401a81:::601.00000000:head [omap-set-vals in=545b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0ca000 con 0x5587eef99c00 2024-09-13T18:31:44.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.537+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 23 ==== osd_op_reply(73 601.00000000 [omap-set-vals] v51'19 uv19 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.544 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.537+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:74 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cb400 con 0x5587ef0a2000 2024-09-13T18:31:44.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.537+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.5 v2:172.21.15.99:6800/827163121 12 ==== osd_op_reply(74 10000000001.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5587efa26b40 con 0x5587ef0a2000 2024-09-13T18:31:44.545 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.537+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:75 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cb800 con 0x5587ef0a2000 2024-09-13T18:31:44.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.541+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.5 v2:172.21.15.99:6800/827163121 13 ==== osd_op_reply(75 10000000001.00000000 [omap-set-header] v51'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5587efa26b40 con 0x5587ef0a2000 2024-09-13T18:31:44.548 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.541+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:76 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cbc00 con 0x5587ef0a2000 2024-09-13T18:31:44.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.541+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.5 v2:172.21.15.99:6800/827163121 14 ==== osd_op_reply(76 10000000001.00000000 [omap-get-vals-by-keys out=520b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+520 (crc 0 0 0) 0x5587efa26b40 con 0x5587ef0a2000 2024-09-13T18:31:44.549 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.541+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:77 6.7 6:e2e07930:::10000000001.00000000:head [omap-rm-keys in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0ca400 con 0x5587ef0a2000 2024-09-13T18:31:44.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.545+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.5 v2:172.21.15.99:6800/827163121 15 ==== osd_op_reply(77 10000000001.00000000 [omap-rm-keys] v51'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5587efa26b40 con 0x5587ef0a2000 2024-09-13T18:31:44.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.545+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:78 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0ca800 con 0x5587efabd000 2024-09-13T18:31:44.552 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.545+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.2 v2:172.21.15.44:6817/3180763837 12 ==== osd_op_reply(78 1.00000000.inode [read 0~582 out=582b] v0'0 uv36 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x5587efa26b40 con 0x5587efabd000 2024-09-13T18:31:44.553 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.545+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:79 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cac00 con 0x5587efabd000 2024-09-13T18:31:44.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.549+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.2 v2:172.21.15.44:6817/3180763837 13 ==== osd_op_reply(79 1.00000000.inode [writefull 0~582] v51'37 uv37 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x5587efa26b40 con 0x5587efabd000 2024-09-13T18:31:44.555 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.549+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:80 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2400 con 0x5587eef99c00 2024-09-13T18:31:44.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.549+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 24 ==== osd_op_reply(80 10000000000.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.556 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.549+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:81 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3c00 con 0x5587eef99c00 2024-09-13T18:31:44.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.549+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 25 ==== osd_op_reply(81 10000000000.00000000 [omap-set-header] v51'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.549+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:82 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2800 con 0x5587eef99c00 2024-09-13T18:31:44.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.553+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 26 ==== osd_op_reply(82 10000000000.00000000 [omap-get-vals-by-keys out=520b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+520 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.559 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.553+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:83 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=520b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3800 con 0x5587eef99c00 2024-09-13T18:31:44.564 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.557+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 27 ==== osd_op_reply(83 10000000000.00000000 [omap-set-vals] v51'21 uv21 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.557+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:84 6.13 6:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587efabd400 con 0x5587eef99000 2024-09-13T18:31:44.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.557+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 26 ==== osd_op_reply(84 100.00000000 [omap-get-header out=274b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.565 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.557+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:85 6.13 6:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef99800 con 0x5587eef99000 2024-09-13T18:31:44.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.561+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 27 ==== osd_op_reply(85 100.00000000 [omap-set-header] v51'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.561+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:86 6.13 6:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef99400 con 0x5587eef99000 2024-09-13T18:31:44.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.561+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 28 ==== osd_op_reply(86 100.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+523 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.568 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.561+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:87 6.13 6:cd5a64a3:::100.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cb400 con 0x5587eef99000 2024-09-13T18:31:44.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.561+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 29 ==== osd_op_reply(87 100.00000000 [omap-set-vals] v51'6 uv6 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.571 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.565+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:88 6.10 6:09401a81:::601.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cb800 con 0x5587eef99c00 2024-09-13T18:31:44.572 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.565+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 28 ==== osd_op_reply(88 601.00000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.572 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.565+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:89 6.10 6:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cbc00 con 0x5587eef99c00 2024-09-13T18:31:44.575 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.565+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 29 ==== osd_op_reply(89 601.00000000 [omap-set-header] v51'22 uv22 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.575 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.565+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:90 6.10 6:09401a81:::601.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef98c00 con 0x5587eef99c00 2024-09-13T18:31:44.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.569+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 30 ==== osd_op_reply(90 601.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv22 ondisk = 0) v8 ==== 156+0+4 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.576 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.569+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:91 6.10 6:09401a81:::601.00000000:head [omap-set-vals in=583b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2c00 con 0x5587eef99c00 2024-09-13T18:31:44.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.569+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 31 ==== osd_op_reply(91 601.00000000 [omap-set-vals] v51'23 uv23 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.578 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.569+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:92 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3000 con 0x5587ef0a2000 2024-09-13T18:31:44.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.569+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.5 v2:172.21.15.99:6800/827163121 16 ==== osd_op_reply(92 10000000001.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5587efa26b40 con 0x5587ef0a2000 2024-09-13T18:31:44.579 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.569+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:93 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3400 con 0x5587ef0a2000 2024-09-13T18:31:44.582 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.573+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.5 v2:172.21.15.99:6800/827163121 17 ==== osd_op_reply(93 10000000001.00000000 [omap-set-header] v51'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5587efa26b40 con 0x5587ef0a2000 2024-09-13T18:31:44.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.573+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:94 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef98c00 con 0x5587ef0a2000 2024-09-13T18:31:44.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.573+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.5 v2:172.21.15.99:6800/827163121 18 ==== osd_op_reply(94 10000000001.00000000 [omap-get-vals-by-keys out=558b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+558 (crc 0 0 0) 0x5587efa26b40 con 0x5587ef0a2000 2024-09-13T18:31:44.583 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.573+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:95 6.7 6:e2e07930:::10000000001.00000000:head [omap-rm-keys in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0ca000 con 0x5587ef0a2000 2024-09-13T18:31:44.584 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.577+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.5 v2:172.21.15.99:6800/827163121 19 ==== osd_op_reply(95 10000000001.00000000 [omap-rm-keys] v51'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5587efa26b40 con 0x5587ef0a2000 2024-09-13T18:31:44.585 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.577+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:96 6.13 6:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cb800 con 0x5587eef99000 2024-09-13T18:31:44.585 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.577+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 30 ==== osd_op_reply(96 100.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.586 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.577+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:97 6.13 6:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cbc00 con 0x5587eef99000 2024-09-13T18:31:44.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.577+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 31 ==== osd_op_reply(97 100.00000000 [omap-set-header] v51'7 uv7 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.587 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.577+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:98 6.13 6:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2400 con 0x5587eef99000 2024-09-13T18:31:44.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.577+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 32 ==== osd_op_reply(98 100.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+523 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.588 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.581+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:99 6.13 6:cd5a64a3:::100.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3c00 con 0x5587eef99000 2024-09-13T18:31:44.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.581+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 33 ==== osd_op_reply(99 100.00000000 [omap-set-vals] v51'8 uv8 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.590 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.581+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:100 6.10 6:09401a81:::601.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2800 con 0x5587eef99c00 2024-09-13T18:31:44.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.581+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 32 ==== osd_op_reply(100 601.00000000 [omap-get-header out=274b] v0'0 uv23 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.591 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.581+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:101 6.10 6:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3800 con 0x5587eef99c00 2024-09-13T18:31:44.593 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.585+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 33 ==== osd_op_reply(101 601.00000000 [omap-set-header] v51'24 uv24 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.585+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:102 6.10 6:09401a81:::601.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2400 con 0x5587eef99c00 2024-09-13T18:31:44.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.585+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 34 ==== osd_op_reply(102 601.00000000 [omap-get-vals-by-keys out=583b] v0'0 uv24 ondisk = 0) v8 ==== 156+0+583 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.594 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.585+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:103 6.10 6:09401a81:::601.00000000:head [omap-set-vals in=545b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cb000 con 0x5587eef99c00 2024-09-13T18:31:44.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.589+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 35 ==== osd_op_reply(103 601.00000000 [omap-set-vals] v51'25 uv25 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.596 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.589+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:104 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cb400 con 0x5587eef99000 2024-09-13T18:31:44.597 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.589+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 34 ==== osd_op_reply(104 1.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.597 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.589+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:105 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cb800 con 0x5587eef99000 2024-09-13T18:31:44.599 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.589+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 35 ==== osd_op_reply(105 1.00000000 [omap-set-header] v51'14 uv14 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.599 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.589+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:106 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cbc00 con 0x5587eef99000 2024-09-13T18:31:44.600 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.593+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 36 ==== osd_op_reply(106 1.00000000 [omap-get-vals-by-keys out=525b] v0'0 uv14 ondisk = 0) v8 ==== 154+0+525 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.600 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.593+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:107 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=525b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef99800 con 0x5587eef99000 2024-09-13T18:31:44.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.593+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 37 ==== osd_op_reply(107 1.00000000 [omap-set-vals] v51'15 uv15 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.593+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:108 6.13 6:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef99400 con 0x5587eef99000 2024-09-13T18:31:44.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.593+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 38 ==== osd_op_reply(108 100.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.603 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.593+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:109 6.13 6:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587efabd400 con 0x5587eef99000 2024-09-13T18:31:44.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.597+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 39 ==== osd_op_reply(109 100.00000000 [omap-set-header] v51'9 uv9 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.605 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.597+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:110 6.13 6:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0e8000 con 0x5587eef99000 2024-09-13T18:31:44.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.597+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 40 ==== osd_op_reply(110 100.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv9 ondisk = 0) v8 ==== 156+0+523 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.608 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.597+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:111 6.13 6:cd5a64a3:::100.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0e8400 con 0x5587eef99000 2024-09-13T18:31:44.609 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.601+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 41 ==== osd_op_reply(111 100.00000000 [omap-set-vals] v51'10 uv10 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.610 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.601+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:112 6.10 6:09401a81:::601.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0e8800 con 0x5587eef99c00 2024-09-13T18:31:44.610 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.601+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 36 ==== osd_op_reply(112 601.00000000 [omap-get-header out=274b] v0'0 uv25 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.610 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.601+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:113 6.10 6:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0e8c00 con 0x5587eef99c00 2024-09-13T18:31:44.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.605+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 37 ==== osd_op_reply(113 601.00000000 [omap-set-header] v51'26 uv26 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.612 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.605+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:114 6.10 6:09401a81:::601.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0e9000 con 0x5587eef99c00 2024-09-13T18:31:44.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.605+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 38 ==== osd_op_reply(114 601.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv26 ondisk = 0) v8 ==== 156+0+4 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.613 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.605+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:115 6.10 6:09401a81:::601.00000000:head [omap-set-vals in=541b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0e9400 con 0x5587eef99c00 2024-09-13T18:31:44.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.609+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 39 ==== osd_op_reply(115 601.00000000 [omap-set-vals] v51'27 uv27 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.615 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.609+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:116 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0e9800 con 0x5587eef99c00 2024-09-13T18:31:44.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.609+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 40 ==== osd_op_reply(116 10000000000.00000000 [omap-get-header out=274b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.616 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.609+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:117 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0e9c00 con 0x5587eef99c00 2024-09-13T18:31:44.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.609+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 41 ==== osd_op_reply(117 10000000000.00000000 [omap-set-header] v51'28 uv28 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.618 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.609+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:118 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0e8800 con 0x5587eef99c00 2024-09-13T18:31:44.619 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.609+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 42 ==== osd_op_reply(118 10000000000.00000000 [omap-get-vals-by-keys out=520b] v0'0 uv28 ondisk = 0) v8 ==== 164+0+520 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.619 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.609+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:119 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-rm-keys in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0e8c00 con 0x5587eef99c00 2024-09-13T18:31:44.621 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.613+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 43 ==== osd_op_reply(119 10000000000.00000000 [omap-rm-keys] v51'29 uv29 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.613+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:120 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0e9000 con 0x5587eef99000 2024-09-13T18:31:44.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.613+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 42 ==== osd_op_reply(120 1.00000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.622 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.613+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:121 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0e9400 con 0x5587eef99000 2024-09-13T18:31:44.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.617+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 43 ==== osd_op_reply(121 1.00000000 [omap-set-header] v51'16 uv16 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.617+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:122 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0e8000 con 0x5587eef99000 2024-09-13T18:31:44.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.617+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 44 ==== osd_op_reply(122 1.00000000 [omap-get-vals-by-keys out=525b] v0'0 uv16 ondisk = 0) v8 ==== 154+0+525 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.625 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.617+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:123 6.1f 6:ff5b34d6:::1.00000000:head [omap-rm-keys in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0e8400 con 0x5587eef99000 2024-09-13T18:31:44.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.621+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 45 ==== osd_op_reply(123 1.00000000 [omap-rm-keys] v51'17 uv17 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.621+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:124 6.13 6:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587efabd400 con 0x5587eef99000 2024-09-13T18:31:44.628 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.621+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 46 ==== osd_op_reply(124 100.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.629 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.621+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:125 6.13 6:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef99800 con 0x5587eef99000 2024-09-13T18:31:44.631 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.621+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 47 ==== osd_op_reply(125 100.00000000 [omap-set-header] v51'11 uv11 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.631 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.621+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:126 6.13 6:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef99400 con 0x5587eef99000 2024-09-13T18:31:44.632 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.625+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 48 ==== osd_op_reply(126 100.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv11 ondisk = 0) v8 ==== 156+0+523 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.632 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.625+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:127 6.13 6:cd5a64a3:::100.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cb000 con 0x5587eef99000 2024-09-13T18:31:44.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.625+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 49 ==== osd_op_reply(127 100.00000000 [omap-set-vals] v51'12 uv12 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.625+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:128 6.10 6:09401a81:::601.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cb400 con 0x5587eef99c00 2024-09-13T18:31:44.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.629+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 44 ==== osd_op_reply(128 601.00000000 [omap-get-header out=274b] v0'0 uv27 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.635 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.629+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:129 6.10 6:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cb800 con 0x5587eef99c00 2024-09-13T18:31:44.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.629+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 45 ==== osd_op_reply(129 601.00000000 [omap-set-header] v51'30 uv30 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.638 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.629+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:130 6.10 6:09401a81:::601.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cbc00 con 0x5587eef99c00 2024-09-13T18:31:44.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.629+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 46 ==== osd_op_reply(130 601.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv30 ondisk = 0) v8 ==== 156+0+4 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.639 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.629+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:131 6.10 6:09401a81:::601.00000000:head [omap-set-vals in=537b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2c00 con 0x5587eef99c00 2024-09-13T18:31:44.642 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.633+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 47 ==== osd_op_reply(131 601.00000000 [omap-set-vals] v51'31 uv31 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.642 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.633+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:132 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2800 con 0x5587efabd000 2024-09-13T18:31:44.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.633+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.2 v2:172.21.15.44:6817/3180763837 14 ==== osd_op_reply(132 1.00000000.inode [read 0~582 out=582b] v0'0 uv37 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x5587efa26b40 con 0x5587efabd000 2024-09-13T18:31:44.643 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.633+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:133 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3800 con 0x5587efabd000 2024-09-13T18:31:44.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.637+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.2 v2:172.21.15.44:6817/3180763837 15 ==== osd_op_reply(133 1.00000000.inode [writefull 0~582] v51'38 uv38 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x5587efa26b40 con 0x5587efabd000 2024-09-13T18:31:44.645 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.637+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:134 6.10 6:09401a81:::601.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2400 con 0x5587eef99c00 2024-09-13T18:31:44.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.637+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 48 ==== osd_op_reply(134 601.00000000 [omap-get-header out=274b] v0'0 uv31 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.646 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.637+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:135 6.10 6:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3c00 con 0x5587eef99c00 2024-09-13T18:31:44.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.641+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 49 ==== osd_op_reply(135 601.00000000 [omap-set-header] v51'32 uv32 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.648 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.641+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:136 6.10 6:09401a81:::601.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2c00 con 0x5587eef99c00 2024-09-13T18:31:44.649 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.641+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 50 ==== osd_op_reply(136 601.00000000 [omap-get-vals-by-keys out=541b] v0'0 uv32 ondisk = 0) v8 ==== 156+0+541 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.649 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.641+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:137 6.10 6:09401a81:::601.00000000:head [omap-rm-keys in=24b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2400 con 0x5587eef99c00 2024-09-13T18:31:44.652 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.645+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 51 ==== osd_op_reply(137 601.00000000 [omap-rm-keys] v51'33 uv33 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.652 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.645+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:138 6.10 6:09401a81:::601.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3c00 con 0x5587eef99c00 2024-09-13T18:31:44.652 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.645+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 52 ==== osd_op_reply(138 601.00000000 [omap-get-header out=274b] v0'0 uv33 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.652 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.645+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:139 6.10 6:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3000 con 0x5587eef99c00 2024-09-13T18:31:44.655 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.645+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 53 ==== osd_op_reply(139 601.00000000 [omap-set-header] v51'34 uv34 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.655 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.645+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:140 6.10 6:09401a81:::601.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a3400 con 0x5587eef99c00 2024-09-13T18:31:44.656 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.649+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 54 ==== osd_op_reply(140 601.00000000 [omap-get-vals-by-keys out=545b] v0'0 uv34 ondisk = 0) v8 ==== 156+0+545 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.656 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.649+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:141 6.10 6:09401a81:::601.00000000:head [omap-rm-keys in=24b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0a2800 con 0x5587eef99c00 2024-09-13T18:31:44.658 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.649+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 55 ==== osd_op_reply(141 601.00000000 [omap-rm-keys] v51'35 uv35 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.658 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.649+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:142 6.10 6:09401a81:::601.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cb400 con 0x5587eef99c00 2024-09-13T18:31:44.659 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.649+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 56 ==== osd_op_reply(142 601.00000000 [omap-get-header out=274b] v0'0 uv35 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.659 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.649+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:143 6.10 6:09401a81:::601.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cb800 con 0x5587eef99c00 2024-09-13T18:31:44.662 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.653+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 57 ==== osd_op_reply(143 601.00000000 [omap-set-header] v51'36 uv36 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.662 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.653+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:144 6.10 6:09401a81:::601.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cbc00 con 0x5587eef99c00 2024-09-13T18:31:44.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.653+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 58 ==== osd_op_reply(144 601.00000000 [omap-get-vals-by-keys out=545b] v0'0 uv36 ondisk = 0) v8 ==== 156+0+545 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.663 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.653+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:145 6.10 6:09401a81:::601.00000000:head [omap-rm-keys in=24b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0ca400 con 0x5587eef99c00 2024-09-13T18:31:44.665 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.657+0000 7fcfa9755700 1 -- 172.21.15.44:0/1356865742 <== osd.0 v2:172.21.15.44:6800/2647753462 59 ==== osd_op_reply(145 601.00000000 [omap-rm-keys] v51'37 uv37 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5587ef0998c0 con 0x5587eef99c00 2024-09-13T18:31:44.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.657+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:146 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0ca800 con 0x5587eef99000 2024-09-13T18:31:44.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.657+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 50 ==== osd_op_reply(146 1.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.666 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.657+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:147 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0cac00 con 0x5587eef99000 2024-09-13T18:31:44.669 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.661+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 51 ==== osd_op_reply(147 1.00000000 [omap-set-header] v51'18 uv18 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.669 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.661+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:148 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0ca000 con 0x5587eef99000 2024-09-13T18:31:44.669 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.661+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 52 ==== osd_op_reply(148 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv18 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.670 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.661+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:149 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587eef98c00 con 0x5587efabd000 2024-09-13T18:31:44.670 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.661+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.2 v2:172.21.15.44:6817/3180763837 16 ==== osd_op_reply(149 1.00000000.inode [read 0~582 out=582b] v0'0 uv38 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x5587efa26b40 con 0x5587efabd000 2024-09-13T18:31:44.670 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.661+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:150 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0e9800 con 0x5587efabd000 2024-09-13T18:31:44.673 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.665+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 <== osd.2 v2:172.21.15.44:6817/3180763837 17 ==== osd_op_reply(150 1.00000000.inode [writefull 0~582] v51'39 uv39 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x5587efa26b40 con 0x5587efabd000 2024-09-13T18:31:44.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.665+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:151 6.13 6:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0e9c00 con 0x5587eef99000 2024-09-13T18:31:44.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.665+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 53 ==== osd_op_reply(151 mds0_inotable [read 0~34 out=34b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.674 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.665+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:152 6.13 6:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5587ef0e8800 con 0x5587eef99000 2024-09-13T18:31:44.677 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfa9f56700 1 -- 172.21.15.44:0/1356865742 <== osd.3 v2:172.21.15.44:6808/771281770 54 ==== osd_op_reply(152 mds0_inotable [writefull 0~34] v51'13 uv13 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x5587ef099200 con 0x5587eef99000 2024-09-13T18:31:44.677 INFO:tasks.workunit.client.0.smithi044.stdout:Events by type: 2024-09-13T18:31:44.677 INFO:tasks.workunit.client.0.smithi044.stdout: PURGED: 1 2024-09-13T18:31:44.677 INFO:tasks.workunit.client.0.smithi044.stdout: SESSION: 2 2024-09-13T18:31:44.677 INFO:tasks.workunit.client.0.smithi044.stdout: SUBTREEMAP: 1 2024-09-13T18:31:44.678 INFO:tasks.workunit.client.0.smithi044.stdout: UPDATE: 15 2024-09-13T18:31:44.678 INFO:tasks.workunit.client.0.smithi044.stdout:Errors: 0 2024-09-13T18:31:44.679 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x5587eef99c00 msgr2=0x5587eecd9600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x5587eef99c00 0x5587eecd9600 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5587efabd000 msgr2=0x5587eecda100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5587efabd000 0x5587eecda100 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5587eef99000 msgr2=0x5587eecd9b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5587eef99000 0x5587eecd9b80 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x5587ef0a2000 msgr2=0x5587ef0ae000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x5587ef0a2000 0x5587ef0ae000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x5587efabd800 msgr2=0x5587ef0ae580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x5587efabd800 0x5587ef0ae580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 reap_dead start 2024-09-13T18:31:44.680 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 reap_dead start 2024-09-13T18:31:44.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfa8f54700 1 -- 172.21.15.44:0/1356865742 reap_dead start 2024-09-13T18:31:44.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5587eef98800 msgr2=0x5587eecdb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5587eef98800 0x5587eecdb700 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x5587eec89740 tx=0x5587eed098c0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5587efabc800 msgr2=0x5587eecdac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5587efabc800 0x5587eecdac00 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x5587efa20840 tx=0x5587eef36c00 comp rx=0 tx=0).stop 2024-09-13T18:31:44.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 shutdown_connections 2024-09-13T18:31:44.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5587eef98800 0x5587eecdb700 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 --2- 172.21.15.44:0/1356865742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5587efabc800 0x5587eecdac00 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 >> 172.21.15.44:0/1356865742 conn(0x5587eec32c00 msgr2=0x5587eecef800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 shutdown_connections 2024-09-13T18:31:44.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1356865742 wait complete. 2024-09-13T18:31:44.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1063260696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5587eec33800 msgr2=0x5587eecd8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 --2- 172.21.15.44:0/1063260696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5587eec33800 0x5587eecd8580 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x5587eed07380 tx=0x5587ef9a2120 comp rx=0 tx=0).stop 2024-09-13T18:31:44.681 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1063260696 shutdown_connections 2024-09-13T18:31:44.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 --2- 172.21.15.44:0/1063260696 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5587eec33000 0x5587eecd9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 --2- 172.21.15.44:0/1063260696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587eec33400 0x5587eecd8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 --2- 172.21.15.44:0/1063260696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5587eec33800 0x5587eecd8580 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1063260696 >> 172.21.15.44:0/1063260696 conn(0x5587eec33c00 msgr2=0x5587eecef000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1063260696 shutdown_connections 2024-09-13T18:31:44.682 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.669+0000 7fcfaaf9b500 1 -- 172.21.15.44:0/1063260696 wait complete. 2024-09-13T18:31:44.684 INFO:tasks.workunit.client.0.smithi044.stderr:+ cephfs-journal-tool --rank=cephfs:0 event splice summary 2024-09-13T18:31:44.725 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.717+0000 7f4f6148b500 1 -- start start 2024-09-13T18:31:44.726 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.717+0000 7f4f6148b500 1 Processor -- start 2024-09-13T18:31:44.728 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f6148b500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a8065800 0x5573a810a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.728 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f6148b500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5573a8065400 0x5573a810ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.728 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f6148b500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5573a8065000 0x5573a810b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.728 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f6148b500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a80e6a00 con 0x5573a8065000 2024-09-13T18:31:44.728 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f6148b500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a80e6780 con 0x5573a8065800 2024-09-13T18:31:44.728 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f6148b500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5573a80e6640 con 0x5573a8065400 2024-09-13T18:31:44.728 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f60446700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5573a8065000 0x5573a810b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.728 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f60446700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5573a8065000 0x5573a810b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60396/0 (socket says 172.21.15.44:60396) 2024-09-13T18:31:44.728 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f60446700 1 -- 172.21.15.44:0/3406697185 learned_addr learned my addr 172.21.15.44:0/3406697185 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.728 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f5f444700 1 --2- 172.21.15.44:0/3406697185 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5573a8065400 0x5573a810ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.728 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f5fc45700 1 --2- 172.21.15.44:0/3406697185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a8065800 0x5573a810a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f60446700 1 -- 172.21.15.44:0/3406697185 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5573a8065400 msgr2=0x5573a810ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f60446700 1 --2- 172.21.15.44:0/3406697185 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5573a8065400 0x5573a810ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f60446700 1 -- 172.21.15.44:0/3406697185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a8065800 msgr2=0x5573a810a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f60446700 1 --2- 172.21.15.44:0/3406697185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a8065800 0x5573a810a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f60446700 1 -- 172.21.15.44:0/3406697185 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573a80889c0 con 0x5573a8065000 2024-09-13T18:31:44.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f60446700 1 --2- 172.21.15.44:0/3406697185 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5573a8065000 0x5573a810b080 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x5573a8139350 tx=0x5573a8ee4120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c68c7f994b8e0c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f5d440700 1 -- 172.21.15.44:0/3406697185 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5573a80b5600 con 0x5573a8065000 2024-09-13T18:31:44.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f5d440700 1 -- 172.21.15.44:0/3406697185 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5573a80b0900 con 0x5573a8065000 2024-09-13T18:31:44.730 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f5d440700 1 -- 172.21.15.44:0/3406697185 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5573a80b51e0 con 0x5573a8065000 2024-09-13T18:31:44.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f6148b500 1 -- 172.21.15.44:0/3406697185 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5573a8088b60 con 0x5573a8065000 2024-09-13T18:31:44.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f6148b500 1 -- 172.21.15.44:0/3406697185 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5573a8088340 con 0x5573a8065000 2024-09-13T18:31:44.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f5d440700 1 -- 172.21.15.44:0/3406697185 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x5573a809ec40 con 0x5573a8065000 2024-09-13T18:31:44.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.721+0000 7f4f5d440700 1 -- 172.21.15.44:0/3406697185 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x5573a8e4c300 con 0x5573a8065000 2024-09-13T18:31:44.731 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.725+0000 7f4f6148b500 1 Processor -- start 2024-09-13T18:31:44.732 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.725+0000 7f4f6148b500 1 -- start start 2024-09-13T18:31:44.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.725+0000 7f4f6148b500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5573a8eee400 0x5573a810b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.725+0000 7f4f6148b500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a8eee800 0x5573a810bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.725+0000 7f4f6148b500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5573a8eeec00 0x5573a810c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.725+0000 7f4f6148b500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a809be00 con 0x5573a8eee400 2024-09-13T18:31:44.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.725+0000 7f4f6148b500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a80e6780 con 0x5573a8eee800 2024-09-13T18:31:44.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.725+0000 7f4f6148b500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5573a80e6500 con 0x5573a8eeec00 2024-09-13T18:31:44.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.725+0000 7f4f5f444700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5573a8eee400 0x5573a810b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.725+0000 7f4f5f444700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5573a8eee400 0x5573a810b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60406/0 (socket says 172.21.15.44:60406) 2024-09-13T18:31:44.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.725+0000 7f4f5f444700 1 -- 172.21.15.44:0/1725718851 learned_addr learned my addr 172.21.15.44:0/1725718851 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.725+0000 7f4f5fc45700 1 --2- 172.21.15.44:0/1725718851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a8eee800 0x5573a810bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.725+0000 7f4f5f444700 1 --2- 172.21.15.44:0/1725718851 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5573a8eeec00 0x5573a810c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.735 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.725+0000 7f4f5f444700 1 -- 172.21.15.44:0/1725718851 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5573a8eeec00 msgr2=0x5573a810c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.725+0000 7f4f5f444700 1 --2- 172.21.15.44:0/1725718851 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5573a8eeec00 0x5573a810c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.725+0000 7f4f5f444700 1 -- 172.21.15.44:0/1725718851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a8eee800 msgr2=0x5573a810bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.725+0000 7f4f5f444700 1 --2- 172.21.15.44:0/1725718851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a8eee800 0x5573a810bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.725+0000 7f4f5f444700 1 -- 172.21.15.44:0/1725718851 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573a8088000 con 0x5573a8eee400 2024-09-13T18:31:44.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.725+0000 7f4f5fc45700 1 --2- 172.21.15.44:0/1725718851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a8eee800 0x5573a810bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:44.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.725+0000 7f4f5f444700 1 --2- 172.21.15.44:0/1725718851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5573a8eee400 0x5573a810b600 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x5573a8ee8810 tx=0x5573a812bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bf88dcfa6810b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.725+0000 7f4f5b43c700 1 -- 172.21.15.44:0/1725718851 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5573a80b5080 con 0x5573a8eee400 2024-09-13T18:31:44.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.725+0000 7f4f5b43c700 1 -- 172.21.15.44:0/1725718851 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5573a8e4e900 con 0x5573a8eee400 2024-09-13T18:31:44.736 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.725+0000 7f4f5b43c700 1 -- 172.21.15.44:0/1725718851 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5573a80b5600 con 0x5573a8eee400 2024-09-13T18:31:44.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f6148b500 1 -- 172.21.15.44:0/1725718851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5573a8eee400 msgr2=0x5573a810b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f6148b500 1 --2- 172.21.15.44:0/1725718851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5573a8eee400 0x5573a810b600 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x5573a8ee8810 tx=0x5573a812bec0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f6148b500 1 -- 172.21.15.44:0/1725718851 shutdown_connections 2024-09-13T18:31:44.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f6148b500 1 --2- 172.21.15.44:0/1725718851 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5573a8eeec00 0x5573a810c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f6148b500 1 --2- 172.21.15.44:0/1725718851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a8eee800 0x5573a810bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f6148b500 1 --2- 172.21.15.44:0/1725718851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5573a8eee400 0x5573a810b600 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f6148b500 1 -- 172.21.15.44:0/1725718851 >> 172.21.15.44:0/1725718851 conn(0x5573a8064c00 msgr2=0x5573a8121800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f6148b500 1 -- 172.21.15.44:0/1725718851 shutdown_connections 2024-09-13T18:31:44.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f6148b500 1 -- 172.21.15.44:0/1725718851 wait complete. 2024-09-13T18:31:44.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f6148b500 1 Processor -- start 2024-09-13T18:31:44.738 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f6148b500 1 -- start start 2024-09-13T18:31:44.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f6148b500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a8eee400 0x5573a810d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f6148b500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5573a8eee800 0x5573a810cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f6148b500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5573a8eeec00 0x5573a810c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f6148b500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a80e63c0 con 0x5573a8eeec00 2024-09-13T18:31:44.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f6148b500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a80e6280 con 0x5573a8eee400 2024-09-13T18:31:44.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f6148b500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5573a80e6140 con 0x5573a8eee800 2024-09-13T18:31:44.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f5f444700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5573a8eeec00 0x5573a810c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f5f444700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5573a8eeec00 0x5573a810c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60422/0 (socket says 172.21.15.44:60422) 2024-09-13T18:31:44.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 learned_addr learned my addr 172.21.15.44:0/2574985733 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f5fc45700 1 --2- 172.21.15.44:0/2574985733 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5573a8eee800 0x5573a810cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.739 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f5f444700 1 --2- 172.21.15.44:0/2574985733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a8eee400 0x5573a810d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5573a8eee800 msgr2=0x5573a810cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.740 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f5f444700 1 --2- 172.21.15.44:0/2574985733 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5573a8eee800 0x5573a810cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a8eee400 msgr2=0x5573a810d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f5f444700 1 --2- 172.21.15.44:0/2574985733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a8eee400 0x5573a810d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573a80881a0 con 0x5573a8eeec00 2024-09-13T18:31:44.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f5f444700 1 --2- 172.21.15.44:0/2574985733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5573a8eeec00 0x5573a810c680 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x5573a8ee94d0 tx=0x5573a813a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f59c39700 1 -- 172.21.15.44:0/2574985733 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5573a80b51e0 con 0x5573a8eeec00 2024-09-13T18:31:44.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f59c39700 1 -- 172.21.15.44:0/2574985733 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5573a80b0480 con 0x5573a8eeec00 2024-09-13T18:31:44.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5573a8088000 con 0x5573a8eeec00 2024-09-13T18:31:44.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f59c39700 1 -- 172.21.15.44:0/2574985733 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5573a80b4dc0 con 0x5573a8eeec00 2024-09-13T18:31:44.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.729+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5573a80889c0 con 0x5573a8eeec00 2024-09-13T18:31:44.741 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.733+0000 7f4f59c39700 1 -- 172.21.15.44:0/2574985733 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x5573a80c4840 con 0x5573a8eeec00 2024-09-13T18:31:44.742 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.733+0000 7f4f59c39700 1 --2- 172.21.15.44:0/2574985733 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5573a83b6400 0x5573a810d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.733+0000 7f4f59c39700 1 -- 172.21.15.44:0/2574985733 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x5573a809ea80 con 0x5573a8eeec00 2024-09-13T18:31:44.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.733+0000 7f4f6148b500 1 --2- 172.21.15.44:0/2574985733 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5573a8eef000 0x5573a810c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.733+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5573a8eef400 con 0x5573a8eef000 2024-09-13T18:31:44.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.733+0000 7f4f5fc45700 1 --2- 172.21.15.44:0/2574985733 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5573a83b6400 0x5573a810d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.733+0000 7f4f5f444700 1 --2- 172.21.15.44:0/2574985733 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5573a8eef000 0x5573a810c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.743 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.737+0000 7f4f5f444700 1 --2- 172.21.15.44:0/2574985733 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5573a8eef000 0x5573a810c100 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.737+0000 7f4f5fc45700 1 --2- 172.21.15.44:0/2574985733 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5573a83b6400 0x5573a810d700 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x5573a8138810 tx=0x5573a8365c80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.737+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x5573a8e44b40 con 0x5573a8eef000 2024-09-13T18:31:44.744 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.737+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5573a8eef800 con 0x5573a8eef000 2024-09-13T18:31:44.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.737+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv30 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x5573a8e44b40 con 0x5573a8eef000 2024-09-13T18:31:44.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.737+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5573a83b6800 con 0x5573a8eef000 2024-09-13T18:31:44.745 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.737+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 <== osd.2 v2:172.21.15.44:6817/3180763837 3 ==== osd_op_reply(3 200.00000001 [read 0~31930 out=31930b] v0'0 uv32 ondisk = 0) v8 ==== 156+0+31930 (crc 0 0 0) 0x5573a8e44b40 con 0x5573a8eef000 2024-09-13T18:31:44.746 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.737+0000 7f4f6148b500 1 --2- 172.21.15.44:0/2574985733 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5573a83b6c00 0x5573a810bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.746 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.737+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x5573a83b7000 con 0x5573a83b6c00 2024-09-13T18:31:44.746 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.737+0000 7f4f60446700 1 --2- 172.21.15.44:0/2574985733 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5573a83b6c00 0x5573a810bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.746 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.737+0000 7f4f60446700 1 --2- 172.21.15.44:0/2574985733 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5573a83b6c00 0x5573a810bb80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.747 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.737+0000 7f4f60446700 1 -- 172.21.15.44:0/2574985733 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5573a84db200 con 0x5573a83b6c00 2024-09-13T18:31:44.747 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.737+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:5 6.14 6:2e2fa760:::200.00000001:head [write 0~892 in=892b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5573a83b7400 con 0x5573a8eef000 2024-09-13T18:31:44.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.741+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 <== osd.2 v2:172.21.15.44:6817/3180763837 4 ==== osd_op_reply(5 200.00000001 [write 0~892] v51'40 uv40 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5573a8e44b40 con 0x5573a8eef000 2024-09-13T18:31:44.750 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.741+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:6 6.14 6:2e2fa760:::200.00000001:head [write 892~442 in=442b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5573a83b7800 con 0x5573a8eef000 2024-09-13T18:31:44.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.745+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 <== osd.2 v2:172.21.15.44:6817/3180763837 5 ==== osd_op_reply(6 200.00000001 [write 892~442] v51'41 uv41 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5573a8e44b40 con 0x5573a8eef000 2024-09-13T18:31:44.753 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.745+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:7 6.14 6:2e2fa760:::200.00000001:head [write 1334~815 in=815b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5573a83b7c00 con 0x5573a8eef000 2024-09-13T18:31:44.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.749+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 <== osd.2 v2:172.21.15.44:6817/3180763837 6 ==== osd_op_reply(7 200.00000001 [write 1334~815] v51'42 uv42 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5573a8e44b40 con 0x5573a8eef000 2024-09-13T18:31:44.756 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.749+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:8 6.14 6:2e2fa760:::200.00000001:head [write 2149~2016 in=2016b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5573a83b6800 con 0x5573a8eef000 2024-09-13T18:31:44.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.749+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 <== osd.2 v2:172.21.15.44:6817/3180763837 7 ==== osd_op_reply(8 200.00000001 [write 2149~2016] v51'43 uv43 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5573a8e44b40 con 0x5573a8eef000 2024-09-13T18:31:44.759 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.753+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:9 6.14 6:2e2fa760:::200.00000001:head [write 4165~1669 in=1669b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5573a8eef400 con 0x5573a8eef000 2024-09-13T18:31:44.762 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.753+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 <== osd.2 v2:172.21.15.44:6817/3180763837 8 ==== osd_op_reply(9 200.00000001 [write 4165~1669] v51'44 uv44 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5573a8e44b40 con 0x5573a8eef000 2024-09-13T18:31:44.762 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.753+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:10 6.14 6:2e2fa760:::200.00000001:head [write 5834~2846 in=2846b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5573a8eef800 con 0x5573a8eef000 2024-09-13T18:31:44.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.757+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 <== osd.2 v2:172.21.15.44:6817/3180763837 9 ==== osd_op_reply(10 200.00000001 [write 5834~2846] v51'45 uv45 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5573a8e44b40 con 0x5573a8eef000 2024-09-13T18:31:44.765 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.757+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:11 6.14 6:2e2fa760:::200.00000001:head [write 8680~2256 in=2256b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5573a83b7400 con 0x5573a8eef000 2024-09-13T18:31:44.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.761+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 <== osd.2 v2:172.21.15.44:6817/3180763837 10 ==== osd_op_reply(11 200.00000001 [write 8680~2256] v51'46 uv46 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5573a8e44b40 con 0x5573a8eef000 2024-09-13T18:31:44.768 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.761+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:12 6.14 6:2e2fa760:::200.00000001:head [write 10936~1954 in=1954b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5573a83b7800 con 0x5573a8eef000 2024-09-13T18:31:44.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.765+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 <== osd.2 v2:172.21.15.44:6817/3180763837 11 ==== osd_op_reply(12 200.00000001 [write 10936~1954] v51'47 uv47 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5573a8e44b40 con 0x5573a8eef000 2024-09-13T18:31:44.772 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.765+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:13 6.14 6:2e2fa760:::200.00000001:head [write 12890~4611 in=4611b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5573a83b7c00 con 0x5573a8eef000 2024-09-13T18:31:44.775 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.765+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 <== osd.2 v2:172.21.15.44:6817/3180763837 12 ==== osd_op_reply(13 200.00000001 [write 12890~4611] v51'48 uv48 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5573a8e44b40 con 0x5573a8eef000 2024-09-13T18:31:44.775 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.765+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:14 6.14 6:2e2fa760:::200.00000001:head [write 17501~3209 in=3209b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5573a83b6800 con 0x5573a8eef000 2024-09-13T18:31:44.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.769+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 <== osd.2 v2:172.21.15.44:6817/3180763837 13 ==== osd_op_reply(14 200.00000001 [write 17501~3209] v51'49 uv49 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5573a8e44b40 con 0x5573a8eef000 2024-09-13T18:31:44.778 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.769+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:15 6.14 6:2e2fa760:::200.00000001:head [write 20710~1949 in=1949b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5573a83b7400 con 0x5573a8eef000 2024-09-13T18:31:44.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.773+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 <== osd.2 v2:172.21.15.44:6817/3180763837 14 ==== osd_op_reply(15 200.00000001 [write 20710~1949] v51'50 uv50 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5573a8e44b40 con 0x5573a8eef000 2024-09-13T18:31:44.781 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.773+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:16 6.14 6:2e2fa760:::200.00000001:head [write 22659~3176 in=3176b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5573a83b7800 con 0x5573a8eef000 2024-09-13T18:31:44.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.777+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 <== osd.2 v2:172.21.15.44:6817/3180763837 15 ==== osd_op_reply(16 200.00000001 [write 22659~3176] v51'51 uv51 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5573a8e44b40 con 0x5573a8eef000 2024-09-13T18:31:44.785 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.777+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:17 6.14 6:2e2fa760:::200.00000001:head [write 25835~2911 in=2911b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5573a83b7c00 con 0x5573a8eef000 2024-09-13T18:31:44.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.781+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 <== osd.2 v2:172.21.15.44:6817/3180763837 16 ==== osd_op_reply(17 200.00000001 [write 25835~2911] v51'52 uv52 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5573a8e44b40 con 0x5573a8eef000 2024-09-13T18:31:44.790 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.781+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:18 6.14 6:2e2fa760:::200.00000001:head [write 28746~599 in=599b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5573a8eef400 con 0x5573a8eef000 2024-09-13T18:31:44.793 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.785+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 <== osd.2 v2:172.21.15.44:6817/3180763837 17 ==== osd_op_reply(18 200.00000001 [write 28746~599] v51'53 uv53 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5573a8e44b40 con 0x5573a8eef000 2024-09-13T18:31:44.793 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.785+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:19 6.14 6:2e2fa760:::200.00000001:head [write 29345~599 in=599b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5573a8eef800 con 0x5573a8eef000 2024-09-13T18:31:44.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.789+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 <== osd.2 v2:172.21.15.44:6817/3180763837 18 ==== osd_op_reply(19 200.00000001 [write 29345~599] v51'54 uv54 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5573a8e44b40 con 0x5573a8eef000 2024-09-13T18:31:44.797 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.789+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:20 6.14 6:2e2fa760:::200.00000001:head [write 29944~599 in=599b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5573a8eef400 con 0x5573a8eef000 2024-09-13T18:31:44.800 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.793+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 <== osd.2 v2:172.21.15.44:6817/3180763837 19 ==== osd_op_reply(20 200.00000001 [write 29944~599] v51'55 uv55 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5573a8e44b40 con 0x5573a8eef000 2024-09-13T18:31:44.800 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.793+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:21 6.14 6:2e2fa760:::200.00000001:head [write 30543~1138 in=1138b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5573a8eef800 con 0x5573a8eef000 2024-09-13T18:31:44.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.797+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 <== osd.2 v2:172.21.15.44:6817/3180763837 20 ==== osd_op_reply(21 200.00000001 [write 30543~1138] v51'56 uv56 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5573a8e44b40 con 0x5573a8eef000 2024-09-13T18:31:44.803 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.797+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:22 6.14 6:2e2fa760:::200.00000001:head [write 31681~173 in=173b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5573a83b6800 con 0x5573a8eef000 2024-09-13T18:31:44.806 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.797+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 <== osd.2 v2:172.21.15.44:6817/3180763837 21 ==== osd_op_reply(22 200.00000001 [write 31681~173] v51'57 uv57 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5573a8e44b40 con 0x5573a8eef000 2024-09-13T18:31:44.807 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.797+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:23 6.14 6:2e2fa760:::200.00000001:head [write 31854~76 in=76b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5573a83b7400 con 0x5573a8eef000 2024-09-13T18:31:44.810 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.801+0000 7f4f5f444700 1 -- 172.21.15.44:0/2574985733 <== osd.2 v2:172.21.15.44:6817/3180763837 22 ==== osd_op_reply(23 200.00000001 [write 31854~76] v51'58 uv58 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5573a8e44b40 con 0x5573a8eef000 2024-09-13T18:31:44.810 INFO:tasks.workunit.client.0.smithi044.stdout:Events by type: 2024-09-13T18:31:44.810 INFO:tasks.workunit.client.0.smithi044.stdout: PURGED: 1 2024-09-13T18:31:44.810 INFO:tasks.workunit.client.0.smithi044.stdout: SESSION: 2 2024-09-13T18:31:44.810 INFO:tasks.workunit.client.0.smithi044.stdout: SUBTREEMAP: 1 2024-09-13T18:31:44.810 INFO:tasks.workunit.client.0.smithi044.stdout: UPDATE: 15 2024-09-13T18:31:44.811 INFO:tasks.workunit.client.0.smithi044.stdout:Errors: 0 2024-09-13T18:31:44.812 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.801+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5573a8eef000 msgr2=0x5573a810c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.812 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.801+0000 7f4f6148b500 1 --2- 172.21.15.44:0/2574985733 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x5573a8eef000 0x5573a810c100 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.812 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.801+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5573a83b6c00 msgr2=0x5573a810bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.812 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.801+0000 7f4f6148b500 1 --2- 172.21.15.44:0/2574985733 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5573a83b6c00 0x5573a810bb80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.812 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.801+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5573a83b6400 msgr2=0x5573a810d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.813 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.801+0000 7f4f6148b500 1 --2- 172.21.15.44:0/2574985733 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5573a83b6400 0x5573a810d700 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x5573a8138810 tx=0x5573a8365c80 comp rx=0 tx=0).stop 2024-09-13T18:31:44.813 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.801+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5573a8eeec00 msgr2=0x5573a810c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.813 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.801+0000 7f4f6148b500 1 --2- 172.21.15.44:0/2574985733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5573a8eeec00 0x5573a810c680 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x5573a8ee94d0 tx=0x5573a813a120 comp rx=0 tx=0).stop 2024-09-13T18:31:44.813 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.801+0000 7f4f5fc45700 1 -- 172.21.15.44:0/2574985733 reap_dead start 2024-09-13T18:31:44.813 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.801+0000 7f4f5fc45700 1 -- 172.21.15.44:0/2574985733 reap_dead start 2024-09-13T18:31:44.813 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.801+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 shutdown_connections 2024-09-13T18:31:44.813 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.801+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 >> 172.21.15.44:0/2574985733 conn(0x5573a8064c00 msgr2=0x5573a8121800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.813 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.801+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 shutdown_connections 2024-09-13T18:31:44.813 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.801+0000 7f4f6148b500 1 -- 172.21.15.44:0/2574985733 wait complete. 2024-09-13T18:31:44.813 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.805+0000 7f4f6148b500 1 -- 172.21.15.44:0/3406697185 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5573a8065000 msgr2=0x5573a810b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.813 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.805+0000 7f4f6148b500 1 --2- 172.21.15.44:0/3406697185 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5573a8065000 0x5573a810b080 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x5573a8139350 tx=0x5573a8ee4120 comp rx=0 tx=0).stop 2024-09-13T18:31:44.813 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.805+0000 7f4f6148b500 1 -- 172.21.15.44:0/3406697185 shutdown_connections 2024-09-13T18:31:44.813 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.805+0000 7f4f6148b500 1 --2- 172.21.15.44:0/3406697185 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5573a8065000 0x5573a810b080 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.814 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.805+0000 7f4f6148b500 1 --2- 172.21.15.44:0/3406697185 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5573a8065400 0x5573a810ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.814 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.805+0000 7f4f6148b500 1 --2- 172.21.15.44:0/3406697185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a8065800 0x5573a810a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.814 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.805+0000 7f4f6148b500 1 -- 172.21.15.44:0/3406697185 >> 172.21.15.44:0/3406697185 conn(0x5573a8065c00 msgr2=0x5573a8121000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.814 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.805+0000 7f4f6148b500 1 -- 172.21.15.44:0/3406697185 shutdown_connections 2024-09-13T18:31:44.814 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.805+0000 7f4f6148b500 1 -- 172.21.15.44:0/3406697185 wait complete. 2024-09-13T18:31:44.817 INFO:tasks.workunit.client.0.smithi044.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal reset --yes-i-really-really-mean-it 2024-09-13T18:31:44.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.849+0000 7f3ab3b97500 1 -- start start 2024-09-13T18:31:44.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.849+0000 7f3ab3b97500 1 Processor -- start 2024-09-13T18:31:44.857 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.849+0000 7f3ab3b97500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559dd1dfb800 0x559dd1ea0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.849+0000 7f3ab3b97500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd1dfb400 0x559dd1ea0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.849+0000 7f3ab3b97500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559dd1dfb000 0x559dd1ea1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.849+0000 7f3ab3b97500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd1e7c780 con 0x559dd1dfb400 2024-09-13T18:31:44.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.849+0000 7f3ab3b97500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd1e7ca00 con 0x559dd1dfb800 2024-09-13T18:31:44.858 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.849+0000 7f3ab3b97500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x559dd1e7c640 con 0x559dd1dfb000 2024-09-13T18:31:44.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.849+0000 7f3ab1b50700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd1dfb400 0x559dd1ea0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.849+0000 7f3ab1b50700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd1dfb400 0x559dd1ea0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60438/0 (socket says 172.21.15.44:60438) 2024-09-13T18:31:44.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.849+0000 7f3ab1b50700 1 -- 172.21.15.44:0/1195338310 learned_addr learned my addr 172.21.15.44:0/1195338310 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.849+0000 7f3ab2351700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559dd1dfb800 0x559dd1ea0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.859 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.849+0000 7f3ab2b52700 1 --2- 172.21.15.44:0/1195338310 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559dd1dfb000 0x559dd1ea1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.849+0000 7f3ab1b50700 1 -- 172.21.15.44:0/1195338310 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559dd1dfb000 msgr2=0x559dd1ea1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.849+0000 7f3ab1b50700 1 --2- 172.21.15.44:0/1195338310 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559dd1dfb000 0x559dd1ea1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.849+0000 7f3ab1b50700 1 -- 172.21.15.44:0/1195338310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559dd1dfb800 msgr2=0x559dd1ea0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.849+0000 7f3ab1b50700 1 --2- 172.21.15.44:0/1195338310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559dd1dfb800 0x559dd1ea0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.849+0000 7f3ab1b50700 1 -- 172.21.15.44:0/1195338310 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559dd1e1e9c0 con 0x559dd1dfb400 2024-09-13T18:31:44.860 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.853+0000 7f3ab1b50700 1 --2- 172.21.15.44:0/1195338310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd1dfb400 0x559dd1ea0b00 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x559dd1ecf2c0 tx=0x559dd1ed18c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7987966f832e4fa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.853+0000 7f3aafb4c700 1 -- 172.21.15.44:0/1195338310 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559dd1e4b080 con 0x559dd1dfb400 2024-09-13T18:31:44.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.853+0000 7f3aafb4c700 1 -- 172.21.15.44:0/1195338310 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559dd2be4480 con 0x559dd1dfb400 2024-09-13T18:31:44.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.853+0000 7f3ab3b97500 1 -- 172.21.15.44:0/1195338310 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559dd1e1e1a0 con 0x559dd1dfb400 2024-09-13T18:31:44.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.853+0000 7f3ab3b97500 1 -- 172.21.15.44:0/1195338310 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x559dd1e1e9c0 con 0x559dd1dfb400 2024-09-13T18:31:44.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.853+0000 7f3aafb4c700 1 -- 172.21.15.44:0/1195338310 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559dd1e4b600 con 0x559dd1dfb400 2024-09-13T18:31:44.861 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.853+0000 7f3aafb4c700 1 -- 172.21.15.44:0/1195338310 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x559dd1e34c40 con 0x559dd1dfb400 2024-09-13T18:31:44.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.853+0000 7f3aafb4c700 1 -- 172.21.15.44:0/1195338310 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x559dd1e3cf00 con 0x559dd1dfb400 2024-09-13T18:31:44.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.853+0000 7f3ab3b97500 1 Processor -- start 2024-09-13T18:31:44.862 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.853+0000 7f3ab3b97500 1 -- start start 2024-09-13T18:31:44.864 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.857+0000 7f3ab3b97500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd2c84400 0x559dd1ea1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.857+0000 7f3ab3b97500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559dd2c84800 0x559dd1ea1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.857+0000 7f3ab3b97500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559dd2c84c00 0x559dd1ea2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.857+0000 7f3ab3b97500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd1e31e00 con 0x559dd2c84400 2024-09-13T18:31:44.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.857+0000 7f3ab3b97500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd1e7ca00 con 0x559dd2c84c00 2024-09-13T18:31:44.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.857+0000 7f3ab3b97500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x559dd1e7c780 con 0x559dd2c84800 2024-09-13T18:31:44.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.857+0000 7f3ab2b52700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd2c84400 0x559dd1ea1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.857+0000 7f3ab2b52700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd2c84400 0x559dd1ea1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60454/0 (socket says 172.21.15.44:60454) 2024-09-13T18:31:44.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.857+0000 7f3ab2b52700 1 -- 172.21.15.44:0/2799380842 learned_addr learned my addr 172.21.15.44:0/2799380842 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.857+0000 7f3ab2351700 1 --2- 172.21.15.44:0/2799380842 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559dd2c84800 0x559dd1ea1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.865 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.857+0000 7f3ab1b50700 1 --2- 172.21.15.44:0/2799380842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559dd2c84c00 0x559dd1ea2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.857+0000 7f3ab2b52700 1 -- 172.21.15.44:0/2799380842 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559dd2c84800 msgr2=0x559dd1ea1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.866 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.857+0000 7f3ab2b52700 1 --2- 172.21.15.44:0/2799380842 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559dd2c84800 0x559dd1ea1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.857+0000 7f3ab2b52700 1 -- 172.21.15.44:0/2799380842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559dd2c84c00 msgr2=0x559dd1ea2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.857+0000 7f3ab2b52700 1 --2- 172.21.15.44:0/2799380842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559dd2c84c00 0x559dd1ea2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.857+0000 7f3ab2b52700 1 -- 172.21.15.44:0/2799380842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559dd1e1eb60 con 0x559dd2c84400 2024-09-13T18:31:44.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.857+0000 7f3ab1b50700 1 --2- 172.21.15.44:0/2799380842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559dd2c84c00 0x559dd1ea2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:44.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.857+0000 7f3ab2b52700 1 --2- 172.21.15.44:0/2799380842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd2c84400 0x559dd1ea1600 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x559dd20f2900 tx=0x559dd215a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae09ee86e3f0c7bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.857+0000 7f3aadb48700 1 -- 172.21.15.44:0/2799380842 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559dd1e4b080 con 0x559dd2c84400 2024-09-13T18:31:44.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.857+0000 7f3aadb48700 1 -- 172.21.15.44:0/2799380842 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559dd1e46480 con 0x559dd2c84400 2024-09-13T18:31:44.867 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.857+0000 7f3aadb48700 1 -- 172.21.15.44:0/2799380842 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559dd1e4b600 con 0x559dd2c84400 2024-09-13T18:31:44.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.861+0000 7f3ab3b97500 1 -- 172.21.15.44:0/2799380842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd2c84400 msgr2=0x559dd1ea1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.861+0000 7f3ab3b97500 1 --2- 172.21.15.44:0/2799380842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd2c84400 0x559dd1ea1600 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x559dd20f2900 tx=0x559dd215a000 comp rx=0 tx=0).stop 2024-09-13T18:31:44.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.861+0000 7f3ab3b97500 1 -- 172.21.15.44:0/2799380842 shutdown_connections 2024-09-13T18:31:44.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.861+0000 7f3ab3b97500 1 --2- 172.21.15.44:0/2799380842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559dd2c84c00 0x559dd1ea2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.861+0000 7f3ab3b97500 1 --2- 172.21.15.44:0/2799380842 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559dd2c84800 0x559dd1ea1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.861+0000 7f3ab3b97500 1 --2- 172.21.15.44:0/2799380842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd2c84400 0x559dd1ea1600 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.861+0000 7f3ab3b97500 1 -- 172.21.15.44:0/2799380842 >> 172.21.15.44:0/2799380842 conn(0x559dd1dfac00 msgr2=0x559dd1eb7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.868 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.861+0000 7f3ab3b97500 1 -- 172.21.15.44:0/2799380842 shutdown_connections 2024-09-13T18:31:44.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.861+0000 7f3ab3b97500 1 -- 172.21.15.44:0/2799380842 wait complete. 2024-09-13T18:31:44.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.861+0000 7f3ab3b97500 1 Processor -- start 2024-09-13T18:31:44.869 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.861+0000 7f3ab3b97500 1 -- start start 2024-09-13T18:31:44.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.861+0000 7f3ab3b97500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559dd2c84400 0x559dd1ea3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.861+0000 7f3ab3b97500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559dd2c84800 0x559dd1ea2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.861+0000 7f3ab3b97500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd2c84c00 0x559dd1ea2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.871 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.861+0000 7f3ab3b97500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd1e7c500 con 0x559dd2c84c00 2024-09-13T18:31:44.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.861+0000 7f3ab3b97500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd1e7c3c0 con 0x559dd2c84400 2024-09-13T18:31:44.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.861+0000 7f3ab3b97500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x559dd1e7c280 con 0x559dd2c84800 2024-09-13T18:31:44.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.861+0000 7f3ab2b52700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559dd2c84400 0x559dd1ea3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.861+0000 7f3ab2351700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559dd2c84800 0x559dd1ea2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.861+0000 7f3ab1b50700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd2c84c00 0x559dd1ea2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.861+0000 7f3ab2b52700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559dd2c84400 0x559dd1ea3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:48022/0 (socket says 172.21.15.44:48022) 2024-09-13T18:31:44.872 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.865+0000 7f3ab2b52700 1 -- 172.21.15.44:0/1191429859 learned_addr learned my addr 172.21.15.44:0/1191429859 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.865+0000 7f3ab1b50700 1 -- 172.21.15.44:0/1191429859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559dd2c84800 msgr2=0x559dd1ea2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.865+0000 7f3ab1b50700 1 --2- 172.21.15.44:0/1191429859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559dd2c84800 0x559dd1ea2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.865+0000 7f3ab1b50700 1 -- 172.21.15.44:0/1191429859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559dd2c84400 msgr2=0x559dd1ea3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.865+0000 7f3ab1b50700 1 --2- 172.21.15.44:0/1191429859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559dd2c84400 0x559dd1ea3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.865+0000 7f3ab1b50700 1 -- 172.21.15.44:0/1191429859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559dd1e1e340 con 0x559dd2c84c00 2024-09-13T18:31:44.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.865+0000 7f3ab2b52700 1 --2- 172.21.15.44:0/1191429859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559dd2c84400 0x559dd1ea3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:44.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.865+0000 7f3ab2351700 1 --2- 172.21.15.44:0/1191429859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559dd2c84800 0x559dd1ea2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:44.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.865+0000 7f3ab1b50700 1 --2- 172.21.15.44:0/1191429859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd2c84c00 0x559dd1ea2680 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x559dd20f20f0 tx=0x559dd1ed00c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.865+0000 7f3aac345700 1 -- 172.21.15.44:0/1191429859 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559dd1e4b1e0 con 0x559dd2c84c00 2024-09-13T18:31:44.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.865+0000 7f3aac345700 1 -- 172.21.15.44:0/1191429859 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559dd2be4f00 con 0x559dd2c84c00 2024-09-13T18:31:44.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.865+0000 7f3ab3b97500 1 -- 172.21.15.44:0/1191429859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559dd1e1e000 con 0x559dd2c84c00 2024-09-13T18:31:44.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.865+0000 7f3aac345700 1 -- 172.21.15.44:0/1191429859 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559dd1e4af20 con 0x559dd2c84c00 2024-09-13T18:31:44.874 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.865+0000 7f3ab3b97500 1 -- 172.21.15.44:0/1191429859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559dd1e1eea0 con 0x559dd2c84c00 2024-09-13T18:31:44.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.865+0000 7f3aac345700 1 -- 172.21.15.44:0/1191429859 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x559dd1e5a840 con 0x559dd2c84c00 2024-09-13T18:31:44.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.865+0000 7f3aac345700 1 --2- 172.21.15.44:0/1191429859 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559dd2168800 0x559dd1ea3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.865+0000 7f3aac345700 1 -- 172.21.15.44:0/1191429859 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x559dd1e34a80 con 0x559dd2c84c00 2024-09-13T18:31:44.875 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.865+0000 7f3ab2b52700 1 --2- 172.21.15.44:0/1191429859 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559dd2168800 0x559dd1ea3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.869+0000 7f3ab2b52700 1 --2- 172.21.15.44:0/1191429859 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559dd2168800 0x559dd1ea3700 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x559dd1ecef00 tx=0x559dd2c7a0c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.869+0000 7f3ab3b97500 1 -- start start 2024-09-13T18:31:44.876 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.869+0000 7f3ab3b97500 1 Processor -- start 2024-09-13T18:31:44.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.869+0000 7f3ab3b97500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd2c85400 0x559dd1ea2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.869+0000 7f3ab3b97500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559dd2c85800 0x559dd1ea1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.869+0000 7f3ab3b97500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559dd216a400 0x559dd1ea1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.869+0000 7f3ab3b97500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd1e7ca00 con 0x559dd2c85400 2024-09-13T18:31:44.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.869+0000 7f3ab3b97500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd1e7c140 con 0x559dd216a400 2024-09-13T18:31:44.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.869+0000 7f3ab3b97500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x559dd1e7c000 con 0x559dd2c85800 2024-09-13T18:31:44.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.869+0000 7f3ab2b52700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd2c85400 0x559dd1ea2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.879 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.869+0000 7f3ab2b52700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd2c85400 0x559dd1ea2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60476/0 (socket says 172.21.15.44:60476) 2024-09-13T18:31:44.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.869+0000 7f3ab2b52700 1 -- 172.21.15.44:0/4185115084 learned_addr learned my addr 172.21.15.44:0/4185115084 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.869+0000 7f3ab2351700 1 --2- 172.21.15.44:0/4185115084 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559dd2c85800 0x559dd1ea1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.880 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.869+0000 7f3ab1b50700 1 --2- 172.21.15.44:0/4185115084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559dd216a400 0x559dd1ea1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3ab2b52700 1 -- 172.21.15.44:0/4185115084 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559dd2c85800 msgr2=0x559dd1ea1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3ab2b52700 1 --2- 172.21.15.44:0/4185115084 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559dd2c85800 0x559dd1ea1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3ab2b52700 1 -- 172.21.15.44:0/4185115084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559dd216a400 msgr2=0x559dd1ea1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3ab2b52700 1 --2- 172.21.15.44:0/4185115084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559dd216a400 0x559dd1ea1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3ab2b52700 1 -- 172.21.15.44:0/4185115084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559dd219d520 con 0x559dd2c85400 2024-09-13T18:31:44.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3ab2b52700 1 --2- 172.21.15.44:0/4185115084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd2c85400 0x559dd1ea2100 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x559dd2209530 tx=0x559dd2c7a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758f46c14ca13944 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3aa933f700 1 -- 172.21.15.44:0/4185115084 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559dd1e4adc0 con 0x559dd2c85400 2024-09-13T18:31:44.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3aa933f700 1 -- 172.21.15.44:0/4185115084 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559dd1e46180 con 0x559dd2c85400 2024-09-13T18:31:44.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3aa933f700 1 -- 172.21.15.44:0/4185115084 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559dd1e4b600 con 0x559dd2c85400 2024-09-13T18:31:44.882 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3ab3b97500 1 -- 172.21.15.44:0/4185115084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559dd219b860 con 0x559dd2c85400 2024-09-13T18:31:44.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3ab3b97500 1 -- 172.21.15.44:0/4185115084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x559dd219b6c0 con 0x559dd2c85400 2024-09-13T18:31:44.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3aa933f700 1 -- 172.21.15.44:0/4185115084 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x559dd1e34700 con 0x559dd2c85400 2024-09-13T18:31:44.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3aa933f700 1 -- 172.21.15.44:0/4185115084 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x559dd22a8300 con 0x559dd2c85400 2024-09-13T18:31:44.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3ab3b97500 1 --2- 172.21.15.44:0/4185115084 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x559dd216a800 0x559dd22be000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3ab3b97500 1 -- 172.21.15.44:0/4185115084 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x559dd2168c00 con 0x559dd216a800 2024-09-13T18:31:44.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3ab2351700 1 --2- 172.21.15.44:0/4185115084 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x559dd216a800 0x559dd22be000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3ab2351700 1 --2- 172.21.15.44:0/4185115084 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x559dd216a800 0x559dd22be000 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=9b18255c301b8cdf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3ab2351700 1 -- 172.21.15.44:0/4185115084 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x559dd2be2b40 con 0x559dd216a800 2024-09-13T18:31:44.883 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3ab3b97500 1 -- 172.21.15.44:0/4185115084 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v8 -- 0x559dd2169000 con 0x559dd216a800 2024-09-13T18:31:44.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3ab2351700 1 -- 172.21.15.44:0/4185115084 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv30 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x559dd2be2b40 con 0x559dd216a800 2024-09-13T18:31:44.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3aa7b3c700 1 -- 172.21.15.44:0/4185115084 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e51) v8 -- 0x559dd216b400 con 0x559dd216a800 2024-09-13T18:31:44.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3aa7b3c700 1 --2- 172.21.15.44:0/4185115084 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x559dd216b800 0x559dd22c0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.884 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3aa7b3c700 1 -- 172.21.15.44:0/4185115084 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e51) v8 -- 0x559dd216bc00 con 0x559dd216b800 2024-09-13T18:31:44.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.873+0000 7f3ab1b50700 1 --2- 172.21.15.44:0/4185115084 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x559dd216b800 0x559dd22c0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.877+0000 7f3ab2351700 1 -- 172.21.15.44:0/4185115084 <== osd.2 v2:172.21.15.44:6817/3180763837 3 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv58 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x559dd2be2b40 con 0x559dd216a800 2024-09-13T18:31:44.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.877+0000 7f3ab1b50700 1 --2- 172.21.15.44:0/4185115084 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x559dd216b800 0x559dd22c0680 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=659707fda6c0b83a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.885 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.877+0000 7f3ab1b50700 1 -- 172.21.15.44:0/4185115084 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x559dd2be2d80 con 0x559dd216b800 2024-09-13T18:31:44.885 INFO:tasks.workunit.client.0.smithi044.stdout:old journal was 4194304~31930 2024-09-13T18:31:44.885 INFO:tasks.workunit.client.0.smithi044.stdout:new journal start will be 8388608 (4162374 bytes past old end) 2024-09-13T18:31:44.885 INFO:tasks.workunit.client.0.smithi044.stdout:writing journal head 2024-09-13T18:31:44.886 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.877+0000 7f3ab3b97500 1 -- 172.21.15.44:0/4185115084 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- osd_op(unknown.0.0:5 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x559dd2169400 con 0x559dd216a800 2024-09-13T18:31:44.887 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.877+0000 7f3ab2351700 1 -- 172.21.15.44:0/4185115084 <== osd.2 v2:172.21.15.44:6817/3180763837 4 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v51'59 uv59 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x559dd2be2b40 con 0x559dd216a800 2024-09-13T18:31:44.887 INFO:tasks.workunit.client.0.smithi044.stdout:writing EResetJournal entry 2024-09-13T18:31:44.888 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.881+0000 7f3ab3b97500 1 -- 172.21.15.44:0/4185115084 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:6 6.1b 6:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x559dd2169800 con 0x559dd216b800 2024-09-13T18:31:44.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.881+0000 7f3ab3b97500 1 -- 172.21.15.44:0/4185115084 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:7 6.b 6:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x559dd2169c00 con 0x559dd216b800 2024-09-13T18:31:44.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.881+0000 7f3ab3b97500 1 -- 172.21.15.44:0/4185115084 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:8 6.1f 6:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x559dd216b400 con 0x559dd216b800 2024-09-13T18:31:44.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.881+0000 7f3ab3b97500 1 --2- 172.21.15.44:0/4185115084 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x559dd2168c00 0x559dd22be580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.881+0000 7f3ab3b97500 1 -- 172.21.15.44:0/4185115084 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:9 6.1a 6:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x559dd2169000 con 0x559dd2168c00 2024-09-13T18:31:44.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.881+0000 7f3ab3b97500 1 -- 172.21.15.44:0/4185115084 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:10 6.1e 6:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x559dd216bc00 con 0x559dd2168c00 2024-09-13T18:31:44.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.881+0000 7f3ab3b97500 1 --2- 172.21.15.44:0/4185115084 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x559dd216b400 0x559dd22beb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.881+0000 7f3ab3b97500 1 -- 172.21.15.44:0/4185115084 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:11 6.1d 6:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x559dd2169800 con 0x559dd216b400 2024-09-13T18:31:44.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.881+0000 7f3ab2351700 1 --2- 172.21.15.44:0/4185115084 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x559dd216b400 0x559dd22beb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.889 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.881+0000 7f3ab2b52700 1 --2- 172.21.15.44:0/4185115084 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x559dd2168c00 0x559dd22be580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.890 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.881+0000 7f3ab2351700 1 --2- 172.21.15.44:0/4185115084 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x559dd216b400 0x559dd22beb00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=5d64d85a99de81b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.890 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.881+0000 7f3ab2b52700 1 --2- 172.21.15.44:0/4185115084 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x559dd2168c00 0x559dd22be580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=58eed2cbeae8b4ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.890 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.881+0000 7f3ab1b50700 1 -- 172.21.15.44:0/4185115084 <== osd.3 v2:172.21.15.44:6808/771281770 2 ==== osd_op_reply(8 200.00000004 [delete] v51'19 uv18 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x559dd2be2d80 con 0x559dd216b800 2024-09-13T18:31:44.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.881+0000 7f3ab1b50700 1 -- 172.21.15.44:0/4185115084 <== osd.3 v2:172.21.15.44:6808/771281770 3 ==== osd_op_reply(6 200.00000002 [delete] v51'7 uv5 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x559dd2be2d80 con 0x559dd216b800 2024-09-13T18:31:44.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.881+0000 7f3ab1b50700 1 -- 172.21.15.44:0/4185115084 <== osd.3 v2:172.21.15.44:6808/771281770 4 ==== osd_op_reply(7 200.00000003 [delete] v51'5 uv1 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x559dd2be2d80 con 0x559dd216b800 2024-09-13T18:31:44.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.881+0000 7f3aa7b3c700 1 -- 172.21.15.44:0/4185115084 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:12 6.1b 6:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x559dd22d6000 con 0x559dd216b800 2024-09-13T18:31:44.891 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab2351700 1 -- 172.21.15.44:0/4185115084 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== osd_op_reply(11 200.00000007 [delete] v51'5 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x559dd2be2b40 con 0x559dd216b400 2024-09-13T18:31:44.892 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab2b52700 1 -- 172.21.15.44:0/4185115084 <== osd.4 v2:172.21.15.99:6816/2515272044 1 ==== osd_op_reply(10 200.00000006 [delete] v51'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x559dd2be38c0 con 0x559dd2168c00 2024-09-13T18:31:44.892 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab2b52700 1 -- 172.21.15.44:0/4185115084 <== osd.4 v2:172.21.15.99:6816/2515272044 2 ==== osd_op_reply(9 200.00000005 [delete] v51'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x559dd2be38c0 con 0x559dd2168c00 2024-09-13T18:31:44.893 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab1b50700 1 -- 172.21.15.44:0/4185115084 <== osd.3 v2:172.21.15.44:6808/771281770 5 ==== osd_op_reply(12 200.00000002 [write 0~48] v51'8 uv8 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x559dd2be2d80 con 0x559dd216b800 2024-09-13T18:31:44.894 INFO:tasks.workunit.client.0.smithi044.stdout:done 2024-09-13T18:31:44.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 -- 172.21.15.44:0/4185115084 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x559dd216b400 msgr2=0x559dd22beb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 --2- 172.21.15.44:0/4185115084 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x559dd216b400 0x559dd22beb00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 -- 172.21.15.44:0/4185115084 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x559dd216a800 msgr2=0x559dd22be000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 --2- 172.21.15.44:0/4185115084 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x559dd216a800 0x559dd22be000 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 -- 172.21.15.44:0/4185115084 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x559dd216b800 msgr2=0x559dd22c0680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 --2- 172.21.15.44:0/4185115084 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x559dd216b800 0x559dd22c0680 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 -- 172.21.15.44:0/4185115084 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x559dd2168c00 msgr2=0x559dd22be580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 --2- 172.21.15.44:0/4185115084 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x559dd2168c00 0x559dd22be580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.895 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab2351700 1 -- 172.21.15.44:0/4185115084 reap_dead start 2024-09-13T18:31:44.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 -- 172.21.15.44:0/4185115084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd2c85400 msgr2=0x559dd1ea2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 --2- 172.21.15.44:0/4185115084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd2c85400 0x559dd1ea2100 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x559dd2209530 tx=0x559dd2c7a060 comp rx=0 tx=0).stop 2024-09-13T18:31:44.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 -- 172.21.15.44:0/4185115084 shutdown_connections 2024-09-13T18:31:44.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 --2- 172.21.15.44:0/4185115084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd2c85400 0x559dd1ea2100 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 -- 172.21.15.44:0/4185115084 >> 172.21.15.44:0/4185115084 conn(0x559dd2c85000 msgr2=0x559dd1eb8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 -- 172.21.15.44:0/4185115084 shutdown_connections 2024-09-13T18:31:44.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 -- 172.21.15.44:0/4185115084 wait complete. 2024-09-13T18:31:44.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 -- 172.21.15.44:0/1191429859 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559dd2168800 msgr2=0x559dd1ea3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 --2- 172.21.15.44:0/1191429859 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559dd2168800 0x559dd1ea3700 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x559dd1ecef00 tx=0x559dd2c7a0c0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 -- 172.21.15.44:0/1191429859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd2c84c00 msgr2=0x559dd1ea2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 --2- 172.21.15.44:0/1191429859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd2c84c00 0x559dd1ea2680 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x559dd20f20f0 tx=0x559dd1ed00c0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 -- 172.21.15.44:0/1191429859 shutdown_connections 2024-09-13T18:31:44.896 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 --2- 172.21.15.44:0/1191429859 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559dd2168800 0x559dd1ea3700 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 --2- 172.21.15.44:0/1191429859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd2c84c00 0x559dd1ea2680 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 --2- 172.21.15.44:0/1191429859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559dd2c84800 0x559dd1ea2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 --2- 172.21.15.44:0/1191429859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559dd2c84400 0x559dd1ea3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 -- 172.21.15.44:0/1191429859 >> 172.21.15.44:0/1191429859 conn(0x559dd1dfac00 msgr2=0x559dd1eb7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 -- 172.21.15.44:0/1191429859 shutdown_connections 2024-09-13T18:31:44.897 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.885+0000 7f3ab3b97500 1 -- 172.21.15.44:0/1191429859 wait complete. 2024-09-13T18:31:44.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.889+0000 7f3ab3b97500 1 -- 172.21.15.44:0/1195338310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd1dfb400 msgr2=0x559dd1ea0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.889+0000 7f3ab3b97500 1 --2- 172.21.15.44:0/1195338310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd1dfb400 0x559dd1ea0b00 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x559dd1ecf2c0 tx=0x559dd1ed18c0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.889+0000 7f3ab3b97500 1 -- 172.21.15.44:0/1195338310 shutdown_connections 2024-09-13T18:31:44.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.889+0000 7f3ab3b97500 1 --2- 172.21.15.44:0/1195338310 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559dd1dfb000 0x559dd1ea1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.889+0000 7f3ab3b97500 1 --2- 172.21.15.44:0/1195338310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559dd1dfb400 0x559dd1ea0b00 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.889+0000 7f3ab3b97500 1 --2- 172.21.15.44:0/1195338310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559dd1dfb800 0x559dd1ea0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.889+0000 7f3ab3b97500 1 -- 172.21.15.44:0/1195338310 >> 172.21.15.44:0/1195338310 conn(0x559dd1dfbc00 msgr2=0x559dd1eb7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.889+0000 7f3ab3b97500 1 -- 172.21.15.44:0/1195338310 shutdown_connections 2024-09-13T18:31:44.898 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.889+0000 7f3ab3b97500 1 -- 172.21.15.44:0/1195338310 wait complete. 2024-09-13T18:31:44.900 INFO:tasks.workunit.client.0.smithi044.stderr:+ cephfs-table-tool all reset session 2024-09-13T18:31:44.940 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.933+0000 7fe31d275500 1 -- start start 2024-09-13T18:31:44.940 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.933+0000 7fe31d275500 1 Processor -- start 2024-09-13T18:31:44.942 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.933+0000 7fe31d275500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5646cbd1d000 0x5646cbdc2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.942 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.933+0000 7fe31d275500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5646cbd1d400 0x5646cbdc2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.943 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.933+0000 7fe31d275500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5646cbd1d800 0x5646cbdc3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.943 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.933+0000 7fe31d275500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646cbd9ea00 con 0x5646cbd1d000 2024-09-13T18:31:44.943 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.933+0000 7fe31d275500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646cbd9e780 con 0x5646cbd1d400 2024-09-13T18:31:44.943 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.933+0000 7fe31d275500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5646cbd9e640 con 0x5646cbd1d800 2024-09-13T18:31:44.943 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.933+0000 7fe31ba2f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5646cbd1d000 0x5646cbdc2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.943 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.933+0000 7fe31ba2f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5646cbd1d000 0x5646cbdc2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60490/0 (socket says 172.21.15.44:60490) 2024-09-13T18:31:44.943 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.933+0000 7fe31c230700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5646cbd1d800 0x5646cbdc3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.943 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.933+0000 7fe31ba2f700 1 -- 172.21.15.44:0/3769295788 learned_addr learned my addr 172.21.15.44:0/3769295788 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.943 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.933+0000 7fe31b22e700 1 --2- 172.21.15.44:0/3769295788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5646cbd1d400 0x5646cbdc2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.944 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.933+0000 7fe31ba2f700 1 -- 172.21.15.44:0/3769295788 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5646cbd1d800 msgr2=0x5646cbdc3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.933+0000 7fe31ba2f700 1 --2- 172.21.15.44:0/3769295788 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5646cbd1d800 0x5646cbdc3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.933+0000 7fe31ba2f700 1 -- 172.21.15.44:0/3769295788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5646cbd1d400 msgr2=0x5646cbdc2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.933+0000 7fe31ba2f700 1 --2- 172.21.15.44:0/3769295788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5646cbd1d400 0x5646cbdc2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.933+0000 7fe31ba2f700 1 -- 172.21.15.44:0/3769295788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646cbd409c0 con 0x5646cbd1d000 2024-09-13T18:31:44.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.937+0000 7fe31ba2f700 1 --2- 172.21.15.44:0/3769295788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5646cbd1d000 0x5646cbdc2580 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x5646cca88ea0 tx=0x5646cca8a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ea6c542b35a7c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.937+0000 7fe31922a700 1 -- 172.21.15.44:0/3769295788 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5646cbd6d600 con 0x5646cbd1d000 2024-09-13T18:31:44.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.937+0000 7fe31922a700 1 -- 172.21.15.44:0/3769295788 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5646cbd68180 con 0x5646cbd1d000 2024-09-13T18:31:44.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.937+0000 7fe31922a700 1 -- 172.21.15.44:0/3769295788 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5646cbd6d1e0 con 0x5646cbd1d000 2024-09-13T18:31:44.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.937+0000 7fe31d275500 1 -- 172.21.15.44:0/3769295788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5646cbd40b60 con 0x5646cbd1d000 2024-09-13T18:31:44.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.937+0000 7fe31d275500 1 -- 172.21.15.44:0/3769295788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5646cbd40340 con 0x5646cbd1d000 2024-09-13T18:31:44.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.937+0000 7fe31922a700 1 -- 172.21.15.44:0/3769295788 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x5646cbd56c40 con 0x5646cbd1d000 2024-09-13T18:31:44.945 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.937+0000 7fe31922a700 1 -- 172.21.15.44:0/3769295788 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) v1 ==== 3118+0+0 (secure 0 0 0) 0x5646cc00c900 con 0x5646cbd1d000 2024-09-13T18:31:44.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.937+0000 7fe31d275500 1 Processor -- start 2024-09-13T18:31:44.946 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.937+0000 7fe31d275500 1 -- start start 2024-09-13T18:31:44.947 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.937+0000 7fe31d275500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5646cc06a400 0x5646cbdc3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.937+0000 7fe31d275500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5646cc06a800 0x5646cbdc3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.937+0000 7fe31d275500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5646cc06ac00 0x5646cbdc4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.937+0000 7fe31d275500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646cbd53e00 con 0x5646cc06ac00 2024-09-13T18:31:44.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.937+0000 7fe31d275500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646cbd9e780 con 0x5646cc06a400 2024-09-13T18:31:44.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.937+0000 7fe31d275500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5646cbd9e500 con 0x5646cc06a800 2024-09-13T18:31:44.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.937+0000 7fe31b22e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5646cc06ac00 0x5646cbdc4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.937+0000 7fe31c230700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5646cc06a400 0x5646cbdc3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.937+0000 7fe31b22e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5646cc06ac00 0x5646cbdc4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60502/0 (socket says 172.21.15.44:60502) 2024-09-13T18:31:44.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.937+0000 7fe31b22e700 1 -- 172.21.15.44:0/537808299 learned_addr learned my addr 172.21.15.44:0/537808299 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.937+0000 7fe31ba2f700 1 --2- 172.21.15.44:0/537808299 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5646cc06a800 0x5646cbdc3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31b22e700 1 -- 172.21.15.44:0/537808299 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5646cc06a800 msgr2=0x5646cbdc3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.948 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31b22e700 1 --2- 172.21.15.44:0/537808299 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5646cc06a800 0x5646cbdc3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31b22e700 1 -- 172.21.15.44:0/537808299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5646cc06a400 msgr2=0x5646cbdc3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31b22e700 1 --2- 172.21.15.44:0/537808299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5646cc06a400 0x5646cbdc3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31b22e700 1 -- 172.21.15.44:0/537808299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646cbd40000 con 0x5646cc06ac00 2024-09-13T18:31:44.949 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31b22e700 1 --2- 172.21.15.44:0/537808299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5646cc06ac00 0x5646cbdc4100 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x5646cc074270 tx=0x5646cc022c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119e9891bfeb23ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe317226700 1 -- 172.21.15.44:0/537808299 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5646cbd6d600 con 0x5646cc06ac00 2024-09-13T18:31:44.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe317226700 1 -- 172.21.15.44:0/537808299 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5646ccb13080 con 0x5646cc06ac00 2024-09-13T18:31:44.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe317226700 1 -- 172.21.15.44:0/537808299 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5646cbd6d1e0 con 0x5646cc06ac00 2024-09-13T18:31:44.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31d275500 1 -- 172.21.15.44:0/537808299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5646cc06ac00 msgr2=0x5646cbdc4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31d275500 1 --2- 172.21.15.44:0/537808299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5646cc06ac00 0x5646cbdc4100 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x5646cc074270 tx=0x5646cc022c00 comp rx=0 tx=0).stop 2024-09-13T18:31:44.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31d275500 1 -- 172.21.15.44:0/537808299 shutdown_connections 2024-09-13T18:31:44.950 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31d275500 1 --2- 172.21.15.44:0/537808299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5646cc06ac00 0x5646cbdc4100 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.951 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31d275500 1 --2- 172.21.15.44:0/537808299 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5646cc06a800 0x5646cbdc3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.951 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31d275500 1 --2- 172.21.15.44:0/537808299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5646cc06a400 0x5646cbdc3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.951 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31d275500 1 -- 172.21.15.44:0/537808299 >> 172.21.15.44:0/537808299 conn(0x5646cc06a000 msgr2=0x5646cbdd9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.951 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31d275500 1 -- 172.21.15.44:0/537808299 shutdown_connections 2024-09-13T18:31:44.951 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31d275500 1 -- 172.21.15.44:0/537808299 wait complete. 2024-09-13T18:31:44.951 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31d275500 1 Processor -- start 2024-09-13T18:31:44.951 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31d275500 1 -- start start 2024-09-13T18:31:44.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31d275500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5646cc06a400 0x5646cbdc5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31d275500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5646cc06a800 0x5646cbdc4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31d275500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5646cc06ac00 0x5646cbdc4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31d275500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646cbd9e3c0 con 0x5646cc06a400 2024-09-13T18:31:44.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31d275500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646cbd9e280 con 0x5646cc06a800 2024-09-13T18:31:44.953 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31d275500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5646cbd9e140 con 0x5646cc06ac00 2024-09-13T18:31:44.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31c230700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5646cc06a400 0x5646cbdc5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31c230700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5646cc06a400 0x5646cbdc5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60516/0 (socket says 172.21.15.44:60516) 2024-09-13T18:31:44.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31c230700 1 -- 172.21.15.44:0/2720928692 learned_addr learned my addr 172.21.15.44:0/2720928692 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:44.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31ba2f700 1 --2- 172.21.15.44:0/2720928692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5646cc06a800 0x5646cbdc4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.941+0000 7fe31b22e700 1 --2- 172.21.15.44:0/2720928692 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5646cc06ac00 0x5646cbdc4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.945+0000 7fe31c230700 1 -- 172.21.15.44:0/2720928692 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5646cc06ac00 msgr2=0x5646cbdc4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.945+0000 7fe31c230700 1 --2- 172.21.15.44:0/2720928692 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5646cc06ac00 0x5646cbdc4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.945+0000 7fe31c230700 1 -- 172.21.15.44:0/2720928692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5646cc06a800 msgr2=0x5646cbdc4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.945+0000 7fe31c230700 1 --2- 172.21.15.44:0/2720928692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5646cc06a800 0x5646cbdc4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.945+0000 7fe31c230700 1 -- 172.21.15.44:0/2720928692 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646cbd409c0 con 0x5646cc06a400 2024-09-13T18:31:44.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.945+0000 7fe31ba2f700 1 --2- 172.21.15.44:0/2720928692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5646cc06a800 0x5646cbdc4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:44.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.945+0000 7fe31c230700 1 --2- 172.21.15.44:0/2720928692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5646cc06a400 0x5646cbdc5180 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x5646cc075500 tx=0x5646cca8a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.954 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.945+0000 7fe315a23700 1 -- 172.21.15.44:0/2720928692 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5646cbd6d080 con 0x5646cc06a400 2024-09-13T18:31:44.955 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.945+0000 7fe315a23700 1 -- 172.21.15.44:0/2720928692 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5646ccb12300 con 0x5646cc06a400 2024-09-13T18:31:44.955 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.945+0000 7fe31d275500 1 -- 172.21.15.44:0/2720928692 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5646cbd40b60 con 0x5646cc06a400 2024-09-13T18:31:44.955 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.945+0000 7fe315a23700 1 -- 172.21.15.44:0/2720928692 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5646cbd6d600 con 0x5646cc06a400 2024-09-13T18:31:44.955 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.945+0000 7fe31d275500 1 -- 172.21.15.44:0/2720928692 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5646cbd40ea0 con 0x5646cc06a400 2024-09-13T18:31:44.956 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.945+0000 7fe315a23700 1 -- 172.21.15.44:0/2720928692 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x5646cbd7c840 con 0x5646cc06a400 2024-09-13T18:31:44.956 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.949+0000 7fe315a23700 1 --2- 172.21.15.44:0/2720928692 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5646cc06b800 0x5646cbdc5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.956 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.949+0000 7fe315a23700 1 -- 172.21.15.44:0/2720928692 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x5646cbd56a80 con 0x5646cc06a400 2024-09-13T18:31:44.956 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.949+0000 7fe31d275500 1 --2- 172.21.15.44:0/2720928692 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5646cc06bc00 0x5646cbdc4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.956 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.949+0000 7fe31d275500 1 -- 172.21.15.44:0/2720928692 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:1 6.b 6:d0630e4c:::mds0_sessionmap:head [omap-clear,omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v8 -- 0x5646cc178000 con 0x5646cc06bc00 2024-09-13T18:31:44.956 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.949+0000 7fe31ba2f700 1 --2- 172.21.15.44:0/2720928692 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5646cc06b800 0x5646cbdc5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.956 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.949+0000 7fe31b22e700 1 --2- 172.21.15.44:0/2720928692 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5646cc06bc00 0x5646cbdc4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.957 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.949+0000 7fe31b22e700 1 --2- 172.21.15.44:0/2720928692 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5646cc06bc00 0x5646cbdc4100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.957 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.949+0000 7fe31ba2f700 1 --2- 172.21.15.44:0/2720928692 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5646cc06b800 0x5646cbdc5700 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x5646cc074030 tx=0x5646cca8a3c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.960 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.953+0000 7fe31b22e700 1 -- 172.21.15.44:0/2720928692 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(1 mds0_sessionmap [omap-clear,omap-set-header] v51'6 uv6 ondisk = 0) v8 ==== 201+0+0 (crc 0 0 0) 0x5646ccb10b40 con 0x5646cc06bc00 2024-09-13T18:31:44.960 INFO:tasks.workunit.client.0.smithi044.stdout:{ 2024-09-13T18:31:44.960 INFO:tasks.workunit.client.0.smithi044.stdout: "0": { 2024-09-13T18:31:44.960 INFO:tasks.workunit.client.0.smithi044.stdout: "data": {}, 2024-09-13T18:31:44.960 INFO:tasks.workunit.client.0.smithi044.stdout: "result": 0 2024-09-13T18:31:44.961 INFO:tasks.workunit.client.0.smithi044.stdout: } 2024-09-13T18:31:44.961 INFO:tasks.workunit.client.0.smithi044.stdout:} 2024-09-13T18:31:44.961 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-09-13T18:31:44.962 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.953+0000 7fe31d275500 1 -- 172.21.15.44:0/2720928692 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5646cc06bc00 msgr2=0x5646cbdc4100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.962 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.953+0000 7fe31d275500 1 --2- 172.21.15.44:0/2720928692 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5646cc06bc00 0x5646cbdc4100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.962 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.953+0000 7fe31d275500 1 -- 172.21.15.44:0/2720928692 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5646cc06b800 msgr2=0x5646cbdc5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.962 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.953+0000 7fe31d275500 1 --2- 172.21.15.44:0/2720928692 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5646cc06b800 0x5646cbdc5700 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x5646cc074030 tx=0x5646cca8a3c0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.962 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.953+0000 7fe31d275500 1 -- 172.21.15.44:0/2720928692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5646cc06a400 msgr2=0x5646cbdc5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.962 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.953+0000 7fe31d275500 1 --2- 172.21.15.44:0/2720928692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5646cc06a400 0x5646cbdc5180 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x5646cc075500 tx=0x5646cca8a000 comp rx=0 tx=0).stop 2024-09-13T18:31:44.962 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.953+0000 7fe31b22e700 1 -- 172.21.15.44:0/2720928692 reap_dead start 2024-09-13T18:31:44.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.953+0000 7fe31d275500 1 -- 172.21.15.44:0/2720928692 shutdown_connections 2024-09-13T18:31:44.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.953+0000 7fe31d275500 1 -- 172.21.15.44:0/2720928692 >> 172.21.15.44:0/2720928692 conn(0x5646cc06a000 msgr2=0x5646cbdd9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.953+0000 7fe31d275500 1 -- 172.21.15.44:0/2720928692 shutdown_connections 2024-09-13T18:31:44.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.953+0000 7fe31d275500 1 -- 172.21.15.44:0/2720928692 wait complete. 2024-09-13T18:31:44.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.953+0000 7fe31d275500 1 -- 172.21.15.44:0/3769295788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5646cbd1d000 msgr2=0x5646cbdc2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.953+0000 7fe31d275500 1 --2- 172.21.15.44:0/3769295788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5646cbd1d000 0x5646cbdc2580 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x5646cca88ea0 tx=0x5646cca8a480 comp rx=0 tx=0).stop 2024-09-13T18:31:44.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.953+0000 7fe31d275500 1 -- 172.21.15.44:0/3769295788 shutdown_connections 2024-09-13T18:31:44.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.953+0000 7fe31d275500 1 --2- 172.21.15.44:0/3769295788 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5646cbd1d800 0x5646cbdc3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.953+0000 7fe31d275500 1 --2- 172.21.15.44:0/3769295788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5646cbd1d400 0x5646cbdc2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.953+0000 7fe31d275500 1 --2- 172.21.15.44:0/3769295788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5646cbd1d000 0x5646cbdc2580 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.953+0000 7fe31d275500 1 -- 172.21.15.44:0/3769295788 >> 172.21.15.44:0/3769295788 conn(0x5646cbd1cc00 msgr2=0x5646cbdd9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.953+0000 7fe31d275500 1 -- 172.21.15.44:0/3769295788 shutdown_connections 2024-09-13T18:31:44.963 INFO:tasks.workunit.client.0.smithi044.stderr:2024-09-13T18:31:44.953+0000 7fe31d275500 1 -- 172.21.15.44:0/3769295788 wait complete. 2024-09-13T18:31:44.966 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T18:31:44.966 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T18:31:45.023 INFO:tasks.workunit:Stopping ['suites/cephfs_journal_tool_smoke.sh'] on client.0... 2024-09-13T18:31:45.023 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T18:31:45.275 DEBUG:teuthology.parallel:result is None 2024-09-13T18:31:45.276 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T18:31:45.291 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T18:31:45.291 DEBUG:teuthology.orchestra.run.smithi044:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:31:45.341 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T18:31:45.341 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-13T18:31:45.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.465+0000 7fc58726d700 1 Processor -- start 2024-09-13T18:31:45.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.465+0000 7fc58726d700 1 -- start start 2024-09-13T18:31:45.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc58726d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5800b3290 0x7fc58015abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:45.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc58726d700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58015b2e0 con 0x7fc58015a800 2024-09-13T18:31:45.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc58726d700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58015b5c0 con 0x7fc58006f8c0 2024-09-13T18:31:45.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc58726d700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58015bf60 con 0x7fc5800b3290 2024-09-13T18:31:45.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc58626b700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc58015a800 0x7fc5800b2b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52916/0 (socket says 172.21.15.44:52916) 2024-09-13T18:31:45.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc58626b700 1 -- 172.21.15.44:0/1761771414 learned_addr learned my addr 172.21.15.44:0/1761771414 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:31:45.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc585a6a700 1 --2- 172.21.15.44:0/1761771414 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5800b3290 0x7fc58015abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:45.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc585269700 1 -- 172.21.15.44:0/1761771414 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779979689 0 0) 0x7fc58015b5c0 con 0x7fc58006f8c0 2024-09-13T18:31:45.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc585269700 1 -- 172.21.15.44:0/1761771414 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc56c0035d0 con 0x7fc58006f8c0 2024-09-13T18:31:45.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc585a6a700 1 -- 172.21.15.44:0/1761771414 >> v1:172.21.15.99:6789/0 conn(0x7fc58006f8c0 legacy=0x7fc58015c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:45.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc585269700 1 -- 172.21.15.44:0/1761771414 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1590574285 0 0) 0x7fc58015b2e0 con 0x7fc58015a800 2024-09-13T18:31:45.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc585a6a700 1 -- 172.21.15.44:0/1761771414 >> v1:172.21.15.44:6789/0 conn(0x7fc58015a800 legacy=0x7fc5800b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:45.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc585a6a700 1 -- 172.21.15.44:0/1761771414 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58015b8a0 con 0x7fc5800b3290 2024-09-13T18:31:45.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc585a6a700 1 --2- 172.21.15.44:0/1761771414 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5800b3290 0x7fc58015abe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc574009880 tx=0x7fc574009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8789fc6eca4c51e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:45.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc585269700 1 -- 172.21.15.44:0/1761771414 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574011830 con 0x7fc5800b3290 2024-09-13T18:31:45.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc585269700 1 -- 172.21.15.44:0/1761771414 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc574011990 con 0x7fc5800b3290 2024-09-13T18:31:45.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc585269700 1 -- 172.21.15.44:0/1761771414 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574011d00 con 0x7fc5800b3290 2024-09-13T18:31:45.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc58726d700 1 -- 172.21.15.44:0/1761771414 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5800b3290 msgr2=0x7fc58015abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:45.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc58726d700 1 --2- 172.21.15.44:0/1761771414 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5800b3290 0x7fc58015abe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc574009880 tx=0x7fc574009b90 comp rx=0 tx=0).stop 2024-09-13T18:31:45.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc58726d700 1 -- 172.21.15.44:0/1761771414 shutdown_connections 2024-09-13T18:31:45.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc58726d700 1 --2- 172.21.15.44:0/1761771414 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5800b3290 0x7fc58015abe0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:45.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc58726d700 1 -- 172.21.15.44:0/1761771414 >> 172.21.15.44:0/1761771414 conn(0x7fc580071ce0 msgr2=0x7fc5800720c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:45.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc58726d700 1 -- 172.21.15.44:0/1761771414 shutdown_connections 2024-09-13T18:31:45.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.469+0000 7fc58726d700 1 -- 172.21.15.44:0/1761771414 wait complete. 2024-09-13T18:31:45.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc58726d700 1 Processor -- start 2024-09-13T18:31:45.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc58726d700 1 -- start start 2024-09-13T18:31:45.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc58726d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc58006f8c0 0x7fc5801efb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:45.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc58726d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5800b3290 0x7fc580152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:45.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc58726d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc58015a800 0x7fc5801f3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:45.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc58726d700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc580147d80 con 0x7fc58015a800 2024-09-13T18:31:45.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc58726d700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5801f3750 con 0x7fc5800b3290 2024-09-13T18:31:45.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc58726d700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5801f39f0 con 0x7fc58006f8c0 2024-09-13T18:31:45.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc586a6c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc58015a800 0x7fc5801f3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:45.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc58626b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc58006f8c0 0x7fc5801efb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:45.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc58626b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc58006f8c0 0x7fc5801efb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:58890/0 (socket says 172.21.15.44:58890) 2024-09-13T18:31:45.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc58626b700 1 -- 172.21.15.44:0/2411573885 learned_addr learned my addr 172.21.15.44:0/2411573885 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:45.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc586a6c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc58015a800 0x7fc5801f3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60526/0 (socket says 172.21.15.44:60526) 2024-09-13T18:31:45.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc585a6a700 1 --2- 172.21.15.44:0/2411573885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5800b3290 0x7fc580152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:45.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc58626b700 1 -- 172.21.15.44:0/2411573885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5800b3290 msgr2=0x7fc580152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:45.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc58626b700 1 --2- 172.21.15.44:0/2411573885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5800b3290 0x7fc580152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:45.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc58626b700 1 -- 172.21.15.44:0/2411573885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc58015a800 msgr2=0x7fc5801f3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:45.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc58626b700 1 --2- 172.21.15.44:0/2411573885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc58015a800 0x7fc5801f3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:45.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc58626b700 1 -- 172.21.15.44:0/2411573885 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5740094b0 con 0x7fc58006f8c0 2024-09-13T18:31:45.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc58626b700 1 --2- 172.21.15.44:0/2411573885 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc58006f8c0 0x7fc5801efb80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc57c00c4e0 tx=0x7fc57c00c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:45.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc572ffd700 1 -- 172.21.15.44:0/2411573885 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c004ca0 con 0x7fc58006f8c0 2024-09-13T18:31:45.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc572ffd700 1 -- 172.21.15.44:0/2411573885 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c004e20 con 0x7fc58006f8c0 2024-09-13T18:31:45.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc572ffd700 1 -- 172.21.15.44:0/2411573885 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c007310 con 0x7fc58006f8c0 2024-09-13T18:31:45.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc58726d700 1 -- 172.21.15.44:0/2411573885 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc580155a40 con 0x7fc58006f8c0 2024-09-13T18:31:45.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.473+0000 7fc58726d700 1 -- 172.21.15.44:0/2411573885 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc580156000 con 0x7fc58006f8c0 2024-09-13T18:31:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.477+0000 7fc58726d700 1 -- 172.21.15.44:0/2411573885 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58015abe0 con 0x7fc58006f8c0 2024-09-13T18:31:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.477+0000 7fc572ffd700 1 -- 172.21.15.44:0/2411573885 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc57c007470 con 0x7fc58006f8c0 2024-09-13T18:31:45.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.477+0000 7fc572ffd700 1 --2- 172.21.15.44:0/2411573885 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc564066730 0x7fc564068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:45.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.477+0000 7fc572ffd700 1 -- 172.21.15.44:0/2411573885 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fc57c083dc0 con 0x7fc58006f8c0 2024-09-13T18:31:45.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.477+0000 7fc585a6a700 1 --2- 172.21.15.44:0/2411573885 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc564066730 0x7fc564068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:45.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.477+0000 7fc585a6a700 1 --2- 172.21.15.44:0/2411573885 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc564066730 0x7fc564068bf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc5800ccf20 tx=0x7fc574010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:45.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.489+0000 7fc572ffd700 1 -- 172.21.15.44:0/2411573885 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc57c0510b0 con 0x7fc58006f8c0 2024-09-13T18:31:45.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:45.697+0000 7fc58726d700 1 -- 172.21.15.44:0/2411573885 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fc58015c8b0 con 0x7fc58006f8c0 2024-09-13T18:31:46.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.581+0000 7fc572ffd700 1 -- 172.21.15.44:0/2411573885 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v34) v1 ==== 162+0+0 (secure 0 0 0) 0x7fc57c007720 con 0x7fc58006f8c0 2024-09-13T18:31:46.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.585+0000 7fc58726d700 1 -- 172.21.15.44:0/2411573885 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc564066730 msgr2=0x7fc564068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:46.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.585+0000 7fc58726d700 1 --2- 172.21.15.44:0/2411573885 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc564066730 0x7fc564068bf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc5800ccf20 tx=0x7fc574010000 comp rx=0 tx=0).stop 2024-09-13T18:31:46.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.585+0000 7fc58726d700 1 -- 172.21.15.44:0/2411573885 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc58006f8c0 msgr2=0x7fc5801efb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:46.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.585+0000 7fc58726d700 1 --2- 172.21.15.44:0/2411573885 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc58006f8c0 0x7fc5801efb80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc57c00c4e0 tx=0x7fc57c00c7f0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.585+0000 7fc58726d700 1 -- 172.21.15.44:0/2411573885 shutdown_connections 2024-09-13T18:31:46.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.585+0000 7fc58726d700 1 --2- 172.21.15.44:0/2411573885 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc564066730 0x7fc564068bf0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.585+0000 7fc58726d700 1 --2- 172.21.15.44:0/2411573885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc58015a800 0x7fc5801f3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.585+0000 7fc58726d700 1 --2- 172.21.15.44:0/2411573885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5800b3290 0x7fc580152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.585+0000 7fc58726d700 1 --2- 172.21.15.44:0/2411573885 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc58006f8c0 0x7fc5801efb80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.585+0000 7fc58726d700 1 -- 172.21.15.44:0/2411573885 >> 172.21.15.44:0/2411573885 conn(0x7fc580071ce0 msgr2=0x7fc58015e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:46.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.585+0000 7fc58726d700 1 -- 172.21.15.44:0/2411573885 shutdown_connections 2024-09-13T18:31:46.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.585+0000 7fc58726d700 1 -- 172.21.15.44:0/2411573885 wait complete. 2024-09-13T18:31:46.596 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-13T18:31:46.613 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:31:46.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0177fff700 1 Processor -- start 2024-09-13T18:31:46.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0177fff700 1 -- start start 2024-09-13T18:31:46.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0177fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f017004ec10 0x7f017001db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:46.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0177fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0170033510 0x7f0170031240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:46.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0177fff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0170033e90 con 0x7f0170036d80 2024-09-13T18:31:46.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0177fff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0170033bb0 con 0x7f0170033510 2024-09-13T18:31:46.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0177fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017001d080 con 0x7f017004ec10 2024-09-13T18:31:46.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f01767fc700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0170036d80 0x7f017004eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52922/0 (socket says 172.21.15.44:52922) 2024-09-13T18:31:46.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f01767fc700 1 -- 172.21.15.44:0/2462350091 learned_addr learned my addr 172.21.15.44:0/2462350091 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:31:46.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f01777fe700 1 --2- 172.21.15.44:0/2462350091 >> v2:172.21.15.99:3300/0 conn(0x7f0170033510 0x7f0170031240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:46.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0176ffd700 1 --2- 172.21.15.44:0/2462350091 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f017004ec10 0x7f017001db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:46.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0175ffb700 1 -- 172.21.15.44:0/2462350091 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2295493261 0 0) 0x7f0170033e90 con 0x7f0170036d80 2024-09-13T18:31:46.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0175ffb700 1 -- 172.21.15.44:0/2462350091 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01600035d0 con 0x7f0170036d80 2024-09-13T18:31:46.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0175ffb700 1 -- 172.21.15.44:0/2462350091 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 913678755 0 0) 0x7f01600035d0 con 0x7f0170036d80 2024-09-13T18:31:46.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0175ffb700 1 -- 172.21.15.44:0/2462350091 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f017004ec10 msgr2=0x7f017001db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:46.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0175ffb700 1 --2- 172.21.15.44:0/2462350091 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f017004ec10 0x7f017001db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0175ffb700 1 -- 172.21.15.44:0/2462350091 >> v2:172.21.15.99:3300/0 conn(0x7f0170033510 msgr2=0x7f0170031240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:46.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0175ffb700 1 --2- 172.21.15.44:0/2462350091 >> v2:172.21.15.99:3300/0 conn(0x7f0170033510 0x7f0170031240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0175ffb700 1 -- 172.21.15.44:0/2462350091 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017001d360 con 0x7f0170036d80 2024-09-13T18:31:46.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0176ffd700 1 --2- 172.21.15.44:0/2462350091 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f017004ec10 0x7f017001db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:46.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0175ffb700 1 -- 172.21.15.44:0/2462350091 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f017804ef50 con 0x7f0170036d80 2024-09-13T18:31:46.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0175ffb700 1 -- 172.21.15.44:0/2462350091 >> v1:172.21.15.44:6789/0 conn(0x7f0170036d80 legacy=0x7f017004eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:46.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0175ffb700 1 --2- 172.21.15.44:0/2462350091 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0160003a20 0x7f0160003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:46.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0175ffb700 1 --2- 172.21.15.44:0/2462350091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01600043c0 0x7f0160004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:46.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0175ffb700 1 --2- 172.21.15.44:0/2462350091 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f017004ec10 0x7f0160004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:46.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0175ffb700 1 -- 172.21.15.44:0/2462350091 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0170033bb0 con 0x7f01600043c0 2024-09-13T18:31:46.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0175ffb700 1 -- 172.21.15.44:0/2462350091 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017001d080 con 0x7f0160003a20 2024-09-13T18:31:46.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0175ffb700 1 -- 172.21.15.44:0/2462350091 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016000ba30 con 0x7f017004ec10 2024-09-13T18:31:46.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f01767fc700 1 --2- 172.21.15.44:0/2462350091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01600043c0 0x7f0160004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:46.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f0176ffd700 1 --2- 172.21.15.44:0/2462350091 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0160003a20 0x7f0160003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:46.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.721+0000 7f01777fe700 1 --2- 172.21.15.44:0/2462350091 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f017004ec10 0x7f0160004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:46.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.725+0000 7f0176ffd700 1 -- 172.21.15.44:0/2462350091 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f017004ec10 msgr2=0x7f0160004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:46.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.725+0000 7f0176ffd700 1 --2- 172.21.15.44:0/2462350091 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f017004ec10 0x7f0160004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.725+0000 7f0176ffd700 1 -- 172.21.15.44:0/2462350091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01600043c0 msgr2=0x7f0160004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:46.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.725+0000 7f0176ffd700 1 --2- 172.21.15.44:0/2462350091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01600043c0 0x7f0160004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.725+0000 7f0176ffd700 1 -- 172.21.15.44:0/2462350091 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c009450 con 0x7f0160003a20 2024-09-13T18:31:46.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.725+0000 7f01767fc700 1 --2- 172.21.15.44:0/2462350091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01600043c0 0x7f0160004890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:46.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.725+0000 7f0176ffd700 1 --2- 172.21.15.44:0/2462350091 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0160003a20 0x7f0160003e40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f016c009d30 tx=0x7f01600058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=972109f297a65e29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:46.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.725+0000 7f0175ffb700 1 -- 172.21.15.44:0/2462350091 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c009e80 con 0x7f0160003a20 2024-09-13T18:31:46.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.725+0000 7f0175ffb700 1 -- 172.21.15.44:0/2462350091 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016c005a40 con 0x7f0160003a20 2024-09-13T18:31:46.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.725+0000 7f0175ffb700 1 -- 172.21.15.44:0/2462350091 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c005db0 con 0x7f0160003a20 2024-09-13T18:31:46.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.725+0000 7f0177fff700 1 -- 172.21.15.44:0/2462350091 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0160003a20 msgr2=0x7f0160003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:46.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.725+0000 7f0177fff700 1 --2- 172.21.15.44:0/2462350091 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0160003a20 0x7f0160003e40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f016c009d30 tx=0x7f01600058a0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.725+0000 7f01777fe700 1 -- 172.21.15.44:0/2462350091 reap_dead start 2024-09-13T18:31:46.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.725+0000 7f0177fff700 1 -- 172.21.15.44:0/2462350091 shutdown_connections 2024-09-13T18:31:46.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.725+0000 7f0177fff700 1 -- 172.21.15.44:0/2462350091 >> 172.21.15.44:0/2462350091 conn(0x7f0170036140 msgr2=0x7f0170036550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:46.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.725+0000 7f0177fff700 1 -- 172.21.15.44:0/2462350091 shutdown_connections 2024-09-13T18:31:46.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.725+0000 7f0177fff700 1 -- 172.21.15.44:0/2462350091 wait complete. 2024-09-13T18:31:46.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.729+0000 7f0177fff700 1 Processor -- start 2024-09-13T18:31:46.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.729+0000 7f0177fff700 1 -- start start 2024-09-13T18:31:46.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.729+0000 7f0177fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0160003a20 0x7f0170037480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:46.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.729+0000 7f0177fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f017000bb10 0x7f017000ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:46.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.733+0000 7f0177fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f01700e7580 0x7f01700dd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:46.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.733+0000 7f0177fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0170038a00 con 0x7f0160003a20 2024-09-13T18:31:46.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.733+0000 7f0177fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0170037d80 con 0x7f017000bb10 2024-09-13T18:31:46.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.733+0000 7f0177fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0170038060 con 0x7f01700e7580 2024-09-13T18:31:46.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.733+0000 7f0176ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0160003a20 0x7f0170037480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:46.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.733+0000 7f0176ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0160003a20 0x7f0170037480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60548/0 (socket says 172.21.15.44:60548) 2024-09-13T18:31:46.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.733+0000 7f0176ffd700 1 -- 172.21.15.44:0/1987220760 learned_addr learned my addr 172.21.15.44:0/1987220760 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:46.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.733+0000 7f01767fc700 1 --2- 172.21.15.44:0/1987220760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f017000bb10 0x7f017000ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:46.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.733+0000 7f01777fe700 1 --2- 172.21.15.44:0/1987220760 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f01700e7580 0x7f01700dd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:46.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.733+0000 7f0176ffd700 1 -- 172.21.15.44:0/1987220760 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f01700e7580 msgr2=0x7f01700dd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:46.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.733+0000 7f0176ffd700 1 --2- 172.21.15.44:0/1987220760 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f01700e7580 0x7f01700dd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.733+0000 7f0176ffd700 1 -- 172.21.15.44:0/1987220760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f017000bb10 msgr2=0x7f017000ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:46.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.733+0000 7f0176ffd700 1 --2- 172.21.15.44:0/1987220760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f017000bb10 0x7f017000ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.733+0000 7f0176ffd700 1 -- 172.21.15.44:0/1987220760 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0170038340 con 0x7f0160003a20 2024-09-13T18:31:46.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.733+0000 7f01767fc700 1 --2- 172.21.15.44:0/1987220760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f017000bb10 0x7f017000ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:46.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.733+0000 7f0176ffd700 1 --2- 172.21.15.44:0/1987220760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0160003a20 0x7f0170037480 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f016c000c00 tx=0x7f016c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:46.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.733+0000 7f015f7fe700 1 -- 172.21.15.44:0/1987220760 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c004240 con 0x7f0160003a20 2024-09-13T18:31:46.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.733+0000 7f0177fff700 1 -- 172.21.15.44:0/1987220760 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0170038620 con 0x7f0160003a20 2024-09-13T18:31:46.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.733+0000 7f015f7fe700 1 -- 172.21.15.44:0/1987220760 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016c021070 con 0x7f0160003a20 2024-09-13T18:31:46.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.733+0000 7f015f7fe700 1 -- 172.21.15.44:0/1987220760 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c0045c0 con 0x7f0160003a20 2024-09-13T18:31:46.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.733+0000 7f0177fff700 1 -- 172.21.15.44:0/1987220760 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017000b2a0 con 0x7f0160003a20 2024-09-13T18:31:46.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.733+0000 7f0177fff700 1 -- 172.21.15.44:0/1987220760 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017000b490 con 0x7f0160003a20 2024-09-13T18:31:46.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.737+0000 7f015f7fe700 1 -- 172.21.15.44:0/1987220760 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f016c023030 con 0x7f0160003a20 2024-09-13T18:31:46.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.737+0000 7f015f7fe700 1 --2- 172.21.15.44:0/1987220760 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0164066730 0x7f0164068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:46.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.737+0000 7f015f7fe700 1 -- 172.21.15.44:0/1987220760 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f016c085af0 con 0x7f0160003a20 2024-09-13T18:31:46.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.737+0000 7f01767fc700 1 --2- 172.21.15.44:0/1987220760 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0164066730 0x7f0164068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:46.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.737+0000 7f01767fc700 1 --2- 172.21.15.44:0/1987220760 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0164066730 0x7f0164068bf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0178000b60 tx=0x7f017806a070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:46.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.745+0000 7f015f7fe700 1 -- 172.21.15.44:0/1987220760 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f016c0567d0 con 0x7f0160003a20 2024-09-13T18:31:46.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.953+0000 7f0177fff700 1 -- 172.21.15.44:0/1987220760 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0170004800 con 0x7f0160003a20 2024-09-13T18:31:46.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.957+0000 7f015f7fe700 1 -- 172.21.15.44:0/1987220760 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4735 (secure 0 0 0) 0x7f016c006e60 con 0x7f0160003a20 2024-09-13T18:31:46.964 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:31:46.964 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":35,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5447,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2081931615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2081931615},{"type":"v1","addr":"172.21.15.99:6835","nonce":2081931615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5639,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1452559390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1452559390},{"type":"v1","addr":"172.21.15.44:6835","nonce":1452559390}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5887,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/2337853364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2337853364},{"type":"v1","addr":"172.21.15.99:6837","nonce":2337853364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:29:10.283572+0000","modified":"2024-09-13T18:31:46.584494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":51,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5976},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5976":{"gid":5976,"name":"a","rank":0,"incarnation":35,"state":"up:replay","state_seq":1,"addr":"172.21.15.44:6833/3567136594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3567136594},{"type":"v1","addr":"172.21.15.44:6833","nonce":3567136594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:31:46.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.957+0000 7f0177fff700 1 -- 172.21.15.44:0/1987220760 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0164066730 msgr2=0x7f0164068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:46.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.957+0000 7f0177fff700 1 --2- 172.21.15.44:0/1987220760 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0164066730 0x7f0164068bf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0178000b60 tx=0x7f017806a070 comp rx=0 tx=0).stop 2024-09-13T18:31:46.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.957+0000 7f0177fff700 1 -- 172.21.15.44:0/1987220760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0160003a20 msgr2=0x7f0170037480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:46.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.957+0000 7f0177fff700 1 --2- 172.21.15.44:0/1987220760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0160003a20 0x7f0170037480 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f016c000c00 tx=0x7f016c0047e0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.957+0000 7f0177fff700 1 -- 172.21.15.44:0/1987220760 shutdown_connections 2024-09-13T18:31:46.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.957+0000 7f0177fff700 1 --2- 172.21.15.44:0/1987220760 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0164066730 0x7f0164068bf0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.957+0000 7f0177fff700 1 --2- 172.21.15.44:0/1987220760 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f01700e7580 0x7f01700dd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.957+0000 7f0177fff700 1 --2- 172.21.15.44:0/1987220760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f017000bb10 0x7f017000ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.957+0000 7f0177fff700 1 --2- 172.21.15.44:0/1987220760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0160003a20 0x7f0170037480 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.957+0000 7f0177fff700 1 -- 172.21.15.44:0/1987220760 >> 172.21.15.44:0/1987220760 conn(0x7f0170036140 msgr2=0x7f0170031440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:46.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.957+0000 7f0177fff700 1 -- 172.21.15.44:0/1987220760 shutdown_connections 2024-09-13T18:31:46.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:46.957+0000 7f0177fff700 1 -- 172.21.15.44:0/1987220760 wait complete. 2024-09-13T18:31:46.968 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 35 2024-09-13T18:31:47.382 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:29:10.283572+0000', 'modified': '2024-09-13T18:31:46.584494+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 51, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5976}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5976': {'gid': 5976, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.44:6833/3567136594', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 3567136594}, {'type': 'v1', 'addr': '172.21.15.44:6833', 'nonce': 3567136594}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:31:47.382 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5976:up:replay 2024-09-13T18:31:48.383 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:31:48.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.497+0000 7f597932c700 1 Processor -- start 2024-09-13T18:31:48.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.497+0000 7f597932c700 1 -- start start 2024-09-13T18:31:48.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.497+0000 7f597932c700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f59740b3ae0 0x7f597406a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:48.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.497+0000 7f597932c700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f597413dcb0 con 0x7f597406aaf0 2024-09-13T18:31:48.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.497+0000 7f597932c700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f597415be60 con 0x7f597406bbf0 2024-09-13T18:31:48.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.497+0000 7f597932c700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597413ffd0 con 0x7f59740b3ae0 2024-09-13T18:31:48.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.497+0000 7f5978b2b700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f597406aaf0 0x7f597415e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52932/0 (socket says 172.21.15.44:52932) 2024-09-13T18:31:48.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5978b2b700 1 -- 172.21.15.44:0/1689449522 learned_addr learned my addr 172.21.15.44:0/1689449522 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:31:48.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f59737fe700 1 --2- 172.21.15.44:0/1689449522 >> v2:172.21.15.99:3300/0 conn(0x7f59740b3ae0 0x7f597406a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:48.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5972ffd700 1 -- 172.21.15.44:0/1689449522 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1791846239 0 0) 0x7f597413dcb0 con 0x7f597406aaf0 2024-09-13T18:31:48.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5972ffd700 1 -- 172.21.15.44:0/1689449522 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59600035d0 con 0x7f597406aaf0 2024-09-13T18:31:48.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5972ffd700 1 -- 172.21.15.44:0/1689449522 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 218438054 0 0) 0x7f597415be60 con 0x7f597406bbf0 2024-09-13T18:31:48.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5972ffd700 1 -- 172.21.15.44:0/1689449522 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f597413dcb0 con 0x7f597406bbf0 2024-09-13T18:31:48.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5972ffd700 1 -- 172.21.15.44:0/1689449522 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3533840846 0 0) 0x7f59600035d0 con 0x7f597406aaf0 2024-09-13T18:31:48.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5972ffd700 1 -- 172.21.15.44:0/1689449522 >> v2:172.21.15.99:3300/0 conn(0x7f59740b3ae0 msgr2=0x7f597406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:48.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5972ffd700 1 --2- 172.21.15.44:0/1689449522 >> v2:172.21.15.99:3300/0 conn(0x7f59740b3ae0 0x7f597406a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5972ffd700 1 -- 172.21.15.44:0/1689449522 >> v1:172.21.15.99:6789/0 conn(0x7f597406bbf0 legacy=0x7f59740b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:48.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5972ffd700 1 -- 172.21.15.44:0/1689449522 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5974140220 con 0x7f597406aaf0 2024-09-13T18:31:48.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5972ffd700 1 -- 172.21.15.44:0/1689449522 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f596c001670 con 0x7f597406aaf0 2024-09-13T18:31:48.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5972ffd700 1 -- 172.21.15.44:0/1689449522 >> v1:172.21.15.44:6789/0 conn(0x7f597406aaf0 legacy=0x7f597415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:48.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5972ffd700 1 --2- 172.21.15.44:0/1689449522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5960003bb0 0x7f5960003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:48.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5972ffd700 1 --2- 172.21.15.44:0/1689449522 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5960004870 0x7f5960004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:48.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5972ffd700 1 --2- 172.21.15.44:0/1689449522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5960005230 0x7f596000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:48.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5972ffd700 1 -- 172.21.15.44:0/1689449522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597413ffd0 con 0x7f5960005230 2024-09-13T18:31:48.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5972ffd700 1 -- 172.21.15.44:0/1689449522 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596000c0b0 con 0x7f5960003bb0 2024-09-13T18:31:48.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5972ffd700 1 -- 172.21.15.44:0/1689449522 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596000c270 con 0x7f5960004870 2024-09-13T18:31:48.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5978b2b700 1 --2- 172.21.15.44:0/1689449522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5960005230 0x7f596000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:48.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5973fff700 1 --2- 172.21.15.44:0/1689449522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5960003bb0 0x7f5960003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:48.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f59737fe700 1 --2- 172.21.15.44:0/1689449522 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5960004870 0x7f5960004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:48.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f59737fe700 1 -- 172.21.15.44:0/1689449522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5960003bb0 msgr2=0x7f5960003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:48.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f59737fe700 1 --2- 172.21.15.44:0/1689449522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5960003bb0 0x7f5960003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f59737fe700 1 -- 172.21.15.44:0/1689449522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5960005230 msgr2=0x7f596000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:48.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f59737fe700 1 --2- 172.21.15.44:0/1689449522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5960005230 0x7f596000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f59737fe700 1 -- 172.21.15.44:0/1689449522 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59600035d0 con 0x7f5960004870 2024-09-13T18:31:48.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5978b2b700 1 --2- 172.21.15.44:0/1689449522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5960005230 0x7f596000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:48.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5978b2b700 1 -- 172.21.15.44:0/1689449522 reap_dead start 2024-09-13T18:31:48.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f59737fe700 1 --2- 172.21.15.44:0/1689449522 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5960004870 0x7f5960004cf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f595c009b70 tx=0x7f59600058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c80f6d65b973ed8a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:48.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5972ffd700 1 -- 172.21.15.44:0/1689449522 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c00e6c0 con 0x7f5960004870 2024-09-13T18:31:48.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5972ffd700 1 -- 172.21.15.44:0/1689449522 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595c00e820 con 0x7f5960004870 2024-09-13T18:31:48.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.501+0000 7f5972ffd700 1 -- 172.21.15.44:0/1689449522 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c00eb90 con 0x7f5960004870 2024-09-13T18:31:48.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.505+0000 7f597932c700 1 -- 172.21.15.44:0/1689449522 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5960004870 msgr2=0x7f5960004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:48.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.505+0000 7f597932c700 1 --2- 172.21.15.44:0/1689449522 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5960004870 0x7f5960004cf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f595c009b70 tx=0x7f59600058a0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.505+0000 7f597932c700 1 -- 172.21.15.44:0/1689449522 shutdown_connections 2024-09-13T18:31:48.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.505+0000 7f597932c700 1 --2- 172.21.15.44:0/1689449522 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5960004870 0x7f5960004cf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.505+0000 7f597932c700 1 -- 172.21.15.44:0/1689449522 >> 172.21.15.44:0/1689449522 conn(0x7f59740b0f00 msgr2=0x7f59740b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:48.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.505+0000 7f597932c700 1 -- 172.21.15.44:0/1689449522 shutdown_connections 2024-09-13T18:31:48.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.505+0000 7f597932c700 1 -- 172.21.15.44:0/1689449522 wait complete. 2024-09-13T18:31:48.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.505+0000 7f597932c700 1 Processor -- start 2024-09-13T18:31:48.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.505+0000 7f597932c700 1 -- start start 2024-09-13T18:31:48.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.505+0000 7f597932c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5960004870 0x7f5974139f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:48.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.505+0000 7f597932c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5974139a20 0x7f5974139390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:48.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.505+0000 7f597932c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f597413c5b0 0x7f597413ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:48.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.505+0000 7f597932c700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5974155f20 con 0x7f5974139a20 2024-09-13T18:31:48.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.505+0000 7f597932c700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597413cf80 con 0x7f597413c5b0 2024-09-13T18:31:48.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.505+0000 7f597932c700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5974156ec0 con 0x7f5960004870 2024-09-13T18:31:48.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.505+0000 7f59737fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5974139a20 0x7f5974139390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:48.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.505+0000 7f59737fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5974139a20 0x7f5974139390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60572/0 (socket says 172.21.15.44:60572) 2024-09-13T18:31:48.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.505+0000 7f59737fe700 1 -- 172.21.15.44:0/1111785223 learned_addr learned my addr 172.21.15.44:0/1111785223 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:48.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.505+0000 7f5973fff700 1 --2- 172.21.15.44:0/1111785223 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5960004870 0x7f5974139f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:48.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.505+0000 7f5978b2b700 1 --2- 172.21.15.44:0/1111785223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f597413c5b0 0x7f597413ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:48.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.509+0000 7f59737fe700 1 -- 172.21.15.44:0/1111785223 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5960004870 msgr2=0x7f5974139f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:48.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.509+0000 7f59737fe700 1 --2- 172.21.15.44:0/1111785223 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5960004870 0x7f5974139f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.509+0000 7f59737fe700 1 -- 172.21.15.44:0/1111785223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f597413c5b0 msgr2=0x7f597413ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:48.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.509+0000 7f59737fe700 1 --2- 172.21.15.44:0/1111785223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f597413c5b0 0x7f597413ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.509+0000 7f59737fe700 1 -- 172.21.15.44:0/1111785223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5974156100 con 0x7f5974139a20 2024-09-13T18:31:48.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.509+0000 7f59737fe700 1 --2- 172.21.15.44:0/1111785223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5974139a20 0x7f5974139390 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f596000c400 tx=0x7f595c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:48.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.509+0000 7f5970ff9700 1 -- 172.21.15.44:0/1111785223 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c00e6c0 con 0x7f5974139a20 2024-09-13T18:31:48.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.509+0000 7f5970ff9700 1 -- 172.21.15.44:0/1111785223 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595c003b10 con 0x7f5974139a20 2024-09-13T18:31:48.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.509+0000 7f597932c700 1 -- 172.21.15.44:0/1111785223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59741563e0 con 0x7f5974139a20 2024-09-13T18:31:48.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.509+0000 7f5970ff9700 1 -- 172.21.15.44:0/1111785223 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c013470 con 0x7f5974139a20 2024-09-13T18:31:48.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.509+0000 7f597932c700 1 -- 172.21.15.44:0/1111785223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59741569a0 con 0x7f5974139a20 2024-09-13T18:31:48.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.509+0000 7f597932c700 1 -- 172.21.15.44:0/1111785223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59741e5db0 con 0x7f5974139a20 2024-09-13T18:31:48.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.509+0000 7f5970ff9700 1 -- 172.21.15.44:0/1111785223 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f595c0135d0 con 0x7f5974139a20 2024-09-13T18:31:48.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.513+0000 7f5970ff9700 1 --2- 172.21.15.44:0/1111785223 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5954066760 0x7f5954068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:48.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.513+0000 7f5970ff9700 1 -- 172.21.15.44:0/1111785223 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f595c0855d0 con 0x7f5974139a20 2024-09-13T18:31:48.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.513+0000 7f5973fff700 1 --2- 172.21.15.44:0/1111785223 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5954066760 0x7f5954068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:48.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.513+0000 7f5973fff700 1 --2- 172.21.15.44:0/1111785223 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5954066760 0x7f5954068c20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5964002230 tx=0x7f5964009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:48.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.521+0000 7f5970ff9700 1 -- 172.21.15.44:0/1111785223 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f595c052bd0 con 0x7f5974139a20 2024-09-13T18:31:48.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.733+0000 7f597932c700 1 -- 172.21.15.44:0/1111785223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f597406af40 con 0x7f5974139a20 2024-09-13T18:31:48.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.733+0000 7f5970ff9700 1 -- 172.21.15.44:0/1111785223 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f595c0561f0 con 0x7f5974139a20 2024-09-13T18:31:48.743 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:31:48.743 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":37,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5447,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2081931615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2081931615},{"type":"v1","addr":"172.21.15.99:6835","nonce":2081931615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5639,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1452559390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1452559390},{"type":"v1","addr":"172.21.15.44:6835","nonce":1452559390}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5887,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/2337853364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2337853364},{"type":"v1","addr":"172.21.15.99:6837","nonce":2337853364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:29:10.283572+0000","modified":"2024-09-13T18:31:48.590303+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":51,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5976},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5976":{"gid":5976,"name":"a","rank":0,"incarnation":35,"state":"up:rejoin","state_seq":43,"addr":"172.21.15.44:6833/3567136594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3567136594},{"type":"v1","addr":"172.21.15.44:6833","nonce":3567136594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:31:48.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.737+0000 7f597932c700 1 -- 172.21.15.44:0/1111785223 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5954066760 msgr2=0x7f5954068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:48.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.737+0000 7f597932c700 1 --2- 172.21.15.44:0/1111785223 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5954066760 0x7f5954068c20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5964002230 tx=0x7f5964009040 comp rx=0 tx=0).stop 2024-09-13T18:31:48.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.737+0000 7f597932c700 1 -- 172.21.15.44:0/1111785223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5974139a20 msgr2=0x7f5974139390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:48.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.737+0000 7f597932c700 1 --2- 172.21.15.44:0/1111785223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5974139a20 0x7f5974139390 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f596000c400 tx=0x7f595c0047e0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.737+0000 7f597932c700 1 -- 172.21.15.44:0/1111785223 shutdown_connections 2024-09-13T18:31:48.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.737+0000 7f597932c700 1 --2- 172.21.15.44:0/1111785223 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5954066760 0x7f5954068c20 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.737+0000 7f597932c700 1 --2- 172.21.15.44:0/1111785223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f597413c5b0 0x7f597413ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.737+0000 7f597932c700 1 --2- 172.21.15.44:0/1111785223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5974139a20 0x7f5974139390 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.737+0000 7f597932c700 1 --2- 172.21.15.44:0/1111785223 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5960004870 0x7f5974139f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.737+0000 7f597932c700 1 -- 172.21.15.44:0/1111785223 >> 172.21.15.44:0/1111785223 conn(0x7f59740b0f00 msgr2=0x7f59740b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:48.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.737+0000 7f597932c700 1 -- 172.21.15.44:0/1111785223 shutdown_connections 2024-09-13T18:31:48.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:48.737+0000 7f597932c700 1 -- 172.21.15.44:0/1111785223 wait complete. 2024-09-13T18:31:48.748 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 37 2024-09-13T18:31:49.161 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:29:10.283572+0000', 'modified': '2024-09-13T18:31:48.590303+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 51, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5976}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5976': {'gid': 5976, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:rejoin', 'state_seq': 43, 'addr': '172.21.15.44:6833/3567136594', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 3567136594}, {'type': 'v1', 'addr': '172.21.15.44:6833', 'nonce': 3567136594}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:31:49.162 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5976:up:rejoin 2024-09-13T18:31:50.164 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:31:50.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8e11f0700 1 Processor -- start 2024-09-13T18:31:50.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8e11f0700 1 -- start start 2024-09-13T18:31:50.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8e11f0700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc8dc0714f0 0x7fc8dc1606e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:50.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8e11f0700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc8dc146500 0x7fc8dc0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:50.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8e11f0700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8dc0ce700 con 0x7fc8dc0718d0 2024-09-13T18:31:50.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8e11f0700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8dc161640 con 0x7fc8dc146500 2024-09-13T18:31:50.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8e11f0700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8dc160da0 con 0x7fc8dc0714f0 2024-09-13T18:31:50.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8d37fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc8dc0718d0 0x7fc8dc145df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52934/0 (socket says 172.21.15.44:52934) 2024-09-13T18:31:50.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8d37fe700 1 -- 172.21.15.44:0/4045975996 learned_addr learned my addr 172.21.15.44:0/4045975996 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:31:50.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8e09ef700 1 --2- 172.21.15.44:0/4045975996 >> v2:172.21.15.44:3300/0 conn(0x7fc8dc146500 0x7fc8dc0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:50.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8dbfff700 1 --2- 172.21.15.44:0/4045975996 >> v2:172.21.15.99:3300/0 conn(0x7fc8dc0714f0 0x7fc8dc1606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:50.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8db7fe700 1 -- 172.21.15.44:0/4045975996 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354998550 0 0) 0x7fc8dc0ce700 con 0x7fc8dc0718d0 2024-09-13T18:31:50.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8db7fe700 1 -- 172.21.15.44:0/4045975996 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8c80035d0 con 0x7fc8dc0718d0 2024-09-13T18:31:50.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8db7fe700 1 -- 172.21.15.44:0/4045975996 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3611766306 0 0) 0x7fc8c80035d0 con 0x7fc8dc0718d0 2024-09-13T18:31:50.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8db7fe700 1 -- 172.21.15.44:0/4045975996 >> v2:172.21.15.99:3300/0 conn(0x7fc8dc0714f0 msgr2=0x7fc8dc1606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:50.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8db7fe700 1 --2- 172.21.15.44:0/4045975996 >> v2:172.21.15.99:3300/0 conn(0x7fc8dc0714f0 0x7fc8dc1606e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8db7fe700 1 -- 172.21.15.44:0/4045975996 >> v2:172.21.15.44:3300/0 conn(0x7fc8dc146500 msgr2=0x7fc8dc0ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:50.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8db7fe700 1 --2- 172.21.15.44:0/4045975996 >> v2:172.21.15.44:3300/0 conn(0x7fc8dc146500 0x7fc8dc0ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8db7fe700 1 -- 172.21.15.44:0/4045975996 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc161080 con 0x7fc8dc0718d0 2024-09-13T18:31:50.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8db7fe700 1 -- 172.21.15.44:0/4045975996 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7fc8c4001670 con 0x7fc8dc0718d0 2024-09-13T18:31:50.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8e09ef700 1 --2- 172.21.15.44:0/4045975996 >> v2:172.21.15.44:3300/0 conn(0x7fc8dc146500 0x7fc8dc0ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:50.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8db7fe700 1 -- 172.21.15.44:0/4045975996 >> v1:172.21.15.44:6789/0 conn(0x7fc8dc0718d0 legacy=0x7fc8dc145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:50.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8db7fe700 1 --2- 172.21.15.44:0/4045975996 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc8c8003a20 0x7fc8c8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:50.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8db7fe700 1 --2- 172.21.15.44:0/4045975996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8c8004870 0x7fc8c8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:50.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8db7fe700 1 --2- 172.21.15.44:0/4045975996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8c8005230 0x7fc8c800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:50.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8db7fe700 1 -- 172.21.15.44:0/4045975996 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc161640 con 0x7fc8c8005230 2024-09-13T18:31:50.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8db7fe700 1 -- 172.21.15.44:0/4045975996 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc160da0 con 0x7fc8c8004870 2024-09-13T18:31:50.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8db7fe700 1 -- 172.21.15.44:0/4045975996 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c800bfc0 con 0x7fc8c8003a20 2024-09-13T18:31:50.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8e09ef700 1 --2- 172.21.15.44:0/4045975996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8c8005230 0x7fc8c800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:50.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8d37fe700 1 --2- 172.21.15.44:0/4045975996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8c8004870 0x7fc8c8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:50.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8dbfff700 1 --2- 172.21.15.44:0/4045975996 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc8c8003a20 0x7fc8c8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:50.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8e09ef700 1 -- 172.21.15.44:0/4045975996 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc8c8003a20 msgr2=0x7fc8c8003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:50.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8e09ef700 1 --2- 172.21.15.44:0/4045975996 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc8c8003a20 0x7fc8c8003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8e09ef700 1 -- 172.21.15.44:0/4045975996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8c8004870 msgr2=0x7fc8c8004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:50.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8e09ef700 1 --2- 172.21.15.44:0/4045975996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8c8004870 0x7fc8c8004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8e09ef700 1 -- 172.21.15.44:0/4045975996 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c80035d0 con 0x7fc8c8005230 2024-09-13T18:31:50.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8e09ef700 1 -- 172.21.15.44:0/4045975996 reap_dead start 2024-09-13T18:31:50.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8e09ef700 1 --2- 172.21.15.44:0/4045975996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8c8005230 0x7fc8c800ba30 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400e350 tx=0x7fc8c80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a862173ede5bd0b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:50.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8db7fe700 1 -- 172.21.15.44:0/4045975996 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d400edf0 con 0x7fc8c8005230 2024-09-13T18:31:50.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8db7fe700 1 -- 172.21.15.44:0/4045975996 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d400f040 con 0x7fc8c8005230 2024-09-13T18:31:50.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.289+0000 7fc8db7fe700 1 -- 172.21.15.44:0/4045975996 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d40146c0 con 0x7fc8c8005230 2024-09-13T18:31:50.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.293+0000 7fc8e11f0700 1 -- 172.21.15.44:0/4045975996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8c8005230 msgr2=0x7fc8c800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:50.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.293+0000 7fc8e11f0700 1 --2- 172.21.15.44:0/4045975996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8c8005230 0x7fc8c800ba30 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400e350 tx=0x7fc8c80058a0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.293+0000 7fc8e11f0700 1 -- 172.21.15.44:0/4045975996 shutdown_connections 2024-09-13T18:31:50.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.293+0000 7fc8e11f0700 1 --2- 172.21.15.44:0/4045975996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8c8005230 0x7fc8c800ba30 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.293+0000 7fc8e11f0700 1 -- 172.21.15.44:0/4045975996 >> 172.21.15.44:0/4045975996 conn(0x7fc8dc0b0d30 msgr2=0x7fc8dc06fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:50.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.293+0000 7fc8e11f0700 1 -- 172.21.15.44:0/4045975996 shutdown_connections 2024-09-13T18:31:50.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.293+0000 7fc8e11f0700 1 -- 172.21.15.44:0/4045975996 wait complete. 2024-09-13T18:31:50.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.293+0000 7fc8e11f0700 1 Processor -- start 2024-09-13T18:31:50.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.293+0000 7fc8e11f0700 1 -- start start 2024-09-13T18:31:50.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.297+0000 7fc8e11f0700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8c8005230 0x7fc8dc1411b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:50.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.297+0000 7fc8e11f0700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc8dc06ca60 0x7fc8dc0ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:50.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.297+0000 7fc8e11f0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8dc06c0d0 0x7fc8dc0abe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:50.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.297+0000 7fc8e11f0700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc06a310 con 0x7fc8dc06c0d0 2024-09-13T18:31:50.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.297+0000 7fc8e11f0700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc0ac350 con 0x7fc8c8005230 2024-09-13T18:31:50.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.297+0000 7fc8e11f0700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc06cef0 con 0x7fc8dc06ca60 2024-09-13T18:31:50.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.297+0000 7fc8dbfff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8c8005230 0x7fc8dc1411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:50.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.297+0000 7fc8d37fe700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc8dc06ca60 0x7fc8dc0ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:50.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.297+0000 7fc8dbfff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8c8005230 0x7fc8dc1411b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:48140/0 (socket says 172.21.15.44:48140) 2024-09-13T18:31:50.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.297+0000 7fc8dbfff700 1 -- 172.21.15.44:0/2064301545 learned_addr learned my addr 172.21.15.44:0/2064301545 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:50.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.297+0000 7fc8e09ef700 1 --2- 172.21.15.44:0/2064301545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8dc06c0d0 0x7fc8dc0abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:50.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.297+0000 7fc8e09ef700 1 -- 172.21.15.44:0/2064301545 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc8dc06ca60 msgr2=0x7fc8dc0ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:50.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.297+0000 7fc8e09ef700 1 --2- 172.21.15.44:0/2064301545 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc8dc06ca60 0x7fc8dc0ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.297+0000 7fc8e09ef700 1 -- 172.21.15.44:0/2064301545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8c8005230 msgr2=0x7fc8dc1411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:50.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.297+0000 7fc8e09ef700 1 --2- 172.21.15.44:0/2064301545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8c8005230 0x7fc8dc1411b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.297+0000 7fc8e09ef700 1 -- 172.21.15.44:0/2064301545 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc06d1d0 con 0x7fc8dc06c0d0 2024-09-13T18:31:50.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.297+0000 7fc8e09ef700 1 --2- 172.21.15.44:0/2064301545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8dc06c0d0 0x7fc8dc0abe10 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc1468e0 tx=0x7fc8d4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:50.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.297+0000 7fc8d97fa700 1 -- 172.21.15.44:0/2064301545 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4007000 con 0x7fc8dc06c0d0 2024-09-13T18:31:50.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.297+0000 7fc8d97fa700 1 -- 172.21.15.44:0/2064301545 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d4021070 con 0x7fc8dc06c0d0 2024-09-13T18:31:50.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.297+0000 7fc8e11f0700 1 -- 172.21.15.44:0/2064301545 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8dc06a520 con 0x7fc8dc06c0d0 2024-09-13T18:31:50.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.297+0000 7fc8d97fa700 1 -- 172.21.15.44:0/2064301545 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d401d660 con 0x7fc8dc06c0d0 2024-09-13T18:31:50.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.297+0000 7fc8e11f0700 1 -- 172.21.15.44:0/2064301545 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8dc1416f0 con 0x7fc8dc06c0d0 2024-09-13T18:31:50.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.297+0000 7fc8e11f0700 1 -- 172.21.15.44:0/2064301545 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8dc06d3c0 con 0x7fc8dc06c0d0 2024-09-13T18:31:50.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.301+0000 7fc8d97fa700 1 -- 172.21.15.44:0/2064301545 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc8d401d7c0 con 0x7fc8dc06c0d0 2024-09-13T18:31:50.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.301+0000 7fc8d97fa700 1 --2- 172.21.15.44:0/2064301545 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc8bc066730 0x7fc8bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:50.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.301+0000 7fc8d97fa700 1 -- 172.21.15.44:0/2064301545 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fc8d4085590 con 0x7fc8dc06c0d0 2024-09-13T18:31:50.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.301+0000 7fc8dbfff700 1 --2- 172.21.15.44:0/2064301545 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc8bc066730 0x7fc8bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:50.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.305+0000 7fc8dbfff700 1 --2- 172.21.15.44:0/2064301545 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc8bc066730 0x7fc8bc068bf0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc009c50 tx=0x7fc8cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:50.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.313+0000 7fc8d97fa700 1 -- 172.21.15.44:0/2064301545 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc8dc06d3c0 con 0x7fc8dc06c0d0 2024-09-13T18:31:50.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.517+0000 7fc8e11f0700 1 -- 172.21.15.44:0/2064301545 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8dc06d3c0 con 0x7fc8dc06c0d0 2024-09-13T18:31:50.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.517+0000 7fc8d97fa700 1 -- 172.21.15.44:0/2064301545 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4736 (secure 0 0 0) 0x7fc8dc06d3c0 con 0x7fc8dc06c0d0 2024-09-13T18:31:50.527 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:31:50.527 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5447,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2081931615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2081931615},{"type":"v1","addr":"172.21.15.99:6835","nonce":2081931615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5639,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1452559390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1452559390},{"type":"v1","addr":"172.21.15.44:6835","nonce":1452559390}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5887,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/2337853364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2337853364},{"type":"v1","addr":"172.21.15.99:6837","nonce":2337853364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:29:10.283572+0000","modified":"2024-09-13T18:31:49.597435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":51,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5976},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5976":{"gid":5976,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":44,"addr":"172.21.15.44:6833/3567136594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3567136594},{"type":"v1","addr":"172.21.15.44:6833","nonce":3567136594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:31:50.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.521+0000 7fc8e11f0700 1 -- 172.21.15.44:0/2064301545 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc8bc066730 msgr2=0x7fc8bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:50.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.521+0000 7fc8e11f0700 1 --2- 172.21.15.44:0/2064301545 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc8bc066730 0x7fc8bc068bf0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc009c50 tx=0x7fc8cc008040 comp rx=0 tx=0).stop 2024-09-13T18:31:50.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.521+0000 7fc8e11f0700 1 -- 172.21.15.44:0/2064301545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8dc06c0d0 msgr2=0x7fc8dc0abe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:50.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.521+0000 7fc8e11f0700 1 --2- 172.21.15.44:0/2064301545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8dc06c0d0 0x7fc8dc0abe10 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc1468e0 tx=0x7fc8d4009750 comp rx=0 tx=0).stop 2024-09-13T18:31:50.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.521+0000 7fc8e11f0700 1 -- 172.21.15.44:0/2064301545 shutdown_connections 2024-09-13T18:31:50.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.521+0000 7fc8e11f0700 1 --2- 172.21.15.44:0/2064301545 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc8bc066730 0x7fc8bc068bf0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.521+0000 7fc8e11f0700 1 --2- 172.21.15.44:0/2064301545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8dc06c0d0 0x7fc8dc0abe10 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.521+0000 7fc8e11f0700 1 --2- 172.21.15.44:0/2064301545 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc8dc06ca60 0x7fc8dc0ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.521+0000 7fc8e11f0700 1 --2- 172.21.15.44:0/2064301545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8c8005230 0x7fc8dc1411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.521+0000 7fc8e11f0700 1 -- 172.21.15.44:0/2064301545 >> 172.21.15.44:0/2064301545 conn(0x7fc8dc0b0d30 msgr2=0x7fc8dc15d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:50.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.521+0000 7fc8e11f0700 1 -- 172.21.15.44:0/2064301545 shutdown_connections 2024-09-13T18:31:50.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:50.521+0000 7fc8e11f0700 1 -- 172.21.15.44:0/2064301545 wait complete. 2024-09-13T18:31:50.531 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 38 2024-09-13T18:31:50.945 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:29:10.283572+0000', 'modified': '2024-09-13T18:31:49.597435+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 51, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5976}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5976': {'gid': 5976, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 44, 'addr': '172.21.15.44:6833/3567136594', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 3567136594}, {'type': 'v1', 'addr': '172.21.15.44:6833', 'nonce': 3567136594}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:31:50.945 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:31:50.946 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:31:51.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.061+0000 7f3f0d47e700 1 Processor -- start 2024-09-13T18:31:51.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.061+0000 7f3f0d47e700 1 -- start start 2024-09-13T18:31:51.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.065+0000 7f3f0d47e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3f081573e0 0x7f3f08070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.065+0000 7f3f0d47e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f08071540 con 0x7f3f0815a630 2024-09-13T18:31:51.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.065+0000 7f3f0d47e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0815ac50 con 0x7f3f080710e0 2024-09-13T18:31:51.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.065+0000 7f3f0d47e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f080cc1b0 con 0x7f3f081573e0 2024-09-13T18:31:51.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.065+0000 7f3f0cc7d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3f0815a630 0x7f3f0806c3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52950/0 (socket says 172.21.15.44:52950) 2024-09-13T18:31:51.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.065+0000 7f3f07fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3f081573e0 0x7f3f08070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.065+0000 7f3f0cc7d700 1 -- 172.21.15.44:0/3368024094 learned_addr learned my addr 172.21.15.44:0/3368024094 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:31:51.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.065+0000 7f3f07fff700 1 -- 172.21.15.44:0/3368024094 >> v1:172.21.15.99:6789/0 conn(0x7f3f080710e0 legacy=0x7f3f08159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.065+0000 7f3f07fff700 1 -- 172.21.15.44:0/3368024094 >> v1:172.21.15.44:6789/0 conn(0x7f3f0815a630 legacy=0x7f3f0806c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.065+0000 7f3f07fff700 1 -- 172.21.15.44:0/3368024094 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f080cb3f0 con 0x7f3f081573e0 2024-09-13T18:31:51.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.065+0000 7f3f077fe700 1 -- 172.21.15.44:0/3368024094 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 430662677 0 0) 0x7f3f08071540 con 0x7f3f0815a630 2024-09-13T18:31:51.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.065+0000 7f3f07fff700 1 --2- 172.21.15.44:0/3368024094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f081573e0 0x7f3f08070ba0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8009850 tx=0x7f3ef8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77948ca694eb9e88 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:51.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.065+0000 7f3f077fe700 1 -- 172.21.15.44:0/3368024094 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef800f8a0 con 0x7f3f081573e0 2024-09-13T18:31:51.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.065+0000 7f3f077fe700 1 -- 172.21.15.44:0/3368024094 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef800fa00 con 0x7f3f081573e0 2024-09-13T18:31:51.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.065+0000 7f3f077fe700 1 -- 172.21.15.44:0/3368024094 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef800fd90 con 0x7f3f081573e0 2024-09-13T18:31:51.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.065+0000 7f3f0d47e700 1 -- 172.21.15.44:0/3368024094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f081573e0 msgr2=0x7f3f08070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.065+0000 7f3f0d47e700 1 --2- 172.21.15.44:0/3368024094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f081573e0 0x7f3f08070ba0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8009850 tx=0x7f3ef8009b60 comp rx=0 tx=0).stop 2024-09-13T18:31:51.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.065+0000 7f3f0d47e700 1 -- 172.21.15.44:0/3368024094 shutdown_connections 2024-09-13T18:31:51.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.065+0000 7f3f0d47e700 1 --2- 172.21.15.44:0/3368024094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f081573e0 0x7f3f08070ba0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.065+0000 7f3f0d47e700 1 -- 172.21.15.44:0/3368024094 >> 172.21.15.44:0/3368024094 conn(0x7f3f080b0e10 msgr2=0x7f3f080b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:51.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.065+0000 7f3f0d47e700 1 -- 172.21.15.44:0/3368024094 shutdown_connections 2024-09-13T18:31:51.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.065+0000 7f3f0d47e700 1 -- 172.21.15.44:0/3368024094 wait complete. 2024-09-13T18:31:51.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.069+0000 7f3f0d47e700 1 Processor -- start 2024-09-13T18:31:51.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.069+0000 7f3f0d47e700 1 -- start start 2024-09-13T18:31:51.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.069+0000 7f3f0d47e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f080710e0 0x7f3f08152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.069+0000 7f3f0d47e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f081573e0 0x7f3f08152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.069+0000 7f3f0d47e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f0815a630 0x7f3f08159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.069+0000 7f3f0d47e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f081581a0 con 0x7f3f0815a630 2024-09-13T18:31:51.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.069+0000 7f3f0d47e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f08158480 con 0x7f3f080710e0 2024-09-13T18:31:51.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.069+0000 7f3f0d47e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f08158760 con 0x7f3f081573e0 2024-09-13T18:31:51.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.069+0000 7f3f0cc7d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f0815a630 0x7f3f08159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.069+0000 7f3f0cc7d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f0815a630 0x7f3f08159240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60616/0 (socket says 172.21.15.44:60616) 2024-09-13T18:31:51.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.069+0000 7f3f0cc7d700 1 -- 172.21.15.44:0/1326757751 learned_addr learned my addr 172.21.15.44:0/1326757751 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:51.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.069+0000 7f3f07fff700 1 --2- 172.21.15.44:0/1326757751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f080710e0 0x7f3f08152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.069+0000 7f3eff7fe700 1 --2- 172.21.15.44:0/1326757751 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f081573e0 0x7f3f08152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.073+0000 7f3f0cc7d700 1 -- 172.21.15.44:0/1326757751 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f081573e0 msgr2=0x7f3f08152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.073+0000 7f3f0cc7d700 1 --2- 172.21.15.44:0/1326757751 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f081573e0 0x7f3f08152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.073+0000 7f3f0cc7d700 1 -- 172.21.15.44:0/1326757751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f080710e0 msgr2=0x7f3f08152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.073+0000 7f3f0cc7d700 1 --2- 172.21.15.44:0/1326757751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f080710e0 0x7f3f08152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.073+0000 7f3f0cc7d700 1 -- 172.21.15.44:0/1326757751 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef80094b0 con 0x7f3f0815a630 2024-09-13T18:31:51.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.073+0000 7f3f07fff700 1 --2- 172.21.15.44:0/1326757751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f080710e0 0x7f3f08152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:51.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.073+0000 7f3f0cc7d700 1 --2- 172.21.15.44:0/1326757751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f0815a630 0x7f3f08159240 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000cb60 tx=0x7f3f0000ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:51.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.073+0000 7f3f057fa700 1 -- 172.21.15.44:0/1326757751 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0000aaa0 con 0x7f3f0815a630 2024-09-13T18:31:51.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.073+0000 7f3f057fa700 1 -- 172.21.15.44:0/1326757751 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0000ac00 con 0x7f3f0815a630 2024-09-13T18:31:51.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.073+0000 7f3f0d47e700 1 -- 172.21.15.44:0/1326757751 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f08158a40 con 0x7f3f0815a630 2024-09-13T18:31:51.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.073+0000 7f3f057fa700 1 -- 172.21.15.44:0/1326757751 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f000070d0 con 0x7f3f0815a630 2024-09-13T18:31:51.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.073+0000 7f3f0d47e700 1 -- 172.21.15.44:0/1326757751 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f081527c0 con 0x7f3f0815a630 2024-09-13T18:31:51.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3f057fa700 1 -- 172.21.15.44:0/1326757751 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3f00007230 con 0x7f3f0815a630 2024-09-13T18:31:51.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3f057fa700 1 --2- 172.21.15.44:0/1326757751 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3ee8066730 0x7f3ee8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3f057fa700 1 -- 172.21.15.44:0/1326757751 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f3f00083cb0 con 0x7f3f0815a630 2024-09-13T18:31:51.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3f11991740 1 Processor -- start 2024-09-13T18:31:51.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3f11991740 1 -- start start 2024-09-13T18:31:51.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3f07fff700 1 --2- 172.21.15.44:0/1326757751 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3ee8066730 0x7f3ee8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3f07fff700 1 --2- 172.21.15.44:0/1326757751 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3ee8066730 0x7f3ee8068bf0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80090b0 tx=0x7f3ef801b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:51.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3f11991740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1f164f0 0x1ef56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3f11991740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1ef5200 0x1f168d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3f11991740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1f16e10 0x1ecbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3f11991740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e3dd80 con 0x1f164f0 2024-09-13T18:31:51.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3f11991740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e3b510 con 0x1f16e10 2024-09-13T18:31:51.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3f11991740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e36e00 con 0x1ef5200 2024-09-13T18:31:51.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3f07fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1f164f0 0x1ef56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3f07fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1f164f0 0x1ef56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60618/0 (socket says 172.21.15.44:60618) 2024-09-13T18:31:51.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3f07fff700 1 -- 172.21.15.44:0/267613805 learned_addr learned my addr 172.21.15.44:0/267613805 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:51.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3eff7fe700 1 --2- 172.21.15.44:0/267613805 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1ef5200 0x1f168d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3f0cc7d700 1 --2- 172.21.15.44:0/267613805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1f16e10 0x1ecbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3f07fff700 1 -- 172.21.15.44:0/267613805 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1ef5200 msgr2=0x1f168d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:51.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3f07fff700 1 --2- 172.21.15.44:0/267613805 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1ef5200 0x1f168d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3f07fff700 1 -- 172.21.15.44:0/267613805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1f16e10 msgr2=0x1ecbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3f07fff700 1 --2- 172.21.15.44:0/267613805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1f16e10 0x1ecbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3f07fff700 1 -- 172.21.15.44:0/267613805 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1ca9960 con 0x1f164f0 2024-09-13T18:31:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3eff7fe700 1 --2- 172.21.15.44:0/267613805 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1ef5200 0x1f168d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3f07fff700 1 --2- 172.21.15.44:0/267613805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1f164f0 0x1ef56a0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f3f080b3c80 tx=0x7f3ef8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0484937f28aaa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3efdffb700 1 -- 172.21.15.44:0/267613805 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef801e040 con 0x1f164f0 2024-09-13T18:31:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.077+0000 7f3efdffb700 1 -- 172.21.15.44:0/267613805 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef802b040 con 0x1f164f0 2024-09-13T18:31:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3efdffb700 1 -- 172.21.15.44:0/267613805 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8025880 con 0x1f164f0 2024-09-13T18:31:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f11991740 1 -- 172.21.15.44:0/267613805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1f164f0 msgr2=0x1ef56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f11991740 1 --2- 172.21.15.44:0/267613805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1f164f0 0x1ef56a0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f3f080b3c80 tx=0x7f3ef8012000 comp rx=0 tx=0).stop 2024-09-13T18:31:51.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f11991740 1 -- 172.21.15.44:0/267613805 shutdown_connections 2024-09-13T18:31:51.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f11991740 1 --2- 172.21.15.44:0/267613805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1f16e10 0x1ecbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f11991740 1 --2- 172.21.15.44:0/267613805 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1ef5200 0x1f168d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f11991740 1 --2- 172.21.15.44:0/267613805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1f164f0 0x1ef56a0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f11991740 1 -- 172.21.15.44:0/267613805 >> 172.21.15.44:0/267613805 conn(0x1c5e4d0 msgr2=0x1ef7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:51.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f11991740 1 -- 172.21.15.44:0/267613805 shutdown_connections 2024-09-13T18:31:51.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f11991740 1 -- 172.21.15.44:0/267613805 wait complete. 2024-09-13T18:31:51.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f11991740 1 -- start start 2024-09-13T18:31:51.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f11991740 1 Processor -- start 2024-09-13T18:31:51.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f11991740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1ef5200 0x1ef7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f11991740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1f164f0 0x1f1c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f11991740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1f16e10 0x1ef4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f11991740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x1df4730 con 0x1ef5200 2024-09-13T18:31:51.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f11991740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x1dfa5b0 con 0x1f164f0 2024-09-13T18:31:51.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f11991740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ce2aa0 con 0x1f16e10 2024-09-13T18:31:51.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f11991740 10 client.0 _ll_register_callbacks cb 0x1e30610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:31:51.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f07fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1ef5200 0x1ef7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f07fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1ef5200 0x1ef7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60634/0 (socket says 172.21.15.44:60634) 2024-09-13T18:31:51.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f07fff700 1 -- 172.21.15.44:0/1706842709 learned_addr learned my addr 172.21.15.44:0/1706842709 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:51.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3eff7fe700 1 --2- 172.21.15.44:0/1706842709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1f164f0 0x1f1c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f0cc7d700 1 --2- 172.21.15.44:0/1706842709 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1f16e10 0x1ef4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f07fff700 1 -- 172.21.15.44:0/1706842709 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1f16e10 msgr2=0x1ef4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:51.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f07fff700 1 --2- 172.21.15.44:0/1706842709 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1f16e10 0x1ef4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f07fff700 1 -- 172.21.15.44:0/1706842709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1f164f0 msgr2=0x1f1c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:51.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f07fff700 1 --2- 172.21.15.44:0/1706842709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1f164f0 0x1f1c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f07fff700 1 -- 172.21.15.44:0/1706842709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f080cb3f0 con 0x1ef5200 2024-09-13T18:31:51.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.081+0000 7f3f0cc7d700 1 --2- 172.21.15.44:0/1706842709 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1f16e10 0x1ef4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:51.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3f07fff700 1 --2- 172.21.15.44:0/1706842709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1ef5200 0x1ef7680 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8032040 tx=0x7f3ef80047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e717566bbf709a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:51.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3ee6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-13T18:31:51.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3ee6ffd700 1 -- 172.21.15.44:0/1706842709 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef801e070 con 0x1ef5200 2024-09-13T18:31:51.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3ee6ffd700 1 -- 172.21.15.44:0/1706842709 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f3ef8010e30 con 0x1ef5200 2024-09-13T18:31:51.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3f11991740 1 -- 172.21.15.44:0/1706842709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1c6b1e0 con 0x1ef5200 2024-09-13T18:31:51.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3ee6ffd700 1 -- 172.21.15.44:0/1706842709 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ef8039b40 con 0x1ef5200 2024-09-13T18:31:51.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3f11991740 10 client.6633 fetch_fsmap learned FSMap version 38 2024-09-13T18:31:51.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3f11991740 1 -- 172.21.15.44:0/1706842709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x1dfd220 con 0x1ef5200 2024-09-13T18:31:51.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3ee6ffd700 1 -- 172.21.15.44:0/1706842709 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1c6b1e0 con 0x1ef5200 2024-09-13T18:31:51.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3ee6ffd700 1 -- 172.21.15.44:0/1706842709 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 38) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3ef8036030 con 0x1ef5200 2024-09-13T18:31:51.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3f11991740 10 client.6633 fetch_fsmap finished waiting for FSMap version 38 2024-09-13T18:31:51.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3f11991740 10 client.6633 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:31:51.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3f11991740 20 client.6633 populate_metadata read hostname 'smithi044' 2024-09-13T18:31:51.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3f11991740 1 --2- 172.21.15.44:0/1706842709 >> [v2:172.21.15.44:6832/3567136594,v1:172.21.15.44:6833/3567136594] conn(0x1f155c0 0x1f159a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3f11991740 4 client.6633 mds_command: new command op to 5976 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:31:51.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3f11991740 1 -- 172.21.15.44:0/1706842709 --> [v2:172.21.15.44:6832/3567136594,v1:172.21.15.44:6833/3567136594] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1cb5460 con 0x1f155c0 2024-09-13T18:31:51.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3eff7fe700 1 --2- 172.21.15.44:0/1706842709 >> [v2:172.21.15.44:6832/3567136594,v1:172.21.15.44:6833/3567136594] conn(0x1f155c0 0x1f159a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3ee6ffd700 10 client.6633 ms_handle_connect on v2:172.21.15.44:6832/3567136594 2024-09-13T18:31:51.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3eff7fe700 1 --2- 172.21.15.44:0/1706842709 >> [v2:172.21.15.44:6832/3567136594,v1:172.21.15.44:6833/3567136594] conn(0x1f155c0 0x1f159a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7079ebc3e6e52e46 server_cookie=75962a1954f4f8bb in_seq=0 out_seq=0 2024-09-13T18:31:51.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3ee6ffd700 1 -- 172.21.15.44:0/1706842709 <== mds.0 v2:172.21.15.44:6832/3567136594 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x1cb5460 con 0x1f155c0 2024-09-13T18:31:51.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3ee6ffd700 10 client.6633 handle_command_reply: tid=0 2024-09-13T18:31:51.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3f11991740 1 client.6633 shutdown 2024-09-13T18:31:51.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3f11991740 1 -- 172.21.15.44:0/1706842709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1ef5200 msgr2=0x1ef7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3f11991740 1 --2- 172.21.15.44:0/1706842709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1ef5200 0x1ef7680 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8032040 tx=0x7f3ef80047e0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3f11991740 1 -- 172.21.15.44:0/1706842709 shutdown_connections 2024-09-13T18:31:51.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3f11991740 1 --2- 172.21.15.44:0/1706842709 >> [v2:172.21.15.44:6832/3567136594,v1:172.21.15.44:6833/3567136594] conn(0x1f155c0 0x1f159a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3f11991740 1 --2- 172.21.15.44:0/1706842709 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1f16e10 0x1ef4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3f11991740 1 --2- 172.21.15.44:0/1706842709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1f164f0 0x1f1c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3f11991740 1 --2- 172.21.15.44:0/1706842709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1ef5200 0x1ef7680 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3ee6ffd700 0 client.6633 ms_handle_reset on v2:172.21.15.44:6832/3567136594 2024-09-13T18:31:51.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3f11991740 1 -- 172.21.15.44:0/1706842709 >> 172.21.15.44:0/1706842709 conn(0x1c5e4d0 msgr2=0x1ecdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:51.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3f11991740 1 -- 172.21.15.44:0/1706842709 shutdown_connections 2024-09-13T18:31:51.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3f11991740 1 -- 172.21.15.44:0/1706842709 wait complete. 2024-09-13T18:31:51.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.085+0000 7f3f11991740 20 client.6633 trim_cache size 0 max 16384 2024-09-13T18:31:51.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.105+0000 7f3f11991740 1 Processor -- start 2024-09-13T18:31:51.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.105+0000 7f3f11991740 1 -- start start 2024-09-13T18:31:51.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.105+0000 7f3f11991740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1ef5200 0x1ed08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.105+0000 7f3f11991740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1f164f0 0x1ed0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.105+0000 7f3f11991740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1f16e10 0x1ef4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.105+0000 7f3f11991740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e35ab0 con 0x1f16e10 2024-09-13T18:31:51.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.105+0000 7f3f11991740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e65ec0 con 0x1ef5200 2024-09-13T18:31:51.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.105+0000 7f3f11991740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e376c0 con 0x1f164f0 2024-09-13T18:31:51.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.105+0000 7f3f0cc7d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1f16e10 0x1ef4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.105+0000 7f3f0cc7d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1f16e10 0x1ef4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60636/0 (socket says 172.21.15.44:60636) 2024-09-13T18:31:51.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.105+0000 7f3f0cc7d700 1 -- 172.21.15.44:0/1725229049 learned_addr learned my addr 172.21.15.44:0/1725229049 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:51.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.105+0000 7f3f07fff700 1 --2- 172.21.15.44:0/1725229049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1ef5200 0x1ed08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.105+0000 7f3eff7fe700 1 --2- 172.21.15.44:0/1725229049 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1f164f0 0x1ed0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.105+0000 7f3f0cc7d700 1 -- 172.21.15.44:0/1725229049 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1f164f0 msgr2=0x1ed0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:51.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.105+0000 7f3f0cc7d700 1 --2- 172.21.15.44:0/1725229049 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1f164f0 0x1ed0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.105+0000 7f3f0cc7d700 1 -- 172.21.15.44:0/1725229049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1ef5200 msgr2=0x1ed08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:51.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.105+0000 7f3f0cc7d700 1 --2- 172.21.15.44:0/1725229049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1ef5200 0x1ed08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.105+0000 7f3f0cc7d700 1 -- 172.21.15.44:0/1725229049 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1de3450 con 0x1f16e10 2024-09-13T18:31:51.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.105+0000 7f3f0cc7d700 1 --2- 172.21.15.44:0/1725229049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1f16e10 0x1ef4060 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3f000070a0 tx=0x7f3f00055350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a2fb5b15bf8f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:51.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.105+0000 7f3efe7fc700 1 -- 172.21.15.44:0/1725229049 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00054c50 con 0x1f16e10 2024-09-13T18:31:51.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.105+0000 7f3efe7fc700 1 -- 172.21.15.44:0/1725229049 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f00058a80 con 0x1f16e10 2024-09-13T18:31:51.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.105+0000 7f3efe7fc700 1 -- 172.21.15.44:0/1725229049 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0005d040 con 0x1f16e10 2024-09-13T18:31:51.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f11991740 1 -- 172.21.15.44:0/1725229049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1f16e10 msgr2=0x1ef4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f11991740 1 --2- 172.21.15.44:0/1725229049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1f16e10 0x1ef4060 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3f000070a0 tx=0x7f3f00055350 comp rx=0 tx=0).stop 2024-09-13T18:31:51.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f11991740 1 -- 172.21.15.44:0/1725229049 shutdown_connections 2024-09-13T18:31:51.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f11991740 1 --2- 172.21.15.44:0/1725229049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1f16e10 0x1ef4060 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f11991740 1 --2- 172.21.15.44:0/1725229049 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1f164f0 0x1ed0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f11991740 1 --2- 172.21.15.44:0/1725229049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1ef5200 0x1ed08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f11991740 1 -- 172.21.15.44:0/1725229049 >> 172.21.15.44:0/1725229049 conn(0x1c5e4d0 msgr2=0x1f1c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:51.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f11991740 1 -- 172.21.15.44:0/1725229049 shutdown_connections 2024-09-13T18:31:51.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f11991740 1 -- 172.21.15.44:0/1725229049 wait complete. 2024-09-13T18:31:51.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f11991740 1 -- start start 2024-09-13T18:31:51.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f11991740 1 Processor -- start 2024-09-13T18:31:51.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f11991740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1ef5200 0x1f76590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f11991740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1f164f0 0x1f77230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f11991740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1f16e10 0x1f77770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f11991740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x1df4730 con 0x1f16e10 2024-09-13T18:31:51.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f11991740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x1dd5470 con 0x1ef5200 2024-09-13T18:31:51.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f11991740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f34eb0 con 0x1f164f0 2024-09-13T18:31:51.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f11991740 10 client.0 _ll_register_callbacks cb 0x7f3ef800f8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:31:51.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f0cc7d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1f16e10 0x1f77770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f0cc7d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1f16e10 0x1f77770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60648/0 (socket says 172.21.15.44:60648) 2024-09-13T18:31:51.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f0cc7d700 1 -- 172.21.15.44:0/2893616893 learned_addr learned my addr 172.21.15.44:0/2893616893 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:51.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f07fff700 1 --2- 172.21.15.44:0/2893616893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1ef5200 0x1f76590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3eff7fe700 1 --2- 172.21.15.44:0/2893616893 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1f164f0 0x1f77230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f0cc7d700 1 -- 172.21.15.44:0/2893616893 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1f164f0 msgr2=0x1f77230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:51.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f0cc7d700 1 --2- 172.21.15.44:0/2893616893 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1f164f0 0x1f77230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f0cc7d700 1 -- 172.21.15.44:0/2893616893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1ef5200 msgr2=0x1f76590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:51.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f0cc7d700 1 --2- 172.21.15.44:0/2893616893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1ef5200 0x1f76590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f0cc7d700 1 -- 172.21.15.44:0/2893616893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f081527c0 con 0x1f16e10 2024-09-13T18:31:51.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3eff7fe700 1 --2- 172.21.15.44:0/2893616893 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1f164f0 0x1f77230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:51.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f0cc7d700 1 --2- 172.21.15.44:0/2893616893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1f16e10 0x1f77770 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3f00054900 tx=0x7f3f0000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7d21a90e67e496 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:51.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3ee6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-13T18:31:51.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3ee6ffd700 1 -- 172.21.15.44:0/2893616893 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0005cdb0 con 0x1f16e10 2024-09-13T18:31:51.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f11991740 1 -- 172.21.15.44:0/2893616893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3ef802b040 con 0x1f16e10 2024-09-13T18:31:51.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3ee6ffd700 1 -- 172.21.15.44:0/2893616893 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f3f0005d040 con 0x1f16e10 2024-09-13T18:31:51.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3ee6ffd700 1 -- 172.21.15.44:0/2893616893 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f00050a40 con 0x1f16e10 2024-09-13T18:31:51.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f11991740 10 client.6639 fetch_fsmap learned FSMap version 38 2024-09-13T18:31:51.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.109+0000 7f3f11991740 1 -- 172.21.15.44:0/2893616893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x1dd7720 con 0x1f16e10 2024-09-13T18:31:51.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3ee6ffd700 1 -- 172.21.15.44:0/2893616893 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef802b040 con 0x1f16e10 2024-09-13T18:31:51.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3ee6ffd700 1 -- 172.21.15.44:0/2893616893 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 38) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3f00050ba0 con 0x1f16e10 2024-09-13T18:31:51.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f11991740 10 client.6639 fetch_fsmap finished waiting for FSMap version 38 2024-09-13T18:31:51.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f11991740 10 client.6639 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:31:51.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f11991740 20 client.6639 populate_metadata read hostname 'smithi044' 2024-09-13T18:31:51.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f11991740 1 --2- 172.21.15.44:0/2893616893 >> [v2:172.21.15.44:6832/3567136594,v1:172.21.15.44:6833/3567136594] conn(0x1f77cb0 0x1f78090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f11991740 4 client.6639 mds_command: new command op to 5976 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:31:51.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f11991740 1 -- 172.21.15.44:0/2893616893 --> [v2:172.21.15.44:6832/3567136594,v1:172.21.15.44:6833/3567136594] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1cda1e0 con 0x1f77cb0 2024-09-13T18:31:51.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f07fff700 1 --2- 172.21.15.44:0/2893616893 >> [v2:172.21.15.44:6832/3567136594,v1:172.21.15.44:6833/3567136594] conn(0x1f77cb0 0x1f78090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3ee6ffd700 10 client.6639 ms_handle_connect on v2:172.21.15.44:6832/3567136594 2024-09-13T18:31:51.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f07fff700 1 --2- 172.21.15.44:0/2893616893 >> [v2:172.21.15.44:6832/3567136594,v1:172.21.15.44:6833/3567136594] conn(0x1f77cb0 0x1f78090 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be50d34bdf7fc860 server_cookie=cc5cd8a115b463a7 in_seq=0 out_seq=0 2024-09-13T18:31:51.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3ee6ffd700 1 -- 172.21.15.44:0/2893616893 <== mds.0 v2:172.21.15.44:6832/3567136594 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x1cda1e0 con 0x1f77cb0 2024-09-13T18:31:51.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3ee6ffd700 10 client.6639 handle_command_reply: tid=0 2024-09-13T18:31:51.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f11991740 1 client.6639 shutdown 2024-09-13T18:31:51.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f11991740 1 -- 172.21.15.44:0/2893616893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1f16e10 msgr2=0x1f77770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f11991740 1 --2- 172.21.15.44:0/2893616893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1f16e10 0x1f77770 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3f00054900 tx=0x7f3f0000cf90 comp rx=0 tx=0).stop 2024-09-13T18:31:51.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f11991740 1 -- 172.21.15.44:0/2893616893 shutdown_connections 2024-09-13T18:31:51.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f11991740 1 --2- 172.21.15.44:0/2893616893 >> [v2:172.21.15.44:6832/3567136594,v1:172.21.15.44:6833/3567136594] conn(0x1f77cb0 0x1f78090 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f11991740 1 --2- 172.21.15.44:0/2893616893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1f16e10 0x1f77770 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3ee6ffd700 0 client.6639 ms_handle_reset on v2:172.21.15.44:6832/3567136594 2024-09-13T18:31:51.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f11991740 1 --2- 172.21.15.44:0/2893616893 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1f164f0 0x1f77230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f11991740 1 --2- 172.21.15.44:0/2893616893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1ef5200 0x1f76590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f11991740 1 -- 172.21.15.44:0/2893616893 >> 172.21.15.44:0/2893616893 conn(0x1c5e4d0 msgr2=0x1ed08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:51.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f11991740 1 -- 172.21.15.44:0/2893616893 shutdown_connections 2024-09-13T18:31:51.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f11991740 1 -- 172.21.15.44:0/2893616893 wait complete. 2024-09-13T18:31:51.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f11991740 20 client.6639 trim_cache size 0 max 16384 2024-09-13T18:31:51.138 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:31:51.139 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "c8e1d12d-7fb9-4a33-982e-b895bb77262c", 2024-09-13T18:31:51.139 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-13T18:31:51.139 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 5976, 2024-09-13T18:31:51.139 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-13T18:31:51.139 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-13T18:31:51.139 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-13T18:31:51.139 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 4.5311648629999999, 2024-09-13T18:31:51.139 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 38, 2024-09-13T18:31:51.139 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 51, 2024-09-13T18:31:51.139 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 51, 2024-09-13T18:31:51.139 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 165.23037366400001 2024-09-13T18:31:51.140 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:31:51.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f0d47e700 1 -- 172.21.15.44:0/1326757751 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3ee8066730 msgr2=0x7f3ee8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f0d47e700 1 --2- 172.21.15.44:0/1326757751 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3ee8066730 0x7f3ee8068bf0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80090b0 tx=0x7f3ef801b040 comp rx=0 tx=0).stop 2024-09-13T18:31:51.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f0d47e700 1 -- 172.21.15.44:0/1326757751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f0815a630 msgr2=0x7f3f08159240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f0d47e700 1 --2- 172.21.15.44:0/1326757751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f0815a630 0x7f3f08159240 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000cb60 tx=0x7f3f0000ce70 comp rx=0 tx=0).stop 2024-09-13T18:31:51.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f0d47e700 1 -- 172.21.15.44:0/1326757751 shutdown_connections 2024-09-13T18:31:51.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f0d47e700 1 --2- 172.21.15.44:0/1326757751 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3ee8066730 0x7f3ee8068bf0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f0d47e700 1 --2- 172.21.15.44:0/1326757751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f0815a630 0x7f3f08159240 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f0d47e700 1 --2- 172.21.15.44:0/1326757751 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f081573e0 0x7f3f08152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f0d47e700 1 --2- 172.21.15.44:0/1326757751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f080710e0 0x7f3f08152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f0d47e700 1 -- 172.21.15.44:0/1326757751 >> 172.21.15.44:0/1326757751 conn(0x7f3f080b0e10 msgr2=0x7f3f080b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:51.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f0d47e700 1 -- 172.21.15.44:0/1326757751 shutdown_connections 2024-09-13T18:31:51.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.113+0000 7f3f0d47e700 1 -- 172.21.15.44:0/1326757751 wait complete. 2024-09-13T18:31:51.142 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:31:51.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.253+0000 7f094a397700 1 Processor -- start 2024-09-13T18:31:51.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.253+0000 7f094a397700 1 -- start start 2024-09-13T18:31:51.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.257+0000 7f094a397700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f094406bcc0 0x7f094415a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.257+0000 7f094a397700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f094406b040 0x7f0944070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.257+0000 7f094a397700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0944071f10 con 0x7f09440cb2a0 2024-09-13T18:31:51.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.257+0000 7f094a397700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f094406a310 con 0x7f094406b040 2024-09-13T18:31:51.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.257+0000 7f094a397700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094406abb0 con 0x7f094406bcc0 2024-09-13T18:31:51.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.257+0000 7f0949395700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f094406bcc0 0x7f094415a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.257+0000 7f0949b96700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f094406b040 0x7f0944070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.257+0000 7f0949395700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f094406bcc0 0x7f094415a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:58984/0 (socket says 172.21.15.44:58984) 2024-09-13T18:31:51.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.257+0000 7f0949395700 1 -- 172.21.15.44:0/862021611 learned_addr learned my addr 172.21.15.44:0/862021611 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:51.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.257+0000 7f0949395700 1 -- 172.21.15.44:0/862021611 >> v2:172.21.15.99:3300/0 conn(0x7f094406b040 msgr2=0x7f0944070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:51.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.257+0000 7f0949395700 1 --2- 172.21.15.44:0/862021611 >> v2:172.21.15.99:3300/0 conn(0x7f094406b040 0x7f0944070320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.257+0000 7f0949395700 1 -- 172.21.15.44:0/862021611 >> v1:172.21.15.99:6789/0 conn(0x7f09440cb2a0 legacy=0x7f094406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.257+0000 7f0949395700 1 -- 172.21.15.44:0/862021611 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09440cba10 con 0x7f094406bcc0 2024-09-13T18:31:51.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.257+0000 7f0949b96700 1 --2- 172.21.15.44:0/862021611 >> v2:172.21.15.99:3300/0 conn(0x7f094406b040 0x7f0944070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:51.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.257+0000 7f0949395700 1 --2- 172.21.15.44:0/862021611 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f094406bcc0 0x7f094415a850 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0940009910 tx=0x7f0940009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f859fb13d581a0aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:51.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.257+0000 7f093bfff700 1 -- 172.21.15.44:0/862021611 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0940011830 con 0x7f094406bcc0 2024-09-13T18:31:51.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.257+0000 7f093bfff700 1 -- 172.21.15.44:0/862021611 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0940011990 con 0x7f094406bcc0 2024-09-13T18:31:51.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.257+0000 7f093bfff700 1 -- 172.21.15.44:0/862021611 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0940011d40 con 0x7f094406bcc0 2024-09-13T18:31:51.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.257+0000 7f094a397700 1 -- 172.21.15.44:0/862021611 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f094406bcc0 msgr2=0x7f094415a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.257+0000 7f094a397700 1 --2- 172.21.15.44:0/862021611 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f094406bcc0 0x7f094415a850 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0940009910 tx=0x7f0940009c20 comp rx=0 tx=0).stop 2024-09-13T18:31:51.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.261+0000 7f094a397700 1 -- 172.21.15.44:0/862021611 shutdown_connections 2024-09-13T18:31:51.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.261+0000 7f094a397700 1 --2- 172.21.15.44:0/862021611 >> v2:172.21.15.99:3300/0 conn(0x7f094406b040 0x7f0944070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.261+0000 7f094a397700 1 --2- 172.21.15.44:0/862021611 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f094406bcc0 0x7f094415a850 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.261+0000 7f094a397700 1 -- 172.21.15.44:0/862021611 >> 172.21.15.44:0/862021611 conn(0x7f094406d900 msgr2=0x7f094406dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:51.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.261+0000 7f094a397700 1 -- 172.21.15.44:0/862021611 shutdown_connections 2024-09-13T18:31:51.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.261+0000 7f094a397700 1 -- 172.21.15.44:0/862021611 wait complete. 2024-09-13T18:31:51.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.261+0000 7f094a397700 1 Processor -- start 2024-09-13T18:31:51.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.261+0000 7f094a397700 1 -- start start 2024-09-13T18:31:51.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.261+0000 7f094a397700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f094406b040 0x7f09441f2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.261+0000 7f094a397700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f094406bcc0 0x7f0944154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.261+0000 7f094a397700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f09441ec310 0x7f09441ec7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.261+0000 7f094a397700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09441ecd00 con 0x7f094406bcc0 2024-09-13T18:31:51.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.261+0000 7f094a397700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09441556e0 con 0x7f094406b040 2024-09-13T18:31:51.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.261+0000 7f094a397700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09441559c0 con 0x7f09441ec310 2024-09-13T18:31:51.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.261+0000 7f0948b94700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f094406bcc0 0x7f0944154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.261+0000 7f0949395700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f094406b040 0x7f09441f2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.261+0000 7f0948b94700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f094406bcc0 0x7f0944154010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60658/0 (socket says 172.21.15.44:60658) 2024-09-13T18:31:51.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.261+0000 7f0948b94700 1 -- 172.21.15.44:0/3403986363 learned_addr learned my addr 172.21.15.44:0/3403986363 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:31:51.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.261+0000 7f0949b96700 1 --2- 172.21.15.44:0/3403986363 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f09441ec310 0x7f09441ec7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.265+0000 7f0948b94700 1 -- 172.21.15.44:0/3403986363 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f09441ec310 msgr2=0x7f09441ec7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.265+0000 7f0948b94700 1 --2- 172.21.15.44:0/3403986363 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f09441ec310 0x7f09441ec7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.265+0000 7f0948b94700 1 -- 172.21.15.44:0/3403986363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f094406b040 msgr2=0x7f09441f2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.265+0000 7f0948b94700 1 --2- 172.21.15.44:0/3403986363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f094406b040 0x7f09441f2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.265+0000 7f0948b94700 1 -- 172.21.15.44:0/3403986363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c009a70 con 0x7f094406bcc0 2024-09-13T18:31:51.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.265+0000 7f0948b94700 1 --2- 172.21.15.44:0/3403986363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f094406bcc0 0x7f0944154010 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f093400c500 tx=0x7f093400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:51.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.265+0000 7f0939ffb700 1 -- 172.21.15.44:0/3403986363 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09340052d0 con 0x7f094406bcc0 2024-09-13T18:31:51.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.265+0000 7f0939ffb700 1 -- 172.21.15.44:0/3403986363 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0934005430 con 0x7f094406bcc0 2024-09-13T18:31:51.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.265+0000 7f094a397700 1 -- 172.21.15.44:0/3403986363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0940009570 con 0x7f094406bcc0 2024-09-13T18:31:51.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.265+0000 7f0939ffb700 1 -- 172.21.15.44:0/3403986363 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09340055a0 con 0x7f094406bcc0 2024-09-13T18:31:51.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.265+0000 7f094a397700 1 -- 172.21.15.44:0/3403986363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0944155f80 con 0x7f094406bcc0 2024-09-13T18:31:51.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.265+0000 7f0939ffb700 1 -- 172.21.15.44:0/3403986363 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f09340036a0 con 0x7f094406bcc0 2024-09-13T18:31:51.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.265+0000 7f094a397700 1 -- 172.21.15.44:0/3403986363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0944158730 con 0x7f094406bcc0 2024-09-13T18:31:51.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.265+0000 7f0939ffb700 1 --2- 172.21.15.44:0/3403986363 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0928066760 0x7f0928068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.265+0000 7f0939ffb700 1 -- 172.21.15.44:0/3403986363 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f09340833c0 con 0x7f094406bcc0 2024-09-13T18:31:51.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.269+0000 7f0949395700 1 --2- 172.21.15.44:0/3403986363 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0928066760 0x7f0928068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.269+0000 7f0949395700 1 --2- 172.21.15.44:0/3403986363 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0928066760 0x7f0928068c20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0940009c60 tx=0x7f0940008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:51.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.273+0000 7f0939ffb700 1 -- 172.21.15.44:0/3403986363 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0934050690 con 0x7f094406bcc0 2024-09-13T18:31:51.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.481+0000 7f094a397700 1 -- 172.21.15.44:0/3403986363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0944156140 con 0x7f094406bcc0 2024-09-13T18:31:51.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.481+0000 7f0939ffb700 1 -- 172.21.15.44:0/3403986363 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0934053cb0 con 0x7f094406bcc0 2024-09-13T18:31:51.491 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:31:51.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.485+0000 7f094a397700 1 -- 172.21.15.44:0/3403986363 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0928066760 msgr2=0x7f0928068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.485+0000 7f094a397700 1 --2- 172.21.15.44:0/3403986363 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0928066760 0x7f0928068c20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0940009c60 tx=0x7f0940008030 comp rx=0 tx=0).stop 2024-09-13T18:31:51.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.485+0000 7f094a397700 1 -- 172.21.15.44:0/3403986363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f094406bcc0 msgr2=0x7f0944154010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.485+0000 7f094a397700 1 --2- 172.21.15.44:0/3403986363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f094406bcc0 0x7f0944154010 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f093400c500 tx=0x7f093400c810 comp rx=0 tx=0).stop 2024-09-13T18:31:51.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.485+0000 7f094a397700 1 -- 172.21.15.44:0/3403986363 shutdown_connections 2024-09-13T18:31:51.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.485+0000 7f094a397700 1 --2- 172.21.15.44:0/3403986363 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0928066760 0x7f0928068c20 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.485+0000 7f094a397700 1 --2- 172.21.15.44:0/3403986363 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f09441ec310 0x7f09441ec7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.485+0000 7f094a397700 1 --2- 172.21.15.44:0/3403986363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f094406bcc0 0x7f0944154010 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.485+0000 7f094a397700 1 --2- 172.21.15.44:0/3403986363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f094406b040 0x7f09441f2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.485+0000 7f094a397700 1 -- 172.21.15.44:0/3403986363 >> 172.21.15.44:0/3403986363 conn(0x7f094406d900 msgr2=0x7f09440b00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:51.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.485+0000 7f094a397700 1 -- 172.21.15.44:0/3403986363 shutdown_connections 2024-09-13T18:31:51.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:31:51.485+0000 7f094a397700 1 -- 172.21.15.44:0/3403986363 wait complete. 2024-09-13T18:31:51.506 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:31:51.506 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:31:51.506 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-13T18:31:51.506 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:31:51.506 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:31:51.506 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:31:51.506 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:31:51.506 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:31:51.506 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:31:51.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:51.507 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-13T18:31:51.512 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:31:51.512 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:31:51.513 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:31:51.513 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:51.513 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-13T18:31:51.513 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:51.513 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:31:51.513 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-13T18:31:51.513 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:31:51.513 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:31:51.513 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:31:51.513 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:31:51.513 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:31:51.513 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42312sec preferred_lft 42312sec 2024-09-13T18:31:51.514 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-13T18:31:51.514 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:51.514 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:31:51.514 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:31:51.514 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:31:51.514 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:80:b2:e4:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:31:51.514 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:31:51.514 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:51.514 INFO:teuthology.orchestra.run.smithi044.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:31:51.514 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 2e:69:eb:1c:57:57 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:31:51.514 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:31:51.514 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:51.514 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::8842:91ff:feed:2c53/64 scope link 2024-09-13T18:31:51.515 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:51.515 INFO:teuthology.orchestra.run.smithi044.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:31:51.515 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 2e:69:eb:1c:57:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:31:51.515 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::2c69:ebff:fe1c:5757/64 scope link 2024-09-13T18:31:51.515 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:51.515 INFO:teuthology.orchestra.run.smithi044.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:31:51.515 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 86:e5:07:ac:f1:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:31:51.516 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::84e5:7ff:feac:f11b/64 scope link 2024-09-13T18:31:51.516 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:51.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:51.516 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:31:51.530 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-13T18:31:51.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:51.532 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-13T18:31:51.540 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-13T18:31:51.540 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:31:51.540 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:31:51.540 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:31:51.540 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:31:51.541 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:31:51.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:51.541 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2024-09-13T18:31:51.541 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-13T18:31:51.541 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:31:51.541 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:31:51.541 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:31:51.541 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-13T18:31:51.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:51.575 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-13T18:31:51.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:31:51.581 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:31:51.581 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:31:51.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:51.582 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-13T18:31:51.643 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:31:51.644 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:31:51.644 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:31:51.651 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:31:51.651 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:31:51.651 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:31:51.657 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:31:51.672 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:31:51.672 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:31:51.730 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:31:51.731 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:31:51.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:51.732 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:31:51.737 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:31:51.737 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:31:51.739 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:31:51.754 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:31:51.754 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:31:51.811 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:31:51.812 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:31:51.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:51.812 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:31:51.830 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2024-09-13T18:31:51.821+0000 7fb5b1c16640 -1 init, newargv = 0x56472e4a9480 newargc=15 2024-09-13T18:31:51.830 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[42001]: starting ceph client 2024-09-13T18:31:51.838 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[42001]: starting fuse 2024-09-13T18:31:51.894 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-09-13T18:31:51.885+0000 7fdaeec9d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:31:52.918 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:31:52.936 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:31:52.936 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:31:52.995 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:31:52.996 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:31:52.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:52.997 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:31:53.002 INFO:teuthology.orchestra.run.smithi044.stdout:52 2024-09-13T18:31:53.002 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T18:31:53.002 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:31:53.002 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2024-09-13T18:31:53.002 DEBUG:teuthology.orchestra.run.smithi044:> import re 2024-09-13T18:31:53.002 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:31:53.002 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2024-09-13T18:31:53.002 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:31:53.002 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2024-09-13T18:31:53.003 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:31:53.003 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2024-09-13T18:31:53.003 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:31:53.003 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:31:53.003 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2024-09-13T18:31:53.003 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2024-09-13T18:31:53.003 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2024-09-13T18:31:53.003 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2024-09-13T18:31:53.003 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:31:53.003 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2024-09-13T18:31:53.003 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:31:53.003 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:31:53.003 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:31:53.003 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2024-09-13T18:31:53.004 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2024-09-13T18:31:53.004 DEBUG:teuthology.orchestra.run.smithi044:> return f 2024-09-13T18:31:53.004 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:31:53.004 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:31:53.004 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.0")) 2024-09-13T18:31:53.004 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:31:53.090 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.0.42001.asok 2024-09-13T18:31:53.271 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.42001.asok 2024-09-13T18:31:53.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:53.272 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.42001.asok status 2024-09-13T18:31:53.378 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:31:53.378 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2024-09-13T18:31:53.378 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:31:53.378 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:31:53.378 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "0", 2024-09-13T18:31:53.378 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2024-09-13T18:31:53.378 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:31:53.379 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "42001", 2024-09-13T18:31:53.379 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2024-09-13T18:31:53.379 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:31:53.379 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2024-09-13T18:31:53.379 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2024-09-13T18:31:53.379 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 6648, 2024-09-13T18:31:53.379 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2024-09-13T18:31:53.379 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2024-09-13T18:31:53.379 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2024-09-13T18:31:53.379 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 6648 2024-09-13T18:31:53.379 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:31:53.379 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:31:53.379 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-13T18:31:53.379 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:31:53.380 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3206806784 2024-09-13T18:31:53.380 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:31:53.380 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:31:53.380 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:31:53.380 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-13T18:31:53.380 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:31:53.380 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3206806784 2024-09-13T18:31:53.380 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:31:53.380 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.6648 192.168.0.1:0/3206806784", 2024-09-13T18:31:53.380 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/3206806784", 2024-09-13T18:31:53.380 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2024-09-13T18:31:53.380 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 38, 2024-09-13T18:31:53.380 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 51, 2024-09-13T18:31:53.381 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:31:53.381 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2024-09-13T18:31:53.381 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2024-09-13T18:31:53.381 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:31:53.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:53.388 DEBUG:teuthology.orchestra.run.smithi044:> stat --file-system '--printf=%T 2024-09-13T18:31:53.388 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:31:53.396 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2024-09-13T18:31:53.396 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:31:53.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:53.397 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:31:53.410 INFO:tasks.workunit:Pulling workunits from ref 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:31:53.410 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T18:31:53.410 DEBUG:teuthology.orchestra.run.smithi044:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:31:53.418 INFO:teuthology.orchestra.run.smithi044.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-13T18:31:53.418 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-13T18:31:53.418 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 34h/52d Inode: 1 Links: 2 2024-09-13T18:31:53.418 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:31:53.418 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T18:31:53.418 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-13 18:30:31.139635368 +0000 2024-09-13T18:31:53.419 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-13 18:30:31.139635368 +0000 2024-09-13T18:31:53.419 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: - 2024-09-13T18:31:53.419 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-13T18:31:53.419 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-13T18:31:53.481 INFO:tasks.workunit:timeout=1h 2024-09-13T18:31:53.482 INFO:tasks.workunit:cleanup=True 2024-09-13T18:31:53.482 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:31:53.490 INFO:tasks.workunit.client.0.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T18:31:59.400 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:31:59.403 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:32:29.448 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:32:29.451 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:32:56.181 INFO:tasks.workunit.client.0.smithi044.stderr:Note: switching to '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'. 2024-09-13T18:32:56.181 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-13T18:32:56.181 INFO:tasks.workunit.client.0.smithi044.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T18:32:56.181 INFO:tasks.workunit.client.0.smithi044.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T18:32:56.181 INFO:tasks.workunit.client.0.smithi044.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T18:32:56.181 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-13T18:32:56.181 INFO:tasks.workunit.client.0.smithi044.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T18:32:56.181 INFO:tasks.workunit.client.0.smithi044.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T18:32:56.181 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-13T18:32:56.181 INFO:tasks.workunit.client.0.smithi044.stderr: git switch -c 2024-09-13T18:32:56.181 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-13T18:32:56.182 INFO:tasks.workunit.client.0.smithi044.stderr:Or undo this operation with: 2024-09-13T18:32:56.182 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-13T18:32:56.182 INFO:tasks.workunit.client.0.smithi044.stderr: git switch - 2024-09-13T18:32:56.182 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-13T18:32:56.182 INFO:tasks.workunit.client.0.smithi044.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T18:32:56.182 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-09-13T18:32:56.182 INFO:tasks.workunit.client.0.smithi044.stderr:HEAD is now at 6c6b083f148 Merge PR #56690 into wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:32:56.187 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T18:32:56.195 INFO:tasks.workunit.client.0.smithi044.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T18:32:56.198 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:32:56.198 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T18:32:56.271 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T18:32:56.342 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T18:32:56.398 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:32:56.400 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:32:56.400 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T18:32:56.454 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:32:56.460 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:32:56.460 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T18:32:56.467 INFO:tasks.workunit:Running workunits matching fs/misc/trivial_sync.sh on client.0... 2024-09-13T18:32:56.469 INFO:tasks.workunit:Running workunit fs/misc/trivial_sync.sh... 2024-09-13T18:32:56.469 DEBUG:teuthology.orchestra.run.smithi044:workunit test fs/misc/trivial_sync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 1h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/trivial_sync.sh 2024-09-13T18:32:58.574 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T18:32:58.574 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T18:32:58.622 INFO:tasks.workunit:Stopping ['fs/misc/trivial_sync.sh'] on client.0... 2024-09-13T18:32:58.622 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T18:32:58.896 DEBUG:teuthology.parallel:result is None 2024-09-13T18:32:58.897 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T18:32:58.925 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T18:32:58.926 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:32:58.926 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:32:58.987 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:32:59.006 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:32:59.006 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:32:59.006 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:32:59.013 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:32:59.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f7fff700 1 Processor -- start 2024-09-13T18:32:59.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f7fff700 1 -- start start 2024-09-13T18:32:59.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f7fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f60f806fb30 0x7f60f80adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f7fff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f806a780 con 0x7f60f806d150 2024-09-13T18:32:59.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f7fff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f8159470 con 0x7f60f806bb90 2024-09-13T18:32:59.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f7fff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f806cd30 con 0x7f60f806fb30 2024-09-13T18:32:59.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f77fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f60f806d150 0x7f60f806d5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60390/0 (socket says 172.21.15.44:60390) 2024-09-13T18:32:59.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f77fe700 1 -- 172.21.15.44:0/1274808689 learned_addr learned my addr 172.21.15.44:0/1274808689 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:32:59.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f6ffd700 1 --2- 172.21.15.44:0/1274808689 >> v2:172.21.15.99:3300/0 conn(0x7f60f806fb30 0x7f60f80adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f67fc700 1 -- 172.21.15.44:0/1274808689 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145972313 0 0) 0x7f60f806a780 con 0x7f60f806d150 2024-09-13T18:32:59.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f67fc700 1 -- 172.21.15.44:0/1274808689 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60e40035d0 con 0x7f60f806d150 2024-09-13T18:32:59.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f6ffd700 1 -- 172.21.15.44:0/1274808689 >> v1:172.21.15.99:6789/0 conn(0x7f60f806bb90 legacy=0x7f60f80cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f67fc700 1 -- 172.21.15.44:0/1274808689 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394831790 0 0) 0x7f60f8159470 con 0x7f60f806bb90 2024-09-13T18:32:59.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f6ffd700 1 -- 172.21.15.44:0/1274808689 >> v1:172.21.15.44:6789/0 conn(0x7f60f806d150 legacy=0x7f60f806d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f6ffd700 1 -- 172.21.15.44:0/1274808689 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f80cc610 con 0x7f60f806fb30 2024-09-13T18:32:59.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f6ffd700 1 --2- 172.21.15.44:0/1274808689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60f806fb30 0x7f60f80adbd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f60e800a9f0 tx=0x7f60e800ad00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b3af2602912e5fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:59.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f67fc700 1 -- 172.21.15.44:0/1274808689 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e800cb70 con 0x7f60f806fb30 2024-09-13T18:32:59.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f67fc700 1 -- 172.21.15.44:0/1274808689 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e800ae90 con 0x7f60f806fb30 2024-09-13T18:32:59.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f67fc700 1 -- 172.21.15.44:0/1274808689 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e8018400 con 0x7f60f806fb30 2024-09-13T18:32:59.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f7fff700 1 -- 172.21.15.44:0/1274808689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60f806fb30 msgr2=0x7f60f80adbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f7fff700 1 --2- 172.21.15.44:0/1274808689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60f806fb30 0x7f60f80adbd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f60e800a9f0 tx=0x7f60e800ad00 comp rx=0 tx=0).stop 2024-09-13T18:32:59.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f7fff700 1 -- 172.21.15.44:0/1274808689 shutdown_connections 2024-09-13T18:32:59.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f7fff700 1 --2- 172.21.15.44:0/1274808689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60f806fb30 0x7f60f80adbd0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f7fff700 1 -- 172.21.15.44:0/1274808689 >> 172.21.15.44:0/1274808689 conn(0x7f60f80b0f00 msgr2=0x7f60f80b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:59.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f7fff700 1 -- 172.21.15.44:0/1274808689 shutdown_connections 2024-09-13T18:32:59.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.136+0000 7f60f7fff700 1 -- 172.21.15.44:0/1274808689 wait complete. 2024-09-13T18:32:59.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60f7fff700 1 Processor -- start 2024-09-13T18:32:59.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60f7fff700 1 -- start start 2024-09-13T18:32:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60f7fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60f806bb90 0x7f60f81f2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60f7fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60f806d150 0x7f60f815c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60f7fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60f806fb30 0x7f60f814bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60f7fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f81f2990 con 0x7f60f806fb30 2024-09-13T18:32:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60f7fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f815c780 con 0x7f60f806d150 2024-09-13T18:32:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60f7fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f814c320 con 0x7f60f806bb90 2024-09-13T18:32:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60f77fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60f806fb30 0x7f60f814bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60f77fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60f806fb30 0x7f60f814bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55304/0 (socket says 172.21.15.44:55304) 2024-09-13T18:32:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60f77fe700 1 -- 172.21.15.44:0/4079436509 learned_addr learned my addr 172.21.15.44:0/4079436509 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:32:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60effff700 1 --2- 172.21.15.44:0/4079436509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60f806d150 0x7f60f815c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60f6ffd700 1 --2- 172.21.15.44:0/4079436509 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60f806bb90 0x7f60f81f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60f77fe700 1 -- 172.21.15.44:0/4079436509 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60f806bb90 msgr2=0x7f60f81f2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60f77fe700 1 --2- 172.21.15.44:0/4079436509 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60f806bb90 0x7f60f81f2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60f77fe700 1 -- 172.21.15.44:0/4079436509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60f806d150 msgr2=0x7f60f815c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60f77fe700 1 --2- 172.21.15.44:0/4079436509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60f806d150 0x7f60f815c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60f77fe700 1 -- 172.21.15.44:0/4079436509 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e800a650 con 0x7f60f806fb30 2024-09-13T18:32:59.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60f77fe700 1 --2- 172.21.15.44:0/4079436509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60f806fb30 0x7f60f814bde0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f60f000cb70 tx=0x7f60f000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:59.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60ef7fe700 1 -- 172.21.15.44:0/4079436509 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0007480 con 0x7f60f806fb30 2024-09-13T18:32:59.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60f7fff700 1 -- 172.21.15.44:0/4079436509 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f81f2b80 con 0x7f60f806fb30 2024-09-13T18:32:59.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60ef7fe700 1 -- 172.21.15.44:0/4079436509 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f00075e0 con 0x7f60f806fb30 2024-09-13T18:32:59.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60ef7fe700 1 -- 172.21.15.44:0/4079436509 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0007970 con 0x7f60f806fb30 2024-09-13T18:32:59.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.140+0000 7f60f7fff700 1 -- 172.21.15.44:0/4079436509 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f81f3140 con 0x7f60f806fb30 2024-09-13T18:32:59.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.144+0000 7f60f7fff700 1 -- 172.21.15.44:0/4079436509 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f80cbf00 con 0x7f60f806fb30 2024-09-13T18:32:59.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.144+0000 7f60ef7fe700 1 -- 172.21.15.44:0/4079436509 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f60f001b3b0 con 0x7f60f806fb30 2024-09-13T18:32:59.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.148+0000 7f60ef7fe700 1 --2- 172.21.15.44:0/4079436509 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f60d8066730 0x7f60d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.148+0000 7f60ef7fe700 1 -- 172.21.15.44:0/4079436509 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f60f0083f10 con 0x7f60f806fb30 2024-09-13T18:32:59.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.148+0000 7f60f6ffd700 1 --2- 172.21.15.44:0/4079436509 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f60d8066730 0x7f60d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.148+0000 7f60f6ffd700 1 --2- 172.21.15.44:0/4079436509 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f60d8066730 0x7f60d8068bf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f60e800a1c0 tx=0x7f60e801b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:59.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.152+0000 7f60ef7fe700 1 -- 172.21.15.44:0/4079436509 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f60f0054d10 con 0x7f60f806fb30 2024-09-13T18:32:59.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.320+0000 7f60f7fff700 1 -- 172.21.15.44:0/4079436509 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60f80b1f10 con 0x7f60f806fb30 2024-09-13T18:32:59.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.324+0000 7f60ef7fe700 1 -- 172.21.15.44:0/4079436509 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16674 (secure 0 0 0) 0x7f60f0017020 con 0x7f60f806fb30 2024-09-13T18:32:59.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:32:59.330 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":51,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:30:35.073160+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:29:08.754284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:29:09.262346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.1b","mappings":[{"from":0,"to":5}]},{"pgid":"7.3c","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/3200882245":"2024-09-14T18:30:35.073090+0000","172.21.15.44:6834/3200882245":"2024-09-14T18:30:35.073090+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:32:59.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.324+0000 7f60f7fff700 1 -- 172.21.15.44:0/4079436509 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f60d8066730 msgr2=0x7f60d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.324+0000 7f60f7fff700 1 --2- 172.21.15.44:0/4079436509 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f60d8066730 0x7f60d8068bf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f60e800a1c0 tx=0x7f60e801b040 comp rx=0 tx=0).stop 2024-09-13T18:32:59.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.324+0000 7f60f7fff700 1 -- 172.21.15.44:0/4079436509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60f806fb30 msgr2=0x7f60f814bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.324+0000 7f60f7fff700 1 --2- 172.21.15.44:0/4079436509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60f806fb30 0x7f60f814bde0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f60f000cb70 tx=0x7f60f000cba0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.324+0000 7f60f7fff700 1 -- 172.21.15.44:0/4079436509 shutdown_connections 2024-09-13T18:32:59.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.324+0000 7f60f7fff700 1 --2- 172.21.15.44:0/4079436509 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f60d8066730 0x7f60d8068bf0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.324+0000 7f60f7fff700 1 --2- 172.21.15.44:0/4079436509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60f806fb30 0x7f60f814bde0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.324+0000 7f60f7fff700 1 --2- 172.21.15.44:0/4079436509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60f806d150 0x7f60f815c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.324+0000 7f60f7fff700 1 --2- 172.21.15.44:0/4079436509 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60f806bb90 0x7f60f81f2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.324+0000 7f60f7fff700 1 -- 172.21.15.44:0/4079436509 >> 172.21.15.44:0/4079436509 conn(0x7f60f80b0f00 msgr2=0x7f60f80ad9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:59.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.324+0000 7f60f7fff700 1 -- 172.21.15.44:0/4079436509 shutdown_connections 2024-09-13T18:32:59.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.324+0000 7f60f7fff700 1 -- 172.21.15.44:0/4079436509 wait complete. 2024-09-13T18:32:59.343 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:29:08.754284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:29:09.262346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:32:59.343 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:32:59.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.456+0000 7f2d57fff700 1 Processor -- start 2024-09-13T18:32:59.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.456+0000 7f2d57fff700 1 -- start start 2024-09-13T18:32:59.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.456+0000 7f2d57fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2d5806b900 0x7f2d580b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.456+0000 7f2d57fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2d5806a520 0x7f2d5806a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.456+0000 7f2d57fff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d580b8430 con 0x7f2d5815cda0 2024-09-13T18:32:59.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.456+0000 7f2d57fff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d5806ae70 con 0x7f2d5806b900 2024-09-13T18:32:59.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.456+0000 7f2d57fff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d5806bd60 con 0x7f2d5806a520 2024-09-13T18:32:59.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.456+0000 7f2d567fc700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2d5806b900 0x7f2d580b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.456+0000 7f2d56ffd700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2d5815cda0 0x7f2d580ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60400/0 (socket says 172.21.15.44:60400) 2024-09-13T18:32:59.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.456+0000 7f2d56ffd700 1 -- 172.21.15.44:0/3697884421 learned_addr learned my addr 172.21.15.44:0/3697884421 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:32:59.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.456+0000 7f2d577fe700 1 --2- 172.21.15.44:0/3697884421 >> v2:172.21.15.99:3300/0 conn(0x7f2d5806a520 0x7f2d5806a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.456+0000 7f2d567fc700 1 -- 172.21.15.44:0/3697884421 >> v2:172.21.15.99:3300/0 conn(0x7f2d5806a520 msgr2=0x7f2d5806a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:59.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.456+0000 7f2d567fc700 1 --2- 172.21.15.44:0/3697884421 >> v2:172.21.15.99:3300/0 conn(0x7f2d5806a520 0x7f2d5806a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.456+0000 7f2d567fc700 1 -- 172.21.15.44:0/3697884421 >> v1:172.21.15.44:6789/0 conn(0x7f2d5815cda0 legacy=0x7f2d580ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.460+0000 7f2d567fc700 1 -- 172.21.15.44:0/3697884421 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d580cf350 con 0x7f2d5806b900 2024-09-13T18:32:59.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.460+0000 7f2d577fe700 1 --2- 172.21.15.44:0/3697884421 >> v2:172.21.15.99:3300/0 conn(0x7f2d5806a520 0x7f2d5806a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:59.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.460+0000 7f2d567fc700 1 --2- 172.21.15.44:0/3697884421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d5806b900 0x7f2d580b5de0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f2d580d2c60 tx=0x7f2d48009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89d0af8fa0605a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:59.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.460+0000 7f2d55ffb700 1 -- 172.21.15.44:0/3697884421 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48011830 con 0x7f2d5806b900 2024-09-13T18:32:59.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.460+0000 7f2d55ffb700 1 -- 172.21.15.44:0/3697884421 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d48011990 con 0x7f2d5806b900 2024-09-13T18:32:59.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.460+0000 7f2d55ffb700 1 -- 172.21.15.44:0/3697884421 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48011d40 con 0x7f2d5806b900 2024-09-13T18:32:59.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.460+0000 7f2d57fff700 1 -- 172.21.15.44:0/3697884421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d5806b900 msgr2=0x7f2d580b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.460+0000 7f2d57fff700 1 --2- 172.21.15.44:0/3697884421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d5806b900 0x7f2d580b5de0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f2d580d2c60 tx=0x7f2d48009b30 comp rx=0 tx=0).stop 2024-09-13T18:32:59.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.460+0000 7f2d57fff700 1 -- 172.21.15.44:0/3697884421 shutdown_connections 2024-09-13T18:32:59.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.460+0000 7f2d57fff700 1 --2- 172.21.15.44:0/3697884421 >> v2:172.21.15.99:3300/0 conn(0x7f2d5806a520 0x7f2d5806a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.460+0000 7f2d57fff700 1 --2- 172.21.15.44:0/3697884421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d5806b900 0x7f2d580b5de0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.460+0000 7f2d57fff700 1 -- 172.21.15.44:0/3697884421 >> 172.21.15.44:0/3697884421 conn(0x7f2d580d2cb0 msgr2=0x7f2d580d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:59.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.460+0000 7f2d57fff700 1 -- 172.21.15.44:0/3697884421 shutdown_connections 2024-09-13T18:32:59.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.460+0000 7f2d57fff700 1 -- 172.21.15.44:0/3697884421 wait complete. 2024-09-13T18:32:59.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.460+0000 7f2d57fff700 1 Processor -- start 2024-09-13T18:32:59.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.460+0000 7f2d57fff700 1 -- start start 2024-09-13T18:32:59.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.464+0000 7f2d57fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d5806a520 0x7f2d580c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.464+0000 7f2d57fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d5806b900 0x7f2d5815e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.464+0000 7f2d57fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d5815cda0 0x7f2d5815e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.464+0000 7f2d57fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d580c9af0 con 0x7f2d5806a520 2024-09-13T18:32:59.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.464+0000 7f2d57fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d58158660 con 0x7f2d5806b900 2024-09-13T18:32:59.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.464+0000 7f2d57fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d580cb670 con 0x7f2d5815cda0 2024-09-13T18:32:59.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.464+0000 7f2d56ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d5806a520 0x7f2d580c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.464+0000 7f2d56ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d5806a520 0x7f2d580c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55318/0 (socket says 172.21.15.44:55318) 2024-09-13T18:32:59.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.464+0000 7f2d56ffd700 1 -- 172.21.15.44:0/601324931 learned_addr learned my addr 172.21.15.44:0/601324931 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:32:59.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.464+0000 7f2d567fc700 1 --2- 172.21.15.44:0/601324931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d5806b900 0x7f2d5815e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.464+0000 7f2d577fe700 1 --2- 172.21.15.44:0/601324931 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d5815cda0 0x7f2d5815e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.464+0000 7f2d56ffd700 1 -- 172.21.15.44:0/601324931 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d5815cda0 msgr2=0x7f2d5815e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.464+0000 7f2d56ffd700 1 --2- 172.21.15.44:0/601324931 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d5815cda0 0x7f2d5815e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.464+0000 7f2d56ffd700 1 -- 172.21.15.44:0/601324931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d5806b900 msgr2=0x7f2d5815e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.464+0000 7f2d56ffd700 1 --2- 172.21.15.44:0/601324931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d5806b900 0x7f2d5815e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.464+0000 7f2d56ffd700 1 -- 172.21.15.44:0/601324931 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d480094b0 con 0x7f2d5806a520 2024-09-13T18:32:59.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.464+0000 7f2d56ffd700 1 --2- 172.21.15.44:0/601324931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d5806a520 0x7f2d580c9d80 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c001eb0 tx=0x7f2d4c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:59.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.464+0000 7f2d3f7fe700 1 -- 172.21.15.44:0/601324931 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c005d90 con 0x7f2d5806a520 2024-09-13T18:32:59.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.464+0000 7f2d3f7fe700 1 -- 172.21.15.44:0/601324931 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4c0070d0 con 0x7f2d5806a520 2024-09-13T18:32:59.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.464+0000 7f2d57fff700 1 -- 172.21.15.44:0/601324931 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d580c9810 con 0x7f2d5806a520 2024-09-13T18:32:59.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.464+0000 7f2d3f7fe700 1 -- 172.21.15.44:0/601324931 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c007440 con 0x7f2d5806a520 2024-09-13T18:32:59.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.464+0000 7f2d57fff700 1 -- 172.21.15.44:0/601324931 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d580cbbf0 con 0x7f2d5806a520 2024-09-13T18:32:59.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.468+0000 7f2d57fff700 1 -- 172.21.15.44:0/601324931 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d5806a930 con 0x7f2d5806a520 2024-09-13T18:32:59.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.468+0000 7f2d3f7fe700 1 -- 172.21.15.44:0/601324931 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2d4c0075a0 con 0x7f2d5806a520 2024-09-13T18:32:59.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.468+0000 7f2d3f7fe700 1 --2- 172.21.15.44:0/601324931 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2d44066730 0x7f2d44068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.468+0000 7f2d3f7fe700 1 -- 172.21.15.44:0/601324931 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f2d4c083350 con 0x7f2d5806a520 2024-09-13T18:32:59.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.468+0000 7f2d567fc700 1 --2- 172.21.15.44:0/601324931 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2d44066730 0x7f2d44068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.468+0000 7f2d567fc700 1 --2- 172.21.15.44:0/601324931 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2d44066730 0x7f2d44068bf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2d480090b0 tx=0x7f2d48008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:59.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.476+0000 7f2d3f7fe700 1 -- 172.21.15.44:0/601324931 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2d4c050770 con 0x7f2d5806a520 2024-09-13T18:32:59.526 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:32:59.528 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:32:59.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.648+0000 7f2d57fff700 1 -- 172.21.15.44:0/601324931 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2d5815b6e0 con 0x7f2d5806a520 2024-09-13T18:32:59.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.648+0000 7f2d3f7fe700 1 -- 172.21.15.44:0/601324931 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2d4c053d90 con 0x7f2d5806a520 2024-09-13T18:32:59.655 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:32:59.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.652+0000 7f2d57fff700 1 -- 172.21.15.44:0/601324931 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2d44066730 msgr2=0x7f2d44068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.652+0000 7f2d57fff700 1 --2- 172.21.15.44:0/601324931 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2d44066730 0x7f2d44068bf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2d480090b0 tx=0x7f2d48008030 comp rx=0 tx=0).stop 2024-09-13T18:32:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.652+0000 7f2d57fff700 1 -- 172.21.15.44:0/601324931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d5806a520 msgr2=0x7f2d580c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.652+0000 7f2d57fff700 1 --2- 172.21.15.44:0/601324931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d5806a520 0x7f2d580c9d80 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c001eb0 tx=0x7f2d4c00c7b0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.652+0000 7f2d57fff700 1 -- 172.21.15.44:0/601324931 shutdown_connections 2024-09-13T18:32:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.652+0000 7f2d57fff700 1 --2- 172.21.15.44:0/601324931 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2d44066730 0x7f2d44068bf0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.652+0000 7f2d57fff700 1 --2- 172.21.15.44:0/601324931 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d5815cda0 0x7f2d5815e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.652+0000 7f2d57fff700 1 --2- 172.21.15.44:0/601324931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d5806b900 0x7f2d5815e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.652+0000 7f2d57fff700 1 --2- 172.21.15.44:0/601324931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d5806a520 0x7f2d580c9d80 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.652+0000 7f2d57fff700 1 -- 172.21.15.44:0/601324931 >> 172.21.15.44:0/601324931 conn(0x7f2d580d2cb0 msgr2=0x7f2d5815bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.652+0000 7f2d57fff700 1 -- 172.21.15.44:0/601324931 shutdown_connections 2024-09-13T18:32:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.652+0000 7f2d57fff700 1 -- 172.21.15.44:0/601324931 wait complete. 2024-09-13T18:32:59.669 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:32:59.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.788+0000 7f880e88a700 1 Processor -- start 2024-09-13T18:32:59.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.788+0000 7f880e88a700 1 -- start start 2024-09-13T18:32:59.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f880e88a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88080cf690 0x7f88080ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f880e88a700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f88080b6380 0x7f880815b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f880e88a700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88080d1910 con 0x7f88080d08a0 2024-09-13T18:32:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f880e88a700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8808151e90 con 0x7f88080b6380 2024-09-13T18:32:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f880e88a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88080d0d90 con 0x7f88080cf690 2024-09-13T18:32:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f88077fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f88080d08a0 0x7f88080b5c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60406/0 (socket says 172.21.15.44:60406) 2024-09-13T18:32:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f88077fe700 1 -- 172.21.15.44:0/3667921891 learned_addr learned my addr 172.21.15.44:0/3667921891 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:32:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f8807fff700 1 --2- 172.21.15.44:0/3667921891 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88080cf690 0x7f88080ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f880ce27700 1 --2- 172.21.15.44:0/3667921891 >> v2:172.21.15.99:3300/0 conn(0x7f88080b6380 0x7f880815b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f8806ffd700 1 -- 172.21.15.44:0/3667921891 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277348933 0 0) 0x7f88080d1910 con 0x7f88080d08a0 2024-09-13T18:32:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f8806ffd700 1 -- 172.21.15.44:0/3667921891 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87f40035d0 con 0x7f88080d08a0 2024-09-13T18:32:59.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f8807fff700 1 -- 172.21.15.44:0/3667921891 >> v2:172.21.15.99:3300/0 conn(0x7f88080b6380 msgr2=0x7f880815b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:59.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f8807fff700 1 --2- 172.21.15.44:0/3667921891 >> v2:172.21.15.99:3300/0 conn(0x7f88080b6380 0x7f880815b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f8806ffd700 1 -- 172.21.15.44:0/3667921891 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2593841442 0 0) 0x7f87f40035d0 con 0x7f88080d08a0 2024-09-13T18:32:59.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f8807fff700 1 -- 172.21.15.44:0/3667921891 >> v1:172.21.15.44:6789/0 conn(0x7f88080d08a0 legacy=0x7f88080b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f8807fff700 1 -- 172.21.15.44:0/3667921891 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88080d1070 con 0x7f88080cf690 2024-09-13T18:32:59.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f8807fff700 1 --2- 172.21.15.44:0/3667921891 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88080cf690 0x7f88080ce7d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f87f8009d90 tx=0x7f87f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b6b174379dd0442 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:59.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f8806ffd700 1 -- 172.21.15.44:0/3667921891 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f800e070 con 0x7f88080cf690 2024-09-13T18:32:59.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f8806ffd700 1 -- 172.21.15.44:0/3667921891 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f8003a40 con 0x7f88080cf690 2024-09-13T18:32:59.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f8806ffd700 1 -- 172.21.15.44:0/3667921891 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f0001670 con 0x7f88080cf690 2024-09-13T18:32:59.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f880e88a700 1 -- 172.21.15.44:0/3667921891 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88080cf690 msgr2=0x7f88080ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f880e88a700 1 --2- 172.21.15.44:0/3667921891 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88080cf690 0x7f88080ce7d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f87f8009d90 tx=0x7f87f800b330 comp rx=0 tx=0).stop 2024-09-13T18:32:59.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f880e88a700 1 -- 172.21.15.44:0/3667921891 shutdown_connections 2024-09-13T18:32:59.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f880e88a700 1 --2- 172.21.15.44:0/3667921891 >> v2:172.21.15.99:3300/0 conn(0x7f88080b6380 0x7f880815b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f880e88a700 1 --2- 172.21.15.44:0/3667921891 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88080cf690 0x7f88080ce7d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.792+0000 7f880e88a700 1 -- 172.21.15.44:0/3667921891 >> 172.21.15.44:0/3667921891 conn(0x7f8808071da0 msgr2=0x7f8808072180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:59.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.796+0000 7f880e88a700 1 -- 172.21.15.44:0/3667921891 shutdown_connections 2024-09-13T18:32:59.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.796+0000 7f880e88a700 1 -- 172.21.15.44:0/3667921891 wait complete. 2024-09-13T18:32:59.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.796+0000 7f880e88a700 1 Processor -- start 2024-09-13T18:32:59.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.796+0000 7f880e88a700 1 -- start start 2024-09-13T18:32:59.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.796+0000 7f880e88a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88080b6380 0x7f880814bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.796+0000 7f880e88a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88080cf690 0x7f8808154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.796+0000 7f880e88a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88080d08a0 0x7f880814e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.796+0000 7f880e88a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8808153090 con 0x7f88080cf690 2024-09-13T18:32:59.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.796+0000 7f880e88a700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8808153e80 con 0x7f88080d08a0 2024-09-13T18:32:59.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.796+0000 7f880e88a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880814c1c0 con 0x7f88080b6380 2024-09-13T18:32:59.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.796+0000 7f88077fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88080cf690 0x7f8808154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.800+0000 7f88077fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88080cf690 0x7f8808154090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55326/0 (socket says 172.21.15.44:55326) 2024-09-13T18:32:59.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.800+0000 7f88077fe700 1 -- 172.21.15.44:0/2556424598 learned_addr learned my addr 172.21.15.44:0/2556424598 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:32:59.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.800+0000 7f880ce27700 1 --2- 172.21.15.44:0/2556424598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88080d08a0 0x7f880814e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.800+0000 7f8807fff700 1 --2- 172.21.15.44:0/2556424598 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88080b6380 0x7f880814bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.800+0000 7f88077fe700 1 -- 172.21.15.44:0/2556424598 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88080b6380 msgr2=0x7f880814bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.800+0000 7f88077fe700 1 --2- 172.21.15.44:0/2556424598 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88080b6380 0x7f880814bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.800+0000 7f88077fe700 1 -- 172.21.15.44:0/2556424598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88080d08a0 msgr2=0x7f880814e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.800+0000 7f88077fe700 1 --2- 172.21.15.44:0/2556424598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88080d08a0 0x7f880814e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.800+0000 7f88077fe700 1 -- 172.21.15.44:0/2556424598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f8009a70 con 0x7f88080cf690 2024-09-13T18:32:59.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.800+0000 7f88077fe700 1 --2- 172.21.15.44:0/2556424598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88080cf690 0x7f8808154090 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f87f000c520 tx=0x7f87f000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:59.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.800+0000 7f8804ff9700 1 -- 172.21.15.44:0/2556424598 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f0004ca0 con 0x7f88080cf690 2024-09-13T18:32:59.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.800+0000 7f8804ff9700 1 -- 172.21.15.44:0/2556424598 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f000ce90 con 0x7f88080cf690 2024-09-13T18:32:59.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.800+0000 7f8804ff9700 1 -- 172.21.15.44:0/2556424598 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f0007310 con 0x7f88080cf690 2024-09-13T18:32:59.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.800+0000 7f880e88a700 1 -- 172.21.15.44:0/2556424598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8808152410 con 0x7f88080cf690 2024-09-13T18:32:59.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.800+0000 7f880e88a700 1 -- 172.21.15.44:0/2556424598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88081529d0 con 0x7f88080cf690 2024-09-13T18:32:59.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.800+0000 7f880e88a700 1 -- 172.21.15.44:0/2556424598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88081531d0 con 0x7f88080cf690 2024-09-13T18:32:59.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.804+0000 7f8804ff9700 1 -- 172.21.15.44:0/2556424598 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f87f0007470 con 0x7f88080cf690 2024-09-13T18:32:59.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.804+0000 7f8804ff9700 1 --2- 172.21.15.44:0/2556424598 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f87e8066730 0x7f87e8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.804+0000 7f8804ff9700 1 -- 172.21.15.44:0/2556424598 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f87f0083e20 con 0x7f88080cf690 2024-09-13T18:32:59.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.804+0000 7f8807fff700 1 --2- 172.21.15.44:0/2556424598 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f87e8066730 0x7f87e8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.804+0000 7f8807fff700 1 --2- 172.21.15.44:0/2556424598 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f87e8066730 0x7f87e8068bf0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f87f800b370 tx=0x7f87f8011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:59.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.812+0000 7f8804ff9700 1 -- 172.21.15.44:0/2556424598 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f88081531d0 con 0x7f88080cf690 2024-09-13T18:32:59.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.984+0000 7f880e88a700 1 -- 172.21.15.44:0/2556424598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f88081531d0 con 0x7f88080cf690 2024-09-13T18:32:59.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.988+0000 7f8804ff9700 1 -- 172.21.15.44:0/2556424598 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7f88081531d0 con 0x7f88080cf690 2024-09-13T18:32:59.992 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:32:59.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.988+0000 7f880e88a700 1 -- 172.21.15.44:0/2556424598 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f87e8066730 msgr2=0x7f87e8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.988+0000 7f880e88a700 1 --2- 172.21.15.44:0/2556424598 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f87e8066730 0x7f87e8068bf0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f87f800b370 tx=0x7f87f8011000 comp rx=0 tx=0).stop 2024-09-13T18:32:59.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.988+0000 7f880e88a700 1 -- 172.21.15.44:0/2556424598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88080cf690 msgr2=0x7f8808154090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.988+0000 7f880e88a700 1 --2- 172.21.15.44:0/2556424598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88080cf690 0x7f8808154090 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f87f000c520 tx=0x7f87f000c830 comp rx=0 tx=0).stop 2024-09-13T18:32:59.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.988+0000 7f880e88a700 1 -- 172.21.15.44:0/2556424598 shutdown_connections 2024-09-13T18:32:59.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.988+0000 7f880e88a700 1 --2- 172.21.15.44:0/2556424598 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f87e8066730 0x7f87e8068bf0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.988+0000 7f880e88a700 1 --2- 172.21.15.44:0/2556424598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88080d08a0 0x7f880814e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.988+0000 7f880e88a700 1 --2- 172.21.15.44:0/2556424598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88080cf690 0x7f8808154090 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.988+0000 7f880e88a700 1 --2- 172.21.15.44:0/2556424598 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88080b6380 0x7f880814bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.988+0000 7f880e88a700 1 -- 172.21.15.44:0/2556424598 >> 172.21.15.44:0/2556424598 conn(0x7f8808071da0 msgr2=0x7f88080b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:59.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.988+0000 7f880e88a700 1 -- 172.21.15.44:0/2556424598 shutdown_connections 2024-09-13T18:32:59.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:32:59.988+0000 7f880e88a700 1 -- 172.21.15.44:0/2556424598 wait complete. 2024-09-13T18:33:00.011 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:33:00.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.124+0000 7f89fec94700 1 Processor -- start 2024-09-13T18:33:00.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.124+0000 7f89fec94700 1 -- start start 2024-09-13T18:33:00.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.124+0000 7f89fec94700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f89f815ca90 0x7f89f806a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.124+0000 7f89fec94700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f89f815ce70 0x7f89f806aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.124+0000 7f89fec94700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f80d1bc0 con 0x7f89f806b420 2024-09-13T18:33:00.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.124+0000 7f89fec94700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f806b8b0 con 0x7f89f815ce70 2024-09-13T18:33:00.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.124+0000 7f89fec94700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f80cdac0 con 0x7f89f815ca90 2024-09-13T18:33:00.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.124+0000 7f89fe493700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f89f806b420 0x7f89f80b5d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60422/0 (socket says 172.21.15.44:60422) 2024-09-13T18:33:00.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.124+0000 7f89fe493700 1 -- 172.21.15.44:0/663190612 learned_addr learned my addr 172.21.15.44:0/663190612 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:00.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.124+0000 7f89fd491700 1 --2- 172.21.15.44:0/663190612 >> v2:172.21.15.44:3300/0 conn(0x7f89f815ce70 0x7f89f806aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.124+0000 7f89fdc92700 1 --2- 172.21.15.44:0/663190612 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f89f815ca90 0x7f89f806a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.124+0000 7f89fcc90700 1 -- 172.21.15.44:0/663190612 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300371351 0 0) 0x7f89f80d1bc0 con 0x7f89f806b420 2024-09-13T18:33:00.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.124+0000 7f89fcc90700 1 -- 172.21.15.44:0/663190612 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89e40035d0 con 0x7f89f806b420 2024-09-13T18:33:00.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.128+0000 7f89fcc90700 1 -- 172.21.15.44:0/663190612 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 900267996 0 0) 0x7f89e40035d0 con 0x7f89f806b420 2024-09-13T18:33:00.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.128+0000 7f89fd491700 1 -- 172.21.15.44:0/663190612 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f89f815ca90 msgr2=0x7f89f806a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:00.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.128+0000 7f89fd491700 1 --2- 172.21.15.44:0/663190612 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f89f815ca90 0x7f89f806a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.128+0000 7f89fd491700 1 -- 172.21.15.44:0/663190612 >> v1:172.21.15.44:6789/0 conn(0x7f89f806b420 legacy=0x7f89f80b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.128+0000 7f89fd491700 1 -- 172.21.15.44:0/663190612 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f806ac20 con 0x7f89f815ce70 2024-09-13T18:33:00.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.128+0000 7f89fdc92700 1 --2- 172.21.15.44:0/663190612 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f89f815ca90 0x7f89f806a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:33:00.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.128+0000 7f89fd491700 1 --2- 172.21.15.44:0/663190612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f815ce70 0x7f89f806aee0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009850 tx=0x7f89f4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24bbcb6eb763026b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:00.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.128+0000 7f89fcc90700 1 -- 172.21.15.44:0/663190612 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f00019f0 con 0x7f89f815ce70 2024-09-13T18:33:00.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.128+0000 7f89fcc90700 1 -- 172.21.15.44:0/663190612 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f4004030 con 0x7f89f815ce70 2024-09-13T18:33:00.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.128+0000 7f89fcc90700 1 -- 172.21.15.44:0/663190612 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f40043e0 con 0x7f89f815ce70 2024-09-13T18:33:00.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.128+0000 7f89fec94700 1 -- 172.21.15.44:0/663190612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f815ce70 msgr2=0x7f89f806aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.128+0000 7f89fec94700 1 --2- 172.21.15.44:0/663190612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f815ce70 0x7f89f806aee0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009850 tx=0x7f89f4009b60 comp rx=0 tx=0).stop 2024-09-13T18:33:00.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.128+0000 7f89fec94700 1 -- 172.21.15.44:0/663190612 shutdown_connections 2024-09-13T18:33:00.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.128+0000 7f89fec94700 1 --2- 172.21.15.44:0/663190612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f815ce70 0x7f89f806aee0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.128+0000 7f89fec94700 1 --2- 172.21.15.44:0/663190612 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f89f815ca90 0x7f89f806a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.128+0000 7f89fec94700 1 -- 172.21.15.44:0/663190612 >> 172.21.15.44:0/663190612 conn(0x7f89f80d2c10 msgr2=0x7f89f80d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:00.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.128+0000 7f89fec94700 1 -- 172.21.15.44:0/663190612 shutdown_connections 2024-09-13T18:33:00.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.128+0000 7f89fec94700 1 -- 172.21.15.44:0/663190612 wait complete. 2024-09-13T18:33:00.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.132+0000 7f89fec94700 1 Processor -- start 2024-09-13T18:33:00.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.132+0000 7f89fec94700 1 -- start start 2024-09-13T18:33:00.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.132+0000 7f89fec94700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f806b420 0x7f89f815fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.132+0000 7f89fec94700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89f815ca90 0x7f89f815d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.132+0000 7f89fec94700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f89f815ce70 0x7f89f81517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.132+0000 7f89fec94700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f80ccc20 con 0x7f89f806b420 2024-09-13T18:33:00.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.132+0000 7f89fec94700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f80c78c0 con 0x7f89f815ca90 2024-09-13T18:33:00.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.132+0000 7f89fec94700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f80cc660 con 0x7f89f815ce70 2024-09-13T18:33:00.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.132+0000 7f89fdc92700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f806b420 0x7f89f815fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.132+0000 7f89fdc92700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f806b420 0x7f89f815fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55344/0 (socket says 172.21.15.44:55344) 2024-09-13T18:33:00.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.132+0000 7f89fdc92700 1 -- 172.21.15.44:0/1362844859 learned_addr learned my addr 172.21.15.44:0/1362844859 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:00.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.132+0000 7f89fd491700 1 --2- 172.21.15.44:0/1362844859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89f815ca90 0x7f89f815d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.132+0000 7f89fe493700 1 --2- 172.21.15.44:0/1362844859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f89f815ce70 0x7f89f81517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.132+0000 7f89fd491700 1 -- 172.21.15.44:0/1362844859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f89f815ce70 msgr2=0x7f89f81517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.132+0000 7f89fd491700 1 --2- 172.21.15.44:0/1362844859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f89f815ce70 0x7f89f81517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.132+0000 7f89fd491700 1 -- 172.21.15.44:0/1362844859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f806b420 msgr2=0x7f89f815fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.132+0000 7f89fd491700 1 --2- 172.21.15.44:0/1362844859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f806b420 0x7f89f815fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.132+0000 7f89fd491700 1 -- 172.21.15.44:0/1362844859 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e80094b0 con 0x7f89f815ca90 2024-09-13T18:33:00.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.132+0000 7f89fdc92700 1 --2- 172.21.15.44:0/1362844859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f806b420 0x7f89f815fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:33:00.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.132+0000 7f89fd491700 1 --2- 172.21.15.44:0/1362844859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89f815ca90 0x7f89f815d4e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f89f4015000 tx=0x7f89f4004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:00.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.136+0000 7f89ee7fc700 1 -- 172.21.15.44:0/1362844859 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f4003d10 con 0x7f89f815ca90 2024-09-13T18:33:00.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.136+0000 7f89ee7fc700 1 -- 172.21.15.44:0/1362844859 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f401f070 con 0x7f89f815ca90 2024-09-13T18:33:00.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.136+0000 7f89fec94700 1 -- 172.21.15.44:0/1362844859 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f40094b0 con 0x7f89f815ca90 2024-09-13T18:33:00.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.136+0000 7f89ee7fc700 1 -- 172.21.15.44:0/1362844859 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f4011870 con 0x7f89f815ca90 2024-09-13T18:33:00.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.136+0000 7f89fec94700 1 -- 172.21.15.44:0/1362844859 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f80c7b60 con 0x7f89f815ca90 2024-09-13T18:33:00.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.136+0000 7f89fec94700 1 -- 172.21.15.44:0/1362844859 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f80b1ce0 con 0x7f89f815ca90 2024-09-13T18:33:00.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.136+0000 7f89ee7fc700 1 -- 172.21.15.44:0/1362844859 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f89f40119d0 con 0x7f89f815ca90 2024-09-13T18:33:00.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.136+0000 7f89ee7fc700 1 --2- 172.21.15.44:0/1362844859 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f89dc066730 0x7f89dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.136+0000 7f89ee7fc700 1 -- 172.21.15.44:0/1362844859 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f89f4021070 con 0x7f89f815ca90 2024-09-13T18:33:00.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.140+0000 7f89fdc92700 1 --2- 172.21.15.44:0/1362844859 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f89dc066730 0x7f89dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.140+0000 7f89fdc92700 1 --2- 172.21.15.44:0/1362844859 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f89dc066730 0x7f89dc068bf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f89e8011530 tx=0x7f89e8009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:00.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.148+0000 7f89ee7fc700 1 -- 172.21.15.44:0/1362844859 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f89f4053100 con 0x7f89f815ca90 2024-09-13T18:33:00.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.316+0000 7f89fec94700 1 -- 172.21.15.44:0/1362844859 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f89f80b2af0 con 0x7f89f815ca90 2024-09-13T18:33:00.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.320+0000 7f89ee7fc700 1 -- 172.21.15.44:0/1362844859 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7f89f4003e90 con 0x7f89f815ca90 2024-09-13T18:33:00.324 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:33:00.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.324+0000 7f89fec94700 1 -- 172.21.15.44:0/1362844859 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f89dc066730 msgr2=0x7f89dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.324+0000 7f89fec94700 1 --2- 172.21.15.44:0/1362844859 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f89dc066730 0x7f89dc068bf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f89e8011530 tx=0x7f89e8009240 comp rx=0 tx=0).stop 2024-09-13T18:33:00.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.324+0000 7f89fec94700 1 -- 172.21.15.44:0/1362844859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89f815ca90 msgr2=0x7f89f815d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.324+0000 7f89fec94700 1 --2- 172.21.15.44:0/1362844859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89f815ca90 0x7f89f815d4e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f89f4015000 tx=0x7f89f4004770 comp rx=0 tx=0).stop 2024-09-13T18:33:00.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.324+0000 7f89fec94700 1 -- 172.21.15.44:0/1362844859 shutdown_connections 2024-09-13T18:33:00.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.324+0000 7f89fec94700 1 --2- 172.21.15.44:0/1362844859 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f89dc066730 0x7f89dc068bf0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.324+0000 7f89fec94700 1 --2- 172.21.15.44:0/1362844859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f89f815ce70 0x7f89f81517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.324+0000 7f89fec94700 1 --2- 172.21.15.44:0/1362844859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89f815ca90 0x7f89f815d4e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.324+0000 7f89fec94700 1 --2- 172.21.15.44:0/1362844859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f806b420 0x7f89f815fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.324+0000 7f89fec94700 1 -- 172.21.15.44:0/1362844859 >> 172.21.15.44:0/1362844859 conn(0x7f89f80d2c10 msgr2=0x7f89f80b6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:00.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.324+0000 7f89fec94700 1 -- 172.21.15.44:0/1362844859 shutdown_connections 2024-09-13T18:33:00.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.324+0000 7f89fec94700 1 -- 172.21.15.44:0/1362844859 wait complete. 2024-09-13T18:33:00.346 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:33:00.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.460+0000 7f473759e700 1 Processor -- start 2024-09-13T18:33:00.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.460+0000 7f473759e700 1 -- start start 2024-09-13T18:33:00.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f473759e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f473815a870 0x7f4738140c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f473759e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47380b5510 0x7f473806dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f473759e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f473806e400 0x7f473806aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f473759e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473806e870 con 0x7f473806e400 2024-09-13T18:33:00.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f473759e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4738141160 con 0x7f473815a870 2024-09-13T18:33:00.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f473759e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473815eed0 con 0x7f47380b5510 2024-09-13T18:33:00.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f4736d9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f473806e400 0x7f473806aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f4736d9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f473806e400 0x7f473806aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55352/0 (socket says 172.21.15.44:55352) 2024-09-13T18:33:00.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f4736d9d700 1 -- 172.21.15.44:0/3514267617 learned_addr learned my addr 172.21.15.44:0/3514267617 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:00.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f473659c700 1 --2- 172.21.15.44:0/3514267617 >> v2:172.21.15.99:3300/0 conn(0x7f473815a870 0x7f4738140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f472ffff700 1 --2- 172.21.15.44:0/3514267617 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47380b5510 0x7f473806dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f4736d9d700 1 -- 172.21.15.44:0/3514267617 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47380b5510 msgr2=0x7f473806dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:00.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f4736d9d700 1 --2- 172.21.15.44:0/3514267617 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47380b5510 0x7f473806dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f4736d9d700 1 -- 172.21.15.44:0/3514267617 >> v2:172.21.15.99:3300/0 conn(0x7f473815a870 msgr2=0x7f4738140c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:00.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f4736d9d700 1 --2- 172.21.15.44:0/3514267617 >> v2:172.21.15.99:3300/0 conn(0x7f473815a870 0x7f4738140c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f4736d9d700 1 -- 172.21.15.44:0/3514267617 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47381444a0 con 0x7f473806e400 2024-09-13T18:33:00.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f473659c700 1 --2- 172.21.15.44:0/3514267617 >> v2:172.21.15.99:3300/0 conn(0x7f473815a870 0x7f4738140c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:33:00.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f4736d9d700 1 --2- 172.21.15.44:0/3514267617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f473806e400 0x7f473806aba0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f473806eab0 tx=0x7f473000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f54ea1bc259caf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:00.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f4735d9b700 1 -- 172.21.15.44:0/3514267617 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473000e070 con 0x7f473806e400 2024-09-13T18:33:00.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f4735d9b700 1 -- 172.21.15.44:0/3514267617 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473000b910 con 0x7f473806e400 2024-09-13T18:33:00.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f4735d9b700 1 -- 172.21.15.44:0/3514267617 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473000bcc0 con 0x7f473806e400 2024-09-13T18:33:00.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f473759e700 1 -- 172.21.15.44:0/3514267617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f473806e400 msgr2=0x7f473806aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f473759e700 1 --2- 172.21.15.44:0/3514267617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f473806e400 0x7f473806aba0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f473806eab0 tx=0x7f473000b330 comp rx=0 tx=0).stop 2024-09-13T18:33:00.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f473759e700 1 -- 172.21.15.44:0/3514267617 shutdown_connections 2024-09-13T18:33:00.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f473759e700 1 --2- 172.21.15.44:0/3514267617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f473806e400 0x7f473806aba0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f473759e700 1 --2- 172.21.15.44:0/3514267617 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47380b5510 0x7f473806dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f473759e700 1 --2- 172.21.15.44:0/3514267617 >> v2:172.21.15.99:3300/0 conn(0x7f473815a870 0x7f4738140c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f473759e700 1 -- 172.21.15.44:0/3514267617 >> 172.21.15.44:0/3514267617 conn(0x7f47380cf980 msgr2=0x7f47380cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:00.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f473759e700 1 -- 172.21.15.44:0/3514267617 shutdown_connections 2024-09-13T18:33:00.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.464+0000 7f473759e700 1 -- 172.21.15.44:0/3514267617 wait complete. 2024-09-13T18:33:00.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.468+0000 7f473759e700 1 Processor -- start 2024-09-13T18:33:00.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.468+0000 7f473759e700 1 -- start start 2024-09-13T18:33:00.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.468+0000 7f473759e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f473806e400 0x7f473813d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.468+0000 7f473759e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47380b5510 0x7f47381560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.468+0000 7f473759e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f473815a870 0x7f473813b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.468+0000 7f473759e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4738156610 con 0x7f473815a870 2024-09-13T18:33:00.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.468+0000 7f473759e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4738156ac0 con 0x7f47380b5510 2024-09-13T18:33:00.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.468+0000 7f473759e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473813b7c0 con 0x7f473806e400 2024-09-13T18:33:00.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.468+0000 7f4736d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f473815a870 0x7f473813b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.468+0000 7f472ffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47380b5510 0x7f47381560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.468+0000 7f4736d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f473815a870 0x7f473813b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55360/0 (socket says 172.21.15.44:55360) 2024-09-13T18:33:00.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.468+0000 7f473659c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f473806e400 0x7f473813d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.468+0000 7f4736d9d700 1 -- 172.21.15.44:0/2376762999 learned_addr learned my addr 172.21.15.44:0/2376762999 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:00.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.472+0000 7f4736d9d700 1 -- 172.21.15.44:0/2376762999 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f473806e400 msgr2=0x7f473813d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.472+0000 7f4736d9d700 1 --2- 172.21.15.44:0/2376762999 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f473806e400 0x7f473813d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.472+0000 7f4736d9d700 1 -- 172.21.15.44:0/2376762999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47380b5510 msgr2=0x7f47381560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.472+0000 7f4736d9d700 1 --2- 172.21.15.44:0/2376762999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47380b5510 0x7f47381560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.472+0000 7f4736d9d700 1 -- 172.21.15.44:0/2376762999 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47280094b0 con 0x7f473815a870 2024-09-13T18:33:00.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.472+0000 7f4736d9d700 1 --2- 172.21.15.44:0/2376762999 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f473815a870 0x7f473813b280 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f47380b54e0 tx=0x7f4730004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:00.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.472+0000 7f472effd700 1 -- 172.21.15.44:0/2376762999 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47300092e0 con 0x7f473815a870 2024-09-13T18:33:00.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.472+0000 7f472effd700 1 -- 172.21.15.44:0/2376762999 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473000ce80 con 0x7f473815a870 2024-09-13T18:33:00.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.472+0000 7f473759e700 1 -- 172.21.15.44:0/2376762999 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4730009b30 con 0x7f473815a870 2024-09-13T18:33:00.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.472+0000 7f472effd700 1 -- 172.21.15.44:0/2376762999 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47300044b0 con 0x7f473815a870 2024-09-13T18:33:00.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.472+0000 7f473759e700 1 -- 172.21.15.44:0/2376762999 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4738159040 con 0x7f473815a870 2024-09-13T18:33:00.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.472+0000 7f473759e700 1 -- 172.21.15.44:0/2376762999 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47381591d0 con 0x7f473815a870 2024-09-13T18:33:00.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.472+0000 7f472effd700 1 -- 172.21.15.44:0/2376762999 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4730004610 con 0x7f473815a870 2024-09-13T18:33:00.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.472+0000 7f472effd700 1 --2- 172.21.15.44:0/2376762999 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4718066730 0x7f4718068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.476+0000 7f472effd700 1 -- 172.21.15.44:0/2376762999 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f4730085560 con 0x7f473815a870 2024-09-13T18:33:00.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.476+0000 7f473659c700 1 --2- 172.21.15.44:0/2376762999 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4718066730 0x7f4718068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.476+0000 7f473659c700 1 --2- 172.21.15.44:0/2376762999 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4718066730 0x7f4718068bf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4728009ce0 tx=0x7f4728009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:00.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.484+0000 7f472effd700 1 -- 172.21.15.44:0/2376762999 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4730052860 con 0x7f473815a870 2024-09-13T18:33:00.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.664+0000 7f473759e700 1 -- 172.21.15.44:0/2376762999 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f47380cce00 con 0x7f473815a870 2024-09-13T18:33:00.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.668+0000 7f472effd700 1 -- 172.21.15.44:0/2376762999 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v51) v1 ==== 80+0+122 (secure 0 0 0) 0x7f4730055e80 con 0x7f473815a870 2024-09-13T18:33:00.672 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/3200882245 2024-09-14T18:30:35.073090+0000 2024-09-13T18:33:00.672 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6834/3200882245 2024-09-14T18:30:35.073090+0000 2024-09-13T18:33:00.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.668+0000 7f473759e700 1 -- 172.21.15.44:0/2376762999 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4718066730 msgr2=0x7f4718068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.668+0000 7f473759e700 1 --2- 172.21.15.44:0/2376762999 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4718066730 0x7f4718068bf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4728009ce0 tx=0x7f4728009240 comp rx=0 tx=0).stop 2024-09-13T18:33:00.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.668+0000 7f473759e700 1 -- 172.21.15.44:0/2376762999 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f473815a870 msgr2=0x7f473813b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.668+0000 7f473759e700 1 --2- 172.21.15.44:0/2376762999 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f473815a870 0x7f473813b280 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f47380b54e0 tx=0x7f4730004af0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.668+0000 7f473759e700 1 -- 172.21.15.44:0/2376762999 shutdown_connections 2024-09-13T18:33:00.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.668+0000 7f473759e700 1 --2- 172.21.15.44:0/2376762999 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4718066730 0x7f4718068bf0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.668+0000 7f473759e700 1 --2- 172.21.15.44:0/2376762999 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f473815a870 0x7f473813b280 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.668+0000 7f473759e700 1 --2- 172.21.15.44:0/2376762999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47380b5510 0x7f47381560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.668+0000 7f473759e700 1 --2- 172.21.15.44:0/2376762999 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f473806e400 0x7f473813d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.668+0000 7f473759e700 1 -- 172.21.15.44:0/2376762999 >> 172.21.15.44:0/2376762999 conn(0x7f47380cf980 msgr2=0x7f47380ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:00.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.668+0000 7f473759e700 1 -- 172.21.15.44:0/2376762999 shutdown_connections 2024-09-13T18:33:00.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:00.668+0000 7f473759e700 1 -- 172.21.15.44:0/2376762999 wait complete. 2024-09-13T18:33:00.676 INFO:teuthology.orchestra.run.smithi044.stderr:listed 2 entries 2024-09-13T18:33:00.687 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2024-09-13T18:33:00.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:00.687 DEBUG:teuthology.orchestra.run.smithi044:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:33:00.699 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[42001]: fuse finished with error 0 and tester_r 0 2024-09-13T18:33:00.701 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:33:00.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:00.701 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:33:00.825 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:33:00.825 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:00.833 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346268k,nr_inodes=4086567,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19562 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275480k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:33:00.833 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:33:00.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:00.834 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:33:00.880 INFO:teuthology.orchestra.run.smithi099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-13T18:33:00.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:33:00.882 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:33:00.882 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:00.891 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349428k,nr_inodes=4087357,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16693 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276112k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:33:00.891 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:33:00.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:00.892 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T18:33:00.898 INFO:teuthology.orchestra.run.smithi044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T18:33:00.899 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:33:00.900 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:33:00.900 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:00.908 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346268k,nr_inodes=4086567,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19562 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275480k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:33:00.908 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:33:00.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:00.908 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T18:33:00.956 INFO:teuthology.orchestra.run.smithi099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T18:33:00.957 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:33:00.957 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:33:01.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.072+0000 7ff2dffff700 1 Processor -- start 2024-09-13T18:33:01.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.072+0000 7ff2dffff700 1 -- start start 2024-09-13T18:33:01.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.072+0000 7ff2dffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff2e015cec0 0x7ff2e00cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.072+0000 7ff2dffff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff2e006b310 0x7ff2e00d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.072+0000 7ff2dffff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e00d21e0 con 0x7ff2e015cae0 2024-09-13T18:33:01.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.072+0000 7ff2dffff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e00d1750 con 0x7ff2e006b310 2024-09-13T18:33:01.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.072+0000 7ff2dffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00d1940 con 0x7ff2e015cec0 2024-09-13T18:33:01.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.072+0000 7ff2deffd700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff2e015cae0 0x7ff2e006ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60432/0 (socket says 172.21.15.44:60432) 2024-09-13T18:33:01.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.072+0000 7ff2deffd700 1 -- 172.21.15.44:0/3875774555 learned_addr learned my addr 172.21.15.44:0/3875774555 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:01.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.072+0000 7ff2df7fe700 1 --2- 172.21.15.44:0/3875774555 >> v2:172.21.15.99:3300/0 conn(0x7ff2e006b310 0x7ff2e00d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.072+0000 7ff2de7fc700 1 --2- 172.21.15.44:0/3875774555 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff2e015cec0 0x7ff2e00cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.072+0000 7ff2ddffb700 1 -- 172.21.15.44:0/3875774555 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747208809 0 0) 0x7ff2e00d21e0 con 0x7ff2e015cae0 2024-09-13T18:33:01.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.072+0000 7ff2ddffb700 1 -- 172.21.15.44:0/3875774555 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2c80035d0 con 0x7ff2e015cae0 2024-09-13T18:33:01.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.072+0000 7ff2df7fe700 1 -- 172.21.15.44:0/3875774555 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff2e015cec0 msgr2=0x7ff2e00cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:01.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.072+0000 7ff2df7fe700 1 --2- 172.21.15.44:0/3875774555 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff2e015cec0 0x7ff2e00cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.072+0000 7ff2df7fe700 1 -- 172.21.15.44:0/3875774555 >> v1:172.21.15.44:6789/0 conn(0x7ff2e015cae0 legacy=0x7ff2e006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.072+0000 7ff2df7fe700 1 -- 172.21.15.44:0/3875774555 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e00d1c20 con 0x7ff2e006b310 2024-09-13T18:33:01.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.076+0000 7ff2df7fe700 1 --2- 172.21.15.44:0/3875774555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2e006b310 0x7ff2e00d1210 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009d90 tx=0x7ff2d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51717a2c1c532edb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:01.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.076+0000 7ff2ddffb700 1 -- 172.21.15.44:0/3875774555 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d800e070 con 0x7ff2e006b310 2024-09-13T18:33:01.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.076+0000 7ff2ddffb700 1 -- 172.21.15.44:0/3875774555 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d800bb20 con 0x7ff2e006b310 2024-09-13T18:33:01.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.076+0000 7ff2ddffb700 1 -- 172.21.15.44:0/3875774555 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8012430 con 0x7ff2e006b310 2024-09-13T18:33:01.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.076+0000 7ff2dffff700 1 -- 172.21.15.44:0/3875774555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2e006b310 msgr2=0x7ff2e00d1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.076+0000 7ff2dffff700 1 --2- 172.21.15.44:0/3875774555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2e006b310 0x7ff2e00d1210 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009d90 tx=0x7ff2d800b330 comp rx=0 tx=0).stop 2024-09-13T18:33:01.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.076+0000 7ff2dffff700 1 -- 172.21.15.44:0/3875774555 shutdown_connections 2024-09-13T18:33:01.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.076+0000 7ff2dffff700 1 --2- 172.21.15.44:0/3875774555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2e006b310 0x7ff2e00d1210 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.076+0000 7ff2dffff700 1 --2- 172.21.15.44:0/3875774555 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff2e015cec0 0x7ff2e00cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.076+0000 7ff2dffff700 1 -- 172.21.15.44:0/3875774555 >> 172.21.15.44:0/3875774555 conn(0x7ff2e00d2c80 msgr2=0x7ff2e00d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:01.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.076+0000 7ff2dffff700 1 -- 172.21.15.44:0/3875774555 shutdown_connections 2024-09-13T18:33:01.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.076+0000 7ff2dffff700 1 -- 172.21.15.44:0/3875774555 wait complete. 2024-09-13T18:33:01.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.080+0000 7ff2dffff700 1 Processor -- start 2024-09-13T18:33:01.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.080+0000 7ff2dffff700 1 -- start start 2024-09-13T18:33:01.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.080+0000 7ff2dffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2e006b310 0x7ff2e00c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.080+0000 7ff2dffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff2e015cae0 0x7ff2e015f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.080+0000 7ff2dffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2e015cec0 0x7ff2e00cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.080+0000 7ff2dffff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00c77c0 con 0x7ff2e015cec0 2024-09-13T18:33:01.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.080+0000 7ff2dffff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e01f2f70 con 0x7ff2e006b310 2024-09-13T18:33:01.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.080+0000 7ff2dffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00c7a10 con 0x7ff2e015cae0 2024-09-13T18:33:01.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.080+0000 7ff2df7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2e015cec0 0x7ff2e00cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.080+0000 7ff2deffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2e006b310 0x7ff2e00c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.080+0000 7ff2df7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2e015cec0 0x7ff2e00cb030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55366/0 (socket says 172.21.15.44:55366) 2024-09-13T18:33:01.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.080+0000 7ff2df7fe700 1 -- 172.21.15.44:0/256131592 learned_addr learned my addr 172.21.15.44:0/256131592 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:01.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.080+0000 7ff2de7fc700 1 --2- 172.21.15.44:0/256131592 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff2e015cae0 0x7ff2e015f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.084+0000 7ff2df7fe700 1 -- 172.21.15.44:0/256131592 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff2e015cae0 msgr2=0x7ff2e015f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.084+0000 7ff2df7fe700 1 --2- 172.21.15.44:0/256131592 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff2e015cae0 0x7ff2e015f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.084+0000 7ff2df7fe700 1 -- 172.21.15.44:0/256131592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2e006b310 msgr2=0x7ff2e00c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.084+0000 7ff2df7fe700 1 --2- 172.21.15.44:0/256131592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2e006b310 0x7ff2e00c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.084+0000 7ff2df7fe700 1 -- 172.21.15.44:0/256131592 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d8009a70 con 0x7ff2e015cec0 2024-09-13T18:33:01.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.084+0000 7ff2df7fe700 1 --2- 172.21.15.44:0/256131592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2e015cec0 0x7ff2e00cb030 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8014040 tx=0x7ff2d8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:01.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.084+0000 7ff2c7fff700 1 -- 172.21.15.44:0/256131592 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8012430 con 0x7ff2e015cec0 2024-09-13T18:33:01.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.084+0000 7ff2c7fff700 1 -- 172.21.15.44:0/256131592 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d8020070 con 0x7ff2e015cec0 2024-09-13T18:33:01.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.084+0000 7ff2dffff700 1 -- 172.21.15.44:0/256131592 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e00c7cf0 con 0x7ff2e015cec0 2024-09-13T18:33:01.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.084+0000 7ff2c7fff700 1 -- 172.21.15.44:0/256131592 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8004280 con 0x7ff2e015cec0 2024-09-13T18:33:01.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.084+0000 7ff2dffff700 1 -- 172.21.15.44:0/256131592 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e015fe50 con 0x7ff2e015cec0 2024-09-13T18:33:01.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.084+0000 7ff2dffff700 1 -- 172.21.15.44:0/256131592 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e006ba50 con 0x7ff2e015cec0 2024-09-13T18:33:01.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.088+0000 7ff2c7fff700 1 -- 172.21.15.44:0/256131592 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff2d80043e0 con 0x7ff2e015cec0 2024-09-13T18:33:01.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.088+0000 7ff2c7fff700 1 --2- 172.21.15.44:0/256131592 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff2cc066730 0x7ff2cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.088+0000 7ff2c7fff700 1 -- 172.21.15.44:0/256131592 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7ff2d8022070 con 0x7ff2e015cec0 2024-09-13T18:33:01.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.088+0000 7ff2deffd700 1 --2- 172.21.15.44:0/256131592 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff2cc066730 0x7ff2cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.088+0000 7ff2deffd700 1 --2- 172.21.15.44:0/256131592 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff2cc066730 0x7ff2cc068bf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4007fd0 tx=0x7ff2d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:01.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.096+0000 7ff2c7fff700 1 -- 172.21.15.44:0/256131592 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff2d8053730 con 0x7ff2e015cec0 2024-09-13T18:33:01.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.304+0000 7ff2dffff700 1 -- 172.21.15.44:0/256131592 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2e015ffe0 con 0x7ff2e015cec0 2024-09-13T18:33:01.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.308+0000 7ff2c7fff700 1 -- 172.21.15.44:0/256131592 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4736 (secure 0 0 0) 0x7ff2d8056d50 con 0x7ff2e015cec0 2024-09-13T18:33:01.312 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:33:01.313 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5447,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2081931615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2081931615},{"type":"v1","addr":"172.21.15.99:6835","nonce":2081931615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5639,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1452559390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1452559390},{"type":"v1","addr":"172.21.15.44:6835","nonce":1452559390}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5887,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/2337853364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2337853364},{"type":"v1","addr":"172.21.15.99:6837","nonce":2337853364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:29:10.283572+0000","modified":"2024-09-13T18:31:49.597435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":51,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5976},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5976":{"gid":5976,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":44,"addr":"172.21.15.44:6833/3567136594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3567136594},{"type":"v1","addr":"172.21.15.44:6833","nonce":3567136594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:33:01.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.308+0000 7ff2dffff700 1 -- 172.21.15.44:0/256131592 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff2cc066730 msgr2=0x7ff2cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.308+0000 7ff2dffff700 1 --2- 172.21.15.44:0/256131592 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff2cc066730 0x7ff2cc068bf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4007fd0 tx=0x7ff2d4009040 comp rx=0 tx=0).stop 2024-09-13T18:33:01.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.308+0000 7ff2dffff700 1 -- 172.21.15.44:0/256131592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2e015cec0 msgr2=0x7ff2e00cb030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.308+0000 7ff2dffff700 1 --2- 172.21.15.44:0/256131592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2e015cec0 0x7ff2e00cb030 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8014040 tx=0x7ff2d8004af0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.308+0000 7ff2dffff700 1 -- 172.21.15.44:0/256131592 shutdown_connections 2024-09-13T18:33:01.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.308+0000 7ff2dffff700 1 --2- 172.21.15.44:0/256131592 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff2cc066730 0x7ff2cc068bf0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.308+0000 7ff2dffff700 1 --2- 172.21.15.44:0/256131592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2e015cec0 0x7ff2e00cb030 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.308+0000 7ff2dffff700 1 --2- 172.21.15.44:0/256131592 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff2e015cae0 0x7ff2e015f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.308+0000 7ff2dffff700 1 --2- 172.21.15.44:0/256131592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2e006b310 0x7ff2e00c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.308+0000 7ff2dffff700 1 -- 172.21.15.44:0/256131592 >> 172.21.15.44:0/256131592 conn(0x7ff2e00d2c80 msgr2=0x7ff2e00ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:01.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.308+0000 7ff2dffff700 1 -- 172.21.15.44:0/256131592 shutdown_connections 2024-09-13T18:33:01.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.308+0000 7ff2dffff700 1 -- 172.21.15.44:0/256131592 wait complete. 2024-09-13T18:33:01.316 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 38 2024-09-13T18:33:01.328 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:01.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.432+0000 7fd33b59e700 1 Processor -- start 2024-09-13T18:33:01.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.432+0000 7fd33b59e700 1 -- start start 2024-09-13T18:33:01.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.432+0000 7fd33b59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd33c15cd80 0x7fd33c06baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.432+0000 7fd33b59e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33c15d160 con 0x7fd33c06b170 2024-09-13T18:33:01.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.432+0000 7fd33b59e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33c0d2120 con 0x7fd33c06a640 2024-09-13T18:33:01.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.432+0000 7fd33b59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0d1570 con 0x7fd33c15cd80 2024-09-13T18:33:01.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.436+0000 7fd33ad9d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd33c06b170 0x7fd33c0ce240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60446/0 (socket says 172.21.15.44:60446) 2024-09-13T18:33:01.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.436+0000 7fd33ad9d700 1 -- 172.21.15.44:0/3608238946 learned_addr learned my addr 172.21.15.44:0/3608238946 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:01.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.436+0000 7fd33a59c700 1 --2- 172.21.15.44:0/3608238946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd33c15cd80 0x7fd33c06baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.436+0000 7fd33959a700 1 -- 172.21.15.44:0/3608238946 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1482795313 0 0) 0x7fd33c0d2120 con 0x7fd33c06a640 2024-09-13T18:33:01.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.436+0000 7fd33959a700 1 -- 172.21.15.44:0/3608238946 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3240035d0 con 0x7fd33c06a640 2024-09-13T18:33:01.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.436+0000 7fd33959a700 1 -- 172.21.15.44:0/3608238946 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742796705 0 0) 0x7fd33c15d160 con 0x7fd33c06b170 2024-09-13T18:33:01.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.436+0000 7fd33959a700 1 -- 172.21.15.44:0/3608238946 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd33c0d2120 con 0x7fd33c06b170 2024-09-13T18:33:01.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.436+0000 7fd33a59c700 1 -- 172.21.15.44:0/3608238946 >> v1:172.21.15.99:6789/0 conn(0x7fd33c06a640 legacy=0x7fd33c06aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.436+0000 7fd33a59c700 1 -- 172.21.15.44:0/3608238946 >> v1:172.21.15.44:6789/0 conn(0x7fd33c06b170 legacy=0x7fd33c0ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.436+0000 7fd33a59c700 1 -- 172.21.15.44:0/3608238946 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c0d25b0 con 0x7fd33c15cd80 2024-09-13T18:33:01.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.436+0000 7fd33a59c700 1 --2- 172.21.15.44:0/3608238946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd33c15cd80 0x7fd33c06baa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd330009880 tx=0x7fd330009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=867ade243f32f7e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:01.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.436+0000 7fd33959a700 1 -- 172.21.15.44:0/3608238946 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd330011830 con 0x7fd33c15cd80 2024-09-13T18:33:01.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.436+0000 7fd33959a700 1 -- 172.21.15.44:0/3608238946 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd330011990 con 0x7fd33c15cd80 2024-09-13T18:33:01.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.436+0000 7fd33959a700 1 -- 172.21.15.44:0/3608238946 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd330011d00 con 0x7fd33c15cd80 2024-09-13T18:33:01.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.436+0000 7fd33b59e700 1 -- 172.21.15.44:0/3608238946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd33c15cd80 msgr2=0x7fd33c06baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.436+0000 7fd33b59e700 1 --2- 172.21.15.44:0/3608238946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd33c15cd80 0x7fd33c06baa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd330009880 tx=0x7fd330009b90 comp rx=0 tx=0).stop 2024-09-13T18:33:01.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.436+0000 7fd33b59e700 1 -- 172.21.15.44:0/3608238946 shutdown_connections 2024-09-13T18:33:01.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.436+0000 7fd33b59e700 1 --2- 172.21.15.44:0/3608238946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd33c15cd80 0x7fd33c06baa0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.436+0000 7fd33b59e700 1 -- 172.21.15.44:0/3608238946 >> 172.21.15.44:0/3608238946 conn(0x7fd33c0d30b0 msgr2=0x7fd33c0d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:01.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.436+0000 7fd33b59e700 1 -- 172.21.15.44:0/3608238946 shutdown_connections 2024-09-13T18:33:01.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.436+0000 7fd33b59e700 1 -- 172.21.15.44:0/3608238946 wait complete. 2024-09-13T18:33:01.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.440+0000 7fd33b59e700 1 Processor -- start 2024-09-13T18:33:01.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.440+0000 7fd33b59e700 1 -- start start 2024-09-13T18:33:01.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.440+0000 7fd33b59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd33c06a640 0x7fd33c1f1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.440+0000 7fd33b59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd33c06b170 0x7fd33c15f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.440+0000 7fd33b59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd33c15cd80 0x7fd33c0cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.440+0000 7fd33b59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0aa390 con 0x7fd33c06a640 2024-09-13T18:33:01.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.440+0000 7fd33b59e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0aa670 con 0x7fd33c06b170 2024-09-13T18:33:01.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.440+0000 7fd33b59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0aa950 con 0x7fd33c15cd80 2024-09-13T18:33:01.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.440+0000 7fd33a59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd33c06a640 0x7fd33c1f1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.440+0000 7fd33a59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd33c06a640 0x7fd33c1f1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55370/0 (socket says 172.21.15.44:55370) 2024-09-13T18:33:01.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.440+0000 7fd33a59c700 1 -- 172.21.15.44:0/2179518237 learned_addr learned my addr 172.21.15.44:0/2179518237 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:01.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.440+0000 7fd339d9b700 1 --2- 172.21.15.44:0/2179518237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd33c06b170 0x7fd33c15f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.440+0000 7fd33ad9d700 1 --2- 172.21.15.44:0/2179518237 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd33c15cd80 0x7fd33c0cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.440+0000 7fd33a59c700 1 -- 172.21.15.44:0/2179518237 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd33c15cd80 msgr2=0x7fd33c0cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.440+0000 7fd33a59c700 1 --2- 172.21.15.44:0/2179518237 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd33c15cd80 0x7fd33c0cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.440+0000 7fd33a59c700 1 -- 172.21.15.44:0/2179518237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd33c06b170 msgr2=0x7fd33c15f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.440+0000 7fd33a59c700 1 --2- 172.21.15.44:0/2179518237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd33c06b170 0x7fd33c15f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.440+0000 7fd33a59c700 1 -- 172.21.15.44:0/2179518237 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3300094b0 con 0x7fd33c06a640 2024-09-13T18:33:01.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.440+0000 7fd33ad9d700 1 --2- 172.21.15.44:0/2179518237 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd33c15cd80 0x7fd33c0cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:01.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.440+0000 7fd33a59c700 1 --2- 172.21.15.44:0/2179518237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd33c06a640 0x7fd33c1f1bc0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fd3300090b0 tx=0x7fd330004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:01.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.444+0000 7fd32affd700 1 -- 172.21.15.44:0/2179518237 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd330004590 con 0x7fd33c06a640 2024-09-13T18:33:01.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.444+0000 7fd32affd700 1 -- 172.21.15.44:0/2179518237 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3300036c0 con 0x7fd33c06a640 2024-09-13T18:33:01.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.444+0000 7fd32affd700 1 -- 172.21.15.44:0/2179518237 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd330003a70 con 0x7fd33c06a640 2024-09-13T18:33:01.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.444+0000 7fd33b59e700 1 -- 172.21.15.44:0/2179518237 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33c0aac30 con 0x7fd33c06a640 2024-09-13T18:33:01.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.444+0000 7fd33b59e700 1 -- 172.21.15.44:0/2179518237 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33c0a9ff0 con 0x7fd33c06a640 2024-09-13T18:33:01.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.444+0000 7fd33b59e700 1 -- 172.21.15.44:0/2179518237 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd33c0ab150 con 0x7fd33c06a640 2024-09-13T18:33:01.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.444+0000 7fd32affd700 1 -- 172.21.15.44:0/2179518237 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd330003bd0 con 0x7fd33c06a640 2024-09-13T18:33:01.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.444+0000 7fd32affd700 1 --2- 172.21.15.44:0/2179518237 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd31c066730 0x7fd31c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.448+0000 7fd32affd700 1 -- 172.21.15.44:0/2179518237 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd330085760 con 0x7fd33c06a640 2024-09-13T18:33:01.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.448+0000 7fd339d9b700 1 --2- 172.21.15.44:0/2179518237 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd31c066730 0x7fd31c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.448+0000 7fd339d9b700 1 --2- 172.21.15.44:0/2179518237 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd31c066730 0x7fd31c068bf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd32c007fd0 tx=0x7fd32c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:01.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.452+0000 7fd32affd700 1 -- 172.21.15.44:0/2179518237 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd330052b50 con 0x7fd33c06a640 2024-09-13T18:33:01.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.616+0000 7fd33b59e700 1 -- 172.21.15.44:0/2179518237 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd33c06baa0 con 0x7fd33c06a640 2024-09-13T18:33:01.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.620+0000 7fd32affd700 1 -- 172.21.15.44:0/2179518237 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16674 (secure 0 0 0) 0x7fd330056170 con 0x7fd33c06a640 2024-09-13T18:33:01.625 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:33:01.625 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":51,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:30:35.073160+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:29:08.754284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:29:09.262346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.1b","mappings":[{"from":0,"to":5}]},{"pgid":"7.3c","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/3200882245":"2024-09-14T18:30:35.073090+0000","172.21.15.44:6834/3200882245":"2024-09-14T18:30:35.073090+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:01.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.620+0000 7fd33b59e700 1 -- 172.21.15.44:0/2179518237 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd31c066730 msgr2=0x7fd31c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.620+0000 7fd33b59e700 1 --2- 172.21.15.44:0/2179518237 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd31c066730 0x7fd31c068bf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd32c007fd0 tx=0x7fd32c009040 comp rx=0 tx=0).stop 2024-09-13T18:33:01.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.620+0000 7fd33b59e700 1 -- 172.21.15.44:0/2179518237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd33c06a640 msgr2=0x7fd33c1f1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.620+0000 7fd33b59e700 1 --2- 172.21.15.44:0/2179518237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd33c06a640 0x7fd33c1f1bc0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fd3300090b0 tx=0x7fd330004770 comp rx=0 tx=0).stop 2024-09-13T18:33:01.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.620+0000 7fd33b59e700 1 -- 172.21.15.44:0/2179518237 shutdown_connections 2024-09-13T18:33:01.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.620+0000 7fd33b59e700 1 --2- 172.21.15.44:0/2179518237 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd31c066730 0x7fd31c068bf0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.620+0000 7fd33b59e700 1 --2- 172.21.15.44:0/2179518237 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd33c15cd80 0x7fd33c0cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.620+0000 7fd33b59e700 1 --2- 172.21.15.44:0/2179518237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd33c06b170 0x7fd33c15f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.620+0000 7fd33b59e700 1 --2- 172.21.15.44:0/2179518237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd33c06a640 0x7fd33c1f1bc0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.620+0000 7fd33b59e700 1 -- 172.21.15.44:0/2179518237 >> 172.21.15.44:0/2179518237 conn(0x7fd33c0d30b0 msgr2=0x7fd33c06aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:01.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.624+0000 7fd33b59e700 1 -- 172.21.15.44:0/2179518237 shutdown_connections 2024-09-13T18:33:01.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.624+0000 7fd33b59e700 1 -- 172.21.15.44:0/2179518237 wait complete. 2024-09-13T18:33:01.641 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:29:08.754284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:29:09.262346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:33:01.641 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:33:01.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.760+0000 7faf3b47f700 1 Processor -- start 2024-09-13T18:33:01.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.760+0000 7faf3b47f700 1 -- start start 2024-09-13T18:33:01.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3b47f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf34150180 0x7faf34070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3b47f700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faf3406baa0 0x7faf340b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3b47f700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf34070df0 con 0x7faf34070890 2024-09-13T18:33:01.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3b47f700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf340710d0 con 0x7faf3406baa0 2024-09-13T18:33:01.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3b47f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf340713b0 con 0x7faf34150180 2024-09-13T18:33:01.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf39c7c700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7faf34070890 0x7faf3406b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60448/0 (socket says 172.21.15.44:60448) 2024-09-13T18:33:01.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf39c7c700 1 -- 172.21.15.44:0/3945411460 learned_addr learned my addr 172.21.15.44:0/3945411460 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:01.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3ac7e700 1 --2- 172.21.15.44:0/3945411460 >> v2:172.21.15.99:3300/0 conn(0x7faf3406baa0 0x7faf340b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3a47d700 1 --2- 172.21.15.44:0/3945411460 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf34150180 0x7faf34070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3947b700 1 -- 172.21.15.44:0/3945411460 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2613711923 0 0) 0x7faf34070df0 con 0x7faf34070890 2024-09-13T18:33:01.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3947b700 1 -- 172.21.15.44:0/3945411460 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf200035d0 con 0x7faf34070890 2024-09-13T18:33:01.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3ac7e700 1 -- 172.21.15.44:0/3945411460 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf34150180 msgr2=0x7faf34070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:01.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3ac7e700 1 --2- 172.21.15.44:0/3945411460 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf34150180 0x7faf34070350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3ac7e700 1 -- 172.21.15.44:0/3945411460 >> v1:172.21.15.44:6789/0 conn(0x7faf34070890 legacy=0x7faf3406b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3ac7e700 1 -- 172.21.15.44:0/3945411460 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf34071690 con 0x7faf3406baa0 2024-09-13T18:33:01.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3ac7e700 1 --2- 172.21.15.44:0/3945411460 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf3406baa0 0x7faf340b26d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009d90 tx=0x7faf2c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=712aaca30caf0c71 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:01.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3947b700 1 -- 172.21.15.44:0/3945411460 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c00bd20 con 0x7faf3406baa0 2024-09-13T18:33:01.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3947b700 1 -- 172.21.15.44:0/3945411460 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c00be80 con 0x7faf3406baa0 2024-09-13T18:33:01.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3947b700 1 -- 172.21.15.44:0/3945411460 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c011660 con 0x7faf3406baa0 2024-09-13T18:33:01.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3b47f700 1 -- 172.21.15.44:0/3945411460 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf3406baa0 msgr2=0x7faf340b26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3b47f700 1 --2- 172.21.15.44:0/3945411460 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf3406baa0 0x7faf340b26d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009d90 tx=0x7faf2c00b330 comp rx=0 tx=0).stop 2024-09-13T18:33:01.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3b47f700 1 -- 172.21.15.44:0/3945411460 shutdown_connections 2024-09-13T18:33:01.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3b47f700 1 --2- 172.21.15.44:0/3945411460 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf3406baa0 0x7faf340b26d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3b47f700 1 --2- 172.21.15.44:0/3945411460 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf34150180 0x7faf34070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3b47f700 1 -- 172.21.15.44:0/3945411460 >> 172.21.15.44:0/3945411460 conn(0x7faf340cf420 msgr2=0x7faf340cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:01.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3b47f700 1 -- 172.21.15.44:0/3945411460 shutdown_connections 2024-09-13T18:33:01.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.764+0000 7faf3b47f700 1 -- 172.21.15.44:0/3945411460 wait complete. 2024-09-13T18:33:01.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.768+0000 7faf3b47f700 1 Processor -- start 2024-09-13T18:33:01.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.768+0000 7faf3b47f700 1 -- start start 2024-09-13T18:33:01.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf3b47f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf3406baa0 0x7faf3414aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf3b47f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf34070890 0x7faf34153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf3b47f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf34150180 0x7faf34157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf3b47f700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf341575c0 con 0x7faf34070890 2024-09-13T18:33:01.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf3b47f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf340ad1d0 con 0x7faf3406baa0 2024-09-13T18:33:01.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf3b47f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf340ac8c0 con 0x7faf34150180 2024-09-13T18:33:01.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf39c7c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf34070890 0x7faf34153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf39c7c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf34070890 0x7faf34153110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55380/0 (socket says 172.21.15.44:55380) 2024-09-13T18:33:01.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf39c7c700 1 -- 172.21.15.44:0/195843253 learned_addr learned my addr 172.21.15.44:0/195843253 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:01.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf3ac7e700 1 --2- 172.21.15.44:0/195843253 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf34150180 0x7faf34157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf3a47d700 1 --2- 172.21.15.44:0/195843253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf3406baa0 0x7faf3414aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf39c7c700 1 -- 172.21.15.44:0/195843253 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf34150180 msgr2=0x7faf34157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf39c7c700 1 --2- 172.21.15.44:0/195843253 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf34150180 0x7faf34157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf39c7c700 1 -- 172.21.15.44:0/195843253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf3406baa0 msgr2=0x7faf3414aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf39c7c700 1 --2- 172.21.15.44:0/195843253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf3406baa0 0x7faf3414aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf39c7c700 1 -- 172.21.15.44:0/195843253 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c009a70 con 0x7faf34070890 2024-09-13T18:33:01.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf3a47d700 1 --2- 172.21.15.44:0/195843253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf3406baa0 0x7faf3414aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:01.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf3ac7e700 1 --2- 172.21.15.44:0/195843253 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf34150180 0x7faf34157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:01.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf39c7c700 1 --2- 172.21.15.44:0/195843253 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf34070890 0x7faf34153110 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7faf24001eb0 tx=0x7faf2400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:01.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf2affd700 1 -- 172.21.15.44:0/195843253 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf24005d90 con 0x7faf34070890 2024-09-13T18:33:01.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf2affd700 1 -- 172.21.15.44:0/195843253 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf240070d0 con 0x7faf34070890 2024-09-13T18:33:01.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf2affd700 1 -- 172.21.15.44:0/195843253 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf24007460 con 0x7faf34070890 2024-09-13T18:33:01.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf3b47f700 1 -- 172.21.15.44:0/195843253 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf341577f0 con 0x7faf34070890 2024-09-13T18:33:01.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.772+0000 7faf3b47f700 1 -- 172.21.15.44:0/195843253 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf340ace60 con 0x7faf34070890 2024-09-13T18:33:01.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.776+0000 7faf2affd700 1 -- 172.21.15.44:0/195843253 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faf240075c0 con 0x7faf34070890 2024-09-13T18:33:01.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.776+0000 7faf3b47f700 1 -- 172.21.15.44:0/195843253 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf34153a00 con 0x7faf34070890 2024-09-13T18:33:01.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.776+0000 7faf2affd700 1 --2- 172.21.15.44:0/195843253 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faf18066730 0x7faf18068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.776+0000 7faf2affd700 1 -- 172.21.15.44:0/195843253 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7faf24083760 con 0x7faf34070890 2024-09-13T18:33:01.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.776+0000 7faf3a47d700 1 --2- 172.21.15.44:0/195843253 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faf18066730 0x7faf18068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.776+0000 7faf3a47d700 1 --2- 172.21.15.44:0/195843253 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faf18066730 0x7faf18068bf0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7faf30009ba0 tx=0x7faf30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:01.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.780+0000 7faf2affd700 1 -- 172.21.15.44:0/195843253 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faf240509c0 con 0x7faf34070890 2024-09-13T18:33:01.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.952+0000 7faf3b47f700 1 -- 172.21.15.44:0/195843253 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faf3414a240 con 0x7faf34070890 2024-09-13T18:33:01.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.952+0000 7faf2affd700 1 -- 172.21.15.44:0/195843253 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7faf24053fe0 con 0x7faf34070890 2024-09-13T18:33:01.959 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:33:01.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.956+0000 7faf3b47f700 1 -- 172.21.15.44:0/195843253 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faf18066730 msgr2=0x7faf18068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.956+0000 7faf3b47f700 1 --2- 172.21.15.44:0/195843253 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faf18066730 0x7faf18068bf0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7faf30009ba0 tx=0x7faf30008040 comp rx=0 tx=0).stop 2024-09-13T18:33:01.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.956+0000 7faf3b47f700 1 -- 172.21.15.44:0/195843253 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf34070890 msgr2=0x7faf34153110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.956+0000 7faf3b47f700 1 --2- 172.21.15.44:0/195843253 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf34070890 0x7faf34153110 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7faf24001eb0 tx=0x7faf2400c860 comp rx=0 tx=0).stop 2024-09-13T18:33:01.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.956+0000 7faf3b47f700 1 -- 172.21.15.44:0/195843253 shutdown_connections 2024-09-13T18:33:01.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.956+0000 7faf3b47f700 1 --2- 172.21.15.44:0/195843253 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faf18066730 0x7faf18068bf0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.956+0000 7faf3b47f700 1 --2- 172.21.15.44:0/195843253 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf34150180 0x7faf34157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.956+0000 7faf3b47f700 1 --2- 172.21.15.44:0/195843253 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf34070890 0x7faf34153110 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.956+0000 7faf3b47f700 1 --2- 172.21.15.44:0/195843253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf3406baa0 0x7faf3414aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.956+0000 7faf3b47f700 1 -- 172.21.15.44:0/195843253 >> 172.21.15.44:0/195843253 conn(0x7faf340cf420 msgr2=0x7faf340b28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:01.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.956+0000 7faf3b47f700 1 -- 172.21.15.44:0/195843253 shutdown_connections 2024-09-13T18:33:01.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:01.956+0000 7faf3b47f700 1 -- 172.21.15.44:0/195843253 wait complete. 2024-09-13T18:33:01.975 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:33:02.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.092+0000 7f7f2e8ee700 1 Processor -- start 2024-09-13T18:33:02.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.092+0000 7f7f2e8ee700 1 -- start start 2024-09-13T18:33:02.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.092+0000 7f7f2e8ee700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f280ad870 0x7f7f280adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.092+0000 7f7f2e8ee700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f280ae5f0 con 0x7f7f28159e00 2024-09-13T18:33:02.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.092+0000 7f7f2e8ee700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2815e440 con 0x7f7f28160740 2024-09-13T18:33:02.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.092+0000 7f7f2e8ee700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2815ede0 con 0x7f7f280ad870 2024-09-13T18:33:02.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.092+0000 7f7f2e0ed700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7f28159e00 0x7f7f2815a250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44176/0 (socket says 172.21.15.44:44176) 2024-09-13T18:33:02.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.092+0000 7f7f2e0ed700 1 -- 172.21.15.44:0/3452554876 learned_addr learned my addr 172.21.15.44:0/3452554876 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:02.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.092+0000 7f7f2d0eb700 1 --2- 172.21.15.44:0/3452554876 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f280ad870 0x7f7f280adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.092+0000 7f7f2c8ea700 1 -- 172.21.15.44:0/3452554876 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902548844 0 0) 0x7f7f280ae5f0 con 0x7f7f28159e00 2024-09-13T18:33:02.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.092+0000 7f7f2c8ea700 1 -- 172.21.15.44:0/3452554876 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f140035d0 con 0x7f7f28159e00 2024-09-13T18:33:02.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.092+0000 7f7f2c8ea700 1 -- 172.21.15.44:0/3452554876 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901062325 0 0) 0x7f7f2815e440 con 0x7f7f28160740 2024-09-13T18:33:02.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.092+0000 7f7f2d0eb700 1 -- 172.21.15.44:0/3452554876 >> v1:172.21.15.99:6789/0 conn(0x7f7f28160740 legacy=0x7f7f28160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.092+0000 7f7f2d0eb700 1 -- 172.21.15.44:0/3452554876 >> v1:172.21.15.44:6789/0 conn(0x7f7f28159e00 legacy=0x7f7f2815a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.092+0000 7f7f2d0eb700 1 -- 172.21.15.44:0/3452554876 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2815e720 con 0x7f7f280ad870 2024-09-13T18:33:02.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.092+0000 7f7f2d0eb700 1 --2- 172.21.15.44:0/3452554876 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f280ad870 0x7f7f280adcd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7f24009880 tx=0x7f7f24009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a03d6796bdc4a68f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.092+0000 7f7f2c8ea700 1 -- 172.21.15.44:0/3452554876 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24011830 con 0x7f7f280ad870 2024-09-13T18:33:02.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.092+0000 7f7f2c8ea700 1 -- 172.21.15.44:0/3452554876 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f24011990 con 0x7f7f280ad870 2024-09-13T18:33:02.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.092+0000 7f7f2c8ea700 1 -- 172.21.15.44:0/3452554876 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24011d00 con 0x7f7f280ad870 2024-09-13T18:33:02.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.096+0000 7f7f2e8ee700 1 -- 172.21.15.44:0/3452554876 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f280ad870 msgr2=0x7f7f280adcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.096+0000 7f7f2e8ee700 1 --2- 172.21.15.44:0/3452554876 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f280ad870 0x7f7f280adcd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7f24009880 tx=0x7f7f24009b90 comp rx=0 tx=0).stop 2024-09-13T18:33:02.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.096+0000 7f7f2e8ee700 1 -- 172.21.15.44:0/3452554876 shutdown_connections 2024-09-13T18:33:02.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.096+0000 7f7f2e8ee700 1 --2- 172.21.15.44:0/3452554876 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f280ad870 0x7f7f280adcd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.096+0000 7f7f2e8ee700 1 -- 172.21.15.44:0/3452554876 >> 172.21.15.44:0/3452554876 conn(0x7f7f280b1cd0 msgr2=0x7f7f280cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:02.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.096+0000 7f7f2e8ee700 1 -- 172.21.15.44:0/3452554876 shutdown_connections 2024-09-13T18:33:02.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.096+0000 7f7f2e8ee700 1 -- 172.21.15.44:0/3452554876 wait complete. 2024-09-13T18:33:02.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.096+0000 7f7f2e8ee700 1 Processor -- start 2024-09-13T18:33:02.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.100+0000 7f7f2e8ee700 1 -- start start 2024-09-13T18:33:02.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.100+0000 7f7f2e8ee700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f280ad870 0x7f7f280c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.100+0000 7f7f2e8ee700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f28159e00 0x7f7f2806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.100+0000 7f7f2e8ee700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f28160740 0x7f7f280b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.100+0000 7f7f2e8ee700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f28148fa0 con 0x7f7f28159e00 2024-09-13T18:33:02.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.100+0000 7f7f2e8ee700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2814e940 con 0x7f7f28160740 2024-09-13T18:33:02.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.100+0000 7f7f2e8ee700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2814b7c0 con 0x7f7f280ad870 2024-09-13T18:33:02.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.100+0000 7f7f2d0eb700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f28159e00 0x7f7f2806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.100+0000 7f7f2d0eb700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f28159e00 0x7f7f2806d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38924/0 (socket says 172.21.15.44:38924) 2024-09-13T18:33:02.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.100+0000 7f7f2d0eb700 1 -- 172.21.15.44:0/3373833835 learned_addr learned my addr 172.21.15.44:0/3373833835 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:02.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.100+0000 7f7f2d8ec700 1 --2- 172.21.15.44:0/3373833835 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f280ad870 0x7f7f280c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.100+0000 7f7f2e0ed700 1 --2- 172.21.15.44:0/3373833835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f28160740 0x7f7f280b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.100+0000 7f7f2d0eb700 1 -- 172.21.15.44:0/3373833835 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f280ad870 msgr2=0x7f7f280c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.100+0000 7f7f2d0eb700 1 --2- 172.21.15.44:0/3373833835 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f280ad870 0x7f7f280c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.100+0000 7f7f2d0eb700 1 -- 172.21.15.44:0/3373833835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f28160740 msgr2=0x7f7f280b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.100+0000 7f7f2d0eb700 1 --2- 172.21.15.44:0/3373833835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f28160740 0x7f7f280b07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.100+0000 7f7f2d0eb700 1 -- 172.21.15.44:0/3373833835 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f240094b0 con 0x7f7f28159e00 2024-09-13T18:33:02.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.100+0000 7f7f2d0eb700 1 --2- 172.21.15.44:0/3373833835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f28159e00 0x7f7f2806d990 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7f240090b0 tx=0x7f7f24004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.100+0000 7f7f1e7fc700 1 -- 172.21.15.44:0/3373833835 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24004550 con 0x7f7f28159e00 2024-09-13T18:33:02.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.100+0000 7f7f1e7fc700 1 -- 172.21.15.44:0/3373833835 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f240036c0 con 0x7f7f28159e00 2024-09-13T18:33:02.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.100+0000 7f7f2e8ee700 1 -- 172.21.15.44:0/3373833835 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f28148bc0 con 0x7f7f28159e00 2024-09-13T18:33:02.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.100+0000 7f7f1e7fc700 1 -- 172.21.15.44:0/3373833835 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24003a50 con 0x7f7f28159e00 2024-09-13T18:33:02.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.100+0000 7f7f2e8ee700 1 -- 172.21.15.44:0/3373833835 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f280b0d00 con 0x7f7f28159e00 2024-09-13T18:33:02.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.104+0000 7f7f2e8ee700 1 -- 172.21.15.44:0/3373833835 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f281490e0 con 0x7f7f28159e00 2024-09-13T18:33:02.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.104+0000 7f7f1e7fc700 1 -- 172.21.15.44:0/3373833835 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7f24003bb0 con 0x7f7f28159e00 2024-09-13T18:33:02.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.104+0000 7f7f1e7fc700 1 --2- 172.21.15.44:0/3373833835 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7f0c066730 0x7f7f0c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.104+0000 7f7f1e7fc700 1 -- 172.21.15.44:0/3373833835 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f7f240856e0 con 0x7f7f28159e00 2024-09-13T18:33:02.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.104+0000 7f7f2d8ec700 1 --2- 172.21.15.44:0/3373833835 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7f0c066730 0x7f7f0c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.104+0000 7f7f2d8ec700 1 --2- 172.21.15.44:0/3373833835 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7f0c066730 0x7f7f0c068bf0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7f18000f60 tx=0x7f7f18009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.116+0000 7f7f1e7fc700 1 -- 172.21.15.44:0/3373833835 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7f24052b70 con 0x7f7f28159e00 2024-09-13T18:33:02.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.284+0000 7f7f2e8ee700 1 -- 172.21.15.44:0/3373833835 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f2806e700 con 0x7f7f28159e00 2024-09-13T18:33:02.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.288+0000 7f7f1e7fc700 1 -- 172.21.15.44:0/3373833835 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f24003e60 con 0x7f7f28159e00 2024-09-13T18:33:02.292 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:33:02.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.288+0000 7f7f2e8ee700 1 -- 172.21.15.44:0/3373833835 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7f0c066730 msgr2=0x7f7f0c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.288+0000 7f7f2e8ee700 1 --2- 172.21.15.44:0/3373833835 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7f0c066730 0x7f7f0c068bf0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7f18000f60 tx=0x7f7f18009040 comp rx=0 tx=0).stop 2024-09-13T18:33:02.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.288+0000 7f7f2e8ee700 1 -- 172.21.15.44:0/3373833835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f28159e00 msgr2=0x7f7f2806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.288+0000 7f7f2e8ee700 1 --2- 172.21.15.44:0/3373833835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f28159e00 0x7f7f2806d990 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7f240090b0 tx=0x7f7f24004770 comp rx=0 tx=0).stop 2024-09-13T18:33:02.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.288+0000 7f7f2e8ee700 1 -- 172.21.15.44:0/3373833835 shutdown_connections 2024-09-13T18:33:02.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.288+0000 7f7f2e8ee700 1 --2- 172.21.15.44:0/3373833835 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7f0c066730 0x7f7f0c068bf0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.288+0000 7f7f2e8ee700 1 --2- 172.21.15.44:0/3373833835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f28160740 0x7f7f280b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.288+0000 7f7f2e8ee700 1 --2- 172.21.15.44:0/3373833835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f28159e00 0x7f7f2806d990 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.288+0000 7f7f2e8ee700 1 --2- 172.21.15.44:0/3373833835 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f280ad870 0x7f7f280c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.288+0000 7f7f2e8ee700 1 -- 172.21.15.44:0/3373833835 >> 172.21.15.44:0/3373833835 conn(0x7f7f280b1cd0 msgr2=0x7f7f281595b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:02.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.288+0000 7f7f2e8ee700 1 -- 172.21.15.44:0/3373833835 shutdown_connections 2024-09-13T18:33:02.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.288+0000 7f7f2e8ee700 1 -- 172.21.15.44:0/3373833835 wait complete. 2024-09-13T18:33:02.308 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:33:02.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.416+0000 7f421330c700 1 Processor -- start 2024-09-13T18:33:02.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f421330c700 1 -- start start 2024-09-13T18:33:02.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f421330c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f420c15ca90 0x7f420c06a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f421330c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f420c06b5f0 0x7f420c0cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f421330c700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420c0d1bc0 con 0x7f420c15ce70 2024-09-13T18:33:02.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f421330c700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420c0cdac0 con 0x7f420c06b5f0 2024-09-13T18:33:02.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f421330c700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c06ac20 con 0x7f420c15ca90 2024-09-13T18:33:02.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f4212b0b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f420c06b5f0 0x7f420c0cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f4212b0b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f420c06b5f0 0x7f420c0cdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38934/0 (socket says 172.21.15.44:38934) 2024-09-13T18:33:02.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f4212b0b700 1 -- 172.21.15.44:0/466983009 learned_addr learned my addr 172.21.15.44:0/466983009 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:02.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f421230a700 1 --2- 172.21.15.44:0/466983009 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f420c15ca90 0x7f420c06a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f4212b0b700 1 -- 172.21.15.44:0/466983009 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f420c15ca90 msgr2=0x7f420c06a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:02.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f4212b0b700 1 --2- 172.21.15.44:0/466983009 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f420c15ca90 0x7f420c06a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f4212b0b700 1 -- 172.21.15.44:0/466983009 >> v1:172.21.15.99:6789/0 conn(0x7f420c15ce70 legacy=0x7f420c06aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f4212b0b700 1 -- 172.21.15.44:0/466983009 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c0d1290 con 0x7f420c06b5f0 2024-09-13T18:33:02.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f4212b0b700 1 --2- 172.21.15.44:0/466983009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f420c06b5f0 0x7f420c0cdec0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f4204009e80 tx=0x7f420400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72a39b84dc18607 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f4211308700 1 -- 172.21.15.44:0/466983009 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420400e070 con 0x7f420c06b5f0 2024-09-13T18:33:02.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f4211308700 1 -- 172.21.15.44:0/466983009 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420400b980 con 0x7f420c06b5f0 2024-09-13T18:33:02.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f4211308700 1 -- 172.21.15.44:0/466983009 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420400bd30 con 0x7f420c06b5f0 2024-09-13T18:33:02.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f421330c700 1 -- 172.21.15.44:0/466983009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f420c06b5f0 msgr2=0x7f420c0cdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f421330c700 1 --2- 172.21.15.44:0/466983009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f420c06b5f0 0x7f420c0cdec0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f4204009e80 tx=0x7f420400b330 comp rx=0 tx=0).stop 2024-09-13T18:33:02.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f421330c700 1 -- 172.21.15.44:0/466983009 shutdown_connections 2024-09-13T18:33:02.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f421330c700 1 --2- 172.21.15.44:0/466983009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f420c06b5f0 0x7f420c0cdec0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f421330c700 1 --2- 172.21.15.44:0/466983009 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f420c15ca90 0x7f420c06a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f421330c700 1 -- 172.21.15.44:0/466983009 >> 172.21.15.44:0/466983009 conn(0x7f420c0d2c10 msgr2=0x7f420c0d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:02.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f421330c700 1 -- 172.21.15.44:0/466983009 shutdown_connections 2024-09-13T18:33:02.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.420+0000 7f421330c700 1 -- 172.21.15.44:0/466983009 wait complete. 2024-09-13T18:33:02.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.424+0000 7f421330c700 1 Processor -- start 2024-09-13T18:33:02.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.424+0000 7f421330c700 1 -- start start 2024-09-13T18:33:02.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.424+0000 7f421330c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f420c06b5f0 0x7f420c157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.424+0000 7f421330c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f420c15ca90 0x7f420c155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.424+0000 7f421330c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f420c15ce70 0x7f420c0c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.424+0000 7f421330c700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c0cc9c0 con 0x7f420c15ce70 2024-09-13T18:33:02.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.424+0000 7f421330c700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c0c9d80 con 0x7f420c15ca90 2024-09-13T18:33:02.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.424+0000 7f421330c700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c1559d0 con 0x7f420c06b5f0 2024-09-13T18:33:02.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.424+0000 7f4212b0b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f420c15ce70 0x7f420c0c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.424+0000 7f4212b0b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f420c15ce70 0x7f420c0c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38940/0 (socket says 172.21.15.44:38940) 2024-09-13T18:33:02.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.424+0000 7f4212b0b700 1 -- 172.21.15.44:0/2522441178 learned_addr learned my addr 172.21.15.44:0/2522441178 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:02.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.424+0000 7f421230a700 1 --2- 172.21.15.44:0/2522441178 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f420c06b5f0 0x7f420c157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.424+0000 7f4211b09700 1 --2- 172.21.15.44:0/2522441178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f420c15ca90 0x7f420c155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.424+0000 7f4212b0b700 1 -- 172.21.15.44:0/2522441178 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f420c06b5f0 msgr2=0x7f420c157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.424+0000 7f4212b0b700 1 --2- 172.21.15.44:0/2522441178 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f420c06b5f0 0x7f420c157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.424+0000 7f4212b0b700 1 -- 172.21.15.44:0/2522441178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f420c15ca90 msgr2=0x7f420c155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.424+0000 7f4212b0b700 1 --2- 172.21.15.44:0/2522441178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f420c15ca90 0x7f420c155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.424+0000 7f4212b0b700 1 -- 172.21.15.44:0/2522441178 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4204009b30 con 0x7f420c15ce70 2024-09-13T18:33:02.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.424+0000 7f421230a700 1 --2- 172.21.15.44:0/2522441178 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f420c06b5f0 0x7f420c157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:02.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.424+0000 7f4211b09700 1 --2- 172.21.15.44:0/2522441178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f420c15ca90 0x7f420c155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:02.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.424+0000 7f4212b0b700 1 --2- 172.21.15.44:0/2522441178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f420c15ce70 0x7f420c0c8940 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4204012000 tx=0x7f4204004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.424+0000 7f4202ffd700 1 -- 172.21.15.44:0/2522441178 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4204004960 con 0x7f420c15ce70 2024-09-13T18:33:02.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.428+0000 7f4202ffd700 1 -- 172.21.15.44:0/2522441178 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42040099b0 con 0x7f420c15ce70 2024-09-13T18:33:02.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.428+0000 7f421330c700 1 -- 172.21.15.44:0/2522441178 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420c0ca020 con 0x7f420c15ce70 2024-09-13T18:33:02.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.428+0000 7f4202ffd700 1 -- 172.21.15.44:0/2522441178 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420401b670 con 0x7f420c15ce70 2024-09-13T18:33:02.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.428+0000 7f421330c700 1 -- 172.21.15.44:0/2522441178 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420c0ca5e0 con 0x7f420c15ce70 2024-09-13T18:33:02.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.428+0000 7f421330c700 1 -- 172.21.15.44:0/2522441178 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f420c06a520 con 0x7f420c15ce70 2024-09-13T18:33:02.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.428+0000 7f4202ffd700 1 -- 172.21.15.44:0/2522441178 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f420401b7d0 con 0x7f420c15ce70 2024-09-13T18:33:02.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.428+0000 7f4202ffd700 1 --2- 172.21.15.44:0/2522441178 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f41f0066730 0x7f41f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.428+0000 7f4202ffd700 1 -- 172.21.15.44:0/2522441178 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f42040854b0 con 0x7f420c15ce70 2024-09-13T18:33:02.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.428+0000 7f421230a700 1 --2- 172.21.15.44:0/2522441178 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f41f0066730 0x7f41f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.432+0000 7f421230a700 1 --2- 172.21.15.44:0/2522441178 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f41f0066730 0x7f41f0068bf0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4208009a10 tx=0x7f4208008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.436+0000 7f4202ffd700 1 -- 172.21.15.44:0/2522441178 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f42040526f0 con 0x7f420c15ce70 2024-09-13T18:33:02.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.603+0000 7f421330c700 1 -- 172.21.15.44:0/2522441178 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f420c0d32b0 con 0x7f420c15ce70 2024-09-13T18:33:02.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.603+0000 7f4202ffd700 1 -- 172.21.15.44:0/2522441178 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4204055d10 con 0x7f420c15ce70 2024-09-13T18:33:02.611 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:33:02.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.607+0000 7f421330c700 1 -- 172.21.15.44:0/2522441178 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f41f0066730 msgr2=0x7f41f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.607+0000 7f421330c700 1 --2- 172.21.15.44:0/2522441178 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f41f0066730 0x7f41f0068bf0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4208009a10 tx=0x7f4208008040 comp rx=0 tx=0).stop 2024-09-13T18:33:02.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.607+0000 7f421330c700 1 -- 172.21.15.44:0/2522441178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f420c15ce70 msgr2=0x7f420c0c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.607+0000 7f421330c700 1 --2- 172.21.15.44:0/2522441178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f420c15ce70 0x7f420c0c8940 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4204012000 tx=0x7f4204004af0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.607+0000 7f421330c700 1 -- 172.21.15.44:0/2522441178 shutdown_connections 2024-09-13T18:33:02.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.607+0000 7f421330c700 1 --2- 172.21.15.44:0/2522441178 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f41f0066730 0x7f41f0068bf0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.607+0000 7f421330c700 1 --2- 172.21.15.44:0/2522441178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f420c15ce70 0x7f420c0c8940 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.607+0000 7f421330c700 1 --2- 172.21.15.44:0/2522441178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f420c15ca90 0x7f420c155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.607+0000 7f421330c700 1 --2- 172.21.15.44:0/2522441178 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f420c06b5f0 0x7f420c157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.607+0000 7f421330c700 1 -- 172.21.15.44:0/2522441178 >> 172.21.15.44:0/2522441178 conn(0x7f420c0d2c10 msgr2=0x7f420c15dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:02.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.607+0000 7f421330c700 1 -- 172.21.15.44:0/2522441178 shutdown_connections 2024-09-13T18:33:02.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.607+0000 7f421330c700 1 -- 172.21.15.44:0/2522441178 wait complete. 2024-09-13T18:33:02.627 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:33:02.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.735+0000 7f8715bf5700 1 Processor -- start 2024-09-13T18:33:02.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.735+0000 7f8715bf5700 1 -- start start 2024-09-13T18:33:02.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f8715bf5700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8710159720 0x7f871006cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f8715bf5700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f871006aa90 0x7f87100b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f8715bf5700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f87100b3910 0x7f8710070c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f8715bf5700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87100b3dc0 con 0x7f87100b3910 2024-09-13T18:33:02.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f8715bf5700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871006aed0 con 0x7f871006aa90 2024-09-13T18:33:02.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f8715bf5700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871006d690 con 0x7f8710159720 2024-09-13T18:33:02.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f87153f4700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f87100b3910 0x7f8710070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f8714bf3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8710159720 0x7f871006cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f870ffff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f871006aa90 0x7f87100b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f87153f4700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f87100b3910 0x7f8710070c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38944/0 (socket says 172.21.15.44:38944) 2024-09-13T18:33:02.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f87153f4700 1 -- 172.21.15.44:0/3978457360 learned_addr learned my addr 172.21.15.44:0/3978457360 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:02.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f8714bf3700 1 -- 172.21.15.44:0/3978457360 >> v2:172.21.15.99:3300/0 conn(0x7f871006aa90 msgr2=0x7f87100b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:02.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f8714bf3700 1 --2- 172.21.15.44:0/3978457360 >> v2:172.21.15.99:3300/0 conn(0x7f871006aa90 0x7f87100b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f8714bf3700 1 -- 172.21.15.44:0/3978457360 >> v2:172.21.15.44:3300/0 conn(0x7f87100b3910 msgr2=0x7f8710070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:02.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f8714bf3700 1 --2- 172.21.15.44:0/3978457360 >> v2:172.21.15.44:3300/0 conn(0x7f87100b3910 0x7f8710070c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f8714bf3700 1 -- 172.21.15.44:0/3978457360 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87100cbfe0 con 0x7f8710159720 2024-09-13T18:33:02.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f87153f4700 1 --2- 172.21.15.44:0/3978457360 >> v2:172.21.15.44:3300/0 conn(0x7f87100b3910 0x7f8710070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:33:02.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f8714bf3700 1 --2- 172.21.15.44:0/3978457360 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8710159720 0x7f871006cf90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8710072080 tx=0x7f8700009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cf32b7b4d8c2a24 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f870f7fe700 1 -- 172.21.15.44:0/3978457360 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700011830 con 0x7f8710159720 2024-09-13T18:33:02.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f870f7fe700 1 -- 172.21.15.44:0/3978457360 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8700011990 con 0x7f8710159720 2024-09-13T18:33:02.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f870f7fe700 1 -- 172.21.15.44:0/3978457360 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700011d20 con 0x7f8710159720 2024-09-13T18:33:02.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f8715bf5700 1 -- 172.21.15.44:0/3978457360 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8710159720 msgr2=0x7f871006cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f8715bf5700 1 --2- 172.21.15.44:0/3978457360 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8710159720 0x7f871006cf90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8710072080 tx=0x7f8700009b60 comp rx=0 tx=0).stop 2024-09-13T18:33:02.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f8715bf5700 1 -- 172.21.15.44:0/3978457360 shutdown_connections 2024-09-13T18:33:02.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f8715bf5700 1 --2- 172.21.15.44:0/3978457360 >> v2:172.21.15.44:3300/0 conn(0x7f87100b3910 0x7f8710070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f8715bf5700 1 --2- 172.21.15.44:0/3978457360 >> v2:172.21.15.99:3300/0 conn(0x7f871006aa90 0x7f87100b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f8715bf5700 1 --2- 172.21.15.44:0/3978457360 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8710159720 0x7f871006cf90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f8715bf5700 1 -- 172.21.15.44:0/3978457360 >> 172.21.15.44:0/3978457360 conn(0x7f87100b0f00 msgr2=0x7f87100b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:02.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f8715bf5700 1 -- 172.21.15.44:0/3978457360 shutdown_connections 2024-09-13T18:33:02.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.739+0000 7f8715bf5700 1 -- 172.21.15.44:0/3978457360 wait complete. 2024-09-13T18:33:02.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f8715bf5700 1 Processor -- start 2024-09-13T18:33:02.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f8715bf5700 1 -- start start 2024-09-13T18:33:02.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f8715bf5700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f871006aa90 0x7f8710145880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f8715bf5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87100b3910 0x7f871014ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f8715bf5700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8710159720 0x7f87100b2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f8715bf5700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8710145dc0 con 0x7f87100b3910 2024-09-13T18:33:02.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f8715bf5700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87101412a0 con 0x7f871006aa90 2024-09-13T18:33:02.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f8715bf5700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87101453f0 con 0x7f8710159720 2024-09-13T18:33:02.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f870ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87100b3910 0x7f871014ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f870ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87100b3910 0x7f871014ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38946/0 (socket says 172.21.15.44:38946) 2024-09-13T18:33:02.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f870ffff700 1 -- 172.21.15.44:0/3989602496 learned_addr learned my addr 172.21.15.44:0/3989602496 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:02.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f8714bf3700 1 --2- 172.21.15.44:0/3989602496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f871006aa90 0x7f8710145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f87153f4700 1 --2- 172.21.15.44:0/3989602496 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8710159720 0x7f87100b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f870ffff700 1 -- 172.21.15.44:0/3989602496 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8710159720 msgr2=0x7f87100b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f870ffff700 1 --2- 172.21.15.44:0/3989602496 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8710159720 0x7f87100b2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f870ffff700 1 -- 172.21.15.44:0/3989602496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f871006aa90 msgr2=0x7f8710145880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f870ffff700 1 --2- 172.21.15.44:0/3989602496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f871006aa90 0x7f8710145880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f870ffff700 1 -- 172.21.15.44:0/3989602496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8708009b30 con 0x7f87100b3910 2024-09-13T18:33:02.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f870ffff700 1 --2- 172.21.15.44:0/3989602496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87100b3910 0x7f871014ea40 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f870400e910 tx=0x7f870400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f870d7fa700 1 -- 172.21.15.44:0/3989602496 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8704013680 con 0x7f87100b3910 2024-09-13T18:33:02.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f870d7fa700 1 -- 172.21.15.44:0/3989602496 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87040137e0 con 0x7f87100b3910 2024-09-13T18:33:02.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f8715bf5700 1 -- 172.21.15.44:0/3989602496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87000094b0 con 0x7f87100b3910 2024-09-13T18:33:02.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f870d7fa700 1 -- 172.21.15.44:0/3989602496 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8704013b70 con 0x7f87100b3910 2024-09-13T18:33:02.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.743+0000 7f8715bf5700 1 -- 172.21.15.44:0/3989602496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8710144b00 con 0x7f87100b3910 2024-09-13T18:33:02.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.747+0000 7f8715bf5700 1 -- 172.21.15.44:0/3989602496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8710145580 con 0x7f87100b3910 2024-09-13T18:33:02.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.747+0000 7f870d7fa700 1 -- 172.21.15.44:0/3989602496 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8704013cd0 con 0x7f87100b3910 2024-09-13T18:33:02.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.747+0000 7f870d7fa700 1 --2- 172.21.15.44:0/3989602496 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f86fc066730 0x7f86fc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.747+0000 7f870d7fa700 1 -- 172.21.15.44:0/3989602496 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8704083d50 con 0x7f87100b3910 2024-09-13T18:33:02.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.747+0000 7f8714bf3700 1 --2- 172.21.15.44:0/3989602496 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f86fc066730 0x7f86fc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.747+0000 7f8714bf3700 1 --2- 172.21.15.44:0/3989602496 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f86fc066730 0x7f86fc068bf0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f87000090b0 tx=0x7f8700008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.755+0000 7f870d7fa700 1 -- 172.21.15.44:0/3989602496 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8704087030 con 0x7f87100b3910 2024-09-13T18:33:02.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.959+0000 7f8715bf5700 1 -- 172.21.15.44:0/3989602496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f871014ef80 con 0x7f87100b3910 2024-09-13T18:33:02.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.959+0000 7f870d7fa700 1 -- 172.21.15.44:0/3989602496 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f8704051030 con 0x7f87100b3910 2024-09-13T18:33:02.966 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:33:02.966 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5447,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2081931615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2081931615},{"type":"v1","addr":"172.21.15.99:6835","nonce":2081931615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5639,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1452559390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1452559390},{"type":"v1","addr":"172.21.15.44:6835","nonce":1452559390}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5887,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/2337853364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2337853364},{"type":"v1","addr":"172.21.15.99:6837","nonce":2337853364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:29:10.283572+0000","modified":"2024-09-13T18:31:49.597435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":51,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5976},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5976":{"gid":5976,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":44,"addr":"172.21.15.44:6833/3567136594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3567136594},{"type":"v1","addr":"172.21.15.44:6833","nonce":3567136594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:33:02.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.963+0000 7f8715bf5700 1 -- 172.21.15.44:0/3989602496 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f86fc066730 msgr2=0x7f86fc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.963+0000 7f8715bf5700 1 --2- 172.21.15.44:0/3989602496 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f86fc066730 0x7f86fc068bf0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f87000090b0 tx=0x7f8700008030 comp rx=0 tx=0).stop 2024-09-13T18:33:02.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.963+0000 7f8715bf5700 1 -- 172.21.15.44:0/3989602496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87100b3910 msgr2=0x7f871014ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.963+0000 7f8715bf5700 1 --2- 172.21.15.44:0/3989602496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87100b3910 0x7f871014ea40 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f870400e910 tx=0x7f870400ec20 comp rx=0 tx=0).stop 2024-09-13T18:33:02.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.963+0000 7f8715bf5700 1 -- 172.21.15.44:0/3989602496 shutdown_connections 2024-09-13T18:33:02.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.963+0000 7f8715bf5700 1 --2- 172.21.15.44:0/3989602496 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f86fc066730 0x7f86fc068bf0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.963+0000 7f8715bf5700 1 --2- 172.21.15.44:0/3989602496 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8710159720 0x7f87100b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.963+0000 7f8715bf5700 1 --2- 172.21.15.44:0/3989602496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87100b3910 0x7f871014ea40 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.963+0000 7f8715bf5700 1 --2- 172.21.15.44:0/3989602496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f871006aa90 0x7f8710145880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.963+0000 7f8715bf5700 1 -- 172.21.15.44:0/3989602496 >> 172.21.15.44:0/3989602496 conn(0x7f87100b0f00 msgr2=0x7f8710157270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:02.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.963+0000 7f8715bf5700 1 -- 172.21.15.44:0/3989602496 shutdown_connections 2024-09-13T18:33:02.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:02.963+0000 7f8715bf5700 1 -- 172.21.15.44:0/3989602496 wait complete. 2024-09-13T18:33:02.971 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 38 2024-09-13T18:33:02.983 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:03.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.095+0000 7fc2b8f05700 1 Processor -- start 2024-09-13T18:33:03.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.095+0000 7fc2b8f05700 1 -- start start 2024-09-13T18:33:03.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.095+0000 7fc2b8f05700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2b406fb30 0x7fc2b40adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.095+0000 7fc2b8f05700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc2b406bb90 0x7fc2b40cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.095+0000 7fc2b8f05700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b406a780 con 0x7fc2b406d150 2024-09-13T18:33:03.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.095+0000 7fc2b8f05700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b406cd30 con 0x7fc2b406bb90 2024-09-13T18:33:03.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.095+0000 7fc2b8f05700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b4159470 con 0x7fc2b406fb30 2024-09-13T18:33:03.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.095+0000 7fc2b3fff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc2b406d150 0x7fc2b406d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44192/0 (socket says 172.21.15.44:44192) 2024-09-13T18:33:03.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.095+0000 7fc2b3fff700 1 -- 172.21.15.44:0/3143967982 learned_addr learned my addr 172.21.15.44:0/3143967982 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:03.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.095+0000 7fc2b2ffd700 1 --2- 172.21.15.44:0/3143967982 >> v2:172.21.15.44:3300/0 conn(0x7fc2b406bb90 0x7fc2b40cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.095+0000 7fc2b37fe700 1 --2- 172.21.15.44:0/3143967982 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2b406fb30 0x7fc2b40adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.099+0000 7fc2b2ffd700 1 -- 172.21.15.44:0/3143967982 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2b406fb30 msgr2=0x7fc2b40adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:03.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.099+0000 7fc2b27fc700 1 -- 172.21.15.44:0/3143967982 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75741481 0 0) 0x7fc2b406a780 con 0x7fc2b406d150 2024-09-13T18:33:03.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.099+0000 7fc2b2ffd700 1 --2- 172.21.15.44:0/3143967982 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2b406fb30 0x7fc2b40adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.099+0000 7fc2b2ffd700 1 -- 172.21.15.44:0/3143967982 >> v1:172.21.15.44:6789/0 conn(0x7fc2b406d150 legacy=0x7fc2b406d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.099+0000 7fc2b2ffd700 1 -- 172.21.15.44:0/3143967982 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b406c0b0 con 0x7fc2b406bb90 2024-09-13T18:33:03.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.099+0000 7fc2b2ffd700 1 --2- 172.21.15.44:0/3143967982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2b406bb90 0x7fc2b40cbf00 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009850 tx=0x7fc2a4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d67d949643734a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.099+0000 7fc2b27fc700 1 -- 172.21.15.44:0/3143967982 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4011830 con 0x7fc2b406bb90 2024-09-13T18:33:03.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.099+0000 7fc2b27fc700 1 -- 172.21.15.44:0/3143967982 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a4011990 con 0x7fc2b406bb90 2024-09-13T18:33:03.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.099+0000 7fc2b27fc700 1 -- 172.21.15.44:0/3143967982 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4011d40 con 0x7fc2b406bb90 2024-09-13T18:33:03.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.099+0000 7fc2b8f05700 1 -- 172.21.15.44:0/3143967982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2b406bb90 msgr2=0x7fc2b40cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.099+0000 7fc2b8f05700 1 --2- 172.21.15.44:0/3143967982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2b406bb90 0x7fc2b40cbf00 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009850 tx=0x7fc2a4009b60 comp rx=0 tx=0).stop 2024-09-13T18:33:03.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.099+0000 7fc2b8f05700 1 -- 172.21.15.44:0/3143967982 shutdown_connections 2024-09-13T18:33:03.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.099+0000 7fc2b8f05700 1 --2- 172.21.15.44:0/3143967982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2b406bb90 0x7fc2b40cbf00 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.099+0000 7fc2b8f05700 1 --2- 172.21.15.44:0/3143967982 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2b406fb30 0x7fc2b40adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.099+0000 7fc2b8f05700 1 -- 172.21.15.44:0/3143967982 >> 172.21.15.44:0/3143967982 conn(0x7fc2b40b0f00 msgr2=0x7fc2b40b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:03.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.099+0000 7fc2b8f05700 1 -- 172.21.15.44:0/3143967982 shutdown_connections 2024-09-13T18:33:03.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.099+0000 7fc2b8f05700 1 -- 172.21.15.44:0/3143967982 wait complete. 2024-09-13T18:33:03.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.099+0000 7fc2b8f05700 1 Processor -- start 2024-09-13T18:33:03.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.099+0000 7fc2b8f05700 1 -- start start 2024-09-13T18:33:03.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.103+0000 7fc2b8f05700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2b406bb90 0x7fc2b414c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.103+0000 7fc2b8f05700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2b406d150 0x7fc2b41551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.103+0000 7fc2b8f05700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2b406fb30 0x7fc2b415b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.103+0000 7fc2b8f05700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b4153ef0 con 0x7fc2b406bb90 2024-09-13T18:33:03.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.103+0000 7fc2b8f05700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b414c5b0 con 0x7fc2b406d150 2024-09-13T18:33:03.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.103+0000 7fc2b8f05700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b4154140 con 0x7fc2b406fb30 2024-09-13T18:33:03.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.103+0000 7fc2b37fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2b406bb90 0x7fc2b414c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.103+0000 7fc2b37fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2b406bb90 0x7fc2b414c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38958/0 (socket says 172.21.15.44:38958) 2024-09-13T18:33:03.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.103+0000 7fc2b37fe700 1 -- 172.21.15.44:0/1071095663 learned_addr learned my addr 172.21.15.44:0/1071095663 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:03.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.103+0000 7fc2b2ffd700 1 --2- 172.21.15.44:0/1071095663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2b406d150 0x7fc2b41551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.103+0000 7fc2b3fff700 1 --2- 172.21.15.44:0/1071095663 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2b406fb30 0x7fc2b415b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.103+0000 7fc2b37fe700 1 -- 172.21.15.44:0/1071095663 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2b406fb30 msgr2=0x7fc2b415b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.103+0000 7fc2b37fe700 1 --2- 172.21.15.44:0/1071095663 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2b406fb30 0x7fc2b415b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.103+0000 7fc2b37fe700 1 -- 172.21.15.44:0/1071095663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2b406d150 msgr2=0x7fc2b41551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.103+0000 7fc2b37fe700 1 --2- 172.21.15.44:0/1071095663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2b406d150 0x7fc2b41551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.103+0000 7fc2b37fe700 1 -- 172.21.15.44:0/1071095663 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a40094b0 con 0x7fc2b406bb90 2024-09-13T18:33:03.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.103+0000 7fc2b37fe700 1 --2- 172.21.15.44:0/1071095663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2b406bb90 0x7fc2b414c070 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc2a800e840 tx=0x7fc2a800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.103+0000 7fc29bfff700 1 -- 172.21.15.44:0/1071095663 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a80095a0 con 0x7fc2b406bb90 2024-09-13T18:33:03.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.103+0000 7fc29bfff700 1 -- 172.21.15.44:0/1071095663 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a8013680 con 0x7fc2b406bb90 2024-09-13T18:33:03.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.103+0000 7fc2b8f05700 1 -- 172.21.15.44:0/1071095663 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b4154420 con 0x7fc2b406bb90 2024-09-13T18:33:03.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.103+0000 7fc29bfff700 1 -- 172.21.15.44:0/1071095663 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a80139f0 con 0x7fc2b406bb90 2024-09-13T18:33:03.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.103+0000 7fc2b8f05700 1 -- 172.21.15.44:0/1071095663 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b41549e0 con 0x7fc2b406bb90 2024-09-13T18:33:03.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.103+0000 7fc2b8f05700 1 -- 172.21.15.44:0/1071095663 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b40adbd0 con 0x7fc2b406bb90 2024-09-13T18:33:03.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.107+0000 7fc29bfff700 1 -- 172.21.15.44:0/1071095663 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc2a8013b50 con 0x7fc2b406bb90 2024-09-13T18:33:03.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.107+0000 7fc29bfff700 1 --2- 172.21.15.44:0/1071095663 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc2a0066730 0x7fc2a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.107+0000 7fc29bfff700 1 -- 172.21.15.44:0/1071095663 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fc2a8084080 con 0x7fc2b406bb90 2024-09-13T18:33:03.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.107+0000 7fc2b2ffd700 1 --2- 172.21.15.44:0/1071095663 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc2a0066730 0x7fc2a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.107+0000 7fc2b2ffd700 1 --2- 172.21.15.44:0/1071095663 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc2a0066730 0x7fc2a0068bf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009ba0 tx=0x7fc2a4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.111+0000 7fc29bfff700 1 -- 172.21.15.44:0/1071095663 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc2a8051360 con 0x7fc2b406bb90 2024-09-13T18:33:03.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.287+0000 7fc2b8f05700 1 -- 172.21.15.44:0/1071095663 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2b40ccf00 con 0x7fc2b406bb90 2024-09-13T18:33:03.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.291+0000 7fc29bfff700 1 -- 172.21.15.44:0/1071095663 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16674 (secure 0 0 0) 0x7fc2a8054980 con 0x7fc2b406bb90 2024-09-13T18:33:03.297 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:33:03.297 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":51,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:30:35.073160+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:29:08.754284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:29:09.262346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.1b","mappings":[{"from":0,"to":5}]},{"pgid":"7.3c","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/3200882245":"2024-09-14T18:30:35.073090+0000","172.21.15.44:6834/3200882245":"2024-09-14T18:30:35.073090+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:03.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.291+0000 7fc2b8f05700 1 -- 172.21.15.44:0/1071095663 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc2a0066730 msgr2=0x7fc2a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.291+0000 7fc2b8f05700 1 --2- 172.21.15.44:0/1071095663 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc2a0066730 0x7fc2a0068bf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009ba0 tx=0x7fc2a4008030 comp rx=0 tx=0).stop 2024-09-13T18:33:03.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.291+0000 7fc2b8f05700 1 -- 172.21.15.44:0/1071095663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2b406bb90 msgr2=0x7fc2b414c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.291+0000 7fc2b8f05700 1 --2- 172.21.15.44:0/1071095663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2b406bb90 0x7fc2b414c070 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc2a800e840 tx=0x7fc2a800eb50 comp rx=0 tx=0).stop 2024-09-13T18:33:03.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.291+0000 7fc2b8f05700 1 -- 172.21.15.44:0/1071095663 shutdown_connections 2024-09-13T18:33:03.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.291+0000 7fc2b8f05700 1 --2- 172.21.15.44:0/1071095663 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc2a0066730 0x7fc2a0068bf0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.291+0000 7fc2b8f05700 1 --2- 172.21.15.44:0/1071095663 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2b406fb30 0x7fc2b415b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.291+0000 7fc2b8f05700 1 --2- 172.21.15.44:0/1071095663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2b406d150 0x7fc2b41551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.291+0000 7fc2b8f05700 1 --2- 172.21.15.44:0/1071095663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2b406bb90 0x7fc2b414c070 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.291+0000 7fc2b8f05700 1 -- 172.21.15.44:0/1071095663 >> 172.21.15.44:0/1071095663 conn(0x7fc2b40b0f00 msgr2=0x7fc2b40b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:03.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.295+0000 7fc2b8f05700 1 -- 172.21.15.44:0/1071095663 shutdown_connections 2024-09-13T18:33:03.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.295+0000 7fc2b8f05700 1 -- 172.21.15.44:0/1071095663 wait complete. 2024-09-13T18:33:03.313 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:33:03.313 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:33:03.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.423+0000 7f0511e84700 1 Processor -- start 2024-09-13T18:33:03.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.423+0000 7f0511e84700 1 -- start start 2024-09-13T18:33:03.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.423+0000 7f0511e84700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f050c1433c0 0x7f050c06cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.423+0000 7f0511e84700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050c0cbe00 con 0x7f050c06d4d0 2024-09-13T18:33:03.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.423+0000 7f0511e84700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050c06da30 con 0x7f050c0b3b70 2024-09-13T18:33:03.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.423+0000 7f0511e84700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f050c06b0b0 con 0x7f050c1433c0 2024-09-13T18:33:03.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.423+0000 7f050bfff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f050c06d4d0 0x7f050c0b3460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44194/0 (socket says 172.21.15.44:44194) 2024-09-13T18:33:03.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.423+0000 7f050bfff700 1 -- 172.21.15.44:0/1314522988 learned_addr learned my addr 172.21.15.44:0/1314522988 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:03.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f0510e82700 1 --2- 172.21.15.44:0/1314522988 >> v2:172.21.15.99:3300/0 conn(0x7f050c1433c0 0x7f050c06cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f050b7fe700 1 -- 172.21.15.44:0/1314522988 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2241399704 0 0) 0x7f050c0cbe00 con 0x7f050c06d4d0 2024-09-13T18:33:03.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f050b7fe700 1 -- 172.21.15.44:0/1314522988 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04f40057e0 con 0x7f050c06d4d0 2024-09-13T18:33:03.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f050b7fe700 1 -- 172.21.15.44:0/1314522988 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1764575425 0 0) 0x7f050c06da30 con 0x7f050c0b3b70 2024-09-13T18:33:03.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f050b7fe700 1 -- 172.21.15.44:0/1314522988 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f050c0cbe00 con 0x7f050c0b3b70 2024-09-13T18:33:03.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f050b7fe700 1 -- 172.21.15.44:0/1314522988 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1233740808 0 0) 0x7f04f40057e0 con 0x7f050c06d4d0 2024-09-13T18:33:03.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f050b7fe700 1 -- 172.21.15.44:0/1314522988 >> v2:172.21.15.99:3300/0 conn(0x7f050c1433c0 msgr2=0x7f050c06cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:03.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f050b7fe700 1 --2- 172.21.15.44:0/1314522988 >> v2:172.21.15.99:3300/0 conn(0x7f050c1433c0 0x7f050c06cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f050b7fe700 1 -- 172.21.15.44:0/1314522988 >> v1:172.21.15.99:6789/0 conn(0x7f050c0b3b70 legacy=0x7f050c0cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f050b7fe700 1 -- 172.21.15.44:0/1314522988 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c06dd10 con 0x7f050c06d4d0 2024-09-13T18:33:03.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f050b7fe700 1 -- 172.21.15.44:0/1314522988 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f04fc0019f0 con 0x7f050c06d4d0 2024-09-13T18:33:03.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f050b7fe700 1 -- 172.21.15.44:0/1314522988 >> v1:172.21.15.44:6789/0 conn(0x7f050c06d4d0 legacy=0x7f050c0b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f050b7fe700 1 --2- 172.21.15.44:0/1314522988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04f4005dc0 0x7f04f40061c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f050b7fe700 1 --2- 172.21.15.44:0/1314522988 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04f4006a80 0x7f04f4006f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f050b7fe700 1 --2- 172.21.15.44:0/1314522988 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04f4007440 0x7f04f400dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f050b7fe700 1 -- 172.21.15.44:0/1314522988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f400e340 con 0x7f04f4005dc0 2024-09-13T18:33:03.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f050b7fe700 1 -- 172.21.15.44:0/1314522988 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f400e4b0 con 0x7f04f4006a80 2024-09-13T18:33:03.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f050b7fe700 1 -- 172.21.15.44:0/1314522988 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f400e670 con 0x7f04f4007440 2024-09-13T18:33:03.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f0510e82700 1 --2- 172.21.15.44:0/1314522988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04f4005dc0 0x7f04f40061c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f050bfff700 1 --2- 172.21.15.44:0/1314522988 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04f4006a80 0x7f04f4006f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f0511683700 1 --2- 172.21.15.44:0/1314522988 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04f4007440 0x7f04f400dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f0510e82700 1 -- 172.21.15.44:0/1314522988 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04f4007440 msgr2=0x7f04f400dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:03.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f0510e82700 1 --2- 172.21.15.44:0/1314522988 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04f4007440 0x7f04f400dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f0510e82700 1 -- 172.21.15.44:0/1314522988 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04f4006a80 msgr2=0x7f04f4006f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:03.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f0510e82700 1 --2- 172.21.15.44:0/1314522988 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04f4006a80 0x7f04f4006f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f0511683700 1 -- 172.21.15.44:0/1314522988 reap_dead start 2024-09-13T18:33:03.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f0510e82700 1 -- 172.21.15.44:0/1314522988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f40057e0 con 0x7f04f4005dc0 2024-09-13T18:33:03.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f0510e82700 1 --2- 172.21.15.44:0/1314522988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04f4005dc0 0x7f04f40061c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f0500009b70 tx=0x7f04f4007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f3c01ee7c7293f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f050b7fe700 1 -- 172.21.15.44:0/1314522988 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050000e6c0 con 0x7f04f4005dc0 2024-09-13T18:33:03.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f050b7fe700 1 -- 172.21.15.44:0/1314522988 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050000e820 con 0x7f04f4005dc0 2024-09-13T18:33:03.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f050b7fe700 1 -- 172.21.15.44:0/1314522988 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050000ebb0 con 0x7f04f4005dc0 2024-09-13T18:33:03.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f0511e84700 1 -- 172.21.15.44:0/1314522988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04f4005dc0 msgr2=0x7f04f40061c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f0511e84700 1 --2- 172.21.15.44:0/1314522988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04f4005dc0 0x7f04f40061c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f0500009b70 tx=0x7f04f4007ab0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f0511e84700 1 -- 172.21.15.44:0/1314522988 shutdown_connections 2024-09-13T18:33:03.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f0511e84700 1 --2- 172.21.15.44:0/1314522988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04f4005dc0 0x7f04f40061c0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f0511e84700 1 -- 172.21.15.44:0/1314522988 >> 172.21.15.44:0/1314522988 conn(0x7f050c0b0f00 msgr2=0x7f050c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:03.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f0511e84700 1 -- 172.21.15.44:0/1314522988 shutdown_connections 2024-09-13T18:33:03.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.427+0000 7f0511e84700 1 -- 172.21.15.44:0/1314522988 wait complete. 2024-09-13T18:33:03.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.431+0000 7f0511e84700 1 Processor -- start 2024-09-13T18:33:03.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.431+0000 7f0511e84700 1 -- start start 2024-09-13T18:33:03.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.431+0000 7f0511e84700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04f4005dc0 0x7f050c13acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.431+0000 7f0511e84700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f050c15a510 0x7f050c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.431+0000 7f0511e84700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f050c15c5b0 0x7f050c157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.431+0000 7f0511e84700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c1f1d80 con 0x7f04f4005dc0 2024-09-13T18:33:03.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.431+0000 7f0511e84700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c15d0f0 con 0x7f050c15c5b0 2024-09-13T18:33:03.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.431+0000 7f0511e84700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050c13b210 con 0x7f050c15a510 2024-09-13T18:33:03.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.431+0000 7f0510e82700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04f4005dc0 0x7f050c13acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.431+0000 7f0510e82700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04f4005dc0 0x7f050c13acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38964/0 (socket says 172.21.15.44:38964) 2024-09-13T18:33:03.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.431+0000 7f0510e82700 1 -- 172.21.15.44:0/219428616 learned_addr learned my addr 172.21.15.44:0/219428616 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:03.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.431+0000 7f0511683700 1 --2- 172.21.15.44:0/219428616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f050c15c5b0 0x7f050c157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.431+0000 7f050bfff700 1 --2- 172.21.15.44:0/219428616 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f050c15a510 0x7f050c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.435+0000 7f0510e82700 1 -- 172.21.15.44:0/219428616 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f050c15a510 msgr2=0x7f050c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.435+0000 7f0510e82700 1 --2- 172.21.15.44:0/219428616 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f050c15a510 0x7f050c15c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.435+0000 7f0510e82700 1 -- 172.21.15.44:0/219428616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f050c15c5b0 msgr2=0x7f050c157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.435+0000 7f0510e82700 1 --2- 172.21.15.44:0/219428616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f050c15c5b0 0x7f050c157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.435+0000 7f0510e82700 1 -- 172.21.15.44:0/219428616 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c15cb30 con 0x7f04f4005dc0 2024-09-13T18:33:03.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.435+0000 7f050bfff700 1 --2- 172.21.15.44:0/219428616 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f050c15a510 0x7f050c15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:03.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.435+0000 7f0510e82700 1 --2- 172.21.15.44:0/219428616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04f4005dc0 0x7f050c13acd0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f05000090b0 tx=0x7f05000047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.435+0000 7f05097fa700 1 -- 172.21.15.44:0/219428616 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050000e6c0 con 0x7f04f4005dc0 2024-09-13T18:33:03.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.435+0000 7f05097fa700 1 -- 172.21.15.44:0/219428616 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0500003af0 con 0x7f04f4005dc0 2024-09-13T18:33:03.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.435+0000 7f0511e84700 1 -- 172.21.15.44:0/219428616 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050c15ce10 con 0x7f04f4005dc0 2024-09-13T18:33:03.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.435+0000 7f05097fa700 1 -- 172.21.15.44:0/219428616 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500003ea0 con 0x7f04f4005dc0 2024-09-13T18:33:03.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.435+0000 7f0511e84700 1 -- 172.21.15.44:0/219428616 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050c159ff0 con 0x7f04f4005dc0 2024-09-13T18:33:03.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.435+0000 7f0511e84700 1 -- 172.21.15.44:0/219428616 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f050c06da30 con 0x7f04f4005dc0 2024-09-13T18:33:03.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.439+0000 7f05097fa700 1 -- 172.21.15.44:0/219428616 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0500013470 con 0x7f04f4005dc0 2024-09-13T18:33:03.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.439+0000 7f05097fa700 1 --2- 172.21.15.44:0/219428616 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f04f8066760 0x7f04f8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.439+0000 7f05097fa700 1 -- 172.21.15.44:0/219428616 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f0500085a80 con 0x7f04f4005dc0 2024-09-13T18:33:03.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.439+0000 7f050bfff700 1 --2- 172.21.15.44:0/219428616 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f04f8066760 0x7f04f8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.439+0000 7f050bfff700 1 --2- 172.21.15.44:0/219428616 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f04f8066760 0x7f04f8068c20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f050c0ad6e0 tx=0x7f04fc006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.447+0000 7f05097fa700 1 -- 172.21.15.44:0/219428616 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f05000569c0 con 0x7f04f4005dc0 2024-09-13T18:33:03.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.651+0000 7f0511e84700 1 -- 172.21.15.44:0/219428616 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f050c140f80 con 0x7f04f4005dc0 2024-09-13T18:33:03.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.651+0000 7f05097fa700 1 -- 172.21.15.44:0/219428616 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f05000045d0 con 0x7f04f4005dc0 2024-09-13T18:33:03.660 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:33:03.660 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5447,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2081931615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2081931615},{"type":"v1","addr":"172.21.15.99:6835","nonce":2081931615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5639,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1452559390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1452559390},{"type":"v1","addr":"172.21.15.44:6835","nonce":1452559390}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5887,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/2337853364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2337853364},{"type":"v1","addr":"172.21.15.99:6837","nonce":2337853364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:29:10.283572+0000","modified":"2024-09-13T18:31:49.597435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":51,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5976},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5976":{"gid":5976,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":44,"addr":"172.21.15.44:6833/3567136594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3567136594},{"type":"v1","addr":"172.21.15.44:6833","nonce":3567136594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:33:03.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.655+0000 7f0511e84700 1 -- 172.21.15.44:0/219428616 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f04f8066760 msgr2=0x7f04f8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.655+0000 7f0511e84700 1 --2- 172.21.15.44:0/219428616 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f04f8066760 0x7f04f8068c20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f050c0ad6e0 tx=0x7f04fc006040 comp rx=0 tx=0).stop 2024-09-13T18:33:03.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.655+0000 7f0511e84700 1 -- 172.21.15.44:0/219428616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04f4005dc0 msgr2=0x7f050c13acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.655+0000 7f0511e84700 1 --2- 172.21.15.44:0/219428616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04f4005dc0 0x7f050c13acd0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f05000090b0 tx=0x7f05000047e0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.655+0000 7f0511e84700 1 -- 172.21.15.44:0/219428616 shutdown_connections 2024-09-13T18:33:03.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.655+0000 7f0511e84700 1 --2- 172.21.15.44:0/219428616 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f04f8066760 0x7f04f8068c20 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.655+0000 7f0511e84700 1 --2- 172.21.15.44:0/219428616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f050c15c5b0 0x7f050c157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.655+0000 7f0511e84700 1 --2- 172.21.15.44:0/219428616 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f050c15a510 0x7f050c15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.655+0000 7f0511e84700 1 --2- 172.21.15.44:0/219428616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04f4005dc0 0x7f050c13acd0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.655+0000 7f0511e84700 1 -- 172.21.15.44:0/219428616 >> 172.21.15.44:0/219428616 conn(0x7f050c0b0f00 msgr2=0x7f050c0afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:03.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.655+0000 7f0511e84700 1 -- 172.21.15.44:0/219428616 shutdown_connections 2024-09-13T18:33:03.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.655+0000 7f0511e84700 1 -- 172.21.15.44:0/219428616 wait complete. 2024-09-13T18:33:03.665 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 38 2024-09-13T18:33:03.676 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:33:03.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.783+0000 7f936bfff700 1 Processor -- start 2024-09-13T18:33:03.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936bfff700 1 -- start start 2024-09-13T18:33:03.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936bfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f936c0cdad0 0x7f936c0cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936bfff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f936c071c90 0x7f936c072100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936bfff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f936c15e080 con 0x7f936c153ba0 2024-09-13T18:33:03.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936bfff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f936c0ce430 con 0x7f936c071c90 2024-09-13T18:33:03.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936bfff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936c0ccde0 con 0x7f936c0cdad0 2024-09-13T18:33:03.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936b7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f936c071c90 0x7f936c072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936b7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f936c071c90 0x7f936c072100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38968/0 (socket says 172.21.15.44:38968) 2024-09-13T18:33:03.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936b7fe700 1 -- 172.21.15.44:0/3835012436 learned_addr learned my addr 172.21.15.44:0/3835012436 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:03.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936affd700 1 --1- 172.21.15.44:0/3835012436 >> v1:172.21.15.44:6789/0 conn(0x7f936c153ba0 0x7f936c0c9d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44198/0 (socket says 172.21.15.44:44198) 2024-09-13T18:33:03.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f9363fff700 1 --2- 172.21.15.44:0/3835012436 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f936c0cdad0 0x7f936c0cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936b7fe700 1 -- 172.21.15.44:0/3835012436 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f936c0cdad0 msgr2=0x7f936c0cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:03.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936b7fe700 1 --2- 172.21.15.44:0/3835012436 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f936c0cdad0 0x7f936c0cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936b7fe700 1 -- 172.21.15.44:0/3835012436 >> v1:172.21.15.44:6789/0 conn(0x7f936c153ba0 legacy=0x7f936c0c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936b7fe700 1 -- 172.21.15.44:0/3835012436 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c160a60 con 0x7f936c071c90 2024-09-13T18:33:03.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936b7fe700 1 --2- 172.21.15.44:0/3835012436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f936c071c90 0x7f936c072100 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f9364009e50 tx=0x7f936400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1d2eeecf78fb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936a7fc700 1 -- 172.21.15.44:0/3835012436 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936400e070 con 0x7f936c071c90 2024-09-13T18:33:03.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936a7fc700 1 -- 172.21.15.44:0/3835012436 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936400b9c0 con 0x7f936c071c90 2024-09-13T18:33:03.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936a7fc700 1 -- 172.21.15.44:0/3835012436 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936400bd70 con 0x7f936c071c90 2024-09-13T18:33:03.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936bfff700 1 -- 172.21.15.44:0/3835012436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f936c071c90 msgr2=0x7f936c072100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936bfff700 1 --2- 172.21.15.44:0/3835012436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f936c071c90 0x7f936c072100 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f9364009e50 tx=0x7f936400b330 comp rx=0 tx=0).stop 2024-09-13T18:33:03.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936bfff700 1 -- 172.21.15.44:0/3835012436 shutdown_connections 2024-09-13T18:33:03.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936bfff700 1 --2- 172.21.15.44:0/3835012436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f936c071c90 0x7f936c072100 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936bfff700 1 --2- 172.21.15.44:0/3835012436 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f936c0cdad0 0x7f936c0cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936bfff700 1 -- 172.21.15.44:0/3835012436 >> 172.21.15.44:0/3835012436 conn(0x7f936c06a310 msgr2=0x7f936c06a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:03.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936bfff700 1 -- 172.21.15.44:0/3835012436 shutdown_connections 2024-09-13T18:33:03.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.787+0000 7f936bfff700 1 -- 172.21.15.44:0/3835012436 wait complete. 2024-09-13T18:33:03.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.791+0000 7f936bfff700 1 Processor -- start 2024-09-13T18:33:03.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.791+0000 7f936bfff700 1 -- start start 2024-09-13T18:33:03.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f936bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f936c071c90 0x7f936c15eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f936bfff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f936c0cdad0 0x7f936c15fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f936bfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f936c153ba0 0x7f936c147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f936bfff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c06cc30 con 0x7f936c071c90 2024-09-13T18:33:03.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f936bfff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c06d750 con 0x7f936c0cdad0 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f936bfff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936c1605b0 con 0x7f936c153ba0 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f936affd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f936c071c90 0x7f936c15eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f936affd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f936c071c90 0x7f936c15eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38982/0 (socket says 172.21.15.44:38982) 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f936affd700 1 -- 172.21.15.44:0/2654405949 learned_addr learned my addr 172.21.15.44:0/2654405949 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f9363fff700 1 --2- 172.21.15.44:0/2654405949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f936c0cdad0 0x7f936c15fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f936b7fe700 1 --2- 172.21.15.44:0/2654405949 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f936c153ba0 0x7f936c147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f936affd700 1 -- 172.21.15.44:0/2654405949 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f936c153ba0 msgr2=0x7f936c147de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f936affd700 1 --2- 172.21.15.44:0/2654405949 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f936c153ba0 0x7f936c147de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f936affd700 1 -- 172.21.15.44:0/2654405949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f936c0cdad0 msgr2=0x7f936c15fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f936affd700 1 --2- 172.21.15.44:0/2654405949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f936c0cdad0 0x7f936c15fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f936affd700 1 -- 172.21.15.44:0/2654405949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9364009b30 con 0x7f936c071c90 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f9363fff700 1 --2- 172.21.15.44:0/2654405949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f936c0cdad0 0x7f936c15fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f936b7fe700 1 --2- 172.21.15.44:0/2654405949 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f936c153ba0 0x7f936c147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:03.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f936affd700 1 --2- 172.21.15.44:0/2654405949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f936c071c90 0x7f936c15eeb0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f935c00c530 tx=0x7f935c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f9368ff9700 1 -- 172.21.15.44:0/2654405949 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c005cd0 con 0x7f936c071c90 2024-09-13T18:33:03.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f9368ff9700 1 -- 172.21.15.44:0/2654405949 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c005e30 con 0x7f936c071c90 2024-09-13T18:33:03.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f9368ff9700 1 -- 172.21.15.44:0/2654405949 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c0072d0 con 0x7f936c071c90 2024-09-13T18:33:03.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f936bfff700 1 -- 172.21.15.44:0/2654405949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f936c160310 con 0x7f936c071c90 2024-09-13T18:33:03.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.795+0000 7f936bfff700 1 -- 172.21.15.44:0/2654405949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936c06d3e0 con 0x7f936c071c90 2024-09-13T18:33:03.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.799+0000 7f936bfff700 1 -- 172.21.15.44:0/2654405949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f936c06cf30 con 0x7f936c071c90 2024-09-13T18:33:03.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.799+0000 7f9368ff9700 1 -- 172.21.15.44:0/2654405949 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f935c007430 con 0x7f936c071c90 2024-09-13T18:33:03.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.799+0000 7f9368ff9700 1 --2- 172.21.15.44:0/2654405949 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f934c066730 0x7f934c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.799+0000 7f9368ff9700 1 -- 172.21.15.44:0/2654405949 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f935c0834d0 con 0x7f936c071c90 2024-09-13T18:33:03.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.799+0000 7f9363fff700 1 --2- 172.21.15.44:0/2654405949 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f934c066730 0x7f934c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.799+0000 7f9363fff700 1 --2- 172.21.15.44:0/2654405949 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f934c066730 0x7f934c068bf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f936c06e5d0 tx=0x7f9354008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:03.807+0000 7f9368ff9700 1 -- 172.21.15.44:0/2654405949 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f935c0508f0 con 0x7f936c071c90 2024-09-13T18:33:04.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.015+0000 7f936bfff700 1 -- 172.21.15.44:0/2654405949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f936c150f50 con 0x7f936c071c90 2024-09-13T18:33:04.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.015+0000 7f9368ff9700 1 -- 172.21.15.44:0/2654405949 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f935c053f10 con 0x7f936c071c90 2024-09-13T18:33:04.023 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:33:04.023 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5447,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2081931615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2081931615},{"type":"v1","addr":"172.21.15.99:6835","nonce":2081931615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5639,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1452559390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1452559390},{"type":"v1","addr":"172.21.15.44:6835","nonce":1452559390}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5887,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/2337853364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2337853364},{"type":"v1","addr":"172.21.15.99:6837","nonce":2337853364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:29:10.283572+0000","modified":"2024-09-13T18:31:49.597435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":51,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5976},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5976":{"gid":5976,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":44,"addr":"172.21.15.44:6833/3567136594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3567136594},{"type":"v1","addr":"172.21.15.44:6833","nonce":3567136594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:33:04.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.019+0000 7f936bfff700 1 -- 172.21.15.44:0/2654405949 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f934c066730 msgr2=0x7f934c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.019+0000 7f936bfff700 1 --2- 172.21.15.44:0/2654405949 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f934c066730 0x7f934c068bf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f936c06e5d0 tx=0x7f9354008040 comp rx=0 tx=0).stop 2024-09-13T18:33:04.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.019+0000 7f936bfff700 1 -- 172.21.15.44:0/2654405949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f936c071c90 msgr2=0x7f936c15eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.019+0000 7f936bfff700 1 --2- 172.21.15.44:0/2654405949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f936c071c90 0x7f936c15eeb0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f935c00c530 tx=0x7f935c00c8f0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.019+0000 7f936bfff700 1 -- 172.21.15.44:0/2654405949 shutdown_connections 2024-09-13T18:33:04.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.019+0000 7f936bfff700 1 --2- 172.21.15.44:0/2654405949 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f934c066730 0x7f934c068bf0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.019+0000 7f936bfff700 1 --2- 172.21.15.44:0/2654405949 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f936c153ba0 0x7f936c147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.019+0000 7f936bfff700 1 --2- 172.21.15.44:0/2654405949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f936c0cdad0 0x7f936c15fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.019+0000 7f936bfff700 1 --2- 172.21.15.44:0/2654405949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f936c071c90 0x7f936c15eeb0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.019+0000 7f936bfff700 1 -- 172.21.15.44:0/2654405949 >> 172.21.15.44:0/2654405949 conn(0x7f936c06a310 msgr2=0x7f936c06a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:04.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.019+0000 7f936bfff700 1 -- 172.21.15.44:0/2654405949 shutdown_connections 2024-09-13T18:33:04.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.019+0000 7f936bfff700 1 -- 172.21.15.44:0/2654405949 wait complete. 2024-09-13T18:33:04.028 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 38 2024-09-13T18:33:04.040 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:04.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.151+0000 7fc82ccba700 1 Processor -- start 2024-09-13T18:33:04.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.151+0000 7fc82ccba700 1 -- start start 2024-09-13T18:33:04.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.151+0000 7fc82ccba700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc8280d1fa0 0x7fc82815e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.151+0000 7fc82ccba700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc82806b480 0x7fc82806b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.151+0000 7fc82ccba700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc82815e960 con 0x7fc82815cb70 2024-09-13T18:33:04.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.151+0000 7fc82ccba700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8280cd480 con 0x7fc82806b480 2024-09-13T18:33:04.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.151+0000 7fc82ccba700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8280cd760 con 0x7fc8280d1fa0 2024-09-13T18:33:04.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.151+0000 7fc827fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc82806b480 0x7fc82806b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.151+0000 7fc827fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc82806b480 0x7fc82806b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38998/0 (socket says 172.21.15.44:38998) 2024-09-13T18:33:04.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.151+0000 7fc827fff700 1 -- 172.21.15.44:0/4170304684 learned_addr learned my addr 172.21.15.44:0/4170304684 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:04.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.151+0000 7fc826ffd700 1 --2- 172.21.15.44:0/4170304684 >> v2:172.21.15.99:3300/0 conn(0x7fc8280d1fa0 0x7fc82815e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.151+0000 7fc827fff700 1 -- 172.21.15.44:0/4170304684 >> v2:172.21.15.99:3300/0 conn(0x7fc8280d1fa0 msgr2=0x7fc82815e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:04.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.151+0000 7fc827fff700 1 --2- 172.21.15.44:0/4170304684 >> v2:172.21.15.99:3300/0 conn(0x7fc8280d1fa0 0x7fc82815e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.151+0000 7fc827fff700 1 -- 172.21.15.44:0/4170304684 >> v1:172.21.15.99:6789/0 conn(0x7fc82815cb70 legacy=0x7fc8280d1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.151+0000 7fc827fff700 1 -- 172.21.15.44:0/4170304684 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8280cda40 con 0x7fc82806b480 2024-09-13T18:33:04.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.155+0000 7fc827fff700 1 --2- 172.21.15.44:0/4170304684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc82806b480 0x7fc82806b860 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc8280cf6e0 tx=0x7fc82000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b10681a982e85d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:04.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.155+0000 7fc8267fc700 1 -- 172.21.15.44:0/4170304684 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82000e070 con 0x7fc82806b480 2024-09-13T18:33:04.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.155+0000 7fc8267fc700 1 -- 172.21.15.44:0/4170304684 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82000b9c0 con 0x7fc82806b480 2024-09-13T18:33:04.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.155+0000 7fc8267fc700 1 -- 172.21.15.44:0/4170304684 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82000bd70 con 0x7fc82806b480 2024-09-13T18:33:04.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.155+0000 7fc82ccba700 1 -- 172.21.15.44:0/4170304684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc82806b480 msgr2=0x7fc82806b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.155+0000 7fc82ccba700 1 --2- 172.21.15.44:0/4170304684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc82806b480 0x7fc82806b860 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc8280cf6e0 tx=0x7fc82000b330 comp rx=0 tx=0).stop 2024-09-13T18:33:04.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.155+0000 7fc82ccba700 1 -- 172.21.15.44:0/4170304684 shutdown_connections 2024-09-13T18:33:04.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.155+0000 7fc82ccba700 1 --2- 172.21.15.44:0/4170304684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc82806b480 0x7fc82806b860 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.155+0000 7fc82ccba700 1 --2- 172.21.15.44:0/4170304684 >> v2:172.21.15.99:3300/0 conn(0x7fc8280d1fa0 0x7fc82815e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.155+0000 7fc82ccba700 1 -- 172.21.15.44:0/4170304684 >> 172.21.15.44:0/4170304684 conn(0x7fc8280cf730 msgr2=0x7fc8280cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:04.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.155+0000 7fc82ccba700 1 -- 172.21.15.44:0/4170304684 shutdown_connections 2024-09-13T18:33:04.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.155+0000 7fc82ccba700 1 -- 172.21.15.44:0/4170304684 wait complete. 2024-09-13T18:33:04.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.155+0000 7fc82ccba700 1 Processor -- start 2024-09-13T18:33:04.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.155+0000 7fc82ccba700 1 -- start start 2024-09-13T18:33:04.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.159+0000 7fc82ccba700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc82806b480 0x7fc8280cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.159+0000 7fc82ccba700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc8280d1fa0 0x7fc8281f1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.159+0000 7fc82ccba700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc82815cb70 0x7fc8281f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.159+0000 7fc82ccba700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8280ae2f0 con 0x7fc82806b480 2024-09-13T18:33:04.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.159+0000 7fc82ccba700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8280a9de0 con 0x7fc82815cb70 2024-09-13T18:33:04.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.159+0000 7fc82ccba700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8280aa0c0 con 0x7fc8280d1fa0 2024-09-13T18:33:04.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.159+0000 7fc8277fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc82806b480 0x7fc8280cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.159+0000 7fc8277fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc82806b480 0x7fc8280cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39008/0 (socket says 172.21.15.44:39008) 2024-09-13T18:33:04.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.159+0000 7fc8277fe700 1 -- 172.21.15.44:0/2825210329 learned_addr learned my addr 172.21.15.44:0/2825210329 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:04.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.159+0000 7fc827fff700 1 --2- 172.21.15.44:0/2825210329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc82815cb70 0x7fc8281f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.159+0000 7fc826ffd700 1 --2- 172.21.15.44:0/2825210329 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc8280d1fa0 0x7fc8281f1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.159+0000 7fc8277fe700 1 -- 172.21.15.44:0/2825210329 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc8280d1fa0 msgr2=0x7fc8281f1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.159+0000 7fc8277fe700 1 --2- 172.21.15.44:0/2825210329 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc8280d1fa0 0x7fc8281f1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.159+0000 7fc8277fe700 1 -- 172.21.15.44:0/2825210329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc82815cb70 msgr2=0x7fc8281f5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.159+0000 7fc8277fe700 1 --2- 172.21.15.44:0/2825210329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc82815cb70 0x7fc8281f5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.159+0000 7fc8277fe700 1 -- 172.21.15.44:0/2825210329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc820009b30 con 0x7fc82806b480 2024-09-13T18:33:04.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.159+0000 7fc8277fe700 1 --2- 172.21.15.44:0/2825210329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc82806b480 0x7fc8280cb820 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc81000c500 tx=0x7fc81000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:04.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.159+0000 7fc81ffff700 1 -- 172.21.15.44:0/2825210329 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8100052d0 con 0x7fc82806b480 2024-09-13T18:33:04.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.159+0000 7fc81ffff700 1 -- 172.21.15.44:0/2825210329 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc810005430 con 0x7fc82806b480 2024-09-13T18:33:04.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.159+0000 7fc82ccba700 1 -- 172.21.15.44:0/2825210329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8280aa3a0 con 0x7fc82806b480 2024-09-13T18:33:04.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.159+0000 7fc81ffff700 1 -- 172.21.15.44:0/2825210329 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8100055a0 con 0x7fc82806b480 2024-09-13T18:33:04.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.159+0000 7fc82ccba700 1 -- 172.21.15.44:0/2825210329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8280aa960 con 0x7fc82806b480 2024-09-13T18:33:04.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.159+0000 7fc82ccba700 1 -- 172.21.15.44:0/2825210329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8280aab80 con 0x7fc82806b480 2024-09-13T18:33:04.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.163+0000 7fc81ffff700 1 -- 172.21.15.44:0/2825210329 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc8100038e0 con 0x7fc82806b480 2024-09-13T18:33:04.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.163+0000 7fc81ffff700 1 --2- 172.21.15.44:0/2825210329 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc808066730 0x7fc808068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.163+0000 7fc81ffff700 1 -- 172.21.15.44:0/2825210329 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fc810083640 con 0x7fc82806b480 2024-09-13T18:33:04.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.163+0000 7fc826ffd700 1 --2- 172.21.15.44:0/2825210329 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc808066730 0x7fc808068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.163+0000 7fc826ffd700 1 --2- 172.21.15.44:0/2825210329 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc808066730 0x7fc808068bf0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc82806b090 tx=0x7fc818008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:04.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.175+0000 7fc81ffff700 1 -- 172.21.15.44:0/2825210329 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc810050880 con 0x7fc82806b480 2024-09-13T18:33:04.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.351+0000 7fc82ccba700 1 -- 172.21.15.44:0/2825210329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc82806b860 con 0x7fc82806b480 2024-09-13T18:33:04.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.355+0000 7fc81ffff700 1 -- 172.21.15.44:0/2825210329 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16674 (secure 0 0 0) 0x7fc810081e60 con 0x7fc82806b480 2024-09-13T18:33:04.361 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:33:04.361 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":51,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:30:35.073160+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:29:08.754284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:29:09.262346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.1b","mappings":[{"from":0,"to":5}]},{"pgid":"7.3c","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/3200882245":"2024-09-14T18:30:35.073090+0000","172.21.15.44:6834/3200882245":"2024-09-14T18:30:35.073090+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.355+0000 7fc82ccba700 1 -- 172.21.15.44:0/2825210329 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc808066730 msgr2=0x7fc808068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.355+0000 7fc82ccba700 1 --2- 172.21.15.44:0/2825210329 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc808066730 0x7fc808068bf0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc82806b090 tx=0x7fc818008040 comp rx=0 tx=0).stop 2024-09-13T18:33:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.355+0000 7fc82ccba700 1 -- 172.21.15.44:0/2825210329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc82806b480 msgr2=0x7fc8280cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.355+0000 7fc82ccba700 1 --2- 172.21.15.44:0/2825210329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc82806b480 0x7fc8280cb820 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc81000c500 tx=0x7fc81000c810 comp rx=0 tx=0).stop 2024-09-13T18:33:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.355+0000 7fc82ccba700 1 -- 172.21.15.44:0/2825210329 shutdown_connections 2024-09-13T18:33:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.355+0000 7fc82ccba700 1 --2- 172.21.15.44:0/2825210329 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc808066730 0x7fc808068bf0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.355+0000 7fc82ccba700 1 --2- 172.21.15.44:0/2825210329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc82815cb70 0x7fc8281f5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.355+0000 7fc82ccba700 1 --2- 172.21.15.44:0/2825210329 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc8280d1fa0 0x7fc8281f1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.355+0000 7fc82ccba700 1 --2- 172.21.15.44:0/2825210329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc82806b480 0x7fc8280cb820 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.355+0000 7fc82ccba700 1 -- 172.21.15.44:0/2825210329 >> 172.21.15.44:0/2825210329 conn(0x7fc8280cf730 msgr2=0x7fc82815d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:04.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.355+0000 7fc82ccba700 1 -- 172.21.15.44:0/2825210329 shutdown_connections 2024-09-13T18:33:04.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.355+0000 7fc82ccba700 1 -- 172.21.15.44:0/2825210329 wait complete. 2024-09-13T18:33:04.376 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:33:04.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.487+0000 7fae14920700 1 Processor -- start 2024-09-13T18:33:04.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.487+0000 7fae14920700 1 -- start start 2024-09-13T18:33:04.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.487+0000 7fae14920700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fae1015a650 0x7fae100b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.487+0000 7fae14920700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fae100b3b80 0x7fae1015dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.487+0000 7fae14920700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fae100cf3e0 0x7fae100cf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.487+0000 7fae14920700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae1015e0e0 con 0x7fae1015a650 2024-09-13T18:33:04.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.487+0000 7fae14920700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae100cfd90 con 0x7fae100cf3e0 2024-09-13T18:33:04.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.487+0000 7fae14920700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae100b4e50 con 0x7fae100b3b80 2024-09-13T18:33:04.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.487+0000 7fae0ed9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fae1015a650 0x7fae100b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.487+0000 7fae0ed9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fae1015a650 0x7fae100b52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39014/0 (socket says 172.21.15.44:39014) 2024-09-13T18:33:04.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.487+0000 7fae0ed9d700 1 -- 172.21.15.44:0/2031118557 learned_addr learned my addr 172.21.15.44:0/2031118557 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:04.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.487+0000 7fae0f59e700 1 --2- 172.21.15.44:0/2031118557 >> v2:172.21.15.99:3300/0 conn(0x7fae100cf3e0 0x7fae100cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.487+0000 7fae0e59c700 1 --2- 172.21.15.44:0/2031118557 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fae100b3b80 0x7fae1015dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.487+0000 7fae0ed9d700 1 -- 172.21.15.44:0/2031118557 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fae100b3b80 msgr2=0x7fae1015dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:04.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.487+0000 7fae0ed9d700 1 --2- 172.21.15.44:0/2031118557 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fae100b3b80 0x7fae1015dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.487+0000 7fae0ed9d700 1 -- 172.21.15.44:0/2031118557 >> v2:172.21.15.99:3300/0 conn(0x7fae100cf3e0 msgr2=0x7fae100cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:04.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.487+0000 7fae0ed9d700 1 --2- 172.21.15.44:0/2031118557 >> v2:172.21.15.99:3300/0 conn(0x7fae100cf3e0 0x7fae100cf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.487+0000 7fae0ed9d700 1 -- 172.21.15.44:0/2031118557 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae100b3fe0 con 0x7fae1015a650 2024-09-13T18:33:04.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.487+0000 7fae0ed9d700 1 --2- 172.21.15.44:0/2031118557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae1015a650 0x7fae100b52e0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fae100ca7e0 tx=0x7fae00009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df89b63816110b9e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:04.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.487+0000 7fae0dd9b700 1 -- 172.21.15.44:0/2031118557 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae00011830 con 0x7fae1015a650 2024-09-13T18:33:04.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.487+0000 7fae0dd9b700 1 -- 172.21.15.44:0/2031118557 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae00011990 con 0x7fae1015a650 2024-09-13T18:33:04.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.487+0000 7fae0dd9b700 1 -- 172.21.15.44:0/2031118557 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae00011d20 con 0x7fae1015a650 2024-09-13T18:33:04.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.491+0000 7fae14920700 1 -- 172.21.15.44:0/2031118557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae1015a650 msgr2=0x7fae100b52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.491+0000 7fae14920700 1 --2- 172.21.15.44:0/2031118557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae1015a650 0x7fae100b52e0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fae100ca7e0 tx=0x7fae00009bf0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.491+0000 7fae14920700 1 -- 172.21.15.44:0/2031118557 shutdown_connections 2024-09-13T18:33:04.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.491+0000 7fae14920700 1 --2- 172.21.15.44:0/2031118557 >> v2:172.21.15.99:3300/0 conn(0x7fae100cf3e0 0x7fae100cf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.491+0000 7fae14920700 1 --2- 172.21.15.44:0/2031118557 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fae100b3b80 0x7fae1015dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.491+0000 7fae14920700 1 --2- 172.21.15.44:0/2031118557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae1015a650 0x7fae100b52e0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.491+0000 7fae14920700 1 -- 172.21.15.44:0/2031118557 >> 172.21.15.44:0/2031118557 conn(0x7fae10071d00 msgr2=0x7fae100720e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:04.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.491+0000 7fae14920700 1 -- 172.21.15.44:0/2031118557 shutdown_connections 2024-09-13T18:33:04.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.491+0000 7fae14920700 1 -- 172.21.15.44:0/2031118557 wait complete. 2024-09-13T18:33:04.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.491+0000 7fae14920700 1 Processor -- start 2024-09-13T18:33:04.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.491+0000 7fae14920700 1 -- start start 2024-09-13T18:33:04.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.491+0000 7fae14920700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fae100b3b80 0x7fae100b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.491+0000 7fae14920700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae100cf3e0 0x7fae10141200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.491+0000 7fae14920700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae1015a650 0x7fae1006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.491+0000 7fae14920700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae101501e0 con 0x7fae1015a650 2024-09-13T18:33:04.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.491+0000 7fae14920700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae101504c0 con 0x7fae100cf3e0 2024-09-13T18:33:04.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.491+0000 7fae14920700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae101507a0 con 0x7fae100b3b80 2024-09-13T18:33:04.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.491+0000 7fae0f59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae1015a650 0x7fae1006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.491+0000 7fae0f59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae1015a650 0x7fae1006cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39016/0 (socket says 172.21.15.44:39016) 2024-09-13T18:33:04.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.491+0000 7fae0f59e700 1 -- 172.21.15.44:0/835497222 learned_addr learned my addr 172.21.15.44:0/835497222 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:04.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.495+0000 7fae0e59c700 1 --2- 172.21.15.44:0/835497222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae100cf3e0 0x7fae10141200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.495+0000 7fae0ed9d700 1 --2- 172.21.15.44:0/835497222 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fae100b3b80 0x7fae100b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.495+0000 7fae0f59e700 1 -- 172.21.15.44:0/835497222 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fae100b3b80 msgr2=0x7fae100b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.495+0000 7fae0f59e700 1 --2- 172.21.15.44:0/835497222 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fae100b3b80 0x7fae100b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.495+0000 7fae0f59e700 1 -- 172.21.15.44:0/835497222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae100cf3e0 msgr2=0x7fae10141200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.495+0000 7fae0f59e700 1 --2- 172.21.15.44:0/835497222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae100cf3e0 0x7fae10141200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.495+0000 7fae0f59e700 1 -- 172.21.15.44:0/835497222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae00009570 con 0x7fae1015a650 2024-09-13T18:33:04.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.495+0000 7fae0f59e700 1 --2- 172.21.15.44:0/835497222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae1015a650 0x7fae1006cd00 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fae0800eb60 tx=0x7fae0800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:04.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.495+0000 7fae077fe700 1 -- 172.21.15.44:0/835497222 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae08009740 con 0x7fae1015a650 2024-09-13T18:33:04.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.495+0000 7fae077fe700 1 -- 172.21.15.44:0/835497222 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae08009e00 con 0x7fae1015a650 2024-09-13T18:33:04.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.495+0000 7fae14920700 1 -- 172.21.15.44:0/835497222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae10150a80 con 0x7fae1015a650 2024-09-13T18:33:04.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.495+0000 7fae077fe700 1 -- 172.21.15.44:0/835497222 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0800ca70 con 0x7fae1015a650 2024-09-13T18:33:04.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.495+0000 7fae14920700 1 -- 172.21.15.44:0/835497222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae100b0ca0 con 0x7fae1015a650 2024-09-13T18:33:04.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.495+0000 7fae14920700 1 -- 172.21.15.44:0/835497222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae10150fa0 con 0x7fae1015a650 2024-09-13T18:33:04.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.499+0000 7fae077fe700 1 -- 172.21.15.44:0/835497222 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fae0800cbd0 con 0x7fae1015a650 2024-09-13T18:33:04.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.499+0000 7fae077fe700 1 --2- 172.21.15.44:0/835497222 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fadf0066730 0x7fadf0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.499+0000 7fae077fe700 1 -- 172.21.15.44:0/835497222 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fae080848c0 con 0x7fae1015a650 2024-09-13T18:33:04.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.499+0000 7fae0ed9d700 1 --2- 172.21.15.44:0/835497222 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fadf0066730 0x7fadf0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.499+0000 7fae0ed9d700 1 --2- 172.21.15.44:0/835497222 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fadf0066730 0x7fadf0068bf0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fae00000c00 tx=0x7fae00008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:04.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.503+0000 7fae077fe700 1 -- 172.21.15.44:0/835497222 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fae08051b80 con 0x7fae1015a650 2024-09-13T18:33:04.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.707+0000 7fae14920700 1 -- 172.21.15.44:0/835497222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fae10150fa0 con 0x7fae1015a650 2024-09-13T18:33:04.716 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-13T18:33:04.711+0000 7fc22bbc2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:33:04.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.723+0000 7fae077fe700 1 -- 172.21.15.44:0/835497222 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) v1 ==== 161+0+0 (secure 0 0 0) 0x7fae10150fa0 con 0x7fae1015a650 2024-09-13T18:33:04.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.727+0000 7fae14920700 1 -- 172.21.15.44:0/835497222 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fadf0066730 msgr2=0x7fadf0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.727+0000 7fae14920700 1 --2- 172.21.15.44:0/835497222 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fadf0066730 0x7fadf0068bf0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fae00000c00 tx=0x7fae00008030 comp rx=0 tx=0).stop 2024-09-13T18:33:04.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.727+0000 7fae14920700 1 -- 172.21.15.44:0/835497222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae1015a650 msgr2=0x7fae1006cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.727+0000 7fae14920700 1 --2- 172.21.15.44:0/835497222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae1015a650 0x7fae1006cd00 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fae0800eb60 tx=0x7fae0800ee70 comp rx=0 tx=0).stop 2024-09-13T18:33:04.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.727+0000 7fae14920700 1 -- 172.21.15.44:0/835497222 shutdown_connections 2024-09-13T18:33:04.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.727+0000 7fae14920700 1 --2- 172.21.15.44:0/835497222 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fadf0066730 0x7fadf0068bf0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.727+0000 7fae14920700 1 --2- 172.21.15.44:0/835497222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae1015a650 0x7fae1006cd00 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.727+0000 7fae14920700 1 --2- 172.21.15.44:0/835497222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae100cf3e0 0x7fae10141200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.727+0000 7fae14920700 1 --2- 172.21.15.44:0/835497222 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fae100b3b80 0x7fae100b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.727+0000 7fae14920700 1 -- 172.21.15.44:0/835497222 >> 172.21.15.44:0/835497222 conn(0x7fae10071d00 msgr2=0x7fae1015c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:04.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.727+0000 7fae14920700 1 -- 172.21.15.44:0/835497222 shutdown_connections 2024-09-13T18:33:04.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.727+0000 7fae14920700 1 -- 172.21.15.44:0/835497222 wait complete. 2024-09-13T18:33:04.733 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:33:04.735 INFO:tasks.ceph.mds.a.smithi044.stderr: -8561> 2024-09-13T18:31:51.885+0000 7fdaeec9d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:33:04.746 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:33:04.772 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-13T18:33:04.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.855+0000 7f6782660700 1 Processor -- start 2024-09-13T18:33:04.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.855+0000 7f6782660700 1 -- start start 2024-09-13T18:33:04.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f6782660700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f677c0b4170 0x7f677c0cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f6782660700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f677c0b4550 0x7f677c0b4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f6782660700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f677c0ac960 con 0x7f677c071a90 2024-09-13T18:33:04.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f6782660700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f677c072630 con 0x7f677c0b4170 2024-09-13T18:33:04.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f6782660700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f677c15cf50 con 0x7f677c0b4550 2024-09-13T18:33:04.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f678165e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f677c0b4170 0x7f677c0cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f6781e5f700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f677c071a90 0x7f677c071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44220/0 (socket says 172.21.15.44:44220) 2024-09-13T18:33:04.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f6781e5f700 1 -- 172.21.15.44:0/597741774 learned_addr learned my addr 172.21.15.44:0/597741774 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:04.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f6780e5d700 1 --2- 172.21.15.44:0/597741774 >> v2:172.21.15.99:3300/0 conn(0x7f677c0b4550 0x7f677c0b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f6773fff700 1 -- 172.21.15.44:0/597741774 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847056874 0 0) 0x7f677c0ac960 con 0x7f677c071a90 2024-09-13T18:33:04.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f678165e700 1 -- 172.21.15.44:0/597741774 >> v2:172.21.15.99:3300/0 conn(0x7f677c0b4550 msgr2=0x7f677c0b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:04.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f678165e700 1 --2- 172.21.15.44:0/597741774 >> v2:172.21.15.99:3300/0 conn(0x7f677c0b4550 0x7f677c0b4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f678165e700 1 -- 172.21.15.44:0/597741774 >> v1:172.21.15.44:6789/0 conn(0x7f677c071a90 legacy=0x7f677c071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f678165e700 1 -- 172.21.15.44:0/597741774 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c0acc00 con 0x7f677c0b4170 2024-09-13T18:33:04.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f678165e700 1 --2- 172.21.15.44:0/597741774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f677c0b4170 0x7f677c0cc940 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f677c072a00 tx=0x7f6778009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65bc4b2842e4e229 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:04.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f6773fff700 1 -- 172.21.15.44:0/597741774 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778011830 con 0x7f677c0b4170 2024-09-13T18:33:04.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f6773fff700 1 -- 172.21.15.44:0/597741774 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6778011990 con 0x7f677c0b4170 2024-09-13T18:33:04.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f6773fff700 1 -- 172.21.15.44:0/597741774 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778011d20 con 0x7f677c0b4170 2024-09-13T18:33:04.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f6782660700 1 -- 172.21.15.44:0/597741774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f677c0b4170 msgr2=0x7f677c0cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f6782660700 1 --2- 172.21.15.44:0/597741774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f677c0b4170 0x7f677c0cc940 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f677c072a00 tx=0x7f6778009b30 comp rx=0 tx=0).stop 2024-09-13T18:33:04.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f6782660700 1 -- 172.21.15.44:0/597741774 shutdown_connections 2024-09-13T18:33:04.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f6782660700 1 --2- 172.21.15.44:0/597741774 >> v2:172.21.15.99:3300/0 conn(0x7f677c0b4550 0x7f677c0b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f6782660700 1 --2- 172.21.15.44:0/597741774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f677c0b4170 0x7f677c0cc940 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f6782660700 1 -- 172.21.15.44:0/597741774 >> 172.21.15.44:0/597741774 conn(0x7f677c0cfad0 msgr2=0x7f677c0cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:04.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f6782660700 1 -- 172.21.15.44:0/597741774 shutdown_connections 2024-09-13T18:33:04.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.859+0000 7f6782660700 1 -- 172.21.15.44:0/597741774 wait complete. 2024-09-13T18:33:04.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.863+0000 7f6782660700 1 Processor -- start 2024-09-13T18:33:04.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.863+0000 7f6782660700 1 -- start start 2024-09-13T18:33:04.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.863+0000 7f6782660700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f677c071a90 0x7f677c15eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.863+0000 7f6782660700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f677c0b4170 0x7f677c14f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.863+0000 7f6782660700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f677c0b4550 0x7f677c151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.863+0000 7f6782660700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c15e6b0 con 0x7f677c0b4170 2024-09-13T18:33:04.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.863+0000 7f6782660700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c14fb90 con 0x7f677c0b4550 2024-09-13T18:33:04.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.863+0000 7f6782660700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677c15daa0 con 0x7f677c071a90 2024-09-13T18:33:04.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.867+0000 7f6780e5d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f677c0b4170 0x7f677c14f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.867+0000 7f6780e5d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f677c0b4170 0x7f677c14f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39056/0 (socket says 172.21.15.44:39056) 2024-09-13T18:33:04.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.867+0000 7f6780e5d700 1 -- 172.21.15.44:0/2574980656 learned_addr learned my addr 172.21.15.44:0/2574980656 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:04.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.867+0000 7f6781e5f700 1 --2- 172.21.15.44:0/2574980656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f677c0b4550 0x7f677c151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.867+0000 7f678165e700 1 --2- 172.21.15.44:0/2574980656 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f677c071a90 0x7f677c15eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.867+0000 7f6780e5d700 1 -- 172.21.15.44:0/2574980656 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f677c071a90 msgr2=0x7f677c15eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.867+0000 7f6780e5d700 1 --2- 172.21.15.44:0/2574980656 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f677c071a90 0x7f677c15eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.867+0000 7f6780e5d700 1 -- 172.21.15.44:0/2574980656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f677c0b4550 msgr2=0x7f677c151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.867+0000 7f6780e5d700 1 --2- 172.21.15.44:0/2574980656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f677c0b4550 0x7f677c151ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.867+0000 7f6780e5d700 1 -- 172.21.15.44:0/2574980656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67780094b0 con 0x7f677c0b4170 2024-09-13T18:33:04.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.867+0000 7f6780e5d700 1 --2- 172.21.15.44:0/2574980656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f677c0b4170 0x7f677c14f650 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f676c00e840 tx=0x7f676c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:04.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.867+0000 7f6771ffb700 1 -- 172.21.15.44:0/2574980656 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c0095a0 con 0x7f677c0b4170 2024-09-13T18:33:04.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.867+0000 7f6771ffb700 1 -- 172.21.15.44:0/2574980656 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676c013680 con 0x7f677c0b4170 2024-09-13T18:33:04.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.867+0000 7f6771ffb700 1 -- 172.21.15.44:0/2574980656 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c0139f0 con 0x7f677c0b4170 2024-09-13T18:33:04.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.867+0000 7f6782660700 1 -- 172.21.15.44:0/2574980656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677c15dd80 con 0x7f677c0b4170 2024-09-13T18:33:04.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.867+0000 7f6782660700 1 -- 172.21.15.44:0/2574980656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677c15e340 con 0x7f677c0b4170 2024-09-13T18:33:04.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.867+0000 7f6782660700 1 -- 172.21.15.44:0/2574980656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677c0cc940 con 0x7f677c0b4170 2024-09-13T18:33:04.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.867+0000 7f6771ffb700 1 -- 172.21.15.44:0/2574980656 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f676c013b50 con 0x7f677c0b4170 2024-09-13T18:33:04.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.871+0000 7f6771ffb700 1 --2- 172.21.15.44:0/2574980656 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6760066730 0x7f6760068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.871+0000 7f6771ffb700 1 -- 172.21.15.44:0/2574980656 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5939+0+0 (secure 0 0 0) 0x7f676c083fe0 con 0x7f677c0b4170 2024-09-13T18:33:04.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.871+0000 7f678165e700 1 --2- 172.21.15.44:0/2574980656 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6760066730 0x7f6760068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.871+0000 7f678165e700 1 --2- 172.21.15.44:0/2574980656 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6760066730 0x7f6760068bf0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6778009fd0 tx=0x7f6778008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:04.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:04.879+0000 7f6771ffb700 1 -- 172.21.15.44:0/2574980656 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f676c0512f0 con 0x7f677c0b4170 2024-09-13T18:33:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.083+0000 7f6782660700 1 -- 172.21.15.44:0/2574980656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f677c156e40 con 0x7f677c0b4170 2024-09-13T18:33:05.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.787+0000 7f6771ffb700 1 -- 172.21.15.44:0/2574980656 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) v1 ==== 104+0+0 (secure 0 0 0) 0x7f676c054910 con 0x7f677c0b4170 2024-09-13T18:33:05.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.791+0000 7f6782660700 1 -- 172.21.15.44:0/2574980656 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6760066730 msgr2=0x7f6760068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.791+0000 7f6782660700 1 --2- 172.21.15.44:0/2574980656 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6760066730 0x7f6760068bf0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6778009fd0 tx=0x7f6778008030 comp rx=0 tx=0).stop 2024-09-13T18:33:05.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.791+0000 7f6782660700 1 -- 172.21.15.44:0/2574980656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f677c0b4170 msgr2=0x7f677c14f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.791+0000 7f6782660700 1 --2- 172.21.15.44:0/2574980656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f677c0b4170 0x7f677c14f650 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f676c00e840 tx=0x7f676c00eb50 comp rx=0 tx=0).stop 2024-09-13T18:33:05.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.795+0000 7f6782660700 1 -- 172.21.15.44:0/2574980656 shutdown_connections 2024-09-13T18:33:05.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.795+0000 7f6782660700 1 --2- 172.21.15.44:0/2574980656 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6760066730 0x7f6760068bf0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.795+0000 7f6782660700 1 --2- 172.21.15.44:0/2574980656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f677c0b4550 0x7f677c151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.795+0000 7f6782660700 1 --2- 172.21.15.44:0/2574980656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f677c0b4170 0x7f677c14f650 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.795+0000 7f6782660700 1 --2- 172.21.15.44:0/2574980656 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f677c071a90 0x7f677c15eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.795+0000 7f6782660700 1 -- 172.21.15.44:0/2574980656 >> 172.21.15.44:0/2574980656 conn(0x7f677c0cfad0 msgr2=0x7f677c0ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:05.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.795+0000 7f6782660700 1 -- 172.21.15.44:0/2574980656 shutdown_connections 2024-09-13T18:33:05.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.795+0000 7f6782660700 1 -- 172.21.15.44:0/2574980656 wait complete. 2024-09-13T18:33:05.817 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:33:05.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.939+0000 7fe2cffff700 1 Processor -- start 2024-09-13T18:33:05.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.939+0000 7fe2cffff700 1 -- start start 2024-09-13T18:33:05.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2cffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2d00d1de0 0x7fe2d00cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2cffff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d015cfc0 con 0x7fe2d015cbe0 2024-09-13T18:33:05.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2cffff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d00b5ae0 con 0x7fe2d00b78b0 2024-09-13T18:33:05.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2cffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d00ce210 con 0x7fe2d00d1de0 2024-09-13T18:33:05.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2ceffd700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe2d015cbe0 0x7fe2d00d16d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44224/0 (socket says 172.21.15.44:44224) 2024-09-13T18:33:05.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2ceffd700 1 -- 172.21.15.44:0/67010451 learned_addr learned my addr 172.21.15.44:0/67010451 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:05.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2ce7fc700 1 --2- 172.21.15.44:0/67010451 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2d00d1de0 0x7fe2d00cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2cdffb700 1 -- 172.21.15.44:0/67010451 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2979126818 0 0) 0x7fe2d015cfc0 con 0x7fe2d015cbe0 2024-09-13T18:33:05.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2cdffb700 1 -- 172.21.15.44:0/67010451 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2bc0035d0 con 0x7fe2d015cbe0 2024-09-13T18:33:05.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2cdffb700 1 -- 172.21.15.44:0/67010451 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867984868 0 0) 0x7fe2d00b5ae0 con 0x7fe2d00b78b0 2024-09-13T18:33:05.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2cdffb700 1 -- 172.21.15.44:0/67010451 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2d015cfc0 con 0x7fe2d00b78b0 2024-09-13T18:33:05.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2cdffb700 1 -- 172.21.15.44:0/67010451 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3588405453 0 0) 0x7fe2bc0035d0 con 0x7fe2d015cbe0 2024-09-13T18:33:05.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2cdffb700 1 -- 172.21.15.44:0/67010451 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2d00d1de0 msgr2=0x7fe2d00cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:05.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2cdffb700 1 --2- 172.21.15.44:0/67010451 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2d00d1de0 0x7fe2d00cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2cdffb700 1 -- 172.21.15.44:0/67010451 >> v1:172.21.15.99:6789/0 conn(0x7fe2d00b78b0 legacy=0x7fe2d01666f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2cdffb700 1 -- 172.21.15.44:0/67010451 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d00b5dc0 con 0x7fe2d015cbe0 2024-09-13T18:33:05.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2cdffb700 1 -- 172.21.15.44:0/67010451 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7fe2b8001670 con 0x7fe2d015cbe0 2024-09-13T18:33:05.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2cdffb700 1 -- 172.21.15.44:0/67010451 >> v1:172.21.15.44:6789/0 conn(0x7fe2d015cbe0 legacy=0x7fe2d00d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2cdffb700 1 --2- 172.21.15.44:0/67010451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2bc003be0 0x7fe2bc003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2cdffb700 1 --2- 172.21.15.44:0/67010451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2bc004870 0x7fe2bc004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2cdffb700 1 --2- 172.21.15.44:0/67010451 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2d00d1de0 0x7fe2bc005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2cdffb700 1 -- 172.21.15.44:0/67010451 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d00ce210 con 0x7fe2bc003be0 2024-09-13T18:33:05.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2cdffb700 1 -- 172.21.15.44:0/67010451 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc00bb10 con 0x7fe2bc004870 2024-09-13T18:33:05.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2cdffb700 1 -- 172.21.15.44:0/67010451 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc00bcd0 con 0x7fe2d00d1de0 2024-09-13T18:33:05.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2ceffd700 1 --2- 172.21.15.44:0/67010451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2bc003be0 0x7fe2bc003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2ce7fc700 1 --2- 172.21.15.44:0/67010451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2bc004870 0x7fe2bc004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2cf7fe700 1 --2- 172.21.15.44:0/67010451 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2d00d1de0 0x7fe2bc005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2ceffd700 1 -- 172.21.15.44:0/67010451 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2d00d1de0 msgr2=0x7fe2bc005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:05.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2ceffd700 1 --2- 172.21.15.44:0/67010451 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2d00d1de0 0x7fe2bc005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2ceffd700 1 -- 172.21.15.44:0/67010451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2bc004870 msgr2=0x7fe2bc004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:05.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2ceffd700 1 --2- 172.21.15.44:0/67010451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2bc004870 0x7fe2bc004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2ceffd700 1 -- 172.21.15.44:0/67010451 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2bc0035d0 con 0x7fe2bc003be0 2024-09-13T18:33:05.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.943+0000 7fe2cf7fe700 1 --2- 172.21.15.44:0/67010451 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2d00d1de0 0x7fe2bc005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:05.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2ceffd700 1 --2- 172.21.15.44:0/67010451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2bc003be0 0x7fe2bc003fe0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800c210 tx=0x7fe2bc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e997ad49238833d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:05.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2cdffb700 1 -- 172.21.15.44:0/67010451 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b800cdb0 con 0x7fe2bc003be0 2024-09-13T18:33:05.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2cdffb700 1 -- 172.21.15.44:0/67010451 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b8005980 con 0x7fe2bc003be0 2024-09-13T18:33:05.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2cdffb700 1 -- 172.21.15.44:0/67010451 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8005d30 con 0x7fe2bc003be0 2024-09-13T18:33:05.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2cffff700 1 -- 172.21.15.44:0/67010451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2bc003be0 msgr2=0x7fe2bc003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2cffff700 1 --2- 172.21.15.44:0/67010451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2bc003be0 0x7fe2bc003fe0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800c210 tx=0x7fe2bc0058a0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2cf7fe700 1 -- 172.21.15.44:0/67010451 reap_dead start 2024-09-13T18:33:05.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2cffff700 1 -- 172.21.15.44:0/67010451 shutdown_connections 2024-09-13T18:33:05.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2cffff700 1 -- 172.21.15.44:0/67010451 >> 172.21.15.44:0/67010451 conn(0x7fe2d00d36a0 msgr2=0x7fe2d00b45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:05.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2cffff700 1 -- 172.21.15.44:0/67010451 shutdown_connections 2024-09-13T18:33:05.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2cffff700 1 -- 172.21.15.44:0/67010451 wait complete. 2024-09-13T18:33:05.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2cffff700 1 Processor -- start 2024-09-13T18:33:05.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2cffff700 1 -- start start 2024-09-13T18:33:05.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2cffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2bc003be0 0x7fe2d015a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2cffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2d0158b10 0x7fe2d0159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2cffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2d0156970 0x7fe2d0156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2cffff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d015b610 con 0x7fe2d0158b10 2024-09-13T18:33:05.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2cffff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d0157330 con 0x7fe2d0156970 2024-09-13T18:33:05.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2cffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d015a990 con 0x7fe2bc003be0 2024-09-13T18:33:05.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2ce7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2d0158b10 0x7fe2d0159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2ce7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2d0158b10 0x7fe2d0159540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39086/0 (socket says 172.21.15.44:39086) 2024-09-13T18:33:05.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2ce7fc700 1 -- 172.21.15.44:0/3999121933 learned_addr learned my addr 172.21.15.44:0/3999121933 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:05.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2ceffd700 1 --2- 172.21.15.44:0/3999121933 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2bc003be0 0x7fe2d015a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.947+0000 7fe2cf7fe700 1 --2- 172.21.15.44:0/3999121933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2d0156970 0x7fe2d0156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.951+0000 7fe2ce7fc700 1 -- 172.21.15.44:0/3999121933 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2bc003be0 msgr2=0x7fe2d015a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.951+0000 7fe2ce7fc700 1 --2- 172.21.15.44:0/3999121933 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2bc003be0 0x7fe2d015a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.951+0000 7fe2ce7fc700 1 -- 172.21.15.44:0/3999121933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2d0156970 msgr2=0x7fe2d0156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.951+0000 7fe2ce7fc700 1 --2- 172.21.15.44:0/3999121933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2d0156970 0x7fe2d0156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.951+0000 7fe2ce7fc700 1 -- 172.21.15.44:0/3999121933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d015ac70 con 0x7fe2d0158b10 2024-09-13T18:33:05.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.951+0000 7fe2cf7fe700 1 --2- 172.21.15.44:0/3999121933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2d0156970 0x7fe2d0156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:05.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.951+0000 7fe2ce7fc700 1 --2- 172.21.15.44:0/3999121933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2d0158b10 0x7fe2d0159540 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0011a20 tx=0x7fe2c0011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:05.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.951+0000 7fe2c7fff700 1 -- 172.21.15.44:0/3999121933 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c000f940 con 0x7fe2d0158b10 2024-09-13T18:33:05.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.951+0000 7fe2c7fff700 1 -- 172.21.15.44:0/3999121933 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c000faa0 con 0x7fe2d0158b10 2024-09-13T18:33:05.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.951+0000 7fe2cffff700 1 -- 172.21.15.44:0/3999121933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d015af50 con 0x7fe2d0158b10 2024-09-13T18:33:05.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.951+0000 7fe2c7fff700 1 -- 172.21.15.44:0/3999121933 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c000fe50 con 0x7fe2d0158b10 2024-09-13T18:33:05.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.951+0000 7fe2cffff700 1 -- 172.21.15.44:0/3999121933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d015ba30 con 0x7fe2d0158b10 2024-09-13T18:33:05.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.951+0000 7fe2cffff700 1 -- 172.21.15.44:0/3999121933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d00b5ae0 con 0x7fe2d0158b10 2024-09-13T18:33:05.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.955+0000 7fe2c7fff700 1 -- 172.21.15.44:0/3999121933 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe2c0014440 con 0x7fe2d0158b10 2024-09-13T18:33:05.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.955+0000 7fe2c7fff700 1 --2- 172.21.15.44:0/3999121933 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe2b0066730 0x7fe2b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.955+0000 7fe2c7fff700 1 -- 172.21.15.44:0/3999121933 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5939+0+0 (secure 0 0 0) 0x7fe2c0084930 con 0x7fe2d0158b10 2024-09-13T18:33:05.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.955+0000 7fe2ceffd700 1 --2- 172.21.15.44:0/3999121933 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe2b0066730 0x7fe2b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.955+0000 7fe2ceffd700 1 --2- 172.21.15.44:0/3999121933 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe2b0066730 0x7fe2b0068bf0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe2b80018b0 tx=0x7fe2b800a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:05.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:05.963+0000 7fe2c7fff700 1 -- 172.21.15.44:0/3999121933 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe2c0051c60 con 0x7fe2d0158b10 2024-09-13T18:33:06.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.139+0000 7fe2cffff700 1 -- 172.21.15.44:0/3999121933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe2d00b1d20 con 0x7fe2d0158b10 2024-09-13T18:33:06.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.803+0000 7fe2c7fff700 1 -- 172.21.15.44:0/3999121933 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe2c0022020 con 0x7fe2d0158b10 2024-09-13T18:33:06.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.807+0000 7fe2cffff700 1 -- 172.21.15.44:0/3999121933 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe2b0066730 msgr2=0x7fe2b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:06.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.807+0000 7fe2cffff700 1 --2- 172.21.15.44:0/3999121933 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe2b0066730 0x7fe2b0068bf0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe2b80018b0 tx=0x7fe2b800a000 comp rx=0 tx=0).stop 2024-09-13T18:33:06.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.807+0000 7fe2cffff700 1 -- 172.21.15.44:0/3999121933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2d0158b10 msgr2=0x7fe2d0159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:06.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.807+0000 7fe2cffff700 1 --2- 172.21.15.44:0/3999121933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2d0158b10 0x7fe2d0159540 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0011a20 tx=0x7fe2c0011d30 comp rx=0 tx=0).stop 2024-09-13T18:33:06.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.807+0000 7fe2cffff700 1 -- 172.21.15.44:0/3999121933 shutdown_connections 2024-09-13T18:33:06.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.807+0000 7fe2cffff700 1 --2- 172.21.15.44:0/3999121933 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe2b0066730 0x7fe2b0068bf0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:06.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.807+0000 7fe2cffff700 1 --2- 172.21.15.44:0/3999121933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2d0156970 0x7fe2d0156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:06.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.807+0000 7fe2cffff700 1 --2- 172.21.15.44:0/3999121933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2d0158b10 0x7fe2d0159540 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:06.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.807+0000 7fe2cffff700 1 --2- 172.21.15.44:0/3999121933 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe2bc003be0 0x7fe2d015a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:06.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.807+0000 7fe2cffff700 1 -- 172.21.15.44:0/3999121933 >> 172.21.15.44:0/3999121933 conn(0x7fe2d00d36a0 msgr2=0x7fe2d00b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:06.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.807+0000 7fe2cffff700 1 -- 172.21.15.44:0/3999121933 shutdown_connections 2024-09-13T18:33:06.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.807+0000 7fe2cffff700 1 -- 172.21.15.44:0/3999121933 wait complete. 2024-09-13T18:33:06.816 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:33:06.831 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:33:06.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe552ded700 1 Processor -- start 2024-09-13T18:33:06.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe552ded700 1 -- start start 2024-09-13T18:33:06.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe552ded700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe54c0ce710 0x7fe54c0b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:06.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe552ded700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe54c160d90 0x7fe54c1611a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:06.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe552ded700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe54c06aa30 con 0x7fe54c0ceaf0 2024-09-13T18:33:06.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe552ded700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe54c0d0660 con 0x7fe54c0ce710 2024-09-13T18:33:06.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe552ded700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe54c0b1e60 con 0x7fe54c160d90 2024-09-13T18:33:06.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe551deb700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe54c0ce710 0x7fe54c0b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:06.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe551deb700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe54c0ce710 0x7fe54c0b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39092/0 (socket says 172.21.15.44:39092) 2024-09-13T18:33:06.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe551deb700 1 -- 172.21.15.44:0/2693026025 learned_addr learned my addr 172.21.15.44:0/2693026025 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:06.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe5525ec700 1 --2- 172.21.15.44:0/2693026025 >> v2:172.21.15.99:3300/0 conn(0x7fe54c160d90 0x7fe54c1611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:06.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe551deb700 1 -- 172.21.15.44:0/2693026025 >> v2:172.21.15.99:3300/0 conn(0x7fe54c160d90 msgr2=0x7fe54c1611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:06.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe551deb700 1 --2- 172.21.15.44:0/2693026025 >> v2:172.21.15.99:3300/0 conn(0x7fe54c160d90 0x7fe54c1611a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:06.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe551deb700 1 -- 172.21.15.44:0/2693026025 >> v1:172.21.15.99:6789/0 conn(0x7fe54c0ceaf0 legacy=0x7fe54c0cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:06.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe551deb700 1 -- 172.21.15.44:0/2693026025 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54c0b18a0 con 0x7fe54c0ce710 2024-09-13T18:33:06.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe551deb700 1 --2- 172.21.15.44:0/2693026025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe54c0ce710 0x7fe54c0b5da0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0b8da0 tx=0x7fe53c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286643ef8253de78 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:06.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe550de9700 1 -- 172.21.15.44:0/2693026025 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c00b8a0 con 0x7fe54c0ce710 2024-09-13T18:33:06.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe550de9700 1 -- 172.21.15.44:0/2693026025 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53c00ba00 con 0x7fe54c0ce710 2024-09-13T18:33:06.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe550de9700 1 -- 172.21.15.44:0/2693026025 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c00bd90 con 0x7fe54c0ce710 2024-09-13T18:33:06.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe552ded700 1 -- 172.21.15.44:0/2693026025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe54c0ce710 msgr2=0x7fe54c0b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:06.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe552ded700 1 --2- 172.21.15.44:0/2693026025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe54c0ce710 0x7fe54c0b5da0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0b8da0 tx=0x7fe53c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:33:06.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe552ded700 1 -- 172.21.15.44:0/2693026025 shutdown_connections 2024-09-13T18:33:06.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe552ded700 1 --2- 172.21.15.44:0/2693026025 >> v2:172.21.15.99:3300/0 conn(0x7fe54c160d90 0x7fe54c1611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:06.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe552ded700 1 --2- 172.21.15.44:0/2693026025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe54c0ce710 0x7fe54c0b5da0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:06.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe552ded700 1 -- 172.21.15.44:0/2693026025 >> 172.21.15.44:0/2693026025 conn(0x7fe54c0d3260 msgr2=0x7fe54c0cf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:06.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.951+0000 7fe552ded700 1 -- 172.21.15.44:0/2693026025 shutdown_connections 2024-09-13T18:33:06.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.955+0000 7fe552ded700 1 -- 172.21.15.44:0/2693026025 wait complete. 2024-09-13T18:33:06.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.955+0000 7fe552ded700 1 Processor -- start 2024-09-13T18:33:06.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.955+0000 7fe552ded700 1 -- start start 2024-09-13T18:33:06.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe552ded700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe54c0ce710 0x7fe54c1556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:06.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe552ded700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe54c0ceaf0 0x7fe54c0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:06.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe552ded700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe54c160d90 0x7fe54c15a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:06.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe552ded700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c0c9d00 con 0x7fe54c0ce710 2024-09-13T18:33:06.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe552ded700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c15aae0 con 0x7fe54c0ceaf0 2024-09-13T18:33:06.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe552ded700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c0c9f50 con 0x7fe54c160d90 2024-09-13T18:33:06.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe551deb700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe54c0ce710 0x7fe54c1556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:06.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe551deb700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe54c0ce710 0x7fe54c1556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39094/0 (socket says 172.21.15.44:39094) 2024-09-13T18:33:06.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe551deb700 1 -- 172.21.15.44:0/3775030915 learned_addr learned my addr 172.21.15.44:0/3775030915 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:06.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe5515ea700 1 --2- 172.21.15.44:0/3775030915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe54c0ceaf0 0x7fe54c0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:06.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe5525ec700 1 --2- 172.21.15.44:0/3775030915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe54c160d90 0x7fe54c15a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:06.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe551deb700 1 -- 172.21.15.44:0/3775030915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe54c160d90 msgr2=0x7fe54c15a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:06.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe551deb700 1 --2- 172.21.15.44:0/3775030915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe54c160d90 0x7fe54c15a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:06.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe551deb700 1 -- 172.21.15.44:0/3775030915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe54c0ceaf0 msgr2=0x7fe54c0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:06.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe551deb700 1 --2- 172.21.15.44:0/3775030915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe54c0ceaf0 0x7fe54c0cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:06.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe551deb700 1 -- 172.21.15.44:0/3775030915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53c009570 con 0x7fe54c0ce710 2024-09-13T18:33:06.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe5515ea700 1 --2- 172.21.15.44:0/3775030915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe54c0ceaf0 0x7fe54c0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:06.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe551deb700 1 --2- 172.21.15.44:0/3775030915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe54c0ce710 0x7fe54c1556a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0d3b60 tx=0x7fe53c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:06.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe5427fc700 1 -- 172.21.15.44:0/3775030915 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c0038c0 con 0x7fe54c0ce710 2024-09-13T18:33:06.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe5427fc700 1 -- 172.21.15.44:0/3775030915 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53c01f070 con 0x7fe54c0ce710 2024-09-13T18:33:06.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe552ded700 1 -- 172.21.15.44:0/3775030915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe54c0ca230 con 0x7fe54c0ce710 2024-09-13T18:33:06.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe5427fc700 1 -- 172.21.15.44:0/3775030915 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c003c60 con 0x7fe54c0ce710 2024-09-13T18:33:06.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe552ded700 1 -- 172.21.15.44:0/3775030915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54c0cc930 con 0x7fe54c0ce710 2024-09-13T18:33:06.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.959+0000 7fe552ded700 1 -- 172.21.15.44:0/3775030915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe54c0ca750 con 0x7fe54c0ce710 2024-09-13T18:33:06.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.963+0000 7fe5427fc700 1 -- 172.21.15.44:0/3775030915 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe53c026480 con 0x7fe54c0ce710 2024-09-13T18:33:06.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.963+0000 7fe5427fc700 1 --2- 172.21.15.44:0/3775030915 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe530066730 0x7fe530068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:06.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.963+0000 7fe5427fc700 1 -- 172.21.15.44:0/3775030915 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5501+0+0 (secure 0 0 0) 0x7fe53c021070 con 0x7fe54c0ce710 2024-09-13T18:33:06.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.963+0000 7fe5515ea700 1 --2- 172.21.15.44:0/3775030915 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe530066730 0x7fe530068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:06.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.963+0000 7fe5515ea700 1 --2- 172.21.15.44:0/3775030915 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe530066730 0x7fe530068bf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe54c15b850 tx=0x7fe548009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:06.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:06.971+0000 7fe5427fc700 1 -- 172.21.15.44:0/3775030915 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe54c0ca750 con 0x7fe54c0ce710 2024-09-13T18:33:07.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.143+0000 7fe552ded700 1 -- 172.21.15.44:0/3775030915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe54c0b80a0 con 0x7fe54c0ce710 2024-09-13T18:33:07.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.811+0000 7fe5427fc700 1 -- 172.21.15.44:0/3775030915 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe53c053000 con 0x7fe54c0ce710 2024-09-13T18:33:07.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.815+0000 7fe552ded700 1 -- 172.21.15.44:0/3775030915 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe530066730 msgr2=0x7fe530068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:07.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.815+0000 7fe552ded700 1 --2- 172.21.15.44:0/3775030915 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe530066730 0x7fe530068bf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe54c15b850 tx=0x7fe548009040 comp rx=0 tx=0).stop 2024-09-13T18:33:07.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.815+0000 7fe552ded700 1 -- 172.21.15.44:0/3775030915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe54c0ce710 msgr2=0x7fe54c1556a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:07.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.815+0000 7fe552ded700 1 --2- 172.21.15.44:0/3775030915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe54c0ce710 0x7fe54c1556a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0d3b60 tx=0x7fe53c004770 comp rx=0 tx=0).stop 2024-09-13T18:33:07.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.815+0000 7fe552ded700 1 -- 172.21.15.44:0/3775030915 shutdown_connections 2024-09-13T18:33:07.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.815+0000 7fe552ded700 1 --2- 172.21.15.44:0/3775030915 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe530066730 0x7fe530068bf0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:07.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.815+0000 7fe552ded700 1 --2- 172.21.15.44:0/3775030915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe54c160d90 0x7fe54c15a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:07.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.815+0000 7fe552ded700 1 --2- 172.21.15.44:0/3775030915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe54c0ceaf0 0x7fe54c0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:07.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.815+0000 7fe552ded700 1 --2- 172.21.15.44:0/3775030915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe54c0ce710 0x7fe54c1556a0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:07.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.815+0000 7fe552ded700 1 -- 172.21.15.44:0/3775030915 >> 172.21.15.44:0/3775030915 conn(0x7fe54c0d3260 msgr2=0x7fe54c15e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:07.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.815+0000 7fe552ded700 1 -- 172.21.15.44:0/3775030915 shutdown_connections 2024-09-13T18:33:07.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.815+0000 7fe552ded700 1 -- 172.21.15.44:0/3775030915 wait complete. 2024-09-13T18:33:07.824 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2024-09-13T18:33:07.838 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:33:07.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.947+0000 7fda03e48700 1 Processor -- start 2024-09-13T18:33:07.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.947+0000 7fda03e48700 1 -- start start 2024-09-13T18:33:07.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.947+0000 7fda03e48700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd9fc15a940 0x7fd9fc06d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:07.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.947+0000 7fda03e48700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9fc06c950 con 0x7fd9fc06a310 2024-09-13T18:33:07.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.947+0000 7fda03e48700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9fc06cc30 con 0x7fd9fc1433e0 2024-09-13T18:33:07.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.947+0000 7fda03e48700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9fc15add0 con 0x7fd9fc15a940 2024-09-13T18:33:07.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.947+0000 7fda023e5700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd9fc15a940 0x7fd9fc06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:07.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.947+0000 7fda01be4700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd9fc06a310 0x7fd9fc06a6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44232/0 (socket says 172.21.15.44:44232) 2024-09-13T18:33:07.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.947+0000 7fda01be4700 1 -- 172.21.15.44:0/3648706048 learned_addr learned my addr 172.21.15.44:0/3648706048 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:07.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.947+0000 7fda023e5700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd9fc15a940 0x7fd9fc06d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39108/0 (socket says 172.21.15.44:39108) 2024-09-13T18:33:07.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.947+0000 7fda023e5700 1 -- 172.21.15.44:0/3648706048 >> v1:172.21.15.99:6789/0 conn(0x7fd9fc1433e0 legacy=0x7fd9fc15b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:07.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.947+0000 7fda023e5700 1 -- 172.21.15.44:0/3648706048 >> v1:172.21.15.44:6789/0 conn(0x7fd9fc06a310 legacy=0x7fd9fc06a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:07.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.947+0000 7fda023e5700 1 -- 172.21.15.44:0/3648706048 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc06cf10 con 0x7fd9fc15a940 2024-09-13T18:33:07.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.947+0000 7fda023e5700 1 --2- 172.21.15.44:0/3648706048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9fc15a940 0x7fd9fc06d710 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400bfa0 tx=0x7fd9f400d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2efec0edf285c03 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:07.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.947+0000 7fda00be2700 1 -- 172.21.15.44:0/3648706048 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4010070 con 0x7fd9fc15a940 2024-09-13T18:33:07.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.947+0000 7fda00be2700 1 -- 172.21.15.44:0/3648706048 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f400b2e0 con 0x7fd9fc15a940 2024-09-13T18:33:07.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.947+0000 7fda00be2700 1 -- 172.21.15.44:0/3648706048 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f400dcf0 con 0x7fd9fc15a940 2024-09-13T18:33:07.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.947+0000 7fda03e48700 1 -- 172.21.15.44:0/3648706048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9fc15a940 msgr2=0x7fd9fc06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:07.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.947+0000 7fda03e48700 1 --2- 172.21.15.44:0/3648706048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9fc15a940 0x7fd9fc06d710 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400bfa0 tx=0x7fd9f400d330 comp rx=0 tx=0).stop 2024-09-13T18:33:07.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.947+0000 7fda03e48700 1 -- 172.21.15.44:0/3648706048 shutdown_connections 2024-09-13T18:33:07.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.947+0000 7fda03e48700 1 --2- 172.21.15.44:0/3648706048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9fc15a940 0x7fd9fc06d710 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:07.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.947+0000 7fda03e48700 1 -- 172.21.15.44:0/3648706048 >> 172.21.15.44:0/3648706048 conn(0x7fd9fc0af620 msgr2=0x7fd9fc0afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:07.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.951+0000 7fda03e48700 1 -- 172.21.15.44:0/3648706048 shutdown_connections 2024-09-13T18:33:07.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.951+0000 7fda03e48700 1 -- 172.21.15.44:0/3648706048 wait complete. 2024-09-13T18:33:07.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.951+0000 7fda03e48700 1 Processor -- start 2024-09-13T18:33:07.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.951+0000 7fda03e48700 1 -- start start 2024-09-13T18:33:07.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.951+0000 7fda03e48700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd9fc06a310 0x7fd9fc1e7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:07.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.951+0000 7fda03e48700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9fc1433e0 0x7fd9fc158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:07.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.951+0000 7fda03e48700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9fc15a940 0x7fd9fc15ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:07.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.951+0000 7fda03e48700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc1e76b0 con 0x7fd9fc15a940 2024-09-13T18:33:07.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.951+0000 7fda03e48700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc1e6a30 con 0x7fd9fc1433e0 2024-09-13T18:33:07.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.951+0000 7fda03e48700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc1e6d10 con 0x7fd9fc06a310 2024-09-13T18:33:07.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.951+0000 7fda023e5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9fc15a940 0x7fd9fc15ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:07.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.951+0000 7fda013e3700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9fc1433e0 0x7fd9fc158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:07.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.951+0000 7fda01be4700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd9fc06a310 0x7fd9fc1e7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:07.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.951+0000 7fda023e5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9fc15a940 0x7fd9fc15ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39118/0 (socket says 172.21.15.44:39118) 2024-09-13T18:33:07.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.951+0000 7fda013e3700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9fc1433e0 0x7fd9fc158060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:47120/0 (socket says 172.21.15.44:47120) 2024-09-13T18:33:07.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.951+0000 7fda023e5700 1 -- 172.21.15.44:0/1036795943 learned_addr learned my addr 172.21.15.44:0/1036795943 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:07.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.955+0000 7fda023e5700 1 -- 172.21.15.44:0/1036795943 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd9fc06a310 msgr2=0x7fd9fc1e7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:07.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.955+0000 7fda023e5700 1 --2- 172.21.15.44:0/1036795943 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd9fc06a310 0x7fd9fc1e7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:07.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.955+0000 7fda023e5700 1 -- 172.21.15.44:0/1036795943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9fc1433e0 msgr2=0x7fd9fc158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:07.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.955+0000 7fda023e5700 1 --2- 172.21.15.44:0/1036795943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9fc1433e0 0x7fd9fc158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:07.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.955+0000 7fda023e5700 1 -- 172.21.15.44:0/1036795943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f400bc80 con 0x7fd9fc15a940 2024-09-13T18:33:07.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.955+0000 7fda013e3700 1 --2- 172.21.15.44:0/1036795943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9fc1433e0 0x7fd9fc158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:33:07.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.955+0000 7fda01be4700 1 --2- 172.21.15.44:0/1036795943 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd9fc06a310 0x7fd9fc1e7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:33:07.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.955+0000 7fda023e5700 1 --2- 172.21.15.44:0/1036795943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9fc15a940 0x7fd9fc15ccc0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0b16b0 tx=0x7fd9f4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:07.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.955+0000 7fd9f27fc700 1 -- 172.21.15.44:0/1036795943 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f400dea0 con 0x7fd9fc15a940 2024-09-13T18:33:07.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.955+0000 7fd9f27fc700 1 -- 172.21.15.44:0/1036795943 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f400ad30 con 0x7fd9fc15a940 2024-09-13T18:33:07.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.955+0000 7fd9f27fc700 1 -- 172.21.15.44:0/1036795943 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f400aea0 con 0x7fd9fc15a940 2024-09-13T18:33:07.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.955+0000 7fda03e48700 1 -- 172.21.15.44:0/1036795943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9fc1e6ff0 con 0x7fd9fc15a940 2024-09-13T18:33:07.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.955+0000 7fda03e48700 1 -- 172.21.15.44:0/1036795943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9fc15d200 con 0x7fd9fc15a940 2024-09-13T18:33:07.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.955+0000 7fda03e48700 1 -- 172.21.15.44:0/1036795943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9fc06a6f0 con 0x7fd9fc15a940 2024-09-13T18:33:07.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.959+0000 7fd9f27fc700 1 -- 172.21.15.44:0/1036795943 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd9f4009070 con 0x7fd9fc15a940 2024-09-13T18:33:07.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.959+0000 7fd9f27fc700 1 --2- 172.21.15.44:0/1036795943 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd9e0066730 0x7fd9e0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:07.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.959+0000 7fd9f27fc700 1 -- 172.21.15.44:0/1036795943 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd9f4085020 con 0x7fd9fc15a940 2024-09-13T18:33:07.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.959+0000 7fda01be4700 1 --2- 172.21.15.44:0/1036795943 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd9e0066730 0x7fd9e0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:07.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.959+0000 7fda01be4700 1 --2- 172.21.15.44:0/1036795943 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd9e0066730 0x7fd9e0068bf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8005930 tx=0x7fd9f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:07.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:07.967+0000 7fd9f27fc700 1 -- 172.21.15.44:0/1036795943 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd9f40526c0 con 0x7fd9fc15a940 2024-09-13T18:33:08.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.151+0000 7fda03e48700 1 -- 172.21.15.44:0/1036795943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd9fc0b4970 con 0x7fd9fc15a940 2024-09-13T18:33:08.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.155+0000 7fd9f27fc700 1 -- 172.21.15.44:0/1036795943 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd9f4055ce0 con 0x7fd9fc15a940 2024-09-13T18:33:08.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.155+0000 7fda03e48700 1 -- 172.21.15.44:0/1036795943 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd9e0066730 msgr2=0x7fd9e0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:08.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.155+0000 7fda03e48700 1 --2- 172.21.15.44:0/1036795943 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd9e0066730 0x7fd9e0068bf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8005930 tx=0x7fd9f8009040 comp rx=0 tx=0).stop 2024-09-13T18:33:08.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.155+0000 7fda03e48700 1 -- 172.21.15.44:0/1036795943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9fc15a940 msgr2=0x7fd9fc15ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:08.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.155+0000 7fda03e48700 1 --2- 172.21.15.44:0/1036795943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9fc15a940 0x7fd9fc15ccc0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0b16b0 tx=0x7fd9f4004af0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.155+0000 7fda03e48700 1 -- 172.21.15.44:0/1036795943 shutdown_connections 2024-09-13T18:33:08.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.155+0000 7fda03e48700 1 --2- 172.21.15.44:0/1036795943 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd9e0066730 0x7fd9e0068bf0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.155+0000 7fda03e48700 1 --2- 172.21.15.44:0/1036795943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9fc15a940 0x7fd9fc15ccc0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.155+0000 7fda03e48700 1 --2- 172.21.15.44:0/1036795943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9fc1433e0 0x7fd9fc158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.155+0000 7fda03e48700 1 --2- 172.21.15.44:0/1036795943 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd9fc06a310 0x7fd9fc1e7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.155+0000 7fda03e48700 1 -- 172.21.15.44:0/1036795943 >> 172.21.15.44:0/1036795943 conn(0x7fd9fc0af620 msgr2=0x7fd9fc071030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:08.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.155+0000 7fda03e48700 1 -- 172.21.15.44:0/1036795943 shutdown_connections 2024-09-13T18:33:08.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.155+0000 7fda03e48700 1 -- 172.21.15.44:0/1036795943 wait complete. 2024-09-13T18:33:08.176 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke' 2024-09-13T18:33:08.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.279+0000 7f4d6653b700 1 Processor -- start 2024-09-13T18:33:08.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.279+0000 7f4d6653b700 1 -- start start 2024-09-13T18:33:08.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.279+0000 7f4d6653b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4d60071810 0x7f4d60071c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:08.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.279+0000 7f4d6653b700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d600cc860 con 0x7f4d600b33d0 2024-09-13T18:33:08.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.279+0000 7f4d6653b700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d600ce0e0 con 0x7f4d600cb130 2024-09-13T18:33:08.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.279+0000 7f4d6653b700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d600713f0 con 0x7f4d60071810 2024-09-13T18:33:08.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.279+0000 7f4d65d3a700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4d600b33d0 0x7f4d600cbc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44242/0 (socket says 172.21.15.44:44242) 2024-09-13T18:33:08.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.279+0000 7f4d65d3a700 1 -- 172.21.15.44:0/2313454857 learned_addr learned my addr 172.21.15.44:0/2313454857 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:08.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.279+0000 7f4d64d38700 1 --2- 172.21.15.44:0/2313454857 >> v2:172.21.15.44:3300/0 conn(0x7f4d60071810 0x7f4d60071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:08.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.279+0000 7f4d64d38700 1 -- 172.21.15.44:0/2313454857 >> v1:172.21.15.99:6789/0 conn(0x7f4d600cb130 legacy=0x7f4d6015d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:08.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.279+0000 7f4d64d38700 1 -- 172.21.15.44:0/2313454857 >> v1:172.21.15.44:6789/0 conn(0x7f4d600b33d0 legacy=0x7f4d600cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:08.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.279+0000 7f4d64d38700 1 -- 172.21.15.44:0/2313454857 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d600cb510 con 0x7f4d60071810 2024-09-13T18:33:08.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.279+0000 7f4d53fff700 1 -- 172.21.15.44:0/2313454857 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130717102 0 0) 0x7f4d600cc860 con 0x7f4d600b33d0 2024-09-13T18:33:08.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.283+0000 7f4d64d38700 1 --2- 172.21.15.44:0/2313454857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d60071810 0x7f4d60071c80 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f4d54009850 tx=0x7f4d54009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1476a431a0512173 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:08.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.283+0000 7f4d53fff700 1 -- 172.21.15.44:0/2313454857 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d54011830 con 0x7f4d60071810 2024-09-13T18:33:08.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.283+0000 7f4d53fff700 1 -- 172.21.15.44:0/2313454857 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d54011990 con 0x7f4d60071810 2024-09-13T18:33:08.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.283+0000 7f4d53fff700 1 -- 172.21.15.44:0/2313454857 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d54011d20 con 0x7f4d60071810 2024-09-13T18:33:08.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.283+0000 7f4d6653b700 1 -- 172.21.15.44:0/2313454857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d60071810 msgr2=0x7f4d60071c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:08.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.283+0000 7f4d6653b700 1 --2- 172.21.15.44:0/2313454857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d60071810 0x7f4d60071c80 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f4d54009850 tx=0x7f4d54009b60 comp rx=0 tx=0).stop 2024-09-13T18:33:08.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.283+0000 7f4d6653b700 1 -- 172.21.15.44:0/2313454857 shutdown_connections 2024-09-13T18:33:08.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.283+0000 7f4d6653b700 1 --2- 172.21.15.44:0/2313454857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d60071810 0x7f4d60071c80 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.283+0000 7f4d6653b700 1 -- 172.21.15.44:0/2313454857 >> 172.21.15.44:0/2313454857 conn(0x7f4d600b0f00 msgr2=0x7f4d600b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:08.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.283+0000 7f4d6653b700 1 -- 172.21.15.44:0/2313454857 shutdown_connections 2024-09-13T18:33:08.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.283+0000 7f4d6653b700 1 -- 172.21.15.44:0/2313454857 wait complete. 2024-09-13T18:33:08.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.283+0000 7f4d6653b700 1 Processor -- start 2024-09-13T18:33:08.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.283+0000 7f4d6653b700 1 -- start start 2024-09-13T18:33:08.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.287+0000 7f4d6653b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d60071810 0x7f4d60144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:08.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.287+0000 7f4d6653b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d600b33d0 0x7f4d600c3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:08.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.287+0000 7f4d6653b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d600cb130 0x7f4d601e8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:08.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.287+0000 7f4d6653b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d600c3dd0 con 0x7f4d60071810 2024-09-13T18:33:08.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.287+0000 7f4d6653b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6006bde0 con 0x7f4d600b33d0 2024-09-13T18:33:08.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.287+0000 7f4d6653b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6006c0c0 con 0x7f4d600cb130 2024-09-13T18:33:08.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.287+0000 7f4d65539700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d60071810 0x7f4d60144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:08.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.287+0000 7f4d65539700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d60071810 0x7f4d60144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39136/0 (socket says 172.21.15.44:39136) 2024-09-13T18:33:08.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.287+0000 7f4d65539700 1 -- 172.21.15.44:0/109728471 learned_addr learned my addr 172.21.15.44:0/109728471 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:08.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.287+0000 7f4d65d3a700 1 --2- 172.21.15.44:0/109728471 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d600cb130 0x7f4d601e8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:08.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.287+0000 7f4d64d38700 1 --2- 172.21.15.44:0/109728471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d600b33d0 0x7f4d600c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:08.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.287+0000 7f4d65539700 1 -- 172.21.15.44:0/109728471 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d600cb130 msgr2=0x7f4d601e8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:08.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.287+0000 7f4d65539700 1 --2- 172.21.15.44:0/109728471 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d600cb130 0x7f4d601e8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.287+0000 7f4d65539700 1 -- 172.21.15.44:0/109728471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d600b33d0 msgr2=0x7f4d600c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:08.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.287+0000 7f4d65539700 1 --2- 172.21.15.44:0/109728471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d600b33d0 0x7f4d600c3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.287+0000 7f4d65539700 1 -- 172.21.15.44:0/109728471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d540094b0 con 0x7f4d60071810 2024-09-13T18:33:08.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.287+0000 7f4d65539700 1 --2- 172.21.15.44:0/109728471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d60071810 0x7f4d60144670 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00c500 tx=0x7f4d5c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:08.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.287+0000 7f4d51ffb700 1 -- 172.21.15.44:0/109728471 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c0052d0 con 0x7f4d60071810 2024-09-13T18:33:08.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.287+0000 7f4d6653b700 1 -- 172.21.15.44:0/109728471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6006c3a0 con 0x7f4d60071810 2024-09-13T18:33:08.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.287+0000 7f4d51ffb700 1 -- 172.21.15.44:0/109728471 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5c005430 con 0x7f4d60071810 2024-09-13T18:33:08.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.287+0000 7f4d51ffb700 1 -- 172.21.15.44:0/109728471 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c0055a0 con 0x7f4d60071810 2024-09-13T18:33:08.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.287+0000 7f4d6653b700 1 -- 172.21.15.44:0/109728471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6006c960 con 0x7f4d60071810 2024-09-13T18:33:08.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.287+0000 7f4d6653b700 1 -- 172.21.15.44:0/109728471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6006cb50 con 0x7f4d60071810 2024-09-13T18:33:08.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.291+0000 7f4d51ffb700 1 -- 172.21.15.44:0/109728471 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4d5c0038e0 con 0x7f4d60071810 2024-09-13T18:33:08.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.291+0000 7f4d51ffb700 1 --2- 172.21.15.44:0/109728471 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4d44066730 0x7f4d44068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:08.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.291+0000 7f4d51ffb700 1 -- 172.21.15.44:0/109728471 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4d5c0831d0 con 0x7f4d60071810 2024-09-13T18:33:08.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.291+0000 7f4d64d38700 1 --2- 172.21.15.44:0/109728471 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4d44066730 0x7f4d44068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:08.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.291+0000 7f4d64d38700 1 --2- 172.21.15.44:0/109728471 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4d44066730 0x7f4d44068bf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4d540090b0 tx=0x7f4d54008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:08.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.299+0000 7f4d51ffb700 1 -- 172.21.15.44:0/109728471 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4d5c0507f0 con 0x7f4d60071810 2024-09-13T18:33:08.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.535+0000 7f4d6653b700 1 -- 172.21.15.44:0/109728471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke"]} v 0) v1 -- 0x7f4d600ce0e0 con 0x7f4d60071810 2024-09-13T18:33:08.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.823+0000 7f4d51ffb700 1 -- 172.21.15.44:0/109728471 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke"]}]=0 v274) v1 ==== 148+0+0 (secure 0 0 0) 0x7f4d600ce0e0 con 0x7f4d60071810 2024-09-13T18:33:08.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.827+0000 7f4d6653b700 1 -- 172.21.15.44:0/109728471 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4d44066730 msgr2=0x7f4d44068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:08.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.827+0000 7f4d6653b700 1 --2- 172.21.15.44:0/109728471 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4d44066730 0x7f4d44068bf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4d540090b0 tx=0x7f4d54008030 comp rx=0 tx=0).stop 2024-09-13T18:33:08.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.827+0000 7f4d6653b700 1 -- 172.21.15.44:0/109728471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d60071810 msgr2=0x7f4d60144670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:08.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.827+0000 7f4d6653b700 1 --2- 172.21.15.44:0/109728471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d60071810 0x7f4d60144670 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00c500 tx=0x7f4d5c00c8c0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.827+0000 7f4d6653b700 1 -- 172.21.15.44:0/109728471 shutdown_connections 2024-09-13T18:33:08.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.827+0000 7f4d6653b700 1 --2- 172.21.15.44:0/109728471 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4d44066730 0x7f4d44068bf0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.827+0000 7f4d6653b700 1 --2- 172.21.15.44:0/109728471 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d600cb130 0x7f4d601e8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.827+0000 7f4d6653b700 1 --2- 172.21.15.44:0/109728471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d600b33d0 0x7f4d600c3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.827+0000 7f4d6653b700 1 --2- 172.21.15.44:0/109728471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d60071810 0x7f4d60144670 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.827+0000 7f4d6653b700 1 -- 172.21.15.44:0/109728471 >> 172.21.15.44:0/109728471 conn(0x7f4d600b0f00 msgr2=0x7f4d600afde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:08.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.827+0000 7f4d6653b700 1 -- 172.21.15.44:0/109728471 shutdown_connections 2024-09-13T18:33:08.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.827+0000 7f4d6653b700 1 -- 172.21.15.44:0/109728471 wait complete. 2024-09-13T18:33:08.852 INFO:tasks.cephfs_test_runner:test_journal_smoke (tasks.cephfs.test_journal_repair.TestJournalRepair) ... ok 2024-09-13T18:33:08.852 INFO:tasks.cephfs_test_runner:Starting test: test_reset (tasks.cephfs.test_journal_repair.TestJournalRepair) That after forcibly modifying the backing store, we can get back into 2024-09-13T18:33:08.852 INFO:tasks.cephfs_test_runner:test_reset (tasks.cephfs.test_journal_repair.TestJournalRepair) 2024-09-13T18:33:08.853 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:08.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.967+0000 7f7e3e356700 1 Processor -- start 2024-09-13T18:33:08.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.967+0000 7f7e3e356700 1 -- start start 2024-09-13T18:33:08.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.967+0000 7f7e3e356700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7e380b3ae0 0x7f7e38165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:08.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.967+0000 7f7e3e356700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e38161290 0x7f7e38161700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:08.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.967+0000 7f7e3e356700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e38071f30 con 0x7f7e38160eb0 2024-09-13T18:33:08.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.967+0000 7f7e3e356700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e381622e0 con 0x7f7e380b3ae0 2024-09-13T18:33:08.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.967+0000 7f7e3e356700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e38162000 con 0x7f7e38161290 2024-09-13T18:33:08.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.967+0000 7f7e3cb53700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7e380b3ae0 0x7f7e38165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:08.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.967+0000 7f7e3cb53700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7e380b3ae0 0x7f7e38165590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39150/0 (socket says 172.21.15.44:39150) 2024-09-13T18:33:08.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.967+0000 7f7e3cb53700 1 -- 172.21.15.44:0/663309336 learned_addr learned my addr 172.21.15.44:0/663309336 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:08.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.967+0000 7f7e3cb53700 1 -- 172.21.15.44:0/663309336 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e38161290 msgr2=0x7f7e38161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:08.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.967+0000 7f7e3db55700 1 --2- 172.21.15.44:0/663309336 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e38161290 0x7f7e38161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.967+0000 7f7e3cb53700 1 --2- 172.21.15.44:0/663309336 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e38161290 0x7f7e38161700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.967+0000 7f7e3cb53700 1 -- 172.21.15.44:0/663309336 >> v1:172.21.15.99:6789/0 conn(0x7f7e38160eb0 legacy=0x7f7e380b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.967+0000 7f7e3cb53700 1 -- 172.21.15.44:0/663309336 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e38164ab0 con 0x7f7e380b3ae0 2024-09-13T18:33:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.967+0000 7f7e3db55700 1 --2- 172.21.15.44:0/663309336 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e38161290 0x7f7e38161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.967+0000 7f7e3cb53700 1 --2- 172.21.15.44:0/663309336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e380b3ae0 0x7f7e38165590 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009e50 tx=0x7f7e3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e586106ff38e7c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.967+0000 7f7e2ffff700 1 -- 172.21.15.44:0/663309336 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3400e070 con 0x7f7e380b3ae0 2024-09-13T18:33:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.971+0000 7f7e2ffff700 1 -- 172.21.15.44:0/663309336 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3400b9c0 con 0x7f7e380b3ae0 2024-09-13T18:33:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.971+0000 7f7e2ffff700 1 -- 172.21.15.44:0/663309336 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3400bd70 con 0x7f7e380b3ae0 2024-09-13T18:33:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.971+0000 7f7e3e356700 1 -- 172.21.15.44:0/663309336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e380b3ae0 msgr2=0x7f7e38165590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.971+0000 7f7e3e356700 1 --2- 172.21.15.44:0/663309336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e380b3ae0 0x7f7e38165590 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009e50 tx=0x7f7e3400b330 comp rx=0 tx=0).stop 2024-09-13T18:33:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.971+0000 7f7e3e356700 1 -- 172.21.15.44:0/663309336 shutdown_connections 2024-09-13T18:33:08.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.971+0000 7f7e3e356700 1 --2- 172.21.15.44:0/663309336 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e38161290 0x7f7e38161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.971+0000 7f7e3e356700 1 --2- 172.21.15.44:0/663309336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e380b3ae0 0x7f7e38165590 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.971+0000 7f7e3e356700 1 -- 172.21.15.44:0/663309336 >> 172.21.15.44:0/663309336 conn(0x7f7e380b0f00 msgr2=0x7f7e380b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:08.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.971+0000 7f7e3e356700 1 -- 172.21.15.44:0/663309336 shutdown_connections 2024-09-13T18:33:08.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.971+0000 7f7e3e356700 1 -- 172.21.15.44:0/663309336 wait complete. 2024-09-13T18:33:08.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.971+0000 7f7e3e356700 1 Processor -- start 2024-09-13T18:33:08.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.971+0000 7f7e3e356700 1 -- start start 2024-09-13T18:33:08.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.971+0000 7f7e3e356700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e380b3ae0 0x7f7e3815a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:08.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.971+0000 7f7e3e356700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e38160eb0 0x7f7e38156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:08.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.971+0000 7f7e3e356700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e38161290 0x7f7e3815bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:08.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.971+0000 7f7e3e356700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e38157110 con 0x7f7e38161290 2024-09-13T18:33:08.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.971+0000 7f7e3e356700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3815e810 con 0x7f7e38160eb0 2024-09-13T18:33:08.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.971+0000 7f7e3e356700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e38158c00 con 0x7f7e380b3ae0 2024-09-13T18:33:08.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.971+0000 7f7e3db55700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e38161290 0x7f7e3815bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:08.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.975+0000 7f7e3db55700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e38161290 0x7f7e3815bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39158/0 (socket says 172.21.15.44:39158) 2024-09-13T18:33:08.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.975+0000 7f7e3db55700 1 -- 172.21.15.44:0/2056544345 learned_addr learned my addr 172.21.15.44:0/2056544345 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:08.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.975+0000 7f7e3cb53700 1 --2- 172.21.15.44:0/2056544345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e38160eb0 0x7f7e38156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:08.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.975+0000 7f7e3d354700 1 --2- 172.21.15.44:0/2056544345 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e380b3ae0 0x7f7e3815a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:08.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.975+0000 7f7e3db55700 1 -- 172.21.15.44:0/2056544345 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e380b3ae0 msgr2=0x7f7e3815a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:08.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.975+0000 7f7e3db55700 1 --2- 172.21.15.44:0/2056544345 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e380b3ae0 0x7f7e3815a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.975+0000 7f7e3db55700 1 -- 172.21.15.44:0/2056544345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e38160eb0 msgr2=0x7f7e38156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:08.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.975+0000 7f7e3db55700 1 --2- 172.21.15.44:0/2056544345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e38160eb0 0x7f7e38156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.975+0000 7f7e3db55700 1 -- 172.21.15.44:0/2056544345 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e34009b30 con 0x7f7e38161290 2024-09-13T18:33:08.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.975+0000 7f7e3db55700 1 --2- 172.21.15.44:0/2056544345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e38161290 0x7f7e3815bbc0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000c820 tx=0x7f7e3000cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:08.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.975+0000 7f7e2dffb700 1 -- 172.21.15.44:0/2056544345 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30011800 con 0x7f7e38161290 2024-09-13T18:33:08.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.975+0000 7f7e2dffb700 1 -- 172.21.15.44:0/2056544345 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e30011980 con 0x7f7e38161290 2024-09-13T18:33:08.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.975+0000 7f7e3e356700 1 -- 172.21.15.44:0/2056544345 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e3815c100 con 0x7f7e38161290 2024-09-13T18:33:08.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.975+0000 7f7e2dffb700 1 -- 172.21.15.44:0/2056544345 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30011d30 con 0x7f7e38161290 2024-09-13T18:33:08.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.975+0000 7f7e3e356700 1 -- 172.21.15.44:0/2056544345 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3815c680 con 0x7f7e38161290 2024-09-13T18:33:08.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.975+0000 7f7e3e356700 1 -- 172.21.15.44:0/2056544345 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e38071580 con 0x7f7e38161290 2024-09-13T18:33:08.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.979+0000 7f7e2dffb700 1 -- 172.21.15.44:0/2056544345 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7e30022350 con 0x7f7e38161290 2024-09-13T18:33:08.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.979+0000 7f7e2dffb700 1 --2- 172.21.15.44:0/2056544345 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e1c066730 0x7f7e1c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:08.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.979+0000 7f7e2dffb700 1 -- 172.21.15.44:0/2056544345 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7e30083d10 con 0x7f7e38161290 2024-09-13T18:33:08.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.979+0000 7f7e3d354700 1 --2- 172.21.15.44:0/2056544345 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e1c066730 0x7f7e1c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:08.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.979+0000 7f7e3d354700 1 --2- 172.21.15.44:0/2056544345 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e1c066730 0x7f7e1c068bf0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7e280018a0 tx=0x7f7e28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:08.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:08.983+0000 7f7e2dffb700 1 -- 172.21.15.44:0/2056544345 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7e30051320 con 0x7f7e38161290 2024-09-13T18:33:09.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.159+0000 7f7e3e356700 1 -- 172.21.15.44:0/2056544345 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e38165590 con 0x7f7e38161290 2024-09-13T18:33:09.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.159+0000 7f7e2dffb700 1 -- 172.21.15.44:0/2056544345 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+13056 (secure 0 0 0) 0x7f7e30054940 con 0x7f7e38161290 2024-09-13T18:33:09.167 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:33:09.168 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":54,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:33:07.800536+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6833/3567136594":"2024-09-14T18:33:04.712277+0000","172.21.15.44:6832/3567136594":"2024-09-14T18:33:04.712277+0000","172.21.15.44:6835/3200882245":"2024-09-14T18:30:35.073090+0000","172.21.15.44:6834/3200882245":"2024-09-14T18:30:35.073090+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:09.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.163+0000 7f7e3e356700 1 -- 172.21.15.44:0/2056544345 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e1c066730 msgr2=0x7f7e1c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:09.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.163+0000 7f7e3e356700 1 --2- 172.21.15.44:0/2056544345 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e1c066730 0x7f7e1c068bf0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7e280018a0 tx=0x7f7e28009040 comp rx=0 tx=0).stop 2024-09-13T18:33:09.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.163+0000 7f7e3e356700 1 -- 172.21.15.44:0/2056544345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e38161290 msgr2=0x7f7e3815bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:09.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.163+0000 7f7e3e356700 1 --2- 172.21.15.44:0/2056544345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e38161290 0x7f7e3815bbc0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000c820 tx=0x7f7e3000cb30 comp rx=0 tx=0).stop 2024-09-13T18:33:09.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.163+0000 7f7e3e356700 1 -- 172.21.15.44:0/2056544345 shutdown_connections 2024-09-13T18:33:09.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.163+0000 7f7e3e356700 1 --2- 172.21.15.44:0/2056544345 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e1c066730 0x7f7e1c068bf0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.163+0000 7f7e3e356700 1 --2- 172.21.15.44:0/2056544345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e38161290 0x7f7e3815bbc0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.163+0000 7f7e3e356700 1 --2- 172.21.15.44:0/2056544345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e38160eb0 0x7f7e38156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.163+0000 7f7e3e356700 1 --2- 172.21.15.44:0/2056544345 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e380b3ae0 0x7f7e3815a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.163+0000 7f7e3e356700 1 -- 172.21.15.44:0/2056544345 >> 172.21.15.44:0/2056544345 conn(0x7f7e380b0f00 msgr2=0x7f7e38162da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:09.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.163+0000 7f7e3e356700 1 -- 172.21.15.44:0/2056544345 shutdown_connections 2024-09-13T18:33:09.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.163+0000 7f7e3e356700 1 -- 172.21.15.44:0/2056544345 wait complete. 2024-09-13T18:33:09.183 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:33:09.183 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:33:09.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.303+0000 7f6ffea8d700 1 Processor -- start 2024-09-13T18:33:09.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.303+0000 7f6ffea8d700 1 -- start start 2024-09-13T18:33:09.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.303+0000 7f6ffea8d700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6ff815d0c0 0x7f6ff80cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.303+0000 7f6ffea8d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6ff80ce640 0x7f6ff80cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.303+0000 7f6ffea8d700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff80cefc0 con 0x7f6ff80b5f70 2024-09-13T18:33:09.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.303+0000 7f6ffea8d700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff80b21f0 con 0x7f6ff80ce640 2024-09-13T18:33:09.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.303+0000 7f6ffea8d700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff80d1780 con 0x7f6ff815d0c0 2024-09-13T18:33:09.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.303+0000 7f6feffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6ff80ce640 0x7f6ff80cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.303+0000 7f6feffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6ff80ce640 0x7f6ff80cea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39162/0 (socket says 172.21.15.44:39162) 2024-09-13T18:33:09.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.303+0000 7f6feffff700 1 -- 172.21.15.44:0/2773156970 learned_addr learned my addr 172.21.15.44:0/2773156970 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:09.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.303+0000 7f6ffc829700 1 --2- 172.21.15.44:0/2773156970 >> v2:172.21.15.99:3300/0 conn(0x7f6ff815d0c0 0x7f6ff80cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.303+0000 7f6feffff700 1 -- 172.21.15.44:0/2773156970 >> v2:172.21.15.99:3300/0 conn(0x7f6ff815d0c0 msgr2=0x7f6ff80cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:09.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.303+0000 7f6feffff700 1 --2- 172.21.15.44:0/2773156970 >> v2:172.21.15.99:3300/0 conn(0x7f6ff815d0c0 0x7f6ff80cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.303+0000 7f6feffff700 1 -- 172.21.15.44:0/2773156970 >> v1:172.21.15.99:6789/0 conn(0x7f6ff80b5f70 legacy=0x7f6ff80b63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:09.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.303+0000 7f6feffff700 1 -- 172.21.15.44:0/2773156970 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff80d1a60 con 0x7f6ff80ce640 2024-09-13T18:33:09.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.303+0000 7f6feffff700 1 --2- 172.21.15.44:0/2773156970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ff80ce640 0x7f6ff80cea80 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80cd590 tx=0x7f6fe8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9aaad7ae21ed1c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:09.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6fef7fe700 1 -- 172.21.15.44:0/2773156970 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8005e50 con 0x7f6ff80ce640 2024-09-13T18:33:09.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6fef7fe700 1 -- 172.21.15.44:0/2773156970 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe8006030 con 0x7f6ff80ce640 2024-09-13T18:33:09.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6fef7fe700 1 -- 172.21.15.44:0/2773156970 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe80063c0 con 0x7f6ff80ce640 2024-09-13T18:33:09.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffea8d700 1 -- 172.21.15.44:0/2773156970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ff80ce640 msgr2=0x7f6ff80cea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:09.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffea8d700 1 --2- 172.21.15.44:0/2773156970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ff80ce640 0x7f6ff80cea80 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80cd590 tx=0x7f6fe8009bf0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffea8d700 1 -- 172.21.15.44:0/2773156970 shutdown_connections 2024-09-13T18:33:09.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffea8d700 1 --2- 172.21.15.44:0/2773156970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ff80ce640 0x7f6ff80cea80 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffea8d700 1 --2- 172.21.15.44:0/2773156970 >> v2:172.21.15.99:3300/0 conn(0x7f6ff815d0c0 0x7f6ff80cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffea8d700 1 -- 172.21.15.44:0/2773156970 >> 172.21.15.44:0/2773156970 conn(0x7f6ff80d2d40 msgr2=0x7f6ff80d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:09.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffea8d700 1 -- 172.21.15.44:0/2773156970 shutdown_connections 2024-09-13T18:33:09.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffea8d700 1 -- 172.21.15.44:0/2773156970 wait complete. 2024-09-13T18:33:09.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffea8d700 1 Processor -- start 2024-09-13T18:33:09.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffea8d700 1 -- start start 2024-09-13T18:33:09.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffea8d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ff80b5f70 0x7f6ff80c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffea8d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ff80ce640 0x7f6ff8153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffea8d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ff815d0c0 0x7f6ff80cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffea8d700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff80cbaf0 con 0x7f6ff815d0c0 2024-09-13T18:33:09.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffea8d700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff80cbdd0 con 0x7f6ff80ce640 2024-09-13T18:33:09.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffea8d700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff80cc0b0 con 0x7f6ff80b5f70 2024-09-13T18:33:09.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffd02a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ff815d0c0 0x7f6ff80cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffc829700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ff80b5f70 0x7f6ff80c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffd02a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ff815d0c0 0x7f6ff80cb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39172/0 (socket says 172.21.15.44:39172) 2024-09-13T18:33:09.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffd02a700 1 -- 172.21.15.44:0/1700443711 learned_addr learned my addr 172.21.15.44:0/1700443711 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:09.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6feffff700 1 --2- 172.21.15.44:0/1700443711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ff80ce640 0x7f6ff8153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffd02a700 1 -- 172.21.15.44:0/1700443711 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ff80b5f70 msgr2=0x7f6ff80c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:09.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffd02a700 1 --2- 172.21.15.44:0/1700443711 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ff80b5f70 0x7f6ff80c7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffd02a700 1 -- 172.21.15.44:0/1700443711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ff80ce640 msgr2=0x7f6ff8153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:09.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.307+0000 7f6ffd02a700 1 --2- 172.21.15.44:0/1700443711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ff80ce640 0x7f6ff8153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.311+0000 7f6ffd02a700 1 -- 172.21.15.44:0/1700443711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe8009520 con 0x7f6ff815d0c0 2024-09-13T18:33:09.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.311+0000 7f6ffc829700 1 --2- 172.21.15.44:0/1700443711 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ff80b5f70 0x7f6ff80c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:33:09.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.311+0000 7f6ffd02a700 1 --2- 172.21.15.44:0/1700443711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ff815d0c0 0x7f6ff80cb2a0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6ff000cc50 tx=0x7f6ff000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:09.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.311+0000 7f6fed7fa700 1 -- 172.21.15.44:0/1700443711 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0003c20 con 0x7f6ff815d0c0 2024-09-13T18:33:09.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.311+0000 7f6fed7fa700 1 -- 172.21.15.44:0/1700443711 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff0003d80 con 0x7f6ff815d0c0 2024-09-13T18:33:09.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.311+0000 7f6fed7fa700 1 -- 172.21.15.44:0/1700443711 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff000aab0 con 0x7f6ff815d0c0 2024-09-13T18:33:09.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.311+0000 7f6ffea8d700 1 -- 172.21.15.44:0/1700443711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff80cc390 con 0x7f6ff815d0c0 2024-09-13T18:33:09.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.311+0000 7f6ffea8d700 1 -- 172.21.15.44:0/1700443711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff80cb7e0 con 0x7f6ff815d0c0 2024-09-13T18:33:09.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.311+0000 7f6ffea8d700 1 -- 172.21.15.44:0/1700443711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff80cc8b0 con 0x7f6ff815d0c0 2024-09-13T18:33:09.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.311+0000 7f6fed7fa700 1 -- 172.21.15.44:0/1700443711 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6ff000ac10 con 0x7f6ff815d0c0 2024-09-13T18:33:09.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.315+0000 7f6fed7fa700 1 --2- 172.21.15.44:0/1700443711 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6fe4066730 0x7f6fe4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.315+0000 7f6fed7fa700 1 -- 172.21.15.44:0/1700443711 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f6ff0083ed0 con 0x7f6ff815d0c0 2024-09-13T18:33:09.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.315+0000 7f6ffc829700 1 --2- 172.21.15.44:0/1700443711 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6fe4066730 0x7f6fe4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.315+0000 7f6ffc829700 1 --2- 172.21.15.44:0/1700443711 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6fe4066730 0x7f6fe4068bf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4009f40 tx=0x7f6ff4009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:09.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.323+0000 7f6fed7fa700 1 -- 172.21.15.44:0/1700443711 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6ff80cc8b0 con 0x7f6ff815d0c0 2024-09-13T18:33:09.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.495+0000 7f6ffea8d700 1 -- 172.21.15.44:0/1700443711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ff80cc8b0 con 0x7f6ff815d0c0 2024-09-13T18:33:09.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.495+0000 7f6fed7fa700 1 -- 172.21.15.44:0/1700443711 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6ff80cc8b0 con 0x7f6ff815d0c0 2024-09-13T18:33:09.501 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:33:09.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.495+0000 7f6ffea8d700 1 -- 172.21.15.44:0/1700443711 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6fe4066730 msgr2=0x7f6fe4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:09.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.495+0000 7f6ffea8d700 1 --2- 172.21.15.44:0/1700443711 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6fe4066730 0x7f6fe4068bf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4009f40 tx=0x7f6ff4009240 comp rx=0 tx=0).stop 2024-09-13T18:33:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.495+0000 7f6ffea8d700 1 -- 172.21.15.44:0/1700443711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ff815d0c0 msgr2=0x7f6ff80cb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.495+0000 7f6ffea8d700 1 --2- 172.21.15.44:0/1700443711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ff815d0c0 0x7f6ff80cb2a0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6ff000cc50 tx=0x7f6ff000cf60 comp rx=0 tx=0).stop 2024-09-13T18:33:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.495+0000 7f6ffea8d700 1 -- 172.21.15.44:0/1700443711 shutdown_connections 2024-09-13T18:33:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.495+0000 7f6ffea8d700 1 --2- 172.21.15.44:0/1700443711 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6fe4066730 0x7f6fe4068bf0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.495+0000 7f6ffea8d700 1 --2- 172.21.15.44:0/1700443711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ff815d0c0 0x7f6ff80cb2a0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.495+0000 7f6ffea8d700 1 --2- 172.21.15.44:0/1700443711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ff80ce640 0x7f6ff8153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.495+0000 7f6ffea8d700 1 --2- 172.21.15.44:0/1700443711 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ff80b5f70 0x7f6ff80c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.495+0000 7f6ffea8d700 1 -- 172.21.15.44:0/1700443711 >> 172.21.15.44:0/1700443711 conn(0x7f6ff80d2d40 msgr2=0x7f6ff80b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.495+0000 7f6ffea8d700 1 -- 172.21.15.44:0/1700443711 shutdown_connections 2024-09-13T18:33:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.495+0000 7f6ffea8d700 1 -- 172.21.15.44:0/1700443711 wait complete. 2024-09-13T18:33:09.520 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_reset' 2024-09-13T18:33:09.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed759e700 1 Processor -- start 2024-09-13T18:33:09.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed759e700 1 -- start start 2024-09-13T18:33:09.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed759e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8ed0055870 0x7f8ed000af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed759e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8ed000b4b0 0x7f8ed0039b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed759e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed00487b0 con 0x7f8ed00ea5d0 2024-09-13T18:33:09.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed759e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed00485c0 con 0x7f8ed0055870 2024-09-13T18:33:09.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed759e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed000b920 con 0x7f8ed000b4b0 2024-09-13T18:33:09.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed5d9b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8ed0055870 0x7f8ed000af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed5d9b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8ed0055870 0x7f8ed000af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39180/0 (socket says 172.21.15.44:39180) 2024-09-13T18:33:09.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed5d9b700 1 -- 172.21.15.44:0/2062343260 learned_addr learned my addr 172.21.15.44:0/2062343260 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:09.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed6d9d700 1 --2- 172.21.15.44:0/2062343260 >> v2:172.21.15.99:3300/0 conn(0x7f8ed000b4b0 0x7f8ed0039b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed5d9b700 1 -- 172.21.15.44:0/2062343260 >> v2:172.21.15.99:3300/0 conn(0x7f8ed000b4b0 msgr2=0x7f8ed0039b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:09.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed5d9b700 1 --2- 172.21.15.44:0/2062343260 >> v2:172.21.15.99:3300/0 conn(0x7f8ed000b4b0 0x7f8ed0039b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed5d9b700 1 -- 172.21.15.44:0/2062343260 >> v1:172.21.15.99:6789/0 conn(0x7f8ed00ea5d0 legacy=0x7f8ed0047eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:09.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed5d9b700 1 -- 172.21.15.44:0/2062343260 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed0036a70 con 0x7f8ed0055870 2024-09-13T18:33:09.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed5d9b700 1 --2- 172.21.15.44:0/2062343260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed0055870 0x7f8ed000af70 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f8ed004be90 tx=0x7f8ec8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8af0d8d968cb1be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:09.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed559a700 1 -- 172.21.15.44:0/2062343260 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec800b810 con 0x7f8ed0055870 2024-09-13T18:33:09.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed559a700 1 -- 172.21.15.44:0/2062343260 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec800b970 con 0x7f8ed0055870 2024-09-13T18:33:09.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed559a700 1 -- 172.21.15.44:0/2062343260 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec800bd00 con 0x7f8ed0055870 2024-09-13T18:33:09.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed759e700 1 -- 172.21.15.44:0/2062343260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed0055870 msgr2=0x7f8ed000af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:09.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed759e700 1 --2- 172.21.15.44:0/2062343260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed0055870 0x7f8ed000af70 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f8ed004be90 tx=0x7f8ec8009c20 comp rx=0 tx=0).stop 2024-09-13T18:33:09.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed759e700 1 -- 172.21.15.44:0/2062343260 shutdown_connections 2024-09-13T18:33:09.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed759e700 1 --2- 172.21.15.44:0/2062343260 >> v2:172.21.15.99:3300/0 conn(0x7f8ed000b4b0 0x7f8ed0039b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed759e700 1 --2- 172.21.15.44:0/2062343260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed0055870 0x7f8ed000af70 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed759e700 1 -- 172.21.15.44:0/2062343260 >> 172.21.15.44:0/2062343260 conn(0x7f8ed001e270 msgr2=0x7f8ed0054ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:09.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed759e700 1 -- 172.21.15.44:0/2062343260 shutdown_connections 2024-09-13T18:33:09.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.631+0000 7f8ed759e700 1 -- 172.21.15.44:0/2062343260 wait complete. 2024-09-13T18:33:09.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.635+0000 7f8ed759e700 1 Processor -- start 2024-09-13T18:33:09.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.635+0000 7f8ed759e700 1 -- start start 2024-09-13T18:33:09.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.635+0000 7f8ed759e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed000b4b0 0x7f8ed0049980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.635+0000 7f8ed759e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ed0055870 0x7f8ed00e6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.635+0000 7f8ed759e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ed00ea5d0 0x7f8ed0006c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.635+0000 7f8ed759e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed00e6fe0 con 0x7f8ed000b4b0 2024-09-13T18:33:09.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.635+0000 7f8ed759e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed004c930 con 0x7f8ed00ea5d0 2024-09-13T18:33:09.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.635+0000 7f8ed759e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed004cbd0 con 0x7f8ed0055870 2024-09-13T18:33:09.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.635+0000 7f8ed659c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed000b4b0 0x7f8ed0049980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.635+0000 7f8ed659c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed000b4b0 0x7f8ed0049980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39184/0 (socket says 172.21.15.44:39184) 2024-09-13T18:33:09.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.635+0000 7f8ed659c700 1 -- 172.21.15.44:0/295057034 learned_addr learned my addr 172.21.15.44:0/295057034 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:09.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.635+0000 7f8ed6d9d700 1 --2- 172.21.15.44:0/295057034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ed00ea5d0 0x7f8ed0006c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.635+0000 7f8ed5d9b700 1 --2- 172.21.15.44:0/295057034 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ed0055870 0x7f8ed00e6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.635+0000 7f8ed659c700 1 -- 172.21.15.44:0/295057034 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ed0055870 msgr2=0x7f8ed00e6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:09.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.635+0000 7f8ed659c700 1 --2- 172.21.15.44:0/295057034 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ed0055870 0x7f8ed00e6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.635+0000 7f8ed659c700 1 -- 172.21.15.44:0/295057034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ed00ea5d0 msgr2=0x7f8ed0006c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:09.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.635+0000 7f8ed659c700 1 --2- 172.21.15.44:0/295057034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ed00ea5d0 0x7f8ed0006c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.635+0000 7f8ed659c700 1 -- 172.21.15.44:0/295057034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec8009570 con 0x7f8ed000b4b0 2024-09-13T18:33:09.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.639+0000 7f8ed659c700 1 --2- 172.21.15.44:0/295057034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed000b4b0 0x7f8ed0049980 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc001f00 tx=0x7f8ecc00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:09.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.639+0000 7f8ec6ffd700 1 -- 172.21.15.44:0/295057034 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc0052d0 con 0x7f8ed000b4b0 2024-09-13T18:33:09.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.639+0000 7f8ec6ffd700 1 -- 172.21.15.44:0/295057034 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ecc005430 con 0x7f8ed000b4b0 2024-09-13T18:33:09.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.639+0000 7f8ec6ffd700 1 -- 172.21.15.44:0/295057034 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc006af0 con 0x7f8ed000b4b0 2024-09-13T18:33:09.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.639+0000 7f8ed759e700 1 -- 172.21.15.44:0/295057034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed004d400 con 0x7f8ed000b4b0 2024-09-13T18:33:09.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.639+0000 7f8ed759e700 1 -- 172.21.15.44:0/295057034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed004ceb0 con 0x7f8ed000b4b0 2024-09-13T18:33:09.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.639+0000 7f8ed759e700 1 -- 172.21.15.44:0/295057034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed00346b0 con 0x7f8ed000b4b0 2024-09-13T18:33:09.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.639+0000 7f8ec6ffd700 1 -- 172.21.15.44:0/295057034 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8ecc0036f0 con 0x7f8ed000b4b0 2024-09-13T18:33:09.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.639+0000 7f8ec6ffd700 1 --2- 172.21.15.44:0/295057034 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8eb8066730 0x7f8eb8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.643+0000 7f8ec6ffd700 1 -- 172.21.15.44:0/295057034 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8ecc083120 con 0x7f8ed000b4b0 2024-09-13T18:33:09.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.643+0000 7f8ed5d9b700 1 --2- 172.21.15.44:0/295057034 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8eb8066730 0x7f8eb8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.643+0000 7f8ed5d9b700 1 --2- 172.21.15.44:0/295057034 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8eb8066730 0x7f8eb8068bf0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8014040 tx=0x7f8ec8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:09.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.651+0000 7f8ec6ffd700 1 -- 172.21.15.44:0/295057034 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8ecc0506b0 con 0x7f8ed000b4b0 2024-09-13T18:33:09.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:09.891+0000 7f8ed759e700 1 -- 172.21.15.44:0/295057034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_reset"]} v 0) v1 -- 0x7f8ed00ea9b0 con 0x7f8ed000b4b0 2024-09-13T18:33:10.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.835+0000 7f8ec6ffd700 1 -- 172.21.15.44:0/295057034 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_reset"]}]=0 v276) v1 ==== 143+0+0 (secure 0 0 0) 0x7f8ecc053cd0 con 0x7f8ed000b4b0 2024-09-13T18:33:10.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.839+0000 7f8ed759e700 1 -- 172.21.15.44:0/295057034 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8eb8066730 msgr2=0x7f8eb8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:10.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.839+0000 7f8ed759e700 1 --2- 172.21.15.44:0/295057034 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8eb8066730 0x7f8eb8068bf0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8014040 tx=0x7f8ec8008030 comp rx=0 tx=0).stop 2024-09-13T18:33:10.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.839+0000 7f8ed759e700 1 -- 172.21.15.44:0/295057034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed000b4b0 msgr2=0x7f8ed0049980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:10.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.839+0000 7f8ed759e700 1 --2- 172.21.15.44:0/295057034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed000b4b0 0x7f8ed0049980 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc001f00 tx=0x7f8ecc00c7b0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.839+0000 7f8ed759e700 1 -- 172.21.15.44:0/295057034 shutdown_connections 2024-09-13T18:33:10.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.839+0000 7f8ed759e700 1 --2- 172.21.15.44:0/295057034 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8eb8066730 0x7f8eb8068bf0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.839+0000 7f8ed759e700 1 --2- 172.21.15.44:0/295057034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ed00ea5d0 0x7f8ed0006c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.839+0000 7f8ed759e700 1 --2- 172.21.15.44:0/295057034 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ed0055870 0x7f8ed00e6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.839+0000 7f8ed759e700 1 --2- 172.21.15.44:0/295057034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed000b4b0 0x7f8ed0049980 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.839+0000 7f8ed759e700 1 -- 172.21.15.44:0/295057034 >> 172.21.15.44:0/295057034 conn(0x7f8ed001e270 msgr2=0x7f8ed0034d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:10.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.839+0000 7f8ed759e700 1 -- 172.21.15.44:0/295057034 shutdown_connections 2024-09-13T18:33:10.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.839+0000 7f8ed759e700 1 -- 172.21.15.44:0/295057034 wait complete. 2024-09-13T18:33:10.864 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:33:10.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.991+0000 7eff51d5f700 1 Processor -- start 2024-09-13T18:33:10.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.991+0000 7eff51d5f700 1 -- start start 2024-09-13T18:33:10.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.991+0000 7eff51d5f700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7eff4c15d200 0x7eff4c163c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:10.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.991+0000 7eff51d5f700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4c06dad0 con 0x7eff4c06d6f0 2024-09-13T18:33:11.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.991+0000 7eff51d5f700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4c0ae3c0 con 0x7eff4c0ce270 2024-09-13T18:33:11.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.991+0000 7eff51d5f700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff4c0705b0 con 0x7eff4c15d200 2024-09-13T18:33:11.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.991+0000 7eff50d5d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7eff4c06d6f0 0x7eff4c0adbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44248/0 (socket says 172.21.15.44:44248) 2024-09-13T18:33:11.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.991+0000 7eff50d5d700 1 -- 172.21.15.44:0/337377936 learned_addr learned my addr 172.21.15.44:0/337377936 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:11.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.991+0000 7eff5155e700 1 --2- 172.21.15.44:0/337377936 >> v2:172.21.15.44:3300/0 conn(0x7eff4c15d200 0x7eff4c163c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:11.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.995+0000 7eff4b7fe700 1 -- 172.21.15.44:0/337377936 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1659668108 0 0) 0x7eff4c06dad0 con 0x7eff4c06d6f0 2024-09-13T18:33:11.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.995+0000 7eff5155e700 1 -- 172.21.15.44:0/337377936 >> v1:172.21.15.99:6789/0 conn(0x7eff4c0ce270 legacy=0x7eff4c15caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:11.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.995+0000 7eff5155e700 1 -- 172.21.15.44:0/337377936 >> v1:172.21.15.44:6789/0 conn(0x7eff4c06d6f0 legacy=0x7eff4c0adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:11.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.995+0000 7eff5155e700 1 -- 172.21.15.44:0/337377936 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c070890 con 0x7eff4c15d200 2024-09-13T18:33:11.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.995+0000 7eff5155e700 1 --2- 172.21.15.44:0/337377936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff4c15d200 0x7eff4c163c50 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7eff4400aa20 tx=0x7eff4400ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2025914a043581aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:11.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.995+0000 7eff4b7fe700 1 -- 172.21.15.44:0/337377936 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4400cb30 con 0x7eff4c15d200 2024-09-13T18:33:11.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.995+0000 7eff4b7fe700 1 -- 172.21.15.44:0/337377936 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4400cc90 con 0x7eff4c15d200 2024-09-13T18:33:11.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.995+0000 7eff4b7fe700 1 -- 172.21.15.44:0/337377936 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4400f470 con 0x7eff4c15d200 2024-09-13T18:33:11.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.995+0000 7eff51d5f700 1 -- 172.21.15.44:0/337377936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff4c15d200 msgr2=0x7eff4c163c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:11.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.995+0000 7eff51d5f700 1 --2- 172.21.15.44:0/337377936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff4c15d200 0x7eff4c163c50 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7eff4400aa20 tx=0x7eff4400ad30 comp rx=0 tx=0).stop 2024-09-13T18:33:11.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.995+0000 7eff51d5f700 1 -- 172.21.15.44:0/337377936 shutdown_connections 2024-09-13T18:33:11.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.995+0000 7eff51d5f700 1 --2- 172.21.15.44:0/337377936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff4c15d200 0x7eff4c163c50 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:11.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.995+0000 7eff51d5f700 1 -- 172.21.15.44:0/337377936 >> 172.21.15.44:0/337377936 conn(0x7eff4c0b0e10 msgr2=0x7eff4c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:11.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.995+0000 7eff51d5f700 1 -- 172.21.15.44:0/337377936 shutdown_connections 2024-09-13T18:33:11.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.995+0000 7eff51d5f700 1 -- 172.21.15.44:0/337377936 wait complete. 2024-09-13T18:33:11.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.995+0000 7eff51d5f700 1 Processor -- start 2024-09-13T18:33:11.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.995+0000 7eff51d5f700 1 -- start start 2024-09-13T18:33:11.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.999+0000 7eff51d5f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff4c06d6f0 0x7eff4c150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:11.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.999+0000 7eff51d5f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff4c0ce270 0x7eff4c148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:11.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.999+0000 7eff51d5f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff4c15d200 0x7eff4c14ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:11.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.999+0000 7eff51d5f700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c14f4b0 con 0x7eff4c0ce270 2024-09-13T18:33:11.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.999+0000 7eff51d5f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c150d60 con 0x7eff4c06d6f0 2024-09-13T18:33:11.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.999+0000 7eff51d5f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c151040 con 0x7eff4c15d200 2024-09-13T18:33:11.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.999+0000 7eff4bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff4c0ce270 0x7eff4c148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:11.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.999+0000 7eff4bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff4c0ce270 0x7eff4c148510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39210/0 (socket says 172.21.15.44:39210) 2024-09-13T18:33:11.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.999+0000 7eff4bfff700 1 -- 172.21.15.44:0/1071902232 learned_addr learned my addr 172.21.15.44:0/1071902232 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:11.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.999+0000 7eff50d5d700 1 --2- 172.21.15.44:0/1071902232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff4c06d6f0 0x7eff4c150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:11.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.999+0000 7eff5155e700 1 --2- 172.21.15.44:0/1071902232 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff4c15d200 0x7eff4c14ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:11.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.999+0000 7eff4bfff700 1 -- 172.21.15.44:0/1071902232 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff4c15d200 msgr2=0x7eff4c14ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:11.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.999+0000 7eff4bfff700 1 --2- 172.21.15.44:0/1071902232 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff4c15d200 0x7eff4c14ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:11.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.999+0000 7eff4bfff700 1 -- 172.21.15.44:0/1071902232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff4c06d6f0 msgr2=0x7eff4c150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:11.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.999+0000 7eff4bfff700 1 --2- 172.21.15.44:0/1071902232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff4c06d6f0 0x7eff4c150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:11.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.999+0000 7eff4bfff700 1 -- 172.21.15.44:0/1071902232 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4400a650 con 0x7eff4c0ce270 2024-09-13T18:33:11.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.999+0000 7eff4bfff700 1 --2- 172.21.15.44:0/1071902232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff4c0ce270 0x7eff4c148510 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7eff4000c500 tx=0x7eff4000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:11.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.999+0000 7eff497fa700 1 -- 172.21.15.44:0/1071902232 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff400052d0 con 0x7eff4c0ce270 2024-09-13T18:33:11.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.999+0000 7eff497fa700 1 -- 172.21.15.44:0/1071902232 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff40005430 con 0x7eff4c0ce270 2024-09-13T18:33:11.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.999+0000 7eff497fa700 1 -- 172.21.15.44:0/1071902232 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff400055a0 con 0x7eff4c0ce270 2024-09-13T18:33:11.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.999+0000 7eff51d5f700 1 -- 172.21.15.44:0/1071902232 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff4c151320 con 0x7eff4c0ce270 2024-09-13T18:33:11.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.999+0000 7eff51d5f700 1 -- 172.21.15.44:0/1071902232 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4c14d5d0 con 0x7eff4c0ce270 2024-09-13T18:33:11.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:10.999+0000 7eff51d5f700 1 -- 172.21.15.44:0/1071902232 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff4c06fa70 con 0x7eff4c0ce270 2024-09-13T18:33:11.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.003+0000 7eff497fa700 1 -- 172.21.15.44:0/1071902232 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7eff400038e0 con 0x7eff4c0ce270 2024-09-13T18:33:11.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.003+0000 7eff497fa700 1 --2- 172.21.15.44:0/1071902232 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7eff38066730 0x7eff38068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:11.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.003+0000 7eff497fa700 1 -- 172.21.15.44:0/1071902232 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5029+0+0 (secure 0 0 0) 0x7eff40083260 con 0x7eff4c0ce270 2024-09-13T18:33:11.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.003+0000 7eff50d5d700 1 --2- 172.21.15.44:0/1071902232 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7eff38066730 0x7eff38068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:11.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.003+0000 7eff50d5d700 1 --2- 172.21.15.44:0/1071902232 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7eff38066730 0x7eff38068bf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7eff3c001d90 tx=0x7eff3c001d20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:11.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.011+0000 7eff497fa700 1 -- 172.21.15.44:0/1071902232 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7eff40050870 con 0x7eff4c0ce270 2024-09-13T18:33:11.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.187+0000 7eff51d5f700 1 -- 172.21.15.44:0/1071902232 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7eff4c14dbf0 con 0x7eff4c0ce270 2024-09-13T18:33:11.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.195+0000 7eff497fa700 1 -- 172.21.15.44:0/1071902232 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7eff4c14dbf0 con 0x7eff4c0ce270 2024-09-13T18:33:11.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.199+0000 7eff51d5f700 1 -- 172.21.15.44:0/1071902232 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7eff38066730 msgr2=0x7eff38068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:11.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.199+0000 7eff51d5f700 1 --2- 172.21.15.44:0/1071902232 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7eff38066730 0x7eff38068bf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7eff3c001d90 tx=0x7eff3c001d20 comp rx=0 tx=0).stop 2024-09-13T18:33:11.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.199+0000 7eff51d5f700 1 -- 172.21.15.44:0/1071902232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff4c0ce270 msgr2=0x7eff4c148510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:11.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.199+0000 7eff51d5f700 1 --2- 172.21.15.44:0/1071902232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff4c0ce270 0x7eff4c148510 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7eff4000c500 tx=0x7eff4000c810 comp rx=0 tx=0).stop 2024-09-13T18:33:11.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.199+0000 7eff51d5f700 1 -- 172.21.15.44:0/1071902232 shutdown_connections 2024-09-13T18:33:11.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.199+0000 7eff51d5f700 1 --2- 172.21.15.44:0/1071902232 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7eff38066730 0x7eff38068bf0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:11.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.199+0000 7eff51d5f700 1 --2- 172.21.15.44:0/1071902232 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff4c15d200 0x7eff4c14ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:11.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.199+0000 7eff51d5f700 1 --2- 172.21.15.44:0/1071902232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff4c0ce270 0x7eff4c148510 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:11.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.199+0000 7eff51d5f700 1 --2- 172.21.15.44:0/1071902232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff4c06d6f0 0x7eff4c150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:11.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.199+0000 7eff51d5f700 1 -- 172.21.15.44:0/1071902232 >> 172.21.15.44:0/1071902232 conn(0x7eff4c0b0e10 msgr2=0x7eff4c159de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:11.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.199+0000 7eff51d5f700 1 -- 172.21.15.44:0/1071902232 shutdown_connections 2024-09-13T18:33:11.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.199+0000 7eff51d5f700 1 -- 172.21.15.44:0/1071902232 wait complete. 2024-09-13T18:33:11.221 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:33:11.221 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:33:11.239 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:33:11.262 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:33:11.262 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:33:11.262 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:11.270 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349428k,nr_inodes=4087357,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16693 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276112k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:33:11.270 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:33:11.270 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:11.314 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346268k,nr_inodes=4086567,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19562 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275480k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:33:11.314 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:33:11.314 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:11.322 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349428k,nr_inodes=4087357,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16693 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276112k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:33:11.322 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:33:11.322 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:11.329 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346268k,nr_inodes=4086567,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19562 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275480k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:33:11.330 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:33:11.330 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:33:11.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.451+0000 7ff51f59e700 1 Processor -- start 2024-09-13T18:33:11.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.451+0000 7ff51f59e700 1 -- start start 2024-09-13T18:33:11.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.451+0000 7ff51f59e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff5200b2870 0x7ff5200b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:11.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.451+0000 7ff51f59e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5200b3c20 con 0x7ff52015d9b0 2024-09-13T18:33:11.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.451+0000 7ff51f59e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5200b3190 con 0x7ff5200b4970 2024-09-13T18:33:11.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.451+0000 7ff51f59e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff52015ddc0 con 0x7ff5200b2870 2024-09-13T18:33:11.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.451+0000 7ff51e59c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff5200b2870 0x7ff5200b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:11.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.451+0000 7ff51ed9d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff52015d9b0 0x7ff5200b52d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44254/0 (socket says 172.21.15.44:44254) 2024-09-13T18:33:11.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.451+0000 7ff51ed9d700 1 -- 172.21.15.44:0/2942512348 learned_addr learned my addr 172.21.15.44:0/2942512348 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:11.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.451+0000 7ff51e59c700 1 -- 172.21.15.44:0/2942512348 >> v1:172.21.15.99:6789/0 conn(0x7ff5200b4970 legacy=0x7ff52015d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:11.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.451+0000 7ff51e59c700 1 -- 172.21.15.44:0/2942512348 >> v1:172.21.15.44:6789/0 conn(0x7ff52015d9b0 legacy=0x7ff5200b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:11.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.451+0000 7ff51e59c700 1 -- 172.21.15.44:0/2942512348 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5200b3e90 con 0x7ff5200b2870 2024-09-13T18:33:11.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.451+0000 7ff51e59c700 1 --2- 172.21.15.44:0/2942512348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5200b2870 0x7ff5200b2c50 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ff510009850 tx=0x7ff510009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6584b025be7fcbb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:11.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.451+0000 7ff51dd9b700 1 -- 172.21.15.44:0/2942512348 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff510004230 con 0x7ff5200b2870 2024-09-13T18:33:11.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.451+0000 7ff51dd9b700 1 -- 172.21.15.44:0/2942512348 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff510004390 con 0x7ff5200b2870 2024-09-13T18:33:11.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.451+0000 7ff51dd9b700 1 -- 172.21.15.44:0/2942512348 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5100036c0 con 0x7ff5200b2870 2024-09-13T18:33:11.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.451+0000 7ff51f59e700 1 -- 172.21.15.44:0/2942512348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5200b2870 msgr2=0x7ff5200b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:11.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.451+0000 7ff51f59e700 1 --2- 172.21.15.44:0/2942512348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5200b2870 0x7ff5200b2c50 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ff510009850 tx=0x7ff510009b60 comp rx=0 tx=0).stop 2024-09-13T18:33:11.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.451+0000 7ff51f59e700 1 -- 172.21.15.44:0/2942512348 shutdown_connections 2024-09-13T18:33:11.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.455+0000 7ff51f59e700 1 --2- 172.21.15.44:0/2942512348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5200b2870 0x7ff5200b2c50 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:11.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.455+0000 7ff51f59e700 1 -- 172.21.15.44:0/2942512348 >> 172.21.15.44:0/2942512348 conn(0x7ff52006a940 msgr2=0x7ff520071d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:11.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.455+0000 7ff51f59e700 1 -- 172.21.15.44:0/2942512348 shutdown_connections 2024-09-13T18:33:11.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.455+0000 7ff51f59e700 1 -- 172.21.15.44:0/2942512348 wait complete. 2024-09-13T18:33:11.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.455+0000 7ff51f59e700 1 Processor -- start 2024-09-13T18:33:11.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.455+0000 7ff51f59e700 1 -- start start 2024-09-13T18:33:11.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.455+0000 7ff51f59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5200b2870 0x7ff5201423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:11.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.455+0000 7ff51f59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5200b4970 0x7ff5200b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:11.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.455+0000 7ff51f59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff52015d9b0 0x7ff5200b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:11.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.455+0000 7ff51f59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52006e3e0 con 0x7ff5200b4970 2024-09-13T18:33:11.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.455+0000 7ff51f59e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5201428f0 con 0x7ff5200b2870 2024-09-13T18:33:11.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.455+0000 7ff51f59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52006d760 con 0x7ff52015d9b0 2024-09-13T18:33:11.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.455+0000 7ff517fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5200b4970 0x7ff5200b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:11.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.455+0000 7ff517fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5200b4970 0x7ff5200b58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39228/0 (socket says 172.21.15.44:39228) 2024-09-13T18:33:11.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.455+0000 7ff517fff700 1 -- 172.21.15.44:0/1087888954 learned_addr learned my addr 172.21.15.44:0/1087888954 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.455+0000 7ff51e59c700 1 --2- 172.21.15.44:0/1087888954 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5200b2870 0x7ff5201423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.459+0000 7ff51ed9d700 1 --2- 172.21.15.44:0/1087888954 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff52015d9b0 0x7ff5200b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.459+0000 7ff517fff700 1 -- 172.21.15.44:0/1087888954 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff52015d9b0 msgr2=0x7ff5200b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.459+0000 7ff517fff700 1 --2- 172.21.15.44:0/1087888954 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff52015d9b0 0x7ff5200b5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.459+0000 7ff517fff700 1 -- 172.21.15.44:0/1087888954 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5200b2870 msgr2=0x7ff5201423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.459+0000 7ff517fff700 1 --2- 172.21.15.44:0/1087888954 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5200b2870 0x7ff5201423b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.459+0000 7ff517fff700 1 -- 172.21.15.44:0/1087888954 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5100094b0 con 0x7ff5200b4970 2024-09-13T18:33:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.459+0000 7ff517fff700 1 --2- 172.21.15.44:0/1087888954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5200b4970 0x7ff5200b58b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7ff50800c4e0 tx=0x7ff50800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.459+0000 7ff516ffd700 1 -- 172.21.15.44:0/1087888954 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff508011790 con 0x7ff5200b4970 2024-09-13T18:33:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.459+0000 7ff516ffd700 1 -- 172.21.15.44:0/1087888954 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff508011910 con 0x7ff5200b4970 2024-09-13T18:33:11.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.459+0000 7ff51f59e700 1 -- 172.21.15.44:0/1087888954 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff52006da40 con 0x7ff5200b4970 2024-09-13T18:33:11.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.459+0000 7ff516ffd700 1 -- 172.21.15.44:0/1087888954 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff508011cc0 con 0x7ff5200b4970 2024-09-13T18:33:11.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.459+0000 7ff51f59e700 1 -- 172.21.15.44:0/1087888954 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52006e000 con 0x7ff5200b4970 2024-09-13T18:33:11.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.459+0000 7ff51f59e700 1 -- 172.21.15.44:0/1087888954 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff52015f150 con 0x7ff5200b4970 2024-09-13T18:33:11.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.459+0000 7ff516ffd700 1 -- 172.21.15.44:0/1087888954 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff50801c460 con 0x7ff5200b4970 2024-09-13T18:33:11.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.463+0000 7ff516ffd700 1 --2- 172.21.15.44:0/1087888954 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff500066730 0x7ff500068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:11.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.463+0000 7ff516ffd700 1 -- 172.21.15.44:0/1087888954 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff508083bd0 con 0x7ff5200b4970 2024-09-13T18:33:11.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.463+0000 7ff51e59c700 1 --2- 172.21.15.44:0/1087888954 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff500066730 0x7ff500068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:11.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.463+0000 7ff51e59c700 1 --2- 172.21.15.44:0/1087888954 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff500066730 0x7ff500068bf0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff510009850 tx=0x7ff510008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:11.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.467+0000 7ff516ffd700 1 -- 172.21.15.44:0/1087888954 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff508051270 con 0x7ff5200b4970 2024-09-13T18:33:11.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.667+0000 7ff51f59e700 1 -- 172.21.15.44:0/1087888954 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff520153ae0 con 0x7ff5200b4970 2024-09-13T18:33:11.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.671+0000 7ff516ffd700 1 -- 172.21.15.44:0/1087888954 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+3529 (secure 0 0 0) 0x7ff508054890 con 0x7ff5200b4970 2024-09-13T18:33:11.676 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:33:11.676 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5447,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2081931615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2081931615},{"type":"v1","addr":"172.21.15.99:6835","nonce":2081931615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5639,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1452559390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1452559390},{"type":"v1","addr":"172.21.15.44:6835","nonce":1452559390}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5887,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/2337853364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2337853364},{"type":"v1","addr":"172.21.15.99:6837","nonce":2337853364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6762,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1805431925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1805431925},{"type":"v1","addr":"172.21.15.44:6833","nonce":1805431925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[]} 2024-09-13T18:33:11.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.671+0000 7ff51f59e700 1 -- 172.21.15.44:0/1087888954 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff500066730 msgr2=0x7ff500068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:11.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.671+0000 7ff51f59e700 1 --2- 172.21.15.44:0/1087888954 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff500066730 0x7ff500068bf0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff510009850 tx=0x7ff510008030 comp rx=0 tx=0).stop 2024-09-13T18:33:11.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.671+0000 7ff51f59e700 1 -- 172.21.15.44:0/1087888954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5200b4970 msgr2=0x7ff5200b58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:11.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.671+0000 7ff51f59e700 1 --2- 172.21.15.44:0/1087888954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5200b4970 0x7ff5200b58b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7ff50800c4e0 tx=0x7ff50800c7f0 comp rx=0 tx=0).stop 2024-09-13T18:33:11.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.671+0000 7ff51f59e700 1 -- 172.21.15.44:0/1087888954 shutdown_connections 2024-09-13T18:33:11.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.671+0000 7ff51f59e700 1 --2- 172.21.15.44:0/1087888954 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff500066730 0x7ff500068bf0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:11.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.671+0000 7ff51f59e700 1 --2- 172.21.15.44:0/1087888954 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff52015d9b0 0x7ff5200b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:11.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.671+0000 7ff51f59e700 1 --2- 172.21.15.44:0/1087888954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5200b4970 0x7ff5200b58b0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:11.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.671+0000 7ff51f59e700 1 --2- 172.21.15.44:0/1087888954 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5200b2870 0x7ff5201423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:11.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.671+0000 7ff51f59e700 1 -- 172.21.15.44:0/1087888954 >> 172.21.15.44:0/1087888954 conn(0x7ff52006a940 msgr2=0x7ff5201532c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:11.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.671+0000 7ff51f59e700 1 -- 172.21.15.44:0/1087888954 shutdown_connections 2024-09-13T18:33:11.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.671+0000 7ff51f59e700 1 -- 172.21.15.44:0/1087888954 wait complete. 2024-09-13T18:33:11.680 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 40 2024-09-13T18:33:11.691 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:33:11.692 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:33:11.692 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:33:11.692 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:33:11.692 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:33:11.693 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:33:11.693 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:33:11.693 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:33:11.693 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:33:11.693 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:33:11.693 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:33:11.694 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:33:11.694 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:33:11.694 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:33:11.694 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:33:11.695 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:33:11.707 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:33:11.707 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:33:11.709 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:33:11.709 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:33:11.711 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:33:11.711 DEBUG:teuthology.parallel:result is None 2024-09-13T18:33:11.712 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:33:11.712 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:33:11.713 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:33:11.714 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:33:11.714 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:33:11.714 DEBUG:teuthology.parallel:result is None 2024-09-13T18:33:11.757 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:33:11.757 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:33:11.758 DEBUG:teuthology.parallel:result is None 2024-09-13T18:33:11.758 DEBUG:teuthology.parallel:result is None 2024-09-13T18:33:11.758 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:33:11.797 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-13T18:33:11.798 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-13T18:33:11.838 INFO:tasks.ceph.mds.b.smithi099.stdout:starting mds.b at 2024-09-13T18:33:11.842 INFO:tasks.ceph.mds.d.smithi099.stdout:starting mds.d at 2024-09-13T18:33:11.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04e697d700 1 Processor -- start 2024-09-13T18:33:11.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04e697d700 1 -- start start 2024-09-13T18:33:11.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04e697d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f04e00b4bd0 0x7f04e0164840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04e697d700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e00b3f50 con 0x7f04e01436c0 2024-09-13T18:33:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04e697d700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e006be50 con 0x7f04e00ccd50 2024-09-13T18:33:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04e697d700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e00b4230 con 0x7f04e00b4bd0 2024-09-13T18:33:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04dffff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f04e01436c0 0x7f04e00b3490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44284/0 (socket says 172.21.15.44:44284) 2024-09-13T18:33:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04dffff700 1 -- 172.21.15.44:0/572209465 learned_addr learned my addr 172.21.15.44:0/572209465 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04e4f1a700 1 --2- 172.21.15.44:0/572209465 >> v2:172.21.15.44:3300/0 conn(0x7f04e00b4bd0 0x7f04e0164840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04deffd700 1 -- 172.21.15.44:0/572209465 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886631619 0 0) 0x7f04e00b3f50 con 0x7f04e01436c0 2024-09-13T18:33:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04deffd700 1 -- 172.21.15.44:0/572209465 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04c80035d0 con 0x7f04e01436c0 2024-09-13T18:33:11.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04deffd700 1 -- 172.21.15.44:0/572209465 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 896506810 0 0) 0x7f04e006be50 con 0x7f04e00ccd50 2024-09-13T18:33:11.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04deffd700 1 -- 172.21.15.44:0/572209465 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04e00b3f50 con 0x7f04e00ccd50 2024-09-13T18:33:11.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04deffd700 1 -- 172.21.15.44:0/572209465 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 397018916 0 0) 0x7f04c80035d0 con 0x7f04e01436c0 2024-09-13T18:33:11.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04deffd700 1 -- 172.21.15.44:0/572209465 >> v2:172.21.15.44:3300/0 conn(0x7f04e00b4bd0 msgr2=0x7f04e0164840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:11.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04deffd700 1 --2- 172.21.15.44:0/572209465 >> v2:172.21.15.44:3300/0 conn(0x7f04e00b4bd0 0x7f04e0164840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:11.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04deffd700 1 -- 172.21.15.44:0/572209465 >> v1:172.21.15.99:6789/0 conn(0x7f04e00ccd50 legacy=0x7f04e00b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04deffd700 1 -- 172.21.15.44:0/572209465 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e006c130 con 0x7f04e01436c0 2024-09-13T18:33:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04deffd700 1 -- 172.21.15.44:0/572209465 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f04d0001670 con 0x7f04e01436c0 2024-09-13T18:33:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04deffd700 1 -- 172.21.15.44:0/572209465 >> v1:172.21.15.44:6789/0 conn(0x7f04e01436c0 legacy=0x7f04e00b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04deffd700 1 --2- 172.21.15.44:0/572209465 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04c8003bb0 0x7f04c8003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04deffd700 1 --2- 172.21.15.44:0/572209465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04c8004870 0x7f04c8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04deffd700 1 --2- 172.21.15.44:0/572209465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04c8005230 0x7f04c800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04deffd700 1 -- 172.21.15.44:0/572209465 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e00b4230 con 0x7f04c8005230 2024-09-13T18:33:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04deffd700 1 -- 172.21.15.44:0/572209465 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c800c0b0 con 0x7f04c8004870 2024-09-13T18:33:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.859+0000 7f04deffd700 1 -- 172.21.15.44:0/572209465 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c800c270 con 0x7f04c8003bb0 2024-09-13T18:33:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.863+0000 7f04dffff700 1 --2- 172.21.15.44:0/572209465 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04c8003bb0 0x7f04c8003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.863+0000 7f04e4f1a700 1 --2- 172.21.15.44:0/572209465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04c8005230 0x7f04c800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.863+0000 7f04df7fe700 1 --2- 172.21.15.44:0/572209465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04c8004870 0x7f04c8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.863+0000 7f04dffff700 1 -- 172.21.15.44:0/572209465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04c8004870 msgr2=0x7f04c8004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.863+0000 7f04dffff700 1 --2- 172.21.15.44:0/572209465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04c8004870 0x7f04c8004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.863+0000 7f04dffff700 1 -- 172.21.15.44:0/572209465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04c8005230 msgr2=0x7f04c800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.863+0000 7f04dffff700 1 --2- 172.21.15.44:0/572209465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04c8005230 0x7f04c800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.863+0000 7f04dffff700 1 -- 172.21.15.44:0/572209465 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c80035d0 con 0x7f04c8003bb0 2024-09-13T18:33:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.863+0000 7f04e4f1a700 1 -- 172.21.15.44:0/572209465 reap_dead start 2024-09-13T18:33:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.863+0000 7f04dffff700 1 --2- 172.21.15.44:0/572209465 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04c8003bb0 0x7f04c8003fb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f04d0007fd0 tx=0x7f04c80058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5c8846687b9705f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.863+0000 7f04deffd700 1 -- 172.21.15.44:0/572209465 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d000cd80 con 0x7f04c8003bb0 2024-09-13T18:33:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.863+0000 7f04deffd700 1 -- 172.21.15.44:0/572209465 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d0001af0 con 0x7f04c8003bb0 2024-09-13T18:33:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.863+0000 7f04deffd700 1 -- 172.21.15.44:0/572209465 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0005bc0 con 0x7f04c8003bb0 2024-09-13T18:33:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.867+0000 7f04e697d700 1 -- 172.21.15.44:0/572209465 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04c8003bb0 msgr2=0x7f04c8003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.867+0000 7f04e697d700 1 --2- 172.21.15.44:0/572209465 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04c8003bb0 0x7f04c8003fb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f04d0007fd0 tx=0x7f04c80058a0 comp rx=0 tx=0).stop 2024-09-13T18:33:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.867+0000 7f04e697d700 1 -- 172.21.15.44:0/572209465 shutdown_connections 2024-09-13T18:33:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.867+0000 7f04e697d700 1 --2- 172.21.15.44:0/572209465 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04c8003bb0 0x7f04c8003fb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.867+0000 7f04e697d700 1 -- 172.21.15.44:0/572209465 >> 172.21.15.44:0/572209465 conn(0x7f04e0070d00 msgr2=0x7f04e0071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.867+0000 7f04e697d700 1 -- 172.21.15.44:0/572209465 shutdown_connections 2024-09-13T18:33:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.867+0000 7f04e697d700 1 -- 172.21.15.44:0/572209465 wait complete. 2024-09-13T18:33:11.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.867+0000 7f04e697d700 1 Processor -- start 2024-09-13T18:33:11.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.867+0000 7f04e697d700 1 -- start start 2024-09-13T18:33:11.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.871+0000 7f04e697d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04c8003bb0 0x7f04e0157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:11.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.871+0000 7f04e697d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04e006ae10 0x7f04e013e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:11.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.871+0000 7f04e697d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04e013eef0 0x7f04e0138ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:11.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.871+0000 7f04e697d700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e013f390 con 0x7f04e013eef0 2024-09-13T18:33:11.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.871+0000 7f04e697d700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e013f670 con 0x7f04c8003bb0 2024-09-13T18:33:11.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.871+0000 7f04e697d700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e0157600 con 0x7f04e006ae10 2024-09-13T18:33:11.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.871+0000 7f04e4f1a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04e013eef0 0x7f04e0138ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:11.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.871+0000 7f04e4f1a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04e013eef0 0x7f04e0138ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39298/0 (socket says 172.21.15.44:39298) 2024-09-13T18:33:11.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.871+0000 7f04e4f1a700 1 -- 172.21.15.44:0/1927488182 learned_addr learned my addr 172.21.15.44:0/1927488182 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:11.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.871+0000 7f04dffff700 1 --2- 172.21.15.44:0/1927488182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04c8003bb0 0x7f04e0157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:11.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.871+0000 7f04df7fe700 1 --2- 172.21.15.44:0/1927488182 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04e006ae10 0x7f04e013e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:11.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.871+0000 7f04e4f1a700 1 -- 172.21.15.44:0/1927488182 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04e006ae10 msgr2=0x7f04e013e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:11.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.871+0000 7f04e4f1a700 1 --2- 172.21.15.44:0/1927488182 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04e006ae10 0x7f04e013e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:11.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.871+0000 7f04e4f1a700 1 -- 172.21.15.44:0/1927488182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04c8003bb0 msgr2=0x7f04e0157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:11.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.871+0000 7f04e4f1a700 1 --2- 172.21.15.44:0/1927488182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04c8003bb0 0x7f04e0157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:11.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.871+0000 7f04e4f1a700 1 -- 172.21.15.44:0/1927488182 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e01578e0 con 0x7f04e013eef0 2024-09-13T18:33:11.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.871+0000 7f04e4f1a700 1 --2- 172.21.15.44:0/1927488182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04e013eef0 0x7f04e0138ff0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f04c80047f0 tx=0x7f04d8011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:11.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.871+0000 7f04dcff9700 1 -- 172.21.15.44:0/1927488182 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d800e040 con 0x7f04e013eef0 2024-09-13T18:33:11.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.871+0000 7f04dcff9700 1 -- 172.21.15.44:0/1927488182 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d800f040 con 0x7f04e013eef0 2024-09-13T18:33:11.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.871+0000 7f04e697d700 1 -- 172.21.15.44:0/1927488182 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e0158340 con 0x7f04e013eef0 2024-09-13T18:33:11.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.871+0000 7f04dcff9700 1 -- 172.21.15.44:0/1927488182 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d800fd00 con 0x7f04e013eef0 2024-09-13T18:33:11.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.871+0000 7f04e697d700 1 -- 172.21.15.44:0/1927488182 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e0156e40 con 0x7f04e013eef0 2024-09-13T18:33:11.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.871+0000 7f04e697d700 1 -- 172.21.15.44:0/1927488182 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e004e7c0 con 0x7f04e013eef0 2024-09-13T18:33:11.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.875+0000 7f04dcff9700 1 -- 172.21.15.44:0/1927488182 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f04d8022460 con 0x7f04e013eef0 2024-09-13T18:33:11.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.875+0000 7f04dcff9700 1 --2- 172.21.15.44:0/1927488182 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f04cc066730 0x7f04cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:11.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.875+0000 7f04dcff9700 1 -- 172.21.15.44:0/1927488182 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f04d80844d0 con 0x7f04e013eef0 2024-09-13T18:33:11.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.875+0000 7f04dffff700 1 --2- 172.21.15.44:0/1927488182 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f04cc066730 0x7f04cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:11.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.875+0000 7f04dffff700 1 --2- 172.21.15.44:0/1927488182 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f04cc066730 0x7f04cc068bf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f04d0000c00 tx=0x7f04d000a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:11.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:11.883+0000 7f04dcff9700 1 -- 172.21.15.44:0/1927488182 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f04d8051ad0 con 0x7f04e013eef0 2024-09-13T18:33:12.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:12.067+0000 7f04e697d700 1 -- 172.21.15.44:0/1927488182 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f04e0157b00 con 0x7f04e013eef0 2024-09-13T18:33:12.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:12.879+0000 7f04dcff9700 1 -- 172.21.15.44:0/1927488182 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v59) v1 ==== 97+0+0 (secure 0 0 0) 0x7f04d80550f0 con 0x7f04e013eef0 2024-09-13T18:33:12.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:12.883+0000 7f04e697d700 1 -- 172.21.15.44:0/1927488182 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f04cc066730 msgr2=0x7f04cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:12.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:12.883+0000 7f04e697d700 1 --2- 172.21.15.44:0/1927488182 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f04cc066730 0x7f04cc068bf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f04d0000c00 tx=0x7f04d000a000 comp rx=0 tx=0).stop 2024-09-13T18:33:12.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:12.883+0000 7f04e697d700 1 -- 172.21.15.44:0/1927488182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04e013eef0 msgr2=0x7f04e0138ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:12.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:12.883+0000 7f04e697d700 1 --2- 172.21.15.44:0/1927488182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04e013eef0 0x7f04e0138ff0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f04c80047f0 tx=0x7f04d8011ed0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:12.887+0000 7f04e697d700 1 -- 172.21.15.44:0/1927488182 shutdown_connections 2024-09-13T18:33:12.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:12.887+0000 7f04e697d700 1 --2- 172.21.15.44:0/1927488182 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f04cc066730 0x7f04cc068bf0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:12.887+0000 7f04e697d700 1 --2- 172.21.15.44:0/1927488182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04e013eef0 0x7f04e0138ff0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:12.887+0000 7f04e697d700 1 --2- 172.21.15.44:0/1927488182 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04e006ae10 0x7f04e013e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:12.887+0000 7f04e697d700 1 --2- 172.21.15.44:0/1927488182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04c8003bb0 0x7f04e0157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:12.887+0000 7f04e697d700 1 -- 172.21.15.44:0/1927488182 >> 172.21.15.44:0/1927488182 conn(0x7f04e0070d00 msgr2=0x7f04e00af6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:12.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:12.887+0000 7f04e697d700 1 -- 172.21.15.44:0/1927488182 shutdown_connections 2024-09-13T18:33:12.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:12.887+0000 7f04e697d700 1 -- 172.21.15.44:0/1927488182 wait complete. 2024-09-13T18:33:12.893 INFO:teuthology.orchestra.run.smithi044.stderr: removed all blocklist entries 2024-09-13T18:33:12.907 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:33:13.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.071+0000 7fbf3e2ae700 1 Processor -- start 2024-09-13T18:33:13.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.071+0000 7fbf3e2ae700 1 -- start start 2024-09-13T18:33:13.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.071+0000 7fbf3e2ae700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbf380b3ae0 0x7fbf3806a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.071+0000 7fbf3e2ae700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbf3806aaf0 0x7fbf3815e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.071+0000 7fbf3e2ae700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf3813dcb0 con 0x7fbf3806bbf0 2024-09-13T18:33:13.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.071+0000 7fbf3e2ae700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf3815be60 con 0x7fbf380b3ae0 2024-09-13T18:33:13.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.071+0000 7fbf3e2ae700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf3813ffd0 con 0x7fbf3806aaf0 2024-09-13T18:33:13.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.071+0000 7fbf3caab700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbf380b3ae0 0x7fbf3806a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.071+0000 7fbf3d2ac700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fbf3806bbf0 0x7fbf380b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51152/0 (socket says 172.21.15.44:51152) 2024-09-13T18:33:13.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.071+0000 7fbf3d2ac700 1 -- 172.21.15.44:0/1823309217 learned_addr learned my addr 172.21.15.44:0/1823309217 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:13.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.075+0000 7fbf3daad700 1 --2- 172.21.15.44:0/1823309217 >> v2:172.21.15.99:3300/0 conn(0x7fbf3806aaf0 0x7fbf3815e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.075+0000 7fbf3caab700 1 -- 172.21.15.44:0/1823309217 >> v2:172.21.15.99:3300/0 conn(0x7fbf3806aaf0 msgr2=0x7fbf3815e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:13.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.075+0000 7fbf3caab700 1 --2- 172.21.15.44:0/1823309217 >> v2:172.21.15.99:3300/0 conn(0x7fbf3806aaf0 0x7fbf3815e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.075+0000 7fbf3caab700 1 -- 172.21.15.44:0/1823309217 >> v1:172.21.15.44:6789/0 conn(0x7fbf3806bbf0 legacy=0x7fbf380b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:13.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.075+0000 7fbf2ffff700 1 -- 172.21.15.44:0/1823309217 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2578052798 0 0) 0x7fbf3813dcb0 con 0x7fbf3806bbf0 2024-09-13T18:33:13.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.075+0000 7fbf3caab700 1 -- 172.21.15.44:0/1823309217 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf38140220 con 0x7fbf380b3ae0 2024-09-13T18:33:13.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.075+0000 7fbf3daad700 1 --2- 172.21.15.44:0/1823309217 >> v2:172.21.15.99:3300/0 conn(0x7fbf3806aaf0 0x7fbf3815e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:13.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.075+0000 7fbf3caab700 1 --2- 172.21.15.44:0/1823309217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf380b3ae0 0x7fbf3806a5b0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fbf3815e380 tx=0x7fbf34009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2815ae0eae901c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:13.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.075+0000 7fbf2ffff700 1 -- 172.21.15.44:0/1823309217 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34011830 con 0x7fbf380b3ae0 2024-09-13T18:33:13.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.075+0000 7fbf2ffff700 1 -- 172.21.15.44:0/1823309217 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf34011990 con 0x7fbf380b3ae0 2024-09-13T18:33:13.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.075+0000 7fbf2ffff700 1 -- 172.21.15.44:0/1823309217 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34011d40 con 0x7fbf380b3ae0 2024-09-13T18:33:13.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.075+0000 7fbf3e2ae700 1 -- 172.21.15.44:0/1823309217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf380b3ae0 msgr2=0x7fbf3806a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:13.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.075+0000 7fbf3e2ae700 1 --2- 172.21.15.44:0/1823309217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf380b3ae0 0x7fbf3806a5b0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fbf3815e380 tx=0x7fbf34009b30 comp rx=0 tx=0).stop 2024-09-13T18:33:13.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.075+0000 7fbf3e2ae700 1 -- 172.21.15.44:0/1823309217 shutdown_connections 2024-09-13T18:33:13.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.075+0000 7fbf3e2ae700 1 --2- 172.21.15.44:0/1823309217 >> v2:172.21.15.99:3300/0 conn(0x7fbf3806aaf0 0x7fbf3815e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.075+0000 7fbf3e2ae700 1 --2- 172.21.15.44:0/1823309217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf380b3ae0 0x7fbf3806a5b0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.075+0000 7fbf3e2ae700 1 -- 172.21.15.44:0/1823309217 >> 172.21.15.44:0/1823309217 conn(0x7fbf380b0f00 msgr2=0x7fbf380b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:13.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.075+0000 7fbf3e2ae700 1 -- 172.21.15.44:0/1823309217 shutdown_connections 2024-09-13T18:33:13.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.075+0000 7fbf3e2ae700 1 -- 172.21.15.44:0/1823309217 wait complete. 2024-09-13T18:33:13.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.075+0000 7fbf3e2ae700 1 Processor -- start 2024-09-13T18:33:13.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.075+0000 7fbf3e2ae700 1 -- start start 2024-09-13T18:33:13.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.079+0000 7fbf3e2ae700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf3806aaf0 0x7fbf381580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.079+0000 7fbf3e2ae700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf3806bbf0 0x7fbf380a9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.079+0000 7fbf3e2ae700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf380b3ae0 0x7fbf3813ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.079+0000 7fbf3e2ae700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf381573a0 con 0x7fbf380b3ae0 2024-09-13T18:33:13.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.079+0000 7fbf3e2ae700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf380a9bb0 con 0x7fbf3806aaf0 2024-09-13T18:33:13.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.079+0000 7fbf3e2ae700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf381575f0 con 0x7fbf3806bbf0 2024-09-13T18:33:13.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.079+0000 7fbf3daad700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf380b3ae0 0x7fbf3813ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.079+0000 7fbf3d2ac700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf3806aaf0 0x7fbf381580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.079+0000 7fbf3daad700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf380b3ae0 0x7fbf3813ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42472/0 (socket says 172.21.15.44:42472) 2024-09-13T18:33:13.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.079+0000 7fbf3daad700 1 -- 172.21.15.44:0/2374349817 learned_addr learned my addr 172.21.15.44:0/2374349817 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:13.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.079+0000 7fbf3caab700 1 --2- 172.21.15.44:0/2374349817 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf3806bbf0 0x7fbf380a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.079+0000 7fbf3daad700 1 -- 172.21.15.44:0/2374349817 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf3806bbf0 msgr2=0x7fbf380a9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:13.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.079+0000 7fbf3daad700 1 --2- 172.21.15.44:0/2374349817 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf3806bbf0 0x7fbf380a9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.079+0000 7fbf3daad700 1 -- 172.21.15.44:0/2374349817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf3806aaf0 msgr2=0x7fbf381580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:13.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.079+0000 7fbf3daad700 1 --2- 172.21.15.44:0/2374349817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf3806aaf0 0x7fbf381580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.079+0000 7fbf3daad700 1 -- 172.21.15.44:0/2374349817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf340094b0 con 0x7fbf380b3ae0 2024-09-13T18:33:13.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.079+0000 7fbf3daad700 1 --2- 172.21.15.44:0/2374349817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf380b3ae0 0x7fbf3813ead0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fbf30009fa0 tx=0x7fbf3000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:13.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.079+0000 7fbf2dffb700 1 -- 172.21.15.44:0/2374349817 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3000ddb0 con 0x7fbf380b3ae0 2024-09-13T18:33:13.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.079+0000 7fbf2dffb700 1 -- 172.21.15.44:0/2374349817 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3000f040 con 0x7fbf380b3ae0 2024-09-13T18:33:13.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.079+0000 7fbf3e2ae700 1 -- 172.21.15.44:0/2374349817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf381578d0 con 0x7fbf380b3ae0 2024-09-13T18:33:13.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.079+0000 7fbf2dffb700 1 -- 172.21.15.44:0/2374349817 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf30003c80 con 0x7fbf380b3ae0 2024-09-13T18:33:13.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.079+0000 7fbf3e2ae700 1 -- 172.21.15.44:0/2374349817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf38158610 con 0x7fbf380b3ae0 2024-09-13T18:33:13.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.083+0000 7fbf3e2ae700 1 -- 172.21.15.44:0/2374349817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf38157df0 con 0x7fbf380b3ae0 2024-09-13T18:33:13.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.083+0000 7fbf2dffb700 1 -- 172.21.15.44:0/2374349817 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbf30004030 con 0x7fbf380b3ae0 2024-09-13T18:33:13.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.083+0000 7fbf2dffb700 1 --2- 172.21.15.44:0/2374349817 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbf1c066730 0x7fbf1c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.083+0000 7fbf2dffb700 1 -- 172.21.15.44:0/2374349817 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbf30083eb0 con 0x7fbf380b3ae0 2024-09-13T18:33:13.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.083+0000 7fbf3d2ac700 1 --2- 172.21.15.44:0/2374349817 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbf1c066730 0x7fbf1c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.083+0000 7fbf3d2ac700 1 --2- 172.21.15.44:0/2374349817 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbf1c066730 0x7fbf1c068bf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbf28000f60 tx=0x7fbf28007e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:13.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.091+0000 7fbf2dffb700 1 -- 172.21.15.44:0/2374349817 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbf38157df0 con 0x7fbf380b3ae0 2024-09-13T18:33:13.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.319+0000 7fbf3e2ae700 1 -- 172.21.15.44:0/2374349817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbf38157df0 con 0x7fbf380b3ae0 2024-09-13T18:33:13.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.323+0000 7fbf2dffb700 1 -- 172.21.15.44:0/2374349817 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fbf38157df0 con 0x7fbf380b3ae0 2024-09-13T18:33:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:33:13.329 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:33:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_dump": [ 2024-09-13T18:33:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:33:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.a", 2024-09-13T18:33:13.329 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rmm4/RGxAAtGPYfgzYpmE4yHhoggZJ8Q==", 2024-09-13T18:33:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:33:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:33:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:33:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:33:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:33:13.330 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:33:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:33:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:33:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.b", 2024-09-13T18:33:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rm8qC+JhAAhdkL3zbxM9+GI8+khy+cSg==", 2024-09-13T18:33:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:33:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:33:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:33:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:33:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:33:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:33:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:33:13.331 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:33:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.c", 2024-09-13T18:33:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rmr/OCIhAAvBF106ILl0AZlzCZ+S990Q==", 2024-09-13T18:33:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:33:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:33:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:33:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:33:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:33:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:33:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:33:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:33:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.d", 2024-09-13T18:33:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+RmSHbxKRAAAGsAWnIPUDUk3Y0aYryf+w==", 2024-09-13T18:33:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:33:13.332 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:33:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:33:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:33:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:33:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:33:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:33:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:33:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.0", 2024-09-13T18:33:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC6g+Rmw8xKHxAArYof7SeFMvQGq5AnVMbiog==", 2024-09-13T18:33:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:33:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:33:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:33:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:33:13.333 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:33:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:33:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.1", 2024-09-13T18:33:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC9g+RmLRFsMxAAC0SXlbIRvFc3byOy742GSg==", 2024-09-13T18:33:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:33:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:33:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:33:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:33:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:33:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:33:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.2", 2024-09-13T18:33:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDAg+RmvbTXNxAAyoLLo9RMD7817x8cdlYjWg==", 2024-09-13T18:33:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:33:13.334 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:33:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:33:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:33:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:33:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:33:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.3", 2024-09-13T18:33:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDDg+Rm4/jKOhAAYVOXNUkd3Z9CXAzbxJw34g==", 2024-09-13T18:33:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:33:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:33:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:33:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:33:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:33:13.335 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:33:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.4", 2024-09-13T18:33:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDJg+RmEZwhJBAAqtUZtMmRzRulAa6cnyvSmQ==", 2024-09-13T18:33:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:33:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:33:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:33:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:33:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:33:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:33:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.5", 2024-09-13T18:33:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDMg+RmCqBKKRAA7oP48mScYw7mkNGahg+ptw==", 2024-09-13T18:33:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:33:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:33:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:33:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:33:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:33:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:33:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.6", 2024-09-13T18:33:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDPg+RmbjDyLxAAIRb9i9TtRsDg+M9SnEegug==", 2024-09-13T18:33:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:33:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:13.337 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:33:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:33:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:33:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:33:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:33:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.7", 2024-09-13T18:33:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDSg+RmA4v7NhAAVe6GV0DVksIWiq6KQvMgVg==", 2024-09-13T18:33:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:33:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:33:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:33:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:33:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:33:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:33:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.0", 2024-09-13T18:33:13.338 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rm7FEGMBAAosZ34edcGJmTiY8UhPtung==", 2024-09-13T18:33:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:33:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:33:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow r", 2024-09-13T18:33:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:33:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:33:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:33:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:33:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.1", 2024-09-13T18:33:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rmpu2zNhAAc0mOfL8c/MYij8KYpvsjRw==", 2024-09-13T18:33:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:33:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:33:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-13T18:33:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-13T18:33:13.339 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-13T18:33:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:33:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:33:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:33:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.2", 2024-09-13T18:33:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rm0xw5MxAAWu4i4+IAjW5QzQwiILs6bg==", 2024-09-13T18:33:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:33:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:33:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-13T18:33:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-13T18:33:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-13T18:33:13.340 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:33:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:33:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:33:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.3", 2024-09-13T18:33:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+RmZdTZORAA26aYb0Nz0g+rRBG+zAu/EQ==", 2024-09-13T18:33:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:33:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:33:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-13T18:33:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-13T18:33:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-13T18:33:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:33:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:33:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:33:13.341 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.admin", 2024-09-13T18:33:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+RmVt6IDBAALp4ZMLL2ehaE9O4vCSZzxQ==", 2024-09-13T18:33:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:33:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-13T18:33:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:33:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:33:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:33:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:33:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:33:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:33:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.x", 2024-09-13T18:33:13.342 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+RmBmEBGBAARTj0TQ0laAEW0n888vMZrA==", 2024-09-13T18:33:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:33:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-13T18:33:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-13T18:33:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:33:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:33:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:33:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:33:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.y", 2024-09-13T18:33:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rm1KSoFBAALCTzYRRxF7MPxQHL3ETGqQ==", 2024-09-13T18:33:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:33:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-13T18:33:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-13T18:33:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:33:13.343 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:33:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:33:13.344 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-13T18:33:13.344 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:33:13.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.323+0000 7fbf3e2ae700 1 -- 172.21.15.44:0/2374349817 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbf1c066730 msgr2=0x7fbf1c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:13.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.323+0000 7fbf3e2ae700 1 --2- 172.21.15.44:0/2374349817 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbf1c066730 0x7fbf1c068bf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbf28000f60 tx=0x7fbf28007e00 comp rx=0 tx=0).stop 2024-09-13T18:33:13.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.323+0000 7fbf3e2ae700 1 -- 172.21.15.44:0/2374349817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf380b3ae0 msgr2=0x7fbf3813ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:13.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.323+0000 7fbf3e2ae700 1 --2- 172.21.15.44:0/2374349817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf380b3ae0 0x7fbf3813ead0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fbf30009fa0 tx=0x7fbf3000d3b0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.323+0000 7fbf3e2ae700 1 -- 172.21.15.44:0/2374349817 shutdown_connections 2024-09-13T18:33:13.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.323+0000 7fbf3e2ae700 1 --2- 172.21.15.44:0/2374349817 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbf1c066730 0x7fbf1c068bf0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.323+0000 7fbf3e2ae700 1 --2- 172.21.15.44:0/2374349817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf380b3ae0 0x7fbf3813ead0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.323+0000 7fbf3e2ae700 1 --2- 172.21.15.44:0/2374349817 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf3806bbf0 0x7fbf380a9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.323+0000 7fbf3e2ae700 1 --2- 172.21.15.44:0/2374349817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf3806aaf0 0x7fbf381580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.323+0000 7fbf3e2ae700 1 -- 172.21.15.44:0/2374349817 >> 172.21.15.44:0/2374349817 conn(0x7fbf380b0f00 msgr2=0x7fbf3815a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:13.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.323+0000 7fbf3e2ae700 1 -- 172.21.15.44:0/2374349817 shutdown_connections 2024-09-13T18:33:13.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.323+0000 7fbf3e2ae700 1 -- 172.21.15.44:0/2374349817 wait complete. 2024-09-13T18:33:13.347 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:13.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.455+0000 7f261d2a7700 1 Processor -- start 2024-09-13T18:33:13.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.459+0000 7f261d2a7700 1 -- start start 2024-09-13T18:33:13.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.459+0000 7f261d2a7700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f261815d470 0x7f26180707c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.459+0000 7f261d2a7700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f261815d850 0x7f261815dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.459+0000 7f261d2a7700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2618070d00 con 0x7f26180b31c0 2024-09-13T18:33:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.459+0000 7f261d2a7700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2618070fa0 con 0x7f261815d850 2024-09-13T18:33:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.459+0000 7f261d2a7700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2618071280 con 0x7f261815d470 2024-09-13T18:33:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.459+0000 7f2617fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f261815d470 0x7f26180707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.459+0000 7f260ffff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f261815d850 0x7f261815dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.459+0000 7f261caa6700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f26180b31c0 0x7f2618160680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:51646/0 (socket says 172.21.15.44:51646) 2024-09-13T18:33:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.459+0000 7f261caa6700 1 -- 172.21.15.44:0/899457871 learned_addr learned my addr 172.21.15.44:0/899457871 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.459+0000 7f2617fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f261815d470 0x7f26180707c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:34458/0 (socket says 172.21.15.44:34458) 2024-09-13T18:33:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.459+0000 7f2617fff700 1 -- 172.21.15.44:0/899457871 >> v2:172.21.15.99:3300/0 conn(0x7f261815d850 msgr2=0x7f261815dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.459+0000 7f2617fff700 1 --2- 172.21.15.44:0/899457871 >> v2:172.21.15.99:3300/0 conn(0x7f261815d850 0x7f261815dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.459+0000 7f2617fff700 1 -- 172.21.15.44:0/899457871 >> v1:172.21.15.99:6789/0 conn(0x7f26180b31c0 legacy=0x7f2618160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.459+0000 7f2617fff700 1 -- 172.21.15.44:0/899457871 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2618071560 con 0x7f261815d470 2024-09-13T18:33:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.459+0000 7f26177fe700 1 -- 172.21.15.44:0/899457871 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195727430 0 0) 0x7f2618070d00 con 0x7f26180b31c0 2024-09-13T18:33:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.459+0000 7f2617fff700 1 --2- 172.21.15.44:0/899457871 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f261815d470 0x7f26180707c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2608009850 tx=0x7f2608009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eeda3dbc38b0d37b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.463+0000 7f26177fe700 1 -- 172.21.15.44:0/899457871 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2608011830 con 0x7f261815d470 2024-09-13T18:33:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.463+0000 7f26177fe700 1 -- 172.21.15.44:0/899457871 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2608011990 con 0x7f261815d470 2024-09-13T18:33:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.463+0000 7f26177fe700 1 -- 172.21.15.44:0/899457871 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2608011d40 con 0x7f261815d470 2024-09-13T18:33:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.463+0000 7f261d2a7700 1 -- 172.21.15.44:0/899457871 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f261815d470 msgr2=0x7f26180707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.463+0000 7f261d2a7700 1 --2- 172.21.15.44:0/899457871 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f261815d470 0x7f26180707c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2608009850 tx=0x7f2608009b60 comp rx=0 tx=0).stop 2024-09-13T18:33:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.463+0000 7f261d2a7700 1 -- 172.21.15.44:0/899457871 shutdown_connections 2024-09-13T18:33:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.463+0000 7f261d2a7700 1 --2- 172.21.15.44:0/899457871 >> v2:172.21.15.99:3300/0 conn(0x7f261815d850 0x7f261815dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.463+0000 7f261d2a7700 1 --2- 172.21.15.44:0/899457871 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f261815d470 0x7f26180707c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.463+0000 7f261d2a7700 1 -- 172.21.15.44:0/899457871 >> 172.21.15.44:0/899457871 conn(0x7f261806d900 msgr2=0x7f261806dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.463+0000 7f261d2a7700 1 -- 172.21.15.44:0/899457871 shutdown_connections 2024-09-13T18:33:13.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.463+0000 7f261d2a7700 1 -- 172.21.15.44:0/899457871 wait complete. 2024-09-13T18:33:13.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.463+0000 7f261d2a7700 1 Processor -- start 2024-09-13T18:33:13.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.463+0000 7f261d2a7700 1 -- start start 2024-09-13T18:33:13.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.467+0000 7f261d2a7700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26180b31c0 0x7f26180cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.467+0000 7f261d2a7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f261815d470 0x7f261806bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.467+0000 7f261d2a7700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f261815d850 0x7f261806c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.467+0000 7f261d2a7700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2618145300 con 0x7f261815d470 2024-09-13T18:33:13.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.467+0000 7f261d2a7700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2618144680 con 0x7f261815d850 2024-09-13T18:33:13.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.467+0000 7f261d2a7700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2618144960 con 0x7f26180b31c0 2024-09-13T18:33:13.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.467+0000 7f260ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f261815d470 0x7f261806bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.467+0000 7f260ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f261815d470 0x7f261806bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42488/0 (socket says 172.21.15.44:42488) 2024-09-13T18:33:13.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.467+0000 7f260ffff700 1 -- 172.21.15.44:0/3998100042 learned_addr learned my addr 172.21.15.44:0/3998100042 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:13.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.467+0000 7f2617fff700 1 --2- 172.21.15.44:0/3998100042 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26180b31c0 0x7f26180cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.467+0000 7f261caa6700 1 --2- 172.21.15.44:0/3998100042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f261815d850 0x7f261806c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.467+0000 7f260ffff700 1 -- 172.21.15.44:0/3998100042 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26180b31c0 msgr2=0x7f26180cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:13.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.467+0000 7f260ffff700 1 --2- 172.21.15.44:0/3998100042 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26180b31c0 0x7f26180cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.467+0000 7f260ffff700 1 -- 172.21.15.44:0/3998100042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f261815d850 msgr2=0x7f261806c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:13.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.467+0000 7f260ffff700 1 --2- 172.21.15.44:0/3998100042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f261815d850 0x7f261806c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.467+0000 7f260ffff700 1 -- 172.21.15.44:0/3998100042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26080094b0 con 0x7f261815d470 2024-09-13T18:33:13.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.467+0000 7f260ffff700 1 --2- 172.21.15.44:0/3998100042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f261815d470 0x7f261806bb90 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f260000e840 tx=0x7f260000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:13.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.467+0000 7f26157fa700 1 -- 172.21.15.44:0/3998100042 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26000095a0 con 0x7f261815d470 2024-09-13T18:33:13.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.467+0000 7f26157fa700 1 -- 172.21.15.44:0/3998100042 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260000c690 con 0x7f261815d470 2024-09-13T18:33:13.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.467+0000 7f261d2a7700 1 -- 172.21.15.44:0/3998100042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2618144c40 con 0x7f261815d470 2024-09-13T18:33:13.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.467+0000 7f26157fa700 1 -- 172.21.15.44:0/3998100042 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260000ca00 con 0x7f261815d470 2024-09-13T18:33:13.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.467+0000 7f261d2a7700 1 -- 172.21.15.44:0/3998100042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26181f5570 con 0x7f261815d470 2024-09-13T18:33:13.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.467+0000 7f261d2a7700 1 -- 172.21.15.44:0/3998100042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261815dc90 con 0x7f261815d470 2024-09-13T18:33:13.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.471+0000 7f26157fa700 1 -- 172.21.15.44:0/3998100042 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f260000cb60 con 0x7f261815d470 2024-09-13T18:33:13.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.471+0000 7f26157fa700 1 --2- 172.21.15.44:0/3998100042 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f25f8066730 0x7f25f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.471+0000 7f26157fa700 1 -- 172.21.15.44:0/3998100042 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2600083dd0 con 0x7f261815d470 2024-09-13T18:33:13.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.471+0000 7f2617fff700 1 --2- 172.21.15.44:0/3998100042 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f25f8066730 0x7f25f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.471+0000 7f2617fff700 1 --2- 172.21.15.44:0/3998100042 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f25f8066730 0x7f25f8068bf0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f26080090b0 tx=0x7f2608008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:13.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.479+0000 7f26157fa700 1 -- 172.21.15.44:0/3998100042 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2600051520 con 0x7f261815d470 2024-09-13T18:33:13.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.651+0000 7f261d2a7700 1 -- 172.21.15.44:0/3998100042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26180aea00 con 0x7f261815d470 2024-09-13T18:33:13.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.651+0000 7f26157fa700 1 -- 172.21.15.44:0/3998100042 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+12797 (secure 0 0 0) 0x7f2600054b40 con 0x7f261815d470 2024-09-13T18:33:13.657 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:33:13.658 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":59,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:33:12.877428+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:13.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.651+0000 7f261d2a7700 1 -- 172.21.15.44:0/3998100042 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f25f8066730 msgr2=0x7f25f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:13.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.651+0000 7f261d2a7700 1 --2- 172.21.15.44:0/3998100042 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f25f8066730 0x7f25f8068bf0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f26080090b0 tx=0x7f2608008030 comp rx=0 tx=0).stop 2024-09-13T18:33:13.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.651+0000 7f261d2a7700 1 -- 172.21.15.44:0/3998100042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f261815d470 msgr2=0x7f261806bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:13.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.651+0000 7f261d2a7700 1 --2- 172.21.15.44:0/3998100042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f261815d470 0x7f261806bb90 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f260000e840 tx=0x7f260000ec00 comp rx=0 tx=0).stop 2024-09-13T18:33:13.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.651+0000 7f261d2a7700 1 -- 172.21.15.44:0/3998100042 shutdown_connections 2024-09-13T18:33:13.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.651+0000 7f261d2a7700 1 --2- 172.21.15.44:0/3998100042 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f25f8066730 0x7f25f8068bf0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.651+0000 7f261d2a7700 1 --2- 172.21.15.44:0/3998100042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f261815d850 0x7f261806c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.651+0000 7f261d2a7700 1 --2- 172.21.15.44:0/3998100042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f261815d470 0x7f261806bb90 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.651+0000 7f261d2a7700 1 --2- 172.21.15.44:0/3998100042 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26180b31c0 0x7f26180cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.651+0000 7f261d2a7700 1 -- 172.21.15.44:0/3998100042 >> 172.21.15.44:0/3998100042 conn(0x7f261806d900 msgr2=0x7f2618160ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:13.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.655+0000 7f261d2a7700 1 -- 172.21.15.44:0/3998100042 shutdown_connections 2024-09-13T18:33:13.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.655+0000 7f261d2a7700 1 -- 172.21.15.44:0/3998100042 wait complete. 2024-09-13T18:33:13.674 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:33:13.674 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:33:13.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3b0e494700 1 Processor -- start 2024-09-13T18:33:13.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3b0e494700 1 -- start start 2024-09-13T18:33:13.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3b0e494700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b081461e0 0x7f3b080b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3b0e494700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3b080b30c0 0x7f3b081465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3b0e494700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3b08146b00 0x7f3b08164b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3b0e494700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b080b4720 con 0x7f3b080b30c0 2024-09-13T18:33:13.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3b0e494700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b08144330 con 0x7f3b08146b00 2024-09-13T18:33:13.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3b0e494700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b080b3680 con 0x7f3b081461e0 2024-09-13T18:33:13.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3aff7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3b080b30c0 0x7f3b081465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3aff7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3b080b30c0 0x7f3b081465c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42502/0 (socket says 172.21.15.44:42502) 2024-09-13T18:33:13.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3aff7fe700 1 -- 172.21.15.44:0/551423712 learned_addr learned my addr 172.21.15.44:0/551423712 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:13.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3b07fff700 1 --2- 172.21.15.44:0/551423712 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b081461e0 0x7f3b080b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3b0ca31700 1 --2- 172.21.15.44:0/551423712 >> v2:172.21.15.99:3300/0 conn(0x7f3b08146b00 0x7f3b08164b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3aff7fe700 1 -- 172.21.15.44:0/551423712 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b081461e0 msgr2=0x7f3b080b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:13.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3aff7fe700 1 --2- 172.21.15.44:0/551423712 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b081461e0 0x7f3b080b2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3aff7fe700 1 -- 172.21.15.44:0/551423712 >> v2:172.21.15.99:3300/0 conn(0x7f3b08146b00 msgr2=0x7f3b08164b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:13.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3aff7fe700 1 --2- 172.21.15.44:0/551423712 >> v2:172.21.15.99:3300/0 conn(0x7f3b08146b00 0x7f3b08164b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3aff7fe700 1 -- 172.21.15.44:0/551423712 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b080b3960 con 0x7f3b080b30c0 2024-09-13T18:33:13.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3aff7fe700 1 --2- 172.21.15.44:0/551423712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b080b30c0 0x7f3b081465c0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f3b08161530 tx=0x7f3af0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97eebc84957cb330 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:13.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3b077fe700 1 -- 172.21.15.44:0/551423712 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af000b8a0 con 0x7f3b080b30c0 2024-09-13T18:33:13.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3b077fe700 1 -- 172.21.15.44:0/551423712 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af000ba00 con 0x7f3b080b30c0 2024-09-13T18:33:13.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3b077fe700 1 -- 172.21.15.44:0/551423712 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af000bd90 con 0x7f3b080b30c0 2024-09-13T18:33:13.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3b0e494700 1 -- 172.21.15.44:0/551423712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b080b30c0 msgr2=0x7f3b081465c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:13.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3b0e494700 1 --2- 172.21.15.44:0/551423712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b080b30c0 0x7f3b081465c0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f3b08161530 tx=0x7f3af0009bf0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3b0e494700 1 -- 172.21.15.44:0/551423712 shutdown_connections 2024-09-13T18:33:13.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3b0e494700 1 --2- 172.21.15.44:0/551423712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b080b30c0 0x7f3b081465c0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3b0e494700 1 --2- 172.21.15.44:0/551423712 >> v2:172.21.15.99:3300/0 conn(0x7f3b08146b00 0x7f3b08164b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3b0e494700 1 --2- 172.21.15.44:0/551423712 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b081461e0 0x7f3b080b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3b0e494700 1 -- 172.21.15.44:0/551423712 >> 172.21.15.44:0/551423712 conn(0x7f3b080af620 msgr2=0x7f3b080afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:13.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.791+0000 7f3b0e494700 1 -- 172.21.15.44:0/551423712 shutdown_connections 2024-09-13T18:33:13.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.795+0000 7f3b0e494700 1 -- 172.21.15.44:0/551423712 wait complete. 2024-09-13T18:33:13.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.795+0000 7f3b0e494700 1 Processor -- start 2024-09-13T18:33:13.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.795+0000 7f3b0e494700 1 -- start start 2024-09-13T18:33:13.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.795+0000 7f3b0e494700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b080b30c0 0x7f3b08160430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.795+0000 7f3b0e494700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b081461e0 0x7f3b081437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.795+0000 7f3b0e494700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b08146b00 0x7f3b08144500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.795+0000 7f3b0e494700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b081f6710 con 0x7f3b081461e0 2024-09-13T18:33:13.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.795+0000 7f3b0e494700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b081f69d0 con 0x7f3b08146b00 2024-09-13T18:33:13.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.795+0000 7f3b0e494700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b081f6cb0 con 0x7f3b080b30c0 2024-09-13T18:33:13.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.795+0000 7f3aff7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b081461e0 0x7f3b081437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.795+0000 7f3aff7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b081461e0 0x7f3b081437e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42504/0 (socket says 172.21.15.44:42504) 2024-09-13T18:33:13.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.795+0000 7f3aff7fe700 1 -- 172.21.15.44:0/487612590 learned_addr learned my addr 172.21.15.44:0/487612590 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:13.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.795+0000 7f3b07fff700 1 --2- 172.21.15.44:0/487612590 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b080b30c0 0x7f3b08160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.795+0000 7f3b0ca31700 1 --2- 172.21.15.44:0/487612590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b08146b00 0x7f3b08144500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.799+0000 7f3aff7fe700 1 -- 172.21.15.44:0/487612590 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b080b30c0 msgr2=0x7f3b08160430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:13.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.799+0000 7f3aff7fe700 1 --2- 172.21.15.44:0/487612590 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b080b30c0 0x7f3b08160430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.799+0000 7f3aff7fe700 1 -- 172.21.15.44:0/487612590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b08146b00 msgr2=0x7f3b08144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:13.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.799+0000 7f3aff7fe700 1 --2- 172.21.15.44:0/487612590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b08146b00 0x7f3b08144500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.799+0000 7f3aff7fe700 1 -- 172.21.15.44:0/487612590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af0009570 con 0x7f3b081461e0 2024-09-13T18:33:13.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.799+0000 7f3aff7fe700 1 --2- 172.21.15.44:0/487612590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b081461e0 0x7f3b081437e0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f3b0806f950 tx=0x7f3af0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:13.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.799+0000 7f3b057fa700 1 -- 172.21.15.44:0/487612590 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af00045a0 con 0x7f3b081461e0 2024-09-13T18:33:13.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.799+0000 7f3b057fa700 1 -- 172.21.15.44:0/487612590 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af001f070 con 0x7f3b081461e0 2024-09-13T18:33:13.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.799+0000 7f3b0e494700 1 -- 172.21.15.44:0/487612590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b081f6f90 con 0x7f3b081461e0 2024-09-13T18:33:13.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.799+0000 7f3b057fa700 1 -- 172.21.15.44:0/487612590 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0003900 con 0x7f3b081461e0 2024-09-13T18:33:13.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.799+0000 7f3b0e494700 1 -- 172.21.15.44:0/487612590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b08160970 con 0x7f3b081461e0 2024-09-13T18:33:13.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.799+0000 7f3b0e494700 1 -- 172.21.15.44:0/487612590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b081596a0 con 0x7f3b081461e0 2024-09-13T18:33:13.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.799+0000 7f3b057fa700 1 -- 172.21.15.44:0/487612590 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3af0021030 con 0x7f3b081461e0 2024-09-13T18:33:13.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.803+0000 7f3b057fa700 1 --2- 172.21.15.44:0/487612590 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3ae8066730 0x7f3ae8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.803+0000 7f3b057fa700 1 -- 172.21.15.44:0/487612590 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3af00852d0 con 0x7f3b081461e0 2024-09-13T18:33:13.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.803+0000 7f3b07fff700 1 --2- 172.21.15.44:0/487612590 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3ae8066730 0x7f3ae8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.803+0000 7f3b07fff700 1 --2- 172.21.15.44:0/487612590 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3ae8066730 0x7f3ae8068bf0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3b081f4270 tx=0x7f3af8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:13.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.811+0000 7f3b057fa700 1 -- 172.21.15.44:0/487612590 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3b081596a0 con 0x7f3b081461e0 2024-09-13T18:33:13.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.979+0000 7f3b0e494700 1 -- 172.21.15.44:0/487612590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b081596a0 con 0x7f3b081461e0 2024-09-13T18:33:13.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.983+0000 7f3b057fa700 1 -- 172.21.15.44:0/487612590 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b081596a0 con 0x7f3b081461e0 2024-09-13T18:33:13.988 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:33:13.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.983+0000 7f3b0e494700 1 -- 172.21.15.44:0/487612590 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3ae8066730 msgr2=0x7f3ae8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:13.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.983+0000 7f3b0e494700 1 --2- 172.21.15.44:0/487612590 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3ae8066730 0x7f3ae8068bf0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3b081f4270 tx=0x7f3af8008040 comp rx=0 tx=0).stop 2024-09-13T18:33:13.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.983+0000 7f3b0e494700 1 -- 172.21.15.44:0/487612590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b081461e0 msgr2=0x7f3b081437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:13.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.983+0000 7f3b0e494700 1 --2- 172.21.15.44:0/487612590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b081461e0 0x7f3b081437e0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f3b0806f950 tx=0x7f3af0004770 comp rx=0 tx=0).stop 2024-09-13T18:33:13.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.983+0000 7f3b0e494700 1 -- 172.21.15.44:0/487612590 shutdown_connections 2024-09-13T18:33:13.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.983+0000 7f3b0e494700 1 --2- 172.21.15.44:0/487612590 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3ae8066730 0x7f3ae8068bf0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.983+0000 7f3b0e494700 1 --2- 172.21.15.44:0/487612590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b08146b00 0x7f3b08144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.983+0000 7f3b0e494700 1 --2- 172.21.15.44:0/487612590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b081461e0 0x7f3b081437e0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.983+0000 7f3b0e494700 1 --2- 172.21.15.44:0/487612590 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b080b30c0 0x7f3b08160430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.983+0000 7f3b0e494700 1 -- 172.21.15.44:0/487612590 >> 172.21.15.44:0/487612590 conn(0x7f3b080af620 msgr2=0x7f3b0806fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:13.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.983+0000 7f3b0e494700 1 -- 172.21.15.44:0/487612590 shutdown_connections 2024-09-13T18:33:13.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:13.983+0000 7f3b0e494700 1 -- 172.21.15.44:0/487612590 wait complete. 2024-09-13T18:33:14.003 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:33:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.107+0000 7f187f23a700 1 Processor -- start 2024-09-13T18:33:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.107+0000 7f187f23a700 1 -- start start 2024-09-13T18:33:14.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.107+0000 7f187f23a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f18780b3ae0 0x7f187806cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.107+0000 7f187f23a700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f187806aa90 0x7f18780ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.107+0000 7f187f23a700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187806af40 con 0x7f1878159720 2024-09-13T18:33:14.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.107+0000 7f187f23a700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f187806d690 con 0x7f187806aa90 2024-09-13T18:33:14.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.107+0000 7f187f23a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18780cbfe0 con 0x7f18780b3ae0 2024-09-13T18:33:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.107+0000 7f187da37700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f18780b3ae0 0x7f187806cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.107+0000 7f187ea39700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f187806aa90 0x7f18780ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.107+0000 7f187da37700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f18780b3ae0 0x7f187806cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:34502/0 (socket says 172.21.15.44:34502) 2024-09-13T18:33:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.107+0000 7f187da37700 1 -- 172.21.15.44:0/1394934522 learned_addr learned my addr 172.21.15.44:0/1394934522 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.107+0000 7f187e238700 1 --1- 172.21.15.44:0/1394934522 >> v1:172.21.15.99:6789/0 conn(0x7f1878159720 0x7f18780b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:51660/0 (socket says 172.21.15.44:51660) 2024-09-13T18:33:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.107+0000 7f187ea39700 1 -- 172.21.15.44:0/1394934522 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f18780b3ae0 msgr2=0x7f187806cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.107+0000 7f187ea39700 1 --2- 172.21.15.44:0/1394934522 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f18780b3ae0 0x7f187806cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.107+0000 7f187ea39700 1 -- 172.21.15.44:0/1394934522 >> v1:172.21.15.99:6789/0 conn(0x7f1878159720 legacy=0x7f18780b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.107+0000 7f187ea39700 1 -- 172.21.15.44:0/1394934522 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18780cc2c0 con 0x7f187806aa90 2024-09-13T18:33:14.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.107+0000 7f187d236700 1 -- 172.21.15.44:0/1394934522 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124475686 0 0) 0x7f187806af40 con 0x7f1878159720 2024-09-13T18:33:14.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.107+0000 7f187ea39700 1 --2- 172.21.15.44:0/1394934522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f187806aa90 0x7f18780ccac0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1870009d90 tx=0x7f187000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a4d3bca7fee4171 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:14.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.107+0000 7f187d236700 1 -- 172.21.15.44:0/1394934522 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187000e070 con 0x7f187806aa90 2024-09-13T18:33:14.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.107+0000 7f187d236700 1 -- 172.21.15.44:0/1394934522 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187000bb20 con 0x7f187806aa90 2024-09-13T18:33:14.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.107+0000 7f187d236700 1 -- 172.21.15.44:0/1394934522 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870012430 con 0x7f187806aa90 2024-09-13T18:33:14.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.111+0000 7f187f23a700 1 -- 172.21.15.44:0/1394934522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f187806aa90 msgr2=0x7f18780ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.111+0000 7f187f23a700 1 --2- 172.21.15.44:0/1394934522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f187806aa90 0x7f18780ccac0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1870009d90 tx=0x7f187000b330 comp rx=0 tx=0).stop 2024-09-13T18:33:14.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.111+0000 7f187f23a700 1 -- 172.21.15.44:0/1394934522 shutdown_connections 2024-09-13T18:33:14.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.111+0000 7f187f23a700 1 --2- 172.21.15.44:0/1394934522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f187806aa90 0x7f18780ccac0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.111+0000 7f187f23a700 1 --2- 172.21.15.44:0/1394934522 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f18780b3ae0 0x7f187806cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.111+0000 7f187f23a700 1 -- 172.21.15.44:0/1394934522 >> 172.21.15.44:0/1394934522 conn(0x7f18780b0f00 msgr2=0x7f18780b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:14.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.111+0000 7f187f23a700 1 -- 172.21.15.44:0/1394934522 shutdown_connections 2024-09-13T18:33:14.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.111+0000 7f187f23a700 1 -- 172.21.15.44:0/1394934522 wait complete. 2024-09-13T18:33:14.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.111+0000 7f187f23a700 1 Processor -- start 2024-09-13T18:33:14.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.111+0000 7f187f23a700 1 -- start start 2024-09-13T18:33:14.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.111+0000 7f187f23a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f187806aa90 0x7f1878154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.111+0000 7f187f23a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18780b3ae0 0x7f187815b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.111+0000 7f187f23a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1878159720 0x7f187815bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.111+0000 7f187f23a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18781f2a90 con 0x7f18780b3ae0 2024-09-13T18:33:14.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.111+0000 7f187f23a700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18781f2d70 con 0x7f187806aa90 2024-09-13T18:33:14.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.111+0000 7f187f23a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18781f3050 con 0x7f1878159720 2024-09-13T18:33:14.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.111+0000 7f187da37700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18780b3ae0 0x7f187815b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.111+0000 7f187da37700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18780b3ae0 0x7f187815b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42514/0 (socket says 172.21.15.44:42514) 2024-09-13T18:33:14.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.111+0000 7f187da37700 1 -- 172.21.15.44:0/125634401 learned_addr learned my addr 172.21.15.44:0/125634401 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:14.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.111+0000 7f187ea39700 1 --2- 172.21.15.44:0/125634401 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1878159720 0x7f187815bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.111+0000 7f187e238700 1 --2- 172.21.15.44:0/125634401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f187806aa90 0x7f1878154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.115+0000 7f187da37700 1 -- 172.21.15.44:0/125634401 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1878159720 msgr2=0x7f187815bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.115+0000 7f187da37700 1 --2- 172.21.15.44:0/125634401 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1878159720 0x7f187815bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.115+0000 7f187da37700 1 -- 172.21.15.44:0/125634401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f187806aa90 msgr2=0x7f1878154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.115+0000 7f187da37700 1 --2- 172.21.15.44:0/125634401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f187806aa90 0x7f1878154c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.115+0000 7f187da37700 1 -- 172.21.15.44:0/125634401 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1870009a70 con 0x7f18780b3ae0 2024-09-13T18:33:14.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.115+0000 7f187da37700 1 --2- 172.21.15.44:0/125634401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18780b3ae0 0x7f187815b410 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f186800e8c0 tx=0x7f186800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:14.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.115+0000 7f186effd700 1 -- 172.21.15.44:0/125634401 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1868013680 con 0x7f18780b3ae0 2024-09-13T18:33:14.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.115+0000 7f186effd700 1 -- 172.21.15.44:0/125634401 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1868013800 con 0x7f18780b3ae0 2024-09-13T18:33:14.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.115+0000 7f187f23a700 1 -- 172.21.15.44:0/125634401 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18781f3330 con 0x7f18780b3ae0 2024-09-13T18:33:14.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.115+0000 7f186effd700 1 -- 172.21.15.44:0/125634401 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1868013bb0 con 0x7f18780b3ae0 2024-09-13T18:33:14.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.115+0000 7f187f23a700 1 -- 172.21.15.44:0/125634401 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187815b950 con 0x7f18780b3ae0 2024-09-13T18:33:14.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.115+0000 7f187f23a700 1 -- 172.21.15.44:0/125634401 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1878159f60 con 0x7f18780b3ae0 2024-09-13T18:33:14.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.115+0000 7f186effd700 1 -- 172.21.15.44:0/125634401 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1868013d10 con 0x7f18780b3ae0 2024-09-13T18:33:14.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.115+0000 7f186effd700 1 --2- 172.21.15.44:0/125634401 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f185c066760 0x7f185c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.115+0000 7f186effd700 1 -- 172.21.15.44:0/125634401 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1868084020 con 0x7f18780b3ae0 2024-09-13T18:33:14.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.119+0000 7f187e238700 1 --2- 172.21.15.44:0/125634401 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f185c066760 0x7f185c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.119+0000 7f187e238700 1 --2- 172.21.15.44:0/125634401 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f185c066760 0x7f185c068c20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1874000f60 tx=0x7f1874009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:14.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.127+0000 7f186effd700 1 -- 172.21.15.44:0/125634401 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1878159f60 con 0x7f18780b3ae0 2024-09-13T18:33:14.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.307+0000 7f187f23a700 1 -- 172.21.15.44:0/125634401 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1878159f60 con 0x7f18780b3ae0 2024-09-13T18:33:14.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.307+0000 7f186effd700 1 -- 172.21.15.44:0/125634401 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v59) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1868021060 con 0x7f18780b3ae0 2024-09-13T18:33:14.313 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:33:14.314 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-09-13T18:33:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:33:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2024-09-13T18:33:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2024-09-13T18:33:14.314 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:33:14.314 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-09-13T18:33:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.307+0000 7f187f23a700 1 -- 172.21.15.44:0/125634401 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f185c066760 msgr2=0x7f185c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.307+0000 7f187f23a700 1 --2- 172.21.15.44:0/125634401 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f185c066760 0x7f185c068c20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1874000f60 tx=0x7f1874009040 comp rx=0 tx=0).stop 2024-09-13T18:33:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.307+0000 7f187f23a700 1 -- 172.21.15.44:0/125634401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18780b3ae0 msgr2=0x7f187815b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.307+0000 7f187f23a700 1 --2- 172.21.15.44:0/125634401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18780b3ae0 0x7f187815b410 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f186800e8c0 tx=0x7f186800ebd0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.307+0000 7f187f23a700 1 -- 172.21.15.44:0/125634401 shutdown_connections 2024-09-13T18:33:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.307+0000 7f187f23a700 1 --2- 172.21.15.44:0/125634401 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f185c066760 0x7f185c068c20 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.307+0000 7f187f23a700 1 --2- 172.21.15.44:0/125634401 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1878159720 0x7f187815bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.307+0000 7f187f23a700 1 --2- 172.21.15.44:0/125634401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18780b3ae0 0x7f187815b410 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.307+0000 7f187f23a700 1 --2- 172.21.15.44:0/125634401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f187806aa90 0x7f1878154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.307+0000 7f187f23a700 1 -- 172.21.15.44:0/125634401 >> 172.21.15.44:0/125634401 conn(0x7f18780b0f00 msgr2=0x7f18780afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.307+0000 7f187f23a700 1 -- 172.21.15.44:0/125634401 shutdown_connections 2024-09-13T18:33:14.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.307+0000 7f187f23a700 1 -- 172.21.15.44:0/125634401 wait complete. 2024-09-13T18:33:14.328 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:33:14.329 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:33:14.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.439+0000 7f24c3b3b700 1 Processor -- start 2024-09-13T18:33:14.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.439+0000 7f24c3b3b700 1 -- start start 2024-09-13T18:33:14.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.443+0000 7f24c3b3b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24bc0b3d10 0x7f24bc0b4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.443+0000 7f24c3b3b700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f24bc06b900 0x7f24bc06bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.443+0000 7f24c3b3b700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24bc0712d0 con 0x7f24bc06b520 2024-09-13T18:33:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.443+0000 7f24c3b3b700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24bc1596d0 con 0x7f24bc06b900 2024-09-13T18:33:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.443+0000 7f24c3b3b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc0b4690 con 0x7f24bc0b3d10 2024-09-13T18:33:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.443+0000 7f24c18d7700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f24bc06b520 0x7f24bc0cbe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51160/0 (socket says 172.21.15.44:51160) 2024-09-13T18:33:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.443+0000 7f24c18d7700 1 -- 172.21.15.44:0/1185734884 learned_addr learned my addr 172.21.15.44:0/1185734884 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.443+0000 7f24c20d8700 1 --2- 172.21.15.44:0/1185734884 >> v2:172.21.15.99:3300/0 conn(0x7f24bc06b900 0x7f24bc06bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.443+0000 7f24c10d6700 1 --2- 172.21.15.44:0/1185734884 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24bc0b3d10 0x7f24bc0b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.443+0000 7f24c08d5700 1 -- 172.21.15.44:0/1185734884 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828814250 0 0) 0x7f24bc0712d0 con 0x7f24bc06b520 2024-09-13T18:33:14.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.443+0000 7f24c08d5700 1 -- 172.21.15.44:0/1185734884 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24a80035d0 con 0x7f24bc06b520 2024-09-13T18:33:14.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.443+0000 7f24c20d8700 1 -- 172.21.15.44:0/1185734884 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24bc0b3d10 msgr2=0x7f24bc0b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:14.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.443+0000 7f24c20d8700 1 --2- 172.21.15.44:0/1185734884 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24bc0b3d10 0x7f24bc0b4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.443+0000 7f24c20d8700 1 -- 172.21.15.44:0/1185734884 >> v1:172.21.15.44:6789/0 conn(0x7f24bc06b520 legacy=0x7f24bc0cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.443+0000 7f24c20d8700 1 -- 172.21.15.44:0/1185734884 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc0ce520 con 0x7f24bc06b900 2024-09-13T18:33:14.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.443+0000 7f24c20d8700 1 --2- 172.21.15.44:0/1185734884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24bc06b900 0x7f24bc06bd90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f24b4009d90 tx=0x7f24b400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7e8a5c436164223 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:14.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.443+0000 7f24c08d5700 1 -- 172.21.15.44:0/1185734884 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b400e070 con 0x7f24bc06b900 2024-09-13T18:33:14.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.443+0000 7f24c08d5700 1 -- 172.21.15.44:0/1185734884 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b400bb20 con 0x7f24bc06b900 2024-09-13T18:33:14.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.443+0000 7f24c08d5700 1 -- 172.21.15.44:0/1185734884 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b4012430 con 0x7f24bc06b900 2024-09-13T18:33:14.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.447+0000 7f24c3b3b700 1 -- 172.21.15.44:0/1185734884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24bc06b900 msgr2=0x7f24bc06bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.447+0000 7f24c3b3b700 1 --2- 172.21.15.44:0/1185734884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24bc06b900 0x7f24bc06bd90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f24b4009d90 tx=0x7f24b400b330 comp rx=0 tx=0).stop 2024-09-13T18:33:14.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.447+0000 7f24c3b3b700 1 -- 172.21.15.44:0/1185734884 shutdown_connections 2024-09-13T18:33:14.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.447+0000 7f24c3b3b700 1 --2- 172.21.15.44:0/1185734884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24bc06b900 0x7f24bc06bd90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.447+0000 7f24c3b3b700 1 --2- 172.21.15.44:0/1185734884 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24bc0b3d10 0x7f24bc0b4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.447+0000 7f24c3b3b700 1 -- 172.21.15.44:0/1185734884 >> 172.21.15.44:0/1185734884 conn(0x7f24bc0b1110 msgr2=0x7f24bc0b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:14.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.447+0000 7f24c3b3b700 1 -- 172.21.15.44:0/1185734884 shutdown_connections 2024-09-13T18:33:14.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.447+0000 7f24c3b3b700 1 -- 172.21.15.44:0/1185734884 wait complete. 2024-09-13T18:33:14.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.447+0000 7f24c3b3b700 1 Processor -- start 2024-09-13T18:33:14.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.447+0000 7f24c3b3b700 1 -- start start 2024-09-13T18:33:14.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.451+0000 7f24c3b3b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24bc06b520 0x7f24bc1f04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.451+0000 7f24c3b3b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24bc06b900 0x7f24bc1f3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.451+0000 7f24c3b3b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24bc0b3d10 0x7f24bc0c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.451+0000 7f24c3b3b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc143610 con 0x7f24bc06b900 2024-09-13T18:33:14.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.451+0000 7f24c3b3b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc153050 con 0x7f24bc06b520 2024-09-13T18:33:14.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.451+0000 7f24c3b3b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc1532a0 con 0x7f24bc0b3d10 2024-09-13T18:33:14.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.451+0000 7f24c10d6700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24bc06b900 0x7f24bc1f3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.451+0000 7f24c10d6700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24bc06b900 0x7f24bc1f3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42518/0 (socket says 172.21.15.44:42518) 2024-09-13T18:33:14.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.451+0000 7f24c10d6700 1 -- 172.21.15.44:0/2710687970 learned_addr learned my addr 172.21.15.44:0/2710687970 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:14.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.451+0000 7f24c18d7700 1 --2- 172.21.15.44:0/2710687970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24bc06b520 0x7f24bc1f04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.451+0000 7f24c20d8700 1 --2- 172.21.15.44:0/2710687970 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24bc0b3d10 0x7f24bc0c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.451+0000 7f24c10d6700 1 -- 172.21.15.44:0/2710687970 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24bc0b3d10 msgr2=0x7f24bc0c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.451+0000 7f24c10d6700 1 --2- 172.21.15.44:0/2710687970 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24bc0b3d10 0x7f24bc0c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.451+0000 7f24c10d6700 1 -- 172.21.15.44:0/2710687970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24bc06b520 msgr2=0x7f24bc1f04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.451+0000 7f24c10d6700 1 --2- 172.21.15.44:0/2710687970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24bc06b520 0x7f24bc1f04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.451+0000 7f24c10d6700 1 -- 172.21.15.44:0/2710687970 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b4009a70 con 0x7f24bc06b900 2024-09-13T18:33:14.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.451+0000 7f24c10d6700 1 --2- 172.21.15.44:0/2710687970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24bc06b900 0x7f24bc1f3d20 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f24ac009fd0 tx=0x7f24ac00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:14.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.451+0000 7f24b27fc700 1 -- 172.21.15.44:0/2710687970 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac0095a0 con 0x7f24bc06b900 2024-09-13T18:33:14.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.451+0000 7f24b27fc700 1 -- 172.21.15.44:0/2710687970 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ac013680 con 0x7f24bc06b900 2024-09-13T18:33:14.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.451+0000 7f24c3b3b700 1 -- 172.21.15.44:0/2710687970 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24bc153580 con 0x7f24bc06b900 2024-09-13T18:33:14.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.451+0000 7f24b27fc700 1 -- 172.21.15.44:0/2710687970 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac013a10 con 0x7f24bc06b900 2024-09-13T18:33:14.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.451+0000 7f24c3b3b700 1 -- 172.21.15.44:0/2710687970 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24bc153b40 con 0x7f24bc06b900 2024-09-13T18:33:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.455+0000 7f24c3b3b700 1 -- 172.21.15.44:0/2710687970 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24bc070f60 con 0x7f24bc06b900 2024-09-13T18:33:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.455+0000 7f24b27fc700 1 -- 172.21.15.44:0/2710687970 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f24ac013b70 con 0x7f24bc06b900 2024-09-13T18:33:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.455+0000 7f24b27fc700 1 --2- 172.21.15.44:0/2710687970 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f24a0066730 0x7f24a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.455+0000 7f24b27fc700 1 -- 172.21.15.44:0/2710687970 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f24ac083d60 con 0x7f24bc06b900 2024-09-13T18:33:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.455+0000 7f24c18d7700 1 --2- 172.21.15.44:0/2710687970 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f24a0066730 0x7f24a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.455+0000 7f24c18d7700 1 --2- 172.21.15.44:0/2710687970 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f24a0066730 0x7f24a0068bf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f24b80011e0 tx=0x7f24b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:14.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.463+0000 7f24b27fc700 1 -- 172.21.15.44:0/2710687970 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f24ac051430 con 0x7f24bc06b900 2024-09-13T18:33:14.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.635+0000 7f24c3b3b700 1 -- 172.21.15.44:0/2710687970 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f24bc0b4280 con 0x7f24bc06b900 2024-09-13T18:33:14.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.895+0000 7f24b27fc700 1 -- 172.21.15.44:0/2710687970 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v60) v1 ==== 138+0+0 (secure 0 0 0) 0x7f24ac054a50 con 0x7f24bc06b900 2024-09-13T18:33:14.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.903+0000 7f24c3b3b700 1 -- 172.21.15.44:0/2710687970 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f24a0066730 msgr2=0x7f24a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.903+0000 7f24c3b3b700 1 --2- 172.21.15.44:0/2710687970 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f24a0066730 0x7f24a0068bf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f24b80011e0 tx=0x7f24b8009040 comp rx=0 tx=0).stop 2024-09-13T18:33:14.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.903+0000 7f24c3b3b700 1 -- 172.21.15.44:0/2710687970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24bc06b900 msgr2=0x7f24bc1f3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.903+0000 7f24c3b3b700 1 --2- 172.21.15.44:0/2710687970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24bc06b900 0x7f24bc1f3d20 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f24ac009fd0 tx=0x7f24ac00ebd0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.903+0000 7f24c3b3b700 1 -- 172.21.15.44:0/2710687970 shutdown_connections 2024-09-13T18:33:14.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.903+0000 7f24c3b3b700 1 --2- 172.21.15.44:0/2710687970 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f24a0066730 0x7f24a0068bf0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.903+0000 7f24c3b3b700 1 --2- 172.21.15.44:0/2710687970 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24bc0b3d10 0x7f24bc0c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.903+0000 7f24c3b3b700 1 --2- 172.21.15.44:0/2710687970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24bc06b900 0x7f24bc1f3d20 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.903+0000 7f24c3b3b700 1 --2- 172.21.15.44:0/2710687970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24bc06b520 0x7f24bc1f04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.903+0000 7f24c3b3b700 1 -- 172.21.15.44:0/2710687970 >> 172.21.15.44:0/2710687970 conn(0x7f24bc0b1110 msgr2=0x7f24bc15ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:14.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.903+0000 7f24c3b3b700 1 -- 172.21.15.44:0/2710687970 shutdown_connections 2024-09-13T18:33:14.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:14.903+0000 7f24c3b3b700 1 -- 172.21.15.44:0/2710687970 wait complete. 2024-09-13T18:33:14.911 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2024-09-13T18:33:14.926 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:33:15.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.051+0000 7f730a622700 1 Processor -- start 2024-09-13T18:33:15.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.051+0000 7f730a622700 1 -- start start 2024-09-13T18:33:15.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.051+0000 7f730a622700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f73040d04e0 0x7f730406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.051+0000 7f730a622700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730406f850 con 0x7f730406e730 2024-09-13T18:33:15.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.051+0000 7f730a622700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730406efb0 con 0x7f730413d9d0 2024-09-13T18:33:15.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.051+0000 7f730a622700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f730413e1a0 con 0x7f73040d04e0 2024-09-13T18:33:15.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.051+0000 7f7308e1f700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f73040d04e0 0x7f730406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.051+0000 7f7308e1f700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f73040d04e0 0x7f730406e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42526/0 (socket says 172.21.15.44:42526) 2024-09-13T18:33:15.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.051+0000 7f7309e21700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f730406e730 0x7f730413e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51164/0 (socket says 172.21.15.44:51164) 2024-09-13T18:33:15.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.051+0000 7f7308e1f700 1 -- 172.21.15.44:0/1721909259 learned_addr learned my addr 172.21.15.44:0/1721909259 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:15.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.055+0000 7f7308e1f700 1 -- 172.21.15.44:0/1721909259 >> v1:172.21.15.99:6789/0 conn(0x7f730413d9d0 legacy=0x7f73040cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.055+0000 7f7308e1f700 1 -- 172.21.15.44:0/1721909259 >> v1:172.21.15.44:6789/0 conn(0x7f730406e730 legacy=0x7f730413e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.055+0000 7f7308e1f700 1 -- 172.21.15.44:0/1721909259 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730406f290 con 0x7f73040d04e0 2024-09-13T18:33:15.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.055+0000 7f72fbfff700 1 -- 172.21.15.44:0/1721909259 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1051337770 0 0) 0x7f730406f850 con 0x7f730406e730 2024-09-13T18:33:15.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.055+0000 7f7308e1f700 1 --2- 172.21.15.44:0/1721909259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73040d04e0 0x7f730406e1f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f7300009910 tx=0x7f7300009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1ec7ec2135976d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:15.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.055+0000 7f72fbfff700 1 -- 172.21.15.44:0/1721909259 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730000ba60 con 0x7f73040d04e0 2024-09-13T18:33:15.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.055+0000 7f72fbfff700 1 -- 172.21.15.44:0/1721909259 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730000bbc0 con 0x7f73040d04e0 2024-09-13T18:33:15.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.055+0000 7f72fbfff700 1 -- 172.21.15.44:0/1721909259 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7300009e60 con 0x7f73040d04e0 2024-09-13T18:33:15.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.055+0000 7f730a622700 1 -- 172.21.15.44:0/1721909259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73040d04e0 msgr2=0x7f730406e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.055+0000 7f730a622700 1 --2- 172.21.15.44:0/1721909259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73040d04e0 0x7f730406e1f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f7300009910 tx=0x7f7300009c20 comp rx=0 tx=0).stop 2024-09-13T18:33:15.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.055+0000 7f730a622700 1 -- 172.21.15.44:0/1721909259 shutdown_connections 2024-09-13T18:33:15.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.055+0000 7f730a622700 1 --2- 172.21.15.44:0/1721909259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73040d04e0 0x7f730406e1f0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.055+0000 7f730a622700 1 -- 172.21.15.44:0/1721909259 >> 172.21.15.44:0/1721909259 conn(0x7f730406a4f0 msgr2=0x7f7304071d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:15.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.055+0000 7f730a622700 1 -- 172.21.15.44:0/1721909259 shutdown_connections 2024-09-13T18:33:15.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.055+0000 7f730a622700 1 -- 172.21.15.44:0/1721909259 wait complete. 2024-09-13T18:33:15.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.059+0000 7f730a622700 1 Processor -- start 2024-09-13T18:33:15.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.059+0000 7f730a622700 1 -- start start 2024-09-13T18:33:15.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.059+0000 7f730a622700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730406e730 0x7f730413ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.059+0000 7f730a622700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73040d04e0 0x7f73040cb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.059+0000 7f730a622700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f730413d9d0 0x7f73040cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.059+0000 7f730a622700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73040c8f70 con 0x7f730406e730 2024-09-13T18:33:15.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.059+0000 7f730a622700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73040c86a0 con 0x7f73040d04e0 2024-09-13T18:33:15.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.059+0000 7f730a622700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7304146540 con 0x7f730413d9d0 2024-09-13T18:33:15.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.059+0000 7f7309620700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730406e730 0x7f730413ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.059+0000 7f7309620700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730406e730 0x7f730413ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42542/0 (socket says 172.21.15.44:42542) 2024-09-13T18:33:15.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.059+0000 7f7309620700 1 -- 172.21.15.44:0/1940625114 learned_addr learned my addr 172.21.15.44:0/1940625114 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:15.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.059+0000 7f7308e1f700 1 --2- 172.21.15.44:0/1940625114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73040d04e0 0x7f73040cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.059+0000 7f7309e21700 1 --2- 172.21.15.44:0/1940625114 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f730413d9d0 0x7f73040cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.059+0000 7f7309620700 1 -- 172.21.15.44:0/1940625114 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f730413d9d0 msgr2=0x7f73040cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.059+0000 7f7309620700 1 --2- 172.21.15.44:0/1940625114 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f730413d9d0 0x7f73040cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.059+0000 7f7309620700 1 -- 172.21.15.44:0/1940625114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73040d04e0 msgr2=0x7f73040cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.059+0000 7f7309620700 1 --2- 172.21.15.44:0/1940625114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73040d04e0 0x7f73040cb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.059+0000 7f7309620700 1 -- 172.21.15.44:0/1940625114 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7300009570 con 0x7f730406e730 2024-09-13T18:33:15.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.063+0000 7f7309620700 1 --2- 172.21.15.44:0/1940625114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730406e730 0x7f730413ca90 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f72f400c500 tx=0x7f72f400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:15.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.063+0000 7f72f9ffb700 1 -- 172.21.15.44:0/1940625114 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f40052d0 con 0x7f730406e730 2024-09-13T18:33:15.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.063+0000 7f72f9ffb700 1 -- 172.21.15.44:0/1940625114 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f4005430 con 0x7f730406e730 2024-09-13T18:33:15.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.063+0000 7f730a622700 1 -- 172.21.15.44:0/1940625114 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7304146820 con 0x7f730406e730 2024-09-13T18:33:15.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.063+0000 7f72f9ffb700 1 -- 172.21.15.44:0/1940625114 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f40055a0 con 0x7f730406e730 2024-09-13T18:33:15.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.063+0000 7f730a622700 1 -- 172.21.15.44:0/1940625114 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730413cfd0 con 0x7f730406e730 2024-09-13T18:33:15.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.063+0000 7f730a622700 1 -- 172.21.15.44:0/1940625114 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7304146380 con 0x7f730406e730 2024-09-13T18:33:15.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.063+0000 7f72f9ffb700 1 -- 172.21.15.44:0/1940625114 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f72f40038e0 con 0x7f730406e730 2024-09-13T18:33:15.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.067+0000 7f72f9ffb700 1 --2- 172.21.15.44:0/1940625114 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f72e8066730 0x7f72e8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.067+0000 7f72f9ffb700 1 -- 172.21.15.44:0/1940625114 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f72f4083230 con 0x7f730406e730 2024-09-13T18:33:15.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.067+0000 7f7308e1f700 1 --2- 172.21.15.44:0/1940625114 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f72e8066730 0x7f72e8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.067+0000 7f7308e1f700 1 --2- 172.21.15.44:0/1940625114 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f72e8066730 0x7f72e8068bf0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7300000c00 tx=0x7f7300008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:15.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.075+0000 7f72f9ffb700 1 -- 172.21.15.44:0/1940625114 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f72f4050810 con 0x7f730406e730 2024-09-13T18:33:15.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.247+0000 7f730a622700 1 -- 172.21.15.44:0/1940625114 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f730406e1f0 con 0x7f730406e730 2024-09-13T18:33:15.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.907+0000 7f72f9ffb700 1 -- 172.21.15.44:0/1940625114 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v61) v1 ==== 170+0+0 (secure 0 0 0) 0x7f72f4053e30 con 0x7f730406e730 2024-09-13T18:33:15.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.911+0000 7f730a622700 1 -- 172.21.15.44:0/1940625114 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f72e8066730 msgr2=0x7f72e8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.911+0000 7f730a622700 1 --2- 172.21.15.44:0/1940625114 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f72e8066730 0x7f72e8068bf0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7300000c00 tx=0x7f7300008030 comp rx=0 tx=0).stop 2024-09-13T18:33:15.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.911+0000 7f730a622700 1 -- 172.21.15.44:0/1940625114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730406e730 msgr2=0x7f730413ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.911+0000 7f730a622700 1 --2- 172.21.15.44:0/1940625114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730406e730 0x7f730413ca90 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f72f400c500 tx=0x7f72f400c810 comp rx=0 tx=0).stop 2024-09-13T18:33:15.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.911+0000 7f730a622700 1 -- 172.21.15.44:0/1940625114 shutdown_connections 2024-09-13T18:33:15.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.911+0000 7f730a622700 1 --2- 172.21.15.44:0/1940625114 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f72e8066730 0x7f72e8068bf0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.911+0000 7f730a622700 1 --2- 172.21.15.44:0/1940625114 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f730413d9d0 0x7f73040cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.911+0000 7f730a622700 1 --2- 172.21.15.44:0/1940625114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73040d04e0 0x7f73040cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.911+0000 7f730a622700 1 --2- 172.21.15.44:0/1940625114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730406e730 0x7f730413ca90 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.911+0000 7f730a622700 1 -- 172.21.15.44:0/1940625114 >> 172.21.15.44:0/1940625114 conn(0x7f730406a4f0 msgr2=0x7f73040d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:15.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.915+0000 7f730a622700 1 -- 172.21.15.44:0/1940625114 shutdown_connections 2024-09-13T18:33:15.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:15.915+0000 7f730a622700 1 -- 172.21.15.44:0/1940625114 wait complete. 2024-09-13T18:33:15.929 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2024-09-13T18:33:15.947 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:33:16.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.055+0000 7ff85ffff700 1 Processor -- start 2024-09-13T18:33:16.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.055+0000 7ff85ffff700 1 -- start start 2024-09-13T18:33:16.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.055+0000 7ff85ffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff86006d8c0 0x7ff860164a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.055+0000 7ff85ffff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff860164f90 0x7ff8600704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.055+0000 7ff85ffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff860070a00 0x7ff860161460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.055+0000 7ff85ffff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff860162e60 con 0x7ff860070a00 2024-09-13T18:33:16.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.055+0000 7ff85ffff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff860162570 con 0x7ff860164f90 2024-09-13T18:33:16.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.055+0000 7ff85ffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8601653f0 con 0x7ff86006d8c0 2024-09-13T18:33:16.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.055+0000 7ff85f7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff860070a00 0x7ff860161460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.055+0000 7ff85f7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff860070a00 0x7ff860161460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42546/0 (socket says 172.21.15.44:42546) 2024-09-13T18:33:16.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.055+0000 7ff85f7fe700 1 -- 172.21.15.44:0/1780174768 learned_addr learned my addr 172.21.15.44:0/1780174768 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:16.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.055+0000 7ff85e7fc700 1 --2- 172.21.15.44:0/1780174768 >> v2:172.21.15.99:3300/0 conn(0x7ff860164f90 0x7ff8600704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.055+0000 7ff85effd700 1 --2- 172.21.15.44:0/1780174768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff86006d8c0 0x7ff860164a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.055+0000 7ff85f7fe700 1 -- 172.21.15.44:0/1780174768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff86006d8c0 msgr2=0x7ff860164a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.055+0000 7ff85f7fe700 1 --2- 172.21.15.44:0/1780174768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff86006d8c0 0x7ff860164a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.055+0000 7ff85f7fe700 1 -- 172.21.15.44:0/1780174768 >> v2:172.21.15.99:3300/0 conn(0x7ff860164f90 msgr2=0x7ff8600704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.055+0000 7ff85f7fe700 1 --2- 172.21.15.44:0/1780174768 >> v2:172.21.15.99:3300/0 conn(0x7ff860164f90 0x7ff8600704c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.055+0000 7ff85f7fe700 1 -- 172.21.15.44:0/1780174768 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff860071240 con 0x7ff860070a00 2024-09-13T18:33:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.055+0000 7ff85e7fc700 1 --2- 172.21.15.44:0/1780174768 >> v2:172.21.15.99:3300/0 conn(0x7ff860164f90 0x7ff8600704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:33:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.059+0000 7ff85f7fe700 1 --2- 172.21.15.44:0/1780174768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff860070a00 0x7ff860161460 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7ff8600b3190 tx=0x7ff85800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7232b56ff5827fc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.059+0000 7ff85dffb700 1 -- 172.21.15.44:0/1780174768 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85800e070 con 0x7ff860070a00 2024-09-13T18:33:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.059+0000 7ff85dffb700 1 -- 172.21.15.44:0/1780174768 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85800b910 con 0x7ff860070a00 2024-09-13T18:33:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.059+0000 7ff85dffb700 1 -- 172.21.15.44:0/1780174768 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85800bcc0 con 0x7ff860070a00 2024-09-13T18:33:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.059+0000 7ff85ffff700 1 -- 172.21.15.44:0/1780174768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff860070a00 msgr2=0x7ff860161460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.059+0000 7ff85ffff700 1 --2- 172.21.15.44:0/1780174768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff860070a00 0x7ff860161460 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7ff8600b3190 tx=0x7ff85800b330 comp rx=0 tx=0).stop 2024-09-13T18:33:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.059+0000 7ff85ffff700 1 -- 172.21.15.44:0/1780174768 shutdown_connections 2024-09-13T18:33:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.059+0000 7ff85ffff700 1 --2- 172.21.15.44:0/1780174768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff860070a00 0x7ff860161460 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.059+0000 7ff85ffff700 1 --2- 172.21.15.44:0/1780174768 >> v2:172.21.15.99:3300/0 conn(0x7ff860164f90 0x7ff8600704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.059+0000 7ff85ffff700 1 --2- 172.21.15.44:0/1780174768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff86006d8c0 0x7ff860164a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.059+0000 7ff85ffff700 1 -- 172.21.15.44:0/1780174768 >> 172.21.15.44:0/1780174768 conn(0x7ff8600b0e10 msgr2=0x7ff8600b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:16.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.059+0000 7ff85ffff700 1 -- 172.21.15.44:0/1780174768 shutdown_connections 2024-09-13T18:33:16.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.059+0000 7ff85ffff700 1 -- 172.21.15.44:0/1780174768 wait complete. 2024-09-13T18:33:16.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.059+0000 7ff85ffff700 1 Processor -- start 2024-09-13T18:33:16.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.059+0000 7ff85ffff700 1 -- start start 2024-09-13T18:33:16.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.063+0000 7ff85ffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff86006d8c0 0x7ff860156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.063+0000 7ff85ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff860070a00 0x7ff8601f7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.063+0000 7ff85ffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff860164f90 0x7ff8601f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.063+0000 7ff85ffff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86015bf40 con 0x7ff860070a00 2024-09-13T18:33:16.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.063+0000 7ff85ffff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff860156b50 con 0x7ff86006d8c0 2024-09-13T18:33:16.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.063+0000 7ff85ffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff86015bba0 con 0x7ff860164f90 2024-09-13T18:33:16.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.063+0000 7ff85e7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff860070a00 0x7ff8601f7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.063+0000 7ff85e7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff860070a00 0x7ff8601f7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42550/0 (socket says 172.21.15.44:42550) 2024-09-13T18:33:16.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.063+0000 7ff85e7fc700 1 -- 172.21.15.44:0/1201804902 learned_addr learned my addr 172.21.15.44:0/1201804902 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:16.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.063+0000 7ff85f7fe700 1 --2- 172.21.15.44:0/1201804902 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff860164f90 0x7ff8601f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.063+0000 7ff85effd700 1 --2- 172.21.15.44:0/1201804902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff86006d8c0 0x7ff860156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.063+0000 7ff85e7fc700 1 -- 172.21.15.44:0/1201804902 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff860164f90 msgr2=0x7ff8601f6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:16.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.063+0000 7ff85e7fc700 1 --2- 172.21.15.44:0/1201804902 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff860164f90 0x7ff8601f6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.063+0000 7ff85e7fc700 1 -- 172.21.15.44:0/1201804902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff86006d8c0 msgr2=0x7ff860156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:16.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.063+0000 7ff85e7fc700 1 --2- 172.21.15.44:0/1201804902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff86006d8c0 0x7ff860156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.063+0000 7ff85e7fc700 1 -- 172.21.15.44:0/1201804902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8500094b0 con 0x7ff860070a00 2024-09-13T18:33:16.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.063+0000 7ff85e7fc700 1 --2- 172.21.15.44:0/1201804902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff860070a00 0x7ff8601f7da0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7ff85000ebb0 tx=0x7ff85000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:16.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.063+0000 7ff847fff700 1 -- 172.21.15.44:0/1201804902 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85000c850 con 0x7ff860070a00 2024-09-13T18:33:16.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.063+0000 7ff847fff700 1 -- 172.21.15.44:0/1201804902 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85000c9b0 con 0x7ff860070a00 2024-09-13T18:33:16.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.063+0000 7ff847fff700 1 -- 172.21.15.44:0/1201804902 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85000cd40 con 0x7ff860070a00 2024-09-13T18:33:16.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.063+0000 7ff85ffff700 1 -- 172.21.15.44:0/1201804902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff858009b30 con 0x7ff860070a00 2024-09-13T18:33:16.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.063+0000 7ff85ffff700 1 -- 172.21.15.44:0/1201804902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8601f7840 con 0x7ff860070a00 2024-09-13T18:33:16.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.063+0000 7ff85ffff700 1 -- 172.21.15.44:0/1201804902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff86015c080 con 0x7ff860070a00 2024-09-13T18:33:16.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.067+0000 7ff847fff700 1 -- 172.21.15.44:0/1201804902 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff850013470 con 0x7ff860070a00 2024-09-13T18:33:16.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.067+0000 7ff847fff700 1 --2- 172.21.15.44:0/1201804902 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff84c066730 0x7ff84c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.067+0000 7ff847fff700 1 -- 172.21.15.44:0/1201804902 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5609+0+0 (secure 0 0 0) 0x7ff8500840c0 con 0x7ff860070a00 2024-09-13T18:33:16.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.067+0000 7ff85effd700 1 --2- 172.21.15.44:0/1201804902 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff84c066730 0x7ff84c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.067+0000 7ff85effd700 1 --2- 172.21.15.44:0/1201804902 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff84c066730 0x7ff84c068bf0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff860164f30 tx=0x7ff854009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:16.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.075+0000 7ff847fff700 1 -- 172.21.15.44:0/1201804902 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff86015c080 con 0x7ff860070a00 2024-09-13T18:33:16.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.287+0000 7ff85ffff700 1 -- 172.21.15.44:0/1201804902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff86015c080 con 0x7ff860070a00 2024-09-13T18:33:16.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.295+0000 7ff847fff700 1 -- 172.21.15.44:0/1201804902 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v42) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff86015c080 con 0x7ff860070a00 2024-09-13T18:33:16.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.307+0000 7ff85ffff700 1 -- 172.21.15.44:0/1201804902 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff84c066730 msgr2=0x7ff84c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:16.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.307+0000 7ff85ffff700 1 --2- 172.21.15.44:0/1201804902 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff84c066730 0x7ff84c068bf0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff860164f30 tx=0x7ff854009240 comp rx=0 tx=0).stop 2024-09-13T18:33:16.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.307+0000 7ff85ffff700 1 -- 172.21.15.44:0/1201804902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff860070a00 msgr2=0x7ff8601f7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:16.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.307+0000 7ff85ffff700 1 --2- 172.21.15.44:0/1201804902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff860070a00 0x7ff8601f7da0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7ff85000ebb0 tx=0x7ff85000eec0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.311+0000 7ff85ffff700 1 -- 172.21.15.44:0/1201804902 shutdown_connections 2024-09-13T18:33:16.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.311+0000 7ff85ffff700 1 --2- 172.21.15.44:0/1201804902 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff84c066730 0x7ff84c068bf0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.311+0000 7ff85ffff700 1 --2- 172.21.15.44:0/1201804902 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff860164f90 0x7ff8601f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.311+0000 7ff85ffff700 1 --2- 172.21.15.44:0/1201804902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff860070a00 0x7ff8601f7da0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.311+0000 7ff85ffff700 1 --2- 172.21.15.44:0/1201804902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff86006d8c0 0x7ff860156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.311+0000 7ff85ffff700 1 -- 172.21.15.44:0/1201804902 >> 172.21.15.44:0/1201804902 conn(0x7ff8600b0e10 msgr2=0x7ff86015fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:16.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.311+0000 7ff85ffff700 1 -- 172.21.15.44:0/1201804902 shutdown_connections 2024-09-13T18:33:16.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.311+0000 7ff85ffff700 1 -- 172.21.15.44:0/1201804902 wait complete. 2024-09-13T18:33:16.324 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 8 and data pool 9 2024-09-13T18:33:16.340 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:16.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.435+0000 7f162359e700 1 Processor -- start 2024-09-13T18:33:16.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.435+0000 7f162359e700 1 -- start start 2024-09-13T18:33:16.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f162359e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f162406bb90 0x7f16240cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f162359e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f162406d150 0x7f162406d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f162359e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162406a780 con 0x7f162406fb30 2024-09-13T18:33:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f162359e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f162406cd30 con 0x7f162406d150 2024-09-13T18:33:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f162359e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16240ae2e0 con 0x7f162406bb90 2024-09-13T18:33:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f1622d9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f162406d150 0x7f162406d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f1622d9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f162406d150 0x7f162406d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42556/0 (socket says 172.21.15.44:42556) 2024-09-13T18:33:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f1622d9d700 1 -- 172.21.15.44:0/1036020667 learned_addr learned my addr 172.21.15.44:0/1036020667 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f1621d9b700 1 --2- 172.21.15.44:0/1036020667 >> v2:172.21.15.99:3300/0 conn(0x7f162406bb90 0x7f16240cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f1622d9d700 1 -- 172.21.15.44:0/1036020667 >> v2:172.21.15.99:3300/0 conn(0x7f162406bb90 msgr2=0x7f16240cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f1622d9d700 1 --2- 172.21.15.44:0/1036020667 >> v2:172.21.15.99:3300/0 conn(0x7f162406bb90 0x7f16240cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f1622d9d700 1 -- 172.21.15.44:0/1036020667 >> v1:172.21.15.99:6789/0 conn(0x7f162406fb30 legacy=0x7f16240adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f1622d9d700 1 -- 172.21.15.44:0/1036020667 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1624159470 con 0x7f162406d150 2024-09-13T18:33:16.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f1622d9d700 1 --2- 172.21.15.44:0/1036020667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f162406d150 0x7f162406d5a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f1624071670 tx=0x7f1614009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3fdc2d4420f82af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:16.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f162159a700 1 -- 172.21.15.44:0/1036020667 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614011830 con 0x7f162406d150 2024-09-13T18:33:16.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f162159a700 1 -- 172.21.15.44:0/1036020667 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1614011990 con 0x7f162406d150 2024-09-13T18:33:16.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f162159a700 1 -- 172.21.15.44:0/1036020667 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614011d20 con 0x7f162406d150 2024-09-13T18:33:16.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f162359e700 1 -- 172.21.15.44:0/1036020667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f162406d150 msgr2=0x7f162406d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:16.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f162359e700 1 --2- 172.21.15.44:0/1036020667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f162406d150 0x7f162406d5a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f1624071670 tx=0x7f1614009bf0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f162359e700 1 -- 172.21.15.44:0/1036020667 shutdown_connections 2024-09-13T18:33:16.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f162359e700 1 --2- 172.21.15.44:0/1036020667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f162406d150 0x7f162406d5a0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f162359e700 1 --2- 172.21.15.44:0/1036020667 >> v2:172.21.15.99:3300/0 conn(0x7f162406bb90 0x7f16240cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f162359e700 1 -- 172.21.15.44:0/1036020667 >> 172.21.15.44:0/1036020667 conn(0x7f16240b0f00 msgr2=0x7f16240b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:16.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f162359e700 1 -- 172.21.15.44:0/1036020667 shutdown_connections 2024-09-13T18:33:16.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.439+0000 7f162359e700 1 -- 172.21.15.44:0/1036020667 wait complete. 2024-09-13T18:33:16.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.443+0000 7f162359e700 1 Processor -- start 2024-09-13T18:33:16.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.443+0000 7f162359e700 1 -- start start 2024-09-13T18:33:16.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.447+0000 7f162359e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f162406bb90 0x7f16240acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.447+0000 7f162359e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f162406d150 0x7f16241524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.447+0000 7f162359e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f162406fb30 0x7f1624143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.447+0000 7f162359e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1624150320 con 0x7f162406fb30 2024-09-13T18:33:16.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.447+0000 7f162359e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1624150600 con 0x7f162406bb90 2024-09-13T18:33:16.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.447+0000 7f162359e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16241508e0 con 0x7f162406d150 2024-09-13T18:33:16.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.447+0000 7f1622d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f162406fb30 0x7f1624143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.447+0000 7f1622d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f162406fb30 0x7f1624143df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42570/0 (socket says 172.21.15.44:42570) 2024-09-13T18:33:16.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.447+0000 7f1622d9d700 1 -- 172.21.15.44:0/2814865138 learned_addr learned my addr 172.21.15.44:0/2814865138 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:16.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.447+0000 7f162259c700 1 --2- 172.21.15.44:0/2814865138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f162406bb90 0x7f16240acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.447+0000 7f1621d9b700 1 --2- 172.21.15.44:0/2814865138 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f162406d150 0x7f16241524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.447+0000 7f1622d9d700 1 -- 172.21.15.44:0/2814865138 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f162406d150 msgr2=0x7f16241524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:16.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.447+0000 7f1622d9d700 1 --2- 172.21.15.44:0/2814865138 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f162406d150 0x7f16241524c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.447+0000 7f1622d9d700 1 -- 172.21.15.44:0/2814865138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f162406bb90 msgr2=0x7f16240acb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:16.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.447+0000 7f1622d9d700 1 --2- 172.21.15.44:0/2814865138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f162406bb90 0x7f16240acb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.447+0000 7f1622d9d700 1 -- 172.21.15.44:0/2814865138 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1614009570 con 0x7f162406fb30 2024-09-13T18:33:16.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.447+0000 7f1622d9d700 1 --2- 172.21.15.44:0/2814865138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f162406fb30 0x7f1624143df0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f16240cb530 tx=0x7f1614004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:16.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.447+0000 7f161affd700 1 -- 172.21.15.44:0/2814865138 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614004450 con 0x7f162406fb30 2024-09-13T18:33:16.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.447+0000 7f161affd700 1 -- 172.21.15.44:0/2814865138 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16140045b0 con 0x7f162406fb30 2024-09-13T18:33:16.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.447+0000 7f161affd700 1 -- 172.21.15.44:0/2814865138 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614003900 con 0x7f162406fb30 2024-09-13T18:33:16.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.447+0000 7f162359e700 1 -- 172.21.15.44:0/2814865138 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1624150bc0 con 0x7f162406fb30 2024-09-13T18:33:16.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.447+0000 7f162359e700 1 -- 172.21.15.44:0/2814865138 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f162414ff60 con 0x7f162406fb30 2024-09-13T18:33:16.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.447+0000 7f162359e700 1 -- 172.21.15.44:0/2814865138 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162406d5a0 con 0x7f162406fb30 2024-09-13T18:33:16.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.451+0000 7f161affd700 1 -- 172.21.15.44:0/2814865138 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1614003a60 con 0x7f162406fb30 2024-09-13T18:33:16.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.451+0000 7f161affd700 1 --2- 172.21.15.44:0/2814865138 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1604066760 0x7f1604068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.451+0000 7f161affd700 1 -- 172.21.15.44:0/2814865138 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1614021030 con 0x7f162406fb30 2024-09-13T18:33:16.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.451+0000 7f162259c700 1 --2- 172.21.15.44:0/2814865138 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1604066760 0x7f1604068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.451+0000 7f162259c700 1 --2- 172.21.15.44:0/2814865138 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1604066760 0x7f1604068c20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f16240b2030 tx=0x7f161c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:16.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.459+0000 7f161affd700 1 -- 172.21.15.44:0/2814865138 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1614052990 con 0x7f162406fb30 2024-09-13T18:33:16.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.631+0000 7f162359e700 1 -- 172.21.15.44:0/2814865138 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16241500f0 con 0x7f162406fb30 2024-09-13T18:33:16.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.635+0000 7f161affd700 1 -- 172.21.15.44:0/2814865138 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+16518 (secure 0 0 0) 0x7f1614055fb0 con 0x7f162406fb30 2024-09-13T18:33:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:33:16.643 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":62,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:33:16.290394+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:14.682923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:15.291935+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:16.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.639+0000 7f162359e700 1 -- 172.21.15.44:0/2814865138 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1604066760 msgr2=0x7f1604068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:16.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.639+0000 7f162359e700 1 --2- 172.21.15.44:0/2814865138 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1604066760 0x7f1604068c20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f16240b2030 tx=0x7f161c009040 comp rx=0 tx=0).stop 2024-09-13T18:33:16.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.639+0000 7f162359e700 1 -- 172.21.15.44:0/2814865138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f162406fb30 msgr2=0x7f1624143df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:16.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.639+0000 7f162359e700 1 --2- 172.21.15.44:0/2814865138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f162406fb30 0x7f1624143df0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f16240cb530 tx=0x7f1614004770 comp rx=0 tx=0).stop 2024-09-13T18:33:16.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.639+0000 7f162359e700 1 -- 172.21.15.44:0/2814865138 shutdown_connections 2024-09-13T18:33:16.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.639+0000 7f162359e700 1 --2- 172.21.15.44:0/2814865138 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1604066760 0x7f1604068c20 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.639+0000 7f162359e700 1 --2- 172.21.15.44:0/2814865138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f162406fb30 0x7f1624143df0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.639+0000 7f162359e700 1 --2- 172.21.15.44:0/2814865138 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f162406d150 0x7f16241524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.639+0000 7f162359e700 1 --2- 172.21.15.44:0/2814865138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f162406bb90 0x7f16240acb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.639+0000 7f162359e700 1 -- 172.21.15.44:0/2814865138 >> 172.21.15.44:0/2814865138 conn(0x7f16240b0f00 msgr2=0x7f16240cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:16.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.639+0000 7f162359e700 1 -- 172.21.15.44:0/2814865138 shutdown_connections 2024-09-13T18:33:16.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.639+0000 7f162359e700 1 -- 172.21.15.44:0/2814865138 wait complete. 2024-09-13T18:33:16.658 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:16.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad24b1d700 1 Processor -- start 2024-09-13T18:33:16.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad24b1d700 1 -- start start 2024-09-13T18:33:16.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad24b1d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad200b3ae0 0x7fad2006a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad24b1d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fad2006aaf0 0x7fad2015e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad24b1d700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2013dcb0 con 0x7fad2006bbf0 2024-09-13T18:33:16.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad24b1d700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2015be60 con 0x7fad2006aaf0 2024-09-13T18:33:16.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad24b1d700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2013ffd0 con 0x7fad200b3ae0 2024-09-13T18:33:16.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad1ffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fad2006aaf0 0x7fad2015e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad1ffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fad2006aaf0 0x7fad2015e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42586/0 (socket says 172.21.15.44:42586) 2024-09-13T18:33:16.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad1effd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad200b3ae0 0x7fad2006a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad1ffff700 1 -- 172.21.15.44:0/611382083 learned_addr learned my addr 172.21.15.44:0/611382083 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:16.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad1ffff700 1 -- 172.21.15.44:0/611382083 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad200b3ae0 msgr2=0x7fad2006a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:16.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad1ffff700 1 --2- 172.21.15.44:0/611382083 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad200b3ae0 0x7fad2006a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad1ffff700 1 -- 172.21.15.44:0/611382083 >> v1:172.21.15.99:6789/0 conn(0x7fad2006bbf0 legacy=0x7fad200b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:16.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad1ffff700 1 -- 172.21.15.44:0/611382083 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad20140220 con 0x7fad2006aaf0 2024-09-13T18:33:16.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad1ffff700 1 --2- 172.21.15.44:0/611382083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad2006aaf0 0x7fad2015e440 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fad18009e50 tx=0x7fad1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed2cfaa09381e4f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:16.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad1e7fc700 1 -- 172.21.15.44:0/611382083 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1800e070 con 0x7fad2006aaf0 2024-09-13T18:33:16.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad1e7fc700 1 -- 172.21.15.44:0/611382083 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1800b910 con 0x7fad2006aaf0 2024-09-13T18:33:16.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad1e7fc700 1 -- 172.21.15.44:0/611382083 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1800bcc0 con 0x7fad2006aaf0 2024-09-13T18:33:16.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad24b1d700 1 -- 172.21.15.44:0/611382083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad2006aaf0 msgr2=0x7fad2015e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:16.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad24b1d700 1 --2- 172.21.15.44:0/611382083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad2006aaf0 0x7fad2015e440 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fad18009e50 tx=0x7fad1800b330 comp rx=0 tx=0).stop 2024-09-13T18:33:16.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad24b1d700 1 -- 172.21.15.44:0/611382083 shutdown_connections 2024-09-13T18:33:16.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad24b1d700 1 --2- 172.21.15.44:0/611382083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad2006aaf0 0x7fad2015e440 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad24b1d700 1 --2- 172.21.15.44:0/611382083 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad200b3ae0 0x7fad2006a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad24b1d700 1 -- 172.21.15.44:0/611382083 >> 172.21.15.44:0/611382083 conn(0x7fad200b0f00 msgr2=0x7fad200b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:16.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad24b1d700 1 -- 172.21.15.44:0/611382083 shutdown_connections 2024-09-13T18:33:16.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.767+0000 7fad24b1d700 1 -- 172.21.15.44:0/611382083 wait complete. 2024-09-13T18:33:16.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.771+0000 7fad24b1d700 1 Processor -- start 2024-09-13T18:33:16.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.771+0000 7fad24b1d700 1 -- start start 2024-09-13T18:33:16.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.771+0000 7fad24b1d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad2006aaf0 0x7fad201436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.771+0000 7fad24b1d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad2006bbf0 0x7fad20138080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.771+0000 7fad24b1d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad200b3ae0 0x7fad201418c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.771+0000 7fad24b1d700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad20143290 con 0x7fad200b3ae0 2024-09-13T18:33:16.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.771+0000 7fad24b1d700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad20142610 con 0x7fad2006aaf0 2024-09-13T18:33:16.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.771+0000 7fad24b1d700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad201428f0 con 0x7fad2006bbf0 2024-09-13T18:33:16.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.771+0000 7fad1ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad200b3ae0 0x7fad201418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.771+0000 7fad1ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad200b3ae0 0x7fad201418c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42600/0 (socket says 172.21.15.44:42600) 2024-09-13T18:33:16.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.771+0000 7fad1ffff700 1 -- 172.21.15.44:0/19408209 learned_addr learned my addr 172.21.15.44:0/19408209 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:16.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.771+0000 7fad1f7fe700 1 --2- 172.21.15.44:0/19408209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad2006aaf0 0x7fad201436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.771+0000 7fad1effd700 1 --2- 172.21.15.44:0/19408209 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad2006bbf0 0x7fad20138080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.775+0000 7fad1f7fe700 1 -- 172.21.15.44:0/19408209 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad2006bbf0 msgr2=0x7fad20138080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:16.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.775+0000 7fad1f7fe700 1 --2- 172.21.15.44:0/19408209 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad2006bbf0 0x7fad20138080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.775+0000 7fad1f7fe700 1 -- 172.21.15.44:0/19408209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad200b3ae0 msgr2=0x7fad201418c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:16.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.775+0000 7fad1f7fe700 1 --2- 172.21.15.44:0/19408209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad200b3ae0 0x7fad201418c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.775+0000 7fad1f7fe700 1 -- 172.21.15.44:0/19408209 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad18009b30 con 0x7fad2006aaf0 2024-09-13T18:33:16.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.775+0000 7fad1ffff700 1 --2- 172.21.15.44:0/19408209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad200b3ae0 0x7fad201418c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:33:16.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.775+0000 7fad1f7fe700 1 --2- 172.21.15.44:0/19408209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad2006aaf0 0x7fad201436b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fad1000c480 tx=0x7fad1000c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:16.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.775+0000 7fad07fff700 1 -- 172.21.15.44:0/19408209 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad100052d0 con 0x7fad2006aaf0 2024-09-13T18:33:16.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.775+0000 7fad07fff700 1 -- 172.21.15.44:0/19408209 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad10005430 con 0x7fad2006aaf0 2024-09-13T18:33:16.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.775+0000 7fad07fff700 1 -- 172.21.15.44:0/19408209 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad100055a0 con 0x7fad2006aaf0 2024-09-13T18:33:16.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.775+0000 7fad24b1d700 1 -- 172.21.15.44:0/19408209 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad20142bd0 con 0x7fad2006aaf0 2024-09-13T18:33:16.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.775+0000 7fad24b1d700 1 -- 172.21.15.44:0/19408209 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad20151c60 con 0x7fad2006aaf0 2024-09-13T18:33:16.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.775+0000 7fad24b1d700 1 -- 172.21.15.44:0/19408209 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad20143bf0 con 0x7fad2006aaf0 2024-09-13T18:33:16.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.775+0000 7fad07fff700 1 -- 172.21.15.44:0/19408209 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fad100038e0 con 0x7fad2006aaf0 2024-09-13T18:33:16.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.779+0000 7fad07fff700 1 --2- 172.21.15.44:0/19408209 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fad0c066730 0x7fad0c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.779+0000 7fad07fff700 1 -- 172.21.15.44:0/19408209 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad10083390 con 0x7fad2006aaf0 2024-09-13T18:33:16.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.779+0000 7fad1effd700 1 --2- 172.21.15.44:0/19408209 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fad0c066730 0x7fad0c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.779+0000 7fad1effd700 1 --2- 172.21.15.44:0/19408209 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fad0c066730 0x7fad0c068bf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fad200b26e0 tx=0x7fad14009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:16.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.787+0000 7fad07fff700 1 -- 172.21.15.44:0/19408209 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fad10050790 con 0x7fad2006aaf0 2024-09-13T18:33:16.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.963+0000 7fad24b1d700 1 -- 172.21.15.44:0/19408209 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad2006af80 con 0x7fad2006aaf0 2024-09-13T18:33:16.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.967+0000 7fad07fff700 1 -- 172.21.15.44:0/19408209 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+16518 (secure 0 0 0) 0x7fad10053db0 con 0x7fad2006aaf0 2024-09-13T18:33:16.974 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:33:16.974 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":62,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:33:16.290394+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:14.682923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:15.291935+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:16.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.967+0000 7fad24b1d700 1 -- 172.21.15.44:0/19408209 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fad0c066730 msgr2=0x7fad0c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:16.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.967+0000 7fad24b1d700 1 --2- 172.21.15.44:0/19408209 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fad0c066730 0x7fad0c068bf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fad200b26e0 tx=0x7fad14009240 comp rx=0 tx=0).stop 2024-09-13T18:33:16.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.967+0000 7fad24b1d700 1 -- 172.21.15.44:0/19408209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad2006aaf0 msgr2=0x7fad201436b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:16.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.967+0000 7fad24b1d700 1 --2- 172.21.15.44:0/19408209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad2006aaf0 0x7fad201436b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fad1000c480 tx=0x7fad1000c790 comp rx=0 tx=0).stop 2024-09-13T18:33:16.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.967+0000 7fad24b1d700 1 -- 172.21.15.44:0/19408209 shutdown_connections 2024-09-13T18:33:16.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.967+0000 7fad24b1d700 1 --2- 172.21.15.44:0/19408209 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fad0c066730 0x7fad0c068bf0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.967+0000 7fad24b1d700 1 --2- 172.21.15.44:0/19408209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad200b3ae0 0x7fad201418c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.967+0000 7fad24b1d700 1 --2- 172.21.15.44:0/19408209 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad2006bbf0 0x7fad20138080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.967+0000 7fad24b1d700 1 --2- 172.21.15.44:0/19408209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad2006aaf0 0x7fad201436b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.967+0000 7fad24b1d700 1 -- 172.21.15.44:0/19408209 >> 172.21.15.44:0/19408209 conn(0x7fad200b0f00 msgr2=0x7fad2006d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:16.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.971+0000 7fad24b1d700 1 -- 172.21.15.44:0/19408209 shutdown_connections 2024-09-13T18:33:16.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:16.971+0000 7fad24b1d700 1 -- 172.21.15.44:0/19408209 wait complete. 2024-09-13T18:33:16.989 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:33:17.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.111+0000 7fa63413e700 1 Processor -- start 2024-09-13T18:33:17.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.111+0000 7fa63413e700 1 -- start start 2024-09-13T18:33:17.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.111+0000 7fa63413e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa62c15aac0 0x7fa62c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:17.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa63413e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62c0ce570 con 0x7fa62c0cba80 2024-09-13T18:33:17.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa63413e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62c0cef40 con 0x7fa62c0b3940 2024-09-13T18:33:17.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa63413e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62c15aea0 con 0x7fa62c15aac0 2024-09-13T18:33:17.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa6316d9700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa62c0cba80 0x7fa62c0b3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51170/0 (socket says 172.21.15.44:51170) 2024-09-13T18:33:17.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa6316d9700 1 -- 172.21.15.44:0/3639365802 learned_addr learned my addr 172.21.15.44:0/3639365802 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:17.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa631eda700 1 --2- 172.21.15.44:0/3639365802 >> v2:172.21.15.99:3300/0 conn(0x7fa62c15aac0 0x7fa62c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:17.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa630ed8700 1 -- 172.21.15.44:0/3639365802 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105156204 0 0) 0x7fa62c0ce570 con 0x7fa62c0cba80 2024-09-13T18:33:17.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa630ed8700 1 -- 172.21.15.44:0/3639365802 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6180035d0 con 0x7fa62c0cba80 2024-09-13T18:33:17.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa631eda700 1 -- 172.21.15.44:0/3639365802 >> v1:172.21.15.99:6789/0 conn(0x7fa62c0b3940 legacy=0x7fa62c06a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:17.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa631eda700 1 -- 172.21.15.44:0/3639365802 >> v1:172.21.15.44:6789/0 conn(0x7fa62c0cba80 legacy=0x7fa62c0b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:17.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa631eda700 1 -- 172.21.15.44:0/3639365802 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c0cd960 con 0x7fa62c15aac0 2024-09-13T18:33:17.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa631eda700 1 --2- 172.21.15.44:0/3639365802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa62c15aac0 0x7fa62c0cea00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa628009850 tx=0x7fa628009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca547e1a38f7218b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:17.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa630ed8700 1 -- 172.21.15.44:0/3639365802 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628011830 con 0x7fa62c15aac0 2024-09-13T18:33:17.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa630ed8700 1 -- 172.21.15.44:0/3639365802 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa628011990 con 0x7fa62c15aac0 2024-09-13T18:33:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa630ed8700 1 -- 172.21.15.44:0/3639365802 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628011d40 con 0x7fa62c15aac0 2024-09-13T18:33:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa63413e700 1 -- 172.21.15.44:0/3639365802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa62c15aac0 msgr2=0x7fa62c0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa63413e700 1 --2- 172.21.15.44:0/3639365802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa62c15aac0 0x7fa62c0cea00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa628009850 tx=0x7fa628009b60 comp rx=0 tx=0).stop 2024-09-13T18:33:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa63413e700 1 -- 172.21.15.44:0/3639365802 shutdown_connections 2024-09-13T18:33:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa63413e700 1 --2- 172.21.15.44:0/3639365802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa62c15aac0 0x7fa62c0cea00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa63413e700 1 -- 172.21.15.44:0/3639365802 >> 172.21.15.44:0/3639365802 conn(0x7fa62c06d900 msgr2=0x7fa62c06dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa63413e700 1 -- 172.21.15.44:0/3639365802 shutdown_connections 2024-09-13T18:33:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa63413e700 1 -- 172.21.15.44:0/3639365802 wait complete. 2024-09-13T18:33:17.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa63413e700 1 Processor -- start 2024-09-13T18:33:17.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.115+0000 7fa63413e700 1 -- start start 2024-09-13T18:33:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.119+0000 7fa63413e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa62c0b3940 0x7fa62c1593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.119+0000 7fa63413e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa62c0cba80 0x7fa62c147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.119+0000 7fa63413e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa62c15aac0 0x7fa62c0add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.119+0000 7fa63413e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c158360 con 0x7fa62c15aac0 2024-09-13T18:33:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.119+0000 7fa63413e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c158640 con 0x7fa62c0b3940 2024-09-13T18:33:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.119+0000 7fa63413e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c158920 con 0x7fa62c0cba80 2024-09-13T18:33:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.119+0000 7fa6326db700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa62c15aac0 0x7fa62c0add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.119+0000 7fa631eda700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa62c0b3940 0x7fa62c1593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.119+0000 7fa6326db700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa62c15aac0 0x7fa62c0add30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42612/0 (socket says 172.21.15.44:42612) 2024-09-13T18:33:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.119+0000 7fa6326db700 1 -- 172.21.15.44:0/775140502 learned_addr learned my addr 172.21.15.44:0/775140502 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.119+0000 7fa6316d9700 1 --2- 172.21.15.44:0/775140502 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa62c0cba80 0x7fa62c147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.119+0000 7fa631eda700 1 -- 172.21.15.44:0/775140502 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa62c0cba80 msgr2=0x7fa62c147b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.119+0000 7fa631eda700 1 --2- 172.21.15.44:0/775140502 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa62c0cba80 0x7fa62c147b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.119+0000 7fa631eda700 1 -- 172.21.15.44:0/775140502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa62c15aac0 msgr2=0x7fa62c0add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.119+0000 7fa631eda700 1 --2- 172.21.15.44:0/775140502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa62c15aac0 0x7fa62c0add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.119+0000 7fa631eda700 1 -- 172.21.15.44:0/775140502 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6280094b0 con 0x7fa62c0b3940 2024-09-13T18:33:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.119+0000 7fa6326db700 1 --2- 172.21.15.44:0/775140502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa62c15aac0 0x7fa62c0add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:33:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.119+0000 7fa631eda700 1 --2- 172.21.15.44:0/775140502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa62c0b3940 0x7fa62c1593e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa628016000 tx=0x7fa628004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.119+0000 7fa6227fc700 1 -- 172.21.15.44:0/775140502 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628019980 con 0x7fa62c0b3940 2024-09-13T18:33:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.119+0000 7fa63413e700 1 -- 172.21.15.44:0/775140502 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62c158c00 con 0x7fa62c0b3940 2024-09-13T18:33:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.119+0000 7fa6227fc700 1 -- 172.21.15.44:0/775140502 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62801e070 con 0x7fa62c0b3940 2024-09-13T18:33:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.119+0000 7fa6227fc700 1 -- 172.21.15.44:0/775140502 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628019d20 con 0x7fa62c0b3940 2024-09-13T18:33:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.119+0000 7fa63413e700 1 -- 172.21.15.44:0/775140502 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62c148090 con 0x7fa62c0b3940 2024-09-13T18:33:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.123+0000 7fa63413e700 1 -- 172.21.15.44:0/775140502 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62c0cd510 con 0x7fa62c0b3940 2024-09-13T18:33:17.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.123+0000 7fa6227fc700 1 -- 172.21.15.44:0/775140502 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa62802d450 con 0x7fa62c0b3940 2024-09-13T18:33:17.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.123+0000 7fa6227fc700 1 --2- 172.21.15.44:0/775140502 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa610066730 0x7fa610068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:17.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.123+0000 7fa6227fc700 1 -- 172.21.15.44:0/775140502 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa628085080 con 0x7fa62c0b3940 2024-09-13T18:33:17.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.123+0000 7fa6316d9700 1 --2- 172.21.15.44:0/775140502 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa610066730 0x7fa610068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:17.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.123+0000 7fa6316d9700 1 --2- 172.21.15.44:0/775140502 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa610066730 0x7fa610068bf0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa62c074710 tx=0x7fa61c007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:17.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.131+0000 7fa6227fc700 1 -- 172.21.15.44:0/775140502 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa628052400 con 0x7fa62c0b3940 2024-09-13T18:33:17.213 INFO:tasks.ceph.mds.d.smithi099.stderr:2024-09-13T18:33:17.206+0000 7fa4a9d14700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:33:17.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:17.347+0000 7fa63413e700 1 -- 172.21.15.44:0/775140502 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa62c0b0160 con 0x7fa62c0b3940 2024-09-13T18:33:18.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.307+0000 7fa6227fc700 1 -- 172.21.15.44:0/775140502 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v44) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa628055a20 con 0x7fa62c0b3940 2024-09-13T18:33:18.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.311+0000 7fa63413e700 1 -- 172.21.15.44:0/775140502 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa610066730 msgr2=0x7fa610068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:18.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.311+0000 7fa63413e700 1 --2- 172.21.15.44:0/775140502 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa610066730 0x7fa610068bf0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa62c074710 tx=0x7fa61c007de0 comp rx=0 tx=0).stop 2024-09-13T18:33:18.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.311+0000 7fa63413e700 1 -- 172.21.15.44:0/775140502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa62c0b3940 msgr2=0x7fa62c1593e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:18.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.311+0000 7fa63413e700 1 --2- 172.21.15.44:0/775140502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa62c0b3940 0x7fa62c1593e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa628016000 tx=0x7fa628004770 comp rx=0 tx=0).stop 2024-09-13T18:33:18.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.311+0000 7fa63413e700 1 -- 172.21.15.44:0/775140502 shutdown_connections 2024-09-13T18:33:18.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.311+0000 7fa63413e700 1 --2- 172.21.15.44:0/775140502 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa610066730 0x7fa610068bf0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:18.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.311+0000 7fa63413e700 1 --2- 172.21.15.44:0/775140502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa62c15aac0 0x7fa62c0add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:18.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.311+0000 7fa63413e700 1 --2- 172.21.15.44:0/775140502 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa62c0cba80 0x7fa62c147b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:18.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.311+0000 7fa63413e700 1 --2- 172.21.15.44:0/775140502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa62c0b3940 0x7fa62c1593e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:18.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.311+0000 7fa63413e700 1 -- 172.21.15.44:0/775140502 >> 172.21.15.44:0/775140502 conn(0x7fa62c06d900 msgr2=0x7fa62c0b0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:18.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.311+0000 7fa63413e700 1 -- 172.21.15.44:0/775140502 shutdown_connections 2024-09-13T18:33:18.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.311+0000 7fa63413e700 1 -- 172.21.15.44:0/775140502 wait complete. 2024-09-13T18:33:18.336 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:33:18.336 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:33:18.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.459+0000 7faf71db0700 1 Processor -- start 2024-09-13T18:33:18.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.459+0000 7faf71db0700 1 -- start start 2024-09-13T18:33:18.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.459+0000 7faf71db0700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf6c06d6f0 0x7faf6c0ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:18.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.459+0000 7faf71db0700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7faf6c15d200 0x7faf6c06baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:18.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.459+0000 7faf71db0700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf6c06dad0 con 0x7faf6c0adbd0 2024-09-13T18:33:18.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.459+0000 7faf71db0700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6c0ae3c0 con 0x7faf6c15d200 2024-09-13T18:33:18.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.459+0000 7faf71db0700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c0705b0 con 0x7faf6c06d6f0 2024-09-13T18:33:18.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.463+0000 7faf715af700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7faf6c15d200 0x7faf6c06baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:18.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.463+0000 7faf715af700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7faf6c15d200 0x7faf6c06baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42620/0 (socket says 172.21.15.44:42620) 2024-09-13T18:33:18.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.463+0000 7faf70dae700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf6c06d6f0 0x7faf6c0ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:18.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.463+0000 7faf715af700 1 -- 172.21.15.44:0/410605256 learned_addr learned my addr 172.21.15.44:0/410605256 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:18.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.463+0000 7faf715af700 1 -- 172.21.15.44:0/410605256 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf6c06d6f0 msgr2=0x7faf6c0ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:18.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.463+0000 7faf715af700 1 --2- 172.21.15.44:0/410605256 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf6c06d6f0 0x7faf6c0ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:18.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.463+0000 7faf715af700 1 -- 172.21.15.44:0/410605256 >> v1:172.21.15.99:6789/0 conn(0x7faf6c0adbd0 legacy=0x7faf6c15caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:18.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.463+0000 7faf715af700 1 -- 172.21.15.44:0/410605256 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c070890 con 0x7faf6c15d200 2024-09-13T18:33:18.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.463+0000 7faf715af700 1 --2- 172.21.15.44:0/410605256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf6c15d200 0x7faf6c06baf0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7faf6400bc10 tx=0x7faf6400bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2418e2132b15049 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:18.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.463+0000 7faf6b7fe700 1 -- 172.21.15.44:0/410605256 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6400dcb0 con 0x7faf6c15d200 2024-09-13T18:33:18.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.463+0000 7faf6b7fe700 1 -- 172.21.15.44:0/410605256 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6400de10 con 0x7faf6c15d200 2024-09-13T18:33:18.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.463+0000 7faf6b7fe700 1 -- 172.21.15.44:0/410605256 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf64010690 con 0x7faf6c15d200 2024-09-13T18:33:18.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.463+0000 7faf71db0700 1 -- 172.21.15.44:0/410605256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf6c15d200 msgr2=0x7faf6c06baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:18.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.463+0000 7faf71db0700 1 --2- 172.21.15.44:0/410605256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf6c15d200 0x7faf6c06baf0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7faf6400bc10 tx=0x7faf6400bf20 comp rx=0 tx=0).stop 2024-09-13T18:33:18.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.463+0000 7faf71db0700 1 -- 172.21.15.44:0/410605256 shutdown_connections 2024-09-13T18:33:18.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.463+0000 7faf71db0700 1 --2- 172.21.15.44:0/410605256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf6c15d200 0x7faf6c06baf0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:18.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.463+0000 7faf71db0700 1 --2- 172.21.15.44:0/410605256 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf6c06d6f0 0x7faf6c0ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:18.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.463+0000 7faf71db0700 1 -- 172.21.15.44:0/410605256 >> 172.21.15.44:0/410605256 conn(0x7faf6c0b0e10 msgr2=0x7faf6c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:18.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.463+0000 7faf71db0700 1 -- 172.21.15.44:0/410605256 shutdown_connections 2024-09-13T18:33:18.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.463+0000 7faf71db0700 1 -- 172.21.15.44:0/410605256 wait complete. 2024-09-13T18:33:18.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.467+0000 7faf71db0700 1 Processor -- start 2024-09-13T18:33:18.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.467+0000 7faf71db0700 1 -- start start 2024-09-13T18:33:18.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.467+0000 7faf71db0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf6c06d6f0 0x7faf6c147b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:18.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.467+0000 7faf71db0700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf6c0adbd0 0x7faf6c15b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:18.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.467+0000 7faf71db0700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf6c15d200 0x7faf6c150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:18.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.467+0000 7faf71db0700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c148760 con 0x7faf6c06d6f0 2024-09-13T18:33:18.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.467+0000 7faf71db0700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c14c040 con 0x7faf6c15d200 2024-09-13T18:33:18.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.467+0000 7faf71db0700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c14c320 con 0x7faf6c0adbd0 2024-09-13T18:33:18.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.467+0000 7faf70dae700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf6c06d6f0 0x7faf6c147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:18.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.467+0000 7faf6bfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf6c0adbd0 0x7faf6c15b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:18.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.467+0000 7faf70dae700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf6c06d6f0 0x7faf6c147b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42636/0 (socket says 172.21.15.44:42636) 2024-09-13T18:33:18.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.467+0000 7faf70dae700 1 -- 172.21.15.44:0/4148906008 learned_addr learned my addr 172.21.15.44:0/4148906008 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:18.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.467+0000 7faf715af700 1 --2- 172.21.15.44:0/4148906008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf6c15d200 0x7faf6c150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:18.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.467+0000 7faf6bfff700 1 -- 172.21.15.44:0/4148906008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf6c15d200 msgr2=0x7faf6c150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:18.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.467+0000 7faf6bfff700 1 --2- 172.21.15.44:0/4148906008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf6c15d200 0x7faf6c150610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:18.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.467+0000 7faf6bfff700 1 -- 172.21.15.44:0/4148906008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf6c06d6f0 msgr2=0x7faf6c147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:18.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.467+0000 7faf6bfff700 1 --2- 172.21.15.44:0/4148906008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf6c06d6f0 0x7faf6c147b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:18.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.467+0000 7faf6bfff700 1 -- 172.21.15.44:0/4148906008 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6400b810 con 0x7faf6c0adbd0 2024-09-13T18:33:18.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.471+0000 7faf6bfff700 1 --2- 172.21.15.44:0/4148906008 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf6c0adbd0 0x7faf6c15b830 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0ad950 tx=0x7faf5400c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:18.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.471+0000 7faf697fa700 1 -- 172.21.15.44:0/4148906008 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf540052d0 con 0x7faf6c0adbd0 2024-09-13T18:33:18.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.471+0000 7faf697fa700 1 -- 172.21.15.44:0/4148906008 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf54005430 con 0x7faf6c0adbd0 2024-09-13T18:33:18.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.471+0000 7faf71db0700 1 -- 172.21.15.44:0/4148906008 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6c14c600 con 0x7faf6c0adbd0 2024-09-13T18:33:18.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.471+0000 7faf697fa700 1 -- 172.21.15.44:0/4148906008 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf540055a0 con 0x7faf6c0adbd0 2024-09-13T18:33:18.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.471+0000 7faf71db0700 1 -- 172.21.15.44:0/4148906008 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6c14cbc0 con 0x7faf6c0adbd0 2024-09-13T18:33:18.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.471+0000 7faf71db0700 1 -- 172.21.15.44:0/4148906008 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf6c0ce270 con 0x7faf6c0adbd0 2024-09-13T18:33:18.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.471+0000 7faf697fa700 1 -- 172.21.15.44:0/4148906008 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faf540038e0 con 0x7faf6c0adbd0 2024-09-13T18:33:18.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.471+0000 7faf697fa700 1 --2- 172.21.15.44:0/4148906008 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faf4c066730 0x7faf4c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:18.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.475+0000 7faf697fa700 1 -- 172.21.15.44:0/4148906008 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf54083410 con 0x7faf6c0adbd0 2024-09-13T18:33:18.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.475+0000 7faf70dae700 1 --2- 172.21.15.44:0/4148906008 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faf4c066730 0x7faf4c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:18.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.475+0000 7faf70dae700 1 --2- 172.21.15.44:0/4148906008 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faf4c066730 0x7faf4c068bf0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7faf5c009a40 tx=0x7faf5c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:18.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.483+0000 7faf697fa700 1 -- 172.21.15.44:0/4148906008 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faf54050790 con 0x7faf6c0adbd0 2024-09-13T18:33:18.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:18.691+0000 7faf71db0700 1 -- 172.21.15.44:0/4148906008 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7faf6c06ceb0 con 0x7faf6c0adbd0 2024-09-13T18:33:19.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.315+0000 7faf697fa700 1 -- 172.21.15.44:0/4148906008 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v45) v1 ==== 122+0+0 (secure 0 0 0) 0x7faf54053db0 con 0x7faf6c0adbd0 2024-09-13T18:33:19.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.319+0000 7faf71db0700 1 -- 172.21.15.44:0/4148906008 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faf4c066730 msgr2=0x7faf4c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:19.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.319+0000 7faf71db0700 1 --2- 172.21.15.44:0/4148906008 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faf4c066730 0x7faf4c068bf0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7faf5c009a40 tx=0x7faf5c00b040 comp rx=0 tx=0).stop 2024-09-13T18:33:19.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.319+0000 7faf71db0700 1 -- 172.21.15.44:0/4148906008 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf6c0adbd0 msgr2=0x7faf6c15b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:19.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.319+0000 7faf71db0700 1 --2- 172.21.15.44:0/4148906008 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf6c0adbd0 0x7faf6c15b830 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0ad950 tx=0x7faf5400c760 comp rx=0 tx=0).stop 2024-09-13T18:33:19.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.319+0000 7faf71db0700 1 -- 172.21.15.44:0/4148906008 shutdown_connections 2024-09-13T18:33:19.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.319+0000 7faf71db0700 1 --2- 172.21.15.44:0/4148906008 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faf4c066730 0x7faf4c068bf0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.319+0000 7faf71db0700 1 --2- 172.21.15.44:0/4148906008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf6c15d200 0x7faf6c150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.319+0000 7faf71db0700 1 --2- 172.21.15.44:0/4148906008 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf6c0adbd0 0x7faf6c15b830 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.319+0000 7faf71db0700 1 --2- 172.21.15.44:0/4148906008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf6c06d6f0 0x7faf6c147b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.319+0000 7faf71db0700 1 -- 172.21.15.44:0/4148906008 >> 172.21.15.44:0/4148906008 conn(0x7faf6c0b0e10 msgr2=0x7faf6c1532b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:19.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.319+0000 7faf71db0700 1 -- 172.21.15.44:0/4148906008 shutdown_connections 2024-09-13T18:33:19.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.319+0000 7faf71db0700 1 -- 172.21.15.44:0/4148906008 wait complete. 2024-09-13T18:33:19.343 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:33:19.343 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:33:19.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.455+0000 7f7230f94700 1 Processor -- start 2024-09-13T18:33:19.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.455+0000 7f7230f94700 1 -- start start 2024-09-13T18:33:19.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.455+0000 7f7230f94700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f722c147440 0x7f722c0b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:19.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.455+0000 7f7230f94700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f722c0cf0c0 0x7f722c147f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:19.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.455+0000 7f7230f94700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f722c0cf4f0 con 0x7f722c0b1bf0 2024-09-13T18:33:19.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.455+0000 7f7230f94700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f722c0b2080 con 0x7f722c147440 2024-09-13T18:33:19.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.455+0000 7f7230f94700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f722c164d10 con 0x7f722c0cf0c0 2024-09-13T18:33:19.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.455+0000 7f722b7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f722c147440 0x7f722c0b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:19.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.455+0000 7f722b7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f722c147440 0x7f722c0b16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42650/0 (socket says 172.21.15.44:42650) 2024-09-13T18:33:19.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.455+0000 7f722b7fe700 1 -- 172.21.15.44:0/2033583905 learned_addr learned my addr 172.21.15.44:0/2033583905 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:19.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.455+0000 7f722affd700 1 --1- 172.21.15.44:0/2033583905 >> v1:172.21.15.44:6789/0 conn(0x7f722c0b1bf0 0x7f722c0ce9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51178/0 (socket says 172.21.15.44:51178) 2024-09-13T18:33:19.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.455+0000 7f722bfff700 1 --2- 172.21.15.44:0/2033583905 >> v2:172.21.15.99:3300/0 conn(0x7f722c0cf0c0 0x7f722c147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:19.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.455+0000 7f722b7fe700 1 -- 172.21.15.44:0/2033583905 >> v2:172.21.15.99:3300/0 conn(0x7f722c0cf0c0 msgr2=0x7f722c147f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:19.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.455+0000 7f722b7fe700 1 --2- 172.21.15.44:0/2033583905 >> v2:172.21.15.99:3300/0 conn(0x7f722c0cf0c0 0x7f722c147f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.455+0000 7f722b7fe700 1 -- 172.21.15.44:0/2033583905 >> v1:172.21.15.44:6789/0 conn(0x7f722c0b1bf0 legacy=0x7f722c0ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:19.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.455+0000 7f722b7fe700 1 -- 172.21.15.44:0/2033583905 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f722c164ff0 con 0x7f722c147440 2024-09-13T18:33:19.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.455+0000 7f722b7fe700 1 --2- 172.21.15.44:0/2033583905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f722c147440 0x7f722c0b16b0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f722c165c70 tx=0x7f721c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a7a52319f7fe72 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:19.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.455+0000 7f722a7fc700 1 -- 172.21.15.44:0/2033583905 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c00b8a0 con 0x7f722c147440 2024-09-13T18:33:19.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.455+0000 7f722a7fc700 1 -- 172.21.15.44:0/2033583905 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721c00ba00 con 0x7f722c147440 2024-09-13T18:33:19.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.455+0000 7f722a7fc700 1 -- 172.21.15.44:0/2033583905 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c00bd90 con 0x7f722c147440 2024-09-13T18:33:19.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.459+0000 7f7230f94700 1 -- 172.21.15.44:0/2033583905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f722c147440 msgr2=0x7f722c0b16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:19.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.459+0000 7f7230f94700 1 --2- 172.21.15.44:0/2033583905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f722c147440 0x7f722c0b16b0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f722c165c70 tx=0x7f721c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.459+0000 7f7230f94700 1 -- 172.21.15.44:0/2033583905 shutdown_connections 2024-09-13T18:33:19.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.459+0000 7f7230f94700 1 --2- 172.21.15.44:0/2033583905 >> v2:172.21.15.99:3300/0 conn(0x7f722c0cf0c0 0x7f722c147f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.459+0000 7f7230f94700 1 --2- 172.21.15.44:0/2033583905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f722c147440 0x7f722c0b16b0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.459+0000 7f7230f94700 1 -- 172.21.15.44:0/2033583905 >> 172.21.15.44:0/2033583905 conn(0x7f722c06a730 msgr2=0x7f722c071d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:19.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.459+0000 7f7230f94700 1 -- 172.21.15.44:0/2033583905 shutdown_connections 2024-09-13T18:33:19.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.459+0000 7f7230f94700 1 -- 172.21.15.44:0/2033583905 wait complete. 2024-09-13T18:33:19.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.459+0000 7f7230f94700 1 Processor -- start 2024-09-13T18:33:19.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.459+0000 7f7230f94700 1 -- start start 2024-09-13T18:33:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.459+0000 7f7230f94700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f722c0b1bf0 0x7f722c1f9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.459+0000 7f7230f94700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f722c0cf0c0 0x7f722c1f8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.459+0000 7f7230f94700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f722c147440 0x7f722c1f9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.459+0000 7f7230f94700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722c14a710 con 0x7f722c0cf0c0 2024-09-13T18:33:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.459+0000 7f7230f94700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722c1f9870 con 0x7f722c0b1bf0 2024-09-13T18:33:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.459+0000 7f7230f94700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f722c1361c0 con 0x7f722c147440 2024-09-13T18:33:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.459+0000 7f722affd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f722c0cf0c0 0x7f722c1f8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.463+0000 7f722affd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f722c0cf0c0 0x7f722c1f8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42660/0 (socket says 172.21.15.44:42660) 2024-09-13T18:33:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.463+0000 7f722affd700 1 -- 172.21.15.44:0/2656326029 learned_addr learned my addr 172.21.15.44:0/2656326029 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.463+0000 7f722bfff700 1 --2- 172.21.15.44:0/2656326029 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f722c147440 0x7f722c1f9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:19.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.463+0000 7f722b7fe700 1 --2- 172.21.15.44:0/2656326029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f722c0b1bf0 0x7f722c1f9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.463+0000 7f722affd700 1 -- 172.21.15.44:0/2656326029 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f722c147440 msgr2=0x7f722c1f9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.463+0000 7f722affd700 1 --2- 172.21.15.44:0/2656326029 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f722c147440 0x7f722c1f9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.463+0000 7f722affd700 1 -- 172.21.15.44:0/2656326029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f722c0b1bf0 msgr2=0x7f722c1f9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.463+0000 7f722affd700 1 --2- 172.21.15.44:0/2656326029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f722c0b1bf0 0x7f722c1f9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.463+0000 7f722affd700 1 -- 172.21.15.44:0/2656326029 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721c009570 con 0x7f722c0cf0c0 2024-09-13T18:33:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.463+0000 7f722affd700 1 --2- 172.21.15.44:0/2656326029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f722c0cf0c0 0x7f722c1f8df0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f722000c530 tx=0x7f722000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.463+0000 7f7213fff700 1 -- 172.21.15.44:0/2656326029 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7220005cd0 con 0x7f722c0cf0c0 2024-09-13T18:33:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.463+0000 7f7213fff700 1 -- 172.21.15.44:0/2656326029 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7220005e30 con 0x7f722c0cf0c0 2024-09-13T18:33:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.463+0000 7f7230f94700 1 -- 172.21.15.44:0/2656326029 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f722c1364a0 con 0x7f722c0cf0c0 2024-09-13T18:33:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.463+0000 7f7213fff700 1 -- 172.21.15.44:0/2656326029 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72200072f0 con 0x7f722c0cf0c0 2024-09-13T18:33:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.463+0000 7f7230f94700 1 -- 172.21.15.44:0/2656326029 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f722c136a60 con 0x7f722c0cf0c0 2024-09-13T18:33:19.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.463+0000 7f7230f94700 1 -- 172.21.15.44:0/2656326029 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f722c0b6aa0 con 0x7f722c0cf0c0 2024-09-13T18:33:19.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.463+0000 7f7213fff700 1 -- 172.21.15.44:0/2656326029 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7220007450 con 0x7f722c0cf0c0 2024-09-13T18:33:19.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.467+0000 7f7213fff700 1 --2- 172.21.15.44:0/2656326029 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7218066730 0x7f7218068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:19.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.467+0000 7f7213fff700 1 -- 172.21.15.44:0/2656326029 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7220083460 con 0x7f722c0cf0c0 2024-09-13T18:33:19.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.467+0000 7f722b7fe700 1 --2- 172.21.15.44:0/2656326029 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7218066730 0x7f7218068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:19.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.467+0000 7f722b7fe700 1 --2- 172.21.15.44:0/2656326029 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7218066730 0x7f7218068bf0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f721c000c00 tx=0x7f721c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:19.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.471+0000 7f7213fff700 1 -- 172.21.15.44:0/2656326029 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7220050860 con 0x7f722c0cf0c0 2024-09-13T18:33:19.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.679+0000 7f7230f94700 1 -- 172.21.15.44:0/2656326029 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f722c136c20 con 0x7f722c0cf0c0 2024-09-13T18:33:19.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.679+0000 7f7213fff700 1 -- 172.21.15.44:0/2656326029 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f7220053e80 con 0x7f722c0cf0c0 2024-09-13T18:33:19.688 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:33:19.688 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":45,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2305930667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2305930667},{"type":"v1","addr":"172.21.15.99:6835","nonce":2305930667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1177460745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1177460745},{"type":"v1","addr":"172.21.15.44:6834","nonce":1177460745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6849,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1608555972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1608555972},{"type":"v1","addr":"172.21.15.44:6835","nonce":1608555972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:33:16.291148+0000","modified":"2024-09-13T18:33:19.305284+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6858},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6858":{"gid":6858,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/3072614790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3072614790},{"type":"v1","addr":"172.21.15.99:6837","nonce":3072614790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:33:19.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.683+0000 7f7230f94700 1 -- 172.21.15.44:0/2656326029 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7218066730 msgr2=0x7f7218068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:19.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.683+0000 7f7230f94700 1 --2- 172.21.15.44:0/2656326029 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7218066730 0x7f7218068bf0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f721c000c00 tx=0x7f721c008030 comp rx=0 tx=0).stop 2024-09-13T18:33:19.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.683+0000 7f7230f94700 1 -- 172.21.15.44:0/2656326029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f722c0cf0c0 msgr2=0x7f722c1f8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:19.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.683+0000 7f7230f94700 1 --2- 172.21.15.44:0/2656326029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f722c0cf0c0 0x7f722c1f8df0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f722000c530 tx=0x7f722000c840 comp rx=0 tx=0).stop 2024-09-13T18:33:19.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.683+0000 7f7230f94700 1 -- 172.21.15.44:0/2656326029 shutdown_connections 2024-09-13T18:33:19.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.683+0000 7f7230f94700 1 --2- 172.21.15.44:0/2656326029 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7218066730 0x7f7218068bf0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.683+0000 7f7230f94700 1 --2- 172.21.15.44:0/2656326029 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f722c147440 0x7f722c1f9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.683+0000 7f7230f94700 1 --2- 172.21.15.44:0/2656326029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f722c0cf0c0 0x7f722c1f8df0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.683+0000 7f7230f94700 1 --2- 172.21.15.44:0/2656326029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f722c0b1bf0 0x7f722c1f9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.683+0000 7f7230f94700 1 -- 172.21.15.44:0/2656326029 >> 172.21.15.44:0/2656326029 conn(0x7f722c06a730 msgr2=0x7f722c0d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:19.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.683+0000 7f7230f94700 1 -- 172.21.15.44:0/2656326029 shutdown_connections 2024-09-13T18:33:19.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.683+0000 7f7230f94700 1 -- 172.21.15.44:0/2656326029 wait complete. 2024-09-13T18:33:19.692 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 45 2024-09-13T18:33:19.704 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:19.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.811+0000 7f37567cf700 1 Processor -- start 2024-09-13T18:33:19.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.811+0000 7f37567cf700 1 -- start start 2024-09-13T18:33:19.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.811+0000 7f37567cf700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f375015cc30 0x7f375006a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:19.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.811+0000 7f37567cf700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f375006ad80 0x7f37500d1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:19.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.811+0000 7f37567cf700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37501617a0 con 0x7f37500d1e90 2024-09-13T18:33:19.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.811+0000 7f37567cf700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375006bf10 con 0x7f375015cc30 2024-09-13T18:33:19.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.811+0000 7f37567cf700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375006b1b0 con 0x7f375006ad80 2024-09-13T18:33:19.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.811+0000 7f37557cd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f375015cc30 0x7f375006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:19.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.811+0000 7f37557cd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f375015cc30 0x7f375006a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42666/0 (socket says 172.21.15.44:42666) 2024-09-13T18:33:19.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.811+0000 7f37557cd700 1 -- 172.21.15.44:0/3045336916 learned_addr learned my addr 172.21.15.44:0/3045336916 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:19.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.811+0000 7f3754fcc700 1 --2- 172.21.15.44:0/3045336916 >> v2:172.21.15.99:3300/0 conn(0x7f375006ad80 0x7f37500d1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:19.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.811+0000 7f37557cd700 1 -- 172.21.15.44:0/3045336916 >> v2:172.21.15.99:3300/0 conn(0x7f375006ad80 msgr2=0x7f37500d1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:19.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.811+0000 7f37557cd700 1 --2- 172.21.15.44:0/3045336916 >> v2:172.21.15.99:3300/0 conn(0x7f375006ad80 0x7f37500d1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.811+0000 7f37557cd700 1 -- 172.21.15.44:0/3045336916 >> v1:172.21.15.44:6789/0 conn(0x7f37500d1e90 legacy=0x7f375015d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:19.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.811+0000 7f37557cd700 1 -- 172.21.15.44:0/3045336916 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37500d22e0 con 0x7f375015cc30 2024-09-13T18:33:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.811+0000 7f37557cd700 1 --2- 172.21.15.44:0/3045336916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f375015cc30 0x7f375006a840 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f37500687c0 tx=0x7f374c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24449dce9896f1b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.811+0000 7f3747fff700 1 -- 172.21.15.44:0/3045336916 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c00e070 con 0x7f375015cc30 2024-09-13T18:33:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.811+0000 7f3747fff700 1 -- 172.21.15.44:0/3045336916 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c00b9c0 con 0x7f375015cc30 2024-09-13T18:33:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.811+0000 7f3747fff700 1 -- 172.21.15.44:0/3045336916 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c00bd70 con 0x7f375015cc30 2024-09-13T18:33:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.815+0000 7f37567cf700 1 -- 172.21.15.44:0/3045336916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f375015cc30 msgr2=0x7f375006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.815+0000 7f37567cf700 1 --2- 172.21.15.44:0/3045336916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f375015cc30 0x7f375006a840 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f37500687c0 tx=0x7f374c00b330 comp rx=0 tx=0).stop 2024-09-13T18:33:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.815+0000 7f37567cf700 1 -- 172.21.15.44:0/3045336916 shutdown_connections 2024-09-13T18:33:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.815+0000 7f37567cf700 1 --2- 172.21.15.44:0/3045336916 >> v2:172.21.15.99:3300/0 conn(0x7f375006ad80 0x7f37500d1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.815+0000 7f37567cf700 1 --2- 172.21.15.44:0/3045336916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f375015cc30 0x7f375006a840 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.815+0000 7f37567cf700 1 -- 172.21.15.44:0/3045336916 >> 172.21.15.44:0/3045336916 conn(0x7f37500b4860 msgr2=0x7f37500b4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.815+0000 7f37567cf700 1 -- 172.21.15.44:0/3045336916 shutdown_connections 2024-09-13T18:33:19.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.815+0000 7f37567cf700 1 -- 172.21.15.44:0/3045336916 wait complete. 2024-09-13T18:33:19.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.815+0000 7f37567cf700 1 Processor -- start 2024-09-13T18:33:19.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f37567cf700 1 -- start start 2024-09-13T18:33:19.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f37567cf700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f375006ad80 0x7f375015faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:19.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f37567cf700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37500d1e90 0x7f3750154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:19.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f37567cf700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f375015cc30 0x7f3750151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:19.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f37567cf700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3750152bf0 con 0x7f37500d1e90 2024-09-13T18:33:19.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f37567cf700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3750154fa0 con 0x7f375006ad80 2024-09-13T18:33:19.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f37567cf700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37501551d0 con 0x7f375015cc30 2024-09-13T18:33:19.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f3754fcc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37500d1e90 0x7f3750154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:19.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f3754fcc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37500d1e90 0x7f3750154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42682/0 (socket says 172.21.15.44:42682) 2024-09-13T18:33:19.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f3754fcc700 1 -- 172.21.15.44:0/2732735244 learned_addr learned my addr 172.21.15.44:0/2732735244 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:19.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f3755fce700 1 --2- 172.21.15.44:0/2732735244 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f375015cc30 0x7f3750151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:19.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f37557cd700 1 --2- 172.21.15.44:0/2732735244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f375006ad80 0x7f375015faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:19.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f3754fcc700 1 -- 172.21.15.44:0/2732735244 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f375015cc30 msgr2=0x7f3750151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:19.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f3754fcc700 1 --2- 172.21.15.44:0/2732735244 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f375015cc30 0x7f3750151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f3754fcc700 1 -- 172.21.15.44:0/2732735244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f375006ad80 msgr2=0x7f375015faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:19.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f3754fcc700 1 --2- 172.21.15.44:0/2732735244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f375006ad80 0x7f375015faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f3754fcc700 1 -- 172.21.15.44:0/2732735244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c009b30 con 0x7f37500d1e90 2024-09-13T18:33:19.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f37557cd700 1 --2- 172.21.15.44:0/2732735244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f375006ad80 0x7f375015faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:19.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f3754fcc700 1 --2- 172.21.15.44:0/2732735244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37500d1e90 0x7f3750154a60 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f374000e760 tx=0x7f374000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:19.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f3745ffb700 1 -- 172.21.15.44:0/2732735244 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3740013610 con 0x7f37500d1e90 2024-09-13T18:33:19.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f3745ffb700 1 -- 172.21.15.44:0/2732735244 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3740013770 con 0x7f37500d1e90 2024-09-13T18:33:19.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f37567cf700 1 -- 172.21.15.44:0/2732735244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3750152250 con 0x7f37500d1e90 2024-09-13T18:33:19.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f3745ffb700 1 -- 172.21.15.44:0/2732735244 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3740013ae0 con 0x7f37500d1e90 2024-09-13T18:33:19.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.819+0000 7f37567cf700 1 -- 172.21.15.44:0/2732735244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3750152810 con 0x7f37500d1e90 2024-09-13T18:33:19.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.823+0000 7f37567cf700 1 -- 172.21.15.44:0/2732735244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3750160b20 con 0x7f37500d1e90 2024-09-13T18:33:19.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.823+0000 7f3745ffb700 1 -- 172.21.15.44:0/2732735244 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3740013c40 con 0x7f37500d1e90 2024-09-13T18:33:19.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.823+0000 7f3745ffb700 1 --2- 172.21.15.44:0/2732735244 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3734066730 0x7f3734068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:19.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.823+0000 7f3745ffb700 1 -- 172.21.15.44:0/2732735244 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3740083db0 con 0x7f37500d1e90 2024-09-13T18:33:19.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.823+0000 7f37557cd700 1 --2- 172.21.15.44:0/2732735244 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3734066730 0x7f3734068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:19.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.827+0000 7f37557cd700 1 --2- 172.21.15.44:0/2732735244 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3734066730 0x7f3734068bf0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f374c000f80 tx=0x7f374c009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:19.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:19.831+0000 7f3745ffb700 1 -- 172.21.15.44:0/2732735244 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3740088070 con 0x7f37500d1e90 2024-09-13T18:33:20.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.003+0000 7f37567cf700 1 -- 172.21.15.44:0/2732735244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f375015c780 con 0x7f37500d1e90 2024-09-13T18:33:20.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.003+0000 7f3745ffb700 1 -- 172.21.15.44:0/2732735244 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f3740021090 con 0x7f37500d1e90 2024-09-13T18:33:20.011 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:33:20.011 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":63,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:33:17.294632+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:14.682923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:15.291935+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:20.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.007+0000 7f37567cf700 1 -- 172.21.15.44:0/2732735244 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3734066730 msgr2=0x7f3734068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.007+0000 7f37567cf700 1 --2- 172.21.15.44:0/2732735244 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3734066730 0x7f3734068bf0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f374c000f80 tx=0x7f374c009000 comp rx=0 tx=0).stop 2024-09-13T18:33:20.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.007+0000 7f37567cf700 1 -- 172.21.15.44:0/2732735244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37500d1e90 msgr2=0x7f3750154a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.007+0000 7f37567cf700 1 --2- 172.21.15.44:0/2732735244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37500d1e90 0x7f3750154a60 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f374000e760 tx=0x7f374000ea70 comp rx=0 tx=0).stop 2024-09-13T18:33:20.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.007+0000 7f37567cf700 1 -- 172.21.15.44:0/2732735244 shutdown_connections 2024-09-13T18:33:20.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.007+0000 7f37567cf700 1 --2- 172.21.15.44:0/2732735244 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3734066730 0x7f3734068bf0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.007+0000 7f37567cf700 1 --2- 172.21.15.44:0/2732735244 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f375015cc30 0x7f3750151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.007+0000 7f37567cf700 1 --2- 172.21.15.44:0/2732735244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37500d1e90 0x7f3750154a60 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.007+0000 7f37567cf700 1 --2- 172.21.15.44:0/2732735244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f375006ad80 0x7f375015faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.007+0000 7f37567cf700 1 -- 172.21.15.44:0/2732735244 >> 172.21.15.44:0/2732735244 conn(0x7f37500b4860 msgr2=0x7f37500ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:20.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.007+0000 7f37567cf700 1 -- 172.21.15.44:0/2732735244 shutdown_connections 2024-09-13T18:33:20.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.007+0000 7f37567cf700 1 -- 172.21.15.44:0/2732735244 wait complete. 2024-09-13T18:33:20.026 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:33:20.026 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:33:20.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.135+0000 7fa0313e6700 1 Processor -- start 2024-09-13T18:33:20.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.135+0000 7fa0313e6700 1 -- start start 2024-09-13T18:33:20.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.135+0000 7fa0313e6700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa02c06bbf0 0x7fa02c0b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.135+0000 7fa0313e6700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa02c06acc0 0x7fa02c15e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.135+0000 7fa0313e6700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa02c13dcb0 con 0x7fa02c0b3910 2024-09-13T18:33:20.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.135+0000 7fa0313e6700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa02c15be60 con 0x7fa02c06acc0 2024-09-13T18:33:20.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.135+0000 7fa0313e6700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c13ffd0 con 0x7fa02c06bbf0 2024-09-13T18:33:20.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.135+0000 7fa030be5700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa02c06acc0 0x7fa02c15e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.135+0000 7fa02b7fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa02c0b3910 0x7fa02c06a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51194/0 (socket says 172.21.15.44:51194) 2024-09-13T18:33:20.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.135+0000 7fa02b7fe700 1 -- 172.21.15.44:0/477902559 learned_addr learned my addr 172.21.15.44:0/477902559 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:20.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.135+0000 7fa02bfff700 1 --2- 172.21.15.44:0/477902559 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa02c06bbf0 0x7fa02c0b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.135+0000 7fa030be5700 1 -- 172.21.15.44:0/477902559 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa02c06bbf0 msgr2=0x7fa02c0b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.135+0000 7fa030be5700 1 --2- 172.21.15.44:0/477902559 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa02c06bbf0 0x7fa02c0b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.135+0000 7fa030be5700 1 -- 172.21.15.44:0/477902559 >> v1:172.21.15.44:6789/0 conn(0x7fa02c0b3910 legacy=0x7fa02c06a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.135+0000 7fa02affd700 1 -- 172.21.15.44:0/477902559 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4048142924 0 0) 0x7fa02c13dcb0 con 0x7fa02c0b3910 2024-09-13T18:33:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.135+0000 7fa030be5700 1 -- 172.21.15.44:0/477902559 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02c0b3d70 con 0x7fa02c06acc0 2024-09-13T18:33:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.135+0000 7fa02bfff700 1 --2- 172.21.15.44:0/477902559 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa02c06bbf0 0x7fa02c0b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.135+0000 7fa030be5700 1 --2- 172.21.15.44:0/477902559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa02c06acc0 0x7fa02c15e440 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fa024009d90 tx=0x7fa02400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e718e8848f8311 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.135+0000 7fa02affd700 1 -- 172.21.15.44:0/477902559 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02400e070 con 0x7fa02c06acc0 2024-09-13T18:33:20.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.135+0000 7fa02affd700 1 -- 172.21.15.44:0/477902559 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02400bbd0 con 0x7fa02c06acc0 2024-09-13T18:33:20.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.135+0000 7fa02affd700 1 -- 172.21.15.44:0/477902559 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa024012430 con 0x7fa02c06acc0 2024-09-13T18:33:20.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.139+0000 7fa0313e6700 1 -- 172.21.15.44:0/477902559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa02c06acc0 msgr2=0x7fa02c15e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.139+0000 7fa0313e6700 1 --2- 172.21.15.44:0/477902559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa02c06acc0 0x7fa02c15e440 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fa024009d90 tx=0x7fa02400b330 comp rx=0 tx=0).stop 2024-09-13T18:33:20.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.139+0000 7fa0313e6700 1 -- 172.21.15.44:0/477902559 shutdown_connections 2024-09-13T18:33:20.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.139+0000 7fa0313e6700 1 --2- 172.21.15.44:0/477902559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa02c06acc0 0x7fa02c15e440 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.139+0000 7fa0313e6700 1 --2- 172.21.15.44:0/477902559 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa02c06bbf0 0x7fa02c0b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.139+0000 7fa0313e6700 1 -- 172.21.15.44:0/477902559 >> 172.21.15.44:0/477902559 conn(0x7fa02c0b0f00 msgr2=0x7fa02c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:20.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.139+0000 7fa0313e6700 1 -- 172.21.15.44:0/477902559 shutdown_connections 2024-09-13T18:33:20.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.139+0000 7fa0313e6700 1 -- 172.21.15.44:0/477902559 wait complete. 2024-09-13T18:33:20.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa0313e6700 1 Processor -- start 2024-09-13T18:33:20.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa0313e6700 1 -- start start 2024-09-13T18:33:20.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa0313e6700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa02c06acc0 0x7fa02c1551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa0313e6700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa02c06bbf0 0x7fa02c1420c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa0313e6700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa02c0b3910 0x7fa02c15b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa0313e6700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c155710 con 0x7fa02c06acc0 2024-09-13T18:33:20.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa0313e6700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c142980 con 0x7fa02c06bbf0 2024-09-13T18:33:20.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa0313e6700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c142c60 con 0x7fa02c0b3910 2024-09-13T18:33:20.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa02bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa02c06acc0 0x7fa02c1551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa02bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa02c06acc0 0x7fa02c1551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42694/0 (socket says 172.21.15.44:42694) 2024-09-13T18:33:20.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa02bfff700 1 -- 172.21.15.44:0/532912442 learned_addr learned my addr 172.21.15.44:0/532912442 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:20.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa02b7fe700 1 --2- 172.21.15.44:0/532912442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa02c06bbf0 0x7fa02c1420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa030be5700 1 --2- 172.21.15.44:0/532912442 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa02c0b3910 0x7fa02c15b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa02bfff700 1 -- 172.21.15.44:0/532912442 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa02c0b3910 msgr2=0x7fa02c15b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa02bfff700 1 --2- 172.21.15.44:0/532912442 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa02c0b3910 0x7fa02c15b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa02bfff700 1 -- 172.21.15.44:0/532912442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa02c06bbf0 msgr2=0x7fa02c1420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa02bfff700 1 --2- 172.21.15.44:0/532912442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa02c06bbf0 0x7fa02c1420c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa02bfff700 1 -- 172.21.15.44:0/532912442 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa024009a70 con 0x7fa02c06acc0 2024-09-13T18:33:20.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa030be5700 1 --2- 172.21.15.44:0/532912442 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa02c0b3910 0x7fa02c15b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:20.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa02bfff700 1 --2- 172.21.15.44:0/532912442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa02c06acc0 0x7fa02c1551d0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fa02000e880 tx=0x7fa02000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:20.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa028ff9700 1 -- 172.21.15.44:0/532912442 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02000c780 con 0x7fa02c06acc0 2024-09-13T18:33:20.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa028ff9700 1 -- 172.21.15.44:0/532912442 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02000c8e0 con 0x7fa02c06acc0 2024-09-13T18:33:20.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa0313e6700 1 -- 172.21.15.44:0/532912442 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa02c142f40 con 0x7fa02c06acc0 2024-09-13T18:33:20.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa028ff9700 1 -- 172.21.15.44:0/532912442 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02000cc70 con 0x7fa02c06acc0 2024-09-13T18:33:20.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.143+0000 7fa0313e6700 1 -- 172.21.15.44:0/532912442 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa02c142600 con 0x7fa02c06acc0 2024-09-13T18:33:20.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.147+0000 7fa0313e6700 1 -- 172.21.15.44:0/532912442 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa02c06bfd0 con 0x7fa02c06acc0 2024-09-13T18:33:20.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.147+0000 7fa028ff9700 1 -- 172.21.15.44:0/532912442 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa020013410 con 0x7fa02c06acc0 2024-09-13T18:33:20.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.147+0000 7fa028ff9700 1 --2- 172.21.15.44:0/532912442 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa018066730 0x7fa018068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.147+0000 7fa028ff9700 1 -- 172.21.15.44:0/532912442 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa020083f00 con 0x7fa02c06acc0 2024-09-13T18:33:20.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.147+0000 7fa02b7fe700 1 --2- 172.21.15.44:0/532912442 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa018066730 0x7fa018068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.151+0000 7fa02b7fe700 1 --2- 172.21.15.44:0/532912442 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa018066730 0x7fa018068bf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa02c1438a0 tx=0x7fa01c007cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:20.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.155+0000 7fa028ff9700 1 -- 172.21.15.44:0/532912442 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa0200511d0 con 0x7fa02c06acc0 2024-09-13T18:33:20.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.327+0000 7fa0313e6700 1 -- 172.21.15.44:0/532912442 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa02c074770 con 0x7fa018066730 2024-09-13T18:33:20.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.339+0000 7fa028ff9700 1 -- 172.21.15.44:0/532912442 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273119 (secure 0 0 0) 0x7fa02c074770 con 0x7fa018066730 2024-09-13T18:33:20.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:33:20.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.347+0000 7fa0313e6700 1 -- 172.21.15.44:0/532912442 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa018066730 msgr2=0x7fa018068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.347+0000 7fa0313e6700 1 --2- 172.21.15.44:0/532912442 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa018066730 0x7fa018068bf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa02c1438a0 tx=0x7fa01c007cb0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.347+0000 7fa0313e6700 1 -- 172.21.15.44:0/532912442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa02c06acc0 msgr2=0x7fa02c1551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.347+0000 7fa0313e6700 1 --2- 172.21.15.44:0/532912442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa02c06acc0 0x7fa02c1551d0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fa02000e880 tx=0x7fa02000ec40 comp rx=0 tx=0).stop 2024-09-13T18:33:20.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.347+0000 7fa0313e6700 1 -- 172.21.15.44:0/532912442 shutdown_connections 2024-09-13T18:33:20.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.347+0000 7fa0313e6700 1 --2- 172.21.15.44:0/532912442 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa018066730 0x7fa018068bf0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.347+0000 7fa0313e6700 1 --2- 172.21.15.44:0/532912442 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa02c0b3910 0x7fa02c15b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.347+0000 7fa0313e6700 1 --2- 172.21.15.44:0/532912442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa02c06bbf0 0x7fa02c1420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.347+0000 7fa0313e6700 1 --2- 172.21.15.44:0/532912442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa02c06acc0 0x7fa02c1551d0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.347+0000 7fa0313e6700 1 -- 172.21.15.44:0/532912442 >> 172.21.15.44:0/532912442 conn(0x7fa02c0b0f00 msgr2=0x7fa02c0b29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:20.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.347+0000 7fa0313e6700 1 -- 172.21.15.44:0/532912442 shutdown_connections 2024-09-13T18:33:20.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.347+0000 7fa0313e6700 1 -- 172.21.15.44:0/532912442 wait complete. 2024-09-13T18:33:20.356 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:33:20.368 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":251,"stamp":"2024-09-13T18:33:18.453136+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":243300,"kb_used_data":6624,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754731420,"statfs":{"total":773094113280,"available":772844974080,"internally_reserved":0,"allocated":6782976,"data_stored":3502698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":242208312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001082"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:15.892604+0000","last_change":"2024-09-13T18:33:15.892604+0000","last_active":"2024-09-13T18:33:15.892604+0000","last_peered":"2024-09-13T18:33:15.892604+0000","last_clean":"2024-09-13T18:33:15.892604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:15.892604+0000","last_undegraded":"2024-09-13T18:33:15.892604+0000","last_fullsized":"2024-09-13T18:33:15.892604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:14.882746+0000","last_change":"2024-09-13T18:33:14.882746+0000","last_active":"2024-09-13T18:33:14.882746+0000","last_peered":"2024-09-13T18:33:14.882746+0000","last_clean":"2024-09-13T18:33:14.882746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:14.882746+0000","last_undegraded":"2024-09-13T18:33:14.882746+0000","last_fullsized":"2024-09-13T18:33:14.882746+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":198,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T18:33:11.880441+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:33:11.880441+0000","last_peered":"2024-09-13T18:33:11.880441+0000","last_clean":"2024-09-13T18:33:11.880441+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:33:11.880441+0000","last_undegraded":"2024-09-13T18:33:11.880441+0000","last_fullsized":"2024-09-13T18:33:11.880441+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1290240,"data_stored":879322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.75900000000000001,"15min":0.755},"min":{"1min":0.44800000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0760000000000001,"5min":1.1240000000000001,"15min":1.163},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.75600000000000001,"15min":0.79600000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.137,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.63600000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.79200000000000004,"15min":0.874},"min":{"1min":0.51900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.181,"5min":1.3120000000000001,"15min":1.7689999999999999},"last":1.093},{"interface":"front","average":{"1min":0.876,"5min":0.872,"15min":0.93999999999999995},"min":{"1min":0.56200000000000006,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.6140000000000001},"last":0.83699999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.81999999999999995,"15min":0.84699999999999998},"min":{"1min":0.56699999999999995,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2270000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80900000000000005,"15min":0.89300000000000002},"min":{"1min":0.51000000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.524,"5min":1.524,"15min":1.6659999999999999},"last":0.67700000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.85099999999999998,"15min":0.88500000000000001},"min":{"1min":0.59999999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.022},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.88500000000000001,"15min":0.871},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.085,"5min":1.419,"15min":1.419},"last":1.274}]},{"osd":4,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.86099999999999999,"15min":0.89500000000000002},"min":{"1min":0.56399999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.7290000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0109999999999999,"15min":1.042},"min":{"1min":0.76700000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.49,"5min":1.49,"15min":1.7050000000000001},"last":1.169}]},{"osd":5,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.95599999999999996,"15min":0.95399999999999996},"min":{"1min":0.78100000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4259999999999999},"last":1.196},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0389999999999999,"15min":1.0529999999999999},"min":{"1min":0.67500000000000004,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.2450000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.028,"15min":1.0940000000000001},"min":{"1min":0.746,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":2.077},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.079,"15min":1.0700000000000001},"min":{"1min":0.85999999999999999,"5min":0.72199999999999998,"15min":0.69099999999999995},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.2230000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27720,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":708608,"data_stored":294151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77900000000000003,"15min":0.82199999999999995},"min":{"1min":0.441,"5min":0.438,"15min":0.438},"max":{"1min":1.1279999999999999,"5min":1.216,"15min":1.2270000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.76500000000000001,"15min":0.82199999999999995},"min":{"1min":0.51000000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.103,"5min":1.361,"15min":1.361},"last":0.75600000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.76900000000000002,"15min":0.80800000000000005},"min":{"1min":0.47999999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98499999999999999,"5min":1.238,"15min":1.238},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.82099999999999995,"15min":0.81899999999999995},"min":{"1min":0.48299999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1200000000000001,"5min":1.214,"15min":1.214},"last":1.0289999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.80200000000000005,"15min":0.80600000000000005},"min":{"1min":0.52200000000000002,"5min":0.47399999999999998,"15min":0.46899999999999997},"max":{"1min":0.98499999999999999,"5min":1.2010000000000001,"15min":1.254},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.82499999999999996,"15min":0.85599999999999998},"min":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1399999999999999,"5min":1.248,"15min":1.248},"last":0.90900000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89100000000000001,"15min":0.86699999999999999},"min":{"1min":0.57599999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1930000000000001,"5min":1.238,"15min":1.238},"last":1.079},{"interface":"front","average":{"1min":0.875,"5min":0.89000000000000001,"15min":0.94299999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1870000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.82799999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.84299999999999997,"15min":0.88200000000000001},"min":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0920000000000001,"5min":1.206,"15min":1.248},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.95399999999999996,"15min":0.99399999999999999},"min":{"1min":0.63800000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.1839999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.115}]},{"osd":5,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0249999999999999,"15min":1.038},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.258,"5min":1.341,"15min":1.341},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.94899999999999995,"15min":0.97899999999999998},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.165,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.98299999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94099999999999995,"15min":0.995},"min":{"1min":0.77100000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.135,"5min":1.256,"15min":1.3169999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.089,"15min":1.107},"min":{"1min":0.82599999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.367,"5min":1.367,"15min":1.3740000000000001},"last":1.157}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27724,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":708608,"data_stored":294151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.77200000000000002,"15min":0.83299999999999996},"min":{"1min":0.46899999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95299999999999996,"5min":1.1279999999999999,"15min":1.3640000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.77400000000000002,"15min":0.85799999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1679999999999999,"5min":1.2190000000000001,"15min":1.482},"last":1.089}]},{"osd":1,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77600000000000002,"15min":0.79100000000000004},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.127},{"interface":"front","average":{"1min":0.873,"5min":0.83799999999999997,"15min":0.92800000000000005},"min":{"1min":0.50900000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.179,"5min":1.2390000000000001,"15min":1.4850000000000001},"last":0.86399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91200000000000003,"15min":0.95599999999999996},"min":{"1min":0.58199999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1319999999999999,"5min":1.2110000000000001,"15min":1.4179999999999999},"last":1.2},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.91800000000000004,"15min":0.996},"min":{"1min":0.51800000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2210000000000001,"5min":1.3029999999999999,"15min":1.4690000000000001},"last":1.161}]},{"osd":3,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.874,"15min":0.94299999999999995},"min":{"1min":0.55800000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.085,"5min":1.222,"15min":1.4510000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.86399999999999999,"15min":0.93999999999999995},"min":{"1min":0.629,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.335,"5min":1.335,"15min":1.4990000000000001},"last":1.05}]},{"osd":4,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.91400000000000003,"15min":0.97999999999999998},"min":{"1min":0.72799999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2889999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.95799999999999996,"15min":1.038},"min":{"1min":0.73899999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2470000000000001,"5min":1.3759999999999999,"15min":1.542},"last":0.90900000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.95999999999999996,"15min":1.032},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.248,"5min":1.3360000000000001,"15min":1.698},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.093,"15min":1.161},"min":{"1min":0.76300000000000001,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.367,"5min":1.581,"15min":1.581},"last":1.3160000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.0680000000000001,"15min":1.1799999999999999},"min":{"1min":0.81399999999999995,"5min":0.76100000000000001,"15min":0.70699999999999996},"max":{"1min":1.226,"5min":1.5069999999999999,"15min":1.847},"last":1.25},{"interface":"front","average":{"1min":1.054,"5min":1.0589999999999999,"15min":1.1459999999999999},"min":{"1min":0.90600000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.4059999999999999,"5min":1.4259999999999999,"15min":1.8100000000000001},"last":1.2909999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":684032,"data_stored":283725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80600000000000005,"15min":0.89800000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.121,"5min":1.206,"15min":1.3720000000000001},"last":0.998},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.86299999999999999,"15min":0.95799999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1879999999999999,"5min":1.3280000000000001,"15min":1.5229999999999999},"last":0.84699999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.75800000000000001,"15min":0.79400000000000004},"min":{"1min":0.47099999999999997,"5min":0.435,"15min":0.435},"max":{"1min":0.98099999999999998,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.80200000000000005,"15min":0.84799999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":1.1020000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.78800000000000003,"15min":0.85599999999999998},"min":{"1min":0.48699999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0229999999999999,"5min":1.171,"15min":1.171},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84199999999999997,"15min":0.84999999999999998},"min":{"1min":0.54300000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.165,"5min":1.331,"15min":1.331},"last":0.90900000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.90100000000000002,"15min":0.97099999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.171,"5min":1.268,"15min":1.639},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.92400000000000004,"15min":0.98099999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0680000000000001,"5min":1.2629999999999999,"15min":1.8300000000000001},"last":0.94599999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91700000000000004,"15min":0.98699999999999999},"min":{"1min":0.60599999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1579999999999999,"5min":1.518,"15min":2.3889999999999998},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0369999999999999,"15min":1.111},"min":{"1min":0.80200000000000005,"5min":0.626,"15min":0.626},"max":{"1min":1.2250000000000001,"5min":1.375,"15min":2.0049999999999999},"last":1.081}]},{"osd":6,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.94399999999999995,"15min":0.91200000000000003},"min":{"1min":0.753,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2989999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.878},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0569999999999999,"15min":1.1040000000000001},"min":{"1min":0.81699999999999995,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.2130000000000001,"5min":1.4259999999999999,"15min":1.794},"last":1.167}]},{"osd":7,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.012,"15min":1.0800000000000001},"min":{"1min":0.66600000000000004,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1779999999999999,"5min":1.643,"15min":1.669},"last":1.147},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.046,"15min":1.03},"min":{"1min":0.75800000000000001,"5min":0.748,"15min":0.61799999999999999},"max":{"1min":1.353,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.0329999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":708608,"data_stored":294151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58299999999999996,"15min":0.67100000000000004},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.93999999999999995,"5min":0.94699999999999995,"15min":0.97799999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.60499999999999998,"15min":0.66300000000000003},"min":{"1min":0.34000000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.85599999999999998,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.72599999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60599999999999998,"15min":0.69099999999999995},"min":{"1min":0.317,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67400000000000004,"15min":0.79800000000000004},"min":{"1min":0.42799999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.397,"5min":1.397,"15min":2.0030000000000001},"last":0.56899999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.70899999999999996,"15min":0.76800000000000002},"min":{"1min":0.41399999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.333},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.74299999999999999,"15min":0.86399999999999999},"min":{"1min":0.40100000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0900000000000001,"5min":1.214,"15min":1.2929999999999999},"last":0.501}]},{"osd":4,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.85699999999999998,"15min":0.95199999999999996},"min":{"1min":0.62,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.139,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.92400000000000004,"15min":1.024},"min":{"1min":0.626,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.88200000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.98199999999999998,"15min":1.149},"min":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":2.2320000000000002},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.96199999999999997,"15min":1.097},"min":{"1min":0.745,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.194,"5min":1.3120000000000001,"15min":1.718},"last":0.95599999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":0.99399999999999999,"15min":1.1100000000000001},"min":{"1min":0.72799999999999998,"5min":0.496,"15min":0.496},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0169999999999999,"15min":1.1970000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.48,"5min":1.48,"15min":2.1819999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.006,"15min":1.0900000000000001},"min":{"1min":0.66800000000000004,"5min":0.624,"15min":0.624},"max":{"1min":1.2649999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0309999999999999,"15min":1.1559999999999999},"min":{"1min":0.71799999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.548,"5min":1.548,"15min":1.5920000000000001},"last":0.93400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31808,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":708608,"data_stored":294151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60199999999999998,"15min":0.65600000000000003},"min":{"1min":0.16500000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.86099999999999999,"5min":1.006,"15min":1.1919999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.77900000000000003},"min":{"1min":0.40699999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.92000000000000004,"5min":1.0429999999999999,"15min":1.4370000000000001},"last":1.014}]},{"osd":1,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61899999999999999,"15min":0.70099999999999996},"min":{"1min":0.28100000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.2629999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.64600000000000002,"15min":0.72199999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.79100000000000004,"5min":1.0549999999999999,"15min":1.206},"last":0.76400000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.64300000000000002,"15min":0.66300000000000003},"min":{"1min":0.317,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.02,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.79000000000000004,"15min":0.84499999999999997},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1180000000000001,"5min":1.2509999999999999,"15min":1.548},"last":0.95899999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.94299999999999995,"15min":0.97599999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1990000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.653},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.94299999999999995,"15min":1.0409999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2989999999999999,"5min":1.51,"15min":2.3849999999999998},"last":1.423}]},{"osd":5,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.91100000000000003,"15min":0.92100000000000004},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1890000000000001,"5min":1.498,"15min":1.498},"last":1.3939999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.98899999999999999,"15min":1.0469999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2869999999999999,"5min":1.6419999999999999,"15min":1.869},"last":1.7549999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":1.008,"15min":1.0940000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.468,"5min":1.6120000000000001,"15min":2.762},"last":1.337},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.997,"15min":1.0409999999999999},"min":{"1min":0.57999999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4299999999999999,"5min":1.5509999999999999,"15min":1.988},"last":1.2250000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.044,"15min":1.1459999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.59799999999999998},"max":{"1min":1.393,"5min":1.577,"15min":2.6800000000000002},"last":1.5629999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.048,"15min":1.0640000000000001},"min":{"1min":0.67100000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5029999999999999,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.464}]}]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31784,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":684032,"data_stored":283725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61699999999999999,"15min":0.626},"min":{"1min":0.34300000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90000000000000002,"5min":1.107,"15min":1.107},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.65900000000000003,"15min":0.72899999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.05,"5min":1.131,"15min":1.3560000000000001},"last":0.79800000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60099999999999998,"15min":0.625},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.96999999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69099999999999995,"15min":0.74099999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.0469999999999999,"5min":1.228,"15min":1.2669999999999999},"last":0.47199999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76500000000000001,"15min":0.77500000000000002},"min":{"1min":0.44,"5min":0.375,"15min":0.375},"max":{"1min":1.1100000000000001,"5min":1.353,"15min":1.353},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71899999999999997,"15min":0.78200000000000003},"min":{"1min":0.35999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1,"5min":1.2090000000000001,"15min":1.4339999999999999},"last":0.68100000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.90800000000000003,"15min":0.95199999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.163,"5min":1.3640000000000001,"15min":1.524},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.94899999999999995,"15min":0.97099999999999997},"min":{"1min":0.67400000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.127,"5min":1.994,"15min":1.994},"last":0.84499999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.97199999999999998,"15min":0.97099999999999997},"min":{"1min":0.71399999999999997,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2210000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.999,"5min":1.0449999999999999,"15min":1.0740000000000001},"min":{"1min":0.63700000000000001,"5min":0.626,"15min":0.626},"max":{"1min":1.264,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":0.86499999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.997,"15min":1.073},"min":{"1min":0.56599999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.198,"5min":1.6950000000000001,"15min":1.8200000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0469999999999999,"15min":1.085},"min":{"1min":0.64700000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.1870000000000001,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.97699999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0740000000000001,"15min":1.0840000000000001},"min":{"1min":0.72499999999999998,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.3440000000000001,"5min":2.5579999999999998,"15min":2.5579999999999998},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0429999999999999,"15min":1.1080000000000001},"min":{"1min":0.55200000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.238,"5min":1.6399999999999999,"15min":1.72},"last":0.89700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1290240,"data_stored":879322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57799999999999996,"15min":0.59099999999999997},"min":{"1min":0.26500000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.82899999999999996,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.23},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.64700000000000002,"15min":0.68400000000000005},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.98399999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":1.1220000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.66200000000000003,"15min":0.69199999999999995},"min":{"1min":0.312,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.204,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.069},{"interface":"front","average":{"1min":0.63,"5min":0.68999999999999995,"15min":0.70799999999999996},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.85399999999999998,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63300000000000001,"15min":0.627},"min":{"1min":0.33000000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.96799999999999997,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.77600000000000002,"15min":0.81200000000000006},"min":{"1min":0.5,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.0580000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":1.3200000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.91700000000000004,"15min":0.95899999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.90100000000000002,"15min":0.89900000000000002},"min":{"1min":0.66400000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.198,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.1799999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.95699999999999996,"15min":0.96299999999999997},"min":{"1min":0.64600000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.3420000000000001,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.288},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.0109999999999999,"15min":1.0409999999999999},"min":{"1min":0.71899999999999997,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.367,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.369}]},{"osd":6,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.052,"15min":1.0800000000000001},"min":{"1min":0.69199999999999995,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4239999999999999,"5min":1.462,"15min":1.462},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.036,"15min":1.1040000000000001},"min":{"1min":0.623,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.3560000000000001,"5min":1.704,"15min":1.704},"last":1.4179999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0349999999999999,"15min":1.103},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4690000000000001,"5min":1.633,"15min":1.633},"last":1.341},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0149999999999999,"15min":1.0309999999999999},"min":{"1min":0.67900000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2789999999999999,"5min":1.353,"15min":1.353},"last":1.3839999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:33:20.374 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:33:20.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc480c64700 1 Processor -- start 2024-09-13T18:33:20.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc480c64700 1 -- start start 2024-09-13T18:33:20.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc480c64700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc47c06b310 0x7fc47c0cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc480c64700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc47c0d21e0 con 0x7fc47c15cec0 2024-09-13T18:33:20.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc480c64700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc47c0d1940 con 0x7fc47c15cae0 2024-09-13T18:33:20.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc480c64700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47c0d1c20 con 0x7fc47c06b310 2024-09-13T18:33:20.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47affd700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc47c15cec0 0x7fc47c0b62b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51208/0 (socket says 172.21.15.44:51208) 2024-09-13T18:33:20.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47affd700 1 -- 172.21.15.44:0/3622365268 learned_addr learned my addr 172.21.15.44:0/3622365268 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:20.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47bfff700 1 --2- 172.21.15.44:0/3622365268 >> v2:172.21.15.99:3300/0 conn(0x7fc47c06b310 0x7fc47c0cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47a7fc700 1 -- 172.21.15.44:0/3622365268 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095522252 0 0) 0x7fc47c0d21e0 con 0x7fc47c15cec0 2024-09-13T18:33:20.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47a7fc700 1 -- 172.21.15.44:0/3622365268 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc45c0035d0 con 0x7fc47c15cec0 2024-09-13T18:33:20.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47a7fc700 1 -- 172.21.15.44:0/3622365268 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3134180785 0 0) 0x7fc47c0d1940 con 0x7fc47c15cae0 2024-09-13T18:33:20.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47a7fc700 1 -- 172.21.15.44:0/3622365268 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc47c0d21e0 con 0x7fc47c15cae0 2024-09-13T18:33:20.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47a7fc700 1 -- 172.21.15.44:0/3622365268 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 558248898 0 0) 0x7fc45c0035d0 con 0x7fc47c15cec0 2024-09-13T18:33:20.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47a7fc700 1 -- 172.21.15.44:0/3622365268 >> v2:172.21.15.99:3300/0 conn(0x7fc47c06b310 msgr2=0x7fc47c0cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:20.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47a7fc700 1 --2- 172.21.15.44:0/3622365268 >> v2:172.21.15.99:3300/0 conn(0x7fc47c06b310 0x7fc47c0cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47a7fc700 1 -- 172.21.15.44:0/3622365268 >> v1:172.21.15.99:6789/0 conn(0x7fc47c15cae0 legacy=0x7fc47c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47a7fc700 1 -- 172.21.15.44:0/3622365268 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c0d1f00 con 0x7fc47c15cec0 2024-09-13T18:33:20.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47a7fc700 1 -- 172.21.15.44:0/3622365268 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7fc46c0019f0 con 0x7fc47c15cec0 2024-09-13T18:33:20.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47a7fc700 1 -- 172.21.15.44:0/3622365268 >> v1:172.21.15.44:6789/0 conn(0x7fc47c15cec0 legacy=0x7fc47c0b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47a7fc700 1 --2- 172.21.15.44:0/3622365268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc45c003bb0 0x7fc45c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47a7fc700 1 --2- 172.21.15.44:0/3622365268 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc45c004870 0x7fc45c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47a7fc700 1 --2- 172.21.15.44:0/3622365268 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc45c005230 0x7fc45c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47a7fc700 1 -- 172.21.15.44:0/3622365268 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0d1c20 con 0x7fc45c003bb0 2024-09-13T18:33:20.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47a7fc700 1 -- 172.21.15.44:0/3622365268 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c00c160 con 0x7fc45c004870 2024-09-13T18:33:20.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47a7fc700 1 -- 172.21.15.44:0/3622365268 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c00c320 con 0x7fc45c005230 2024-09-13T18:33:20.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47b7fe700 1 --2- 172.21.15.44:0/3622365268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc45c003bb0 0x7fc45c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47affd700 1 --2- 172.21.15.44:0/3622365268 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc45c004870 0x7fc45c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47bfff700 1 --2- 172.21.15.44:0/3622365268 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc45c005230 0x7fc45c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47b7fe700 1 -- 172.21.15.44:0/3622365268 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc45c005230 msgr2=0x7fc45c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:20.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47b7fe700 1 --2- 172.21.15.44:0/3622365268 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc45c005230 0x7fc45c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47b7fe700 1 -- 172.21.15.44:0/3622365268 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc45c004870 msgr2=0x7fc45c004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:20.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47b7fe700 1 --2- 172.21.15.44:0/3622365268 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc45c004870 0x7fc45c004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47b7fe700 1 -- 172.21.15.44:0/3622365268 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45c0035d0 con 0x7fc45c003bb0 2024-09-13T18:33:20.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47affd700 1 --2- 172.21.15.44:0/3622365268 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc45c004870 0x7fc45c004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:20.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47bfff700 1 -- 172.21.15.44:0/3622365268 reap_dead start 2024-09-13T18:33:20.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.483+0000 7fc47b7fe700 1 --2- 172.21.15.44:0/3622365268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc45c003bb0 0x7fc45c003fb0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc464001960 tx=0x7fc45c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294e2c55f1498087 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:20.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.487+0000 7fc47a7fc700 1 -- 172.21.15.44:0/3622365268 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc464001450 con 0x7fc45c003bb0 2024-09-13T18:33:20.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.487+0000 7fc47a7fc700 1 -- 172.21.15.44:0/3622365268 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4640052f0 con 0x7fc45c003bb0 2024-09-13T18:33:20.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.487+0000 7fc47a7fc700 1 -- 172.21.15.44:0/3622365268 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc464001d30 con 0x7fc45c003bb0 2024-09-13T18:33:20.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.487+0000 7fc480c64700 1 -- 172.21.15.44:0/3622365268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc45c003bb0 msgr2=0x7fc45c003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.487+0000 7fc480c64700 1 --2- 172.21.15.44:0/3622365268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc45c003bb0 0x7fc45c003fb0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc464001960 tx=0x7fc45c0058a0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.487+0000 7fc480c64700 1 -- 172.21.15.44:0/3622365268 shutdown_connections 2024-09-13T18:33:20.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.487+0000 7fc480c64700 1 --2- 172.21.15.44:0/3622365268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc45c003bb0 0x7fc45c003fb0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.487+0000 7fc480c64700 1 -- 172.21.15.44:0/3622365268 >> 172.21.15.44:0/3622365268 conn(0x7fc47c0d2c80 msgr2=0x7fc47c0d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:20.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.487+0000 7fc480c64700 1 -- 172.21.15.44:0/3622365268 shutdown_connections 2024-09-13T18:33:20.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.487+0000 7fc480c64700 1 -- 172.21.15.44:0/3622365268 wait complete. 2024-09-13T18:33:20.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.487+0000 7fc480c64700 1 Processor -- start 2024-09-13T18:33:20.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.487+0000 7fc480c64700 1 -- start start 2024-09-13T18:33:20.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.491+0000 7fc480c64700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc45c003bb0 0x7fc47c154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.491+0000 7fc480c64700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc47c0cbb20 0x7fc47c0cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.491+0000 7fc480c64700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc47c0ce440 0x7fc47c1f27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.491+0000 7fc480c64700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0cb700 con 0x7fc47c0cbb20 2024-09-13T18:33:20.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.491+0000 7fc480c64700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0ce8d0 con 0x7fc45c003bb0 2024-09-13T18:33:20.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.491+0000 7fc480c64700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0cada0 con 0x7fc47c0ce440 2024-09-13T18:33:20.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.491+0000 7fc47affd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc47c0cbb20 0x7fc47c0cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.491+0000 7fc47affd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc47c0cbb20 0x7fc47c0cdf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42712/0 (socket says 172.21.15.44:42712) 2024-09-13T18:33:20.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.491+0000 7fc47affd700 1 -- 172.21.15.44:0/1839885344 learned_addr learned my addr 172.21.15.44:0/1839885344 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:20.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.491+0000 7fc47b7fe700 1 --2- 172.21.15.44:0/1839885344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc45c003bb0 0x7fc47c154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.491+0000 7fc47bfff700 1 --2- 172.21.15.44:0/1839885344 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc47c0ce440 0x7fc47c1f27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.491+0000 7fc47affd700 1 -- 172.21.15.44:0/1839885344 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc47c0ce440 msgr2=0x7fc47c1f27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.491+0000 7fc47affd700 1 --2- 172.21.15.44:0/1839885344 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc47c0ce440 0x7fc47c1f27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.491+0000 7fc47affd700 1 -- 172.21.15.44:0/1839885344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc45c003bb0 msgr2=0x7fc47c154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.491+0000 7fc47affd700 1 --2- 172.21.15.44:0/1839885344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc45c003bb0 0x7fc47c154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.491+0000 7fc47affd700 1 -- 172.21.15.44:0/1839885344 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c1f3500 con 0x7fc47c0cbb20 2024-09-13T18:33:20.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.491+0000 7fc47affd700 1 --2- 172.21.15.44:0/1839885344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc47c0cbb20 0x7fc47c0cdf00 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fc46c001330 tx=0x7fc46c00e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:20.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.491+0000 7fc473fff700 1 -- 172.21.15.44:0/1839885344 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c00eab0 con 0x7fc47c0cbb20 2024-09-13T18:33:20.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.491+0000 7fc473fff700 1 -- 172.21.15.44:0/1839885344 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c00ec10 con 0x7fc47c0cbb20 2024-09-13T18:33:20.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.491+0000 7fc480c64700 1 -- 172.21.15.44:0/1839885344 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47c0cb040 con 0x7fc47c0cbb20 2024-09-13T18:33:20.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.491+0000 7fc473fff700 1 -- 172.21.15.44:0/1839885344 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c013420 con 0x7fc47c0cbb20 2024-09-13T18:33:20.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.491+0000 7fc480c64700 1 -- 172.21.15.44:0/1839885344 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47c1f2d10 con 0x7fc47c0cbb20 2024-09-13T18:33:20.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.491+0000 7fc480c64700 1 -- 172.21.15.44:0/1839885344 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc47c0cb840 con 0x7fc47c0cbb20 2024-09-13T18:33:20.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.495+0000 7fc473fff700 1 -- 172.21.15.44:0/1839885344 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc46c013580 con 0x7fc47c0cbb20 2024-09-13T18:33:20.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.495+0000 7fc473fff700 1 --2- 172.21.15.44:0/1839885344 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc460066760 0x7fc460068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.495+0000 7fc473fff700 1 -- 172.21.15.44:0/1839885344 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc46c084490 con 0x7fc47c0cbb20 2024-09-13T18:33:20.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.495+0000 7fc47b7fe700 1 --2- 172.21.15.44:0/1839885344 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc460066760 0x7fc460068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.495+0000 7fc47b7fe700 1 --2- 172.21.15.44:0/1839885344 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc460066760 0x7fc460068c20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc464005040 tx=0x7fc46400a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:20.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.503+0000 7fc473fff700 1 -- 172.21.15.44:0/1839885344 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc47c0cb840 con 0x7fc47c0cbb20 2024-09-13T18:33:20.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.671+0000 7fc480c64700 1 -- 172.21.15.44:0/1839885344 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc47c0cb840 con 0x7fc460066760 2024-09-13T18:33:20.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.687+0000 7fc473fff700 1 -- 172.21.15.44:0/1839885344 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287952 (secure 0 0 0) 0x7fc47c0cb840 con 0x7fc460066760 2024-09-13T18:33:20.698 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:33:20.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.691+0000 7fc480c64700 1 -- 172.21.15.44:0/1839885344 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc460066760 msgr2=0x7fc460068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.691+0000 7fc480c64700 1 --2- 172.21.15.44:0/1839885344 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc460066760 0x7fc460068c20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc464005040 tx=0x7fc46400a000 comp rx=0 tx=0).stop 2024-09-13T18:33:20.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.691+0000 7fc480c64700 1 -- 172.21.15.44:0/1839885344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc47c0cbb20 msgr2=0x7fc47c0cdf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.691+0000 7fc480c64700 1 --2- 172.21.15.44:0/1839885344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc47c0cbb20 0x7fc47c0cdf00 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fc46c001330 tx=0x7fc46c00e160 comp rx=0 tx=0).stop 2024-09-13T18:33:20.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.691+0000 7fc480c64700 1 -- 172.21.15.44:0/1839885344 shutdown_connections 2024-09-13T18:33:20.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.691+0000 7fc480c64700 1 --2- 172.21.15.44:0/1839885344 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc460066760 0x7fc460068c20 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.691+0000 7fc480c64700 1 --2- 172.21.15.44:0/1839885344 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc47c0ce440 0x7fc47c1f27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.691+0000 7fc480c64700 1 --2- 172.21.15.44:0/1839885344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc47c0cbb20 0x7fc47c0cdf00 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.691+0000 7fc480c64700 1 --2- 172.21.15.44:0/1839885344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc45c003bb0 0x7fc47c154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.691+0000 7fc480c64700 1 -- 172.21.15.44:0/1839885344 >> 172.21.15.44:0/1839885344 conn(0x7fc47c0d2c80 msgr2=0x7fc47c0b6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:20.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.691+0000 7fc480c64700 1 -- 172.21.15.44:0/1839885344 shutdown_connections 2024-09-13T18:33:20.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.691+0000 7fc480c64700 1 -- 172.21.15.44:0/1839885344 wait complete. 2024-09-13T18:33:20.702 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:33:20.717 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-09-13T18:33:20.453727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":143,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":247920,"kb_used_data":7144,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754726800,"statfs":{"total":773094113280,"available":772840243200,"internally_reserved":0,"allocated":7315456,"data_stored":3739940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":246402616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.560064"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.509127+0000","last_change":"2024-09-13T18:33:16.321657+0000","last_active":"2024-09-13T18:33:18.509127+0000","last_peered":"2024-09-13T18:33:18.509127+0000","last_clean":"2024-09-13T18:33:18.509127+0000","last_became_active":"2024-09-13T18:33:16.321311+0000","last_became_peered":"2024-09-13T18:33:16.321311+0000","last_unstale":"2024-09-13T18:33:18.509127+0000","last_undegraded":"2024-09-13T18:33:18.509127+0000","last_fullsized":"2024-09-13T18:33:18.509127+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:23.859973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.510268+0000","last_change":"2024-09-13T18:33:16.309712+0000","last_active":"2024-09-13T18:33:18.510268+0000","last_peered":"2024-09-13T18:33:18.510268+0000","last_clean":"2024-09-13T18:33:18.510268+0000","last_became_active":"2024-09-13T18:33:16.309429+0000","last_became_peered":"2024-09-13T18:33:16.309429+0000","last_unstale":"2024-09-13T18:33:18.510268+0000","last_undegraded":"2024-09-13T18:33:18.510268+0000","last_fullsized":"2024-09-13T18:33:18.510268+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:16.683759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.307503+0000","last_change":"2024-09-13T18:33:16.334003+0000","last_active":"2024-09-13T18:33:17.307503+0000","last_peered":"2024-09-13T18:33:17.307503+0000","last_clean":"2024-09-13T18:33:17.307503+0000","last_became_active":"2024-09-13T18:33:16.332530+0000","last_became_peered":"2024-09-13T18:33:16.332530+0000","last_unstale":"2024-09-13T18:33:17.307503+0000","last_undegraded":"2024-09-13T18:33:17.307503+0000","last_fullsized":"2024-09-13T18:33:17.307503+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:28.782618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.444067+0000","last_change":"2024-09-13T18:33:16.317642+0000","last_active":"2024-09-13T18:33:18.444067+0000","last_peered":"2024-09-13T18:33:18.444067+0000","last_clean":"2024-09-13T18:33:18.444067+0000","last_became_active":"2024-09-13T18:33:16.316687+0000","last_became_peered":"2024-09-13T18:33:16.316687+0000","last_unstale":"2024-09-13T18:33:18.444067+0000","last_undegraded":"2024-09-13T18:33:18.444067+0000","last_fullsized":"2024-09-13T18:33:18.444067+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:39.954951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.509226+0000","last_change":"2024-09-13T18:33:16.312444+0000","last_active":"2024-09-13T18:33:18.509226+0000","last_peered":"2024-09-13T18:33:18.509226+0000","last_clean":"2024-09-13T18:33:18.509226+0000","last_became_active":"2024-09-13T18:33:16.312205+0000","last_became_peered":"2024-09-13T18:33:16.312205+0000","last_unstale":"2024-09-13T18:33:18.509226+0000","last_undegraded":"2024-09-13T18:33:18.509226+0000","last_fullsized":"2024-09-13T18:33:18.509226+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:44.818474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.033122+0000","last_change":"2024-09-13T18:33:16.316284+0000","last_active":"2024-09-13T18:33:18.033122+0000","last_peered":"2024-09-13T18:33:18.033122+0000","last_clean":"2024-09-13T18:33:18.033122+0000","last_became_active":"2024-09-13T18:33:16.315619+0000","last_became_peered":"2024-09-13T18:33:16.315619+0000","last_unstale":"2024-09-13T18:33:18.033122+0000","last_undegraded":"2024-09-13T18:33:18.033122+0000","last_fullsized":"2024-09-13T18:33:18.033122+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:06.146817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.508088+0000","last_change":"2024-09-13T18:33:16.314944+0000","last_active":"2024-09-13T18:33:18.508088+0000","last_peered":"2024-09-13T18:33:18.508088+0000","last_clean":"2024-09-13T18:33:18.508088+0000","last_became_active":"2024-09-13T18:33:16.314666+0000","last_became_peered":"2024-09-13T18:33:16.314666+0000","last_unstale":"2024-09-13T18:33:18.508088+0000","last_undegraded":"2024-09-13T18:33:18.508088+0000","last_fullsized":"2024-09-13T18:33:18.508088+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:07.665349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.509268+0000","last_change":"2024-09-13T18:33:16.312889+0000","last_active":"2024-09-13T18:33:18.509268+0000","last_peered":"2024-09-13T18:33:18.509268+0000","last_clean":"2024-09-13T18:33:18.509268+0000","last_became_active":"2024-09-13T18:33:16.312659+0000","last_became_peered":"2024-09-13T18:33:16.312659+0000","last_unstale":"2024-09-13T18:33:18.509268+0000","last_undegraded":"2024-09-13T18:33:18.509268+0000","last_fullsized":"2024-09-13T18:33:18.509268+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:57.863143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.508756+0000","last_change":"2024-09-13T18:33:16.322288+0000","last_active":"2024-09-13T18:33:18.508756+0000","last_peered":"2024-09-13T18:33:18.508756+0000","last_clean":"2024-09-13T18:33:18.508756+0000","last_became_active":"2024-09-13T18:33:16.322047+0000","last_became_peered":"2024-09-13T18:33:16.322047+0000","last_unstale":"2024-09-13T18:33:18.508756+0000","last_undegraded":"2024-09-13T18:33:18.508756+0000","last_fullsized":"2024-09-13T18:33:18.508756+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:41.202479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.306917+0000","last_change":"2024-09-13T18:33:16.319004+0000","last_active":"2024-09-13T18:33:17.306917+0000","last_peered":"2024-09-13T18:33:17.306917+0000","last_clean":"2024-09-13T18:33:17.306917+0000","last_became_active":"2024-09-13T18:33:16.318723+0000","last_became_peered":"2024-09-13T18:33:16.318723+0000","last_unstale":"2024-09-13T18:33:17.306917+0000","last_undegraded":"2024-09-13T18:33:17.306917+0000","last_fullsized":"2024-09-13T18:33:17.306917+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:22.144611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.307136+0000","last_change":"2024-09-13T18:33:16.319153+0000","last_active":"2024-09-13T18:33:17.307136+0000","last_peered":"2024-09-13T18:33:17.307136+0000","last_clean":"2024-09-13T18:33:17.307136+0000","last_became_active":"2024-09-13T18:33:16.318962+0000","last_became_peered":"2024-09-13T18:33:16.318962+0000","last_unstale":"2024-09-13T18:33:17.307136+0000","last_undegraded":"2024-09-13T18:33:17.307136+0000","last_fullsized":"2024-09-13T18:33:17.307136+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:46.740517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.444237+0000","last_change":"2024-09-13T18:33:16.329567+0000","last_active":"2024-09-13T18:33:18.444237+0000","last_peered":"2024-09-13T18:33:18.444237+0000","last_clean":"2024-09-13T18:33:18.444237+0000","last_became_active":"2024-09-13T18:33:16.329194+0000","last_became_peered":"2024-09-13T18:33:16.329194+0000","last_unstale":"2024-09-13T18:33:18.444237+0000","last_undegraded":"2024-09-13T18:33:18.444237+0000","last_fullsized":"2024-09-13T18:33:18.444237+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:02.343870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.307568+0000","last_change":"2024-09-13T18:33:16.318645+0000","last_active":"2024-09-13T18:33:17.307568+0000","last_peered":"2024-09-13T18:33:17.307568+0000","last_clean":"2024-09-13T18:33:17.307568+0000","last_became_active":"2024-09-13T18:33:16.318359+0000","last_became_peered":"2024-09-13T18:33:16.318359+0000","last_unstale":"2024-09-13T18:33:17.307568+0000","last_undegraded":"2024-09-13T18:33:17.307568+0000","last_fullsized":"2024-09-13T18:33:17.307568+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:50.907410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.508298+0000","last_change":"2024-09-13T18:33:16.318488+0000","last_active":"2024-09-13T18:33:18.508298+0000","last_peered":"2024-09-13T18:33:18.508298+0000","last_clean":"2024-09-13T18:33:18.508298+0000","last_became_active":"2024-09-13T18:33:16.318165+0000","last_became_peered":"2024-09-13T18:33:16.318165+0000","last_unstale":"2024-09-13T18:33:18.508298+0000","last_undegraded":"2024-09-13T18:33:18.508298+0000","last_fullsized":"2024-09-13T18:33:18.508298+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:01.894924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.508088+0000","last_change":"2024-09-13T18:33:16.319764+0000","last_active":"2024-09-13T18:33:18.508088+0000","last_peered":"2024-09-13T18:33:18.508088+0000","last_clean":"2024-09-13T18:33:18.508088+0000","last_became_active":"2024-09-13T18:33:16.319218+0000","last_became_peered":"2024-09-13T18:33:16.319218+0000","last_unstale":"2024-09-13T18:33:18.508088+0000","last_undegraded":"2024-09-13T18:33:18.508088+0000","last_fullsized":"2024-09-13T18:33:18.508088+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:03.468587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.032799+0000","last_change":"2024-09-13T18:33:16.321353+0000","last_active":"2024-09-13T18:33:18.032799+0000","last_peered":"2024-09-13T18:33:18.032799+0000","last_clean":"2024-09-13T18:33:18.032799+0000","last_became_active":"2024-09-13T18:33:16.321112+0000","last_became_peered":"2024-09-13T18:33:16.321112+0000","last_unstale":"2024-09-13T18:33:18.032799+0000","last_undegraded":"2024-09-13T18:33:18.032799+0000","last_fullsized":"2024-09-13T18:33:18.032799+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:58.830713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.509929+0000","last_change":"2024-09-13T18:33:16.319901+0000","last_active":"2024-09-13T18:33:18.509929+0000","last_peered":"2024-09-13T18:33:18.509929+0000","last_clean":"2024-09-13T18:33:18.509929+0000","last_became_active":"2024-09-13T18:33:16.319572+0000","last_became_peered":"2024-09-13T18:33:16.319572+0000","last_unstale":"2024-09-13T18:33:18.509929+0000","last_undegraded":"2024-09-13T18:33:18.509929+0000","last_fullsized":"2024-09-13T18:33:18.509929+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:35.688112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.307634+0000","last_change":"2024-09-13T18:33:16.331514+0000","last_active":"2024-09-13T18:33:17.307634+0000","last_peered":"2024-09-13T18:33:17.307634+0000","last_clean":"2024-09-13T18:33:17.307634+0000","last_became_active":"2024-09-13T18:33:16.330133+0000","last_became_peered":"2024-09-13T18:33:16.330133+0000","last_unstale":"2024-09-13T18:33:17.307634+0000","last_undegraded":"2024-09-13T18:33:17.307634+0000","last_fullsized":"2024-09-13T18:33:17.307634+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:42.913947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.509654+0000","last_change":"2024-09-13T18:33:16.321236+0000","last_active":"2024-09-13T18:33:18.509654+0000","last_peered":"2024-09-13T18:33:18.509654+0000","last_clean":"2024-09-13T18:33:18.509654+0000","last_became_active":"2024-09-13T18:33:16.320586+0000","last_became_peered":"2024-09-13T18:33:16.320586+0000","last_unstale":"2024-09-13T18:33:18.509654+0000","last_undegraded":"2024-09-13T18:33:18.509654+0000","last_fullsized":"2024-09-13T18:33:18.509654+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:38.528867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.510385+0000","last_change":"2024-09-13T18:33:16.311263+0000","last_active":"2024-09-13T18:33:18.510385+0000","last_peered":"2024-09-13T18:33:18.510385+0000","last_clean":"2024-09-13T18:33:18.510385+0000","last_became_active":"2024-09-13T18:33:16.311015+0000","last_became_peered":"2024-09-13T18:33:16.311015+0000","last_unstale":"2024-09-13T18:33:18.510385+0000","last_undegraded":"2024-09-13T18:33:18.510385+0000","last_fullsized":"2024-09-13T18:33:18.510385+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:53.818665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.307043+0000","last_change":"2024-09-13T18:33:16.329466+0000","last_active":"2024-09-13T18:33:17.307043+0000","last_peered":"2024-09-13T18:33:17.307043+0000","last_clean":"2024-09-13T18:33:17.307043+0000","last_became_active":"2024-09-13T18:33:16.327957+0000","last_became_peered":"2024-09-13T18:33:16.327957+0000","last_unstale":"2024-09-13T18:33:17.307043+0000","last_undegraded":"2024-09-13T18:33:17.307043+0000","last_fullsized":"2024-09-13T18:33:17.307043+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:06.146817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.509332+0000","last_change":"2024-09-13T18:33:16.312285+0000","last_active":"2024-09-13T18:33:18.509332+0000","last_peered":"2024-09-13T18:33:18.509332+0000","last_clean":"2024-09-13T18:33:18.509332+0000","last_became_active":"2024-09-13T18:33:16.312058+0000","last_became_peered":"2024-09-13T18:33:16.312058+0000","last_unstale":"2024-09-13T18:33:18.509332+0000","last_undegraded":"2024-09-13T18:33:18.509332+0000","last_fullsized":"2024-09-13T18:33:18.509332+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:31.637096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.307253+0000","last_change":"2024-09-13T18:33:16.331553+0000","last_active":"2024-09-13T18:33:17.307253+0000","last_peered":"2024-09-13T18:33:17.307253+0000","last_clean":"2024-09-13T18:33:17.307253+0000","last_became_active":"2024-09-13T18:33:16.330285+0000","last_became_peered":"2024-09-13T18:33:16.330285+0000","last_unstale":"2024-09-13T18:33:17.307253+0000","last_undegraded":"2024-09-13T18:33:17.307253+0000","last_fullsized":"2024-09-13T18:33:17.307253+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:28.271093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.306853+0000","last_change":"2024-09-13T18:33:16.322319+0000","last_active":"2024-09-13T18:33:17.306853+0000","last_peered":"2024-09-13T18:33:17.306853+0000","last_clean":"2024-09-13T18:33:17.306853+0000","last_became_active":"2024-09-13T18:33:16.321853+0000","last_became_peered":"2024-09-13T18:33:16.321853+0000","last_unstale":"2024-09-13T18:33:17.306853+0000","last_undegraded":"2024-09-13T18:33:17.306853+0000","last_fullsized":"2024-09-13T18:33:17.306853+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.152143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.510823+0000","last_change":"2024-09-13T18:33:16.319035+0000","last_active":"2024-09-13T18:33:18.510823+0000","last_peered":"2024-09-13T18:33:18.510823+0000","last_clean":"2024-09-13T18:33:18.510823+0000","last_became_active":"2024-09-13T18:33:16.318794+0000","last_became_peered":"2024-09-13T18:33:16.318794+0000","last_unstale":"2024-09-13T18:33:18.510823+0000","last_undegraded":"2024-09-13T18:33:18.510823+0000","last_fullsized":"2024-09-13T18:33:18.510823+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:19.978088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.444603+0000","last_change":"2024-09-13T18:33:16.315334+0000","last_active":"2024-09-13T18:33:18.444603+0000","last_peered":"2024-09-13T18:33:18.444603+0000","last_clean":"2024-09-13T18:33:18.444603+0000","last_became_active":"2024-09-13T18:33:16.315062+0000","last_became_peered":"2024-09-13T18:33:16.315062+0000","last_unstale":"2024-09-13T18:33:18.444603+0000","last_undegraded":"2024-09-13T18:33:18.444603+0000","last_fullsized":"2024-09-13T18:33:18.444603+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:58.830713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.033492+0000","last_change":"2024-09-13T18:33:16.320746+0000","last_active":"2024-09-13T18:33:18.033492+0000","last_peered":"2024-09-13T18:33:18.033492+0000","last_clean":"2024-09-13T18:33:18.033492+0000","last_became_active":"2024-09-13T18:33:16.320499+0000","last_became_peered":"2024-09-13T18:33:16.320499+0000","last_unstale":"2024-09-13T18:33:18.033492+0000","last_undegraded":"2024-09-13T18:33:18.033492+0000","last_fullsized":"2024-09-13T18:33:18.033492+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:42.913947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.509778+0000","last_change":"2024-09-13T18:33:16.317750+0000","last_active":"2024-09-13T18:33:18.509778+0000","last_peered":"2024-09-13T18:33:18.509778+0000","last_clean":"2024-09-13T18:33:18.509778+0000","last_became_active":"2024-09-13T18:33:16.317384+0000","last_became_peered":"2024-09-13T18:33:16.317384+0000","last_unstale":"2024-09-13T18:33:18.509778+0000","last_undegraded":"2024-09-13T18:33:18.509778+0000","last_fullsized":"2024-09-13T18:33:18.509778+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:54.659297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.509599+0000","last_change":"2024-09-13T18:33:16.310131+0000","last_active":"2024-09-13T18:33:18.509599+0000","last_peered":"2024-09-13T18:33:18.509599+0000","last_clean":"2024-09-13T18:33:18.509599+0000","last_became_active":"2024-09-13T18:33:16.308811+0000","last_became_peered":"2024-09-13T18:33:16.308811+0000","last_unstale":"2024-09-13T18:33:18.509599+0000","last_undegraded":"2024-09-13T18:33:18.509599+0000","last_fullsized":"2024-09-13T18:33:18.509599+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:51.525761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.307132+0000","last_change":"2024-09-13T18:33:16.334132+0000","last_active":"2024-09-13T18:33:17.307132+0000","last_peered":"2024-09-13T18:33:17.307132+0000","last_clean":"2024-09-13T18:33:17.307132+0000","last_became_active":"2024-09-13T18:33:16.333659+0000","last_became_peered":"2024-09-13T18:33:16.333659+0000","last_unstale":"2024-09-13T18:33:17.307132+0000","last_undegraded":"2024-09-13T18:33:17.307132+0000","last_fullsized":"2024-09-13T18:33:17.307132+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:07.637052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.508961+0000","last_change":"2024-09-13T18:33:16.319681+0000","last_active":"2024-09-13T18:33:18.508961+0000","last_peered":"2024-09-13T18:33:18.508961+0000","last_clean":"2024-09-13T18:33:18.508961+0000","last_became_active":"2024-09-13T18:33:16.319454+0000","last_became_peered":"2024-09-13T18:33:16.319454+0000","last_unstale":"2024-09-13T18:33:18.508961+0000","last_undegraded":"2024-09-13T18:33:18.508961+0000","last_fullsized":"2024-09-13T18:33:18.508961+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:49.429733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.033137+0000","last_change":"2024-09-13T18:33:16.320304+0000","last_active":"2024-09-13T18:33:18.033137+0000","last_peered":"2024-09-13T18:33:18.033137+0000","last_clean":"2024-09-13T18:33:18.033137+0000","last_became_active":"2024-09-13T18:33:16.320040+0000","last_became_peered":"2024-09-13T18:33:16.320040+0000","last_unstale":"2024-09-13T18:33:18.033137+0000","last_undegraded":"2024-09-13T18:33:18.033137+0000","last_fullsized":"2024-09-13T18:33:18.033137+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:25.424200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.033942+0000","last_change":"2024-09-13T18:33:16.328311+0000","last_active":"2024-09-13T18:33:18.033942+0000","last_peered":"2024-09-13T18:33:18.033942+0000","last_clean":"2024-09-13T18:33:18.033942+0000","last_became_active":"2024-09-13T18:33:16.327949+0000","last_became_peered":"2024-09-13T18:33:16.327949+0000","last_unstale":"2024-09-13T18:33:18.033942+0000","last_undegraded":"2024-09-13T18:33:18.033942+0000","last_fullsized":"2024-09-13T18:33:18.033942+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:28.008779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"62'4","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.033881+0000","last_change":"2024-09-13T18:33:15.929800+0000","last_active":"2024-09-13T18:33:18.033881+0000","last_peered":"2024-09-13T18:33:18.033881+0000","last_clean":"2024-09-13T18:33:18.033881+0000","last_became_active":"2024-09-13T18:33:15.929514+0000","last_became_peered":"2024-09-13T18:33:15.929514+0000","last_unstale":"2024-09-13T18:33:18.033881+0000","last_undegraded":"2024-09-13T18:33:18.033881+0000","last_fullsized":"2024-09-13T18:33:18.033881+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:21.134753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.307418+0000","last_change":"2024-09-13T18:33:16.328682+0000","last_active":"2024-09-13T18:33:17.307418+0000","last_peered":"2024-09-13T18:33:17.307418+0000","last_clean":"2024-09-13T18:33:17.307418+0000","last_became_active":"2024-09-13T18:33:16.328455+0000","last_became_peered":"2024-09-13T18:33:16.328455+0000","last_unstale":"2024-09-13T18:33:17.307418+0000","last_undegraded":"2024-09-13T18:33:17.307418+0000","last_fullsized":"2024-09-13T18:33:17.307418+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:50.907410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"62'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.510393+0000","last_change":"2024-09-13T18:33:15.933995+0000","last_active":"2024-09-13T18:33:18.510393+0000","last_peered":"2024-09-13T18:33:18.510393+0000","last_clean":"2024-09-13T18:33:18.510393+0000","last_became_active":"2024-09-13T18:33:15.933720+0000","last_became_peered":"2024-09-13T18:33:15.933720+0000","last_unstale":"2024-09-13T18:33:18.510393+0000","last_undegraded":"2024-09-13T18:33:18.510393+0000","last_fullsized":"2024-09-13T18:33:18.510393+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:05.136959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.033558+0000","last_change":"2024-09-13T18:33:16.319108+0000","last_active":"2024-09-13T18:33:18.033558+0000","last_peered":"2024-09-13T18:33:18.033558+0000","last_clean":"2024-09-13T18:33:18.033558+0000","last_became_active":"2024-09-13T18:33:16.318798+0000","last_became_peered":"2024-09-13T18:33:16.318798+0000","last_unstale":"2024-09-13T18:33:18.033558+0000","last_undegraded":"2024-09-13T18:33:18.033558+0000","last_fullsized":"2024-09-13T18:33:18.033558+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:02.343870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"62'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.033797+0000","last_change":"2024-09-13T18:33:15.927841+0000","last_active":"2024-09-13T18:33:18.033797+0000","last_peered":"2024-09-13T18:33:18.033797+0000","last_clean":"2024-09-13T18:33:18.033797+0000","last_became_active":"2024-09-13T18:33:15.927570+0000","last_became_peered":"2024-09-13T18:33:15.927570+0000","last_unstale":"2024-09-13T18:33:18.033797+0000","last_undegraded":"2024-09-13T18:33:18.033797+0000","last_fullsized":"2024-09-13T18:33:18.033797+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:39.184168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.033575+0000","last_change":"2024-09-13T18:33:16.311324+0000","last_active":"2024-09-13T18:33:18.033575+0000","last_peered":"2024-09-13T18:33:18.033575+0000","last_clean":"2024-09-13T18:33:18.033575+0000","last_became_active":"2024-09-13T18:33:16.311084+0000","last_became_peered":"2024-09-13T18:33:16.311084+0000","last_unstale":"2024-09-13T18:33:18.033575+0000","last_undegraded":"2024-09-13T18:33:18.033575+0000","last_fullsized":"2024-09-13T18:33:18.033575+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:13.260831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"62'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.444187+0000","last_change":"2024-09-13T18:33:15.931543+0000","last_active":"2024-09-13T18:33:18.444187+0000","last_peered":"2024-09-13T18:33:18.444187+0000","last_clean":"2024-09-13T18:33:18.444187+0000","last_became_active":"2024-09-13T18:33:15.931276+0000","last_became_peered":"2024-09-13T18:33:15.931276+0000","last_unstale":"2024-09-13T18:33:18.444187+0000","last_undegraded":"2024-09-13T18:33:18.444187+0000","last_fullsized":"2024-09-13T18:33:18.444187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:45.730659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.510564+0000","last_change":"2024-09-13T18:33:16.312192+0000","last_active":"2024-09-13T18:33:18.510564+0000","last_peered":"2024-09-13T18:33:18.510564+0000","last_clean":"2024-09-13T18:33:18.510564+0000","last_became_active":"2024-09-13T18:33:16.311943+0000","last_became_peered":"2024-09-13T18:33:16.311943+0000","last_unstale":"2024-09-13T18:33:18.510564+0000","last_undegraded":"2024-09-13T18:33:18.510564+0000","last_fullsized":"2024-09-13T18:33:18.510564+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:41.702510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"62'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.508436+0000","last_change":"2024-09-13T18:33:15.932816+0000","last_active":"2024-09-13T18:33:18.508436+0000","last_peered":"2024-09-13T18:33:18.508436+0000","last_clean":"2024-09-13T18:33:18.508436+0000","last_became_active":"2024-09-13T18:33:15.932534+0000","last_became_peered":"2024-09-13T18:33:15.932534+0000","last_unstale":"2024-09-13T18:33:18.508436+0000","last_undegraded":"2024-09-13T18:33:18.508436+0000","last_fullsized":"2024-09-13T18:33:18.508436+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:37.007022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.509224+0000","last_change":"2024-09-13T18:33:16.316118+0000","last_active":"2024-09-13T18:33:18.509224+0000","last_peered":"2024-09-13T18:33:18.509224+0000","last_clean":"2024-09-13T18:33:18.509224+0000","last_became_active":"2024-09-13T18:33:16.315868+0000","last_became_peered":"2024-09-13T18:33:16.315868+0000","last_unstale":"2024-09-13T18:33:18.509224+0000","last_undegraded":"2024-09-13T18:33:18.509224+0000","last_fullsized":"2024-09-13T18:33:18.509224+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:01:24.939331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"62'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.033076+0000","last_change":"2024-09-13T18:33:15.928933+0000","last_active":"2024-09-13T18:33:18.033076+0000","last_peered":"2024-09-13T18:33:18.033076+0000","last_clean":"2024-09-13T18:33:18.033076+0000","last_became_active":"2024-09-13T18:33:15.928659+0000","last_became_peered":"2024-09-13T18:33:15.928659+0000","last_unstale":"2024-09-13T18:33:18.033076+0000","last_undegraded":"2024-09-13T18:33:18.033076+0000","last_fullsized":"2024-09-13T18:33:18.033076+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:04.702522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.307734+0000","last_change":"2024-09-13T18:33:16.335357+0000","last_active":"2024-09-13T18:33:17.307734+0000","last_peered":"2024-09-13T18:33:17.307734+0000","last_clean":"2024-09-13T18:33:17.307734+0000","last_became_active":"2024-09-13T18:33:16.334897+0000","last_became_peered":"2024-09-13T18:33:16.334897+0000","last_unstale":"2024-09-13T18:33:17.307734+0000","last_undegraded":"2024-09-13T18:33:17.307734+0000","last_fullsized":"2024-09-13T18:33:17.307734+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:05.712380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.443821+0000","last_change":"2024-09-13T18:33:15.925110+0000","last_active":"2024-09-13T18:33:18.443821+0000","last_peered":"2024-09-13T18:33:18.443821+0000","last_clean":"2024-09-13T18:33:18.443821+0000","last_became_active":"2024-09-13T18:33:15.924750+0000","last_became_peered":"2024-09-13T18:33:15.924750+0000","last_unstale":"2024-09-13T18:33:18.443821+0000","last_undegraded":"2024-09-13T18:33:18.443821+0000","last_fullsized":"2024-09-13T18:33:18.443821+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:39.184168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.509665+0000","last_change":"2024-09-13T18:33:16.320632+0000","last_active":"2024-09-13T18:33:18.509665+0000","last_peered":"2024-09-13T18:33:18.509665+0000","last_clean":"2024-09-13T18:33:18.509665+0000","last_became_active":"2024-09-13T18:33:16.320368+0000","last_became_peered":"2024-09-13T18:33:16.320368+0000","last_unstale":"2024-09-13T18:33:18.509665+0000","last_undegraded":"2024-09-13T18:33:18.509665+0000","last_fullsized":"2024-09-13T18:33:18.509665+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:41.464789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.508191+0000","last_change":"2024-09-13T18:33:15.930720+0000","last_active":"2024-09-13T18:33:18.508191+0000","last_peered":"2024-09-13T18:33:18.508191+0000","last_clean":"2024-09-13T18:33:18.508191+0000","last_became_active":"2024-09-13T18:33:15.930454+0000","last_became_peered":"2024-09-13T18:33:15.930454+0000","last_unstale":"2024-09-13T18:33:18.508191+0000","last_undegraded":"2024-09-13T18:33:18.508191+0000","last_fullsized":"2024-09-13T18:33:18.508191+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:10.321005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.508828+0000","last_change":"2024-09-13T18:33:16.318810+0000","last_active":"2024-09-13T18:33:18.508828+0000","last_peered":"2024-09-13T18:33:18.508828+0000","last_clean":"2024-09-13T18:33:18.508828+0000","last_became_active":"2024-09-13T18:33:16.318486+0000","last_became_peered":"2024-09-13T18:33:16.318486+0000","last_unstale":"2024-09-13T18:33:18.508828+0000","last_undegraded":"2024-09-13T18:33:18.508828+0000","last_fullsized":"2024-09-13T18:33:18.508828+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:09.628856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.307879+0000","last_change":"2024-09-13T18:33:15.933795+0000","last_active":"2024-09-13T18:33:17.307879+0000","last_peered":"2024-09-13T18:33:17.307879+0000","last_clean":"2024-09-13T18:33:17.307879+0000","last_became_active":"2024-09-13T18:33:15.933539+0000","last_became_peered":"2024-09-13T18:33:15.933539+0000","last_unstale":"2024-09-13T18:33:17.307879+0000","last_undegraded":"2024-09-13T18:33:17.307879+0000","last_fullsized":"2024-09-13T18:33:17.307879+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:54.491339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.307943+0000","last_change":"2024-09-13T18:33:16.334646+0000","last_active":"2024-09-13T18:33:17.307943+0000","last_peered":"2024-09-13T18:33:17.307943+0000","last_clean":"2024-09-13T18:33:17.307943+0000","last_became_active":"2024-09-13T18:33:16.334303+0000","last_became_peered":"2024-09-13T18:33:16.334303+0000","last_unstale":"2024-09-13T18:33:17.307943+0000","last_undegraded":"2024-09-13T18:33:17.307943+0000","last_fullsized":"2024-09-13T18:33:17.307943+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:34.794821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.510510+0000","last_change":"2024-09-13T18:33:15.932023+0000","last_active":"2024-09-13T18:33:18.510510+0000","last_peered":"2024-09-13T18:33:18.510510+0000","last_clean":"2024-09-13T18:33:18.510510+0000","last_became_active":"2024-09-13T18:33:15.931733+0000","last_became_peered":"2024-09-13T18:33:15.931733+0000","last_unstale":"2024-09-13T18:33:18.510510+0000","last_undegraded":"2024-09-13T18:33:18.510510+0000","last_fullsized":"2024-09-13T18:33:18.510510+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:06.627194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.306811+0000","last_change":"2024-09-13T18:33:16.318594+0000","last_active":"2024-09-13T18:33:17.306811+0000","last_peered":"2024-09-13T18:33:17.306811+0000","last_clean":"2024-09-13T18:33:17.306811+0000","last_became_active":"2024-09-13T18:33:16.318317+0000","last_became_peered":"2024-09-13T18:33:16.318317+0000","last_unstale":"2024-09-13T18:33:17.306811+0000","last_undegraded":"2024-09-13T18:33:17.306811+0000","last_fullsized":"2024-09-13T18:33:17.306811+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.152143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"62'3","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.307698+0000","last_change":"2024-09-13T18:33:15.936036+0000","last_active":"2024-09-13T18:33:17.307698+0000","last_peered":"2024-09-13T18:33:17.307698+0000","last_clean":"2024-09-13T18:33:17.307698+0000","last_became_active":"2024-09-13T18:33:15.935730+0000","last_became_peered":"2024-09-13T18:33:15.935730+0000","last_unstale":"2024-09-13T18:33:17.307698+0000","last_undegraded":"2024-09-13T18:33:17.307698+0000","last_fullsized":"2024-09-13T18:33:17.307698+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:40.192621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.307546+0000","last_change":"2024-09-13T18:33:16.331750+0000","last_active":"2024-09-13T18:33:17.307546+0000","last_peered":"2024-09-13T18:33:17.307546+0000","last_clean":"2024-09-13T18:33:17.307546+0000","last_became_active":"2024-09-13T18:33:16.330178+0000","last_became_peered":"2024-09-13T18:33:16.330178+0000","last_unstale":"2024-09-13T18:33:17.307546+0000","last_undegraded":"2024-09-13T18:33:17.307546+0000","last_fullsized":"2024-09-13T18:33:17.307546+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:43.915387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"62'6","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.508899+0000","last_change":"2024-09-13T18:33:15.927548+0000","last_active":"2024-09-13T18:33:18.508899+0000","last_peered":"2024-09-13T18:33:18.508899+0000","last_clean":"2024-09-13T18:33:18.508899+0000","last_became_active":"2024-09-13T18:33:15.927287+0000","last_became_peered":"2024-09-13T18:33:15.927287+0000","last_unstale":"2024-09-13T18:33:18.508899+0000","last_undegraded":"2024-09-13T18:33:18.508899+0000","last_fullsized":"2024-09-13T18:33:18.508899+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:34.057705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.443898+0000","last_change":"2024-09-13T18:33:16.317098+0000","last_active":"2024-09-13T18:33:18.443898+0000","last_peered":"2024-09-13T18:33:18.443898+0000","last_clean":"2024-09-13T18:33:18.443898+0000","last_became_active":"2024-09-13T18:33:16.316845+0000","last_became_peered":"2024-09-13T18:33:16.316845+0000","last_unstale":"2024-09-13T18:33:18.443898+0000","last_undegraded":"2024-09-13T18:33:18.443898+0000","last_fullsized":"2024-09-13T18:33:18.443898+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:42.968772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"62'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.509338+0000","last_change":"2024-09-13T18:33:15.933291+0000","last_active":"2024-09-13T18:33:18.509338+0000","last_peered":"2024-09-13T18:33:18.509338+0000","last_clean":"2024-09-13T18:33:18.509338+0000","last_became_active":"2024-09-13T18:33:15.932980+0000","last_became_peered":"2024-09-13T18:33:15.932980+0000","last_unstale":"2024-09-13T18:33:18.509338+0000","last_undegraded":"2024-09-13T18:33:18.509338+0000","last_fullsized":"2024-09-13T18:33:18.509338+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:41.904089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.307237+0000","last_change":"2024-09-13T18:33:16.332015+0000","last_active":"2024-09-13T18:33:17.307237+0000","last_peered":"2024-09-13T18:33:17.307237+0000","last_clean":"2024-09-13T18:33:17.307237+0000","last_became_active":"2024-09-13T18:33:16.331765+0000","last_became_peered":"2024-09-13T18:33:16.331765+0000","last_unstale":"2024-09-13T18:33:17.307237+0000","last_undegraded":"2024-09-13T18:33:17.307237+0000","last_fullsized":"2024-09-13T18:33:17.307237+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:17.822572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.307411+0000","last_change":"2024-09-13T18:33:15.931525+0000","last_active":"2024-09-13T18:33:17.307411+0000","last_peered":"2024-09-13T18:33:17.307411+0000","last_clean":"2024-09-13T18:33:17.307411+0000","last_became_active":"2024-09-13T18:33:15.931240+0000","last_became_peered":"2024-09-13T18:33:15.931240+0000","last_unstale":"2024-09-13T18:33:17.307411+0000","last_undegraded":"2024-09-13T18:33:17.307411+0000","last_fullsized":"2024-09-13T18:33:17.307411+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:10.321005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.507999+0000","last_change":"2024-09-13T18:33:16.335147+0000","last_active":"2024-09-13T18:33:18.507999+0000","last_peered":"2024-09-13T18:33:18.507999+0000","last_clean":"2024-09-13T18:33:18.507999+0000","last_became_active":"2024-09-13T18:33:16.334877+0000","last_became_peered":"2024-09-13T18:33:16.334877+0000","last_unstale":"2024-09-13T18:33:18.507999+0000","last_undegraded":"2024-09-13T18:33:18.507999+0000","last_fullsized":"2024-09-13T18:33:18.507999+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:55.501197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.443879+0000","last_change":"2024-09-13T18:33:15.927318+0000","last_active":"2024-09-13T18:33:18.443879+0000","last_peered":"2024-09-13T18:33:18.443879+0000","last_clean":"2024-09-13T18:33:18.443879+0000","last_became_active":"2024-09-13T18:33:15.926999+0000","last_became_peered":"2024-09-13T18:33:15.926999+0000","last_unstale":"2024-09-13T18:33:18.443879+0000","last_undegraded":"2024-09-13T18:33:18.443879+0000","last_fullsized":"2024-09-13T18:33:18.443879+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:21.134753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.307943+0000","last_change":"2024-09-13T18:33:16.332102+0000","last_active":"2024-09-13T18:33:17.307943+0000","last_peered":"2024-09-13T18:33:17.307943+0000","last_clean":"2024-09-13T18:33:17.307943+0000","last_became_active":"2024-09-13T18:33:16.331773+0000","last_became_peered":"2024-09-13T18:33:16.331773+0000","last_unstale":"2024-09-13T18:33:17.307943+0000","last_undegraded":"2024-09-13T18:33:17.307943+0000","last_fullsized":"2024-09-13T18:33:17.307943+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:13.260831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"62'8","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.307237+0000","last_change":"2024-09-13T18:33:15.936108+0000","last_active":"2024-09-13T18:33:17.307237+0000","last_peered":"2024-09-13T18:33:17.307237+0000","last_clean":"2024-09-13T18:33:17.307237+0000","last_became_active":"2024-09-13T18:33:15.935812+0000","last_became_peered":"2024-09-13T18:33:15.935812+0000","last_unstale":"2024-09-13T18:33:17.307237+0000","last_undegraded":"2024-09-13T18:33:17.307237+0000","last_fullsized":"2024-09-13T18:33:17.307237+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:00.885067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.307763+0000","last_change":"2024-09-13T18:33:16.334158+0000","last_active":"2024-09-13T18:33:17.307763+0000","last_peered":"2024-09-13T18:33:17.307763+0000","last_clean":"2024-09-13T18:33:17.307763+0000","last_became_active":"2024-09-13T18:33:16.333872+0000","last_became_peered":"2024-09-13T18:33:16.333872+0000","last_unstale":"2024-09-13T18:33:17.307763+0000","last_undegraded":"2024-09-13T18:33:17.307763+0000","last_fullsized":"2024-09-13T18:33:17.307763+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:53.711035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"62'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.510310+0000","last_change":"2024-09-13T18:33:15.933588+0000","last_active":"2024-09-13T18:33:18.510310+0000","last_peered":"2024-09-13T18:33:18.510310+0000","last_clean":"2024-09-13T18:33:18.510310+0000","last_became_active":"2024-09-13T18:33:15.933253+0000","last_became_peered":"2024-09-13T18:33:15.933253+0000","last_unstale":"2024-09-13T18:33:18.510310+0000","last_undegraded":"2024-09-13T18:33:18.510310+0000","last_fullsized":"2024-09-13T18:33:18.510310+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:38.945093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.444761+0000","last_change":"2024-09-13T18:33:16.306413+0000","last_active":"2024-09-13T18:33:18.444761+0000","last_peered":"2024-09-13T18:33:18.444761+0000","last_clean":"2024-09-13T18:33:18.444761+0000","last_became_active":"2024-09-13T18:33:16.306125+0000","last_became_peered":"2024-09-13T18:33:16.306125+0000","last_unstale":"2024-09-13T18:33:18.444761+0000","last_undegraded":"2024-09-13T18:33:18.444761+0000","last_fullsized":"2024-09-13T18:33:18.444761+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:28.008779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"62'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.034049+0000","last_change":"2024-09-13T18:33:15.932840+0000","last_active":"2024-09-13T18:33:18.034049+0000","last_peered":"2024-09-13T18:33:18.034049+0000","last_clean":"2024-09-13T18:33:18.034049+0000","last_became_active":"2024-09-13T18:33:15.932580+0000","last_became_peered":"2024-09-13T18:33:15.932580+0000","last_unstale":"2024-09-13T18:33:18.034049+0000","last_undegraded":"2024-09-13T18:33:18.034049+0000","last_fullsized":"2024-09-13T18:33:18.034049+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:45.730659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.510632+0000","last_change":"2024-09-13T18:33:16.315075+0000","last_active":"2024-09-13T18:33:18.510632+0000","last_peered":"2024-09-13T18:33:18.510632+0000","last_clean":"2024-09-13T18:33:18.510632+0000","last_became_active":"2024-09-13T18:33:16.313817+0000","last_became_peered":"2024-09-13T18:33:16.313817+0000","last_unstale":"2024-09-13T18:33:18.510632+0000","last_undegraded":"2024-09-13T18:33:18.510632+0000","last_fullsized":"2024-09-13T18:33:18.510632+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:05.074515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"62'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.444609+0000","last_change":"2024-09-13T18:33:15.931564+0000","last_active":"2024-09-13T18:33:18.444609+0000","last_peered":"2024-09-13T18:33:18.444609+0000","last_clean":"2024-09-13T18:33:18.444609+0000","last_became_active":"2024-09-13T18:33:15.931313+0000","last_became_peered":"2024-09-13T18:33:15.931313+0000","last_unstale":"2024-09-13T18:33:18.444609+0000","last_undegraded":"2024-09-13T18:33:18.444609+0000","last_fullsized":"2024-09-13T18:33:18.444609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:49.897552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.307604+0000","last_change":"2024-09-13T18:33:16.331995+0000","last_active":"2024-09-13T18:33:17.307604+0000","last_peered":"2024-09-13T18:33:17.307604+0000","last_clean":"2024-09-13T18:33:17.307604+0000","last_became_active":"2024-09-13T18:33:16.331483+0000","last_became_peered":"2024-09-13T18:33:16.331483+0000","last_unstale":"2024-09-13T18:33:17.307604+0000","last_undegraded":"2024-09-13T18:33:17.307604+0000","last_fullsized":"2024-09-13T18:33:17.307604+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:08.900561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.033591+0000","last_change":"2024-09-13T18:33:15.931186+0000","last_active":"2024-09-13T18:33:18.033591+0000","last_peered":"2024-09-13T18:33:18.033591+0000","last_clean":"2024-09-13T18:33:18.033591+0000","last_became_active":"2024-09-13T18:33:15.930917+0000","last_became_peered":"2024-09-13T18:33:15.930917+0000","last_unstale":"2024-09-13T18:33:18.033591+0000","last_undegraded":"2024-09-13T18:33:18.033591+0000","last_fullsized":"2024-09-13T18:33:18.033591+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:09.142285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.443862+0000","last_change":"2024-09-13T18:33:16.306058+0000","last_active":"2024-09-13T18:33:18.443862+0000","last_peered":"2024-09-13T18:33:18.443862+0000","last_clean":"2024-09-13T18:33:18.443862+0000","last_became_active":"2024-09-13T18:33:16.305792+0000","last_became_peered":"2024-09-13T18:33:16.305792+0000","last_unstale":"2024-09-13T18:33:18.443862+0000","last_undegraded":"2024-09-13T18:33:18.443862+0000","last_fullsized":"2024-09-13T18:33:18.443862+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:26.104830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"62'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.509834+0000","last_change":"2024-09-13T18:33:15.931182+0000","last_active":"2024-09-13T18:33:18.509834+0000","last_peered":"2024-09-13T18:33:18.509834+0000","last_clean":"2024-09-13T18:33:18.509834+0000","last_became_active":"2024-09-13T18:33:15.930900+0000","last_became_peered":"2024-09-13T18:33:15.930900+0000","last_unstale":"2024-09-13T18:33:18.509834+0000","last_undegraded":"2024-09-13T18:33:18.509834+0000","last_fullsized":"2024-09-13T18:33:18.509834+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:24.414342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.033491+0000","last_change":"2024-09-13T18:33:16.320827+0000","last_active":"2024-09-13T18:33:18.033491+0000","last_peered":"2024-09-13T18:33:18.033491+0000","last_clean":"2024-09-13T18:33:18.033491+0000","last_became_active":"2024-09-13T18:33:16.320586+0000","last_became_peered":"2024-09-13T18:33:16.320586+0000","last_unstale":"2024-09-13T18:33:18.033491+0000","last_undegraded":"2024-09-13T18:33:18.033491+0000","last_fullsized":"2024-09-13T18:33:18.033491+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:42.968772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.306565+0000","last_change":"2024-09-13T18:33:15.932881+0000","last_active":"2024-09-13T18:33:17.306565+0000","last_peered":"2024-09-13T18:33:17.306565+0000","last_clean":"2024-09-13T18:33:17.306565+0000","last_became_active":"2024-09-13T18:33:15.932632+0000","last_became_peered":"2024-09-13T18:33:15.932632+0000","last_unstale":"2024-09-13T18:33:17.306565+0000","last_undegraded":"2024-09-13T18:33:17.306565+0000","last_fullsized":"2024-09-13T18:33:17.306565+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:40.585002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.032920+0000","last_change":"2024-09-13T18:33:16.328099+0000","last_active":"2024-09-13T18:33:18.032920+0000","last_peered":"2024-09-13T18:33:18.032920+0000","last_clean":"2024-09-13T18:33:18.032920+0000","last_became_active":"2024-09-13T18:33:16.327865+0000","last_became_peered":"2024-09-13T18:33:16.327865+0000","last_unstale":"2024-09-13T18:33:18.032920+0000","last_undegraded":"2024-09-13T18:33:18.032920+0000","last_fullsized":"2024-09-13T18:33:18.032920+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:39.954951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.443699+0000","last_change":"2024-09-13T18:33:15.925947+0000","last_active":"2024-09-13T18:33:18.443699+0000","last_peered":"2024-09-13T18:33:18.443699+0000","last_clean":"2024-09-13T18:33:18.443699+0000","last_became_active":"2024-09-13T18:33:15.925558+0000","last_became_peered":"2024-09-13T18:33:15.925558+0000","last_unstale":"2024-09-13T18:33:18.443699+0000","last_undegraded":"2024-09-13T18:33:18.443699+0000","last_fullsized":"2024-09-13T18:33:18.443699+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:36.416736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.444532+0000","last_change":"2024-09-13T18:33:16.312395+0000","last_active":"2024-09-13T18:33:18.444532+0000","last_peered":"2024-09-13T18:33:18.444532+0000","last_clean":"2024-09-13T18:33:18.444532+0000","last_became_active":"2024-09-13T18:33:16.312055+0000","last_became_peered":"2024-09-13T18:33:16.312055+0000","last_unstale":"2024-09-13T18:33:18.444532+0000","last_undegraded":"2024-09-13T18:33:18.444532+0000","last_fullsized":"2024-09-13T18:33:18.444532+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:07.637052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"62'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.307563+0000","last_change":"2024-09-13T18:33:15.924008+0000","last_active":"2024-09-13T18:33:17.307563+0000","last_peered":"2024-09-13T18:33:17.307563+0000","last_clean":"2024-09-13T18:33:17.307563+0000","last_became_active":"2024-09-13T18:33:15.923723+0000","last_became_peered":"2024-09-13T18:33:15.923723+0000","last_unstale":"2024-09-13T18:33:17.307563+0000","last_undegraded":"2024-09-13T18:33:17.307563+0000","last_fullsized":"2024-09-13T18:33:17.307563+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:11.369589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.444845+0000","last_change":"2024-09-13T18:33:16.328744+0000","last_active":"2024-09-13T18:33:18.444845+0000","last_peered":"2024-09-13T18:33:18.444845+0000","last_clean":"2024-09-13T18:33:18.444845+0000","last_became_active":"2024-09-13T18:33:16.328415+0000","last_became_peered":"2024-09-13T18:33:16.328415+0000","last_unstale":"2024-09-13T18:33:18.444845+0000","last_undegraded":"2024-09-13T18:33:18.444845+0000","last_fullsized":"2024-09-13T18:33:18.444845+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:53.711035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.034145+0000","last_change":"2024-09-13T18:33:15.928891+0000","last_active":"2024-09-13T18:33:18.034145+0000","last_peered":"2024-09-13T18:33:18.034145+0000","last_clean":"2024-09-13T18:33:18.034145+0000","last_became_active":"2024-09-13T18:33:15.928630+0000","last_became_peered":"2024-09-13T18:33:15.928630+0000","last_unstale":"2024-09-13T18:33:18.034145+0000","last_undegraded":"2024-09-13T18:33:18.034145+0000","last_fullsized":"2024-09-13T18:33:18.034145+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:49.897552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.306955+0000","last_change":"2024-09-13T18:33:16.317904+0000","last_active":"2024-09-13T18:33:17.306955+0000","last_peered":"2024-09-13T18:33:17.306955+0000","last_clean":"2024-09-13T18:33:17.306955+0000","last_became_active":"2024-09-13T18:33:16.317611+0000","last_became_peered":"2024-09-13T18:33:16.317611+0000","last_unstale":"2024-09-13T18:33:17.306955+0000","last_undegraded":"2024-09-13T18:33:17.306955+0000","last_fullsized":"2024-09-13T18:33:17.306955+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:40.194026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.307613+0000","last_change":"2024-09-13T18:33:15.929072+0000","last_active":"2024-09-13T18:33:17.307613+0000","last_peered":"2024-09-13T18:33:17.307613+0000","last_clean":"2024-09-13T18:33:17.307613+0000","last_became_active":"2024-09-13T18:33:15.928766+0000","last_became_peered":"2024-09-13T18:33:15.928766+0000","last_unstale":"2024-09-13T18:33:17.307613+0000","last_undegraded":"2024-09-13T18:33:17.307613+0000","last_fullsized":"2024-09-13T18:33:17.307613+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:34.057705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.033740+0000","last_change":"2024-09-13T18:33:16.311575+0000","last_active":"2024-09-13T18:33:18.033740+0000","last_peered":"2024-09-13T18:33:18.033740+0000","last_clean":"2024-09-13T18:33:18.033740+0000","last_became_active":"2024-09-13T18:33:16.311218+0000","last_became_peered":"2024-09-13T18:33:16.311218+0000","last_unstale":"2024-09-13T18:33:18.033740+0000","last_undegraded":"2024-09-13T18:33:18.033740+0000","last_fullsized":"2024-09-13T18:33:18.033740+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:17.822572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.444436+0000","last_change":"2024-09-13T18:33:15.925144+0000","last_active":"2024-09-13T18:33:18.444436+0000","last_peered":"2024-09-13T18:33:18.444436+0000","last_clean":"2024-09-13T18:33:18.444436+0000","last_became_active":"2024-09-13T18:33:15.924700+0000","last_became_peered":"2024-09-13T18:33:15.924700+0000","last_unstale":"2024-09-13T18:33:18.444436+0000","last_undegraded":"2024-09-13T18:33:18.444436+0000","last_fullsized":"2024-09-13T18:33:18.444436+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:09.142285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.510562+0000","last_change":"2024-09-13T18:33:16.315822+0000","last_active":"2024-09-13T18:33:18.510562+0000","last_peered":"2024-09-13T18:33:18.510562+0000","last_clean":"2024-09-13T18:33:18.510562+0000","last_became_active":"2024-09-13T18:33:16.315526+0000","last_became_peered":"2024-09-13T18:33:16.315526+0000","last_unstale":"2024-09-13T18:33:18.510562+0000","last_undegraded":"2024-09-13T18:33:18.510562+0000","last_fullsized":"2024-09-13T18:33:18.510562+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:34.463890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.306667+0000","last_change":"2024-09-13T18:33:15.925668+0000","last_active":"2024-09-13T18:33:17.306667+0000","last_peered":"2024-09-13T18:33:17.306667+0000","last_clean":"2024-09-13T18:33:17.306667+0000","last_became_active":"2024-09-13T18:33:15.925383+0000","last_became_peered":"2024-09-13T18:33:15.925383+0000","last_unstale":"2024-09-13T18:33:17.306667+0000","last_undegraded":"2024-09-13T18:33:17.306667+0000","last_fullsized":"2024-09-13T18:33:17.306667+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:39.551047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.307284+0000","last_change":"2024-09-13T18:33:16.334186+0000","last_active":"2024-09-13T18:33:17.307284+0000","last_peered":"2024-09-13T18:33:17.307284+0000","last_clean":"2024-09-13T18:33:17.307284+0000","last_became_active":"2024-09-13T18:33:16.333896+0000","last_became_peered":"2024-09-13T18:33:16.333896+0000","last_unstale":"2024-09-13T18:33:17.307284+0000","last_undegraded":"2024-09-13T18:33:17.307284+0000","last_fullsized":"2024-09-13T18:33:17.307284+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:05.642733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.508477+0000","last_change":"2024-09-13T18:33:15.928027+0000","last_active":"2024-09-13T18:33:18.508477+0000","last_peered":"2024-09-13T18:33:18.508477+0000","last_clean":"2024-09-13T18:33:18.508477+0000","last_became_active":"2024-09-13T18:33:15.927790+0000","last_became_peered":"2024-09-13T18:33:15.927790+0000","last_unstale":"2024-09-13T18:33:18.508477+0000","last_undegraded":"2024-09-13T18:33:18.508477+0000","last_fullsized":"2024-09-13T18:33:18.508477+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:36.416736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.306260+0000","last_change":"2024-09-13T18:33:16.320759+0000","last_active":"2024-09-13T18:33:17.306260+0000","last_peered":"2024-09-13T18:33:17.306260+0000","last_clean":"2024-09-13T18:33:17.306260+0000","last_became_active":"2024-09-13T18:33:16.320521+0000","last_became_peered":"2024-09-13T18:33:16.320521+0000","last_unstale":"2024-09-13T18:33:17.306260+0000","last_undegraded":"2024-09-13T18:33:17.306260+0000","last_fullsized":"2024-09-13T18:33:17.306260+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:37.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.306510+0000","last_change":"2024-09-13T18:33:15.927878+0000","last_active":"2024-09-13T18:33:17.306510+0000","last_peered":"2024-09-13T18:33:17.306510+0000","last_clean":"2024-09-13T18:33:17.306510+0000","last_became_active":"2024-09-13T18:33:15.927642+0000","last_became_peered":"2024-09-13T18:33:15.927642+0000","last_unstale":"2024-09-13T18:33:17.306510+0000","last_undegraded":"2024-09-13T18:33:17.306510+0000","last_fullsized":"2024-09-13T18:33:17.306510+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:16.786715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.509925+0000","last_change":"2024-09-13T18:33:16.320537+0000","last_active":"2024-09-13T18:33:18.509925+0000","last_peered":"2024-09-13T18:33:18.509925+0000","last_clean":"2024-09-13T18:33:18.509925+0000","last_became_active":"2024-09-13T18:33:16.320288+0000","last_became_peered":"2024-09-13T18:33:16.320288+0000","last_unstale":"2024-09-13T18:33:18.509925+0000","last_undegraded":"2024-09-13T18:33:18.509925+0000","last_fullsized":"2024-09-13T18:33:18.509925+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:04.305727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.510863+0000","last_change":"2024-09-13T18:33:15.927836+0000","last_active":"2024-09-13T18:33:18.510863+0000","last_peered":"2024-09-13T18:33:18.510863+0000","last_clean":"2024-09-13T18:33:18.510863+0000","last_became_active":"2024-09-13T18:33:15.926044+0000","last_became_peered":"2024-09-13T18:33:15.926044+0000","last_unstale":"2024-09-13T18:33:18.510863+0000","last_undegraded":"2024-09-13T18:33:18.510863+0000","last_fullsized":"2024-09-13T18:33:18.510863+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:16.812714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:18.509542+0000","last_change":"2024-09-13T18:33:16.317061+0000","last_active":"2024-09-13T18:33:18.509542+0000","last_peered":"2024-09-13T18:33:18.509542+0000","last_clean":"2024-09-13T18:33:18.509542+0000","last_became_active":"2024-09-13T18:33:16.316794+0000","last_became_peered":"2024-09-13T18:33:16.316794+0000","last_unstale":"2024-09-13T18:33:18.509542+0000","last_undegraded":"2024-09-13T18:33:18.509542+0000","last_fullsized":"2024-09-13T18:33:18.509542+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:15.892604+0000","last_clean_scrub_stamp":"2024-09-13T18:33:15.892604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:58.526237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.307242+0000","last_change":"2024-09-13T18:33:15.928605+0000","last_active":"2024-09-13T18:33:17.307242+0000","last_peered":"2024-09-13T18:33:17.307242+0000","last_clean":"2024-09-13T18:33:17.307242+0000","last_became_active":"2024-09-13T18:33:15.928305+0000","last_became_peered":"2024-09-13T18:33:15.928305+0000","last_unstale":"2024-09-13T18:33:17.307242+0000","last_undegraded":"2024-09-13T18:33:17.307242+0000","last_fullsized":"2024-09-13T18:33:17.307242+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:14.882746+0000","last_clean_scrub_stamp":"2024-09-13T18:33:14.882746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:37.007022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":202,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-13T18:33:16.322713+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:33:16.322713+0000","last_peered":"2024-09-13T18:33:16.322713+0000","last_clean":"2024-09-13T18:33:16.322713+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:33:16.322713+0000","last_undegraded":"2024-09-13T18:33:16.322713+0000","last_fullsized":"2024-09-13T18:33:16.322713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574929,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1359872,"data_stored":909838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.75900000000000001,"15min":0.755},"min":{"1min":0.44800000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0760000000000001,"5min":1.1240000000000001,"15min":1.163},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.75600000000000001,"15min":0.79600000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.137,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.198}]},{"osd":1,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.79200000000000004,"15min":0.874},"min":{"1min":0.51900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.181,"5min":1.3120000000000001,"15min":1.7689999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.872,"15min":0.93999999999999995},"min":{"1min":0.56200000000000006,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.6140000000000001},"last":1.2669999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.81999999999999995,"15min":0.84699999999999998},"min":{"1min":0.56699999999999995,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2270000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80900000000000005,"15min":0.89300000000000002},"min":{"1min":0.51000000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.524,"5min":1.524,"15min":1.6659999999999999},"last":0.71699999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.85099999999999998,"15min":0.88500000000000001},"min":{"1min":0.59999999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.88500000000000001,"15min":0.871},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.085,"5min":1.419,"15min":1.419},"last":1.008}]},{"osd":4,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.86099999999999999,"15min":0.89500000000000002},"min":{"1min":0.56399999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.7290000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0109999999999999,"15min":1.042},"min":{"1min":0.76700000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.49,"5min":1.49,"15min":1.7050000000000001},"last":1.1060000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.95599999999999996,"15min":0.95399999999999996},"min":{"1min":0.78100000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4259999999999999},"last":0.876},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0389999999999999,"15min":1.0529999999999999},"min":{"1min":0.67500000000000004,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.24}]},{"osd":6,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.028,"15min":1.0940000000000001},"min":{"1min":0.746,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":2.077},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.079,"15min":1.0700000000000001},"min":{"1min":0.85999999999999999,"5min":0.72199999999999998,"15min":0.69099999999999995},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.1779999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574931,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":757760,"data_stored":319310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77900000000000003,"15min":0.82199999999999995},"min":{"1min":0.441,"5min":0.438,"15min":0.438},"max":{"1min":1.1279999999999999,"5min":1.216,"15min":1.2270000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.76500000000000001,"15min":0.82199999999999995},"min":{"1min":0.51000000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.103,"5min":1.361,"15min":1.361},"last":0.58599999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.76900000000000002,"15min":0.80800000000000005},"min":{"1min":0.47999999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98499999999999999,"5min":1.238,"15min":1.238},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.82099999999999995,"15min":0.81899999999999995},"min":{"1min":0.48299999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1200000000000001,"5min":1.214,"15min":1.214},"last":0.503}]},{"osd":2,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.80200000000000005,"15min":0.80600000000000005},"min":{"1min":0.52200000000000002,"5min":0.47399999999999998,"15min":0.46899999999999997},"max":{"1min":0.98499999999999999,"5min":1.2010000000000001,"15min":1.254},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.82499999999999996,"15min":0.85599999999999998},"min":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1399999999999999,"5min":1.248,"15min":1.248},"last":0.96299999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89100000000000001,"15min":0.86699999999999999},"min":{"1min":0.57599999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1930000000000001,"5min":1.238,"15min":1.238},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.875,"5min":0.89000000000000001,"15min":0.94299999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1870000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.71799999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.84299999999999997,"15min":0.88200000000000001},"min":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0920000000000001,"5min":1.206,"15min":1.248},"last":1.042},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.95399999999999996,"15min":0.99399999999999999},"min":{"1min":0.63800000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.1839999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.0620000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0249999999999999,"15min":1.038},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.258,"5min":1.341,"15min":1.341},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.94899999999999995,"15min":0.97899999999999998},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.165,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.80600000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94099999999999995,"15min":0.995},"min":{"1min":0.77100000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.135,"5min":1.256,"15min":1.3169999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.089,"15min":1.107},"min":{"1min":0.82599999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.367,"5min":1.367,"15min":1.3740000000000001},"last":1.0069999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574929,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":765952,"data_stored":319962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.77200000000000002,"15min":0.83299999999999996},"min":{"1min":0.46899999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.95299999999999996,"5min":1.1279999999999999,"15min":1.3640000000000001},"last":1.3280000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.77400000000000002,"15min":0.85799999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1679999999999999,"5min":1.2190000000000001,"15min":1.482},"last":1.1679999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77600000000000002,"15min":0.79100000000000004},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.099},{"interface":"front","average":{"1min":0.873,"5min":0.83799999999999997,"15min":0.92800000000000005},"min":{"1min":0.50900000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.179,"5min":1.2390000000000001,"15min":1.4850000000000001},"last":1.137}]},{"osd":2,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91200000000000003,"15min":0.95599999999999996},"min":{"1min":0.58199999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1319999999999999,"5min":1.2110000000000001,"15min":1.4179999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.91800000000000004,"15min":0.996},"min":{"1min":0.51800000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2210000000000001,"5min":1.3029999999999999,"15min":1.4690000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.874,"15min":0.94299999999999995},"min":{"1min":0.55800000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.085,"5min":1.222,"15min":1.4510000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.86399999999999999,"15min":0.93999999999999995},"min":{"1min":0.629,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.335,"5min":1.335,"15min":1.4990000000000001},"last":0.98699999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.91400000000000003,"15min":0.97999999999999998},"min":{"1min":0.72799999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2889999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.026},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.95799999999999996,"15min":1.038},"min":{"1min":0.73899999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2470000000000001,"5min":1.3759999999999999,"15min":1.542},"last":1.0589999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.95999999999999996,"15min":1.032},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.248,"5min":1.3360000000000001,"15min":1.698},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.093,"15min":1.161},"min":{"1min":0.76300000000000001,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.367,"5min":1.581,"15min":1.581},"last":1.504}]},{"osd":7,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.0680000000000001,"15min":1.1799999999999999},"min":{"1min":0.81399999999999995,"5min":0.76100000000000001,"15min":0.70699999999999996},"max":{"1min":1.226,"5min":1.5069999999999999,"15min":1.847},"last":1.248},{"interface":"front","average":{"1min":1.054,"5min":1.0589999999999999,"15min":1.1459999999999999},"min":{"1min":0.90600000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.4059999999999999,"5min":1.4259999999999999,"15min":1.8100000000000001},"last":1.204}]}]},{"osd":4,"up_from":13,"seq":55834574929,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":770048,"data_stored":320874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80600000000000005,"15min":0.89800000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.121,"5min":1.206,"15min":1.3720000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.86299999999999999,"15min":0.95799999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1879999999999999,"5min":1.3280000000000001,"15min":1.5229999999999999},"last":0.998}]},{"osd":1,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.75800000000000001,"15min":0.79400000000000004},"min":{"1min":0.47099999999999997,"5min":0.435,"15min":0.435},"max":{"1min":0.98099999999999998,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.80200000000000005,"15min":0.84799999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.64300000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.78800000000000003,"15min":0.85599999999999998},"min":{"1min":0.48699999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0229999999999999,"5min":1.171,"15min":1.171},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84199999999999997,"15min":0.84999999999999998},"min":{"1min":0.54300000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.165,"5min":1.331,"15min":1.331},"last":0.74099999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.90100000000000002,"15min":0.97099999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.171,"5min":1.268,"15min":1.639},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.92400000000000004,"15min":0.98099999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0680000000000001,"5min":1.2629999999999999,"15min":1.8300000000000001},"last":0.82299999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91700000000000004,"15min":0.98699999999999999},"min":{"1min":0.60599999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1579999999999999,"5min":1.518,"15min":2.3889999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0369999999999999,"15min":1.111},"min":{"1min":0.80200000000000005,"5min":0.626,"15min":0.626},"max":{"1min":1.2250000000000001,"5min":1.375,"15min":2.0049999999999999},"last":1.0669999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.94399999999999995,"15min":0.91200000000000003},"min":{"1min":0.753,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2989999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0569999999999999,"15min":1.1040000000000001},"min":{"1min":0.81699999999999995,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.2130000000000001,"5min":1.4259999999999999,"15min":1.794},"last":0.94899999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.012,"15min":1.0800000000000001},"min":{"1min":0.66600000000000004,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1779999999999999,"5min":1.643,"15min":1.669},"last":1.181},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.046,"15min":1.03},"min":{"1min":0.75800000000000001,"5min":0.748,"15min":0.61799999999999999},"max":{"1min":1.353,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.036}]}]},{"osd":3,"up_from":13,"seq":55834574932,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":765952,"data_stored":319366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58299999999999996,"15min":0.67100000000000004},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.93999999999999995,"5min":0.94699999999999995,"15min":0.97799999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.60499999999999998,"15min":0.66300000000000003},"min":{"1min":0.34000000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.85599999999999998,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.72599999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60599999999999998,"15min":0.69099999999999995},"min":{"1min":0.317,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67400000000000004,"15min":0.79800000000000004},"min":{"1min":0.42799999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.397,"5min":1.397,"15min":2.0030000000000001},"last":0.56899999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.70899999999999996,"15min":0.76800000000000002},"min":{"1min":0.41399999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.333},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.74299999999999999,"15min":0.86399999999999999},"min":{"1min":0.40100000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0900000000000001,"5min":1.214,"15min":1.2929999999999999},"last":0.501}]},{"osd":4,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.85699999999999998,"15min":0.95199999999999996},"min":{"1min":0.62,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.139,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.92400000000000004,"15min":1.024},"min":{"1min":0.626,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.88200000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.98199999999999998,"15min":1.149},"min":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":2.2320000000000002},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.96199999999999997,"15min":1.097},"min":{"1min":0.745,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.194,"5min":1.3120000000000001,"15min":1.718},"last":0.95599999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":0.99399999999999999,"15min":1.1100000000000001},"min":{"1min":0.72799999999999998,"5min":0.496,"15min":0.496},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0169999999999999,"15min":1.1970000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.48,"5min":1.48,"15min":2.1819999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.006,"15min":1.0900000000000001},"min":{"1min":0.66800000000000004,"5min":0.624,"15min":0.624},"max":{"1min":1.2649999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0309999999999999,"15min":1.1559999999999999},"min":{"1min":0.71799999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.548,"5min":1.548,"15min":1.5920000000000001},"last":0.93400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574930,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":765952,"data_stored":319366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60199999999999998,"15min":0.65600000000000003},"min":{"1min":0.16500000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.86099999999999999,"5min":1.006,"15min":1.1919999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.77900000000000003},"min":{"1min":0.40699999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.92000000000000004,"5min":1.0429999999999999,"15min":1.4370000000000001},"last":0.81599999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61899999999999999,"15min":0.70099999999999996},"min":{"1min":0.28100000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.2629999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.64600000000000002,"15min":0.72199999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.79100000000000004,"5min":1.0549999999999999,"15min":1.206},"last":0.73699999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.64300000000000002,"15min":0.66300000000000003},"min":{"1min":0.317,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.02,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.79000000000000004,"15min":0.84499999999999997},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1180000000000001,"5min":1.2509999999999999,"15min":1.548},"last":0.77100000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.94299999999999995,"15min":0.97599999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1990000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.94299999999999995,"15min":1.0409999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2989999999999999,"5min":1.51,"15min":2.3849999999999998},"last":1.2210000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.91100000000000003,"15min":0.92100000000000004},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1890000000000001,"5min":1.498,"15min":1.498},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.98899999999999999,"15min":1.0469999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2869999999999999,"5min":1.6419999999999999,"15min":1.869},"last":0.97099999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":1.008,"15min":1.0940000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.468,"5min":1.6120000000000001,"15min":2.762},"last":1.167},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.997,"15min":1.0409999999999999},"min":{"1min":0.57999999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4299999999999999,"5min":1.5509999999999999,"15min":1.988},"last":0.86199999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.044,"15min":1.1459999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.59799999999999998},"max":{"1min":1.393,"5min":1.577,"15min":2.6800000000000002},"last":1.2669999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.048,"15min":1.0640000000000001},"min":{"1min":0.67100000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5029999999999999,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.93200000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":761856,"data_stored":319400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61699999999999999,"15min":0.626},"min":{"1min":0.34300000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90000000000000002,"5min":1.107,"15min":1.107},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.65900000000000003,"15min":0.72899999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.05,"5min":1.131,"15min":1.3560000000000001},"last":0.76900000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60099999999999998,"15min":0.625},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.96999999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69099999999999995,"15min":0.74099999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.0469999999999999,"5min":1.228,"15min":1.2669999999999999},"last":0.82099999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76500000000000001,"15min":0.77500000000000002},"min":{"1min":0.44,"5min":0.375,"15min":0.375},"max":{"1min":1.1100000000000001,"5min":1.353,"15min":1.353},"last":0.996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71899999999999997,"15min":0.78200000000000003},"min":{"1min":0.35999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1,"5min":1.2090000000000001,"15min":1.4339999999999999},"last":0.65600000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.90800000000000003,"15min":0.95199999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.163,"5min":1.3640000000000001,"15min":1.524},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.94899999999999995,"15min":0.97099999999999997},"min":{"1min":0.67400000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.127,"5min":1.994,"15min":1.994},"last":0.88800000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.97199999999999998,"15min":0.97099999999999997},"min":{"1min":0.71399999999999997,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2210000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.999,"5min":1.0449999999999999,"15min":1.0740000000000001},"min":{"1min":0.63700000000000001,"5min":0.626,"15min":0.626},"max":{"1min":1.264,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":1.3089999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.997,"15min":1.073},"min":{"1min":0.56599999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.198,"5min":1.6950000000000001,"15min":1.8200000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0469999999999999,"15min":1.085},"min":{"1min":0.64700000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.1870000000000001,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.0329999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0740000000000001,"15min":1.0840000000000001},"min":{"1min":0.72499999999999998,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.3440000000000001,"5min":2.5579999999999998,"15min":2.5579999999999998},"last":1.212},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0429999999999999,"15min":1.1080000000000001},"min":{"1min":0.55200000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.238,"5min":1.6399999999999999,"15min":1.72},"last":1.0649999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574930,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1368064,"data_stored":911824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57799999999999996,"15min":0.59099999999999997},"min":{"1min":0.26500000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.82899999999999996,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.64700000000000002,"15min":0.68400000000000005},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.98399999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":1.083}]},{"osd":2,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.66200000000000003,"15min":0.69199999999999995},"min":{"1min":0.312,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.204,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.68999999999999995,"15min":0.70799999999999996},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.85399999999999998,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.80900000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63300000000000001,"15min":0.627},"min":{"1min":0.33000000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.96799999999999997,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.77600000000000002,"15min":0.81200000000000006},"min":{"1min":0.5,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.0580000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.83999999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.91700000000000004,"15min":0.95899999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.90100000000000002,"15min":0.89900000000000002},"min":{"1min":0.66400000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.198,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.2}]},{"osd":5,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.95699999999999996,"15min":0.96299999999999997},"min":{"1min":0.64600000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.3420000000000001,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.0109999999999999,"15min":1.0409999999999999},"min":{"1min":0.71899999999999997,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.367,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.121}]},{"osd":6,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.052,"15min":1.0800000000000001},"min":{"1min":0.69199999999999995,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4239999999999999,"5min":1.462,"15min":1.462},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.036,"15min":1.1040000000000001},"min":{"1min":0.623,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.3560000000000001,"5min":1.704,"15min":1.704},"last":1.25}]},{"osd":7,"last update":"Fri Sep 13 18:33:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0349999999999999,"15min":1.103},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4690000000000001,"5min":1.633,"15min":1.633},"last":1.167},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0149999999999999,"15min":1.0309999999999999},"min":{"1min":0.67900000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2789999999999999,"5min":1.353,"15min":1.353},"last":1.6279999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:33:20.725 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:33:20.725 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:33:20.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.843+0000 7fab74aae700 1 Processor -- start 2024-09-13T18:33:20.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.843+0000 7fab74aae700 1 -- start start 2024-09-13T18:33:20.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.843+0000 7fab74aae700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fab7006b900 0x7fab700b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.843+0000 7fab74aae700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab700b8430 con 0x7fab7006a520 2024-09-13T18:33:20.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.843+0000 7fab74aae700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab7006bd60 con 0x7fab7015cda0 2024-09-13T18:33:20.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.843+0000 7fab74aae700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab700cf350 con 0x7fab7006b900 2024-09-13T18:33:20.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.847+0000 7fab6effd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fab7006b900 0x7fab700b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.847+0000 7fab6ffff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fab7006a520 0x7fab7006a930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51222/0 (socket says 172.21.15.44:51222) 2024-09-13T18:33:20.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.847+0000 7fab6ffff700 1 -- 172.21.15.44:0/2504204235 learned_addr learned my addr 172.21.15.44:0/2504204235 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:20.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.847+0000 7fab6effd700 1 -- 172.21.15.44:0/2504204235 >> v1:172.21.15.99:6789/0 conn(0x7fab7015cda0 legacy=0x7fab700ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.847+0000 7fab6effd700 1 -- 172.21.15.44:0/2504204235 >> v1:172.21.15.44:6789/0 conn(0x7fab7006a520 legacy=0x7fab7006a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.847+0000 7fab6e7fc700 1 -- 172.21.15.44:0/2504204235 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684247605 0 0) 0x7fab700b8430 con 0x7fab7006a520 2024-09-13T18:33:20.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.847+0000 7fab6effd700 1 -- 172.21.15.44:0/2504204235 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab700d0880 con 0x7fab7006b900 2024-09-13T18:33:20.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.847+0000 7fab6effd700 1 --2- 172.21.15.44:0/2504204235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab7006b900 0x7fab700b5de0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fab60009d90 tx=0x7fab6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c187dcbdf73e1e47 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:20.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.847+0000 7fab6e7fc700 1 -- 172.21.15.44:0/2504204235 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6000e070 con 0x7fab7006b900 2024-09-13T18:33:20.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.847+0000 7fab6e7fc700 1 -- 172.21.15.44:0/2504204235 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6000bbd0 con 0x7fab7006b900 2024-09-13T18:33:20.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.847+0000 7fab6e7fc700 1 -- 172.21.15.44:0/2504204235 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab60012430 con 0x7fab7006b900 2024-09-13T18:33:20.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.847+0000 7fab74aae700 1 -- 172.21.15.44:0/2504204235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab7006b900 msgr2=0x7fab700b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.847+0000 7fab74aae700 1 --2- 172.21.15.44:0/2504204235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab7006b900 0x7fab700b5de0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fab60009d90 tx=0x7fab6000b330 comp rx=0 tx=0).stop 2024-09-13T18:33:20.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.847+0000 7fab74aae700 1 -- 172.21.15.44:0/2504204235 shutdown_connections 2024-09-13T18:33:20.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.847+0000 7fab74aae700 1 --2- 172.21.15.44:0/2504204235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab7006b900 0x7fab700b5de0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.847+0000 7fab74aae700 1 -- 172.21.15.44:0/2504204235 >> 172.21.15.44:0/2504204235 conn(0x7fab700d2cb0 msgr2=0x7fab700d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:20.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.847+0000 7fab74aae700 1 -- 172.21.15.44:0/2504204235 shutdown_connections 2024-09-13T18:33:20.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.847+0000 7fab74aae700 1 -- 172.21.15.44:0/2504204235 wait complete. 2024-09-13T18:33:20.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.851+0000 7fab74aae700 1 Processor -- start 2024-09-13T18:33:20.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.851+0000 7fab74aae700 1 -- start start 2024-09-13T18:33:20.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.851+0000 7fab74aae700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab7006a520 0x7fab70146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.851+0000 7fab74aae700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab7006b900 0x7fab701f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.851+0000 7fab74aae700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab7015cda0 0x7fab700c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.851+0000 7fab74aae700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab701522f0 con 0x7fab7006a520 2024-09-13T18:33:20.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.851+0000 7fab74aae700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab70154740 con 0x7fab7015cda0 2024-09-13T18:33:20.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.851+0000 7fab74aae700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab70154a20 con 0x7fab7006b900 2024-09-13T18:33:20.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.851+0000 7fab6f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab7006a520 0x7fab70146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.855+0000 7fab6f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab7006a520 0x7fab70146f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42732/0 (socket says 172.21.15.44:42732) 2024-09-13T18:33:20.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.855+0000 7fab6f7fe700 1 -- 172.21.15.44:0/1208014831 learned_addr learned my addr 172.21.15.44:0/1208014831 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:20.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.855+0000 7fab6effd700 1 --2- 172.21.15.44:0/1208014831 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab7006b900 0x7fab701f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.855+0000 7fab6ffff700 1 --2- 172.21.15.44:0/1208014831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab7015cda0 0x7fab700c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.855+0000 7fab6f7fe700 1 -- 172.21.15.44:0/1208014831 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab7006b900 msgr2=0x7fab701f26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.855+0000 7fab6f7fe700 1 --2- 172.21.15.44:0/1208014831 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab7006b900 0x7fab701f26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.855+0000 7fab6f7fe700 1 -- 172.21.15.44:0/1208014831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab7015cda0 msgr2=0x7fab700c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.855+0000 7fab6f7fe700 1 --2- 172.21.15.44:0/1208014831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab7015cda0 0x7fab700c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.855+0000 7fab6f7fe700 1 -- 172.21.15.44:0/1208014831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab60009a70 con 0x7fab7006a520 2024-09-13T18:33:20.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.855+0000 7fab6f7fe700 1 --2- 172.21.15.44:0/1208014831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab7006a520 0x7fab70146f70 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fab6400c500 tx=0x7fab6400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:20.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.855+0000 7fab57fff700 1 -- 172.21.15.44:0/1208014831 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab640052d0 con 0x7fab7006a520 2024-09-13T18:33:20.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.855+0000 7fab57fff700 1 -- 172.21.15.44:0/1208014831 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab64005430 con 0x7fab7006a520 2024-09-13T18:33:20.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.855+0000 7fab74aae700 1 -- 172.21.15.44:0/1208014831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab70152540 con 0x7fab7006a520 2024-09-13T18:33:20.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.855+0000 7fab57fff700 1 -- 172.21.15.44:0/1208014831 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab640055a0 con 0x7fab7006a520 2024-09-13T18:33:20.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.855+0000 7fab74aae700 1 -- 172.21.15.44:0/1208014831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab701474b0 con 0x7fab7006a520 2024-09-13T18:33:20.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.855+0000 7fab74aae700 1 -- 172.21.15.44:0/1208014831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab70152a60 con 0x7fab7006a520 2024-09-13T18:33:20.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.855+0000 7fab57fff700 1 -- 172.21.15.44:0/1208014831 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fab640038e0 con 0x7fab7006a520 2024-09-13T18:33:20.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.855+0000 7fab57fff700 1 --2- 172.21.15.44:0/1208014831 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fab5c066730 0x7fab5c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.855+0000 7fab57fff700 1 -- 172.21.15.44:0/1208014831 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab64083410 con 0x7fab7006a520 2024-09-13T18:33:20.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.859+0000 7fab6effd700 1 --2- 172.21.15.44:0/1208014831 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fab5c066730 0x7fab5c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.859+0000 7fab6effd700 1 --2- 172.21.15.44:0/1208014831 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fab5c066730 0x7fab5c068bf0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fab60014040 tx=0x7fab6001e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:20.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:20.867+0000 7fab57fff700 1 -- 172.21.15.44:0/1208014831 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fab64050810 con 0x7fab7006a520 2024-09-13T18:33:21.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.095+0000 7fab74aae700 1 -- 172.21.15.44:0/1208014831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fab700b5de0 con 0x7fab7006a520 2024-09-13T18:33:21.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.103+0000 7fab57fff700 1 -- 172.21.15.44:0/1208014831 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fab64053e30 con 0x7fab7006a520 2024-09-13T18:33:21.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.107+0000 7fab74aae700 1 -- 172.21.15.44:0/1208014831 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fab5c066730 msgr2=0x7fab5c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.107+0000 7fab74aae700 1 --2- 172.21.15.44:0/1208014831 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fab5c066730 0x7fab5c068bf0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fab60014040 tx=0x7fab6001e040 comp rx=0 tx=0).stop 2024-09-13T18:33:21.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.107+0000 7fab74aae700 1 -- 172.21.15.44:0/1208014831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab7006a520 msgr2=0x7fab70146f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.107+0000 7fab74aae700 1 --2- 172.21.15.44:0/1208014831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab7006a520 0x7fab70146f70 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fab6400c500 tx=0x7fab6400c810 comp rx=0 tx=0).stop 2024-09-13T18:33:21.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.107+0000 7fab74aae700 1 -- 172.21.15.44:0/1208014831 shutdown_connections 2024-09-13T18:33:21.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.107+0000 7fab74aae700 1 --2- 172.21.15.44:0/1208014831 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fab5c066730 0x7fab5c068bf0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.107+0000 7fab74aae700 1 --2- 172.21.15.44:0/1208014831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab7015cda0 0x7fab700c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.107+0000 7fab74aae700 1 --2- 172.21.15.44:0/1208014831 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab7006b900 0x7fab701f26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.107+0000 7fab74aae700 1 --2- 172.21.15.44:0/1208014831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab7006a520 0x7fab70146f70 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.107+0000 7fab74aae700 1 -- 172.21.15.44:0/1208014831 >> 172.21.15.44:0/1208014831 conn(0x7fab700d2cb0 msgr2=0x7fab700d1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:21.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.107+0000 7fab74aae700 1 -- 172.21.15.44:0/1208014831 shutdown_connections 2024-09-13T18:33:21.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.107+0000 7fab74aae700 1 -- 172.21.15.44:0/1208014831 wait complete. 2024-09-13T18:33:21.117 INFO:teuthology.orchestra.run.smithi044.stderr:updated caps for client.0 2024-09-13T18:33:21.131 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:33:21.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb641b700 1 Processor -- start 2024-09-13T18:33:21.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb641b700 1 -- start start 2024-09-13T18:33:21.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb641b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0cb00b3ae0 0x7f0cb0165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb641b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0cb0161290 0x7f0cb0161700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb641b700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb0071f30 con 0x7f0cb0160eb0 2024-09-13T18:33:21.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb641b700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb01622e0 con 0x7f0cb00b3ae0 2024-09-13T18:33:21.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb641b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb0162000 con 0x7f0cb0161290 2024-09-13T18:33:21.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb4c18700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0cb00b3ae0 0x7f0cb0165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb4c18700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0cb00b3ae0 0x7f0cb0165590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42742/0 (socket says 172.21.15.44:42742) 2024-09-13T18:33:21.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb4c18700 1 -- 172.21.15.44:0/3861458653 learned_addr learned my addr 172.21.15.44:0/3861458653 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:21.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb5c1a700 1 --2- 172.21.15.44:0/3861458653 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0cb0161290 0x7f0cb0161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb4c18700 1 -- 172.21.15.44:0/3861458653 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0cb0161290 msgr2=0x7f0cb0161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:21.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb4c18700 1 --2- 172.21.15.44:0/3861458653 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0cb0161290 0x7f0cb0161700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb4c18700 1 -- 172.21.15.44:0/3861458653 >> v1:172.21.15.99:6789/0 conn(0x7f0cb0160eb0 legacy=0x7f0cb00b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb4c18700 1 -- 172.21.15.44:0/3861458653 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb0164ab0 con 0x7f0cb00b3ae0 2024-09-13T18:33:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb4c18700 1 --2- 172.21.15.44:0/3861458653 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cb00b3ae0 0x7f0cb0165590 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4009910 tx=0x7f0ca4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65bac6cafbb90846 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0ca3fff700 1 -- 172.21.15.44:0/3861458653 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca4011830 con 0x7f0cb00b3ae0 2024-09-13T18:33:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0ca3fff700 1 -- 172.21.15.44:0/3861458653 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca4011990 con 0x7f0cb00b3ae0 2024-09-13T18:33:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0ca3fff700 1 -- 172.21.15.44:0/3861458653 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca4011d40 con 0x7f0cb00b3ae0 2024-09-13T18:33:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb641b700 1 -- 172.21.15.44:0/3861458653 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cb00b3ae0 msgr2=0x7f0cb0165590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb641b700 1 --2- 172.21.15.44:0/3861458653 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cb00b3ae0 0x7f0cb0165590 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4009910 tx=0x7f0ca4009c20 comp rx=0 tx=0).stop 2024-09-13T18:33:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb641b700 1 -- 172.21.15.44:0/3861458653 shutdown_connections 2024-09-13T18:33:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb641b700 1 --2- 172.21.15.44:0/3861458653 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0cb0161290 0x7f0cb0161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb641b700 1 --2- 172.21.15.44:0/3861458653 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cb00b3ae0 0x7f0cb0165590 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb641b700 1 -- 172.21.15.44:0/3861458653 >> 172.21.15.44:0/3861458653 conn(0x7f0cb00b0f00 msgr2=0x7f0cb00b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb641b700 1 -- 172.21.15.44:0/3861458653 shutdown_connections 2024-09-13T18:33:21.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.239+0000 7f0cb641b700 1 -- 172.21.15.44:0/3861458653 wait complete. 2024-09-13T18:33:21.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0cb641b700 1 Processor -- start 2024-09-13T18:33:21.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0cb641b700 1 -- start start 2024-09-13T18:33:21.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0cb641b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cb0160eb0 0x7f0cb01434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0cb641b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0cb0161290 0x7f0cb006c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0cb641b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cb015ad70 0x7f0cb015c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0cb641b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb015c010 con 0x7f0cb015ad70 2024-09-13T18:33:21.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0cb641b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb006cd50 con 0x7f0cb0160eb0 2024-09-13T18:33:21.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0cb641b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb006d030 con 0x7f0cb0161290 2024-09-13T18:33:21.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0cb5c1a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cb015ad70 0x7f0cb015c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0cb5419700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cb0160eb0 0x7f0cb01434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0cb5c1a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cb015ad70 0x7f0cb015c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42752/0 (socket says 172.21.15.44:42752) 2024-09-13T18:33:21.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0cb4c18700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0cb0161290 0x7f0cb006c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0cb5c1a700 1 -- 172.21.15.44:0/3431724906 learned_addr learned my addr 172.21.15.44:0/3431724906 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:21.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0cb5c1a700 1 -- 172.21.15.44:0/3431724906 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0cb0161290 msgr2=0x7f0cb006c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0cb5c1a700 1 --2- 172.21.15.44:0/3431724906 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0cb0161290 0x7f0cb006c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0cb5c1a700 1 -- 172.21.15.44:0/3431724906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cb0160eb0 msgr2=0x7f0cb01434e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0cb5c1a700 1 --2- 172.21.15.44:0/3431724906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cb0160eb0 0x7f0cb01434e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0cb5c1a700 1 -- 172.21.15.44:0/3431724906 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca4009570 con 0x7f0cb015ad70 2024-09-13T18:33:21.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0cb5c1a700 1 --2- 172.21.15.44:0/3431724906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cb015ad70 0x7f0cb015c170 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f0cac00e7f0 tx=0x7f0cac00eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:21.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0ca1ffb700 1 -- 172.21.15.44:0/3431724906 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac0095c0 con 0x7f0cb015ad70 2024-09-13T18:33:21.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0ca1ffb700 1 -- 172.21.15.44:0/3431724906 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cac013680 con 0x7f0cb015ad70 2024-09-13T18:33:21.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0ca1ffb700 1 -- 172.21.15.44:0/3431724906 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac013a10 con 0x7f0cb015ad70 2024-09-13T18:33:21.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0cb641b700 1 -- 172.21.15.44:0/3431724906 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb006d310 con 0x7f0cb015ad70 2024-09-13T18:33:21.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.243+0000 7f0cb641b700 1 -- 172.21.15.44:0/3431724906 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb0143a20 con 0x7f0cb015ad70 2024-09-13T18:33:21.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.247+0000 7f0ca1ffb700 1 -- 172.21.15.44:0/3431724906 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0cac013b90 con 0x7f0cb015ad70 2024-09-13T18:33:21.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.247+0000 7f0cb641b700 1 -- 172.21.15.44:0/3431724906 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb0164490 con 0x7f0cb015ad70 2024-09-13T18:33:21.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.247+0000 7f0ca1ffb700 1 --2- 172.21.15.44:0/3431724906 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0c94066730 0x7f0c94068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.247+0000 7f0cb5419700 1 --2- 172.21.15.44:0/3431724906 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0c94066730 0x7f0c94068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.247+0000 7f0ca1ffb700 1 -- 172.21.15.44:0/3431724906 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cac084070 con 0x7f0cb015ad70 2024-09-13T18:33:21.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.247+0000 7f0cb5419700 1 --2- 172.21.15.44:0/3431724906 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0c94066730 0x7f0c94068bf0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80012e0 tx=0x7f0ca8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:21.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.251+0000 7f0ca1ffb700 1 -- 172.21.15.44:0/3431724906 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0cac0b5db0 con 0x7f0cb015ad70 2024-09-13T18:33:21.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.463+0000 7f0cb641b700 1 -- 172.21.15.44:0/3431724906 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0cb0165590 con 0x7f0cb015ad70 2024-09-13T18:33:21.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.463+0000 7f0ca1ffb700 1 -- 172.21.15.44:0/3431724906 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f0cac054dd0 con 0x7f0cb015ad70 2024-09-13T18:33:21.470 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:33:21.470 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":45,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2305930667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2305930667},{"type":"v1","addr":"172.21.15.99:6835","nonce":2305930667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1177460745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1177460745},{"type":"v1","addr":"172.21.15.44:6834","nonce":1177460745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6849,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1608555972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1608555972},{"type":"v1","addr":"172.21.15.44:6835","nonce":1608555972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:33:16.291148+0000","modified":"2024-09-13T18:33:19.305284+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6858},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6858":{"gid":6858,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/3072614790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3072614790},{"type":"v1","addr":"172.21.15.99:6837","nonce":3072614790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:33:21.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.467+0000 7f0cb641b700 1 -- 172.21.15.44:0/3431724906 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0c94066730 msgr2=0x7f0c94068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.467+0000 7f0cb641b700 1 --2- 172.21.15.44:0/3431724906 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0c94066730 0x7f0c94068bf0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80012e0 tx=0x7f0ca8009040 comp rx=0 tx=0).stop 2024-09-13T18:33:21.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.467+0000 7f0cb641b700 1 -- 172.21.15.44:0/3431724906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cb015ad70 msgr2=0x7f0cb015c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.467+0000 7f0cb641b700 1 --2- 172.21.15.44:0/3431724906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cb015ad70 0x7f0cb015c170 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f0cac00e7f0 tx=0x7f0cac00eb00 comp rx=0 tx=0).stop 2024-09-13T18:33:21.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.467+0000 7f0cb641b700 1 -- 172.21.15.44:0/3431724906 shutdown_connections 2024-09-13T18:33:21.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.467+0000 7f0cb641b700 1 --2- 172.21.15.44:0/3431724906 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0c94066730 0x7f0c94068bf0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.467+0000 7f0cb641b700 1 --2- 172.21.15.44:0/3431724906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cb015ad70 0x7f0cb015c170 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.467+0000 7f0cb641b700 1 --2- 172.21.15.44:0/3431724906 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0cb0161290 0x7f0cb006c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.467+0000 7f0cb641b700 1 --2- 172.21.15.44:0/3431724906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cb0160eb0 0x7f0cb01434e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.467+0000 7f0cb641b700 1 -- 172.21.15.44:0/3431724906 >> 172.21.15.44:0/3431724906 conn(0x7f0cb00b0f00 msgr2=0x7f0cb01636b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:21.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.467+0000 7f0cb641b700 1 -- 172.21.15.44:0/3431724906 shutdown_connections 2024-09-13T18:33:21.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:21.467+0000 7f0cb641b700 1 -- 172.21.15.44:0/3431724906 wait complete. 2024-09-13T18:33:21.475 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 45 2024-09-13T18:33:21.888 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:33:16.291148+0000', 'modified': '2024-09-13T18:33:19.305284+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6858}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6858': {'gid': 6858, 'name': 'd', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.99:6837/3072614790', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6836', 'nonce': 3072614790}, {'type': 'v1', 'addr': '172.21.15.99:6837', 'nonce': 3072614790}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:33:21.888 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:33:21.888 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-13T18:33:22.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.007+0000 7f686e728700 1 Processor -- start 2024-09-13T18:33:22.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.007+0000 7f686e728700 1 -- start start 2024-09-13T18:33:22.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686e728700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f686806d8c0 0x7f6868164a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686e728700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6868070bd0 0x7f6868163280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686e728700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6868162570 con 0x7f6868164f90 2024-09-13T18:33:22.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686e728700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6868162e60 con 0x7f6868070bd0 2024-09-13T18:33:22.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686e728700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6868071240 con 0x7f686806d8c0 2024-09-13T18:33:22.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686d726700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f686806d8c0 0x7f6868164a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686df27700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6868070bd0 0x7f6868163280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686d726700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f686806d8c0 0x7f6868164a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:58682/0 (socket says 172.21.15.44:58682) 2024-09-13T18:33:22.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686cf25700 1 --1- 172.21.15.44:0/238547373 >> v1:172.21.15.99:6789/0 conn(0x7f6868164f90 0x7f68680704c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:48480/0 (socket says 172.21.15.44:48480) 2024-09-13T18:33:22.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686d726700 1 -- 172.21.15.44:0/238547373 learned_addr learned my addr 172.21.15.44:0/238547373 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:22.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f685ffff700 1 -- 172.21.15.44:0/238547373 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545314360 0 0) 0x7f6868162570 con 0x7f6868164f90 2024-09-13T18:33:22.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f685ffff700 1 -- 172.21.15.44:0/238547373 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68540035d0 con 0x7f6868164f90 2024-09-13T18:33:22.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686d726700 1 -- 172.21.15.44:0/238547373 >> v2:172.21.15.99:3300/0 conn(0x7f6868070bd0 msgr2=0x7f6868163280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:22.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686d726700 1 --2- 172.21.15.44:0/238547373 >> v2:172.21.15.99:3300/0 conn(0x7f6868070bd0 0x7f6868163280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686d726700 1 -- 172.21.15.44:0/238547373 >> v1:172.21.15.99:6789/0 conn(0x7f6868164f90 legacy=0x7f68680704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686d726700 1 -- 172.21.15.44:0/238547373 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68681653f0 con 0x7f686806d8c0 2024-09-13T18:33:22.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686df27700 1 --2- 172.21.15.44:0/238547373 >> v2:172.21.15.99:3300/0 conn(0x7f6868070bd0 0x7f6868163280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:33:22.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686d726700 1 --2- 172.21.15.44:0/238547373 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f686806d8c0 0x7f6868164a50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6858009910 tx=0x7f6858009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65020acd3e3897 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:22.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f685ffff700 1 -- 172.21.15.44:0/238547373 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6858011830 con 0x7f686806d8c0 2024-09-13T18:33:22.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f685ffff700 1 -- 172.21.15.44:0/238547373 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6858011990 con 0x7f686806d8c0 2024-09-13T18:33:22.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f685ffff700 1 -- 172.21.15.44:0/238547373 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6858011d40 con 0x7f686806d8c0 2024-09-13T18:33:22.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686e728700 1 -- 172.21.15.44:0/238547373 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f686806d8c0 msgr2=0x7f6868164a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686e728700 1 --2- 172.21.15.44:0/238547373 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f686806d8c0 0x7f6868164a50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6858009910 tx=0x7f6858009c20 comp rx=0 tx=0).stop 2024-09-13T18:33:22.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686e728700 1 -- 172.21.15.44:0/238547373 shutdown_connections 2024-09-13T18:33:22.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686e728700 1 --2- 172.21.15.44:0/238547373 >> v2:172.21.15.99:3300/0 conn(0x7f6868070bd0 0x7f6868163280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686e728700 1 --2- 172.21.15.44:0/238547373 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f686806d8c0 0x7f6868164a50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686e728700 1 -- 172.21.15.44:0/238547373 >> 172.21.15.44:0/238547373 conn(0x7f68680b0e10 msgr2=0x7f68680b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:22.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686e728700 1 -- 172.21.15.44:0/238547373 shutdown_connections 2024-09-13T18:33:22.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.011+0000 7f686e728700 1 -- 172.21.15.44:0/238547373 wait complete. 2024-09-13T18:33:22.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.015+0000 7f686e728700 1 Processor -- start 2024-09-13T18:33:22.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.015+0000 7f686e728700 1 -- start start 2024-09-13T18:33:22.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.015+0000 7f686e728700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f686806d8c0 0x7f68681570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.015+0000 7f686e728700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6868070bd0 0x7f68680a8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.015+0000 7f686e728700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868164f90 0x7f686806b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.015+0000 7f686e728700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68680ad570 con 0x7f6868164f90 2024-09-13T18:33:22.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.015+0000 7f686e728700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6868157b80 con 0x7f686806d8c0 2024-09-13T18:33:22.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.015+0000 7f686e728700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68680ac8f0 con 0x7f6868070bd0 2024-09-13T18:33:22.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.015+0000 7f686df27700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868164f90 0x7f686806b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.015+0000 7f686d726700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f686806d8c0 0x7f68681570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.015+0000 7f686cf25700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6868070bd0 0x7f68680a8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.015+0000 7f686d726700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f686806d8c0 0x7f68681570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:56516/0 (socket says 172.21.15.44:56516) 2024-09-13T18:33:22.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.015+0000 7f686cf25700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6868070bd0 0x7f68680a8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:58684/0 (socket says 172.21.15.44:58684) 2024-09-13T18:33:22.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.015+0000 7f686d726700 1 -- 172.21.15.44:0/2363975433 learned_addr learned my addr 172.21.15.44:0/2363975433 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:22.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.015+0000 7f686df27700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868164f90 0x7f686806b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44886/0 (socket says 172.21.15.44:44886) 2024-09-13T18:33:22.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.015+0000 7f686df27700 1 -- 172.21.15.44:0/2363975433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6868070bd0 msgr2=0x7f68680a8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.015+0000 7f686df27700 1 --2- 172.21.15.44:0/2363975433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6868070bd0 0x7f68680a8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.015+0000 7f686df27700 1 -- 172.21.15.44:0/2363975433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f686806d8c0 msgr2=0x7f68681570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.015+0000 7f686df27700 1 --2- 172.21.15.44:0/2363975433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f686806d8c0 0x7f68681570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.015+0000 7f686df27700 1 -- 172.21.15.44:0/2363975433 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68600094b0 con 0x7f6868164f90 2024-09-13T18:33:22.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.015+0000 7f686d726700 1 --2- 172.21.15.44:0/2363975433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f686806d8c0 0x7f68681570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:33:22.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.015+0000 7f686df27700 1 --2- 172.21.15.44:0/2363975433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868164f90 0x7f686806b2b0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f686000e930 tx=0x7f686000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:22.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.019+0000 7f685dffb700 1 -- 172.21.15.44:0/2363975433 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6860004020 con 0x7f6868164f90 2024-09-13T18:33:22.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.019+0000 7f685dffb700 1 -- 172.21.15.44:0/2363975433 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68600041a0 con 0x7f6868164f90 2024-09-13T18:33:22.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.019+0000 7f685dffb700 1 -- 172.21.15.44:0/2363975433 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6860004550 con 0x7f6868164f90 2024-09-13T18:33:22.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.019+0000 7f686e728700 1 -- 172.21.15.44:0/2363975433 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6858009570 con 0x7f6868164f90 2024-09-13T18:33:22.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.019+0000 7f686e728700 1 -- 172.21.15.44:0/2363975433 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68680aceb0 con 0x7f6868164f90 2024-09-13T18:33:22.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.019+0000 7f685dffb700 1 -- 172.21.15.44:0/2363975433 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f68600036c0 con 0x7f6868164f90 2024-09-13T18:33:22.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.019+0000 7f685dffb700 1 --2- 172.21.15.44:0/2363975433 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f684c066730 0x7f684c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.019+0000 7f685dffb700 1 -- 172.21.15.44:0/2363975433 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6860083e50 con 0x7f6868164f90 2024-09-13T18:33:22.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.019+0000 7f686d726700 1 --2- 172.21.15.44:0/2363975433 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f684c066730 0x7f684c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f686d726700 1 --2- 172.21.15.44:0/2363975433 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f684c066730 0x7f684c068bf0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6858009c60 tx=0x7f6858008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:22.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f6872c3b740 1 Processor -- start 2024-09-13T18:33:22.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f6872c3b740 1 -- start start 2024-09-13T18:33:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f6872c3b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2913da0 0x2914180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f6872c3b740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x28f2d00 0x28dc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f6872c3b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x29146c0 0x28dcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f6872c3b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x283bd80 con 0x2913da0 2024-09-13T18:33:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f6872c3b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x2839510 con 0x29146c0 2024-09-13T18:33:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f6872c3b740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x2834e00 con 0x28f2d00 2024-09-13T18:33:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f686d726700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2913da0 0x2914180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f686d726700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2913da0 0x2914180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44894/0 (socket says 172.21.15.44:44894) 2024-09-13T18:33:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f686d726700 1 -- 172.21.15.44:0/2630217749 learned_addr learned my addr 172.21.15.44:0/2630217749 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f686df27700 1 --2- 172.21.15.44:0/2630217749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x29146c0 0x28dcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f686cf25700 1 --2- 172.21.15.44:0/2630217749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x28f2d00 0x28dc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f686d726700 1 -- 172.21.15.44:0/2630217749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x28f2d00 msgr2=0x28dc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:22.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f686d726700 1 --2- 172.21.15.44:0/2630217749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x28f2d00 0x28dc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f686d726700 1 -- 172.21.15.44:0/2630217749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x29146c0 msgr2=0x28dcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:22.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f686d726700 1 --2- 172.21.15.44:0/2630217749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x29146c0 0x28dcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f686d726700 1 -- 172.21.15.44:0/2630217749 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x26a7960 con 0x2913da0 2024-09-13T18:33:22.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f686cf25700 1 --2- 172.21.15.44:0/2630217749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x28f2d00 0x28dc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:22.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f686d726700 1 --2- 172.21.15.44:0/2630217749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2913da0 0x2914180 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f6858011760 tx=0x7f6858010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd487b1f4df784f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:22.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f684affd700 1 -- 172.21.15.44:0/2630217749 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6858020070 con 0x2913da0 2024-09-13T18:33:22.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f684affd700 1 -- 172.21.15.44:0/2630217749 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6858004590 con 0x2913da0 2024-09-13T18:33:22.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.023+0000 7f684affd700 1 -- 172.21.15.44:0/2630217749 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68580038c0 con 0x2913da0 2024-09-13T18:33:22.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f6872c3b740 1 -- 172.21.15.44:0/2630217749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2913da0 msgr2=0x2914180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f6872c3b740 1 --2- 172.21.15.44:0/2630217749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2913da0 0x2914180 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f6858011760 tx=0x7f6858010000 comp rx=0 tx=0).stop 2024-09-13T18:33:22.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f6872c3b740 1 -- 172.21.15.44:0/2630217749 shutdown_connections 2024-09-13T18:33:22.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f6872c3b740 1 --2- 172.21.15.44:0/2630217749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x29146c0 0x28dcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f6872c3b740 1 --2- 172.21.15.44:0/2630217749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x28f2d00 0x28dc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f6872c3b740 1 --2- 172.21.15.44:0/2630217749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2913da0 0x2914180 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f6872c3b740 1 -- 172.21.15.44:0/2630217749 >> 172.21.15.44:0/2630217749 conn(0x265c4d0 msgr2=0x28f5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:22.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f6872c3b740 1 -- 172.21.15.44:0/2630217749 shutdown_connections 2024-09-13T18:33:22.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f6872c3b740 1 -- 172.21.15.44:0/2630217749 wait complete. 2024-09-13T18:33:22.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f6872c3b740 1 -- start start 2024-09-13T18:33:22.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f6872c3b740 1 Processor -- start 2024-09-13T18:33:22.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f6872c3b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x28f2d00 0x28cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f6872c3b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2913da0 0x28ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f6872c3b740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x29146c0 0x28ca600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f6872c3b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x27f2730 con 0x2913da0 2024-09-13T18:33:22.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f6872c3b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x27f85b0 con 0x28f2d00 2024-09-13T18:33:22.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f6872c3b740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x26e0aa0 con 0x29146c0 2024-09-13T18:33:22.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f6872c3b740 10 client.0 _ll_register_callbacks cb 0x282e610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:33:22.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f686cf25700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2913da0 0x28ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f686cf25700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2913da0 0x28ca0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44906/0 (socket says 172.21.15.44:44906) 2024-09-13T18:33:22.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f686cf25700 1 -- 172.21.15.44:0/1005973665 learned_addr learned my addr 172.21.15.44:0/1005973665 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:22.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f686d726700 1 --2- 172.21.15.44:0/1005973665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x28f2d00 0x28cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f686df27700 1 --2- 172.21.15.44:0/1005973665 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x29146c0 0x28ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f686cf25700 1 -- 172.21.15.44:0/1005973665 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x29146c0 msgr2=0x28ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:22.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f686cf25700 1 --2- 172.21.15.44:0/1005973665 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x29146c0 0x28ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f686cf25700 1 -- 172.21.15.44:0/1005973665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x28f2d00 msgr2=0x28cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:22.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f686cf25700 1 --2- 172.21.15.44:0/1005973665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x28f2d00 0x28cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.027+0000 7f686cf25700 1 -- 172.21.15.44:0/1005973665 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68681653f0 con 0x2913da0 2024-09-13T18:33:22.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.031+0000 7f686cf25700 1 --2- 172.21.15.44:0/1005973665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2913da0 0x28ca0c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f6868158550 tx=0x7f6864007ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58377493e0b0cfde server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:22.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.031+0000 7f6843fff700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-13T18:33:22.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.031+0000 7f6843fff700 1 -- 172.21.15.44:0/1005973665 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6864011950 con 0x2913da0 2024-09-13T18:33:22.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.031+0000 7f6872c3b740 1 -- 172.21.15.44:0/1005973665 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x26691e0 con 0x2913da0 2024-09-13T18:33:22.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.031+0000 7f6843fff700 1 -- 172.21.15.44:0/1005973665 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6864011ab0 con 0x2913da0 2024-09-13T18:33:22.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.031+0000 7f6843fff700 1 -- 172.21.15.44:0/1005973665 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6864011cb0 con 0x2913da0 2024-09-13T18:33:22.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.031+0000 7f6872c3b740 10 client.6990 fetch_fsmap learned FSMap version 45 2024-09-13T18:33:22.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.031+0000 7f6872c3b740 1 -- 172.21.15.44:0/1005973665 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x27fb220 con 0x2913da0 2024-09-13T18:33:22.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.031+0000 7f6843fff700 1 -- 172.21.15.44:0/1005973665 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x26691e0 con 0x2913da0 2024-09-13T18:33:22.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.031+0000 7f6843fff700 1 -- 172.21.15.44:0/1005973665 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 45) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f6864015470 con 0x2913da0 2024-09-13T18:33:22.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.031+0000 7f6872c3b740 10 client.6990 fetch_fsmap finished waiting for FSMap version 45 2024-09-13T18:33:22.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.031+0000 7f6872c3b740 10 client.6990 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:33:22.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.031+0000 7f6872c3b740 20 client.6990 populate_metadata read hostname 'smithi044' 2024-09-13T18:33:22.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.031+0000 7f6872c3b740 1 --2- 172.21.15.44:0/1005973665 >> [v2:172.21.15.99:6836/3072614790,v1:172.21.15.99:6837/3072614790] conn(0x291dd80 0x291e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.031+0000 7f6872c3b740 4 client.6990 mds_command: new command op to 6858 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:33:22.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.031+0000 7f6872c3b740 1 -- 172.21.15.44:0/1005973665 --> [v2:172.21.15.99:6836/3072614790,v1:172.21.15.99:6837/3072614790] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x26b3460 con 0x291dd80 2024-09-13T18:33:22.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.031+0000 7f686d726700 1 --2- 172.21.15.44:0/1005973665 >> [v2:172.21.15.99:6836/3072614790,v1:172.21.15.99:6837/3072614790] conn(0x291dd80 0x291e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.031+0000 7f6843fff700 10 client.6990 ms_handle_connect on v2:172.21.15.99:6836/3072614790 2024-09-13T18:33:22.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.031+0000 7f686d726700 1 --2- 172.21.15.44:0/1005973665 >> [v2:172.21.15.99:6836/3072614790,v1:172.21.15.99:6837/3072614790] conn(0x291dd80 0x291e160 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47c36c96bf0fb736 server_cookie=9d6e5e5dfc33ce33 in_seq=0 out_seq=0 2024-09-13T18:33:22.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.031+0000 7f6843fff700 1 -- 172.21.15.44:0/1005973665 <== mds.0 v2:172.21.15.99:6836/3072614790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x26b3460 con 0x291dd80 2024-09-13T18:33:22.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.031+0000 7f6843fff700 10 client.6990 handle_command_reply: tid=0 2024-09-13T18:33:22.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.031+0000 7f6872c3b740 1 client.6990 shutdown 2024-09-13T18:33:22.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.035+0000 7f6872c3b740 1 -- 172.21.15.44:0/1005973665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2913da0 msgr2=0x28ca0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.035+0000 7f6872c3b740 1 --2- 172.21.15.44:0/1005973665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2913da0 0x28ca0c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f6868158550 tx=0x7f6864007ad0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.035+0000 7f6872c3b740 1 -- 172.21.15.44:0/1005973665 shutdown_connections 2024-09-13T18:33:22.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.035+0000 7f6872c3b740 1 --2- 172.21.15.44:0/1005973665 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x29146c0 0x28ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.035+0000 7f6872c3b740 1 --2- 172.21.15.44:0/1005973665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2913da0 0x28ca0c0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.035+0000 7f6872c3b740 1 --2- 172.21.15.44:0/1005973665 >> [v2:172.21.15.99:6836/3072614790,v1:172.21.15.99:6837/3072614790] conn(0x291dd80 0x291e160 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.035+0000 7f6872c3b740 1 --2- 172.21.15.44:0/1005973665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x28f2d00 0x28cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.035+0000 7f6872c3b740 1 -- 172.21.15.44:0/1005973665 >> 172.21.15.44:0/1005973665 conn(0x265c4d0 msgr2=0x28ef710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:22.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.035+0000 7f6843fff700 0 client.6990 ms_handle_reset on v2:172.21.15.99:6836/3072614790 2024-09-13T18:33:22.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.035+0000 7f6872c3b740 1 -- 172.21.15.44:0/1005973665 shutdown_connections 2024-09-13T18:33:22.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.035+0000 7f6872c3b740 1 -- 172.21.15.44:0/1005973665 wait complete. 2024-09-13T18:33:22.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.035+0000 7f6872c3b740 20 client.6990 trim_cache size 0 max 16384 2024-09-13T18:33:22.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.055+0000 7f6872c3b740 1 Processor -- start 2024-09-13T18:33:22.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.055+0000 7f6872c3b740 1 -- start start 2024-09-13T18:33:22.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.055+0000 7f6872c3b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x28f2d00 0x292c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.055+0000 7f6872c3b740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x2913da0 0x29271d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.055+0000 7f6872c3b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x29146c0 0x2927710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.055+0000 7f6872c3b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x2913a70 con 0x28f2d00 2024-09-13T18:33:22.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.055+0000 7f6872c3b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x2863ec0 con 0x29146c0 2024-09-13T18:33:22.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.055+0000 7f6872c3b740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x282ebd0 con 0x2913da0 2024-09-13T18:33:22.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.055+0000 7f686d726700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x28f2d00 0x292c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.055+0000 7f686d726700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x28f2d00 0x292c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44920/0 (socket says 172.21.15.44:44920) 2024-09-13T18:33:22.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.055+0000 7f686d726700 1 -- 172.21.15.44:0/4236568993 learned_addr learned my addr 172.21.15.44:0/4236568993 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:22.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.055+0000 7f686d726700 1 -- 172.21.15.44:0/4236568993 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x2913da0 msgr2=0x29271d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:22.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.055+0000 7f686cf25700 1 --2- 172.21.15.44:0/4236568993 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x2913da0 0x29271d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.055+0000 7f686df27700 1 --2- 172.21.15.44:0/4236568993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x29146c0 0x2927710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.055+0000 7f686d726700 1 --2- 172.21.15.44:0/4236568993 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x2913da0 0x29271d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.055+0000 7f686d726700 1 -- 172.21.15.44:0/4236568993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x29146c0 msgr2=0x2927710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:22.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.055+0000 7f686d726700 1 --2- 172.21.15.44:0/4236568993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x29146c0 0x2927710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.055+0000 7f686d726700 1 -- 172.21.15.44:0/4236568993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x27e1450 con 0x28f2d00 2024-09-13T18:33:22.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.055+0000 7f686cf25700 1 --2- 172.21.15.44:0/4236568993 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x2913da0 0x29271d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:22.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.055+0000 7f686d726700 1 --2- 172.21.15.44:0/4236568993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x28f2d00 0x292c160 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f6858022040 tx=0x7f68580092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44704bb53f34ce1e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:22.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.055+0000 7f684b7fe700 1 -- 172.21.15.44:0/4236568993 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6858037040 con 0x28f2d00 2024-09-13T18:33:22.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.055+0000 7f684b7fe700 1 -- 172.21.15.44:0/4236568993 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6858038040 con 0x28f2d00 2024-09-13T18:33:22.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.055+0000 7f684b7fe700 1 -- 172.21.15.44:0/4236568993 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6858003c20 con 0x28f2d00 2024-09-13T18:33:22.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.059+0000 7f6872c3b740 1 -- 172.21.15.44:0/4236568993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x28f2d00 msgr2=0x292c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.059+0000 7f6872c3b740 1 --2- 172.21.15.44:0/4236568993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x28f2d00 0x292c160 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f6858022040 tx=0x7f68580092e0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.059+0000 7f6872c3b740 1 -- 172.21.15.44:0/4236568993 shutdown_connections 2024-09-13T18:33:22.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.059+0000 7f6872c3b740 1 --2- 172.21.15.44:0/4236568993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x29146c0 0x2927710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.059+0000 7f6872c3b740 1 --2- 172.21.15.44:0/4236568993 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x2913da0 0x29271d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.059+0000 7f6872c3b740 1 --2- 172.21.15.44:0/4236568993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x28f2d00 0x292c160 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.059+0000 7f6872c3b740 1 -- 172.21.15.44:0/4236568993 >> 172.21.15.44:0/4236568993 conn(0x265c4d0 msgr2=0x28ee040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:22.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.059+0000 7f6872c3b740 1 -- 172.21.15.44:0/4236568993 shutdown_connections 2024-09-13T18:33:22.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.059+0000 7f6872c3b740 1 -- 172.21.15.44:0/4236568993 wait complete. 2024-09-13T18:33:22.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.059+0000 7f6872c3b740 1 -- start start 2024-09-13T18:33:22.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.059+0000 7f6872c3b740 1 Processor -- start 2024-09-13T18:33:22.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f6872c3b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x28f2d00 0x2932120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f6872c3b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2913da0 0x2974770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f6872c3b740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x29146c0 0x29759e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f6872c3b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x2932f40 con 0x2913da0 2024-09-13T18:33:22.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f6872c3b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x2932660 con 0x28f2d00 2024-09-13T18:33:22.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f6872c3b740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x28ee900 con 0x29146c0 2024-09-13T18:33:22.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f6872c3b740 10 client.0 _ll_register_callbacks cb 0x288b710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:33:22.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f686cf25700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2913da0 0x2974770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f686d726700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x28f2d00 0x2932120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f686cf25700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2913da0 0x2974770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44924/0 (socket says 172.21.15.44:44924) 2024-09-13T18:33:22.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f686cf25700 1 -- 172.21.15.44:0/3485736703 learned_addr learned my addr 172.21.15.44:0/3485736703 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:22.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f686df27700 1 --2- 172.21.15.44:0/3485736703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x29146c0 0x29759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f686cf25700 1 -- 172.21.15.44:0/3485736703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x29146c0 msgr2=0x29759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:22.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f686cf25700 1 --2- 172.21.15.44:0/3485736703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x29146c0 0x29759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f686cf25700 1 -- 172.21.15.44:0/3485736703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x28f2d00 msgr2=0x2932120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:22.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f686cf25700 1 --2- 172.21.15.44:0/3485736703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x28f2d00 0x2932120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f686cf25700 1 -- 172.21.15.44:0/3485736703 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x26a7960 con 0x2913da0 2024-09-13T18:33:22.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f686df27700 1 --2- 172.21.15.44:0/3485736703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x29146c0 0x29759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:33:22.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f686cf25700 1 --2- 172.21.15.44:0/3485736703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2913da0 0x2974770 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f68640016e0 tx=0x7f68640014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24300f418db395da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:22.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f6843fff700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-13T18:33:22.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f6843fff700 1 -- 172.21.15.44:0/3485736703 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686402c070 con 0x2913da0 2024-09-13T18:33:22.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f6843fff700 1 -- 172.21.15.44:0/3485736703 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68640159d0 con 0x2913da0 2024-09-13T18:33:22.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f6872c3b740 1 -- 172.21.15.44:0/3485736703 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6858004590 con 0x2913da0 2024-09-13T18:33:22.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f6843fff700 1 -- 172.21.15.44:0/3485736703 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6864011530 con 0x2913da0 2024-09-13T18:33:22.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f6872c3b740 10 client.6996 fetch_fsmap learned FSMap version 45 2024-09-13T18:33:22.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f6872c3b740 1 -- 172.21.15.44:0/3485736703 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x27d5720 con 0x2913da0 2024-09-13T18:33:22.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f6843fff700 1 -- 172.21.15.44:0/3485736703 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6858004590 con 0x2913da0 2024-09-13T18:33:22.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f6843fff700 1 -- 172.21.15.44:0/3485736703 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 45) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f6864031420 con 0x2913da0 2024-09-13T18:33:22.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f6872c3b740 10 client.6996 fetch_fsmap finished waiting for FSMap version 45 2024-09-13T18:33:22.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f6872c3b740 10 client.6996 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:33:22.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f6872c3b740 20 client.6996 populate_metadata read hostname 'smithi044' 2024-09-13T18:33:22.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.063+0000 7f6872c3b740 1 --2- 172.21.15.44:0/3485736703 >> [v2:172.21.15.99:6836/3072614790,v1:172.21.15.99:6837/3072614790] conn(0x2976200 0x292abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f6872c3b740 4 client.6996 mds_command: new command op to 6858 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:33:22.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f6872c3b740 1 -- 172.21.15.44:0/3485736703 --> [v2:172.21.15.99:6836/3072614790,v1:172.21.15.99:6837/3072614790] -- command(tid 0: {"prefix": "status"}) v1 -- 0x26d81e0 con 0x2976200 2024-09-13T18:33:22.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f686d726700 1 --2- 172.21.15.44:0/3485736703 >> [v2:172.21.15.99:6836/3072614790,v1:172.21.15.99:6837/3072614790] conn(0x2976200 0x292abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f686d726700 1 --2- 172.21.15.44:0/3485736703 >> [v2:172.21.15.99:6836/3072614790,v1:172.21.15.99:6837/3072614790] conn(0x2976200 0x292abc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=317b37c45b28625b server_cookie=189eb1d0d2ddb452 in_seq=0 out_seq=0 2024-09-13T18:33:22.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f6843fff700 10 client.6996 ms_handle_connect on v2:172.21.15.99:6836/3072614790 2024-09-13T18:33:22.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f6843fff700 1 -- 172.21.15.44:0/3485736703 <== mds.0 v2:172.21.15.99:6836/3072614790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x26d81e0 con 0x2976200 2024-09-13T18:33:22.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f6843fff700 10 client.6996 handle_command_reply: tid=0 2024-09-13T18:33:22.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f6872c3b740 1 client.6996 shutdown 2024-09-13T18:33:22.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f6872c3b740 1 -- 172.21.15.44:0/3485736703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2913da0 msgr2=0x2974770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f6872c3b740 1 --2- 172.21.15.44:0/3485736703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2913da0 0x2974770 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f68640016e0 tx=0x7f68640014d0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f6872c3b740 1 -- 172.21.15.44:0/3485736703 shutdown_connections 2024-09-13T18:33:22.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f6872c3b740 1 --2- 172.21.15.44:0/3485736703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x29146c0 0x29759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f6872c3b740 1 --2- 172.21.15.44:0/3485736703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x2913da0 0x2974770 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f6872c3b740 1 --2- 172.21.15.44:0/3485736703 >> [v2:172.21.15.99:6836/3072614790,v1:172.21.15.99:6837/3072614790] conn(0x2976200 0x292abc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f6872c3b740 1 --2- 172.21.15.44:0/3485736703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x28f2d00 0x2932120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f6843fff700 0 client.6996 ms_handle_reset on v2:172.21.15.99:6836/3072614790 2024-09-13T18:33:22.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f6872c3b740 1 -- 172.21.15.44:0/3485736703 >> 172.21.15.44:0/3485736703 conn(0x265c4d0 msgr2=0x29261c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:22.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f6872c3b740 1 -- 172.21.15.44:0/3485736703 shutdown_connections 2024-09-13T18:33:22.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f6872c3b740 1 -- 172.21.15.44:0/3485736703 wait complete. 2024-09-13T18:33:22.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f6872c3b740 20 client.6996 trim_cache size 0 max 16384 2024-09-13T18:33:22.077 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:33:22.077 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "c8e1d12d-7fb9-4a33-982e-b895bb77262c", 2024-09-13T18:33:22.077 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-13T18:33:22.078 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 6858, 2024-09-13T18:33:22.078 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-13T18:33:22.078 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-13T18:33:22.078 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-13T18:33:22.078 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 5.775265933, 2024-09-13T18:33:22.078 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 45, 2024-09-13T18:33:22.078 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 63, 2024-09-13T18:33:22.078 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 63, 2024-09-13T18:33:22.078 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 10.229280139 2024-09-13T18:33:22.078 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:33:22.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f686e728700 1 -- 172.21.15.44:0/2363975433 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f684c066730 msgr2=0x7f684c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f686e728700 1 --2- 172.21.15.44:0/2363975433 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f684c066730 0x7f684c068bf0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6858009c60 tx=0x7f6858008030 comp rx=0 tx=0).stop 2024-09-13T18:33:22.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f686e728700 1 -- 172.21.15.44:0/2363975433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868164f90 msgr2=0x7f686806b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f686e728700 1 --2- 172.21.15.44:0/2363975433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868164f90 0x7f686806b2b0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f686000e930 tx=0x7f686000ec40 comp rx=0 tx=0).stop 2024-09-13T18:33:22.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f686e728700 1 -- 172.21.15.44:0/2363975433 shutdown_connections 2024-09-13T18:33:22.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f686e728700 1 --2- 172.21.15.44:0/2363975433 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f684c066730 0x7f684c068bf0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f686e728700 1 --2- 172.21.15.44:0/2363975433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868164f90 0x7f686806b2b0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f686e728700 1 --2- 172.21.15.44:0/2363975433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6868070bd0 0x7f68680a8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f686e728700 1 --2- 172.21.15.44:0/2363975433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f686806d8c0 0x7f68681570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f686e728700 1 -- 172.21.15.44:0/2363975433 >> 172.21.15.44:0/2363975433 conn(0x7f68680b0e10 msgr2=0x7f6868066110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:22.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f686e728700 1 -- 172.21.15.44:0/2363975433 shutdown_connections 2024-09-13T18:33:22.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.067+0000 7f686e728700 1 -- 172.21.15.44:0/2363975433 wait complete. 2024-09-13T18:33:22.092 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:33:22.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.207+0000 7fc20c243700 1 Processor -- start 2024-09-13T18:33:22.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.207+0000 7fc20c243700 1 -- start start 2024-09-13T18:33:22.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.207+0000 7fc20c243700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc20414acf0 0x7fc2040b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.207+0000 7fc20c243700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc2040b2fc0 0x7fc2040cc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.207+0000 7fc20c243700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc204071120 con 0x7fc2040cc690 2024-09-13T18:33:22.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.207+0000 7fc20c243700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2040ccb00 con 0x7fc2040b2fc0 2024-09-13T18:33:22.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.207+0000 7fc20c243700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc204071400 con 0x7fc20414acf0 2024-09-13T18:33:22.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.207+0000 7fc209fdf700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc20414acf0 0x7fc2040b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.207+0000 7fc209fdf700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc20414acf0 0x7fc2040b2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:58722/0 (socket says 172.21.15.44:58722) 2024-09-13T18:33:22.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.207+0000 7fc209fdf700 1 -- 172.21.15.44:0/908951984 learned_addr learned my addr 172.21.15.44:0/908951984 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:22.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.207+0000 7fc2097de700 1 --2- 172.21.15.44:0/908951984 >> v2:172.21.15.99:3300/0 conn(0x7fc2040b2fc0 0x7fc2040cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.207+0000 7fc209fdf700 1 -- 172.21.15.44:0/908951984 >> v2:172.21.15.99:3300/0 conn(0x7fc2040b2fc0 msgr2=0x7fc2040cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:22.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.207+0000 7fc209fdf700 1 --2- 172.21.15.44:0/908951984 >> v2:172.21.15.99:3300/0 conn(0x7fc2040b2fc0 0x7fc2040cc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.207+0000 7fc209fdf700 1 -- 172.21.15.44:0/908951984 >> v1:172.21.15.99:6789/0 conn(0x7fc2040cc690 legacy=0x7fc204164f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.207+0000 7fc209fdf700 1 -- 172.21.15.44:0/908951984 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2040716e0 con 0x7fc20414acf0 2024-09-13T18:33:22.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.207+0000 7fc209fdf700 1 --2- 172.21.15.44:0/908951984 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc20414acf0 0x7fc2040b2a80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc200009910 tx=0x7fc200009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffe99bcd04450a8b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:22.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.207+0000 7fc208fdd700 1 -- 172.21.15.44:0/908951984 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc200011830 con 0x7fc20414acf0 2024-09-13T18:33:22.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.207+0000 7fc208fdd700 1 -- 172.21.15.44:0/908951984 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc200011990 con 0x7fc20414acf0 2024-09-13T18:33:22.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.207+0000 7fc208fdd700 1 -- 172.21.15.44:0/908951984 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc200011d40 con 0x7fc20414acf0 2024-09-13T18:33:22.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.211+0000 7fc20c243700 1 -- 172.21.15.44:0/908951984 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc20414acf0 msgr2=0x7fc2040b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.211+0000 7fc20c243700 1 --2- 172.21.15.44:0/908951984 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc20414acf0 0x7fc2040b2a80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc200009910 tx=0x7fc200009c20 comp rx=0 tx=0).stop 2024-09-13T18:33:22.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.211+0000 7fc20c243700 1 -- 172.21.15.44:0/908951984 shutdown_connections 2024-09-13T18:33:22.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.211+0000 7fc20c243700 1 --2- 172.21.15.44:0/908951984 >> v2:172.21.15.99:3300/0 conn(0x7fc2040b2fc0 0x7fc2040cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.211+0000 7fc20c243700 1 --2- 172.21.15.44:0/908951984 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc20414acf0 0x7fc2040b2a80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.211+0000 7fc20c243700 1 -- 172.21.15.44:0/908951984 >> 172.21.15.44:0/908951984 conn(0x7fc2040b1780 msgr2=0x7fc2040b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:22.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.211+0000 7fc20c243700 1 -- 172.21.15.44:0/908951984 shutdown_connections 2024-09-13T18:33:22.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.211+0000 7fc20c243700 1 -- 172.21.15.44:0/908951984 wait complete. 2024-09-13T18:33:22.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.211+0000 7fc20c243700 1 Processor -- start 2024-09-13T18:33:22.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.211+0000 7fc20c243700 1 -- start start 2024-09-13T18:33:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.211+0000 7fc20c243700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2040b2fc0 0x7fc2040c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.211+0000 7fc20c243700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2040cc690 0x7fc204160d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.211+0000 7fc20c243700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc20414acf0 0x7fc2041f6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.211+0000 7fc20c243700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2040c5b70 con 0x7fc2040b2fc0 2024-09-13T18:33:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.211+0000 7fc20c243700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2040c9d80 con 0x7fc20414acf0 2024-09-13T18:33:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.211+0000 7fc20c243700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2040c5dc0 con 0x7fc2040cc690 2024-09-13T18:33:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.211+0000 7fc209fdf700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2040b2fc0 0x7fc2040c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.211+0000 7fc209fdf700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2040b2fc0 0x7fc2040c9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44928/0 (socket says 172.21.15.44:44928) 2024-09-13T18:33:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.211+0000 7fc209fdf700 1 -- 172.21.15.44:0/4240269525 learned_addr learned my addr 172.21.15.44:0/4240269525 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.211+0000 7fc2097de700 1 --2- 172.21.15.44:0/4240269525 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2040cc690 0x7fc204160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.211+0000 7fc20a7e0700 1 --2- 172.21.15.44:0/4240269525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc20414acf0 0x7fc2041f6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.215+0000 7fc209fdf700 1 -- 172.21.15.44:0/4240269525 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2040cc690 msgr2=0x7fc204160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.215+0000 7fc209fdf700 1 --2- 172.21.15.44:0/4240269525 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2040cc690 0x7fc204160d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.215+0000 7fc209fdf700 1 -- 172.21.15.44:0/4240269525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc20414acf0 msgr2=0x7fc2041f6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.215+0000 7fc209fdf700 1 --2- 172.21.15.44:0/4240269525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc20414acf0 0x7fc2041f6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.215+0000 7fc209fdf700 1 -- 172.21.15.44:0/4240269525 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc200009570 con 0x7fc2040b2fc0 2024-09-13T18:33:22.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.215+0000 7fc2097de700 1 --2- 172.21.15.44:0/4240269525 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2040cc690 0x7fc204160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:22.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.215+0000 7fc209fdf700 1 --2- 172.21.15.44:0/4240269525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2040b2fc0 0x7fc2040c9840 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fc2040b2780 tx=0x7fc200004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:22.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.215+0000 7fc1fa7fc700 1 -- 172.21.15.44:0/4240269525 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc200004520 con 0x7fc2040b2fc0 2024-09-13T18:33:22.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.215+0000 7fc20c243700 1 -- 172.21.15.44:0/4240269525 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2040c60a0 con 0x7fc2040b2fc0 2024-09-13T18:33:22.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.215+0000 7fc1fa7fc700 1 -- 172.21.15.44:0/4240269525 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20001e070 con 0x7fc2040b2fc0 2024-09-13T18:33:22.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.215+0000 7fc1fa7fc700 1 -- 172.21.15.44:0/4240269525 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc200003900 con 0x7fc2040b2fc0 2024-09-13T18:33:22.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.215+0000 7fc20c243700 1 -- 172.21.15.44:0/4240269525 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2040c6660 con 0x7fc2040b2fc0 2024-09-13T18:33:22.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.215+0000 7fc20c243700 1 -- 172.21.15.44:0/4240269525 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2040c6880 con 0x7fc2040b2fc0 2024-09-13T18:33:22.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.219+0000 7fc1fa7fc700 1 -- 172.21.15.44:0/4240269525 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc200003a60 con 0x7fc2040b2fc0 2024-09-13T18:33:22.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.219+0000 7fc1fa7fc700 1 --2- 172.21.15.44:0/4240269525 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc1e8066730 0x7fc1e8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.219+0000 7fc1fa7fc700 1 -- 172.21.15.44:0/4240269525 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc200020070 con 0x7fc2040b2fc0 2024-09-13T18:33:22.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.219+0000 7fc2097de700 1 --2- 172.21.15.44:0/4240269525 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc1e8066730 0x7fc1e8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.219+0000 7fc2097de700 1 --2- 172.21.15.44:0/4240269525 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc1e8066730 0x7fc1e8068bf0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc2041620c0 tx=0x7fc1f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:22.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.223+0000 7fc1fa7fc700 1 -- 172.21.15.44:0/4240269525 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc200052ec0 con 0x7fc2040b2fc0 2024-09-13T18:33:22.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.431+0000 7fc20c243700 1 -- 172.21.15.44:0/4240269525 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc20414b0d0 con 0x7fc2040b2fc0 2024-09-13T18:33:22.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.431+0000 7fc1fa7fc700 1 -- 172.21.15.44:0/4240269525 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v45) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc200015070 con 0x7fc2040b2fc0 2024-09-13T18:33:22.439 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:33:22.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.435+0000 7fc20c243700 1 -- 172.21.15.44:0/4240269525 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc1e8066730 msgr2=0x7fc1e8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.435+0000 7fc20c243700 1 --2- 172.21.15.44:0/4240269525 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc1e8066730 0x7fc1e8068bf0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc2041620c0 tx=0x7fc1f4008040 comp rx=0 tx=0).stop 2024-09-13T18:33:22.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.435+0000 7fc20c243700 1 -- 172.21.15.44:0/4240269525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2040b2fc0 msgr2=0x7fc2040c9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.435+0000 7fc20c243700 1 --2- 172.21.15.44:0/4240269525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2040b2fc0 0x7fc2040c9840 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fc2040b2780 tx=0x7fc200004770 comp rx=0 tx=0).stop 2024-09-13T18:33:22.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.435+0000 7fc20c243700 1 -- 172.21.15.44:0/4240269525 shutdown_connections 2024-09-13T18:33:22.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.435+0000 7fc20c243700 1 --2- 172.21.15.44:0/4240269525 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc1e8066730 0x7fc1e8068bf0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.435+0000 7fc20c243700 1 --2- 172.21.15.44:0/4240269525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc20414acf0 0x7fc2041f6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.435+0000 7fc20c243700 1 --2- 172.21.15.44:0/4240269525 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2040cc690 0x7fc204160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.435+0000 7fc20c243700 1 --2- 172.21.15.44:0/4240269525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2040b2fc0 0x7fc2040c9840 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.435+0000 7fc20c243700 1 -- 172.21.15.44:0/4240269525 >> 172.21.15.44:0/4240269525 conn(0x7fc2040b1780 msgr2=0x7fc2041621c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:22.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.435+0000 7fc20c243700 1 -- 172.21.15.44:0/4240269525 shutdown_connections 2024-09-13T18:33:22.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:22.435+0000 7fc20c243700 1 -- 172.21.15.44:0/4240269525 wait complete. 2024-09-13T18:33:22.455 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:33:22.455 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:33:22.455 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-13T18:33:22.455 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:33:22.455 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:33:22.455 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:33:22.455 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:33:22.455 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:33:22.455 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:33:22.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:22.456 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-13T18:33:22.463 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:33:22.464 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:33:22.464 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:33:22.464 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:22.464 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-13T18:33:22.464 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:22.464 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:33:22.464 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-13T18:33:22.464 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:33:22.464 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:33:22.464 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:33:22.464 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:33:22.465 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:33:22.465 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42221sec preferred_lft 42221sec 2024-09-13T18:33:22.465 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-13T18:33:22.465 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:22.465 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:33:22.465 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:33:22.465 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:33:22.465 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:80:b2:e4:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:33:22.465 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:33:22.465 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:22.465 INFO:teuthology.orchestra.run.smithi044.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:33:22.465 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 2e:69:eb:1c:57:57 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:33:22.465 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:33:22.465 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:22.466 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::8842:91ff:feed:2c53/64 scope link 2024-09-13T18:33:22.466 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:22.466 INFO:teuthology.orchestra.run.smithi044.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:33:22.466 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 2e:69:eb:1c:57:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:33:22.466 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::2c69:ebff:fe1c:5757/64 scope link 2024-09-13T18:33:22.466 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:22.466 INFO:teuthology.orchestra.run.smithi044.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:33:22.466 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 86:e5:07:ac:f1:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:33:22.466 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::84e5:7ff:feac:f11b/64 scope link 2024-09-13T18:33:22.466 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:22.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:22.467 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:33:22.479 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-13T18:33:22.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:22.481 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-13T18:33:22.536 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-13T18:33:22.536 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:33:22.537 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:33:22.537 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:33:22.537 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:33:22.537 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:33:22.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:22.537 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2024-09-13T18:33:22.537 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-13T18:33:22.537 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:33:22.537 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:33:22.537 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:33:22.538 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-13T18:33:22.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:22.580 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-13T18:33:22.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:33:22.587 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:33:22.588 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:33:22.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:22.588 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-13T18:33:22.601 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:33:22.601 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:33:22.601 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:33:22.650 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:33:22.650 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:33:22.651 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:33:22.657 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:33:22.671 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:33:22.671 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:33:22.683 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:33:22.684 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:33:22.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:22.686 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:33:22.692 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:33:22.692 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:33:22.694 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:33:22.710 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:33:22.710 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:33:22.769 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:33:22.770 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:33:22.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:22.770 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:33:22.787 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2024-09-13T18:33:22.779+0000 7f188229a640 -1 init, newargv = 0x55dc89ec7800 newargc=15 2024-09-13T18:33:22.787 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[43542]: starting ceph client 2024-09-13T18:33:22.796 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[43542]: starting fuse 2024-09-13T18:33:23.877 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:33:23.897 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:33:23.897 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:33:23.955 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:33:23.956 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:33:23.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:23.956 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:33:23.963 INFO:teuthology.orchestra.run.smithi044.stdout:52 2024-09-13T18:33:23.964 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T18:33:23.964 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:33:23.964 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2024-09-13T18:33:23.964 DEBUG:teuthology.orchestra.run.smithi044:> import re 2024-09-13T18:33:23.964 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:33:23.965 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2024-09-13T18:33:23.965 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:33:23.965 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2024-09-13T18:33:23.965 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:33:23.965 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2024-09-13T18:33:23.965 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:33:23.965 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:33:23.965 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2024-09-13T18:33:23.965 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2024-09-13T18:33:23.965 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2024-09-13T18:33:23.965 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2024-09-13T18:33:23.965 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:33:23.965 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2024-09-13T18:33:23.965 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:33:23.965 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:33:23.965 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:33:23.966 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2024-09-13T18:33:23.966 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2024-09-13T18:33:23.966 DEBUG:teuthology.orchestra.run.smithi044:> return f 2024-09-13T18:33:23.966 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:33:23.966 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:33:23.966 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.0")) 2024-09-13T18:33:23.966 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:33:24.047 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.0.43542.asok 2024-09-13T18:33:24.233 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.43542.asok 2024-09-13T18:33:24.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:24.233 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.43542.asok status 2024-09-13T18:33:24.345 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:33:24.345 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2024-09-13T18:33:24.345 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:33:24.345 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:33:24.345 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "0", 2024-09-13T18:33:24.345 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2024-09-13T18:33:24.345 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:33:24.345 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "43542", 2024-09-13T18:33:24.345 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2024-09-13T18:33:24.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:33:24.346 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2024-09-13T18:33:24.346 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2024-09-13T18:33:24.346 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 7005, 2024-09-13T18:33:24.346 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2024-09-13T18:33:24.346 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2024-09-13T18:33:24.346 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2024-09-13T18:33:24.346 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 7005 2024-09-13T18:33:24.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:33:24.346 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:33:24.346 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-13T18:33:24.346 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:33:24.346 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3461673344 2024-09-13T18:33:24.346 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:33:24.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:33:24.346 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:33:24.347 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-13T18:33:24.347 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:33:24.347 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3461673344 2024-09-13T18:33:24.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:33:24.347 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.7005 192.168.0.1:0/3461673344", 2024-09-13T18:33:24.347 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/3461673344", 2024-09-13T18:33:24.347 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2024-09-13T18:33:24.347 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 45, 2024-09-13T18:33:24.347 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 63, 2024-09-13T18:33:24.347 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:33:24.347 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2024-09-13T18:33:24.347 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2024-09-13T18:33:24.347 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:33:24.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:24.355 DEBUG:teuthology.orchestra.run.smithi044:> stat --file-system '--printf=%T 2024-09-13T18:33:24.355 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:33:24.362 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2024-09-13T18:33:24.362 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:33:24.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:24.363 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:33:24.424 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2024-09-13T18:33:24.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.543+0000 7efe8ffff700 1 Processor -- start 2024-09-13T18:33:24.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.543+0000 7efe8ffff700 1 -- start start 2024-09-13T18:33:24.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.543+0000 7efe8ffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efe9006a520 0x7efe9006a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:24.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.543+0000 7efe8ffff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe900b8430 con 0x7efe9015cda0 2024-09-13T18:33:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.543+0000 7efe8ffff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe9006ae70 con 0x7efe9006b900 2024-09-13T18:33:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.543+0000 7efe8ffff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe900b64f0 con 0x7efe9006a520 2024-09-13T18:33:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.547+0000 7efe8f7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efe9006a520 0x7efe9006a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.547+0000 7efe8effd700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7efe9015cda0 0x7efe900ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49764/0 (socket says 172.21.15.44:49764) 2024-09-13T18:33:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.547+0000 7efe8effd700 1 -- 172.21.15.44:0/1072451396 learned_addr learned my addr 172.21.15.44:0/1072451396 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.547+0000 7efe8f7fe700 1 -- 172.21.15.44:0/1072451396 >> v1:172.21.15.99:6789/0 conn(0x7efe9006b900 legacy=0x7efe900b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.547+0000 7efe8f7fe700 1 -- 172.21.15.44:0/1072451396 >> v1:172.21.15.44:6789/0 conn(0x7efe9015cda0 legacy=0x7efe900ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:24.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.547+0000 7efe8f7fe700 1 -- 172.21.15.44:0/1072451396 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9006bd60 con 0x7efe9006a520 2024-09-13T18:33:24.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.547+0000 7efe8f7fe700 1 --2- 172.21.15.44:0/1072451396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9006a520 0x7efe9006a930 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7efe88009d90 tx=0x7efe8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae51f86dd5d4d9cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:24.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.547+0000 7efe8dffb700 1 -- 172.21.15.44:0/1072451396 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8800e070 con 0x7efe9006a520 2024-09-13T18:33:24.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.547+0000 7efe8dffb700 1 -- 172.21.15.44:0/1072451396 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8800bbd0 con 0x7efe9006a520 2024-09-13T18:33:24.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.547+0000 7efe8dffb700 1 -- 172.21.15.44:0/1072451396 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88012430 con 0x7efe9006a520 2024-09-13T18:33:24.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.547+0000 7efe8ffff700 1 -- 172.21.15.44:0/1072451396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9006a520 msgr2=0x7efe9006a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:24.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.547+0000 7efe8ffff700 1 --2- 172.21.15.44:0/1072451396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9006a520 0x7efe9006a930 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7efe88009d90 tx=0x7efe8800b330 comp rx=0 tx=0).stop 2024-09-13T18:33:24.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.547+0000 7efe8ffff700 1 -- 172.21.15.44:0/1072451396 shutdown_connections 2024-09-13T18:33:24.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.547+0000 7efe8ffff700 1 --2- 172.21.15.44:0/1072451396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9006a520 0x7efe9006a930 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:24.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.547+0000 7efe8ffff700 1 -- 172.21.15.44:0/1072451396 >> 172.21.15.44:0/1072451396 conn(0x7efe900d2cb0 msgr2=0x7efe900d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:24.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.547+0000 7efe8ffff700 1 -- 172.21.15.44:0/1072451396 shutdown_connections 2024-09-13T18:33:24.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.547+0000 7efe8ffff700 1 -- 172.21.15.44:0/1072451396 wait complete. 2024-09-13T18:33:24.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe8ffff700 1 Processor -- start 2024-09-13T18:33:24.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe8ffff700 1 -- start start 2024-09-13T18:33:24.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe8ffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe9006a520 0x7efe90154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:24.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe8ffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe9006b900 0x7efe900c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:24.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe8ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9015cda0 0x7efe900b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:24.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe8ffff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe900c7610 con 0x7efe9015cda0 2024-09-13T18:33:24.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe8ffff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe900c9ad0 con 0x7efe9006a520 2024-09-13T18:33:24.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe8ffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe900c7820 con 0x7efe9006b900 2024-09-13T18:33:24.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe8f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9015cda0 0x7efe900b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:24.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe8f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9015cda0 0x7efe900b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44948/0 (socket says 172.21.15.44:44948) 2024-09-13T18:33:24.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe8f7fe700 1 -- 172.21.15.44:0/2891108279 learned_addr learned my addr 172.21.15.44:0/2891108279 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:24.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe8effd700 1 --2- 172.21.15.44:0/2891108279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe9006a520 0x7efe90154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:24.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe8e7fc700 1 --2- 172.21.15.44:0/2891108279 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe9006b900 0x7efe900c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:24.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe8f7fe700 1 -- 172.21.15.44:0/2891108279 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe9006b900 msgr2=0x7efe900c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:24.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe8f7fe700 1 --2- 172.21.15.44:0/2891108279 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe9006b900 0x7efe900c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:24.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe8f7fe700 1 -- 172.21.15.44:0/2891108279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe9006a520 msgr2=0x7efe90154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:24.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe8f7fe700 1 --2- 172.21.15.44:0/2891108279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe9006a520 0x7efe90154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:24.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe8f7fe700 1 -- 172.21.15.44:0/2891108279 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe88009a70 con 0x7efe9015cda0 2024-09-13T18:33:24.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe8f7fe700 1 --2- 172.21.15.44:0/2891108279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9015cda0 0x7efe900b32b0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7efe88014040 tx=0x7efe88004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:24.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe77fff700 1 -- 172.21.15.44:0/2891108279 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88012d20 con 0x7efe9015cda0 2024-09-13T18:33:24.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe77fff700 1 -- 172.21.15.44:0/2891108279 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe88020070 con 0x7efe9015cda0 2024-09-13T18:33:24.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe77fff700 1 -- 172.21.15.44:0/2891108279 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88012ea0 con 0x7efe9015cda0 2024-09-13T18:33:24.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe8ffff700 1 -- 172.21.15.44:0/2891108279 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe9015d3b0 con 0x7efe9015cda0 2024-09-13T18:33:24.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.551+0000 7efe8ffff700 1 -- 172.21.15.44:0/2891108279 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe9015d970 con 0x7efe9015cda0 2024-09-13T18:33:24.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.555+0000 7efe77fff700 1 -- 172.21.15.44:0/2891108279 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efe88004280 con 0x7efe9015cda0 2024-09-13T18:33:24.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.555+0000 7efe8ffff700 1 -- 172.21.15.44:0/2891108279 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe900d0b60 con 0x7efe9015cda0 2024-09-13T18:33:24.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.555+0000 7efe77fff700 1 --2- 172.21.15.44:0/2891108279 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe7c066730 0x7efe7c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:24.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.555+0000 7efe77fff700 1 -- 172.21.15.44:0/2891108279 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe88022070 con 0x7efe9015cda0 2024-09-13T18:33:24.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.555+0000 7efe8effd700 1 --2- 172.21.15.44:0/2891108279 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe7c066730 0x7efe7c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:24.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.555+0000 7efe8effd700 1 --2- 172.21.15.44:0/2891108279 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe7c066730 0x7efe7c068bf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efe84005930 tx=0x7efe84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:24.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.567+0000 7efe77fff700 1 -- 172.21.15.44:0/2891108279 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efe8808b020 con 0x7efe9015cda0 2024-09-13T18:33:24.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:24.779+0000 7efe8ffff700 1 -- 172.21.15.44:0/2891108279 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7efe900d1120 con 0x7efe9015cda0 2024-09-13T18:33:25.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.519+0000 7efe77fff700 1 -- 172.21.15.44:0/2891108279 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v46) v1 ==== 105+0+0 (secure 0 0 0) 0x7efe8802c0b0 con 0x7efe9015cda0 2024-09-13T18:33:25.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.523+0000 7efe8ffff700 1 -- 172.21.15.44:0/2891108279 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe7c066730 msgr2=0x7efe7c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:25.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.523+0000 7efe8ffff700 1 --2- 172.21.15.44:0/2891108279 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe7c066730 0x7efe7c068bf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efe84005930 tx=0x7efe84009040 comp rx=0 tx=0).stop 2024-09-13T18:33:25.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.523+0000 7efe8ffff700 1 -- 172.21.15.44:0/2891108279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9015cda0 msgr2=0x7efe900b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:25.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.523+0000 7efe8ffff700 1 --2- 172.21.15.44:0/2891108279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9015cda0 0x7efe900b32b0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7efe88014040 tx=0x7efe88004af0 comp rx=0 tx=0).stop 2024-09-13T18:33:25.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.523+0000 7efe8ffff700 1 -- 172.21.15.44:0/2891108279 shutdown_connections 2024-09-13T18:33:25.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.523+0000 7efe8ffff700 1 --2- 172.21.15.44:0/2891108279 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe7c066730 0x7efe7c068bf0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:25.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.523+0000 7efe8ffff700 1 --2- 172.21.15.44:0/2891108279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9015cda0 0x7efe900b32b0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:25.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.523+0000 7efe8ffff700 1 --2- 172.21.15.44:0/2891108279 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe9006b900 0x7efe900c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:25.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.523+0000 7efe8ffff700 1 --2- 172.21.15.44:0/2891108279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe9006a520 0x7efe90154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:25.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.523+0000 7efe8ffff700 1 -- 172.21.15.44:0/2891108279 >> 172.21.15.44:0/2891108279 conn(0x7efe900d2cb0 msgr2=0x7efe900b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:25.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.523+0000 7efe8ffff700 1 -- 172.21.15.44:0/2891108279 shutdown_connections 2024-09-13T18:33:25.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.527+0000 7efe8ffff700 1 -- 172.21.15.44:0/2891108279 wait complete. 2024-09-13T18:33:25.553 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:33:25.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.655+0000 7fc59b59e700 1 Processor -- start 2024-09-13T18:33:25.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.655+0000 7fc59b59e700 1 -- start start 2024-09-13T18:33:25.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.655+0000 7fc59b59e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc59c0cb150 0x7fc59c0cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:25.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.655+0000 7fc59b59e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59c0cbb00 con 0x7fc59c0b57e0 2024-09-13T18:33:25.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.655+0000 7fc59b59e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59c0b5050 con 0x7fc59c0d0a10 2024-09-13T18:33:25.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.655+0000 7fc59b59e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59c15b3e0 con 0x7fc59c0cb150 2024-09-13T18:33:25.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.655+0000 7fc59ad9d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc59c0b57e0 0x7fc59c0b5c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49778/0 (socket says 172.21.15.44:49778) 2024-09-13T18:33:25.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.655+0000 7fc59ad9d700 1 -- 172.21.15.44:0/2582186512 learned_addr learned my addr 172.21.15.44:0/2582186512 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:25.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.655+0000 7fc599d9b700 1 --2- 172.21.15.44:0/2582186512 >> v2:172.21.15.99:3300/0 conn(0x7fc59c0cb150 0x7fc59c0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:25.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.659+0000 7fc59959a700 1 -- 172.21.15.44:0/2582186512 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648491624 0 0) 0x7fc59c0cbb00 con 0x7fc59c0b57e0 2024-09-13T18:33:25.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.659+0000 7fc59959a700 1 -- 172.21.15.44:0/2582186512 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5880035d0 con 0x7fc59c0b57e0 2024-09-13T18:33:25.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.659+0000 7fc599d9b700 1 -- 172.21.15.44:0/2582186512 >> v1:172.21.15.99:6789/0 conn(0x7fc59c0d0a10 legacy=0x7fc59c0d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:25.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.659+0000 7fc599d9b700 1 -- 172.21.15.44:0/2582186512 >> v1:172.21.15.44:6789/0 conn(0x7fc59c0b57e0 legacy=0x7fc59c0b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:25.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.659+0000 7fc599d9b700 1 -- 172.21.15.44:0/2582186512 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c0ce3f0 con 0x7fc59c0cb150 2024-09-13T18:33:25.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.659+0000 7fc599d9b700 1 --2- 172.21.15.44:0/2582186512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc59c0cb150 0x7fc59c0cb5c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc58c009880 tx=0x7fc58c009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8e9b4926af8eae5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:25.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.659+0000 7fc59959a700 1 -- 172.21.15.44:0/2582186512 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c011830 con 0x7fc59c0cb150 2024-09-13T18:33:25.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.659+0000 7fc59959a700 1 -- 172.21.15.44:0/2582186512 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c011990 con 0x7fc59c0cb150 2024-09-13T18:33:25.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.659+0000 7fc59959a700 1 -- 172.21.15.44:0/2582186512 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c011d20 con 0x7fc59c0cb150 2024-09-13T18:33:25.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.659+0000 7fc59b59e700 1 -- 172.21.15.44:0/2582186512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc59c0cb150 msgr2=0x7fc59c0cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:25.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.659+0000 7fc59b59e700 1 --2- 172.21.15.44:0/2582186512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc59c0cb150 0x7fc59c0cb5c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc58c009880 tx=0x7fc58c009b90 comp rx=0 tx=0).stop 2024-09-13T18:33:25.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.659+0000 7fc59b59e700 1 -- 172.21.15.44:0/2582186512 shutdown_connections 2024-09-13T18:33:25.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.659+0000 7fc59b59e700 1 --2- 172.21.15.44:0/2582186512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc59c0cb150 0x7fc59c0cb5c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:25.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.659+0000 7fc59b59e700 1 -- 172.21.15.44:0/2582186512 >> 172.21.15.44:0/2582186512 conn(0x7fc59c071ee0 msgr2=0x7fc59c0722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:25.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.659+0000 7fc59b59e700 1 -- 172.21.15.44:0/2582186512 shutdown_connections 2024-09-13T18:33:25.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.659+0000 7fc59b59e700 1 -- 172.21.15.44:0/2582186512 wait complete. 2024-09-13T18:33:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.659+0000 7fc59b59e700 1 Processor -- start 2024-09-13T18:33:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.659+0000 7fc59b59e700 1 -- start start 2024-09-13T18:33:25.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc59b59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc59c0b57e0 0x7fc59c15a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc59b59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc59c0cb150 0x7fc59c1f1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc59b59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc59c0d0a10 0x7fc59c151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc59b59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c153340 con 0x7fc59c0d0a10 2024-09-13T18:33:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc59b59e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c1f2320 con 0x7fc59c0cb150 2024-09-13T18:33:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc59b59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c152730 con 0x7fc59c0b57e0 2024-09-13T18:33:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc59ad9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc59c0d0a10 0x7fc59c151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc59ad9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc59c0d0a10 0x7fc59c151ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44960/0 (socket says 172.21.15.44:44960) 2024-09-13T18:33:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc59ad9d700 1 -- 172.21.15.44:0/611177553 learned_addr learned my addr 172.21.15.44:0/611177553 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc599d9b700 1 --2- 172.21.15.44:0/611177553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc59c0cb150 0x7fc59c1f1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc59a59c700 1 --2- 172.21.15.44:0/611177553 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc59c0b57e0 0x7fc59c15a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:25.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc59ad9d700 1 -- 172.21.15.44:0/611177553 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc59c0b57e0 msgr2=0x7fc59c15a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:25.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc59ad9d700 1 --2- 172.21.15.44:0/611177553 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc59c0b57e0 0x7fc59c15a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:25.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc59ad9d700 1 -- 172.21.15.44:0/611177553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc59c0cb150 msgr2=0x7fc59c1f1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:25.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc59ad9d700 1 --2- 172.21.15.44:0/611177553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc59c0cb150 0x7fc59c1f1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:25.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc59ad9d700 1 -- 172.21.15.44:0/611177553 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c0094b0 con 0x7fc59c0d0a10 2024-09-13T18:33:25.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc599d9b700 1 --2- 172.21.15.44:0/611177553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc59c0cb150 0x7fc59c1f1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:33:25.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc59a59c700 1 --2- 172.21.15.44:0/611177553 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc59c0b57e0 0x7fc59c15a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:33:25.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc59ad9d700 1 --2- 172.21.15.44:0/611177553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc59c0d0a10 0x7fc59c151ee0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fc59400caa0 tx=0x7fc59400cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:25.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc592ffd700 1 -- 172.21.15.44:0/611177553 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc594007480 con 0x7fc59c0d0a10 2024-09-13T18:33:25.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc592ffd700 1 -- 172.21.15.44:0/611177553 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5940075e0 con 0x7fc59c0d0a10 2024-09-13T18:33:25.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc59b59e700 1 -- 172.21.15.44:0/611177553 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59c152a10 con 0x7fc59c0d0a10 2024-09-13T18:33:25.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc592ffd700 1 -- 172.21.15.44:0/611177553 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc594007970 con 0x7fc59c0d0a10 2024-09-13T18:33:25.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc59b59e700 1 -- 172.21.15.44:0/611177553 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59c152fd0 con 0x7fc59c0d0a10 2024-09-13T18:33:25.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.663+0000 7fc59b59e700 1 -- 172.21.15.44:0/611177553 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59c1534b0 con 0x7fc59c0d0a10 2024-09-13T18:33:25.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.667+0000 7fc592ffd700 1 -- 172.21.15.44:0/611177553 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc59401b3b0 con 0x7fc59c0d0a10 2024-09-13T18:33:25.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.667+0000 7fc592ffd700 1 --2- 172.21.15.44:0/611177553 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc57c066730 0x7fc57c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:25.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.667+0000 7fc592ffd700 1 -- 172.21.15.44:0/611177553 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc594083af0 con 0x7fc59c0d0a10 2024-09-13T18:33:25.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.667+0000 7fc59a59c700 1 --2- 172.21.15.44:0/611177553 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc57c066730 0x7fc57c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:25.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.667+0000 7fc59a59c700 1 --2- 172.21.15.44:0/611177553 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc57c066730 0x7fc57c068bf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc584000f60 tx=0x7fc584009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:25.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.671+0000 7fc592ffd700 1 -- 172.21.15.44:0/611177553 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc594050dc0 con 0x7fc59c0d0a10 2024-09-13T18:33:25.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.879+0000 7fc59b59e700 1 -- 172.21.15.44:0/611177553 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc59c0b5270 con 0x7fc59c0d0a10 2024-09-13T18:33:25.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.879+0000 7fc592ffd700 1 -- 172.21.15.44:0/611177553 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4750 (secure 0 0 0) 0x7fc594017020 con 0x7fc59c0d0a10 2024-09-13T18:33:25.888 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:33:25.888 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":47,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2305930667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2305930667},{"type":"v1","addr":"172.21.15.99:6835","nonce":2305930667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1177460745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1177460745},{"type":"v1","addr":"172.21.15.44:6834","nonce":1177460745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:33:16.291148+0000","modified":"2024-09-13T18:33:25.522967+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6858,"mds_1":6849},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6849":{"gid":6849,"name":"a","rank":1,"incarnation":47,"state":"up:creating","state_seq":1,"addr":"172.21.15.44:6835/1608555972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1608555972},{"type":"v1","addr":"172.21.15.44:6835","nonce":1608555972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6858":{"gid":6858,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/3072614790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3072614790},{"type":"v1","addr":"172.21.15.99:6837","nonce":3072614790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:33:25.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.883+0000 7fc59b59e700 1 -- 172.21.15.44:0/611177553 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc57c066730 msgr2=0x7fc57c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:25.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.883+0000 7fc59b59e700 1 --2- 172.21.15.44:0/611177553 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc57c066730 0x7fc57c068bf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc584000f60 tx=0x7fc584009040 comp rx=0 tx=0).stop 2024-09-13T18:33:25.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.883+0000 7fc59b59e700 1 -- 172.21.15.44:0/611177553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc59c0d0a10 msgr2=0x7fc59c151ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:25.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.883+0000 7fc59b59e700 1 --2- 172.21.15.44:0/611177553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc59c0d0a10 0x7fc59c151ee0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fc59400caa0 tx=0x7fc59400cad0 comp rx=0 tx=0).stop 2024-09-13T18:33:25.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.883+0000 7fc59b59e700 1 -- 172.21.15.44:0/611177553 shutdown_connections 2024-09-13T18:33:25.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.883+0000 7fc59b59e700 1 --2- 172.21.15.44:0/611177553 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc57c066730 0x7fc57c068bf0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.883+0000 7fc59b59e700 1 --2- 172.21.15.44:0/611177553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc59c0d0a10 0x7fc59c151ee0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.883+0000 7fc59b59e700 1 --2- 172.21.15.44:0/611177553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc59c0cb150 0x7fc59c1f1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.883+0000 7fc59b59e700 1 --2- 172.21.15.44:0/611177553 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc59c0b57e0 0x7fc59c15a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.883+0000 7fc59b59e700 1 -- 172.21.15.44:0/611177553 >> 172.21.15.44:0/611177553 conn(0x7fc59c071ee0 msgr2=0x7fc59c15e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.887+0000 7fc59b59e700 1 -- 172.21.15.44:0/611177553 shutdown_connections 2024-09-13T18:33:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:25.887+0000 7fc59b59e700 1 -- 172.21.15.44:0/611177553 wait complete. 2024-09-13T18:33:25.894 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 47 2024-09-13T18:33:26.311 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:33:16.291148+0000', 'modified': '2024-09-13T18:33:25.522967+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 6858, 'mds_1': 6849}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6849': {'gid': 6849, 'name': 'a', 'rank': 1, 'incarnation': 47, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.44:6835/1608555972', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6833', 'nonce': 1608555972}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 1608555972}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_6858': {'gid': 6858, 'name': 'd', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.99:6837/3072614790', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6836', 'nonce': 3072614790}, {'type': 'v1', 'addr': '172.21.15.99:6837', 'nonce': 3072614790}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:33:26.312 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6849:up:creating 2024-09-13T18:33:27.312 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:33:27.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.431+0000 7f55cd4f5700 1 Processor -- start 2024-09-13T18:33:27.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.431+0000 7f55cd4f5700 1 -- start start 2024-09-13T18:33:27.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.431+0000 7f55cd4f5700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55c815ac40 0x7f55c806ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:27.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.431+0000 7f55cd4f5700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f55c80adb70 0x7f55c815ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:27.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.431+0000 7f55cd4f5700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c815b020 con 0x7f55c80ad710 2024-09-13T18:33:27.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.431+0000 7f55cd4f5700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c80b31e0 con 0x7f55c80adb70 2024-09-13T18:33:27.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.431+0000 7f55cd4f5700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80b3df0 con 0x7f55c815ac40 2024-09-13T18:33:27.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.431+0000 7f55c77fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f55c80adb70 0x7f55c815ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:27.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.431+0000 7f55c6ffd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55c815ac40 0x7f55c806ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:27.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.431+0000 7f55c77fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f55c80adb70 0x7f55c815ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44962/0 (socket says 172.21.15.44:44962) 2024-09-13T18:33:27.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.431+0000 7f55c77fe700 1 -- 172.21.15.44:0/655966174 learned_addr learned my addr 172.21.15.44:0/655966174 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:27.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.431+0000 7f55c77fe700 1 -- 172.21.15.44:0/655966174 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55c815ac40 msgr2=0x7f55c806ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:27.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.431+0000 7f55c77fe700 1 --2- 172.21.15.44:0/655966174 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55c815ac40 0x7f55c806ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:27.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.431+0000 7f55c77fe700 1 -- 172.21.15.44:0/655966174 >> v1:172.21.15.99:6789/0 conn(0x7f55c80ad710 legacy=0x7f55c815e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:27.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.431+0000 7f55c77fe700 1 -- 172.21.15.44:0/655966174 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c806a6f0 con 0x7f55c80adb70 2024-09-13T18:33:27.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.431+0000 7f55c77fe700 1 --2- 172.21.15.44:0/655966174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55c80adb70 0x7f55c815ee40 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f55c0009e80 tx=0x7f55c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=584d0cb573c7ee23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:27.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.431+0000 7f55c67fc700 1 -- 172.21.15.44:0/655966174 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c000e070 con 0x7f55c80adb70 2024-09-13T18:33:27.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.431+0000 7f55c67fc700 1 -- 172.21.15.44:0/655966174 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c000b8d0 con 0x7f55c80adb70 2024-09-13T18:33:27.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.431+0000 7f55c67fc700 1 -- 172.21.15.44:0/655966174 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c000bc80 con 0x7f55c80adb70 2024-09-13T18:33:27.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.431+0000 7f55cd4f5700 1 -- 172.21.15.44:0/655966174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55c80adb70 msgr2=0x7f55c815ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:27.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.431+0000 7f55cd4f5700 1 --2- 172.21.15.44:0/655966174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55c80adb70 0x7f55c815ee40 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f55c0009e80 tx=0x7f55c000b330 comp rx=0 tx=0).stop 2024-09-13T18:33:27.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55cd4f5700 1 -- 172.21.15.44:0/655966174 shutdown_connections 2024-09-13T18:33:27.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55cd4f5700 1 --2- 172.21.15.44:0/655966174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55c80adb70 0x7f55c815ee40 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:27.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55cd4f5700 1 --2- 172.21.15.44:0/655966174 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55c815ac40 0x7f55c806ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:27.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55cd4f5700 1 -- 172.21.15.44:0/655966174 >> 172.21.15.44:0/655966174 conn(0x7f55c80ce980 msgr2=0x7f55c80ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:27.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55cd4f5700 1 -- 172.21.15.44:0/655966174 shutdown_connections 2024-09-13T18:33:27.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55cd4f5700 1 -- 172.21.15.44:0/655966174 wait complete. 2024-09-13T18:33:27.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55cd4f5700 1 Processor -- start 2024-09-13T18:33:27.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55cd4f5700 1 -- start start 2024-09-13T18:33:27.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55cd4f5700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55c80ad710 0x7f55c8159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:27.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55cd4f5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55c80adb70 0x7f55c814c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:27.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55cd4f5700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55c815ac40 0x7f55c8070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:27.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55cd4f5700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c814c570 con 0x7f55c80adb70 2024-09-13T18:33:27.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55cd4f5700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c815b6a0 con 0x7f55c80ad710 2024-09-13T18:33:27.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55cd4f5700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c815b980 con 0x7f55c815ac40 2024-09-13T18:33:27.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55be7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55c80adb70 0x7f55c814c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:27.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55be7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55c80adb70 0x7f55c814c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44964/0 (socket says 172.21.15.44:44964) 2024-09-13T18:33:27.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55be7fc700 1 -- 172.21.15.44:0/3695134945 learned_addr learned my addr 172.21.15.44:0/3695134945 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:27.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55c6ffd700 1 --2- 172.21.15.44:0/3695134945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55c80ad710 0x7f55c8159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:27.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55c77fe700 1 --2- 172.21.15.44:0/3695134945 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55c815ac40 0x7f55c8070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:27.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55be7fc700 1 -- 172.21.15.44:0/3695134945 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55c815ac40 msgr2=0x7f55c8070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:27.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55be7fc700 1 --2- 172.21.15.44:0/3695134945 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55c815ac40 0x7f55c8070fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:27.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55be7fc700 1 -- 172.21.15.44:0/3695134945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55c80ad710 msgr2=0x7f55c8159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:27.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55be7fc700 1 --2- 172.21.15.44:0/3695134945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55c80ad710 0x7f55c8159660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:27.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.435+0000 7f55be7fc700 1 -- 172.21.15.44:0/3695134945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c0009b30 con 0x7f55c80adb70 2024-09-13T18:33:27.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.439+0000 7f55c77fe700 1 --2- 172.21.15.44:0/3695134945 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55c815ac40 0x7f55c8070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:27.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.439+0000 7f55c6ffd700 1 --2- 172.21.15.44:0/3695134945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55c80ad710 0x7f55c8159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:27.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.439+0000 7f55be7fc700 1 --2- 172.21.15.44:0/3695134945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55c80adb70 0x7f55c814c030 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f55b000c4d0 tx=0x7f55b000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:27.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.439+0000 7f55bffff700 1 -- 172.21.15.44:0/3695134945 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b00052d0 con 0x7f55c80adb70 2024-09-13T18:33:27.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.439+0000 7f55bffff700 1 -- 172.21.15.44:0/3695134945 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b0005430 con 0x7f55c80adb70 2024-09-13T18:33:27.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.439+0000 7f55cd4f5700 1 -- 172.21.15.44:0/3695134945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c815bc60 con 0x7f55c80adb70 2024-09-13T18:33:27.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.439+0000 7f55bffff700 1 -- 172.21.15.44:0/3695134945 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b00055a0 con 0x7f55c80adb70 2024-09-13T18:33:27.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.439+0000 7f55cd4f5700 1 -- 172.21.15.44:0/3695134945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c815c220 con 0x7f55c80adb70 2024-09-13T18:33:27.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.439+0000 7f55cd4f5700 1 -- 172.21.15.44:0/3695134945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c80adfe0 con 0x7f55c80adb70 2024-09-13T18:33:27.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.439+0000 7f55bffff700 1 -- 172.21.15.44:0/3695134945 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f55b00038a0 con 0x7f55c80adb70 2024-09-13T18:33:27.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.439+0000 7f55bffff700 1 --2- 172.21.15.44:0/3695134945 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f55a8066730 0x7f55a8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:27.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.443+0000 7f55bffff700 1 -- 172.21.15.44:0/3695134945 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55b0083460 con 0x7f55c80adb70 2024-09-13T18:33:27.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.443+0000 7f55c6ffd700 1 --2- 172.21.15.44:0/3695134945 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f55a8066730 0x7f55a8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:27.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.443+0000 7f55c6ffd700 1 --2- 172.21.15.44:0/3695134945 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f55a8066730 0x7f55a8068bf0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f55b8009ba0 tx=0x7f55b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:27.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.447+0000 7f55bffff700 1 -- 172.21.15.44:0/3695134945 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f55b0050870 con 0x7f55c80adb70 2024-09-13T18:33:27.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.651+0000 7f55cd4f5700 1 -- 172.21.15.44:0/3695134945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55c80acbc0 con 0x7f55c80adb70 2024-09-13T18:33:27.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.651+0000 7f55bffff700 1 -- 172.21.15.44:0/3695134945 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f55b0053e90 con 0x7f55c80adb70 2024-09-13T18:33:27.659 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:33:27.659 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":48,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2305930667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2305930667},{"type":"v1","addr":"172.21.15.99:6835","nonce":2305930667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1177460745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1177460745},{"type":"v1","addr":"172.21.15.44:6834","nonce":1177460745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:33:16.291148+0000","modified":"2024-09-13T18:33:26.525802+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6858,"mds_1":6849},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6849":{"gid":6849,"name":"a","rank":1,"incarnation":47,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6835/1608555972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1608555972},{"type":"v1","addr":"172.21.15.44:6835","nonce":1608555972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6858":{"gid":6858,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/3072614790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3072614790},{"type":"v1","addr":"172.21.15.99:6837","nonce":3072614790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:33:27.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.655+0000 7f55cd4f5700 1 -- 172.21.15.44:0/3695134945 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f55a8066730 msgr2=0x7f55a8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:27.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.655+0000 7f55cd4f5700 1 --2- 172.21.15.44:0/3695134945 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f55a8066730 0x7f55a8068bf0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f55b8009ba0 tx=0x7f55b8008040 comp rx=0 tx=0).stop 2024-09-13T18:33:27.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.655+0000 7f55cd4f5700 1 -- 172.21.15.44:0/3695134945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55c80adb70 msgr2=0x7f55c814c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:27.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.655+0000 7f55cd4f5700 1 --2- 172.21.15.44:0/3695134945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55c80adb70 0x7f55c814c030 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f55b000c4d0 tx=0x7f55b000c890 comp rx=0 tx=0).stop 2024-09-13T18:33:27.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.655+0000 7f55cd4f5700 1 -- 172.21.15.44:0/3695134945 shutdown_connections 2024-09-13T18:33:27.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.655+0000 7f55cd4f5700 1 --2- 172.21.15.44:0/3695134945 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f55a8066730 0x7f55a8068bf0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:27.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.655+0000 7f55cd4f5700 1 --2- 172.21.15.44:0/3695134945 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55c815ac40 0x7f55c8070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:27.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.655+0000 7f55cd4f5700 1 --2- 172.21.15.44:0/3695134945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55c80adb70 0x7f55c814c030 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:27.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.655+0000 7f55cd4f5700 1 --2- 172.21.15.44:0/3695134945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55c80ad710 0x7f55c8159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:27.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.655+0000 7f55cd4f5700 1 -- 172.21.15.44:0/3695134945 >> 172.21.15.44:0/3695134945 conn(0x7f55c80ce980 msgr2=0x7f55c806c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:27.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.655+0000 7f55cd4f5700 1 -- 172.21.15.44:0/3695134945 shutdown_connections 2024-09-13T18:33:27.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:27.655+0000 7f55cd4f5700 1 -- 172.21.15.44:0/3695134945 wait complete. 2024-09-13T18:33:27.663 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 48 2024-09-13T18:33:28.077 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:33:16.291148+0000', 'modified': '2024-09-13T18:33:26.525802+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 6858, 'mds_1': 6849}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6849': {'gid': 6849, 'name': 'a', 'rank': 1, 'incarnation': 47, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.44:6835/1608555972', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6833', 'nonce': 1608555972}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 1608555972}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_6858': {'gid': 6858, 'name': 'd', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.99:6837/3072614790', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6836', 'nonce': 3072614790}, {'type': 'v1', 'addr': '172.21.15.99:6837', 'nonce': 3072614790}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:33:28.077 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2024-09-13T18:33:28.078 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:33:28.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.195+0000 7fefd7ab3700 1 Processor -- start 2024-09-13T18:33:28.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.195+0000 7fefd7ab3700 1 -- start start 2024-09-13T18:33:28.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.199+0000 7fefd7ab3700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fefd015af90 0x7fefd00b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.199+0000 7fefd7ab3700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd00b3160 con 0x7fefd00b2d60 2024-09-13T18:33:28.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.199+0000 7fefd7ab3700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd00b3ed0 con 0x7fefd015abb0 2024-09-13T18:33:28.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.199+0000 7fefd7ab3700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd00b41b0 con 0x7fefd015af90 2024-09-13T18:33:28.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.199+0000 7fefd6050700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fefd00b2d60 0x7fefd00b4f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49794/0 (socket says 172.21.15.44:49794) 2024-09-13T18:33:28.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.199+0000 7fefd6050700 1 -- 172.21.15.44:0/3401713742 learned_addr learned my addr 172.21.15.44:0/3401713742 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:28.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.199+0000 7fefd504e700 1 --2- 172.21.15.44:0/3401713742 >> v2:172.21.15.44:3300/0 conn(0x7fefd015af90 0x7fefd00b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.199+0000 7fefd484d700 1 -- 172.21.15.44:0/3401713742 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2814886471 0 0) 0x7fefd00b3160 con 0x7fefd00b2d60 2024-09-13T18:33:28.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.199+0000 7fefd484d700 1 -- 172.21.15.44:0/3401713742 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefb80035d0 con 0x7fefd00b2d60 2024-09-13T18:33:28.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.199+0000 7fefd504e700 1 -- 172.21.15.44:0/3401713742 >> v1:172.21.15.99:6789/0 conn(0x7fefd015abb0 legacy=0x7fefd006e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.199+0000 7fefd504e700 1 -- 172.21.15.44:0/3401713742 >> v1:172.21.15.44:6789/0 conn(0x7fefd00b2d60 legacy=0x7fefd00b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.199+0000 7fefd504e700 1 -- 172.21.15.44:0/3401713742 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd00b4490 con 0x7fefd015af90 2024-09-13T18:33:28.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.199+0000 7fefd504e700 1 --2- 172.21.15.44:0/3401713742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd015af90 0x7fefd00b2820 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fefcc009850 tx=0x7fefcc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c40658efe97e3be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:28.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.199+0000 7fefd484d700 1 -- 172.21.15.44:0/3401713742 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc011830 con 0x7fefd015af90 2024-09-13T18:33:28.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.199+0000 7fefd484d700 1 -- 172.21.15.44:0/3401713742 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefcc011990 con 0x7fefd015af90 2024-09-13T18:33:28.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.199+0000 7fefd484d700 1 -- 172.21.15.44:0/3401713742 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc011d40 con 0x7fefd015af90 2024-09-13T18:33:28.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.199+0000 7fefd7ab3700 1 -- 172.21.15.44:0/3401713742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd015af90 msgr2=0x7fefd00b2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.199+0000 7fefd7ab3700 1 --2- 172.21.15.44:0/3401713742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd015af90 0x7fefd00b2820 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fefcc009850 tx=0x7fefcc009b60 comp rx=0 tx=0).stop 2024-09-13T18:33:28.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.199+0000 7fefd7ab3700 1 -- 172.21.15.44:0/3401713742 shutdown_connections 2024-09-13T18:33:28.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.199+0000 7fefd7ab3700 1 --2- 172.21.15.44:0/3401713742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd015af90 0x7fefd00b2820 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.199+0000 7fefd7ab3700 1 -- 172.21.15.44:0/3401713742 >> 172.21.15.44:0/3401713742 conn(0x7fefd00d0b30 msgr2=0x7fefd00d0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:28.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.199+0000 7fefd7ab3700 1 -- 172.21.15.44:0/3401713742 shutdown_connections 2024-09-13T18:33:28.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.199+0000 7fefd7ab3700 1 -- 172.21.15.44:0/3401713742 wait complete. 2024-09-13T18:33:28.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.203+0000 7fefd7ab3700 1 Processor -- start 2024-09-13T18:33:28.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.203+0000 7fefd7ab3700 1 -- start start 2024-09-13T18:33:28.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.203+0000 7fefd7ab3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fefd00b2d60 0x7fefd0156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.203+0000 7fefd7ab3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd015abb0 0x7fefd0155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.203+0000 7fefd7ab3700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd015af90 0x7fefd01583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.203+0000 7fefd7ab3700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd0157010 con 0x7fefd015abb0 2024-09-13T18:33:28.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.203+0000 7fefd7ab3700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd0155ff0 con 0x7fefd015af90 2024-09-13T18:33:28.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.203+0000 7fefd7ab3700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd006cea0 con 0x7fefd00b2d60 2024-09-13T18:33:28.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.203+0000 7fefd504e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd015abb0 0x7fefd0155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.203+0000 7fefd504e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd015abb0 0x7fefd0155ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44990/0 (socket says 172.21.15.44:44990) 2024-09-13T18:33:28.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.203+0000 7fefd504e700 1 -- 172.21.15.44:0/3757978024 learned_addr learned my addr 172.21.15.44:0/3757978024 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:28.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.203+0000 7fefd584f700 1 --2- 172.21.15.44:0/3757978024 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fefd00b2d60 0x7fefd0156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.203+0000 7fefd6050700 1 --2- 172.21.15.44:0/3757978024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd015af90 0x7fefd01583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.207+0000 7fefd504e700 1 -- 172.21.15.44:0/3757978024 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fefd00b2d60 msgr2=0x7fefd0156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.207+0000 7fefd504e700 1 --2- 172.21.15.44:0/3757978024 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fefd00b2d60 0x7fefd0156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.207+0000 7fefd504e700 1 -- 172.21.15.44:0/3757978024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd015af90 msgr2=0x7fefd01583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.207+0000 7fefd504e700 1 --2- 172.21.15.44:0/3757978024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd015af90 0x7fefd01583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.207+0000 7fefd504e700 1 -- 172.21.15.44:0/3757978024 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefcc0094b0 con 0x7fefd015abb0 2024-09-13T18:33:28.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.207+0000 7fefd504e700 1 --2- 172.21.15.44:0/3757978024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd015abb0 0x7fefd0155ab0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fefcc014040 tx=0x7fefcc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:28.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.207+0000 7fefc67fc700 1 -- 172.21.15.44:0/3757978024 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc019980 con 0x7fefd015abb0 2024-09-13T18:33:28.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.207+0000 7fefc67fc700 1 -- 172.21.15.44:0/3757978024 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefcc01e070 con 0x7fefd015abb0 2024-09-13T18:33:28.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.207+0000 7fefd7ab3700 1 -- 172.21.15.44:0/3757978024 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd01499d0 con 0x7fefd015abb0 2024-09-13T18:33:28.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.207+0000 7fefc67fc700 1 -- 172.21.15.44:0/3757978024 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc019d20 con 0x7fefd015abb0 2024-09-13T18:33:28.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.207+0000 7fefd7ab3700 1 -- 172.21.15.44:0/3757978024 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd0149f90 con 0x7fefd015abb0 2024-09-13T18:33:28.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefc67fc700 1 -- 172.21.15.44:0/3757978024 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fefcc02d450 con 0x7fefd015abb0 2024-09-13T18:33:28.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefdad64740 1 Processor -- start 2024-09-13T18:33:28.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefc67fc700 1 --2- 172.21.15.44:0/3757978024 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fefbc066730 0x7fefbc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefdad64740 1 -- start start 2024-09-13T18:33:28.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefc67fc700 1 -- 172.21.15.44:0/3757978024 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefcc085110 con 0x7fefd015abb0 2024-09-13T18:33:28.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefd6050700 1 --2- 172.21.15.44:0/3757978024 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fefbc066730 0x7fefbc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefdad64740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bc5da0 0x1bc6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefdad64740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1ba4d00 0x1b8e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefd6050700 1 --2- 172.21.15.44:0/3757978024 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fefbc066730 0x7fefbc068bf0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fefc00011e0 tx=0x7fefc0007cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:28.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefdad64740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bc66c0 0x1b8edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefdad64740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x1aedd80 con 0x1ba4d00 2024-09-13T18:33:28.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefdad64740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x1aeb510 con 0x1bc5da0 2024-09-13T18:33:28.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefdad64740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ae6e00 con 0x1bc66c0 2024-09-13T18:33:28.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefd504e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1ba4d00 0x1b8e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefd504e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1ba4d00 0x1b8e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44996/0 (socket says 172.21.15.44:44996) 2024-09-13T18:33:28.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefd504e700 1 -- 172.21.15.44:0/1719094734 learned_addr learned my addr 172.21.15.44:0/1719094734 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:28.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefd6050700 1 --2- 172.21.15.44:0/1719094734 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bc66c0 0x1b8edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefd584f700 1 --2- 172.21.15.44:0/1719094734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bc5da0 0x1bc6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefd504e700 1 -- 172.21.15.44:0/1719094734 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bc66c0 msgr2=0x1b8edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:28.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefd504e700 1 --2- 172.21.15.44:0/1719094734 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bc66c0 0x1b8edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefd504e700 1 -- 172.21.15.44:0/1719094734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bc5da0 msgr2=0x1bc6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:28.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefd504e700 1 --2- 172.21.15.44:0/1719094734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bc5da0 0x1bc6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefd504e700 1 -- 172.21.15.44:0/1719094734 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1959960 con 0x1ba4d00 2024-09-13T18:33:28.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefd6050700 1 --2- 172.21.15.44:0/1719094734 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bc66c0 0x1b8edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:28.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefd504e700 1 --2- 172.21.15.44:0/1719094734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1ba4d00 0x1b8e890 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fefcc05dff0 tx=0x7fefcc055a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d5b51c1f7604f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:28.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefb77fe700 1 -- 172.21.15.44:0/1719094734 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc056830 con 0x1ba4d00 2024-09-13T18:33:28.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefb77fe700 1 -- 172.21.15.44:0/1719094734 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefcc058070 con 0x1ba4d00 2024-09-13T18:33:28.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.211+0000 7fefb77fe700 1 -- 172.21.15.44:0/1719094734 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc056130 con 0x1ba4d00 2024-09-13T18:33:28.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.215+0000 7fefdad64740 1 -- 172.21.15.44:0/1719094734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1ba4d00 msgr2=0x1b8e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.215+0000 7fefdad64740 1 --2- 172.21.15.44:0/1719094734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1ba4d00 0x1b8e890 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fefcc05dff0 tx=0x7fefcc055a90 comp rx=0 tx=0).stop 2024-09-13T18:33:28.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.215+0000 7fefdad64740 1 -- 172.21.15.44:0/1719094734 shutdown_connections 2024-09-13T18:33:28.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.215+0000 7fefdad64740 1 --2- 172.21.15.44:0/1719094734 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1bc66c0 0x1b8edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.215+0000 7fefdad64740 1 --2- 172.21.15.44:0/1719094734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1ba4d00 0x1b8e890 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.215+0000 7fefdad64740 1 --2- 172.21.15.44:0/1719094734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bc5da0 0x1bc6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.215+0000 7fefdad64740 1 -- 172.21.15.44:0/1719094734 >> 172.21.15.44:0/1719094734 conn(0x190e4d0 msgr2=0x1ba7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:28.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.215+0000 7fefdad64740 1 -- 172.21.15.44:0/1719094734 shutdown_connections 2024-09-13T18:33:28.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.215+0000 7fefdad64740 1 -- 172.21.15.44:0/1719094734 wait complete. 2024-09-13T18:33:28.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.215+0000 7fefdad64740 1 -- start start 2024-09-13T18:33:28.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.215+0000 7fefdad64740 1 Processor -- start 2024-09-13T18:33:28.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.215+0000 7fefdad64740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1ba4d00 0x1bc6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.215+0000 7fefdad64740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bc5da0 0x1bcc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefdad64740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bc66c0 0x1bcef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefdad64740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x1aa4730 con 0x1bc66c0 2024-09-13T18:33:28.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefdad64740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x1aaa5b0 con 0x1bc5da0 2024-09-13T18:33:28.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefdad64740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x1992aa0 con 0x1ba4d00 2024-09-13T18:33:28.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefdad64740 10 client.0 _ll_register_callbacks cb 0x1ae0610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:33:28.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefd6050700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bc66c0 0x1bcef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefd6050700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bc66c0 0x1bcef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45006/0 (socket says 172.21.15.44:45006) 2024-09-13T18:33:28.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefd584f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1ba4d00 0x1bc6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefd6050700 1 -- 172.21.15.44:0/72531504 learned_addr learned my addr 172.21.15.44:0/72531504 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:28.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefd504e700 1 --2- 172.21.15.44:0/72531504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bc5da0 0x1bcc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefd6050700 1 -- 172.21.15.44:0/72531504 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1ba4d00 msgr2=0x1bc6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:28.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefd6050700 1 --2- 172.21.15.44:0/72531504 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1ba4d00 0x1bc6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefd6050700 1 -- 172.21.15.44:0/72531504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bc5da0 msgr2=0x1bcc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:28.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefd6050700 1 --2- 172.21.15.44:0/72531504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bc5da0 0x1bcc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefd6050700 1 -- 172.21.15.44:0/72531504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd0149f90 con 0x1bc66c0 2024-09-13T18:33:28.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefd6050700 1 --2- 172.21.15.44:0/72531504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bc66c0 0x1bcef90 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fefc0006680 tx=0x7fefc0001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0efe068452fceed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:28.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefb4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-13T18:33:28.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefb4ff9700 1 -- 172.21.15.44:0/72531504 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc0001600 con 0x1bc66c0 2024-09-13T18:33:28.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefb4ff9700 1 -- 172.21.15.44:0/72531504 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefc001b070 con 0x1bc66c0 2024-09-13T18:33:28.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefdad64740 1 -- 172.21.15.44:0/72531504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x191b1e0 con 0x1bc66c0 2024-09-13T18:33:28.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefb4ff9700 1 -- 172.21.15.44:0/72531504 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefc0001760 con 0x1bc66c0 2024-09-13T18:33:28.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefdad64740 10 client.7041 fetch_fsmap learned FSMap version 48 2024-09-13T18:33:28.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefdad64740 1 -- 172.21.15.44:0/72531504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x1aad220 con 0x1bc66c0 2024-09-13T18:33:28.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefb4ff9700 1 -- 172.21.15.44:0/72531504 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x191b1e0 con 0x1bc66c0 2024-09-13T18:33:28.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefb4ff9700 1 -- 172.21.15.44:0/72531504 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 48) v1 ==== 3126+0+0 (secure 0 0 0) 0x7fefc00018c0 con 0x1bc66c0 2024-09-13T18:33:28.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefdad64740 10 client.7041 fetch_fsmap finished waiting for FSMap version 48 2024-09-13T18:33:28.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefdad64740 10 client.7041 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:33:28.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefdad64740 20 client.7041 populate_metadata read hostname 'smithi044' 2024-09-13T18:33:28.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefdad64740 1 --2- 172.21.15.44:0/72531504 >> [v2:172.21.15.44:6833/1608555972,v1:172.21.15.44:6835/1608555972] conn(0x1b7f5f0 0x1b7f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefdad64740 4 client.7041 mds_command: new command op to 6849 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:33:28.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefdad64740 1 -- 172.21.15.44:0/72531504 --> [v2:172.21.15.44:6833/1608555972,v1:172.21.15.44:6835/1608555972] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1965460 con 0x1b7f5f0 2024-09-13T18:33:28.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefd584f700 1 --2- 172.21.15.44:0/72531504 >> [v2:172.21.15.44:6833/1608555972,v1:172.21.15.44:6835/1608555972] conn(0x1b7f5f0 0x1b7f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefb4ff9700 10 client.7041 ms_handle_connect on v2:172.21.15.44:6833/1608555972 2024-09-13T18:33:28.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefd584f700 1 --2- 172.21.15.44:0/72531504 >> [v2:172.21.15.44:6833/1608555972,v1:172.21.15.44:6835/1608555972] conn(0x1b7f5f0 0x1b7f9d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f146077c14166777 server_cookie=1151a8414ab47ada in_seq=0 out_seq=0 2024-09-13T18:33:28.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefb4ff9700 1 -- 172.21.15.44:0/72531504 <== mds.1 v2:172.21.15.44:6833/1608555972 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x1965460 con 0x1b7f5f0 2024-09-13T18:33:28.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.219+0000 7fefb4ff9700 10 client.7041 handle_command_reply: tid=0 2024-09-13T18:33:28.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.223+0000 7fefdad64740 1 client.7041 shutdown 2024-09-13T18:33:28.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.223+0000 7fefdad64740 1 -- 172.21.15.44:0/72531504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bc66c0 msgr2=0x1bcef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.223+0000 7fefdad64740 1 --2- 172.21.15.44:0/72531504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bc66c0 0x1bcef90 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fefc0006680 tx=0x7fefc0001150 comp rx=0 tx=0).stop 2024-09-13T18:33:28.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.223+0000 7fefdad64740 1 -- 172.21.15.44:0/72531504 shutdown_connections 2024-09-13T18:33:28.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.223+0000 7fefdad64740 1 --2- 172.21.15.44:0/72531504 >> [v2:172.21.15.44:6833/1608555972,v1:172.21.15.44:6835/1608555972] conn(0x1b7f5f0 0x1b7f9d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.223+0000 7fefdad64740 1 --2- 172.21.15.44:0/72531504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bc66c0 0x1bcef90 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.223+0000 7fefdad64740 1 --2- 172.21.15.44:0/72531504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bc5da0 0x1bcc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.223+0000 7fefdad64740 1 --2- 172.21.15.44:0/72531504 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1ba4d00 0x1bc6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.223+0000 7fefdad64740 1 -- 172.21.15.44:0/72531504 >> 172.21.15.44:0/72531504 conn(0x190e4d0 msgr2=0x1ba1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:28.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.223+0000 7fefb4ff9700 0 client.7041 ms_handle_reset on v2:172.21.15.44:6833/1608555972 2024-09-13T18:33:28.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.223+0000 7fefdad64740 1 -- 172.21.15.44:0/72531504 shutdown_connections 2024-09-13T18:33:28.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.223+0000 7fefdad64740 1 -- 172.21.15.44:0/72531504 wait complete. 2024-09-13T18:33:28.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.223+0000 7fefdad64740 20 client.7041 trim_cache size 0 max 16384 2024-09-13T18:33:28.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefdad64740 1 Processor -- start 2024-09-13T18:33:28.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefdad64740 1 -- start start 2024-09-13T18:33:28.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefdad64740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1ba4d00 0x1b7c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefdad64740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bc5da0 0x1b7cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefdad64740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bc66c0 0x1bc6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefdad64740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b14d90 con 0x1bc5da0 2024-09-13T18:33:28.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefdad64740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a8d950 con 0x1bc66c0 2024-09-13T18:33:28.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefdad64740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x1aa8e90 con 0x1ba4d00 2024-09-13T18:33:28.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefd504e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bc5da0 0x1b7cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefd504e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bc5da0 0x1b7cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45012/0 (socket says 172.21.15.44:45012) 2024-09-13T18:33:28.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefd504e700 1 -- 172.21.15.44:0/4065523962 learned_addr learned my addr 172.21.15.44:0/4065523962 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:28.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefd6050700 1 --2- 172.21.15.44:0/4065523962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bc66c0 0x1bc6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefd584f700 1 --2- 172.21.15.44:0/4065523962 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1ba4d00 0x1b7c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefd504e700 1 -- 172.21.15.44:0/4065523962 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1ba4d00 msgr2=0x1b7c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:28.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefd504e700 1 --2- 172.21.15.44:0/4065523962 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1ba4d00 0x1b7c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefd504e700 1 -- 172.21.15.44:0/4065523962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bc66c0 msgr2=0x1bc6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:28.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefd504e700 1 --2- 172.21.15.44:0/4065523962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bc66c0 0x1bc6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefd504e700 1 -- 172.21.15.44:0/4065523962 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1a93450 con 0x1bc5da0 2024-09-13T18:33:28.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefd504e700 1 --2- 172.21.15.44:0/4065523962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bc5da0 0x1b7cc50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fefcc083630 tx=0x7fefcc020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ec832a717e0a92 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:28.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefb7fff700 1 -- 172.21.15.44:0/4065523962 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc019e80 con 0x1bc5da0 2024-09-13T18:33:28.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefb7fff700 1 -- 172.21.15.44:0/4065523962 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefcc056830 con 0x1bc5da0 2024-09-13T18:33:28.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefb7fff700 1 -- 172.21.15.44:0/4065523962 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc059f60 con 0x1bc5da0 2024-09-13T18:33:28.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefdad64740 1 -- 172.21.15.44:0/4065523962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bc5da0 msgr2=0x1b7cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefdad64740 1 --2- 172.21.15.44:0/4065523962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bc5da0 0x1b7cc50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fefcc083630 tx=0x7fefcc020000 comp rx=0 tx=0).stop 2024-09-13T18:33:28.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefdad64740 1 -- 172.21.15.44:0/4065523962 shutdown_connections 2024-09-13T18:33:28.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefdad64740 1 --2- 172.21.15.44:0/4065523962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bc66c0 0x1bc6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefdad64740 1 --2- 172.21.15.44:0/4065523962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bc5da0 0x1b7cc50 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefdad64740 1 --2- 172.21.15.44:0/4065523962 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1ba4d00 0x1b7c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefdad64740 1 -- 172.21.15.44:0/4065523962 >> 172.21.15.44:0/4065523962 conn(0x190e4d0 msgr2=0x1ba4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefdad64740 1 -- 172.21.15.44:0/4065523962 shutdown_connections 2024-09-13T18:33:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.243+0000 7fefdad64740 1 -- 172.21.15.44:0/4065523962 wait complete. 2024-09-13T18:33:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.247+0000 7fefdad64740 1 -- start start 2024-09-13T18:33:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.247+0000 7fefdad64740 1 Processor -- start 2024-09-13T18:33:28.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.247+0000 7fefdad64740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1ba4d00 0x1bcb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.247+0000 7fefdad64740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bc5da0 0x1c26f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.247+0000 7fefdad64740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bc66c0 0x1c28140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.247+0000 7fefdad64740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bca9c0 con 0x1bc5da0 2024-09-13T18:33:28.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.247+0000 7fefdad64740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bcae90 con 0x1bc66c0 2024-09-13T18:33:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.247+0000 7fefdad64740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b7ef20 con 0x1ba4d00 2024-09-13T18:33:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.247+0000 7fefd504e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bc5da0 0x1c26f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.247+0000 7fefdad64740 10 client.0 _ll_register_callbacks cb 0x1b3d710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:33:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.247+0000 7fefd504e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bc5da0 0x1c26f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45018/0 (socket says 172.21.15.44:45018) 2024-09-13T18:33:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.247+0000 7fefd584f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1ba4d00 0x1bcb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.247+0000 7fefd504e700 1 -- 172.21.15.44:0/1952923282 learned_addr learned my addr 172.21.15.44:0/1952923282 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.247+0000 7fefd6050700 1 --2- 172.21.15.44:0/1952923282 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bc66c0 0x1c28140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.247+0000 7fefd504e700 1 -- 172.21.15.44:0/1952923282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1ba4d00 msgr2=0x1bcb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.247+0000 7fefd504e700 1 --2- 172.21.15.44:0/1952923282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1ba4d00 0x1bcb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.247+0000 7fefd504e700 1 -- 172.21.15.44:0/1952923282 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bc66c0 msgr2=0x1c28140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.247+0000 7fefd504e700 1 --2- 172.21.15.44:0/1952923282 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bc66c0 0x1c28140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.247+0000 7fefd504e700 1 -- 172.21.15.44:0/1952923282 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1959960 con 0x1bc5da0 2024-09-13T18:33:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.247+0000 7fefd6050700 1 --2- 172.21.15.44:0/1952923282 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bc66c0 0x1c28140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:28.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.247+0000 7fefd504e700 1 --2- 172.21.15.44:0/1952923282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bc5da0 0x1c26f30 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fefcc000c00 tx=0x7fefcc011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc5d1d18b8e40d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:28.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.247+0000 7fefb4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-13T18:33:28.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefb4ff9700 1 -- 172.21.15.44:0/1952923282 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc019e80 con 0x1bc5da0 2024-09-13T18:33:28.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefb4ff9700 1 -- 172.21.15.44:0/1952923282 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefcc082070 con 0x1bc5da0 2024-09-13T18:33:28.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefdad64740 1 -- 172.21.15.44:0/1952923282 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1bcc650 con 0x1bc5da0 2024-09-13T18:33:28.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefb4ff9700 1 -- 172.21.15.44:0/1952923282 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefcc05e520 con 0x1bc5da0 2024-09-13T18:33:28.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefdad64740 10 client.7047 fetch_fsmap learned FSMap version 48 2024-09-13T18:33:28.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefdad64740 1 -- 172.21.15.44:0/1952923282 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x1a87720 con 0x1bc5da0 2024-09-13T18:33:28.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefb4ff9700 1 -- 172.21.15.44:0/1952923282 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1bcc650 con 0x1bc5da0 2024-09-13T18:33:28.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefb4ff9700 1 -- 172.21.15.44:0/1952923282 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 48) v1 ==== 3126+0+0 (secure 0 0 0) 0x7fefcc07c030 con 0x1bc5da0 2024-09-13T18:33:28.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefdad64740 10 client.7047 fetch_fsmap finished waiting for FSMap version 48 2024-09-13T18:33:28.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefdad64740 10 client.7047 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:33:28.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefdad64740 20 client.7047 populate_metadata read hostname 'smithi044' 2024-09-13T18:33:28.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefdad64740 1 --2- 172.21.15.44:0/1952923282 >> [v2:172.21.15.44:6833/1608555972,v1:172.21.15.44:6835/1608555972] conn(0x1c28680 0x1c28a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefdad64740 4 client.7047 mds_command: new command op to 6849 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:33:28.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefdad64740 1 -- 172.21.15.44:0/1952923282 --> [v2:172.21.15.44:6833/1608555972,v1:172.21.15.44:6835/1608555972] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fefcc058070 con 0x1c28680 2024-09-13T18:33:28.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefd584f700 1 --2- 172.21.15.44:0/1952923282 >> [v2:172.21.15.44:6833/1608555972,v1:172.21.15.44:6835/1608555972] conn(0x1c28680 0x1c28a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefb4ff9700 10 client.7047 ms_handle_connect on v2:172.21.15.44:6833/1608555972 2024-09-13T18:33:28.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefd584f700 1 --2- 172.21.15.44:0/1952923282 >> [v2:172.21.15.44:6833/1608555972,v1:172.21.15.44:6835/1608555972] conn(0x1c28680 0x1c28a60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b5614722b588405c server_cookie=5f8810423da82350 in_seq=0 out_seq=0 2024-09-13T18:33:28.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefb4ff9700 1 -- 172.21.15.44:0/1952923282 <== mds.1 v2:172.21.15.44:6833/1608555972 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7fefcc058070 con 0x1c28680 2024-09-13T18:33:28.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefb4ff9700 10 client.7047 handle_command_reply: tid=0 2024-09-13T18:33:28.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefdad64740 1 client.7047 shutdown 2024-09-13T18:33:28.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefdad64740 1 -- 172.21.15.44:0/1952923282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bc5da0 msgr2=0x1c26f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefdad64740 1 --2- 172.21.15.44:0/1952923282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bc5da0 0x1c26f30 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fefcc000c00 tx=0x7fefcc011e30 comp rx=0 tx=0).stop 2024-09-13T18:33:28.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefdad64740 1 -- 172.21.15.44:0/1952923282 shutdown_connections 2024-09-13T18:33:28.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefdad64740 1 --2- 172.21.15.44:0/1952923282 >> [v2:172.21.15.44:6833/1608555972,v1:172.21.15.44:6835/1608555972] conn(0x1c28680 0x1c28a60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefdad64740 1 --2- 172.21.15.44:0/1952923282 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1bc66c0 0x1c28140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefdad64740 1 --2- 172.21.15.44:0/1952923282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1bc5da0 0x1c26f30 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefb4ff9700 0 client.7047 ms_handle_reset on v2:172.21.15.44:6833/1608555972 2024-09-13T18:33:28.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefdad64740 1 --2- 172.21.15.44:0/1952923282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1ba4d00 0x1bcb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefdad64740 1 -- 172.21.15.44:0/1952923282 >> 172.21.15.44:0/1952923282 conn(0x190e4d0 msgr2=0x1bc5310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:28.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefdad64740 1 -- 172.21.15.44:0/1952923282 shutdown_connections 2024-09-13T18:33:28.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefdad64740 1 -- 172.21.15.44:0/1952923282 wait complete. 2024-09-13T18:33:28.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefdad64740 20 client.7047 trim_cache size 0 max 16384 2024-09-13T18:33:28.263 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:33:28.263 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "c8e1d12d-7fb9-4a33-982e-b895bb77262c", 2024-09-13T18:33:28.263 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 1, 2024-09-13T18:33:28.263 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 6849, 2024-09-13T18:33:28.263 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-13T18:33:28.263 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-13T18:33:28.263 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-13T18:33:28.263 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 2.7289834690000001, 2024-09-13T18:33:28.263 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 48, 2024-09-13T18:33:28.263 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 63, 2024-09-13T18:33:28.263 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 63, 2024-09-13T18:33:28.264 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 16.458849707999999 2024-09-13T18:33:28.264 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:33:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefd7ab3700 1 -- 172.21.15.44:0/3757978024 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fefbc066730 msgr2=0x7fefbc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefd7ab3700 1 --2- 172.21.15.44:0/3757978024 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fefbc066730 0x7fefbc068bf0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fefc00011e0 tx=0x7fefc0007cb0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefd7ab3700 1 -- 172.21.15.44:0/3757978024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd015abb0 msgr2=0x7fefd0155ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.251+0000 7fefd7ab3700 1 --2- 172.21.15.44:0/3757978024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd015abb0 0x7fefd0155ab0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fefcc014040 tx=0x7fefcc004770 comp rx=0 tx=0).stop 2024-09-13T18:33:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.255+0000 7fefd7ab3700 1 -- 172.21.15.44:0/3757978024 shutdown_connections 2024-09-13T18:33:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.255+0000 7fefd7ab3700 1 --2- 172.21.15.44:0/3757978024 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fefbc066730 0x7fefbc068bf0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.255+0000 7fefd7ab3700 1 --2- 172.21.15.44:0/3757978024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd015af90 0x7fefd01583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.255+0000 7fefd7ab3700 1 --2- 172.21.15.44:0/3757978024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd015abb0 0x7fefd0155ab0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.255+0000 7fefd7ab3700 1 --2- 172.21.15.44:0/3757978024 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fefd00b2d60 0x7fefd0156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.255+0000 7fefd7ab3700 1 -- 172.21.15.44:0/3757978024 >> 172.21.15.44:0/3757978024 conn(0x7fefd00d0b30 msgr2=0x7fefd00b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.255+0000 7fefd7ab3700 1 -- 172.21.15.44:0/3757978024 shutdown_connections 2024-09-13T18:33:28.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.255+0000 7fefd7ab3700 1 -- 172.21.15.44:0/3757978024 wait complete. 2024-09-13T18:33:28.276 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-13T18:33:28.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.391+0000 7f2448b82700 1 Processor -- start 2024-09-13T18:33:28.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.391+0000 7f2448b82700 1 -- start start 2024-09-13T18:33:28.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f2448b82700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f244415cda0 0x7f244406b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f2448b82700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24440ceb70 0x7f24440b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f2448b82700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24440b8430 con 0x7f244406a520 2024-09-13T18:33:28.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f2448b82700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f244406be40 con 0x7f244415cda0 2024-09-13T18:33:28.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f2448b82700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24440cf350 con 0x7f24440ceb70 2024-09-13T18:33:28.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f2443fff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f244406a520 0x7f24440d1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49800/0 (socket says 172.21.15.44:49800) 2024-09-13T18:33:28.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f2443fff700 1 -- 172.21.15.44:0/3483635719 learned_addr learned my addr 172.21.15.44:0/3483635719 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:33:28.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f24437fe700 1 --2- 172.21.15.44:0/3483635719 >> v2:172.21.15.99:3300/0 conn(0x7f244415cda0 0x7f244406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f2442ffd700 1 --2- 172.21.15.44:0/3483635719 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24440ceb70 0x7f24440b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f24427fc700 1 -- 172.21.15.44:0/3483635719 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388746345 0 0) 0x7f24440b8430 con 0x7f244406a520 2024-09-13T18:33:28.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f24427fc700 1 -- 172.21.15.44:0/3483635719 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f242c0035d0 con 0x7f244406a520 2024-09-13T18:33:28.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f24437fe700 1 -- 172.21.15.44:0/3483635719 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24440ceb70 msgr2=0x7f24440b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:28.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f24437fe700 1 --2- 172.21.15.44:0/3483635719 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24440ceb70 0x7f24440b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f24437fe700 1 -- 172.21.15.44:0/3483635719 >> v1:172.21.15.44:6789/0 conn(0x7f244406a520 legacy=0x7f24440d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f24437fe700 1 -- 172.21.15.44:0/3483635719 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24440d0880 con 0x7f244415cda0 2024-09-13T18:33:28.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f24437fe700 1 --2- 172.21.15.44:0/3483635719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f244415cda0 0x7f244406b900 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2434009d90 tx=0x7f243400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc5eacd2a5d16087 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:28.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f24427fc700 1 -- 172.21.15.44:0/3483635719 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243400e070 con 0x7f244415cda0 2024-09-13T18:33:28.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f24427fc700 1 -- 172.21.15.44:0/3483635719 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243400bb20 con 0x7f244415cda0 2024-09-13T18:33:28.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f24427fc700 1 -- 172.21.15.44:0/3483635719 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434012430 con 0x7f244415cda0 2024-09-13T18:33:28.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f2448b82700 1 -- 172.21.15.44:0/3483635719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f244415cda0 msgr2=0x7f244406b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f2448b82700 1 --2- 172.21.15.44:0/3483635719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f244415cda0 0x7f244406b900 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2434009d90 tx=0x7f243400b330 comp rx=0 tx=0).stop 2024-09-13T18:33:28.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f2448b82700 1 -- 172.21.15.44:0/3483635719 shutdown_connections 2024-09-13T18:33:28.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f2448b82700 1 --2- 172.21.15.44:0/3483635719 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24440ceb70 0x7f24440b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f2448b82700 1 --2- 172.21.15.44:0/3483635719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f244415cda0 0x7f244406b900 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f2448b82700 1 -- 172.21.15.44:0/3483635719 >> 172.21.15.44:0/3483635719 conn(0x7f24440d2cb0 msgr2=0x7f24440d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:28.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f2448b82700 1 -- 172.21.15.44:0/3483635719 shutdown_connections 2024-09-13T18:33:28.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.395+0000 7f2448b82700 1 -- 172.21.15.44:0/3483635719 wait complete. 2024-09-13T18:33:28.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f2448b82700 1 Processor -- start 2024-09-13T18:33:28.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f2448b82700 1 -- start start 2024-09-13T18:33:28.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f2448b82700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f244406a520 0x7f24441f1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f2448b82700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24440ceb70 0x7f24441f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f2448b82700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f244415cda0 0x7f24441f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f2448b82700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24440cbba0 con 0x7f244406a520 2024-09-13T18:33:28.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f2448b82700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24440cbe80 con 0x7f24440ceb70 2024-09-13T18:33:28.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f2448b82700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24440cc160 con 0x7f244415cda0 2024-09-13T18:33:28.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f24437fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f244406a520 0x7f24441f1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f24437fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f244406a520 0x7f24441f1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45026/0 (socket says 172.21.15.44:45026) 2024-09-13T18:33:28.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f24437fe700 1 -- 172.21.15.44:0/4079892353 learned_addr learned my addr 172.21.15.44:0/4079892353 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:28.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f2443fff700 1 --2- 172.21.15.44:0/4079892353 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f244415cda0 0x7f24441f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f2442ffd700 1 --2- 172.21.15.44:0/4079892353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24440ceb70 0x7f24441f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f24437fe700 1 -- 172.21.15.44:0/4079892353 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f244415cda0 msgr2=0x7f24441f5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f24437fe700 1 --2- 172.21.15.44:0/4079892353 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f244415cda0 0x7f24441f5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f24437fe700 1 -- 172.21.15.44:0/4079892353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24440ceb70 msgr2=0x7f24441f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f24437fe700 1 --2- 172.21.15.44:0/4079892353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24440ceb70 0x7f24441f5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f24437fe700 1 -- 172.21.15.44:0/4079892353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2434009a70 con 0x7f244406a520 2024-09-13T18:33:28.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f24437fe700 1 --2- 172.21.15.44:0/4079892353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f244406a520 0x7f24441f1b50 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f2434014040 tx=0x7f2434004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:28.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f242bfff700 1 -- 172.21.15.44:0/4079892353 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434012430 con 0x7f244406a520 2024-09-13T18:33:28.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f242bfff700 1 -- 172.21.15.44:0/4079892353 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2434020070 con 0x7f244406a520 2024-09-13T18:33:28.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f2448b82700 1 -- 172.21.15.44:0/4079892353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24440cc440 con 0x7f244406a520 2024-09-13T18:33:28.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f242bfff700 1 -- 172.21.15.44:0/4079892353 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434004280 con 0x7f244406a520 2024-09-13T18:33:28.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.399+0000 7f2448b82700 1 -- 172.21.15.44:0/4079892353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24440cc720 con 0x7f244406a520 2024-09-13T18:33:28.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.403+0000 7f242bfff700 1 -- 172.21.15.44:0/4079892353 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f24340043e0 con 0x7f244406a520 2024-09-13T18:33:28.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.403+0000 7f242bfff700 1 --2- 172.21.15.44:0/4079892353 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2430066730 0x7f2430068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.403+0000 7f2442ffd700 1 --2- 172.21.15.44:0/4079892353 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2430066730 0x7f2430068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.403+0000 7f242bfff700 1 -- 172.21.15.44:0/4079892353 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2434022070 con 0x7f244406a520 2024-09-13T18:33:28.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.407+0000 7f2442ffd700 1 --2- 172.21.15.44:0/4079892353 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2430066730 0x7f2430068bf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2444158060 tx=0x7f2438008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:28.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.407+0000 7f244d095740 1 Processor -- start 2024-09-13T18:33:28.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.407+0000 7f244d095740 1 -- start start 2024-09-13T18:33:28.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.407+0000 7f244d095740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x127e230 0x127e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.407+0000 7f244d095740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x125ce90 0x1246890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.407+0000 7f244d095740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x127eb50 0x1246dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.407+0000 7f244d095740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x11a5d80 con 0x127eb50 2024-09-13T18:33:28.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.407+0000 7f244d095740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x11a3510 con 0x125ce90 2024-09-13T18:33:28.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.407+0000 7f244d095740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x119ee00 con 0x127e230 2024-09-13T18:33:28.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f2443fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x127eb50 0x1246dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f2443fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x127eb50 0x1246dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45028/0 (socket says 172.21.15.44:45028) 2024-09-13T18:33:28.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f24437fe700 1 --2- 172.21.15.44:0/2206699389 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x127e230 0x127e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f2443fff700 1 -- 172.21.15.44:0/2206699389 learned_addr learned my addr 172.21.15.44:0/2206699389 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:28.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f2442ffd700 1 --2- 172.21.15.44:0/2206699389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x125ce90 0x1246890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f24437fe700 1 -- 172.21.15.44:0/2206699389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x125ce90 msgr2=0x1246890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:28.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f24437fe700 1 --2- 172.21.15.44:0/2206699389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x125ce90 0x1246890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f24437fe700 1 -- 172.21.15.44:0/2206699389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x127eb50 msgr2=0x1246dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:28.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f24437fe700 1 --2- 172.21.15.44:0/2206699389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x127eb50 0x1246dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f24437fe700 1 -- 172.21.15.44:0/2206699389 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1011960 con 0x127e230 2024-09-13T18:33:28.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f24437fe700 1 --2- 172.21.15.44:0/2206699389 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x127e230 0x127e610 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f24340571a0 tx=0x7f2434056b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8285c0552c1768ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:28.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f24297fa700 1 -- 172.21.15.44:0/2206699389 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434057210 con 0x127e230 2024-09-13T18:33:28.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f24297fa700 1 -- 172.21.15.44:0/2206699389 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243405b040 con 0x127e230 2024-09-13T18:33:28.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f24297fa700 1 -- 172.21.15.44:0/2206699389 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243405f600 con 0x127e230 2024-09-13T18:33:28.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f244d095740 1 -- 172.21.15.44:0/2206699389 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x127e230 msgr2=0x127e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f244d095740 1 --2- 172.21.15.44:0/2206699389 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x127e230 0x127e610 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f24340571a0 tx=0x7f2434056b70 comp rx=0 tx=0).stop 2024-09-13T18:33:28.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f244d095740 1 -- 172.21.15.44:0/2206699389 shutdown_connections 2024-09-13T18:33:28.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f244d095740 1 --2- 172.21.15.44:0/2206699389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x127eb50 0x1246dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f244d095740 1 --2- 172.21.15.44:0/2206699389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x125ce90 0x1246890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f244d095740 1 --2- 172.21.15.44:0/2206699389 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x127e230 0x127e610 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f244d095740 1 -- 172.21.15.44:0/2206699389 >> 172.21.15.44:0/2206699389 conn(0xfc64d0 msgr2=0x125fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:28.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f244d095740 1 -- 172.21.15.44:0/2206699389 shutdown_connections 2024-09-13T18:33:28.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f244d095740 1 -- 172.21.15.44:0/2206699389 wait complete. 2024-09-13T18:33:28.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f244d095740 1 -- start start 2024-09-13T18:33:28.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.411+0000 7f244d095740 1 Processor -- start 2024-09-13T18:33:28.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f244d095740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x125ce90 0x1258be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f244d095740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x127e230 0x1236910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f244d095740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x127eb50 0x1236e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f244d095740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x115c730 con 0x125ce90 2024-09-13T18:33:28.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f244d095740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x11625b0 con 0x127e230 2024-09-13T18:33:28.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f244d095740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x104aaa0 con 0x127eb50 2024-09-13T18:33:28.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f244d095740 10 client.0 _ll_register_callbacks cb 0x1198610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:33:28.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f24437fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x125ce90 0x1258be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f24437fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x125ce90 0x1258be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45030/0 (socket says 172.21.15.44:45030) 2024-09-13T18:33:28.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f24437fe700 1 -- 172.21.15.44:0/2795416667 learned_addr learned my addr 172.21.15.44:0/2795416667 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:28.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f2443fff700 1 --2- 172.21.15.44:0/2795416667 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x127eb50 0x1236e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f2442ffd700 1 --2- 172.21.15.44:0/2795416667 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x127e230 0x1236910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f24437fe700 1 -- 172.21.15.44:0/2795416667 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x127eb50 msgr2=0x1236e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:28.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f24437fe700 1 --2- 172.21.15.44:0/2795416667 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x127eb50 0x1236e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f24437fe700 1 -- 172.21.15.44:0/2795416667 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x127e230 msgr2=0x1236910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:28.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f24437fe700 1 --2- 172.21.15.44:0/2795416667 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x127e230 0x1236910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f24437fe700 1 -- 172.21.15.44:0/2795416667 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24440cc720 con 0x125ce90 2024-09-13T18:33:28.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f2442ffd700 1 --2- 172.21.15.44:0/2795416667 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x127e230 0x1236910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:28.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f24437fe700 1 --2- 172.21.15.44:0/2795416667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x125ce90 0x1258be0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f2434056f10 tx=0x7f2434086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73ddefee1025ffc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:28.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f24227fc700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-13T18:33:28.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f24227fc700 1 -- 172.21.15.44:0/2795416667 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434075250 con 0x125ce90 2024-09-13T18:33:28.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f24227fc700 1 -- 172.21.15.44:0/2795416667 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f243405f600 con 0x125ce90 2024-09-13T18:33:28.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f244d095740 1 -- 172.21.15.44:0/2795416667 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xfd31e0 con 0x125ce90 2024-09-13T18:33:28.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f24227fc700 1 -- 172.21.15.44:0/2795416667 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24340098f0 con 0x125ce90 2024-09-13T18:33:28.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f244d095740 10 client.7059 fetch_fsmap learned FSMap version 48 2024-09-13T18:33:28.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f244d095740 1 -- 172.21.15.44:0/2795416667 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x1165220 con 0x125ce90 2024-09-13T18:33:28.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f24227fc700 1 -- 172.21.15.44:0/2795416667 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xfd31e0 con 0x125ce90 2024-09-13T18:33:28.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f24227fc700 1 -- 172.21.15.44:0/2795416667 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 48) v1 ==== 3126+0+0 (secure 0 0 0) 0x7f2434056700 con 0x125ce90 2024-09-13T18:33:28.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f244d095740 10 client.7059 fetch_fsmap finished waiting for FSMap version 48 2024-09-13T18:33:28.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f244d095740 10 client.7059 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:33:28.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f244d095740 20 client.7059 populate_metadata read hostname 'smithi044' 2024-09-13T18:33:28.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f244d095740 1 --2- 172.21.15.44:0/2795416667 >> [v2:172.21.15.99:6836/3072614790,v1:172.21.15.99:6837/3072614790] conn(0x1233c40 0x1234020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f244d095740 4 client.7059 mds_command: new command op to 6858 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:33:28.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f244d095740 1 -- 172.21.15.44:0/2795416667 --> [v2:172.21.15.99:6836/3072614790,v1:172.21.15.99:6837/3072614790] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x101d460 con 0x1233c40 2024-09-13T18:33:28.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f2442ffd700 1 --2- 172.21.15.44:0/2795416667 >> [v2:172.21.15.99:6836/3072614790,v1:172.21.15.99:6837/3072614790] conn(0x1233c40 0x1234020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f24227fc700 10 client.7059 ms_handle_connect on v2:172.21.15.99:6836/3072614790 2024-09-13T18:33:28.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.415+0000 7f2442ffd700 1 --2- 172.21.15.44:0/2795416667 >> [v2:172.21.15.99:6836/3072614790,v1:172.21.15.99:6837/3072614790] conn(0x1233c40 0x1234020 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44f7d1763fd33b73 server_cookie=fbaa280251acac81 in_seq=0 out_seq=0 2024-09-13T18:33:28.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.419+0000 7f24227fc700 1 -- 172.21.15.44:0/2795416667 <== mds.0 v2:172.21.15.99:6836/3072614790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x101d460 con 0x1233c40 2024-09-13T18:33:28.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.419+0000 7f24227fc700 10 client.7059 handle_command_reply: tid=0 2024-09-13T18:33:28.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.419+0000 7f244d095740 1 client.7059 shutdown 2024-09-13T18:33:28.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.419+0000 7f244d095740 1 -- 172.21.15.44:0/2795416667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x125ce90 msgr2=0x1258be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.419+0000 7f244d095740 1 --2- 172.21.15.44:0/2795416667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x125ce90 0x1258be0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f2434056f10 tx=0x7f2434086040 comp rx=0 tx=0).stop 2024-09-13T18:33:28.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.419+0000 7f244d095740 1 -- 172.21.15.44:0/2795416667 shutdown_connections 2024-09-13T18:33:28.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.419+0000 7f244d095740 1 --2- 172.21.15.44:0/2795416667 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x127eb50 0x1236e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.419+0000 7f244d095740 1 --2- 172.21.15.44:0/2795416667 >> [v2:172.21.15.99:6836/3072614790,v1:172.21.15.99:6837/3072614790] conn(0x1233c40 0x1234020 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.419+0000 7f244d095740 1 --2- 172.21.15.44:0/2795416667 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x127e230 0x1236910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.419+0000 7f244d095740 1 --2- 172.21.15.44:0/2795416667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x125ce90 0x1258be0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.419+0000 7f24227fc700 0 client.7059 ms_handle_reset on v2:172.21.15.99:6836/3072614790 2024-09-13T18:33:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.419+0000 7f244d095740 1 -- 172.21.15.44:0/2795416667 >> 172.21.15.44:0/2795416667 conn(0xfc64d0 msgr2=0x1259470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.419+0000 7f244d095740 1 -- 172.21.15.44:0/2795416667 shutdown_connections 2024-09-13T18:33:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.419+0000 7f244d095740 1 -- 172.21.15.44:0/2795416667 wait complete. 2024-09-13T18:33:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.419+0000 7f244d095740 20 client.7059 trim_cache size 0 max 16384 2024-09-13T18:33:28.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.439+0000 7f244d095740 1 Processor -- start 2024-09-13T18:33:28.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.439+0000 7f244d095740 1 -- start start 2024-09-13T18:33:28.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.439+0000 7f244d095740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x125ce90 0x128dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.439+0000 7f244d095740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x127e230 0x128e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.439+0000 7f244d095740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x127eb50 0x127ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.439+0000 7f244d095740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x11cdec0 con 0x127eb50 2024-09-13T18:33:28.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.439+0000 7f244d095740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x11625b0 con 0x127e230 2024-09-13T18:33:28.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.439+0000 7f244d095740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x1296650 con 0x125ce90 2024-09-13T18:33:28.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.439+0000 7f2443fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x127eb50 0x127ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.439+0000 7f2443fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x127eb50 0x127ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45040/0 (socket says 172.21.15.44:45040) 2024-09-13T18:33:28.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.439+0000 7f2443fff700 1 -- 172.21.15.44:0/533039272 learned_addr learned my addr 172.21.15.44:0/533039272 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:28.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.439+0000 7f24437fe700 1 --2- 172.21.15.44:0/533039272 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x125ce90 0x128dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.439+0000 7f2442ffd700 1 --2- 172.21.15.44:0/533039272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x127e230 0x128e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.439+0000 7f2443fff700 1 -- 172.21.15.44:0/533039272 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x125ce90 msgr2=0x128dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:28.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.439+0000 7f2443fff700 1 --2- 172.21.15.44:0/533039272 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x125ce90 0x128dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.439+0000 7f2443fff700 1 -- 172.21.15.44:0/533039272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x127e230 msgr2=0x128e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:28.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.439+0000 7f2443fff700 1 --2- 172.21.15.44:0/533039272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x127e230 0x128e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.439+0000 7f2443fff700 1 -- 172.21.15.44:0/533039272 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x114b450 con 0x127eb50 2024-09-13T18:33:28.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.439+0000 7f2442ffd700 1 --2- 172.21.15.44:0/533039272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x127e230 0x128e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:28.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.443+0000 7f2443fff700 1 --2- 172.21.15.44:0/533039272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x127eb50 0x127ca70 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f243c007fa0 tx=0x7f243c007320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13caf7469566a3b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:28.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.443+0000 7f2429ffb700 1 -- 172.21.15.44:0/533039272 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c001520 con 0x127eb50 2024-09-13T18:33:28.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.443+0000 7f2429ffb700 1 -- 172.21.15.44:0/533039272 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243c001680 con 0x127eb50 2024-09-13T18:33:28.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.443+0000 7f2429ffb700 1 -- 172.21.15.44:0/533039272 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c0019f0 con 0x127eb50 2024-09-13T18:33:28.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.443+0000 7f244d095740 1 -- 172.21.15.44:0/533039272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x127eb50 msgr2=0x127ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.443+0000 7f244d095740 1 --2- 172.21.15.44:0/533039272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x127eb50 0x127ca70 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f243c007fa0 tx=0x7f243c007320 comp rx=0 tx=0).stop 2024-09-13T18:33:28.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.443+0000 7f244d095740 1 -- 172.21.15.44:0/533039272 shutdown_connections 2024-09-13T18:33:28.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.443+0000 7f244d095740 1 --2- 172.21.15.44:0/533039272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x127eb50 0x127ca70 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.443+0000 7f244d095740 1 --2- 172.21.15.44:0/533039272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x127e230 0x128e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.443+0000 7f244d095740 1 --2- 172.21.15.44:0/533039272 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x125ce90 0x128dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.443+0000 7f244d095740 1 -- 172.21.15.44:0/533039272 >> 172.21.15.44:0/533039272 conn(0xfc64d0 msgr2=0x128d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:28.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.443+0000 7f244d095740 1 -- 172.21.15.44:0/533039272 shutdown_connections 2024-09-13T18:33:28.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.443+0000 7f244d095740 1 -- 172.21.15.44:0/533039272 wait complete. 2024-09-13T18:33:28.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.443+0000 7f244d095740 1 -- start start 2024-09-13T18:33:28.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.443+0000 7f244d095740 1 Processor -- start 2024-09-13T18:33:28.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f244d095740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x125ce90 0x12de830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f244d095740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x127e230 0x125b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f244d095740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x127eb50 0x125b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f244d095740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x129d250 con 0x127eb50 2024-09-13T18:33:28.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f244d095740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x1282b70 con 0x125ce90 2024-09-13T18:33:28.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f244d095740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x1283040 con 0x127e230 2024-09-13T18:33:28.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f244d095740 10 client.0 _ll_register_callbacks cb 0x1150ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:33:28.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f2443fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x127eb50 0x125b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f24437fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x125ce90 0x12de830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f24437fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x125ce90 0x12de830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:56720/0 (socket says 172.21.15.44:56720) 2024-09-13T18:33:28.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f24437fe700 1 -- 172.21.15.44:0/2813416980 learned_addr learned my addr 172.21.15.44:0/2813416980 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:28.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f2442ffd700 1 --2- 172.21.15.44:0/2813416980 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x127e230 0x125b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f2442ffd700 1 -- 172.21.15.44:0/2813416980 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x125ce90 msgr2=0x12de830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:28.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f2442ffd700 1 --2- 172.21.15.44:0/2813416980 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x125ce90 0x12de830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f2442ffd700 1 -- 172.21.15.44:0/2813416980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x127eb50 msgr2=0x125b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:28.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f2442ffd700 1 --2- 172.21.15.44:0/2813416980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x127eb50 0x125b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f2442ffd700 1 -- 172.21.15.44:0/2813416980 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f242c0035d0 con 0x127e230 2024-09-13T18:33:28.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f2442ffd700 1 --2- 172.21.15.44:0/2813416980 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x127e230 0x125b400 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2438009760 tx=0x7f2438004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4368f689b280ebfd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:28.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f24227fc700 10 client.0 ms_handle_connect on v2:172.21.15.99:3301/0 2024-09-13T18:33:28.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f24227fc700 1 -- 172.21.15.44:0/2813416980 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438028040 con 0x127e230 2024-09-13T18:33:28.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f24227fc700 1 -- 172.21.15.44:0/2813416980 <== mon.2 v2:172.21.15.99:3301/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2438011a20 con 0x127e230 2024-09-13T18:33:28.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f244d095740 1 -- 172.21.15.44:0/2813416980 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f243405b040 con 0x127e230 2024-09-13T18:33:28.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f24227fc700 1 -- 172.21.15.44:0/2813416980 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f243802ad80 con 0x127e230 2024-09-13T18:33:28.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f244d095740 10 client.6257 fetch_fsmap learned FSMap version 48 2024-09-13T18:33:28.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.447+0000 7f244d095740 1 -- 172.21.15.44:0/2813416980 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x113f720 con 0x127e230 2024-09-13T18:33:28.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f24227fc700 1 -- 172.21.15.44:0/2813416980 <== mon.2 v2:172.21.15.99:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243405b040 con 0x127e230 2024-09-13T18:33:28.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f24227fc700 1 -- 172.21.15.44:0/2813416980 <== mon.2 v2:172.21.15.99:3301/0 5 ==== fsmap(e 48) v1 ==== 3126+0+0 (secure 0 0 0) 0x7f2438015a80 con 0x127e230 2024-09-13T18:33:28.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f244d095740 10 client.6257 fetch_fsmap finished waiting for FSMap version 48 2024-09-13T18:33:28.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f244d095740 10 client.6257 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:33:28.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f244d095740 20 client.6257 populate_metadata read hostname 'smithi044' 2024-09-13T18:33:28.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f244d095740 1 --2- 172.21.15.44:0/2813416980 >> [v2:172.21.15.99:6836/3072614790,v1:172.21.15.99:6837/3072614790] conn(0x1281320 0x1281700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f244d095740 4 client.6257 mds_command: new command op to 6858 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:33:28.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f244d095740 1 -- 172.21.15.44:0/2813416980 --> [v2:172.21.15.99:6836/3072614790,v1:172.21.15.99:6837/3072614790] -- command(tid 0: {"prefix": "status"}) v1 -- 0x10421e0 con 0x1281320 2024-09-13T18:33:28.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f24437fe700 1 --2- 172.21.15.44:0/2813416980 >> [v2:172.21.15.99:6836/3072614790,v1:172.21.15.99:6837/3072614790] conn(0x1281320 0x1281700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f24437fe700 1 --2- 172.21.15.44:0/2813416980 >> [v2:172.21.15.99:6836/3072614790,v1:172.21.15.99:6837/3072614790] conn(0x1281320 0x1281700 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4ed21470496b07b server_cookie=42020de9a1b7cc4d in_seq=0 out_seq=0 2024-09-13T18:33:28.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f24227fc700 10 client.6257 ms_handle_connect on v2:172.21.15.99:6836/3072614790 2024-09-13T18:33:28.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f24227fc700 1 -- 172.21.15.44:0/2813416980 <== mds.0 v2:172.21.15.99:6836/3072614790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x10421e0 con 0x1281320 2024-09-13T18:33:28.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f24227fc700 10 client.6257 handle_command_reply: tid=0 2024-09-13T18:33:28.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f244d095740 1 client.6257 shutdown 2024-09-13T18:33:28.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f244d095740 1 -- 172.21.15.44:0/2813416980 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x127e230 msgr2=0x125b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f244d095740 1 --2- 172.21.15.44:0/2813416980 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x127e230 0x125b400 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2438009760 tx=0x7f2438004770 comp rx=0 tx=0).stop 2024-09-13T18:33:28.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f244d095740 1 -- 172.21.15.44:0/2813416980 shutdown_connections 2024-09-13T18:33:28.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f244d095740 1 --2- 172.21.15.44:0/2813416980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x127eb50 0x125b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f244d095740 1 --2- 172.21.15.44:0/2813416980 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x127e230 0x125b400 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f244d095740 1 --2- 172.21.15.44:0/2813416980 >> [v2:172.21.15.99:6836/3072614790,v1:172.21.15.99:6837/3072614790] conn(0x1281320 0x1281700 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f244d095740 1 --2- 172.21.15.44:0/2813416980 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x125ce90 0x12de830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f24227fc700 0 client.6257 ms_handle_reset on v2:172.21.15.99:6836/3072614790 2024-09-13T18:33:28.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f244d095740 1 -- 172.21.15.44:0/2813416980 >> 172.21.15.44:0/2813416980 conn(0xfc64d0 msgr2=0x128e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:28.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f244d095740 1 -- 172.21.15.44:0/2813416980 shutdown_connections 2024-09-13T18:33:28.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f244d095740 1 -- 172.21.15.44:0/2813416980 wait complete. 2024-09-13T18:33:28.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f244d095740 20 client.6257 trim_cache size 0 max 16384 2024-09-13T18:33:28.462 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:33:28.462 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "c8e1d12d-7fb9-4a33-982e-b895bb77262c", 2024-09-13T18:33:28.462 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-13T18:33:28.462 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 6858, 2024-09-13T18:33:28.462 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-13T18:33:28.462 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-13T18:33:28.462 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-13T18:33:28.462 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 12.159959044000001, 2024-09-13T18:33:28.462 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 48, 2024-09-13T18:33:28.462 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 63, 2024-09-13T18:33:28.462 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 63, 2024-09-13T18:33:28.462 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 16.613975461999999 2024-09-13T18:33:28.463 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:33:28.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f2448b82700 1 -- 172.21.15.44:0/4079892353 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2430066730 msgr2=0x7f2430068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f2448b82700 1 --2- 172.21.15.44:0/4079892353 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2430066730 0x7f2430068bf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2444158060 tx=0x7f2438008040 comp rx=0 tx=0).stop 2024-09-13T18:33:28.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f2448b82700 1 -- 172.21.15.44:0/4079892353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f244406a520 msgr2=0x7f24441f1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f2448b82700 1 --2- 172.21.15.44:0/4079892353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f244406a520 0x7f24441f1b50 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f2434014040 tx=0x7f2434004af0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f2448b82700 1 -- 172.21.15.44:0/4079892353 shutdown_connections 2024-09-13T18:33:28.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f2448b82700 1 --2- 172.21.15.44:0/4079892353 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2430066730 0x7f2430068bf0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f2448b82700 1 --2- 172.21.15.44:0/4079892353 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f244415cda0 0x7f24441f5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f2448b82700 1 --2- 172.21.15.44:0/4079892353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24440ceb70 0x7f24441f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f2448b82700 1 --2- 172.21.15.44:0/4079892353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f244406a520 0x7f24441f1b50 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.451+0000 7f2448b82700 1 -- 172.21.15.44:0/4079892353 >> 172.21.15.44:0/4079892353 conn(0x7f24440d2cb0 msgr2=0x7f244415b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:28.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.455+0000 7f2448b82700 1 -- 172.21.15.44:0/4079892353 shutdown_connections 2024-09-13T18:33:28.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.455+0000 7f2448b82700 1 -- 172.21.15.44:0/4079892353 wait complete. 2024-09-13T18:33:28.478 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable false 2024-09-13T18:33:28.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.599+0000 7f6903382700 1 Processor -- start 2024-09-13T18:33:28.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.599+0000 7f6903382700 1 -- start start 2024-09-13T18:33:28.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.599+0000 7f6903382700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f68fc06bc80 0x7f68fc06a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.599+0000 7f6903382700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f68fc06ada0 0x7f68fc0cd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.599+0000 7f6903382700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68fc15ad00 con 0x7f68fc0d18f0 2024-09-13T18:33:28.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.599+0000 7f6903382700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68fc15d770 con 0x7f68fc06ada0 2024-09-13T18:33:28.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.599+0000 7f6903382700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68fc15da50 con 0x7f68fc06bc80 2024-09-13T18:33:28.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.599+0000 7f6902b81700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f68fc06ada0 0x7f68fc0cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.599+0000 7f6902b81700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f68fc06ada0 0x7f68fc0cd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45062/0 (socket says 172.21.15.44:45062) 2024-09-13T18:33:28.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.599+0000 7f6902b81700 1 -- 172.21.15.44:0/956229632 learned_addr learned my addr 172.21.15.44:0/956229632 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:28.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.599+0000 7f6902380700 1 --1- 172.21.15.44:0/956229632 >> v1:172.21.15.44:6789/0 conn(0x7f68fc0d18f0 0x7f68fc0d1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49804/0 (socket says 172.21.15.44:49804) 2024-09-13T18:33:28.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.599+0000 7f6901b7f700 1 --2- 172.21.15.44:0/956229632 >> v2:172.21.15.99:3300/0 conn(0x7f68fc06bc80 0x7f68fc06a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.603+0000 7f6902b81700 1 -- 172.21.15.44:0/956229632 >> v2:172.21.15.99:3300/0 conn(0x7f68fc06bc80 msgr2=0x7f68fc06a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:28.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.603+0000 7f6902b81700 1 --2- 172.21.15.44:0/956229632 >> v2:172.21.15.99:3300/0 conn(0x7f68fc06bc80 0x7f68fc06a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.603+0000 7f6902b81700 1 -- 172.21.15.44:0/956229632 >> v1:172.21.15.44:6789/0 conn(0x7f68fc0d18f0 legacy=0x7f68fc0d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.603+0000 7f6902b81700 1 -- 172.21.15.44:0/956229632 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc15dd30 con 0x7f68fc06ada0 2024-09-13T18:33:28.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.603+0000 7f6902b81700 1 --2- 172.21.15.44:0/956229632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68fc06ada0 0x7f68fc0cd720 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f68fc161900 tx=0x7f68f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695c20631935b9ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:28.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.603+0000 7f690137e700 1 -- 172.21.15.44:0/956229632 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f400e070 con 0x7f68fc06ada0 2024-09-13T18:33:28.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.603+0000 7f690137e700 1 -- 172.21.15.44:0/956229632 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f400b910 con 0x7f68fc06ada0 2024-09-13T18:33:28.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.603+0000 7f690137e700 1 -- 172.21.15.44:0/956229632 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f400bcc0 con 0x7f68fc06ada0 2024-09-13T18:33:28.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.603+0000 7f6903382700 1 -- 172.21.15.44:0/956229632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68fc06ada0 msgr2=0x7f68fc0cd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.603+0000 7f6903382700 1 --2- 172.21.15.44:0/956229632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68fc06ada0 0x7f68fc0cd720 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f68fc161900 tx=0x7f68f400b330 comp rx=0 tx=0).stop 2024-09-13T18:33:28.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.603+0000 7f6903382700 1 -- 172.21.15.44:0/956229632 shutdown_connections 2024-09-13T18:33:28.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.603+0000 7f6903382700 1 --2- 172.21.15.44:0/956229632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68fc06ada0 0x7f68fc0cd720 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.603+0000 7f6903382700 1 --2- 172.21.15.44:0/956229632 >> v2:172.21.15.99:3300/0 conn(0x7f68fc06bc80 0x7f68fc06a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.603+0000 7f6903382700 1 -- 172.21.15.44:0/956229632 >> 172.21.15.44:0/956229632 conn(0x7f68fc0b4800 msgr2=0x7f68fc0b4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:28.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.603+0000 7f6903382700 1 -- 172.21.15.44:0/956229632 shutdown_connections 2024-09-13T18:33:28.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.603+0000 7f6903382700 1 -- 172.21.15.44:0/956229632 wait complete. 2024-09-13T18:33:28.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f6903382700 1 Processor -- start 2024-09-13T18:33:28.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f6903382700 1 -- start start 2024-09-13T18:33:28.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f6903382700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68fc06ada0 0x7f68fc14c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f6903382700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68fc06bc80 0x7f68fc0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f6903382700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f68fc0d18f0 0x7f68fc15f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f6903382700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc14d1b0 con 0x7f68fc06bc80 2024-09-13T18:33:28.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f6903382700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc14d490 con 0x7f68fc06ada0 2024-09-13T18:33:28.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f6903382700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc14d770 con 0x7f68fc0d18f0 2024-09-13T18:33:28.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f6901b7f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68fc06bc80 0x7f68fc0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f6901b7f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68fc06bc80 0x7f68fc0cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45078/0 (socket says 172.21.15.44:45078) 2024-09-13T18:33:28.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f6901b7f700 1 -- 172.21.15.44:0/1245353985 learned_addr learned my addr 172.21.15.44:0/1245353985 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:33:28.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f6902380700 1 --2- 172.21.15.44:0/1245353985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68fc06ada0 0x7f68fc14c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f6902b81700 1 --2- 172.21.15.44:0/1245353985 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f68fc0d18f0 0x7f68fc15f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f6901b7f700 1 -- 172.21.15.44:0/1245353985 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f68fc0d18f0 msgr2=0x7f68fc15f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f6901b7f700 1 --2- 172.21.15.44:0/1245353985 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f68fc0d18f0 0x7f68fc15f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f6901b7f700 1 -- 172.21.15.44:0/1245353985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68fc06ada0 msgr2=0x7f68fc14c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:28.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f6901b7f700 1 --2- 172.21.15.44:0/1245353985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68fc06ada0 0x7f68fc14c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:28.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f6901b7f700 1 -- 172.21.15.44:0/1245353985 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f4009b30 con 0x7f68fc06bc80 2024-09-13T18:33:28.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f6902b81700 1 --2- 172.21.15.44:0/1245353985 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f68fc0d18f0 0x7f68fc15f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:28.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f6901b7f700 1 --2- 172.21.15.44:0/1245353985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68fc06bc80 0x7f68fc0cc6f0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f68f800e960 tx=0x7f68f800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:28.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f68f2ffd700 1 -- 172.21.15.44:0/1245353985 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f800eeb0 con 0x7f68fc06bc80 2024-09-13T18:33:28.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f68f2ffd700 1 -- 172.21.15.44:0/1245353985 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f800c850 con 0x7f68fc06bc80 2024-09-13T18:33:28.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f6903382700 1 -- 172.21.15.44:0/1245353985 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68fc14da50 con 0x7f68fc06bc80 2024-09-13T18:33:28.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f68f2ffd700 1 -- 172.21.15.44:0/1245353985 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f800cbc0 con 0x7f68fc06bc80 2024-09-13T18:33:28.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.607+0000 7f6903382700 1 -- 172.21.15.44:0/1245353985 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68fc14cea0 con 0x7f68fc06bc80 2024-09-13T18:33:28.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.611+0000 7f6903382700 1 -- 172.21.15.44:0/1245353985 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68fc0cd720 con 0x7f68fc06bc80 2024-09-13T18:33:28.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.611+0000 7f68f2ffd700 1 -- 172.21.15.44:0/1245353985 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f68f800cd20 con 0x7f68fc06bc80 2024-09-13T18:33:28.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.611+0000 7f68f2ffd700 1 --2- 172.21.15.44:0/1245353985 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f68e0066730 0x7f68e0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:28.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.611+0000 7f68f2ffd700 1 -- 172.21.15.44:0/1245353985 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68f80840f0 con 0x7f68fc06bc80 2024-09-13T18:33:28.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.611+0000 7f6902380700 1 --2- 172.21.15.44:0/1245353985 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f68e0066730 0x7f68e0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:28.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.611+0000 7f6902380700 1 --2- 172.21.15.44:0/1245353985 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f68e0066730 0x7f68e0068bf0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f68ec000f60 tx=0x7f68ec007ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:28.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.619+0000 7f68f2ffd700 1 -- 172.21.15.44:0/1245353985 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f68f80514f0 con 0x7f68fc06bc80 2024-09-13T18:33:28.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:28.823+0000 7f6903382700 1 -- 172.21.15.44:0/1245353985 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "false"} v 0) v1 -- 0x7f68fc06c3c0 con 0x7f68fc06bc80 2024-09-13T18:33:29.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:29.563+0000 7f68f2ffd700 1 -- 172.21.15.44:0/1245353985 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "false"}]=0 cephfs marked not joinable; MDS cannot join as newly active. v49) v1 ==== 170+0+0 (secure 0 0 0) 0x7f68f8054b10 con 0x7f68fc06bc80 2024-09-13T18:33:29.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:29.567+0000 7f6903382700 1 -- 172.21.15.44:0/1245353985 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f68e0066730 msgr2=0x7f68e0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:29.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:29.567+0000 7f6903382700 1 --2- 172.21.15.44:0/1245353985 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f68e0066730 0x7f68e0068bf0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f68ec000f60 tx=0x7f68ec007ef0 comp rx=0 tx=0).stop 2024-09-13T18:33:29.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:29.567+0000 7f6903382700 1 -- 172.21.15.44:0/1245353985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68fc06bc80 msgr2=0x7f68fc0cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:29.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:29.567+0000 7f6903382700 1 --2- 172.21.15.44:0/1245353985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68fc06bc80 0x7f68fc0cc6f0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f68f800e960 tx=0x7f68f800ec70 comp rx=0 tx=0).stop 2024-09-13T18:33:29.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:29.567+0000 7f6903382700 1 -- 172.21.15.44:0/1245353985 shutdown_connections 2024-09-13T18:33:29.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:29.567+0000 7f6903382700 1 --2- 172.21.15.44:0/1245353985 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f68e0066730 0x7f68e0068bf0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:29.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:29.567+0000 7f6903382700 1 --2- 172.21.15.44:0/1245353985 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f68fc0d18f0 0x7f68fc15f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:29.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:29.567+0000 7f6903382700 1 --2- 172.21.15.44:0/1245353985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68fc06bc80 0x7f68fc0cc6f0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:29.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:29.567+0000 7f6903382700 1 --2- 172.21.15.44:0/1245353985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68fc06ada0 0x7f68fc14c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:29.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:29.567+0000 7f6903382700 1 -- 172.21.15.44:0/1245353985 >> 172.21.15.44:0/1245353985 conn(0x7f68fc0b4800 msgr2=0x7f68fc06a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:29.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:29.567+0000 7f6903382700 1 -- 172.21.15.44:0/1245353985 shutdown_connections 2024-09-13T18:33:29.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:33:29.567+0000 7f6903382700 1 -- 172.21.15.44:0/1245353985 wait complete. 2024-09-13T18:33:29.575 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join as newly active. 2024-09-13T18:33:29.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:29.591 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'mkdir {alpha,bravo} && touch {alpha,bravo}/file') 2024-09-13T18:33:29.608 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:33:29.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:29.632 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 alpha/) 2024-09-13T18:33:29.677 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:33:29.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:29.702 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 bravo/) 2024-09-13T18:33:29.714 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-13T18:33:29.845 INFO:teuthology.orchestra.run.smithi099.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"11","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:33:29.846 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "11" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:33:29.846 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/alpha', 0), ('/bravo', 1)] 2024-09-13T18:33:31.848 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-13T18:33:31.972 INFO:teuthology.orchestra.run.smithi099.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/alpha","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"3","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}}] 2024-09-13T18:33:31.973 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/alpha", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:33:31.973 INFO:tasks.cephfs.cephfs_test_case:[('/alpha', 0)] =?= [('/alpha', 0), ('/bravo', 1)] 2024-09-13T18:33:33.974 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-13T18:33:34.122 INFO:teuthology.orchestra.run.smithi099.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/alpha","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"3","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}}] 2024-09-13T18:33:34.122 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/alpha", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:33:34.123 INFO:tasks.cephfs.cephfs_test_case:[('/alpha', 0)] =?= [('/alpha', 0), ('/bravo', 1)] 2024-09-13T18:33:36.123 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-13T18:33:36.249 INFO:teuthology.orchestra.run.smithi099.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"17","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/alpha","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"5","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":1},"nref":4}}] 2024-09-13T18:33:36.250 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 2, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "17", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/alpha", "pins": { "authpin": 1, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "5", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:33:36.250 INFO:tasks.cephfs.cephfs_test_case:[('/alpha', 0)] =?= [('/alpha', 0), ('/bravo', 1)] 2024-09-13T18:33:38.251 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-13T18:33:38.383 INFO:teuthology.orchestra.run.smithi099.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"18","version":"18","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/alpha","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"5","version":"5","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/bravo","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"5","version":"5","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2024-09-13T18:33:38.383 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "18", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "18" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/alpha", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "5", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000001", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/bravo", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "5", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-13T18:33:38.383 INFO:tasks.cephfs.cephfs_test_case:[('/alpha', 0), ('/bravo', 1)] =?= [('/alpha', 0), ('/bravo', 1)] 2024-09-13T18:33:38.384 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:33:38.384 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:38.393 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:33:38.393 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:33:38.393 DEBUG:teuthology.orchestra.run.smithi044:> import uuid 2024-09-13T18:33:38.393 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:33:38.393 DEBUG:teuthology.orchestra.run.smithi044:> n = 1000 2024-09-13T18:33:38.393 DEBUG:teuthology.orchestra.run.smithi044:> create_hard_links = False 2024-09-13T18:33:38.393 DEBUG:teuthology.orchestra.run.smithi044:> if 0 > 0: 2024-09-13T18:33:38.393 DEBUG:teuthology.orchestra.run.smithi044:> create_hard_links = True 2024-09-13T18:33:38.394 DEBUG:teuthology.orchestra.run.smithi044:> path = "/home/ubuntu/cephtest/mnt.0/alpha/file" 2024-09-13T18:33:38.394 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:33:38.394 DEBUG:teuthology.orchestra.run.smithi044:> dpath = os.path.dirname(path) 2024-09-13T18:33:38.394 DEBUG:teuthology.orchestra.run.smithi044:> fnameprefix = os.path.basename(path) 2024-09-13T18:33:38.394 DEBUG:teuthology.orchestra.run.smithi044:> os.makedirs(dpath, exist_ok=True) 2024-09-13T18:33:38.394 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:33:38.394 DEBUG:teuthology.orchestra.run.smithi044:> try: 2024-09-13T18:33:38.394 DEBUG:teuthology.orchestra.run.smithi044:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-13T18:33:38.394 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:33:38.394 DEBUG:teuthology.orchestra.run.smithi044:> for i in range(n): 2024-09-13T18:33:38.394 DEBUG:teuthology.orchestra.run.smithi044:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-13T18:33:38.394 DEBUG:teuthology.orchestra.run.smithi044:> with open(fpath, '"'"'w'"'"') as f: 2024-09-13T18:33:38.394 DEBUG:teuthology.orchestra.run.smithi044:> f.write(f"{i}") 2024-09-13T18:33:38.394 DEBUG:teuthology.orchestra.run.smithi044:> if False: 2024-09-13T18:33:38.394 DEBUG:teuthology.orchestra.run.smithi044:> f.flush() 2024-09-13T18:33:38.395 DEBUG:teuthology.orchestra.run.smithi044:> os.fsync(f.fileno()) 2024-09-13T18:33:38.395 DEBUG:teuthology.orchestra.run.smithi044:> if False: 2024-09-13T18:33:38.395 DEBUG:teuthology.orchestra.run.smithi044:> os.unlink(fpath) 2024-09-13T18:33:38.395 DEBUG:teuthology.orchestra.run.smithi044:> if False: 2024-09-13T18:33:38.395 DEBUG:teuthology.orchestra.run.smithi044:> os.fsync(dirfd) 2024-09-13T18:33:38.395 DEBUG:teuthology.orchestra.run.smithi044:> if create_hard_links: 2024-09-13T18:33:38.395 DEBUG:teuthology.orchestra.run.smithi044:> for j in range(0): 2024-09-13T18:33:38.395 DEBUG:teuthology.orchestra.run.smithi044:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-13T18:33:38.395 DEBUG:teuthology.orchestra.run.smithi044:> if False: 2024-09-13T18:33:38.395 DEBUG:teuthology.orchestra.run.smithi044:> os.fsync(dirfd) 2024-09-13T18:33:38.395 DEBUG:teuthology.orchestra.run.smithi044:> finally: 2024-09-13T18:33:38.395 DEBUG:teuthology.orchestra.run.smithi044:> os.close(dirfd) 2024-09-13T18:33:38.395 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:33:51.314 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:33:51.314 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:51.323 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:33:51.323 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:33:51.323 DEBUG:teuthology.orchestra.run.smithi044:> import uuid 2024-09-13T18:33:51.323 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:33:51.324 DEBUG:teuthology.orchestra.run.smithi044:> n = 1000 2024-09-13T18:33:51.324 DEBUG:teuthology.orchestra.run.smithi044:> create_hard_links = False 2024-09-13T18:33:51.324 DEBUG:teuthology.orchestra.run.smithi044:> if 0 > 0: 2024-09-13T18:33:51.324 DEBUG:teuthology.orchestra.run.smithi044:> create_hard_links = True 2024-09-13T18:33:51.324 DEBUG:teuthology.orchestra.run.smithi044:> path = "/home/ubuntu/cephtest/mnt.0/bravo/file" 2024-09-13T18:33:51.324 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:33:51.324 DEBUG:teuthology.orchestra.run.smithi044:> dpath = os.path.dirname(path) 2024-09-13T18:33:51.324 DEBUG:teuthology.orchestra.run.smithi044:> fnameprefix = os.path.basename(path) 2024-09-13T18:33:51.324 DEBUG:teuthology.orchestra.run.smithi044:> os.makedirs(dpath, exist_ok=True) 2024-09-13T18:33:51.324 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:33:51.324 DEBUG:teuthology.orchestra.run.smithi044:> try: 2024-09-13T18:33:51.324 DEBUG:teuthology.orchestra.run.smithi044:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-13T18:33:51.324 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:33:51.325 DEBUG:teuthology.orchestra.run.smithi044:> for i in range(n): 2024-09-13T18:33:51.325 DEBUG:teuthology.orchestra.run.smithi044:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-13T18:33:51.325 DEBUG:teuthology.orchestra.run.smithi044:> with open(fpath, '"'"'w'"'"') as f: 2024-09-13T18:33:51.325 DEBUG:teuthology.orchestra.run.smithi044:> f.write(f"{i}") 2024-09-13T18:33:51.325 DEBUG:teuthology.orchestra.run.smithi044:> if False: 2024-09-13T18:33:51.325 DEBUG:teuthology.orchestra.run.smithi044:> f.flush() 2024-09-13T18:33:51.325 DEBUG:teuthology.orchestra.run.smithi044:> os.fsync(f.fileno()) 2024-09-13T18:33:51.325 DEBUG:teuthology.orchestra.run.smithi044:> if False: 2024-09-13T18:33:51.325 DEBUG:teuthology.orchestra.run.smithi044:> os.unlink(fpath) 2024-09-13T18:33:51.325 DEBUG:teuthology.orchestra.run.smithi044:> if False: 2024-09-13T18:33:51.326 DEBUG:teuthology.orchestra.run.smithi044:> os.fsync(dirfd) 2024-09-13T18:33:51.326 DEBUG:teuthology.orchestra.run.smithi044:> if create_hard_links: 2024-09-13T18:33:51.326 DEBUG:teuthology.orchestra.run.smithi044:> for j in range(0): 2024-09-13T18:33:51.326 DEBUG:teuthology.orchestra.run.smithi044:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-13T18:33:51.326 DEBUG:teuthology.orchestra.run.smithi044:> if False: 2024-09-13T18:33:51.326 DEBUG:teuthology.orchestra.run.smithi044:> os.fsync(dirfd) 2024-09-13T18:33:51.326 DEBUG:teuthology.orchestra.run.smithi044:> finally: 2024-09-13T18:33:51.326 DEBUG:teuthology.orchestra.run.smithi044:> os.close(dirfd) 2024-09-13T18:33:51.326 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:33:59.724 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:33:59.727 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:34:11.411 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:34:11.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.526+0000 7f97167f4700 1 Processor -- start 2024-09-13T18:34:11.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.526+0000 7f97167f4700 1 -- start start 2024-09-13T18:34:11.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f97167f4700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f97100b3ae0 0x7f9710165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:11.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f97167f4700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9710161dd0 con 0x7f9710161290 2024-09-13T18:34:11.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f97167f4700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9710071f30 con 0x7f9710160eb0 2024-09-13T18:34:11.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f97167f4700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97101622e0 con 0x7f97100b3ae0 2024-09-13T18:34:11.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9715ff3700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9710161290 0x7f97101616c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40288/0 (socket says 172.21.15.44:40288) 2024-09-13T18:34:11.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9715ff3700 1 -- 172.21.15.44:0/12892920 learned_addr learned my addr 172.21.15.44:0/12892920 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:34:11.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9714ff1700 1 --2- 172.21.15.44:0/12892920 >> v2:172.21.15.99:3300/0 conn(0x7f97100b3ae0 0x7f9710165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:11.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9707fff700 1 -- 172.21.15.44:0/12892920 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313784429 0 0) 0x7f9710161dd0 con 0x7f9710161290 2024-09-13T18:34:11.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9707fff700 1 -- 172.21.15.44:0/12892920 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96fc0035d0 con 0x7f9710161290 2024-09-13T18:34:11.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9707fff700 1 -- 172.21.15.44:0/12892920 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1643396917 0 0) 0x7f96fc0035d0 con 0x7f9710161290 2024-09-13T18:34:11.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9707fff700 1 -- 172.21.15.44:0/12892920 >> v2:172.21.15.99:3300/0 conn(0x7f97100b3ae0 msgr2=0x7f9710165590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:11.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9707fff700 1 --2- 172.21.15.44:0/12892920 >> v2:172.21.15.99:3300/0 conn(0x7f97100b3ae0 0x7f9710165590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:11.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9707fff700 1 -- 172.21.15.44:0/12892920 >> v1:172.21.15.99:6789/0 conn(0x7f9710160eb0 legacy=0x7f97100b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:11.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9707fff700 1 -- 172.21.15.44:0/12892920 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9710162000 con 0x7f9710161290 2024-09-13T18:34:11.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9707fff700 1 -- 172.21.15.44:0/12892920 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f97080019f0 con 0x7f9710161290 2024-09-13T18:34:11.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9707fff700 1 -- 172.21.15.44:0/12892920 >> v1:172.21.15.44:6789/0 conn(0x7f9710161290 legacy=0x7f97101616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:11.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9707fff700 1 --2- 172.21.15.44:0/12892920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96fc003a20 0x7f96fc003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:11.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9707fff700 1 --2- 172.21.15.44:0/12892920 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96fc004870 0x7f96fc004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:11.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9707fff700 1 --2- 172.21.15.44:0/12892920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96fc005230 0x7f96fc00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:11.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9707fff700 1 -- 172.21.15.44:0/12892920 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97101622e0 con 0x7f96fc003a20 2024-09-13T18:34:11.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9707fff700 1 -- 172.21.15.44:0/12892920 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc00c0d0 con 0x7f96fc005230 2024-09-13T18:34:11.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9707fff700 1 -- 172.21.15.44:0/12892920 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc00c290 con 0x7f96fc004870 2024-09-13T18:34:11.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f97157f2700 1 --2- 172.21.15.44:0/12892920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96fc003a20 0x7f96fc003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:11.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9714ff1700 1 --2- 172.21.15.44:0/12892920 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96fc004870 0x7f96fc004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:11.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9715ff3700 1 --2- 172.21.15.44:0/12892920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96fc005230 0x7f96fc00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:11.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f97157f2700 1 -- 172.21.15.44:0/12892920 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96fc004870 msgr2=0x7f96fc004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:11.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f97157f2700 1 --2- 172.21.15.44:0/12892920 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96fc004870 0x7f96fc004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:11.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f97157f2700 1 -- 172.21.15.44:0/12892920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96fc005230 msgr2=0x7f96fc00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:11.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f97157f2700 1 --2- 172.21.15.44:0/12892920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96fc005230 0x7f96fc00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:11.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9715ff3700 1 -- 172.21.15.44:0/12892920 reap_dead start 2024-09-13T18:34:11.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f97157f2700 1 -- 172.21.15.44:0/12892920 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96fc0035d0 con 0x7f96fc003a20 2024-09-13T18:34:11.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f97157f2700 1 --2- 172.21.15.44:0/12892920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96fc003a20 0x7f96fc003e40 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f97000017e0 tx=0x7f96fc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74e410267e5cb07 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:11.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9707fff700 1 -- 172.21.15.44:0/12892920 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97000052d0 con 0x7f96fc003a20 2024-09-13T18:34:11.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9707fff700 1 -- 172.21.15.44:0/12892920 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9700005450 con 0x7f96fc003a20 2024-09-13T18:34:11.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f9707fff700 1 -- 172.21.15.44:0/12892920 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97000038e0 con 0x7f96fc003a20 2024-09-13T18:34:11.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f97167f4700 1 -- 172.21.15.44:0/12892920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96fc003a20 msgr2=0x7f96fc003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:11.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f97167f4700 1 --2- 172.21.15.44:0/12892920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96fc003a20 0x7f96fc003e40 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f97000017e0 tx=0x7f96fc0058a0 comp rx=0 tx=0).stop 2024-09-13T18:34:11.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f97167f4700 1 -- 172.21.15.44:0/12892920 shutdown_connections 2024-09-13T18:34:11.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f97167f4700 1 --2- 172.21.15.44:0/12892920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96fc003a20 0x7f96fc003e40 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:11.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f97167f4700 1 -- 172.21.15.44:0/12892920 >> 172.21.15.44:0/12892920 conn(0x7f97100b0f00 msgr2=0x7f97100b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:11.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.530+0000 7f97167f4700 1 -- 172.21.15.44:0/12892920 shutdown_connections 2024-09-13T18:34:11.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.534+0000 7f97167f4700 1 -- 172.21.15.44:0/12892920 wait complete. 2024-09-13T18:34:11.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.534+0000 7f97167f4700 1 Processor -- start 2024-09-13T18:34:11.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.534+0000 7f97167f4700 1 -- start start 2024-09-13T18:34:11.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.534+0000 7f97167f4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96fc003a20 0x7f9710159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:11.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.534+0000 7f97167f4700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97100a8b10 0x7f97100a8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:11.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.534+0000 7f97167f4700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f971015ea80 0x7f971015ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:11.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.534+0000 7f97167f4700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97100a94d0 con 0x7f96fc003a20 2024-09-13T18:34:11.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.534+0000 7f97167f4700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971015f440 con 0x7f97100a8b10 2024-09-13T18:34:11.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.534+0000 7f97167f4700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971015e770 con 0x7f971015ea80 2024-09-13T18:34:11.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.538+0000 7f97157f2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96fc003a20 0x7f9710159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:11.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.538+0000 7f97157f2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96fc003a20 0x7f9710159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60350/0 (socket says 172.21.15.44:60350) 2024-09-13T18:34:11.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.538+0000 7f97157f2700 1 -- 172.21.15.44:0/986605841 learned_addr learned my addr 172.21.15.44:0/986605841 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:34:11.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.538+0000 7f9714ff1700 1 --2- 172.21.15.44:0/986605841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97100a8b10 0x7f97100a8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:11.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.538+0000 7f9715ff3700 1 --2- 172.21.15.44:0/986605841 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f971015ea80 0x7f971015ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:11.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.538+0000 7f97157f2700 1 -- 172.21.15.44:0/986605841 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f971015ea80 msgr2=0x7f971015ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:11.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.538+0000 7f97157f2700 1 --2- 172.21.15.44:0/986605841 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f971015ea80 0x7f971015ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:11.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.538+0000 7f97157f2700 1 -- 172.21.15.44:0/986605841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97100a8b10 msgr2=0x7f97100a8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:11.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.538+0000 7f97157f2700 1 --2- 172.21.15.44:0/986605841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97100a8b10 0x7f97100a8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:11.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.538+0000 7f97157f2700 1 -- 172.21.15.44:0/986605841 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971015a220 con 0x7f96fc003a20 2024-09-13T18:34:11.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.538+0000 7f97157f2700 1 --2- 172.21.15.44:0/986605841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96fc003a20 0x7f9710159ce0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f9700001dd0 tx=0x7f9700001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:11.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.538+0000 7f9705ffb700 1 -- 172.21.15.44:0/986605841 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9700007240 con 0x7f96fc003a20 2024-09-13T18:34:11.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.538+0000 7f9705ffb700 1 -- 172.21.15.44:0/986605841 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97000073a0 con 0x7f96fc003a20 2024-09-13T18:34:11.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.538+0000 7f97167f4700 1 -- 172.21.15.44:0/986605841 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971015f660 con 0x7f96fc003a20 2024-09-13T18:34:11.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.538+0000 7f9705ffb700 1 -- 172.21.15.44:0/986605841 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9700007750 con 0x7f96fc003a20 2024-09-13T18:34:11.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.538+0000 7f97167f4700 1 -- 172.21.15.44:0/986605841 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971015fc20 con 0x7f96fc003a20 2024-09-13T18:34:11.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.538+0000 7f97167f4700 1 -- 172.21.15.44:0/986605841 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97100b33d0 con 0x7f96fc003a20 2024-09-13T18:34:11.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.542+0000 7f9705ffb700 1 -- 172.21.15.44:0/986605841 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f97000036a0 con 0x7f96fc003a20 2024-09-13T18:34:11.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.542+0000 7f9705ffb700 1 --2- 172.21.15.44:0/986605841 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f96f4066730 0x7f96f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:11.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.542+0000 7f9705ffb700 1 -- 172.21.15.44:0/986605841 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9700084bb0 con 0x7f96fc003a20 2024-09-13T18:34:11.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.542+0000 7f9714ff1700 1 --2- 172.21.15.44:0/986605841 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f96f4066730 0x7f96f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:11.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.542+0000 7f9714ff1700 1 --2- 172.21.15.44:0/986605841 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f96f4066730 0x7f96f4068bf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f971015e400 tx=0x7f970c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:11.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.550+0000 7f9705ffb700 1 -- 172.21.15.44:0/986605841 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9700052030 con 0x7f96fc003a20 2024-09-13T18:34:11.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.754+0000 7f97167f4700 1 -- 172.21.15.44:0/986605841 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97100cb0e0 con 0x7f96fc003a20 2024-09-13T18:34:11.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.754+0000 7f9705ffb700 1 -- 172.21.15.44:0/986605841 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4750 (secure 0 0 0) 0x7f9700017090 con 0x7f96fc003a20 2024-09-13T18:34:11.764 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:34:11.764 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":50,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2305930667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2305930667},{"type":"v1","addr":"172.21.15.99:6835","nonce":2305930667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1177460745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1177460745},{"type":"v1","addr":"172.21.15.44:6834","nonce":1177460745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":50,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:33:16.291148+0000","modified":"2024-09-13T18:33:37.585063+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6858,"mds_1":6849},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6849":{"gid":6849,"name":"a","rank":1,"incarnation":47,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6835/1608555972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1608555972},{"type":"v1","addr":"172.21.15.44:6835","nonce":1608555972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6858":{"gid":6858,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/3072614790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3072614790},{"type":"v1","addr":"172.21.15.99:6837","nonce":3072614790}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:34:11.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.758+0000 7f97167f4700 1 -- 172.21.15.44:0/986605841 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f96f4066730 msgr2=0x7f96f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:11.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.758+0000 7f97167f4700 1 --2- 172.21.15.44:0/986605841 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f96f4066730 0x7f96f4068bf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f971015e400 tx=0x7f970c009240 comp rx=0 tx=0).stop 2024-09-13T18:34:11.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.758+0000 7f97167f4700 1 -- 172.21.15.44:0/986605841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96fc003a20 msgr2=0x7f9710159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:11.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.758+0000 7f97167f4700 1 --2- 172.21.15.44:0/986605841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96fc003a20 0x7f9710159ce0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f9700001dd0 tx=0x7f9700001120 comp rx=0 tx=0).stop 2024-09-13T18:34:11.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.758+0000 7f97167f4700 1 -- 172.21.15.44:0/986605841 shutdown_connections 2024-09-13T18:34:11.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.758+0000 7f97167f4700 1 --2- 172.21.15.44:0/986605841 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f96f4066730 0x7f96f4068bf0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:11.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.758+0000 7f97167f4700 1 --2- 172.21.15.44:0/986605841 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f971015ea80 0x7f971015ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:11.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.758+0000 7f97167f4700 1 --2- 172.21.15.44:0/986605841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97100a8b10 0x7f97100a8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:11.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.758+0000 7f97167f4700 1 --2- 172.21.15.44:0/986605841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96fc003a20 0x7f9710159ce0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:11.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.758+0000 7f97167f4700 1 -- 172.21.15.44:0/986605841 >> 172.21.15.44:0/986605841 conn(0x7f97100b0f00 msgr2=0x7f9710162af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:11.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.758+0000 7f97167f4700 1 -- 172.21.15.44:0/986605841 shutdown_connections 2024-09-13T18:34:11.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:11.758+0000 7f97167f4700 1 -- 172.21.15.44:0/986605841 wait complete. 2024-09-13T18:34:11.769 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 50 2024-09-13T18:34:11.784 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-09-13T18:34:12.074 INFO:teuthology.orchestra.run.smithi099.stdout:{"message":"","return_code":0} 2024-09-13T18:34:12.074 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-13T18:34:12.075 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:34:12.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.178+0000 7f832e193700 1 Processor -- start 2024-09-13T18:34:12.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.178+0000 7f832e193700 1 -- start start 2024-09-13T18:34:12.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f832e193700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f832806e970 0x7f832806ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:12.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f832e193700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f832806c3d0 0x7f832815dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:12.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f832e193700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832815e260 con 0x7f8328159770 2024-09-13T18:34:12.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f832e193700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832806b3d0 con 0x7f832806e970 2024-09-13T18:34:12.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f832e193700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83280cb5b0 con 0x7f832806c3d0 2024-09-13T18:34:12.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f832d191700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8328159770 0x7f832806bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43088/0 (socket says 172.21.15.44:43088) 2024-09-13T18:34:12.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f832d191700 1 -- 172.21.15.44:0/517993089 learned_addr learned my addr 172.21.15.44:0/517993089 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:34:12.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f832d992700 1 --2- 172.21.15.44:0/517993089 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f832806c3d0 0x7f832815dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:12.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f832c990700 1 --2- 172.21.15.44:0/517993089 >> v2:172.21.15.99:3300/0 conn(0x7f832806e970 0x7f832806ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:12.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f831ffff700 1 -- 172.21.15.44:0/517993089 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2605888025 0 0) 0x7f8324001110 con 0x7f8328159770 2024-09-13T18:34:12.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f831ffff700 1 -- 172.21.15.44:0/517993089 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83140035d0 con 0x7f8328159770 2024-09-13T18:34:12.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f831ffff700 1 -- 172.21.15.44:0/517993089 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 257127497 0 0) 0x7f83140035d0 con 0x7f8328159770 2024-09-13T18:34:12.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f831ffff700 1 -- 172.21.15.44:0/517993089 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f832806c3d0 msgr2=0x7f832815dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:12.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f831ffff700 1 --2- 172.21.15.44:0/517993089 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f832806c3d0 0x7f832815dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:12.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f831ffff700 1 -- 172.21.15.44:0/517993089 >> v2:172.21.15.99:3300/0 conn(0x7f832806e970 msgr2=0x7f832806ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:12.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f831ffff700 1 --2- 172.21.15.44:0/517993089 >> v2:172.21.15.99:3300/0 conn(0x7f832806e970 0x7f832806ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:12.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f831ffff700 1 -- 172.21.15.44:0/517993089 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83280cb890 con 0x7f8328159770 2024-09-13T18:34:12.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f831ffff700 1 -- 172.21.15.44:0/517993089 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f8324001800 con 0x7f8328159770 2024-09-13T18:34:12.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f831ffff700 1 -- 172.21.15.44:0/517993089 >> v1:172.21.15.44:6789/0 conn(0x7f8328159770 legacy=0x7f832806bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:12.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f831ffff700 1 --2- 172.21.15.44:0/517993089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8314003a20 0x7f8314003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:12.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f831ffff700 1 --2- 172.21.15.44:0/517993089 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83140043d0 0x7f83140048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:12.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f831ffff700 1 --2- 172.21.15.44:0/517993089 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f832806c3d0 0x7f8314004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:12.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f831ffff700 1 -- 172.21.15.44:0/517993089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832806b3d0 con 0x7f8314003a20 2024-09-13T18:34:12.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f831ffff700 1 -- 172.21.15.44:0/517993089 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83280cb5b0 con 0x7f83140043d0 2024-09-13T18:34:12.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f831ffff700 1 -- 172.21.15.44:0/517993089 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831400ba30 con 0x7f832806c3d0 2024-09-13T18:34:12.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f832d191700 1 --2- 172.21.15.44:0/517993089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8314003a20 0x7f8314003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:12.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f832c990700 1 --2- 172.21.15.44:0/517993089 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83140043d0 0x7f83140048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:12.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.182+0000 7f832d992700 1 --2- 172.21.15.44:0/517993089 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f832806c3d0 0x7f8314004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:12.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.186+0000 7f832d191700 1 -- 172.21.15.44:0/517993089 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f832806c3d0 msgr2=0x7f8314004f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:12.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.186+0000 7f832d191700 1 --2- 172.21.15.44:0/517993089 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f832806c3d0 0x7f8314004f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:12.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.186+0000 7f832d191700 1 -- 172.21.15.44:0/517993089 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83140043d0 msgr2=0x7f83140048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:12.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.186+0000 7f832d191700 1 --2- 172.21.15.44:0/517993089 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83140043d0 0x7f83140048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:12.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.186+0000 7f832d191700 1 -- 172.21.15.44:0/517993089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83140035d0 con 0x7f8314003a20 2024-09-13T18:34:12.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.186+0000 7f832c990700 1 --2- 172.21.15.44:0/517993089 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83140043d0 0x7f83140048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:12.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.186+0000 7f832d191700 1 --2- 172.21.15.44:0/517993089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8314003a20 0x7f8314003e00 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f8324007570 tx=0x7f83140058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b701c2a7cd210579 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:12.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.186+0000 7f831ffff700 1 -- 172.21.15.44:0/517993089 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8324007d90 con 0x7f8314003a20 2024-09-13T18:34:12.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.186+0000 7f831ffff700 1 -- 172.21.15.44:0/517993089 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832400a0d0 con 0x7f8314003a20 2024-09-13T18:34:12.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.186+0000 7f831ffff700 1 -- 172.21.15.44:0/517993089 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832400a460 con 0x7f8314003a20 2024-09-13T18:34:12.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.186+0000 7f832e193700 1 -- 172.21.15.44:0/517993089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8314003a20 msgr2=0x7f8314003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:12.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.186+0000 7f832e193700 1 --2- 172.21.15.44:0/517993089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8314003a20 0x7f8314003e00 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f8324007570 tx=0x7f83140058a0 comp rx=0 tx=0).stop 2024-09-13T18:34:12.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.186+0000 7f832d992700 1 -- 172.21.15.44:0/517993089 reap_dead start 2024-09-13T18:34:12.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.186+0000 7f832e193700 1 -- 172.21.15.44:0/517993089 shutdown_connections 2024-09-13T18:34:12.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.186+0000 7f832e193700 1 -- 172.21.15.44:0/517993089 >> 172.21.15.44:0/517993089 conn(0x7f832806d900 msgr2=0x7f832806dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:12.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.186+0000 7f832e193700 1 -- 172.21.15.44:0/517993089 shutdown_connections 2024-09-13T18:34:12.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.186+0000 7f832e193700 1 -- 172.21.15.44:0/517993089 wait complete. 2024-09-13T18:34:12.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.186+0000 7f832e193700 1 Processor -- start 2024-09-13T18:34:12.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.186+0000 7f832e193700 1 -- start start 2024-09-13T18:34:12.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f832e193700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8314003a20 0x7f8328145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:12.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f832e193700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8328156ca0 0x7f83280addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:12.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f832e193700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83280abd60 0x7f83280ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:12.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f832e193700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83280ae6f0 con 0x7f83280abd60 2024-09-13T18:34:12.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f832e193700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832815d870 con 0x7f8314003a20 2024-09-13T18:34:12.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f832e193700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83280ac720 con 0x7f8328156ca0 2024-09-13T18:34:12.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f832d992700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83280abd60 0x7f83280ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:12.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f832d992700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83280abd60 0x7f83280ac1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52638/0 (socket says 172.21.15.44:52638) 2024-09-13T18:34:12.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f832d992700 1 -- 172.21.15.44:0/184203283 learned_addr learned my addr 172.21.15.44:0/184203283 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:34:12.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f832d191700 1 --2- 172.21.15.44:0/184203283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8314003a20 0x7f8328145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:12.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f832c990700 1 --2- 172.21.15.44:0/184203283 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8328156ca0 0x7f83280addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:12.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f832d992700 1 -- 172.21.15.44:0/184203283 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8328156ca0 msgr2=0x7f83280addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:12.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f832d992700 1 --2- 172.21.15.44:0/184203283 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8328156ca0 0x7f83280addc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:12.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f832d992700 1 -- 172.21.15.44:0/184203283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8314003a20 msgr2=0x7f8328145490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:12.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f832d992700 1 --2- 172.21.15.44:0/184203283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8314003a20 0x7f8328145490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:12.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f832d992700 1 -- 172.21.15.44:0/184203283 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832815cf40 con 0x7f83280abd60 2024-09-13T18:34:12.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f832d992700 1 --2- 172.21.15.44:0/184203283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83280abd60 0x7f83280ac1e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f83280b5370 tx=0x7f83200111d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:12.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f831dffb700 1 -- 172.21.15.44:0/184203283 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832000e070 con 0x7f83280abd60 2024-09-13T18:34:12.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f831dffb700 1 -- 172.21.15.44:0/184203283 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8320003d10 con 0x7f83280abd60 2024-09-13T18:34:12.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f832e193700 1 -- 172.21.15.44:0/184203283 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f832815d220 con 0x7f83280abd60 2024-09-13T18:34:12.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f831dffb700 1 -- 172.21.15.44:0/184203283 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83200117d0 con 0x7f83280abd60 2024-09-13T18:34:12.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f832e193700 1 -- 172.21.15.44:0/184203283 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832815dd00 con 0x7f83280abd60 2024-09-13T18:34:12.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f832e193700 1 -- 172.21.15.44:0/184203283 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832815d9b0 con 0x7f83280abd60 2024-09-13T18:34:12.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.190+0000 7f831dffb700 1 -- 172.21.15.44:0/184203283 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8320011930 con 0x7f83280abd60 2024-09-13T18:34:12.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.194+0000 7f831dffb700 1 --2- 172.21.15.44:0/184203283 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f830c066760 0x7f830c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:12.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.194+0000 7f831dffb700 1 -- 172.21.15.44:0/184203283 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f83200844a0 con 0x7f83280abd60 2024-09-13T18:34:12.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.194+0000 7f832d191700 1 --2- 172.21.15.44:0/184203283 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f830c066760 0x7f830c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:12.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.194+0000 7f832d191700 1 --2- 172.21.15.44:0/184203283 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f830c066760 0x7f830c068c20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8324007570 tx=0x7f832400c070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:12.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.198+0000 7f831dffb700 1 -- 172.21.15.44:0/184203283 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8320051780 con 0x7f83280abd60 2024-09-13T18:34:12.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.410+0000 7f832e193700 1 -- 172.21.15.44:0/184203283 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83280cecd0 con 0x7f83280abd60 2024-09-13T18:34:12.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.414+0000 7f831dffb700 1 -- 172.21.15.44:0/184203283 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4750 (secure 0 0 0) 0x7f8320054da0 con 0x7f83280abd60 2024-09-13T18:34:12.421 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:34:12.421 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":50,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2305930667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2305930667},{"type":"v1","addr":"172.21.15.99:6835","nonce":2305930667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1177460745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1177460745},{"type":"v1","addr":"172.21.15.44:6834","nonce":1177460745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":50,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:33:16.291148+0000","modified":"2024-09-13T18:33:37.585063+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6858,"mds_1":6849},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6849":{"gid":6849,"name":"a","rank":1,"incarnation":47,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6835/1608555972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1608555972},{"type":"v1","addr":"172.21.15.44:6835","nonce":1608555972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6858":{"gid":6858,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/3072614790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3072614790},{"type":"v1","addr":"172.21.15.99:6837","nonce":3072614790}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:34:12.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.414+0000 7f832e193700 1 -- 172.21.15.44:0/184203283 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f830c066760 msgr2=0x7f830c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:12.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.414+0000 7f832e193700 1 --2- 172.21.15.44:0/184203283 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f830c066760 0x7f830c068c20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8324007570 tx=0x7f832400c070 comp rx=0 tx=0).stop 2024-09-13T18:34:12.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.414+0000 7f832e193700 1 -- 172.21.15.44:0/184203283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83280abd60 msgr2=0x7f83280ac1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:12.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.414+0000 7f832e193700 1 --2- 172.21.15.44:0/184203283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83280abd60 0x7f83280ac1e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f83280b5370 tx=0x7f83200111d0 comp rx=0 tx=0).stop 2024-09-13T18:34:12.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.414+0000 7f832e193700 1 -- 172.21.15.44:0/184203283 shutdown_connections 2024-09-13T18:34:12.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.414+0000 7f832e193700 1 --2- 172.21.15.44:0/184203283 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f830c066760 0x7f830c068c20 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:12.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.414+0000 7f832e193700 1 --2- 172.21.15.44:0/184203283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83280abd60 0x7f83280ac1e0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:12.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.414+0000 7f832e193700 1 --2- 172.21.15.44:0/184203283 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8328156ca0 0x7f83280addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:12.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.414+0000 7f832e193700 1 --2- 172.21.15.44:0/184203283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8314003a20 0x7f8328145490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:12.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.414+0000 7f832e193700 1 -- 172.21.15.44:0/184203283 >> 172.21.15.44:0/184203283 conn(0x7f832806d900 msgr2=0x7f83280b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:12.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.414+0000 7f832e193700 1 -- 172.21.15.44:0/184203283 shutdown_connections 2024-09-13T18:34:12.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.414+0000 7f832e193700 1 -- 172.21.15.44:0/184203283 wait complete. 2024-09-13T18:34:12.425 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 50 2024-09-13T18:34:12.436 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-13T18:34:12.746 INFO:teuthology.orchestra.run.smithi044.stdout:{"message":"","return_code":0} 2024-09-13T18:34:12.746 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-13T18:34:12.746 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 4:1 2024-09-13T18:34:12.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.858+0000 7f324759e700 1 Processor -- start 2024-09-13T18:34:12.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.858+0000 7f324759e700 1 -- start start 2024-09-13T18:34:12.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324759e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f32480cc420 0x7f32480cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:12.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324759e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f324806d6f0 0x7f324806db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:12.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324759e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324806e080 con 0x7f32480cc800 2024-09-13T18:34:12.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324759e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32480cdf80 con 0x7f32480cc420 2024-09-13T18:34:12.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324759e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32480ce260 con 0x7f324806d6f0 2024-09-13T18:34:12.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324659c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f32480cc420 0x7f32480cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:12.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324659c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f32480cc420 0x7f32480cd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52640/0 (socket says 172.21.15.44:52640) 2024-09-13T18:34:12.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324659c700 1 -- 172.21.15.44:0/3522949451 learned_addr learned my addr 172.21.15.44:0/3522949451 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:34:12.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f3246d9d700 1 --2- 172.21.15.44:0/3522949451 >> v2:172.21.15.99:3300/0 conn(0x7f324806d6f0 0x7f324806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:12.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324659c700 1 -- 172.21.15.44:0/3522949451 >> v2:172.21.15.99:3300/0 conn(0x7f324806d6f0 msgr2=0x7f324806db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:12.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324659c700 1 --2- 172.21.15.44:0/3522949451 >> v2:172.21.15.99:3300/0 conn(0x7f324806d6f0 0x7f324806db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:12.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324659c700 1 -- 172.21.15.44:0/3522949451 >> v1:172.21.15.99:6789/0 conn(0x7f32480cc800 legacy=0x7f324815a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:12.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324659c700 1 -- 172.21.15.44:0/3522949451 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32480ce540 con 0x7f32480cc420 2024-09-13T18:34:12.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324659c700 1 --2- 172.21.15.44:0/3522949451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32480cc420 0x7f32480cd8f0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f3248159ef0 tx=0x7f323800be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6d658c509a1841 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:12.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324559a700 1 -- 172.21.15.44:0/3522949451 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323800dd90 con 0x7f32480cc420 2024-09-13T18:34:12.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324559a700 1 -- 172.21.15.44:0/3522949451 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3238010470 con 0x7f32480cc420 2024-09-13T18:34:12.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324559a700 1 -- 172.21.15.44:0/3522949451 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3238010800 con 0x7f32480cc420 2024-09-13T18:34:12.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324759e700 1 -- 172.21.15.44:0/3522949451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32480cc420 msgr2=0x7f32480cd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:12.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324759e700 1 --2- 172.21.15.44:0/3522949451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32480cc420 0x7f32480cd8f0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f3248159ef0 tx=0x7f323800be90 comp rx=0 tx=0).stop 2024-09-13T18:34:12.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324759e700 1 -- 172.21.15.44:0/3522949451 shutdown_connections 2024-09-13T18:34:12.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324759e700 1 --2- 172.21.15.44:0/3522949451 >> v2:172.21.15.99:3300/0 conn(0x7f324806d6f0 0x7f324806db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:12.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324759e700 1 --2- 172.21.15.44:0/3522949451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32480cc420 0x7f32480cd8f0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:12.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324759e700 1 -- 172.21.15.44:0/3522949451 >> 172.21.15.44:0/3522949451 conn(0x7f32480cf090 msgr2=0x7f32480cf470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:12.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324759e700 1 -- 172.21.15.44:0/3522949451 shutdown_connections 2024-09-13T18:34:12.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.862+0000 7f324759e700 1 -- 172.21.15.44:0/3522949451 wait complete. 2024-09-13T18:34:12.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f324759e700 1 Processor -- start 2024-09-13T18:34:12.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f324759e700 1 -- start start 2024-09-13T18:34:12.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f324759e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f324806d6f0 0x7f32480cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:12.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f324759e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32480cc420 0x7f324814edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:12.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f324759e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32480cc800 0x7f324814f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:12.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f324759e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32480aae30 con 0x7f32480cc420 2024-09-13T18:34:12.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f324759e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32480cb1d0 con 0x7f32480cc800 2024-09-13T18:34:12.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f324759e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32481f2bc0 con 0x7f324806d6f0 2024-09-13T18:34:12.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f3245d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32480cc420 0x7f324814edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:12.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f324659c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f324806d6f0 0x7f32480cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:12.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f3246d9d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32480cc800 0x7f324814f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:12.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f3246d9d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32480cc800 0x7f324814f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:50890/0 (socket says 172.21.15.44:50890) 2024-09-13T18:34:12.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f324659c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f324806d6f0 0x7f32480cac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:38998/0 (socket says 172.21.15.44:38998) 2024-09-13T18:34:12.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f3246d9d700 1 -- 172.21.15.44:0/340980391 learned_addr learned my addr 172.21.15.44:0/340980391 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:34:12.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f3245d9b700 1 -- 172.21.15.44:0/340980391 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f324806d6f0 msgr2=0x7f32480cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:12.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f3245d9b700 1 --2- 172.21.15.44:0/340980391 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f324806d6f0 0x7f32480cac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:12.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f3245d9b700 1 -- 172.21.15.44:0/340980391 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32480cc800 msgr2=0x7f324814f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:12.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f3245d9b700 1 --2- 172.21.15.44:0/340980391 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32480cc800 0x7f324814f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:12.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f3245d9b700 1 -- 172.21.15.44:0/340980391 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323800b810 con 0x7f32480cc420 2024-09-13T18:34:12.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f3245d9b700 1 --2- 172.21.15.44:0/340980391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32480cc420 0x7f324814edc0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f323c00c410 tx=0x7f323c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:12.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f3236ffd700 1 -- 172.21.15.44:0/340980391 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c0052d0 con 0x7f32480cc420 2024-09-13T18:34:12.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f3236ffd700 1 -- 172.21.15.44:0/340980391 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323c005430 con 0x7f32480cc420 2024-09-13T18:34:12.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f324759e700 1 -- 172.21.15.44:0/340980391 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32480aa500 con 0x7f32480cc420 2024-09-13T18:34:12.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f3236ffd700 1 -- 172.21.15.44:0/340980391 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c0055a0 con 0x7f32480cc420 2024-09-13T18:34:12.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.866+0000 7f324759e700 1 -- 172.21.15.44:0/340980391 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32480aaac0 con 0x7f32480cc420 2024-09-13T18:34:12.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.870+0000 7f324759e700 1 -- 172.21.15.44:0/340980391 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32480aafe0 con 0x7f32480cc420 2024-09-13T18:34:12.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.870+0000 7f3236ffd700 1 -- 172.21.15.44:0/340980391 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f323c0038e0 con 0x7f32480cc420 2024-09-13T18:34:12.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.870+0000 7f3236ffd700 1 --2- 172.21.15.44:0/340980391 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3228066730 0x7f3228068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:12.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.870+0000 7f3236ffd700 1 -- 172.21.15.44:0/340980391 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f323c083420 con 0x7f32480cc420 2024-09-13T18:34:12.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.870+0000 7f324659c700 1 --2- 172.21.15.44:0/340980391 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3228066730 0x7f3228068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:12.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.870+0000 7f324659c700 1 --2- 172.21.15.44:0/340980391 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3228066730 0x7f3228068bf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f323800bfd0 tx=0x7f3238013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:12.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:12.878+0000 7f3236ffd700 1 -- 172.21.15.44:0/340980391 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f32480aafe0 con 0x7f32480cc420 2024-09-13T18:34:13.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.110+0000 7f324759e700 1 -- 172.21.15.44:0/340980391 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "4:1"} v 0) v1 -- 0x7f324806db40 con 0x7f32480cc420 2024-09-13T18:34:13.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.130+0000 7f3236ffd700 1 -- 172.21.15.44:0/340980391 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "4:1"}]=0 failed mds gid 6849 v51) v1 ==== 97+0+0 (secure 0 0 0) 0x7f323c050710 con 0x7f32480cc420 2024-09-13T18:34:13.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.130+0000 7f324759e700 1 -- 172.21.15.44:0/340980391 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3228066730 msgr2=0x7f3228068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.130+0000 7f324759e700 1 --2- 172.21.15.44:0/340980391 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3228066730 0x7f3228068bf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f323800bfd0 tx=0x7f3238013000 comp rx=0 tx=0).stop 2024-09-13T18:34:13.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.130+0000 7f324759e700 1 -- 172.21.15.44:0/340980391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32480cc420 msgr2=0x7f324814edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.130+0000 7f324759e700 1 --2- 172.21.15.44:0/340980391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32480cc420 0x7f324814edc0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f323c00c410 tx=0x7f323c001e70 comp rx=0 tx=0).stop 2024-09-13T18:34:13.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.130+0000 7f324759e700 1 -- 172.21.15.44:0/340980391 shutdown_connections 2024-09-13T18:34:13.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.130+0000 7f324759e700 1 --2- 172.21.15.44:0/340980391 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3228066730 0x7f3228068bf0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.130+0000 7f324759e700 1 --2- 172.21.15.44:0/340980391 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32480cc800 0x7f324814f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.130+0000 7f324759e700 1 --2- 172.21.15.44:0/340980391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32480cc420 0x7f324814edc0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.130+0000 7f324759e700 1 --2- 172.21.15.44:0/340980391 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f324806d6f0 0x7f32480cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.130+0000 7f324759e700 1 -- 172.21.15.44:0/340980391 >> 172.21.15.44:0/340980391 conn(0x7f32480cf090 msgr2=0x7f32480aeb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:13.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.130+0000 7f324759e700 1 -- 172.21.15.44:0/340980391 shutdown_connections 2024-09-13T18:34:13.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.130+0000 7f324759e700 1 -- 172.21.15.44:0/340980391 wait complete. 2024-09-13T18:34:13.142 INFO:teuthology.orchestra.run.smithi044.stderr:failed mds gid 6849 2024-09-13T18:34:13.153 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata ls 2024-09-13T18:34:13.178 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-13T18:34:13.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.182+0000 7f972a6e4140 1 Processor -- start 2024-09-13T18:34:13.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.182+0000 7f972a6e4140 1 -- start start 2024-09-13T18:34:13.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.182+0000 7f972a6e4140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f5c45e3a0 0x557f5c4600e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.182+0000 7f972a6e4140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f5c4ecad0 0x557f5c430780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.182+0000 7f972a6e4140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f5c4ef5d0 0x557f5c474950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.182+0000 7f972a6e4140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f5c3c22f0 con 0x557f5c45e3a0 2024-09-13T18:34:13.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.182+0000 7f972a6e4140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f5c37e8e0 con 0x557f5c4ef5d0 2024-09-13T18:34:13.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.182+0000 7f972a6e4140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f5c37e580 con 0x557f5c4ecad0 2024-09-13T18:34:13.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.182+0000 7f9728219700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f5c45e3a0 0x557f5c4600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.182+0000 7f9728219700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f5c45e3a0 0x557f5c4600e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52696/0 (socket says 172.21.15.44:52696) 2024-09-13T18:34:13.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.182+0000 7f9728219700 1 -- 172.21.15.44:0/3120309102 learned_addr learned my addr 172.21.15.44:0/3120309102 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:34:13.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f9727a18700 1 --2- 172.21.15.44:0/3120309102 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f5c4ecad0 0x557f5c430780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f9728a1a700 1 --2- 172.21.15.44:0/3120309102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f5c4ef5d0 0x557f5c474950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f9728219700 1 -- 172.21.15.44:0/3120309102 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f5c4ecad0 msgr2=0x557f5c430780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:13.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f9728219700 1 --2- 172.21.15.44:0/3120309102 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f5c4ecad0 0x557f5c430780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f9728219700 1 -- 172.21.15.44:0/3120309102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f5c4ef5d0 msgr2=0x557f5c474950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:13.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f9728219700 1 --2- 172.21.15.44:0/3120309102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f5c4ef5d0 0x557f5c474950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f9728219700 1 -- 172.21.15.44:0/3120309102 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972000a100 con 0x557f5c45e3a0 2024-09-13T18:34:13.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f9728219700 1 --2- 172.21.15.44:0/3120309102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f5c45e3a0 0x557f5c4600e0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f97180097b0 tx=0x7f9718005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140793b32ac5a0f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:13.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f9726a16700 1 -- 172.21.15.44:0/3120309102 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971800f040 con 0x557f5c45e3a0 2024-09-13T18:34:13.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f9726a16700 1 -- 172.21.15.44:0/3120309102 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9718008930 con 0x557f5c45e3a0 2024-09-13T18:34:13.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f9726a16700 1 -- 172.21.15.44:0/3120309102 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9718005e10 con 0x557f5c45e3a0 2024-09-13T18:34:13.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f972a6e4140 1 -- 172.21.15.44:0/3120309102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f5c45e3a0 msgr2=0x557f5c4600e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f972a6e4140 1 --2- 172.21.15.44:0/3120309102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f5c45e3a0 0x557f5c4600e0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f97180097b0 tx=0x7f9718005a00 comp rx=0 tx=0).stop 2024-09-13T18:34:13.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f972a6e4140 1 -- 172.21.15.44:0/3120309102 shutdown_connections 2024-09-13T18:34:13.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f972a6e4140 1 --2- 172.21.15.44:0/3120309102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f5c4ef5d0 0x557f5c474950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f972a6e4140 1 --2- 172.21.15.44:0/3120309102 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f5c4ecad0 0x557f5c430780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f972a6e4140 1 --2- 172.21.15.44:0/3120309102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f5c45e3a0 0x557f5c4600e0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f972a6e4140 1 -- 172.21.15.44:0/3120309102 >> 172.21.15.44:0/3120309102 conn(0x557f5c42e5d0 msgr2=0x557f5c431be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:13.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f972a6e4140 1 -- 172.21.15.44:0/3120309102 shutdown_connections 2024-09-13T18:34:13.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f972a6e4140 1 -- 172.21.15.44:0/3120309102 wait complete. 2024-09-13T18:34:13.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f972a6e4140 1 Processor -- start 2024-09-13T18:34:13.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f972a6e4140 1 -- start start 2024-09-13T18:34:13.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f972a6e4140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f5c45e3a0 0x557f5c4eb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f972a6e4140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f5c4ecad0 0x557f5c45a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f972a6e4140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f5c4ef5d0 0x557f5c45a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f972a6e4140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f5c3548d0 con 0x557f5c4ef5d0 2024-09-13T18:34:13.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f972a6e4140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f5c4eb950 con 0x557f5c4ecad0 2024-09-13T18:34:13.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f972a6e4140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f5c5074c0 con 0x557f5c45e3a0 2024-09-13T18:34:13.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f9728a1a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f5c4ef5d0 0x557f5c45a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f9728a1a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f5c4ef5d0 0x557f5c45a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52700/0 (socket says 172.21.15.44:52700) 2024-09-13T18:34:13.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f9728a1a700 1 -- 172.21.15.44:0/162280072 learned_addr learned my addr 172.21.15.44:0/162280072 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:34:13.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f9728219700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f5c45e3a0 0x557f5c4eb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f9727a18700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f5c4ecad0 0x557f5c45a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f9728a1a700 1 -- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f5c45e3a0 msgr2=0x557f5c4eb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f9728a1a700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f5c45e3a0 0x557f5c4eb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f9728a1a700 1 -- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f5c4ecad0 msgr2=0x557f5c45a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f9728a1a700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f5c4ecad0 0x557f5c45a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f9728a1a700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9718009410 con 0x557f5c4ef5d0 2024-09-13T18:34:13.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f9727a18700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f5c4ecad0 0x557f5c45a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:13.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.186+0000 7f9728219700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f5c45e3a0 0x557f5c4eb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:13.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.190+0000 7f9728a1a700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f5c4ef5d0 0x557f5c45a5d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f9720013040 tx=0x7f9720003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:13.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.190+0000 7f9725a14700 1 -- 172.21.15.44:0/162280072 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9720024660 con 0x557f5c4ef5d0 2024-09-13T18:34:13.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.190+0000 7f9725a14700 1 -- 172.21.15.44:0/162280072 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97200247e0 con 0x557f5c4ef5d0 2024-09-13T18:34:13.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.190+0000 7f972a6e4140 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557f5c36cb00 con 0x557f5c4ef5d0 2024-09-13T18:34:13.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.190+0000 7f9725a14700 1 -- 172.21.15.44:0/162280072 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9720024b90 con 0x557f5c4ef5d0 2024-09-13T18:34:13.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.190+0000 7f972a6e4140 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f5c35ff40 con 0x557f5c4ef5d0 2024-09-13T18:34:13.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.190+0000 7f9725a14700 1 -- 172.21.15.44:0/162280072 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9720017070 con 0x557f5c4ef5d0 2024-09-13T18:34:13.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.190+0000 7f9725a14700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9708065090 0x7f9708067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.190+0000 7f9725a14700 1 -- 172.21.15.44:0/162280072 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f97200843d0 con 0x557f5c4ef5d0 2024-09-13T18:34:13.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.190+0000 7f9728219700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9708065090 0x7f9708067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.190+0000 7f972a6e4140 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x557f5c475ce0 0x557f5c4760f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.190+0000 7f972a6e4140 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:1 8.0 8:00000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x557f5c475ce0 2024-09-13T18:34:13.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.190+0000 7f9727a18700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x557f5c475ce0 0x557f5c4760f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.194+0000 7f9728219700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9708065090 0x7f9708067550 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9718005a40 tx=0x7f9718012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:13.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.194+0000 7f9727a18700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x557f5c475ce0 0x557f5c4760f0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:13.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.198+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(1 [pgnls start_epoch 64 out=49b] v63'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f971000f690 con 0x557f5c475ce0 2024-09-13T18:34:13.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.198+0000 7f9727a18700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f9710011900 0x7f9710010380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.198+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- osd_op(unknown.0.0:2 8.10 8:08000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f9710011900 2024-09-13T18:34:13.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.198+0000 7f9728219700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f9710011900 0x7f9710010380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.198+0000 7f9728219700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f9710011900 0x7f9710010380 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:13.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.202+0000 7f9728219700 1 -- 172.21.15.44:0/162280072 <== osd.7 v2:172.21.15.99:6824/2245335901 1 ==== osd_op_reply(2 [pgnls start_epoch 64 out=201b] v63'12 uv12 ondisk = 1) v8 ==== 144+0+201 (crc 0 0 0) 0x7f9718019020 con 0x7f9710011900 2024-09-13T18:34:13.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.202+0000 7f9728219700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f9718013420 0x7f9718013880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.202+0000 7f9728219700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:3 8.8 8:10000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f9718013420 2024-09-13T18:34:13.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.202+0000 7f9727a18700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f9718013420 0x7f9718013880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.206+0000 7f9727a18700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f9718013420 0x7f9718013880 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:13.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.206+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 <== osd.5 v2:172.21.15.99:6800/827163121 1 ==== osd_op_reply(3 [pgnls start_epoch 64 out=73b] v63'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f971000f690 con 0x7f9718013420 2024-09-13T18:34:13.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.206+0000 7f9727a18700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f971000d800 0x7f971000b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.206+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:4 8.18 8:18000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f971000d800 2024-09-13T18:34:13.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.206+0000 7f9728a1a700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f971000d800 0x7f971000b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.206+0000 7f9728a1a700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f971000d800 0x7f971000b270 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:13.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.210+0000 7f9728a1a700 1 -- 172.21.15.44:0/162280072 <== osd.4 v2:172.21.15.99:6816/2515272044 1 ==== osd_op_reply(4 [pgnls start_epoch 64 out=49b] v63'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97200537d0 con 0x7f971000d800 2024-09-13T18:34:13.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.210+0000 7f9728a1a700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:5 8.4 8:20000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f9718013420 2024-09-13T18:34:13.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.210+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 <== osd.5 v2:172.21.15.99:6800/827163121 2 ==== osd_op_reply(5 [pgnls start_epoch 64 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f971000f690 con 0x7f9718013420 2024-09-13T18:34:13.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.210+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:6 8.14 8:28000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f971000d800 2024-09-13T18:34:13.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.214+0000 7f9728a1a700 1 -- 172.21.15.44:0/162280072 <== osd.4 v2:172.21.15.99:6816/2515272044 2 ==== osd_op_reply(6 [pgnls start_epoch 64 out=149b] v63'1253 uv1253 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x7f97200537d0 con 0x7f971000d800 2024-09-13T18:34:13.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.214+0000 7f9728a1a700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7f9720055690 0x7f9720054390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.214+0000 7f9728a1a700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:7 8.c 8:30000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f9720055690 2024-09-13T18:34:13.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.214+0000 7f9728219700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7f9720055690 0x7f9720054390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.214+0000 7f9728219700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7f9720055690 0x7f9720054390 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:13.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.214+0000 7f9728219700 1 -- 172.21.15.44:0/162280072 <== osd.0 v2:172.21.15.44:6800/2647753462 1 ==== osd_op_reply(7 [pgnls start_epoch 64 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9718019020 con 0x7f9720055690 2024-09-13T18:34:13.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.214+0000 7f9728219700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:8 8.1c 8:38000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f9718013420 2024-09-13T18:34:13.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.214+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 <== osd.5 v2:172.21.15.99:6800/827163121 3 ==== osd_op_reply(8 [pgnls start_epoch 64 out=73b] v62'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f971000f690 con 0x7f9718013420 2024-09-13T18:34:13.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.214+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:9 8.2 8:40000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f971000d800 2024-09-13T18:34:13.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.214+0000 7f9728a1a700 1 -- 172.21.15.44:0/162280072 <== osd.4 v2:172.21.15.99:6816/2515272044 3 ==== osd_op_reply(9 [pgnls start_epoch 64 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97200537d0 con 0x7f971000d800 2024-09-13T18:34:13.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.214+0000 7f9728a1a700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f9720054920 0x7f9720005040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.218+0000 7f9728a1a700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:10 8.12 8:48000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f9720054920 2024-09-13T18:34:13.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.218+0000 7f9727a18700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f9720054920 0x7f9720005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.218+0000 7f9727a18700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f9720054920 0x7f9720005040 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:13.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.218+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 <== osd.6 v2:172.21.15.99:6808/2907584318 1 ==== osd_op_reply(10 [pgnls start_epoch 64 out=73b] v63'3 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f971000f690 con 0x7f9720054920 2024-09-13T18:34:13.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.218+0000 7f9727a18700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7f9710025960 0x7f97100233f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.218+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:11 8.a 8:50000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f9710025960 2024-09-13T18:34:13.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.218+0000 7f9728a1a700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7f9710025960 0x7f97100233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.218+0000 7f9728a1a700 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7f9710025960 0x7f97100233f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:13.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.218+0000 7f9728a1a700 1 -- 172.21.15.44:0/162280072 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== osd_op_reply(11 [pgnls start_epoch 64 out=77b] v63'8 uv8 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x7f97200537d0 con 0x7f9710025960 2024-09-13T18:34:13.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.218+0000 7f9728a1a700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:12 8.1a 8:58000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f9720055690 2024-09-13T18:34:13.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.218+0000 7f9728219700 1 -- 172.21.15.44:0/162280072 <== osd.0 v2:172.21.15.44:6800/2647753462 2 ==== osd_op_reply(12 [pgnls start_epoch 64 out=49b] v62'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9718019020 con 0x7f9720055690 2024-09-13T18:34:13.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.218+0000 7f9728219700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:13 8.6 8:60000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f9720055690 2024-09-13T18:34:13.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.218+0000 7f9728219700 1 -- 172.21.15.44:0/162280072 <== osd.0 v2:172.21.15.44:6800/2647753462 3 ==== osd_op_reply(13 [pgnls start_epoch 64 out=77b] v63'9 uv9 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x7f9718019020 con 0x7f9720055690 2024-09-13T18:34:13.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.218+0000 7f9728219700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:14 8.16 8:68000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x557f5c475ce0 2024-09-13T18:34:13.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.222+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 <== osd.3 v2:172.21.15.44:6808/771281770 2 ==== osd_op_reply(14 [pgnls start_epoch 64 out=73b] v63'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f971000f690 con 0x557f5c475ce0 2024-09-13T18:34:13.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.222+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:15 8.e 8:70000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f9720055690 2024-09-13T18:34:13.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.222+0000 7f9728219700 1 -- 172.21.15.44:0/162280072 <== osd.0 v2:172.21.15.44:6800/2647753462 4 ==== osd_op_reply(15 [pgnls start_epoch 64 out=73b] v62'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f9718019020 con 0x7f9720055690 2024-09-13T18:34:13.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.222+0000 7f9728219700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:16 8.1e 8:78000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x557f5c475ce0 2024-09-13T18:34:13.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.222+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 <== osd.3 v2:172.21.15.44:6808/771281770 3 ==== osd_op_reply(16 [pgnls start_epoch 64 out=49b] v62'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f971000f690 con 0x557f5c475ce0 2024-09-13T18:34:13.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.222+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:17 8.1 8:80000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f9710025960 2024-09-13T18:34:13.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.222+0000 7f9728a1a700 1 -- 172.21.15.44:0/162280072 <== osd.1 v2:172.21.15.44:6816/2250405239 2 ==== osd_op_reply(17 [pgnls start_epoch 64 out=49b] v63'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9720072040 con 0x7f9710025960 2024-09-13T18:34:13.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.222+0000 7f9728a1a700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:18 8.11 8:88000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f9718013420 2024-09-13T18:34:13.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.222+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 <== osd.5 v2:172.21.15.99:6800/827163121 4 ==== osd_op_reply(18 [pgnls start_epoch 64 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f971000f690 con 0x7f9718013420 2024-09-13T18:34:13.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.222+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:19 8.9 8:90000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f9720054920 2024-09-13T18:34:13.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.222+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 <== osd.6 v2:172.21.15.99:6808/2907584318 2 ==== osd_op_reply(19 [pgnls start_epoch 64 out=97b] v63'3 uv3 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x7f971000f690 con 0x7f9720054920 2024-09-13T18:34:13.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.222+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:20 8.19 8:98000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f9718013420 2024-09-13T18:34:13.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.222+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 <== osd.5 v2:172.21.15.99:6800/827163121 5 ==== osd_op_reply(20 [pgnls start_epoch 64 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f971000f690 con 0x7f9718013420 2024-09-13T18:34:13.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.222+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:21 8.5 8:a0000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f9720054920 2024-09-13T18:34:13.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.226+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 <== osd.6 v2:172.21.15.99:6808/2907584318 3 ==== osd_op_reply(21 [pgnls start_epoch 64 out=73b] v63'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f971000f690 con 0x7f9720054920 2024-09-13T18:34:13.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.226+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- osd_op(unknown.0.0:22 8.15 8:a8000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f9710011900 2024-09-13T18:34:13.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.226+0000 7f9728219700 1 -- 172.21.15.44:0/162280072 <== osd.7 v2:172.21.15.99:6824/2245335901 2 ==== osd_op_reply(22 [pgnls start_epoch 64 out=127b] v63'4 uv4 ondisk = 1) v8 ==== 144+0+127 (crc 0 0 0) 0x7f9718019020 con 0x7f9710011900 2024-09-13T18:34:13.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.226+0000 7f9728219700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:23 8.d 8:b0000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f9718013420 2024-09-13T18:34:13.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.226+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 <== osd.5 v2:172.21.15.99:6800/827163121 6 ==== osd_op_reply(23 [pgnls start_epoch 64 out=74b] v62'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f971000f690 con 0x7f9718013420 2024-09-13T18:34:13.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.226+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:24 8.1d 8:b8000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f9720055690 2024-09-13T18:34:13.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.226+0000 7f9728219700 1 -- 172.21.15.44:0/162280072 <== osd.0 v2:172.21.15.44:6800/2647753462 5 ==== osd_op_reply(24 [pgnls start_epoch 64 out=73b] v63'3 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f9718019020 con 0x7f9720055690 2024-09-13T18:34:13.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.226+0000 7f9728219700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:25 8.3 8:c0000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f9710025960 2024-09-13T18:34:13.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.226+0000 7f9728a1a700 1 -- 172.21.15.44:0/162280072 <== osd.1 v2:172.21.15.44:6816/2250405239 3 ==== osd_op_reply(25 [pgnls start_epoch 64 out=100b] v63'3 uv3 ondisk = 1) v8 ==== 144+0+100 (crc 0 0 0) 0x7f9720072040 con 0x7f9710025960 2024-09-13T18:34:13.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.226+0000 7f9728a1a700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:26 8.13 8:c8000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x557f5c475ce0 2024-09-13T18:34:13.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.226+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 <== osd.3 v2:172.21.15.44:6808/771281770 4 ==== osd_op_reply(26 [pgnls start_epoch 64 out=122b] v63'5 uv5 ondisk = 1) v8 ==== 144+0+122 (crc 0 0 0) 0x7f971000f690 con 0x557f5c475ce0 2024-09-13T18:34:13.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.226+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:27 8.b 8:d0000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x557f5c475ce0 2024-09-13T18:34:13.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.226+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 <== osd.3 v2:172.21.15.44:6808/771281770 5 ==== osd_op_reply(27 [pgnls start_epoch 64 out=100b] v63'5 uv5 ondisk = 1) v8 ==== 144+0+100 (crc 0 0 0) 0x7f971000f690 con 0x557f5c475ce0 2024-09-13T18:34:13.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.226+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:28 8.1b 8:d8000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f971000d800 2024-09-13T18:34:13.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f9728a1a700 1 -- 172.21.15.44:0/162280072 <== osd.4 v2:172.21.15.99:6816/2515272044 4 ==== osd_op_reply(28 [pgnls start_epoch 64 out=122b] v63'1790 uv1790 ondisk = 1) v8 ==== 144+0+122 (crc 0 0 0) 0x7f9720072040 con 0x7f971000d800 2024-09-13T18:34:13.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f9728a1a700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:29 8.7 8:e0000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f9710025960 2024-09-13T18:34:13.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f9728a1a700 1 -- 172.21.15.44:0/162280072 <== osd.1 v2:172.21.15.44:6816/2250405239 4 ==== osd_op_reply(29 [pgnls start_epoch 64 out=129b] v63'6 uv6 ondisk = 1) v8 ==== 144+0+129 (crc 0 0 0) 0x7f9720072040 con 0x7f9710025960 2024-09-13T18:34:13.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f9728a1a700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- osd_op(unknown.0.0:30 8.17 8:e8000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f9710011900 2024-09-13T18:34:13.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f9728219700 1 -- 172.21.15.44:0/162280072 <== osd.7 v2:172.21.15.99:6824/2245335901 3 ==== osd_op_reply(30 [pgnls start_epoch 64 out=97b] v63'8 uv8 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x7f9718019020 con 0x7f9710011900 2024-09-13T18:34:13.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f9728219700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:31 8.f 8:f0000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x557f5c475ce0 2024-09-13T18:34:13.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 <== osd.3 v2:172.21.15.44:6808/771281770 6 ==== osd_op_reply(31 [pgnls start_epoch 64 out=73b] v62'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f971000f690 con 0x557f5c475ce0 2024-09-13T18:34:13.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f9727a18700 1 -- 172.21.15.44:0/162280072 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:32 8.1f 8:f8000000::::head [pgnls start_epoch 64 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e64) v8 -- 0x557f5c476630 con 0x7f9720055690 2024-09-13T18:34:13.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f9728219700 1 -- 172.21.15.44:0/162280072 <== osd.0 v2:172.21.15.44:6800/2647753462 6 ==== osd_op_reply(32 [pgnls start_epoch 64 out=101b] v63'6 uv6 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x7f9718019020 con 0x7f9720055690 2024-09-13T18:34:13.244 INFO:teuthology.orchestra.run.smithi044.stdout:601.00000000 2024-09-13T18:34:13.244 INFO:teuthology.orchestra.run.smithi044.stdout:602.00000000 2024-09-13T18:34:13.244 INFO:teuthology.orchestra.run.smithi044.stdout:10000000000.00000000 2024-09-13T18:34:13.244 INFO:teuthology.orchestra.run.smithi044.stdout:600.00000000 2024-09-13T18:34:13.244 INFO:teuthology.orchestra.run.smithi044.stdout:603.00000000 2024-09-13T18:34:13.244 INFO:teuthology.orchestra.run.smithi044.stdout:60a.00000000 2024-09-13T18:34:13.244 INFO:teuthology.orchestra.run.smithi044.stdout:613.00000000 2024-09-13T18:34:13.244 INFO:teuthology.orchestra.run.smithi044.stdout:1.00000000.inode 2024-09-13T18:34:13.244 INFO:teuthology.orchestra.run.smithi044.stdout:200.00000000 2024-09-13T18:34:13.244 INFO:teuthology.orchestra.run.smithi044.stdout:610.00000000 2024-09-13T18:34:13.244 INFO:teuthology.orchestra.run.smithi044.stdout:606.00000000 2024-09-13T18:34:13.244 INFO:teuthology.orchestra.run.smithi044.stdout:607.00000000 2024-09-13T18:34:13.245 INFO:teuthology.orchestra.run.smithi044.stdout:60e.00000000 2024-09-13T18:34:13.245 INFO:teuthology.orchestra.run.smithi044.stdout:mds1_openfiles.0 2024-09-13T18:34:13.245 INFO:teuthology.orchestra.run.smithi044.stdout:mds0_openfiles.0 2024-09-13T18:34:13.245 INFO:teuthology.orchestra.run.smithi044.stdout:60f.00000000 2024-09-13T18:34:13.245 INFO:teuthology.orchestra.run.smithi044.stdout:608.00000000 2024-09-13T18:34:13.245 INFO:teuthology.orchestra.run.smithi044.stdout:501.00000000 2024-09-13T18:34:13.245 INFO:teuthology.orchestra.run.smithi044.stdout:612.00000000 2024-09-13T18:34:13.246 INFO:teuthology.orchestra.run.smithi044.stdout:401.00000000 2024-09-13T18:34:13.246 INFO:teuthology.orchestra.run.smithi044.stdout:604.00000000 2024-09-13T18:34:13.246 INFO:teuthology.orchestra.run.smithi044.stdout:101.00000000.inode 2024-09-13T18:34:13.246 INFO:teuthology.orchestra.run.smithi044.stdout:500.00000000 2024-09-13T18:34:13.246 INFO:teuthology.orchestra.run.smithi044.stdout:mds_snaptable 2024-09-13T18:34:13.246 INFO:teuthology.orchestra.run.smithi044.stdout:605.00000000 2024-09-13T18:34:13.246 INFO:teuthology.orchestra.run.smithi044.stdout:101.00000000 2024-09-13T18:34:13.246 INFO:teuthology.orchestra.run.smithi044.stdout:mds1_sessionmap 2024-09-13T18:34:13.246 INFO:teuthology.orchestra.run.smithi044.stdout:mds0_inotable 2024-09-13T18:34:13.246 INFO:teuthology.orchestra.run.smithi044.stdout:611.00000000 2024-09-13T18:34:13.246 INFO:teuthology.orchestra.run.smithi044.stdout:100.00000000 2024-09-13T18:34:13.246 INFO:teuthology.orchestra.run.smithi044.stdout:mds0_sessionmap 2024-09-13T18:34:13.247 INFO:teuthology.orchestra.run.smithi044.stdout:60c.00000000 2024-09-13T18:34:13.247 INFO:teuthology.orchestra.run.smithi044.stdout:201.00000001 2024-09-13T18:34:13.247 INFO:teuthology.orchestra.run.smithi044.stdout:mds1_inotable 2024-09-13T18:34:13.247 INFO:teuthology.orchestra.run.smithi044.stdout:200.00000002 2024-09-13T18:34:13.247 INFO:teuthology.orchestra.run.smithi044.stdout:609.00000000 2024-09-13T18:34:13.247 INFO:teuthology.orchestra.run.smithi044.stdout:10000000001.00000000 2024-09-13T18:34:13.247 INFO:teuthology.orchestra.run.smithi044.stdout:60b.00000000 2024-09-13T18:34:13.247 INFO:teuthology.orchestra.run.smithi044.stdout:60d.00000000 2024-09-13T18:34:13.247 INFO:teuthology.orchestra.run.smithi044.stdout:201.00000000 2024-09-13T18:34:13.247 INFO:teuthology.orchestra.run.smithi044.stdout:400.00000000 2024-09-13T18:34:13.247 INFO:teuthology.orchestra.run.smithi044.stdout:100.00000000.inode 2024-09-13T18:34:13.247 INFO:teuthology.orchestra.run.smithi044.stdout:1.00000000 2024-09-13T18:34:13.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f972a6e4140 1 -- 172.21.15.44:0/162280072 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7f9720055690 msgr2=0x7f9720054390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f972a6e4140 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7f9720055690 0x7f9720054390 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f972a6e4140 1 -- 172.21.15.44:0/162280072 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7f9710025960 msgr2=0x7f97100233f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f972a6e4140 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7f9710025960 0x7f97100233f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f972a6e4140 1 -- 172.21.15.44:0/162280072 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x557f5c475ce0 msgr2=0x557f5c4760f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f972a6e4140 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x557f5c475ce0 0x557f5c4760f0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f972a6e4140 1 -- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f971000d800 msgr2=0x7f971000b270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f972a6e4140 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f971000d800 0x7f971000b270 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f9728a1a700 1 -- 172.21.15.44:0/162280072 reap_dead start 2024-09-13T18:34:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f972a6e4140 1 -- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f9718013420 msgr2=0x7f9718013880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f972a6e4140 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f9718013420 0x7f9718013880 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f9728a1a700 1 -- 172.21.15.44:0/162280072 reap_dead start 2024-09-13T18:34:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f972a6e4140 1 -- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f9720054920 msgr2=0x7f9720005040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f972a6e4140 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f9720054920 0x7f9720005040 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f972a6e4140 1 -- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f9710011900 msgr2=0x7f9710010380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f972a6e4140 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f9710011900 0x7f9710010380 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f972a6e4140 1 -- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9708065090 msgr2=0x7f9708067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f972a6e4140 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9708065090 0x7f9708067550 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9718005a40 tx=0x7f9718012000 comp rx=0 tx=0).stop 2024-09-13T18:34:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f972a6e4140 1 -- 172.21.15.44:0/162280072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f5c4ef5d0 msgr2=0x557f5c45a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f972a6e4140 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f5c4ef5d0 0x557f5c45a5d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f9720013040 tx=0x7f9720003330 comp rx=0 tx=0).stop 2024-09-13T18:34:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.230+0000 7f972a6e4140 1 -- 172.21.15.44:0/162280072 shutdown_connections 2024-09-13T18:34:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.234+0000 7f972a6e4140 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f9710011900 0x7f9710010380 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.234+0000 7f972a6e4140 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f9720054920 0x7f9720005040 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.234+0000 7f972a6e4140 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9708065090 0x7f9708067550 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.234+0000 7f972a6e4140 1 --2- 172.21.15.44:0/162280072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f5c4ef5d0 0x557f5c45a5d0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.234+0000 7f972a6e4140 1 -- 172.21.15.44:0/162280072 >> 172.21.15.44:0/162280072 conn(0x557f5c42e5d0 msgr2=0x557f5c431be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.234+0000 7f972a6e4140 1 -- 172.21.15.44:0/162280072 shutdown_connections 2024-09-13T18:34:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.234+0000 7f972a6e4140 1 -- 172.21.15.44:0/162280072 wait complete. 2024-09-13T18:34:13.252 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm mds1_openfiles.0 2024-09-13T18:34:13.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.330+0000 7efe7d619140 1 Processor -- start 2024-09-13T18:34:13.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.330+0000 7efe7d619140 1 -- start start 2024-09-13T18:34:13.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.330+0000 7efe7d619140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55847dac1140 0x55847db95900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.330+0000 7efe7d619140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55847db97520 0x55847db05360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.330+0000 7efe7d619140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55847db9a570 0x55847db058a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.330+0000 7efe7d619140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55847da532f0 con 0x55847db97520 2024-09-13T18:34:13.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.330+0000 7efe7d619140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55847da0f8e0 con 0x55847dac1140 2024-09-13T18:34:13.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.330+0000 7efe7d619140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55847da0f580 con 0x55847db9a570 2024-09-13T18:34:13.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.330+0000 7efe7a94d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55847db97520 0x55847db05360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.330+0000 7efe7a94d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55847db97520 0x55847db05360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52718/0 (socket says 172.21.15.44:52718) 2024-09-13T18:34:13.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.330+0000 7efe7a94d700 1 -- 172.21.15.44:0/2524855564 learned_addr learned my addr 172.21.15.44:0/2524855564 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:34:13.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.330+0000 7efe7b14e700 1 --2- 172.21.15.44:0/2524855564 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55847dac1140 0x55847db95900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.330+0000 7efe7b94f700 1 --2- 172.21.15.44:0/2524855564 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55847db9a570 0x55847db058a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.330+0000 7efe7a94d700 1 -- 172.21.15.44:0/2524855564 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55847db9a570 msgr2=0x55847db058a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:13.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.330+0000 7efe7a94d700 1 --2- 172.21.15.44:0/2524855564 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55847db9a570 0x55847db058a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.330+0000 7efe7a94d700 1 -- 172.21.15.44:0/2524855564 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55847dac1140 msgr2=0x55847db95900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:13.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.330+0000 7efe7a94d700 1 --2- 172.21.15.44:0/2524855564 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55847dac1140 0x55847db95900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.330+0000 7efe7a94d700 1 -- 172.21.15.44:0/2524855564 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6c005de0 con 0x55847db97520 2024-09-13T18:34:13.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.330+0000 7efe7a94d700 1 --2- 172.21.15.44:0/2524855564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55847db97520 0x55847db05360 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7efe64009750 tx=0x7efe64005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1ab35eb381e661 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:13.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.330+0000 7efe7994b700 1 -- 172.21.15.44:0/2524855564 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6400f040 con 0x55847db97520 2024-09-13T18:34:13.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.330+0000 7efe7994b700 1 -- 172.21.15.44:0/2524855564 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe64008870 con 0x55847db97520 2024-09-13T18:34:13.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.330+0000 7efe7994b700 1 -- 172.21.15.44:0/2524855564 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe64005e10 con 0x55847db97520 2024-09-13T18:34:13.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.334+0000 7efe7d619140 1 -- 172.21.15.44:0/2524855564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55847db97520 msgr2=0x55847db05360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.334+0000 7efe7d619140 1 --2- 172.21.15.44:0/2524855564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55847db97520 0x55847db05360 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7efe64009750 tx=0x7efe64005a00 comp rx=0 tx=0).stop 2024-09-13T18:34:13.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.334+0000 7efe7d619140 1 -- 172.21.15.44:0/2524855564 shutdown_connections 2024-09-13T18:34:13.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.334+0000 7efe7d619140 1 --2- 172.21.15.44:0/2524855564 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55847db9a570 0x55847db058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.334+0000 7efe7d619140 1 --2- 172.21.15.44:0/2524855564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55847db97520 0x55847db05360 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.334+0000 7efe7d619140 1 --2- 172.21.15.44:0/2524855564 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55847dac1140 0x55847db95900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.334+0000 7efe7d619140 1 -- 172.21.15.44:0/2524855564 >> 172.21.15.44:0/2524855564 conn(0x55847daf0280 msgr2=0x55847db7cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:13.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.334+0000 7efe7d619140 1 -- 172.21.15.44:0/2524855564 shutdown_connections 2024-09-13T18:34:13.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.334+0000 7efe7d619140 1 -- 172.21.15.44:0/2524855564 wait complete. 2024-09-13T18:34:13.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.334+0000 7efe7d619140 1 Processor -- start 2024-09-13T18:34:13.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.334+0000 7efe7d619140 1 -- start start 2024-09-13T18:34:13.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.334+0000 7efe7d619140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55847dac1140 0x55847daf1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.334+0000 7efe7d619140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55847db97520 0x55847daf2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.334+0000 7efe7d619140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55847db9a570 0x55847daf3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.334+0000 7efe7d619140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55847d9e58d0 con 0x55847db97520 2024-09-13T18:34:13.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.334+0000 7efe7d619140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55847dc2e0a0 con 0x55847dac1140 2024-09-13T18:34:13.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.334+0000 7efe7d619140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55847dc2e340 con 0x55847db9a570 2024-09-13T18:34:13.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.334+0000 7efe7a94d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55847db97520 0x55847daf2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.334+0000 7efe7b94f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55847db9a570 0x55847daf3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.334+0000 7efe7a94d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55847db97520 0x55847daf2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52720/0 (socket says 172.21.15.44:52720) 2024-09-13T18:34:13.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.334+0000 7efe7a94d700 1 -- 172.21.15.44:0/3528111807 learned_addr learned my addr 172.21.15.44:0/3528111807 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:34:13.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.334+0000 7efe7b14e700 1 --2- 172.21.15.44:0/3528111807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55847dac1140 0x55847daf1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.338+0000 7efe7a94d700 1 -- 172.21.15.44:0/3528111807 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55847db9a570 msgr2=0x55847daf3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.338+0000 7efe7a94d700 1 --2- 172.21.15.44:0/3528111807 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55847db9a570 0x55847daf3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.338+0000 7efe7a94d700 1 -- 172.21.15.44:0/3528111807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55847dac1140 msgr2=0x55847daf1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.338+0000 7efe7a94d700 1 --2- 172.21.15.44:0/3528111807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55847dac1140 0x55847daf1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.338+0000 7efe7a94d700 1 -- 172.21.15.44:0/3528111807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe64009410 con 0x55847db97520 2024-09-13T18:34:13.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.338+0000 7efe7a94d700 1 --2- 172.21.15.44:0/3528111807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55847db97520 0x55847daf2de0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7efe64009fd0 tx=0x7efe64003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:13.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.338+0000 7efe78949700 1 -- 172.21.15.44:0/3528111807 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6400f070 con 0x55847db97520 2024-09-13T18:34:13.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.338+0000 7efe78949700 1 -- 172.21.15.44:0/3528111807 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe64013630 con 0x55847db97520 2024-09-13T18:34:13.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.338+0000 7efe7d619140 1 -- 172.21.15.44:0/3528111807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55847d9fdb00 con 0x55847db97520 2024-09-13T18:34:13.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.338+0000 7efe78949700 1 -- 172.21.15.44:0/3528111807 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe640139e0 con 0x55847db97520 2024-09-13T18:34:13.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.338+0000 7efe7d619140 1 -- 172.21.15.44:0/3528111807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55847d9f0f40 con 0x55847db97520 2024-09-13T18:34:13.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.338+0000 7efe78949700 1 -- 172.21.15.44:0/3528111807 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efe64023070 con 0x55847db97520 2024-09-13T18:34:13.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.342+0000 7efe78949700 1 --2- 172.21.15.44:0/3528111807 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe60065090 0x7efe60067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.342+0000 7efe78949700 1 -- 172.21.15.44:0/3528111807 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5795+0+0 (secure 0 0 0) 0x7efe64084ad0 con 0x55847db97520 2024-09-13T18:34:13.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.342+0000 7efe7d619140 1 --2- 172.21.15.44:0/3528111807 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x55847dc2f230 0x55847dc2f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.342+0000 7efe7b14e700 1 --2- 172.21.15.44:0/3528111807 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe60065090 0x7efe60067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.342+0000 7efe7d619140 1 -- 172.21.15.44:0/3528111807 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:1 8.a 8:54ba6923:::mds1_openfiles.0:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e64) v8 -- 0x55847dc37f30 con 0x55847dc2f230 2024-09-13T18:34:13.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.342+0000 7efe7b94f700 1 --2- 172.21.15.44:0/3528111807 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x55847dc2f230 0x55847dc2f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.342+0000 7efe7b14e700 1 --2- 172.21.15.44:0/3528111807 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe60065090 0x7efe60067550 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x55847daf0ea0 tx=0x7efe6c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:13.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.342+0000 7efe7b94f700 1 --2- 172.21.15.44:0/3528111807 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x55847dc2f230 0x55847dc2f640 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:13.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.346+0000 7efe7b94f700 1 -- 172.21.15.44:0/3528111807 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== osd_op_reply(1 mds1_openfiles.0 [delete] v64'9 uv9 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7efe740105a0 con 0x55847dc2f230 2024-09-13T18:34:13.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.346+0000 7efe7d619140 1 -- 172.21.15.44:0/3528111807 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x55847dc2f230 msgr2=0x55847dc2f640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.346+0000 7efe7d619140 1 --2- 172.21.15.44:0/3528111807 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x55847dc2f230 0x55847dc2f640 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.346+0000 7efe7d619140 1 -- 172.21.15.44:0/3528111807 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe60065090 msgr2=0x7efe60067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.346+0000 7efe7d619140 1 --2- 172.21.15.44:0/3528111807 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe60065090 0x7efe60067550 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x55847daf0ea0 tx=0x7efe6c00f000 comp rx=0 tx=0).stop 2024-09-13T18:34:13.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.346+0000 7efe7d619140 1 -- 172.21.15.44:0/3528111807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55847db97520 msgr2=0x55847daf2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.346+0000 7efe7d619140 1 --2- 172.21.15.44:0/3528111807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55847db97520 0x55847daf2de0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7efe64009fd0 tx=0x7efe64003020 comp rx=0 tx=0).stop 2024-09-13T18:34:13.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.346+0000 7efe7b94f700 1 -- 172.21.15.44:0/3528111807 reap_dead start 2024-09-13T18:34:13.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.346+0000 7efe7d619140 1 -- 172.21.15.44:0/3528111807 shutdown_connections 2024-09-13T18:34:13.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.346+0000 7efe7d619140 1 -- 172.21.15.44:0/3528111807 >> 172.21.15.44:0/3528111807 conn(0x55847daf0280 msgr2=0x55847db7cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:13.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.346+0000 7efe7d619140 1 -- 172.21.15.44:0/3528111807 shutdown_connections 2024-09-13T18:34:13.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.346+0000 7efe7d619140 1 -- 172.21.15.44:0/3528111807 wait complete. 2024-09-13T18:34:13.358 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm mds1_sessionmap 2024-09-13T18:34:13.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.390+0000 7efc2d91c140 1 Processor -- start 2024-09-13T18:34:13.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.390+0000 7efc2d91c140 1 -- start start 2024-09-13T18:34:13.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2d91c140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dd123d140 0x561dd12f8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2d91c140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561dd1313140 0x561dd13a49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2d91c140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561dd1313520 0x561dd13a4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2d91c140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dd11d3a00 con 0x561dd123d140 2024-09-13T18:34:13.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2d91c140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dd11cf2f0 con 0x561dd1313140 2024-09-13T18:34:13.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2d91c140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x561dd118b8e0 con 0x561dd1313520 2024-09-13T18:34:13.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2b451700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dd123d140 0x561dd12f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2bc52700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561dd1313520 0x561dd13a4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2ac50700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561dd1313140 0x561dd13a49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2b451700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dd123d140 0x561dd12f8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52730/0 (socket says 172.21.15.44:52730) 2024-09-13T18:34:13.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2b451700 1 -- 172.21.15.44:0/3085275104 learned_addr learned my addr 172.21.15.44:0/3085275104 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:34:13.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2b451700 1 -- 172.21.15.44:0/3085275104 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561dd1313520 msgr2=0x561dd13a4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:13.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2b451700 1 --2- 172.21.15.44:0/3085275104 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561dd1313520 0x561dd13a4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2b451700 1 -- 172.21.15.44:0/3085275104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561dd1313140 msgr2=0x561dd13a49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:13.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2b451700 1 --2- 172.21.15.44:0/3085275104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561dd1313140 0x561dd13a49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2b451700 1 -- 172.21.15.44:0/3085275104 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc14005d20 con 0x561dd123d140 2024-09-13T18:34:13.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2ac50700 1 --2- 172.21.15.44:0/3085275104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561dd1313140 0x561dd13a49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:34:13.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2b451700 1 --2- 172.21.15.44:0/3085275104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dd123d140 0x561dd12f8dd0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7efc24001760 tx=0x7efc24001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1ca97fad058c73d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:13.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc29c4e700 1 -- 172.21.15.44:0/3085275104 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc24002690 con 0x561dd123d140 2024-09-13T18:34:13.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc29c4e700 1 -- 172.21.15.44:0/3085275104 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc24002810 con 0x561dd123d140 2024-09-13T18:34:13.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc29c4e700 1 -- 172.21.15.44:0/3085275104 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc24002bc0 con 0x561dd123d140 2024-09-13T18:34:13.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2d91c140 1 -- 172.21.15.44:0/3085275104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dd123d140 msgr2=0x561dd12f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2d91c140 1 --2- 172.21.15.44:0/3085275104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dd123d140 0x561dd12f8dd0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7efc24001760 tx=0x7efc24001a70 comp rx=0 tx=0).stop 2024-09-13T18:34:13.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2d91c140 1 -- 172.21.15.44:0/3085275104 shutdown_connections 2024-09-13T18:34:13.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2d91c140 1 --2- 172.21.15.44:0/3085275104 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561dd1313520 0x561dd13a4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2d91c140 1 --2- 172.21.15.44:0/3085275104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561dd1313140 0x561dd13a49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.394+0000 7efc2d91c140 1 --2- 172.21.15.44:0/3085275104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dd123d140 0x561dd12f8dd0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.398+0000 7efc2d91c140 1 -- 172.21.15.44:0/3085275104 >> 172.21.15.44:0/3085275104 conn(0x561dd126c280 msgr2=0x561dd13123e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:13.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.398+0000 7efc2d91c140 1 -- 172.21.15.44:0/3085275104 shutdown_connections 2024-09-13T18:34:13.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.398+0000 7efc2d91c140 1 -- 172.21.15.44:0/3085275104 wait complete. 2024-09-13T18:34:13.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.398+0000 7efc2d91c140 1 Processor -- start 2024-09-13T18:34:13.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.398+0000 7efc2d91c140 1 -- start start 2024-09-13T18:34:13.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.398+0000 7efc2d91c140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dd123d140 0x561dd13069c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.398+0000 7efc2d91c140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561dd1313140 0x561dd13aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.398+0000 7efc2d91c140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561dd1313520 0x561dd13ab430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.398+0000 7efc2d91c140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dd118b580 con 0x561dd123d140 2024-09-13T18:34:13.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.402+0000 7efc2d91c140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dd11618d0 con 0x561dd1313520 2024-09-13T18:34:13.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.402+0000 7efc2d91c140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x561dd13a8950 con 0x561dd1313140 2024-09-13T18:34:13.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.402+0000 7efc2b451700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dd123d140 0x561dd13069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.402+0000 7efc2b451700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dd123d140 0x561dd13069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52736/0 (socket says 172.21.15.44:52736) 2024-09-13T18:34:13.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.402+0000 7efc2b451700 1 -- 172.21.15.44:0/3664844290 learned_addr learned my addr 172.21.15.44:0/3664844290 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:34:13.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.402+0000 7efc2ac50700 1 --2- 172.21.15.44:0/3664844290 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561dd1313140 0x561dd13aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.402+0000 7efc2bc52700 1 --2- 172.21.15.44:0/3664844290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561dd1313520 0x561dd13ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.402+0000 7efc2b451700 1 -- 172.21.15.44:0/3664844290 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561dd1313140 msgr2=0x561dd13aaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.402+0000 7efc2b451700 1 --2- 172.21.15.44:0/3664844290 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561dd1313140 0x561dd13aaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.402+0000 7efc2b451700 1 -- 172.21.15.44:0/3664844290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561dd1313520 msgr2=0x561dd13ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.402+0000 7efc2b451700 1 --2- 172.21.15.44:0/3664844290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561dd1313520 0x561dd13ab430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.402+0000 7efc2b451700 1 -- 172.21.15.44:0/3664844290 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561dd1179b00 con 0x561dd123d140 2024-09-13T18:34:13.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.402+0000 7efc2ac50700 1 --2- 172.21.15.44:0/3664844290 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x561dd1313140 0x561dd13aaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:13.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.402+0000 7efc2b451700 1 --2- 172.21.15.44:0/3664844290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dd123d140 0x561dd13069c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7efc240012e0 tx=0x7efc24001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:13.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.402+0000 7efc28c4c700 1 -- 172.21.15.44:0/3664844290 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc24006560 con 0x561dd123d140 2024-09-13T18:34:13.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.402+0000 7efc28c4c700 1 -- 172.21.15.44:0/3664844290 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2401e840 con 0x561dd123d140 2024-09-13T18:34:13.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.402+0000 7efc2d91c140 1 -- 172.21.15.44:0/3664844290 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc24006d10 con 0x561dd123d140 2024-09-13T18:34:13.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.402+0000 7efc28c4c700 1 -- 172.21.15.44:0/3664844290 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2401ebf0 con 0x561dd123d140 2024-09-13T18:34:13.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.402+0000 7efc2d91c140 1 -- 172.21.15.44:0/3664844290 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561dd116cf40 con 0x561dd123d140 2024-09-13T18:34:13.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.402+0000 7efc28c4c700 1 -- 172.21.15.44:0/3664844290 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efc24003070 con 0x561dd123d140 2024-09-13T18:34:13.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.406+0000 7efc28c4c700 1 --2- 172.21.15.44:0/3664844290 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efc10065090 0x7efc10067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.406+0000 7efc28c4c700 1 -- 172.21.15.44:0/3664844290 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5795+0+0 (secure 0 0 0) 0x7efc24084440 con 0x561dd123d140 2024-09-13T18:34:13.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.406+0000 7efc2ac50700 1 --2- 172.21.15.44:0/3664844290 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efc10065090 0x7efc10067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.406+0000 7efc2d91c140 1 --2- 172.21.15.44:0/3664844290 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x561dd13a8480 0x561dd13a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.406+0000 7efc2d91c140 1 -- 172.21.15.44:0/3664844290 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:1 8.3 8:c27f454c:::mds1_sessionmap:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e64) v8 -- 0x561dd13a9db0 con 0x561dd13a8480 2024-09-13T18:34:13.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.406+0000 7efc2bc52700 1 --2- 172.21.15.44:0/3664844290 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x561dd13a8480 0x561dd13a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.406+0000 7efc2ac50700 1 --2- 172.21.15.44:0/3664844290 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efc10065090 0x7efc10067550 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efc1400af40 tx=0x7efc1400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:13.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.406+0000 7efc2bc52700 1 --2- 172.21.15.44:0/3664844290 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x561dd13a8480 0x561dd13a9870 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:13.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.410+0000 7efc2bc52700 1 -- 172.21.15.44:0/3664844290 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== osd_op_reply(1 mds1_sessionmap [delete] v64'4 uv4 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7efc1c00e440 con 0x561dd13a8480 2024-09-13T18:34:13.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.410+0000 7efc2d91c140 1 -- 172.21.15.44:0/3664844290 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x561dd13a8480 msgr2=0x561dd13a9870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.410+0000 7efc2d91c140 1 --2- 172.21.15.44:0/3664844290 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x561dd13a8480 0x561dd13a9870 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.410+0000 7efc2d91c140 1 -- 172.21.15.44:0/3664844290 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efc10065090 msgr2=0x7efc10067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.410+0000 7efc2d91c140 1 --2- 172.21.15.44:0/3664844290 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efc10065090 0x7efc10067550 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efc1400af40 tx=0x7efc1400f000 comp rx=0 tx=0).stop 2024-09-13T18:34:13.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.410+0000 7efc2d91c140 1 -- 172.21.15.44:0/3664844290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dd123d140 msgr2=0x561dd13069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.410+0000 7efc2d91c140 1 --2- 172.21.15.44:0/3664844290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dd123d140 0x561dd13069c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7efc240012e0 tx=0x7efc24001250 comp rx=0 tx=0).stop 2024-09-13T18:34:13.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.410+0000 7efc2bc52700 1 -- 172.21.15.44:0/3664844290 reap_dead start 2024-09-13T18:34:13.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.410+0000 7efc2d91c140 1 -- 172.21.15.44:0/3664844290 shutdown_connections 2024-09-13T18:34:13.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.410+0000 7efc2d91c140 1 -- 172.21.15.44:0/3664844290 >> 172.21.15.44:0/3664844290 conn(0x561dd126c280 msgr2=0x561dd12f8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:13.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.410+0000 7efc2d91c140 1 -- 172.21.15.44:0/3664844290 shutdown_connections 2024-09-13T18:34:13.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.410+0000 7efc2d91c140 1 -- 172.21.15.44:0/3664844290 wait complete. 2024-09-13T18:34:13.421 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm mds1_inotable 2024-09-13T18:34:13.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdf1c0140 1 Processor -- start 2024-09-13T18:34:13.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdf1c0140 1 -- start start 2024-09-13T18:34:13.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdf1c0140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fbba085160 0x55fbba1123a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdf1c0140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbba085540 0x55fbba06ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdf1c0140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fbba0f5840 0x55fbba07b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdf1c0140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbb9fcd2f0 con 0x55fbba085540 2024-09-13T18:34:13.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdf1c0140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbb9f898e0 con 0x55fbba0f5840 2024-09-13T18:34:13.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdf1c0140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fbb9f89580 con 0x55fbba085160 2024-09-13T18:34:13.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdc4f4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbba085540 0x55fbba06ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdc4f4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbba085540 0x55fbba06ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52754/0 (socket says 172.21.15.44:52754) 2024-09-13T18:34:13.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdc4f4700 1 -- 172.21.15.44:0/2551601794 learned_addr learned my addr 172.21.15.44:0/2551601794 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:34:13.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdd4f6700 1 --2- 172.21.15.44:0/2551601794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fbba0f5840 0x55fbba07b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdccf5700 1 --2- 172.21.15.44:0/2551601794 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fbba085160 0x55fbba1123a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdc4f4700 1 -- 172.21.15.44:0/2551601794 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fbba085160 msgr2=0x55fbba1123a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdc4f4700 1 --2- 172.21.15.44:0/2551601794 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fbba085160 0x55fbba1123a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdc4f4700 1 -- 172.21.15.44:0/2551601794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fbba0f5840 msgr2=0x55fbba07b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdc4f4700 1 --2- 172.21.15.44:0/2551601794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fbba0f5840 0x55fbba07b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdc4f4700 1 -- 172.21.15.44:0/2551601794 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc400a100 con 0x55fbba085540 2024-09-13T18:34:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdc4f4700 1 --2- 172.21.15.44:0/2551601794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbba085540 0x55fbba06ad10 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4005f10 tx=0x7f3fc400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67df87696923451 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdb4f2700 1 -- 172.21.15.44:0/2551601794 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc400f790 con 0x55fbba085540 2024-09-13T18:34:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdb4f2700 1 -- 172.21.15.44:0/2551601794 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc400fa60 con 0x55fbba085540 2024-09-13T18:34:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdb4f2700 1 -- 172.21.15.44:0/2551601794 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc400fe30 con 0x55fbba085540 2024-09-13T18:34:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdf1c0140 1 -- 172.21.15.44:0/2551601794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbba085540 msgr2=0x55fbba06ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdf1c0140 1 --2- 172.21.15.44:0/2551601794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbba085540 0x55fbba06ad10 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4005f10 tx=0x7f3fc400f000 comp rx=0 tx=0).stop 2024-09-13T18:34:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdf1c0140 1 -- 172.21.15.44:0/2551601794 shutdown_connections 2024-09-13T18:34:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdf1c0140 1 --2- 172.21.15.44:0/2551601794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fbba0f5840 0x55fbba07b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdf1c0140 1 --2- 172.21.15.44:0/2551601794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbba085540 0x55fbba06ad10 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdf1c0140 1 --2- 172.21.15.44:0/2551601794 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fbba085160 0x55fbba1123a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdf1c0140 1 -- 172.21.15.44:0/2551601794 >> 172.21.15.44:0/2551601794 conn(0x55fbba0395a0 msgr2=0x55fbba03e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.458+0000 7f3fdf1c0140 1 -- 172.21.15.44:0/2551601794 shutdown_connections 2024-09-13T18:34:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdf1c0140 1 -- 172.21.15.44:0/2551601794 wait complete. 2024-09-13T18:34:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdf1c0140 1 Processor -- start 2024-09-13T18:34:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdf1c0140 1 -- start start 2024-09-13T18:34:13.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdf1c0140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbba085160 0x55fbba07c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdf1c0140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fbba085540 0x55fbba1a6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdf1c0140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fbba0f5840 0x55fbba10eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdf1c0140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbb9f5f8d0 con 0x55fbba085160 2024-09-13T18:34:13.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdf1c0140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbba1a6650 con 0x55fbba085540 2024-09-13T18:34:13.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdf1c0140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fbba07d770 con 0x55fbba0f5840 2024-09-13T18:34:13.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdccf5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbba085160 0x55fbba07c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdccf5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbba085160 0x55fbba07c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52756/0 (socket says 172.21.15.44:52756) 2024-09-13T18:34:13.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdccf5700 1 -- 172.21.15.44:0/766944280 learned_addr learned my addr 172.21.15.44:0/766944280 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:34:13.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdc4f4700 1 --2- 172.21.15.44:0/766944280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fbba085540 0x55fbba1a6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdd4f6700 1 --2- 172.21.15.44:0/766944280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fbba0f5840 0x55fbba10eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdccf5700 1 -- 172.21.15.44:0/766944280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fbba0f5840 msgr2=0x55fbba10eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdccf5700 1 --2- 172.21.15.44:0/766944280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fbba0f5840 0x55fbba10eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdccf5700 1 -- 172.21.15.44:0/766944280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fbba085540 msgr2=0x55fbba1a6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdccf5700 1 --2- 172.21.15.44:0/766944280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fbba085540 0x55fbba1a6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdccf5700 1 -- 172.21.15.44:0/766944280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbb9f91ca0 con 0x55fbba085160 2024-09-13T18:34:13.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdc4f4700 1 --2- 172.21.15.44:0/766944280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fbba085540 0x55fbba1a6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:13.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdd4f6700 1 --2- 172.21.15.44:0/766944280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fbba0f5840 0x55fbba10eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:13.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdccf5700 1 --2- 172.21.15.44:0/766944280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbba085160 0x55fbba07c220 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc001be0 tx=0x7f3fcc00b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:13.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fda4f0700 1 -- 172.21.15.44:0/766944280 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc00f450 con 0x55fbba085160 2024-09-13T18:34:13.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fda4f0700 1 -- 172.21.15.44:0/766944280 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fcc00f5b0 con 0x55fbba085160 2024-09-13T18:34:13.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdf1c0140 1 -- 172.21.15.44:0/766944280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fbb9f77b00 con 0x55fbba085160 2024-09-13T18:34:13.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fda4f0700 1 -- 172.21.15.44:0/766944280 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc00f940 con 0x55fbba085160 2024-09-13T18:34:13.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.462+0000 7f3fdf1c0140 1 -- 172.21.15.44:0/766944280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fbb9f6af40 con 0x55fbba085160 2024-09-13T18:34:13.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.466+0000 7f3fda4f0700 1 -- 172.21.15.44:0/766944280 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3fcc00faa0 con 0x55fbba085160 2024-09-13T18:34:13.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.466+0000 7f3fda4f0700 1 --2- 172.21.15.44:0/766944280 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3fc0065090 0x7f3fc0067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.466+0000 7f3fda4f0700 1 -- 172.21.15.44:0/766944280 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3fcc083330 con 0x55fbba085160 2024-09-13T18:34:13.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.466+0000 7f3fdc4f4700 1 --2- 172.21.15.44:0/766944280 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3fc0065090 0x7f3fc0067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.466+0000 7f3fdf1c0140 1 --2- 172.21.15.44:0/766944280 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x55fbba07b000 0x55fbba07b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:13.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.466+0000 7f3fdf1c0140 1 -- 172.21.15.44:0/766944280 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:1 8.1b 8:dbae76b5:::mds1_inotable:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e64) v8 -- 0x55fbba07b950 con 0x55fbba07b000 2024-09-13T18:34:13.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.466+0000 7f3fdd4f6700 1 --2- 172.21.15.44:0/766944280 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x55fbba07b000 0x55fbba07b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:13.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.466+0000 7f3fdc4f4700 1 --2- 172.21.15.44:0/766944280 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3fc0065090 0x7f3fc0067550 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400a3f0 tx=0x7f3fc4026040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:13.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.466+0000 7f3fdd4f6700 1 --2- 172.21.15.44:0/766944280 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x55fbba07b000 0x55fbba07b410 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:13.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.470+0000 7f3fdd4f6700 1 -- 172.21.15.44:0/766944280 <== osd.4 v2:172.21.15.99:6816/2515272044 1 ==== osd_op_reply(1 mds1_inotable [delete] v64'1791 uv1791 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3fd40096b0 con 0x55fbba07b000 2024-09-13T18:34:13.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.470+0000 7f3fdf1c0140 1 -- 172.21.15.44:0/766944280 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x55fbba07b000 msgr2=0x55fbba07b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.470+0000 7f3fdf1c0140 1 --2- 172.21.15.44:0/766944280 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x55fbba07b000 0x55fbba07b410 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.470+0000 7f3fdf1c0140 1 -- 172.21.15.44:0/766944280 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3fc0065090 msgr2=0x7f3fc0067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.470+0000 7f3fdf1c0140 1 --2- 172.21.15.44:0/766944280 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3fc0065090 0x7f3fc0067550 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400a3f0 tx=0x7f3fc4026040 comp rx=0 tx=0).stop 2024-09-13T18:34:13.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.470+0000 7f3fdf1c0140 1 -- 172.21.15.44:0/766944280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbba085160 msgr2=0x55fbba07c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:13.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.470+0000 7f3fdf1c0140 1 --2- 172.21.15.44:0/766944280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fbba085160 0x55fbba07c220 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc001be0 tx=0x7f3fcc00b5d0 comp rx=0 tx=0).stop 2024-09-13T18:34:13.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.470+0000 7f3fdd4f6700 1 -- 172.21.15.44:0/766944280 reap_dead start 2024-09-13T18:34:13.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.470+0000 7f3fdf1c0140 1 -- 172.21.15.44:0/766944280 shutdown_connections 2024-09-13T18:34:13.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.470+0000 7f3fdf1c0140 1 -- 172.21.15.44:0/766944280 >> 172.21.15.44:0/766944280 conn(0x55fbba0395a0 msgr2=0x55fbba0f7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:13.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.470+0000 7f3fdf1c0140 1 -- 172.21.15.44:0/766944280 shutdown_connections 2024-09-13T18:34:13.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:34:13.470+0000 7f3fdf1c0140 1 -- 172.21.15.44:0/766944280 wait complete. 2024-09-13T18:34:13.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:13.484 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R) 2024-09-13T18:34:13.486 INFO:tasks.cephfs.test_journal_repair:Sleeping to check ls is blocked... 2024-09-13T18:34:13.577 INFO:teuthology.orchestra.run.smithi044.stdout:.: 2024-09-13T18:34:13.577 INFO:teuthology.orchestra.run.smithi044.stdout:alpha 2024-09-13T18:34:13.577 INFO:teuthology.orchestra.run.smithi044.stdout:bravo 2024-09-13T18:34:13.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:34:13.577 INFO:teuthology.orchestra.run.smithi044.stdout:./alpha: 2024-09-13T18:34:13.577 INFO:teuthology.orchestra.run.smithi044.stdout:file 2024-09-13T18:34:13.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_0 2024-09-13T18:34:13.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_1 2024-09-13T18:34:13.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_10 2024-09-13T18:34:13.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_100 2024-09-13T18:34:13.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_101 2024-09-13T18:34:13.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_102 2024-09-13T18:34:13.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_103 2024-09-13T18:34:13.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_104 2024-09-13T18:34:13.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_105 2024-09-13T18:34:13.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_106 2024-09-13T18:34:13.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_107 2024-09-13T18:34:13.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_108 2024-09-13T18:34:13.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_109 2024-09-13T18:34:13.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_11 2024-09-13T18:34:13.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_110 2024-09-13T18:34:13.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_111 2024-09-13T18:34:13.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_112 2024-09-13T18:34:13.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_113 2024-09-13T18:34:13.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_114 2024-09-13T18:34:13.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_115 2024-09-13T18:34:13.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_116 2024-09-13T18:34:13.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_117 2024-09-13T18:34:13.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_118 2024-09-13T18:34:13.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_119 2024-09-13T18:34:13.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_12 2024-09-13T18:34:13.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_120 2024-09-13T18:34:13.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_121 2024-09-13T18:34:13.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_122 2024-09-13T18:34:13.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_123 2024-09-13T18:34:13.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_124 2024-09-13T18:34:13.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_125 2024-09-13T18:34:13.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_126 2024-09-13T18:34:13.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_127 2024-09-13T18:34:13.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_128 2024-09-13T18:34:13.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_129 2024-09-13T18:34:13.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_13 2024-09-13T18:34:13.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_130 2024-09-13T18:34:13.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_131 2024-09-13T18:34:13.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_132 2024-09-13T18:34:13.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_133 2024-09-13T18:34:13.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_134 2024-09-13T18:34:13.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_135 2024-09-13T18:34:13.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_136 2024-09-13T18:34:13.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_137 2024-09-13T18:34:13.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_138 2024-09-13T18:34:13.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_139 2024-09-13T18:34:13.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_14 2024-09-13T18:34:13.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_140 2024-09-13T18:34:13.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_141 2024-09-13T18:34:13.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_142 2024-09-13T18:34:13.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_143 2024-09-13T18:34:13.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_144 2024-09-13T18:34:13.582 INFO:teuthology.orchestra.run.smithi044.stdout:file_145 2024-09-13T18:34:13.582 INFO:teuthology.orchestra.run.smithi044.stdout:file_146 2024-09-13T18:34:13.582 INFO:teuthology.orchestra.run.smithi044.stdout:file_147 2024-09-13T18:34:13.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_148 2024-09-13T18:34:13.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_149 2024-09-13T18:34:13.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_15 2024-09-13T18:34:13.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_150 2024-09-13T18:34:13.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_151 2024-09-13T18:34:13.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_152 2024-09-13T18:34:13.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_153 2024-09-13T18:34:13.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_154 2024-09-13T18:34:13.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_155 2024-09-13T18:34:13.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_156 2024-09-13T18:34:13.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_157 2024-09-13T18:34:13.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_158 2024-09-13T18:34:13.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_159 2024-09-13T18:34:13.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_16 2024-09-13T18:34:13.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_160 2024-09-13T18:34:13.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_161 2024-09-13T18:34:13.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_162 2024-09-13T18:34:13.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_163 2024-09-13T18:34:13.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_164 2024-09-13T18:34:13.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_165 2024-09-13T18:34:13.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_166 2024-09-13T18:34:13.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_167 2024-09-13T18:34:13.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_168 2024-09-13T18:34:13.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_169 2024-09-13T18:34:13.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_17 2024-09-13T18:34:13.585 INFO:teuthology.orchestra.run.smithi044.stdout:file_170 2024-09-13T18:34:13.585 INFO:teuthology.orchestra.run.smithi044.stdout:file_171 2024-09-13T18:34:13.585 INFO:teuthology.orchestra.run.smithi044.stdout:file_172 2024-09-13T18:34:13.585 INFO:teuthology.orchestra.run.smithi044.stdout:file_173 2024-09-13T18:34:13.586 INFO:teuthology.orchestra.run.smithi044.stdout:file_174 2024-09-13T18:34:13.586 INFO:teuthology.orchestra.run.smithi044.stdout:file_175 2024-09-13T18:34:13.586 INFO:teuthology.orchestra.run.smithi044.stdout:file_176 2024-09-13T18:34:13.587 INFO:teuthology.orchestra.run.smithi044.stdout:file_177 2024-09-13T18:34:13.587 INFO:teuthology.orchestra.run.smithi044.stdout:file_178 2024-09-13T18:34:13.587 INFO:teuthology.orchestra.run.smithi044.stdout:file_179 2024-09-13T18:34:13.588 INFO:teuthology.orchestra.run.smithi044.stdout:file_18 2024-09-13T18:34:13.588 INFO:teuthology.orchestra.run.smithi044.stdout:file_180 2024-09-13T18:34:13.588 INFO:teuthology.orchestra.run.smithi044.stdout:file_181 2024-09-13T18:34:13.589 INFO:teuthology.orchestra.run.smithi044.stdout:file_182 2024-09-13T18:34:13.589 INFO:teuthology.orchestra.run.smithi044.stdout:file_183 2024-09-13T18:34:13.589 INFO:teuthology.orchestra.run.smithi044.stdout:file_184 2024-09-13T18:34:13.589 INFO:teuthology.orchestra.run.smithi044.stdout:file_185 2024-09-13T18:34:13.589 INFO:teuthology.orchestra.run.smithi044.stdout:file_186 2024-09-13T18:34:13.589 INFO:teuthology.orchestra.run.smithi044.stdout:file_187 2024-09-13T18:34:13.589 INFO:teuthology.orchestra.run.smithi044.stdout:file_188 2024-09-13T18:34:13.589 INFO:teuthology.orchestra.run.smithi044.stdout:file_189 2024-09-13T18:34:13.589 INFO:teuthology.orchestra.run.smithi044.stdout:file_19 2024-09-13T18:34:13.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_190 2024-09-13T18:34:13.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_191 2024-09-13T18:34:13.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_192 2024-09-13T18:34:13.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_193 2024-09-13T18:34:13.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_194 2024-09-13T18:34:13.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_195 2024-09-13T18:34:13.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_196 2024-09-13T18:34:13.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_197 2024-09-13T18:34:13.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_198 2024-09-13T18:34:13.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_199 2024-09-13T18:34:13.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_2 2024-09-13T18:34:13.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_20 2024-09-13T18:34:13.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_200 2024-09-13T18:34:13.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_201 2024-09-13T18:34:13.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_202 2024-09-13T18:34:13.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_203 2024-09-13T18:34:13.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_204 2024-09-13T18:34:13.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_205 2024-09-13T18:34:13.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_206 2024-09-13T18:34:13.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_207 2024-09-13T18:34:13.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_208 2024-09-13T18:34:13.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_209 2024-09-13T18:34:13.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_21 2024-09-13T18:34:13.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_210 2024-09-13T18:34:13.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_211 2024-09-13T18:34:13.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_212 2024-09-13T18:34:13.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_213 2024-09-13T18:34:13.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_214 2024-09-13T18:34:13.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_215 2024-09-13T18:34:13.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_216 2024-09-13T18:34:13.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_217 2024-09-13T18:34:13.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_218 2024-09-13T18:34:13.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_219 2024-09-13T18:34:13.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_22 2024-09-13T18:34:13.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_220 2024-09-13T18:34:13.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_221 2024-09-13T18:34:13.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_222 2024-09-13T18:34:13.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_223 2024-09-13T18:34:13.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_224 2024-09-13T18:34:13.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_225 2024-09-13T18:34:13.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_226 2024-09-13T18:34:13.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_227 2024-09-13T18:34:13.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_228 2024-09-13T18:34:13.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_229 2024-09-13T18:34:13.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_23 2024-09-13T18:34:13.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_230 2024-09-13T18:34:13.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_231 2024-09-13T18:34:13.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_232 2024-09-13T18:34:13.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_233 2024-09-13T18:34:13.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_234 2024-09-13T18:34:13.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_235 2024-09-13T18:34:13.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_236 2024-09-13T18:34:13.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_237 2024-09-13T18:34:13.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_238 2024-09-13T18:34:13.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_239 2024-09-13T18:34:13.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_24 2024-09-13T18:34:13.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_240 2024-09-13T18:34:13.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_241 2024-09-13T18:34:13.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_242 2024-09-13T18:34:13.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_243 2024-09-13T18:34:13.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_244 2024-09-13T18:34:13.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_245 2024-09-13T18:34:13.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_246 2024-09-13T18:34:13.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_247 2024-09-13T18:34:13.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_248 2024-09-13T18:34:13.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_249 2024-09-13T18:34:13.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_25 2024-09-13T18:34:13.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_250 2024-09-13T18:34:13.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_251 2024-09-13T18:34:13.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_252 2024-09-13T18:34:13.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_253 2024-09-13T18:34:13.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_254 2024-09-13T18:34:13.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_255 2024-09-13T18:34:13.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_256 2024-09-13T18:34:13.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_257 2024-09-13T18:34:13.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_258 2024-09-13T18:34:13.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_259 2024-09-13T18:34:13.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_26 2024-09-13T18:34:13.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_260 2024-09-13T18:34:13.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_261 2024-09-13T18:34:13.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_262 2024-09-13T18:34:13.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_263 2024-09-13T18:34:13.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_264 2024-09-13T18:34:13.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_265 2024-09-13T18:34:13.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_266 2024-09-13T18:34:13.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_267 2024-09-13T18:34:13.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_268 2024-09-13T18:34:13.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_269 2024-09-13T18:34:13.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_27 2024-09-13T18:34:13.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_270 2024-09-13T18:34:13.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_271 2024-09-13T18:34:13.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_272 2024-09-13T18:34:13.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_273 2024-09-13T18:34:13.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_274 2024-09-13T18:34:13.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_275 2024-09-13T18:34:13.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_276 2024-09-13T18:34:13.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_277 2024-09-13T18:34:13.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_278 2024-09-13T18:34:13.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_279 2024-09-13T18:34:13.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_28 2024-09-13T18:34:13.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_280 2024-09-13T18:34:13.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_281 2024-09-13T18:34:13.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_282 2024-09-13T18:34:13.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_283 2024-09-13T18:34:13.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_284 2024-09-13T18:34:13.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_285 2024-09-13T18:34:13.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_286 2024-09-13T18:34:13.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_287 2024-09-13T18:34:13.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_288 2024-09-13T18:34:13.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_289 2024-09-13T18:34:13.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_29 2024-09-13T18:34:13.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_290 2024-09-13T18:34:13.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_291 2024-09-13T18:34:13.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_292 2024-09-13T18:34:13.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_293 2024-09-13T18:34:13.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_294 2024-09-13T18:34:13.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_295 2024-09-13T18:34:13.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_296 2024-09-13T18:34:13.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_297 2024-09-13T18:34:13.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_298 2024-09-13T18:34:13.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_299 2024-09-13T18:34:13.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_3 2024-09-13T18:34:13.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_30 2024-09-13T18:34:13.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_300 2024-09-13T18:34:13.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_301 2024-09-13T18:34:13.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_302 2024-09-13T18:34:13.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_303 2024-09-13T18:34:13.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_304 2024-09-13T18:34:13.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_305 2024-09-13T18:34:13.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_306 2024-09-13T18:34:13.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_307 2024-09-13T18:34:13.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_308 2024-09-13T18:34:13.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_309 2024-09-13T18:34:13.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_31 2024-09-13T18:34:13.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_310 2024-09-13T18:34:13.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_311 2024-09-13T18:34:13.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_312 2024-09-13T18:34:13.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_313 2024-09-13T18:34:13.600 INFO:teuthology.orchestra.run.smithi044.stdout:file_314 2024-09-13T18:34:13.600 INFO:teuthology.orchestra.run.smithi044.stdout:file_315 2024-09-13T18:34:13.600 INFO:teuthology.orchestra.run.smithi044.stdout:file_316 2024-09-13T18:34:13.600 INFO:teuthology.orchestra.run.smithi044.stdout:file_317 2024-09-13T18:34:13.600 INFO:teuthology.orchestra.run.smithi044.stdout:file_318 2024-09-13T18:34:13.600 INFO:teuthology.orchestra.run.smithi044.stdout:file_319 2024-09-13T18:34:13.600 INFO:teuthology.orchestra.run.smithi044.stdout:file_32 2024-09-13T18:34:13.600 INFO:teuthology.orchestra.run.smithi044.stdout:file_320 2024-09-13T18:34:13.600 INFO:teuthology.orchestra.run.smithi044.stdout:file_321 2024-09-13T18:34:13.600 INFO:teuthology.orchestra.run.smithi044.stdout:file_322 2024-09-13T18:34:13.600 INFO:teuthology.orchestra.run.smithi044.stdout:file_323 2024-09-13T18:34:13.600 INFO:teuthology.orchestra.run.smithi044.stdout:file_324 2024-09-13T18:34:13.600 INFO:teuthology.orchestra.run.smithi044.stdout:file_325 2024-09-13T18:34:13.601 INFO:teuthology.orchestra.run.smithi044.stdout:file_326 2024-09-13T18:34:13.601 INFO:teuthology.orchestra.run.smithi044.stdout:file_327 2024-09-13T18:34:13.601 INFO:teuthology.orchestra.run.smithi044.stdout:file_328 2024-09-13T18:34:13.601 INFO:teuthology.orchestra.run.smithi044.stdout:file_329 2024-09-13T18:34:13.601 INFO:teuthology.orchestra.run.smithi044.stdout:file_33 2024-09-13T18:34:13.601 INFO:teuthology.orchestra.run.smithi044.stdout:file_330 2024-09-13T18:34:13.601 INFO:teuthology.orchestra.run.smithi044.stdout:file_331 2024-09-13T18:34:13.601 INFO:teuthology.orchestra.run.smithi044.stdout:file_332 2024-09-13T18:34:13.601 INFO:teuthology.orchestra.run.smithi044.stdout:file_333 2024-09-13T18:34:13.601 INFO:teuthology.orchestra.run.smithi044.stdout:file_334 2024-09-13T18:34:13.601 INFO:teuthology.orchestra.run.smithi044.stdout:file_335 2024-09-13T18:34:13.601 INFO:teuthology.orchestra.run.smithi044.stdout:file_336 2024-09-13T18:34:13.601 INFO:teuthology.orchestra.run.smithi044.stdout:file_337 2024-09-13T18:34:13.601 INFO:teuthology.orchestra.run.smithi044.stdout:file_338 2024-09-13T18:34:13.602 INFO:teuthology.orchestra.run.smithi044.stdout:file_339 2024-09-13T18:34:13.602 INFO:teuthology.orchestra.run.smithi044.stdout:file_34 2024-09-13T18:34:13.602 INFO:teuthology.orchestra.run.smithi044.stdout:file_340 2024-09-13T18:34:13.602 INFO:teuthology.orchestra.run.smithi044.stdout:file_341 2024-09-13T18:34:13.602 INFO:teuthology.orchestra.run.smithi044.stdout:file_342 2024-09-13T18:34:13.602 INFO:teuthology.orchestra.run.smithi044.stdout:file_343 2024-09-13T18:34:13.602 INFO:teuthology.orchestra.run.smithi044.stdout:file_344 2024-09-13T18:34:13.602 INFO:teuthology.orchestra.run.smithi044.stdout:file_345 2024-09-13T18:34:13.602 INFO:teuthology.orchestra.run.smithi044.stdout:file_346 2024-09-13T18:34:13.602 INFO:teuthology.orchestra.run.smithi044.stdout:file_347 2024-09-13T18:34:13.602 INFO:teuthology.orchestra.run.smithi044.stdout:file_348 2024-09-13T18:34:13.603 INFO:teuthology.orchestra.run.smithi044.stdout:file_349 2024-09-13T18:34:13.603 INFO:teuthology.orchestra.run.smithi044.stdout:file_35 2024-09-13T18:34:13.603 INFO:teuthology.orchestra.run.smithi044.stdout:file_350 2024-09-13T18:34:13.603 INFO:teuthology.orchestra.run.smithi044.stdout:file_351 2024-09-13T18:34:13.603 INFO:teuthology.orchestra.run.smithi044.stdout:file_352 2024-09-13T18:34:13.603 INFO:teuthology.orchestra.run.smithi044.stdout:file_353 2024-09-13T18:34:13.603 INFO:teuthology.orchestra.run.smithi044.stdout:file_354 2024-09-13T18:34:13.604 INFO:teuthology.orchestra.run.smithi044.stdout:file_355 2024-09-13T18:34:13.604 INFO:teuthology.orchestra.run.smithi044.stdout:file_356 2024-09-13T18:34:13.604 INFO:teuthology.orchestra.run.smithi044.stdout:file_357 2024-09-13T18:34:13.604 INFO:teuthology.orchestra.run.smithi044.stdout:file_358 2024-09-13T18:34:13.604 INFO:teuthology.orchestra.run.smithi044.stdout:file_359 2024-09-13T18:34:13.604 INFO:teuthology.orchestra.run.smithi044.stdout:file_36 2024-09-13T18:34:13.604 INFO:teuthology.orchestra.run.smithi044.stdout:file_360 2024-09-13T18:34:13.604 INFO:teuthology.orchestra.run.smithi044.stdout:file_361 2024-09-13T18:34:13.604 INFO:teuthology.orchestra.run.smithi044.stdout:file_362 2024-09-13T18:34:13.604 INFO:teuthology.orchestra.run.smithi044.stdout:file_363 2024-09-13T18:34:13.604 INFO:teuthology.orchestra.run.smithi044.stdout:file_364 2024-09-13T18:34:13.605 INFO:teuthology.orchestra.run.smithi044.stdout:file_365 2024-09-13T18:34:13.605 INFO:teuthology.orchestra.run.smithi044.stdout:file_366 2024-09-13T18:34:13.605 INFO:teuthology.orchestra.run.smithi044.stdout:file_367 2024-09-13T18:34:13.605 INFO:teuthology.orchestra.run.smithi044.stdout:file_368 2024-09-13T18:34:13.605 INFO:teuthology.orchestra.run.smithi044.stdout:file_369 2024-09-13T18:34:13.605 INFO:teuthology.orchestra.run.smithi044.stdout:file_37 2024-09-13T18:34:13.605 INFO:teuthology.orchestra.run.smithi044.stdout:file_370 2024-09-13T18:34:13.605 INFO:teuthology.orchestra.run.smithi044.stdout:file_371 2024-09-13T18:34:13.605 INFO:teuthology.orchestra.run.smithi044.stdout:file_372 2024-09-13T18:34:13.605 INFO:teuthology.orchestra.run.smithi044.stdout:file_373 2024-09-13T18:34:13.605 INFO:teuthology.orchestra.run.smithi044.stdout:file_374 2024-09-13T18:34:13.605 INFO:teuthology.orchestra.run.smithi044.stdout:file_375 2024-09-13T18:34:13.605 INFO:teuthology.orchestra.run.smithi044.stdout:file_376 2024-09-13T18:34:13.606 INFO:teuthology.orchestra.run.smithi044.stdout:file_377 2024-09-13T18:34:13.606 INFO:teuthology.orchestra.run.smithi044.stdout:file_378 2024-09-13T18:34:13.606 INFO:teuthology.orchestra.run.smithi044.stdout:file_379 2024-09-13T18:34:13.606 INFO:teuthology.orchestra.run.smithi044.stdout:file_38 2024-09-13T18:34:13.606 INFO:teuthology.orchestra.run.smithi044.stdout:file_380 2024-09-13T18:34:13.606 INFO:teuthology.orchestra.run.smithi044.stdout:file_381 2024-09-13T18:34:13.606 INFO:teuthology.orchestra.run.smithi044.stdout:file_382 2024-09-13T18:34:13.606 INFO:teuthology.orchestra.run.smithi044.stdout:file_383 2024-09-13T18:34:13.606 INFO:teuthology.orchestra.run.smithi044.stdout:file_384 2024-09-13T18:34:13.606 INFO:teuthology.orchestra.run.smithi044.stdout:file_385 2024-09-13T18:34:13.606 INFO:teuthology.orchestra.run.smithi044.stdout:file_386 2024-09-13T18:34:13.606 INFO:teuthology.orchestra.run.smithi044.stdout:file_387 2024-09-13T18:34:13.606 INFO:teuthology.orchestra.run.smithi044.stdout:file_388 2024-09-13T18:34:13.606 INFO:teuthology.orchestra.run.smithi044.stdout:file_389 2024-09-13T18:34:13.607 INFO:teuthology.orchestra.run.smithi044.stdout:file_39 2024-09-13T18:34:13.607 INFO:teuthology.orchestra.run.smithi044.stdout:file_390 2024-09-13T18:34:13.607 INFO:teuthology.orchestra.run.smithi044.stdout:file_391 2024-09-13T18:34:13.607 INFO:teuthology.orchestra.run.smithi044.stdout:file_392 2024-09-13T18:34:13.607 INFO:teuthology.orchestra.run.smithi044.stdout:file_393 2024-09-13T18:34:13.607 INFO:teuthology.orchestra.run.smithi044.stdout:file_394 2024-09-13T18:34:13.607 INFO:teuthology.orchestra.run.smithi044.stdout:file_395 2024-09-13T18:34:13.607 INFO:teuthology.orchestra.run.smithi044.stdout:file_396 2024-09-13T18:34:13.607 INFO:teuthology.orchestra.run.smithi044.stdout:file_397 2024-09-13T18:34:13.607 INFO:teuthology.orchestra.run.smithi044.stdout:file_398 2024-09-13T18:34:13.607 INFO:teuthology.orchestra.run.smithi044.stdout:file_399 2024-09-13T18:34:13.607 INFO:teuthology.orchestra.run.smithi044.stdout:file_4 2024-09-13T18:34:13.607 INFO:teuthology.orchestra.run.smithi044.stdout:file_40 2024-09-13T18:34:13.608 INFO:teuthology.orchestra.run.smithi044.stdout:file_400 2024-09-13T18:34:13.608 INFO:teuthology.orchestra.run.smithi044.stdout:file_401 2024-09-13T18:34:13.608 INFO:teuthology.orchestra.run.smithi044.stdout:file_402 2024-09-13T18:34:13.608 INFO:teuthology.orchestra.run.smithi044.stdout:file_403 2024-09-13T18:34:13.608 INFO:teuthology.orchestra.run.smithi044.stdout:file_404 2024-09-13T18:34:13.608 INFO:teuthology.orchestra.run.smithi044.stdout:file_405 2024-09-13T18:34:13.608 INFO:teuthology.orchestra.run.smithi044.stdout:file_406 2024-09-13T18:34:13.608 INFO:teuthology.orchestra.run.smithi044.stdout:file_407 2024-09-13T18:34:13.608 INFO:teuthology.orchestra.run.smithi044.stdout:file_408 2024-09-13T18:34:13.608 INFO:teuthology.orchestra.run.smithi044.stdout:file_409 2024-09-13T18:34:13.608 INFO:teuthology.orchestra.run.smithi044.stdout:file_41 2024-09-13T18:34:13.608 INFO:teuthology.orchestra.run.smithi044.stdout:file_410 2024-09-13T18:34:13.608 INFO:teuthology.orchestra.run.smithi044.stdout:file_411 2024-09-13T18:34:13.608 INFO:teuthology.orchestra.run.smithi044.stdout:file_412 2024-09-13T18:34:13.609 INFO:teuthology.orchestra.run.smithi044.stdout:file_413 2024-09-13T18:34:13.609 INFO:teuthology.orchestra.run.smithi044.stdout:file_414 2024-09-13T18:34:13.609 INFO:teuthology.orchestra.run.smithi044.stdout:file_415 2024-09-13T18:34:13.609 INFO:teuthology.orchestra.run.smithi044.stdout:file_416 2024-09-13T18:34:13.609 INFO:teuthology.orchestra.run.smithi044.stdout:file_417 2024-09-13T18:34:13.609 INFO:teuthology.orchestra.run.smithi044.stdout:file_418 2024-09-13T18:34:13.609 INFO:teuthology.orchestra.run.smithi044.stdout:file_419 2024-09-13T18:34:13.609 INFO:teuthology.orchestra.run.smithi044.stdout:file_42 2024-09-13T18:34:13.609 INFO:teuthology.orchestra.run.smithi044.stdout:file_420 2024-09-13T18:34:13.609 INFO:teuthology.orchestra.run.smithi044.stdout:file_421 2024-09-13T18:34:13.609 INFO:teuthology.orchestra.run.smithi044.stdout:file_422 2024-09-13T18:34:13.609 INFO:teuthology.orchestra.run.smithi044.stdout:file_423 2024-09-13T18:34:13.609 INFO:teuthology.orchestra.run.smithi044.stdout:file_424 2024-09-13T18:34:13.610 INFO:teuthology.orchestra.run.smithi044.stdout:file_425 2024-09-13T18:34:13.610 INFO:teuthology.orchestra.run.smithi044.stdout:file_426 2024-09-13T18:34:13.610 INFO:teuthology.orchestra.run.smithi044.stdout:file_427 2024-09-13T18:34:13.610 INFO:teuthology.orchestra.run.smithi044.stdout:file_428 2024-09-13T18:34:13.610 INFO:teuthology.orchestra.run.smithi044.stdout:file_429 2024-09-13T18:34:13.610 INFO:teuthology.orchestra.run.smithi044.stdout:file_43 2024-09-13T18:34:13.610 INFO:teuthology.orchestra.run.smithi044.stdout:file_430 2024-09-13T18:34:13.610 INFO:teuthology.orchestra.run.smithi044.stdout:file_431 2024-09-13T18:34:13.610 INFO:teuthology.orchestra.run.smithi044.stdout:file_432 2024-09-13T18:34:13.610 INFO:teuthology.orchestra.run.smithi044.stdout:file_433 2024-09-13T18:34:13.610 INFO:teuthology.orchestra.run.smithi044.stdout:file_434 2024-09-13T18:34:13.610 INFO:teuthology.orchestra.run.smithi044.stdout:file_435 2024-09-13T18:34:13.610 INFO:teuthology.orchestra.run.smithi044.stdout:file_436 2024-09-13T18:34:13.610 INFO:teuthology.orchestra.run.smithi044.stdout:file_437 2024-09-13T18:34:13.611 INFO:teuthology.orchestra.run.smithi044.stdout:file_438 2024-09-13T18:34:13.611 INFO:teuthology.orchestra.run.smithi044.stdout:file_439 2024-09-13T18:34:13.611 INFO:teuthology.orchestra.run.smithi044.stdout:file_44 2024-09-13T18:34:13.611 INFO:teuthology.orchestra.run.smithi044.stdout:file_440 2024-09-13T18:34:13.611 INFO:teuthology.orchestra.run.smithi044.stdout:file_441 2024-09-13T18:34:13.611 INFO:teuthology.orchestra.run.smithi044.stdout:file_442 2024-09-13T18:34:13.611 INFO:teuthology.orchestra.run.smithi044.stdout:file_443 2024-09-13T18:34:13.611 INFO:teuthology.orchestra.run.smithi044.stdout:file_444 2024-09-13T18:34:13.611 INFO:teuthology.orchestra.run.smithi044.stdout:file_445 2024-09-13T18:34:13.611 INFO:teuthology.orchestra.run.smithi044.stdout:file_446 2024-09-13T18:34:13.611 INFO:teuthology.orchestra.run.smithi044.stdout:file_447 2024-09-13T18:34:13.611 INFO:teuthology.orchestra.run.smithi044.stdout:file_448 2024-09-13T18:34:13.611 INFO:teuthology.orchestra.run.smithi044.stdout:file_449 2024-09-13T18:34:13.611 INFO:teuthology.orchestra.run.smithi044.stdout:file_45 2024-09-13T18:34:13.612 INFO:teuthology.orchestra.run.smithi044.stdout:file_450 2024-09-13T18:34:13.612 INFO:teuthology.orchestra.run.smithi044.stdout:file_451 2024-09-13T18:34:13.612 INFO:teuthology.orchestra.run.smithi044.stdout:file_452 2024-09-13T18:34:13.612 INFO:teuthology.orchestra.run.smithi044.stdout:file_453 2024-09-13T18:34:13.612 INFO:teuthology.orchestra.run.smithi044.stdout:file_454 2024-09-13T18:34:13.612 INFO:teuthology.orchestra.run.smithi044.stdout:file_455 2024-09-13T18:34:13.612 INFO:teuthology.orchestra.run.smithi044.stdout:file_456 2024-09-13T18:34:13.612 INFO:teuthology.orchestra.run.smithi044.stdout:file_457 2024-09-13T18:34:13.612 INFO:teuthology.orchestra.run.smithi044.stdout:file_458 2024-09-13T18:34:13.612 INFO:teuthology.orchestra.run.smithi044.stdout:file_459 2024-09-13T18:34:13.612 INFO:teuthology.orchestra.run.smithi044.stdout:file_46 2024-09-13T18:34:13.612 INFO:teuthology.orchestra.run.smithi044.stdout:file_460 2024-09-13T18:34:13.612 INFO:teuthology.orchestra.run.smithi044.stdout:file_461 2024-09-13T18:34:13.612 INFO:teuthology.orchestra.run.smithi044.stdout:file_462 2024-09-13T18:34:13.613 INFO:teuthology.orchestra.run.smithi044.stdout:file_463 2024-09-13T18:34:13.613 INFO:teuthology.orchestra.run.smithi044.stdout:file_464 2024-09-13T18:34:13.613 INFO:teuthology.orchestra.run.smithi044.stdout:file_465 2024-09-13T18:34:13.613 INFO:teuthology.orchestra.run.smithi044.stdout:file_466 2024-09-13T18:34:13.613 INFO:teuthology.orchestra.run.smithi044.stdout:file_467 2024-09-13T18:34:13.613 INFO:teuthology.orchestra.run.smithi044.stdout:file_468 2024-09-13T18:34:13.613 INFO:teuthology.orchestra.run.smithi044.stdout:file_469 2024-09-13T18:34:13.613 INFO:teuthology.orchestra.run.smithi044.stdout:file_47 2024-09-13T18:34:13.613 INFO:teuthology.orchestra.run.smithi044.stdout:file_470 2024-09-13T18:34:13.613 INFO:teuthology.orchestra.run.smithi044.stdout:file_471 2024-09-13T18:34:13.613 INFO:teuthology.orchestra.run.smithi044.stdout:file_472 2024-09-13T18:34:13.613 INFO:teuthology.orchestra.run.smithi044.stdout:file_473 2024-09-13T18:34:13.613 INFO:teuthology.orchestra.run.smithi044.stdout:file_474 2024-09-13T18:34:13.614 INFO:teuthology.orchestra.run.smithi044.stdout:file_475 2024-09-13T18:34:13.614 INFO:teuthology.orchestra.run.smithi044.stdout:file_476 2024-09-13T18:34:13.614 INFO:teuthology.orchestra.run.smithi044.stdout:file_477 2024-09-13T18:34:13.614 INFO:teuthology.orchestra.run.smithi044.stdout:file_478 2024-09-13T18:34:13.614 INFO:teuthology.orchestra.run.smithi044.stdout:file_479 2024-09-13T18:34:13.614 INFO:teuthology.orchestra.run.smithi044.stdout:file_48 2024-09-13T18:34:13.614 INFO:teuthology.orchestra.run.smithi044.stdout:file_480 2024-09-13T18:34:13.614 INFO:teuthology.orchestra.run.smithi044.stdout:file_481 2024-09-13T18:34:13.614 INFO:teuthology.orchestra.run.smithi044.stdout:file_482 2024-09-13T18:34:13.614 INFO:teuthology.orchestra.run.smithi044.stdout:file_483 2024-09-13T18:34:13.614 INFO:teuthology.orchestra.run.smithi044.stdout:file_484 2024-09-13T18:34:13.614 INFO:teuthology.orchestra.run.smithi044.stdout:file_485 2024-09-13T18:34:13.614 INFO:teuthology.orchestra.run.smithi044.stdout:file_486 2024-09-13T18:34:13.615 INFO:teuthology.orchestra.run.smithi044.stdout:file_487 2024-09-13T18:34:13.615 INFO:teuthology.orchestra.run.smithi044.stdout:file_488 2024-09-13T18:34:13.615 INFO:teuthology.orchestra.run.smithi044.stdout:file_489 2024-09-13T18:34:13.615 INFO:teuthology.orchestra.run.smithi044.stdout:file_49 2024-09-13T18:34:13.615 INFO:teuthology.orchestra.run.smithi044.stdout:file_490 2024-09-13T18:34:13.615 INFO:teuthology.orchestra.run.smithi044.stdout:file_491 2024-09-13T18:34:13.615 INFO:teuthology.orchestra.run.smithi044.stdout:file_492 2024-09-13T18:34:13.615 INFO:teuthology.orchestra.run.smithi044.stdout:file_493 2024-09-13T18:34:13.615 INFO:teuthology.orchestra.run.smithi044.stdout:file_494 2024-09-13T18:34:13.615 INFO:teuthology.orchestra.run.smithi044.stdout:file_495 2024-09-13T18:34:13.615 INFO:teuthology.orchestra.run.smithi044.stdout:file_496 2024-09-13T18:34:13.615 INFO:teuthology.orchestra.run.smithi044.stdout:file_497 2024-09-13T18:34:13.615 INFO:teuthology.orchestra.run.smithi044.stdout:file_498 2024-09-13T18:34:13.616 INFO:teuthology.orchestra.run.smithi044.stdout:file_499 2024-09-13T18:34:13.616 INFO:teuthology.orchestra.run.smithi044.stdout:file_5 2024-09-13T18:34:13.616 INFO:teuthology.orchestra.run.smithi044.stdout:file_50 2024-09-13T18:34:13.616 INFO:teuthology.orchestra.run.smithi044.stdout:file_500 2024-09-13T18:34:13.616 INFO:teuthology.orchestra.run.smithi044.stdout:file_501 2024-09-13T18:34:13.616 INFO:teuthology.orchestra.run.smithi044.stdout:file_502 2024-09-13T18:34:13.616 INFO:teuthology.orchestra.run.smithi044.stdout:file_503 2024-09-13T18:34:13.616 INFO:teuthology.orchestra.run.smithi044.stdout:file_504 2024-09-13T18:34:13.616 INFO:teuthology.orchestra.run.smithi044.stdout:file_505 2024-09-13T18:34:13.616 INFO:teuthology.orchestra.run.smithi044.stdout:file_506 2024-09-13T18:34:13.616 INFO:teuthology.orchestra.run.smithi044.stdout:file_507 2024-09-13T18:34:13.616 INFO:teuthology.orchestra.run.smithi044.stdout:file_508 2024-09-13T18:34:13.616 INFO:teuthology.orchestra.run.smithi044.stdout:file_509 2024-09-13T18:34:13.617 INFO:teuthology.orchestra.run.smithi044.stdout:file_51 2024-09-13T18:34:13.617 INFO:teuthology.orchestra.run.smithi044.stdout:file_510 2024-09-13T18:34:13.617 INFO:teuthology.orchestra.run.smithi044.stdout:file_511 2024-09-13T18:34:13.617 INFO:teuthology.orchestra.run.smithi044.stdout:file_512 2024-09-13T18:34:13.617 INFO:teuthology.orchestra.run.smithi044.stdout:file_513 2024-09-13T18:34:13.617 INFO:teuthology.orchestra.run.smithi044.stdout:file_514 2024-09-13T18:34:13.617 INFO:teuthology.orchestra.run.smithi044.stdout:file_515 2024-09-13T18:34:13.617 INFO:teuthology.orchestra.run.smithi044.stdout:file_516 2024-09-13T18:34:13.617 INFO:teuthology.orchestra.run.smithi044.stdout:file_517 2024-09-13T18:34:13.617 INFO:teuthology.orchestra.run.smithi044.stdout:file_518 2024-09-13T18:34:13.617 INFO:teuthology.orchestra.run.smithi044.stdout:file_519 2024-09-13T18:34:13.617 INFO:teuthology.orchestra.run.smithi044.stdout:file_52 2024-09-13T18:34:13.617 INFO:teuthology.orchestra.run.smithi044.stdout:file_520 2024-09-13T18:34:13.618 INFO:teuthology.orchestra.run.smithi044.stdout:file_521 2024-09-13T18:34:13.618 INFO:teuthology.orchestra.run.smithi044.stdout:file_522 2024-09-13T18:34:13.618 INFO:teuthology.orchestra.run.smithi044.stdout:file_523 2024-09-13T18:34:13.618 INFO:teuthology.orchestra.run.smithi044.stdout:file_524 2024-09-13T18:34:13.618 INFO:teuthology.orchestra.run.smithi044.stdout:file_525 2024-09-13T18:34:13.618 INFO:teuthology.orchestra.run.smithi044.stdout:file_526 2024-09-13T18:34:13.618 INFO:teuthology.orchestra.run.smithi044.stdout:file_527 2024-09-13T18:34:13.618 INFO:teuthology.orchestra.run.smithi044.stdout:file_528 2024-09-13T18:34:13.618 INFO:teuthology.orchestra.run.smithi044.stdout:file_529 2024-09-13T18:34:13.618 INFO:teuthology.orchestra.run.smithi044.stdout:file_53 2024-09-13T18:34:13.618 INFO:teuthology.orchestra.run.smithi044.stdout:file_530 2024-09-13T18:34:13.618 INFO:teuthology.orchestra.run.smithi044.stdout:file_531 2024-09-13T18:34:13.619 INFO:teuthology.orchestra.run.smithi044.stdout:file_532 2024-09-13T18:34:13.619 INFO:teuthology.orchestra.run.smithi044.stdout:file_533 2024-09-13T18:34:13.619 INFO:teuthology.orchestra.run.smithi044.stdout:file_534 2024-09-13T18:34:13.619 INFO:teuthology.orchestra.run.smithi044.stdout:file_535 2024-09-13T18:34:13.619 INFO:teuthology.orchestra.run.smithi044.stdout:file_536 2024-09-13T18:34:13.619 INFO:teuthology.orchestra.run.smithi044.stdout:file_537 2024-09-13T18:34:13.619 INFO:teuthology.orchestra.run.smithi044.stdout:file_538 2024-09-13T18:34:13.619 INFO:teuthology.orchestra.run.smithi044.stdout:file_539 2024-09-13T18:34:13.619 INFO:teuthology.orchestra.run.smithi044.stdout:file_54 2024-09-13T18:34:13.619 INFO:teuthology.orchestra.run.smithi044.stdout:file_540 2024-09-13T18:34:13.619 INFO:teuthology.orchestra.run.smithi044.stdout:file_541 2024-09-13T18:34:13.619 INFO:teuthology.orchestra.run.smithi044.stdout:file_542 2024-09-13T18:34:13.619 INFO:teuthology.orchestra.run.smithi044.stdout:file_543 2024-09-13T18:34:13.620 INFO:teuthology.orchestra.run.smithi044.stdout:file_544 2024-09-13T18:34:13.620 INFO:teuthology.orchestra.run.smithi044.stdout:file_545 2024-09-13T18:34:13.620 INFO:teuthology.orchestra.run.smithi044.stdout:file_546 2024-09-13T18:34:13.620 INFO:teuthology.orchestra.run.smithi044.stdout:file_547 2024-09-13T18:34:13.620 INFO:teuthology.orchestra.run.smithi044.stdout:file_548 2024-09-13T18:34:13.620 INFO:teuthology.orchestra.run.smithi044.stdout:file_549 2024-09-13T18:34:13.620 INFO:teuthology.orchestra.run.smithi044.stdout:file_55 2024-09-13T18:34:13.620 INFO:teuthology.orchestra.run.smithi044.stdout:file_550 2024-09-13T18:34:13.620 INFO:teuthology.orchestra.run.smithi044.stdout:file_551 2024-09-13T18:34:13.620 INFO:teuthology.orchestra.run.smithi044.stdout:file_552 2024-09-13T18:34:13.620 INFO:teuthology.orchestra.run.smithi044.stdout:file_553 2024-09-13T18:34:13.620 INFO:teuthology.orchestra.run.smithi044.stdout:file_554 2024-09-13T18:34:13.620 INFO:teuthology.orchestra.run.smithi044.stdout:file_555 2024-09-13T18:34:13.620 INFO:teuthology.orchestra.run.smithi044.stdout:file_556 2024-09-13T18:34:13.621 INFO:teuthology.orchestra.run.smithi044.stdout:file_557 2024-09-13T18:34:13.621 INFO:teuthology.orchestra.run.smithi044.stdout:file_558 2024-09-13T18:34:13.621 INFO:teuthology.orchestra.run.smithi044.stdout:file_559 2024-09-13T18:34:13.621 INFO:teuthology.orchestra.run.smithi044.stdout:file_56 2024-09-13T18:34:13.621 INFO:teuthology.orchestra.run.smithi044.stdout:file_560 2024-09-13T18:34:13.621 INFO:teuthology.orchestra.run.smithi044.stdout:file_561 2024-09-13T18:34:13.621 INFO:teuthology.orchestra.run.smithi044.stdout:file_562 2024-09-13T18:34:13.621 INFO:teuthology.orchestra.run.smithi044.stdout:file_563 2024-09-13T18:34:13.621 INFO:teuthology.orchestra.run.smithi044.stdout:file_564 2024-09-13T18:34:13.621 INFO:teuthology.orchestra.run.smithi044.stdout:file_565 2024-09-13T18:34:13.621 INFO:teuthology.orchestra.run.smithi044.stdout:file_566 2024-09-13T18:34:13.621 INFO:teuthology.orchestra.run.smithi044.stdout:file_567 2024-09-13T18:34:13.621 INFO:teuthology.orchestra.run.smithi044.stdout:file_568 2024-09-13T18:34:13.622 INFO:teuthology.orchestra.run.smithi044.stdout:file_569 2024-09-13T18:34:13.622 INFO:teuthology.orchestra.run.smithi044.stdout:file_57 2024-09-13T18:34:13.622 INFO:teuthology.orchestra.run.smithi044.stdout:file_570 2024-09-13T18:34:13.622 INFO:teuthology.orchestra.run.smithi044.stdout:file_571 2024-09-13T18:34:13.622 INFO:teuthology.orchestra.run.smithi044.stdout:file_572 2024-09-13T18:34:13.622 INFO:teuthology.orchestra.run.smithi044.stdout:file_573 2024-09-13T18:34:13.622 INFO:teuthology.orchestra.run.smithi044.stdout:file_574 2024-09-13T18:34:13.622 INFO:teuthology.orchestra.run.smithi044.stdout:file_575 2024-09-13T18:34:13.622 INFO:teuthology.orchestra.run.smithi044.stdout:file_576 2024-09-13T18:34:13.622 INFO:teuthology.orchestra.run.smithi044.stdout:file_577 2024-09-13T18:34:13.622 INFO:teuthology.orchestra.run.smithi044.stdout:file_578 2024-09-13T18:34:13.622 INFO:teuthology.orchestra.run.smithi044.stdout:file_579 2024-09-13T18:34:13.622 INFO:teuthology.orchestra.run.smithi044.stdout:file_58 2024-09-13T18:34:13.622 INFO:teuthology.orchestra.run.smithi044.stdout:file_580 2024-09-13T18:34:13.623 INFO:teuthology.orchestra.run.smithi044.stdout:file_581 2024-09-13T18:34:13.623 INFO:teuthology.orchestra.run.smithi044.stdout:file_582 2024-09-13T18:34:13.623 INFO:teuthology.orchestra.run.smithi044.stdout:file_583 2024-09-13T18:34:13.623 INFO:teuthology.orchestra.run.smithi044.stdout:file_584 2024-09-13T18:34:13.623 INFO:teuthology.orchestra.run.smithi044.stdout:file_585 2024-09-13T18:34:13.623 INFO:teuthology.orchestra.run.smithi044.stdout:file_586 2024-09-13T18:34:13.623 INFO:teuthology.orchestra.run.smithi044.stdout:file_587 2024-09-13T18:34:13.623 INFO:teuthology.orchestra.run.smithi044.stdout:file_588 2024-09-13T18:34:13.623 INFO:teuthology.orchestra.run.smithi044.stdout:file_589 2024-09-13T18:34:13.623 INFO:teuthology.orchestra.run.smithi044.stdout:file_59 2024-09-13T18:34:13.623 INFO:teuthology.orchestra.run.smithi044.stdout:file_590 2024-09-13T18:34:13.623 INFO:teuthology.orchestra.run.smithi044.stdout:file_591 2024-09-13T18:34:13.623 INFO:teuthology.orchestra.run.smithi044.stdout:file_592 2024-09-13T18:34:13.624 INFO:teuthology.orchestra.run.smithi044.stdout:file_593 2024-09-13T18:34:13.624 INFO:teuthology.orchestra.run.smithi044.stdout:file_594 2024-09-13T18:34:13.624 INFO:teuthology.orchestra.run.smithi044.stdout:file_595 2024-09-13T18:34:13.624 INFO:teuthology.orchestra.run.smithi044.stdout:file_596 2024-09-13T18:34:13.624 INFO:teuthology.orchestra.run.smithi044.stdout:file_597 2024-09-13T18:34:13.624 INFO:teuthology.orchestra.run.smithi044.stdout:file_598 2024-09-13T18:34:13.624 INFO:teuthology.orchestra.run.smithi044.stdout:file_599 2024-09-13T18:34:13.624 INFO:teuthology.orchestra.run.smithi044.stdout:file_6 2024-09-13T18:34:13.624 INFO:teuthology.orchestra.run.smithi044.stdout:file_60 2024-09-13T18:34:13.624 INFO:teuthology.orchestra.run.smithi044.stdout:file_600 2024-09-13T18:34:13.624 INFO:teuthology.orchestra.run.smithi044.stdout:file_601 2024-09-13T18:34:13.624 INFO:teuthology.orchestra.run.smithi044.stdout:file_602 2024-09-13T18:34:13.624 INFO:teuthology.orchestra.run.smithi044.stdout:file_603 2024-09-13T18:34:13.625 INFO:teuthology.orchestra.run.smithi044.stdout:file_604 2024-09-13T18:34:13.625 INFO:teuthology.orchestra.run.smithi044.stdout:file_605 2024-09-13T18:34:13.625 INFO:teuthology.orchestra.run.smithi044.stdout:file_606 2024-09-13T18:34:13.625 INFO:teuthology.orchestra.run.smithi044.stdout:file_607 2024-09-13T18:34:13.625 INFO:teuthology.orchestra.run.smithi044.stdout:file_608 2024-09-13T18:34:13.625 INFO:teuthology.orchestra.run.smithi044.stdout:file_609 2024-09-13T18:34:13.625 INFO:teuthology.orchestra.run.smithi044.stdout:file_61 2024-09-13T18:34:13.625 INFO:teuthology.orchestra.run.smithi044.stdout:file_610 2024-09-13T18:34:13.625 INFO:teuthology.orchestra.run.smithi044.stdout:file_611 2024-09-13T18:34:13.625 INFO:teuthology.orchestra.run.smithi044.stdout:file_612 2024-09-13T18:34:13.625 INFO:teuthology.orchestra.run.smithi044.stdout:file_613 2024-09-13T18:34:13.625 INFO:teuthology.orchestra.run.smithi044.stdout:file_614 2024-09-13T18:34:13.625 INFO:teuthology.orchestra.run.smithi044.stdout:file_615 2024-09-13T18:34:13.625 INFO:teuthology.orchestra.run.smithi044.stdout:file_616 2024-09-13T18:34:13.626 INFO:teuthology.orchestra.run.smithi044.stdout:file_617 2024-09-13T18:34:13.626 INFO:teuthology.orchestra.run.smithi044.stdout:file_618 2024-09-13T18:34:13.626 INFO:teuthology.orchestra.run.smithi044.stdout:file_619 2024-09-13T18:34:13.626 INFO:teuthology.orchestra.run.smithi044.stdout:file_62 2024-09-13T18:34:13.626 INFO:teuthology.orchestra.run.smithi044.stdout:file_620 2024-09-13T18:34:13.626 INFO:teuthology.orchestra.run.smithi044.stdout:file_621 2024-09-13T18:34:13.626 INFO:teuthology.orchestra.run.smithi044.stdout:file_622 2024-09-13T18:34:13.626 INFO:teuthology.orchestra.run.smithi044.stdout:file_623 2024-09-13T18:34:13.626 INFO:teuthology.orchestra.run.smithi044.stdout:file_624 2024-09-13T18:34:13.626 INFO:teuthology.orchestra.run.smithi044.stdout:file_625 2024-09-13T18:34:13.626 INFO:teuthology.orchestra.run.smithi044.stdout:file_626 2024-09-13T18:34:13.626 INFO:teuthology.orchestra.run.smithi044.stdout:file_627 2024-09-13T18:34:13.626 INFO:teuthology.orchestra.run.smithi044.stdout:file_628 2024-09-13T18:34:13.627 INFO:teuthology.orchestra.run.smithi044.stdout:file_629 2024-09-13T18:34:13.627 INFO:teuthology.orchestra.run.smithi044.stdout:file_63 2024-09-13T18:34:13.627 INFO:teuthology.orchestra.run.smithi044.stdout:file_630 2024-09-13T18:34:13.627 INFO:teuthology.orchestra.run.smithi044.stdout:file_631 2024-09-13T18:34:13.627 INFO:teuthology.orchestra.run.smithi044.stdout:file_632 2024-09-13T18:34:13.627 INFO:teuthology.orchestra.run.smithi044.stdout:file_633 2024-09-13T18:34:13.627 INFO:teuthology.orchestra.run.smithi044.stdout:file_634 2024-09-13T18:34:13.627 INFO:teuthology.orchestra.run.smithi044.stdout:file_635 2024-09-13T18:34:13.627 INFO:teuthology.orchestra.run.smithi044.stdout:file_636 2024-09-13T18:34:13.627 INFO:teuthology.orchestra.run.smithi044.stdout:file_637 2024-09-13T18:34:13.627 INFO:teuthology.orchestra.run.smithi044.stdout:file_638 2024-09-13T18:34:13.627 INFO:teuthology.orchestra.run.smithi044.stdout:file_639 2024-09-13T18:34:13.627 INFO:teuthology.orchestra.run.smithi044.stdout:file_64 2024-09-13T18:34:13.628 INFO:teuthology.orchestra.run.smithi044.stdout:file_640 2024-09-13T18:34:13.628 INFO:teuthology.orchestra.run.smithi044.stdout:file_641 2024-09-13T18:34:13.628 INFO:teuthology.orchestra.run.smithi044.stdout:file_642 2024-09-13T18:34:13.628 INFO:teuthology.orchestra.run.smithi044.stdout:file_643 2024-09-13T18:34:13.628 INFO:teuthology.orchestra.run.smithi044.stdout:file_644 2024-09-13T18:34:13.628 INFO:teuthology.orchestra.run.smithi044.stdout:file_645 2024-09-13T18:34:13.628 INFO:teuthology.orchestra.run.smithi044.stdout:file_646 2024-09-13T18:34:13.628 INFO:teuthology.orchestra.run.smithi044.stdout:file_647 2024-09-13T18:34:13.628 INFO:teuthology.orchestra.run.smithi044.stdout:file_648 2024-09-13T18:34:13.628 INFO:teuthology.orchestra.run.smithi044.stdout:file_649 2024-09-13T18:34:13.628 INFO:teuthology.orchestra.run.smithi044.stdout:file_65 2024-09-13T18:34:13.628 INFO:teuthology.orchestra.run.smithi044.stdout:file_650 2024-09-13T18:34:13.628 INFO:teuthology.orchestra.run.smithi044.stdout:file_651 2024-09-13T18:34:13.629 INFO:teuthology.orchestra.run.smithi044.stdout:file_652 2024-09-13T18:34:13.629 INFO:teuthology.orchestra.run.smithi044.stdout:file_653 2024-09-13T18:34:13.629 INFO:teuthology.orchestra.run.smithi044.stdout:file_654 2024-09-13T18:34:13.629 INFO:teuthology.orchestra.run.smithi044.stdout:file_655 2024-09-13T18:34:13.629 INFO:teuthology.orchestra.run.smithi044.stdout:file_656 2024-09-13T18:34:13.629 INFO:teuthology.orchestra.run.smithi044.stdout:file_657 2024-09-13T18:34:13.629 INFO:teuthology.orchestra.run.smithi044.stdout:file_658 2024-09-13T18:34:13.629 INFO:teuthology.orchestra.run.smithi044.stdout:file_659 2024-09-13T18:34:13.629 INFO:teuthology.orchestra.run.smithi044.stdout:file_66 2024-09-13T18:34:13.629 INFO:teuthology.orchestra.run.smithi044.stdout:file_660 2024-09-13T18:34:13.629 INFO:teuthology.orchestra.run.smithi044.stdout:file_661 2024-09-13T18:34:13.629 INFO:teuthology.orchestra.run.smithi044.stdout:file_662 2024-09-13T18:34:13.629 INFO:teuthology.orchestra.run.smithi044.stdout:file_663 2024-09-13T18:34:13.630 INFO:teuthology.orchestra.run.smithi044.stdout:file_664 2024-09-13T18:34:13.630 INFO:teuthology.orchestra.run.smithi044.stdout:file_665 2024-09-13T18:34:13.630 INFO:teuthology.orchestra.run.smithi044.stdout:file_666 2024-09-13T18:34:13.630 INFO:teuthology.orchestra.run.smithi044.stdout:file_667 2024-09-13T18:34:13.630 INFO:teuthology.orchestra.run.smithi044.stdout:file_668 2024-09-13T18:34:13.630 INFO:teuthology.orchestra.run.smithi044.stdout:file_669 2024-09-13T18:34:13.630 INFO:teuthology.orchestra.run.smithi044.stdout:file_67 2024-09-13T18:34:13.630 INFO:teuthology.orchestra.run.smithi044.stdout:file_670 2024-09-13T18:34:13.630 INFO:teuthology.orchestra.run.smithi044.stdout:file_671 2024-09-13T18:34:13.630 INFO:teuthology.orchestra.run.smithi044.stdout:file_672 2024-09-13T18:34:13.630 INFO:teuthology.orchestra.run.smithi044.stdout:file_673 2024-09-13T18:34:13.630 INFO:teuthology.orchestra.run.smithi044.stdout:file_674 2024-09-13T18:34:13.630 INFO:teuthology.orchestra.run.smithi044.stdout:file_675 2024-09-13T18:34:13.630 INFO:teuthology.orchestra.run.smithi044.stdout:file_676 2024-09-13T18:34:13.631 INFO:teuthology.orchestra.run.smithi044.stdout:file_677 2024-09-13T18:34:13.631 INFO:teuthology.orchestra.run.smithi044.stdout:file_678 2024-09-13T18:34:13.631 INFO:teuthology.orchestra.run.smithi044.stdout:file_679 2024-09-13T18:34:13.631 INFO:teuthology.orchestra.run.smithi044.stdout:file_68 2024-09-13T18:34:13.631 INFO:teuthology.orchestra.run.smithi044.stdout:file_680 2024-09-13T18:34:13.631 INFO:teuthology.orchestra.run.smithi044.stdout:file_681 2024-09-13T18:34:13.631 INFO:teuthology.orchestra.run.smithi044.stdout:file_682 2024-09-13T18:34:13.631 INFO:teuthology.orchestra.run.smithi044.stdout:file_683 2024-09-13T18:34:13.631 INFO:teuthology.orchestra.run.smithi044.stdout:file_684 2024-09-13T18:34:13.631 INFO:teuthology.orchestra.run.smithi044.stdout:file_685 2024-09-13T18:34:13.631 INFO:teuthology.orchestra.run.smithi044.stdout:file_686 2024-09-13T18:34:13.631 INFO:teuthology.orchestra.run.smithi044.stdout:file_687 2024-09-13T18:34:13.632 INFO:teuthology.orchestra.run.smithi044.stdout:file_688 2024-09-13T18:34:13.632 INFO:teuthology.orchestra.run.smithi044.stdout:file_689 2024-09-13T18:34:13.632 INFO:teuthology.orchestra.run.smithi044.stdout:file_69 2024-09-13T18:34:13.632 INFO:teuthology.orchestra.run.smithi044.stdout:file_690 2024-09-13T18:34:13.632 INFO:teuthology.orchestra.run.smithi044.stdout:file_691 2024-09-13T18:34:13.632 INFO:teuthology.orchestra.run.smithi044.stdout:file_692 2024-09-13T18:34:13.632 INFO:teuthology.orchestra.run.smithi044.stdout:file_693 2024-09-13T18:34:13.632 INFO:teuthology.orchestra.run.smithi044.stdout:file_694 2024-09-13T18:34:13.632 INFO:teuthology.orchestra.run.smithi044.stdout:file_695 2024-09-13T18:34:13.632 INFO:teuthology.orchestra.run.smithi044.stdout:file_696 2024-09-13T18:34:13.632 INFO:teuthology.orchestra.run.smithi044.stdout:file_697 2024-09-13T18:34:13.633 INFO:teuthology.orchestra.run.smithi044.stdout:file_698 2024-09-13T18:34:13.633 INFO:teuthology.orchestra.run.smithi044.stdout:file_699 2024-09-13T18:34:13.633 INFO:teuthology.orchestra.run.smithi044.stdout:file_7 2024-09-13T18:34:13.633 INFO:teuthology.orchestra.run.smithi044.stdout:file_70 2024-09-13T18:34:13.633 INFO:teuthology.orchestra.run.smithi044.stdout:file_700 2024-09-13T18:34:13.633 INFO:teuthology.orchestra.run.smithi044.stdout:file_701 2024-09-13T18:34:13.633 INFO:teuthology.orchestra.run.smithi044.stdout:file_702 2024-09-13T18:34:13.633 INFO:teuthology.orchestra.run.smithi044.stdout:file_703 2024-09-13T18:34:13.633 INFO:teuthology.orchestra.run.smithi044.stdout:file_704 2024-09-13T18:34:13.633 INFO:teuthology.orchestra.run.smithi044.stdout:file_705 2024-09-13T18:34:13.633 INFO:teuthology.orchestra.run.smithi044.stdout:file_706 2024-09-13T18:34:13.633 INFO:teuthology.orchestra.run.smithi044.stdout:file_707 2024-09-13T18:34:13.633 INFO:teuthology.orchestra.run.smithi044.stdout:file_708 2024-09-13T18:34:13.633 INFO:teuthology.orchestra.run.smithi044.stdout:file_709 2024-09-13T18:34:13.634 INFO:teuthology.orchestra.run.smithi044.stdout:file_71 2024-09-13T18:34:13.634 INFO:teuthology.orchestra.run.smithi044.stdout:file_710 2024-09-13T18:34:13.634 INFO:teuthology.orchestra.run.smithi044.stdout:file_711 2024-09-13T18:34:13.634 INFO:teuthology.orchestra.run.smithi044.stdout:file_712 2024-09-13T18:34:13.634 INFO:teuthology.orchestra.run.smithi044.stdout:file_713 2024-09-13T18:34:13.634 INFO:teuthology.orchestra.run.smithi044.stdout:file_714 2024-09-13T18:34:13.634 INFO:teuthology.orchestra.run.smithi044.stdout:file_715 2024-09-13T18:34:13.634 INFO:teuthology.orchestra.run.smithi044.stdout:file_716 2024-09-13T18:34:13.634 INFO:teuthology.orchestra.run.smithi044.stdout:file_717 2024-09-13T18:34:13.634 INFO:teuthology.orchestra.run.smithi044.stdout:file_718 2024-09-13T18:34:13.634 INFO:teuthology.orchestra.run.smithi044.stdout:file_719 2024-09-13T18:34:13.634 INFO:teuthology.orchestra.run.smithi044.stdout:file_72 2024-09-13T18:34:13.635 INFO:teuthology.orchestra.run.smithi044.stdout:file_720 2024-09-13T18:34:13.635 INFO:teuthology.orchestra.run.smithi044.stdout:file_721 2024-09-13T18:34:13.635 INFO:teuthology.orchestra.run.smithi044.stdout:file_722 2024-09-13T18:34:13.635 INFO:teuthology.orchestra.run.smithi044.stdout:file_723 2024-09-13T18:34:13.635 INFO:teuthology.orchestra.run.smithi044.stdout:file_724 2024-09-13T18:34:13.635 INFO:teuthology.orchestra.run.smithi044.stdout:file_725 2024-09-13T18:34:13.635 INFO:teuthology.orchestra.run.smithi044.stdout:file_726 2024-09-13T18:34:13.635 INFO:teuthology.orchestra.run.smithi044.stdout:file_727 2024-09-13T18:34:13.635 INFO:teuthology.orchestra.run.smithi044.stdout:file_728 2024-09-13T18:34:13.635 INFO:teuthology.orchestra.run.smithi044.stdout:file_729 2024-09-13T18:34:13.635 INFO:teuthology.orchestra.run.smithi044.stdout:file_73 2024-09-13T18:34:13.635 INFO:teuthology.orchestra.run.smithi044.stdout:file_730 2024-09-13T18:34:13.636 INFO:teuthology.orchestra.run.smithi044.stdout:file_731 2024-09-13T18:34:13.636 INFO:teuthology.orchestra.run.smithi044.stdout:file_732 2024-09-13T18:34:13.636 INFO:teuthology.orchestra.run.smithi044.stdout:file_733 2024-09-13T18:34:13.636 INFO:teuthology.orchestra.run.smithi044.stdout:file_734 2024-09-13T18:34:13.636 INFO:teuthology.orchestra.run.smithi044.stdout:file_735 2024-09-13T18:34:13.636 INFO:teuthology.orchestra.run.smithi044.stdout:file_736 2024-09-13T18:34:13.636 INFO:teuthology.orchestra.run.smithi044.stdout:file_737 2024-09-13T18:34:13.636 INFO:teuthology.orchestra.run.smithi044.stdout:file_738 2024-09-13T18:34:13.636 INFO:teuthology.orchestra.run.smithi044.stdout:file_739 2024-09-13T18:34:13.636 INFO:teuthology.orchestra.run.smithi044.stdout:file_74 2024-09-13T18:34:13.636 INFO:teuthology.orchestra.run.smithi044.stdout:file_740 2024-09-13T18:34:13.636 INFO:teuthology.orchestra.run.smithi044.stdout:file_741 2024-09-13T18:34:13.636 INFO:teuthology.orchestra.run.smithi044.stdout:file_742 2024-09-13T18:34:13.637 INFO:teuthology.orchestra.run.smithi044.stdout:file_743 2024-09-13T18:34:13.637 INFO:teuthology.orchestra.run.smithi044.stdout:file_744 2024-09-13T18:34:13.637 INFO:teuthology.orchestra.run.smithi044.stdout:file_745 2024-09-13T18:34:13.637 INFO:teuthology.orchestra.run.smithi044.stdout:file_746 2024-09-13T18:34:13.637 INFO:teuthology.orchestra.run.smithi044.stdout:file_747 2024-09-13T18:34:13.637 INFO:teuthology.orchestra.run.smithi044.stdout:file_748 2024-09-13T18:34:13.637 INFO:teuthology.orchestra.run.smithi044.stdout:file_749 2024-09-13T18:34:13.637 INFO:teuthology.orchestra.run.smithi044.stdout:file_75 2024-09-13T18:34:13.637 INFO:teuthology.orchestra.run.smithi044.stdout:file_750 2024-09-13T18:34:13.637 INFO:teuthology.orchestra.run.smithi044.stdout:file_751 2024-09-13T18:34:13.637 INFO:teuthology.orchestra.run.smithi044.stdout:file_752 2024-09-13T18:34:13.638 INFO:teuthology.orchestra.run.smithi044.stdout:file_753 2024-09-13T18:34:13.638 INFO:teuthology.orchestra.run.smithi044.stdout:file_754 2024-09-13T18:34:13.638 INFO:teuthology.orchestra.run.smithi044.stdout:file_755 2024-09-13T18:34:13.638 INFO:teuthology.orchestra.run.smithi044.stdout:file_756 2024-09-13T18:34:13.638 INFO:teuthology.orchestra.run.smithi044.stdout:file_757 2024-09-13T18:34:13.638 INFO:teuthology.orchestra.run.smithi044.stdout:file_758 2024-09-13T18:34:13.638 INFO:teuthology.orchestra.run.smithi044.stdout:file_759 2024-09-13T18:34:13.638 INFO:teuthology.orchestra.run.smithi044.stdout:file_76 2024-09-13T18:34:13.638 INFO:teuthology.orchestra.run.smithi044.stdout:file_760 2024-09-13T18:34:13.638 INFO:teuthology.orchestra.run.smithi044.stdout:file_761 2024-09-13T18:34:13.638 INFO:teuthology.orchestra.run.smithi044.stdout:file_762 2024-09-13T18:34:13.638 INFO:teuthology.orchestra.run.smithi044.stdout:file_763 2024-09-13T18:34:13.639 INFO:teuthology.orchestra.run.smithi044.stdout:file_764 2024-09-13T18:34:13.639 INFO:teuthology.orchestra.run.smithi044.stdout:file_765 2024-09-13T18:34:13.639 INFO:teuthology.orchestra.run.smithi044.stdout:file_766 2024-09-13T18:34:13.639 INFO:teuthology.orchestra.run.smithi044.stdout:file_767 2024-09-13T18:34:13.639 INFO:teuthology.orchestra.run.smithi044.stdout:file_768 2024-09-13T18:34:13.639 INFO:teuthology.orchestra.run.smithi044.stdout:file_769 2024-09-13T18:34:13.639 INFO:teuthology.orchestra.run.smithi044.stdout:file_77 2024-09-13T18:34:13.639 INFO:teuthology.orchestra.run.smithi044.stdout:file_770 2024-09-13T18:34:13.639 INFO:teuthology.orchestra.run.smithi044.stdout:file_771 2024-09-13T18:34:13.639 INFO:teuthology.orchestra.run.smithi044.stdout:file_772 2024-09-13T18:34:13.639 INFO:teuthology.orchestra.run.smithi044.stdout:file_773 2024-09-13T18:34:13.639 INFO:teuthology.orchestra.run.smithi044.stdout:file_774 2024-09-13T18:34:13.639 INFO:teuthology.orchestra.run.smithi044.stdout:file_775 2024-09-13T18:34:13.640 INFO:teuthology.orchestra.run.smithi044.stdout:file_776 2024-09-13T18:34:13.640 INFO:teuthology.orchestra.run.smithi044.stdout:file_777 2024-09-13T18:34:13.640 INFO:teuthology.orchestra.run.smithi044.stdout:file_778 2024-09-13T18:34:13.640 INFO:teuthology.orchestra.run.smithi044.stdout:file_779 2024-09-13T18:34:13.640 INFO:teuthology.orchestra.run.smithi044.stdout:file_78 2024-09-13T18:34:13.640 INFO:teuthology.orchestra.run.smithi044.stdout:file_780 2024-09-13T18:34:13.640 INFO:teuthology.orchestra.run.smithi044.stdout:file_781 2024-09-13T18:34:13.640 INFO:teuthology.orchestra.run.smithi044.stdout:file_782 2024-09-13T18:34:13.640 INFO:teuthology.orchestra.run.smithi044.stdout:file_783 2024-09-13T18:34:13.640 INFO:teuthology.orchestra.run.smithi044.stdout:file_784 2024-09-13T18:34:13.640 INFO:teuthology.orchestra.run.smithi044.stdout:file_785 2024-09-13T18:34:13.640 INFO:teuthology.orchestra.run.smithi044.stdout:file_786 2024-09-13T18:34:13.640 INFO:teuthology.orchestra.run.smithi044.stdout:file_787 2024-09-13T18:34:13.640 INFO:teuthology.orchestra.run.smithi044.stdout:file_788 2024-09-13T18:34:13.641 INFO:teuthology.orchestra.run.smithi044.stdout:file_789 2024-09-13T18:34:13.641 INFO:teuthology.orchestra.run.smithi044.stdout:file_79 2024-09-13T18:34:13.641 INFO:teuthology.orchestra.run.smithi044.stdout:file_790 2024-09-13T18:34:13.641 INFO:teuthology.orchestra.run.smithi044.stdout:file_791 2024-09-13T18:34:13.641 INFO:teuthology.orchestra.run.smithi044.stdout:file_792 2024-09-13T18:34:13.641 INFO:teuthology.orchestra.run.smithi044.stdout:file_793 2024-09-13T18:34:13.641 INFO:teuthology.orchestra.run.smithi044.stdout:file_794 2024-09-13T18:34:13.641 INFO:teuthology.orchestra.run.smithi044.stdout:file_795 2024-09-13T18:34:13.641 INFO:teuthology.orchestra.run.smithi044.stdout:file_796 2024-09-13T18:34:13.641 INFO:teuthology.orchestra.run.smithi044.stdout:file_797 2024-09-13T18:34:13.641 INFO:teuthology.orchestra.run.smithi044.stdout:file_798 2024-09-13T18:34:13.641 INFO:teuthology.orchestra.run.smithi044.stdout:file_799 2024-09-13T18:34:13.641 INFO:teuthology.orchestra.run.smithi044.stdout:file_8 2024-09-13T18:34:13.642 INFO:teuthology.orchestra.run.smithi044.stdout:file_80 2024-09-13T18:34:13.642 INFO:teuthology.orchestra.run.smithi044.stdout:file_800 2024-09-13T18:34:13.642 INFO:teuthology.orchestra.run.smithi044.stdout:file_801 2024-09-13T18:34:13.642 INFO:teuthology.orchestra.run.smithi044.stdout:file_802 2024-09-13T18:34:13.642 INFO:teuthology.orchestra.run.smithi044.stdout:file_803 2024-09-13T18:34:13.642 INFO:teuthology.orchestra.run.smithi044.stdout:file_804 2024-09-13T18:34:13.642 INFO:teuthology.orchestra.run.smithi044.stdout:file_805 2024-09-13T18:34:13.642 INFO:teuthology.orchestra.run.smithi044.stdout:file_806 2024-09-13T18:34:13.642 INFO:teuthology.orchestra.run.smithi044.stdout:file_807 2024-09-13T18:34:13.642 INFO:teuthology.orchestra.run.smithi044.stdout:file_808 2024-09-13T18:34:13.642 INFO:teuthology.orchestra.run.smithi044.stdout:file_809 2024-09-13T18:34:13.642 INFO:teuthology.orchestra.run.smithi044.stdout:file_81 2024-09-13T18:34:13.642 INFO:teuthology.orchestra.run.smithi044.stdout:file_810 2024-09-13T18:34:13.642 INFO:teuthology.orchestra.run.smithi044.stdout:file_811 2024-09-13T18:34:13.643 INFO:teuthology.orchestra.run.smithi044.stdout:file_812 2024-09-13T18:34:13.643 INFO:teuthology.orchestra.run.smithi044.stdout:file_813 2024-09-13T18:34:13.643 INFO:teuthology.orchestra.run.smithi044.stdout:file_814 2024-09-13T18:34:13.643 INFO:teuthology.orchestra.run.smithi044.stdout:file_815 2024-09-13T18:34:13.643 INFO:teuthology.orchestra.run.smithi044.stdout:file_816 2024-09-13T18:34:13.643 INFO:teuthology.orchestra.run.smithi044.stdout:file_817 2024-09-13T18:34:13.643 INFO:teuthology.orchestra.run.smithi044.stdout:file_818 2024-09-13T18:34:13.643 INFO:teuthology.orchestra.run.smithi044.stdout:file_819 2024-09-13T18:34:13.643 INFO:teuthology.orchestra.run.smithi044.stdout:file_82 2024-09-13T18:34:13.643 INFO:teuthology.orchestra.run.smithi044.stdout:file_820 2024-09-13T18:34:13.643 INFO:teuthology.orchestra.run.smithi044.stdout:file_821 2024-09-13T18:34:13.643 INFO:teuthology.orchestra.run.smithi044.stdout:file_822 2024-09-13T18:34:13.643 INFO:teuthology.orchestra.run.smithi044.stdout:file_823 2024-09-13T18:34:13.643 INFO:teuthology.orchestra.run.smithi044.stdout:file_824 2024-09-13T18:34:13.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_825 2024-09-13T18:34:13.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_826 2024-09-13T18:34:13.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_827 2024-09-13T18:34:13.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_828 2024-09-13T18:34:13.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_829 2024-09-13T18:34:13.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_83 2024-09-13T18:34:13.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_830 2024-09-13T18:34:13.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_831 2024-09-13T18:34:13.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_832 2024-09-13T18:34:13.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_833 2024-09-13T18:34:13.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_834 2024-09-13T18:34:13.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_835 2024-09-13T18:34:13.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_836 2024-09-13T18:34:13.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_837 2024-09-13T18:34:13.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_838 2024-09-13T18:34:13.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_839 2024-09-13T18:34:13.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_84 2024-09-13T18:34:13.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_840 2024-09-13T18:34:13.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_841 2024-09-13T18:34:13.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_842 2024-09-13T18:34:13.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_843 2024-09-13T18:34:13.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_844 2024-09-13T18:34:13.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_845 2024-09-13T18:34:13.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_846 2024-09-13T18:34:13.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_847 2024-09-13T18:34:13.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_848 2024-09-13T18:34:13.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_849 2024-09-13T18:34:13.646 INFO:teuthology.orchestra.run.smithi044.stdout:file_85 2024-09-13T18:34:13.646 INFO:teuthology.orchestra.run.smithi044.stdout:file_850 2024-09-13T18:34:13.646 INFO:teuthology.orchestra.run.smithi044.stdout:file_851 2024-09-13T18:34:13.646 INFO:teuthology.orchestra.run.smithi044.stdout:file_852 2024-09-13T18:34:13.646 INFO:teuthology.orchestra.run.smithi044.stdout:file_853 2024-09-13T18:34:13.646 INFO:teuthology.orchestra.run.smithi044.stdout:file_854 2024-09-13T18:34:13.646 INFO:teuthology.orchestra.run.smithi044.stdout:file_855 2024-09-13T18:34:13.646 INFO:teuthology.orchestra.run.smithi044.stdout:file_856 2024-09-13T18:34:13.646 INFO:teuthology.orchestra.run.smithi044.stdout:file_857 2024-09-13T18:34:13.646 INFO:teuthology.orchestra.run.smithi044.stdout:file_858 2024-09-13T18:34:13.646 INFO:teuthology.orchestra.run.smithi044.stdout:file_859 2024-09-13T18:34:13.646 INFO:teuthology.orchestra.run.smithi044.stdout:file_86 2024-09-13T18:34:13.646 INFO:teuthology.orchestra.run.smithi044.stdout:file_860 2024-09-13T18:34:13.646 INFO:teuthology.orchestra.run.smithi044.stdout:file_861 2024-09-13T18:34:13.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_862 2024-09-13T18:34:13.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_863 2024-09-13T18:34:13.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_864 2024-09-13T18:34:13.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_865 2024-09-13T18:34:13.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_866 2024-09-13T18:34:13.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_867 2024-09-13T18:34:13.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_868 2024-09-13T18:34:13.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_869 2024-09-13T18:34:13.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_87 2024-09-13T18:34:13.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_870 2024-09-13T18:34:13.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_871 2024-09-13T18:34:13.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_872 2024-09-13T18:34:13.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_873 2024-09-13T18:34:13.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_874 2024-09-13T18:34:13.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_875 2024-09-13T18:34:13.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_876 2024-09-13T18:34:13.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_877 2024-09-13T18:34:13.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_878 2024-09-13T18:34:13.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_879 2024-09-13T18:34:13.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_88 2024-09-13T18:34:13.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_880 2024-09-13T18:34:13.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_881 2024-09-13T18:34:13.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_882 2024-09-13T18:34:13.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_883 2024-09-13T18:34:13.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_884 2024-09-13T18:34:13.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_885 2024-09-13T18:34:13.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_886 2024-09-13T18:34:13.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_887 2024-09-13T18:34:13.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_888 2024-09-13T18:34:13.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_889 2024-09-13T18:34:13.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_89 2024-09-13T18:34:13.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_890 2024-09-13T18:34:13.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_891 2024-09-13T18:34:13.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_892 2024-09-13T18:34:13.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_893 2024-09-13T18:34:13.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_894 2024-09-13T18:34:13.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_895 2024-09-13T18:34:13.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_896 2024-09-13T18:34:13.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_897 2024-09-13T18:34:13.650 INFO:teuthology.orchestra.run.smithi044.stdout:file_898 2024-09-13T18:34:13.650 INFO:teuthology.orchestra.run.smithi044.stdout:file_899 2024-09-13T18:34:13.650 INFO:teuthology.orchestra.run.smithi044.stdout:file_9 2024-09-13T18:34:13.650 INFO:teuthology.orchestra.run.smithi044.stdout:file_90 2024-09-13T18:34:13.650 INFO:teuthology.orchestra.run.smithi044.stdout:file_900 2024-09-13T18:34:13.650 INFO:teuthology.orchestra.run.smithi044.stdout:file_901 2024-09-13T18:34:13.650 INFO:teuthology.orchestra.run.smithi044.stdout:file_902 2024-09-13T18:34:13.650 INFO:teuthology.orchestra.run.smithi044.stdout:file_903 2024-09-13T18:34:13.650 INFO:teuthology.orchestra.run.smithi044.stdout:file_904 2024-09-13T18:34:13.650 INFO:teuthology.orchestra.run.smithi044.stdout:file_905 2024-09-13T18:34:13.650 INFO:teuthology.orchestra.run.smithi044.stdout:file_906 2024-09-13T18:34:13.650 INFO:teuthology.orchestra.run.smithi044.stdout:file_907 2024-09-13T18:34:13.651 INFO:teuthology.orchestra.run.smithi044.stdout:file_908 2024-09-13T18:34:13.651 INFO:teuthology.orchestra.run.smithi044.stdout:file_909 2024-09-13T18:34:13.651 INFO:teuthology.orchestra.run.smithi044.stdout:file_91 2024-09-13T18:34:13.651 INFO:teuthology.orchestra.run.smithi044.stdout:file_910 2024-09-13T18:34:13.651 INFO:teuthology.orchestra.run.smithi044.stdout:file_911 2024-09-13T18:34:13.651 INFO:teuthology.orchestra.run.smithi044.stdout:file_912 2024-09-13T18:34:13.651 INFO:teuthology.orchestra.run.smithi044.stdout:file_913 2024-09-13T18:34:13.651 INFO:teuthology.orchestra.run.smithi044.stdout:file_914 2024-09-13T18:34:13.651 INFO:teuthology.orchestra.run.smithi044.stdout:file_915 2024-09-13T18:34:13.651 INFO:teuthology.orchestra.run.smithi044.stdout:file_916 2024-09-13T18:34:13.651 INFO:teuthology.orchestra.run.smithi044.stdout:file_917 2024-09-13T18:34:13.651 INFO:teuthology.orchestra.run.smithi044.stdout:file_918 2024-09-13T18:34:13.651 INFO:teuthology.orchestra.run.smithi044.stdout:file_919 2024-09-13T18:34:13.651 INFO:teuthology.orchestra.run.smithi044.stdout:file_92 2024-09-13T18:34:13.652 INFO:teuthology.orchestra.run.smithi044.stdout:file_920 2024-09-13T18:34:13.652 INFO:teuthology.orchestra.run.smithi044.stdout:file_921 2024-09-13T18:34:13.652 INFO:teuthology.orchestra.run.smithi044.stdout:file_922 2024-09-13T18:34:13.652 INFO:teuthology.orchestra.run.smithi044.stdout:file_923 2024-09-13T18:34:13.652 INFO:teuthology.orchestra.run.smithi044.stdout:file_924 2024-09-13T18:34:30.105 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:34:30.111 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:35:00.158 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:35:00.165 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:35:13.587 INFO:tasks.cephfs.test_journal_repair:Killing mount, it's blocked on the MDS we killed 2024-09-13T18:35:13.587 INFO:tasks.cephfs.mount:Killing connection on ubuntu@smithi044.front.sepia.ceph.com... 2024-09-13T18:35:13.587 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:35:13.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:13.587 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 down 2024-09-13T18:35:13.607 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:35:13.608 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:35:13.608 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:35:13.656 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:13.663 INFO:teuthology.orchestra.run.smithi044.stdout:file_925 2024-09-13T18:35:13.663 INFO:teuthology.orchestra.run.smithi044.stdout:file_926 2024-09-13T18:35:13.663 INFO:teuthology.orchestra.run.smithi044.stdout:file_927 2024-09-13T18:35:13.663 INFO:teuthology.orchestra.run.smithi044.stdout:file_928 2024-09-13T18:35:13.663 INFO:teuthology.orchestra.run.smithi044.stdout:file_929 2024-09-13T18:35:13.663 INFO:teuthology.orchestra.run.smithi044.stdout:file_93 2024-09-13T18:35:13.663 INFO:teuthology.orchestra.run.smithi044.stdout:file_930 2024-09-13T18:35:13.663 INFO:teuthology.orchestra.run.smithi044.stdout:file_931 2024-09-13T18:35:13.663 INFO:teuthology.orchestra.run.smithi044.stdout:file_932 2024-09-13T18:35:13.664 INFO:teuthology.orchestra.run.smithi044.stdout:file_933 2024-09-13T18:35:13.664 INFO:teuthology.orchestra.run.smithi044.stdout:file_934 2024-09-13T18:35:13.664 INFO:teuthology.orchestra.run.smithi044.stdout:file_935 2024-09-13T18:35:13.664 INFO:teuthology.orchestra.run.smithi044.stdout:file_936 2024-09-13T18:35:13.664 INFO:teuthology.orchestra.run.smithi044.stdout:file_937 2024-09-13T18:35:13.664 INFO:teuthology.orchestra.run.smithi044.stdout:file_938 2024-09-13T18:35:13.664 INFO:teuthology.orchestra.run.smithi044.stdout:file_939 2024-09-13T18:35:13.664 INFO:teuthology.orchestra.run.smithi044.stdout:file_94 2024-09-13T18:35:13.664 INFO:teuthology.orchestra.run.smithi044.stdout:file_940 2024-09-13T18:35:13.664 INFO:teuthology.orchestra.run.smithi044.stdout:file_941 2024-09-13T18:35:13.665 INFO:teuthology.orchestra.run.smithi044.stdout:file_942 2024-09-13T18:35:13.665 INFO:teuthology.orchestra.run.smithi044.stdout:file_943 2024-09-13T18:35:13.665 INFO:teuthology.orchestra.run.smithi044.stdout:file_944 2024-09-13T18:35:13.665 INFO:teuthology.orchestra.run.smithi044.stdout:file_945 2024-09-13T18:35:13.665 INFO:teuthology.orchestra.run.smithi044.stdout:file_946 2024-09-13T18:35:13.665 INFO:teuthology.orchestra.run.smithi044.stdout:file_947 2024-09-13T18:35:13.665 INFO:teuthology.orchestra.run.smithi044.stdout:file_948 2024-09-13T18:35:13.665 INFO:teuthology.orchestra.run.smithi044.stdout:file_949 2024-09-13T18:35:13.665 INFO:teuthology.orchestra.run.smithi044.stdout:file_95 2024-09-13T18:35:13.665 INFO:teuthology.orchestra.run.smithi044.stdout:file_950 2024-09-13T18:35:13.665 INFO:teuthology.orchestra.run.smithi044.stdout:file_951 2024-09-13T18:35:13.665 INFO:teuthology.orchestra.run.smithi044.stdout:file_952 2024-09-13T18:35:13.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_953 2024-09-13T18:35:13.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_954 2024-09-13T18:35:13.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_955 2024-09-13T18:35:13.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_956 2024-09-13T18:35:13.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_957 2024-09-13T18:35:13.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_958 2024-09-13T18:35:13.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_959 2024-09-13T18:35:13.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_96 2024-09-13T18:35:13.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_960 2024-09-13T18:35:13.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_961 2024-09-13T18:35:13.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_962 2024-09-13T18:35:13.667 INFO:teuthology.orchestra.run.smithi044.stdout:file_963 2024-09-13T18:35:13.667 INFO:teuthology.orchestra.run.smithi044.stdout:file_964 2024-09-13T18:35:13.667 INFO:teuthology.orchestra.run.smithi044.stdout:file_965 2024-09-13T18:35:13.667 INFO:teuthology.orchestra.run.smithi044.stdout:file_966 2024-09-13T18:35:13.667 INFO:teuthology.orchestra.run.smithi044.stdout:file_967 2024-09-13T18:35:13.667 INFO:teuthology.orchestra.run.smithi044.stdout:file_968 2024-09-13T18:35:13.667 INFO:teuthology.orchestra.run.smithi044.stdout:file_969 2024-09-13T18:35:13.668 INFO:teuthology.orchestra.run.smithi044.stdout:file_97 2024-09-13T18:35:13.668 INFO:teuthology.orchestra.run.smithi044.stdout:file_970 2024-09-13T18:35:13.668 INFO:teuthology.orchestra.run.smithi044.stdout:file_971 2024-09-13T18:35:13.668 INFO:teuthology.orchestra.run.smithi044.stdout:file_972 2024-09-13T18:35:13.668 INFO:teuthology.orchestra.run.smithi044.stdout:file_973 2024-09-13T18:35:13.668 INFO:teuthology.orchestra.run.smithi044.stdout:file_974 2024-09-13T18:35:13.668 INFO:teuthology.orchestra.run.smithi044.stdout:file_975 2024-09-13T18:35:13.668 INFO:teuthology.orchestra.run.smithi044.stdout:file_976 2024-09-13T18:35:13.668 INFO:teuthology.orchestra.run.smithi044.stdout:file_977 2024-09-13T18:35:13.669 INFO:teuthology.orchestra.run.smithi044.stdout:file_978 2024-09-13T18:35:13.669 INFO:teuthology.orchestra.run.smithi044.stdout:file_979 2024-09-13T18:35:13.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_98 2024-09-13T18:35:13.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_980 2024-09-13T18:35:13.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_981 2024-09-13T18:35:13.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_982 2024-09-13T18:35:13.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_983 2024-09-13T18:35:13.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_984 2024-09-13T18:35:13.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_985 2024-09-13T18:35:13.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_986 2024-09-13T18:35:13.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_987 2024-09-13T18:35:13.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_988 2024-09-13T18:35:13.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_989 2024-09-13T18:35:13.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_99 2024-09-13T18:35:13.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_990 2024-09-13T18:35:13.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_991 2024-09-13T18:35:13.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_992 2024-09-13T18:35:13.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_993 2024-09-13T18:35:13.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_994 2024-09-13T18:35:13.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_995 2024-09-13T18:35:13.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_996 2024-09-13T18:35:13.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_997 2024-09-13T18:35:13.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_998 2024-09-13T18:35:13.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_999 2024-09-13T18:35:13.671 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:13.671 INFO:teuthology.orchestra.run.smithi044.stdout:./bravo: 2024-09-13T18:35:13.672 INFO:teuthology.orchestra.run.smithi044.stderr:ls: reading directory './bravo': Software caused connection abort 2024-09-13T18:35:13.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.769+0000 7fdf41343700 1 Processor -- start 2024-09-13T18:35:13.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.769+0000 7fdf41343700 1 -- start start 2024-09-13T18:35:13.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.769+0000 7fdf41343700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdf3c160eb0 0x7fdf3c165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:13.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.769+0000 7fdf41343700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdf3c1619a0 0x7fdf3c0b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:13.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.769+0000 7fdf41343700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf3c0b3d60 con 0x7fdf3c0b33d0 2024-09-13T18:35:13.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.769+0000 7fdf41343700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf3c161df0 con 0x7fdf3c160eb0 2024-09-13T18:35:13.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.769+0000 7fdf41343700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf3c071f30 con 0x7fdf3c1619a0 2024-09-13T18:35:13.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.769+0000 7fdf3bfff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdf3c160eb0 0x7fdf3c165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:13.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.769+0000 7fdf3b7fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fdf3c0b33d0 0x7fdf3c161290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43472/0 (socket says 172.21.15.44:43472) 2024-09-13T18:35:13.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.769+0000 7fdf3b7fe700 1 -- 172.21.15.44:0/1807192301 learned_addr learned my addr 172.21.15.44:0/1807192301 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:13.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.769+0000 7fdf40b42700 1 --2- 172.21.15.44:0/1807192301 >> v2:172.21.15.99:3300/0 conn(0x7fdf3c1619a0 0x7fdf3c0b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:13.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.769+0000 7fdf3bfff700 1 -- 172.21.15.44:0/1807192301 >> v2:172.21.15.99:3300/0 conn(0x7fdf3c1619a0 msgr2=0x7fdf3c0b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:13.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.769+0000 7fdf3bfff700 1 --2- 172.21.15.44:0/1807192301 >> v2:172.21.15.99:3300/0 conn(0x7fdf3c1619a0 0x7fdf3c0b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:13.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.769+0000 7fdf3bfff700 1 -- 172.21.15.44:0/1807192301 >> v1:172.21.15.44:6789/0 conn(0x7fdf3c0b33d0 legacy=0x7fdf3c161290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:13.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.769+0000 7fdf3bfff700 1 -- 172.21.15.44:0/1807192301 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c1622e0 con 0x7fdf3c160eb0 2024-09-13T18:35:13.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf3bfff700 1 --2- 172.21.15.44:0/1807192301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf3c160eb0 0x7fdf3c165590 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c0cb7b0 tx=0x7fdf3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6e5ec22866b294 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:13.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf3affd700 1 -- 172.21.15.44:0/1807192301 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3400e070 con 0x7fdf3c160eb0 2024-09-13T18:35:13.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf3affd700 1 -- 172.21.15.44:0/1807192301 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3400bbd0 con 0x7fdf3c160eb0 2024-09-13T18:35:13.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf3affd700 1 -- 172.21.15.44:0/1807192301 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf34012430 con 0x7fdf3c160eb0 2024-09-13T18:35:13.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf41343700 1 -- 172.21.15.44:0/1807192301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf3c160eb0 msgr2=0x7fdf3c165590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:13.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf41343700 1 --2- 172.21.15.44:0/1807192301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf3c160eb0 0x7fdf3c165590 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c0cb7b0 tx=0x7fdf3400b330 comp rx=0 tx=0).stop 2024-09-13T18:35:13.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf41343700 1 -- 172.21.15.44:0/1807192301 shutdown_connections 2024-09-13T18:35:13.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf41343700 1 --2- 172.21.15.44:0/1807192301 >> v2:172.21.15.99:3300/0 conn(0x7fdf3c1619a0 0x7fdf3c0b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:13.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf41343700 1 --2- 172.21.15.44:0/1807192301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf3c160eb0 0x7fdf3c165590 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:13.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf41343700 1 -- 172.21.15.44:0/1807192301 >> 172.21.15.44:0/1807192301 conn(0x7fdf3c0b0f00 msgr2=0x7fdf3c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:13.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf41343700 1 -- 172.21.15.44:0/1807192301 shutdown_connections 2024-09-13T18:35:13.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf41343700 1 -- 172.21.15.44:0/1807192301 wait complete. 2024-09-13T18:35:13.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf41343700 1 Processor -- start 2024-09-13T18:35:13.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf41343700 1 -- start start 2024-09-13T18:35:13.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf41343700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf3c0b33d0 0x7fdf3c1f3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:13.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf41343700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf3c160eb0 0x7fdf3c0a9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:13.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf41343700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf3c1619a0 0x7fdf3c0a9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:13.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf41343700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c0aaec0 con 0x7fdf3c160eb0 2024-09-13T18:35:13.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf41343700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c1f44d0 con 0x7fdf3c0b33d0 2024-09-13T18:35:13.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf41343700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c0aa2b0 con 0x7fdf3c1619a0 2024-09-13T18:35:13.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf3b7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf3c160eb0 0x7fdf3c0a9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:13.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf3bfff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf3c0b33d0 0x7fdf3c1f3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:13.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf40b42700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf3c1619a0 0x7fdf3c0a9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:13.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf3bfff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf3c0b33d0 0x7fdf3c1f3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:46696/0 (socket says 172.21.15.44:46696) 2024-09-13T18:35:13.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.773+0000 7fdf3bfff700 1 -- 172.21.15.44:0/2811990781 learned_addr learned my addr 172.21.15.44:0/2811990781 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:13.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.777+0000 7fdf3b7fe700 1 -- 172.21.15.44:0/2811990781 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf3c1619a0 msgr2=0x7fdf3c0a9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:13.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.777+0000 7fdf3b7fe700 1 --2- 172.21.15.44:0/2811990781 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf3c1619a0 0x7fdf3c0a9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:13.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.777+0000 7fdf3b7fe700 1 -- 172.21.15.44:0/2811990781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf3c0b33d0 msgr2=0x7fdf3c1f3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:13.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.777+0000 7fdf3b7fe700 1 --2- 172.21.15.44:0/2811990781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf3c0b33d0 0x7fdf3c1f3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:13.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.777+0000 7fdf3b7fe700 1 -- 172.21.15.44:0/2811990781 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf34009a70 con 0x7fdf3c160eb0 2024-09-13T18:35:13.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.777+0000 7fdf3b7fe700 1 --2- 172.21.15.44:0/2811990781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf3c160eb0 0x7fdf3c0a9740 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fdf3000c430 tx=0x7fdf3000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:13.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.777+0000 7fdf38ff9700 1 -- 172.21.15.44:0/2811990781 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf30005d90 con 0x7fdf3c160eb0 2024-09-13T18:35:13.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.777+0000 7fdf38ff9700 1 -- 172.21.15.44:0/2811990781 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3000ce40 con 0x7fdf3c160eb0 2024-09-13T18:35:13.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.777+0000 7fdf41343700 1 -- 172.21.15.44:0/2811990781 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf3c0aa590 con 0x7fdf3c160eb0 2024-09-13T18:35:13.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.777+0000 7fdf38ff9700 1 -- 172.21.15.44:0/2811990781 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf300072d0 con 0x7fdf3c160eb0 2024-09-13T18:35:13.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.777+0000 7fdf41343700 1 -- 172.21.15.44:0/2811990781 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3c0aab50 con 0x7fdf3c160eb0 2024-09-13T18:35:13.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.777+0000 7fdf41343700 1 -- 172.21.15.44:0/2811990781 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf3c0ab030 con 0x7fdf3c160eb0 2024-09-13T18:35:13.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.781+0000 7fdf38ff9700 1 -- 172.21.15.44:0/2811990781 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdf30007430 con 0x7fdf3c160eb0 2024-09-13T18:35:13.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.781+0000 7fdf38ff9700 1 --2- 172.21.15.44:0/2811990781 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdf28066730 0x7fdf28068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:13.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.781+0000 7fdf38ff9700 1 -- 172.21.15.44:0/2811990781 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fdf300831b0 con 0x7fdf3c160eb0 2024-09-13T18:35:13.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.781+0000 7fdf3bfff700 1 --2- 172.21.15.44:0/2811990781 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdf28066730 0x7fdf28068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:13.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.781+0000 7fdf3bfff700 1 --2- 172.21.15.44:0/2811990781 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdf28066730 0x7fdf28068bf0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fdf34000f80 tx=0x7fdf34011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:13.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.785+0000 7fdf38ff9700 1 -- 172.21.15.44:0/2811990781 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdf300504f0 con 0x7fdf3c160eb0 2024-09-13T18:35:13.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.961+0000 7fdf41343700 1 -- 172.21.15.44:0/2811990781 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf3c0b3d60 con 0x7fdf3c160eb0 2024-09-13T18:35:13.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.965+0000 7fdf38ff9700 1 -- 172.21.15.44:0/2811990781 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16634 (secure 0 0 0) 0x7fdf3c0b3d60 con 0x7fdf3c160eb0 2024-09-13T18:35:13.974 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:13.975 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":64,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:34:13.117328+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:14.682923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:15.291935+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/1608555972":"2024-09-14T18:34:13.117246+0000","172.21.15.44:6833/1608555972":"2024-09-14T18:34:13.117246+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:13.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.965+0000 7fdf41343700 1 -- 172.21.15.44:0/2811990781 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdf28066730 msgr2=0x7fdf28068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:13.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.965+0000 7fdf41343700 1 --2- 172.21.15.44:0/2811990781 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdf28066730 0x7fdf28068bf0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fdf34000f80 tx=0x7fdf34011000 comp rx=0 tx=0).stop 2024-09-13T18:35:13.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.965+0000 7fdf41343700 1 -- 172.21.15.44:0/2811990781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf3c160eb0 msgr2=0x7fdf3c0a9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:13.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.965+0000 7fdf41343700 1 --2- 172.21.15.44:0/2811990781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf3c160eb0 0x7fdf3c0a9740 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fdf3000c430 tx=0x7fdf3000c740 comp rx=0 tx=0).stop 2024-09-13T18:35:13.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.969+0000 7fdf41343700 1 -- 172.21.15.44:0/2811990781 shutdown_connections 2024-09-13T18:35:13.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.969+0000 7fdf41343700 1 --2- 172.21.15.44:0/2811990781 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdf28066730 0x7fdf28068bf0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:13.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.969+0000 7fdf41343700 1 --2- 172.21.15.44:0/2811990781 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf3c1619a0 0x7fdf3c0a9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:13.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.969+0000 7fdf41343700 1 --2- 172.21.15.44:0/2811990781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf3c160eb0 0x7fdf3c0a9740 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:13.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.969+0000 7fdf41343700 1 --2- 172.21.15.44:0/2811990781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf3c0b33d0 0x7fdf3c1f3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:13.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.969+0000 7fdf41343700 1 -- 172.21.15.44:0/2811990781 >> 172.21.15.44:0/2811990781 conn(0x7fdf3c0b0f00 msgr2=0x7fdf3c06d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:13.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.969+0000 7fdf41343700 1 -- 172.21.15.44:0/2811990781 shutdown_connections 2024-09-13T18:35:13.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:13.969+0000 7fdf41343700 1 -- 172.21.15.44:0/2811990781 wait complete. 2024-09-13T18:35:13.990 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:33:14.682923+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:33:15.291935+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:35:13.991 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:35:14.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.101+0000 7f5912c56700 1 Processor -- start 2024-09-13T18:35:14.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.101+0000 7f5912c56700 1 -- start start 2024-09-13T18:35:14.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.101+0000 7f5912c56700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f590c1573e0 0x7f590c070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.101+0000 7f5912c56700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f590c0710e0 0x7f590c159f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.101+0000 7f5912c56700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f590c071540 con 0x7f590c15a460 2024-09-13T18:35:14.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.101+0000 7f5912c56700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f590c0cc1b0 con 0x7f590c0710e0 2024-09-13T18:35:14.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.101+0000 7f5912c56700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590c15ac50 con 0x7f590c1573e0 2024-09-13T18:35:14.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.101+0000 7f5911c54700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f590c1573e0 0x7f590c070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.101+0000 7f5911453700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f590c0710e0 0x7f590c159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.101+0000 7f5912455700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f590c15a460 0x7f590c15d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:44106/0 (socket says 172.21.15.44:44106) 2024-09-13T18:35:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.101+0000 7f5912455700 1 -- 172.21.15.44:0/812889574 learned_addr learned my addr 172.21.15.44:0/812889574 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.101+0000 7f5911453700 1 -- 172.21.15.44:0/812889574 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f590c1573e0 msgr2=0x7f590c070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.101+0000 7f5911453700 1 --2- 172.21.15.44:0/812889574 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f590c1573e0 0x7f590c070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.101+0000 7f5911453700 1 -- 172.21.15.44:0/812889574 >> v1:172.21.15.99:6789/0 conn(0x7f590c15a460 legacy=0x7f590c15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.101+0000 7f5911453700 1 -- 172.21.15.44:0/812889574 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c0cb3f0 con 0x7f590c0710e0 2024-09-13T18:35:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.101+0000 7f5911453700 1 --2- 172.21.15.44:0/812889574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f590c0710e0 0x7f590c159f20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f58fc009880 tx=0x7f58fc009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=113bd64199efc6c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:14.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.101+0000 7f5910c52700 1 -- 172.21.15.44:0/812889574 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc011830 con 0x7f590c0710e0 2024-09-13T18:35:14.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.101+0000 7f5910c52700 1 -- 172.21.15.44:0/812889574 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58fc011990 con 0x7f590c0710e0 2024-09-13T18:35:14.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.101+0000 7f5910c52700 1 -- 172.21.15.44:0/812889574 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc011d20 con 0x7f590c0710e0 2024-09-13T18:35:14.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.105+0000 7f5912c56700 1 -- 172.21.15.44:0/812889574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f590c0710e0 msgr2=0x7f590c159f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.105+0000 7f5912c56700 1 --2- 172.21.15.44:0/812889574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f590c0710e0 0x7f590c159f20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f58fc009880 tx=0x7f58fc009b90 comp rx=0 tx=0).stop 2024-09-13T18:35:14.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.105+0000 7f5912c56700 1 -- 172.21.15.44:0/812889574 shutdown_connections 2024-09-13T18:35:14.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.105+0000 7f5912c56700 1 --2- 172.21.15.44:0/812889574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f590c0710e0 0x7f590c159f20 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.105+0000 7f5912c56700 1 --2- 172.21.15.44:0/812889574 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f590c1573e0 0x7f590c070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.105+0000 7f5912c56700 1 -- 172.21.15.44:0/812889574 >> 172.21.15.44:0/812889574 conn(0x7f590c0b0e10 msgr2=0x7f590c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:14.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.105+0000 7f5912c56700 1 -- 172.21.15.44:0/812889574 shutdown_connections 2024-09-13T18:35:14.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.105+0000 7f5912c56700 1 -- 172.21.15.44:0/812889574 wait complete. 2024-09-13T18:35:14.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.105+0000 7f5912c56700 1 Processor -- start 2024-09-13T18:35:14.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.105+0000 7f5912c56700 1 -- start start 2024-09-13T18:35:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.105+0000 7f5912c56700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f590c0710e0 0x7f590c14c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.105+0000 7f5912c56700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f590c1573e0 0x7f590c14ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.105+0000 7f5912c56700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f590c15a460 0x7f590c14fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.109+0000 7f5912c56700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c14eb30 con 0x7f590c15a460 2024-09-13T18:35:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.109+0000 7f5912c56700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c14d940 con 0x7f590c1573e0 2024-09-13T18:35:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.109+0000 7f5912c56700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590c14cd30 con 0x7f590c0710e0 2024-09-13T18:35:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.109+0000 7f5912455700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f590c15a460 0x7f590c14fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.109+0000 7f5911c54700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f590c0710e0 0x7f590c14c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.109+0000 7f5911453700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f590c1573e0 0x7f590c14ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.109+0000 7f5912455700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f590c15a460 0x7f590c14fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39654/0 (socket says 172.21.15.44:39654) 2024-09-13T18:35:14.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.109+0000 7f5912455700 1 -- 172.21.15.44:0/3636176646 learned_addr learned my addr 172.21.15.44:0/3636176646 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:14.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.109+0000 7f5912455700 1 -- 172.21.15.44:0/3636176646 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f590c0710e0 msgr2=0x7f590c14c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.109+0000 7f5912455700 1 --2- 172.21.15.44:0/3636176646 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f590c0710e0 0x7f590c14c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.109+0000 7f5912455700 1 -- 172.21.15.44:0/3636176646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f590c1573e0 msgr2=0x7f590c14ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.109+0000 7f5912455700 1 --2- 172.21.15.44:0/3636176646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f590c1573e0 0x7f590c14ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.109+0000 7f5912455700 1 -- 172.21.15.44:0/3636176646 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc0094b0 con 0x7f590c15a460 2024-09-13T18:35:14.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.109+0000 7f5912455700 1 --2- 172.21.15.44:0/3636176646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f590c15a460 0x7f590c14fba0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f590400cab0 tx=0x7f590400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:14.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.109+0000 7f59027fc700 1 -- 172.21.15.44:0/3636176646 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5904007480 con 0x7f590c15a460 2024-09-13T18:35:14.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.109+0000 7f59027fc700 1 -- 172.21.15.44:0/3636176646 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59040075e0 con 0x7f590c15a460 2024-09-13T18:35:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.109+0000 7f5912c56700 1 -- 172.21.15.44:0/3636176646 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f590c14d010 con 0x7f590c15a460 2024-09-13T18:35:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.109+0000 7f5912c56700 1 -- 172.21.15.44:0/3636176646 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f590c14d5d0 con 0x7f590c15a460 2024-09-13T18:35:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.109+0000 7f59027fc700 1 -- 172.21.15.44:0/3636176646 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5904007950 con 0x7f590c15a460 2024-09-13T18:35:14.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.109+0000 7f5912c56700 1 -- 172.21.15.44:0/3636176646 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590c159f20 con 0x7f590c15a460 2024-09-13T18:35:14.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.113+0000 7f59027fc700 1 -- 172.21.15.44:0/3636176646 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f590401b3b0 con 0x7f590c15a460 2024-09-13T18:35:14.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.113+0000 7f59027fc700 1 --2- 172.21.15.44:0/3636176646 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f58f0066730 0x7f58f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.113+0000 7f59027fc700 1 -- 172.21.15.44:0/3636176646 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5904083e80 con 0x7f590c15a460 2024-09-13T18:35:14.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.113+0000 7f5911c54700 1 --2- 172.21.15.44:0/3636176646 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f58f0066730 0x7f58f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.113+0000 7f5911c54700 1 --2- 172.21.15.44:0/3636176646 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f58f0066730 0x7f58f0068bf0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5908009bf0 tx=0x7f5908009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:14.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.121+0000 7f59027fc700 1 -- 172.21.15.44:0/3636176646 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5904051230 con 0x7f590c15a460 2024-09-13T18:35:14.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.289+0000 7f5912c56700 1 -- 172.21.15.44:0/3636176646 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f590c14da80 con 0x7f590c15a460 2024-09-13T18:35:14.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.289+0000 7f59027fc700 1 -- 172.21.15.44:0/3636176646 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f59040210a0 con 0x7f590c15a460 2024-09-13T18:35:14.299 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:35:14.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.293+0000 7f5912c56700 1 -- 172.21.15.44:0/3636176646 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f58f0066730 msgr2=0x7f58f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.293+0000 7f5912c56700 1 --2- 172.21.15.44:0/3636176646 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f58f0066730 0x7f58f0068bf0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5908009bf0 tx=0x7f5908009240 comp rx=0 tx=0).stop 2024-09-13T18:35:14.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.293+0000 7f5912c56700 1 -- 172.21.15.44:0/3636176646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f590c15a460 msgr2=0x7f590c14fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.293+0000 7f5912c56700 1 --2- 172.21.15.44:0/3636176646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f590c15a460 0x7f590c14fba0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f590400cab0 tx=0x7f590400cae0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.293+0000 7f5912c56700 1 -- 172.21.15.44:0/3636176646 shutdown_connections 2024-09-13T18:35:14.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.293+0000 7f5912c56700 1 --2- 172.21.15.44:0/3636176646 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f58f0066730 0x7f58f0068bf0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.293+0000 7f5912c56700 1 --2- 172.21.15.44:0/3636176646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f590c15a460 0x7f590c14fba0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.293+0000 7f5912c56700 1 --2- 172.21.15.44:0/3636176646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f590c1573e0 0x7f590c14ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.293+0000 7f5912c56700 1 --2- 172.21.15.44:0/3636176646 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f590c0710e0 0x7f590c14c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.293+0000 7f5912c56700 1 -- 172.21.15.44:0/3636176646 >> 172.21.15.44:0/3636176646 conn(0x7f590c0b0e10 msgr2=0x7f590c15ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:14.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.293+0000 7f5912c56700 1 -- 172.21.15.44:0/3636176646 shutdown_connections 2024-09-13T18:35:14.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.293+0000 7f5912c56700 1 -- 172.21.15.44:0/3636176646 wait complete. 2024-09-13T18:35:14.320 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:35:14.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.433+0000 7f42f9e44700 1 Processor -- start 2024-09-13T18:35:14.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.433+0000 7f42f9e44700 1 -- start start 2024-09-13T18:35:14.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.433+0000 7f42f9e44700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f42f41466d0 0x7f42f40ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.433+0000 7f42f9e44700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f42f40b3e30 0x7f42f40cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.433+0000 7f42f9e44700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f415d1b0 con 0x7f42f40cc310 2024-09-13T18:35:14.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.433+0000 7f42f9e44700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f40cc7c0 con 0x7f42f40b3e30 2024-09-13T18:35:14.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.433+0000 7f42f9e44700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f40ac8c0 con 0x7f42f41466d0 2024-09-13T18:35:14.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.433+0000 7f42f2ffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f42f40b3e30 0x7f42f40cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.433+0000 7f42f2ffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f42f40b3e30 0x7f42f40cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39658/0 (socket says 172.21.15.44:39658) 2024-09-13T18:35:14.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.433+0000 7f42f2ffd700 1 -- 172.21.15.44:0/800434471 learned_addr learned my addr 172.21.15.44:0/800434471 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:14.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.433+0000 7f42f37fe700 1 --2- 172.21.15.44:0/800434471 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f42f41466d0 0x7f42f40ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.433+0000 7f42f2ffd700 1 -- 172.21.15.44:0/800434471 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f42f41466d0 msgr2=0x7f42f40ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:14.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.433+0000 7f42f2ffd700 1 --2- 172.21.15.44:0/800434471 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f42f41466d0 0x7f42f40ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.433+0000 7f42f2ffd700 1 -- 172.21.15.44:0/800434471 >> v1:172.21.15.99:6789/0 conn(0x7f42f40cc310 legacy=0x7f42f4160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.433+0000 7f42f2ffd700 1 -- 172.21.15.44:0/800434471 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f40b43f0 con 0x7f42f40b3e30 2024-09-13T18:35:14.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.433+0000 7f42f37fe700 1 --2- 172.21.15.44:0/800434471 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f42f41466d0 0x7f42f40ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:14.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.433+0000 7f42f2ffd700 1 --2- 172.21.15.44:0/800434471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f40b3e30 0x7f42f40cbdd0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009e50 tx=0x7f42dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6307785172bbe83c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:14.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.433+0000 7f42f27fc700 1 -- 172.21.15.44:0/800434471 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc00e070 con 0x7f42f40b3e30 2024-09-13T18:35:14.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.433+0000 7f42f27fc700 1 -- 172.21.15.44:0/800434471 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42dc00b9c0 con 0x7f42f40b3e30 2024-09-13T18:35:14.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.433+0000 7f42f27fc700 1 -- 172.21.15.44:0/800434471 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc00bd70 con 0x7f42f40b3e30 2024-09-13T18:35:14.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.433+0000 7f42f9e44700 1 -- 172.21.15.44:0/800434471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f40b3e30 msgr2=0x7f42f40cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.433+0000 7f42f9e44700 1 --2- 172.21.15.44:0/800434471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f40b3e30 0x7f42f40cbdd0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009e50 tx=0x7f42dc00b330 comp rx=0 tx=0).stop 2024-09-13T18:35:14.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f9e44700 1 -- 172.21.15.44:0/800434471 shutdown_connections 2024-09-13T18:35:14.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f9e44700 1 --2- 172.21.15.44:0/800434471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f40b3e30 0x7f42f40cbdd0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f9e44700 1 --2- 172.21.15.44:0/800434471 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f42f41466d0 0x7f42f40ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f9e44700 1 -- 172.21.15.44:0/800434471 >> 172.21.15.44:0/800434471 conn(0x7f42f40af620 msgr2=0x7f42f40afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:14.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f9e44700 1 -- 172.21.15.44:0/800434471 shutdown_connections 2024-09-13T18:35:14.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f9e44700 1 -- 172.21.15.44:0/800434471 wait complete. 2024-09-13T18:35:14.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f9e44700 1 Processor -- start 2024-09-13T18:35:14.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f9e44700 1 -- start start 2024-09-13T18:35:14.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f9e44700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f40b3e30 0x7f42f413bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f9e44700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f42f40cc310 0x7f42f406bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f9e44700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42f41466d0 0x7f42f4142870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f9e44700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f413c400 con 0x7f42f40b3e30 2024-09-13T18:35:14.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f9e44700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f413d880 con 0x7f42f41466d0 2024-09-13T18:35:14.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f9e44700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f406c8c0 con 0x7f42f40cc310 2024-09-13T18:35:14.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f37fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f40b3e30 0x7f42f413bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f37fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f40b3e30 0x7f42f413bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39664/0 (socket says 172.21.15.44:39664) 2024-09-13T18:35:14.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f37fe700 1 -- 172.21.15.44:0/3961581923 learned_addr learned my addr 172.21.15.44:0/3961581923 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f2ffd700 1 --2- 172.21.15.44:0/3961581923 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f42f40cc310 0x7f42f406bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f3fff700 1 --2- 172.21.15.44:0/3961581923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42f41466d0 0x7f42f4142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f37fe700 1 -- 172.21.15.44:0/3961581923 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f42f40cc310 msgr2=0x7f42f406bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f37fe700 1 --2- 172.21.15.44:0/3961581923 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f42f40cc310 0x7f42f406bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f37fe700 1 -- 172.21.15.44:0/3961581923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42f41466d0 msgr2=0x7f42f4142870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f37fe700 1 --2- 172.21.15.44:0/3961581923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42f41466d0 0x7f42f4142870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f37fe700 1 -- 172.21.15.44:0/3961581923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42dc009b30 con 0x7f42f40b3e30 2024-09-13T18:35:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.437+0000 7f42f3fff700 1 --2- 172.21.15.44:0/3961581923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42f41466d0 0x7f42f4142870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.441+0000 7f42f37fe700 1 --2- 172.21.15.44:0/3961581923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f40b3e30 0x7f42f413bec0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f42e400e880 tx=0x7f42e400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.441+0000 7f42ebfff700 1 -- 172.21.15.44:0/3961581923 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e4013610 con 0x7f42f40b3e30 2024-09-13T18:35:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.441+0000 7f42ebfff700 1 -- 172.21.15.44:0/3961581923 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e4013770 con 0x7f42f40b3e30 2024-09-13T18:35:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.441+0000 7f42f9e44700 1 -- 172.21.15.44:0/3961581923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f406cba0 con 0x7f42f40b3e30 2024-09-13T18:35:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.441+0000 7f42ebfff700 1 -- 172.21.15.44:0/3961581923 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e4013b00 con 0x7f42f40b3e30 2024-09-13T18:35:14.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.441+0000 7f42f9e44700 1 -- 172.21.15.44:0/3961581923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f413dad0 con 0x7f42f40b3e30 2024-09-13T18:35:14.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.441+0000 7f42f9e44700 1 -- 172.21.15.44:0/3961581923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f406d0c0 con 0x7f42f40b3e30 2024-09-13T18:35:14.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.441+0000 7f42ebfff700 1 -- 172.21.15.44:0/3961581923 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f42e4013c60 con 0x7f42f40b3e30 2024-09-13T18:35:14.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.441+0000 7f42ebfff700 1 --2- 172.21.15.44:0/3961581923 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f42d4066730 0x7f42d4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.441+0000 7f42ebfff700 1 -- 172.21.15.44:0/3961581923 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f42e4083e70 con 0x7f42f40b3e30 2024-09-13T18:35:14.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.441+0000 7f42f2ffd700 1 --2- 172.21.15.44:0/3961581923 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f42d4066730 0x7f42d4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.445+0000 7f42f2ffd700 1 --2- 172.21.15.44:0/3961581923 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f42d4066730 0x7f42d4068bf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009e50 tx=0x7f42dc009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:14.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.453+0000 7f42ebfff700 1 -- 172.21.15.44:0/3961581923 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f42e4051100 con 0x7f42f40b3e30 2024-09-13T18:35:14.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.625+0000 7f42f9e44700 1 -- 172.21.15.44:0/3961581923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f42f40cbdd0 con 0x7f42f40b3e30 2024-09-13T18:35:14.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.625+0000 7f42ebfff700 1 -- 172.21.15.44:0/3961581923 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v64) v1 ==== 104+0+11 (secure 0 0 0) 0x7f42e4054720 con 0x7f42f40b3e30 2024-09-13T18:35:14.635 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:35:14.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.629+0000 7f42f9e44700 1 -- 172.21.15.44:0/3961581923 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f42d4066730 msgr2=0x7f42d4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.629+0000 7f42f9e44700 1 --2- 172.21.15.44:0/3961581923 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f42d4066730 0x7f42d4068bf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009e50 tx=0x7f42dc009000 comp rx=0 tx=0).stop 2024-09-13T18:35:14.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.629+0000 7f42f9e44700 1 -- 172.21.15.44:0/3961581923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f40b3e30 msgr2=0x7f42f413bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.629+0000 7f42f9e44700 1 --2- 172.21.15.44:0/3961581923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f40b3e30 0x7f42f413bec0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f42e400e880 tx=0x7f42e400eb90 comp rx=0 tx=0).stop 2024-09-13T18:35:14.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.629+0000 7f42f9e44700 1 -- 172.21.15.44:0/3961581923 shutdown_connections 2024-09-13T18:35:14.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.629+0000 7f42f9e44700 1 --2- 172.21.15.44:0/3961581923 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f42d4066730 0x7f42d4068bf0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.629+0000 7f42f9e44700 1 --2- 172.21.15.44:0/3961581923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42f41466d0 0x7f42f4142870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.629+0000 7f42f9e44700 1 --2- 172.21.15.44:0/3961581923 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f42f40cc310 0x7f42f406bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.629+0000 7f42f9e44700 1 --2- 172.21.15.44:0/3961581923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f40b3e30 0x7f42f413bec0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.629+0000 7f42f9e44700 1 -- 172.21.15.44:0/3961581923 >> 172.21.15.44:0/3961581923 conn(0x7f42f40af620 msgr2=0x7f42f40b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:14.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.629+0000 7f42f9e44700 1 -- 172.21.15.44:0/3961581923 shutdown_connections 2024-09-13T18:35:14.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.629+0000 7f42f9e44700 1 -- 172.21.15.44:0/3961581923 wait complete. 2024-09-13T18:35:14.656 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:35:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.765+0000 7fad2e942700 1 Processor -- start 2024-09-13T18:35:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.765+0000 7fad2e942700 1 -- start start 2024-09-13T18:35:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.765+0000 7fad2e942700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad28144340 0x7fad2806d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.765+0000 7fad2e942700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fad280cdc90 0x7fad2806fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.765+0000 7fad2e942700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad28144720 con 0x7fad2806bdb0 2024-09-13T18:35:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.765+0000 7fad2e942700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2806dd40 con 0x7fad280cdc90 2024-09-13T18:35:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.765+0000 7fad2e942700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2806da60 con 0x7fad28144340 2024-09-13T18:35:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.765+0000 7fad2e141700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fad280cdc90 0x7fad2806fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.765+0000 7fad2e141700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fad280cdc90 0x7fad2806fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39670/0 (socket says 172.21.15.44:39670) 2024-09-13T18:35:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.765+0000 7fad2e141700 1 -- 172.21.15.44:0/1768580308 learned_addr learned my addr 172.21.15.44:0/1768580308 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.765+0000 7fad2d940700 1 --2- 172.21.15.44:0/1768580308 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad28144340 0x7fad2806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.765+0000 7fad2e141700 1 -- 172.21.15.44:0/1768580308 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad28144340 msgr2=0x7fad2806d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.765+0000 7fad2e141700 1 --2- 172.21.15.44:0/1768580308 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad28144340 0x7fad2806d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.765+0000 7fad2e141700 1 -- 172.21.15.44:0/1768580308 >> v1:172.21.15.99:6789/0 conn(0x7fad2806bdb0 legacy=0x7fad280cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.765+0000 7fad2e141700 1 -- 172.21.15.44:0/1768580308 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2815e660 con 0x7fad280cdc90 2024-09-13T18:35:14.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.765+0000 7fad2e141700 1 --2- 172.21.15.44:0/1768580308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad280cdc90 0x7fad2806fa90 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fad20009e50 tx=0x7fad2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53bf756fae715d3b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:14.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.765+0000 7fad2c93e700 1 -- 172.21.15.44:0/1768580308 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2000e070 con 0x7fad280cdc90 2024-09-13T18:35:14.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.765+0000 7fad2c93e700 1 -- 172.21.15.44:0/1768580308 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2000b910 con 0x7fad280cdc90 2024-09-13T18:35:14.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.765+0000 7fad2c93e700 1 -- 172.21.15.44:0/1768580308 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2000bcc0 con 0x7fad280cdc90 2024-09-13T18:35:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.769+0000 7fad2e942700 1 -- 172.21.15.44:0/1768580308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad280cdc90 msgr2=0x7fad2806fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.769+0000 7fad2e942700 1 --2- 172.21.15.44:0/1768580308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad280cdc90 0x7fad2806fa90 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fad20009e50 tx=0x7fad2000b330 comp rx=0 tx=0).stop 2024-09-13T18:35:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.769+0000 7fad2e942700 1 -- 172.21.15.44:0/1768580308 shutdown_connections 2024-09-13T18:35:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.769+0000 7fad2e942700 1 --2- 172.21.15.44:0/1768580308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad280cdc90 0x7fad2806fa90 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.769+0000 7fad2e942700 1 --2- 172.21.15.44:0/1768580308 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad28144340 0x7fad2806d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.769+0000 7fad2e942700 1 -- 172.21.15.44:0/1768580308 >> 172.21.15.44:0/1768580308 conn(0x7fad280b0e10 msgr2=0x7fad280b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.769+0000 7fad2e942700 1 -- 172.21.15.44:0/1768580308 shutdown_connections 2024-09-13T18:35:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.769+0000 7fad2e942700 1 -- 172.21.15.44:0/1768580308 wait complete. 2024-09-13T18:35:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.769+0000 7fad2e942700 1 Processor -- start 2024-09-13T18:35:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.769+0000 7fad2e942700 1 -- start start 2024-09-13T18:35:14.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.769+0000 7fad2e942700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad2806bdb0 0x7fad281f2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.769+0000 7fad2e942700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad280cdc90 0x7fad280c4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.769+0000 7fad2e942700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad28144340 0x7fad281f36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.769+0000 7fad2e942700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad280aa060 con 0x7fad280cdc90 2024-09-13T18:35:14.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.773+0000 7fad2e942700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2815abc0 con 0x7fad2806bdb0 2024-09-13T18:35:14.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.773+0000 7fad2e942700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad280a9110 con 0x7fad28144340 2024-09-13T18:35:14.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.773+0000 7fad2d13f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad280cdc90 0x7fad280c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.773+0000 7fad2d940700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad2806bdb0 0x7fad281f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.773+0000 7fad2e141700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad28144340 0x7fad281f36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.773+0000 7fad2d13f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad280cdc90 0x7fad280c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39672/0 (socket says 172.21.15.44:39672) 2024-09-13T18:35:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.773+0000 7fad2d940700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad2806bdb0 0x7fad281f2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:46736/0 (socket says 172.21.15.44:46736) 2024-09-13T18:35:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.773+0000 7fad2d13f700 1 -- 172.21.15.44:0/305957500 learned_addr learned my addr 172.21.15.44:0/305957500 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:14.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.773+0000 7fad2e141700 1 -- 172.21.15.44:0/305957500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad2806bdb0 msgr2=0x7fad281f2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.773+0000 7fad2e141700 1 --2- 172.21.15.44:0/305957500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad2806bdb0 0x7fad281f2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.773+0000 7fad2e141700 1 -- 172.21.15.44:0/305957500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad280cdc90 msgr2=0x7fad280c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.773+0000 7fad2e141700 1 --2- 172.21.15.44:0/305957500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad280cdc90 0x7fad280c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.773+0000 7fad2e141700 1 -- 172.21.15.44:0/305957500 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad20009b30 con 0x7fad28144340 2024-09-13T18:35:14.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.773+0000 7fad2d940700 1 --2- 172.21.15.44:0/305957500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad2806bdb0 0x7fad281f2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:14.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.773+0000 7fad2d13f700 1 --2- 172.21.15.44:0/305957500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad280cdc90 0x7fad280c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:14.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.773+0000 7fad2e141700 1 --2- 172.21.15.44:0/305957500 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad28144340 0x7fad281f36a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fad20015000 tx=0x7fad20004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:14.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.773+0000 7fad1a7fc700 1 -- 172.21.15.44:0/305957500 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad200048c0 con 0x7fad28144340 2024-09-13T18:35:14.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.773+0000 7fad1a7fc700 1 -- 172.21.15.44:0/305957500 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad200099b0 con 0x7fad28144340 2024-09-13T18:35:14.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.773+0000 7fad2e942700 1 -- 172.21.15.44:0/305957500 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad280a93e0 con 0x7fad28144340 2024-09-13T18:35:14.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.773+0000 7fad1a7fc700 1 -- 172.21.15.44:0/305957500 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2001c680 con 0x7fad28144340 2024-09-13T18:35:14.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.773+0000 7fad2e942700 1 -- 172.21.15.44:0/305957500 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad280a99a0 con 0x7fad28144340 2024-09-13T18:35:14.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.773+0000 7fad2e942700 1 -- 172.21.15.44:0/305957500 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad280aa1a0 con 0x7fad28144340 2024-09-13T18:35:14.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.777+0000 7fad1a7fc700 1 -- 172.21.15.44:0/305957500 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fad2001c7e0 con 0x7fad28144340 2024-09-13T18:35:14.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.777+0000 7fad1a7fc700 1 --2- 172.21.15.44:0/305957500 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fad0c066730 0x7fad0c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.777+0000 7fad1a7fc700 1 -- 172.21.15.44:0/305957500 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fad20085da0 con 0x7fad28144340 2024-09-13T18:35:14.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.777+0000 7fad2d940700 1 --2- 172.21.15.44:0/305957500 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fad0c066730 0x7fad0c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.777+0000 7fad2d940700 1 --2- 172.21.15.44:0/305957500 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fad0c066730 0x7fad0c068bf0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fad281f11e0 tx=0x7fad24009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:14.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.785+0000 7fad1a7fc700 1 -- 172.21.15.44:0/305957500 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fad20053240 con 0x7fad28144340 2024-09-13T18:35:14.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.957+0000 7fad2e942700 1 -- 172.21.15.44:0/305957500 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fad2806a310 con 0x7fad28144340 2024-09-13T18:35:14.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.961+0000 7fad1a7fc700 1 -- 172.21.15.44:0/305957500 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v64) v1 ==== 100+0+11 (secure 0 0 0) 0x7fad20056860 con 0x7fad28144340 2024-09-13T18:35:14.969 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:35:14.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.961+0000 7fad2e942700 1 -- 172.21.15.44:0/305957500 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fad0c066730 msgr2=0x7fad0c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.961+0000 7fad2e942700 1 --2- 172.21.15.44:0/305957500 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fad0c066730 0x7fad0c068bf0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fad281f11e0 tx=0x7fad24009240 comp rx=0 tx=0).stop 2024-09-13T18:35:14.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.961+0000 7fad2e942700 1 -- 172.21.15.44:0/305957500 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad28144340 msgr2=0x7fad281f36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.961+0000 7fad2e942700 1 --2- 172.21.15.44:0/305957500 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad28144340 0x7fad281f36a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fad20015000 tx=0x7fad20004af0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.961+0000 7fad2e942700 1 -- 172.21.15.44:0/305957500 shutdown_connections 2024-09-13T18:35:14.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.961+0000 7fad2e942700 1 --2- 172.21.15.44:0/305957500 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fad0c066730 0x7fad0c068bf0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.961+0000 7fad2e942700 1 --2- 172.21.15.44:0/305957500 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad28144340 0x7fad281f36a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.961+0000 7fad2e942700 1 --2- 172.21.15.44:0/305957500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad280cdc90 0x7fad280c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.961+0000 7fad2e942700 1 --2- 172.21.15.44:0/305957500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad2806bdb0 0x7fad281f2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.961+0000 7fad2e942700 1 -- 172.21.15.44:0/305957500 >> 172.21.15.44:0/305957500 conn(0x7fad280b0e10 msgr2=0x7fad280b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:14.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.961+0000 7fad2e942700 1 -- 172.21.15.44:0/305957500 shutdown_connections 2024-09-13T18:35:14.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:14.961+0000 7fad2e942700 1 -- 172.21.15.44:0/305957500 wait complete. 2024-09-13T18:35:14.984 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:35:15.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.093+0000 7fea29ce6700 1 Processor -- start 2024-09-13T18:35:15.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.093+0000 7fea29ce6700 1 -- start start 2024-09-13T18:35:15.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.097+0000 7fea29ce6700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fea240712b0 0x7fea24159f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.097+0000 7fea29ce6700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea2415ac50 con 0x7fea2415a460 2024-09-13T18:35:15.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.097+0000 7fea29ce6700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea240cb3f0 con 0x7fea241573e0 2024-09-13T18:35:15.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.097+0000 7fea29ce6700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea240cc1b0 con 0x7fea240712b0 2024-09-13T18:35:15.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.097+0000 7fea294e5700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fea2415a460 0x7fea2406c3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43478/0 (socket says 172.21.15.44:43478) 2024-09-13T18:35:15.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.097+0000 7fea294e5700 1 -- 172.21.15.44:0/3871898431 learned_addr learned my addr 172.21.15.44:0/3871898431 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:15.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.097+0000 7fea23fff700 1 --2- 172.21.15.44:0/3871898431 >> v2:172.21.15.99:3300/0 conn(0x7fea240712b0 0x7fea24159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.097+0000 7fea237fe700 1 -- 172.21.15.44:0/3871898431 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386442678 0 0) 0x7fea240cb3f0 con 0x7fea241573e0 2024-09-13T18:35:15.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.097+0000 7fea237fe700 1 -- 172.21.15.44:0/3871898431 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea100035d0 con 0x7fea241573e0 2024-09-13T18:35:15.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.097+0000 7fea237fe700 1 -- 172.21.15.44:0/3871898431 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117390547 0 0) 0x7fea2415ac50 con 0x7fea2415a460 2024-09-13T18:35:15.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.097+0000 7fea237fe700 1 -- 172.21.15.44:0/3871898431 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea240cb3f0 con 0x7fea2415a460 2024-09-13T18:35:15.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.097+0000 7fea23fff700 1 -- 172.21.15.44:0/3871898431 >> v1:172.21.15.99:6789/0 conn(0x7fea241573e0 legacy=0x7fea24070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.097+0000 7fea23fff700 1 -- 172.21.15.44:0/3871898431 >> v1:172.21.15.44:6789/0 conn(0x7fea2415a460 legacy=0x7fea2406c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.097+0000 7fea23fff700 1 -- 172.21.15.44:0/3871898431 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea240cb6d0 con 0x7fea240712b0 2024-09-13T18:35:15.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.097+0000 7fea23fff700 1 --2- 172.21.15.44:0/3871898431 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea240712b0 0x7fea24159f20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fea0c009850 tx=0x7fea0c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecdded090875e4b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:15.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.097+0000 7fea237fe700 1 -- 172.21.15.44:0/3871898431 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c011830 con 0x7fea240712b0 2024-09-13T18:35:15.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.097+0000 7fea237fe700 1 -- 172.21.15.44:0/3871898431 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c011990 con 0x7fea240712b0 2024-09-13T18:35:15.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.097+0000 7fea237fe700 1 -- 172.21.15.44:0/3871898431 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c011d40 con 0x7fea240712b0 2024-09-13T18:35:15.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.097+0000 7fea29ce6700 1 -- 172.21.15.44:0/3871898431 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea240712b0 msgr2=0x7fea24159f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.097+0000 7fea29ce6700 1 --2- 172.21.15.44:0/3871898431 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea240712b0 0x7fea24159f20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fea0c009850 tx=0x7fea0c009b60 comp rx=0 tx=0).stop 2024-09-13T18:35:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.101+0000 7fea29ce6700 1 -- 172.21.15.44:0/3871898431 shutdown_connections 2024-09-13T18:35:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.101+0000 7fea29ce6700 1 --2- 172.21.15.44:0/3871898431 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea240712b0 0x7fea24159f20 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.101+0000 7fea29ce6700 1 -- 172.21.15.44:0/3871898431 >> 172.21.15.44:0/3871898431 conn(0x7fea240b0e10 msgr2=0x7fea240b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.101+0000 7fea29ce6700 1 -- 172.21.15.44:0/3871898431 shutdown_connections 2024-09-13T18:35:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.101+0000 7fea29ce6700 1 -- 172.21.15.44:0/3871898431 wait complete. 2024-09-13T18:35:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.101+0000 7fea29ce6700 1 Processor -- start 2024-09-13T18:35:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.101+0000 7fea29ce6700 1 -- start start 2024-09-13T18:35:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.101+0000 7fea29ce6700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea240712b0 0x7fea241461b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.101+0000 7fea29ce6700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fea241573e0 0x7fea240cde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.101+0000 7fea29ce6700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea2415a460 0x7fea2406fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.101+0000 7fea29ce6700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea24150cc0 con 0x7fea240712b0 2024-09-13T18:35:15.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.101+0000 7fea29ce6700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea241466f0 con 0x7fea2415a460 2024-09-13T18:35:15.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.101+0000 7fea29ce6700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea241500b0 con 0x7fea241573e0 2024-09-13T18:35:15.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.101+0000 7fea28ce4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea240712b0 0x7fea241461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.101+0000 7fea28ce4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea240712b0 0x7fea241461b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39674/0 (socket says 172.21.15.44:39674) 2024-09-13T18:35:15.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.101+0000 7fea28ce4700 1 -- 172.21.15.44:0/2567064721 learned_addr learned my addr 172.21.15.44:0/2567064721 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:15.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.101+0000 7fea23fff700 1 --2- 172.21.15.44:0/2567064721 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fea241573e0 0x7fea240cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.105+0000 7fea294e5700 1 --2- 172.21.15.44:0/2567064721 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea2415a460 0x7fea2406fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.105+0000 7fea28ce4700 1 -- 172.21.15.44:0/2567064721 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fea241573e0 msgr2=0x7fea240cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.105+0000 7fea28ce4700 1 --2- 172.21.15.44:0/2567064721 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fea241573e0 0x7fea240cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.105+0000 7fea28ce4700 1 -- 172.21.15.44:0/2567064721 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea2415a460 msgr2=0x7fea2406fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.105+0000 7fea28ce4700 1 --2- 172.21.15.44:0/2567064721 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea2415a460 0x7fea2406fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.105+0000 7fea28ce4700 1 -- 172.21.15.44:0/2567064721 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0c0094b0 con 0x7fea240712b0 2024-09-13T18:35:15.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.105+0000 7fea28ce4700 1 --2- 172.21.15.44:0/2567064721 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea240712b0 0x7fea241461b0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fea1c00cfd0 tx=0x7fea1c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:15.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.105+0000 7fea217fa700 1 -- 172.21.15.44:0/2567064721 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c003c20 con 0x7fea240712b0 2024-09-13T18:35:15.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.105+0000 7fea217fa700 1 -- 172.21.15.44:0/2567064721 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1c003d80 con 0x7fea240712b0 2024-09-13T18:35:15.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.105+0000 7fea217fa700 1 -- 172.21.15.44:0/2567064721 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c00abb0 con 0x7fea240712b0 2024-09-13T18:35:15.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.105+0000 7fea29ce6700 1 -- 172.21.15.44:0/2567064721 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea24150390 con 0x7fea240712b0 2024-09-13T18:35:15.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.105+0000 7fea29ce6700 1 -- 172.21.15.44:0/2567064721 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea24150950 con 0x7fea240712b0 2024-09-13T18:35:15.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.105+0000 7fea29ce6700 1 -- 172.21.15.44:0/2567064721 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea24159f20 con 0x7fea240712b0 2024-09-13T18:35:15.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.109+0000 7fea217fa700 1 -- 172.21.15.44:0/2567064721 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fea1c00ad10 con 0x7fea240712b0 2024-09-13T18:35:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.109+0000 7fea217fa700 1 --2- 172.21.15.44:0/2567064721 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fea04066730 0x7fea04068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.109+0000 7fea217fa700 1 -- 172.21.15.44:0/2567064721 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fea1c084260 con 0x7fea240712b0 2024-09-13T18:35:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.109+0000 7fea23fff700 1 --2- 172.21.15.44:0/2567064721 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fea04066730 0x7fea04068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.109+0000 7fea23fff700 1 --2- 172.21.15.44:0/2567064721 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fea04066730 0x7fea04068bf0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0090b0 tx=0x7fea0c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:15.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.113+0000 7fea217fa700 1 -- 172.21.15.44:0/2567064721 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fea1c051570 con 0x7fea240712b0 2024-09-13T18:35:15.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.297+0000 7fea29ce6700 1 -- 172.21.15.44:0/2567064721 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fea2415ddc0 con 0x7fea240712b0 2024-09-13T18:35:15.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.297+0000 7fea217fa700 1 -- 172.21.15.44:0/2567064721 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v64) v1 ==== 80+0+122 (secure 0 0 0) 0x7fea1c054b90 con 0x7fea240712b0 2024-09-13T18:35:15.306 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/1608555972 2024-09-14T18:34:13.117246+0000 2024-09-13T18:35:15.306 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/1608555972 2024-09-14T18:34:13.117246+0000 2024-09-13T18:35:15.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.301+0000 7fea29ce6700 1 -- 172.21.15.44:0/2567064721 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fea04066730 msgr2=0x7fea04068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.301+0000 7fea29ce6700 1 --2- 172.21.15.44:0/2567064721 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fea04066730 0x7fea04068bf0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0090b0 tx=0x7fea0c008030 comp rx=0 tx=0).stop 2024-09-13T18:35:15.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.301+0000 7fea29ce6700 1 -- 172.21.15.44:0/2567064721 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea240712b0 msgr2=0x7fea241461b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.301+0000 7fea29ce6700 1 --2- 172.21.15.44:0/2567064721 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea240712b0 0x7fea241461b0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fea1c00cfd0 tx=0x7fea1c00a060 comp rx=0 tx=0).stop 2024-09-13T18:35:15.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.301+0000 7fea29ce6700 1 -- 172.21.15.44:0/2567064721 shutdown_connections 2024-09-13T18:35:15.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.301+0000 7fea29ce6700 1 --2- 172.21.15.44:0/2567064721 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fea04066730 0x7fea04068bf0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.301+0000 7fea29ce6700 1 --2- 172.21.15.44:0/2567064721 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea2415a460 0x7fea2406fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.301+0000 7fea29ce6700 1 --2- 172.21.15.44:0/2567064721 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fea241573e0 0x7fea240cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.301+0000 7fea29ce6700 1 --2- 172.21.15.44:0/2567064721 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea240712b0 0x7fea241461b0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.301+0000 7fea29ce6700 1 -- 172.21.15.44:0/2567064721 >> 172.21.15.44:0/2567064721 conn(0x7fea240b0e10 msgr2=0x7fea240ad710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:15.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.301+0000 7fea29ce6700 1 -- 172.21.15.44:0/2567064721 shutdown_connections 2024-09-13T18:35:15.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.301+0000 7fea29ce6700 1 -- 172.21.15.44:0/2567064721 wait complete. 2024-09-13T18:35:15.310 INFO:teuthology.orchestra.run.smithi044.stderr:listed 2 entries 2024-09-13T18:35:15.322 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:35:15.322 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:35:15.330 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:15.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.433+0000 7fe5b759e700 1 Processor -- start 2024-09-13T18:35:15.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.433+0000 7fe5b759e700 1 -- start start 2024-09-13T18:35:15.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.433+0000 7fe5b759e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe5b80cf690 0x7fe5b80b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.433+0000 7fe5b759e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b80b3bf0 con 0x7fe5b8145a30 2024-09-13T18:35:15.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.433+0000 7fe5b759e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b8145e10 con 0x7fe5b80b5830 2024-09-13T18:35:15.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.433+0000 7fe5b759e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b80b47e0 con 0x7fe5b80cf690 2024-09-13T18:35:15.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.433+0000 7fe5b659c700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe5b8145a30 0x7fe5b80cfdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43482/0 (socket says 172.21.15.44:43482) 2024-09-13T18:35:15.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.433+0000 7fe5b659c700 1 -- 172.21.15.44:0/1814467994 learned_addr learned my addr 172.21.15.44:0/1814467994 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:15.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.433+0000 7fe5b5d9b700 1 --2- 172.21.15.44:0/1814467994 >> v2:172.21.15.99:3300/0 conn(0x7fe5b80cf690 0x7fe5b80b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.437+0000 7fe5b559a700 1 -- 172.21.15.44:0/1814467994 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304344492 0 0) 0x7fe5b80b3bf0 con 0x7fe5b8145a30 2024-09-13T18:35:15.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.437+0000 7fe5b559a700 1 -- 172.21.15.44:0/1814467994 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5a40035d0 con 0x7fe5b8145a30 2024-09-13T18:35:15.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.437+0000 7fe5b5d9b700 1 -- 172.21.15.44:0/1814467994 >> v1:172.21.15.99:6789/0 conn(0x7fe5b80b5830 legacy=0x7fe5b80b5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.437+0000 7fe5b5d9b700 1 -- 172.21.15.44:0/1814467994 >> v1:172.21.15.44:6789/0 conn(0x7fe5b8145a30 legacy=0x7fe5b80cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.437+0000 7fe5b5d9b700 1 -- 172.21.15.44:0/1814467994 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b80b3e40 con 0x7fe5b80cf690 2024-09-13T18:35:15.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.437+0000 7fe5b5d9b700 1 --2- 172.21.15.44:0/1814467994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5b80cf690 0x7fe5b80b4c00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8009850 tx=0x7fe5a8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90c96270e798a7b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:15.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.437+0000 7fe5b559a700 1 -- 172.21.15.44:0/1814467994 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8011830 con 0x7fe5b80cf690 2024-09-13T18:35:15.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.437+0000 7fe5b559a700 1 -- 172.21.15.44:0/1814467994 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a8011990 con 0x7fe5b80cf690 2024-09-13T18:35:15.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.437+0000 7fe5b559a700 1 -- 172.21.15.44:0/1814467994 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8011d40 con 0x7fe5b80cf690 2024-09-13T18:35:15.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.437+0000 7fe5b759e700 1 -- 172.21.15.44:0/1814467994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5b80cf690 msgr2=0x7fe5b80b4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.437+0000 7fe5b759e700 1 --2- 172.21.15.44:0/1814467994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5b80cf690 0x7fe5b80b4c00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8009850 tx=0x7fe5a8009b60 comp rx=0 tx=0).stop 2024-09-13T18:35:15.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.437+0000 7fe5b759e700 1 -- 172.21.15.44:0/1814467994 shutdown_connections 2024-09-13T18:35:15.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.437+0000 7fe5b759e700 1 --2- 172.21.15.44:0/1814467994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5b80cf690 0x7fe5b80b4c00 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.437+0000 7fe5b759e700 1 -- 172.21.15.44:0/1814467994 >> 172.21.15.44:0/1814467994 conn(0x7fe5b8071d00 msgr2=0x7fe5b80720e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:15.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.437+0000 7fe5b759e700 1 -- 172.21.15.44:0/1814467994 shutdown_connections 2024-09-13T18:35:15.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.437+0000 7fe5b759e700 1 -- 172.21.15.44:0/1814467994 wait complete. 2024-09-13T18:35:15.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.437+0000 7fe5b759e700 1 Processor -- start 2024-09-13T18:35:15.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.437+0000 7fe5b759e700 1 -- start start 2024-09-13T18:35:15.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.441+0000 7fe5b759e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5b80b5830 0x7fe5b806d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.441+0000 7fe5b759e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe5b80cf690 0x7fe5b813ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.441+0000 7fe5b759e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5b8145a30 0x7fe5b813b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.441+0000 7fe5b759e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b806cc40 con 0x7fe5b8145a30 2024-09-13T18:35:15.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.441+0000 7fe5b759e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b815bc80 con 0x7fe5b80b5830 2024-09-13T18:35:15.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.441+0000 7fe5b759e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b806bfc0 con 0x7fe5b80cf690 2024-09-13T18:35:15.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.441+0000 7fe5b6d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5b8145a30 0x7fe5b813b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.441+0000 7fe5b6d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5b8145a30 0x7fe5b813b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39688/0 (socket says 172.21.15.44:39688) 2024-09-13T18:35:15.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.441+0000 7fe5b6d9d700 1 -- 172.21.15.44:0/3619183587 learned_addr learned my addr 172.21.15.44:0/3619183587 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:15.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.441+0000 7fe5b659c700 1 --2- 172.21.15.44:0/3619183587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5b80b5830 0x7fe5b806d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.441+0000 7fe5b5d9b700 1 --2- 172.21.15.44:0/3619183587 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe5b80cf690 0x7fe5b813ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.441+0000 7fe5b6d9d700 1 -- 172.21.15.44:0/3619183587 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe5b80cf690 msgr2=0x7fe5b813ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.441+0000 7fe5b6d9d700 1 --2- 172.21.15.44:0/3619183587 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe5b80cf690 0x7fe5b813ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.441+0000 7fe5b6d9d700 1 -- 172.21.15.44:0/3619183587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5b80b5830 msgr2=0x7fe5b806d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.441+0000 7fe5b6d9d700 1 --2- 172.21.15.44:0/3619183587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5b80b5830 0x7fe5b806d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.441+0000 7fe5b6d9d700 1 -- 172.21.15.44:0/3619183587 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a80094b0 con 0x7fe5b8145a30 2024-09-13T18:35:15.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.441+0000 7fe5b6d9d700 1 --2- 172.21.15.44:0/3619183587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5b8145a30 0x7fe5b813b340 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fe5b000cc50 tx=0x7fe5b000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:15.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.441+0000 7fe5aeffd700 1 -- 172.21.15.44:0/3619183587 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0003c20 con 0x7fe5b8145a30 2024-09-13T18:35:15.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.441+0000 7fe5aeffd700 1 -- 172.21.15.44:0/3619183587 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b0003d80 con 0x7fe5b8145a30 2024-09-13T18:35:15.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.441+0000 7fe5b759e700 1 -- 172.21.15.44:0/3619183587 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b806c2a0 con 0x7fe5b8145a30 2024-09-13T18:35:15.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.441+0000 7fe5aeffd700 1 -- 172.21.15.44:0/3619183587 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b000aab0 con 0x7fe5b8145a30 2024-09-13T18:35:15.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.441+0000 7fe5b759e700 1 -- 172.21.15.44:0/3619183587 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b806c860 con 0x7fe5b8145a30 2024-09-13T18:35:15.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.441+0000 7fe5b759e700 1 -- 172.21.15.44:0/3619183587 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b806cd80 con 0x7fe5b8145a30 2024-09-13T18:35:15.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.445+0000 7fe5aeffd700 1 -- 172.21.15.44:0/3619183587 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe5b000ac10 con 0x7fe5b8145a30 2024-09-13T18:35:15.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.445+0000 7fe5aeffd700 1 --2- 172.21.15.44:0/3619183587 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe598066730 0x7fe598068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.445+0000 7fe5aeffd700 1 -- 172.21.15.44:0/3619183587 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe5b00841a0 con 0x7fe5b8145a30 2024-09-13T18:35:15.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.445+0000 7fe5b659c700 1 --2- 172.21.15.44:0/3619183587 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe598066730 0x7fe598068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.445+0000 7fe5b659c700 1 --2- 172.21.15.44:0/3619183587 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe598066730 0x7fe598068bf0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0007fd0 tx=0x7fe5a0007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:15.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.449+0000 7fe5aeffd700 1 -- 172.21.15.44:0/3619183587 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe5b00514b0 con 0x7fe5b8145a30 2024-09-13T18:35:15.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.625+0000 7fe5b759e700 1 -- 172.21.15.44:0/3619183587 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5b80b4c00 con 0x7fe5b8145a30 2024-09-13T18:35:15.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.629+0000 7fe5aeffd700 1 -- 172.21.15.44:0/3619183587 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16634 (secure 0 0 0) 0x7fe5b0054ad0 con 0x7fe5b8145a30 2024-09-13T18:35:15.638 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:15.638 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":64,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:34:13.117328+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:14.682923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:15.291935+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/1608555972":"2024-09-14T18:34:13.117246+0000","172.21.15.44:6833/1608555972":"2024-09-14T18:34:13.117246+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:15.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.629+0000 7fe5b759e700 1 -- 172.21.15.44:0/3619183587 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe598066730 msgr2=0x7fe598068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.629+0000 7fe5b759e700 1 --2- 172.21.15.44:0/3619183587 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe598066730 0x7fe598068bf0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0007fd0 tx=0x7fe5a0007de0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.629+0000 7fe5b759e700 1 -- 172.21.15.44:0/3619183587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5b8145a30 msgr2=0x7fe5b813b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.629+0000 7fe5b759e700 1 --2- 172.21.15.44:0/3619183587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5b8145a30 0x7fe5b813b340 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fe5b000cc50 tx=0x7fe5b000cf60 comp rx=0 tx=0).stop 2024-09-13T18:35:15.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.629+0000 7fe5b759e700 1 -- 172.21.15.44:0/3619183587 shutdown_connections 2024-09-13T18:35:15.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.629+0000 7fe5b759e700 1 --2- 172.21.15.44:0/3619183587 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe598066730 0x7fe598068bf0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.629+0000 7fe5b759e700 1 --2- 172.21.15.44:0/3619183587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5b8145a30 0x7fe5b813b340 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.629+0000 7fe5b759e700 1 --2- 172.21.15.44:0/3619183587 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe5b80cf690 0x7fe5b813ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.629+0000 7fe5b759e700 1 --2- 172.21.15.44:0/3619183587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5b80b5830 0x7fe5b806d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.629+0000 7fe5b759e700 1 -- 172.21.15.44:0/3619183587 >> 172.21.15.44:0/3619183587 conn(0x7fe5b8071d00 msgr2=0x7fe5b80b5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:15.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.629+0000 7fe5b759e700 1 -- 172.21.15.44:0/3619183587 shutdown_connections 2024-09-13T18:35:15.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.629+0000 7fe5b759e700 1 -- 172.21.15.44:0/3619183587 wait complete. 2024-09-13T18:35:15.657 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:33:14.682923+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:33:15.291935+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:35:15.657 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:35:15.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956f59e700 1 Processor -- start 2024-09-13T18:35:15.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956f59e700 1 -- start start 2024-09-13T18:35:15.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956f59e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f957006f8c0 0x7f957015abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956f59e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f957015b2e0 con 0x7f95700b3290 2024-09-13T18:35:15.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956f59e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f957015b5c0 con 0x7f957015a800 2024-09-13T18:35:15.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956f59e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f957015bf60 con 0x7f957006f8c0 2024-09-13T18:35:15.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956dd9b700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f95700b3290 0x7f957015c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43484/0 (socket says 172.21.15.44:43484) 2024-09-13T18:35:15.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956dd9b700 1 -- 172.21.15.44:0/2826257202 learned_addr learned my addr 172.21.15.44:0/2826257202 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:15.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956ed9d700 1 --2- 172.21.15.44:0/2826257202 >> v2:172.21.15.99:3300/0 conn(0x7f957006f8c0 0x7f957015abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956d59a700 1 -- 172.21.15.44:0/2826257202 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4022915766 0 0) 0x7f957015b2e0 con 0x7f95700b3290 2024-09-13T18:35:15.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956d59a700 1 -- 172.21.15.44:0/2826257202 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95500035d0 con 0x7f95700b3290 2024-09-13T18:35:15.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956ed9d700 1 -- 172.21.15.44:0/2826257202 >> v1:172.21.15.99:6789/0 conn(0x7f957015a800 legacy=0x7f95700b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956ed9d700 1 -- 172.21.15.44:0/2826257202 >> v1:172.21.15.44:6789/0 conn(0x7f95700b3290 legacy=0x7f957015c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956ed9d700 1 -- 172.21.15.44:0/2826257202 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957015b8a0 con 0x7f957006f8c0 2024-09-13T18:35:15.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956ed9d700 1 --2- 172.21.15.44:0/2826257202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f957006f8c0 0x7f957015abe0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9568009d90 tx=0x7f956800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd4c50a4e55721c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:15.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956d59a700 1 -- 172.21.15.44:0/2826257202 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956800e070 con 0x7f957006f8c0 2024-09-13T18:35:15.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956d59a700 1 -- 172.21.15.44:0/2826257202 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956800bb20 con 0x7f957006f8c0 2024-09-13T18:35:15.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956d59a700 1 -- 172.21.15.44:0/2826257202 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956800be90 con 0x7f957006f8c0 2024-09-13T18:35:15.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956f59e700 1 -- 172.21.15.44:0/2826257202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f957006f8c0 msgr2=0x7f957015abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956f59e700 1 --2- 172.21.15.44:0/2826257202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f957006f8c0 0x7f957015abe0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9568009d90 tx=0x7f956800b330 comp rx=0 tx=0).stop 2024-09-13T18:35:15.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956f59e700 1 -- 172.21.15.44:0/2826257202 shutdown_connections 2024-09-13T18:35:15.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956f59e700 1 --2- 172.21.15.44:0/2826257202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f957006f8c0 0x7f957015abe0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956f59e700 1 -- 172.21.15.44:0/2826257202 >> 172.21.15.44:0/2826257202 conn(0x7f9570071ce0 msgr2=0x7f95700720c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:15.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956f59e700 1 -- 172.21.15.44:0/2826257202 shutdown_connections 2024-09-13T18:35:15.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.773+0000 7f956f59e700 1 -- 172.21.15.44:0/2826257202 wait complete. 2024-09-13T18:35:15.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f956f59e700 1 Processor -- start 2024-09-13T18:35:15.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f956f59e700 1 -- start start 2024-09-13T18:35:15.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f956f59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f957006f8c0 0x7f95701f05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f956f59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95700b3290 0x7f95701503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f956f59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f957015a800 0x7f9570144370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f956f59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9570150910 con 0x7f95700b3290 2024-09-13T18:35:15.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f956f59e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95701f0c60 con 0x7f957015a800 2024-09-13T18:35:15.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f956f59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95701f0f40 con 0x7f957006f8c0 2024-09-13T18:35:15.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f956dd9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95700b3290 0x7f95701503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f956dd9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95700b3290 0x7f95701503d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39694/0 (socket says 172.21.15.44:39694) 2024-09-13T18:35:15.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f956dd9b700 1 -- 172.21.15.44:0/407186901 learned_addr learned my addr 172.21.15.44:0/407186901 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:15.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f956e59c700 1 --2- 172.21.15.44:0/407186901 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f957006f8c0 0x7f95701f05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f956ed9d700 1 --2- 172.21.15.44:0/407186901 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f957015a800 0x7f9570144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f956dd9b700 1 -- 172.21.15.44:0/407186901 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f957006f8c0 msgr2=0x7f95701f05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f956dd9b700 1 --2- 172.21.15.44:0/407186901 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f957006f8c0 0x7f95701f05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f956dd9b700 1 -- 172.21.15.44:0/407186901 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f957015a800 msgr2=0x7f9570144370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f956dd9b700 1 --2- 172.21.15.44:0/407186901 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f957015a800 0x7f9570144370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f956dd9b700 1 -- 172.21.15.44:0/407186901 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9568009a70 con 0x7f95700b3290 2024-09-13T18:35:15.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f956dd9b700 1 --2- 172.21.15.44:0/407186901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95700b3290 0x7f95701503d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f955800c700 tx=0x7f955800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:15.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f9566ffd700 1 -- 172.21.15.44:0/407186901 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9558005d90 con 0x7f95700b3290 2024-09-13T18:35:15.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f9566ffd700 1 -- 172.21.15.44:0/407186901 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95580070d0 con 0x7f95700b3290 2024-09-13T18:35:15.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f956f59e700 1 -- 172.21.15.44:0/407186901 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95701f1220 con 0x7f95700b3290 2024-09-13T18:35:15.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f9566ffd700 1 -- 172.21.15.44:0/407186901 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9558007480 con 0x7f95700b3290 2024-09-13T18:35:15.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.777+0000 7f956f59e700 1 -- 172.21.15.44:0/407186901 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95701512c0 con 0x7f95700b3290 2024-09-13T18:35:15.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.781+0000 7f956f59e700 1 -- 172.21.15.44:0/407186901 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f957015abe0 con 0x7f95700b3290 2024-09-13T18:35:15.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.781+0000 7f9566ffd700 1 -- 172.21.15.44:0/407186901 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f95580075e0 con 0x7f95700b3290 2024-09-13T18:35:15.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.781+0000 7f9566ffd700 1 --2- 172.21.15.44:0/407186901 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9554066730 0x7f9554068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.781+0000 7f9566ffd700 1 -- 172.21.15.44:0/407186901 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f95580837f0 con 0x7f95700b3290 2024-09-13T18:35:15.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.781+0000 7f956e59c700 1 --2- 172.21.15.44:0/407186901 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9554066730 0x7f9554068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.781+0000 7f956e59c700 1 --2- 172.21.15.44:0/407186901 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9554066730 0x7f9554068bf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f95600016e0 tx=0x7f9560009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:15.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.785+0000 7f9566ffd700 1 -- 172.21.15.44:0/407186901 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9558050af0 con 0x7f95700b3290 2024-09-13T18:35:15.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.961+0000 7f956f59e700 1 -- 172.21.15.44:0/407186901 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f957015c940 con 0x7f95700b3290 2024-09-13T18:35:15.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.961+0000 7f9566ffd700 1 -- 172.21.15.44:0/407186901 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9558054110 con 0x7f95700b3290 2024-09-13T18:35:15.970 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:35:15.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.965+0000 7f956f59e700 1 -- 172.21.15.44:0/407186901 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9554066730 msgr2=0x7f9554068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.965+0000 7f956f59e700 1 --2- 172.21.15.44:0/407186901 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9554066730 0x7f9554068bf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f95600016e0 tx=0x7f9560009040 comp rx=0 tx=0).stop 2024-09-13T18:35:15.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.965+0000 7f956f59e700 1 -- 172.21.15.44:0/407186901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95700b3290 msgr2=0x7f95701503d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.965+0000 7f956f59e700 1 --2- 172.21.15.44:0/407186901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95700b3290 0x7f95701503d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f955800c700 tx=0x7f955800cac0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.965+0000 7f956f59e700 1 -- 172.21.15.44:0/407186901 shutdown_connections 2024-09-13T18:35:15.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.965+0000 7f956f59e700 1 --2- 172.21.15.44:0/407186901 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9554066730 0x7f9554068bf0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.965+0000 7f956f59e700 1 --2- 172.21.15.44:0/407186901 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f957015a800 0x7f9570144370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.965+0000 7f956f59e700 1 --2- 172.21.15.44:0/407186901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95700b3290 0x7f95701503d0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.965+0000 7f956f59e700 1 --2- 172.21.15.44:0/407186901 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f957006f8c0 0x7f95701f05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.965+0000 7f956f59e700 1 -- 172.21.15.44:0/407186901 >> 172.21.15.44:0/407186901 conn(0x7f9570071ce0 msgr2=0x7f957015e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:15.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.965+0000 7f956f59e700 1 -- 172.21.15.44:0/407186901 shutdown_connections 2024-09-13T18:35:15.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:15.965+0000 7f956f59e700 1 -- 172.21.15.44:0/407186901 wait complete. 2024-09-13T18:35:15.986 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:35:16.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.097+0000 7fe461a64700 1 Processor -- start 2024-09-13T18:35:16.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.097+0000 7fe461a64700 1 -- start start 2024-09-13T18:35:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe461a64700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe45c06b900 0x7fe45c0b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe461a64700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe45c06a520 0x7fe45c06a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe461a64700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe45c06aeb0 con 0x7fe45c15cda0 2024-09-13T18:35:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe461a64700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe45c0b8430 con 0x7fe45c06a520 2024-09-13T18:35:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe461a64700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c06bd60 con 0x7fe45c06b900 2024-09-13T18:35:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe460a62700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe45c15cda0 0x7fe45c0ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43498/0 (socket says 172.21.15.44:43498) 2024-09-13T18:35:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe460a62700 1 -- 172.21.15.44:0/2064603462 learned_addr learned my addr 172.21.15.44:0/2064603462 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe45bfff700 1 --2- 172.21.15.44:0/2064603462 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe45c06b900 0x7fe45c0b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe461263700 1 --2- 172.21.15.44:0/2064603462 >> v2:172.21.15.99:3300/0 conn(0x7fe45c06a520 0x7fe45c06a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe45b7fe700 1 -- 172.21.15.44:0/2064603462 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1394957039 0 0) 0x7fe450001110 con 0x7fe45c15cda0 2024-09-13T18:35:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe45b7fe700 1 -- 172.21.15.44:0/2064603462 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4440035d0 con 0x7fe45c15cda0 2024-09-13T18:35:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe45bfff700 1 -- 172.21.15.44:0/2064603462 >> v2:172.21.15.99:3300/0 conn(0x7fe45c06a520 msgr2=0x7fe45c06a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe45bfff700 1 --2- 172.21.15.44:0/2064603462 >> v2:172.21.15.99:3300/0 conn(0x7fe45c06a520 0x7fe45c06a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe45bfff700 1 -- 172.21.15.44:0/2064603462 >> v1:172.21.15.44:6789/0 conn(0x7fe45c15cda0 legacy=0x7fe45c0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe45bfff700 1 -- 172.21.15.44:0/2064603462 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c0cf350 con 0x7fe45c06b900 2024-09-13T18:35:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe461263700 1 --2- 172.21.15.44:0/2064603462 >> v2:172.21.15.99:3300/0 conn(0x7fe45c06a520 0x7fe45c06a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe45bfff700 1 --2- 172.21.15.44:0/2064603462 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe45c06b900 0x7fe45c0b5de0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009850 tx=0x7fe44c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d40069477e016f1e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe45b7fe700 1 -- 172.21.15.44:0/2064603462 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c011830 con 0x7fe45c06b900 2024-09-13T18:35:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe45b7fe700 1 -- 172.21.15.44:0/2064603462 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44c011990 con 0x7fe45c06b900 2024-09-13T18:35:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe45b7fe700 1 -- 172.21.15.44:0/2064603462 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c011d40 con 0x7fe45c06b900 2024-09-13T18:35:16.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe461a64700 1 -- 172.21.15.44:0/2064603462 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe45c06b900 msgr2=0x7fe45c0b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:16.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe461a64700 1 --2- 172.21.15.44:0/2064603462 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe45c06b900 0x7fe45c0b5de0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009850 tx=0x7fe44c009b60 comp rx=0 tx=0).stop 2024-09-13T18:35:16.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe461a64700 1 -- 172.21.15.44:0/2064603462 shutdown_connections 2024-09-13T18:35:16.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe461a64700 1 --2- 172.21.15.44:0/2064603462 >> v2:172.21.15.99:3300/0 conn(0x7fe45c06a520 0x7fe45c06a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe461a64700 1 --2- 172.21.15.44:0/2064603462 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe45c06b900 0x7fe45c0b5de0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe461a64700 1 -- 172.21.15.44:0/2064603462 >> 172.21.15.44:0/2064603462 conn(0x7fe45c0d2cb0 msgr2=0x7fe45c0d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:16.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe461a64700 1 -- 172.21.15.44:0/2064603462 shutdown_connections 2024-09-13T18:35:16.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.101+0000 7fe461a64700 1 -- 172.21.15.44:0/2064603462 wait complete. 2024-09-13T18:35:16.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe461a64700 1 Processor -- start 2024-09-13T18:35:16.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe461a64700 1 -- start start 2024-09-13T18:35:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe461a64700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe45c06a520 0x7fe45c154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe461a64700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe45c06b900 0x7fe45c1521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe461a64700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe45c15cda0 0x7fe45c152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe461a64700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c152c50 con 0x7fe45c06b900 2024-09-13T18:35:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe461a64700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c1559b0 con 0x7fe45c06a520 2024-09-13T18:35:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe461a64700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c0c6880 con 0x7fe45c15cda0 2024-09-13T18:35:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe45bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe45c06b900 0x7fe45c1521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe45bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe45c06b900 0x7fe45c1521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39698/0 (socket says 172.21.15.44:39698) 2024-09-13T18:35:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe45bfff700 1 -- 172.21.15.44:0/2221449918 learned_addr learned my addr 172.21.15.44:0/2221449918 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe461263700 1 --2- 172.21.15.44:0/2221449918 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe45c15cda0 0x7fe45c152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:16.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe460a62700 1 --2- 172.21.15.44:0/2221449918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe45c06a520 0x7fe45c154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:16.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe45bfff700 1 -- 172.21.15.44:0/2221449918 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe45c15cda0 msgr2=0x7fe45c152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:16.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe45bfff700 1 --2- 172.21.15.44:0/2221449918 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe45c15cda0 0x7fe45c152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe45bfff700 1 -- 172.21.15.44:0/2221449918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe45c06a520 msgr2=0x7fe45c154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:16.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe45bfff700 1 --2- 172.21.15.44:0/2221449918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe45c06a520 0x7fe45c154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe45bfff700 1 -- 172.21.15.44:0/2221449918 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe454009a70 con 0x7fe45c06b900 2024-09-13T18:35:16.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe461263700 1 --2- 172.21.15.44:0/2221449918 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe45c15cda0 0x7fe45c152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:16.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe45bfff700 1 --2- 172.21.15.44:0/2221449918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe45c06b900 0x7fe45c1521d0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fe45c06bea0 tx=0x7fe44c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:16.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe4597fa700 1 -- 172.21.15.44:0/2221449918 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c0036c0 con 0x7fe45c06b900 2024-09-13T18:35:16.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe4597fa700 1 -- 172.21.15.44:0/2221449918 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44c01f070 con 0x7fe45c06b900 2024-09-13T18:35:16.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe461a64700 1 -- 172.21.15.44:0/2221449918 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44c0094b0 con 0x7fe45c06b900 2024-09-13T18:35:16.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe4597fa700 1 -- 172.21.15.44:0/2221449918 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c003a60 con 0x7fe45c06b900 2024-09-13T18:35:16.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe461a64700 1 -- 172.21.15.44:0/2221449918 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45c0c6dd0 con 0x7fe45c06b900 2024-09-13T18:35:16.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe461a64700 1 -- 172.21.15.44:0/2221449918 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe45c0c6ff0 con 0x7fe45c06b900 2024-09-13T18:35:16.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe4597fa700 1 -- 172.21.15.44:0/2221449918 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe44c003bc0 con 0x7fe45c06b900 2024-09-13T18:35:16.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe4597fa700 1 --2- 172.21.15.44:0/2221449918 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe448066730 0x7fe448068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:16.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe4597fa700 1 -- 172.21.15.44:0/2221449918 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe44c021070 con 0x7fe45c06b900 2024-09-13T18:35:16.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe460a62700 1 --2- 172.21.15.44:0/2221449918 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe448066730 0x7fe448068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:16.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.109+0000 7fe460a62700 1 --2- 172.21.15.44:0/2221449918 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe448066730 0x7fe448068bf0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe450005930 tx=0x7fe450009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:16.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.117+0000 7fe4597fa700 1 -- 172.21.15.44:0/2221449918 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe44c052d80 con 0x7fe45c06b900 2024-09-13T18:35:16.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.293+0000 7fe461a64700 1 -- 172.21.15.44:0/2221449918 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe45c06a970 con 0x7fe45c06b900 2024-09-13T18:35:16.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.293+0000 7fe4597fa700 1 -- 172.21.15.44:0/2221449918 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v64) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe44c0150a0 con 0x7fe45c06b900 2024-09-13T18:35:16.301 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:35:16.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.293+0000 7fe461a64700 1 -- 172.21.15.44:0/2221449918 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe448066730 msgr2=0x7fe448068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:16.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.293+0000 7fe461a64700 1 --2- 172.21.15.44:0/2221449918 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe448066730 0x7fe448068bf0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe450005930 tx=0x7fe450009040 comp rx=0 tx=0).stop 2024-09-13T18:35:16.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.293+0000 7fe461a64700 1 -- 172.21.15.44:0/2221449918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe45c06b900 msgr2=0x7fe45c1521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:16.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.293+0000 7fe461a64700 1 --2- 172.21.15.44:0/2221449918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe45c06b900 0x7fe45c1521d0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fe45c06bea0 tx=0x7fe44c004770 comp rx=0 tx=0).stop 2024-09-13T18:35:16.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.293+0000 7fe461a64700 1 -- 172.21.15.44:0/2221449918 shutdown_connections 2024-09-13T18:35:16.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.293+0000 7fe461a64700 1 --2- 172.21.15.44:0/2221449918 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe448066730 0x7fe448068bf0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.293+0000 7fe461a64700 1 --2- 172.21.15.44:0/2221449918 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe45c15cda0 0x7fe45c152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.293+0000 7fe461a64700 1 --2- 172.21.15.44:0/2221449918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe45c06b900 0x7fe45c1521d0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.293+0000 7fe461a64700 1 --2- 172.21.15.44:0/2221449918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe45c06a520 0x7fe45c154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.293+0000 7fe461a64700 1 -- 172.21.15.44:0/2221449918 >> 172.21.15.44:0/2221449918 conn(0x7fe45c0d2cb0 msgr2=0x7fe45c06b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:16.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.293+0000 7fe461a64700 1 -- 172.21.15.44:0/2221449918 shutdown_connections 2024-09-13T18:35:16.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.293+0000 7fe461a64700 1 -- 172.21.15.44:0/2221449918 wait complete. 2024-09-13T18:35:16.317 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:35:16.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb223007700 1 Processor -- start 2024-09-13T18:35:16.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb223007700 1 -- start start 2024-09-13T18:35:16.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb223007700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb21c15cda0 0x7fb21c06b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:16.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb223007700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb21c06a520 0x7fb21c06a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:16.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb223007700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb21c06aeb0 con 0x7fb21c0ceb70 2024-09-13T18:35:16.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb223007700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb21c06be40 con 0x7fb21c06a520 2024-09-13T18:35:16.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb223007700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c0b64f0 con 0x7fb21c15cda0 2024-09-13T18:35:16.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb222806700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb21c06a520 0x7fb21c06a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:16.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb221804700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb21c0ceb70 0x7fb21c0b5de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43508/0 (socket says 172.21.15.44:43508) 2024-09-13T18:35:16.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb222806700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb21c06a520 0x7fb21c06a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39710/0 (socket says 172.21.15.44:39710) 2024-09-13T18:35:16.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb221804700 1 -- 172.21.15.44:0/554936001 learned_addr learned my addr 172.21.15.44:0/554936001 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:16.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb222005700 1 --2- 172.21.15.44:0/554936001 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb21c15cda0 0x7fb21c06b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:16.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb222806700 1 -- 172.21.15.44:0/554936001 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb21c15cda0 msgr2=0x7fb21c06b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:16.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb222806700 1 --2- 172.21.15.44:0/554936001 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb21c15cda0 0x7fb21c06b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb222806700 1 -- 172.21.15.44:0/554936001 >> v1:172.21.15.44:6789/0 conn(0x7fb21c0ceb70 legacy=0x7fb21c0b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:16.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb222806700 1 -- 172.21.15.44:0/554936001 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21c0b8430 con 0x7fb21c06a520 2024-09-13T18:35:16.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb222005700 1 --2- 172.21.15.44:0/554936001 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb21c15cda0 0x7fb21c06b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:16.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb222806700 1 --2- 172.21.15.44:0/554936001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb21c06a520 0x7fb21c06a970 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fb214009d90 tx=0x7fb21400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9586cd40b401fcb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:16.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb221003700 1 -- 172.21.15.44:0/554936001 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21400e070 con 0x7fb21c06a520 2024-09-13T18:35:16.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb221003700 1 -- 172.21.15.44:0/554936001 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21400bbd0 con 0x7fb21c06a520 2024-09-13T18:35:16.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb221003700 1 -- 172.21.15.44:0/554936001 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb214012430 con 0x7fb21c06a520 2024-09-13T18:35:16.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb223007700 1 -- 172.21.15.44:0/554936001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb21c06a520 msgr2=0x7fb21c06a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:16.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb223007700 1 --2- 172.21.15.44:0/554936001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb21c06a520 0x7fb21c06a970 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fb214009d90 tx=0x7fb21400b330 comp rx=0 tx=0).stop 2024-09-13T18:35:16.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb223007700 1 -- 172.21.15.44:0/554936001 shutdown_connections 2024-09-13T18:35:16.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb223007700 1 --2- 172.21.15.44:0/554936001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb21c06a520 0x7fb21c06a970 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb223007700 1 --2- 172.21.15.44:0/554936001 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb21c15cda0 0x7fb21c06b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb223007700 1 -- 172.21.15.44:0/554936001 >> 172.21.15.44:0/554936001 conn(0x7fb21c0d2cb0 msgr2=0x7fb21c0d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:16.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb223007700 1 -- 172.21.15.44:0/554936001 shutdown_connections 2024-09-13T18:35:16.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.429+0000 7fb223007700 1 -- 172.21.15.44:0/554936001 wait complete. 2024-09-13T18:35:16.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb223007700 1 Processor -- start 2024-09-13T18:35:16.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb223007700 1 -- start start 2024-09-13T18:35:16.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb223007700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb21c06a520 0x7fb21c0ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:16.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb223007700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb21c0ceb70 0x7fb21c15d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:16.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb223007700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb21c15cda0 0x7fb21c15dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:16.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb223007700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c0ca6e0 con 0x7fb21c0ceb70 2024-09-13T18:35:16.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb223007700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c15f540 con 0x7fb21c15cda0 2024-09-13T18:35:16.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb223007700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c15f820 con 0x7fb21c06a520 2024-09-13T18:35:16.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb221804700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb21c0ceb70 0x7fb21c15d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:16.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb221804700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb21c0ceb70 0x7fb21c15d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39720/0 (socket says 172.21.15.44:39720) 2024-09-13T18:35:16.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb221804700 1 -- 172.21.15.44:0/643378260 learned_addr learned my addr 172.21.15.44:0/643378260 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:16.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb222005700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb21c06a520 0x7fb21c0ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:16.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb222806700 1 --2- 172.21.15.44:0/643378260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb21c15cda0 0x7fb21c15dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:16.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb221804700 1 -- 172.21.15.44:0/643378260 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb21c06a520 msgr2=0x7fb21c0ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:16.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb221804700 1 --2- 172.21.15.44:0/643378260 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb21c06a520 0x7fb21c0ca1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb221804700 1 -- 172.21.15.44:0/643378260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb21c15cda0 msgr2=0x7fb21c15dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:16.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb221804700 1 --2- 172.21.15.44:0/643378260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb21c15cda0 0x7fb21c15dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb221804700 1 -- 172.21.15.44:0/643378260 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb214009a70 con 0x7fb21c0ceb70 2024-09-13T18:35:16.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb221804700 1 --2- 172.21.15.44:0/643378260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb21c0ceb70 0x7fb21c15d210 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fb21800c520 tx=0x7fb21800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:16.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb212ffd700 1 -- 172.21.15.44:0/643378260 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218005d90 con 0x7fb21c0ceb70 2024-09-13T18:35:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb212ffd700 1 -- 172.21.15.44:0/643378260 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2180070d0 con 0x7fb21c0ceb70 2024-09-13T18:35:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb223007700 1 -- 172.21.15.44:0/643378260 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb21c0c7f60 con 0x7fb21c0ceb70 2024-09-13T18:35:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb212ffd700 1 -- 172.21.15.44:0/643378260 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218007440 con 0x7fb21c0ceb70 2024-09-13T18:35:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.433+0000 7fb223007700 1 -- 172.21.15.44:0/643378260 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb21c15d750 con 0x7fb21c0ceb70 2024-09-13T18:35:16.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.437+0000 7fb223007700 1 -- 172.21.15.44:0/643378260 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb21c0c7dc0 con 0x7fb21c0ceb70 2024-09-13T18:35:16.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.437+0000 7fb212ffd700 1 -- 172.21.15.44:0/643378260 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb2180075a0 con 0x7fb21c0ceb70 2024-09-13T18:35:16.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.437+0000 7fb212ffd700 1 --2- 172.21.15.44:0/643378260 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb200066730 0x7fb200068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:16.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.437+0000 7fb212ffd700 1 -- 172.21.15.44:0/643378260 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb218083250 con 0x7fb21c0ceb70 2024-09-13T18:35:16.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.437+0000 7fb222005700 1 --2- 172.21.15.44:0/643378260 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb200066730 0x7fb200068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:16.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.441+0000 7fb222005700 1 --2- 172.21.15.44:0/643378260 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb200066730 0x7fb200068bf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb20c006fd0 tx=0x7fb20c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:16.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.449+0000 7fb212ffd700 1 -- 172.21.15.44:0/643378260 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb21c0c7dc0 con 0x7fb21c0ceb70 2024-09-13T18:35:16.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.617+0000 7fb223007700 1 -- 172.21.15.44:0/643378260 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb21c0c8760 con 0x7fb21c0ceb70 2024-09-13T18:35:16.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.617+0000 7fb212ffd700 1 -- 172.21.15.44:0/643378260 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v64) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb21c0c8760 con 0x7fb21c0ceb70 2024-09-13T18:35:16.626 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:35:16.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.617+0000 7fb223007700 1 -- 172.21.15.44:0/643378260 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb200066730 msgr2=0x7fb200068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:16.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.617+0000 7fb223007700 1 --2- 172.21.15.44:0/643378260 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb200066730 0x7fb200068bf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb20c006fd0 tx=0x7fb20c008040 comp rx=0 tx=0).stop 2024-09-13T18:35:16.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.617+0000 7fb223007700 1 -- 172.21.15.44:0/643378260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb21c0ceb70 msgr2=0x7fb21c15d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:16.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.617+0000 7fb223007700 1 --2- 172.21.15.44:0/643378260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb21c0ceb70 0x7fb21c15d210 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fb21800c520 tx=0x7fb21800c830 comp rx=0 tx=0).stop 2024-09-13T18:35:16.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.617+0000 7fb223007700 1 -- 172.21.15.44:0/643378260 shutdown_connections 2024-09-13T18:35:16.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.617+0000 7fb223007700 1 --2- 172.21.15.44:0/643378260 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb200066730 0x7fb200068bf0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.617+0000 7fb223007700 1 --2- 172.21.15.44:0/643378260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb21c15cda0 0x7fb21c15dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.617+0000 7fb223007700 1 --2- 172.21.15.44:0/643378260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb21c0ceb70 0x7fb21c15d210 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.617+0000 7fb223007700 1 --2- 172.21.15.44:0/643378260 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb21c06a520 0x7fb21c0ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.617+0000 7fb223007700 1 -- 172.21.15.44:0/643378260 >> 172.21.15.44:0/643378260 conn(0x7fb21c0d2cb0 msgr2=0x7fb21c0b5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:16.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.621+0000 7fb223007700 1 -- 172.21.15.44:0/643378260 shutdown_connections 2024-09-13T18:35:16.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.621+0000 7fb223007700 1 -- 172.21.15.44:0/643378260 wait complete. 2024-09-13T18:35:16.642 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:35:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.753+0000 7ff56d7f1700 1 Processor -- start 2024-09-13T18:35:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.753+0000 7ff56d7f1700 1 -- start start 2024-09-13T18:35:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.753+0000 7ff56d7f1700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff56815cda0 0x7ff56806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.753+0000 7ff56d7f1700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff56806a520 0x7ff56806a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.753+0000 7ff56d7f1700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5680b8430 con 0x7ff5680ceb70 2024-09-13T18:35:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.753+0000 7ff56d7f1700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56806be40 con 0x7ff56806a520 2024-09-13T18:35:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.753+0000 7ff56d7f1700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5680b64f0 con 0x7ff56815cda0 2024-09-13T18:35:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.757+0000 7ff56cff0700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff56806a520 0x7ff56806a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.757+0000 7ff5677fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff5680ceb70 0x7ff5680b5de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43516/0 (socket says 172.21.15.44:43516) 2024-09-13T18:35:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.757+0000 7ff5677fe700 1 -- 172.21.15.44:0/329597804 learned_addr learned my addr 172.21.15.44:0/329597804 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:16.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.757+0000 7ff567fff700 1 --2- 172.21.15.44:0/329597804 >> v2:172.21.15.99:3300/0 conn(0x7ff56815cda0 0x7ff56806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.757+0000 7ff56cff0700 1 -- 172.21.15.44:0/329597804 >> v2:172.21.15.99:3300/0 conn(0x7ff56815cda0 msgr2=0x7ff56806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.757+0000 7ff56cff0700 1 --2- 172.21.15.44:0/329597804 >> v2:172.21.15.99:3300/0 conn(0x7ff56815cda0 0x7ff56806b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.757+0000 7ff56cff0700 1 -- 172.21.15.44:0/329597804 >> v1:172.21.15.44:6789/0 conn(0x7ff5680ceb70 legacy=0x7ff5680b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.757+0000 7ff56cff0700 1 -- 172.21.15.44:0/329597804 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56806ae70 con 0x7ff56806a520 2024-09-13T18:35:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.757+0000 7ff56cff0700 1 --2- 172.21.15.44:0/329597804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff56806a520 0x7ff56806a930 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7ff5680d0800 tx=0x7ff560009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56145b814ce0604 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.757+0000 7ff566ffd700 1 -- 172.21.15.44:0/329597804 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff560011830 con 0x7ff56806a520 2024-09-13T18:35:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.757+0000 7ff566ffd700 1 -- 172.21.15.44:0/329597804 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff560011990 con 0x7ff56806a520 2024-09-13T18:35:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.757+0000 7ff566ffd700 1 -- 172.21.15.44:0/329597804 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff560011d40 con 0x7ff56806a520 2024-09-13T18:35:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.757+0000 7ff56d7f1700 1 -- 172.21.15.44:0/329597804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff56806a520 msgr2=0x7ff56806a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.757+0000 7ff56d7f1700 1 --2- 172.21.15.44:0/329597804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff56806a520 0x7ff56806a930 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7ff5680d0800 tx=0x7ff560009b30 comp rx=0 tx=0).stop 2024-09-13T18:35:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.757+0000 7ff56d7f1700 1 -- 172.21.15.44:0/329597804 shutdown_connections 2024-09-13T18:35:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.757+0000 7ff56d7f1700 1 --2- 172.21.15.44:0/329597804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff56806a520 0x7ff56806a930 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.757+0000 7ff56d7f1700 1 --2- 172.21.15.44:0/329597804 >> v2:172.21.15.99:3300/0 conn(0x7ff56815cda0 0x7ff56806b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.757+0000 7ff56d7f1700 1 -- 172.21.15.44:0/329597804 >> 172.21.15.44:0/329597804 conn(0x7ff5680d2cb0 msgr2=0x7ff5680d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:16.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.757+0000 7ff56d7f1700 1 -- 172.21.15.44:0/329597804 shutdown_connections 2024-09-13T18:35:16.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.757+0000 7ff56d7f1700 1 -- 172.21.15.44:0/329597804 wait complete. 2024-09-13T18:35:16.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.757+0000 7ff56d7f1700 1 Processor -- start 2024-09-13T18:35:16.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.757+0000 7ff56d7f1700 1 -- start start 2024-09-13T18:35:16.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff56d7f1700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff56806a520 0x7ff5680c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:16.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff56d7f1700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5680ceb70 0x7ff568160700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:16.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff56d7f1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff56815cda0 0x7ff5681566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:16.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff56d7f1700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5681f5b60 con 0x7ff56815cda0 2024-09-13T18:35:16.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff56d7f1700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5681f5db0 con 0x7ff5680ceb70 2024-09-13T18:35:16.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff56d7f1700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5681f6090 con 0x7ff56806a520 2024-09-13T18:35:16.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff56cff0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff56815cda0 0x7ff5681566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:16.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff56cff0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff56815cda0 0x7ff5681566c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39732/0 (socket says 172.21.15.44:39732) 2024-09-13T18:35:16.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff56cff0700 1 -- 172.21.15.44:0/1233808540 learned_addr learned my addr 172.21.15.44:0/1233808540 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:16.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff5677fe700 1 --2- 172.21.15.44:0/1233808540 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5680ceb70 0x7ff568160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:16.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff567fff700 1 --2- 172.21.15.44:0/1233808540 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff56806a520 0x7ff5680c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:16.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff56cff0700 1 -- 172.21.15.44:0/1233808540 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff56806a520 msgr2=0x7ff5680c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:16.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff56cff0700 1 --2- 172.21.15.44:0/1233808540 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff56806a520 0x7ff5680c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff56cff0700 1 -- 172.21.15.44:0/1233808540 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5680ceb70 msgr2=0x7ff568160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:16.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff56cff0700 1 --2- 172.21.15.44:0/1233808540 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5680ceb70 0x7ff568160700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff56cff0700 1 -- 172.21.15.44:0/1233808540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5600094b0 con 0x7ff56815cda0 2024-09-13T18:35:16.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff567fff700 1 --2- 172.21.15.44:0/1233808540 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff56806a520 0x7ff5680c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:16.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff5677fe700 1 --2- 172.21.15.44:0/1233808540 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5680ceb70 0x7ff568160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:16.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff56cff0700 1 --2- 172.21.15.44:0/1233808540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff56815cda0 0x7ff5681566c0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7ff5600097a0 tx=0x7ff560004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:16.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff564ff9700 1 -- 172.21.15.44:0/1233808540 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff560004570 con 0x7ff56815cda0 2024-09-13T18:35:16.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff564ff9700 1 -- 172.21.15.44:0/1233808540 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56001f070 con 0x7ff56815cda0 2024-09-13T18:35:16.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff56d7f1700 1 -- 172.21.15.44:0/1233808540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5681f6370 con 0x7ff56815cda0 2024-09-13T18:35:16.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff564ff9700 1 -- 172.21.15.44:0/1233808540 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5600038e0 con 0x7ff56815cda0 2024-09-13T18:35:16.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff56d7f1700 1 -- 172.21.15.44:0/1233808540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5681f69c0 con 0x7ff56815cda0 2024-09-13T18:35:16.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.761+0000 7ff56d7f1700 1 -- 172.21.15.44:0/1233808540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5680d1120 con 0x7ff56815cda0 2024-09-13T18:35:16.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.765+0000 7ff564ff9700 1 -- 172.21.15.44:0/1233808540 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff560021030 con 0x7ff56815cda0 2024-09-13T18:35:16.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.765+0000 7ff564ff9700 1 --2- 172.21.15.44:0/1233808540 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff54c066730 0x7ff54c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:16.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.765+0000 7ff564ff9700 1 -- 172.21.15.44:0/1233808540 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff5600855a0 con 0x7ff56815cda0 2024-09-13T18:35:16.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.765+0000 7ff567fff700 1 --2- 172.21.15.44:0/1233808540 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff54c066730 0x7ff54c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:16.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.765+0000 7ff567fff700 1 --2- 172.21.15.44:0/1233808540 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff54c066730 0x7ff54c068bf0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff56815c1a0 tx=0x7ff558003aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:16.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.773+0000 7ff564ff9700 1 -- 172.21.15.44:0/1233808540 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff560052940 con 0x7ff56815cda0 2024-09-13T18:35:16.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.961+0000 7ff56d7f1700 1 -- 172.21.15.44:0/1233808540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff56815b280 con 0x7ff56815cda0 2024-09-13T18:35:16.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.961+0000 7ff564ff9700 1 -- 172.21.15.44:0/1233808540 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v64) v1 ==== 80+0+122 (secure 0 0 0) 0x7ff560055f60 con 0x7ff56815cda0 2024-09-13T18:35:16.968 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/1608555972 2024-09-14T18:34:13.117246+0000 2024-09-13T18:35:16.968 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/1608555972 2024-09-14T18:34:13.117246+0000 2024-09-13T18:35:16.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.965+0000 7ff56d7f1700 1 -- 172.21.15.44:0/1233808540 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff54c066730 msgr2=0x7ff54c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:16.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.965+0000 7ff56d7f1700 1 --2- 172.21.15.44:0/1233808540 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff54c066730 0x7ff54c068bf0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff56815c1a0 tx=0x7ff558003aa0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.965+0000 7ff56d7f1700 1 -- 172.21.15.44:0/1233808540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff56815cda0 msgr2=0x7ff5681566c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:16.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.965+0000 7ff56d7f1700 1 --2- 172.21.15.44:0/1233808540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff56815cda0 0x7ff5681566c0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7ff5600097a0 tx=0x7ff560004770 comp rx=0 tx=0).stop 2024-09-13T18:35:16.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.965+0000 7ff56d7f1700 1 -- 172.21.15.44:0/1233808540 shutdown_connections 2024-09-13T18:35:16.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.965+0000 7ff56d7f1700 1 --2- 172.21.15.44:0/1233808540 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff54c066730 0x7ff54c068bf0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.965+0000 7ff56d7f1700 1 --2- 172.21.15.44:0/1233808540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff56815cda0 0x7ff5681566c0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.965+0000 7ff56d7f1700 1 --2- 172.21.15.44:0/1233808540 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5680ceb70 0x7ff568160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.965+0000 7ff56d7f1700 1 --2- 172.21.15.44:0/1233808540 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff56806a520 0x7ff5680c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.965+0000 7ff56d7f1700 1 -- 172.21.15.44:0/1233808540 >> 172.21.15.44:0/1233808540 conn(0x7ff5680d2cb0 msgr2=0x7ff5680d1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:16.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.965+0000 7ff56d7f1700 1 -- 172.21.15.44:0/1233808540 shutdown_connections 2024-09-13T18:35:16.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:16.965+0000 7ff56d7f1700 1 -- 172.21.15.44:0/1233808540 wait complete. 2024-09-13T18:35:16.972 INFO:teuthology.orchestra.run.smithi044.stderr:listed 2 entries 2024-09-13T18:35:16.984 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2024-09-13T18:35:16.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:16.984 DEBUG:teuthology.orchestra.run.smithi044:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:35:17.006 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:35:17.007 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:35:17.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:17.007 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:35:17.060 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:35:17.061 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-13T18:35:17.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.185+0000 7f56e1f60700 1 Processor -- start 2024-09-13T18:35:17.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.185+0000 7f56e1f60700 1 -- start start 2024-09-13T18:35:17.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56e1f60700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56dc159760 0x7f56dc0b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56e1f60700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f56dc06d4e0 0x7f56dc072120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56e1f60700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56dc072660 con 0x7f56dc070bf0 2024-09-13T18:35:17.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56e1f60700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56dc071d00 con 0x7f56dc06d4e0 2024-09-13T18:35:17.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56e1f60700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc071080 con 0x7f56dc159760 2024-09-13T18:35:17.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56e175f700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f56dc06d4e0 0x7f56dc072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56e175f700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f56dc06d4e0 0x7f56dc072120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39742/0 (socket says 172.21.15.44:39742) 2024-09-13T18:35:17.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56e175f700 1 -- 172.21.15.44:0/3024920632 learned_addr learned my addr 172.21.15.44:0/3024920632 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:17.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56e0f5e700 1 --2- 172.21.15.44:0/3024920632 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56dc159760 0x7f56dc0b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56e175f700 1 -- 172.21.15.44:0/3024920632 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56dc159760 msgr2=0x7f56dc0b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:17.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56e175f700 1 --2- 172.21.15.44:0/3024920632 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56dc159760 0x7f56dc0b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56e175f700 1 -- 172.21.15.44:0/3024920632 >> v1:172.21.15.99:6789/0 conn(0x7f56dc070bf0 legacy=0x7f56dc06cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:17.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56e175f700 1 -- 172.21.15.44:0/3024920632 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56dc071360 con 0x7f56dc06d4e0 2024-09-13T18:35:17.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56e175f700 1 --2- 172.21.15.44:0/3024920632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56dc06d4e0 0x7f56dc072120 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009e50 tx=0x7f56d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02c1a125e1a7748 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:17.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56db7fe700 1 -- 172.21.15.44:0/3024920632 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d400e070 con 0x7f56dc06d4e0 2024-09-13T18:35:17.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56db7fe700 1 -- 172.21.15.44:0/3024920632 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d400b910 con 0x7f56dc06d4e0 2024-09-13T18:35:17.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56db7fe700 1 -- 172.21.15.44:0/3024920632 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d400bcc0 con 0x7f56dc06d4e0 2024-09-13T18:35:17.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56e1f60700 1 -- 172.21.15.44:0/3024920632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56dc06d4e0 msgr2=0x7f56dc072120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:17.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56e1f60700 1 --2- 172.21.15.44:0/3024920632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56dc06d4e0 0x7f56dc072120 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009e50 tx=0x7f56d400b330 comp rx=0 tx=0).stop 2024-09-13T18:35:17.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56e1f60700 1 -- 172.21.15.44:0/3024920632 shutdown_connections 2024-09-13T18:35:17.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56e1f60700 1 --2- 172.21.15.44:0/3024920632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56dc06d4e0 0x7f56dc072120 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56e1f60700 1 --2- 172.21.15.44:0/3024920632 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56dc159760 0x7f56dc0b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56e1f60700 1 -- 172.21.15.44:0/3024920632 >> 172.21.15.44:0/3024920632 conn(0x7f56dc0b1810 msgr2=0x7f56dc0b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:17.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56e1f60700 1 -- 172.21.15.44:0/3024920632 shutdown_connections 2024-09-13T18:35:17.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.189+0000 7f56e1f60700 1 -- 172.21.15.44:0/3024920632 wait complete. 2024-09-13T18:35:17.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.193+0000 7f56e1f60700 1 Processor -- start 2024-09-13T18:35:17.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.193+0000 7f56e1f60700 1 -- start start 2024-09-13T18:35:17.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.197+0000 7f56e1f60700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56dc06d4e0 0x7f56dc15bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.197+0000 7f56e1f60700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56dc159760 0x7f56dc150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.197+0000 7f56e1f60700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56dc0ae320 0x7f56dc150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.197+0000 7f56e1f60700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc1f2bc0 con 0x7f56dc06d4e0 2024-09-13T18:35:17.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.197+0000 7f56e1f60700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc15c6a0 con 0x7f56dc159760 2024-09-13T18:35:17.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.197+0000 7f56e1f60700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc1f2500 con 0x7f56dc0ae320 2024-09-13T18:35:17.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.197+0000 7f56e0f5e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56dc06d4e0 0x7f56dc15bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.197+0000 7f56e0f5e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56dc06d4e0 0x7f56dc15bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39750/0 (socket says 172.21.15.44:39750) 2024-09-13T18:35:17.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.197+0000 7f56e0f5e700 1 -- 172.21.15.44:0/955855704 learned_addr learned my addr 172.21.15.44:0/955855704 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:17.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.197+0000 7f56dbfff700 1 --2- 172.21.15.44:0/955855704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56dc159760 0x7f56dc150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.197+0000 7f56e175f700 1 --2- 172.21.15.44:0/955855704 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56dc0ae320 0x7f56dc150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.197+0000 7f56e0f5e700 1 -- 172.21.15.44:0/955855704 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56dc0ae320 msgr2=0x7f56dc150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:17.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.197+0000 7f56e0f5e700 1 --2- 172.21.15.44:0/955855704 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56dc0ae320 0x7f56dc150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.197+0000 7f56e0f5e700 1 -- 172.21.15.44:0/955855704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56dc159760 msgr2=0x7f56dc150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:17.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.197+0000 7f56e0f5e700 1 --2- 172.21.15.44:0/955855704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56dc159760 0x7f56dc150630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.197+0000 7f56e0f5e700 1 -- 172.21.15.44:0/955855704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d4009b30 con 0x7f56dc06d4e0 2024-09-13T18:35:17.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.197+0000 7f56e0f5e700 1 --2- 172.21.15.44:0/955855704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56dc06d4e0 0x7f56dc15bdc0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f56d000e840 tx=0x7f56d000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:17.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.197+0000 7f56d97fa700 1 -- 172.21.15.44:0/955855704 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d00095a0 con 0x7f56dc06d4e0 2024-09-13T18:35:17.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.197+0000 7f56d97fa700 1 -- 172.21.15.44:0/955855704 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d0013680 con 0x7f56dc06d4e0 2024-09-13T18:35:17.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.197+0000 7f56e1f60700 1 -- 172.21.15.44:0/955855704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56dc1f27e0 con 0x7f56dc06d4e0 2024-09-13T18:35:17.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.197+0000 7f56d97fa700 1 -- 172.21.15.44:0/955855704 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d00139f0 con 0x7f56dc06d4e0 2024-09-13T18:35:17.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.197+0000 7f56e1f60700 1 -- 172.21.15.44:0/955855704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56dc150b70 con 0x7f56dc06d4e0 2024-09-13T18:35:17.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.201+0000 7f56e1f60700 1 -- 172.21.15.44:0/955855704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56dc159c60 con 0x7f56dc06d4e0 2024-09-13T18:35:17.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.201+0000 7f56d97fa700 1 -- 172.21.15.44:0/955855704 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f56d0013b50 con 0x7f56dc06d4e0 2024-09-13T18:35:17.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.201+0000 7f56d97fa700 1 --2- 172.21.15.44:0/955855704 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f56c0066730 0x7f56c0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.201+0000 7f56d97fa700 1 -- 172.21.15.44:0/955855704 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f56d0083fc0 con 0x7f56dc06d4e0 2024-09-13T18:35:17.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.201+0000 7f56dbfff700 1 --2- 172.21.15.44:0/955855704 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f56c0066730 0x7f56c0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.201+0000 7f56dbfff700 1 --2- 172.21.15.44:0/955855704 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f56c0066730 0x7f56c0068bf0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f56dc0b09e0 tx=0x7f56c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:17.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.205+0000 7f56d97fa700 1 -- 172.21.15.44:0/955855704 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f56d00b5db0 con 0x7f56dc06d4e0 2024-09-13T18:35:17.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:17.417+0000 7f56e1f60700 1 -- 172.21.15.44:0/955855704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f56dc0ad690 con 0x7f56dc06d4e0 2024-09-13T18:35:18.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.153+0000 7f56d97fa700 1 -- 172.21.15.44:0/955855704 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v53) v1 ==== 162+0+0 (secure 0 0 0) 0x7f56d0051360 con 0x7f56dc06d4e0 2024-09-13T18:35:18.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.161+0000 7f56e1f60700 1 -- 172.21.15.44:0/955855704 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f56c0066730 msgr2=0x7f56c0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:18.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.161+0000 7f56e1f60700 1 --2- 172.21.15.44:0/955855704 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f56c0066730 0x7f56c0068bf0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f56dc0b09e0 tx=0x7f56c8009040 comp rx=0 tx=0).stop 2024-09-13T18:35:18.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.161+0000 7f56e1f60700 1 -- 172.21.15.44:0/955855704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56dc06d4e0 msgr2=0x7f56dc15bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:18.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.161+0000 7f56e1f60700 1 --2- 172.21.15.44:0/955855704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56dc06d4e0 0x7f56dc15bdc0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f56d000e840 tx=0x7f56d000eb50 comp rx=0 tx=0).stop 2024-09-13T18:35:18.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.161+0000 7f56e1f60700 1 -- 172.21.15.44:0/955855704 shutdown_connections 2024-09-13T18:35:18.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.161+0000 7f56e1f60700 1 --2- 172.21.15.44:0/955855704 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f56c0066730 0x7f56c0068bf0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.161+0000 7f56e1f60700 1 --2- 172.21.15.44:0/955855704 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f56dc0ae320 0x7f56dc150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.161+0000 7f56e1f60700 1 --2- 172.21.15.44:0/955855704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56dc159760 0x7f56dc150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.161+0000 7f56e1f60700 1 --2- 172.21.15.44:0/955855704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56dc06d4e0 0x7f56dc15bdc0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.161+0000 7f56e1f60700 1 -- 172.21.15.44:0/955855704 >> 172.21.15.44:0/955855704 conn(0x7f56dc0b1810 msgr2=0x7f56dc0ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:18.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.161+0000 7f56e1f60700 1 -- 172.21.15.44:0/955855704 shutdown_connections 2024-09-13T18:35:18.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.161+0000 7f56e1f60700 1 -- 172.21.15.44:0/955855704 wait complete. 2024-09-13T18:35:18.168 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-13T18:35:18.169 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-09-13T18:35:18.165+0000 7ff39ba52700 -1 mds.1.sessionmap _load_finish got (2) No such file or directory 2024-09-13T18:35:18.169 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-09-13T18:35:18.165+0000 7ff39ba52700 -1 log_channel(cluster) log [ERR] : error reading sessionmap 'mds1_sessionmap' -2 ((2) No such file or directory) 2024-09-13T18:35:18.170 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-13T18:35:18.165+0000 7fc22bbc2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2024-09-13T18:35:18.186 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:35:18.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.285+0000 7fde7e025700 1 Processor -- start 2024-09-13T18:35:18.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.285+0000 7fde7e025700 1 -- start start 2024-09-13T18:35:18.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.289+0000 7fde7e025700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fde7815cec0 0x7fde780cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:18.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.289+0000 7fde7e025700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fde7806b310 0x7fde780d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:18.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.289+0000 7fde7e025700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde780d21e0 con 0x7fde7815cae0 2024-09-13T18:35:18.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.289+0000 7fde7e025700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde780d1750 con 0x7fde7806b310 2024-09-13T18:35:18.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.289+0000 7fde7e025700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde780d1940 con 0x7fde7815cec0 2024-09-13T18:35:18.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.289+0000 7fde7d023700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fde7815cae0 0x7fde7806ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43518/0 (socket says 172.21.15.44:43518) 2024-09-13T18:35:18.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.289+0000 7fde7d824700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fde7806b310 0x7fde780d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:18.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.289+0000 7fde7d023700 1 -- 172.21.15.44:0/2490064263 learned_addr learned my addr 172.21.15.44:0/2490064263 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:18.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.289+0000 7fde7c822700 1 --2- 172.21.15.44:0/2490064263 >> v2:172.21.15.99:3300/0 conn(0x7fde7815cec0 0x7fde780cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:18.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.289+0000 7fde6ffff700 1 -- 172.21.15.44:0/2490064263 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202596080 0 0) 0x7fde780d21e0 con 0x7fde7815cae0 2024-09-13T18:35:18.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.289+0000 7fde6ffff700 1 -- 172.21.15.44:0/2490064263 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde640035d0 con 0x7fde7815cae0 2024-09-13T18:35:18.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.289+0000 7fde6ffff700 1 -- 172.21.15.44:0/2490064263 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 797568474 0 0) 0x7fde640035d0 con 0x7fde7815cae0 2024-09-13T18:35:18.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.289+0000 7fde7d824700 1 -- 172.21.15.44:0/2490064263 >> v2:172.21.15.99:3300/0 conn(0x7fde7815cec0 msgr2=0x7fde780cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:18.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.289+0000 7fde7d824700 1 --2- 172.21.15.44:0/2490064263 >> v2:172.21.15.99:3300/0 conn(0x7fde7815cec0 0x7fde780cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.289+0000 7fde7d824700 1 -- 172.21.15.44:0/2490064263 >> v1:172.21.15.44:6789/0 conn(0x7fde7815cae0 legacy=0x7fde7806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:18.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.289+0000 7fde7d824700 1 -- 172.21.15.44:0/2490064263 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde780d1c20 con 0x7fde7806b310 2024-09-13T18:35:18.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.289+0000 7fde7d824700 1 --2- 172.21.15.44:0/2490064263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde7806b310 0x7fde780d1210 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fde70009d90 tx=0x7fde7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41857792bcc5d1a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:18.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.289+0000 7fde6ffff700 1 -- 172.21.15.44:0/2490064263 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000e070 con 0x7fde7806b310 2024-09-13T18:35:18.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.289+0000 7fde6ffff700 1 -- 172.21.15.44:0/2490064263 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde70003a40 con 0x7fde7806b310 2024-09-13T18:35:18.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.289+0000 7fde6ffff700 1 -- 172.21.15.44:0/2490064263 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74001670 con 0x7fde7806b310 2024-09-13T18:35:18.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.289+0000 7fde7e025700 1 -- 172.21.15.44:0/2490064263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde7806b310 msgr2=0x7fde780d1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:18.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.289+0000 7fde7e025700 1 --2- 172.21.15.44:0/2490064263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde7806b310 0x7fde780d1210 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fde70009d90 tx=0x7fde7000b330 comp rx=0 tx=0).stop 2024-09-13T18:35:18.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.293+0000 7fde7e025700 1 -- 172.21.15.44:0/2490064263 shutdown_connections 2024-09-13T18:35:18.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.293+0000 7fde7e025700 1 --2- 172.21.15.44:0/2490064263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde7806b310 0x7fde780d1210 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.293+0000 7fde7e025700 1 --2- 172.21.15.44:0/2490064263 >> v2:172.21.15.99:3300/0 conn(0x7fde7815cec0 0x7fde780cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.293+0000 7fde7e025700 1 -- 172.21.15.44:0/2490064263 >> 172.21.15.44:0/2490064263 conn(0x7fde780d2c80 msgr2=0x7fde780d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:18.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.293+0000 7fde7e025700 1 -- 172.21.15.44:0/2490064263 shutdown_connections 2024-09-13T18:35:18.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.293+0000 7fde7e025700 1 -- 172.21.15.44:0/2490064263 wait complete. 2024-09-13T18:35:18.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.293+0000 7fde7e025700 1 Processor -- start 2024-09-13T18:35:18.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.293+0000 7fde7e025700 1 -- start start 2024-09-13T18:35:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.297+0000 7fde7e025700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde7806b310 0x7fde780b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.297+0000 7fde7e025700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fde7815cae0 0x7fde780b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.297+0000 7fde7e025700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde7815cec0 0x7fde780a95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.297+0000 7fde7e025700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde781f24e0 con 0x7fde7815cec0 2024-09-13T18:35:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.297+0000 7fde7e025700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7815eed0 con 0x7fde7806b310 2024-09-13T18:35:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.297+0000 7fde7e025700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7815f1b0 con 0x7fde7815cae0 2024-09-13T18:35:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.297+0000 7fde7d824700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde7815cec0 0x7fde780a95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.297+0000 7fde7d824700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde7815cec0 0x7fde780a95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39764/0 (socket says 172.21.15.44:39764) 2024-09-13T18:35:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.297+0000 7fde7d824700 1 -- 172.21.15.44:0/4227636183 learned_addr learned my addr 172.21.15.44:0/4227636183 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.297+0000 7fde7c822700 1 --2- 172.21.15.44:0/4227636183 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fde7815cae0 0x7fde780b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.297+0000 7fde7d023700 1 --2- 172.21.15.44:0/4227636183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde7806b310 0x7fde780b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.297+0000 7fde7d824700 1 -- 172.21.15.44:0/4227636183 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fde7815cae0 msgr2=0x7fde780b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.297+0000 7fde7d824700 1 --2- 172.21.15.44:0/4227636183 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fde7815cae0 0x7fde780b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.297+0000 7fde7d824700 1 -- 172.21.15.44:0/4227636183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde7806b310 msgr2=0x7fde780b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.297+0000 7fde7d824700 1 --2- 172.21.15.44:0/4227636183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde7806b310 0x7fde780b0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.297+0000 7fde7d824700 1 -- 172.21.15.44:0/4227636183 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde70009a70 con 0x7fde7815cec0 2024-09-13T18:35:18.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.297+0000 7fde7d824700 1 --2- 172.21.15.44:0/4227636183 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde7815cec0 0x7fde780a95e0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fde7000b370 tx=0x7fde70004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:18.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.297+0000 7fde6dffb700 1 -- 172.21.15.44:0/4227636183 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde700044c0 con 0x7fde7815cec0 2024-09-13T18:35:18.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.297+0000 7fde6dffb700 1 -- 172.21.15.44:0/4227636183 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde70004660 con 0x7fde7815cec0 2024-09-13T18:35:18.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.297+0000 7fde7e025700 1 -- 172.21.15.44:0/4227636183 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde7815f490 con 0x7fde7815cec0 2024-09-13T18:35:18.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.297+0000 7fde6dffb700 1 -- 172.21.15.44:0/4227636183 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde70012450 con 0x7fde7815cec0 2024-09-13T18:35:18.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.297+0000 7fde7e025700 1 -- 172.21.15.44:0/4227636183 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7815fa50 con 0x7fde7815cec0 2024-09-13T18:35:18.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.301+0000 7fde7e025700 1 -- 172.21.15.44:0/4227636183 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7815fc40 con 0x7fde7815cec0 2024-09-13T18:35:18.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.301+0000 7fde6dffb700 1 -- 172.21.15.44:0/4227636183 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fde700125b0 con 0x7fde7815cec0 2024-09-13T18:35:18.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.301+0000 7fde6dffb700 1 --2- 172.21.15.44:0/4227636183 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fde5c066730 0x7fde5c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:18.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.301+0000 7fde6dffb700 1 -- 172.21.15.44:0/4227636183 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fde70085bd0 con 0x7fde7815cec0 2024-09-13T18:35:18.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.301+0000 7fde7d023700 1 --2- 172.21.15.44:0/4227636183 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fde5c066730 0x7fde5c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:18.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.301+0000 7fde7d023700 1 --2- 172.21.15.44:0/4227636183 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fde5c066730 0x7fde5c068bf0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fde781f67d0 tx=0x7fde74001e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:18.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.309+0000 7fde6dffb700 1 -- 172.21.15.44:0/4227636183 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fde70052f20 con 0x7fde7815cec0 2024-09-13T18:35:18.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.517+0000 7fde7e025700 1 -- 172.21.15.44:0/4227636183 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde780d1210 con 0x7fde7815cec0 2024-09-13T18:35:18.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.521+0000 7fde6dffb700 1 -- 172.21.15.44:0/4227636183 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+3982 (secure 0 0 0) 0x7fde70017090 con 0x7fde7815cec0 2024-09-13T18:35:18.525 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:18.525 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":55,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2305930667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2305930667},{"type":"v1","addr":"172.21.15.99:6835","nonce":2305930667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1177460745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1177460745},{"type":"v1","addr":"172.21.15.44:6834","nonce":1177460745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:33:16.291148+0000","modified":"2024-09-13T18:35:18.167016+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6858},"failed":[],"damaged":[1],"stopped":[],"info":{"gid_6858":{"gid":6858,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/3072614790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3072614790},{"type":"v1","addr":"172.21.15.99:6837","nonce":3072614790}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:35:18.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.521+0000 7fde7e025700 1 -- 172.21.15.44:0/4227636183 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fde5c066730 msgr2=0x7fde5c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:18.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.521+0000 7fde7e025700 1 --2- 172.21.15.44:0/4227636183 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fde5c066730 0x7fde5c068bf0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fde781f67d0 tx=0x7fde74001e40 comp rx=0 tx=0).stop 2024-09-13T18:35:18.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.521+0000 7fde7e025700 1 -- 172.21.15.44:0/4227636183 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde7815cec0 msgr2=0x7fde780a95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:18.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.521+0000 7fde7e025700 1 --2- 172.21.15.44:0/4227636183 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde7815cec0 0x7fde780a95e0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fde7000b370 tx=0x7fde70004af0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.521+0000 7fde7e025700 1 -- 172.21.15.44:0/4227636183 shutdown_connections 2024-09-13T18:35:18.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.521+0000 7fde7e025700 1 --2- 172.21.15.44:0/4227636183 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fde5c066730 0x7fde5c068bf0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.521+0000 7fde7e025700 1 --2- 172.21.15.44:0/4227636183 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde7815cec0 0x7fde780a95e0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.521+0000 7fde7e025700 1 --2- 172.21.15.44:0/4227636183 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fde7815cae0 0x7fde780b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.521+0000 7fde7e025700 1 --2- 172.21.15.44:0/4227636183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde7806b310 0x7fde780b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.521+0000 7fde7e025700 1 -- 172.21.15.44:0/4227636183 >> 172.21.15.44:0/4227636183 conn(0x7fde780d2c80 msgr2=0x7fde7815b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:18.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.521+0000 7fde7e025700 1 -- 172.21.15.44:0/4227636183 shutdown_connections 2024-09-13T18:35:18.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.521+0000 7fde7e025700 1 -- 172.21.15.44:0/4227636183 wait complete. 2024-09-13T18:35:18.529 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 55 2024-09-13T18:35:18.541 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-13T18:35:18.541 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:35:18.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.649+0000 7f9f56389700 1 Processor -- start 2024-09-13T18:35:18.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.649+0000 7f9f56389700 1 -- start start 2024-09-13T18:35:18.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.649+0000 7f9f56389700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9f500b3ae0 0x7f9f50165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:18.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.649+0000 7f9f56389700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9f50161290 0x7f9f50161740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:18.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.649+0000 7f9f56389700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f50071f30 con 0x7f9f50160eb0 2024-09-13T18:35:18.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.649+0000 7f9f56389700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f501622e0 con 0x7f9f50161290 2024-09-13T18:35:18.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.649+0000 7f9f56389700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f50162000 con 0x7f9f500b3ae0 2024-09-13T18:35:18.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.649+0000 7f9f55b88700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9f50161290 0x7f9f50161740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:18.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.649+0000 7f9f55b88700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9f50161290 0x7f9f50161740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39780/0 (socket says 172.21.15.44:39780) 2024-09-13T18:35:18.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.649+0000 7f9f55b88700 1 -- 172.21.15.44:0/3436683320 learned_addr learned my addr 172.21.15.44:0/3436683320 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:18.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.649+0000 7f9f54b86700 1 --2- 172.21.15.44:0/3436683320 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9f500b3ae0 0x7f9f50165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:18.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.649+0000 7f9f54b86700 1 -- 172.21.15.44:0/3436683320 >> v2:172.21.15.44:3300/0 conn(0x7f9f50161290 msgr2=0x7f9f50161740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:18.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.649+0000 7f9f54b86700 1 --2- 172.21.15.44:0/3436683320 >> v2:172.21.15.44:3300/0 conn(0x7f9f50161290 0x7f9f50161740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.649+0000 7f9f54b86700 1 -- 172.21.15.44:0/3436683320 >> v1:172.21.15.99:6789/0 conn(0x7f9f50160eb0 legacy=0x7f9f500b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:18.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.649+0000 7f9f54b86700 1 -- 172.21.15.44:0/3436683320 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f50164ab0 con 0x7f9f500b3ae0 2024-09-13T18:35:18.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.649+0000 7f9f54b86700 1 --2- 172.21.15.44:0/3436683320 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9f500b3ae0 0x7f9f50165590 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c009850 tx=0x7f9f4c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1227d1279f8a004 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:18.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.653+0000 7f9f43fff700 1 -- 172.21.15.44:0/3436683320 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c011830 con 0x7f9f500b3ae0 2024-09-13T18:35:18.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.653+0000 7f9f43fff700 1 -- 172.21.15.44:0/3436683320 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c011990 con 0x7f9f500b3ae0 2024-09-13T18:35:18.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.653+0000 7f9f43fff700 1 -- 172.21.15.44:0/3436683320 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c011d40 con 0x7f9f500b3ae0 2024-09-13T18:35:18.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.653+0000 7f9f56389700 1 -- 172.21.15.44:0/3436683320 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9f500b3ae0 msgr2=0x7f9f50165590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:18.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.653+0000 7f9f56389700 1 --2- 172.21.15.44:0/3436683320 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9f500b3ae0 0x7f9f50165590 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c009850 tx=0x7f9f4c009b60 comp rx=0 tx=0).stop 2024-09-13T18:35:18.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.653+0000 7f9f56389700 1 -- 172.21.15.44:0/3436683320 shutdown_connections 2024-09-13T18:35:18.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.653+0000 7f9f56389700 1 --2- 172.21.15.44:0/3436683320 >> v2:172.21.15.44:3300/0 conn(0x7f9f50161290 0x7f9f50161740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.653+0000 7f9f56389700 1 --2- 172.21.15.44:0/3436683320 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9f500b3ae0 0x7f9f50165590 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.653+0000 7f9f56389700 1 -- 172.21.15.44:0/3436683320 >> 172.21.15.44:0/3436683320 conn(0x7f9f500b0f00 msgr2=0x7f9f500b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:18.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.653+0000 7f9f56389700 1 -- 172.21.15.44:0/3436683320 shutdown_connections 2024-09-13T18:35:18.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.653+0000 7f9f56389700 1 -- 172.21.15.44:0/3436683320 wait complete. 2024-09-13T18:35:18.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f56389700 1 Processor -- start 2024-09-13T18:35:18.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f56389700 1 -- start start 2024-09-13T18:35:18.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f56389700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9f500b3ae0 0x7f9f500a9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:18.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f56389700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f50160eb0 0x7f9f5015f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:18.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f56389700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f50161290 0x7f9f5015c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:18.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f56389700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500a8f60 con 0x7f9f50160eb0 2024-09-13T18:35:18.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f56389700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500aa4d0 con 0x7f9f50161290 2024-09-13T18:35:18.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f56389700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500a91d0 con 0x7f9f500b3ae0 2024-09-13T18:35:18.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f54b86700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f50160eb0 0x7f9f5015f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:18.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f54b86700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f50160eb0 0x7f9f5015f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39782/0 (socket says 172.21.15.44:39782) 2024-09-13T18:35:18.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f54b86700 1 -- 172.21.15.44:0/4202231763 learned_addr learned my addr 172.21.15.44:0/4202231763 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:18.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f55387700 1 --2- 172.21.15.44:0/4202231763 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9f500b3ae0 0x7f9f500a9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:18.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f55b88700 1 --2- 172.21.15.44:0/4202231763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f50161290 0x7f9f5015c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:18.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f54b86700 1 -- 172.21.15.44:0/4202231763 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9f500b3ae0 msgr2=0x7f9f500a9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:18.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f54b86700 1 --2- 172.21.15.44:0/4202231763 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9f500b3ae0 0x7f9f500a9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f54b86700 1 -- 172.21.15.44:0/4202231763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f50161290 msgr2=0x7f9f5015c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:18.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f54b86700 1 --2- 172.21.15.44:0/4202231763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f50161290 0x7f9f5015c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f54b86700 1 -- 172.21.15.44:0/4202231763 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4c0094b0 con 0x7f9f50160eb0 2024-09-13T18:35:18.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f54b86700 1 --2- 172.21.15.44:0/4202231763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f50160eb0 0x7f9f5015f670 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c0090b0 tx=0x7f9f4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:18.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f41ffb700 1 -- 172.21.15.44:0/4202231763 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c0036c0 con 0x7f9f50160eb0 2024-09-13T18:35:18.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f41ffb700 1 -- 172.21.15.44:0/4202231763 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c01f070 con 0x7f9f50160eb0 2024-09-13T18:35:18.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f56389700 1 -- 172.21.15.44:0/4202231763 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f500a94b0 con 0x7f9f50160eb0 2024-09-13T18:35:18.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f41ffb700 1 -- 172.21.15.44:0/4202231763 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c003a60 con 0x7f9f50160eb0 2024-09-13T18:35:18.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.657+0000 7f9f56389700 1 -- 172.21.15.44:0/4202231763 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f500a9a70 con 0x7f9f50160eb0 2024-09-13T18:35:18.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.661+0000 7f9f56389700 1 -- 172.21.15.44:0/4202231763 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f50165590 con 0x7f9f50160eb0 2024-09-13T18:35:18.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.661+0000 7f9f41ffb700 1 -- 172.21.15.44:0/4202231763 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9f4c003bc0 con 0x7f9f50160eb0 2024-09-13T18:35:18.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.661+0000 7f9f41ffb700 1 --2- 172.21.15.44:0/4202231763 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9f34066730 0x7f9f34068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:18.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.661+0000 7f9f41ffb700 1 -- 172.21.15.44:0/4202231763 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f9f4c021070 con 0x7f9f50160eb0 2024-09-13T18:35:18.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.661+0000 7f9f55387700 1 --2- 172.21.15.44:0/4202231763 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9f34066730 0x7f9f34068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:18.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.661+0000 7f9f55387700 1 --2- 172.21.15.44:0/4202231763 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9f34066730 0x7f9f34068bf0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9f440018a0 tx=0x7f9f44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:18.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.673+0000 7f9f41ffb700 1 -- 172.21.15.44:0/4202231763 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9f4c052c60 con 0x7f9f50160eb0 2024-09-13T18:35:18.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.881+0000 7f9f56389700 1 -- 172.21.15.44:0/4202231763 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f5006d590 con 0x7f9f50160eb0 2024-09-13T18:35:18.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.881+0000 7f9f41ffb700 1 -- 172.21.15.44:0/4202231763 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+3982 (secure 0 0 0) 0x7f9f4c015020 con 0x7f9f50160eb0 2024-09-13T18:35:18.886 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:18.886 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":55,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2305930667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2305930667},{"type":"v1","addr":"172.21.15.99:6835","nonce":2305930667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1177460745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1177460745},{"type":"v1","addr":"172.21.15.44:6834","nonce":1177460745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:33:16.291148+0000","modified":"2024-09-13T18:35:18.167016+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6858},"failed":[],"damaged":[1],"stopped":[],"info":{"gid_6858":{"gid":6858,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/3072614790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3072614790},{"type":"v1","addr":"172.21.15.99:6837","nonce":3072614790}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:35:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.885+0000 7f9f56389700 1 -- 172.21.15.44:0/4202231763 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9f34066730 msgr2=0x7f9f34068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.885+0000 7f9f56389700 1 --2- 172.21.15.44:0/4202231763 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9f34066730 0x7f9f34068bf0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9f440018a0 tx=0x7f9f44009040 comp rx=0 tx=0).stop 2024-09-13T18:35:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.885+0000 7f9f56389700 1 -- 172.21.15.44:0/4202231763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f50160eb0 msgr2=0x7f9f5015f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.885+0000 7f9f56389700 1 --2- 172.21.15.44:0/4202231763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f50160eb0 0x7f9f5015f670 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c0090b0 tx=0x7f9f4c004770 comp rx=0 tx=0).stop 2024-09-13T18:35:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.885+0000 7f9f56389700 1 -- 172.21.15.44:0/4202231763 shutdown_connections 2024-09-13T18:35:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.885+0000 7f9f56389700 1 --2- 172.21.15.44:0/4202231763 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9f34066730 0x7f9f34068bf0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.885+0000 7f9f56389700 1 --2- 172.21.15.44:0/4202231763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f50161290 0x7f9f5015c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.885+0000 7f9f56389700 1 --2- 172.21.15.44:0/4202231763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f50160eb0 0x7f9f5015f670 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.885+0000 7f9f56389700 1 --2- 172.21.15.44:0/4202231763 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9f500b3ae0 0x7f9f500a9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.885+0000 7f9f56389700 1 -- 172.21.15.44:0/4202231763 >> 172.21.15.44:0/4202231763 conn(0x7f9f500b0f00 msgr2=0x7f9f500afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:18.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.885+0000 7f9f56389700 1 -- 172.21.15.44:0/4202231763 shutdown_connections 2024-09-13T18:35:18.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:18.885+0000 7f9f56389700 1 -- 172.21.15.44:0/4202231763 wait complete. 2024-09-13T18:35:18.890 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 55 2024-09-13T18:35:18.902 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:35:19.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.017+0000 7f4aa7fff700 1 Processor -- start 2024-09-13T18:35:19.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.017+0000 7f4aa7fff700 1 -- start start 2024-09-13T18:35:19.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa7fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4aa815cda0 0x7f4aa806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa7fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4aa80ceb70 0x7f4aa80b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa7fff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa80b8430 con 0x7f4aa806a520 2024-09-13T18:35:19.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa7fff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa806be40 con 0x7f4aa815cda0 2024-09-13T18:35:19.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa7fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa80cf350 con 0x7f4aa80ceb70 2024-09-13T18:35:19.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa6ffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4aa815cda0 0x7f4aa806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa6ffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4aa815cda0 0x7f4aa806b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39786/0 (socket says 172.21.15.44:39786) 2024-09-13T18:35:19.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa6ffd700 1 -- 172.21.15.44:0/3689297106 learned_addr learned my addr 172.21.15.44:0/3689297106 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:19.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa67fc700 1 --2- 172.21.15.44:0/3689297106 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4aa80ceb70 0x7f4aa80b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa5ffb700 1 -- 172.21.15.44:0/3689297106 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135857648 0 0) 0x7f4aa80b8430 con 0x7f4aa806a520 2024-09-13T18:35:19.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa67fc700 1 -- 172.21.15.44:0/3689297106 >> v2:172.21.15.44:3300/0 conn(0x7f4aa815cda0 msgr2=0x7f4aa806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa67fc700 1 --2- 172.21.15.44:0/3689297106 >> v2:172.21.15.44:3300/0 conn(0x7f4aa815cda0 0x7f4aa806b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa67fc700 1 -- 172.21.15.44:0/3689297106 >> v1:172.21.15.99:6789/0 conn(0x7f4aa806a520 legacy=0x7f4aa80d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa67fc700 1 -- 172.21.15.44:0/3689297106 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa80d0880 con 0x7f4aa80ceb70 2024-09-13T18:35:19.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa6ffd700 1 --2- 172.21.15.44:0/3689297106 >> v2:172.21.15.44:3300/0 conn(0x7f4aa815cda0 0x7f4aa806b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:19.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa67fc700 1 --2- 172.21.15.44:0/3689297106 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4aa80ceb70 0x7f4aa80b5de0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4a90009850 tx=0x7f4a90009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c0db3ae5eea036f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa5ffb700 1 -- 172.21.15.44:0/3689297106 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a90011830 con 0x7f4aa80ceb70 2024-09-13T18:35:19.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa5ffb700 1 -- 172.21.15.44:0/3689297106 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a90011990 con 0x7f4aa80ceb70 2024-09-13T18:35:19.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa5ffb700 1 -- 172.21.15.44:0/3689297106 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a90011d40 con 0x7f4aa80ceb70 2024-09-13T18:35:19.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa7fff700 1 -- 172.21.15.44:0/3689297106 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4aa80ceb70 msgr2=0x7f4aa80b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa7fff700 1 --2- 172.21.15.44:0/3689297106 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4aa80ceb70 0x7f4aa80b5de0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4a90009850 tx=0x7f4a90009b60 comp rx=0 tx=0).stop 2024-09-13T18:35:19.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa7fff700 1 -- 172.21.15.44:0/3689297106 shutdown_connections 2024-09-13T18:35:19.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa7fff700 1 --2- 172.21.15.44:0/3689297106 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4aa80ceb70 0x7f4aa80b5de0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa7fff700 1 --2- 172.21.15.44:0/3689297106 >> v2:172.21.15.44:3300/0 conn(0x7f4aa815cda0 0x7f4aa806b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa7fff700 1 -- 172.21.15.44:0/3689297106 >> 172.21.15.44:0/3689297106 conn(0x7f4aa80d2cb0 msgr2=0x7f4aa80d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa7fff700 1 -- 172.21.15.44:0/3689297106 shutdown_connections 2024-09-13T18:35:19.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.021+0000 7f4aa7fff700 1 -- 172.21.15.44:0/3689297106 wait complete. 2024-09-13T18:35:19.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.025+0000 7f4aa7fff700 1 Processor -- start 2024-09-13T18:35:19.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.025+0000 7f4aa7fff700 1 -- start start 2024-09-13T18:35:19.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.029+0000 7f4aa7fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4aa806a520 0x7f4aa8155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.029+0000 7f4aa7fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4aa80ceb70 0x7f4aa8154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.029+0000 7f4aa7fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aa815cda0 0x7f4aa80c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.029+0000 7f4aa7fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa80c79d0 con 0x7f4aa815cda0 2024-09-13T18:35:19.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.029+0000 7f4aa7fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa8156a20 con 0x7f4aa806a520 2024-09-13T18:35:19.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.029+0000 7f4aa7fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa8156180 con 0x7f4aa80ceb70 2024-09-13T18:35:19.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.029+0000 7f4aa77fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aa815cda0 0x7f4aa80c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.029+0000 7f4aa6ffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4aa806a520 0x7f4aa8155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.029+0000 7f4aa67fc700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4aa80ceb70 0x7f4aa8154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.029+0000 7f4aa77fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aa815cda0 0x7f4aa80c7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39798/0 (socket says 172.21.15.44:39798) 2024-09-13T18:35:19.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.029+0000 7f4aa67fc700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4aa80ceb70 0x7f4aa8154260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:46876/0 (socket says 172.21.15.44:46876) 2024-09-13T18:35:19.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.029+0000 7f4aa77fe700 1 -- 172.21.15.44:0/1638796294 learned_addr learned my addr 172.21.15.44:0/1638796294 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:19.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.029+0000 7f4aa67fc700 1 -- 172.21.15.44:0/1638796294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4aa806a520 msgr2=0x7f4aa8155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.029+0000 7f4aa67fc700 1 --2- 172.21.15.44:0/1638796294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4aa806a520 0x7f4aa8155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.029+0000 7f4aa67fc700 1 -- 172.21.15.44:0/1638796294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aa815cda0 msgr2=0x7f4aa80c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.029+0000 7f4aa67fc700 1 --2- 172.21.15.44:0/1638796294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aa815cda0 0x7f4aa80c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.029+0000 7f4aa67fc700 1 -- 172.21.15.44:0/1638796294 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a98009570 con 0x7f4aa80ceb70 2024-09-13T18:35:19.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.029+0000 7f4aa67fc700 1 --2- 172.21.15.44:0/1638796294 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4aa80ceb70 0x7f4aa8154260 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4aa81617d0 tx=0x7f4a90004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.029+0000 7f4a9ffff700 1 -- 172.21.15.44:0/1638796294 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a90004550 con 0x7f4aa80ceb70 2024-09-13T18:35:19.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.029+0000 7f4a9ffff700 1 -- 172.21.15.44:0/1638796294 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9001f070 con 0x7f4aa80ceb70 2024-09-13T18:35:19.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.029+0000 7f4aa7fff700 1 -- 172.21.15.44:0/1638796294 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a900094b0 con 0x7f4aa80ceb70 2024-09-13T18:35:19.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.029+0000 7f4aa7fff700 1 -- 172.21.15.44:0/1638796294 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa8156740 con 0x7f4aa80ceb70 2024-09-13T18:35:19.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.029+0000 7f4a9ffff700 1 -- 172.21.15.44:0/1638796294 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a90003900 con 0x7f4aa80ceb70 2024-09-13T18:35:19.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.033+0000 7f4aa7fff700 1 -- 172.21.15.44:0/1638796294 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a80005310 con 0x7f4aa80ceb70 2024-09-13T18:35:19.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.033+0000 7f4a9ffff700 1 -- 172.21.15.44:0/1638796294 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4a90003a60 con 0x7f4aa80ceb70 2024-09-13T18:35:19.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.033+0000 7f4a9ffff700 1 --2- 172.21.15.44:0/1638796294 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4a8c066730 0x7f4a8c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.033+0000 7f4a9ffff700 1 -- 172.21.15.44:0/1638796294 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f4a90021070 con 0x7f4aa80ceb70 2024-09-13T18:35:19.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.033+0000 7f4aa6ffd700 1 --2- 172.21.15.44:0/1638796294 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4a8c066730 0x7f4a8c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.037+0000 7f4aa6ffd700 1 --2- 172.21.15.44:0/1638796294 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4a8c066730 0x7f4a8c068bf0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4a98006d50 tx=0x7f4a980092e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.045+0000 7f4a9ffff700 1 -- 172.21.15.44:0/1638796294 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4a900532a0 con 0x7f4aa80ceb70 2024-09-13T18:35:19.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.257+0000 7f4aa7fff700 1 -- 172.21.15.44:0/1638796294 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4a80005890 con 0x7f4aa80ceb70 2024-09-13T18:35:19.265 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-13T18:35:19.261+0000 7fc22bbc2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:35:19.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.273+0000 7f4a9ffff700 1 -- 172.21.15.44:0/1638796294 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4a90015090 con 0x7f4aa80ceb70 2024-09-13T18:35:19.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.273+0000 7f4aa7fff700 1 -- 172.21.15.44:0/1638796294 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4a8c066730 msgr2=0x7f4a8c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.277+0000 7f4aa7fff700 1 --2- 172.21.15.44:0/1638796294 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4a8c066730 0x7f4a8c068bf0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4a98006d50 tx=0x7f4a980092e0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.277+0000 7f4aa7fff700 1 -- 172.21.15.44:0/1638796294 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4aa80ceb70 msgr2=0x7f4aa8154260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.277+0000 7f4aa7fff700 1 --2- 172.21.15.44:0/1638796294 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4aa80ceb70 0x7f4aa8154260 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4aa81617d0 tx=0x7f4a90004770 comp rx=0 tx=0).stop 2024-09-13T18:35:19.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.277+0000 7f4aa7fff700 1 -- 172.21.15.44:0/1638796294 shutdown_connections 2024-09-13T18:35:19.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.277+0000 7f4aa7fff700 1 --2- 172.21.15.44:0/1638796294 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4a8c066730 0x7f4a8c068bf0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.277+0000 7f4aa7fff700 1 --2- 172.21.15.44:0/1638796294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aa815cda0 0x7f4aa80c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.277+0000 7f4aa7fff700 1 --2- 172.21.15.44:0/1638796294 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4aa80ceb70 0x7f4aa8154260 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.277+0000 7f4aa7fff700 1 --2- 172.21.15.44:0/1638796294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4aa806a520 0x7f4aa8155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.277+0000 7f4aa7fff700 1 -- 172.21.15.44:0/1638796294 >> 172.21.15.44:0/1638796294 conn(0x7f4aa80d2cb0 msgr2=0x7f4aa815af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.277+0000 7f4aa7fff700 1 -- 172.21.15.44:0/1638796294 shutdown_connections 2024-09-13T18:35:19.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.277+0000 7f4aa7fff700 1 -- 172.21.15.44:0/1638796294 wait complete. 2024-09-13T18:35:19.282 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:35:19.295 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-journal-tool --debug-mds=1 --debug-objecter=1 --rank cephfs:0 event recover_dentries summary 2024-09-13T18:35:19.318 INFO:tasks.ceph.mds.d.smithi099.stdout:starting mds.d at 2024-09-13T18:35:19.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.329+0000 7f08a0e8d500 1 -- start start 2024-09-13T18:35:19.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.329+0000 7f08a0e8d500 1 Processor -- start 2024-09-13T18:35:19.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.333+0000 7f08a0e8d500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b750a9800 0x557b7514fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.333+0000 7f08a0e8d500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b750a9400 0x557b7514f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.333+0000 7f08a0e8d500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b750a9000 0x557b7514f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.333+0000 7f08a0e8d500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b7512aa00 con 0x557b750a9400 2024-09-13T18:35:19.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.333+0000 7f08a0e8d500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b7512a640 con 0x557b750a9000 2024-09-13T18:35:19.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.333+0000 7f08a0e8d500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b7512a500 con 0x557b750a9800 2024-09-13T18:35:19.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.333+0000 7f089ee46700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b750a9400 0x557b7514f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.333+0000 7f089ee46700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b750a9400 0x557b7514f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39820/0 (socket says 172.21.15.44:39820) 2024-09-13T18:35:19.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.333+0000 7f089ee46700 1 -- 172.21.15.44:0/2397102214 learned_addr learned my addr 172.21.15.44:0/2397102214 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:19.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.333+0000 7f089f647700 1 --2- 172.21.15.44:0/2397102214 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b750a9800 0x557b7514fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.333+0000 7f089ee46700 1 -- 172.21.15.44:0/2397102214 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b750a9800 msgr2=0x557b7514fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.333+0000 7f089ee46700 1 --2- 172.21.15.44:0/2397102214 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b750a9800 0x557b7514fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.333+0000 7f089ee46700 1 -- 172.21.15.44:0/2397102214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b750a9000 msgr2=0x557b7514f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.333+0000 7f089ee46700 1 --2- 172.21.15.44:0/2397102214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b750a9000 0x557b7514f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.333+0000 7f089ee46700 1 -- 172.21.15.44:0/2397102214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b750cc9c0 con 0x557b750a9400 2024-09-13T18:35:19.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.333+0000 7f089ee46700 1 --2- 172.21.15.44:0/2397102214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b750a9400 0x557b7514f600 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x557b751bb350 tx=0x557b75ea4cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3294e41ccfed7fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.333+0000 7f089ce42700 1 -- 172.21.15.44:0/2397102214 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557b750f9600 con 0x557b750a9400 2024-09-13T18:35:19.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.333+0000 7f089ce42700 1 -- 172.21.15.44:0/2397102214 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557b75e98000 con 0x557b750a9400 2024-09-13T18:35:19.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.333+0000 7f089ce42700 1 -- 172.21.15.44:0/2397102214 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557b750f91e0 con 0x557b750a9400 2024-09-13T18:35:19.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.333+0000 7f08a0e8d500 1 -- 172.21.15.44:0/2397102214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b750ccb60 con 0x557b750a9400 2024-09-13T18:35:19.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.333+0000 7f08a0e8d500 1 -- 172.21.15.44:0/2397102214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x557b750cc340 con 0x557b750a9400 2024-09-13T18:35:19.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.333+0000 7f089ce42700 1 -- 172.21.15.44:0/2397102214 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x557b750e2c40 con 0x557b750a9400 2024-09-13T18:35:19.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.333+0000 7f089ce42700 1 -- 172.21.15.44:0/2397102214 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 56) v1 ==== 2044+0+0 (secure 0 0 0) 0x557b75e9a900 con 0x557b750a9400 2024-09-13T18:35:19.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f08a0e8d500 1 Processor -- start 2024-09-13T18:35:19.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f08a0e8d500 1 -- start start 2024-09-13T18:35:19.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f08a0e8d500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b75e90400 0x557b7514eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f08a0e8d500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b75e90800 0x557b7514e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f08a0e8d500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b75e90c00 0x557b75150100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f08a0e8d500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b750dfe00 con 0x557b75e90800 2024-09-13T18:35:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f08a0e8d500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b7512a640 con 0x557b75e90c00 2024-09-13T18:35:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f08a0e8d500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b7512a3c0 con 0x557b75e90400 2024-09-13T18:35:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f089f647700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b75e90800 0x557b7514e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f089f647700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b75e90800 0x557b7514e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39832/0 (socket says 172.21.15.44:39832) 2024-09-13T18:35:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f089f647700 1 -- 172.21.15.44:0/3172008416 learned_addr learned my addr 172.21.15.44:0/3172008416 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f089fe48700 1 --2- 172.21.15.44:0/3172008416 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b75e90400 0x557b7514eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f089ee46700 1 --2- 172.21.15.44:0/3172008416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b75e90c00 0x557b75150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f089f647700 1 -- 172.21.15.44:0/3172008416 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b75e90400 msgr2=0x557b7514eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f089f647700 1 --2- 172.21.15.44:0/3172008416 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b75e90400 0x557b7514eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f089f647700 1 -- 172.21.15.44:0/3172008416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b75e90c00 msgr2=0x557b75150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f089f647700 1 --2- 172.21.15.44:0/3172008416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b75e90c00 0x557b75150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f089f647700 1 -- 172.21.15.44:0/3172008416 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b750cc000 con 0x557b75e90800 2024-09-13T18:35:19.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f089f647700 1 --2- 172.21.15.44:0/3172008416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b75e90800 0x557b7514e580 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x557b75e8e8d0 tx=0x557b753a4c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5b6519e12a4687 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f089ae3e700 1 -- 172.21.15.44:0/3172008416 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557b750f9600 con 0x557b75e90800 2024-09-13T18:35:19.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f089ae3e700 1 -- 172.21.15.44:0/3172008416 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557b75e98180 con 0x557b75e90800 2024-09-13T18:35:19.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f089ae3e700 1 -- 172.21.15.44:0/3172008416 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557b750f91e0 con 0x557b75e90800 2024-09-13T18:35:19.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f08a0e8d500 1 -- 172.21.15.44:0/3172008416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b75e90800 msgr2=0x557b7514e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f08a0e8d500 1 --2- 172.21.15.44:0/3172008416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b75e90800 0x557b7514e580 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x557b75e8e8d0 tx=0x557b753a4c00 comp rx=0 tx=0).stop 2024-09-13T18:35:19.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f08a0e8d500 1 -- 172.21.15.44:0/3172008416 shutdown_connections 2024-09-13T18:35:19.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f08a0e8d500 1 --2- 172.21.15.44:0/3172008416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b75e90c00 0x557b75150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f08a0e8d500 1 --2- 172.21.15.44:0/3172008416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b75e90800 0x557b7514e580 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f08a0e8d500 1 --2- 172.21.15.44:0/3172008416 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b75e90400 0x557b7514eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.337+0000 7f08a0e8d500 1 -- 172.21.15.44:0/3172008416 >> 172.21.15.44:0/3172008416 conn(0x557b750a8c00 msgr2=0x557b75199800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.341+0000 7f08a0e8d500 1 -- 172.21.15.44:0/3172008416 shutdown_connections 2024-09-13T18:35:19.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.341+0000 7f08a0e8d500 1 -- 172.21.15.44:0/3172008416 wait complete. 2024-09-13T18:35:19.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.341+0000 7f08a0e8d500 1 Processor -- start 2024-09-13T18:35:19.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.341+0000 7f08a0e8d500 1 -- start start 2024-09-13T18:35:19.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.341+0000 7f08a0e8d500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b75e90400 0x557b7514eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.341+0000 7f08a0e8d500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b75e90800 0x557b7514e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.341+0000 7f08a0e8d500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b75e90c00 0x557b75150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.341+0000 7f08a0e8d500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b7512a280 con 0x557b75e90c00 2024-09-13T18:35:19.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.341+0000 7f08a0e8d500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b7512a140 con 0x557b75e90800 2024-09-13T18:35:19.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.341+0000 7f08a0e8d500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b7512a000 con 0x557b75e90400 2024-09-13T18:35:19.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.341+0000 7f089ee46700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b75e90c00 0x557b75150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.341+0000 7f089fe48700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b75e90400 0x557b7514eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.341+0000 7f089ee46700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b75e90c00 0x557b75150100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39834/0 (socket says 172.21.15.44:39834) 2024-09-13T18:35:19.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.341+0000 7f089ee46700 1 -- 172.21.15.44:0/1664163150 learned_addr learned my addr 172.21.15.44:0/1664163150 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:19.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.341+0000 7f089f647700 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b75e90800 0x557b7514e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.345+0000 7f089ee46700 1 -- 172.21.15.44:0/1664163150 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b75e90400 msgr2=0x557b7514eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.345+0000 7f089ee46700 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b75e90400 0x557b7514eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.345+0000 7f089ee46700 1 -- 172.21.15.44:0/1664163150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b75e90800 msgr2=0x557b7514e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.345+0000 7f089ee46700 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b75e90800 0x557b7514e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.345+0000 7f089ee46700 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b750cc9c0 con 0x557b75e90c00 2024-09-13T18:35:19.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.345+0000 7f089ee46700 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b75e90c00 0x557b75150100 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x557b751bbfb0 tx=0x557b7517f080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.345+0000 7f089963b700 1 -- 172.21.15.44:0/1664163150 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557b750f8f20 con 0x557b75e90c00 2024-09-13T18:35:19.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.345+0000 7f089963b700 1 -- 172.21.15.44:0/1664163150 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557b75e99680 con 0x557b75e90c00 2024-09-13T18:35:19.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.345+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557b750ccb60 con 0x557b75e90c00 2024-09-13T18:35:19.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.345+0000 7f089963b700 1 -- 172.21.15.44:0/1664163150 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557b750f9600 con 0x557b75e90c00 2024-09-13T18:35:19.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.345+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b750ccea0 con 0x557b75e90c00 2024-09-13T18:35:19.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.345+0000 7f089963b700 1 -- 172.21.15.44:0/1664163150 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x557b75108840 con 0x557b75e90c00 2024-09-13T18:35:19.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.349+0000 7f089963b700 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x557b754ee000 0x557b754f0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.349+0000 7f089963b700 1 -- 172.21.15.44:0/1664163150 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x557b750e2a80 con 0x557b75e90c00 2024-09-13T18:35:19.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.349+0000 7f08a0e8d500 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x557b75e91000 0x557b75150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.349+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:1 8.f 8:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b75e91400 con 0x557b75e91000 2024-09-13T18:35:19.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.349+0000 7f089fe48700 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x557b754ee000 0x557b754f0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.349+0000 7f089f647700 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x557b75e91000 0x557b75150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.349+0000 7f089fe48700 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x557b754ee000 0x557b754f0000 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x557b750ffe30 tx=0x557b7517f260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.349+0000 7f089f647700 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x557b75e91000 0x557b75150680 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.349+0000 7f089f647700 1 -- 172.21.15.44:0/1664163150 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x557b75f32b40 con 0x557b75e91000 2024-09-13T18:35:19.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.349+0000 7f08a0e8d500 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x557b75e91800 0x557b75150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.349+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:2 8.14 8:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b754ee400 con 0x557b75e91800 2024-09-13T18:35:19.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.349+0000 7f089fe48700 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x557b75e91800 0x557b75150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.349+0000 7f089fe48700 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x557b75e91800 0x557b75150c00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.357+0000 7f089fe48700 1 -- 172.21.15.44:0/1664163150 <== osd.4 v2:172.21.15.99:6816/2515272044 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv1252 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x557b75f32d80 con 0x557b75e91800 2024-09-13T18:35:19.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.357+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:3 8.1b 8:ddb4e4d7:::200.00000002:head [read 1383303~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b754ee800 con 0x557b75e91800 2024-09-13T18:35:19.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.357+0000 7f089fe48700 1 -- 172.21.15.44:0/1664163150 <== osd.4 v2:172.21.15.99:6816/2515272044 2 ==== osd_op_reply(3 200.00000002 [read 1383303~5052 out=5052b] v0'0 uv1790 ondisk = 0) v8 ==== 156+0+5052 (crc 0 0 0) 0x557b75f32d80 con 0x557b75e91800 2024-09-13T18:35:19.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.357+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:4 8.b 8:d5c7a900:::200.00000003:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b754eec00 con 0x557b75e91000 2024-09-13T18:35:19.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.357+0000 7f089f647700 1 -- 172.21.15.44:0/1664163150 <== osd.3 v2:172.21.15.44:6808/771281770 2 ==== osd_op_reply(4 200.00000003 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x557b75f32b40 con 0x557b75e91000 2024-09-13T18:35:19.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.357+0000 7f08a0e8d500 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x557b754ef000 0x557b75151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.357+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:5 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b754ef400 con 0x557b754ef000 2024-09-13T18:35:19.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.357+0000 7f089f647700 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x557b754ef000 0x557b75151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.357+0000 7f089f647700 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x557b754ef000 0x557b75151180 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.361+0000 7f089f647700 1 -- 172.21.15.44:0/1664163150 <== osd.0 v2:172.21.15.44:6800/2647753462 1 ==== osd_op_reply(5 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x557b75f32b40 con 0x557b754ef000 2024-09-13T18:35:19.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.361+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:6 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b754ef800 con 0x557b754ef000 2024-09-13T18:35:19.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.365+0000 7f089f647700 1 -- 172.21.15.44:0/1664163150 <== osd.0 v2:172.21.15.44:6800/2647753462 2 ==== osd_op_reply(6 1.00000000 [omap-get-vals-by-keys out=522b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+522 (crc 0 0 0) 0x557b75f32b40 con 0x557b754ef000 2024-09-13T18:35:19.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.365+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:7 8.13 8:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b754efc00 con 0x557b75e91000 2024-09-13T18:35:19.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.365+0000 7f089f647700 1 -- 172.21.15.44:0/1664163150 <== osd.3 v2:172.21.15.44:6808/771281770 3 ==== osd_op_reply(7 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x557b75f32b40 con 0x557b75e91000 2024-09-13T18:35:19.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.365+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:8 8.13 8:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b754ef400 con 0x557b75e91000 2024-09-13T18:35:19.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.365+0000 7f089f647700 1 -- 172.21.15.44:0/1664163150 <== osd.3 v2:172.21.15.44:6808/771281770 4 ==== osd_op_reply(8 100.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+4 (crc 0 0 0) 0x557b75f32b40 con 0x557b75e91000 2024-09-13T18:35:19.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.365+0000 7f08a0e8d500 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x557b754ef800 0x557b75151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.365+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:9 8.7 8:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b754efc00 con 0x557b754ef800 2024-09-13T18:35:19.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.365+0000 7f089ee46700 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x557b754ef800 0x557b75151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.365+0000 7f089ee46700 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x557b754ef800 0x557b75151700 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.369+0000 7f089ee46700 1 -- 172.21.15.44:0/1664163150 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== osd_op_reply(9 10000000001.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x557b75f33440 con 0x557b754ef800 2024-09-13T18:35:19.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.369+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:10 8.7 8:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b754eec00 con 0x557b754ef800 2024-09-13T18:35:19.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.373+0000 7f089ee46700 1 -- 172.21.15.44:0/1664163150 <== osd.1 v2:172.21.15.44:6816/2250405239 2 ==== osd_op_reply(10 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x557b75f33440 con 0x557b754ef800 2024-09-13T18:35:19.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.373+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:11 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b754ee400 con 0x557b754ef000 2024-09-13T18:35:19.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.373+0000 7f089f647700 1 -- 172.21.15.44:0/1664163150 <== osd.0 v2:172.21.15.44:6800/2647753462 3 ==== osd_op_reply(11 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x557b75f32b40 con 0x557b754ef000 2024-09-13T18:35:19.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.373+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:12 8.1f 8:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b754ee800 con 0x557b754ef000 2024-09-13T18:35:19.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.373+0000 7f089f647700 1 -- 172.21.15.44:0/1664163150 <== osd.0 v2:172.21.15.44:6800/2647753462 4 ==== osd_op_reply(12 1.00000000 [omap-set-header] v66'7 uv7 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x557b75f32b40 con 0x557b754ef000 2024-09-13T18:35:19.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.373+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:13 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b75e91400 con 0x557b754ef000 2024-09-13T18:35:19.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.377+0000 7f089f647700 1 -- 172.21.15.44:0/1664163150 <== osd.0 v2:172.21.15.44:6800/2647753462 5 ==== osd_op_reply(13 1.00000000 [omap-get-vals-by-keys out=522b] v0'0 uv7 ondisk = 0) v8 ==== 154+0+522 (crc 0 0 0) 0x557b75f32b40 con 0x557b754ef000 2024-09-13T18:35:19.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.377+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:14 8.1f 8:ff5b34d6:::1.00000000:head [omap-set-vals in=522b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b75e91400 con 0x557b754ef000 2024-09-13T18:35:19.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.377+0000 7f089f647700 1 -- 172.21.15.44:0/1664163150 <== osd.0 v2:172.21.15.44:6800/2647753462 6 ==== osd_op_reply(14 1.00000000 [omap-set-vals] v66'8 uv8 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x557b75f32b40 con 0x557b754ef000 2024-09-13T18:35:19.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.377+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:15 8.14 8:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b754ef400 con 0x557b75e91800 2024-09-13T18:35:19.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.377+0000 7f089fe48700 1 -- 172.21.15.44:0/1664163150 <== osd.4 v2:172.21.15.99:6816/2515272044 3 ==== osd_op_reply(15 1.00000000.inode [read 0~582 out=582b] v0'0 uv1250 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x557b75f32d80 con 0x557b75e91800 2024-09-13T18:35:19.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.377+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:16 8.14 8:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b754ee400 con 0x557b75e91800 2024-09-13T18:35:19.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.381+0000 7f089fe48700 1 -- 172.21.15.44:0/1664163150 <== osd.4 v2:172.21.15.99:6816/2515272044 4 ==== osd_op_reply(16 1.00000000.inode [writefull 0~582] v66'1254 uv1254 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x557b75f32d80 con 0x557b75e91800 2024-09-13T18:35:19.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.381+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:17 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b754ee800 con 0x557b754ef000 2024-09-13T18:35:19.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.385+0000 7f089f647700 1 -- 172.21.15.44:0/1664163150 <== osd.0 v2:172.21.15.44:6800/2647753462 7 ==== osd_op_reply(17 1.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x557b75f32b40 con 0x557b754ef000 2024-09-13T18:35:19.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.385+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:18 8.1f 8:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b7550a000 con 0x557b754ef000 2024-09-13T18:35:19.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.385+0000 7f089f647700 1 -- 172.21.15.44:0/1664163150 <== osd.0 v2:172.21.15.44:6800/2647753462 8 ==== osd_op_reply(18 1.00000000 [omap-set-header] v66'9 uv9 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x557b75f32b40 con 0x557b754ef000 2024-09-13T18:35:19.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.385+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:19 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b7550a400 con 0x557b754ef000 2024-09-13T18:35:19.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.385+0000 7f089f647700 1 -- 172.21.15.44:0/1664163150 <== osd.0 v2:172.21.15.44:6800/2647753462 9 ==== osd_op_reply(19 1.00000000 [omap-get-vals-by-keys out=522b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+522 (crc 0 0 0) 0x557b75f32b40 con 0x557b754ef000 2024-09-13T18:35:19.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.385+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:20 8.1f 8:ff5b34d6:::1.00000000:head [omap-set-vals in=522b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b7550a800 con 0x557b754ef000 2024-09-13T18:35:19.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.389+0000 7f089f647700 1 -- 172.21.15.44:0/1664163150 <== osd.0 v2:172.21.15.44:6800/2647753462 10 ==== osd_op_reply(20 1.00000000 [omap-set-vals] v66'10 uv10 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x557b75f32b40 con 0x557b754ef000 2024-09-13T18:35:19.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.389+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:21 8.14 8:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b7550ac00 con 0x557b75e91800 2024-09-13T18:35:19.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.389+0000 7f089fe48700 1 -- 172.21.15.44:0/1664163150 <== osd.4 v2:172.21.15.99:6816/2515272044 5 ==== osd_op_reply(21 1.00000000.inode [read 0~582 out=582b] v0'0 uv1254 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x557b75f32d80 con 0x557b75e91800 2024-09-13T18:35:19.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.389+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:22 8.14 8:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b7550b000 con 0x557b75e91800 2024-09-13T18:35:19.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.393+0000 7f089fe48700 1 -- 172.21.15.44:0/1664163150 <== osd.4 v2:172.21.15.99:6816/2515272044 6 ==== osd_op_reply(22 1.00000000.inode [writefull 0~582] v66'1255 uv1255 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x557b75f32d80 con 0x557b75e91800 2024-09-13T18:35:19.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.393+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:23 8.13 8:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b7550b400 con 0x557b75e91000 2024-09-13T18:35:19.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.393+0000 7f089f647700 1 -- 172.21.15.44:0/1664163150 <== osd.3 v2:172.21.15.44:6808/771281770 5 ==== osd_op_reply(23 mds0_inotable [read 0~34 out=34b] v0'0 uv5 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x557b75f32b40 con 0x557b75e91000 2024-09-13T18:35:19.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.393+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:24 8.1b 8:dbae76b5:::mds1_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557b7550b800 con 0x557b75e91800 2024-09-13T18:35:19.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.393+0000 7f089fe48700 1 -- 172.21.15.44:0/1664163150 <== osd.4 v2:172.21.15.99:6816/2515272044 7 ==== osd_op_reply(24 mds1_inotable [read 0~4194304] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x557b75f32d80 con 0x557b75e91800 2024-09-13T18:35:19.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 -1 consume_inos: unable to read inotable 'mds1_inotable': (2) No such file or directory 2024-09-13T18:35:19.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 main_event: Error updating InoTable for 1 consume inos: (2) No such file or directory 2024-09-13T18:35:19.401 INFO:teuthology.orchestra.run.smithi044.stdout:Events by type: 2024-09-13T18:35:19.401 INFO:teuthology.orchestra.run.smithi044.stdout: SUBTREEMAP: 1 2024-09-13T18:35:19.401 INFO:teuthology.orchestra.run.smithi044.stdout: UPDATE: 2 2024-09-13T18:35:19.401 INFO:teuthology.orchestra.run.smithi044.stdout:Errors: 0 2024-09-13T18:35:19.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x557b754ef000 msgr2=0x557b75151180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x557b754ef000 0x557b75151180 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x557b754ef800 msgr2=0x557b75151700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x557b754ef800 0x557b75151700 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x557b75e91000 msgr2=0x557b75150680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x557b75e91000 0x557b75150680 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x557b75e91800 msgr2=0x557b75150c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x557b75e91800 0x557b75150c00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f089f647700 1 -- 172.21.15.44:0/1664163150 reap_dead start 2024-09-13T18:35:19.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f089f647700 1 -- 172.21.15.44:0/1664163150 reap_dead start 2024-09-13T18:35:19.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x557b754ee000 msgr2=0x557b754f0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x557b754ee000 0x557b754f0000 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x557b750ffe30 tx=0x557b7517f260 comp rx=0 tx=0).stop 2024-09-13T18:35:19.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b75e90c00 msgr2=0x557b75150100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b75e90c00 0x557b75150100 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x557b751bbfb0 tx=0x557b7517f080 comp rx=0 tx=0).stop 2024-09-13T18:35:19.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 shutdown_connections 2024-09-13T18:35:19.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x557b754ee000 0x557b754f0000 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 --2- 172.21.15.44:0/1664163150 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b75e90c00 0x557b75150100 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 >> 172.21.15.44:0/1664163150 conn(0x557b750a8c00 msgr2=0x557b75199800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 shutdown_connections 2024-09-13T18:35:19.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 -- 172.21.15.44:0/1664163150 wait complete. 2024-09-13T18:35:19.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 -- 172.21.15.44:0/2397102214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b750a9400 msgr2=0x557b7514f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 --2- 172.21.15.44:0/2397102214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b750a9400 0x557b7514f600 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x557b751bb350 tx=0x557b75ea4cc0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 -- 172.21.15.44:0/2397102214 shutdown_connections 2024-09-13T18:35:19.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 --2- 172.21.15.44:0/2397102214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557b750a9000 0x557b7514f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 --2- 172.21.15.44:0/2397102214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b750a9400 0x557b7514f600 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 --2- 172.21.15.44:0/2397102214 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557b750a9800 0x557b7514fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 -- 172.21.15.44:0/2397102214 >> 172.21.15.44:0/2397102214 conn(0x557b750a9c00 msgr2=0x557b75199000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 -- 172.21.15.44:0/2397102214 shutdown_connections 2024-09-13T18:35:19.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.397+0000 7f08a0e8d500 1 -- 172.21.15.44:0/2397102214 wait complete. 2024-09-13T18:35:19.407 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'recover_dentries', 'summary'] in time 0:00:00.111969, result: Events by type: SUBTREEMAP: 1 UPDATE: 2 Errors: 0 2024-09-13T18:35:19.407 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-journal-tool --debug-mds=1 --debug-objecter=1 --rank cephfs:1 event recover_dentries summary 2024-09-13T18:35:19.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.441+0000 7fd0a13e6500 1 -- start start 2024-09-13T18:35:19.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.441+0000 7fd0a13e6500 1 Processor -- start 2024-09-13T18:35:19.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.441+0000 7fd0a13e6500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f586ad000 0x557f58752b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.441+0000 7fd0a13e6500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f586ad800 0x557f58753080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.441+0000 7fd0a13e6500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f586adc00 0x557f58753600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.441+0000 7fd0a13e6500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f5872ea00 con 0x557f586adc00 2024-09-13T18:35:19.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.441+0000 7fd0a13e6500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f5872e780 con 0x557f586ad000 2024-09-13T18:35:19.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.441+0000 7fd0a13e6500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f5872e640 con 0x557f586ad800 2024-09-13T18:35:19.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd0a03a1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f586adc00 0x557f58753600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd0a03a1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f586adc00 0x557f58753600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39862/0 (socket says 172.21.15.44:39862) 2024-09-13T18:35:19.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd0a03a1700 1 -- 172.21.15.44:0/3697401854 learned_addr learned my addr 172.21.15.44:0/3697401854 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:19.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd09fba0700 1 --2- 172.21.15.44:0/3697401854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f586ad000 0x557f58752b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd0a03a1700 1 -- 172.21.15.44:0/3697401854 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f586ad800 msgr2=0x557f58753080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd0a03a1700 1 --2- 172.21.15.44:0/3697401854 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f586ad800 0x557f58753080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd0a03a1700 1 -- 172.21.15.44:0/3697401854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f586ad000 msgr2=0x557f58752b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd0a03a1700 1 --2- 172.21.15.44:0/3697401854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f586ad000 0x557f58752b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd0a03a1700 1 -- 172.21.15.44:0/3697401854 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f586d09c0 con 0x557f586adc00 2024-09-13T18:35:19.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd09fba0700 1 --2- 172.21.15.44:0/3697401854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f586ad000 0x557f58752b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:19.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd0a03a1700 1 --2- 172.21.15.44:0/3697401854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f586adc00 0x557f58753600 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x557f587bf230 tx=0x557f5952ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa02b55fa7ae122 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd09d39b700 1 -- 172.21.15.44:0/3697401854 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557f586fd600 con 0x557f586adc00 2024-09-13T18:35:19.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd09d39b700 1 -- 172.21.15.44:0/3697401854 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557f586f8480 con 0x557f586adc00 2024-09-13T18:35:19.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd09d39b700 1 -- 172.21.15.44:0/3697401854 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557f586fd1e0 con 0x557f586adc00 2024-09-13T18:35:19.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd0a13e6500 1 -- 172.21.15.44:0/3697401854 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f586d0b60 con 0x557f586adc00 2024-09-13T18:35:19.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd0a13e6500 1 -- 172.21.15.44:0/3697401854 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x557f586d0340 con 0x557f586adc00 2024-09-13T18:35:19.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd09d39b700 1 -- 172.21.15.44:0/3697401854 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x557f586e6c40 con 0x557f586adc00 2024-09-13T18:35:19.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd09d39b700 1 -- 172.21.15.44:0/3697401854 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 56) v1 ==== 2044+0+0 (secure 0 0 0) 0x557f59536000 con 0x557f586adc00 2024-09-13T18:35:19.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd0a13e6500 1 Processor -- start 2024-09-13T18:35:19.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd0a13e6500 1 -- start start 2024-09-13T18:35:19.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd0a13e6500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f59532800 0x557f58753b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd0a13e6500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f59532c00 0x557f58754100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd0a13e6500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f59533000 0x557f58754680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd0a13e6500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f586e3e00 con 0x557f59533000 2024-09-13T18:35:19.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd0a13e6500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f5872e780 con 0x557f59532800 2024-09-13T18:35:19.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd0a13e6500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f5872e500 con 0x557f59532c00 2024-09-13T18:35:19.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd09f39f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f59533000 0x557f58754680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd09f39f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f59533000 0x557f58754680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39864/0 (socket says 172.21.15.44:39864) 2024-09-13T18:35:19.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd09f39f700 1 -- 172.21.15.44:0/282051862 learned_addr learned my addr 172.21.15.44:0/282051862 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:19.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd09fba0700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f59532c00 0x557f58754100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.445+0000 7fd09f39f700 1 --2- 172.21.15.44:0/282051862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f59532800 0x557f58753b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd09fba0700 1 -- 172.21.15.44:0/282051862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f59532800 msgr2=0x557f58753b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd09fba0700 1 --2- 172.21.15.44:0/282051862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f59532800 0x557f58753b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd09fba0700 1 -- 172.21.15.44:0/282051862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f59533000 msgr2=0x557f58754680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd09fba0700 1 --2- 172.21.15.44:0/282051862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f59533000 0x557f58754680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd09fba0700 1 -- 172.21.15.44:0/282051862 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f586d0000 con 0x557f59532c00 2024-09-13T18:35:19.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd09f39f700 1 --2- 172.21.15.44:0/282051862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f59533000 0x557f58754680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:19.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd09fba0700 1 --2- 172.21.15.44:0/282051862 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f59532c00 0x557f58754100 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x557f589aa720 tx=0x557f58a080c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb9567f3cd650833 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd09b397700 1 -- 172.21.15.44:0/282051862 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557f586fd600 con 0x557f59532c00 2024-09-13T18:35:19.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd09b397700 1 -- 172.21.15.44:0/282051862 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557f5949ca80 con 0x557f59532c00 2024-09-13T18:35:19.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd09b397700 1 -- 172.21.15.44:0/282051862 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557f586fd1e0 con 0x557f59532c00 2024-09-13T18:35:19.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd0a13e6500 1 -- 172.21.15.44:0/282051862 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f59532c00 msgr2=0x557f58754100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd0a13e6500 1 --2- 172.21.15.44:0/282051862 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f59532c00 0x557f58754100 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x557f589aa720 tx=0x557f58a080c0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd0a13e6500 1 -- 172.21.15.44:0/282051862 shutdown_connections 2024-09-13T18:35:19.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd0a13e6500 1 --2- 172.21.15.44:0/282051862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f59533000 0x557f58754680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd0a13e6500 1 --2- 172.21.15.44:0/282051862 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f59532c00 0x557f58754100 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd0a13e6500 1 --2- 172.21.15.44:0/282051862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f59532800 0x557f58753b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd0a13e6500 1 -- 172.21.15.44:0/282051862 >> 172.21.15.44:0/282051862 conn(0x557f59532400 msgr2=0x557f5879d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd0a13e6500 1 -- 172.21.15.44:0/282051862 shutdown_connections 2024-09-13T18:35:19.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd0a13e6500 1 -- 172.21.15.44:0/282051862 wait complete. 2024-09-13T18:35:19.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd0a13e6500 1 Processor -- start 2024-09-13T18:35:19.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd0a13e6500 1 -- start start 2024-09-13T18:35:19.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd0a13e6500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f59532800 0x557f58753b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd0a13e6500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f59532c00 0x557f58754100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd0a13e6500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f59533000 0x557f58754680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd0a13e6500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f5872e3c0 con 0x557f59533000 2024-09-13T18:35:19.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd0a13e6500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f5872e280 con 0x557f59532c00 2024-09-13T18:35:19.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd0a13e6500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f5872e140 con 0x557f59532800 2024-09-13T18:35:19.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd09f39f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f59533000 0x557f58754680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd09f39f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f59533000 0x557f58754680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39876/0 (socket says 172.21.15.44:39876) 2024-09-13T18:35:19.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd09f39f700 1 -- 172.21.15.44:0/1563667069 learned_addr learned my addr 172.21.15.44:0/1563667069 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:19.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd09f39f700 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f59532800 0x557f58753b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.449+0000 7fd09fba0700 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f59532c00 0x557f58754100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.453+0000 7fd09f39f700 1 -- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f59532800 msgr2=0x557f58753b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.453+0000 7fd09f39f700 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f59532800 0x557f58753b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.453+0000 7fd09f39f700 1 -- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f59532c00 msgr2=0x557f58754100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.453+0000 7fd09f39f700 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f59532c00 0x557f58754100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.453+0000 7fd09f39f700 1 -- 172.21.15.44:0/1563667069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f586d09c0 con 0x557f59533000 2024-09-13T18:35:19.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.453+0000 7fd09f39f700 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f59533000 0x557f58754680 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x557f589ab3b0 tx=0x557f587832c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.453+0000 7fd099b94700 1 -- 172.21.15.44:0/1563667069 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557f586fd080 con 0x557f59533000 2024-09-13T18:35:19.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.453+0000 7fd099b94700 1 -- 172.21.15.44:0/1563667069 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557f5949d380 con 0x557f59533000 2024-09-13T18:35:19.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.453+0000 7fd099b94700 1 -- 172.21.15.44:0/1563667069 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557f586fd600 con 0x557f59533000 2024-09-13T18:35:19.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.453+0000 7fd0a13e6500 1 -- 172.21.15.44:0/1563667069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557f586d0b60 con 0x557f59533000 2024-09-13T18:35:19.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.453+0000 7fd0a13e6500 1 -- 172.21.15.44:0/1563667069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f586d0ea0 con 0x557f59533000 2024-09-13T18:35:19.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.453+0000 7fd099b94700 1 -- 172.21.15.44:0/1563667069 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x557f5870c840 con 0x557f59533000 2024-09-13T18:35:19.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.453+0000 7fd099b94700 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x557f59533400 0x557f58755700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.457+0000 7fd099b94700 1 -- 172.21.15.44:0/1563667069 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x557f586e6a80 con 0x557f59533000 2024-09-13T18:35:19.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.457+0000 7fd0a13e6500 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x557f59533800 0x557f58754c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.457+0000 7fd0a13e6500 1 -- 172.21.15.44:0/1563667069 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:1 8.5 8:a6e36b3f:::401.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557f59533c00 con 0x557f59533800 2024-09-13T18:35:19.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.457+0000 7fd09fba0700 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x557f59533400 0x557f58755700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.457+0000 7fd09f39f700 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x557f59533800 0x557f58754c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.457+0000 7fd09fba0700 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x557f59533400 0x557f58755700 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x557f589aa720 tx=0x557f58a08000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.457+0000 7fd09f39f700 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x557f59533800 0x557f58754c00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.461+0000 7fd09f39f700 1 -- 172.21.15.44:0/1563667069 <== osd.6 v2:172.21.15.99:6808/2907584318 1 ==== osd_op_reply(1 401.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x557f5941ab40 con 0x557f59533800 2024-09-13T18:35:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.461+0000 7fd0a13e6500 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x557f58afc000 0x557f58755180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.461+0000 7fd0a13e6500 1 -- 172.21.15.44:0/1563667069 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- osd_op(unknown.0.0:2 8.17 8:ea85266a:::201.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557f58afc400 con 0x557f58afc000 2024-09-13T18:35:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.461+0000 7fd0a03a1700 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x557f58afc000 0x557f58755180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.465+0000 7fd0a03a1700 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x557f58afc000 0x557f58755180 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.469+0000 7fd0a03a1700 1 -- 172.21.15.44:0/1563667069 <== osd.7 v2:172.21.15.99:6824/2245335901 1 ==== osd_op_reply(2 201.00000000 [read 0~90 out=90b] v0'0 uv8 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x557f5941ad80 con 0x557f58afc000 2024-09-13T18:35:19.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.469+0000 7fd0a13e6500 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x557f58afc800 0x557f58b06000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.469+0000 7fd0a13e6500 1 -- 172.21.15.44:0/1563667069 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:3 8.1b 8:db457a8a:::201.00000001:head [read 2548043~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557f58afcc00 con 0x557f58afc800 2024-09-13T18:35:19.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.469+0000 7fd09fba0700 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x557f58afc800 0x557f58b06000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.469+0000 7fd09fba0700 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x557f58afc800 0x557f58b06000 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.473+0000 7fd09fba0700 1 -- 172.21.15.44:0/1563667069 <== osd.4 v2:172.21.15.99:6816/2515272044 1 ==== osd_op_reply(3 201.00000001 [read 2548043~1740 out=1740b] v0'0 uv1787 ondisk = 0) v8 ==== 156+0+1740 (crc 0 0 0) 0x557f5941afc0 con 0x557f58afc800 2024-09-13T18:35:19.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.473+0000 7fd0a13e6500 1 -- 172.21.15.44:0/1563667069 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:4 8.1b 8:d80f8093:::201.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557f58afd000 con 0x557f58afc800 2024-09-13T18:35:19.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.473+0000 7fd09fba0700 1 -- 172.21.15.44:0/1563667069 <== osd.4 v2:172.21.15.99:6816/2515272044 2 ==== osd_op_reply(4 201.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x557f5941afc0 con 0x557f58afc800 2024-09-13T18:35:19.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.473+0000 7fd0a13e6500 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x557f58afd400 0x557f58b06580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.473+0000 7fd0a13e6500 1 -- 172.21.15.44:0/1563667069 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:5 8.3 8:c112adae:::101.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557f58afcc00 con 0x557f58afd400 2024-09-13T18:35:19.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.473+0000 7fd09f39f700 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x557f58afd400 0x557f58b06580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.473+0000 7fd09f39f700 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x557f58afd400 0x557f58b06580 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.473+0000 7fd09f39f700 1 -- 172.21.15.44:0/1563667069 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== osd_op_reply(5 101.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x557f5941ab40 con 0x557f58afd400 2024-09-13T18:35:19.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.473+0000 7fd0a13e6500 1 -- 172.21.15.44:0/1563667069 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:6 8.3 8:c112adae:::101.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557f58afd000 con 0x557f58afd400 2024-09-13T18:35:19.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.473+0000 7fd09f39f700 1 -- 172.21.15.44:0/1563667069 <== osd.1 v2:172.21.15.44:6816/2250405239 2 ==== osd_op_reply(6 101.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+4 (crc 0 0 0) 0x557f5941ab40 con 0x557f58afd400 2024-09-13T18:35:19.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.473+0000 7fd0a13e6500 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x557f58afd800 0x557f58b06b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.473+0000 7fd0a13e6500 1 -- 172.21.15.44:0/1563667069 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:7 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557f58afdc00 con 0x557f58afd800 2024-09-13T18:35:19.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.473+0000 7fd0a03a1700 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x557f58afd800 0x557f58b06b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd0a03a1700 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x557f58afd800 0x557f58b06b00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd0a03a1700 1 -- 172.21.15.44:0/1563667069 <== osd.0 v2:172.21.15.44:6800/2647753462 1 ==== osd_op_reply(7 1.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x557f5941ad80 con 0x557f58afd800 2024-09-13T18:35:19.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd0a13e6500 1 -- 172.21.15.44:0/1563667069 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:8 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557f58afcc00 con 0x557f58afd800 2024-09-13T18:35:19.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd0a03a1700 1 -- 172.21.15.44:0/1563667069 <== osd.0 v2:172.21.15.44:6800/2647753462 2 ==== osd_op_reply(8 1.00000000 [omap-get-vals-by-keys out=522b] v0'0 uv10 ondisk = 0) v8 ==== 154+0+522 (crc 0 0 0) 0x557f5941ad80 con 0x557f58afd800 2024-09-13T18:35:19.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd0a13e6500 1 -- 172.21.15.44:0/1563667069 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:9 8.7 8:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557f59533c00 con 0x557f58afd400 2024-09-13T18:35:19.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd09f39f700 1 -- 172.21.15.44:0/1563667069 <== osd.1 v2:172.21.15.44:6816/2250405239 3 ==== osd_op_reply(9 10000000001.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x557f5941ab40 con 0x557f58afd400 2024-09-13T18:35:19.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd0a13e6500 1 -- 172.21.15.44:0/1563667069 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:10 8.7 8:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x557f58afc400 con 0x557f58afd400 2024-09-13T18:35:19.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd09f39f700 1 -- 172.21.15.44:0/1563667069 <== osd.1 v2:172.21.15.44:6816/2250405239 4 ==== osd_op_reply(10 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x557f5941ab40 con 0x557f58afd400 2024-09-13T18:35:19.484 INFO:teuthology.orchestra.run.smithi044.stdout:Events by type: 2024-09-13T18:35:19.484 INFO:teuthology.orchestra.run.smithi044.stdout: SUBTREEMAP: 1 2024-09-13T18:35:19.484 INFO:teuthology.orchestra.run.smithi044.stdout:Errors: 0 2024-09-13T18:35:19.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd0a13e6500 1 -- 172.21.15.44:0/1563667069 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x557f58afd800 msgr2=0x557f58b06b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd0a13e6500 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x557f58afd800 0x557f58b06b00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd0a13e6500 1 -- 172.21.15.44:0/1563667069 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x557f58afd400 msgr2=0x557f58b06580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd0a13e6500 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x557f58afd400 0x557f58b06580 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd0a13e6500 1 -- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x557f58afc800 msgr2=0x557f58b06000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd0a13e6500 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x557f58afc800 0x557f58b06000 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd0a13e6500 1 -- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x557f59533800 msgr2=0x557f58754c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd0a13e6500 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x557f59533800 0x557f58754c00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd09fba0700 1 -- 172.21.15.44:0/1563667069 reap_dead start 2024-09-13T18:35:19.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd0a13e6500 1 -- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x557f58afc000 msgr2=0x557f58755180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd0a13e6500 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x557f58afc000 0x557f58755180 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd09fba0700 1 -- 172.21.15.44:0/1563667069 reap_dead start 2024-09-13T18:35:19.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd0a13e6500 1 -- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x557f59533400 msgr2=0x557f58755700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd0a13e6500 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x557f59533400 0x557f58755700 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x557f589aa720 tx=0x557f58a08000 comp rx=0 tx=0).stop 2024-09-13T18:35:19.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd0a13e6500 1 -- 172.21.15.44:0/1563667069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f59533000 msgr2=0x557f58754680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.477+0000 7fd0a13e6500 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f59533000 0x557f58754680 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x557f589ab3b0 tx=0x557f587832c0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.481+0000 7fd0a13e6500 1 -- 172.21.15.44:0/1563667069 shutdown_connections 2024-09-13T18:35:19.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.481+0000 7fd0a13e6500 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x557f59533400 0x557f58755700 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.481+0000 7fd0a13e6500 1 --2- 172.21.15.44:0/1563667069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f59533000 0x557f58754680 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.481+0000 7fd0a13e6500 1 -- 172.21.15.44:0/1563667069 >> 172.21.15.44:0/1563667069 conn(0x557f59532400 msgr2=0x557f5879d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.481+0000 7fd0a13e6500 1 -- 172.21.15.44:0/1563667069 shutdown_connections 2024-09-13T18:35:19.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.481+0000 7fd0a13e6500 1 -- 172.21.15.44:0/1563667069 wait complete. 2024-09-13T18:35:19.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.481+0000 7fd0a13e6500 1 -- 172.21.15.44:0/3697401854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f586adc00 msgr2=0x557f58753600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.481+0000 7fd0a13e6500 1 --2- 172.21.15.44:0/3697401854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f586adc00 0x557f58753600 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x557f587bf230 tx=0x557f5952ec60 comp rx=0 tx=0).stop 2024-09-13T18:35:19.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.481+0000 7fd0a13e6500 1 -- 172.21.15.44:0/3697401854 shutdown_connections 2024-09-13T18:35:19.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.481+0000 7fd0a13e6500 1 --2- 172.21.15.44:0/3697401854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f586adc00 0x557f58753600 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.481+0000 7fd0a13e6500 1 --2- 172.21.15.44:0/3697401854 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x557f586ad800 0x557f58753080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.481+0000 7fd0a13e6500 1 --2- 172.21.15.44:0/3697401854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f586ad000 0x557f58752b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.481+0000 7fd0a13e6500 1 -- 172.21.15.44:0/3697401854 >> 172.21.15.44:0/3697401854 conn(0x557f586acc00 msgr2=0x557f5879d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.481+0000 7fd0a13e6500 1 -- 172.21.15.44:0/3697401854 shutdown_connections 2024-09-13T18:35:19.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.481+0000 7fd0a13e6500 1 -- 172.21.15.44:0/3697401854 wait complete. 2024-09-13T18:35:19.491 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=1', '--debug-objecter=1', '--rank', 'cephfs:1', 'event', 'recover_dentries', 'summary'] in time 0:00:00.083280, result: Events by type: SUBTREEMAP: 1 Errors: 0 2024-09-13T18:35:19.491 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 reset session 2024-09-13T18:35:19.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.525+0000 7fcbbb4e9500 1 -- start start 2024-09-13T18:35:19.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.525+0000 7fcbbb4e9500 1 Processor -- start 2024-09-13T18:35:19.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbbb4e9500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55758a731800 0x55758a7d6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbbb4e9500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55758a731400 0x55758a7d6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbbb4e9500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55758a731000 0x55758a7d7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbbb4e9500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55758a7b2a00 con 0x55758a731000 2024-09-13T18:35:19.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbbb4e9500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55758a7b2780 con 0x55758a731800 2024-09-13T18:35:19.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbbb4e9500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55758a7b2640 con 0x55758a731400 2024-09-13T18:35:19.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbb9ca3700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55758a731800 0x55758a7d6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbba4a4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55758a731000 0x55758a7d7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbb94a2700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55758a731400 0x55758a7d6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbb9ca3700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55758a731800 0x55758a7d6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:46980/0 (socket says 172.21.15.44:46980) 2024-09-13T18:35:19.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbb9ca3700 1 -- 172.21.15.44:0/4232717579 learned_addr learned my addr 172.21.15.44:0/4232717579 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:19.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbb9ca3700 1 -- 172.21.15.44:0/4232717579 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55758a731400 msgr2=0x55758a7d6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbb9ca3700 1 --2- 172.21.15.44:0/4232717579 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55758a731400 0x55758a7d6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbb9ca3700 1 -- 172.21.15.44:0/4232717579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55758a731000 msgr2=0x55758a7d7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbb9ca3700 1 --2- 172.21.15.44:0/4232717579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55758a731000 0x55758a7d7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbb9ca3700 1 -- 172.21.15.44:0/4232717579 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55758a7549c0 con 0x55758a731800 2024-09-13T18:35:19.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbb9ca3700 1 --2- 172.21.15.44:0/4232717579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55758a731800 0x55758a7d6580 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55758a890de0 tx=0x55758b5b8480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcae72b04f214dd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbb749e700 1 -- 172.21.15.44:0/4232717579 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55758a781600 con 0x55758a731800 2024-09-13T18:35:19.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbb749e700 1 -- 172.21.15.44:0/4232717579 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55758a77c480 con 0x55758a731800 2024-09-13T18:35:19.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbb749e700 1 -- 172.21.15.44:0/4232717579 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55758a7811e0 con 0x55758a731800 2024-09-13T18:35:19.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbbb4e9500 1 -- 172.21.15.44:0/4232717579 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55758a754b60 con 0x55758a731800 2024-09-13T18:35:19.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbbb4e9500 1 -- 172.21.15.44:0/4232717579 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55758a754340 con 0x55758a731800 2024-09-13T18:35:19.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbbb4e9500 4 waiting for MDS map... 2024-09-13T18:35:19.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbb749e700 1 -- 172.21.15.44:0/4232717579 <== mon.1 v2:172.21.15.99:3300/0 4 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x55758a76ac40 con 0x55758a731800 2024-09-13T18:35:19.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbb749e700 1 -- 172.21.15.44:0/4232717579 <== mon.1 v2:172.21.15.99:3300/0 5 ==== fsmap(e 56) v1 ==== 2044+0+0 (secure 0 0 0) 0x55758aa32000 con 0x55758a731800 2024-09-13T18:35:19.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbbb4e9500 4 Got MDS map 56 2024-09-13T18:35:19.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbbb4e9500 10 main: main 2024-09-13T18:35:19.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbbb4e9500 4 main: connecting to RADOS... 2024-09-13T18:35:19.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbbb4e9500 1 Processor -- start 2024-09-13T18:35:19.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.529+0000 7fcbbb4e9500 1 -- start start 2024-09-13T18:35:19.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbbb4e9500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55758aa28400 0x55758a7d7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbbb4e9500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55758aa28800 0x55758a7d7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbbb4e9500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55758aa28c00 0x55758a7d8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbbb4e9500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55758a767e00 con 0x55758aa28c00 2024-09-13T18:35:19.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbbb4e9500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55758a7b2a00 con 0x55758aa28400 2024-09-13T18:35:19.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbbb4e9500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55758a7b2500 con 0x55758aa28800 2024-09-13T18:35:19.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbb94a2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55758aa28c00 0x55758a7d8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbba4a4700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55758aa28400 0x55758a7d7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbb9ca3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55758aa28800 0x55758a7d7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbb94a2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55758aa28c00 0x55758a7d8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39898/0 (socket says 172.21.15.44:39898) 2024-09-13T18:35:19.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbb94a2700 1 -- 172.21.15.44:0/2187114864 learned_addr learned my addr 172.21.15.44:0/2187114864 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:19.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbba4a4700 1 -- 172.21.15.44:0/2187114864 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55758aa28800 msgr2=0x55758a7d7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbba4a4700 1 --2- 172.21.15.44:0/2187114864 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55758aa28800 0x55758a7d7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbba4a4700 1 -- 172.21.15.44:0/2187114864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55758aa28c00 msgr2=0x55758a7d8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbba4a4700 1 --2- 172.21.15.44:0/2187114864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55758aa28c00 0x55758a7d8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbba4a4700 1 -- 172.21.15.44:0/2187114864 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55758a754000 con 0x55758aa28400 2024-09-13T18:35:19.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbb9ca3700 1 --2- 172.21.15.44:0/2187114864 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55758aa28800 0x55758a7d7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:19.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbb94a2700 1 --2- 172.21.15.44:0/2187114864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55758aa28c00 0x55758a7d8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:19.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbba4a4700 1 --2- 172.21.15.44:0/2187114864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55758aa28400 0x55758a7d7600 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x55758aa92150 tx=0x55758aa8c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a521558c4a6c150a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbb549a700 1 -- 172.21.15.44:0/2187114864 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55758a781600 con 0x55758aa28400 2024-09-13T18:35:19.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbb549a700 1 -- 172.21.15.44:0/2187114864 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55758b51e300 con 0x55758aa28400 2024-09-13T18:35:19.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbb549a700 1 -- 172.21.15.44:0/2187114864 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55758a7811e0 con 0x55758aa28400 2024-09-13T18:35:19.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbbb4e9500 1 -- 172.21.15.44:0/2187114864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55758aa28400 msgr2=0x55758a7d7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbbb4e9500 1 --2- 172.21.15.44:0/2187114864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55758aa28400 0x55758a7d7600 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x55758aa92150 tx=0x55758aa8c420 comp rx=0 tx=0).stop 2024-09-13T18:35:19.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbbb4e9500 1 -- 172.21.15.44:0/2187114864 shutdown_connections 2024-09-13T18:35:19.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbbb4e9500 1 --2- 172.21.15.44:0/2187114864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55758aa28c00 0x55758a7d8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbbb4e9500 1 --2- 172.21.15.44:0/2187114864 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55758aa28800 0x55758a7d7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbbb4e9500 1 --2- 172.21.15.44:0/2187114864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55758aa28400 0x55758a7d7600 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbbb4e9500 1 -- 172.21.15.44:0/2187114864 >> 172.21.15.44:0/2187114864 conn(0x55758a730c00 msgr2=0x55758a821800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbbb4e9500 1 -- 172.21.15.44:0/2187114864 shutdown_connections 2024-09-13T18:35:19.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.533+0000 7fcbbb4e9500 1 -- 172.21.15.44:0/2187114864 wait complete. 2024-09-13T18:35:19.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbbb4e9500 1 Processor -- start 2024-09-13T18:35:19.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbbb4e9500 1 -- start start 2024-09-13T18:35:19.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbbb4e9500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55758aa28400 0x55758a7d9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbbb4e9500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55758aa28800 0x55758a7d8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbbb4e9500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55758aa28c00 0x55758a7d8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbbb4e9500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55758a7b23c0 con 0x55758aa28800 2024-09-13T18:35:19.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbbb4e9500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55758a7b2280 con 0x55758aa28c00 2024-09-13T18:35:19.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbbb4e9500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55758a7b2140 con 0x55758aa28400 2024-09-13T18:35:19.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbb9ca3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55758aa28800 0x55758a7d8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbb9ca3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55758aa28800 0x55758a7d8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39914/0 (socket says 172.21.15.44:39914) 2024-09-13T18:35:19.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbb9ca3700 1 -- 172.21.15.44:0/383557195 learned_addr learned my addr 172.21.15.44:0/383557195 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:19.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbba4a4700 1 --2- 172.21.15.44:0/383557195 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55758aa28400 0x55758a7d9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbb94a2700 1 --2- 172.21.15.44:0/383557195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55758aa28c00 0x55758a7d8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbb9ca3700 1 -- 172.21.15.44:0/383557195 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55758aa28400 msgr2=0x55758a7d9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbb9ca3700 1 --2- 172.21.15.44:0/383557195 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55758aa28400 0x55758a7d9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbb9ca3700 1 -- 172.21.15.44:0/383557195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55758aa28c00 msgr2=0x55758a7d8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbb9ca3700 1 --2- 172.21.15.44:0/383557195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55758aa28c00 0x55758a7d8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbb9ca3700 1 -- 172.21.15.44:0/383557195 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55758a7549c0 con 0x55758aa28800 2024-09-13T18:35:19.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbb9ca3700 1 --2- 172.21.15.44:0/383557195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55758aa28800 0x55758a7d8c00 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x55758a8911d0 tx=0x55758a807020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbb3c97700 1 -- 172.21.15.44:0/383557195 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55758a780f20 con 0x55758aa28800 2024-09-13T18:35:19.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbb3c97700 1 -- 172.21.15.44:0/383557195 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55758b51ec00 con 0x55758aa28800 2024-09-13T18:35:19.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbbb4e9500 1 -- 172.21.15.44:0/383557195 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55758a754b60 con 0x55758aa28800 2024-09-13T18:35:19.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbb3c97700 1 -- 172.21.15.44:0/383557195 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55758a781600 con 0x55758aa28800 2024-09-13T18:35:19.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbbb4e9500 1 -- 172.21.15.44:0/383557195 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55758a754ea0 con 0x55758aa28800 2024-09-13T18:35:19.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.537+0000 7fcbbb4e9500 4 main: resolving pool 8 2024-09-13T18:35:19.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.541+0000 7fcbb3c97700 1 -- 172.21.15.44:0/383557195 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x55758a790840 con 0x55758aa28800 2024-09-13T18:35:19.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.541+0000 7fcbb3c97700 1 --2- 172.21.15.44:0/383557195 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55758ab82000 0x55758a7d9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.541+0000 7fcbb3c97700 1 -- 172.21.15.44:0/383557195 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x55758a76aa80 con 0x55758aa28800 2024-09-13T18:35:19.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.541+0000 7fcbbb4e9500 4 main: creating IoCtx.. 2024-09-13T18:35:19.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.541+0000 7fcbbb4e9500 1 --2- 172.21.15.44:0/383557195 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55758aa29000 0x55758a7d8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.541+0000 7fcbbb4e9500 1 -- 172.21.15.44:0/383557195 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:1 8.b 8:d0630e4c:::mds0_sessionmap:head [omap-clear,omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66) v8 -- 0x55758aa29400 con 0x55758aa29000 2024-09-13T18:35:19.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.541+0000 7fcbba4a4700 1 --2- 172.21.15.44:0/383557195 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55758ab82000 0x55758a7d9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.541+0000 7fcbb94a2700 1 --2- 172.21.15.44:0/383557195 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55758aa29000 0x55758a7d8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.541+0000 7fcbb94a2700 1 --2- 172.21.15.44:0/383557195 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55758aa29000 0x55758a7d8100 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.541+0000 7fcbba4a4700 1 --2- 172.21.15.44:0/383557195 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55758ab82000 0x55758a7d9700 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x55758aa92150 tx=0x55758b5b80c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.545+0000 7fcbb94a2700 1 -- 172.21.15.44:0/383557195 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(1 mds0_sessionmap [omap-clear,omap-set-header] v66'6 uv6 ondisk = 0) v8 ==== 201+0+0 (crc 0 0 0) 0x55758b512b40 con 0x55758aa29000 2024-09-13T18:35:19.551 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:35:19.551 INFO:teuthology.orchestra.run.smithi044.stdout: "0": { 2024-09-13T18:35:19.551 INFO:teuthology.orchestra.run.smithi044.stdout: "data": {}, 2024-09-13T18:35:19.551 INFO:teuthology.orchestra.run.smithi044.stdout: "result": 0 2024-09-13T18:35:19.551 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:19.551 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:35:19.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:19.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.545+0000 7fcbbb4e9500 1 -- 172.21.15.44:0/383557195 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55758aa29000 msgr2=0x55758a7d8100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.545+0000 7fcbbb4e9500 1 --2- 172.21.15.44:0/383557195 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55758aa29000 0x55758a7d8100 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.545+0000 7fcbbb4e9500 1 -- 172.21.15.44:0/383557195 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55758ab82000 msgr2=0x55758a7d9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.545+0000 7fcbbb4e9500 1 --2- 172.21.15.44:0/383557195 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55758ab82000 0x55758a7d9700 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x55758aa92150 tx=0x55758b5b80c0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.545+0000 7fcbbb4e9500 1 -- 172.21.15.44:0/383557195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55758aa28800 msgr2=0x55758a7d8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.545+0000 7fcbbb4e9500 1 --2- 172.21.15.44:0/383557195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55758aa28800 0x55758a7d8c00 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x55758a8911d0 tx=0x55758a807020 comp rx=0 tx=0).stop 2024-09-13T18:35:19.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.545+0000 7fcbb94a2700 1 -- 172.21.15.44:0/383557195 reap_dead start 2024-09-13T18:35:19.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.545+0000 7fcbbb4e9500 1 -- 172.21.15.44:0/383557195 shutdown_connections 2024-09-13T18:35:19.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.545+0000 7fcbbb4e9500 1 -- 172.21.15.44:0/383557195 >> 172.21.15.44:0/383557195 conn(0x55758a730c00 msgr2=0x55758a821800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.545+0000 7fcbbb4e9500 1 -- 172.21.15.44:0/383557195 shutdown_connections 2024-09-13T18:35:19.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.545+0000 7fcbbb4e9500 1 -- 172.21.15.44:0/383557195 wait complete. 2024-09-13T18:35:19.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.545+0000 7fcbbb4e9500 1 -- 172.21.15.44:0/4232717579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55758a731800 msgr2=0x55758a7d6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.545+0000 7fcbbb4e9500 1 --2- 172.21.15.44:0/4232717579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55758a731800 0x55758a7d6580 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55758a890de0 tx=0x55758b5b8480 comp rx=0 tx=0).stop 2024-09-13T18:35:19.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.545+0000 7fcbbb4e9500 1 -- 172.21.15.44:0/4232717579 shutdown_connections 2024-09-13T18:35:19.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.545+0000 7fcbbb4e9500 1 --2- 172.21.15.44:0/4232717579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55758a731000 0x55758a7d7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.545+0000 7fcbbb4e9500 1 --2- 172.21.15.44:0/4232717579 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55758a731400 0x55758a7d6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.545+0000 7fcbbb4e9500 1 --2- 172.21.15.44:0/4232717579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55758a731800 0x55758a7d6580 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.545+0000 7fcbbb4e9500 1 -- 172.21.15.44:0/4232717579 >> 172.21.15.44:0/4232717579 conn(0x55758a731c00 msgr2=0x55758a821000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.545+0000 7fcbbb4e9500 1 -- 172.21.15.44:0/4232717579 shutdown_connections 2024-09-13T18:35:19.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.545+0000 7fcbbb4e9500 1 -- 172.21.15.44:0/4232717579 wait complete. 2024-09-13T18:35:19.557 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'reset', 'session'] in time 0:00:00.065881, result: { "0": { "data": {}, "result": 0 } } 2024-09-13T18:35:19.557 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --yes-i-really-really-mean-it 2024-09-13T18:35:19.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2ccae500 1 -- start start 2024-09-13T18:35:19.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2ccae500 1 Processor -- start 2024-09-13T18:35:19.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2ccae500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c64d94f800 0x55c64d9f4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2ccae500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64d94f400 0x55c64d9f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2ccae500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c64d94f000 0x55c64d9f5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2ccae500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64d9d0a00 con 0x55c64d94f400 2024-09-13T18:35:19.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2ccae500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64d9d0780 con 0x55c64d94f800 2024-09-13T18:35:19.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2ccae500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c64d9d0640 con 0x55c64d94f000 2024-09-13T18:35:19.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2ac67700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64d94f400 0x55c64d9f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2ac67700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64d94f400 0x55c64d9f4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39924/0 (socket says 172.21.15.44:39924) 2024-09-13T18:35:19.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2b468700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c64d94f800 0x55c64d9f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2bc69700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c64d94f000 0x55c64d9f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2ac67700 1 -- 172.21.15.44:0/3155265755 learned_addr learned my addr 172.21.15.44:0/3155265755 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:19.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2ac67700 1 -- 172.21.15.44:0/3155265755 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c64d94f000 msgr2=0x55c64d9f5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2ac67700 1 --2- 172.21.15.44:0/3155265755 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c64d94f000 0x55c64d9f5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2ac67700 1 -- 172.21.15.44:0/3155265755 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c64d94f800 msgr2=0x55c64d9f4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2ac67700 1 --2- 172.21.15.44:0/3155265755 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c64d94f800 0x55c64d9f4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2ac67700 1 -- 172.21.15.44:0/3155265755 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c64d9729c0 con 0x55c64d94f400 2024-09-13T18:35:19.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2ac67700 1 --2- 172.21.15.44:0/3155265755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64d94f400 0x55c64d9f4b00 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x55c64da612c0 tx=0x55c64e730c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e8fd8cd71aeb96 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb28c63700 1 -- 172.21.15.44:0/3155265755 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c64d99f600 con 0x55c64d94f400 2024-09-13T18:35:19.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb28c63700 1 -- 172.21.15.44:0/3155265755 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c64d99a480 con 0x55c64d94f400 2024-09-13T18:35:19.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2ccae500 1 -- 172.21.15.44:0/3155265755 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c64d972b60 con 0x55c64d94f400 2024-09-13T18:35:19.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2ccae500 1 -- 172.21.15.44:0/3155265755 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55c64d972340 con 0x55c64d94f400 2024-09-13T18:35:19.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2ccae500 4 waiting for MDS map... 2024-09-13T18:35:19.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb28c63700 1 -- 172.21.15.44:0/3155265755 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c64d99f1e0 con 0x55c64d94f400 2024-09-13T18:35:19.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb28c63700 1 -- 172.21.15.44:0/3155265755 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x55c64d988c40 con 0x55c64d94f400 2024-09-13T18:35:19.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb28c63700 1 -- 172.21.15.44:0/3155265755 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 56) v1 ==== 2044+0+0 (secure 0 0 0) 0x55c64dc42900 con 0x55c64d94f400 2024-09-13T18:35:19.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2ccae500 4 Got MDS map 56 2024-09-13T18:35:19.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.597+0000 7ffb2ccae500 10 main: JournalTool::main 2024-09-13T18:35:19.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb2ccae500 4 main: JournalTool: connecting to RADOS... 2024-09-13T18:35:19.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb2ccae500 1 Processor -- start 2024-09-13T18:35:19.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb2ccae500 1 -- start start 2024-09-13T18:35:19.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb2ccae500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64dc4a400 0x55c64d9f5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb2ccae500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c64dc4a800 0x55c64d9f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb2ccae500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c64dc4ac00 0x55c64d9f6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb2ccae500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64d985e00 con 0x55c64dc4a400 2024-09-13T18:35:19.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb2ccae500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64d9d0780 con 0x55c64dc4ac00 2024-09-13T18:35:19.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb2ccae500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c64d9d0500 con 0x55c64dc4a800 2024-09-13T18:35:19.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb2bc69700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64dc4a400 0x55c64d9f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb2bc69700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64dc4a400 0x55c64d9f5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39932/0 (socket says 172.21.15.44:39932) 2024-09-13T18:35:19.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb2bc69700 1 -- 172.21.15.44:0/2423419237 learned_addr learned my addr 172.21.15.44:0/2423419237 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:19.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb2ac67700 1 --2- 172.21.15.44:0/2423419237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c64dc4ac00 0x55c64d9f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb2b468700 1 --2- 172.21.15.44:0/2423419237 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c64dc4a800 0x55c64d9f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb2bc69700 1 -- 172.21.15.44:0/2423419237 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c64dc4a800 msgr2=0x55c64d9f5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb2bc69700 1 --2- 172.21.15.44:0/2423419237 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c64dc4a800 0x55c64d9f5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb2bc69700 1 -- 172.21.15.44:0/2423419237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c64dc4ac00 msgr2=0x55c64d9f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb2bc69700 1 --2- 172.21.15.44:0/2423419237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c64dc4ac00 0x55c64d9f6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb2bc69700 1 -- 172.21.15.44:0/2423419237 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c64d972000 con 0x55c64dc4a400 2024-09-13T18:35:19.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb2ac67700 1 --2- 172.21.15.44:0/2423419237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c64dc4ac00 0x55c64d9f6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:19.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb2bc69700 1 --2- 172.21.15.44:0/2423419237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64dc4a400 0x55c64d9f5600 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x55c64dc5a690 tx=0x55c64dcb6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94fd424eaa50cf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb26c5f700 1 -- 172.21.15.44:0/2423419237 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c64d99f600 con 0x55c64dc4a400 2024-09-13T18:35:19.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb26c5f700 1 -- 172.21.15.44:0/2423419237 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c64d99a480 con 0x55c64dc4a400 2024-09-13T18:35:19.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.601+0000 7ffb26c5f700 1 -- 172.21.15.44:0/2423419237 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c64d99f1e0 con 0x55c64dc4a400 2024-09-13T18:35:19.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.605+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2423419237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64dc4a400 msgr2=0x55c64d9f5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.605+0000 7ffb2ccae500 1 --2- 172.21.15.44:0/2423419237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64dc4a400 0x55c64d9f5600 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x55c64dc5a690 tx=0x55c64dcb6000 comp rx=0 tx=0).stop 2024-09-13T18:35:19.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.605+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2423419237 shutdown_connections 2024-09-13T18:35:19.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.605+0000 7ffb2ccae500 1 --2- 172.21.15.44:0/2423419237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c64dc4ac00 0x55c64d9f6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.605+0000 7ffb2ccae500 1 --2- 172.21.15.44:0/2423419237 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c64dc4a800 0x55c64d9f5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.605+0000 7ffb2ccae500 1 --2- 172.21.15.44:0/2423419237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64dc4a400 0x55c64d9f5600 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.605+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2423419237 >> 172.21.15.44:0/2423419237 conn(0x55c64d94ec00 msgr2=0x55c64da3f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.605+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2423419237 shutdown_connections 2024-09-13T18:35:19.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.605+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2423419237 wait complete. 2024-09-13T18:35:19.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.605+0000 7ffb2ccae500 1 Processor -- start 2024-09-13T18:35:19.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.605+0000 7ffb2ccae500 1 -- start start 2024-09-13T18:35:19.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.605+0000 7ffb2ccae500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64dc4a400 0x55c64d9f7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.605+0000 7ffb2ccae500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c64dc4a800 0x55c64d9f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.605+0000 7ffb2ccae500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c64dc4ac00 0x55c64d9f6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.605+0000 7ffb2ccae500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64d9d03c0 con 0x55c64dc4a400 2024-09-13T18:35:19.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.605+0000 7ffb2ccae500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64d9d0280 con 0x55c64dc4a800 2024-09-13T18:35:19.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.605+0000 7ffb2ccae500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c64d9d0140 con 0x55c64dc4ac00 2024-09-13T18:35:19.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.605+0000 7ffb2bc69700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64dc4a400 0x55c64d9f7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.605+0000 7ffb2bc69700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64dc4a400 0x55c64d9f7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39934/0 (socket says 172.21.15.44:39934) 2024-09-13T18:35:19.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.605+0000 7ffb2bc69700 1 -- 172.21.15.44:0/1784501722 learned_addr learned my addr 172.21.15.44:0/1784501722 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:19.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.605+0000 7ffb2ac67700 1 --2- 172.21.15.44:0/1784501722 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c64dc4ac00 0x55c64d9f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.605+0000 7ffb2b468700 1 --2- 172.21.15.44:0/1784501722 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c64dc4a800 0x55c64d9f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.609+0000 7ffb2ac67700 1 -- 172.21.15.44:0/1784501722 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c64dc4a800 msgr2=0x55c64d9f6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.609+0000 7ffb2ac67700 1 --2- 172.21.15.44:0/1784501722 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c64dc4a800 0x55c64d9f6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.609+0000 7ffb2ac67700 1 -- 172.21.15.44:0/1784501722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64dc4a400 msgr2=0x55c64d9f7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.609+0000 7ffb2ac67700 1 --2- 172.21.15.44:0/1784501722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64dc4a400 0x55c64d9f7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.609+0000 7ffb2ac67700 1 -- 172.21.15.44:0/1784501722 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c64d9729c0 con 0x55c64dc4ac00 2024-09-13T18:35:19.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.609+0000 7ffb2bc69700 1 --2- 172.21.15.44:0/1784501722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64dc4a400 0x55c64d9f7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:19.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.609+0000 7ffb2ac67700 1 --2- 172.21.15.44:0/1784501722 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c64dc4ac00 0x55c64d9f6680 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55c64da61e60 tx=0x55c64da25380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.609+0000 7ffb2545c700 1 -- 172.21.15.44:0/1784501722 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c64d99ef20 con 0x55c64dc4ac00 2024-09-13T18:35:19.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.609+0000 7ffb2545c700 1 -- 172.21.15.44:0/1784501722 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c64da22c00 con 0x55c64dc4ac00 2024-09-13T18:35:19.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.609+0000 7ffb2ccae500 1 -- 172.21.15.44:0/1784501722 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c64d972b60 con 0x55c64dc4ac00 2024-09-13T18:35:19.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.609+0000 7ffb2545c700 1 -- 172.21.15.44:0/1784501722 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c64d99f600 con 0x55c64dc4ac00 2024-09-13T18:35:19.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.609+0000 7ffb2ccae500 1 -- 172.21.15.44:0/1784501722 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c64d972ea0 con 0x55c64dc4ac00 2024-09-13T18:35:19.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.609+0000 7ffb2ccae500 4 main: JournalTool: resolving pool 8 2024-09-13T18:35:19.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.609+0000 7ffb2545c700 1 -- 172.21.15.44:0/1784501722 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x55c64d9ae840 con 0x55c64dc4ac00 2024-09-13T18:35:19.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.609+0000 7ffb2545c700 1 --2- 172.21.15.44:0/1784501722 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55c64dcc2400 0x55c64d9f7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.609+0000 7ffb2545c700 1 -- 172.21.15.44:0/1784501722 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x55c64d988a80 con 0x55c64dc4ac00 2024-09-13T18:35:19.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.609+0000 7ffb2ccae500 4 main: JournalTool: creating IoCtx.. 2024-09-13T18:35:19.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.609+0000 7ffb2ccae500 4 main: Executing for rank 0 2024-09-13T18:35:19.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.613+0000 7ffb2bc69700 1 --2- 172.21.15.44:0/1784501722 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55c64dcc2400 0x55c64d9f7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.613+0000 7ffb2bc69700 1 --2- 172.21.15.44:0/1784501722 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55c64dcc2400 0x55c64d9f7700 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x55c64dc5b2f0 tx=0x55c64e730ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.613+0000 7ffb2ccae500 1 -- start start 2024-09-13T18:35:19.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.613+0000 7ffb2ccae500 1 Processor -- start 2024-09-13T18:35:19.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.613+0000 7ffb2ccae500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c64dc4b400 0x55c64d9f6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.613+0000 7ffb2ccae500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64dc4b800 0x55c64d9f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.613+0000 7ffb2ccae500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c64dcc2800 0x55c64d9f5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.613+0000 7ffb2ccae500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64d9d0280 con 0x55c64dc4b800 2024-09-13T18:35:19.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.613+0000 7ffb2ccae500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64d9d03c0 con 0x55c64dc4b400 2024-09-13T18:35:19.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.613+0000 7ffb2ccae500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c64d9d0500 con 0x55c64dcc2800 2024-09-13T18:35:19.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.613+0000 7ffb2b468700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64dc4b800 0x55c64d9f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.613+0000 7ffb2b468700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64dc4b800 0x55c64d9f5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39950/0 (socket says 172.21.15.44:39950) 2024-09-13T18:35:19.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.613+0000 7ffb2b468700 1 -- 172.21.15.44:0/2310197811 learned_addr learned my addr 172.21.15.44:0/2310197811 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:19.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.613+0000 7ffb2bc69700 1 --2- 172.21.15.44:0/2310197811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c64dc4b400 0x55c64d9f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.613+0000 7ffb2ac67700 1 --2- 172.21.15.44:0/2310197811 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c64dcc2800 0x55c64d9f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.613+0000 7ffb2b468700 1 -- 172.21.15.44:0/2310197811 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c64dcc2800 msgr2=0x55c64d9f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.613+0000 7ffb2b468700 1 --2- 172.21.15.44:0/2310197811 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c64dcc2800 0x55c64d9f5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.613+0000 7ffb2b468700 1 -- 172.21.15.44:0/2310197811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c64dc4b400 msgr2=0x55c64d9f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.613+0000 7ffb2b468700 1 --2- 172.21.15.44:0/2310197811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c64dc4b400 0x55c64d9f6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.613+0000 7ffb2b468700 1 -- 172.21.15.44:0/2310197811 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c64dcef6c0 con 0x55c64dc4b800 2024-09-13T18:35:19.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.617+0000 7ffb2b468700 1 --2- 172.21.15.44:0/2310197811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64dc4b800 0x55c64d9f5b80 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x55c64dd72e40 tx=0x55c64dda3020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2fb175f598db6f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.617+0000 7ffb22456700 1 -- 172.21.15.44:0/2310197811 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c64d99f080 con 0x55c64dc4b800 2024-09-13T18:35:19.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.617+0000 7ffb22456700 1 -- 172.21.15.44:0/2310197811 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c64d99a180 con 0x55c64dc4b800 2024-09-13T18:35:19.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.617+0000 7ffb22456700 1 -- 172.21.15.44:0/2310197811 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c64d99e6e0 con 0x55c64dc4b800 2024-09-13T18:35:19.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.617+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2310197811 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c64dceda00 con 0x55c64dc4b800 2024-09-13T18:35:19.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.617+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2310197811 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55c64dced860 con 0x55c64dc4b800 2024-09-13T18:35:19.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.617+0000 7ffb2ccae500 4 waiting for MDS map... 2024-09-13T18:35:19.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.617+0000 7ffb22456700 1 -- 172.21.15.44:0/2310197811 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x55c64d988700 con 0x55c64dc4b800 2024-09-13T18:35:19.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.617+0000 7ffb22456700 1 -- 172.21.15.44:0/2310197811 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 56) v1 ==== 2044+0+0 (secure 0 0 0) 0x55c64d990f00 con 0x55c64dc4b800 2024-09-13T18:35:19.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.617+0000 7ffb2ccae500 4 Got MDS map 56 2024-09-13T18:35:19.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.617+0000 7ffb2ccae500 1 --2- 172.21.15.44:0/2310197811 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55c64dcc2c00 0x55c64de12000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.617+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2310197811 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:1 8.f 8:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x55c64dcc3000 con 0x55c64dcc2c00 2024-09-13T18:35:19.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.617+0000 7ffb2bc69700 1 --2- 172.21.15.44:0/2310197811 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55c64dcc2c00 0x55c64de12000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.617+0000 7ffb2bc69700 1 --2- 172.21.15.44:0/2310197811 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55c64dcc2c00 0x55c64de12000 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=88f5962f42d9ce9d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.617+0000 7ffb2bc69700 1 -- 172.21.15.44:0/2310197811 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55c64e7d0b40 con 0x55c64dcc2c00 2024-09-13T18:35:19.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.617+0000 7ffb2ccae500 1 --2- 172.21.15.44:0/2310197811 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x55c64dcc3400 0x55c64de12580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.617+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2310197811 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:2 8.14 8:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x55c64dcc3800 con 0x55c64dcc3400 2024-09-13T18:35:19.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.617+0000 7ffb2ac67700 1 --2- 172.21.15.44:0/2310197811 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x55c64dcc3400 0x55c64de12580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.617+0000 7ffb2ac67700 1 --2- 172.21.15.44:0/2310197811 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x55c64dcc3400 0x55c64de12580 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=f1091b7dd5b735cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.621+0000 7ffb2ac67700 1 -- 172.21.15.44:0/2310197811 <== osd.4 v2:172.21.15.99:6816/2515272044 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv1252 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55c64e7d0d80 con 0x55c64dcc3400 2024-09-13T18:35:19.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.621+0000 7ffb20c53700 1 -- 172.21.15.44:0/2310197811 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:3 8.1b 8:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e66) v8 -- 0x55c64ddfa800 con 0x55c64dcc3400 2024-09-13T18:35:19.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.621+0000 7ffb20c53700 1 -- 172.21.15.44:0/2310197811 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:4 8.b 8:d5c7a900:::200.00000003:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e66) v8 -- 0x55c64ddfac00 con 0x55c64dcc2c00 2024-09-13T18:35:19.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.621+0000 7ffb2bc69700 1 -- 172.21.15.44:0/2310197811 <== osd.3 v2:172.21.15.44:6808/771281770 2 ==== osd_op_reply(4 200.00000003 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55c64e7d0b40 con 0x55c64dcc2c00 2024-09-13T18:35:19.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.621+0000 7ffb2ac67700 1 -- 172.21.15.44:0/2310197811 <== osd.4 v2:172.21.15.99:6816/2515272044 2 ==== osd_op_reply(3 200.00000002 [stat out=16b] v0'0 uv1790 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x55c64e7d0d80 con 0x55c64dcc3400 2024-09-13T18:35:19.628 INFO:teuthology.orchestra.run.smithi044.stdout:old journal was 9771911~5052 2024-09-13T18:35:19.628 INFO:teuthology.orchestra.run.smithi044.stdout:new journal start will be 12582912 (2805949 bytes past old end) 2024-09-13T18:35:19.628 INFO:teuthology.orchestra.run.smithi044.stdout:writing journal head 2024-09-13T18:35:19.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.621+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2310197811 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:5 8.14 8:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66) v8 -- 0x55c64dcc3c00 con 0x55c64dcc3400 2024-09-13T18:35:19.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.625+0000 7ffb2ac67700 1 -- 172.21.15.44:0/2310197811 <== osd.4 v2:172.21.15.99:6816/2515272044 3 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v66'1256 uv1256 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55c64e7d0d80 con 0x55c64dcc3400 2024-09-13T18:35:19.630 INFO:teuthology.orchestra.run.smithi044.stdout:writing EResetJournal entry 2024-09-13T18:35:19.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.625+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2310197811 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:6 8.b 8:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66) v8 -- 0x55c64ddfb400 con 0x55c64dcc2c00 2024-09-13T18:35:19.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.625+0000 7ffb2ccae500 1 --2- 172.21.15.44:0/2310197811 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x55c64ddfb800 0x55c64de12b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.625+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2310197811 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:7 8.1f 8:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66) v8 -- 0x55c64ddfbc00 con 0x55c64ddfb800 2024-09-13T18:35:19.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.625+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2310197811 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:8 8.1a 8:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66) v8 -- 0x55c64de24000 con 0x55c64ddfb800 2024-09-13T18:35:19.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.625+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2310197811 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:9 8.1e 8:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66) v8 -- 0x55c64de24400 con 0x55c64dcc2c00 2024-09-13T18:35:19.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.625+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2310197811 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:10 8.1d 8:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66) v8 -- 0x55c64de24800 con 0x55c64ddfb800 2024-09-13T18:35:19.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.625+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2310197811 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:11 8.1d 8:bf8dcf43:::200.00000008:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66) v8 -- 0x55c64de24c00 con 0x55c64ddfb800 2024-09-13T18:35:19.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.625+0000 7ffb2bc69700 1 --2- 172.21.15.44:0/2310197811 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x55c64ddfb800 0x55c64de12b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.625+0000 7ffb2bc69700 1 --2- 172.21.15.44:0/2310197811 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x55c64ddfb800 0x55c64de12b00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=8eac777f7f03273f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.625+0000 7ffb2bc69700 1 -- 172.21.15.44:0/2310197811 <== osd.3 v2:172.21.15.44:6808/771281770 3 ==== osd_op_reply(6 200.00000003 [delete] v66'7 uv6 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55c64e7d0b40 con 0x55c64dcc2c00 2024-09-13T18:35:19.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.629+0000 7ffb2bc69700 1 -- 172.21.15.44:0/2310197811 <== osd.3 v2:172.21.15.44:6808/771281770 4 ==== osd_op_reply(9 200.00000006 [delete] v66'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55c64e7d0b40 con 0x55c64dcc2c00 2024-09-13T18:35:19.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.629+0000 7ffb2bc69700 1 -- 172.21.15.44:0/2310197811 <== osd.0 v2:172.21.15.44:6800/2647753462 1 ==== osd_op_reply(8 200.00000005 [delete] v66'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55c64e7d0b40 con 0x55c64ddfb800 2024-09-13T18:35:19.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.629+0000 7ffb2bc69700 1 -- 172.21.15.44:0/2310197811 <== osd.0 v2:172.21.15.44:6800/2647753462 2 ==== osd_op_reply(7 200.00000004 [delete] v66'11 uv10 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55c64e7d0b40 con 0x55c64ddfb800 2024-09-13T18:35:19.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.629+0000 7ffb20c53700 1 -- 172.21.15.44:0/2310197811 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:12 8.b 8:d5c7a900:::200.00000003:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66) v8 -- 0x55c64ddfb000 con 0x55c64dcc2c00 2024-09-13T18:35:19.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.629+0000 7ffb2bc69700 1 -- 172.21.15.44:0/2310197811 <== osd.0 v2:172.21.15.44:6800/2647753462 3 ==== osd_op_reply(10 200.00000007 [delete] v66'4 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55c64e7d0b40 con 0x55c64ddfb800 2024-09-13T18:35:19.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.629+0000 7ffb2bc69700 1 -- 172.21.15.44:0/2310197811 <== osd.0 v2:172.21.15.44:6800/2647753462 4 ==== osd_op_reply(11 200.00000008 [delete] v66'5 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55c64e7d0b40 con 0x55c64ddfb800 2024-09-13T18:35:19.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2bc69700 1 -- 172.21.15.44:0/2310197811 <== osd.3 v2:172.21.15.44:6808/771281770 5 ==== osd_op_reply(12 200.00000003 [write 0~48] v66'8 uv8 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55c64e7d0b40 con 0x55c64dcc2c00 2024-09-13T18:35:19.637 INFO:teuthology.orchestra.run.smithi044.stdout:done 2024-09-13T18:35:19.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2310197811 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x55c64ddfb800 msgr2=0x55c64de12b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 --2- 172.21.15.44:0/2310197811 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x55c64ddfb800 0x55c64de12b00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2310197811 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55c64dcc2c00 msgr2=0x55c64de12000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 --2- 172.21.15.44:0/2310197811 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55c64dcc2c00 0x55c64de12000 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2310197811 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x55c64dcc3400 msgr2=0x55c64de12580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 --2- 172.21.15.44:0/2310197811 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x55c64dcc3400 0x55c64de12580 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2310197811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64dc4b800 msgr2=0x55c64d9f5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 --2- 172.21.15.44:0/2310197811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64dc4b800 0x55c64d9f5b80 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x55c64dd72e40 tx=0x55c64dda3020 comp rx=0 tx=0).stop 2024-09-13T18:35:19.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2b468700 1 -- 172.21.15.44:0/2310197811 reap_dead start 2024-09-13T18:35:19.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2b468700 1 -- 172.21.15.44:0/2310197811 reap_dead start 2024-09-13T18:35:19.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2310197811 shutdown_connections 2024-09-13T18:35:19.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2310197811 >> 172.21.15.44:0/2310197811 conn(0x55c64dc4b000 msgr2=0x55c64da40000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2310197811 shutdown_connections 2024-09-13T18:35:19.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 -- 172.21.15.44:0/2310197811 wait complete. 2024-09-13T18:35:19.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 -- 172.21.15.44:0/1784501722 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55c64dcc2400 msgr2=0x55c64d9f7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 --2- 172.21.15.44:0/1784501722 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55c64dcc2400 0x55c64d9f7700 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x55c64dc5b2f0 tx=0x55c64e730ba0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 -- 172.21.15.44:0/1784501722 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c64dc4ac00 msgr2=0x55c64d9f6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 --2- 172.21.15.44:0/1784501722 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c64dc4ac00 0x55c64d9f6680 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55c64da61e60 tx=0x55c64da25380 comp rx=0 tx=0).stop 2024-09-13T18:35:19.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 -- 172.21.15.44:0/1784501722 shutdown_connections 2024-09-13T18:35:19.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 --2- 172.21.15.44:0/1784501722 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55c64dcc2400 0x55c64d9f7700 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 --2- 172.21.15.44:0/1784501722 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c64dc4ac00 0x55c64d9f6680 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 --2- 172.21.15.44:0/1784501722 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c64dc4a800 0x55c64d9f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 --2- 172.21.15.44:0/1784501722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64dc4a400 0x55c64d9f7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 -- 172.21.15.44:0/1784501722 >> 172.21.15.44:0/1784501722 conn(0x55c64d94ec00 msgr2=0x55c64da3f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 -- 172.21.15.44:0/1784501722 shutdown_connections 2024-09-13T18:35:19.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 -- 172.21.15.44:0/1784501722 wait complete. 2024-09-13T18:35:19.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 -- 172.21.15.44:0/3155265755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64d94f400 msgr2=0x55c64d9f4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 --2- 172.21.15.44:0/3155265755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64d94f400 0x55c64d9f4b00 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x55c64da612c0 tx=0x55c64e730c00 comp rx=0 tx=0).stop 2024-09-13T18:35:19.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 -- 172.21.15.44:0/3155265755 shutdown_connections 2024-09-13T18:35:19.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 --2- 172.21.15.44:0/3155265755 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55c64d94f000 0x55c64d9f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 --2- 172.21.15.44:0/3155265755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c64d94f400 0x55c64d9f4b00 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 --2- 172.21.15.44:0/3155265755 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c64d94f800 0x55c64d9f4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 -- 172.21.15.44:0/3155265755 >> 172.21.15.44:0/3155265755 conn(0x55c64d94fc00 msgr2=0x55c64da3f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 -- 172.21.15.44:0/3155265755 shutdown_connections 2024-09-13T18:35:19.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.633+0000 7ffb2ccae500 1 -- 172.21.15.44:0/3155265755 wait complete. 2024-09-13T18:35:19.643 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--yes-i-really-really-mean-it'] in time 0:00:00.086599, result: old journal was 9771911~5052 new journal start will be 12582912 (2805949 bytes past old end) writing journal head writing EResetJournal entry done 2024-09-13T18:35:19.644 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata ls 2024-09-13T18:35:19.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.677+0000 7fa6dfa35140 1 Processor -- start 2024-09-13T18:35:19.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.677+0000 7fa6dfa35140 1 -- start start 2024-09-13T18:35:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.677+0000 7fa6dfa35140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563416c24140 0x563416c541e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.677+0000 7fa6dfa35140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563416cfa140 0x563416c569f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.677+0000 7fa6dfa35140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563416cfa520 0x563416cf8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.677+0000 7fa6dfa35140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x563416bb62f0 con 0x563416cfa520 2024-09-13T18:35:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.677+0000 7fa6dfa35140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x563416b728e0 con 0x563416c24140 2024-09-13T18:35:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.677+0000 7fa6dfa35140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x563416b72580 con 0x563416cfa140 2024-09-13T18:35:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.677+0000 7fa6ddd6b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563416cfa520 0x563416cf8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.677+0000 7fa6dd56a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563416c24140 0x563416c541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.677+0000 7fa6ddd6b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563416cfa520 0x563416cf8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39956/0 (socket says 172.21.15.44:39956) 2024-09-13T18:35:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.677+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/712889432 learned_addr learned my addr 172.21.15.44:0/712889432 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.677+0000 7fa6dcd69700 1 --2- 172.21.15.44:0/712889432 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563416cfa140 0x563416c569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.677+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/712889432 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563416cfa140 msgr2=0x563416c569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.677+0000 7fa6ddd6b700 1 --2- 172.21.15.44:0/712889432 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563416cfa140 0x563416c569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.677+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/712889432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563416c24140 msgr2=0x563416c541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.677+0000 7fa6ddd6b700 1 --2- 172.21.15.44:0/712889432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563416c24140 0x563416c541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.677+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/712889432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d800a100 con 0x563416cfa520 2024-09-13T18:35:19.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.677+0000 7fa6dd56a700 1 --2- 172.21.15.44:0/712889432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563416c24140 0x563416c541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:19.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.677+0000 7fa6ddd6b700 1 --2- 172.21.15.44:0/712889432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563416cfa520 0x563416cf8510 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00098d0 tx=0x7fa6d0005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e055db48480af30f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.681+0000 7fa6d77fe700 1 -- 172.21.15.44:0/712889432 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d000f040 con 0x563416cfa520 2024-09-13T18:35:19.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.681+0000 7fa6d77fe700 1 -- 172.21.15.44:0/712889432 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d00089b0 con 0x563416cfa520 2024-09-13T18:35:19.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.681+0000 7fa6d77fe700 1 -- 172.21.15.44:0/712889432 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0008d60 con 0x563416cfa520 2024-09-13T18:35:19.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.681+0000 7fa6dfa35140 1 -- 172.21.15.44:0/712889432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563416cfa520 msgr2=0x563416cf8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.681+0000 7fa6dfa35140 1 --2- 172.21.15.44:0/712889432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563416cfa520 0x563416cf8510 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00098d0 tx=0x7fa6d0005a00 comp rx=0 tx=0).stop 2024-09-13T18:35:19.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.681+0000 7fa6dfa35140 1 -- 172.21.15.44:0/712889432 shutdown_connections 2024-09-13T18:35:19.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.681+0000 7fa6dfa35140 1 --2- 172.21.15.44:0/712889432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563416cfa520 0x563416cf8510 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.681+0000 7fa6dfa35140 1 --2- 172.21.15.44:0/712889432 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563416cfa140 0x563416c569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.681+0000 7fa6dfa35140 1 --2- 172.21.15.44:0/712889432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563416c24140 0x563416c541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.681+0000 7fa6dfa35140 1 -- 172.21.15.44:0/712889432 >> 172.21.15.44:0/712889432 conn(0x563416c53280 msgr2=0x563416cdfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.681+0000 7fa6dfa35140 1 -- 172.21.15.44:0/712889432 shutdown_connections 2024-09-13T18:35:19.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.681+0000 7fa6dfa35140 1 -- 172.21.15.44:0/712889432 wait complete. 2024-09-13T18:35:19.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.681+0000 7fa6dfa35140 1 Processor -- start 2024-09-13T18:35:19.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.681+0000 7fa6dfa35140 1 -- start start 2024-09-13T18:35:19.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.685+0000 7fa6dfa35140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563416c24140 0x563416d92550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.685+0000 7fa6dfa35140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563416cfa140 0x563416c6a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.685+0000 7fa6dfa35140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563416cfa520 0x563416c48d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.685+0000 7fa6dfa35140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x563416b488d0 con 0x563416cfa520 2024-09-13T18:35:19.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.685+0000 7fa6dfa35140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x563416c6b390 con 0x563416cfa140 2024-09-13T18:35:19.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.685+0000 7fa6dfa35140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x563416c6b630 con 0x563416c24140 2024-09-13T18:35:19.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.685+0000 7fa6ddd6b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563416cfa520 0x563416c48d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.685+0000 7fa6ddd6b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563416cfa520 0x563416c48d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39970/0 (socket says 172.21.15.44:39970) 2024-09-13T18:35:19.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.685+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/2957771585 learned_addr learned my addr 172.21.15.44:0/2957771585 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:19.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.685+0000 7fa6dd56a700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563416c24140 0x563416d92550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.685+0000 7fa6dcd69700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563416cfa140 0x563416c6a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.685+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563416c24140 msgr2=0x563416d92550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.685+0000 7fa6ddd6b700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563416c24140 0x563416d92550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.685+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563416cfa140 msgr2=0x563416c6a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.685+0000 7fa6ddd6b700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563416cfa140 0x563416c6a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.685+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563416b7aca0 con 0x563416cfa520 2024-09-13T18:35:19.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.685+0000 7fa6ddd6b700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563416cfa520 0x563416c48d70 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0006010 tx=0x7fa6d0003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.685+0000 7fa6d67fc700 1 -- 172.21.15.44:0/2957771585 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d000f050 con 0x563416cfa520 2024-09-13T18:35:19.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.685+0000 7fa6d67fc700 1 -- 172.21.15.44:0/2957771585 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d0013630 con 0x563416cfa520 2024-09-13T18:35:19.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.685+0000 7fa6dfa35140 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d0009550 con 0x563416cfa520 2024-09-13T18:35:19.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.685+0000 7fa6d67fc700 1 -- 172.21.15.44:0/2957771585 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d00139a0 con 0x563416cfa520 2024-09-13T18:35:19.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.685+0000 7fa6dfa35140 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563416b60b00 con 0x563416cfa520 2024-09-13T18:35:19.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.689+0000 7fa6d67fc700 1 -- 172.21.15.44:0/2957771585 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa6d0022070 con 0x563416cfa520 2024-09-13T18:35:19.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.689+0000 7fa6d67fc700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa6c0065090 0x7fa6c0067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.689+0000 7fa6d67fc700 1 -- 172.21.15.44:0/2957771585 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fa6d0084d30 con 0x563416cfa520 2024-09-13T18:35:19.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.689+0000 7fa6dd56a700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa6c0065090 0x7fa6c0067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.689+0000 7fa6dfa35140 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x563416d8fe70 0x563416d90280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.689+0000 7fa6dfa35140 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:1 8.0 8:00000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x563416d8fe70 2024-09-13T18:35:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.689+0000 7fa6dcd69700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x563416d8fe70 0x563416d90280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.689+0000 7fa6dd56a700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa6c0065090 0x7fa6c0067550 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa6d800a3f0 tx=0x7fa6d8007030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.689+0000 7fa6dcd69700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x563416d8fe70 0x563416d90280 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.693+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(1 [pgnls start_epoch 66 out=49b] v63'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6c800f6f0 con 0x563416d8fe70 2024-09-13T18:35:19.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.693+0000 7fa6dcd69700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7fa6c800e950 0x7fa6c800d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.693+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- osd_op(unknown.0.0:2 8.10 8:08000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6c800e950 2024-09-13T18:35:19.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.693+0000 7fa6dd56a700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7fa6c800e950 0x7fa6c800d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.693+0000 7fa6dd56a700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7fa6c800e950 0x7fa6c800d3d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.693+0000 7fa6dd56a700 1 -- 172.21.15.44:0/2957771585 <== osd.7 v2:172.21.15.99:6824/2245335901 1 ==== osd_op_reply(2 [pgnls start_epoch 66 out=201b] v63'12 uv12 ondisk = 1) v8 ==== 144+0+201 (crc 0 0 0) 0x7fa6d800fc20 con 0x7fa6c800e950 2024-09-13T18:35:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.693+0000 7fa6dd56a700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7fa6d8028410 0x7fa6d8028870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.693+0000 7fa6dd56a700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:3 8.8 8:10000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6d8028410 2024-09-13T18:35:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.693+0000 7fa6dcd69700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7fa6d8028410 0x7fa6d8028870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.693+0000 7fa6dcd69700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7fa6d8028410 0x7fa6d8028870 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.697+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 <== osd.5 v2:172.21.15.99:6800/827163121 1 ==== osd_op_reply(3 [pgnls start_epoch 66 out=73b] v63'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fa6c8018060 con 0x7fa6d8028410 2024-09-13T18:35:19.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.697+0000 7fa6dcd69700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7fa6c801f8d0 0x7fa6c801e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.697+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:4 8.18 8:18000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6c801f8d0 2024-09-13T18:35:19.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.697+0000 7fa6ddd6b700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7fa6c801f8d0 0x7fa6c801e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.697+0000 7fa6ddd6b700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7fa6c801f8d0 0x7fa6c801e350 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.697+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/2957771585 <== osd.4 v2:172.21.15.99:6816/2515272044 1 ==== osd_op_reply(4 [pgnls start_epoch 66 out=49b] v63'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6d0021030 con 0x7fa6c801f8d0 2024-09-13T18:35:19.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.697+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:5 8.4 8:20000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6d8028410 2024-09-13T18:35:19.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.697+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 <== osd.5 v2:172.21.15.99:6800/827163121 2 ==== osd_op_reply(5 [pgnls start_epoch 66 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6c8018060 con 0x7fa6d8028410 2024-09-13T18:35:19.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.697+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:6 8.14 8:28000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6c801f8d0 2024-09-13T18:35:19.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.701+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/2957771585 <== osd.4 v2:172.21.15.99:6816/2515272044 2 ==== osd_op_reply(6 [pgnls start_epoch 66 out=149b] v66'1256 uv1256 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x7fa6d0021030 con 0x7fa6c801f8d0 2024-09-13T18:35:19.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.701+0000 7fa6ddd6b700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7fa6d0055f50 0x7fa6d0054c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.701+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:7 8.c 8:30000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6d0055f50 2024-09-13T18:35:19.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.701+0000 7fa6dd56a700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7fa6d0055f50 0x7fa6d0054c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.701+0000 7fa6dd56a700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7fa6d0055f50 0x7fa6d0054c50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.701+0000 7fa6dd56a700 1 -- 172.21.15.44:0/2957771585 <== osd.0 v2:172.21.15.44:6800/2647753462 1 ==== osd_op_reply(7 [pgnls start_epoch 66 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6d800fc20 con 0x7fa6d0055f50 2024-09-13T18:35:19.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.701+0000 7fa6dd56a700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:8 8.1c 8:38000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6d8028410 2024-09-13T18:35:19.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.701+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 <== osd.5 v2:172.21.15.99:6800/827163121 3 ==== osd_op_reply(8 [pgnls start_epoch 66 out=73b] v62'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fa6c8018060 con 0x7fa6d8028410 2024-09-13T18:35:19.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.701+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:9 8.2 8:40000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6c801f8d0 2024-09-13T18:35:19.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.701+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/2957771585 <== osd.4 v2:172.21.15.99:6816/2515272044 3 ==== osd_op_reply(9 [pgnls start_epoch 66 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6d0021030 con 0x7fa6c801f8d0 2024-09-13T18:35:19.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.701+0000 7fa6ddd6b700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7fa6d00551e0 0x7fa6d0056680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.701+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:10 8.12 8:48000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6d00551e0 2024-09-13T18:35:19.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.705+0000 7fa6dcd69700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7fa6d00551e0 0x7fa6d0056680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.705+0000 7fa6dcd69700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7fa6d00551e0 0x7fa6d0056680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.705+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 <== osd.6 v2:172.21.15.99:6808/2907584318 1 ==== osd_op_reply(10 [pgnls start_epoch 66 out=73b] v63'3 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fa6c8018060 con 0x7fa6d00551e0 2024-09-13T18:35:19.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.705+0000 7fa6dcd69700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7fa6c8022950 0x7fa6c800b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.705+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:11 8.a 8:50000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6c8022950 2024-09-13T18:35:19.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.705+0000 7fa6ddd6b700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7fa6c8022950 0x7fa6c800b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.705+0000 7fa6ddd6b700 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7fa6c8022950 0x7fa6c800b350 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.705+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/2957771585 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== osd_op_reply(11 [pgnls start_epoch 66 out=49b] v64'9 uv9 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6d0021030 con 0x7fa6c8022950 2024-09-13T18:35:19.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.705+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:12 8.1a 8:58000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6d0055f50 2024-09-13T18:35:19.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.705+0000 7fa6dd56a700 1 -- 172.21.15.44:0/2957771585 <== osd.0 v2:172.21.15.44:6800/2647753462 2 ==== osd_op_reply(12 [pgnls start_epoch 66 out=49b] v66'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6d800fc20 con 0x7fa6d0055f50 2024-09-13T18:35:19.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.705+0000 7fa6dd56a700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:13 8.6 8:60000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6d0055f50 2024-09-13T18:35:19.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.709+0000 7fa6dd56a700 1 -- 172.21.15.44:0/2957771585 <== osd.0 v2:172.21.15.44:6800/2647753462 3 ==== osd_op_reply(13 [pgnls start_epoch 66 out=77b] v63'9 uv9 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x7fa6d800fc20 con 0x7fa6d0055f50 2024-09-13T18:35:19.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.709+0000 7fa6dd56a700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:14 8.16 8:68000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x563416d8fe70 2024-09-13T18:35:19.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.709+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 <== osd.3 v2:172.21.15.44:6808/771281770 2 ==== osd_op_reply(14 [pgnls start_epoch 66 out=73b] v63'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fa6c8018060 con 0x563416d8fe70 2024-09-13T18:35:19.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.709+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:15 8.e 8:70000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6d0055f50 2024-09-13T18:35:19.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.709+0000 7fa6dd56a700 1 -- 172.21.15.44:0/2957771585 <== osd.0 v2:172.21.15.44:6800/2647753462 4 ==== osd_op_reply(15 [pgnls start_epoch 66 out=73b] v62'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fa6d800fc20 con 0x7fa6d0055f50 2024-09-13T18:35:19.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.709+0000 7fa6dd56a700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:16 8.1e 8:78000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x563416d8fe70 2024-09-13T18:35:19.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.709+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 <== osd.3 v2:172.21.15.44:6808/771281770 3 ==== osd_op_reply(16 [pgnls start_epoch 66 out=49b] v66'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6c8018060 con 0x563416d8fe70 2024-09-13T18:35:19.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.709+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:17 8.1 8:80000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6c8022950 2024-09-13T18:35:19.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.709+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/2957771585 <== osd.1 v2:172.21.15.44:6816/2250405239 2 ==== osd_op_reply(17 [pgnls start_epoch 66 out=49b] v63'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6d0021030 con 0x7fa6c8022950 2024-09-13T18:35:19.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.709+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:18 8.11 8:88000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6d8028410 2024-09-13T18:35:19.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.713+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 <== osd.5 v2:172.21.15.99:6800/827163121 4 ==== osd_op_reply(18 [pgnls start_epoch 66 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6c8018060 con 0x7fa6d8028410 2024-09-13T18:35:19.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.713+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:19 8.9 8:90000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6d00551e0 2024-09-13T18:35:19.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.713+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 <== osd.6 v2:172.21.15.99:6808/2907584318 2 ==== osd_op_reply(19 [pgnls start_epoch 66 out=97b] v63'3 uv3 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x7fa6c8018060 con 0x7fa6d00551e0 2024-09-13T18:35:19.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.713+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:20 8.19 8:98000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6d8028410 2024-09-13T18:35:19.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.713+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 <== osd.5 v2:172.21.15.99:6800/827163121 5 ==== osd_op_reply(20 [pgnls start_epoch 66 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6c8018060 con 0x7fa6d8028410 2024-09-13T18:35:19.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.713+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:21 8.5 8:a0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6d00551e0 2024-09-13T18:35:19.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.713+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 <== osd.6 v2:172.21.15.99:6808/2907584318 3 ==== osd_op_reply(21 [pgnls start_epoch 66 out=73b] v63'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fa6c8018060 con 0x7fa6d00551e0 2024-09-13T18:35:19.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.713+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- osd_op(unknown.0.0:22 8.15 8:a8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6c800e950 2024-09-13T18:35:19.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.713+0000 7fa6dd56a700 1 -- 172.21.15.44:0/2957771585 <== osd.7 v2:172.21.15.99:6824/2245335901 2 ==== osd_op_reply(22 [pgnls start_epoch 66 out=127b] v63'4 uv4 ondisk = 1) v8 ==== 144+0+127 (crc 0 0 0) 0x7fa6d800fc20 con 0x7fa6c800e950 2024-09-13T18:35:19.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.713+0000 7fa6dd56a700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:23 8.d 8:b0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6d8028410 2024-09-13T18:35:19.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.717+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 <== osd.5 v2:172.21.15.99:6800/827163121 6 ==== osd_op_reply(23 [pgnls start_epoch 66 out=74b] v62'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa6c8018060 con 0x7fa6d8028410 2024-09-13T18:35:19.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.717+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:24 8.1d 8:b8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6d0055f50 2024-09-13T18:35:19.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.717+0000 7fa6dd56a700 1 -- 172.21.15.44:0/2957771585 <== osd.0 v2:172.21.15.44:6800/2647753462 5 ==== osd_op_reply(24 [pgnls start_epoch 66 out=73b] v66'5 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fa6d800fc20 con 0x7fa6d0055f50 2024-09-13T18:35:19.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.717+0000 7fa6dd56a700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:25 8.3 8:c0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6c8022950 2024-09-13T18:35:19.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.717+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/2957771585 <== osd.1 v2:172.21.15.44:6816/2250405239 3 ==== osd_op_reply(25 [pgnls start_epoch 66 out=73b] v64'4 uv4 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fa6d0021030 con 0x7fa6c8022950 2024-09-13T18:35:19.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.717+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:26 8.13 8:c8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x563416d8fe70 2024-09-13T18:35:19.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.717+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 <== osd.3 v2:172.21.15.44:6808/771281770 4 ==== osd_op_reply(26 [pgnls start_epoch 66 out=122b] v63'5 uv5 ondisk = 1) v8 ==== 144+0+122 (crc 0 0 0) 0x7fa6c8018060 con 0x563416d8fe70 2024-09-13T18:35:19.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.717+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:27 8.b 8:d0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x563416d8fe70 2024-09-13T18:35:19.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.717+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 <== osd.3 v2:172.21.15.44:6808/771281770 5 ==== osd_op_reply(27 [pgnls start_epoch 66 out=124b] v66'8 uv8 ondisk = 1) v8 ==== 144+0+124 (crc 0 0 0) 0x7fa6c8018060 con 0x563416d8fe70 2024-09-13T18:35:19.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.717+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:28 8.1b 8:d8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6c801f8d0 2024-09-13T18:35:19.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.721+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/2957771585 <== osd.4 v2:172.21.15.99:6816/2515272044 4 ==== osd_op_reply(28 [pgnls start_epoch 66 out=97b] v64'1791 uv1791 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x7fa6d0021030 con 0x7fa6c801f8d0 2024-09-13T18:35:19.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.721+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:29 8.7 8:e0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6c8022950 2024-09-13T18:35:19.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.721+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/2957771585 <== osd.1 v2:172.21.15.44:6816/2250405239 4 ==== osd_op_reply(29 [pgnls start_epoch 66 out=129b] v63'6 uv6 ondisk = 1) v8 ==== 144+0+129 (crc 0 0 0) 0x7fa6d0021030 con 0x7fa6c8022950 2024-09-13T18:35:19.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.721+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- osd_op(unknown.0.0:30 8.17 8:e8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6c800e950 2024-09-13T18:35:19.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.721+0000 7fa6dd56a700 1 -- 172.21.15.44:0/2957771585 <== osd.7 v2:172.21.15.99:6824/2245335901 3 ==== osd_op_reply(30 [pgnls start_epoch 66 out=97b] v63'8 uv8 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x7fa6d800fc20 con 0x7fa6c800e950 2024-09-13T18:35:19.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.721+0000 7fa6dd56a700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:31 8.f 8:f0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x563416d8fe70 2024-09-13T18:35:19.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.721+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 <== osd.3 v2:172.21.15.44:6808/771281770 6 ==== osd_op_reply(31 [pgnls start_epoch 66 out=73b] v62'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fa6c8018060 con 0x563416d8fe70 2024-09-13T18:35:19.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.721+0000 7fa6dcd69700 1 -- 172.21.15.44:0/2957771585 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:32 8.1f 8:f8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x563416c6af20 con 0x7fa6d0055f50 2024-09-13T18:35:19.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.721+0000 7fa6dd56a700 1 -- 172.21.15.44:0/2957771585 <== osd.0 v2:172.21.15.44:6800/2647753462 6 ==== osd_op_reply(32 [pgnls start_epoch 66 out=101b] v66'11 uv10 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x7fa6d800fc20 con 0x7fa6d0055f50 2024-09-13T18:35:19.729 INFO:teuthology.orchestra.run.smithi044.stdout:601.00000000 2024-09-13T18:35:19.729 INFO:teuthology.orchestra.run.smithi044.stdout:602.00000000 2024-09-13T18:35:19.730 INFO:teuthology.orchestra.run.smithi044.stdout:10000000000.00000000 2024-09-13T18:35:19.730 INFO:teuthology.orchestra.run.smithi044.stdout:600.00000000 2024-09-13T18:35:19.730 INFO:teuthology.orchestra.run.smithi044.stdout:603.00000000 2024-09-13T18:35:19.730 INFO:teuthology.orchestra.run.smithi044.stdout:60a.00000000 2024-09-13T18:35:19.730 INFO:teuthology.orchestra.run.smithi044.stdout:613.00000000 2024-09-13T18:35:19.730 INFO:teuthology.orchestra.run.smithi044.stdout:1.00000000.inode 2024-09-13T18:35:19.730 INFO:teuthology.orchestra.run.smithi044.stdout:200.00000000 2024-09-13T18:35:19.731 INFO:teuthology.orchestra.run.smithi044.stdout:610.00000000 2024-09-13T18:35:19.731 INFO:teuthology.orchestra.run.smithi044.stdout:606.00000000 2024-09-13T18:35:19.731 INFO:teuthology.orchestra.run.smithi044.stdout:607.00000000 2024-09-13T18:35:19.731 INFO:teuthology.orchestra.run.smithi044.stdout:60e.00000000 2024-09-13T18:35:19.731 INFO:teuthology.orchestra.run.smithi044.stdout:mds0_openfiles.0 2024-09-13T18:35:19.731 INFO:teuthology.orchestra.run.smithi044.stdout:60f.00000000 2024-09-13T18:35:19.732 INFO:teuthology.orchestra.run.smithi044.stdout:608.00000000 2024-09-13T18:35:19.732 INFO:teuthology.orchestra.run.smithi044.stdout:501.00000000 2024-09-13T18:35:19.732 INFO:teuthology.orchestra.run.smithi044.stdout:612.00000000 2024-09-13T18:35:19.732 INFO:teuthology.orchestra.run.smithi044.stdout:401.00000000 2024-09-13T18:35:19.732 INFO:teuthology.orchestra.run.smithi044.stdout:604.00000000 2024-09-13T18:35:19.732 INFO:teuthology.orchestra.run.smithi044.stdout:101.00000000.inode 2024-09-13T18:35:19.732 INFO:teuthology.orchestra.run.smithi044.stdout:500.00000000 2024-09-13T18:35:19.732 INFO:teuthology.orchestra.run.smithi044.stdout:mds_snaptable 2024-09-13T18:35:19.732 INFO:teuthology.orchestra.run.smithi044.stdout:605.00000000 2024-09-13T18:35:19.732 INFO:teuthology.orchestra.run.smithi044.stdout:101.00000000 2024-09-13T18:35:19.733 INFO:teuthology.orchestra.run.smithi044.stdout:mds0_inotable 2024-09-13T18:35:19.733 INFO:teuthology.orchestra.run.smithi044.stdout:611.00000000 2024-09-13T18:35:19.733 INFO:teuthology.orchestra.run.smithi044.stdout:100.00000000 2024-09-13T18:35:19.733 INFO:teuthology.orchestra.run.smithi044.stdout:mds0_sessionmap 2024-09-13T18:35:19.733 INFO:teuthology.orchestra.run.smithi044.stdout:200.00000003 2024-09-13T18:35:19.733 INFO:teuthology.orchestra.run.smithi044.stdout:60c.00000000 2024-09-13T18:35:19.734 INFO:teuthology.orchestra.run.smithi044.stdout:201.00000001 2024-09-13T18:35:19.734 INFO:teuthology.orchestra.run.smithi044.stdout:200.00000002 2024-09-13T18:35:19.734 INFO:teuthology.orchestra.run.smithi044.stdout:609.00000000 2024-09-13T18:35:19.734 INFO:teuthology.orchestra.run.smithi044.stdout:10000000001.00000000 2024-09-13T18:35:19.734 INFO:teuthology.orchestra.run.smithi044.stdout:60b.00000000 2024-09-13T18:35:19.734 INFO:teuthology.orchestra.run.smithi044.stdout:60d.00000000 2024-09-13T18:35:19.735 INFO:teuthology.orchestra.run.smithi044.stdout:201.00000000 2024-09-13T18:35:19.735 INFO:teuthology.orchestra.run.smithi044.stdout:400.00000000 2024-09-13T18:35:19.735 INFO:teuthology.orchestra.run.smithi044.stdout:100.00000000.inode 2024-09-13T18:35:19.735 INFO:teuthology.orchestra.run.smithi044.stdout:1.00000000 2024-09-13T18:35:19.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.721+0000 7fa6dfa35140 1 -- 172.21.15.44:0/2957771585 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7fa6d0055f50 msgr2=0x7fa6d0054c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.721+0000 7fa6dfa35140 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7fa6d0055f50 0x7fa6d0054c50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6dfa35140 1 -- 172.21.15.44:0/2957771585 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7fa6c8022950 msgr2=0x7fa6c800b350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6dfa35140 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7fa6c8022950 0x7fa6c800b350 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6dfa35140 1 -- 172.21.15.44:0/2957771585 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x563416d8fe70 msgr2=0x563416d90280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6dfa35140 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x563416d8fe70 0x563416d90280 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6dfa35140 1 -- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7fa6c801f8d0 msgr2=0x7fa6c801e350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6dfa35140 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7fa6c801f8d0 0x7fa6c801e350 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6dfa35140 1 -- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7fa6d8028410 msgr2=0x7fa6d8028870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6dfa35140 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7fa6d8028410 0x7fa6d8028870 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/2957771585 reap_dead start 2024-09-13T18:35:19.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6dfa35140 1 -- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7fa6d00551e0 msgr2=0x7fa6d0056680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6dfa35140 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7fa6d00551e0 0x7fa6d0056680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/2957771585 reap_dead start 2024-09-13T18:35:19.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6dfa35140 1 -- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7fa6c800e950 msgr2=0x7fa6c800d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6dfa35140 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7fa6c800e950 0x7fa6c800d3d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6ddd6b700 1 -- 172.21.15.44:0/2957771585 reap_dead start 2024-09-13T18:35:19.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6dfa35140 1 -- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa6c0065090 msgr2=0x7fa6c0067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6dfa35140 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa6c0065090 0x7fa6c0067550 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa6d800a3f0 tx=0x7fa6d8007030 comp rx=0 tx=0).stop 2024-09-13T18:35:19.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6dfa35140 1 -- 172.21.15.44:0/2957771585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563416cfa520 msgr2=0x563416c48d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6dfa35140 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563416cfa520 0x563416c48d70 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0006010 tx=0x7fa6d0003020 comp rx=0 tx=0).stop 2024-09-13T18:35:19.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6dfa35140 1 -- 172.21.15.44:0/2957771585 shutdown_connections 2024-09-13T18:35:19.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6dfa35140 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa6c0065090 0x7fa6c0067550 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6dfa35140 1 --2- 172.21.15.44:0/2957771585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563416cfa520 0x563416c48d70 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6dfa35140 1 -- 172.21.15.44:0/2957771585 >> 172.21.15.44:0/2957771585 conn(0x563416c53280 msgr2=0x563416c22b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6dfa35140 1 -- 172.21.15.44:0/2957771585 shutdown_connections 2024-09-13T18:35:19.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.725+0000 7fa6dfa35140 1 -- 172.21.15.44:0/2957771585 wait complete. 2024-09-13T18:35:19.742 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 201.00000001 2024-09-13T18:35:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f041bbb9140 1 Processor -- start 2024-09-13T18:35:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f041bbb9140 1 -- start start 2024-09-13T18:35:19.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f041bbb9140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f90bc0f140 0x55f90bc3f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f041bbb9140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55f90bce5140 0x55f90bccadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f041bbb9140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f90bce5520 0x55f90bce5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f041bbb9140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f90bba12f0 con 0x55f90bc0f140 2024-09-13T18:35:19.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f041bbb9140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f90bb5d8e0 con 0x55f90bce5520 2024-09-13T18:35:19.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f041bbb9140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f90bb5d580 con 0x55f90bce5140 2024-09-13T18:35:19.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f04196ee700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f90bc0f140 0x55f90bc3f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f0419eef700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f90bce5520 0x55f90bce5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f0418eed700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55f90bce5140 0x55f90bccadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f0419eef700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f90bce5520 0x55f90bce5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:47094/0 (socket says 172.21.15.44:47094) 2024-09-13T18:35:19.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f0419eef700 1 -- 172.21.15.44:0/2005627267 learned_addr learned my addr 172.21.15.44:0/2005627267 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:19.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f0419eef700 1 -- 172.21.15.44:0/2005627267 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55f90bce5140 msgr2=0x55f90bccadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f0419eef700 1 --2- 172.21.15.44:0/2005627267 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55f90bce5140 0x55f90bccadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f0419eef700 1 -- 172.21.15.44:0/2005627267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f90bc0f140 msgr2=0x55f90bc3f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f0419eef700 1 --2- 172.21.15.44:0/2005627267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f90bc0f140 0x55f90bc3f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f0419eef700 1 -- 172.21.15.44:0/2005627267 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0414005d20 con 0x55f90bce5520 2024-09-13T18:35:19.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f0419eef700 1 --2- 172.21.15.44:0/2005627267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f90bce5520 0x55f90bce5960 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0414009950 tx=0x7f0414005a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f150f41aae53e8d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f04137fe700 1 -- 172.21.15.44:0/2005627267 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041400f040 con 0x55f90bce5520 2024-09-13T18:35:19.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f04137fe700 1 -- 172.21.15.44:0/2005627267 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0414008a30 con 0x55f90bce5520 2024-09-13T18:35:19.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f04137fe700 1 -- 172.21.15.44:0/2005627267 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414008de0 con 0x55f90bce5520 2024-09-13T18:35:19.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f041bbb9140 1 -- 172.21.15.44:0/2005627267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f90bce5520 msgr2=0x55f90bce5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f041bbb9140 1 --2- 172.21.15.44:0/2005627267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f90bce5520 0x55f90bce5960 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0414009950 tx=0x7f0414005a00 comp rx=0 tx=0).stop 2024-09-13T18:35:19.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f041bbb9140 1 -- 172.21.15.44:0/2005627267 shutdown_connections 2024-09-13T18:35:19.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f041bbb9140 1 --2- 172.21.15.44:0/2005627267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f90bce5520 0x55f90bce5960 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f041bbb9140 1 --2- 172.21.15.44:0/2005627267 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55f90bce5140 0x55f90bccadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f041bbb9140 1 --2- 172.21.15.44:0/2005627267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f90bc0f140 0x55f90bc3f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f041bbb9140 1 -- 172.21.15.44:0/2005627267 >> 172.21.15.44:0/2005627267 conn(0x55f90bc3e280 msgr2=0x55f90bce4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f041bbb9140 1 -- 172.21.15.44:0/2005627267 shutdown_connections 2024-09-13T18:35:19.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.817+0000 7f041bbb9140 1 -- 172.21.15.44:0/2005627267 wait complete. 2024-09-13T18:35:19.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f041bbb9140 1 Processor -- start 2024-09-13T18:35:19.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f041bbb9140 1 -- start start 2024-09-13T18:35:19.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f041bbb9140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f90bc0f140 0x55f90bcc75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f041bbb9140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f90bce5140 0x55f90bcccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f041bbb9140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55f90bce5520 0x55f90bccd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f041bbb9140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f90bb338d0 con 0x55f90bce5140 2024-09-13T18:35:19.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f041bbb9140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f90bccc0d0 con 0x55f90bc0f140 2024-09-13T18:35:19.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f041bbb9140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f90bccd7f0 con 0x55f90bce5520 2024-09-13T18:35:19.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f0418eed700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f90bce5140 0x55f90bcccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f0418eed700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f90bce5140 0x55f90bcccca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39980/0 (socket says 172.21.15.44:39980) 2024-09-13T18:35:19.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f0418eed700 1 -- 172.21.15.44:0/2089545379 learned_addr learned my addr 172.21.15.44:0/2089545379 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:19.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f04196ee700 1 --2- 172.21.15.44:0/2089545379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f90bc0f140 0x55f90bcc75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f0419eef700 1 --2- 172.21.15.44:0/2089545379 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55f90bce5520 0x55f90bccd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f0418eed700 1 -- 172.21.15.44:0/2089545379 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55f90bce5520 msgr2=0x55f90bccd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f0418eed700 1 --2- 172.21.15.44:0/2089545379 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55f90bce5520 0x55f90bccd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f0418eed700 1 -- 172.21.15.44:0/2089545379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f90bc0f140 msgr2=0x55f90bcc75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f0418eed700 1 --2- 172.21.15.44:0/2089545379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f90bc0f140 0x55f90bcc75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f0418eed700 1 -- 172.21.15.44:0/2089545379 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04140095a0 con 0x55f90bce5140 2024-09-13T18:35:19.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f0419eef700 1 --2- 172.21.15.44:0/2089545379 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55f90bce5520 0x55f90bccd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:19.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f04196ee700 1 --2- 172.21.15.44:0/2089545379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f90bc0f140 0x55f90bcc75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:19.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f0418eed700 1 --2- 172.21.15.44:0/2089545379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f90bce5140 0x55f90bcccca0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f0404003f90 tx=0x7f04040017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f04127fc700 1 -- 172.21.15.44:0/2089545379 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0404011350 con 0x55f90bce5140 2024-09-13T18:35:19.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f04127fc700 1 -- 172.21.15.44:0/2089545379 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04040114d0 con 0x55f90bce5140 2024-09-13T18:35:19.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f041bbb9140 1 -- 172.21.15.44:0/2089545379 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040c005d20 con 0x55f90bce5140 2024-09-13T18:35:19.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f04127fc700 1 -- 172.21.15.44:0/2089545379 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0404011880 con 0x55f90bce5140 2024-09-13T18:35:19.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.821+0000 7f041bbb9140 1 -- 172.21.15.44:0/2089545379 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f90bb4bb00 con 0x55f90bce5140 2024-09-13T18:35:19.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.825+0000 7f04127fc700 1 -- 172.21.15.44:0/2089545379 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f04040119e0 con 0x55f90bce5140 2024-09-13T18:35:19.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.825+0000 7f04127fc700 1 --2- 172.21.15.44:0/2089545379 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f03fc065090 0x7f03fc067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.825+0000 7f04196ee700 1 --2- 172.21.15.44:0/2089545379 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f03fc065090 0x7f03fc067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.825+0000 7f04127fc700 1 -- 172.21.15.44:0/2089545379 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f0404082720 con 0x55f90bce5140 2024-09-13T18:35:19.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.825+0000 7f041bbb9140 1 --2- 172.21.15.44:0/2089545379 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x55f90bcc7b30 0x55f90bd708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.825+0000 7f041bbb9140 1 -- 172.21.15.44:0/2089545379 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:1 8.1b 8:db457a8a:::201.00000001:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e66) v8 -- 0x55f90bd70e30 con 0x55f90bcc7b30 2024-09-13T18:35:19.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.825+0000 7f04196ee700 1 --2- 172.21.15.44:0/2089545379 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f03fc065090 0x7f03fc067550 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f040c00a440 tx=0x7f040c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.825+0000 7f0419eef700 1 --2- 172.21.15.44:0/2089545379 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x55f90bcc7b30 0x55f90bd708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.825+0000 7f0419eef700 1 --2- 172.21.15.44:0/2089545379 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x55f90bcc7b30 0x55f90bd708f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.833+0000 7f0419eef700 1 -- 172.21.15.44:0/2089545379 <== osd.4 v2:172.21.15.99:6816/2515272044 1 ==== osd_op_reply(1 201.00000001 [delete] v66'1792 uv1792 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0414008d20 con 0x55f90bcc7b30 2024-09-13T18:35:19.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.833+0000 7f041bbb9140 1 -- 172.21.15.44:0/2089545379 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x55f90bcc7b30 msgr2=0x55f90bd708f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.833+0000 7f041bbb9140 1 --2- 172.21.15.44:0/2089545379 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x55f90bcc7b30 0x55f90bd708f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.833+0000 7f041bbb9140 1 -- 172.21.15.44:0/2089545379 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f03fc065090 msgr2=0x7f03fc067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.833+0000 7f041bbb9140 1 --2- 172.21.15.44:0/2089545379 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f03fc065090 0x7f03fc067550 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f040c00a440 tx=0x7f040c00f000 comp rx=0 tx=0).stop 2024-09-13T18:35:19.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.833+0000 7f041bbb9140 1 -- 172.21.15.44:0/2089545379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f90bce5140 msgr2=0x55f90bcccca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.833+0000 7f041bbb9140 1 --2- 172.21.15.44:0/2089545379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f90bce5140 0x55f90bcccca0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f0404003f90 tx=0x7f04040017f0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.833+0000 7f0419eef700 1 -- 172.21.15.44:0/2089545379 reap_dead start 2024-09-13T18:35:19.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.833+0000 7f041bbb9140 1 -- 172.21.15.44:0/2089545379 shutdown_connections 2024-09-13T18:35:19.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.833+0000 7f041bbb9140 1 -- 172.21.15.44:0/2089545379 >> 172.21.15.44:0/2089545379 conn(0x55f90bc3e280 msgr2=0x55f90bce4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.833+0000 7f041bbb9140 1 -- 172.21.15.44:0/2089545379 shutdown_connections 2024-09-13T18:35:19.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.833+0000 7f041bbb9140 1 -- 172.21.15.44:0/2089545379 wait complete. 2024-09-13T18:35:19.844 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 201.00000000 2024-09-13T18:35:19.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.881+0000 7f9683970140 1 Processor -- start 2024-09-13T18:35:19.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.881+0000 7f9683970140 1 -- start start 2024-09-13T18:35:19.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.881+0000 7f9683970140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559147a07140 0x559147ae0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.881+0000 7f9683970140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559147add140 0x559147adc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.881+0000 7f9683970140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559147add520 0x559147ac2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.881+0000 7f9683970140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591479992f0 con 0x559147a07140 2024-09-13T18:35:19.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.881+0000 7f9683970140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591479558e0 con 0x559147add140 2024-09-13T18:35:19.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.881+0000 7f9683970140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x559147955580 con 0x559147add520 2024-09-13T18:35:19.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.881+0000 7f96814a5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559147a07140 0x559147ae0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.881+0000 7f96814a5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559147a07140 0x559147ae0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40004/0 (socket says 172.21.15.44:40004) 2024-09-13T18:35:19.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.881+0000 7f96814a5700 1 -- 172.21.15.44:0/3701553978 learned_addr learned my addr 172.21.15.44:0/3701553978 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:19.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.881+0000 7f9681ca6700 1 --2- 172.21.15.44:0/3701553978 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559147add520 0x559147ac2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.881+0000 7f9680ca4700 1 --2- 172.21.15.44:0/3701553978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559147add140 0x559147adc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.881+0000 7f96814a5700 1 -- 172.21.15.44:0/3701553978 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559147add520 msgr2=0x559147ac2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.881+0000 7f96814a5700 1 --2- 172.21.15.44:0/3701553978 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559147add520 0x559147ac2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.881+0000 7f96814a5700 1 -- 172.21.15.44:0/3701553978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559147add140 msgr2=0x559147adc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.881+0000 7f96814a5700 1 --2- 172.21.15.44:0/3701553978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559147add140 0x559147adc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.881+0000 7f96814a5700 1 -- 172.21.15.44:0/3701553978 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c005de0 con 0x559147a07140 2024-09-13T18:35:19.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.881+0000 7f96814a5700 1 --2- 172.21.15.44:0/3701553978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559147a07140 0x559147ae0310 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f9674001d60 tx=0x7f967400b510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23874cd981702b1d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f967b7fe700 1 -- 172.21.15.44:0/3701553978 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9674014070 con 0x559147a07140 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f967b7fe700 1 -- 172.21.15.44:0/3701553978 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967400bcc0 con 0x559147a07140 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f967b7fe700 1 -- 172.21.15.44:0/3701553978 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967400f690 con 0x559147a07140 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9683970140 1 -- 172.21.15.44:0/3701553978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559147a07140 msgr2=0x559147ae0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9683970140 1 --2- 172.21.15.44:0/3701553978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559147a07140 0x559147ae0310 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f9674001d60 tx=0x7f967400b510 comp rx=0 tx=0).stop 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9683970140 1 -- 172.21.15.44:0/3701553978 shutdown_connections 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9683970140 1 --2- 172.21.15.44:0/3701553978 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559147add520 0x559147ac2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9683970140 1 --2- 172.21.15.44:0/3701553978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559147add140 0x559147adc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9683970140 1 --2- 172.21.15.44:0/3701553978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559147a07140 0x559147ae0310 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9683970140 1 -- 172.21.15.44:0/3701553978 >> 172.21.15.44:0/3701553978 conn(0x559147a36280 msgr2=0x559147a39820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9683970140 1 -- 172.21.15.44:0/3701553978 shutdown_connections 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9683970140 1 -- 172.21.15.44:0/3701553978 wait complete. 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9683970140 1 Processor -- start 2024-09-13T18:35:19.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9683970140 1 -- start start 2024-09-13T18:35:19.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9683970140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559147a07140 0x559147a4a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9683970140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559147add140 0x559147adb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9683970140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559147add520 0x559147abf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9683970140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55914792b8d0 con 0x559147add140 2024-09-13T18:35:19.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9683970140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559147ada960 con 0x559147add520 2024-09-13T18:35:19.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9683970140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x559147adac00 con 0x559147a07140 2024-09-13T18:35:19.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9680ca4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559147add140 0x559147adb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9680ca4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559147add140 0x559147adb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40012/0 (socket says 172.21.15.44:40012) 2024-09-13T18:35:19.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9680ca4700 1 -- 172.21.15.44:0/4084902537 learned_addr learned my addr 172.21.15.44:0/4084902537 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:19.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f96814a5700 1 --2- 172.21.15.44:0/4084902537 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559147a07140 0x559147a4a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9681ca6700 1 --2- 172.21.15.44:0/4084902537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559147add520 0x559147abf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9680ca4700 1 -- 172.21.15.44:0/4084902537 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559147a07140 msgr2=0x559147a4a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9680ca4700 1 --2- 172.21.15.44:0/4084902537 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559147a07140 0x559147a4a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9680ca4700 1 -- 172.21.15.44:0/4084902537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559147add520 msgr2=0x559147abf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9680ca4700 1 --2- 172.21.15.44:0/4084902537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559147add520 0x559147abf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9680ca4700 1 -- 172.21.15.44:0/4084902537 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559147936bb0 con 0x559147add140 2024-09-13T18:35:19.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f96814a5700 1 --2- 172.21.15.44:0/4084902537 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559147a07140 0x559147a4a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:19.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.885+0000 7f9680ca4700 1 --2- 172.21.15.44:0/4084902537 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559147add140 0x559147adb5e0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f966c015040 tx=0x7f966c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.889+0000 7f967a7fc700 1 -- 172.21.15.44:0/4084902537 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c008690 con 0x559147add140 2024-09-13T18:35:19.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.889+0000 7f967a7fc700 1 -- 172.21.15.44:0/4084902537 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966c012860 con 0x559147add140 2024-09-13T18:35:19.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.889+0000 7f9683970140 1 -- 172.21.15.44:0/4084902537 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559147943b00 con 0x559147add140 2024-09-13T18:35:19.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.889+0000 7f967a7fc700 1 -- 172.21.15.44:0/4084902537 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c012c10 con 0x559147add140 2024-09-13T18:35:19.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.889+0000 7f9683970140 1 -- 172.21.15.44:0/4084902537 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559147936f40 con 0x559147add140 2024-09-13T18:35:19.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.889+0000 7f967a7fc700 1 -- 172.21.15.44:0/4084902537 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f966c027400 con 0x559147add140 2024-09-13T18:35:19.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.889+0000 7f967a7fc700 1 --2- 172.21.15.44:0/4084902537 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9664065090 0x7f9664067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.893+0000 7f967a7fc700 1 -- 172.21.15.44:0/4084902537 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f966c084e00 con 0x559147add140 2024-09-13T18:35:19.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.893+0000 7f96814a5700 1 --2- 172.21.15.44:0/4084902537 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9664065090 0x7f9664067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.893+0000 7f9683970140 1 --2- 172.21.15.44:0/4084902537 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x559147ada1b0 0x559147a4cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.893+0000 7f9683970140 1 -- 172.21.15.44:0/4084902537 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- osd_op(unknown.0.0:1 8.17 8:ea85266a:::201.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e66) v8 -- 0x559147abfb40 con 0x559147ada1b0 2024-09-13T18:35:19.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.893+0000 7f9681ca6700 1 --2- 172.21.15.44:0/4084902537 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x559147ada1b0 0x559147a4cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.893+0000 7f96814a5700 1 --2- 172.21.15.44:0/4084902537 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9664065090 0x7f9664067550 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9674001ed0 tx=0x7f9674009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.893+0000 7f9681ca6700 1 --2- 172.21.15.44:0/4084902537 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x559147ada1b0 0x559147a4cf30 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.893+0000 7f9681ca6700 1 -- 172.21.15.44:0/4084902537 <== osd.7 v2:172.21.15.99:6824/2245335901 1 ==== osd_op_reply(1 201.00000000 [delete] v66'9 uv9 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f967c002a10 con 0x559147ada1b0 2024-09-13T18:35:19.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.897+0000 7f9683970140 1 -- 172.21.15.44:0/4084902537 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x559147ada1b0 msgr2=0x559147a4cf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.897+0000 7f9683970140 1 --2- 172.21.15.44:0/4084902537 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x559147ada1b0 0x559147a4cf30 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.897+0000 7f9683970140 1 -- 172.21.15.44:0/4084902537 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9664065090 msgr2=0x7f9664067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.897+0000 7f9683970140 1 --2- 172.21.15.44:0/4084902537 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9664065090 0x7f9664067550 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9674001ed0 tx=0x7f9674009000 comp rx=0 tx=0).stop 2024-09-13T18:35:19.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.897+0000 7f9683970140 1 -- 172.21.15.44:0/4084902537 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559147add140 msgr2=0x559147adb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.897+0000 7f9683970140 1 --2- 172.21.15.44:0/4084902537 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559147add140 0x559147adb5e0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f966c015040 tx=0x7f966c002fb0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.897+0000 7f9681ca6700 1 -- 172.21.15.44:0/4084902537 reap_dead start 2024-09-13T18:35:19.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.897+0000 7f9683970140 1 -- 172.21.15.44:0/4084902537 shutdown_connections 2024-09-13T18:35:19.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.897+0000 7f9683970140 1 -- 172.21.15.44:0/4084902537 >> 172.21.15.44:0/4084902537 conn(0x559147a36280 msgr2=0x5591479f5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.897+0000 7f9683970140 1 -- 172.21.15.44:0/4084902537 shutdown_connections 2024-09-13T18:35:19.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.897+0000 7f9683970140 1 -- 172.21.15.44:0/4084902537 wait complete. 2024-09-13T18:35:19.905 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata ls 2024-09-13T18:35:19.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.941+0000 7f5470656140 1 Processor -- start 2024-09-13T18:35:19.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.941+0000 7f5470656140 1 -- start start 2024-09-13T18:35:19.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.941+0000 7f5470656140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0ee492140 0x55a0ee54ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.941+0000 7f5470656140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ee568140 0x55a0ee5f9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.941+0000 7f5470656140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0ee568520 0x55a0ee5fa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.941+0000 7f5470656140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0ee428a00 con 0x55a0ee568140 2024-09-13T18:35:19.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.941+0000 7f5470656140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0ee4242f0 con 0x55a0ee492140 2024-09-13T18:35:19.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.941+0000 7f5470656140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0ee3e08e0 con 0x55a0ee568520 2024-09-13T18:35:19.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.941+0000 7f546d98a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ee568140 0x55a0ee5f9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.941+0000 7f546d98a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ee568140 0x55a0ee5f9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40016/0 (socket says 172.21.15.44:40016) 2024-09-13T18:35:19.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.941+0000 7f546d98a700 1 -- 172.21.15.44:0/3392512406 learned_addr learned my addr 172.21.15.44:0/3392512406 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:19.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.941+0000 7f546e18b700 1 --2- 172.21.15.44:0/3392512406 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0ee492140 0x55a0ee54ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.941+0000 7f546e98c700 1 --2- 172.21.15.44:0/3392512406 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0ee568520 0x55a0ee5fa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.941+0000 7f546d98a700 1 -- 172.21.15.44:0/3392512406 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0ee568520 msgr2=0x55a0ee5fa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.941+0000 7f546d98a700 1 --2- 172.21.15.44:0/3392512406 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0ee568520 0x55a0ee5fa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.941+0000 7f546d98a700 1 -- 172.21.15.44:0/3392512406 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0ee492140 msgr2=0x55a0ee54ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.941+0000 7f546d98a700 1 --2- 172.21.15.44:0/3392512406 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0ee492140 0x55a0ee54ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.941+0000 7f546d98a700 1 -- 172.21.15.44:0/3392512406 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545800a100 con 0x55a0ee568140 2024-09-13T18:35:19.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.941+0000 7f546e18b700 1 --2- 172.21.15.44:0/3392512406 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0ee492140 0x55a0ee54ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:19.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.941+0000 7f546e98c700 1 --2- 172.21.15.44:0/3392512406 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0ee568520 0x55a0ee5fa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:19.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.945+0000 7f546d98a700 1 --2- 172.21.15.44:0/3392512406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ee568140 0x55a0ee5f9b20 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x55a0ee4c0e10 tx=0x7f545800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f5a4ecfa6901af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.945+0000 7f546c988700 1 -- 172.21.15.44:0/3392512406 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545800f790 con 0x55a0ee568140 2024-09-13T18:35:19.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.945+0000 7f546c988700 1 -- 172.21.15.44:0/3392512406 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545800fa60 con 0x55a0ee568140 2024-09-13T18:35:19.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.945+0000 7f546c988700 1 -- 172.21.15.44:0/3392512406 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545800fe10 con 0x55a0ee568140 2024-09-13T18:35:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.945+0000 7f5470656140 1 -- 172.21.15.44:0/3392512406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ee568140 msgr2=0x55a0ee5f9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.945+0000 7f5470656140 1 --2- 172.21.15.44:0/3392512406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ee568140 0x55a0ee5f9b20 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x55a0ee4c0e10 tx=0x7f545800f000 comp rx=0 tx=0).stop 2024-09-13T18:35:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.945+0000 7f5470656140 1 -- 172.21.15.44:0/3392512406 shutdown_connections 2024-09-13T18:35:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.945+0000 7f5470656140 1 --2- 172.21.15.44:0/3392512406 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0ee568520 0x55a0ee5fa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.945+0000 7f5470656140 1 --2- 172.21.15.44:0/3392512406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ee568140 0x55a0ee5f9b20 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.945+0000 7f5470656140 1 --2- 172.21.15.44:0/3392512406 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0ee492140 0x55a0ee54ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.945+0000 7f5470656140 1 -- 172.21.15.44:0/3392512406 >> 172.21.15.44:0/3392512406 conn(0x55a0ee4c1280 msgr2=0x55a0ee567450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.945+0000 7f5470656140 1 -- 172.21.15.44:0/3392512406 shutdown_connections 2024-09-13T18:35:19.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.945+0000 7f5470656140 1 -- 172.21.15.44:0/3392512406 wait complete. 2024-09-13T18:35:19.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.945+0000 7f5470656140 1 Processor -- start 2024-09-13T18:35:19.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.945+0000 7f5470656140 1 -- start start 2024-09-13T18:35:19.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.949+0000 7f5470656140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0ee492140 0x55a0ee567170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.949+0000 7f5470656140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ee568140 0x55a0ee5fdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.949+0000 7f5470656140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0ee568520 0x55a0ee54a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.949+0000 7f5470656140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0ee3e0580 con 0x55a0ee568140 2024-09-13T18:35:19.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.949+0000 7f5470656140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0ee3b68d0 con 0x55a0ee492140 2024-09-13T18:35:19.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.949+0000 7f5470656140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0ee5fe9c0 con 0x55a0ee568520 2024-09-13T18:35:19.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.949+0000 7f546d98a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ee568140 0x55a0ee5fdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.949+0000 7f546d98a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ee568140 0x55a0ee5fdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40020/0 (socket says 172.21.15.44:40020) 2024-09-13T18:35:19.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.949+0000 7f546d98a700 1 -- 172.21.15.44:0/686038165 learned_addr learned my addr 172.21.15.44:0/686038165 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:19.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.949+0000 7f546e18b700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0ee492140 0x55a0ee567170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.949+0000 7f546e98c700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0ee568520 0x55a0ee54a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.949+0000 7f546d98a700 1 -- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0ee568520 msgr2=0x55a0ee54a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.949+0000 7f546d98a700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0ee568520 0x55a0ee54a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.949+0000 7f546d98a700 1 -- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0ee492140 msgr2=0x55a0ee567170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.949+0000 7f546d98a700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0ee492140 0x55a0ee567170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.949+0000 7f546d98a700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546800a040 con 0x55a0ee568140 2024-09-13T18:35:19.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.949+0000 7f546e98c700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0ee568520 0x55a0ee54a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:19.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.949+0000 7f546d98a700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ee568140 0x55a0ee5fdfc0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f545801c040 tx=0x7f54580033a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.949+0000 7f54677fe700 1 -- 172.21.15.44:0/686038165 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458025650 con 0x55a0ee568140 2024-09-13T18:35:19.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.949+0000 7f54677fe700 1 -- 172.21.15.44:0/686038165 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545801e050 con 0x55a0ee568140 2024-09-13T18:35:19.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.949+0000 7f5470656140 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a0ee3ceb00 con 0x55a0ee568140 2024-09-13T18:35:19.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.949+0000 7f54677fe700 1 -- 172.21.15.44:0/686038165 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54580259f0 con 0x55a0ee568140 2024-09-13T18:35:19.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.953+0000 7f5470656140 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0ee3c1f40 con 0x55a0ee568140 2024-09-13T18:35:19.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.953+0000 7f54677fe700 1 -- 172.21.15.44:0/686038165 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5458017050 con 0x55a0ee568140 2024-09-13T18:35:19.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.953+0000 7f54677fe700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5450065060 0x7f5450067520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.953+0000 7f54677fe700 1 -- 172.21.15.44:0/686038165 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f54580856d0 con 0x55a0ee568140 2024-09-13T18:35:19.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.953+0000 7f546e18b700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5450065060 0x7f5450067520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.953+0000 7f5470656140 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55a0ee5fe500 0x55a0ee5ffdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.953+0000 7f5470656140 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:1 8.0 8:00000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x55a0ee5fe500 2024-09-13T18:35:19.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.957+0000 7f546e98c700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55a0ee5fe500 0x55a0ee5ffdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.957+0000 7f546e18b700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5450065060 0x7f5450067520 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5468011560 tx=0x7f54680017b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.957+0000 7f546e98c700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55a0ee5fe500 0x55a0ee5ffdf0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.957+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(1 [pgnls start_epoch 66 out=49b] v63'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f546000f690 con 0x55a0ee5fe500 2024-09-13T18:35:19.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.957+0000 7f546e98c700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f546000d8e0 0x7f546000b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.957+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- osd_op(unknown.0.0:2 8.10 8:08000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f546000d8e0 2024-09-13T18:35:19.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.957+0000 7f546e18b700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f546000d8e0 0x7f546000b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.957+0000 7f546e18b700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f546000d8e0 0x7f546000b350 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.957+0000 7f546e18b700 1 -- 172.21.15.44:0/686038165 <== osd.7 v2:172.21.15.99:6824/2245335901 1 ==== osd_op_reply(2 [pgnls start_epoch 66 out=201b] v63'12 uv12 ondisk = 1) v8 ==== 144+0+201 (crc 0 0 0) 0x7f5468017040 con 0x7f546000d8e0 2024-09-13T18:35:19.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.957+0000 7f546e18b700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f546801e8d0 0x7f546800e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.957+0000 7f546e18b700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:3 8.8 8:10000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f546801e8d0 2024-09-13T18:35:19.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.957+0000 7f546d98a700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f546801e8d0 0x7f546800e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.961+0000 7f546d98a700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f546801e8d0 0x7f546800e340 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.961+0000 7f546d98a700 1 -- 172.21.15.44:0/686038165 <== osd.5 v2:172.21.15.99:6800/827163121 1 ==== osd_op_reply(3 [pgnls start_epoch 66 out=73b] v63'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5458056970 con 0x7f546801e8d0 2024-09-13T18:35:19.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.961+0000 7f546d98a700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f5458025070 0x7f5458084ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.961+0000 7f546d98a700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:4 8.18 8:18000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f5458025070 2024-09-13T18:35:19.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.961+0000 7f546e98c700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f5458025070 0x7f5458084ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.961+0000 7f546e98c700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f5458025070 0x7f5458084ed0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.961+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 <== osd.4 v2:172.21.15.99:6816/2515272044 1 ==== osd_op_reply(4 [pgnls start_epoch 66 out=49b] v63'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f546000f690 con 0x7f5458025070 2024-09-13T18:35:19.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.961+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:5 8.4 8:20000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f546801e8d0 2024-09-13T18:35:19.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.961+0000 7f546d98a700 1 -- 172.21.15.44:0/686038165 <== osd.5 v2:172.21.15.99:6800/827163121 2 ==== osd_op_reply(5 [pgnls start_epoch 66 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5458056970 con 0x7f546801e8d0 2024-09-13T18:35:19.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.961+0000 7f546d98a700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:6 8.14 8:28000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f5458025070 2024-09-13T18:35:19.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.965+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 <== osd.4 v2:172.21.15.99:6816/2515272044 2 ==== osd_op_reply(6 [pgnls start_epoch 66 out=149b] v66'1256 uv1256 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x7f546000f690 con 0x7f5458025070 2024-09-13T18:35:19.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.965+0000 7f546e98c700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7f546001d910 0x7f546001c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.965+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:7 8.c 8:30000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f546001d910 2024-09-13T18:35:19.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.965+0000 7f546e18b700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7f546001d910 0x7f546001c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.965+0000 7f546e18b700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7f546001d910 0x7f546001c330 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.965+0000 7f546e18b700 1 -- 172.21.15.44:0/686038165 <== osd.0 v2:172.21.15.44:6800/2647753462 1 ==== osd_op_reply(7 [pgnls start_epoch 66 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5468017040 con 0x7f546001d910 2024-09-13T18:35:19.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.965+0000 7f546e18b700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:8 8.1c 8:38000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f546801e8d0 2024-09-13T18:35:19.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.965+0000 7f546d98a700 1 -- 172.21.15.44:0/686038165 <== osd.5 v2:172.21.15.99:6800/827163121 3 ==== osd_op_reply(8 [pgnls start_epoch 66 out=73b] v62'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5458056970 con 0x7f546801e8d0 2024-09-13T18:35:19.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.965+0000 7f546d98a700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:9 8.2 8:40000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f5458025070 2024-09-13T18:35:19.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.965+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 <== osd.4 v2:172.21.15.99:6816/2515272044 3 ==== osd_op_reply(9 [pgnls start_epoch 66 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f546000f690 con 0x7f5458025070 2024-09-13T18:35:19.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.965+0000 7f546e98c700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f5460021430 0x7f5460021870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.965+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:10 8.12 8:48000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f5460021430 2024-09-13T18:35:19.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.969+0000 7f546d98a700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f5460021430 0x7f5460021870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.969+0000 7f546d98a700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f5460021430 0x7f5460021870 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.969+0000 7f546d98a700 1 -- 172.21.15.44:0/686038165 <== osd.6 v2:172.21.15.99:6808/2907584318 1 ==== osd_op_reply(10 [pgnls start_epoch 66 out=73b] v63'3 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5458056970 con 0x7f5460021430 2024-09-13T18:35:19.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.969+0000 7f546d98a700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7f5458025b50 0x7f545805a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.969+0000 7f546d98a700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:11 8.a 8:50000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f5458025b50 2024-09-13T18:35:19.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.969+0000 7f546e98c700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7f5458025b50 0x7f545805a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.969+0000 7f546e98c700 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7f5458025b50 0x7f545805a0b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.969+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== osd_op_reply(11 [pgnls start_epoch 66 out=49b] v64'9 uv9 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f546000f690 con 0x7f5458025b50 2024-09-13T18:35:19.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.969+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:12 8.1a 8:58000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f546001d910 2024-09-13T18:35:19.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.969+0000 7f546e18b700 1 -- 172.21.15.44:0/686038165 <== osd.0 v2:172.21.15.44:6800/2647753462 2 ==== osd_op_reply(12 [pgnls start_epoch 66 out=49b] v66'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5468017040 con 0x7f546001d910 2024-09-13T18:35:19.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.969+0000 7f546e18b700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:13 8.6 8:60000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f546001d910 2024-09-13T18:35:19.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.973+0000 7f546e18b700 1 -- 172.21.15.44:0/686038165 <== osd.0 v2:172.21.15.44:6800/2647753462 3 ==== osd_op_reply(13 [pgnls start_epoch 66 out=77b] v63'9 uv9 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x7f5468017040 con 0x7f546001d910 2024-09-13T18:35:19.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.973+0000 7f546e18b700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:14 8.16 8:68000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x55a0ee5fe500 2024-09-13T18:35:19.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.973+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 <== osd.3 v2:172.21.15.44:6808/771281770 2 ==== osd_op_reply(14 [pgnls start_epoch 66 out=73b] v63'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f546000f690 con 0x55a0ee5fe500 2024-09-13T18:35:19.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.973+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:15 8.e 8:70000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f546001d910 2024-09-13T18:35:19.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.973+0000 7f546e18b700 1 -- 172.21.15.44:0/686038165 <== osd.0 v2:172.21.15.44:6800/2647753462 4 ==== osd_op_reply(15 [pgnls start_epoch 66 out=73b] v62'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5468017040 con 0x7f546001d910 2024-09-13T18:35:19.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.973+0000 7f546e18b700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:16 8.1e 8:78000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x55a0ee5fe500 2024-09-13T18:35:19.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.973+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 <== osd.3 v2:172.21.15.44:6808/771281770 3 ==== osd_op_reply(16 [pgnls start_epoch 66 out=49b] v66'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f546000f690 con 0x55a0ee5fe500 2024-09-13T18:35:19.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.973+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:17 8.1 8:80000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f5458025b50 2024-09-13T18:35:19.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.973+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 <== osd.1 v2:172.21.15.44:6816/2250405239 2 ==== osd_op_reply(17 [pgnls start_epoch 66 out=49b] v63'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f546000f690 con 0x7f5458025b50 2024-09-13T18:35:19.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.973+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:18 8.11 8:88000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f546801e8d0 2024-09-13T18:35:19.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.977+0000 7f546d98a700 1 -- 172.21.15.44:0/686038165 <== osd.5 v2:172.21.15.99:6800/827163121 4 ==== osd_op_reply(18 [pgnls start_epoch 66 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5458056970 con 0x7f546801e8d0 2024-09-13T18:35:19.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.977+0000 7f546d98a700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:19 8.9 8:90000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f5460021430 2024-09-13T18:35:19.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.977+0000 7f546d98a700 1 -- 172.21.15.44:0/686038165 <== osd.6 v2:172.21.15.99:6808/2907584318 2 ==== osd_op_reply(19 [pgnls start_epoch 66 out=97b] v63'3 uv3 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x7f5458056970 con 0x7f5460021430 2024-09-13T18:35:19.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.977+0000 7f546d98a700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:20 8.19 8:98000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f546801e8d0 2024-09-13T18:35:19.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.977+0000 7f546d98a700 1 -- 172.21.15.44:0/686038165 <== osd.5 v2:172.21.15.99:6800/827163121 5 ==== osd_op_reply(20 [pgnls start_epoch 66 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5458056970 con 0x7f546801e8d0 2024-09-13T18:35:19.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.977+0000 7f546d98a700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:21 8.5 8:a0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f5460021430 2024-09-13T18:35:19.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.977+0000 7f546d98a700 1 -- 172.21.15.44:0/686038165 <== osd.6 v2:172.21.15.99:6808/2907584318 3 ==== osd_op_reply(21 [pgnls start_epoch 66 out=73b] v63'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5458056970 con 0x7f5460021430 2024-09-13T18:35:19.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.977+0000 7f546d98a700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- osd_op(unknown.0.0:22 8.15 8:a8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f546000d8e0 2024-09-13T18:35:19.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.977+0000 7f546e18b700 1 -- 172.21.15.44:0/686038165 <== osd.7 v2:172.21.15.99:6824/2245335901 2 ==== osd_op_reply(22 [pgnls start_epoch 66 out=127b] v63'4 uv4 ondisk = 1) v8 ==== 144+0+127 (crc 0 0 0) 0x7f5468017040 con 0x7f546000d8e0 2024-09-13T18:35:19.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.977+0000 7f546e18b700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:23 8.d 8:b0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f546801e8d0 2024-09-13T18:35:19.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.981+0000 7f546d98a700 1 -- 172.21.15.44:0/686038165 <== osd.5 v2:172.21.15.99:6800/827163121 6 ==== osd_op_reply(23 [pgnls start_epoch 66 out=74b] v62'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f5458056970 con 0x7f546801e8d0 2024-09-13T18:35:19.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.981+0000 7f546d98a700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:24 8.1d 8:b8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f546001d910 2024-09-13T18:35:19.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.981+0000 7f546e18b700 1 -- 172.21.15.44:0/686038165 <== osd.0 v2:172.21.15.44:6800/2647753462 5 ==== osd_op_reply(24 [pgnls start_epoch 66 out=73b] v66'5 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5468017040 con 0x7f546001d910 2024-09-13T18:35:19.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.981+0000 7f546e18b700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:25 8.3 8:c0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f5458025b50 2024-09-13T18:35:19.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.981+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 <== osd.1 v2:172.21.15.44:6816/2250405239 3 ==== osd_op_reply(25 [pgnls start_epoch 66 out=73b] v64'4 uv4 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f546000f690 con 0x7f5458025b50 2024-09-13T18:35:19.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.981+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:26 8.13 8:c8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x55a0ee5fe500 2024-09-13T18:35:19.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.981+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 <== osd.3 v2:172.21.15.44:6808/771281770 4 ==== osd_op_reply(26 [pgnls start_epoch 66 out=122b] v63'5 uv5 ondisk = 1) v8 ==== 144+0+122 (crc 0 0 0) 0x7f546000f690 con 0x55a0ee5fe500 2024-09-13T18:35:19.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.981+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:27 8.b 8:d0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x55a0ee5fe500 2024-09-13T18:35:19.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.981+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 <== osd.3 v2:172.21.15.44:6808/771281770 5 ==== osd_op_reply(27 [pgnls start_epoch 66 out=124b] v66'8 uv8 ondisk = 1) v8 ==== 144+0+124 (crc 0 0 0) 0x7f546000f690 con 0x55a0ee5fe500 2024-09-13T18:35:19.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.981+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:28 8.1b 8:d8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f5458025070 2024-09-13T18:35:19.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.985+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 <== osd.4 v2:172.21.15.99:6816/2515272044 4 ==== osd_op_reply(28 [pgnls start_epoch 66 out=73b] v66'1792 uv1792 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f546000f690 con 0x7f5458025070 2024-09-13T18:35:19.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.985+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:29 8.7 8:e0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f5458025b50 2024-09-13T18:35:19.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.985+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 <== osd.1 v2:172.21.15.44:6816/2250405239 4 ==== osd_op_reply(29 [pgnls start_epoch 66 out=129b] v63'6 uv6 ondisk = 1) v8 ==== 144+0+129 (crc 0 0 0) 0x7f546000f690 con 0x7f5458025b50 2024-09-13T18:35:19.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.985+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- osd_op(unknown.0.0:30 8.17 8:e8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f546000d8e0 2024-09-13T18:35:19.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.985+0000 7f546e18b700 1 -- 172.21.15.44:0/686038165 <== osd.7 v2:172.21.15.99:6824/2245335901 3 ==== osd_op_reply(30 [pgnls start_epoch 66 out=73b] v66'9 uv9 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5468017040 con 0x7f546000d8e0 2024-09-13T18:35:19.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.985+0000 7f546e18b700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:31 8.f 8:f0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x55a0ee5fe500 2024-09-13T18:35:19.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.985+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 <== osd.3 v2:172.21.15.44:6808/771281770 6 ==== osd_op_reply(31 [pgnls start_epoch 66 out=73b] v62'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f546000f690 con 0x55a0ee5fe500 2024-09-13T18:35:19.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.985+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:32 8.1f 8:f8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x55a0ee5676b0 con 0x7f546001d910 2024-09-13T18:35:19.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.985+0000 7f546e18b700 1 -- 172.21.15.44:0/686038165 <== osd.0 v2:172.21.15.44:6800/2647753462 6 ==== osd_op_reply(32 [pgnls start_epoch 66 out=101b] v66'11 uv10 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x7f5468017040 con 0x7f546001d910 2024-09-13T18:35:19.992 INFO:teuthology.orchestra.run.smithi044.stdout:601.00000000 2024-09-13T18:35:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:602.00000000 2024-09-13T18:35:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:10000000000.00000000 2024-09-13T18:35:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:600.00000000 2024-09-13T18:35:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:603.00000000 2024-09-13T18:35:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:60a.00000000 2024-09-13T18:35:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:613.00000000 2024-09-13T18:35:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:1.00000000.inode 2024-09-13T18:35:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:200.00000000 2024-09-13T18:35:19.993 INFO:teuthology.orchestra.run.smithi044.stdout:610.00000000 2024-09-13T18:35:19.994 INFO:teuthology.orchestra.run.smithi044.stdout:606.00000000 2024-09-13T18:35:19.994 INFO:teuthology.orchestra.run.smithi044.stdout:607.00000000 2024-09-13T18:35:19.994 INFO:teuthology.orchestra.run.smithi044.stdout:60e.00000000 2024-09-13T18:35:19.994 INFO:teuthology.orchestra.run.smithi044.stdout:mds0_openfiles.0 2024-09-13T18:35:19.994 INFO:teuthology.orchestra.run.smithi044.stdout:60f.00000000 2024-09-13T18:35:19.994 INFO:teuthology.orchestra.run.smithi044.stdout:608.00000000 2024-09-13T18:35:19.994 INFO:teuthology.orchestra.run.smithi044.stdout:501.00000000 2024-09-13T18:35:19.994 INFO:teuthology.orchestra.run.smithi044.stdout:612.00000000 2024-09-13T18:35:19.994 INFO:teuthology.orchestra.run.smithi044.stdout:401.00000000 2024-09-13T18:35:19.994 INFO:teuthology.orchestra.run.smithi044.stdout:604.00000000 2024-09-13T18:35:19.994 INFO:teuthology.orchestra.run.smithi044.stdout:101.00000000.inode 2024-09-13T18:35:19.994 INFO:teuthology.orchestra.run.smithi044.stdout:500.00000000 2024-09-13T18:35:19.994 INFO:teuthology.orchestra.run.smithi044.stdout:mds_snaptable 2024-09-13T18:35:19.995 INFO:teuthology.orchestra.run.smithi044.stdout:605.00000000 2024-09-13T18:35:19.995 INFO:teuthology.orchestra.run.smithi044.stdout:101.00000000 2024-09-13T18:35:19.995 INFO:teuthology.orchestra.run.smithi044.stdout:mds0_inotable 2024-09-13T18:35:19.995 INFO:teuthology.orchestra.run.smithi044.stdout:611.00000000 2024-09-13T18:35:19.995 INFO:teuthology.orchestra.run.smithi044.stdout:100.00000000 2024-09-13T18:35:19.995 INFO:teuthology.orchestra.run.smithi044.stdout:mds0_sessionmap 2024-09-13T18:35:19.995 INFO:teuthology.orchestra.run.smithi044.stdout:200.00000003 2024-09-13T18:35:19.995 INFO:teuthology.orchestra.run.smithi044.stdout:60c.00000000 2024-09-13T18:35:19.995 INFO:teuthology.orchestra.run.smithi044.stdout:200.00000002 2024-09-13T18:35:19.995 INFO:teuthology.orchestra.run.smithi044.stdout:609.00000000 2024-09-13T18:35:19.996 INFO:teuthology.orchestra.run.smithi044.stdout:10000000001.00000000 2024-09-13T18:35:19.996 INFO:teuthology.orchestra.run.smithi044.stdout:60b.00000000 2024-09-13T18:35:19.996 INFO:teuthology.orchestra.run.smithi044.stdout:60d.00000000 2024-09-13T18:35:19.996 INFO:teuthology.orchestra.run.smithi044.stdout:400.00000000 2024-09-13T18:35:19.996 INFO:teuthology.orchestra.run.smithi044.stdout:100.00000000.inode 2024-09-13T18:35:19.996 INFO:teuthology.orchestra.run.smithi044.stdout:1.00000000 2024-09-13T18:35:19.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.985+0000 7f5470656140 1 -- 172.21.15.44:0/686038165 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7f546001d910 msgr2=0x7f546001c330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7f546001d910 0x7f546001c330 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 -- 172.21.15.44:0/686038165 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7f5458025b50 msgr2=0x7f545805a0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7f5458025b50 0x7f545805a0b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 -- 172.21.15.44:0/686038165 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55a0ee5fe500 msgr2=0x55a0ee5ffdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x55a0ee5fe500 0x55a0ee5ffdf0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 -- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f5458025070 msgr2=0x7f5458084ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f5458025070 0x7f5458084ed0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 -- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f546801e8d0 msgr2=0x7f546800e340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f546801e8d0 0x7f546800e340 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 reap_dead start 2024-09-13T18:35:20.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 -- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f5460021430 msgr2=0x7f5460021870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f546e98c700 1 -- 172.21.15.44:0/686038165 reap_dead start 2024-09-13T18:35:20.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f5460021430 0x7f5460021870 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 -- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f546000d8e0 msgr2=0x7f546000b350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f546000d8e0 0x7f546000b350 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 -- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5450065060 msgr2=0x7f5450067520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5450065060 0x7f5450067520 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5468011560 tx=0x7f54680017b0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 -- 172.21.15.44:0/686038165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ee568140 msgr2=0x55a0ee5fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ee568140 0x55a0ee5fdfc0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f545801c040 tx=0x7f54580033a0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 -- 172.21.15.44:0/686038165 shutdown_connections 2024-09-13T18:35:20.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f546000d8e0 0x7f546000b350 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f5460021430 0x7f5460021870 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5450065060 0x7f5450067520 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 --2- 172.21.15.44:0/686038165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ee568140 0x55a0ee5fdfc0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 -- 172.21.15.44:0/686038165 >> 172.21.15.44:0/686038165 conn(0x55a0ee4c1280 msgr2=0x55a0ee56a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:20.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 -- 172.21.15.44:0/686038165 shutdown_connections 2024-09-13T18:35:20.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:19.989+0000 7f5470656140 1 -- 172.21.15.44:0/686038165 wait complete. 2024-09-13T18:35:20.003 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata ls 2024-09-13T18:35:20.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.073+0000 7f5bc3f08140 1 Processor -- start 2024-09-13T18:35:20.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.073+0000 7f5bc3f08140 1 -- start start 2024-09-13T18:35:20.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc3f08140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563798861980 0x563798835f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc3f08140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637988f0ad0 0x563798860160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc3f08140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637988f35d0 0x56379887ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc3f08140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637987caa00 con 0x5637988f0ad0 2024-09-13T18:35:20.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc3f08140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637987c62f0 con 0x5637988f35d0 2024-09-13T18:35:20.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc3f08140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5637987828e0 con 0x563798861980 2024-09-13T18:35:20.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc123c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637988f0ad0 0x563798860160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc123c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637988f0ad0 0x563798860160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40032/0 (socket says 172.21.15.44:40032) 2024-09-13T18:35:20.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc123c700 1 -- 172.21.15.44:0/3767215536 learned_addr learned my addr 172.21.15.44:0/3767215536 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:20.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc223e700 1 --2- 172.21.15.44:0/3767215536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637988f35d0 0x56379887ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc1a3d700 1 --2- 172.21.15.44:0/3767215536 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563798861980 0x563798835f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc123c700 1 -- 172.21.15.44:0/3767215536 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563798861980 msgr2=0x563798835f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:20.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc123c700 1 --2- 172.21.15.44:0/3767215536 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563798861980 0x563798835f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc123c700 1 -- 172.21.15.44:0/3767215536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637988f35d0 msgr2=0x56379887ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:20.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc123c700 1 --2- 172.21.15.44:0/3767215536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637988f35d0 0x56379887ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc123c700 1 -- 172.21.15.44:0/3767215536 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc005d20 con 0x5637988f0ad0 2024-09-13T18:35:20.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc1a3d700 1 --2- 172.21.15.44:0/3767215536 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563798861980 0x563798835f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:20.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc123c700 1 --2- 172.21.15.44:0/3767215536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637988f0ad0 0x563798860160 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f5bac006f30 tx=0x7f5bac001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dec42bd0c72a3a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bbbfff700 1 -- 172.21.15.44:0/3767215536 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac012600 con 0x5637988f0ad0 2024-09-13T18:35:20.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bbbfff700 1 -- 172.21.15.44:0/3767215536 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bac012780 con 0x5637988f0ad0 2024-09-13T18:35:20.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bbbfff700 1 -- 172.21.15.44:0/3767215536 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac012b30 con 0x5637988f0ad0 2024-09-13T18:35:20.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc3f08140 1 -- 172.21.15.44:0/3767215536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637988f0ad0 msgr2=0x563798860160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc3f08140 1 --2- 172.21.15.44:0/3767215536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637988f0ad0 0x563798860160 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f5bac006f30 tx=0x7f5bac001930 comp rx=0 tx=0).stop 2024-09-13T18:35:20.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc3f08140 1 -- 172.21.15.44:0/3767215536 shutdown_connections 2024-09-13T18:35:20.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc3f08140 1 --2- 172.21.15.44:0/3767215536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637988f35d0 0x56379887ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc3f08140 1 --2- 172.21.15.44:0/3767215536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637988f0ad0 0x563798860160 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc3f08140 1 --2- 172.21.15.44:0/3767215536 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x563798861980 0x563798835f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc3f08140 1 -- 172.21.15.44:0/3767215536 >> 172.21.15.44:0/3767215536 conn(0x5637988325d0 msgr2=0x56379890cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:20.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc3f08140 1 -- 172.21.15.44:0/3767215536 shutdown_connections 2024-09-13T18:35:20.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.077+0000 7f5bc3f08140 1 -- 172.21.15.44:0/3767215536 wait complete. 2024-09-13T18:35:20.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.081+0000 7f5bc3f08140 1 Processor -- start 2024-09-13T18:35:20.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.081+0000 7f5bc3f08140 1 -- start start 2024-09-13T18:35:20.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.081+0000 7f5bc3f08140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563798861980 0x5637988579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.081+0000 7f5bc3f08140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637988f0ad0 0x5637989a2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.081+0000 7f5bc3f08140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637988f35d0 0x56379899f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.081+0000 7f5bc3f08140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x563798782580 con 0x5637988f35d0 2024-09-13T18:35:20.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.081+0000 7f5bc3f08140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637987588d0 con 0x563798861980 2024-09-13T18:35:20.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.081+0000 7f5bc3f08140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x56379890d670 con 0x5637988f0ad0 2024-09-13T18:35:20.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.081+0000 7f5bc223e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637988f35d0 0x56379899f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.081+0000 7f5bc1a3d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563798861980 0x5637988579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.081+0000 7f5bc1a3d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563798861980 0x5637988579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:47166/0 (socket says 172.21.15.44:47166) 2024-09-13T18:35:20.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.081+0000 7f5bc1a3d700 1 -- 172.21.15.44:0/3367635630 learned_addr learned my addr 172.21.15.44:0/3367635630 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:20.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.081+0000 7f5bc223e700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637988f35d0 0x56379899f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40038/0 (socket says 172.21.15.44:40038) 2024-09-13T18:35:20.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.081+0000 7f5bc123c700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637988f0ad0 0x5637989a2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.085+0000 7f5bc1a3d700 1 -- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637988f0ad0 msgr2=0x5637989a2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.085+0000 7f5bc1a3d700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637988f0ad0 0x5637989a2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.085+0000 7f5bc1a3d700 1 -- 172.21.15.44:0/3367635630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637988f35d0 msgr2=0x56379899f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.085+0000 7f5bc1a3d700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637988f35d0 0x56379899f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.085+0000 7f5bc1a3d700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563798763bb0 con 0x563798861980 2024-09-13T18:35:20.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.085+0000 7f5bc123c700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5637988f0ad0 0x5637989a2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:20.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.085+0000 7f5bc1a3d700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563798861980 0x5637988579f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5bb400dd00 tx=0x7f5bb400b5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.085+0000 7f5bbaffd700 1 -- 172.21.15.44:0/3367635630 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb400de50 con 0x563798861980 2024-09-13T18:35:20.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.085+0000 7f5bc3f08140 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563798763f40 con 0x563798861980 2024-09-13T18:35:20.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.085+0000 7f5bbaffd700 1 -- 172.21.15.44:0/3367635630 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb400f450 con 0x563798861980 2024-09-13T18:35:20.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.085+0000 7f5bbaffd700 1 -- 172.21.15.44:0/3367635630 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb400f7c0 con 0x563798861980 2024-09-13T18:35:20.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.085+0000 7f5bc3f08140 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5637987639a0 con 0x563798861980 2024-09-13T18:35:20.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.085+0000 7f5bbaffd700 1 -- 172.21.15.44:0/3367635630 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5bb400f920 con 0x563798861980 2024-09-13T18:35:20.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.089+0000 7f5bbaffd700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5ba4065090 0x7f5ba4067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.089+0000 7f5bbaffd700 1 -- 172.21.15.44:0/3367635630 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f5bb4083280 con 0x563798861980 2024-09-13T18:35:20.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.089+0000 7f5bc123c700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5ba4065090 0x7f5ba4067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.089+0000 7f5bc3f08140 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5637988799b0 0x5637988592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.089+0000 7f5bc3f08140 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:1 8.0 8:00000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x5637988799b0 2024-09-13T18:35:20.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.089+0000 7f5bc223e700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5637988799b0 0x5637988592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.089+0000 7f5bc223e700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5637988799b0 0x5637988592a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.089+0000 7f5bc123c700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5ba4065090 0x7f5ba4067550 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5bac014040 tx=0x7f5bac008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.089+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(1 [pgnls start_epoch 66 out=49b] v63'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5bbc019040 con 0x5637988799b0 2024-09-13T18:35:20.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.089+0000 7f5bc223e700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f5bbc00a040 0x7f5bbc012920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.089+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- osd_op(unknown.0.0:2 8.10 8:08000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bbc00a040 2024-09-13T18:35:20.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.089+0000 7f5bc1a3d700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f5bbc00a040 0x7f5bbc012920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.089+0000 7f5bc1a3d700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f5bbc00a040 0x7f5bbc012920 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.089+0000 7f5bc1a3d700 1 -- 172.21.15.44:0/3367635630 <== osd.7 v2:172.21.15.99:6824/2245335901 1 ==== osd_op_reply(2 [pgnls start_epoch 66 out=201b] v63'12 uv12 ondisk = 1) v8 ==== 144+0+201 (crc 0 0 0) 0x7f5bb4052560 con 0x7f5bbc00a040 2024-09-13T18:35:20.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.089+0000 7f5bc1a3d700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f5bb4054420 0x7f5bb4053120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.089+0000 7f5bc1a3d700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:3 8.8 8:10000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bb4054420 2024-09-13T18:35:20.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.093+0000 7f5bc123c700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f5bb4054420 0x7f5bb4053120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.093+0000 7f5bc123c700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f5bb4054420 0x7f5bb4053120 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.093+0000 7f5bc123c700 1 -- 172.21.15.44:0/3367635630 <== osd.5 v2:172.21.15.99:6800/827163121 1 ==== osd_op_reply(3 [pgnls start_epoch 66 out=73b] v63'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5bac012bb0 con 0x7f5bb4054420 2024-09-13T18:35:20.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.093+0000 7f5bc123c700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f5bac012020 0x7f5bac02a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.093+0000 7f5bc123c700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:4 8.18 8:18000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bac012020 2024-09-13T18:35:20.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.093+0000 7f5bc223e700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f5bac012020 0x7f5bac02a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.093+0000 7f5bc223e700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f5bac012020 0x7f5bac02a410 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.093+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 <== osd.4 v2:172.21.15.99:6816/2515272044 1 ==== osd_op_reply(4 [pgnls start_epoch 66 out=49b] v63'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5bbc019040 con 0x7f5bac012020 2024-09-13T18:35:20.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.093+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:5 8.4 8:20000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bb4054420 2024-09-13T18:35:20.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.093+0000 7f5bc123c700 1 -- 172.21.15.44:0/3367635630 <== osd.5 v2:172.21.15.99:6800/827163121 2 ==== osd_op_reply(5 [pgnls start_epoch 66 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5bac012bb0 con 0x7f5bb4054420 2024-09-13T18:35:20.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.093+0000 7f5bc123c700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:6 8.14 8:28000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bac012020 2024-09-13T18:35:20.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.097+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 <== osd.4 v2:172.21.15.99:6816/2515272044 2 ==== osd_op_reply(6 [pgnls start_epoch 66 out=149b] v66'1256 uv1256 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x7f5bbc019040 con 0x7f5bac012020 2024-09-13T18:35:20.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.097+0000 7f5bc223e700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7f5bbc02d400 0x7f5bbc02d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.097+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:7 8.c 8:30000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bbc02d400 2024-09-13T18:35:20.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.097+0000 7f5bc1a3d700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7f5bbc02d400 0x7f5bbc02d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.097+0000 7f5bc1a3d700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7f5bbc02d400 0x7f5bbc02d880 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.097+0000 7f5bc1a3d700 1 -- 172.21.15.44:0/3367635630 <== osd.0 v2:172.21.15.44:6800/2647753462 1 ==== osd_op_reply(7 [pgnls start_epoch 66 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5bb4052560 con 0x7f5bbc02d400 2024-09-13T18:35:20.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.097+0000 7f5bc1a3d700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:8 8.1c 8:38000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bb4054420 2024-09-13T18:35:20.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.097+0000 7f5bc123c700 1 -- 172.21.15.44:0/3367635630 <== osd.5 v2:172.21.15.99:6800/827163121 3 ==== osd_op_reply(8 [pgnls start_epoch 66 out=73b] v62'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5bac012bb0 con 0x7f5bb4054420 2024-09-13T18:35:20.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.097+0000 7f5bc123c700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:9 8.2 8:40000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bac012020 2024-09-13T18:35:20.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.097+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 <== osd.4 v2:172.21.15.99:6816/2515272044 3 ==== osd_op_reply(9 [pgnls start_epoch 66 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5bbc019040 con 0x7f5bac012020 2024-09-13T18:35:20.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.097+0000 7f5bc223e700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f5bbc01e910 0x7f5bbc0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.097+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:10 8.12 8:48000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bbc01e910 2024-09-13T18:35:20.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.101+0000 7f5bc123c700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f5bbc01e910 0x7f5bbc0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.101+0000 7f5bc123c700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f5bbc01e910 0x7f5bbc0073e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.101+0000 7f5bc123c700 1 -- 172.21.15.44:0/3367635630 <== osd.6 v2:172.21.15.99:6808/2907584318 1 ==== osd_op_reply(10 [pgnls start_epoch 66 out=73b] v63'3 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5bac012bb0 con 0x7f5bbc01e910 2024-09-13T18:35:20.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.101+0000 7f5bc123c700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7f5bac038940 0x7f5bac011420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.101+0000 7f5bc123c700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:11 8.a 8:50000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bac038940 2024-09-13T18:35:20.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.101+0000 7f5bc223e700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7f5bac038940 0x7f5bac011420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.101+0000 7f5bc223e700 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7f5bac038940 0x7f5bac011420 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.101+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== osd_op_reply(11 [pgnls start_epoch 66 out=49b] v64'9 uv9 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5bbc037040 con 0x7f5bac038940 2024-09-13T18:35:20.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.101+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:12 8.1a 8:58000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bbc02d400 2024-09-13T18:35:20.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.101+0000 7f5bc1a3d700 1 -- 172.21.15.44:0/3367635630 <== osd.0 v2:172.21.15.44:6800/2647753462 2 ==== osd_op_reply(12 [pgnls start_epoch 66 out=49b] v66'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5bb4052560 con 0x7f5bbc02d400 2024-09-13T18:35:20.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.101+0000 7f5bc1a3d700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:13 8.6 8:60000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bbc02d400 2024-09-13T18:35:20.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.105+0000 7f5bc1a3d700 1 -- 172.21.15.44:0/3367635630 <== osd.0 v2:172.21.15.44:6800/2647753462 3 ==== osd_op_reply(13 [pgnls start_epoch 66 out=77b] v63'9 uv9 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x7f5bb4052560 con 0x7f5bbc02d400 2024-09-13T18:35:20.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.105+0000 7f5bc1a3d700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:14 8.16 8:68000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x5637988799b0 2024-09-13T18:35:20.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.105+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 <== osd.3 v2:172.21.15.44:6808/771281770 2 ==== osd_op_reply(14 [pgnls start_epoch 66 out=73b] v63'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5bbc037040 con 0x5637988799b0 2024-09-13T18:35:20.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.105+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:15 8.e 8:70000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bbc02d400 2024-09-13T18:35:20.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.105+0000 7f5bc1a3d700 1 -- 172.21.15.44:0/3367635630 <== osd.0 v2:172.21.15.44:6800/2647753462 4 ==== osd_op_reply(15 [pgnls start_epoch 66 out=73b] v62'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5bb4052560 con 0x7f5bbc02d400 2024-09-13T18:35:20.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.105+0000 7f5bc1a3d700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:16 8.1e 8:78000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x5637988799b0 2024-09-13T18:35:20.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.105+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 <== osd.3 v2:172.21.15.44:6808/771281770 3 ==== osd_op_reply(16 [pgnls start_epoch 66 out=49b] v66'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5bbc037040 con 0x5637988799b0 2024-09-13T18:35:20.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.105+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:17 8.1 8:80000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bac038940 2024-09-13T18:35:20.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.105+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 <== osd.1 v2:172.21.15.44:6816/2250405239 2 ==== osd_op_reply(17 [pgnls start_epoch 66 out=49b] v63'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5bbc037040 con 0x7f5bac038940 2024-09-13T18:35:20.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.105+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:18 8.11 8:88000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bb4054420 2024-09-13T18:35:20.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.105+0000 7f5bc123c700 1 -- 172.21.15.44:0/3367635630 <== osd.5 v2:172.21.15.99:6800/827163121 4 ==== osd_op_reply(18 [pgnls start_epoch 66 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5bac012bb0 con 0x7f5bb4054420 2024-09-13T18:35:20.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.105+0000 7f5bc123c700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:19 8.9 8:90000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bbc01e910 2024-09-13T18:35:20.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.109+0000 7f5bc123c700 1 -- 172.21.15.44:0/3367635630 <== osd.6 v2:172.21.15.99:6808/2907584318 2 ==== osd_op_reply(19 [pgnls start_epoch 66 out=97b] v63'3 uv3 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x7f5bac012bb0 con 0x7f5bbc01e910 2024-09-13T18:35:20.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.109+0000 7f5bc123c700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:20 8.19 8:98000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bb4054420 2024-09-13T18:35:20.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.109+0000 7f5bc123c700 1 -- 172.21.15.44:0/3367635630 <== osd.5 v2:172.21.15.99:6800/827163121 5 ==== osd_op_reply(20 [pgnls start_epoch 66 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5bac012bb0 con 0x7f5bb4054420 2024-09-13T18:35:20.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.109+0000 7f5bc123c700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:21 8.5 8:a0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bbc01e910 2024-09-13T18:35:20.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.109+0000 7f5bc123c700 1 -- 172.21.15.44:0/3367635630 <== osd.6 v2:172.21.15.99:6808/2907584318 3 ==== osd_op_reply(21 [pgnls start_epoch 66 out=73b] v63'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5bac012bb0 con 0x7f5bbc01e910 2024-09-13T18:35:20.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.109+0000 7f5bc123c700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- osd_op(unknown.0.0:22 8.15 8:a8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bbc00a040 2024-09-13T18:35:20.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.109+0000 7f5bc1a3d700 1 -- 172.21.15.44:0/3367635630 <== osd.7 v2:172.21.15.99:6824/2245335901 2 ==== osd_op_reply(22 [pgnls start_epoch 66 out=127b] v63'4 uv4 ondisk = 1) v8 ==== 144+0+127 (crc 0 0 0) 0x7f5bb4052560 con 0x7f5bbc00a040 2024-09-13T18:35:20.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.109+0000 7f5bc1a3d700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:23 8.d 8:b0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bb4054420 2024-09-13T18:35:20.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.109+0000 7f5bc123c700 1 -- 172.21.15.44:0/3367635630 <== osd.5 v2:172.21.15.99:6800/827163121 6 ==== osd_op_reply(23 [pgnls start_epoch 66 out=74b] v62'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f5bac012bb0 con 0x7f5bb4054420 2024-09-13T18:35:20.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.109+0000 7f5bc123c700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:24 8.1d 8:b8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bbc02d400 2024-09-13T18:35:20.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.113+0000 7f5bc1a3d700 1 -- 172.21.15.44:0/3367635630 <== osd.0 v2:172.21.15.44:6800/2647753462 5 ==== osd_op_reply(24 [pgnls start_epoch 66 out=73b] v66'5 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5bb4052560 con 0x7f5bbc02d400 2024-09-13T18:35:20.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.113+0000 7f5bc1a3d700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:25 8.3 8:c0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bac038940 2024-09-13T18:35:20.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.113+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 <== osd.1 v2:172.21.15.44:6816/2250405239 3 ==== osd_op_reply(25 [pgnls start_epoch 66 out=73b] v64'4 uv4 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5bbc037040 con 0x7f5bac038940 2024-09-13T18:35:20.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.113+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:26 8.13 8:c8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x5637988799b0 2024-09-13T18:35:20.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.113+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 <== osd.3 v2:172.21.15.44:6808/771281770 4 ==== osd_op_reply(26 [pgnls start_epoch 66 out=122b] v63'5 uv5 ondisk = 1) v8 ==== 144+0+122 (crc 0 0 0) 0x7f5bbc037040 con 0x5637988799b0 2024-09-13T18:35:20.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.113+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:27 8.b 8:d0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x5637988799b0 2024-09-13T18:35:20.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.113+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 <== osd.3 v2:172.21.15.44:6808/771281770 5 ==== osd_op_reply(27 [pgnls start_epoch 66 out=124b] v66'8 uv8 ondisk = 1) v8 ==== 144+0+124 (crc 0 0 0) 0x7f5bbc037040 con 0x5637988799b0 2024-09-13T18:35:20.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.113+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:28 8.1b 8:d8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bac012020 2024-09-13T18:35:20.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.113+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 <== osd.4 v2:172.21.15.99:6816/2515272044 4 ==== osd_op_reply(28 [pgnls start_epoch 66 out=73b] v66'1792 uv1792 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5bbc037040 con 0x7f5bac012020 2024-09-13T18:35:20.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.113+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:29 8.7 8:e0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bac038940 2024-09-13T18:35:20.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 <== osd.1 v2:172.21.15.44:6816/2250405239 4 ==== osd_op_reply(29 [pgnls start_epoch 66 out=129b] v63'6 uv6 ondisk = 1) v8 ==== 144+0+129 (crc 0 0 0) 0x7f5bbc037040 con 0x7f5bac038940 2024-09-13T18:35:20.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- osd_op(unknown.0.0:30 8.17 8:e8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bbc00a040 2024-09-13T18:35:20.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc1a3d700 1 -- 172.21.15.44:0/3367635630 <== osd.7 v2:172.21.15.99:6824/2245335901 3 ==== osd_op_reply(30 [pgnls start_epoch 66 out=73b] v66'9 uv9 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5bb4052560 con 0x7f5bbc00a040 2024-09-13T18:35:20.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc1a3d700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:31 8.f 8:f0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x5637988799b0 2024-09-13T18:35:20.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 <== osd.3 v2:172.21.15.44:6808/771281770 6 ==== osd_op_reply(31 [pgnls start_epoch 66 out=73b] v62'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5bbc037040 con 0x5637988799b0 2024-09-13T18:35:20.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:32 8.1f 8:f8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x5637988597e0 con 0x7f5bbc02d400 2024-09-13T18:35:20.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc1a3d700 1 -- 172.21.15.44:0/3367635630 <== osd.0 v2:172.21.15.44:6800/2647753462 6 ==== osd_op_reply(32 [pgnls start_epoch 66 out=101b] v66'11 uv10 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x7f5bb4052560 con 0x7f5bbc02d400 2024-09-13T18:35:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:601.00000000 2024-09-13T18:35:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:602.00000000 2024-09-13T18:35:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:10000000000.00000000 2024-09-13T18:35:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:600.00000000 2024-09-13T18:35:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:603.00000000 2024-09-13T18:35:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:60a.00000000 2024-09-13T18:35:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:613.00000000 2024-09-13T18:35:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:1.00000000.inode 2024-09-13T18:35:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:200.00000000 2024-09-13T18:35:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:610.00000000 2024-09-13T18:35:20.126 INFO:teuthology.orchestra.run.smithi044.stdout:606.00000000 2024-09-13T18:35:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:607.00000000 2024-09-13T18:35:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:60e.00000000 2024-09-13T18:35:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:mds0_openfiles.0 2024-09-13T18:35:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:60f.00000000 2024-09-13T18:35:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:608.00000000 2024-09-13T18:35:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:501.00000000 2024-09-13T18:35:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:612.00000000 2024-09-13T18:35:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:401.00000000 2024-09-13T18:35:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:604.00000000 2024-09-13T18:35:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:101.00000000.inode 2024-09-13T18:35:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:500.00000000 2024-09-13T18:35:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:mds_snaptable 2024-09-13T18:35:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:605.00000000 2024-09-13T18:35:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:101.00000000 2024-09-13T18:35:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:mds0_inotable 2024-09-13T18:35:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:611.00000000 2024-09-13T18:35:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:100.00000000 2024-09-13T18:35:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:mds0_sessionmap 2024-09-13T18:35:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:200.00000003 2024-09-13T18:35:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:60c.00000000 2024-09-13T18:35:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:200.00000002 2024-09-13T18:35:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:609.00000000 2024-09-13T18:35:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:10000000001.00000000 2024-09-13T18:35:20.129 INFO:teuthology.orchestra.run.smithi044.stdout:60b.00000000 2024-09-13T18:35:20.129 INFO:teuthology.orchestra.run.smithi044.stdout:60d.00000000 2024-09-13T18:35:20.129 INFO:teuthology.orchestra.run.smithi044.stdout:400.00000000 2024-09-13T18:35:20.129 INFO:teuthology.orchestra.run.smithi044.stdout:100.00000000.inode 2024-09-13T18:35:20.129 INFO:teuthology.orchestra.run.smithi044.stdout:1.00000000 2024-09-13T18:35:20.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 -- 172.21.15.44:0/3367635630 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7f5bbc02d400 msgr2=0x7f5bbc02d880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7f5bbc02d400 0x7f5bbc02d880 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 -- 172.21.15.44:0/3367635630 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7f5bac038940 msgr2=0x7f5bac011420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7f5bac038940 0x7f5bac011420 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 -- 172.21.15.44:0/3367635630 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5637988799b0 msgr2=0x5637988592a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x5637988799b0 0x5637988592a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 -- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f5bac012020 msgr2=0x7f5bac02a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f5bac012020 0x7f5bac02a410 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 -- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f5bb4054420 msgr2=0x7f5bb4053120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f5bb4054420 0x7f5bb4053120 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 -- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f5bbc01e910 msgr2=0x7f5bbc0073e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f5bbc01e910 0x7f5bbc0073e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 -- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f5bbc00a040 msgr2=0x7f5bbc012920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f5bbc00a040 0x7f5bbc012920 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 reap_dead start 2024-09-13T18:35:20.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 reap_dead start 2024-09-13T18:35:20.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc223e700 1 -- 172.21.15.44:0/3367635630 reap_dead start 2024-09-13T18:35:20.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 -- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5ba4065090 msgr2=0x7f5ba4067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5ba4065090 0x7f5ba4067550 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5bac014040 tx=0x7f5bac008030 comp rx=0 tx=0).stop 2024-09-13T18:35:20.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 -- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563798861980 msgr2=0x5637988579f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563798861980 0x5637988579f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5bb400dd00 tx=0x7f5bb400b5d0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 -- 172.21.15.44:0/3367635630 shutdown_connections 2024-09-13T18:35:20.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5ba4065090 0x7f5ba4067550 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 --2- 172.21.15.44:0/3367635630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563798861980 0x5637988579f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 -- 172.21.15.44:0/3367635630 >> 172.21.15.44:0/3367635630 conn(0x5637988325d0 msgr2=0x5637988ef3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:20.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 -- 172.21.15.44:0/3367635630 shutdown_connections 2024-09-13T18:35:20.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.117+0000 7f5bc3f08140 1 -- 172.21.15.44:0/3367635630 wait complete. 2024-09-13T18:35:20.133 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 401.00000000 2024-09-13T18:35:20.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.173+0000 7f6fe1cce140 1 Processor -- start 2024-09-13T18:35:20.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.173+0000 7f6fe1cce140 1 -- start start 2024-09-13T18:35:20.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.177+0000 7f6fe1cce140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55731d0b0140 0x55731d1695b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.177+0000 7f6fe1cce140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55731d186140 0x55731d186be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.177+0000 7f6fe1cce140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55731d186520 0x55731d16af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.177+0000 7f6fe1cce140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55731d046a00 con 0x55731d186140 2024-09-13T18:35:20.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.177+0000 7f6fe1cce140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55731d0422f0 con 0x55731d0b0140 2024-09-13T18:35:20.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.177+0000 7f6fe1cce140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55731cffe8e0 con 0x55731d186520 2024-09-13T18:35:20.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.177+0000 7f6fdf002700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55731d186140 0x55731d186be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.177+0000 7f6fdf002700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55731d186140 0x55731d186be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40040/0 (socket says 172.21.15.44:40040) 2024-09-13T18:35:20.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.177+0000 7f6fdf002700 1 -- 172.21.15.44:0/1066935585 learned_addr learned my addr 172.21.15.44:0/1066935585 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:20.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.177+0000 7f6fdf803700 1 --2- 172.21.15.44:0/1066935585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55731d0b0140 0x55731d1695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.177+0000 7f6fe0004700 1 --2- 172.21.15.44:0/1066935585 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55731d186520 0x55731d16af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.177+0000 7f6fdf002700 1 -- 172.21.15.44:0/1066935585 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55731d186520 msgr2=0x55731d16af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:20.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.177+0000 7f6fdf002700 1 --2- 172.21.15.44:0/1066935585 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55731d186520 0x55731d16af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.177+0000 7f6fdf002700 1 -- 172.21.15.44:0/1066935585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55731d0b0140 msgr2=0x55731d1695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:20.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.177+0000 7f6fdf002700 1 --2- 172.21.15.44:0/1066935585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55731d0b0140 0x55731d1695b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.177+0000 7f6fdf002700 1 -- 172.21.15.44:0/1066935585 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd800a100 con 0x55731d186140 2024-09-13T18:35:20.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.177+0000 7f6fdf002700 1 --2- 172.21.15.44:0/1066935585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55731d186140 0x55731d186be0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8001d60 tx=0x7f6fc800b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c85e42de27936dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.177+0000 7f6fde000700 1 -- 172.21.15.44:0/1066935585 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8014070 con 0x55731d186140 2024-09-13T18:35:20.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.177+0000 7f6fde000700 1 -- 172.21.15.44:0/1066935585 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc8008030 con 0x55731d186140 2024-09-13T18:35:20.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.177+0000 7f6fde000700 1 -- 172.21.15.44:0/1066935585 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc800bcc0 con 0x55731d186140 2024-09-13T18:35:20.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.181+0000 7f6fe1cce140 1 -- 172.21.15.44:0/1066935585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55731d186140 msgr2=0x55731d186be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.181+0000 7f6fe1cce140 1 --2- 172.21.15.44:0/1066935585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55731d186140 0x55731d186be0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8001d60 tx=0x7f6fc800b4c0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.181+0000 7f6fe1cce140 1 -- 172.21.15.44:0/1066935585 shutdown_connections 2024-09-13T18:35:20.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.181+0000 7f6fe1cce140 1 --2- 172.21.15.44:0/1066935585 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55731d186520 0x55731d16af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.181+0000 7f6fe1cce140 1 --2- 172.21.15.44:0/1066935585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55731d186140 0x55731d186be0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.181+0000 7f6fe1cce140 1 --2- 172.21.15.44:0/1066935585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55731d0b0140 0x55731d1695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.181+0000 7f6fe1cce140 1 -- 172.21.15.44:0/1066935585 >> 172.21.15.44:0/1066935585 conn(0x55731d0df280 msgr2=0x55731d185420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:20.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.181+0000 7f6fe1cce140 1 -- 172.21.15.44:0/1066935585 shutdown_connections 2024-09-13T18:35:20.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.181+0000 7f6fe1cce140 1 -- 172.21.15.44:0/1066935585 wait complete. 2024-09-13T18:35:20.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.181+0000 7f6fe1cce140 1 Processor -- start 2024-09-13T18:35:20.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.181+0000 7f6fe1cce140 1 -- start start 2024-09-13T18:35:20.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.181+0000 7f6fe1cce140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55731d0b0140 0x55731d0fb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.181+0000 7f6fe1cce140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55731d186140 0x55731d21d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.181+0000 7f6fe1cce140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55731d186520 0x55731d21d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.181+0000 7f6fe1cce140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55731cffe580 con 0x55731d186140 2024-09-13T18:35:20.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.181+0000 7f6fe1cce140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55731cfd48d0 con 0x55731d0b0140 2024-09-13T18:35:20.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.181+0000 7f6fe1cce140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55731d21e7f0 con 0x55731d186520 2024-09-13T18:35:20.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.185+0000 7f6fdf002700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55731d186140 0x55731d21d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.185+0000 7f6fdf803700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55731d0b0140 0x55731d0fb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.185+0000 7f6fdf002700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55731d186140 0x55731d21d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40048/0 (socket says 172.21.15.44:40048) 2024-09-13T18:35:20.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.185+0000 7f6fdf002700 1 -- 172.21.15.44:0/1904381533 learned_addr learned my addr 172.21.15.44:0/1904381533 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:20.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.185+0000 7f6fe0004700 1 --2- 172.21.15.44:0/1904381533 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55731d186520 0x55731d21d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.185+0000 7f6fdf002700 1 -- 172.21.15.44:0/1904381533 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55731d186520 msgr2=0x55731d21d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.185+0000 7f6fdf002700 1 --2- 172.21.15.44:0/1904381533 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55731d186520 0x55731d21d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.185+0000 7f6fdf002700 1 -- 172.21.15.44:0/1904381533 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55731d0b0140 msgr2=0x55731d0fb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.185+0000 7f6fdf002700 1 --2- 172.21.15.44:0/1904381533 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55731d0b0140 0x55731d0fb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.185+0000 7f6fdf002700 1 -- 172.21.15.44:0/1904381533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc800a040 con 0x55731d186140 2024-09-13T18:35:20.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.185+0000 7f6fdf002700 1 --2- 172.21.15.44:0/1904381533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55731d186140 0x55731d21d020 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f6fc800f900 tx=0x7f6fc8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.185+0000 7f6fdcffe700 1 -- 172.21.15.44:0/1904381533 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8014040 con 0x55731d186140 2024-09-13T18:35:20.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.185+0000 7f6fdcffe700 1 -- 172.21.15.44:0/1904381533 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc800be90 con 0x55731d186140 2024-09-13T18:35:20.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.185+0000 7f6fe1cce140 1 -- 172.21.15.44:0/1904381533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55731cfdff40 con 0x55731d186140 2024-09-13T18:35:20.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.185+0000 7f6fdcffe700 1 -- 172.21.15.44:0/1904381533 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc801b670 con 0x55731d186140 2024-09-13T18:35:20.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.185+0000 7f6fe1cce140 1 -- 172.21.15.44:0/1904381533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55731cfdf9a0 con 0x55731d186140 2024-09-13T18:35:20.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.185+0000 7f6fdcffe700 1 -- 172.21.15.44:0/1904381533 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6fc801b7d0 con 0x55731d186140 2024-09-13T18:35:20.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.189+0000 7f6fdcffe700 1 --2- 172.21.15.44:0/1904381533 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6fc0065090 0x7f6fc0067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.189+0000 7f6fdcffe700 1 -- 172.21.15.44:0/1904381533 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f6fc8083ae0 con 0x55731d186140 2024-09-13T18:35:20.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.189+0000 7f6fdf803700 1 --2- 172.21.15.44:0/1904381533 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6fc0065090 0x7f6fc0067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.189+0000 7f6fe1cce140 1 --2- 172.21.15.44:0/1904381533 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55731d0fb570 0x55731d17a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.189+0000 7f6fe1cce140 1 -- 172.21.15.44:0/1904381533 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:1 8.5 8:a6e36b3f:::401.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e66) v8 -- 0x55731d0f5370 con 0x55731d0fb570 2024-09-13T18:35:20.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.189+0000 7f6fe0004700 1 --2- 172.21.15.44:0/1904381533 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55731d0fb570 0x55731d17a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.189+0000 7f6fdf803700 1 --2- 172.21.15.44:0/1904381533 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6fc0065090 0x7f6fc0067550 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8013040 tx=0x7f6fd8007030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.189+0000 7f6fe0004700 1 --2- 172.21.15.44:0/1904381533 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55731d0fb570 0x55731d17a890 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.193+0000 7f6fe0004700 1 -- 172.21.15.44:0/1904381533 <== osd.6 v2:172.21.15.99:6808/2907584318 1 ==== osd_op_reply(1 401.00000000 [delete] v66'2 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f6fd000f770 con 0x55731d0fb570 2024-09-13T18:35:20.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.193+0000 7f6fe1cce140 1 -- 172.21.15.44:0/1904381533 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55731d0fb570 msgr2=0x55731d17a890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.193+0000 7f6fe1cce140 1 --2- 172.21.15.44:0/1904381533 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55731d0fb570 0x55731d17a890 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.193+0000 7f6fe1cce140 1 -- 172.21.15.44:0/1904381533 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6fc0065090 msgr2=0x7f6fc0067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.193+0000 7f6fe1cce140 1 --2- 172.21.15.44:0/1904381533 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6fc0065090 0x7f6fc0067550 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8013040 tx=0x7f6fd8007030 comp rx=0 tx=0).stop 2024-09-13T18:35:20.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.193+0000 7f6fe1cce140 1 -- 172.21.15.44:0/1904381533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55731d186140 msgr2=0x55731d21d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.193+0000 7f6fe1cce140 1 --2- 172.21.15.44:0/1904381533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55731d186140 0x55731d21d020 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f6fc800f900 tx=0x7f6fc8000ed0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.193+0000 7f6fe0004700 1 -- 172.21.15.44:0/1904381533 reap_dead start 2024-09-13T18:35:20.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.193+0000 7f6fe1cce140 1 -- 172.21.15.44:0/1904381533 shutdown_connections 2024-09-13T18:35:20.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.193+0000 7f6fe1cce140 1 -- 172.21.15.44:0/1904381533 >> 172.21.15.44:0/1904381533 conn(0x55731d0df280 msgr2=0x55731d0fc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:20.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.193+0000 7f6fe1cce140 1 -- 172.21.15.44:0/1904381533 shutdown_connections 2024-09-13T18:35:20.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.193+0000 7f6fe1cce140 1 -- 172.21.15.44:0/1904381533 wait complete. 2024-09-13T18:35:20.203 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata ls 2024-09-13T18:35:20.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76dfcb140 1 Processor -- start 2024-09-13T18:35:20.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76dfcb140 1 -- start start 2024-09-13T18:35:20.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76dfcb140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x565537d74890 0x565537d8b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76dfcb140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565537d911d0 0x565537d756c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76dfcb140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565537d915b0 0x565537d75c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76dfcb140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x565537cdda00 con 0x565537d911d0 2024-09-13T18:35:20.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76dfcb140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x565537cd92f0 con 0x565537d915b0 2024-09-13T18:35:20.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76dfcb140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x565537c958e0 con 0x565537d74890 2024-09-13T18:35:20.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76b2ff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565537d911d0 0x565537d756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76b2ff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565537d911d0 0x565537d756c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40056/0 (socket says 172.21.15.44:40056) 2024-09-13T18:35:20.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76b2ff700 1 -- 172.21.15.44:0/3999554778 learned_addr learned my addr 172.21.15.44:0/3999554778 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:20.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76bb00700 1 --2- 172.21.15.44:0/3999554778 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x565537d74890 0x565537d8b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76c301700 1 --2- 172.21.15.44:0/3999554778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565537d915b0 0x565537d75c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76bb00700 1 -- 172.21.15.44:0/3999554778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565537d915b0 msgr2=0x565537d75c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:20.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76bb00700 1 --2- 172.21.15.44:0/3999554778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565537d915b0 0x565537d75c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76bb00700 1 -- 172.21.15.44:0/3999554778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565537d911d0 msgr2=0x565537d756c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:20.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76bb00700 1 --2- 172.21.15.44:0/3999554778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565537d911d0 0x565537d756c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76bb00700 1 -- 172.21.15.44:0/3999554778 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75400a100 con 0x565537d74890 2024-09-13T18:35:20.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76bb00700 1 --2- 172.21.15.44:0/3999554778 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x565537d74890 0x565537d8b800 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb75c001e50 tx=0x7fb75c00b4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d566a338b534c4dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76a2fd700 1 -- 172.21.15.44:0/3999554778 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c00f3a0 con 0x565537d74890 2024-09-13T18:35:20.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76a2fd700 1 -- 172.21.15.44:0/3999554778 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75c00a040 con 0x565537d74890 2024-09-13T18:35:20.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76a2fd700 1 -- 172.21.15.44:0/3999554778 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c00f740 con 0x565537d74890 2024-09-13T18:35:20.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76dfcb140 1 -- 172.21.15.44:0/3999554778 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x565537d74890 msgr2=0x565537d8b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76dfcb140 1 --2- 172.21.15.44:0/3999554778 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x565537d74890 0x565537d8b800 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb75c001e50 tx=0x7fb75c00b4a0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76dfcb140 1 -- 172.21.15.44:0/3999554778 shutdown_connections 2024-09-13T18:35:20.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76dfcb140 1 --2- 172.21.15.44:0/3999554778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565537d915b0 0x565537d75c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76dfcb140 1 --2- 172.21.15.44:0/3999554778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565537d911d0 0x565537d756c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76dfcb140 1 --2- 172.21.15.44:0/3999554778 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x565537d74890 0x565537d8b800 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76dfcb140 1 -- 172.21.15.44:0/3999554778 >> 172.21.15.44:0/3999554778 conn(0x565537d455d0 msgr2=0x565537e1dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:20.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76dfcb140 1 -- 172.21.15.44:0/3999554778 shutdown_connections 2024-09-13T18:35:20.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.237+0000 7fb76dfcb140 1 -- 172.21.15.44:0/3999554778 wait complete. 2024-09-13T18:35:20.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb76dfcb140 1 Processor -- start 2024-09-13T18:35:20.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb76dfcb140 1 -- start start 2024-09-13T18:35:20.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb76dfcb140 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x565537d74890 0x565537e0f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb76dfcb140 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565537d911d0 0x565537d69af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb76dfcb140 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565537d915b0 0x565537eb5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb76dfcb140 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x565537c95580 con 0x565537d915b0 2024-09-13T18:35:20.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb76dfcb140 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x565537c6b8d0 con 0x565537d911d0 2024-09-13T18:35:20.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb76dfcb140 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x565537e0e630 con 0x565537d74890 2024-09-13T18:35:20.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb76c301700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565537d915b0 0x565537eb5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb76c301700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565537d915b0 0x565537eb5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40058/0 (socket says 172.21.15.44:40058) 2024-09-13T18:35:20.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb76c301700 1 -- 172.21.15.44:0/2347762595 learned_addr learned my addr 172.21.15.44:0/2347762595 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:20.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb76bb00700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x565537d74890 0x565537e0f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb76b2ff700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565537d911d0 0x565537d69af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb76c301700 1 -- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x565537d74890 msgr2=0x565537e0f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb76c301700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x565537d74890 0x565537e0f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb76c301700 1 -- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565537d911d0 msgr2=0x565537d69af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb76c301700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565537d911d0 0x565537d69af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb76c301700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c001a50 con 0x565537d915b0 2024-09-13T18:35:20.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb76b2ff700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565537d911d0 0x565537d69af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:20.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb76c301700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565537d915b0 0x565537eb5ee0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fb76400c560 tx=0x7fb76400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb7692fb700 1 -- 172.21.15.44:0/2347762595 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb764016030 con 0x565537d915b0 2024-09-13T18:35:20.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb76dfcb140 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x565537c76f40 con 0x565537d915b0 2024-09-13T18:35:20.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb7692fb700 1 -- 172.21.15.44:0/2347762595 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb764005070 con 0x565537d915b0 2024-09-13T18:35:20.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb7692fb700 1 -- 172.21.15.44:0/2347762595 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb764011680 con 0x565537d915b0 2024-09-13T18:35:20.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.241+0000 7fb76dfcb140 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565537c769a0 con 0x565537d915b0 2024-09-13T18:35:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.245+0000 7fb7692fb700 1 -- 172.21.15.44:0/2347762595 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb764019070 con 0x565537d915b0 2024-09-13T18:35:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.245+0000 7fb7692fb700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb74c065060 0x7fb74c067520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.245+0000 7fb7692fb700 1 -- 172.21.15.44:0/2347762595 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fb764017070 con 0x565537d915b0 2024-09-13T18:35:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.245+0000 7fb76dfcb140 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x565537e10010 0x565537e10420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.245+0000 7fb76bb00700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb74c065060 0x7fb74c067520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.245+0000 7fb76dfcb140 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:1 8.0 8:00000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x565537e10010 2024-09-13T18:35:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.245+0000 7fb76b2ff700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x565537e10010 0x565537e10420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.245+0000 7fb76bb00700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb74c065060 0x7fb74c067520 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb75c000fb0 tx=0x7fb75c003000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.245+0000 7fb76b2ff700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x565537e10010 0x565537e10420 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.245+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== osd_op_reply(1 [pgnls start_epoch 66 out=49b] v63'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb754017040 con 0x565537e10010 2024-09-13T18:35:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.245+0000 7fb76b2ff700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7fb75401b3f0 0x7fb75401b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.245+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- osd_op(unknown.0.0:2 8.10 8:08000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb75401b3f0 2024-09-13T18:35:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.245+0000 7fb76bb00700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7fb75401b3f0 0x7fb75401b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.249+0000 7fb76bb00700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7fb75401b3f0 0x7fb75401b870 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.249+0000 7fb76bb00700 1 -- 172.21.15.44:0/2347762595 <== osd.7 v2:172.21.15.99:6824/2245335901 1 ==== osd_op_reply(2 [pgnls start_epoch 66 out=201b] v63'12 uv12 ondisk = 1) v8 ==== 144+0+201 (crc 0 0 0) 0x7fb75c024040 con 0x7fb75401b3f0 2024-09-13T18:35:20.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.249+0000 7fb76bb00700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7fb75c02aa90 0x7fb75c01e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.249+0000 7fb76bb00700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:3 8.8 8:10000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb75c02aa90 2024-09-13T18:35:20.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.249+0000 7fb76b2ff700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7fb75c02aa90 0x7fb75c01e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.249+0000 7fb76b2ff700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7fb75c02aa90 0x7fb75c01e410 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.249+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 <== osd.5 v2:172.21.15.99:6800/827163121 1 ==== osd_op_reply(3 [pgnls start_epoch 66 out=73b] v63'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fb754017040 con 0x7fb75c02aa90 2024-09-13T18:35:20.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.249+0000 7fb76b2ff700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7fb75401a890 0x7fb75402b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.249+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:4 8.18 8:18000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb75401a890 2024-09-13T18:35:20.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.249+0000 7fb76c301700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7fb75401a890 0x7fb75402b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.253+0000 7fb76c301700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7fb75401a890 0x7fb75402b320 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.253+0000 7fb76c301700 1 -- 172.21.15.44:0/2347762595 <== osd.4 v2:172.21.15.99:6816/2515272044 1 ==== osd_op_reply(4 [pgnls start_epoch 66 out=49b] v63'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb764052280 con 0x7fb75401a890 2024-09-13T18:35:20.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.253+0000 7fb76c301700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:5 8.4 8:20000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb75c02aa90 2024-09-13T18:35:20.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.253+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 <== osd.5 v2:172.21.15.99:6800/827163121 2 ==== osd_op_reply(5 [pgnls start_epoch 66 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb754017040 con 0x7fb75c02aa90 2024-09-13T18:35:20.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.253+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:6 8.14 8:28000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb75401a890 2024-09-13T18:35:20.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.253+0000 7fb76c301700 1 -- 172.21.15.44:0/2347762595 <== osd.4 v2:172.21.15.99:6816/2515272044 2 ==== osd_op_reply(6 [pgnls start_epoch 66 out=149b] v66'1256 uv1256 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x7fb764052280 con 0x7fb75401a890 2024-09-13T18:35:20.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.253+0000 7fb76c301700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7fb764054140 0x7fb764070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.253+0000 7fb76c301700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:7 8.c 8:30000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb764054140 2024-09-13T18:35:20.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.253+0000 7fb76bb00700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7fb764054140 0x7fb764070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.253+0000 7fb76bb00700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7fb764054140 0x7fb764070aa0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.257+0000 7fb76bb00700 1 -- 172.21.15.44:0/2347762595 <== osd.0 v2:172.21.15.44:6800/2647753462 1 ==== osd_op_reply(7 [pgnls start_epoch 66 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb75c024040 con 0x7fb764054140 2024-09-13T18:35:20.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.257+0000 7fb76bb00700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:8 8.1c 8:38000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb75c02aa90 2024-09-13T18:35:20.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.257+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 <== osd.5 v2:172.21.15.99:6800/827163121 3 ==== osd_op_reply(8 [pgnls start_epoch 66 out=73b] v62'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fb754017040 con 0x7fb75c02aa90 2024-09-13T18:35:20.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.257+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:9 8.2 8:40000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb75401a890 2024-09-13T18:35:20.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.257+0000 7fb76c301700 1 -- 172.21.15.44:0/2347762595 <== osd.4 v2:172.21.15.99:6816/2515272044 3 ==== osd_op_reply(9 [pgnls start_epoch 66 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb764052280 con 0x7fb75401a890 2024-09-13T18:35:20.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.257+0000 7fb76c301700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7fb7640533d0 0x7fb7640127f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.257+0000 7fb76c301700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:10 8.12 8:48000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb7640533d0 2024-09-13T18:35:20.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.257+0000 7fb76b2ff700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7fb7640533d0 0x7fb7640127f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.257+0000 7fb76b2ff700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7fb7640533d0 0x7fb7640127f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.261+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 <== osd.6 v2:172.21.15.99:6808/2907584318 1 ==== osd_op_reply(10 [pgnls start_epoch 66 out=73b] v63'3 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fb754017040 con 0x7fb7640533d0 2024-09-13T18:35:20.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.261+0000 7fb76b2ff700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7fb75402f940 0x7fb75402e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.261+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:11 8.a 8:50000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb75402f940 2024-09-13T18:35:20.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.261+0000 7fb76c301700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7fb75402f940 0x7fb75402e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.261+0000 7fb76c301700 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7fb75402f940 0x7fb75402e3c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.261+0000 7fb76c301700 1 -- 172.21.15.44:0/2347762595 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== osd_op_reply(11 [pgnls start_epoch 66 out=49b] v64'9 uv9 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb764052280 con 0x7fb75402f940 2024-09-13T18:35:20.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.261+0000 7fb76c301700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:12 8.1a 8:58000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb764054140 2024-09-13T18:35:20.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.261+0000 7fb76bb00700 1 -- 172.21.15.44:0/2347762595 <== osd.0 v2:172.21.15.44:6800/2647753462 2 ==== osd_op_reply(12 [pgnls start_epoch 66 out=49b] v66'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb75c024040 con 0x7fb764054140 2024-09-13T18:35:20.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.261+0000 7fb76bb00700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:13 8.6 8:60000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb764054140 2024-09-13T18:35:20.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.261+0000 7fb76bb00700 1 -- 172.21.15.44:0/2347762595 <== osd.0 v2:172.21.15.44:6800/2647753462 3 ==== osd_op_reply(13 [pgnls start_epoch 66 out=77b] v63'9 uv9 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x7fb75c024040 con 0x7fb764054140 2024-09-13T18:35:20.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.261+0000 7fb76bb00700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:14 8.16 8:68000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x565537e10010 2024-09-13T18:35:20.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.261+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 <== osd.3 v2:172.21.15.44:6808/771281770 2 ==== osd_op_reply(14 [pgnls start_epoch 66 out=73b] v63'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fb754017040 con 0x565537e10010 2024-09-13T18:35:20.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.261+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:15 8.e 8:70000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb764054140 2024-09-13T18:35:20.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.261+0000 7fb76bb00700 1 -- 172.21.15.44:0/2347762595 <== osd.0 v2:172.21.15.44:6800/2647753462 4 ==== osd_op_reply(15 [pgnls start_epoch 66 out=73b] v62'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fb75c024040 con 0x7fb764054140 2024-09-13T18:35:20.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.261+0000 7fb76bb00700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:16 8.1e 8:78000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x565537e10010 2024-09-13T18:35:20.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.265+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 <== osd.3 v2:172.21.15.44:6808/771281770 3 ==== osd_op_reply(16 [pgnls start_epoch 66 out=49b] v66'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb754017040 con 0x565537e10010 2024-09-13T18:35:20.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.265+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:17 8.1 8:80000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb75402f940 2024-09-13T18:35:20.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.265+0000 7fb76c301700 1 -- 172.21.15.44:0/2347762595 <== osd.1 v2:172.21.15.44:6816/2250405239 2 ==== osd_op_reply(17 [pgnls start_epoch 66 out=49b] v63'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb764052280 con 0x7fb75402f940 2024-09-13T18:35:20.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.265+0000 7fb76c301700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:18 8.11 8:88000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb75c02aa90 2024-09-13T18:35:20.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.265+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 <== osd.5 v2:172.21.15.99:6800/827163121 4 ==== osd_op_reply(18 [pgnls start_epoch 66 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb754017040 con 0x7fb75c02aa90 2024-09-13T18:35:20.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.265+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:19 8.9 8:90000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb7640533d0 2024-09-13T18:35:20.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.265+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 <== osd.6 v2:172.21.15.99:6808/2907584318 2 ==== osd_op_reply(19 [pgnls start_epoch 66 out=97b] v63'3 uv3 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x7fb754045040 con 0x7fb7640533d0 2024-09-13T18:35:20.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.265+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:20 8.19 8:98000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb75c02aa90 2024-09-13T18:35:20.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.265+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 <== osd.5 v2:172.21.15.99:6800/827163121 5 ==== osd_op_reply(20 [pgnls start_epoch 66 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb754045040 con 0x7fb75c02aa90 2024-09-13T18:35:20.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.265+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:21 8.5 8:a0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb7640533d0 2024-09-13T18:35:20.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.269+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 <== osd.6 v2:172.21.15.99:6808/2907584318 3 ==== osd_op_reply(21 [pgnls start_epoch 66 out=49b] v66'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb754045040 con 0x7fb7640533d0 2024-09-13T18:35:20.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.269+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- osd_op(unknown.0.0:22 8.15 8:a8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb75401b3f0 2024-09-13T18:35:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.269+0000 7fb76bb00700 1 -- 172.21.15.44:0/2347762595 <== osd.7 v2:172.21.15.99:6824/2245335901 2 ==== osd_op_reply(22 [pgnls start_epoch 66 out=127b] v63'4 uv4 ondisk = 1) v8 ==== 144+0+127 (crc 0 0 0) 0x7fb75c024040 con 0x7fb75401b3f0 2024-09-13T18:35:20.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.269+0000 7fb76bb00700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- osd_op(unknown.0.0:23 8.d 8:b0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb75c02aa90 2024-09-13T18:35:20.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.269+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 <== osd.5 v2:172.21.15.99:6800/827163121 6 ==== osd_op_reply(23 [pgnls start_epoch 66 out=74b] v62'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fb754045040 con 0x7fb75c02aa90 2024-09-13T18:35:20.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.269+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:24 8.1d 8:b8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb764054140 2024-09-13T18:35:20.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.269+0000 7fb76bb00700 1 -- 172.21.15.44:0/2347762595 <== osd.0 v2:172.21.15.44:6800/2647753462 5 ==== osd_op_reply(24 [pgnls start_epoch 66 out=73b] v66'5 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fb75c024040 con 0x7fb764054140 2024-09-13T18:35:20.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.269+0000 7fb76bb00700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:25 8.3 8:c0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb75402f940 2024-09-13T18:35:20.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.273+0000 7fb76c301700 1 -- 172.21.15.44:0/2347762595 <== osd.1 v2:172.21.15.44:6816/2250405239 3 ==== osd_op_reply(25 [pgnls start_epoch 66 out=73b] v64'4 uv4 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fb764052280 con 0x7fb75402f940 2024-09-13T18:35:20.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.273+0000 7fb76c301700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:26 8.13 8:c8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x565537e10010 2024-09-13T18:35:20.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.273+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 <== osd.3 v2:172.21.15.44:6808/771281770 4 ==== osd_op_reply(26 [pgnls start_epoch 66 out=122b] v63'5 uv5 ondisk = 1) v8 ==== 144+0+122 (crc 0 0 0) 0x7fb754045040 con 0x565537e10010 2024-09-13T18:35:20.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.273+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:27 8.b 8:d0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x565537e10010 2024-09-13T18:35:20.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.273+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 <== osd.3 v2:172.21.15.44:6808/771281770 5 ==== osd_op_reply(27 [pgnls start_epoch 66 out=124b] v66'8 uv8 ondisk = 1) v8 ==== 144+0+124 (crc 0 0 0) 0x7fb754045040 con 0x565537e10010 2024-09-13T18:35:20.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.273+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- osd_op(unknown.0.0:28 8.1b 8:d8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb75401a890 2024-09-13T18:35:20.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.273+0000 7fb76c301700 1 -- 172.21.15.44:0/2347762595 <== osd.4 v2:172.21.15.99:6816/2515272044 4 ==== osd_op_reply(28 [pgnls start_epoch 66 out=73b] v66'1792 uv1792 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fb764073040 con 0x7fb75401a890 2024-09-13T18:35:20.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.273+0000 7fb76c301700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:29 8.7 8:e0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb75402f940 2024-09-13T18:35:20.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.273+0000 7fb76c301700 1 -- 172.21.15.44:0/2347762595 <== osd.1 v2:172.21.15.44:6816/2250405239 4 ==== osd_op_reply(29 [pgnls start_epoch 66 out=129b] v63'6 uv6 ondisk = 1) v8 ==== 144+0+129 (crc 0 0 0) 0x7fb764073040 con 0x7fb75402f940 2024-09-13T18:35:20.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.273+0000 7fb76c301700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- osd_op(unknown.0.0:30 8.17 8:e8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb75401b3f0 2024-09-13T18:35:20.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76bb00700 1 -- 172.21.15.44:0/2347762595 <== osd.7 v2:172.21.15.99:6824/2245335901 3 ==== osd_op_reply(30 [pgnls start_epoch 66 out=73b] v66'9 uv9 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fb75c024040 con 0x7fb75401b3f0 2024-09-13T18:35:20.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76bb00700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- osd_op(unknown.0.0:31 8.f 8:f0000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x565537e10010 2024-09-13T18:35:20.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 <== osd.3 v2:172.21.15.44:6808/771281770 6 ==== osd_op_reply(31 [pgnls start_epoch 66 out=73b] v62'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fb754045040 con 0x565537e10010 2024-09-13T18:35:20.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76b2ff700 1 -- 172.21.15.44:0/2347762595 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- osd_op(unknown.0.0:32 8.1f 8:f8000000::::head [pgnls start_epoch 66 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e66) v8 -- 0x565537eb2a20 con 0x7fb764054140 2024-09-13T18:35:20.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76bb00700 1 -- 172.21.15.44:0/2347762595 <== osd.0 v2:172.21.15.44:6800/2647753462 6 ==== osd_op_reply(32 [pgnls start_epoch 66 out=101b] v66'11 uv10 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x7fb75c024040 con 0x7fb764054140 2024-09-13T18:35:20.283 INFO:teuthology.orchestra.run.smithi044.stdout:601.00000000 2024-09-13T18:35:20.283 INFO:teuthology.orchestra.run.smithi044.stdout:602.00000000 2024-09-13T18:35:20.283 INFO:teuthology.orchestra.run.smithi044.stdout:10000000000.00000000 2024-09-13T18:35:20.283 INFO:teuthology.orchestra.run.smithi044.stdout:600.00000000 2024-09-13T18:35:20.283 INFO:teuthology.orchestra.run.smithi044.stdout:603.00000000 2024-09-13T18:35:20.284 INFO:teuthology.orchestra.run.smithi044.stdout:60a.00000000 2024-09-13T18:35:20.284 INFO:teuthology.orchestra.run.smithi044.stdout:613.00000000 2024-09-13T18:35:20.284 INFO:teuthology.orchestra.run.smithi044.stdout:1.00000000.inode 2024-09-13T18:35:20.284 INFO:teuthology.orchestra.run.smithi044.stdout:200.00000000 2024-09-13T18:35:20.284 INFO:teuthology.orchestra.run.smithi044.stdout:610.00000000 2024-09-13T18:35:20.284 INFO:teuthology.orchestra.run.smithi044.stdout:606.00000000 2024-09-13T18:35:20.284 INFO:teuthology.orchestra.run.smithi044.stdout:607.00000000 2024-09-13T18:35:20.284 INFO:teuthology.orchestra.run.smithi044.stdout:60e.00000000 2024-09-13T18:35:20.284 INFO:teuthology.orchestra.run.smithi044.stdout:mds0_openfiles.0 2024-09-13T18:35:20.284 INFO:teuthology.orchestra.run.smithi044.stdout:60f.00000000 2024-09-13T18:35:20.284 INFO:teuthology.orchestra.run.smithi044.stdout:608.00000000 2024-09-13T18:35:20.285 INFO:teuthology.orchestra.run.smithi044.stdout:501.00000000 2024-09-13T18:35:20.285 INFO:teuthology.orchestra.run.smithi044.stdout:612.00000000 2024-09-13T18:35:20.285 INFO:teuthology.orchestra.run.smithi044.stdout:604.00000000 2024-09-13T18:35:20.285 INFO:teuthology.orchestra.run.smithi044.stdout:101.00000000.inode 2024-09-13T18:35:20.285 INFO:teuthology.orchestra.run.smithi044.stdout:500.00000000 2024-09-13T18:35:20.285 INFO:teuthology.orchestra.run.smithi044.stdout:mds_snaptable 2024-09-13T18:35:20.285 INFO:teuthology.orchestra.run.smithi044.stdout:605.00000000 2024-09-13T18:35:20.285 INFO:teuthology.orchestra.run.smithi044.stdout:101.00000000 2024-09-13T18:35:20.285 INFO:teuthology.orchestra.run.smithi044.stdout:mds0_inotable 2024-09-13T18:35:20.285 INFO:teuthology.orchestra.run.smithi044.stdout:611.00000000 2024-09-13T18:35:20.285 INFO:teuthology.orchestra.run.smithi044.stdout:100.00000000 2024-09-13T18:35:20.286 INFO:teuthology.orchestra.run.smithi044.stdout:mds0_sessionmap 2024-09-13T18:35:20.286 INFO:teuthology.orchestra.run.smithi044.stdout:200.00000003 2024-09-13T18:35:20.286 INFO:teuthology.orchestra.run.smithi044.stdout:60c.00000000 2024-09-13T18:35:20.286 INFO:teuthology.orchestra.run.smithi044.stdout:200.00000002 2024-09-13T18:35:20.286 INFO:teuthology.orchestra.run.smithi044.stdout:609.00000000 2024-09-13T18:35:20.286 INFO:teuthology.orchestra.run.smithi044.stdout:10000000001.00000000 2024-09-13T18:35:20.286 INFO:teuthology.orchestra.run.smithi044.stdout:60b.00000000 2024-09-13T18:35:20.286 INFO:teuthology.orchestra.run.smithi044.stdout:60d.00000000 2024-09-13T18:35:20.287 INFO:teuthology.orchestra.run.smithi044.stdout:400.00000000 2024-09-13T18:35:20.287 INFO:teuthology.orchestra.run.smithi044.stdout:100.00000000.inode 2024-09-13T18:35:20.287 INFO:teuthology.orchestra.run.smithi044.stdout:1.00000000 2024-09-13T18:35:20.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76dfcb140 1 -- 172.21.15.44:0/2347762595 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7fb764054140 msgr2=0x7fb764070aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76dfcb140 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7fb764054140 0x7fb764070aa0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76dfcb140 1 -- 172.21.15.44:0/2347762595 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7fb75402f940 msgr2=0x7fb75402e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76dfcb140 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7fb75402f940 0x7fb75402e3c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76dfcb140 1 -- 172.21.15.44:0/2347762595 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x565537e10010 msgr2=0x565537e10420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76dfcb140 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x565537e10010 0x565537e10420 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76dfcb140 1 -- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7fb75401a890 msgr2=0x7fb75402b320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76dfcb140 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7fb75401a890 0x7fb75402b320 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76dfcb140 1 -- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7fb75c02aa90 msgr2=0x7fb75c01e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76dfcb140 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7fb75c02aa90 0x7fb75c01e410 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76dfcb140 1 -- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7fb7640533d0 msgr2=0x7fb7640127f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76dfcb140 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7fb7640533d0 0x7fb7640127f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76dfcb140 1 -- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7fb75401b3f0 msgr2=0x7fb75401b870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76dfcb140 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7fb75401b3f0 0x7fb75401b870 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76c301700 1 -- 172.21.15.44:0/2347762595 reap_dead start 2024-09-13T18:35:20.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76dfcb140 1 -- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb74c065060 msgr2=0x7fb74c067520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76dfcb140 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb74c065060 0x7fb74c067520 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb75c000fb0 tx=0x7fb75c003000 comp rx=0 tx=0).stop 2024-09-13T18:35:20.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76c301700 1 -- 172.21.15.44:0/2347762595 reap_dead start 2024-09-13T18:35:20.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76dfcb140 1 -- 172.21.15.44:0/2347762595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565537d915b0 msgr2=0x565537eb5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76dfcb140 1 --2- 172.21.15.44:0/2347762595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565537d915b0 0x565537eb5ee0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fb76400c560 tx=0x7fb76400c870 comp rx=0 tx=0).stop 2024-09-13T18:35:20.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76c301700 1 -- 172.21.15.44:0/2347762595 reap_dead start 2024-09-13T18:35:20.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76dfcb140 1 -- 172.21.15.44:0/2347762595 shutdown_connections 2024-09-13T18:35:20.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76dfcb140 1 -- 172.21.15.44:0/2347762595 >> 172.21.15.44:0/2347762595 conn(0x565537d455d0 msgr2=0x565537e029a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:20.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76dfcb140 1 -- 172.21.15.44:0/2347762595 shutdown_connections 2024-09-13T18:35:20.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.277+0000 7fb76dfcb140 1 -- 172.21.15.44:0/2347762595 wait complete. 2024-09-13T18:35:20.291 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs reset cephfs --yes-i-really-mean-it 2024-09-13T18:35:20.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba7568c700 1 Processor -- start 2024-09-13T18:35:20.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba7568c700 1 -- start start 2024-09-13T18:35:20.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba7568c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fba7006d3f0 0x7fba7015a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba7568c700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7015ac50 con 0x7fba701573e0 2024-09-13T18:35:20.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba7568c700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba700cb3f0 con 0x7fba700712b0 2024-09-13T18:35:20.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba7568c700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba700cc1b0 con 0x7fba7006d3f0 2024-09-13T18:35:20.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba6ffff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fba701573e0 0x7fba70070ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43624/0 (socket says 172.21.15.44:43624) 2024-09-13T18:35:20.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba6ffff700 1 -- 172.21.15.44:0/255713936 learned_addr learned my addr 172.21.15.44:0/255713936 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:20.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba74e8b700 1 --2- 172.21.15.44:0/255713936 >> v2:172.21.15.44:3300/0 conn(0x7fba7006d3f0 0x7fba7015a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba6f7fe700 1 -- 172.21.15.44:0/255713936 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357889438 0 0) 0x7fba7015ac50 con 0x7fba701573e0 2024-09-13T18:35:20.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba6f7fe700 1 -- 172.21.15.44:0/255713936 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba5c0035d0 con 0x7fba701573e0 2024-09-13T18:35:20.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba74e8b700 1 -- 172.21.15.44:0/255713936 >> v1:172.21.15.99:6789/0 conn(0x7fba700712b0 legacy=0x7fba70159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba74e8b700 1 -- 172.21.15.44:0/255713936 >> v1:172.21.15.44:6789/0 conn(0x7fba701573e0 legacy=0x7fba70070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba74e8b700 1 -- 172.21.15.44:0/255713936 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba700cb6d0 con 0x7fba7006d3f0 2024-09-13T18:35:20.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba74e8b700 1 --2- 172.21.15.44:0/255713936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba7006d3f0 0x7fba7015a630 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fba68009d90 tx=0x7fba6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed84198d41504fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba6f7fe700 1 -- 172.21.15.44:0/255713936 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6800e070 con 0x7fba7006d3f0 2024-09-13T18:35:20.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba6f7fe700 1 -- 172.21.15.44:0/255713936 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6800bb20 con 0x7fba7006d3f0 2024-09-13T18:35:20.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba6f7fe700 1 -- 172.21.15.44:0/255713936 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba68012430 con 0x7fba7006d3f0 2024-09-13T18:35:20.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba7568c700 1 -- 172.21.15.44:0/255713936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba7006d3f0 msgr2=0x7fba7015a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba7568c700 1 --2- 172.21.15.44:0/255713936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba7006d3f0 0x7fba7015a630 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fba68009d90 tx=0x7fba6800b330 comp rx=0 tx=0).stop 2024-09-13T18:35:20.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba7568c700 1 -- 172.21.15.44:0/255713936 shutdown_connections 2024-09-13T18:35:20.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba7568c700 1 --2- 172.21.15.44:0/255713936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba7006d3f0 0x7fba7015a630 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba7568c700 1 -- 172.21.15.44:0/255713936 >> 172.21.15.44:0/255713936 conn(0x7fba700b0e10 msgr2=0x7fba700b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:20.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba7568c700 1 -- 172.21.15.44:0/255713936 shutdown_connections 2024-09-13T18:35:20.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.457+0000 7fba7568c700 1 -- 172.21.15.44:0/255713936 wait complete. 2024-09-13T18:35:20.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba7568c700 1 Processor -- start 2024-09-13T18:35:20.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba7568c700 1 -- start start 2024-09-13T18:35:20.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba7568c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba7006d3f0 0x7fba700ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba7568c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba700712b0 0x7fba701538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba7568c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba701573e0 0x7fba7014a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba7568c700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba700cd580 con 0x7fba701573e0 2024-09-13T18:35:20.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba7568c700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba700cd860 con 0x7fba700712b0 2024-09-13T18:35:20.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba7568c700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba700cdb40 con 0x7fba7006d3f0 2024-09-13T18:35:20.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba74e8b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba701573e0 0x7fba7014a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba74e8b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba701573e0 0x7fba7014a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40088/0 (socket says 172.21.15.44:40088) 2024-09-13T18:35:20.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba74e8b700 1 -- 172.21.15.44:0/478917847 learned_addr learned my addr 172.21.15.44:0/478917847 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:20.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba6ffff700 1 --2- 172.21.15.44:0/478917847 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba7006d3f0 0x7fba700ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba677fe700 1 --2- 172.21.15.44:0/478917847 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba700712b0 0x7fba701538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba74e8b700 1 -- 172.21.15.44:0/478917847 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba7006d3f0 msgr2=0x7fba700ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba74e8b700 1 --2- 172.21.15.44:0/478917847 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba7006d3f0 0x7fba700ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba74e8b700 1 -- 172.21.15.44:0/478917847 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba700712b0 msgr2=0x7fba701538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba74e8b700 1 --2- 172.21.15.44:0/478917847 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba700712b0 0x7fba701538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba74e8b700 1 -- 172.21.15.44:0/478917847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba68009a70 con 0x7fba701573e0 2024-09-13T18:35:20.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba74e8b700 1 --2- 172.21.15.44:0/478917847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba701573e0 0x7fba7014a9f0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fba70157850 tx=0x7fba68004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba6d7fa700 1 -- 172.21.15.44:0/478917847 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba68012430 con 0x7fba701573e0 2024-09-13T18:35:20.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba6d7fa700 1 -- 172.21.15.44:0/478917847 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba68020070 con 0x7fba701573e0 2024-09-13T18:35:20.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba7568c700 1 -- 172.21.15.44:0/478917847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba700cde20 con 0x7fba701573e0 2024-09-13T18:35:20.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba6d7fa700 1 -- 172.21.15.44:0/478917847 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba68004280 con 0x7fba701573e0 2024-09-13T18:35:20.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba7568c700 1 -- 172.21.15.44:0/478917847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba70153e20 con 0x7fba701573e0 2024-09-13T18:35:20.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.461+0000 7fba7568c700 1 -- 172.21.15.44:0/478917847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba700ce340 con 0x7fba701573e0 2024-09-13T18:35:20.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.465+0000 7fba6d7fa700 1 -- 172.21.15.44:0/478917847 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fba680043e0 con 0x7fba701573e0 2024-09-13T18:35:20.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.465+0000 7fba6d7fa700 1 --2- 172.21.15.44:0/478917847 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fba50066730 0x7fba50068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.465+0000 7fba6d7fa700 1 -- 172.21.15.44:0/478917847 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fba68022070 con 0x7fba701573e0 2024-09-13T18:35:20.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.465+0000 7fba6ffff700 1 --2- 172.21.15.44:0/478917847 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fba50066730 0x7fba50068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.465+0000 7fba6ffff700 1 --2- 172.21.15.44:0/478917847 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fba50066730 0x7fba50068bf0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fba60000f60 tx=0x7fba6000d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.473+0000 7fba6d7fa700 1 -- 172.21.15.44:0/478917847 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fba700ce340 con 0x7fba701573e0 2024-09-13T18:35:20.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:20.697+0000 7fba7568c700 1 -- 172.21.15.44:0/478917847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs reset", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fba700ce340 con 0x7fba701573e0 2024-09-13T18:35:21.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.284+0000 7fba6d7fa700 1 -- 172.21.15.44:0/478917847 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs reset", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v58) v1 ==== 107+0+0 (secure 0 0 0) 0x7fba700ce340 con 0x7fba701573e0 2024-09-13T18:35:21.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.288+0000 7fba7568c700 1 -- 172.21.15.44:0/478917847 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fba50066730 msgr2=0x7fba50068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.288+0000 7fba7568c700 1 --2- 172.21.15.44:0/478917847 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fba50066730 0x7fba50068bf0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fba60000f60 tx=0x7fba6000d040 comp rx=0 tx=0).stop 2024-09-13T18:35:21.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.288+0000 7fba7568c700 1 -- 172.21.15.44:0/478917847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba701573e0 msgr2=0x7fba7014a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.288+0000 7fba7568c700 1 --2- 172.21.15.44:0/478917847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba701573e0 0x7fba7014a9f0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fba70157850 tx=0x7fba68004af0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.288+0000 7fba7568c700 1 -- 172.21.15.44:0/478917847 shutdown_connections 2024-09-13T18:35:21.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.288+0000 7fba7568c700 1 --2- 172.21.15.44:0/478917847 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fba50066730 0x7fba50068bf0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.288+0000 7fba7568c700 1 --2- 172.21.15.44:0/478917847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba701573e0 0x7fba7014a9f0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.288+0000 7fba7568c700 1 --2- 172.21.15.44:0/478917847 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba700712b0 0x7fba701538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.288+0000 7fba7568c700 1 --2- 172.21.15.44:0/478917847 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba7006d3f0 0x7fba700ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.288+0000 7fba7568c700 1 -- 172.21.15.44:0/478917847 >> 172.21.15.44:0/478917847 conn(0x7fba700b0e10 msgr2=0x7fba700ad710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:21.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.288+0000 7fba7568c700 1 -- 172.21.15.44:0/478917847 shutdown_connections 2024-09-13T18:35:21.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.288+0000 7fba7568c700 1 -- 172.21.15.44:0/478917847 wait complete. 2024-09-13T18:35:21.315 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-13T18:35:21.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.436+0000 7f12f759e700 1 Processor -- start 2024-09-13T18:35:21.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.436+0000 7f12f759e700 1 -- start start 2024-09-13T18:35:21.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.436+0000 7f12f759e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f12f815cda0 0x7f12f806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.436+0000 7f12f759e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f12f806a520 0x7f12f806a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.436+0000 7f12f759e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f80b8430 con 0x7f12f80ceb70 2024-09-13T18:35:21.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.436+0000 7f12f759e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f806be40 con 0x7f12f815cda0 2024-09-13T18:35:21.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.436+0000 7f12f759e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f80b64f0 con 0x7f12f806a520 2024-09-13T18:35:21.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.440+0000 7f12f659c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f12f815cda0 0x7f12f806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.440+0000 7f12f5d9b700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f12f80ceb70 0x7f12f80b5de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43630/0 (socket says 172.21.15.44:43630) 2024-09-13T18:35:21.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.440+0000 7f12f5d9b700 1 -- 172.21.15.44:0/2573924977 learned_addr learned my addr 172.21.15.44:0/2573924977 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:21.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.440+0000 7f12f6d9d700 1 --2- 172.21.15.44:0/2573924977 >> v2:172.21.15.99:3300/0 conn(0x7f12f806a520 0x7f12f806a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.440+0000 7f12f659c700 1 -- 172.21.15.44:0/2573924977 >> v2:172.21.15.99:3300/0 conn(0x7f12f806a520 msgr2=0x7f12f806a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:21.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.440+0000 7f12f659c700 1 --2- 172.21.15.44:0/2573924977 >> v2:172.21.15.99:3300/0 conn(0x7f12f806a520 0x7f12f806a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.440+0000 7f12f659c700 1 -- 172.21.15.44:0/2573924977 >> v1:172.21.15.44:6789/0 conn(0x7f12f80ceb70 legacy=0x7f12f80b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.440+0000 7f12f659c700 1 -- 172.21.15.44:0/2573924977 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f806ae70 con 0x7f12f815cda0 2024-09-13T18:35:21.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.440+0000 7f12f559a700 1 -- 172.21.15.44:0/2573924977 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769668871 0 0) 0x7f12f80b8430 con 0x7f12f80ceb70 2024-09-13T18:35:21.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.440+0000 7f12f659c700 1 --2- 172.21.15.44:0/2573924977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f815cda0 0x7f12f806b900 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f12f80d2c60 tx=0x7f12e0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdafbd0a428bd44c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:21.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.440+0000 7f12f559a700 1 -- 172.21.15.44:0/2573924977 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e0011830 con 0x7f12f815cda0 2024-09-13T18:35:21.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.440+0000 7f12f559a700 1 -- 172.21.15.44:0/2573924977 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e0011990 con 0x7f12f815cda0 2024-09-13T18:35:21.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.440+0000 7f12f559a700 1 -- 172.21.15.44:0/2573924977 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e0011d20 con 0x7f12f815cda0 2024-09-13T18:35:21.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.440+0000 7f12f759e700 1 -- 172.21.15.44:0/2573924977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f815cda0 msgr2=0x7f12f806b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.440+0000 7f12f759e700 1 --2- 172.21.15.44:0/2573924977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f815cda0 0x7f12f806b900 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f12f80d2c60 tx=0x7f12e0009b30 comp rx=0 tx=0).stop 2024-09-13T18:35:21.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.440+0000 7f12f759e700 1 -- 172.21.15.44:0/2573924977 shutdown_connections 2024-09-13T18:35:21.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.440+0000 7f12f759e700 1 --2- 172.21.15.44:0/2573924977 >> v2:172.21.15.99:3300/0 conn(0x7f12f806a520 0x7f12f806a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.440+0000 7f12f759e700 1 --2- 172.21.15.44:0/2573924977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f815cda0 0x7f12f806b900 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.440+0000 7f12f759e700 1 -- 172.21.15.44:0/2573924977 >> 172.21.15.44:0/2573924977 conn(0x7f12f80d2cb0 msgr2=0x7f12f80d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:21.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.440+0000 7f12f759e700 1 -- 172.21.15.44:0/2573924977 shutdown_connections 2024-09-13T18:35:21.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.440+0000 7f12f759e700 1 -- 172.21.15.44:0/2573924977 wait complete. 2024-09-13T18:35:21.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12f759e700 1 Processor -- start 2024-09-13T18:35:21.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12f759e700 1 -- start start 2024-09-13T18:35:21.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12f759e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12f806a520 0x7f12f81efe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12f759e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f80ceb70 0x7f12f81570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12f759e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f12f815cda0 0x7f12f8157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12f759e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f80cd140 con 0x7f12f80ceb70 2024-09-13T18:35:21.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12f759e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f8160400 con 0x7f12f806a520 2024-09-13T18:35:21.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12f759e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f81f03a0 con 0x7f12f815cda0 2024-09-13T18:35:21.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12f5d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f80ceb70 0x7f12f81570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12f5d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f80ceb70 0x7f12f81570e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40108/0 (socket says 172.21.15.44:40108) 2024-09-13T18:35:21.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12f5d9b700 1 -- 172.21.15.44:0/2711608778 learned_addr learned my addr 172.21.15.44:0/2711608778 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:21.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12f659c700 1 --2- 172.21.15.44:0/2711608778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12f806a520 0x7f12f81efe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12f6d9d700 1 --2- 172.21.15.44:0/2711608778 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f12f815cda0 0x7f12f8157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12f5d9b700 1 -- 172.21.15.44:0/2711608778 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f12f815cda0 msgr2=0x7f12f8157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12f5d9b700 1 --2- 172.21.15.44:0/2711608778 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f12f815cda0 0x7f12f8157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12f5d9b700 1 -- 172.21.15.44:0/2711608778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12f806a520 msgr2=0x7f12f81efe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12f5d9b700 1 --2- 172.21.15.44:0/2711608778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12f806a520 0x7f12f81efe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12f5d9b700 1 -- 172.21.15.44:0/2711608778 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e00094b0 con 0x7f12f80ceb70 2024-09-13T18:35:21.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12f6d9d700 1 --2- 172.21.15.44:0/2711608778 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f12f815cda0 0x7f12f8157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:21.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12f5d9b700 1 --2- 172.21.15.44:0/2711608778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f80ceb70 0x7f12f81570e0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f12e800c5b0 tx=0x7f12e800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:21.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12eeffd700 1 -- 172.21.15.44:0/2711608778 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8004ca0 con 0x7f12f80ceb70 2024-09-13T18:35:21.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12eeffd700 1 -- 172.21.15.44:0/2711608778 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e8004e20 con 0x7f12f80ceb70 2024-09-13T18:35:21.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12eeffd700 1 -- 172.21.15.44:0/2711608778 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8007310 con 0x7f12f80ceb70 2024-09-13T18:35:21.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12f759e700 1 -- 172.21.15.44:0/2711608778 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f80c9810 con 0x7f12f80ceb70 2024-09-13T18:35:21.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.444+0000 7f12f759e700 1 -- 172.21.15.44:0/2711608778 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f80c8ee0 con 0x7f12f80ceb70 2024-09-13T18:35:21.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.448+0000 7f12f759e700 1 -- 172.21.15.44:0/2711608778 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f80b8cc0 con 0x7f12f80ceb70 2024-09-13T18:35:21.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.448+0000 7f12eeffd700 1 -- 172.21.15.44:0/2711608778 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f12e8007470 con 0x7f12f80ceb70 2024-09-13T18:35:21.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.448+0000 7f12eeffd700 1 --2- 172.21.15.44:0/2711608778 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f12d8066730 0x7f12d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.448+0000 7f12eeffd700 1 -- 172.21.15.44:0/2711608778 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f12e8083fb0 con 0x7f12f80ceb70 2024-09-13T18:35:21.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.448+0000 7f12f659c700 1 --2- 172.21.15.44:0/2711608778 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f12d8066730 0x7f12d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.452+0000 7f12f659c700 1 --2- 172.21.15.44:0/2711608778 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f12d8066730 0x7f12d8068bf0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f12e0009fd0 tx=0x7f12e0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:21.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.460+0000 7f12eeffd700 1 -- 172.21.15.44:0/2711608778 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f12e80b5db0 con 0x7f12f80ceb70 2024-09-13T18:35:21.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:21.668+0000 7f12f759e700 1 -- 172.21.15.44:0/2711608778 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f12f80d0860 con 0x7f12f80ceb70 2024-09-13T18:35:22.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.292+0000 7f12eeffd700 1 -- 172.21.15.44:0/2711608778 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v60) v1 ==== 162+0+0 (secure 0 0 0) 0x7f12f80d0860 con 0x7f12f80ceb70 2024-09-13T18:35:22.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.296+0000 7f12f759e700 1 -- 172.21.15.44:0/2711608778 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f12d8066730 msgr2=0x7f12d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.296+0000 7f12f759e700 1 --2- 172.21.15.44:0/2711608778 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f12d8066730 0x7f12d8068bf0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f12e0009fd0 tx=0x7f12e0008030 comp rx=0 tx=0).stop 2024-09-13T18:35:22.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.296+0000 7f12f759e700 1 -- 172.21.15.44:0/2711608778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f80ceb70 msgr2=0x7f12f81570e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.296+0000 7f12f759e700 1 --2- 172.21.15.44:0/2711608778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f80ceb70 0x7f12f81570e0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f12e800c5b0 tx=0x7f12e800c8c0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.296+0000 7f12f759e700 1 -- 172.21.15.44:0/2711608778 shutdown_connections 2024-09-13T18:35:22.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.296+0000 7f12f759e700 1 --2- 172.21.15.44:0/2711608778 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f12d8066730 0x7f12d8068bf0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.296+0000 7f12f759e700 1 --2- 172.21.15.44:0/2711608778 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f12f815cda0 0x7f12f8157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.296+0000 7f12f759e700 1 --2- 172.21.15.44:0/2711608778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f80ceb70 0x7f12f81570e0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.296+0000 7f12f759e700 1 --2- 172.21.15.44:0/2711608778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12f806a520 0x7f12f81efe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.296+0000 7f12f759e700 1 -- 172.21.15.44:0/2711608778 >> 172.21.15.44:0/2711608778 conn(0x7f12f80d2cb0 msgr2=0x7f12f80d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:22.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.296+0000 7f12f759e700 1 -- 172.21.15.44:0/2711608778 shutdown_connections 2024-09-13T18:35:22.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.296+0000 7f12f759e700 1 -- 172.21.15.44:0/2711608778 wait complete. 2024-09-13T18:35:22.304 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-13T18:35:22.318 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:35:22.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.428+0000 7f513cf4e700 1 Processor -- start 2024-09-13T18:35:22.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.428+0000 7f513cf4e700 1 -- start start 2024-09-13T18:35:22.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.432+0000 7f513cf4e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51380cf280 0x7f51380b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.432+0000 7f513cf4e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f513815ef70 0x7f5138071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.432+0000 7f513cf4e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f513815af70 con 0x7f51380720f0 2024-09-13T18:35:22.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.432+0000 7f513cf4e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5138151f10 con 0x7f513815ef70 2024-09-13T18:35:22.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.432+0000 7f513cf4e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5138072560 con 0x7f51380cf280 2024-09-13T18:35:22.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.432+0000 7f5137fff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f51380720f0 0x7f513806aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47636/0 (socket says 172.21.15.44:47636) 2024-09-13T18:35:22.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.432+0000 7f5137fff700 1 -- 172.21.15.44:0/770425655 learned_addr learned my addr 172.21.15.44:0/770425655 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:22.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.432+0000 7f5136ffd700 1 --2- 172.21.15.44:0/770425655 >> v2:172.21.15.99:3300/0 conn(0x7f513815ef70 0x7f5138071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.432+0000 7f51377fe700 1 --2- 172.21.15.44:0/770425655 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51380cf280 0x7f51380b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.432+0000 7f51367fc700 1 -- 172.21.15.44:0/770425655 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305468789 0 0) 0x7f513815af70 con 0x7f51380720f0 2024-09-13T18:35:22.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.432+0000 7f51367fc700 1 -- 172.21.15.44:0/770425655 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51180035d0 con 0x7f51380720f0 2024-09-13T18:35:22.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.432+0000 7f51377fe700 1 -- 172.21.15.44:0/770425655 >> v2:172.21.15.99:3300/0 conn(0x7f513815ef70 msgr2=0x7f5138071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:22.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.432+0000 7f51377fe700 1 --2- 172.21.15.44:0/770425655 >> v2:172.21.15.99:3300/0 conn(0x7f513815ef70 0x7f5138071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.432+0000 7f51377fe700 1 -- 172.21.15.44:0/770425655 >> v1:172.21.15.44:6789/0 conn(0x7f51380720f0 legacy=0x7f513806aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.432+0000 7f51377fe700 1 -- 172.21.15.44:0/770425655 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51380b58d0 con 0x7f51380cf280 2024-09-13T18:35:22.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.432+0000 7f5136ffd700 1 --2- 172.21.15.44:0/770425655 >> v2:172.21.15.99:3300/0 conn(0x7f513815ef70 0x7f5138071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:22.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.432+0000 7f51377fe700 1 --2- 172.21.15.44:0/770425655 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51380cf280 0x7f51380b51d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5128009850 tx=0x7f5128009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22efec68df5476d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:22.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.432+0000 7f51367fc700 1 -- 172.21.15.44:0/770425655 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5128011830 con 0x7f51380cf280 2024-09-13T18:35:22.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.432+0000 7f51367fc700 1 -- 172.21.15.44:0/770425655 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5128011990 con 0x7f51380cf280 2024-09-13T18:35:22.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.432+0000 7f51367fc700 1 -- 172.21.15.44:0/770425655 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5128011d00 con 0x7f51380cf280 2024-09-13T18:35:22.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.436+0000 7f513cf4e700 1 -- 172.21.15.44:0/770425655 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51380cf280 msgr2=0x7f51380b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.436+0000 7f513cf4e700 1 --2- 172.21.15.44:0/770425655 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51380cf280 0x7f51380b51d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5128009850 tx=0x7f5128009b60 comp rx=0 tx=0).stop 2024-09-13T18:35:22.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.436+0000 7f513cf4e700 1 -- 172.21.15.44:0/770425655 shutdown_connections 2024-09-13T18:35:22.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.436+0000 7f513cf4e700 1 --2- 172.21.15.44:0/770425655 >> v2:172.21.15.99:3300/0 conn(0x7f513815ef70 0x7f5138071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.436+0000 7f513cf4e700 1 --2- 172.21.15.44:0/770425655 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51380cf280 0x7f51380b51d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.436+0000 7f513cf4e700 1 -- 172.21.15.44:0/770425655 >> 172.21.15.44:0/770425655 conn(0x7f51380cf910 msgr2=0x7f51380cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:22.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.436+0000 7f513cf4e700 1 -- 172.21.15.44:0/770425655 shutdown_connections 2024-09-13T18:35:22.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.436+0000 7f513cf4e700 1 -- 172.21.15.44:0/770425655 wait complete. 2024-09-13T18:35:22.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.436+0000 7f513cf4e700 1 Processor -- start 2024-09-13T18:35:22.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.436+0000 7f513cf4e700 1 -- start start 2024-09-13T18:35:22.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.440+0000 7f513cf4e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51380720f0 0x7f5138151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.440+0000 7f513cf4e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51380cf280 0x7f51380a86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.440+0000 7f513cf4e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f513815ef70 0x7f513815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.440+0000 7f513cf4e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51380a9030 con 0x7f51380720f0 2024-09-13T18:35:22.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.440+0000 7f513cf4e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51380a9310 con 0x7f51380cf280 2024-09-13T18:35:22.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.440+0000 7f513cf4e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51381f31c0 con 0x7f513815ef70 2024-09-13T18:35:22.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.440+0000 7f51377fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51380720f0 0x7f5138151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.440+0000 7f51377fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51380720f0 0x7f5138151510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52508/0 (socket says 172.21.15.44:52508) 2024-09-13T18:35:22.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.440+0000 7f51377fe700 1 -- 172.21.15.44:0/3640242497 learned_addr learned my addr 172.21.15.44:0/3640242497 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:22.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.440+0000 7f5136ffd700 1 --2- 172.21.15.44:0/3640242497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51380cf280 0x7f51380a86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.440+0000 7f5137fff700 1 --2- 172.21.15.44:0/3640242497 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f513815ef70 0x7f513815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.440+0000 7f51377fe700 1 -- 172.21.15.44:0/3640242497 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f513815ef70 msgr2=0x7f513815cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.440+0000 7f51377fe700 1 --2- 172.21.15.44:0/3640242497 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f513815ef70 0x7f513815cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.440+0000 7f51377fe700 1 -- 172.21.15.44:0/3640242497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51380cf280 msgr2=0x7f51380a86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.440+0000 7f51377fe700 1 --2- 172.21.15.44:0/3640242497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51380cf280 0x7f51380a86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.440+0000 7f51377fe700 1 -- 172.21.15.44:0/3640242497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51200094b0 con 0x7f51380720f0 2024-09-13T18:35:22.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.440+0000 7f5136ffd700 1 --2- 172.21.15.44:0/3640242497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51380cf280 0x7f51380a86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:22.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.440+0000 7f51377fe700 1 --2- 172.21.15.44:0/3640242497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51380720f0 0x7f5138151510 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f5128009ba0 tx=0x7f5128004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:22.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.440+0000 7f512ffff700 1 -- 172.21.15.44:0/3640242497 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51280044d0 con 0x7f51380720f0 2024-09-13T18:35:22.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.440+0000 7f512ffff700 1 -- 172.21.15.44:0/3640242497 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512801f070 con 0x7f51380720f0 2024-09-13T18:35:22.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.440+0000 7f512ffff700 1 -- 172.21.15.44:0/3640242497 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5128003900 con 0x7f51380720f0 2024-09-13T18:35:22.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.440+0000 7f513cf4e700 1 -- 172.21.15.44:0/3640242497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51280094b0 con 0x7f51380720f0 2024-09-13T18:35:22.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.440+0000 7f513cf4e700 1 -- 172.21.15.44:0/3640242497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51381f3780 con 0x7f51380720f0 2024-09-13T18:35:22.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.444+0000 7f513cf4e700 1 -- 172.21.15.44:0/3640242497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51380cf660 con 0x7f51380720f0 2024-09-13T18:35:22.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.444+0000 7f512ffff700 1 -- 172.21.15.44:0/3640242497 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5128003a60 con 0x7f51380720f0 2024-09-13T18:35:22.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.444+0000 7f512ffff700 1 --2- 172.21.15.44:0/3640242497 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f511c066730 0x7f511c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.444+0000 7f512ffff700 1 -- 172.21.15.44:0/3640242497 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f5128021070 con 0x7f51380720f0 2024-09-13T18:35:22.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.444+0000 7f5136ffd700 1 --2- 172.21.15.44:0/3640242497 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f511c066730 0x7f511c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.444+0000 7f5136ffd700 1 --2- 172.21.15.44:0/3640242497 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f511c066730 0x7f511c068bf0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f51200113d0 tx=0x7f5120009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:22.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.452+0000 7f512ffff700 1 -- 172.21.15.44:0/3640242497 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5128052830 con 0x7f51380720f0 2024-09-13T18:35:22.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.660+0000 7f513cf4e700 1 -- 172.21.15.44:0/3640242497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5138151bd0 con 0x7f51380720f0 2024-09-13T18:35:22.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.660+0000 7f512ffff700 1 -- 172.21.15.44:0/3640242497 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+3981 (secure 0 0 0) 0x7f5128006ce0 con 0x7f51380720f0 2024-09-13T18:35:22.667 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:22.667 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":60,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2305930667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2305930667},{"type":"v1","addr":"172.21.15.99:6835","nonce":2305930667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1177460745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1177460745},{"type":"v1","addr":"172.21.15.44:6834","nonce":1177460745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:35:20.700105+0000","modified":"2024-09-13T18:35:22.289468+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7093},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_7093":{"gid":7093,"name":"d","rank":0,"incarnation":59,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.99:6837/1121392581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1121392581},{"type":"v1","addr":"172.21.15.99:6837","nonce":1121392581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:35:22.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.664+0000 7f513cf4e700 1 -- 172.21.15.44:0/3640242497 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f511c066730 msgr2=0x7f511c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.664+0000 7f513cf4e700 1 --2- 172.21.15.44:0/3640242497 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f511c066730 0x7f511c068bf0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f51200113d0 tx=0x7f5120009240 comp rx=0 tx=0).stop 2024-09-13T18:35:22.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.664+0000 7f513cf4e700 1 -- 172.21.15.44:0/3640242497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51380720f0 msgr2=0x7f5138151510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.664+0000 7f513cf4e700 1 --2- 172.21.15.44:0/3640242497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51380720f0 0x7f5138151510 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f5128009ba0 tx=0x7f5128004770 comp rx=0 tx=0).stop 2024-09-13T18:35:22.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.664+0000 7f513cf4e700 1 -- 172.21.15.44:0/3640242497 shutdown_connections 2024-09-13T18:35:22.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.664+0000 7f513cf4e700 1 --2- 172.21.15.44:0/3640242497 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f511c066730 0x7f511c068bf0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.664+0000 7f513cf4e700 1 --2- 172.21.15.44:0/3640242497 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f513815ef70 0x7f513815cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.664+0000 7f513cf4e700 1 --2- 172.21.15.44:0/3640242497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51380cf280 0x7f51380a86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.664+0000 7f513cf4e700 1 --2- 172.21.15.44:0/3640242497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51380720f0 0x7f5138151510 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.664+0000 7f513cf4e700 1 -- 172.21.15.44:0/3640242497 >> 172.21.15.44:0/3640242497 conn(0x7f51380cf910 msgr2=0x7f51380717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:22.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.664+0000 7f513cf4e700 1 -- 172.21.15.44:0/3640242497 shutdown_connections 2024-09-13T18:35:22.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:22.664+0000 7f513cf4e700 1 -- 172.21.15.44:0/3640242497 wait complete. 2024-09-13T18:35:22.671 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 60 2024-09-13T18:35:22.926 INFO:tasks.ceph.mds.a.smithi044.stderr: -51> 2024-09-13T18:35:18.165+0000 7ff39ba52700 -1 mds.1.sessionmap _load_finish got (2) No such file or directory 2024-09-13T18:35:22.926 INFO:tasks.ceph.mds.a.smithi044.stderr: -50> 2024-09-13T18:35:18.165+0000 7ff39ba52700 -1 log_channel(cluster) log [ERR] : error reading sessionmap 'mds1_sessionmap' -2 ((2) No such file or directory) 2024-09-13T18:35:22.960 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-13T18:35:23.086 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:35:20.700105+0000', 'modified': '2024-09-13T18:35:22.289468+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7093}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_7093': {'gid': 7093, 'name': 'd', 'rank': 0, 'incarnation': 59, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.99:6837/1121392581', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6836', 'nonce': 1121392581}, {'type': 'v1', 'addr': '172.21.15.99:6837', 'nonce': 1121392581}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:35:23.086 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7093:up:reconnect 2024-09-13T18:35:24.086 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:35:24.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.204+0000 7f3bfc81b700 1 Processor -- start 2024-09-13T18:35:24.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.204+0000 7f3bfc81b700 1 -- start start 2024-09-13T18:35:24.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bfc81b700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3bf815cd80 0x7f3bf806baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:24.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bfc81b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3bf806a640 0x7f3bf806aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:24.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bfc81b700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf815d160 con 0x7f3bf806afa0 2024-09-13T18:35:24.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bfc81b700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf80d1570 con 0x7f3bf815cd80 2024-09-13T18:35:24.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bfc81b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf806b450 con 0x7f3bf806a640 2024-09-13T18:35:24.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bf7fff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3bf806afa0 0x7f3bf80b5e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47642/0 (socket says 172.21.15.44:47642) 2024-09-13T18:35:24.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bf7fff700 1 -- 172.21.15.44:0/1579019780 learned_addr learned my addr 172.21.15.44:0/1579019780 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:24.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bf77fe700 1 --2- 172.21.15.44:0/1579019780 >> v2:172.21.15.99:3300/0 conn(0x7f3bf815cd80 0x7f3bf806baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:24.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bf6ffd700 1 --2- 172.21.15.44:0/1579019780 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3bf806a640 0x7f3bf806aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:24.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bf67fc700 1 -- 172.21.15.44:0/1579019780 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1072899553 0 0) 0x7f3bf815d160 con 0x7f3bf806afa0 2024-09-13T18:35:24.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bf67fc700 1 -- 172.21.15.44:0/1579019780 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bd80035d0 con 0x7f3bf806afa0 2024-09-13T18:35:24.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bf77fe700 1 -- 172.21.15.44:0/1579019780 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3bf806a640 msgr2=0x7f3bf806aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:24.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bf77fe700 1 --2- 172.21.15.44:0/1579019780 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3bf806a640 0x7f3bf806aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bf77fe700 1 -- 172.21.15.44:0/1579019780 >> v1:172.21.15.44:6789/0 conn(0x7f3bf806afa0 legacy=0x7f3bf80b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bf77fe700 1 -- 172.21.15.44:0/1579019780 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf80d2120 con 0x7f3bf815cd80 2024-09-13T18:35:24.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bf77fe700 1 --2- 172.21.15.44:0/1579019780 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf815cd80 0x7f3bf806baa0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3be8009d90 tx=0x7f3be800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6cd547c8998b90 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:24.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bf67fc700 1 -- 172.21.15.44:0/1579019780 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be800e070 con 0x7f3bf815cd80 2024-09-13T18:35:24.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bf67fc700 1 -- 172.21.15.44:0/1579019780 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be800bb20 con 0x7f3bf815cd80 2024-09-13T18:35:24.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bf67fc700 1 -- 172.21.15.44:0/1579019780 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be800be90 con 0x7f3bf815cd80 2024-09-13T18:35:24.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bfc81b700 1 -- 172.21.15.44:0/1579019780 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf815cd80 msgr2=0x7f3bf806baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bfc81b700 1 --2- 172.21.15.44:0/1579019780 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf815cd80 0x7f3bf806baa0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3be8009d90 tx=0x7f3be800b330 comp rx=0 tx=0).stop 2024-09-13T18:35:24.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bfc81b700 1 -- 172.21.15.44:0/1579019780 shutdown_connections 2024-09-13T18:35:24.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bfc81b700 1 --2- 172.21.15.44:0/1579019780 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3bf806a640 0x7f3bf806aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bfc81b700 1 --2- 172.21.15.44:0/1579019780 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf815cd80 0x7f3bf806baa0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bfc81b700 1 -- 172.21.15.44:0/1579019780 >> 172.21.15.44:0/1579019780 conn(0x7f3bf80d30b0 msgr2=0x7f3bf80d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:24.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bfc81b700 1 -- 172.21.15.44:0/1579019780 shutdown_connections 2024-09-13T18:35:24.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.208+0000 7f3bfc81b700 1 -- 172.21.15.44:0/1579019780 wait complete. 2024-09-13T18:35:24.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3bfc81b700 1 Processor -- start 2024-09-13T18:35:24.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3bfc81b700 1 -- start start 2024-09-13T18:35:24.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3bfc81b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf806a640 0x7f3bf80b83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:24.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3bfc81b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bf806afa0 0x7f3bf80cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:24.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3bfc81b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3bf815cd80 0x7f3bf81f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:24.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3bfc81b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf80cbd00 con 0x7f3bf806afa0 2024-09-13T18:35:24.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3bfc81b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf80cbfd0 con 0x7f3bf806a640 2024-09-13T18:35:24.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3bfc81b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf80cc2b0 con 0x7f3bf815cd80 2024-09-13T18:35:24.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3bf6ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bf806afa0 0x7f3bf80cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:24.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3bf6ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bf806afa0 0x7f3bf80cb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52530/0 (socket says 172.21.15.44:52530) 2024-09-13T18:35:24.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3bf6ffd700 1 -- 172.21.15.44:0/2807989371 learned_addr learned my addr 172.21.15.44:0/2807989371 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:24.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3bf77fe700 1 --2- 172.21.15.44:0/2807989371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf806a640 0x7f3bf80b83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:24.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3bf7fff700 1 --2- 172.21.15.44:0/2807989371 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3bf815cd80 0x7f3bf81f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:24.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3bf6ffd700 1 -- 172.21.15.44:0/2807989371 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3bf815cd80 msgr2=0x7f3bf81f4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3bf6ffd700 1 --2- 172.21.15.44:0/2807989371 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3bf815cd80 0x7f3bf81f4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3bf6ffd700 1 -- 172.21.15.44:0/2807989371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf806a640 msgr2=0x7f3bf80b83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3bf6ffd700 1 --2- 172.21.15.44:0/2807989371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf806a640 0x7f3bf80b83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3bf6ffd700 1 -- 172.21.15.44:0/2807989371 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be8009a70 con 0x7f3bf806afa0 2024-09-13T18:35:24.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3bf7fff700 1 --2- 172.21.15.44:0/2807989371 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3bf815cd80 0x7f3bf81f4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:24.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3bf6ffd700 1 --2- 172.21.15.44:0/2807989371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bf806afa0 0x7f3bf80cb7c0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f3be000e9a0 tx=0x7f3be000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:24.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3beffff700 1 -- 172.21.15.44:0/2807989371 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0009720 con 0x7f3bf806afa0 2024-09-13T18:35:24.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3beffff700 1 -- 172.21.15.44:0/2807989371 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be000c850 con 0x7f3bf806afa0 2024-09-13T18:35:24.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3bfc81b700 1 -- 172.21.15.44:0/2807989371 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf80cc590 con 0x7f3bf806afa0 2024-09-13T18:35:24.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3beffff700 1 -- 172.21.15.44:0/2807989371 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be000cbe0 con 0x7f3bf806afa0 2024-09-13T18:35:24.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.212+0000 7f3bfc81b700 1 -- 172.21.15.44:0/2807989371 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf80ccb50 con 0x7f3bf806afa0 2024-09-13T18:35:24.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.216+0000 7f3bfc81b700 1 -- 172.21.15.44:0/2807989371 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf806aa60 con 0x7f3bf806afa0 2024-09-13T18:35:24.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.216+0000 7f3beffff700 1 -- 172.21.15.44:0/2807989371 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3be000cd40 con 0x7f3bf806afa0 2024-09-13T18:35:24.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.216+0000 7f3beffff700 1 --2- 172.21.15.44:0/2807989371 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3bdc066760 0x7f3bdc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:24.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.216+0000 7f3beffff700 1 -- 172.21.15.44:0/2807989371 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f3be0084370 con 0x7f3bf806afa0 2024-09-13T18:35:24.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.216+0000 7f3bf77fe700 1 --2- 172.21.15.44:0/2807989371 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3bdc066760 0x7f3bdc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:24.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.220+0000 7f3bf77fe700 1 --2- 172.21.15.44:0/2807989371 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3bdc066760 0x7f3bdc068c20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3be8014040 tx=0x7f3be8011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:24.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.224+0000 7f3beffff700 1 -- 172.21.15.44:0/2807989371 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3be00514d0 con 0x7f3bf806afa0 2024-09-13T18:35:24.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.436+0000 7f3bfc81b700 1 -- 172.21.15.44:0/2807989371 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3bf80b3240 con 0x7f3bf806afa0 2024-09-13T18:35:24.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.440+0000 7f3beffff700 1 -- 172.21.15.44:0/2807989371 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4735 (secure 0 0 0) 0x7f3be0054af0 con 0x7f3bf806afa0 2024-09-13T18:35:24.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:24.445 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":62,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2305930667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2305930667},{"type":"v1","addr":"172.21.15.99:6835","nonce":2305930667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1177460745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1177460745},{"type":"v1","addr":"172.21.15.44:6834","nonce":1177460745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7395,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1292209064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1292209064},{"type":"v1","addr":"172.21.15.44:6835","nonce":1292209064}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:35:20.700105+0000","modified":"2024-09-13T18:35:24.301327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7093},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_7093":{"gid":7093,"name":"d","rank":0,"incarnation":59,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6837/1121392581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1121392581},{"type":"v1","addr":"172.21.15.99:6837","nonce":1121392581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:35:24.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.444+0000 7f3bfc81b700 1 -- 172.21.15.44:0/2807989371 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3bdc066760 msgr2=0x7f3bdc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.444+0000 7f3bfc81b700 1 --2- 172.21.15.44:0/2807989371 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3bdc066760 0x7f3bdc068c20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3be8014040 tx=0x7f3be8011000 comp rx=0 tx=0).stop 2024-09-13T18:35:24.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.444+0000 7f3bfc81b700 1 -- 172.21.15.44:0/2807989371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bf806afa0 msgr2=0x7f3bf80cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.444+0000 7f3bfc81b700 1 --2- 172.21.15.44:0/2807989371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bf806afa0 0x7f3bf80cb7c0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f3be000e9a0 tx=0x7f3be000ecb0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.444+0000 7f3bfc81b700 1 -- 172.21.15.44:0/2807989371 shutdown_connections 2024-09-13T18:35:24.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.444+0000 7f3bfc81b700 1 --2- 172.21.15.44:0/2807989371 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3bdc066760 0x7f3bdc068c20 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.444+0000 7f3bfc81b700 1 --2- 172.21.15.44:0/2807989371 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3bf815cd80 0x7f3bf81f4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.444+0000 7f3bfc81b700 1 --2- 172.21.15.44:0/2807989371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bf806afa0 0x7f3bf80cb7c0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.444+0000 7f3bfc81b700 1 --2- 172.21.15.44:0/2807989371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf806a640 0x7f3bf80b83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.444+0000 7f3bfc81b700 1 -- 172.21.15.44:0/2807989371 >> 172.21.15.44:0/2807989371 conn(0x7f3bf80d30b0 msgr2=0x7f3bf815b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:24.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.444+0000 7f3bfc81b700 1 -- 172.21.15.44:0/2807989371 shutdown_connections 2024-09-13T18:35:24.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.444+0000 7f3bfc81b700 1 -- 172.21.15.44:0/2807989371 wait complete. 2024-09-13T18:35:24.451 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 62 2024-09-13T18:35:24.869 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:35:20.700105+0000', 'modified': '2024-09-13T18:35:24.301327+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7093}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_7093': {'gid': 7093, 'name': 'd', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.99:6837/1121392581', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6836', 'nonce': 1121392581}, {'type': 'v1', 'addr': '172.21.15.99:6837', 'nonce': 1121392581}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:35:24.870 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:35:24.870 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-13T18:35:25.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.992+0000 7f6865980700 1 Processor -- start 2024-09-13T18:35:25.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.992+0000 7f6865980700 1 -- start start 2024-09-13T18:35:25.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.996+0000 7f6865980700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f68601465c0 0x7f6860146a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.996+0000 7f6865980700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6860144600 0x7f6860144ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.996+0000 7f6865980700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6860144330 con 0x7f68601461e0 2024-09-13T18:35:25.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.996+0000 7f6865980700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68600b4720 con 0x7f6860144600 2024-09-13T18:35:25.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.996+0000 7f6865980700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68600b3680 con 0x7f68601465c0 2024-09-13T18:35:25.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.996+0000 7f685f7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6860144600 0x7f6860144ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.996+0000 7f685f7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6860144600 0x7f6860144ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52532/0 (socket says 172.21.15.44:52532) 2024-09-13T18:35:25.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.996+0000 7f685e7fc700 1 --2- 172.21.15.44:0/289605224 >> v2:172.21.15.99:3300/0 conn(0x7f68601465c0 0x7f6860146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.996+0000 7f685f7fe700 1 -- 172.21.15.44:0/289605224 learned_addr learned my addr 172.21.15.44:0/289605224 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:25.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.996+0000 7f685f7fe700 1 -- 172.21.15.44:0/289605224 >> v2:172.21.15.99:3300/0 conn(0x7f68601465c0 msgr2=0x7f6860146a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:25.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.996+0000 7f685f7fe700 1 --2- 172.21.15.44:0/289605224 >> v2:172.21.15.99:3300/0 conn(0x7f68601465c0 0x7f6860146a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.996+0000 7f685f7fe700 1 -- 172.21.15.44:0/289605224 >> v1:172.21.15.99:6789/0 conn(0x7f68601461e0 legacy=0x7f68600b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:25.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.996+0000 7f685f7fe700 1 -- 172.21.15.44:0/289605224 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68600b3960 con 0x7f6860144600 2024-09-13T18:35:25.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.996+0000 7f685f7fe700 1 --2- 172.21.15.44:0/289605224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6860144600 0x7f6860144ab0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f6860161530 tx=0x7f685800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b833bcd038960fe8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:25.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.996+0000 7f685dffb700 1 -- 172.21.15.44:0/289605224 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685800e070 con 0x7f6860144600 2024-09-13T18:35:25.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.996+0000 7f685dffb700 1 -- 172.21.15.44:0/289605224 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685800b910 con 0x7f6860144600 2024-09-13T18:35:25.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:24.996+0000 7f685dffb700 1 -- 172.21.15.44:0/289605224 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685800bcc0 con 0x7f6860144600 2024-09-13T18:35:25.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f6865980700 1 -- 172.21.15.44:0/289605224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6860144600 msgr2=0x7f6860144ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:25.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f6865980700 1 --2- 172.21.15.44:0/289605224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6860144600 0x7f6860144ab0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f6860161530 tx=0x7f685800b330 comp rx=0 tx=0).stop 2024-09-13T18:35:25.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f6865980700 1 -- 172.21.15.44:0/289605224 shutdown_connections 2024-09-13T18:35:25.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f6865980700 1 --2- 172.21.15.44:0/289605224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6860144600 0x7f6860144ab0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f6865980700 1 --2- 172.21.15.44:0/289605224 >> v2:172.21.15.99:3300/0 conn(0x7f68601465c0 0x7f6860146a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f6865980700 1 -- 172.21.15.44:0/289605224 >> 172.21.15.44:0/289605224 conn(0x7f68600af620 msgr2=0x7f68600afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:25.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f6865980700 1 -- 172.21.15.44:0/289605224 shutdown_connections 2024-09-13T18:35:25.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f6865980700 1 -- 172.21.15.44:0/289605224 wait complete. 2024-09-13T18:35:25.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f6865980700 1 Processor -- start 2024-09-13T18:35:25.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f6865980700 1 -- start start 2024-09-13T18:35:25.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f6865980700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6860144600 0x7f686015a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f6865980700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68601461e0 0x7f6860158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f6865980700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f68601465c0 0x7f6860071310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f6865980700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68601f6eb0 con 0x7f68601461e0 2024-09-13T18:35:25.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f6865980700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6860159450 con 0x7f6860144600 2024-09-13T18:35:25.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f6865980700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6860070f60 con 0x7f68601465c0 2024-09-13T18:35:25.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f685e7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68601461e0 0x7f6860158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f685e7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68601461e0 0x7f6860158f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52546/0 (socket says 172.21.15.44:52546) 2024-09-13T18:35:25.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f685effd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6860144600 0x7f686015a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f685e7fc700 1 -- 172.21.15.44:0/2171987002 learned_addr learned my addr 172.21.15.44:0/2171987002 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:25.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f685f7fe700 1 --2- 172.21.15.44:0/2171987002 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f68601465c0 0x7f6860071310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f685e7fc700 1 -- 172.21.15.44:0/2171987002 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f68601465c0 msgr2=0x7f6860071310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:25.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f685e7fc700 1 --2- 172.21.15.44:0/2171987002 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f68601465c0 0x7f6860071310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f685e7fc700 1 -- 172.21.15.44:0/2171987002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6860144600 msgr2=0x7f686015a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:25.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f685e7fc700 1 --2- 172.21.15.44:0/2171987002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6860144600 0x7f686015a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f685e7fc700 1 -- 172.21.15.44:0/2171987002 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6858009b30 con 0x7f68601461e0 2024-09-13T18:35:25.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.000+0000 7f685effd700 1 --2- 172.21.15.44:0/2171987002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6860144600 0x7f686015a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:25.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.004+0000 7f685e7fc700 1 --2- 172.21.15.44:0/2171987002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68601461e0 0x7f6860158f10 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f685000e870 tx=0x7f685000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:25.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.004+0000 7f6847fff700 1 -- 172.21.15.44:0/2171987002 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68500095a0 con 0x7f68601461e0 2024-09-13T18:35:25.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.004+0000 7f6847fff700 1 -- 172.21.15.44:0/2171987002 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6850013680 con 0x7f68601461e0 2024-09-13T18:35:25.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.004+0000 7f6847fff700 1 -- 172.21.15.44:0/2171987002 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68500139f0 con 0x7f68601461e0 2024-09-13T18:35:25.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.004+0000 7f6865980700 1 -- 172.21.15.44:0/2171987002 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686015b730 con 0x7f68601461e0 2024-09-13T18:35:25.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.004+0000 7f6865980700 1 -- 172.21.15.44:0/2171987002 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686015ae90 con 0x7f68601461e0 2024-09-13T18:35:25.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.004+0000 7f6847fff700 1 -- 172.21.15.44:0/2171987002 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6850013b50 con 0x7f68601461e0 2024-09-13T18:35:25.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f6847fff700 1 --2- 172.21.15.44:0/2171987002 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f684c066730 0x7f684c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f6847fff700 1 -- 172.21.15.44:0/2171987002 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f6850084370 con 0x7f68601461e0 2024-09-13T18:35:25.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f685effd700 1 --2- 172.21.15.44:0/2171987002 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f684c066730 0x7f684c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f685effd700 1 --2- 172.21.15.44:0/2171987002 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f684c066730 0x7f684c068bf0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6854000f60 tx=0x7f6854009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:25.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f6868c33740 1 Processor -- start 2024-09-13T18:35:25.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f6868c33740 1 -- start start 2024-09-13T18:35:25.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f6868c33740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1325da0 0x1326180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f6868c33740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1304d00 0x12ee890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f6868c33740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x13266c0 0x12eedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f6868c33740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x124dd80 con 0x1304d00 2024-09-13T18:35:25.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f6868c33740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x124b510 con 0x1325da0 2024-09-13T18:35:25.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f6868c33740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x1246e00 con 0x13266c0 2024-09-13T18:35:25.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f685e7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1304d00 0x12ee890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f685f7fe700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x13266c0 0x12eedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f685e7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1304d00 0x12ee890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52556/0 (socket says 172.21.15.44:52556) 2024-09-13T18:35:25.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f685e7fc700 1 -- 172.21.15.44:0/4109475600 learned_addr learned my addr 172.21.15.44:0/4109475600 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:25.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f685effd700 1 --2- 172.21.15.44:0/4109475600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1325da0 0x1326180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f685e7fc700 1 -- 172.21.15.44:0/4109475600 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x13266c0 msgr2=0x12eedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:25.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f685e7fc700 1 --2- 172.21.15.44:0/4109475600 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x13266c0 0x12eedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f685e7fc700 1 -- 172.21.15.44:0/4109475600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1325da0 msgr2=0x1326180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:25.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f685e7fc700 1 --2- 172.21.15.44:0/4109475600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1325da0 0x1326180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f685e7fc700 1 -- 172.21.15.44:0/4109475600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10b9960 con 0x1304d00 2024-09-13T18:35:25.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f685effd700 1 --2- 172.21.15.44:0/4109475600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1325da0 0x1326180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:25.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.008+0000 7f685e7fc700 1 --2- 172.21.15.44:0/4109475600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1304d00 0x12ee890 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f685005d160 tx=0x7f6850055320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3c5f00ac14d13c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:25.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.012+0000 7f68457fa700 1 -- 172.21.15.44:0/4109475600 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685005d690 con 0x1304d00 2024-09-13T18:35:25.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.012+0000 7f68457fa700 1 -- 172.21.15.44:0/4109475600 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685006b070 con 0x1304d00 2024-09-13T18:35:25.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.012+0000 7f68457fa700 1 -- 172.21.15.44:0/4109475600 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850053640 con 0x1304d00 2024-09-13T18:35:25.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.012+0000 7f6868c33740 1 -- 172.21.15.44:0/4109475600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1304d00 msgr2=0x12ee890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:25.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.012+0000 7f6868c33740 1 --2- 172.21.15.44:0/4109475600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1304d00 0x12ee890 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f685005d160 tx=0x7f6850055320 comp rx=0 tx=0).stop 2024-09-13T18:35:25.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.012+0000 7f6868c33740 1 -- 172.21.15.44:0/4109475600 shutdown_connections 2024-09-13T18:35:25.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.012+0000 7f6868c33740 1 --2- 172.21.15.44:0/4109475600 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x13266c0 0x12eedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.012+0000 7f6868c33740 1 --2- 172.21.15.44:0/4109475600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1304d00 0x12ee890 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.012+0000 7f6868c33740 1 --2- 172.21.15.44:0/4109475600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1325da0 0x1326180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.012+0000 7f6868c33740 1 -- 172.21.15.44:0/4109475600 >> 172.21.15.44:0/4109475600 conn(0x106e4d0 msgr2=0x1307c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:25.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.012+0000 7f6868c33740 1 -- 172.21.15.44:0/4109475600 shutdown_connections 2024-09-13T18:35:25.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.012+0000 7f6868c33740 1 -- 172.21.15.44:0/4109475600 wait complete. 2024-09-13T18:35:25.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.012+0000 7f6868c33740 1 -- start start 2024-09-13T18:35:25.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.012+0000 7f6868c33740 1 Processor -- start 2024-09-13T18:35:25.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f6868c33740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1304d00 0x132c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f6868c33740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1325da0 0x12df470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f6868c33740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x13266c0 0x13211b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f6868c33740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x1204730 con 0x1325da0 2024-09-13T18:35:25.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f6868c33740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x120a5b0 con 0x1304d00 2024-09-13T18:35:25.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f6868c33740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x10f2aa0 con 0x13266c0 2024-09-13T18:35:25.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f6868c33740 10 client.0 _ll_register_callbacks cb 0x1240610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:35:25.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f685e7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1325da0 0x12df470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f685e7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1325da0 0x12df470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52558/0 (socket says 172.21.15.44:52558) 2024-09-13T18:35:25.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f685e7fc700 1 -- 172.21.15.44:0/1505262209 learned_addr learned my addr 172.21.15.44:0/1505262209 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:25.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f685f7fe700 1 --2- 172.21.15.44:0/1505262209 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x13266c0 0x13211b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f685effd700 1 --2- 172.21.15.44:0/1505262209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1304d00 0x132c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f685e7fc700 1 -- 172.21.15.44:0/1505262209 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x13266c0 msgr2=0x13211b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:25.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f685e7fc700 1 --2- 172.21.15.44:0/1505262209 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x13266c0 0x13211b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f685e7fc700 1 -- 172.21.15.44:0/1505262209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1304d00 msgr2=0x132c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:25.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f685e7fc700 1 --2- 172.21.15.44:0/1505262209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1304d00 0x132c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f685e7fc700 1 -- 172.21.15.44:0/1505262209 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686015ae90 con 0x1325da0 2024-09-13T18:35:25.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f685f7fe700 1 --2- 172.21.15.44:0/1505262209 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x13266c0 0x13211b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:25.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f685effd700 1 --2- 172.21.15.44:0/1505262209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1304d00 0x132c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:25.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f685e7fc700 1 --2- 172.21.15.44:0/1505262209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1325da0 0x12df470 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f6850055b50 tx=0x7f6850000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5348b5fa4af2ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:25.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f683e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-13T18:35:25.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f683e7fc700 1 -- 172.21.15.44:0/1505262209 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850053640 con 0x1325da0 2024-09-13T18:35:25.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f683e7fc700 1 -- 172.21.15.44:0/1505262209 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f68500840b0 con 0x1325da0 2024-09-13T18:35:25.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f6868c33740 1 -- 172.21.15.44:0/1505262209 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x107b1e0 con 0x1325da0 2024-09-13T18:35:25.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f683e7fc700 1 -- 172.21.15.44:0/1505262209 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6850054790 con 0x1325da0 2024-09-13T18:35:25.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f6868c33740 10 client.7413 fetch_fsmap learned FSMap version 62 2024-09-13T18:35:25.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f6868c33740 1 -- 172.21.15.44:0/1505262209 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x120d220 con 0x1325da0 2024-09-13T18:35:25.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f683e7fc700 1 -- 172.21.15.44:0/1505262209 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x107b1e0 con 0x1325da0 2024-09-13T18:35:25.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f683e7fc700 1 -- 172.21.15.44:0/1505262209 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 62) v1 ==== 3118+0+0 (secure 0 0 0) 0x7f6850073070 con 0x1325da0 2024-09-13T18:35:25.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f6868c33740 10 client.7413 fetch_fsmap finished waiting for FSMap version 62 2024-09-13T18:35:25.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f6868c33740 10 client.7413 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:35:25.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f6868c33740 20 client.7413 populate_metadata read hostname 'smithi044' 2024-09-13T18:35:25.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f6868c33740 1 --2- 172.21.15.44:0/1505262209 >> [v2:172.21.15.99:6836/1121392581,v1:172.21.15.99:6837/1121392581] conn(0x12de100 0x12de4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f6868c33740 4 client.7413 mds_command: new command op to 7093 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:35:25.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f6868c33740 1 -- 172.21.15.44:0/1505262209 --> [v2:172.21.15.99:6836/1121392581,v1:172.21.15.99:6837/1121392581] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x10c5460 con 0x12de100 2024-09-13T18:35:25.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f685effd700 1 --2- 172.21.15.44:0/1505262209 >> [v2:172.21.15.99:6836/1121392581,v1:172.21.15.99:6837/1121392581] conn(0x12de100 0x12de4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f685effd700 1 --2- 172.21.15.44:0/1505262209 >> [v2:172.21.15.99:6836/1121392581,v1:172.21.15.99:6837/1121392581] conn(0x12de100 0x12de4e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14a0c0de3929f2a1 server_cookie=a51a8a83ce900b0e in_seq=0 out_seq=0 2024-09-13T18:35:25.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.016+0000 7f683e7fc700 10 client.7413 ms_handle_connect on v2:172.21.15.99:6836/1121392581 2024-09-13T18:35:25.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.020+0000 7f683e7fc700 1 -- 172.21.15.44:0/1505262209 <== mds.0 v2:172.21.15.99:6836/1121392581 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x10c5460 con 0x12de100 2024-09-13T18:35:25.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.020+0000 7f683e7fc700 10 client.7413 handle_command_reply: tid=0 2024-09-13T18:35:25.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.020+0000 7f6868c33740 1 client.7413 shutdown 2024-09-13T18:35:25.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.020+0000 7f6868c33740 1 -- 172.21.15.44:0/1505262209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1325da0 msgr2=0x12df470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:25.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.020+0000 7f6868c33740 1 --2- 172.21.15.44:0/1505262209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1325da0 0x12df470 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f6850055b50 tx=0x7f6850000bc0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.020+0000 7f6868c33740 1 -- 172.21.15.44:0/1505262209 shutdown_connections 2024-09-13T18:35:25.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.020+0000 7f6868c33740 1 --2- 172.21.15.44:0/1505262209 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x13266c0 0x13211b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.020+0000 7f6868c33740 1 --2- 172.21.15.44:0/1505262209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1325da0 0x12df470 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.020+0000 7f6868c33740 1 --2- 172.21.15.44:0/1505262209 >> [v2:172.21.15.99:6836/1121392581,v1:172.21.15.99:6837/1121392581] conn(0x12de100 0x12de4e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.020+0000 7f6868c33740 1 --2- 172.21.15.44:0/1505262209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1304d00 0x132c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.020+0000 7f6868c33740 1 -- 172.21.15.44:0/1505262209 >> 172.21.15.44:0/1505262209 conn(0x106e4d0 msgr2=0x1301780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:25.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.020+0000 7f683e7fc700 0 client.7413 ms_handle_reset on v2:172.21.15.99:6836/1121392581 2024-09-13T18:35:25.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.020+0000 7f6868c33740 1 -- 172.21.15.44:0/1505262209 shutdown_connections 2024-09-13T18:35:25.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.020+0000 7f6868c33740 1 -- 172.21.15.44:0/1505262209 wait complete. 2024-09-13T18:35:25.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.020+0000 7f6868c33740 20 client.7413 trim_cache size 0 max 16384 2024-09-13T18:35:25.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f6868c33740 1 Processor -- start 2024-09-13T18:35:25.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f6868c33740 1 -- start start 2024-09-13T18:35:25.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f6868c33740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1304d00 0x12dc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f6868c33740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x13266c0 0x12dcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f6868c33740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1336460 0x131f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f6868c33740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x1204730 con 0x13266c0 2024-09-13T18:35:25.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f6868c33740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x1275ec0 con 0x1336460 2024-09-13T18:35:25.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f6868c33740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x120a5b0 con 0x1304d00 2024-09-13T18:35:25.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f685e7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x13266c0 0x12dcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f685e7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x13266c0 0x12dcc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52572/0 (socket says 172.21.15.44:52572) 2024-09-13T18:35:25.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f685e7fc700 1 -- 172.21.15.44:0/231485647 learned_addr learned my addr 172.21.15.44:0/231485647 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:25.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f685effd700 1 --2- 172.21.15.44:0/231485647 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1304d00 0x12dc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f685f7fe700 1 --2- 172.21.15.44:0/231485647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1336460 0x131f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f685e7fc700 1 -- 172.21.15.44:0/231485647 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1304d00 msgr2=0x12dc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:25.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f685e7fc700 1 --2- 172.21.15.44:0/231485647 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1304d00 0x12dc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f685e7fc700 1 -- 172.21.15.44:0/231485647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1336460 msgr2=0x131f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:25.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f685e7fc700 1 --2- 172.21.15.44:0/231485647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1336460 0x131f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f685e7fc700 1 -- 172.21.15.44:0/231485647 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x11f3450 con 0x13266c0 2024-09-13T18:35:25.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f685e7fc700 1 --2- 172.21.15.44:0/231485647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x13266c0 0x12dcc50 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f6850054fa0 tx=0x7f685007e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2276794296770b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:25.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f6845ffb700 1 -- 172.21.15.44:0/231485647 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850054790 con 0x13266c0 2024-09-13T18:35:25.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f6845ffb700 1 -- 172.21.15.44:0/231485647 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68500826e0 con 0x13266c0 2024-09-13T18:35:25.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f6845ffb700 1 -- 172.21.15.44:0/231485647 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68500840b0 con 0x13266c0 2024-09-13T18:35:25.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f6868c33740 1 -- 172.21.15.44:0/231485647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x13266c0 msgr2=0x12dcc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:25.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f6868c33740 1 --2- 172.21.15.44:0/231485647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x13266c0 0x12dcc50 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f6850054fa0 tx=0x7f685007e040 comp rx=0 tx=0).stop 2024-09-13T18:35:25.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f6868c33740 1 -- 172.21.15.44:0/231485647 shutdown_connections 2024-09-13T18:35:25.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f6868c33740 1 --2- 172.21.15.44:0/231485647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x1336460 0x131f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f6868c33740 1 --2- 172.21.15.44:0/231485647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x13266c0 0x12dcc50 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f6868c33740 1 --2- 172.21.15.44:0/231485647 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1304d00 0x12dc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f6868c33740 1 -- 172.21.15.44:0/231485647 >> 172.21.15.44:0/231485647 conn(0x106e4d0 msgr2=0x1335870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f6868c33740 1 -- 172.21.15.44:0/231485647 shutdown_connections 2024-09-13T18:35:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.044+0000 7f6868c33740 1 -- 172.21.15.44:0/231485647 wait complete. 2024-09-13T18:35:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.048+0000 7f6868c33740 1 -- start start 2024-09-13T18:35:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.048+0000 7f6868c33740 1 Processor -- start 2024-09-13T18:35:25.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.048+0000 7f6868c33740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1304d00 0x1344640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.048+0000 7f6868c33740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x13266c0 0x132b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.048+0000 7f6868c33740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1336460 0x1387a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.048+0000 7f6868c33740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x13207d0 con 0x1336460 2024-09-13T18:35:25.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.048+0000 7f6868c33740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x1388670 con 0x13266c0 2024-09-13T18:35:25.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.048+0000 7f6868c33740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x1344b80 con 0x1304d00 2024-09-13T18:35:25.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.048+0000 7f6868c33740 10 client.0 _ll_register_callbacks cb 0x129d710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:35:25.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.048+0000 7f685f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1336460 0x1387a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.048+0000 7f685effd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1304d00 0x1344640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.048+0000 7f685f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1336460 0x1387a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52586/0 (socket says 172.21.15.44:52586) 2024-09-13T18:35:25.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.048+0000 7f685e7fc700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x13266c0 0x132b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.048+0000 7f685f7fe700 1 -- 172.21.15.44:0/2328973572 learned_addr learned my addr 172.21.15.44:0/2328973572 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:25.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.048+0000 7f685effd700 1 -- 172.21.15.44:0/2328973572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x13266c0 msgr2=0x132b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:25.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.048+0000 7f685effd700 1 --2- 172.21.15.44:0/2328973572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x13266c0 0x132b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.048+0000 7f685effd700 1 -- 172.21.15.44:0/2328973572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1336460 msgr2=0x1387a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:25.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.048+0000 7f685effd700 1 --2- 172.21.15.44:0/2328973572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1336460 0x1387a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.048+0000 7f685effd700 1 -- 172.21.15.44:0/2328973572 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x120d220 con 0x1304d00 2024-09-13T18:35:25.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f685effd700 1 --2- 172.21.15.44:0/2328973572 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1304d00 0x1344640 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x12dfe70 tx=0x7f6854000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b52b9db930544b26 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:25.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f683e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.99:3301/0 2024-09-13T18:35:25.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f683e7fc700 1 -- 172.21.15.44:0/2328973572 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6854027ea0 con 0x1304d00 2024-09-13T18:35:25.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f683e7fc700 1 -- 172.21.15.44:0/2328973572 <== mon.2 v2:172.21.15.99:3301/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f685401c040 con 0x1304d00 2024-09-13T18:35:25.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f6868c33740 1 -- 172.21.15.44:0/2328973572 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f685006b070 con 0x1304d00 2024-09-13T18:35:25.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f683e7fc700 1 -- 172.21.15.44:0/2328973572 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6854027870 con 0x1304d00 2024-09-13T18:35:25.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f6868c33740 10 client.6509 fetch_fsmap learned FSMap version 62 2024-09-13T18:35:25.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f6868c33740 1 -- 172.21.15.44:0/2328973572 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x11e7720 con 0x1304d00 2024-09-13T18:35:25.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f683e7fc700 1 -- 172.21.15.44:0/2328973572 <== mon.2 v2:172.21.15.99:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685006b070 con 0x1304d00 2024-09-13T18:35:25.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f683e7fc700 1 -- 172.21.15.44:0/2328973572 <== mon.2 v2:172.21.15.99:3301/0 5 ==== fsmap(e 62) v1 ==== 3118+0+0 (secure 0 0 0) 0x7f6854023460 con 0x1304d00 2024-09-13T18:35:25.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f6868c33740 10 client.6509 fetch_fsmap finished waiting for FSMap version 62 2024-09-13T18:35:25.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f6868c33740 10 client.6509 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:35:25.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f6868c33740 20 client.6509 populate_metadata read hostname 'smithi044' 2024-09-13T18:35:25.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f6868c33740 1 --2- 172.21.15.44:0/2328973572 >> [v2:172.21.15.99:6836/1121392581,v1:172.21.15.99:6837/1121392581] conn(0x1329d90 0x132a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f6868c33740 4 client.6509 mds_command: new command op to 7093 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:35:25.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f6868c33740 1 -- 172.21.15.44:0/2328973572 --> [v2:172.21.15.99:6836/1121392581,v1:172.21.15.99:6837/1121392581] -- command(tid 0: {"prefix": "status"}) v1 -- 0x10ea1e0 con 0x1329d90 2024-09-13T18:35:25.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f685e7fc700 1 --2- 172.21.15.44:0/2328973572 >> [v2:172.21.15.99:6836/1121392581,v1:172.21.15.99:6837/1121392581] conn(0x1329d90 0x132a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f685e7fc700 1 --2- 172.21.15.44:0/2328973572 >> [v2:172.21.15.99:6836/1121392581,v1:172.21.15.99:6837/1121392581] conn(0x1329d90 0x132a170 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19a662d20eaa62aa server_cookie=1c2fc9a69a011dd7 in_seq=0 out_seq=0 2024-09-13T18:35:25.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f683e7fc700 10 client.6509 ms_handle_connect on v2:172.21.15.99:6836/1121392581 2024-09-13T18:35:25.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f683e7fc700 1 -- 172.21.15.44:0/2328973572 <== mds.0 v2:172.21.15.99:6836/1121392581 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x10ea1e0 con 0x1329d90 2024-09-13T18:35:25.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f683e7fc700 10 client.6509 handle_command_reply: tid=0 2024-09-13T18:35:25.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f6868c33740 1 client.6509 shutdown 2024-09-13T18:35:25.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f6868c33740 1 -- 172.21.15.44:0/2328973572 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1304d00 msgr2=0x1344640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:25.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f6868c33740 1 --2- 172.21.15.44:0/2328973572 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1304d00 0x1344640 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x12dfe70 tx=0x7f6854000ed0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f6868c33740 1 -- 172.21.15.44:0/2328973572 shutdown_connections 2024-09-13T18:35:25.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f6868c33740 1 --2- 172.21.15.44:0/2328973572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x1336460 0x1387a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f6868c33740 1 --2- 172.21.15.44:0/2328973572 >> [v2:172.21.15.99:6836/1121392581,v1:172.21.15.99:6837/1121392581] conn(0x1329d90 0x132a170 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f6868c33740 1 --2- 172.21.15.44:0/2328973572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x13266c0 0x132b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f6868c33740 1 --2- 172.21.15.44:0/2328973572 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x1304d00 0x1344640 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f683e7fc700 0 client.6509 ms_handle_reset on v2:172.21.15.99:6836/1121392581 2024-09-13T18:35:25.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.052+0000 7f6868c33740 1 -- 172.21.15.44:0/2328973572 >> 172.21.15.44:0/2328973572 conn(0x106e4d0 msgr2=0x132eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:25.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.056+0000 7f6868c33740 1 -- 172.21.15.44:0/2328973572 shutdown_connections 2024-09-13T18:35:25.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.056+0000 7f6868c33740 1 -- 172.21.15.44:0/2328973572 wait complete. 2024-09-13T18:35:25.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.056+0000 7f6868c33740 20 client.6509 trim_cache size 0 max 16384 2024-09-13T18:35:25.065 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:35:25.065 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "c8e1d12d-7fb9-4a33-982e-b895bb77262c", 2024-09-13T18:35:25.065 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-13T18:35:25.065 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 7093, 2024-09-13T18:35:25.065 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-13T18:35:25.065 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-13T18:35:25.066 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-13T18:35:25.066 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 3.7659835369999999, 2024-09-13T18:35:25.066 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 62, 2024-09-13T18:35:25.066 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 66, 2024-09-13T18:35:25.066 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 66, 2024-09-13T18:35:25.066 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 5.7400919459999997 2024-09-13T18:35:25.066 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:35:25.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.056+0000 7f6865980700 1 -- 172.21.15.44:0/2171987002 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f684c066730 msgr2=0x7f684c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:25.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.056+0000 7f6865980700 1 --2- 172.21.15.44:0/2171987002 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f684c066730 0x7f684c068bf0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6854000f60 tx=0x7f6854009040 comp rx=0 tx=0).stop 2024-09-13T18:35:25.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.056+0000 7f6865980700 1 -- 172.21.15.44:0/2171987002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68601461e0 msgr2=0x7f6860158f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:25.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.056+0000 7f6865980700 1 --2- 172.21.15.44:0/2171987002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68601461e0 0x7f6860158f10 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f685000e870 tx=0x7f685000eb80 comp rx=0 tx=0).stop 2024-09-13T18:35:25.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.056+0000 7f6865980700 1 -- 172.21.15.44:0/2171987002 shutdown_connections 2024-09-13T18:35:25.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.056+0000 7f6865980700 1 --2- 172.21.15.44:0/2171987002 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f684c066730 0x7f684c068bf0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.056+0000 7f6865980700 1 --2- 172.21.15.44:0/2171987002 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f68601465c0 0x7f6860071310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.056+0000 7f6865980700 1 --2- 172.21.15.44:0/2171987002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68601461e0 0x7f6860158f10 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.056+0000 7f6865980700 1 --2- 172.21.15.44:0/2171987002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6860144600 0x7f686015a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.056+0000 7f6865980700 1 -- 172.21.15.44:0/2171987002 >> 172.21.15.44:0/2171987002 conn(0x7f68600af620 msgr2=0x7f68600b2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:25.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.056+0000 7f6865980700 1 -- 172.21.15.44:0/2171987002 shutdown_connections 2024-09-13T18:35:25.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.056+0000 7f6865980700 1 -- 172.21.15.44:0/2171987002 wait complete. 2024-09-13T18:35:25.080 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:35:25.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.196+0000 7f4428fa3700 1 Processor -- start 2024-09-13T18:35:25.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4428fa3700 1 -- start start 2024-09-13T18:35:25.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4428fa3700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4424071350 0x7f4424159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4428fa3700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f44240ae010 0x7f442415a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4428fa3700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f442415aa10 con 0x7f44240adc30 2024-09-13T18:35:25.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4428fa3700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44240cd6c0 con 0x7f44240ae010 2024-09-13T18:35:25.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4428fa3700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f442415acc0 con 0x7f4424071350 2024-09-13T18:35:25.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4423fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f44240ae010 0x7f442415a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4423fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f44240ae010 0x7f442415a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52590/0 (socket says 172.21.15.44:52590) 2024-09-13T18:35:25.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f44237fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f44240adc30 0x7f4424070c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47658/0 (socket says 172.21.15.44:47658) 2024-09-13T18:35:25.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4423fff700 1 -- 172.21.15.44:0/3677646690 learned_addr learned my addr 172.21.15.44:0/3677646690 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:25.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f441bfff700 1 --2- 172.21.15.44:0/3677646690 >> v2:172.21.15.99:3300/0 conn(0x7f4424071350 0x7f4424159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4423fff700 1 -- 172.21.15.44:0/3677646690 >> v2:172.21.15.99:3300/0 conn(0x7f4424071350 msgr2=0x7f4424159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:25.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4423fff700 1 --2- 172.21.15.44:0/3677646690 >> v2:172.21.15.99:3300/0 conn(0x7f4424071350 0x7f4424159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4423fff700 1 -- 172.21.15.44:0/3677646690 >> v1:172.21.15.44:6789/0 conn(0x7f44240adc30 legacy=0x7f4424070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:25.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4423fff700 1 -- 172.21.15.44:0/3677646690 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44240cb3a0 con 0x7f44240ae010 2024-09-13T18:35:25.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4423fff700 1 --2- 172.21.15.44:0/3677646690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44240ae010 0x7f442415a4d0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f441c009e50 tx=0x7f441c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f24353447d87b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:25.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4422ffd700 1 -- 172.21.15.44:0/3677646690 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c00e070 con 0x7f44240ae010 2024-09-13T18:35:25.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4422ffd700 1 -- 172.21.15.44:0/3677646690 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441c00b980 con 0x7f44240ae010 2024-09-13T18:35:25.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4422ffd700 1 -- 172.21.15.44:0/3677646690 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c00bd30 con 0x7f44240ae010 2024-09-13T18:35:25.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4428fa3700 1 -- 172.21.15.44:0/3677646690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44240ae010 msgr2=0x7f442415a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:25.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4428fa3700 1 --2- 172.21.15.44:0/3677646690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44240ae010 0x7f442415a4d0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f441c009e50 tx=0x7f441c00b330 comp rx=0 tx=0).stop 2024-09-13T18:35:25.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4428fa3700 1 -- 172.21.15.44:0/3677646690 shutdown_connections 2024-09-13T18:35:25.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4428fa3700 1 --2- 172.21.15.44:0/3677646690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44240ae010 0x7f442415a4d0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4428fa3700 1 --2- 172.21.15.44:0/3677646690 >> v2:172.21.15.99:3300/0 conn(0x7f4424071350 0x7f4424159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4428fa3700 1 -- 172.21.15.44:0/3677646690 >> 172.21.15.44:0/3677646690 conn(0x7f44240b0f00 msgr2=0x7f44240b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:25.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4428fa3700 1 -- 172.21.15.44:0/3677646690 shutdown_connections 2024-09-13T18:35:25.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.200+0000 7f4428fa3700 1 -- 172.21.15.44:0/3677646690 wait complete. 2024-09-13T18:35:25.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.204+0000 7f4428fa3700 1 Processor -- start 2024-09-13T18:35:25.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.204+0000 7f4428fa3700 1 -- start start 2024-09-13T18:35:25.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.204+0000 7f4428fa3700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4424071350 0x7f44241f0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.204+0000 7f4428fa3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44240adc30 0x7f4424148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.204+0000 7f4428fa3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44240ae010 0x7f442406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.204+0000 7f4428fa3700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442414c620 con 0x7f44240adc30 2024-09-13T18:35:25.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.204+0000 7f4428fa3700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442414baa0 con 0x7f4424071350 2024-09-13T18:35:25.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.204+0000 7f4428fa3700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442414bd80 con 0x7f44240ae010 2024-09-13T18:35:25.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.204+0000 7f441bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44240adc30 0x7f4424148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.204+0000 7f441bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44240adc30 0x7f4424148db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52604/0 (socket says 172.21.15.44:52604) 2024-09-13T18:35:25.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.204+0000 7f441bfff700 1 -- 172.21.15.44:0/3900048182 learned_addr learned my addr 172.21.15.44:0/3900048182 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:25.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.204+0000 7f44237fe700 1 --2- 172.21.15.44:0/3900048182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4424071350 0x7f44241f0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.204+0000 7f4423fff700 1 --2- 172.21.15.44:0/3900048182 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44240ae010 0x7f442406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.204+0000 7f441bfff700 1 -- 172.21.15.44:0/3900048182 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44240ae010 msgr2=0x7f442406d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:25.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.204+0000 7f441bfff700 1 --2- 172.21.15.44:0/3900048182 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44240ae010 0x7f442406d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.204+0000 7f441bfff700 1 -- 172.21.15.44:0/3900048182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4424071350 msgr2=0x7f44241f0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:25.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.204+0000 7f441bfff700 1 --2- 172.21.15.44:0/3900048182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4424071350 0x7f44241f0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.204+0000 7f441bfff700 1 -- 172.21.15.44:0/3900048182 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c009b30 con 0x7f44240adc30 2024-09-13T18:35:25.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.204+0000 7f441bfff700 1 --2- 172.21.15.44:0/3900048182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44240adc30 0x7f4424148db0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f440c00e760 tx=0x7f440c00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:25.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.204+0000 7f4420ff9700 1 -- 172.21.15.44:0/3900048182 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c00c070 con 0x7f44240adc30 2024-09-13T18:35:25.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.208+0000 7f4420ff9700 1 -- 172.21.15.44:0/3900048182 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440c013610 con 0x7f44240adc30 2024-09-13T18:35:25.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.208+0000 7f4428fa3700 1 -- 172.21.15.44:0/3900048182 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f442414c060 con 0x7f44240adc30 2024-09-13T18:35:25.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.208+0000 7f4420ff9700 1 -- 172.21.15.44:0/3900048182 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c013980 con 0x7f44240adc30 2024-09-13T18:35:25.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.208+0000 7f4428fa3700 1 -- 172.21.15.44:0/3900048182 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44241f12d0 con 0x7f44240adc30 2024-09-13T18:35:25.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.208+0000 7f4428fa3700 1 -- 172.21.15.44:0/3900048182 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4424070c40 con 0x7f44240adc30 2024-09-13T18:35:25.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.208+0000 7f4420ff9700 1 -- 172.21.15.44:0/3900048182 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f440c013ae0 con 0x7f44240adc30 2024-09-13T18:35:25.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.208+0000 7f4420ff9700 1 --2- 172.21.15.44:0/3900048182 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4404066730 0x7f4404068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.208+0000 7f4420ff9700 1 -- 172.21.15.44:0/3900048182 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f440c083c30 con 0x7f44240adc30 2024-09-13T18:35:25.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.208+0000 7f44237fe700 1 --2- 172.21.15.44:0/3900048182 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4404066730 0x7f4404068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.212+0000 7f44237fe700 1 --2- 172.21.15.44:0/3900048182 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4404066730 0x7f4404068bf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4414000f60 tx=0x7f4414007f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:25.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.216+0000 7f4420ff9700 1 -- 172.21.15.44:0/3900048182 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f440c050f30 con 0x7f44240adc30 2024-09-13T18:35:25.288 INFO:tasks.ceph.mds.d.smithi099.stderr:2024-09-13T18:35:25.283+0000 7f7e06d1e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:35:25.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.424+0000 7f4428fa3700 1 -- 172.21.15.44:0/3900048182 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f44240b25e0 con 0x7f44240adc30 2024-09-13T18:35:25.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.424+0000 7f4420ff9700 1 -- 172.21.15.44:0/3900048182 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) v1 ==== 53+0+73 (secure 0 0 0) 0x7f440c054550 con 0x7f44240adc30 2024-09-13T18:35:25.430 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:35:25.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.428+0000 7f4428fa3700 1 -- 172.21.15.44:0/3900048182 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4404066730 msgr2=0x7f4404068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:25.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.428+0000 7f4428fa3700 1 --2- 172.21.15.44:0/3900048182 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4404066730 0x7f4404068bf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4414000f60 tx=0x7f4414007f30 comp rx=0 tx=0).stop 2024-09-13T18:35:25.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.428+0000 7f4428fa3700 1 -- 172.21.15.44:0/3900048182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44240adc30 msgr2=0x7f4424148db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:25.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.428+0000 7f4428fa3700 1 --2- 172.21.15.44:0/3900048182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44240adc30 0x7f4424148db0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f440c00e760 tx=0x7f440c00ea70 comp rx=0 tx=0).stop 2024-09-13T18:35:25.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.428+0000 7f4428fa3700 1 -- 172.21.15.44:0/3900048182 shutdown_connections 2024-09-13T18:35:25.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.428+0000 7f4428fa3700 1 --2- 172.21.15.44:0/3900048182 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4404066730 0x7f4404068bf0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.428+0000 7f4428fa3700 1 --2- 172.21.15.44:0/3900048182 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44240ae010 0x7f442406d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.428+0000 7f4428fa3700 1 --2- 172.21.15.44:0/3900048182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44240adc30 0x7f4424148db0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.428+0000 7f4428fa3700 1 --2- 172.21.15.44:0/3900048182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4424071350 0x7f44241f0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.428+0000 7f4428fa3700 1 -- 172.21.15.44:0/3900048182 >> 172.21.15.44:0/3900048182 conn(0x7f44240b0f00 msgr2=0x7f44240b2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:25.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.428+0000 7f4428fa3700 1 -- 172.21.15.44:0/3900048182 shutdown_connections 2024-09-13T18:35:25.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:25.428+0000 7f4428fa3700 1 -- 172.21.15.44:0/3900048182 wait complete. 2024-09-13T18:35:25.452 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:35:25.452 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:35:25.452 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-13T18:35:25.452 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:35:25.452 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:35:25.452 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:35:25.452 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:35:25.452 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:35:25.452 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:35:25.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:25.453 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-13T18:35:25.459 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:35:25.459 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:35:25.459 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:35:25.459 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:35:25.459 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-13T18:35:25.459 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:35:25.459 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:35:25.459 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-13T18:35:25.460 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:35:25.460 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:35:25.460 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:35:25.460 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:35:25.460 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:35:25.460 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42098sec preferred_lft 42098sec 2024-09-13T18:35:25.460 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-13T18:35:25.460 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:35:25.460 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:35:25.460 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:35:25.460 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:35:25.460 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:80:b2:e4:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:35:25.460 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:35:25.461 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:35:25.461 INFO:teuthology.orchestra.run.smithi044.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:35:25.461 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 2e:69:eb:1c:57:57 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:35:25.461 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:35:25.461 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:35:25.461 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::8842:91ff:feed:2c53/64 scope link 2024-09-13T18:35:25.461 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:35:25.461 INFO:teuthology.orchestra.run.smithi044.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state DOWN group default qlen 1000 2024-09-13T18:35:25.461 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 2e:69:eb:1c:57:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:35:25.461 INFO:teuthology.orchestra.run.smithi044.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:35:25.461 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 86:e5:07:ac:f1:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:35:25.461 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::84e5:7ff:feac:f11b/64 scope link 2024-09-13T18:35:25.461 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:35:25.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:25.462 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:35:25.515 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-13T18:35:25.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:25.517 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-13T18:35:25.524 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-13T18:35:25.524 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:35:25.524 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:35:25.524 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:35:25.524 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:35:25.524 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:35:25.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:25.525 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2024-09-13T18:35:25.525 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-13T18:35:25.525 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:35:25.525 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:35:25.525 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:35:25.525 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-13T18:35:25.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:25.562 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-13T18:35:25.569 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:35:25.570 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:35:25.570 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:35:25.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:25.571 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-13T18:35:25.584 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:35:25.584 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:35:25.584 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:35:25.591 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:35:25.591 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:35:25.591 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:35:25.639 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:35:25.654 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:35:25.654 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:35:25.670 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:35:25.671 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:35:25.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:25.672 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:35:25.679 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:35:25.679 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:35:25.723 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:35:25.739 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:35:25.739 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:35:25.748 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:35:25.749 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:35:25.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:25.749 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:35:26.166 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2024-09-13T18:35:26.160+0000 7f39658ef640 -1 init, newargv = 0x5588ec6a4900 newargc=15 2024-09-13T18:35:26.166 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[44943]: starting ceph client 2024-09-13T18:35:26.176 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[44943]: starting fuse 2024-09-13T18:35:26.900 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:35:26.920 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:35:26.920 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:35:26.936 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:35:26.937 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:35:26.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:26.937 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:35:26.987 INFO:teuthology.orchestra.run.smithi044.stdout:52 2024-09-13T18:35:26.987 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T18:35:26.987 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:35:26.987 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2024-09-13T18:35:26.987 DEBUG:teuthology.orchestra.run.smithi044:> import re 2024-09-13T18:35:26.988 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:35:26.988 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2024-09-13T18:35:26.988 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:35:26.988 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2024-09-13T18:35:26.988 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:35:26.988 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2024-09-13T18:35:26.988 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:35:26.988 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:35:26.988 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2024-09-13T18:35:26.988 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2024-09-13T18:35:26.988 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2024-09-13T18:35:26.988 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2024-09-13T18:35:26.988 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:35:26.988 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2024-09-13T18:35:26.989 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:35:26.989 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:35:26.989 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:35:26.989 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2024-09-13T18:35:26.989 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2024-09-13T18:35:26.989 DEBUG:teuthology.orchestra.run.smithi044:> return f 2024-09-13T18:35:26.989 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:35:26.989 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:35:26.989 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.0")) 2024-09-13T18:35:26.989 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:35:27.076 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.0.44943.asok 2024-09-13T18:35:27.260 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44943.asok 2024-09-13T18:35:27.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:27.260 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44943.asok status 2024-09-13T18:35:27.366 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:35:27.366 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2024-09-13T18:35:27.366 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:35:27.366 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:35:27.366 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "0", 2024-09-13T18:35:27.366 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2024-09-13T18:35:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:35:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "44943", 2024-09-13T18:35:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2024-09-13T18:35:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2024-09-13T18:35:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2024-09-13T18:35:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 7437, 2024-09-13T18:35:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2024-09-13T18:35:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2024-09-13T18:35:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2024-09-13T18:35:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 7437 2024-09-13T18:35:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:35:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-13T18:35:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:35:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 1935858480 2024-09-13T18:35:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:35:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-13T18:35:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:35:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 1935858480 2024-09-13T18:35:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.7437 192.168.0.1:0/1935858480", 2024-09-13T18:35:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/1935858480", 2024-09-13T18:35:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2024-09-13T18:35:27.368 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 62, 2024-09-13T18:35:27.369 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 66, 2024-09-13T18:35:27.369 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:35:27.369 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2024-09-13T18:35:27.369 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2024-09-13T18:35:27.369 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:35:27.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:27.376 DEBUG:teuthology.orchestra.run.smithi044:> stat --file-system '--printf=%T 2024-09-13T18:35:27.376 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:35:27.382 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2024-09-13T18:35:27.383 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:35:27.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:27.383 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:35:27.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:27.400 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R) 2024-09-13T18:35:27.530 INFO:teuthology.orchestra.run.smithi044.stdout:.: 2024-09-13T18:35:27.531 INFO:teuthology.orchestra.run.smithi044.stdout:alpha 2024-09-13T18:35:27.531 INFO:teuthology.orchestra.run.smithi044.stdout:bravo 2024-09-13T18:35:27.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:27.531 INFO:teuthology.orchestra.run.smithi044.stdout:./alpha: 2024-09-13T18:35:27.531 INFO:teuthology.orchestra.run.smithi044.stdout:file 2024-09-13T18:35:27.531 INFO:teuthology.orchestra.run.smithi044.stdout:file_0 2024-09-13T18:35:27.531 INFO:teuthology.orchestra.run.smithi044.stdout:file_1 2024-09-13T18:35:27.531 INFO:teuthology.orchestra.run.smithi044.stdout:file_10 2024-09-13T18:35:27.531 INFO:teuthology.orchestra.run.smithi044.stdout:file_100 2024-09-13T18:35:27.531 INFO:teuthology.orchestra.run.smithi044.stdout:file_101 2024-09-13T18:35:27.532 INFO:teuthology.orchestra.run.smithi044.stdout:file_102 2024-09-13T18:35:27.532 INFO:teuthology.orchestra.run.smithi044.stdout:file_103 2024-09-13T18:35:27.532 INFO:teuthology.orchestra.run.smithi044.stdout:file_104 2024-09-13T18:35:27.532 INFO:teuthology.orchestra.run.smithi044.stdout:file_105 2024-09-13T18:35:27.532 INFO:teuthology.orchestra.run.smithi044.stdout:file_106 2024-09-13T18:35:27.532 INFO:teuthology.orchestra.run.smithi044.stdout:file_107 2024-09-13T18:35:27.532 INFO:teuthology.orchestra.run.smithi044.stdout:file_108 2024-09-13T18:35:27.532 INFO:teuthology.orchestra.run.smithi044.stdout:file_109 2024-09-13T18:35:27.532 INFO:teuthology.orchestra.run.smithi044.stdout:file_11 2024-09-13T18:35:27.532 INFO:teuthology.orchestra.run.smithi044.stdout:file_110 2024-09-13T18:35:27.532 INFO:teuthology.orchestra.run.smithi044.stdout:file_111 2024-09-13T18:35:27.532 INFO:teuthology.orchestra.run.smithi044.stdout:file_112 2024-09-13T18:35:27.532 INFO:teuthology.orchestra.run.smithi044.stdout:file_113 2024-09-13T18:35:27.533 INFO:teuthology.orchestra.run.smithi044.stdout:file_114 2024-09-13T18:35:27.533 INFO:teuthology.orchestra.run.smithi044.stdout:file_115 2024-09-13T18:35:27.533 INFO:teuthology.orchestra.run.smithi044.stdout:file_116 2024-09-13T18:35:27.533 INFO:teuthology.orchestra.run.smithi044.stdout:file_117 2024-09-13T18:35:27.533 INFO:teuthology.orchestra.run.smithi044.stdout:file_118 2024-09-13T18:35:27.533 INFO:teuthology.orchestra.run.smithi044.stdout:file_119 2024-09-13T18:35:27.533 INFO:teuthology.orchestra.run.smithi044.stdout:file_12 2024-09-13T18:35:27.533 INFO:teuthology.orchestra.run.smithi044.stdout:file_120 2024-09-13T18:35:27.533 INFO:teuthology.orchestra.run.smithi044.stdout:file_121 2024-09-13T18:35:27.533 INFO:teuthology.orchestra.run.smithi044.stdout:file_122 2024-09-13T18:35:27.533 INFO:teuthology.orchestra.run.smithi044.stdout:file_123 2024-09-13T18:35:27.533 INFO:teuthology.orchestra.run.smithi044.stdout:file_124 2024-09-13T18:35:27.533 INFO:teuthology.orchestra.run.smithi044.stdout:file_125 2024-09-13T18:35:27.533 INFO:teuthology.orchestra.run.smithi044.stdout:file_126 2024-09-13T18:35:27.534 INFO:teuthology.orchestra.run.smithi044.stdout:file_127 2024-09-13T18:35:27.534 INFO:teuthology.orchestra.run.smithi044.stdout:file_128 2024-09-13T18:35:27.534 INFO:teuthology.orchestra.run.smithi044.stdout:file_129 2024-09-13T18:35:27.534 INFO:teuthology.orchestra.run.smithi044.stdout:file_13 2024-09-13T18:35:27.534 INFO:teuthology.orchestra.run.smithi044.stdout:file_130 2024-09-13T18:35:27.534 INFO:teuthology.orchestra.run.smithi044.stdout:file_131 2024-09-13T18:35:27.534 INFO:teuthology.orchestra.run.smithi044.stdout:file_132 2024-09-13T18:35:27.534 INFO:teuthology.orchestra.run.smithi044.stdout:file_133 2024-09-13T18:35:27.534 INFO:teuthology.orchestra.run.smithi044.stdout:file_134 2024-09-13T18:35:27.534 INFO:teuthology.orchestra.run.smithi044.stdout:file_135 2024-09-13T18:35:27.534 INFO:teuthology.orchestra.run.smithi044.stdout:file_136 2024-09-13T18:35:27.534 INFO:teuthology.orchestra.run.smithi044.stdout:file_137 2024-09-13T18:35:27.534 INFO:teuthology.orchestra.run.smithi044.stdout:file_138 2024-09-13T18:35:27.535 INFO:teuthology.orchestra.run.smithi044.stdout:file_139 2024-09-13T18:35:27.535 INFO:teuthology.orchestra.run.smithi044.stdout:file_14 2024-09-13T18:35:27.535 INFO:teuthology.orchestra.run.smithi044.stdout:file_140 2024-09-13T18:35:27.535 INFO:teuthology.orchestra.run.smithi044.stdout:file_141 2024-09-13T18:35:27.535 INFO:teuthology.orchestra.run.smithi044.stdout:file_142 2024-09-13T18:35:27.535 INFO:teuthology.orchestra.run.smithi044.stdout:file_143 2024-09-13T18:35:27.535 INFO:teuthology.orchestra.run.smithi044.stdout:file_144 2024-09-13T18:35:27.535 INFO:teuthology.orchestra.run.smithi044.stdout:file_145 2024-09-13T18:35:27.535 INFO:teuthology.orchestra.run.smithi044.stdout:file_146 2024-09-13T18:35:27.535 INFO:teuthology.orchestra.run.smithi044.stdout:file_147 2024-09-13T18:35:27.535 INFO:teuthology.orchestra.run.smithi044.stdout:file_148 2024-09-13T18:35:27.535 INFO:teuthology.orchestra.run.smithi044.stdout:file_149 2024-09-13T18:35:27.535 INFO:teuthology.orchestra.run.smithi044.stdout:file_15 2024-09-13T18:35:27.535 INFO:teuthology.orchestra.run.smithi044.stdout:file_150 2024-09-13T18:35:27.536 INFO:teuthology.orchestra.run.smithi044.stdout:file_151 2024-09-13T18:35:27.536 INFO:teuthology.orchestra.run.smithi044.stdout:file_152 2024-09-13T18:35:27.536 INFO:teuthology.orchestra.run.smithi044.stdout:file_153 2024-09-13T18:35:27.536 INFO:teuthology.orchestra.run.smithi044.stdout:file_154 2024-09-13T18:35:27.536 INFO:teuthology.orchestra.run.smithi044.stdout:file_155 2024-09-13T18:35:27.536 INFO:teuthology.orchestra.run.smithi044.stdout:file_156 2024-09-13T18:35:27.536 INFO:teuthology.orchestra.run.smithi044.stdout:file_157 2024-09-13T18:35:27.536 INFO:teuthology.orchestra.run.smithi044.stdout:file_158 2024-09-13T18:35:27.536 INFO:teuthology.orchestra.run.smithi044.stdout:file_159 2024-09-13T18:35:27.536 INFO:teuthology.orchestra.run.smithi044.stdout:file_16 2024-09-13T18:35:27.536 INFO:teuthology.orchestra.run.smithi044.stdout:file_160 2024-09-13T18:35:27.536 INFO:teuthology.orchestra.run.smithi044.stdout:file_161 2024-09-13T18:35:27.536 INFO:teuthology.orchestra.run.smithi044.stdout:file_162 2024-09-13T18:35:27.537 INFO:teuthology.orchestra.run.smithi044.stdout:file_163 2024-09-13T18:35:27.537 INFO:teuthology.orchestra.run.smithi044.stdout:file_164 2024-09-13T18:35:27.537 INFO:teuthology.orchestra.run.smithi044.stdout:file_165 2024-09-13T18:35:27.537 INFO:teuthology.orchestra.run.smithi044.stdout:file_166 2024-09-13T18:35:27.537 INFO:teuthology.orchestra.run.smithi044.stdout:file_167 2024-09-13T18:35:27.537 INFO:teuthology.orchestra.run.smithi044.stdout:file_168 2024-09-13T18:35:27.537 INFO:teuthology.orchestra.run.smithi044.stdout:file_169 2024-09-13T18:35:27.537 INFO:teuthology.orchestra.run.smithi044.stdout:file_17 2024-09-13T18:35:27.537 INFO:teuthology.orchestra.run.smithi044.stdout:file_170 2024-09-13T18:35:27.537 INFO:teuthology.orchestra.run.smithi044.stdout:file_171 2024-09-13T18:35:27.537 INFO:teuthology.orchestra.run.smithi044.stdout:file_172 2024-09-13T18:35:27.537 INFO:teuthology.orchestra.run.smithi044.stdout:file_173 2024-09-13T18:35:27.537 INFO:teuthology.orchestra.run.smithi044.stdout:file_174 2024-09-13T18:35:27.537 INFO:teuthology.orchestra.run.smithi044.stdout:file_175 2024-09-13T18:35:27.538 INFO:teuthology.orchestra.run.smithi044.stdout:file_176 2024-09-13T18:35:27.538 INFO:teuthology.orchestra.run.smithi044.stdout:file_177 2024-09-13T18:35:27.538 INFO:teuthology.orchestra.run.smithi044.stdout:file_178 2024-09-13T18:35:27.538 INFO:teuthology.orchestra.run.smithi044.stdout:file_179 2024-09-13T18:35:27.538 INFO:teuthology.orchestra.run.smithi044.stdout:file_18 2024-09-13T18:35:27.538 INFO:teuthology.orchestra.run.smithi044.stdout:file_180 2024-09-13T18:35:27.538 INFO:teuthology.orchestra.run.smithi044.stdout:file_181 2024-09-13T18:35:27.538 INFO:teuthology.orchestra.run.smithi044.stdout:file_182 2024-09-13T18:35:27.538 INFO:teuthology.orchestra.run.smithi044.stdout:file_183 2024-09-13T18:35:27.538 INFO:teuthology.orchestra.run.smithi044.stdout:file_184 2024-09-13T18:35:27.538 INFO:teuthology.orchestra.run.smithi044.stdout:file_185 2024-09-13T18:35:27.538 INFO:teuthology.orchestra.run.smithi044.stdout:file_186 2024-09-13T18:35:27.538 INFO:teuthology.orchestra.run.smithi044.stdout:file_187 2024-09-13T18:35:27.539 INFO:teuthology.orchestra.run.smithi044.stdout:file_188 2024-09-13T18:35:27.539 INFO:teuthology.orchestra.run.smithi044.stdout:file_189 2024-09-13T18:35:27.539 INFO:teuthology.orchestra.run.smithi044.stdout:file_19 2024-09-13T18:35:27.539 INFO:teuthology.orchestra.run.smithi044.stdout:file_190 2024-09-13T18:35:27.539 INFO:teuthology.orchestra.run.smithi044.stdout:file_191 2024-09-13T18:35:27.539 INFO:teuthology.orchestra.run.smithi044.stdout:file_192 2024-09-13T18:35:27.539 INFO:teuthology.orchestra.run.smithi044.stdout:file_193 2024-09-13T18:35:27.539 INFO:teuthology.orchestra.run.smithi044.stdout:file_194 2024-09-13T18:35:27.539 INFO:teuthology.orchestra.run.smithi044.stdout:file_195 2024-09-13T18:35:27.539 INFO:teuthology.orchestra.run.smithi044.stdout:file_196 2024-09-13T18:35:27.539 INFO:teuthology.orchestra.run.smithi044.stdout:file_197 2024-09-13T18:35:27.539 INFO:teuthology.orchestra.run.smithi044.stdout:file_198 2024-09-13T18:35:27.539 INFO:teuthology.orchestra.run.smithi044.stdout:file_199 2024-09-13T18:35:27.539 INFO:teuthology.orchestra.run.smithi044.stdout:file_2 2024-09-13T18:35:27.540 INFO:teuthology.orchestra.run.smithi044.stdout:file_20 2024-09-13T18:35:27.540 INFO:teuthology.orchestra.run.smithi044.stdout:file_200 2024-09-13T18:35:27.540 INFO:teuthology.orchestra.run.smithi044.stdout:file_201 2024-09-13T18:35:27.540 INFO:teuthology.orchestra.run.smithi044.stdout:file_202 2024-09-13T18:35:27.540 INFO:teuthology.orchestra.run.smithi044.stdout:file_203 2024-09-13T18:35:27.540 INFO:teuthology.orchestra.run.smithi044.stdout:file_204 2024-09-13T18:35:27.540 INFO:teuthology.orchestra.run.smithi044.stdout:file_205 2024-09-13T18:35:27.540 INFO:teuthology.orchestra.run.smithi044.stdout:file_206 2024-09-13T18:35:27.540 INFO:teuthology.orchestra.run.smithi044.stdout:file_207 2024-09-13T18:35:27.540 INFO:teuthology.orchestra.run.smithi044.stdout:file_208 2024-09-13T18:35:27.540 INFO:teuthology.orchestra.run.smithi044.stdout:file_209 2024-09-13T18:35:27.540 INFO:teuthology.orchestra.run.smithi044.stdout:file_21 2024-09-13T18:35:27.540 INFO:teuthology.orchestra.run.smithi044.stdout:file_210 2024-09-13T18:35:27.541 INFO:teuthology.orchestra.run.smithi044.stdout:file_211 2024-09-13T18:35:27.541 INFO:teuthology.orchestra.run.smithi044.stdout:file_212 2024-09-13T18:35:27.541 INFO:teuthology.orchestra.run.smithi044.stdout:file_213 2024-09-13T18:35:27.541 INFO:teuthology.orchestra.run.smithi044.stdout:file_214 2024-09-13T18:35:27.541 INFO:teuthology.orchestra.run.smithi044.stdout:file_215 2024-09-13T18:35:27.541 INFO:teuthology.orchestra.run.smithi044.stdout:file_216 2024-09-13T18:35:27.541 INFO:teuthology.orchestra.run.smithi044.stdout:file_217 2024-09-13T18:35:27.541 INFO:teuthology.orchestra.run.smithi044.stdout:file_218 2024-09-13T18:35:27.541 INFO:teuthology.orchestra.run.smithi044.stdout:file_219 2024-09-13T18:35:27.541 INFO:teuthology.orchestra.run.smithi044.stdout:file_22 2024-09-13T18:35:27.541 INFO:teuthology.orchestra.run.smithi044.stdout:file_220 2024-09-13T18:35:27.541 INFO:teuthology.orchestra.run.smithi044.stdout:file_221 2024-09-13T18:35:27.542 INFO:teuthology.orchestra.run.smithi044.stdout:file_222 2024-09-13T18:35:27.542 INFO:teuthology.orchestra.run.smithi044.stdout:file_223 2024-09-13T18:35:27.542 INFO:teuthology.orchestra.run.smithi044.stdout:file_224 2024-09-13T18:35:27.542 INFO:teuthology.orchestra.run.smithi044.stdout:file_225 2024-09-13T18:35:27.542 INFO:teuthology.orchestra.run.smithi044.stdout:file_226 2024-09-13T18:35:27.542 INFO:teuthology.orchestra.run.smithi044.stdout:file_227 2024-09-13T18:35:27.542 INFO:teuthology.orchestra.run.smithi044.stdout:file_228 2024-09-13T18:35:27.542 INFO:teuthology.orchestra.run.smithi044.stdout:file_229 2024-09-13T18:35:27.542 INFO:teuthology.orchestra.run.smithi044.stdout:file_23 2024-09-13T18:35:27.542 INFO:teuthology.orchestra.run.smithi044.stdout:file_230 2024-09-13T18:35:27.542 INFO:teuthology.orchestra.run.smithi044.stdout:file_231 2024-09-13T18:35:27.542 INFO:teuthology.orchestra.run.smithi044.stdout:file_232 2024-09-13T18:35:27.542 INFO:teuthology.orchestra.run.smithi044.stdout:file_233 2024-09-13T18:35:27.542 INFO:teuthology.orchestra.run.smithi044.stdout:file_234 2024-09-13T18:35:27.543 INFO:teuthology.orchestra.run.smithi044.stdout:file_235 2024-09-13T18:35:27.543 INFO:teuthology.orchestra.run.smithi044.stdout:file_236 2024-09-13T18:35:27.543 INFO:teuthology.orchestra.run.smithi044.stdout:file_237 2024-09-13T18:35:27.543 INFO:teuthology.orchestra.run.smithi044.stdout:file_238 2024-09-13T18:35:27.543 INFO:teuthology.orchestra.run.smithi044.stdout:file_239 2024-09-13T18:35:27.543 INFO:teuthology.orchestra.run.smithi044.stdout:file_24 2024-09-13T18:35:27.543 INFO:teuthology.orchestra.run.smithi044.stdout:file_240 2024-09-13T18:35:27.543 INFO:teuthology.orchestra.run.smithi044.stdout:file_241 2024-09-13T18:35:27.543 INFO:teuthology.orchestra.run.smithi044.stdout:file_242 2024-09-13T18:35:27.543 INFO:teuthology.orchestra.run.smithi044.stdout:file_243 2024-09-13T18:35:27.543 INFO:teuthology.orchestra.run.smithi044.stdout:file_244 2024-09-13T18:35:27.543 INFO:teuthology.orchestra.run.smithi044.stdout:file_245 2024-09-13T18:35:27.543 INFO:teuthology.orchestra.run.smithi044.stdout:file_246 2024-09-13T18:35:27.543 INFO:teuthology.orchestra.run.smithi044.stdout:file_247 2024-09-13T18:35:27.544 INFO:teuthology.orchestra.run.smithi044.stdout:file_248 2024-09-13T18:35:27.544 INFO:teuthology.orchestra.run.smithi044.stdout:file_249 2024-09-13T18:35:27.544 INFO:teuthology.orchestra.run.smithi044.stdout:file_25 2024-09-13T18:35:27.544 INFO:teuthology.orchestra.run.smithi044.stdout:file_250 2024-09-13T18:35:27.544 INFO:teuthology.orchestra.run.smithi044.stdout:file_251 2024-09-13T18:35:27.544 INFO:teuthology.orchestra.run.smithi044.stdout:file_252 2024-09-13T18:35:27.544 INFO:teuthology.orchestra.run.smithi044.stdout:file_253 2024-09-13T18:35:27.544 INFO:teuthology.orchestra.run.smithi044.stdout:file_254 2024-09-13T18:35:27.544 INFO:teuthology.orchestra.run.smithi044.stdout:file_255 2024-09-13T18:35:27.544 INFO:teuthology.orchestra.run.smithi044.stdout:file_256 2024-09-13T18:35:27.544 INFO:teuthology.orchestra.run.smithi044.stdout:file_257 2024-09-13T18:35:27.544 INFO:teuthology.orchestra.run.smithi044.stdout:file_258 2024-09-13T18:35:27.544 INFO:teuthology.orchestra.run.smithi044.stdout:file_259 2024-09-13T18:35:27.545 INFO:teuthology.orchestra.run.smithi044.stdout:file_26 2024-09-13T18:35:27.545 INFO:teuthology.orchestra.run.smithi044.stdout:file_260 2024-09-13T18:35:27.545 INFO:teuthology.orchestra.run.smithi044.stdout:file_261 2024-09-13T18:35:27.545 INFO:teuthology.orchestra.run.smithi044.stdout:file_262 2024-09-13T18:35:27.545 INFO:teuthology.orchestra.run.smithi044.stdout:file_263 2024-09-13T18:35:27.545 INFO:teuthology.orchestra.run.smithi044.stdout:file_264 2024-09-13T18:35:27.545 INFO:teuthology.orchestra.run.smithi044.stdout:file_265 2024-09-13T18:35:27.545 INFO:teuthology.orchestra.run.smithi044.stdout:file_266 2024-09-13T18:35:27.545 INFO:teuthology.orchestra.run.smithi044.stdout:file_267 2024-09-13T18:35:27.545 INFO:teuthology.orchestra.run.smithi044.stdout:file_268 2024-09-13T18:35:27.545 INFO:teuthology.orchestra.run.smithi044.stdout:file_269 2024-09-13T18:35:27.545 INFO:teuthology.orchestra.run.smithi044.stdout:file_27 2024-09-13T18:35:27.545 INFO:teuthology.orchestra.run.smithi044.stdout:file_270 2024-09-13T18:35:27.545 INFO:teuthology.orchestra.run.smithi044.stdout:file_271 2024-09-13T18:35:27.545 INFO:teuthology.orchestra.run.smithi044.stdout:file_272 2024-09-13T18:35:27.546 INFO:teuthology.orchestra.run.smithi044.stdout:file_273 2024-09-13T18:35:27.546 INFO:teuthology.orchestra.run.smithi044.stdout:file_274 2024-09-13T18:35:27.546 INFO:teuthology.orchestra.run.smithi044.stdout:file_275 2024-09-13T18:35:27.546 INFO:teuthology.orchestra.run.smithi044.stdout:file_276 2024-09-13T18:35:27.546 INFO:teuthology.orchestra.run.smithi044.stdout:file_277 2024-09-13T18:35:27.546 INFO:teuthology.orchestra.run.smithi044.stdout:file_278 2024-09-13T18:35:27.546 INFO:teuthology.orchestra.run.smithi044.stdout:file_279 2024-09-13T18:35:27.546 INFO:teuthology.orchestra.run.smithi044.stdout:file_28 2024-09-13T18:35:27.546 INFO:teuthology.orchestra.run.smithi044.stdout:file_280 2024-09-13T18:35:27.546 INFO:teuthology.orchestra.run.smithi044.stdout:file_281 2024-09-13T18:35:27.546 INFO:teuthology.orchestra.run.smithi044.stdout:file_282 2024-09-13T18:35:27.546 INFO:teuthology.orchestra.run.smithi044.stdout:file_283 2024-09-13T18:35:27.546 INFO:teuthology.orchestra.run.smithi044.stdout:file_284 2024-09-13T18:35:27.547 INFO:teuthology.orchestra.run.smithi044.stdout:file_285 2024-09-13T18:35:27.547 INFO:teuthology.orchestra.run.smithi044.stdout:file_286 2024-09-13T18:35:27.547 INFO:teuthology.orchestra.run.smithi044.stdout:file_287 2024-09-13T18:35:27.547 INFO:teuthology.orchestra.run.smithi044.stdout:file_288 2024-09-13T18:35:27.547 INFO:teuthology.orchestra.run.smithi044.stdout:file_289 2024-09-13T18:35:27.547 INFO:teuthology.orchestra.run.smithi044.stdout:file_29 2024-09-13T18:35:27.547 INFO:teuthology.orchestra.run.smithi044.stdout:file_290 2024-09-13T18:35:27.547 INFO:teuthology.orchestra.run.smithi044.stdout:file_291 2024-09-13T18:35:27.547 INFO:teuthology.orchestra.run.smithi044.stdout:file_292 2024-09-13T18:35:27.547 INFO:teuthology.orchestra.run.smithi044.stdout:file_293 2024-09-13T18:35:27.547 INFO:teuthology.orchestra.run.smithi044.stdout:file_294 2024-09-13T18:35:27.548 INFO:teuthology.orchestra.run.smithi044.stdout:file_295 2024-09-13T18:35:27.548 INFO:teuthology.orchestra.run.smithi044.stdout:file_296 2024-09-13T18:35:27.548 INFO:teuthology.orchestra.run.smithi044.stdout:file_297 2024-09-13T18:35:27.548 INFO:teuthology.orchestra.run.smithi044.stdout:file_298 2024-09-13T18:35:27.548 INFO:teuthology.orchestra.run.smithi044.stdout:file_299 2024-09-13T18:35:27.548 INFO:teuthology.orchestra.run.smithi044.stdout:file_3 2024-09-13T18:35:27.548 INFO:teuthology.orchestra.run.smithi044.stdout:file_30 2024-09-13T18:35:27.548 INFO:teuthology.orchestra.run.smithi044.stdout:file_300 2024-09-13T18:35:27.548 INFO:teuthology.orchestra.run.smithi044.stdout:file_301 2024-09-13T18:35:27.548 INFO:teuthology.orchestra.run.smithi044.stdout:file_302 2024-09-13T18:35:27.548 INFO:teuthology.orchestra.run.smithi044.stdout:file_303 2024-09-13T18:35:27.548 INFO:teuthology.orchestra.run.smithi044.stdout:file_304 2024-09-13T18:35:27.548 INFO:teuthology.orchestra.run.smithi044.stdout:file_305 2024-09-13T18:35:27.549 INFO:teuthology.orchestra.run.smithi044.stdout:file_306 2024-09-13T18:35:27.549 INFO:teuthology.orchestra.run.smithi044.stdout:file_307 2024-09-13T18:35:27.549 INFO:teuthology.orchestra.run.smithi044.stdout:file_308 2024-09-13T18:35:27.549 INFO:teuthology.orchestra.run.smithi044.stdout:file_309 2024-09-13T18:35:27.549 INFO:teuthology.orchestra.run.smithi044.stdout:file_31 2024-09-13T18:35:27.549 INFO:teuthology.orchestra.run.smithi044.stdout:file_310 2024-09-13T18:35:27.549 INFO:teuthology.orchestra.run.smithi044.stdout:file_311 2024-09-13T18:35:27.549 INFO:teuthology.orchestra.run.smithi044.stdout:file_312 2024-09-13T18:35:27.549 INFO:teuthology.orchestra.run.smithi044.stdout:file_313 2024-09-13T18:35:27.549 INFO:teuthology.orchestra.run.smithi044.stdout:file_314 2024-09-13T18:35:27.549 INFO:teuthology.orchestra.run.smithi044.stdout:file_315 2024-09-13T18:35:27.549 INFO:teuthology.orchestra.run.smithi044.stdout:file_316 2024-09-13T18:35:27.549 INFO:teuthology.orchestra.run.smithi044.stdout:file_317 2024-09-13T18:35:27.549 INFO:teuthology.orchestra.run.smithi044.stdout:file_318 2024-09-13T18:35:27.550 INFO:teuthology.orchestra.run.smithi044.stdout:file_319 2024-09-13T18:35:27.550 INFO:teuthology.orchestra.run.smithi044.stdout:file_32 2024-09-13T18:35:27.550 INFO:teuthology.orchestra.run.smithi044.stdout:file_320 2024-09-13T18:35:27.550 INFO:teuthology.orchestra.run.smithi044.stdout:file_321 2024-09-13T18:35:27.550 INFO:teuthology.orchestra.run.smithi044.stdout:file_322 2024-09-13T18:35:27.550 INFO:teuthology.orchestra.run.smithi044.stdout:file_323 2024-09-13T18:35:27.550 INFO:teuthology.orchestra.run.smithi044.stdout:file_324 2024-09-13T18:35:27.550 INFO:teuthology.orchestra.run.smithi044.stdout:file_325 2024-09-13T18:35:27.550 INFO:teuthology.orchestra.run.smithi044.stdout:file_326 2024-09-13T18:35:27.550 INFO:teuthology.orchestra.run.smithi044.stdout:file_327 2024-09-13T18:35:27.550 INFO:teuthology.orchestra.run.smithi044.stdout:file_328 2024-09-13T18:35:27.550 INFO:teuthology.orchestra.run.smithi044.stdout:file_329 2024-09-13T18:35:27.550 INFO:teuthology.orchestra.run.smithi044.stdout:file_33 2024-09-13T18:35:27.551 INFO:teuthology.orchestra.run.smithi044.stdout:file_330 2024-09-13T18:35:27.551 INFO:teuthology.orchestra.run.smithi044.stdout:file_331 2024-09-13T18:35:27.551 INFO:teuthology.orchestra.run.smithi044.stdout:file_332 2024-09-13T18:35:27.551 INFO:teuthology.orchestra.run.smithi044.stdout:file_333 2024-09-13T18:35:27.551 INFO:teuthology.orchestra.run.smithi044.stdout:file_334 2024-09-13T18:35:27.551 INFO:teuthology.orchestra.run.smithi044.stdout:file_335 2024-09-13T18:35:27.551 INFO:teuthology.orchestra.run.smithi044.stdout:file_336 2024-09-13T18:35:27.551 INFO:teuthology.orchestra.run.smithi044.stdout:file_337 2024-09-13T18:35:27.551 INFO:teuthology.orchestra.run.smithi044.stdout:file_338 2024-09-13T18:35:27.551 INFO:teuthology.orchestra.run.smithi044.stdout:file_339 2024-09-13T18:35:27.551 INFO:teuthology.orchestra.run.smithi044.stdout:file_34 2024-09-13T18:35:27.551 INFO:teuthology.orchestra.run.smithi044.stdout:file_340 2024-09-13T18:35:27.551 INFO:teuthology.orchestra.run.smithi044.stdout:file_341 2024-09-13T18:35:27.551 INFO:teuthology.orchestra.run.smithi044.stdout:file_342 2024-09-13T18:35:27.552 INFO:teuthology.orchestra.run.smithi044.stdout:file_343 2024-09-13T18:35:27.552 INFO:teuthology.orchestra.run.smithi044.stdout:file_344 2024-09-13T18:35:27.552 INFO:teuthology.orchestra.run.smithi044.stdout:file_345 2024-09-13T18:35:27.552 INFO:teuthology.orchestra.run.smithi044.stdout:file_346 2024-09-13T18:35:27.552 INFO:teuthology.orchestra.run.smithi044.stdout:file_347 2024-09-13T18:35:27.552 INFO:teuthology.orchestra.run.smithi044.stdout:file_348 2024-09-13T18:35:27.552 INFO:teuthology.orchestra.run.smithi044.stdout:file_349 2024-09-13T18:35:27.552 INFO:teuthology.orchestra.run.smithi044.stdout:file_35 2024-09-13T18:35:27.552 INFO:teuthology.orchestra.run.smithi044.stdout:file_350 2024-09-13T18:35:27.552 INFO:teuthology.orchestra.run.smithi044.stdout:file_351 2024-09-13T18:35:27.552 INFO:teuthology.orchestra.run.smithi044.stdout:file_352 2024-09-13T18:35:27.552 INFO:teuthology.orchestra.run.smithi044.stdout:file_353 2024-09-13T18:35:27.552 INFO:teuthology.orchestra.run.smithi044.stdout:file_354 2024-09-13T18:35:27.553 INFO:teuthology.orchestra.run.smithi044.stdout:file_355 2024-09-13T18:35:27.553 INFO:teuthology.orchestra.run.smithi044.stdout:file_356 2024-09-13T18:35:27.553 INFO:teuthology.orchestra.run.smithi044.stdout:file_357 2024-09-13T18:35:27.553 INFO:teuthology.orchestra.run.smithi044.stdout:file_358 2024-09-13T18:35:27.553 INFO:teuthology.orchestra.run.smithi044.stdout:file_359 2024-09-13T18:35:27.553 INFO:teuthology.orchestra.run.smithi044.stdout:file_36 2024-09-13T18:35:27.553 INFO:teuthology.orchestra.run.smithi044.stdout:file_360 2024-09-13T18:35:27.553 INFO:teuthology.orchestra.run.smithi044.stdout:file_361 2024-09-13T18:35:27.553 INFO:teuthology.orchestra.run.smithi044.stdout:file_362 2024-09-13T18:35:27.553 INFO:teuthology.orchestra.run.smithi044.stdout:file_363 2024-09-13T18:35:27.553 INFO:teuthology.orchestra.run.smithi044.stdout:file_364 2024-09-13T18:35:27.553 INFO:teuthology.orchestra.run.smithi044.stdout:file_365 2024-09-13T18:35:27.553 INFO:teuthology.orchestra.run.smithi044.stdout:file_366 2024-09-13T18:35:27.553 INFO:teuthology.orchestra.run.smithi044.stdout:file_367 2024-09-13T18:35:27.553 INFO:teuthology.orchestra.run.smithi044.stdout:file_368 2024-09-13T18:35:27.554 INFO:teuthology.orchestra.run.smithi044.stdout:file_369 2024-09-13T18:35:27.554 INFO:teuthology.orchestra.run.smithi044.stdout:file_37 2024-09-13T18:35:27.554 INFO:teuthology.orchestra.run.smithi044.stdout:file_370 2024-09-13T18:35:27.554 INFO:teuthology.orchestra.run.smithi044.stdout:file_371 2024-09-13T18:35:27.554 INFO:teuthology.orchestra.run.smithi044.stdout:file_372 2024-09-13T18:35:27.554 INFO:teuthology.orchestra.run.smithi044.stdout:file_373 2024-09-13T18:35:27.554 INFO:teuthology.orchestra.run.smithi044.stdout:file_374 2024-09-13T18:35:27.554 INFO:teuthology.orchestra.run.smithi044.stdout:file_375 2024-09-13T18:35:27.554 INFO:teuthology.orchestra.run.smithi044.stdout:file_376 2024-09-13T18:35:27.554 INFO:teuthology.orchestra.run.smithi044.stdout:file_377 2024-09-13T18:35:27.554 INFO:teuthology.orchestra.run.smithi044.stdout:file_378 2024-09-13T18:35:27.554 INFO:teuthology.orchestra.run.smithi044.stdout:file_379 2024-09-13T18:35:27.554 INFO:teuthology.orchestra.run.smithi044.stdout:file_38 2024-09-13T18:35:27.554 INFO:teuthology.orchestra.run.smithi044.stdout:file_380 2024-09-13T18:35:27.555 INFO:teuthology.orchestra.run.smithi044.stdout:file_381 2024-09-13T18:35:27.555 INFO:teuthology.orchestra.run.smithi044.stdout:file_382 2024-09-13T18:35:27.555 INFO:teuthology.orchestra.run.smithi044.stdout:file_383 2024-09-13T18:35:27.555 INFO:teuthology.orchestra.run.smithi044.stdout:file_384 2024-09-13T18:35:27.555 INFO:teuthology.orchestra.run.smithi044.stdout:file_385 2024-09-13T18:35:27.555 INFO:teuthology.orchestra.run.smithi044.stdout:file_386 2024-09-13T18:35:27.555 INFO:teuthology.orchestra.run.smithi044.stdout:file_387 2024-09-13T18:35:27.555 INFO:teuthology.orchestra.run.smithi044.stdout:file_388 2024-09-13T18:35:27.555 INFO:teuthology.orchestra.run.smithi044.stdout:file_389 2024-09-13T18:35:27.555 INFO:teuthology.orchestra.run.smithi044.stdout:file_39 2024-09-13T18:35:27.555 INFO:teuthology.orchestra.run.smithi044.stdout:file_390 2024-09-13T18:35:27.555 INFO:teuthology.orchestra.run.smithi044.stdout:file_391 2024-09-13T18:35:27.555 INFO:teuthology.orchestra.run.smithi044.stdout:file_392 2024-09-13T18:35:27.555 INFO:teuthology.orchestra.run.smithi044.stdout:file_393 2024-09-13T18:35:27.556 INFO:teuthology.orchestra.run.smithi044.stdout:file_394 2024-09-13T18:35:27.556 INFO:teuthology.orchestra.run.smithi044.stdout:file_395 2024-09-13T18:35:27.556 INFO:teuthology.orchestra.run.smithi044.stdout:file_396 2024-09-13T18:35:27.556 INFO:teuthology.orchestra.run.smithi044.stdout:file_397 2024-09-13T18:35:27.556 INFO:teuthology.orchestra.run.smithi044.stdout:file_398 2024-09-13T18:35:27.556 INFO:teuthology.orchestra.run.smithi044.stdout:file_399 2024-09-13T18:35:27.556 INFO:teuthology.orchestra.run.smithi044.stdout:file_4 2024-09-13T18:35:27.556 INFO:teuthology.orchestra.run.smithi044.stdout:file_40 2024-09-13T18:35:27.556 INFO:teuthology.orchestra.run.smithi044.stdout:file_400 2024-09-13T18:35:27.556 INFO:teuthology.orchestra.run.smithi044.stdout:file_401 2024-09-13T18:35:27.556 INFO:teuthology.orchestra.run.smithi044.stdout:file_402 2024-09-13T18:35:27.556 INFO:teuthology.orchestra.run.smithi044.stdout:file_403 2024-09-13T18:35:27.556 INFO:teuthology.orchestra.run.smithi044.stdout:file_404 2024-09-13T18:35:27.557 INFO:teuthology.orchestra.run.smithi044.stdout:file_405 2024-09-13T18:35:27.557 INFO:teuthology.orchestra.run.smithi044.stdout:file_406 2024-09-13T18:35:27.557 INFO:teuthology.orchestra.run.smithi044.stdout:file_407 2024-09-13T18:35:27.557 INFO:teuthology.orchestra.run.smithi044.stdout:file_408 2024-09-13T18:35:27.557 INFO:teuthology.orchestra.run.smithi044.stdout:file_409 2024-09-13T18:35:27.557 INFO:teuthology.orchestra.run.smithi044.stdout:file_41 2024-09-13T18:35:27.557 INFO:teuthology.orchestra.run.smithi044.stdout:file_410 2024-09-13T18:35:27.557 INFO:teuthology.orchestra.run.smithi044.stdout:file_411 2024-09-13T18:35:27.557 INFO:teuthology.orchestra.run.smithi044.stdout:file_412 2024-09-13T18:35:27.557 INFO:teuthology.orchestra.run.smithi044.stdout:file_413 2024-09-13T18:35:27.557 INFO:teuthology.orchestra.run.smithi044.stdout:file_414 2024-09-13T18:35:27.557 INFO:teuthology.orchestra.run.smithi044.stdout:file_415 2024-09-13T18:35:27.557 INFO:teuthology.orchestra.run.smithi044.stdout:file_416 2024-09-13T18:35:27.557 INFO:teuthology.orchestra.run.smithi044.stdout:file_417 2024-09-13T18:35:27.557 INFO:teuthology.orchestra.run.smithi044.stdout:file_418 2024-09-13T18:35:27.558 INFO:teuthology.orchestra.run.smithi044.stdout:file_419 2024-09-13T18:35:27.558 INFO:teuthology.orchestra.run.smithi044.stdout:file_42 2024-09-13T18:35:27.558 INFO:teuthology.orchestra.run.smithi044.stdout:file_420 2024-09-13T18:35:27.558 INFO:teuthology.orchestra.run.smithi044.stdout:file_421 2024-09-13T18:35:27.558 INFO:teuthology.orchestra.run.smithi044.stdout:file_422 2024-09-13T18:35:27.558 INFO:teuthology.orchestra.run.smithi044.stdout:file_423 2024-09-13T18:35:27.558 INFO:teuthology.orchestra.run.smithi044.stdout:file_424 2024-09-13T18:35:27.558 INFO:teuthology.orchestra.run.smithi044.stdout:file_425 2024-09-13T18:35:27.558 INFO:teuthology.orchestra.run.smithi044.stdout:file_426 2024-09-13T18:35:27.558 INFO:teuthology.orchestra.run.smithi044.stdout:file_427 2024-09-13T18:35:27.558 INFO:teuthology.orchestra.run.smithi044.stdout:file_428 2024-09-13T18:35:27.558 INFO:teuthology.orchestra.run.smithi044.stdout:file_429 2024-09-13T18:35:27.558 INFO:teuthology.orchestra.run.smithi044.stdout:file_43 2024-09-13T18:35:27.559 INFO:teuthology.orchestra.run.smithi044.stdout:file_430 2024-09-13T18:35:27.559 INFO:teuthology.orchestra.run.smithi044.stdout:file_431 2024-09-13T18:35:27.559 INFO:teuthology.orchestra.run.smithi044.stdout:file_432 2024-09-13T18:35:27.559 INFO:teuthology.orchestra.run.smithi044.stdout:file_433 2024-09-13T18:35:27.559 INFO:teuthology.orchestra.run.smithi044.stdout:file_434 2024-09-13T18:35:27.559 INFO:teuthology.orchestra.run.smithi044.stdout:file_435 2024-09-13T18:35:27.559 INFO:teuthology.orchestra.run.smithi044.stdout:file_436 2024-09-13T18:35:27.559 INFO:teuthology.orchestra.run.smithi044.stdout:file_437 2024-09-13T18:35:27.559 INFO:teuthology.orchestra.run.smithi044.stdout:file_438 2024-09-13T18:35:27.559 INFO:teuthology.orchestra.run.smithi044.stdout:file_439 2024-09-13T18:35:27.559 INFO:teuthology.orchestra.run.smithi044.stdout:file_44 2024-09-13T18:35:27.559 INFO:teuthology.orchestra.run.smithi044.stdout:file_440 2024-09-13T18:35:27.559 INFO:teuthology.orchestra.run.smithi044.stdout:file_441 2024-09-13T18:35:27.559 INFO:teuthology.orchestra.run.smithi044.stdout:file_442 2024-09-13T18:35:27.560 INFO:teuthology.orchestra.run.smithi044.stdout:file_443 2024-09-13T18:35:27.560 INFO:teuthology.orchestra.run.smithi044.stdout:file_444 2024-09-13T18:35:27.560 INFO:teuthology.orchestra.run.smithi044.stdout:file_445 2024-09-13T18:35:27.560 INFO:teuthology.orchestra.run.smithi044.stdout:file_446 2024-09-13T18:35:27.560 INFO:teuthology.orchestra.run.smithi044.stdout:file_447 2024-09-13T18:35:27.560 INFO:teuthology.orchestra.run.smithi044.stdout:file_448 2024-09-13T18:35:27.560 INFO:teuthology.orchestra.run.smithi044.stdout:file_449 2024-09-13T18:35:27.560 INFO:teuthology.orchestra.run.smithi044.stdout:file_45 2024-09-13T18:35:27.560 INFO:teuthology.orchestra.run.smithi044.stdout:file_450 2024-09-13T18:35:27.560 INFO:teuthology.orchestra.run.smithi044.stdout:file_451 2024-09-13T18:35:27.560 INFO:teuthology.orchestra.run.smithi044.stdout:file_452 2024-09-13T18:35:27.560 INFO:teuthology.orchestra.run.smithi044.stdout:file_453 2024-09-13T18:35:27.560 INFO:teuthology.orchestra.run.smithi044.stdout:file_454 2024-09-13T18:35:27.560 INFO:teuthology.orchestra.run.smithi044.stdout:file_455 2024-09-13T18:35:27.561 INFO:teuthology.orchestra.run.smithi044.stdout:file_456 2024-09-13T18:35:27.561 INFO:teuthology.orchestra.run.smithi044.stdout:file_457 2024-09-13T18:35:27.561 INFO:teuthology.orchestra.run.smithi044.stdout:file_458 2024-09-13T18:35:27.561 INFO:teuthology.orchestra.run.smithi044.stdout:file_459 2024-09-13T18:35:27.561 INFO:teuthology.orchestra.run.smithi044.stdout:file_46 2024-09-13T18:35:27.561 INFO:teuthology.orchestra.run.smithi044.stdout:file_460 2024-09-13T18:35:27.561 INFO:teuthology.orchestra.run.smithi044.stdout:file_461 2024-09-13T18:35:27.561 INFO:teuthology.orchestra.run.smithi044.stdout:file_462 2024-09-13T18:35:27.561 INFO:teuthology.orchestra.run.smithi044.stdout:file_463 2024-09-13T18:35:27.561 INFO:teuthology.orchestra.run.smithi044.stdout:file_464 2024-09-13T18:35:27.561 INFO:teuthology.orchestra.run.smithi044.stdout:file_465 2024-09-13T18:35:27.561 INFO:teuthology.orchestra.run.smithi044.stdout:file_466 2024-09-13T18:35:27.561 INFO:teuthology.orchestra.run.smithi044.stdout:file_467 2024-09-13T18:35:27.561 INFO:teuthology.orchestra.run.smithi044.stdout:file_468 2024-09-13T18:35:27.562 INFO:teuthology.orchestra.run.smithi044.stdout:file_469 2024-09-13T18:35:27.562 INFO:teuthology.orchestra.run.smithi044.stdout:file_47 2024-09-13T18:35:27.562 INFO:teuthology.orchestra.run.smithi044.stdout:file_470 2024-09-13T18:35:27.562 INFO:teuthology.orchestra.run.smithi044.stdout:file_471 2024-09-13T18:35:27.562 INFO:teuthology.orchestra.run.smithi044.stdout:file_472 2024-09-13T18:35:27.562 INFO:teuthology.orchestra.run.smithi044.stdout:file_473 2024-09-13T18:35:27.562 INFO:teuthology.orchestra.run.smithi044.stdout:file_474 2024-09-13T18:35:27.562 INFO:teuthology.orchestra.run.smithi044.stdout:file_475 2024-09-13T18:35:27.562 INFO:teuthology.orchestra.run.smithi044.stdout:file_476 2024-09-13T18:35:27.562 INFO:teuthology.orchestra.run.smithi044.stdout:file_477 2024-09-13T18:35:27.562 INFO:teuthology.orchestra.run.smithi044.stdout:file_478 2024-09-13T18:35:27.562 INFO:teuthology.orchestra.run.smithi044.stdout:file_479 2024-09-13T18:35:27.562 INFO:teuthology.orchestra.run.smithi044.stdout:file_48 2024-09-13T18:35:27.562 INFO:teuthology.orchestra.run.smithi044.stdout:file_480 2024-09-13T18:35:27.563 INFO:teuthology.orchestra.run.smithi044.stdout:file_481 2024-09-13T18:35:27.563 INFO:teuthology.orchestra.run.smithi044.stdout:file_482 2024-09-13T18:35:27.563 INFO:teuthology.orchestra.run.smithi044.stdout:file_483 2024-09-13T18:35:27.563 INFO:teuthology.orchestra.run.smithi044.stdout:file_484 2024-09-13T18:35:27.563 INFO:teuthology.orchestra.run.smithi044.stdout:file_485 2024-09-13T18:35:27.563 INFO:teuthology.orchestra.run.smithi044.stdout:file_486 2024-09-13T18:35:27.563 INFO:teuthology.orchestra.run.smithi044.stdout:file_487 2024-09-13T18:35:27.563 INFO:teuthology.orchestra.run.smithi044.stdout:file_488 2024-09-13T18:35:27.563 INFO:teuthology.orchestra.run.smithi044.stdout:file_489 2024-09-13T18:35:27.563 INFO:teuthology.orchestra.run.smithi044.stdout:file_49 2024-09-13T18:35:27.563 INFO:teuthology.orchestra.run.smithi044.stdout:file_490 2024-09-13T18:35:27.563 INFO:teuthology.orchestra.run.smithi044.stdout:file_491 2024-09-13T18:35:27.563 INFO:teuthology.orchestra.run.smithi044.stdout:file_492 2024-09-13T18:35:27.563 INFO:teuthology.orchestra.run.smithi044.stdout:file_493 2024-09-13T18:35:27.564 INFO:teuthology.orchestra.run.smithi044.stdout:file_494 2024-09-13T18:35:27.564 INFO:teuthology.orchestra.run.smithi044.stdout:file_495 2024-09-13T18:35:27.564 INFO:teuthology.orchestra.run.smithi044.stdout:file_496 2024-09-13T18:35:27.564 INFO:teuthology.orchestra.run.smithi044.stdout:file_497 2024-09-13T18:35:27.564 INFO:teuthology.orchestra.run.smithi044.stdout:file_498 2024-09-13T18:35:27.564 INFO:teuthology.orchestra.run.smithi044.stdout:file_499 2024-09-13T18:35:27.564 INFO:teuthology.orchestra.run.smithi044.stdout:file_5 2024-09-13T18:35:27.564 INFO:teuthology.orchestra.run.smithi044.stdout:file_50 2024-09-13T18:35:27.564 INFO:teuthology.orchestra.run.smithi044.stdout:file_500 2024-09-13T18:35:27.565 INFO:teuthology.orchestra.run.smithi044.stdout:file_501 2024-09-13T18:35:27.565 INFO:teuthology.orchestra.run.smithi044.stdout:file_502 2024-09-13T18:35:27.565 INFO:teuthology.orchestra.run.smithi044.stdout:file_503 2024-09-13T18:35:27.565 INFO:teuthology.orchestra.run.smithi044.stdout:file_504 2024-09-13T18:35:27.565 INFO:teuthology.orchestra.run.smithi044.stdout:file_505 2024-09-13T18:35:27.565 INFO:teuthology.orchestra.run.smithi044.stdout:file_506 2024-09-13T18:35:27.565 INFO:teuthology.orchestra.run.smithi044.stdout:file_507 2024-09-13T18:35:27.565 INFO:teuthology.orchestra.run.smithi044.stdout:file_508 2024-09-13T18:35:27.565 INFO:teuthology.orchestra.run.smithi044.stdout:file_509 2024-09-13T18:35:27.565 INFO:teuthology.orchestra.run.smithi044.stdout:file_51 2024-09-13T18:35:27.565 INFO:teuthology.orchestra.run.smithi044.stdout:file_510 2024-09-13T18:35:27.565 INFO:teuthology.orchestra.run.smithi044.stdout:file_511 2024-09-13T18:35:27.565 INFO:teuthology.orchestra.run.smithi044.stdout:file_512 2024-09-13T18:35:27.565 INFO:teuthology.orchestra.run.smithi044.stdout:file_513 2024-09-13T18:35:27.566 INFO:teuthology.orchestra.run.smithi044.stdout:file_514 2024-09-13T18:35:27.566 INFO:teuthology.orchestra.run.smithi044.stdout:file_515 2024-09-13T18:35:27.566 INFO:teuthology.orchestra.run.smithi044.stdout:file_516 2024-09-13T18:35:27.566 INFO:teuthology.orchestra.run.smithi044.stdout:file_517 2024-09-13T18:35:27.566 INFO:teuthology.orchestra.run.smithi044.stdout:file_518 2024-09-13T18:35:27.566 INFO:teuthology.orchestra.run.smithi044.stdout:file_519 2024-09-13T18:35:27.566 INFO:teuthology.orchestra.run.smithi044.stdout:file_52 2024-09-13T18:35:27.566 INFO:teuthology.orchestra.run.smithi044.stdout:file_520 2024-09-13T18:35:27.566 INFO:teuthology.orchestra.run.smithi044.stdout:file_521 2024-09-13T18:35:27.566 INFO:teuthology.orchestra.run.smithi044.stdout:file_522 2024-09-13T18:35:27.566 INFO:teuthology.orchestra.run.smithi044.stdout:file_523 2024-09-13T18:35:27.566 INFO:teuthology.orchestra.run.smithi044.stdout:file_524 2024-09-13T18:35:27.566 INFO:teuthology.orchestra.run.smithi044.stdout:file_525 2024-09-13T18:35:27.566 INFO:teuthology.orchestra.run.smithi044.stdout:file_526 2024-09-13T18:35:27.567 INFO:teuthology.orchestra.run.smithi044.stdout:file_527 2024-09-13T18:35:27.567 INFO:teuthology.orchestra.run.smithi044.stdout:file_528 2024-09-13T18:35:27.567 INFO:teuthology.orchestra.run.smithi044.stdout:file_529 2024-09-13T18:35:27.567 INFO:teuthology.orchestra.run.smithi044.stdout:file_53 2024-09-13T18:35:27.567 INFO:teuthology.orchestra.run.smithi044.stdout:file_530 2024-09-13T18:35:27.567 INFO:teuthology.orchestra.run.smithi044.stdout:file_531 2024-09-13T18:35:27.567 INFO:teuthology.orchestra.run.smithi044.stdout:file_532 2024-09-13T18:35:27.567 INFO:teuthology.orchestra.run.smithi044.stdout:file_533 2024-09-13T18:35:27.567 INFO:teuthology.orchestra.run.smithi044.stdout:file_534 2024-09-13T18:35:27.567 INFO:teuthology.orchestra.run.smithi044.stdout:file_535 2024-09-13T18:35:27.567 INFO:teuthology.orchestra.run.smithi044.stdout:file_536 2024-09-13T18:35:27.567 INFO:teuthology.orchestra.run.smithi044.stdout:file_537 2024-09-13T18:35:27.567 INFO:teuthology.orchestra.run.smithi044.stdout:file_538 2024-09-13T18:35:27.567 INFO:teuthology.orchestra.run.smithi044.stdout:file_539 2024-09-13T18:35:27.568 INFO:teuthology.orchestra.run.smithi044.stdout:file_54 2024-09-13T18:35:27.568 INFO:teuthology.orchestra.run.smithi044.stdout:file_540 2024-09-13T18:35:27.568 INFO:teuthology.orchestra.run.smithi044.stdout:file_541 2024-09-13T18:35:27.568 INFO:teuthology.orchestra.run.smithi044.stdout:file_542 2024-09-13T18:35:27.568 INFO:teuthology.orchestra.run.smithi044.stdout:file_543 2024-09-13T18:35:27.568 INFO:teuthology.orchestra.run.smithi044.stdout:file_544 2024-09-13T18:35:27.568 INFO:teuthology.orchestra.run.smithi044.stdout:file_545 2024-09-13T18:35:27.568 INFO:teuthology.orchestra.run.smithi044.stdout:file_546 2024-09-13T18:35:27.568 INFO:teuthology.orchestra.run.smithi044.stdout:file_547 2024-09-13T18:35:27.568 INFO:teuthology.orchestra.run.smithi044.stdout:file_548 2024-09-13T18:35:27.568 INFO:teuthology.orchestra.run.smithi044.stdout:file_549 2024-09-13T18:35:27.568 INFO:teuthology.orchestra.run.smithi044.stdout:file_55 2024-09-13T18:35:27.568 INFO:teuthology.orchestra.run.smithi044.stdout:file_550 2024-09-13T18:35:27.568 INFO:teuthology.orchestra.run.smithi044.stdout:file_551 2024-09-13T18:35:27.569 INFO:teuthology.orchestra.run.smithi044.stdout:file_552 2024-09-13T18:35:27.569 INFO:teuthology.orchestra.run.smithi044.stdout:file_553 2024-09-13T18:35:27.569 INFO:teuthology.orchestra.run.smithi044.stdout:file_554 2024-09-13T18:35:27.569 INFO:teuthology.orchestra.run.smithi044.stdout:file_555 2024-09-13T18:35:27.569 INFO:teuthology.orchestra.run.smithi044.stdout:file_556 2024-09-13T18:35:27.569 INFO:teuthology.orchestra.run.smithi044.stdout:file_557 2024-09-13T18:35:27.569 INFO:teuthology.orchestra.run.smithi044.stdout:file_558 2024-09-13T18:35:27.569 INFO:teuthology.orchestra.run.smithi044.stdout:file_559 2024-09-13T18:35:27.569 INFO:teuthology.orchestra.run.smithi044.stdout:file_56 2024-09-13T18:35:27.569 INFO:teuthology.orchestra.run.smithi044.stdout:file_560 2024-09-13T18:35:27.569 INFO:teuthology.orchestra.run.smithi044.stdout:file_561 2024-09-13T18:35:27.569 INFO:teuthology.orchestra.run.smithi044.stdout:file_562 2024-09-13T18:35:27.569 INFO:teuthology.orchestra.run.smithi044.stdout:file_563 2024-09-13T18:35:27.569 INFO:teuthology.orchestra.run.smithi044.stdout:file_564 2024-09-13T18:35:27.570 INFO:teuthology.orchestra.run.smithi044.stdout:file_565 2024-09-13T18:35:27.570 INFO:teuthology.orchestra.run.smithi044.stdout:file_566 2024-09-13T18:35:27.570 INFO:teuthology.orchestra.run.smithi044.stdout:file_567 2024-09-13T18:35:27.570 INFO:teuthology.orchestra.run.smithi044.stdout:file_568 2024-09-13T18:35:27.570 INFO:teuthology.orchestra.run.smithi044.stdout:file_569 2024-09-13T18:35:27.570 INFO:teuthology.orchestra.run.smithi044.stdout:file_57 2024-09-13T18:35:27.570 INFO:teuthology.orchestra.run.smithi044.stdout:file_570 2024-09-13T18:35:27.570 INFO:teuthology.orchestra.run.smithi044.stdout:file_571 2024-09-13T18:35:27.570 INFO:teuthology.orchestra.run.smithi044.stdout:file_572 2024-09-13T18:35:27.570 INFO:teuthology.orchestra.run.smithi044.stdout:file_573 2024-09-13T18:35:27.570 INFO:teuthology.orchestra.run.smithi044.stdout:file_574 2024-09-13T18:35:27.570 INFO:teuthology.orchestra.run.smithi044.stdout:file_575 2024-09-13T18:35:27.570 INFO:teuthology.orchestra.run.smithi044.stdout:file_576 2024-09-13T18:35:27.570 INFO:teuthology.orchestra.run.smithi044.stdout:file_577 2024-09-13T18:35:27.571 INFO:teuthology.orchestra.run.smithi044.stdout:file_578 2024-09-13T18:35:27.571 INFO:teuthology.orchestra.run.smithi044.stdout:file_579 2024-09-13T18:35:27.571 INFO:teuthology.orchestra.run.smithi044.stdout:file_58 2024-09-13T18:35:27.571 INFO:teuthology.orchestra.run.smithi044.stdout:file_580 2024-09-13T18:35:27.571 INFO:teuthology.orchestra.run.smithi044.stdout:file_581 2024-09-13T18:35:27.571 INFO:teuthology.orchestra.run.smithi044.stdout:file_582 2024-09-13T18:35:27.571 INFO:teuthology.orchestra.run.smithi044.stdout:file_583 2024-09-13T18:35:27.571 INFO:teuthology.orchestra.run.smithi044.stdout:file_584 2024-09-13T18:35:27.571 INFO:teuthology.orchestra.run.smithi044.stdout:file_585 2024-09-13T18:35:27.571 INFO:teuthology.orchestra.run.smithi044.stdout:file_586 2024-09-13T18:35:27.571 INFO:teuthology.orchestra.run.smithi044.stdout:file_587 2024-09-13T18:35:27.571 INFO:teuthology.orchestra.run.smithi044.stdout:file_588 2024-09-13T18:35:27.571 INFO:teuthology.orchestra.run.smithi044.stdout:file_589 2024-09-13T18:35:27.572 INFO:teuthology.orchestra.run.smithi044.stdout:file_59 2024-09-13T18:35:27.572 INFO:teuthology.orchestra.run.smithi044.stdout:file_590 2024-09-13T18:35:27.572 INFO:teuthology.orchestra.run.smithi044.stdout:file_591 2024-09-13T18:35:27.572 INFO:teuthology.orchestra.run.smithi044.stdout:file_592 2024-09-13T18:35:27.572 INFO:teuthology.orchestra.run.smithi044.stdout:file_593 2024-09-13T18:35:27.572 INFO:teuthology.orchestra.run.smithi044.stdout:file_594 2024-09-13T18:35:27.572 INFO:teuthology.orchestra.run.smithi044.stdout:file_595 2024-09-13T18:35:27.572 INFO:teuthology.orchestra.run.smithi044.stdout:file_596 2024-09-13T18:35:27.572 INFO:teuthology.orchestra.run.smithi044.stdout:file_597 2024-09-13T18:35:27.572 INFO:teuthology.orchestra.run.smithi044.stdout:file_598 2024-09-13T18:35:27.572 INFO:teuthology.orchestra.run.smithi044.stdout:file_599 2024-09-13T18:35:27.572 INFO:teuthology.orchestra.run.smithi044.stdout:file_6 2024-09-13T18:35:27.572 INFO:teuthology.orchestra.run.smithi044.stdout:file_60 2024-09-13T18:35:27.572 INFO:teuthology.orchestra.run.smithi044.stdout:file_600 2024-09-13T18:35:27.573 INFO:teuthology.orchestra.run.smithi044.stdout:file_601 2024-09-13T18:35:27.573 INFO:teuthology.orchestra.run.smithi044.stdout:file_602 2024-09-13T18:35:27.573 INFO:teuthology.orchestra.run.smithi044.stdout:file_603 2024-09-13T18:35:27.573 INFO:teuthology.orchestra.run.smithi044.stdout:file_604 2024-09-13T18:35:27.573 INFO:teuthology.orchestra.run.smithi044.stdout:file_605 2024-09-13T18:35:27.573 INFO:teuthology.orchestra.run.smithi044.stdout:file_606 2024-09-13T18:35:27.573 INFO:teuthology.orchestra.run.smithi044.stdout:file_607 2024-09-13T18:35:27.573 INFO:teuthology.orchestra.run.smithi044.stdout:file_608 2024-09-13T18:35:27.573 INFO:teuthology.orchestra.run.smithi044.stdout:file_609 2024-09-13T18:35:27.573 INFO:teuthology.orchestra.run.smithi044.stdout:file_61 2024-09-13T18:35:27.573 INFO:teuthology.orchestra.run.smithi044.stdout:file_610 2024-09-13T18:35:27.573 INFO:teuthology.orchestra.run.smithi044.stdout:file_611 2024-09-13T18:35:27.573 INFO:teuthology.orchestra.run.smithi044.stdout:file_612 2024-09-13T18:35:27.574 INFO:teuthology.orchestra.run.smithi044.stdout:file_613 2024-09-13T18:35:27.574 INFO:teuthology.orchestra.run.smithi044.stdout:file_614 2024-09-13T18:35:27.574 INFO:teuthology.orchestra.run.smithi044.stdout:file_615 2024-09-13T18:35:27.574 INFO:teuthology.orchestra.run.smithi044.stdout:file_616 2024-09-13T18:35:27.574 INFO:teuthology.orchestra.run.smithi044.stdout:file_617 2024-09-13T18:35:27.574 INFO:teuthology.orchestra.run.smithi044.stdout:file_618 2024-09-13T18:35:27.574 INFO:teuthology.orchestra.run.smithi044.stdout:file_619 2024-09-13T18:35:27.574 INFO:teuthology.orchestra.run.smithi044.stdout:file_62 2024-09-13T18:35:27.574 INFO:teuthology.orchestra.run.smithi044.stdout:file_620 2024-09-13T18:35:27.574 INFO:teuthology.orchestra.run.smithi044.stdout:file_621 2024-09-13T18:35:27.574 INFO:teuthology.orchestra.run.smithi044.stdout:file_622 2024-09-13T18:35:27.574 INFO:teuthology.orchestra.run.smithi044.stdout:file_623 2024-09-13T18:35:27.574 INFO:teuthology.orchestra.run.smithi044.stdout:file_624 2024-09-13T18:35:27.574 INFO:teuthology.orchestra.run.smithi044.stdout:file_625 2024-09-13T18:35:27.575 INFO:teuthology.orchestra.run.smithi044.stdout:file_626 2024-09-13T18:35:27.575 INFO:teuthology.orchestra.run.smithi044.stdout:file_627 2024-09-13T18:35:27.575 INFO:teuthology.orchestra.run.smithi044.stdout:file_628 2024-09-13T18:35:27.575 INFO:teuthology.orchestra.run.smithi044.stdout:file_629 2024-09-13T18:35:27.575 INFO:teuthology.orchestra.run.smithi044.stdout:file_63 2024-09-13T18:35:27.575 INFO:teuthology.orchestra.run.smithi044.stdout:file_630 2024-09-13T18:35:27.575 INFO:teuthology.orchestra.run.smithi044.stdout:file_631 2024-09-13T18:35:27.575 INFO:teuthology.orchestra.run.smithi044.stdout:file_632 2024-09-13T18:35:27.575 INFO:teuthology.orchestra.run.smithi044.stdout:file_633 2024-09-13T18:35:27.575 INFO:teuthology.orchestra.run.smithi044.stdout:file_634 2024-09-13T18:35:27.575 INFO:teuthology.orchestra.run.smithi044.stdout:file_635 2024-09-13T18:35:27.575 INFO:teuthology.orchestra.run.smithi044.stdout:file_636 2024-09-13T18:35:27.575 INFO:teuthology.orchestra.run.smithi044.stdout:file_637 2024-09-13T18:35:27.576 INFO:teuthology.orchestra.run.smithi044.stdout:file_638 2024-09-13T18:35:27.576 INFO:teuthology.orchestra.run.smithi044.stdout:file_639 2024-09-13T18:35:27.576 INFO:teuthology.orchestra.run.smithi044.stdout:file_64 2024-09-13T18:35:27.576 INFO:teuthology.orchestra.run.smithi044.stdout:file_640 2024-09-13T18:35:27.576 INFO:teuthology.orchestra.run.smithi044.stdout:file_641 2024-09-13T18:35:27.576 INFO:teuthology.orchestra.run.smithi044.stdout:file_642 2024-09-13T18:35:27.576 INFO:teuthology.orchestra.run.smithi044.stdout:file_643 2024-09-13T18:35:27.576 INFO:teuthology.orchestra.run.smithi044.stdout:file_644 2024-09-13T18:35:27.576 INFO:teuthology.orchestra.run.smithi044.stdout:file_645 2024-09-13T18:35:27.576 INFO:teuthology.orchestra.run.smithi044.stdout:file_646 2024-09-13T18:35:27.576 INFO:teuthology.orchestra.run.smithi044.stdout:file_647 2024-09-13T18:35:27.576 INFO:teuthology.orchestra.run.smithi044.stdout:file_648 2024-09-13T18:35:27.576 INFO:teuthology.orchestra.run.smithi044.stdout:file_649 2024-09-13T18:35:27.576 INFO:teuthology.orchestra.run.smithi044.stdout:file_65 2024-09-13T18:35:27.577 INFO:teuthology.orchestra.run.smithi044.stdout:file_650 2024-09-13T18:35:27.577 INFO:teuthology.orchestra.run.smithi044.stdout:file_651 2024-09-13T18:35:27.577 INFO:teuthology.orchestra.run.smithi044.stdout:file_652 2024-09-13T18:35:27.577 INFO:teuthology.orchestra.run.smithi044.stdout:file_653 2024-09-13T18:35:27.577 INFO:teuthology.orchestra.run.smithi044.stdout:file_654 2024-09-13T18:35:27.577 INFO:teuthology.orchestra.run.smithi044.stdout:file_655 2024-09-13T18:35:27.577 INFO:teuthology.orchestra.run.smithi044.stdout:file_656 2024-09-13T18:35:27.577 INFO:teuthology.orchestra.run.smithi044.stdout:file_657 2024-09-13T18:35:27.577 INFO:teuthology.orchestra.run.smithi044.stdout:file_658 2024-09-13T18:35:27.577 INFO:teuthology.orchestra.run.smithi044.stdout:file_659 2024-09-13T18:35:27.577 INFO:teuthology.orchestra.run.smithi044.stdout:file_66 2024-09-13T18:35:27.577 INFO:teuthology.orchestra.run.smithi044.stdout:file_660 2024-09-13T18:35:27.577 INFO:teuthology.orchestra.run.smithi044.stdout:file_661 2024-09-13T18:35:27.577 INFO:teuthology.orchestra.run.smithi044.stdout:file_662 2024-09-13T18:35:27.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_663 2024-09-13T18:35:27.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_664 2024-09-13T18:35:27.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_665 2024-09-13T18:35:27.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_666 2024-09-13T18:35:27.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_667 2024-09-13T18:35:27.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_668 2024-09-13T18:35:27.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_669 2024-09-13T18:35:27.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_67 2024-09-13T18:35:27.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_670 2024-09-13T18:35:27.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_671 2024-09-13T18:35:27.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_672 2024-09-13T18:35:27.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_673 2024-09-13T18:35:27.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_674 2024-09-13T18:35:27.578 INFO:teuthology.orchestra.run.smithi044.stdout:file_675 2024-09-13T18:35:27.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_676 2024-09-13T18:35:27.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_677 2024-09-13T18:35:27.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_678 2024-09-13T18:35:27.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_679 2024-09-13T18:35:27.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_68 2024-09-13T18:35:27.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_680 2024-09-13T18:35:27.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_681 2024-09-13T18:35:27.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_682 2024-09-13T18:35:27.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_683 2024-09-13T18:35:27.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_684 2024-09-13T18:35:27.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_685 2024-09-13T18:35:27.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_686 2024-09-13T18:35:27.579 INFO:teuthology.orchestra.run.smithi044.stdout:file_687 2024-09-13T18:35:27.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_688 2024-09-13T18:35:27.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_689 2024-09-13T18:35:27.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_69 2024-09-13T18:35:27.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_690 2024-09-13T18:35:27.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_691 2024-09-13T18:35:27.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_692 2024-09-13T18:35:27.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_693 2024-09-13T18:35:27.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_694 2024-09-13T18:35:27.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_695 2024-09-13T18:35:27.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_696 2024-09-13T18:35:27.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_697 2024-09-13T18:35:27.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_698 2024-09-13T18:35:27.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_699 2024-09-13T18:35:27.580 INFO:teuthology.orchestra.run.smithi044.stdout:file_7 2024-09-13T18:35:27.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_70 2024-09-13T18:35:27.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_700 2024-09-13T18:35:27.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_701 2024-09-13T18:35:27.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_702 2024-09-13T18:35:27.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_703 2024-09-13T18:35:27.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_704 2024-09-13T18:35:27.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_705 2024-09-13T18:35:27.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_706 2024-09-13T18:35:27.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_707 2024-09-13T18:35:27.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_708 2024-09-13T18:35:27.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_709 2024-09-13T18:35:27.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_71 2024-09-13T18:35:27.581 INFO:teuthology.orchestra.run.smithi044.stdout:file_710 2024-09-13T18:35:27.582 INFO:teuthology.orchestra.run.smithi044.stdout:file_711 2024-09-13T18:35:27.582 INFO:teuthology.orchestra.run.smithi044.stdout:file_712 2024-09-13T18:35:27.582 INFO:teuthology.orchestra.run.smithi044.stdout:file_713 2024-09-13T18:35:27.582 INFO:teuthology.orchestra.run.smithi044.stdout:file_714 2024-09-13T18:35:27.582 INFO:teuthology.orchestra.run.smithi044.stdout:file_715 2024-09-13T18:35:27.582 INFO:teuthology.orchestra.run.smithi044.stdout:file_716 2024-09-13T18:35:27.582 INFO:teuthology.orchestra.run.smithi044.stdout:file_717 2024-09-13T18:35:27.582 INFO:teuthology.orchestra.run.smithi044.stdout:file_718 2024-09-13T18:35:27.582 INFO:teuthology.orchestra.run.smithi044.stdout:file_719 2024-09-13T18:35:27.582 INFO:teuthology.orchestra.run.smithi044.stdout:file_72 2024-09-13T18:35:27.582 INFO:teuthology.orchestra.run.smithi044.stdout:file_720 2024-09-13T18:35:27.582 INFO:teuthology.orchestra.run.smithi044.stdout:file_721 2024-09-13T18:35:27.582 INFO:teuthology.orchestra.run.smithi044.stdout:file_722 2024-09-13T18:35:27.582 INFO:teuthology.orchestra.run.smithi044.stdout:file_723 2024-09-13T18:35:27.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_724 2024-09-13T18:35:27.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_725 2024-09-13T18:35:27.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_726 2024-09-13T18:35:27.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_727 2024-09-13T18:35:27.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_728 2024-09-13T18:35:27.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_729 2024-09-13T18:35:27.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_73 2024-09-13T18:35:27.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_730 2024-09-13T18:35:27.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_731 2024-09-13T18:35:27.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_732 2024-09-13T18:35:27.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_733 2024-09-13T18:35:27.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_734 2024-09-13T18:35:27.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_735 2024-09-13T18:35:27.583 INFO:teuthology.orchestra.run.smithi044.stdout:file_736 2024-09-13T18:35:27.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_737 2024-09-13T18:35:27.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_738 2024-09-13T18:35:27.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_739 2024-09-13T18:35:27.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_74 2024-09-13T18:35:27.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_740 2024-09-13T18:35:27.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_741 2024-09-13T18:35:27.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_742 2024-09-13T18:35:27.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_743 2024-09-13T18:35:27.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_744 2024-09-13T18:35:27.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_745 2024-09-13T18:35:27.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_746 2024-09-13T18:35:27.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_747 2024-09-13T18:35:27.584 INFO:teuthology.orchestra.run.smithi044.stdout:file_748 2024-09-13T18:35:27.585 INFO:teuthology.orchestra.run.smithi044.stdout:file_749 2024-09-13T18:35:27.585 INFO:teuthology.orchestra.run.smithi044.stdout:file_75 2024-09-13T18:35:27.585 INFO:teuthology.orchestra.run.smithi044.stdout:file_750 2024-09-13T18:35:27.585 INFO:teuthology.orchestra.run.smithi044.stdout:file_751 2024-09-13T18:35:27.585 INFO:teuthology.orchestra.run.smithi044.stdout:file_752 2024-09-13T18:35:27.585 INFO:teuthology.orchestra.run.smithi044.stdout:file_753 2024-09-13T18:35:27.585 INFO:teuthology.orchestra.run.smithi044.stdout:file_754 2024-09-13T18:35:27.585 INFO:teuthology.orchestra.run.smithi044.stdout:file_755 2024-09-13T18:35:27.585 INFO:teuthology.orchestra.run.smithi044.stdout:file_756 2024-09-13T18:35:27.585 INFO:teuthology.orchestra.run.smithi044.stdout:file_757 2024-09-13T18:35:27.585 INFO:teuthology.orchestra.run.smithi044.stdout:file_758 2024-09-13T18:35:27.585 INFO:teuthology.orchestra.run.smithi044.stdout:file_759 2024-09-13T18:35:27.585 INFO:teuthology.orchestra.run.smithi044.stdout:file_76 2024-09-13T18:35:27.586 INFO:teuthology.orchestra.run.smithi044.stdout:file_760 2024-09-13T18:35:27.586 INFO:teuthology.orchestra.run.smithi044.stdout:file_761 2024-09-13T18:35:27.586 INFO:teuthology.orchestra.run.smithi044.stdout:file_762 2024-09-13T18:35:27.586 INFO:teuthology.orchestra.run.smithi044.stdout:file_763 2024-09-13T18:35:27.586 INFO:teuthology.orchestra.run.smithi044.stdout:file_764 2024-09-13T18:35:27.586 INFO:teuthology.orchestra.run.smithi044.stdout:file_765 2024-09-13T18:35:27.586 INFO:teuthology.orchestra.run.smithi044.stdout:file_766 2024-09-13T18:35:27.586 INFO:teuthology.orchestra.run.smithi044.stdout:file_767 2024-09-13T18:35:27.586 INFO:teuthology.orchestra.run.smithi044.stdout:file_768 2024-09-13T18:35:27.586 INFO:teuthology.orchestra.run.smithi044.stdout:file_769 2024-09-13T18:35:27.586 INFO:teuthology.orchestra.run.smithi044.stdout:file_77 2024-09-13T18:35:27.586 INFO:teuthology.orchestra.run.smithi044.stdout:file_770 2024-09-13T18:35:27.586 INFO:teuthology.orchestra.run.smithi044.stdout:file_771 2024-09-13T18:35:27.587 INFO:teuthology.orchestra.run.smithi044.stdout:file_772 2024-09-13T18:35:27.587 INFO:teuthology.orchestra.run.smithi044.stdout:file_773 2024-09-13T18:35:27.587 INFO:teuthology.orchestra.run.smithi044.stdout:file_774 2024-09-13T18:35:27.587 INFO:teuthology.orchestra.run.smithi044.stdout:file_775 2024-09-13T18:35:27.587 INFO:teuthology.orchestra.run.smithi044.stdout:file_776 2024-09-13T18:35:27.587 INFO:teuthology.orchestra.run.smithi044.stdout:file_777 2024-09-13T18:35:27.587 INFO:teuthology.orchestra.run.smithi044.stdout:file_778 2024-09-13T18:35:27.587 INFO:teuthology.orchestra.run.smithi044.stdout:file_779 2024-09-13T18:35:27.587 INFO:teuthology.orchestra.run.smithi044.stdout:file_78 2024-09-13T18:35:27.587 INFO:teuthology.orchestra.run.smithi044.stdout:file_780 2024-09-13T18:35:27.587 INFO:teuthology.orchestra.run.smithi044.stdout:file_781 2024-09-13T18:35:27.587 INFO:teuthology.orchestra.run.smithi044.stdout:file_782 2024-09-13T18:35:27.587 INFO:teuthology.orchestra.run.smithi044.stdout:file_783 2024-09-13T18:35:27.588 INFO:teuthology.orchestra.run.smithi044.stdout:file_784 2024-09-13T18:35:27.588 INFO:teuthology.orchestra.run.smithi044.stdout:file_785 2024-09-13T18:35:27.588 INFO:teuthology.orchestra.run.smithi044.stdout:file_786 2024-09-13T18:35:27.588 INFO:teuthology.orchestra.run.smithi044.stdout:file_787 2024-09-13T18:35:27.588 INFO:teuthology.orchestra.run.smithi044.stdout:file_788 2024-09-13T18:35:27.588 INFO:teuthology.orchestra.run.smithi044.stdout:file_789 2024-09-13T18:35:27.588 INFO:teuthology.orchestra.run.smithi044.stdout:file_79 2024-09-13T18:35:27.588 INFO:teuthology.orchestra.run.smithi044.stdout:file_790 2024-09-13T18:35:27.588 INFO:teuthology.orchestra.run.smithi044.stdout:file_791 2024-09-13T18:35:27.588 INFO:teuthology.orchestra.run.smithi044.stdout:file_792 2024-09-13T18:35:27.588 INFO:teuthology.orchestra.run.smithi044.stdout:file_793 2024-09-13T18:35:27.588 INFO:teuthology.orchestra.run.smithi044.stdout:file_794 2024-09-13T18:35:27.588 INFO:teuthology.orchestra.run.smithi044.stdout:file_795 2024-09-13T18:35:27.588 INFO:teuthology.orchestra.run.smithi044.stdout:file_796 2024-09-13T18:35:27.589 INFO:teuthology.orchestra.run.smithi044.stdout:file_797 2024-09-13T18:35:27.589 INFO:teuthology.orchestra.run.smithi044.stdout:file_798 2024-09-13T18:35:27.589 INFO:teuthology.orchestra.run.smithi044.stdout:file_799 2024-09-13T18:35:27.589 INFO:teuthology.orchestra.run.smithi044.stdout:file_8 2024-09-13T18:35:27.589 INFO:teuthology.orchestra.run.smithi044.stdout:file_80 2024-09-13T18:35:27.589 INFO:teuthology.orchestra.run.smithi044.stdout:file_800 2024-09-13T18:35:27.589 INFO:teuthology.orchestra.run.smithi044.stdout:file_801 2024-09-13T18:35:27.589 INFO:teuthology.orchestra.run.smithi044.stdout:file_802 2024-09-13T18:35:27.589 INFO:teuthology.orchestra.run.smithi044.stdout:file_803 2024-09-13T18:35:27.589 INFO:teuthology.orchestra.run.smithi044.stdout:file_804 2024-09-13T18:35:27.589 INFO:teuthology.orchestra.run.smithi044.stdout:file_805 2024-09-13T18:35:27.589 INFO:teuthology.orchestra.run.smithi044.stdout:file_806 2024-09-13T18:35:27.589 INFO:teuthology.orchestra.run.smithi044.stdout:file_807 2024-09-13T18:35:27.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_808 2024-09-13T18:35:27.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_809 2024-09-13T18:35:27.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_81 2024-09-13T18:35:27.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_810 2024-09-13T18:35:27.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_811 2024-09-13T18:35:27.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_812 2024-09-13T18:35:27.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_813 2024-09-13T18:35:27.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_814 2024-09-13T18:35:27.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_815 2024-09-13T18:35:27.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_816 2024-09-13T18:35:27.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_817 2024-09-13T18:35:27.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_818 2024-09-13T18:35:27.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_819 2024-09-13T18:35:27.590 INFO:teuthology.orchestra.run.smithi044.stdout:file_82 2024-09-13T18:35:27.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_820 2024-09-13T18:35:27.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_821 2024-09-13T18:35:27.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_822 2024-09-13T18:35:27.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_823 2024-09-13T18:35:27.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_824 2024-09-13T18:35:27.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_825 2024-09-13T18:35:27.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_826 2024-09-13T18:35:27.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_827 2024-09-13T18:35:27.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_828 2024-09-13T18:35:27.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_829 2024-09-13T18:35:27.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_83 2024-09-13T18:35:27.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_830 2024-09-13T18:35:27.591 INFO:teuthology.orchestra.run.smithi044.stdout:file_831 2024-09-13T18:35:27.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_832 2024-09-13T18:35:27.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_833 2024-09-13T18:35:27.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_834 2024-09-13T18:35:27.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_835 2024-09-13T18:35:27.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_836 2024-09-13T18:35:27.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_837 2024-09-13T18:35:27.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_838 2024-09-13T18:35:27.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_839 2024-09-13T18:35:27.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_84 2024-09-13T18:35:27.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_840 2024-09-13T18:35:27.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_841 2024-09-13T18:35:27.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_842 2024-09-13T18:35:27.592 INFO:teuthology.orchestra.run.smithi044.stdout:file_843 2024-09-13T18:35:27.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_844 2024-09-13T18:35:27.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_845 2024-09-13T18:35:27.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_846 2024-09-13T18:35:27.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_847 2024-09-13T18:35:27.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_848 2024-09-13T18:35:27.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_849 2024-09-13T18:35:27.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_85 2024-09-13T18:35:27.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_850 2024-09-13T18:35:27.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_851 2024-09-13T18:35:27.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_852 2024-09-13T18:35:27.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_853 2024-09-13T18:35:27.593 INFO:teuthology.orchestra.run.smithi044.stdout:file_854 2024-09-13T18:35:27.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_855 2024-09-13T18:35:27.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_856 2024-09-13T18:35:27.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_857 2024-09-13T18:35:27.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_858 2024-09-13T18:35:27.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_859 2024-09-13T18:35:27.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_86 2024-09-13T18:35:27.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_860 2024-09-13T18:35:27.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_861 2024-09-13T18:35:27.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_862 2024-09-13T18:35:27.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_863 2024-09-13T18:35:27.594 INFO:teuthology.orchestra.run.smithi044.stdout:file_864 2024-09-13T18:35:27.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_865 2024-09-13T18:35:27.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_866 2024-09-13T18:35:27.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_867 2024-09-13T18:35:27.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_868 2024-09-13T18:35:27.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_869 2024-09-13T18:35:27.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_87 2024-09-13T18:35:27.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_870 2024-09-13T18:35:27.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_871 2024-09-13T18:35:27.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_872 2024-09-13T18:35:27.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_873 2024-09-13T18:35:27.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_874 2024-09-13T18:35:27.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_875 2024-09-13T18:35:27.595 INFO:teuthology.orchestra.run.smithi044.stdout:file_876 2024-09-13T18:35:27.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_877 2024-09-13T18:35:27.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_878 2024-09-13T18:35:27.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_879 2024-09-13T18:35:27.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_88 2024-09-13T18:35:27.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_880 2024-09-13T18:35:27.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_881 2024-09-13T18:35:27.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_882 2024-09-13T18:35:27.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_883 2024-09-13T18:35:27.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_884 2024-09-13T18:35:27.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_885 2024-09-13T18:35:27.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_886 2024-09-13T18:35:27.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_887 2024-09-13T18:35:27.596 INFO:teuthology.orchestra.run.smithi044.stdout:file_888 2024-09-13T18:35:27.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_889 2024-09-13T18:35:27.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_89 2024-09-13T18:35:27.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_890 2024-09-13T18:35:27.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_891 2024-09-13T18:35:27.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_892 2024-09-13T18:35:27.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_893 2024-09-13T18:35:27.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_894 2024-09-13T18:35:27.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_895 2024-09-13T18:35:27.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_896 2024-09-13T18:35:27.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_897 2024-09-13T18:35:27.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_898 2024-09-13T18:35:27.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_899 2024-09-13T18:35:27.597 INFO:teuthology.orchestra.run.smithi044.stdout:file_9 2024-09-13T18:35:27.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_90 2024-09-13T18:35:27.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_900 2024-09-13T18:35:27.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_901 2024-09-13T18:35:27.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_902 2024-09-13T18:35:27.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_903 2024-09-13T18:35:27.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_904 2024-09-13T18:35:27.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_905 2024-09-13T18:35:27.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_906 2024-09-13T18:35:27.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_907 2024-09-13T18:35:27.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_908 2024-09-13T18:35:27.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_909 2024-09-13T18:35:27.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_91 2024-09-13T18:35:27.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_910 2024-09-13T18:35:27.598 INFO:teuthology.orchestra.run.smithi044.stdout:file_911 2024-09-13T18:35:27.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_912 2024-09-13T18:35:27.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_913 2024-09-13T18:35:27.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_914 2024-09-13T18:35:27.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_915 2024-09-13T18:35:27.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_916 2024-09-13T18:35:27.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_917 2024-09-13T18:35:27.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_918 2024-09-13T18:35:27.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_919 2024-09-13T18:35:27.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_92 2024-09-13T18:35:27.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_920 2024-09-13T18:35:27.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_921 2024-09-13T18:35:27.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_922 2024-09-13T18:35:27.599 INFO:teuthology.orchestra.run.smithi044.stdout:file_923 2024-09-13T18:35:27.600 INFO:teuthology.orchestra.run.smithi044.stdout:file_924 2024-09-13T18:35:27.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_925 2024-09-13T18:35:27.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_926 2024-09-13T18:35:27.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_927 2024-09-13T18:35:27.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_928 2024-09-13T18:35:27.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_929 2024-09-13T18:35:27.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_93 2024-09-13T18:35:27.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_930 2024-09-13T18:35:27.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_931 2024-09-13T18:35:27.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_932 2024-09-13T18:35:27.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_933 2024-09-13T18:35:27.644 INFO:teuthology.orchestra.run.smithi044.stdout:file_934 2024-09-13T18:35:27.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_935 2024-09-13T18:35:27.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_936 2024-09-13T18:35:27.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_937 2024-09-13T18:35:27.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_938 2024-09-13T18:35:27.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_939 2024-09-13T18:35:27.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_94 2024-09-13T18:35:27.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_940 2024-09-13T18:35:27.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_941 2024-09-13T18:35:27.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_942 2024-09-13T18:35:27.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_943 2024-09-13T18:35:27.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_944 2024-09-13T18:35:27.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_945 2024-09-13T18:35:27.645 INFO:teuthology.orchestra.run.smithi044.stdout:file_946 2024-09-13T18:35:27.646 INFO:teuthology.orchestra.run.smithi044.stdout:file_947 2024-09-13T18:35:27.646 INFO:teuthology.orchestra.run.smithi044.stdout:file_948 2024-09-13T18:35:27.646 INFO:teuthology.orchestra.run.smithi044.stdout:file_949 2024-09-13T18:35:27.646 INFO:teuthology.orchestra.run.smithi044.stdout:file_95 2024-09-13T18:35:27.646 INFO:teuthology.orchestra.run.smithi044.stdout:file_950 2024-09-13T18:35:27.646 INFO:teuthology.orchestra.run.smithi044.stdout:file_951 2024-09-13T18:35:27.646 INFO:teuthology.orchestra.run.smithi044.stdout:file_952 2024-09-13T18:35:27.646 INFO:teuthology.orchestra.run.smithi044.stdout:file_953 2024-09-13T18:35:27.646 INFO:teuthology.orchestra.run.smithi044.stdout:file_954 2024-09-13T18:35:27.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_955 2024-09-13T18:35:27.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_956 2024-09-13T18:35:27.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_957 2024-09-13T18:35:27.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_958 2024-09-13T18:35:27.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_959 2024-09-13T18:35:27.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_96 2024-09-13T18:35:27.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_960 2024-09-13T18:35:27.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_961 2024-09-13T18:35:27.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_962 2024-09-13T18:35:27.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_963 2024-09-13T18:35:27.647 INFO:teuthology.orchestra.run.smithi044.stdout:file_964 2024-09-13T18:35:27.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_965 2024-09-13T18:35:27.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_966 2024-09-13T18:35:27.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_967 2024-09-13T18:35:27.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_968 2024-09-13T18:35:27.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_969 2024-09-13T18:35:27.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_97 2024-09-13T18:35:27.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_970 2024-09-13T18:35:27.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_971 2024-09-13T18:35:27.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_972 2024-09-13T18:35:27.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_973 2024-09-13T18:35:27.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_974 2024-09-13T18:35:27.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_975 2024-09-13T18:35:27.648 INFO:teuthology.orchestra.run.smithi044.stdout:file_976 2024-09-13T18:35:27.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_977 2024-09-13T18:35:27.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_978 2024-09-13T18:35:27.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_979 2024-09-13T18:35:27.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_98 2024-09-13T18:35:27.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_980 2024-09-13T18:35:27.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_981 2024-09-13T18:35:27.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_982 2024-09-13T18:35:27.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_983 2024-09-13T18:35:27.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_984 2024-09-13T18:35:27.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_985 2024-09-13T18:35:27.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_986 2024-09-13T18:35:27.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_987 2024-09-13T18:35:27.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_988 2024-09-13T18:35:27.649 INFO:teuthology.orchestra.run.smithi044.stdout:file_989 2024-09-13T18:35:27.650 INFO:teuthology.orchestra.run.smithi044.stdout:file_99 2024-09-13T18:35:27.650 INFO:teuthology.orchestra.run.smithi044.stdout:file_990 2024-09-13T18:35:27.650 INFO:teuthology.orchestra.run.smithi044.stdout:file_991 2024-09-13T18:35:27.650 INFO:teuthology.orchestra.run.smithi044.stdout:file_992 2024-09-13T18:35:27.650 INFO:teuthology.orchestra.run.smithi044.stdout:file_993 2024-09-13T18:35:27.650 INFO:teuthology.orchestra.run.smithi044.stdout:file_994 2024-09-13T18:35:27.650 INFO:teuthology.orchestra.run.smithi044.stdout:file_995 2024-09-13T18:35:27.651 INFO:teuthology.orchestra.run.smithi044.stdout:file_996 2024-09-13T18:35:27.651 INFO:teuthology.orchestra.run.smithi044.stdout:file_997 2024-09-13T18:35:27.651 INFO:teuthology.orchestra.run.smithi044.stdout:file_998 2024-09-13T18:35:27.651 INFO:teuthology.orchestra.run.smithi044.stdout:file_999 2024-09-13T18:35:27.652 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:27.652 INFO:teuthology.orchestra.run.smithi044.stdout:./bravo: 2024-09-13T18:35:27.652 INFO:teuthology.orchestra.run.smithi044.stdout:file 2024-09-13T18:35:27.652 INFO:teuthology.orchestra.run.smithi044.stdout:file_0 2024-09-13T18:35:27.652 INFO:teuthology.orchestra.run.smithi044.stdout:file_1 2024-09-13T18:35:27.652 INFO:teuthology.orchestra.run.smithi044.stdout:file_10 2024-09-13T18:35:27.652 INFO:teuthology.orchestra.run.smithi044.stdout:file_100 2024-09-13T18:35:27.652 INFO:teuthology.orchestra.run.smithi044.stdout:file_101 2024-09-13T18:35:27.652 INFO:teuthology.orchestra.run.smithi044.stdout:file_102 2024-09-13T18:35:27.652 INFO:teuthology.orchestra.run.smithi044.stdout:file_103 2024-09-13T18:35:27.653 INFO:teuthology.orchestra.run.smithi044.stdout:file_104 2024-09-13T18:35:27.653 INFO:teuthology.orchestra.run.smithi044.stdout:file_105 2024-09-13T18:35:27.653 INFO:teuthology.orchestra.run.smithi044.stdout:file_106 2024-09-13T18:35:27.653 INFO:teuthology.orchestra.run.smithi044.stdout:file_107 2024-09-13T18:35:27.653 INFO:teuthology.orchestra.run.smithi044.stdout:file_108 2024-09-13T18:35:27.653 INFO:teuthology.orchestra.run.smithi044.stdout:file_109 2024-09-13T18:35:27.653 INFO:teuthology.orchestra.run.smithi044.stdout:file_11 2024-09-13T18:35:27.653 INFO:teuthology.orchestra.run.smithi044.stdout:file_110 2024-09-13T18:35:27.653 INFO:teuthology.orchestra.run.smithi044.stdout:file_111 2024-09-13T18:35:27.653 INFO:teuthology.orchestra.run.smithi044.stdout:file_112 2024-09-13T18:35:27.654 INFO:teuthology.orchestra.run.smithi044.stdout:file_113 2024-09-13T18:35:27.654 INFO:teuthology.orchestra.run.smithi044.stdout:file_114 2024-09-13T18:35:27.654 INFO:teuthology.orchestra.run.smithi044.stdout:file_115 2024-09-13T18:35:27.654 INFO:teuthology.orchestra.run.smithi044.stdout:file_116 2024-09-13T18:35:27.654 INFO:teuthology.orchestra.run.smithi044.stdout:file_117 2024-09-13T18:35:27.654 INFO:teuthology.orchestra.run.smithi044.stdout:file_118 2024-09-13T18:35:27.654 INFO:teuthology.orchestra.run.smithi044.stdout:file_119 2024-09-13T18:35:27.654 INFO:teuthology.orchestra.run.smithi044.stdout:file_12 2024-09-13T18:35:27.654 INFO:teuthology.orchestra.run.smithi044.stdout:file_120 2024-09-13T18:35:27.654 INFO:teuthology.orchestra.run.smithi044.stdout:file_121 2024-09-13T18:35:27.654 INFO:teuthology.orchestra.run.smithi044.stdout:file_122 2024-09-13T18:35:27.654 INFO:teuthology.orchestra.run.smithi044.stdout:file_123 2024-09-13T18:35:27.654 INFO:teuthology.orchestra.run.smithi044.stdout:file_124 2024-09-13T18:35:27.654 INFO:teuthology.orchestra.run.smithi044.stdout:file_125 2024-09-13T18:35:27.655 INFO:teuthology.orchestra.run.smithi044.stdout:file_126 2024-09-13T18:35:27.655 INFO:teuthology.orchestra.run.smithi044.stdout:file_127 2024-09-13T18:35:27.655 INFO:teuthology.orchestra.run.smithi044.stdout:file_128 2024-09-13T18:35:27.655 INFO:teuthology.orchestra.run.smithi044.stdout:file_129 2024-09-13T18:35:27.655 INFO:teuthology.orchestra.run.smithi044.stdout:file_13 2024-09-13T18:35:27.655 INFO:teuthology.orchestra.run.smithi044.stdout:file_130 2024-09-13T18:35:27.655 INFO:teuthology.orchestra.run.smithi044.stdout:file_131 2024-09-13T18:35:27.655 INFO:teuthology.orchestra.run.smithi044.stdout:file_132 2024-09-13T18:35:27.655 INFO:teuthology.orchestra.run.smithi044.stdout:file_133 2024-09-13T18:35:27.655 INFO:teuthology.orchestra.run.smithi044.stdout:file_134 2024-09-13T18:35:27.655 INFO:teuthology.orchestra.run.smithi044.stdout:file_135 2024-09-13T18:35:27.655 INFO:teuthology.orchestra.run.smithi044.stdout:file_136 2024-09-13T18:35:27.656 INFO:teuthology.orchestra.run.smithi044.stdout:file_137 2024-09-13T18:35:27.656 INFO:teuthology.orchestra.run.smithi044.stdout:file_138 2024-09-13T18:35:27.656 INFO:teuthology.orchestra.run.smithi044.stdout:file_139 2024-09-13T18:35:27.656 INFO:teuthology.orchestra.run.smithi044.stdout:file_14 2024-09-13T18:35:27.656 INFO:teuthology.orchestra.run.smithi044.stdout:file_140 2024-09-13T18:35:27.656 INFO:teuthology.orchestra.run.smithi044.stdout:file_141 2024-09-13T18:35:27.656 INFO:teuthology.orchestra.run.smithi044.stdout:file_142 2024-09-13T18:35:27.657 INFO:teuthology.orchestra.run.smithi044.stdout:file_143 2024-09-13T18:35:27.657 INFO:teuthology.orchestra.run.smithi044.stdout:file_144 2024-09-13T18:35:27.657 INFO:teuthology.orchestra.run.smithi044.stdout:file_145 2024-09-13T18:35:27.657 INFO:teuthology.orchestra.run.smithi044.stdout:file_146 2024-09-13T18:35:27.657 INFO:teuthology.orchestra.run.smithi044.stdout:file_147 2024-09-13T18:35:27.657 INFO:teuthology.orchestra.run.smithi044.stdout:file_148 2024-09-13T18:35:27.657 INFO:teuthology.orchestra.run.smithi044.stdout:file_149 2024-09-13T18:35:27.657 INFO:teuthology.orchestra.run.smithi044.stdout:file_15 2024-09-13T18:35:27.657 INFO:teuthology.orchestra.run.smithi044.stdout:file_150 2024-09-13T18:35:27.657 INFO:teuthology.orchestra.run.smithi044.stdout:file_151 2024-09-13T18:35:27.657 INFO:teuthology.orchestra.run.smithi044.stdout:file_152 2024-09-13T18:35:27.657 INFO:teuthology.orchestra.run.smithi044.stdout:file_153 2024-09-13T18:35:27.657 INFO:teuthology.orchestra.run.smithi044.stdout:file_154 2024-09-13T18:35:27.657 INFO:teuthology.orchestra.run.smithi044.stdout:file_155 2024-09-13T18:35:27.658 INFO:teuthology.orchestra.run.smithi044.stdout:file_156 2024-09-13T18:35:27.658 INFO:teuthology.orchestra.run.smithi044.stdout:file_157 2024-09-13T18:35:27.658 INFO:teuthology.orchestra.run.smithi044.stdout:file_158 2024-09-13T18:35:27.658 INFO:teuthology.orchestra.run.smithi044.stdout:file_159 2024-09-13T18:35:27.658 INFO:teuthology.orchestra.run.smithi044.stdout:file_16 2024-09-13T18:35:27.658 INFO:teuthology.orchestra.run.smithi044.stdout:file_160 2024-09-13T18:35:27.658 INFO:teuthology.orchestra.run.smithi044.stdout:file_161 2024-09-13T18:35:27.658 INFO:teuthology.orchestra.run.smithi044.stdout:file_162 2024-09-13T18:35:27.658 INFO:teuthology.orchestra.run.smithi044.stdout:file_163 2024-09-13T18:35:27.658 INFO:teuthology.orchestra.run.smithi044.stdout:file_164 2024-09-13T18:35:27.658 INFO:teuthology.orchestra.run.smithi044.stdout:file_165 2024-09-13T18:35:27.658 INFO:teuthology.orchestra.run.smithi044.stdout:file_166 2024-09-13T18:35:27.658 INFO:teuthology.orchestra.run.smithi044.stdout:file_167 2024-09-13T18:35:27.659 INFO:teuthology.orchestra.run.smithi044.stdout:file_168 2024-09-13T18:35:27.659 INFO:teuthology.orchestra.run.smithi044.stdout:file_169 2024-09-13T18:35:27.659 INFO:teuthology.orchestra.run.smithi044.stdout:file_17 2024-09-13T18:35:27.659 INFO:teuthology.orchestra.run.smithi044.stdout:file_170 2024-09-13T18:35:27.659 INFO:teuthology.orchestra.run.smithi044.stdout:file_171 2024-09-13T18:35:27.659 INFO:teuthology.orchestra.run.smithi044.stdout:file_172 2024-09-13T18:35:27.659 INFO:teuthology.orchestra.run.smithi044.stdout:file_173 2024-09-13T18:35:27.659 INFO:teuthology.orchestra.run.smithi044.stdout:file_174 2024-09-13T18:35:27.659 INFO:teuthology.orchestra.run.smithi044.stdout:file_175 2024-09-13T18:35:27.659 INFO:teuthology.orchestra.run.smithi044.stdout:file_176 2024-09-13T18:35:27.659 INFO:teuthology.orchestra.run.smithi044.stdout:file_177 2024-09-13T18:35:27.659 INFO:teuthology.orchestra.run.smithi044.stdout:file_178 2024-09-13T18:35:27.659 INFO:teuthology.orchestra.run.smithi044.stdout:file_179 2024-09-13T18:35:27.659 INFO:teuthology.orchestra.run.smithi044.stdout:file_18 2024-09-13T18:35:27.660 INFO:teuthology.orchestra.run.smithi044.stdout:file_180 2024-09-13T18:35:27.660 INFO:teuthology.orchestra.run.smithi044.stdout:file_181 2024-09-13T18:35:27.660 INFO:teuthology.orchestra.run.smithi044.stdout:file_182 2024-09-13T18:35:27.660 INFO:teuthology.orchestra.run.smithi044.stdout:file_183 2024-09-13T18:35:27.660 INFO:teuthology.orchestra.run.smithi044.stdout:file_184 2024-09-13T18:35:27.660 INFO:teuthology.orchestra.run.smithi044.stdout:file_185 2024-09-13T18:35:27.660 INFO:teuthology.orchestra.run.smithi044.stdout:file_186 2024-09-13T18:35:27.660 INFO:teuthology.orchestra.run.smithi044.stdout:file_187 2024-09-13T18:35:27.660 INFO:teuthology.orchestra.run.smithi044.stdout:file_188 2024-09-13T18:35:27.660 INFO:teuthology.orchestra.run.smithi044.stdout:file_189 2024-09-13T18:35:27.660 INFO:teuthology.orchestra.run.smithi044.stdout:file_19 2024-09-13T18:35:27.660 INFO:teuthology.orchestra.run.smithi044.stdout:file_190 2024-09-13T18:35:27.660 INFO:teuthology.orchestra.run.smithi044.stdout:file_191 2024-09-13T18:35:27.660 INFO:teuthology.orchestra.run.smithi044.stdout:file_192 2024-09-13T18:35:27.661 INFO:teuthology.orchestra.run.smithi044.stdout:file_193 2024-09-13T18:35:27.661 INFO:teuthology.orchestra.run.smithi044.stdout:file_194 2024-09-13T18:35:27.661 INFO:teuthology.orchestra.run.smithi044.stdout:file_195 2024-09-13T18:35:27.661 INFO:teuthology.orchestra.run.smithi044.stdout:file_196 2024-09-13T18:35:27.661 INFO:teuthology.orchestra.run.smithi044.stdout:file_197 2024-09-13T18:35:27.661 INFO:teuthology.orchestra.run.smithi044.stdout:file_198 2024-09-13T18:35:27.661 INFO:teuthology.orchestra.run.smithi044.stdout:file_199 2024-09-13T18:35:27.661 INFO:teuthology.orchestra.run.smithi044.stdout:file_2 2024-09-13T18:35:27.661 INFO:teuthology.orchestra.run.smithi044.stdout:file_20 2024-09-13T18:35:27.661 INFO:teuthology.orchestra.run.smithi044.stdout:file_200 2024-09-13T18:35:27.661 INFO:teuthology.orchestra.run.smithi044.stdout:file_201 2024-09-13T18:35:27.661 INFO:teuthology.orchestra.run.smithi044.stdout:file_202 2024-09-13T18:35:27.661 INFO:teuthology.orchestra.run.smithi044.stdout:file_203 2024-09-13T18:35:27.661 INFO:teuthology.orchestra.run.smithi044.stdout:file_204 2024-09-13T18:35:27.662 INFO:teuthology.orchestra.run.smithi044.stdout:file_205 2024-09-13T18:35:27.662 INFO:teuthology.orchestra.run.smithi044.stdout:file_206 2024-09-13T18:35:27.662 INFO:teuthology.orchestra.run.smithi044.stdout:file_207 2024-09-13T18:35:27.662 INFO:teuthology.orchestra.run.smithi044.stdout:file_208 2024-09-13T18:35:27.662 INFO:teuthology.orchestra.run.smithi044.stdout:file_209 2024-09-13T18:35:27.662 INFO:teuthology.orchestra.run.smithi044.stdout:file_21 2024-09-13T18:35:27.662 INFO:teuthology.orchestra.run.smithi044.stdout:file_210 2024-09-13T18:35:27.662 INFO:teuthology.orchestra.run.smithi044.stdout:file_211 2024-09-13T18:35:27.662 INFO:teuthology.orchestra.run.smithi044.stdout:file_212 2024-09-13T18:35:27.662 INFO:teuthology.orchestra.run.smithi044.stdout:file_213 2024-09-13T18:35:27.662 INFO:teuthology.orchestra.run.smithi044.stdout:file_214 2024-09-13T18:35:27.662 INFO:teuthology.orchestra.run.smithi044.stdout:file_215 2024-09-13T18:35:27.662 INFO:teuthology.orchestra.run.smithi044.stdout:file_216 2024-09-13T18:35:27.663 INFO:teuthology.orchestra.run.smithi044.stdout:file_217 2024-09-13T18:35:27.663 INFO:teuthology.orchestra.run.smithi044.stdout:file_218 2024-09-13T18:35:27.663 INFO:teuthology.orchestra.run.smithi044.stdout:file_219 2024-09-13T18:35:27.663 INFO:teuthology.orchestra.run.smithi044.stdout:file_22 2024-09-13T18:35:27.663 INFO:teuthology.orchestra.run.smithi044.stdout:file_220 2024-09-13T18:35:27.663 INFO:teuthology.orchestra.run.smithi044.stdout:file_221 2024-09-13T18:35:27.663 INFO:teuthology.orchestra.run.smithi044.stdout:file_222 2024-09-13T18:35:27.663 INFO:teuthology.orchestra.run.smithi044.stdout:file_223 2024-09-13T18:35:27.663 INFO:teuthology.orchestra.run.smithi044.stdout:file_224 2024-09-13T18:35:27.663 INFO:teuthology.orchestra.run.smithi044.stdout:file_225 2024-09-13T18:35:27.665 INFO:teuthology.orchestra.run.smithi044.stdout:file_226 2024-09-13T18:35:27.665 INFO:teuthology.orchestra.run.smithi044.stdout:file_227 2024-09-13T18:35:27.665 INFO:teuthology.orchestra.run.smithi044.stdout:file_228 2024-09-13T18:35:27.665 INFO:teuthology.orchestra.run.smithi044.stdout:file_229 2024-09-13T18:35:27.665 INFO:teuthology.orchestra.run.smithi044.stdout:file_23 2024-09-13T18:35:27.665 INFO:teuthology.orchestra.run.smithi044.stdout:file_230 2024-09-13T18:35:27.665 INFO:teuthology.orchestra.run.smithi044.stdout:file_231 2024-09-13T18:35:27.665 INFO:teuthology.orchestra.run.smithi044.stdout:file_232 2024-09-13T18:35:27.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_233 2024-09-13T18:35:27.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_234 2024-09-13T18:35:27.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_235 2024-09-13T18:35:27.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_236 2024-09-13T18:35:27.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_237 2024-09-13T18:35:27.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_238 2024-09-13T18:35:27.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_239 2024-09-13T18:35:27.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_24 2024-09-13T18:35:27.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_240 2024-09-13T18:35:27.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_241 2024-09-13T18:35:27.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_242 2024-09-13T18:35:27.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_243 2024-09-13T18:35:27.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_244 2024-09-13T18:35:27.666 INFO:teuthology.orchestra.run.smithi044.stdout:file_245 2024-09-13T18:35:27.667 INFO:teuthology.orchestra.run.smithi044.stdout:file_246 2024-09-13T18:35:27.667 INFO:teuthology.orchestra.run.smithi044.stdout:file_247 2024-09-13T18:35:27.667 INFO:teuthology.orchestra.run.smithi044.stdout:file_248 2024-09-13T18:35:27.667 INFO:teuthology.orchestra.run.smithi044.stdout:file_249 2024-09-13T18:35:27.667 INFO:teuthology.orchestra.run.smithi044.stdout:file_25 2024-09-13T18:35:27.667 INFO:teuthology.orchestra.run.smithi044.stdout:file_250 2024-09-13T18:35:27.667 INFO:teuthology.orchestra.run.smithi044.stdout:file_251 2024-09-13T18:35:27.667 INFO:teuthology.orchestra.run.smithi044.stdout:file_252 2024-09-13T18:35:27.667 INFO:teuthology.orchestra.run.smithi044.stdout:file_253 2024-09-13T18:35:27.667 INFO:teuthology.orchestra.run.smithi044.stdout:file_254 2024-09-13T18:35:27.667 INFO:teuthology.orchestra.run.smithi044.stdout:file_255 2024-09-13T18:35:27.667 INFO:teuthology.orchestra.run.smithi044.stdout:file_256 2024-09-13T18:35:27.668 INFO:teuthology.orchestra.run.smithi044.stdout:file_257 2024-09-13T18:35:27.668 INFO:teuthology.orchestra.run.smithi044.stdout:file_258 2024-09-13T18:35:27.668 INFO:teuthology.orchestra.run.smithi044.stdout:file_259 2024-09-13T18:35:27.668 INFO:teuthology.orchestra.run.smithi044.stdout:file_26 2024-09-13T18:35:27.668 INFO:teuthology.orchestra.run.smithi044.stdout:file_260 2024-09-13T18:35:27.668 INFO:teuthology.orchestra.run.smithi044.stdout:file_261 2024-09-13T18:35:27.668 INFO:teuthology.orchestra.run.smithi044.stdout:file_262 2024-09-13T18:35:27.668 INFO:teuthology.orchestra.run.smithi044.stdout:file_263 2024-09-13T18:35:27.668 INFO:teuthology.orchestra.run.smithi044.stdout:file_264 2024-09-13T18:35:27.668 INFO:teuthology.orchestra.run.smithi044.stdout:file_265 2024-09-13T18:35:27.668 INFO:teuthology.orchestra.run.smithi044.stdout:file_266 2024-09-13T18:35:27.668 INFO:teuthology.orchestra.run.smithi044.stdout:file_267 2024-09-13T18:35:27.668 INFO:teuthology.orchestra.run.smithi044.stdout:file_268 2024-09-13T18:35:27.669 INFO:teuthology.orchestra.run.smithi044.stdout:file_269 2024-09-13T18:35:27.669 INFO:teuthology.orchestra.run.smithi044.stdout:file_27 2024-09-13T18:35:27.669 INFO:teuthology.orchestra.run.smithi044.stdout:file_270 2024-09-13T18:35:27.669 INFO:teuthology.orchestra.run.smithi044.stdout:file_271 2024-09-13T18:35:27.669 INFO:teuthology.orchestra.run.smithi044.stdout:file_272 2024-09-13T18:35:27.669 INFO:teuthology.orchestra.run.smithi044.stdout:file_273 2024-09-13T18:35:27.669 INFO:teuthology.orchestra.run.smithi044.stdout:file_274 2024-09-13T18:35:27.669 INFO:teuthology.orchestra.run.smithi044.stdout:file_275 2024-09-13T18:35:27.669 INFO:teuthology.orchestra.run.smithi044.stdout:file_276 2024-09-13T18:35:27.669 INFO:teuthology.orchestra.run.smithi044.stdout:file_277 2024-09-13T18:35:27.669 INFO:teuthology.orchestra.run.smithi044.stdout:file_278 2024-09-13T18:35:27.669 INFO:teuthology.orchestra.run.smithi044.stdout:file_279 2024-09-13T18:35:27.669 INFO:teuthology.orchestra.run.smithi044.stdout:file_28 2024-09-13T18:35:27.669 INFO:teuthology.orchestra.run.smithi044.stdout:file_280 2024-09-13T18:35:27.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_281 2024-09-13T18:35:27.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_282 2024-09-13T18:35:27.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_283 2024-09-13T18:35:27.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_284 2024-09-13T18:35:27.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_285 2024-09-13T18:35:27.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_286 2024-09-13T18:35:27.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_287 2024-09-13T18:35:27.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_288 2024-09-13T18:35:27.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_289 2024-09-13T18:35:27.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_29 2024-09-13T18:35:27.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_290 2024-09-13T18:35:27.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_291 2024-09-13T18:35:27.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_292 2024-09-13T18:35:27.670 INFO:teuthology.orchestra.run.smithi044.stdout:file_293 2024-09-13T18:35:27.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_294 2024-09-13T18:35:27.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_295 2024-09-13T18:35:27.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_296 2024-09-13T18:35:27.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_297 2024-09-13T18:35:27.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_298 2024-09-13T18:35:27.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_299 2024-09-13T18:35:27.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_3 2024-09-13T18:35:27.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_30 2024-09-13T18:35:27.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_300 2024-09-13T18:35:27.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_301 2024-09-13T18:35:27.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_302 2024-09-13T18:35:27.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_303 2024-09-13T18:35:27.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_304 2024-09-13T18:35:27.671 INFO:teuthology.orchestra.run.smithi044.stdout:file_305 2024-09-13T18:35:27.672 INFO:teuthology.orchestra.run.smithi044.stdout:file_306 2024-09-13T18:35:27.672 INFO:teuthology.orchestra.run.smithi044.stdout:file_307 2024-09-13T18:35:27.672 INFO:teuthology.orchestra.run.smithi044.stdout:file_308 2024-09-13T18:35:27.672 INFO:teuthology.orchestra.run.smithi044.stdout:file_309 2024-09-13T18:35:27.672 INFO:teuthology.orchestra.run.smithi044.stdout:file_31 2024-09-13T18:35:27.672 INFO:teuthology.orchestra.run.smithi044.stdout:file_310 2024-09-13T18:35:27.672 INFO:teuthology.orchestra.run.smithi044.stdout:file_311 2024-09-13T18:35:27.672 INFO:teuthology.orchestra.run.smithi044.stdout:file_312 2024-09-13T18:35:27.672 INFO:teuthology.orchestra.run.smithi044.stdout:file_313 2024-09-13T18:35:27.672 INFO:teuthology.orchestra.run.smithi044.stdout:file_314 2024-09-13T18:35:27.672 INFO:teuthology.orchestra.run.smithi044.stdout:file_315 2024-09-13T18:35:27.672 INFO:teuthology.orchestra.run.smithi044.stdout:file_316 2024-09-13T18:35:27.672 INFO:teuthology.orchestra.run.smithi044.stdout:file_317 2024-09-13T18:35:27.673 INFO:teuthology.orchestra.run.smithi044.stdout:file_318 2024-09-13T18:35:27.673 INFO:teuthology.orchestra.run.smithi044.stdout:file_319 2024-09-13T18:35:27.673 INFO:teuthology.orchestra.run.smithi044.stdout:file_32 2024-09-13T18:35:27.673 INFO:teuthology.orchestra.run.smithi044.stdout:file_320 2024-09-13T18:35:27.673 INFO:teuthology.orchestra.run.smithi044.stdout:file_321 2024-09-13T18:35:27.673 INFO:teuthology.orchestra.run.smithi044.stdout:file_322 2024-09-13T18:35:27.673 INFO:teuthology.orchestra.run.smithi044.stdout:file_323 2024-09-13T18:35:27.673 INFO:teuthology.orchestra.run.smithi044.stdout:file_324 2024-09-13T18:35:27.673 INFO:teuthology.orchestra.run.smithi044.stdout:file_325 2024-09-13T18:35:27.673 INFO:teuthology.orchestra.run.smithi044.stdout:file_326 2024-09-13T18:35:27.673 INFO:teuthology.orchestra.run.smithi044.stdout:file_327 2024-09-13T18:35:27.673 INFO:teuthology.orchestra.run.smithi044.stdout:file_328 2024-09-13T18:35:27.673 INFO:teuthology.orchestra.run.smithi044.stdout:file_329 2024-09-13T18:35:27.673 INFO:teuthology.orchestra.run.smithi044.stdout:file_33 2024-09-13T18:35:27.674 INFO:teuthology.orchestra.run.smithi044.stdout:file_330 2024-09-13T18:35:27.674 INFO:teuthology.orchestra.run.smithi044.stdout:file_331 2024-09-13T18:35:27.674 INFO:teuthology.orchestra.run.smithi044.stdout:file_332 2024-09-13T18:35:27.674 INFO:teuthology.orchestra.run.smithi044.stdout:file_333 2024-09-13T18:35:27.674 INFO:teuthology.orchestra.run.smithi044.stdout:file_334 2024-09-13T18:35:27.674 INFO:teuthology.orchestra.run.smithi044.stdout:file_335 2024-09-13T18:35:27.674 INFO:teuthology.orchestra.run.smithi044.stdout:file_336 2024-09-13T18:35:27.674 INFO:teuthology.orchestra.run.smithi044.stdout:file_337 2024-09-13T18:35:27.674 INFO:teuthology.orchestra.run.smithi044.stdout:file_338 2024-09-13T18:35:27.674 INFO:teuthology.orchestra.run.smithi044.stdout:file_339 2024-09-13T18:35:27.674 INFO:teuthology.orchestra.run.smithi044.stdout:file_34 2024-09-13T18:35:27.674 INFO:teuthology.orchestra.run.smithi044.stdout:file_340 2024-09-13T18:35:27.674 INFO:teuthology.orchestra.run.smithi044.stdout:file_341 2024-09-13T18:35:27.674 INFO:teuthology.orchestra.run.smithi044.stdout:file_342 2024-09-13T18:35:27.675 INFO:teuthology.orchestra.run.smithi044.stdout:file_343 2024-09-13T18:35:27.675 INFO:teuthology.orchestra.run.smithi044.stdout:file_344 2024-09-13T18:35:27.675 INFO:teuthology.orchestra.run.smithi044.stdout:file_345 2024-09-13T18:35:27.675 INFO:teuthology.orchestra.run.smithi044.stdout:file_346 2024-09-13T18:35:27.675 INFO:teuthology.orchestra.run.smithi044.stdout:file_347 2024-09-13T18:35:27.675 INFO:teuthology.orchestra.run.smithi044.stdout:file_348 2024-09-13T18:35:27.675 INFO:teuthology.orchestra.run.smithi044.stdout:file_349 2024-09-13T18:35:27.675 INFO:teuthology.orchestra.run.smithi044.stdout:file_35 2024-09-13T18:35:27.675 INFO:teuthology.orchestra.run.smithi044.stdout:file_350 2024-09-13T18:35:27.675 INFO:teuthology.orchestra.run.smithi044.stdout:file_351 2024-09-13T18:35:27.675 INFO:teuthology.orchestra.run.smithi044.stdout:file_352 2024-09-13T18:35:27.675 INFO:teuthology.orchestra.run.smithi044.stdout:file_353 2024-09-13T18:35:27.675 INFO:teuthology.orchestra.run.smithi044.stdout:file_354 2024-09-13T18:35:27.675 INFO:teuthology.orchestra.run.smithi044.stdout:file_355 2024-09-13T18:35:27.676 INFO:teuthology.orchestra.run.smithi044.stdout:file_356 2024-09-13T18:35:27.676 INFO:teuthology.orchestra.run.smithi044.stdout:file_357 2024-09-13T18:35:27.676 INFO:teuthology.orchestra.run.smithi044.stdout:file_358 2024-09-13T18:35:27.676 INFO:teuthology.orchestra.run.smithi044.stdout:file_359 2024-09-13T18:35:27.676 INFO:teuthology.orchestra.run.smithi044.stdout:file_36 2024-09-13T18:35:27.676 INFO:teuthology.orchestra.run.smithi044.stdout:file_360 2024-09-13T18:35:27.676 INFO:teuthology.orchestra.run.smithi044.stdout:file_361 2024-09-13T18:35:27.676 INFO:teuthology.orchestra.run.smithi044.stdout:file_362 2024-09-13T18:35:27.676 INFO:teuthology.orchestra.run.smithi044.stdout:file_363 2024-09-13T18:35:27.676 INFO:teuthology.orchestra.run.smithi044.stdout:file_364 2024-09-13T18:35:27.676 INFO:teuthology.orchestra.run.smithi044.stdout:file_365 2024-09-13T18:35:27.676 INFO:teuthology.orchestra.run.smithi044.stdout:file_366 2024-09-13T18:35:27.676 INFO:teuthology.orchestra.run.smithi044.stdout:file_367 2024-09-13T18:35:27.677 INFO:teuthology.orchestra.run.smithi044.stdout:file_368 2024-09-13T18:35:27.677 INFO:teuthology.orchestra.run.smithi044.stdout:file_369 2024-09-13T18:35:27.677 INFO:teuthology.orchestra.run.smithi044.stdout:file_37 2024-09-13T18:35:27.677 INFO:teuthology.orchestra.run.smithi044.stdout:file_370 2024-09-13T18:35:27.677 INFO:teuthology.orchestra.run.smithi044.stdout:file_371 2024-09-13T18:35:27.677 INFO:teuthology.orchestra.run.smithi044.stdout:file_372 2024-09-13T18:35:27.677 INFO:teuthology.orchestra.run.smithi044.stdout:file_373 2024-09-13T18:35:27.677 INFO:teuthology.orchestra.run.smithi044.stdout:file_374 2024-09-13T18:35:27.677 INFO:teuthology.orchestra.run.smithi044.stdout:file_375 2024-09-13T18:35:27.677 INFO:teuthology.orchestra.run.smithi044.stdout:file_376 2024-09-13T18:35:27.677 INFO:teuthology.orchestra.run.smithi044.stdout:file_377 2024-09-13T18:35:27.677 INFO:teuthology.orchestra.run.smithi044.stdout:file_378 2024-09-13T18:35:27.677 INFO:teuthology.orchestra.run.smithi044.stdout:file_379 2024-09-13T18:35:27.677 INFO:teuthology.orchestra.run.smithi044.stdout:file_38 2024-09-13T18:35:27.678 INFO:teuthology.orchestra.run.smithi044.stdout:file_380 2024-09-13T18:35:27.678 INFO:teuthology.orchestra.run.smithi044.stdout:file_381 2024-09-13T18:35:27.678 INFO:teuthology.orchestra.run.smithi044.stdout:file_382 2024-09-13T18:35:27.678 INFO:teuthology.orchestra.run.smithi044.stdout:file_383 2024-09-13T18:35:27.678 INFO:teuthology.orchestra.run.smithi044.stdout:file_384 2024-09-13T18:35:27.678 INFO:teuthology.orchestra.run.smithi044.stdout:file_385 2024-09-13T18:35:27.678 INFO:teuthology.orchestra.run.smithi044.stdout:file_386 2024-09-13T18:35:27.678 INFO:teuthology.orchestra.run.smithi044.stdout:file_387 2024-09-13T18:35:27.678 INFO:teuthology.orchestra.run.smithi044.stdout:file_388 2024-09-13T18:35:27.678 INFO:teuthology.orchestra.run.smithi044.stdout:file_389 2024-09-13T18:35:27.678 INFO:teuthology.orchestra.run.smithi044.stdout:file_39 2024-09-13T18:35:27.678 INFO:teuthology.orchestra.run.smithi044.stdout:file_390 2024-09-13T18:35:27.678 INFO:teuthology.orchestra.run.smithi044.stdout:file_391 2024-09-13T18:35:27.678 INFO:teuthology.orchestra.run.smithi044.stdout:file_392 2024-09-13T18:35:27.679 INFO:teuthology.orchestra.run.smithi044.stdout:file_393 2024-09-13T18:35:27.679 INFO:teuthology.orchestra.run.smithi044.stdout:file_394 2024-09-13T18:35:27.679 INFO:teuthology.orchestra.run.smithi044.stdout:file_395 2024-09-13T18:35:27.679 INFO:teuthology.orchestra.run.smithi044.stdout:file_396 2024-09-13T18:35:27.679 INFO:teuthology.orchestra.run.smithi044.stdout:file_397 2024-09-13T18:35:27.679 INFO:teuthology.orchestra.run.smithi044.stdout:file_398 2024-09-13T18:35:27.679 INFO:teuthology.orchestra.run.smithi044.stdout:file_399 2024-09-13T18:35:27.679 INFO:teuthology.orchestra.run.smithi044.stdout:file_4 2024-09-13T18:35:27.679 INFO:teuthology.orchestra.run.smithi044.stdout:file_40 2024-09-13T18:35:27.679 INFO:teuthology.orchestra.run.smithi044.stdout:file_400 2024-09-13T18:35:27.679 INFO:teuthology.orchestra.run.smithi044.stdout:file_401 2024-09-13T18:35:27.679 INFO:teuthology.orchestra.run.smithi044.stdout:file_402 2024-09-13T18:35:27.679 INFO:teuthology.orchestra.run.smithi044.stdout:file_403 2024-09-13T18:35:27.680 INFO:teuthology.orchestra.run.smithi044.stdout:file_404 2024-09-13T18:35:27.680 INFO:teuthology.orchestra.run.smithi044.stdout:file_405 2024-09-13T18:35:27.680 INFO:teuthology.orchestra.run.smithi044.stdout:file_406 2024-09-13T18:35:27.680 INFO:teuthology.orchestra.run.smithi044.stdout:file_407 2024-09-13T18:35:27.680 INFO:teuthology.orchestra.run.smithi044.stdout:file_408 2024-09-13T18:35:27.680 INFO:teuthology.orchestra.run.smithi044.stdout:file_409 2024-09-13T18:35:27.680 INFO:teuthology.orchestra.run.smithi044.stdout:file_41 2024-09-13T18:35:27.680 INFO:teuthology.orchestra.run.smithi044.stdout:file_410 2024-09-13T18:35:27.680 INFO:teuthology.orchestra.run.smithi044.stdout:file_411 2024-09-13T18:35:27.680 INFO:teuthology.orchestra.run.smithi044.stdout:file_412 2024-09-13T18:35:27.680 INFO:teuthology.orchestra.run.smithi044.stdout:file_413 2024-09-13T18:35:27.680 INFO:teuthology.orchestra.run.smithi044.stdout:file_414 2024-09-13T18:35:27.681 INFO:teuthology.orchestra.run.smithi044.stdout:file_415 2024-09-13T18:35:27.681 INFO:teuthology.orchestra.run.smithi044.stdout:file_416 2024-09-13T18:35:27.681 INFO:teuthology.orchestra.run.smithi044.stdout:file_417 2024-09-13T18:35:27.681 INFO:teuthology.orchestra.run.smithi044.stdout:file_418 2024-09-13T18:35:27.681 INFO:teuthology.orchestra.run.smithi044.stdout:file_419 2024-09-13T18:35:27.681 INFO:teuthology.orchestra.run.smithi044.stdout:file_42 2024-09-13T18:35:27.681 INFO:teuthology.orchestra.run.smithi044.stdout:file_420 2024-09-13T18:35:27.681 INFO:teuthology.orchestra.run.smithi044.stdout:file_421 2024-09-13T18:35:27.681 INFO:teuthology.orchestra.run.smithi044.stdout:file_422 2024-09-13T18:35:27.681 INFO:teuthology.orchestra.run.smithi044.stdout:file_423 2024-09-13T18:35:27.681 INFO:teuthology.orchestra.run.smithi044.stdout:file_424 2024-09-13T18:35:27.681 INFO:teuthology.orchestra.run.smithi044.stdout:file_425 2024-09-13T18:35:27.681 INFO:teuthology.orchestra.run.smithi044.stdout:file_426 2024-09-13T18:35:27.681 INFO:teuthology.orchestra.run.smithi044.stdout:file_427 2024-09-13T18:35:27.682 INFO:teuthology.orchestra.run.smithi044.stdout:file_428 2024-09-13T18:35:27.682 INFO:teuthology.orchestra.run.smithi044.stdout:file_429 2024-09-13T18:35:27.682 INFO:teuthology.orchestra.run.smithi044.stdout:file_43 2024-09-13T18:35:27.682 INFO:teuthology.orchestra.run.smithi044.stdout:file_430 2024-09-13T18:35:27.682 INFO:teuthology.orchestra.run.smithi044.stdout:file_431 2024-09-13T18:35:27.682 INFO:teuthology.orchestra.run.smithi044.stdout:file_432 2024-09-13T18:35:27.682 INFO:teuthology.orchestra.run.smithi044.stdout:file_433 2024-09-13T18:35:27.682 INFO:teuthology.orchestra.run.smithi044.stdout:file_434 2024-09-13T18:35:27.682 INFO:teuthology.orchestra.run.smithi044.stdout:file_435 2024-09-13T18:35:27.682 INFO:teuthology.orchestra.run.smithi044.stdout:file_436 2024-09-13T18:35:27.682 INFO:teuthology.orchestra.run.smithi044.stdout:file_437 2024-09-13T18:35:27.682 INFO:teuthology.orchestra.run.smithi044.stdout:file_438 2024-09-13T18:35:27.682 INFO:teuthology.orchestra.run.smithi044.stdout:file_439 2024-09-13T18:35:27.682 INFO:teuthology.orchestra.run.smithi044.stdout:file_44 2024-09-13T18:35:27.683 INFO:teuthology.orchestra.run.smithi044.stdout:file_440 2024-09-13T18:35:27.683 INFO:teuthology.orchestra.run.smithi044.stdout:file_441 2024-09-13T18:35:27.683 INFO:teuthology.orchestra.run.smithi044.stdout:file_442 2024-09-13T18:35:27.683 INFO:teuthology.orchestra.run.smithi044.stdout:file_443 2024-09-13T18:35:27.683 INFO:teuthology.orchestra.run.smithi044.stdout:file_444 2024-09-13T18:35:27.683 INFO:teuthology.orchestra.run.smithi044.stdout:file_445 2024-09-13T18:35:27.683 INFO:teuthology.orchestra.run.smithi044.stdout:file_446 2024-09-13T18:35:27.683 INFO:teuthology.orchestra.run.smithi044.stdout:file_447 2024-09-13T18:35:27.683 INFO:teuthology.orchestra.run.smithi044.stdout:file_448 2024-09-13T18:35:27.683 INFO:teuthology.orchestra.run.smithi044.stdout:file_449 2024-09-13T18:35:27.683 INFO:teuthology.orchestra.run.smithi044.stdout:file_45 2024-09-13T18:35:27.683 INFO:teuthology.orchestra.run.smithi044.stdout:file_450 2024-09-13T18:35:27.683 INFO:teuthology.orchestra.run.smithi044.stdout:file_451 2024-09-13T18:35:27.684 INFO:teuthology.orchestra.run.smithi044.stdout:file_452 2024-09-13T18:35:27.684 INFO:teuthology.orchestra.run.smithi044.stdout:file_453 2024-09-13T18:35:27.684 INFO:teuthology.orchestra.run.smithi044.stdout:file_454 2024-09-13T18:35:27.684 INFO:teuthology.orchestra.run.smithi044.stdout:file_455 2024-09-13T18:35:27.684 INFO:teuthology.orchestra.run.smithi044.stdout:file_456 2024-09-13T18:35:27.684 INFO:teuthology.orchestra.run.smithi044.stdout:file_457 2024-09-13T18:35:27.684 INFO:teuthology.orchestra.run.smithi044.stdout:file_458 2024-09-13T18:35:27.684 INFO:teuthology.orchestra.run.smithi044.stdout:file_459 2024-09-13T18:35:27.684 INFO:teuthology.orchestra.run.smithi044.stdout:file_46 2024-09-13T18:35:27.684 INFO:teuthology.orchestra.run.smithi044.stdout:file_460 2024-09-13T18:35:27.684 INFO:teuthology.orchestra.run.smithi044.stdout:file_461 2024-09-13T18:35:27.684 INFO:teuthology.orchestra.run.smithi044.stdout:file_462 2024-09-13T18:35:27.684 INFO:teuthology.orchestra.run.smithi044.stdout:file_463 2024-09-13T18:35:27.685 INFO:teuthology.orchestra.run.smithi044.stdout:file_464 2024-09-13T18:35:27.685 INFO:teuthology.orchestra.run.smithi044.stdout:file_465 2024-09-13T18:35:27.685 INFO:teuthology.orchestra.run.smithi044.stdout:file_466 2024-09-13T18:35:27.685 INFO:teuthology.orchestra.run.smithi044.stdout:file_467 2024-09-13T18:35:27.685 INFO:teuthology.orchestra.run.smithi044.stdout:file_468 2024-09-13T18:35:27.685 INFO:teuthology.orchestra.run.smithi044.stdout:file_469 2024-09-13T18:35:27.685 INFO:teuthology.orchestra.run.smithi044.stdout:file_47 2024-09-13T18:35:27.685 INFO:teuthology.orchestra.run.smithi044.stdout:file_470 2024-09-13T18:35:27.685 INFO:teuthology.orchestra.run.smithi044.stdout:file_471 2024-09-13T18:35:27.685 INFO:teuthology.orchestra.run.smithi044.stdout:file_472 2024-09-13T18:35:27.685 INFO:teuthology.orchestra.run.smithi044.stdout:file_473 2024-09-13T18:35:27.685 INFO:teuthology.orchestra.run.smithi044.stdout:file_474 2024-09-13T18:35:27.685 INFO:teuthology.orchestra.run.smithi044.stdout:file_475 2024-09-13T18:35:27.686 INFO:teuthology.orchestra.run.smithi044.stdout:file_476 2024-09-13T18:35:27.686 INFO:teuthology.orchestra.run.smithi044.stdout:file_477 2024-09-13T18:35:27.686 INFO:teuthology.orchestra.run.smithi044.stdout:file_478 2024-09-13T18:35:27.686 INFO:teuthology.orchestra.run.smithi044.stdout:file_479 2024-09-13T18:35:27.686 INFO:teuthology.orchestra.run.smithi044.stdout:file_48 2024-09-13T18:35:27.686 INFO:teuthology.orchestra.run.smithi044.stdout:file_480 2024-09-13T18:35:27.686 INFO:teuthology.orchestra.run.smithi044.stdout:file_481 2024-09-13T18:35:27.686 INFO:teuthology.orchestra.run.smithi044.stdout:file_482 2024-09-13T18:35:27.686 INFO:teuthology.orchestra.run.smithi044.stdout:file_483 2024-09-13T18:35:27.686 INFO:teuthology.orchestra.run.smithi044.stdout:file_484 2024-09-13T18:35:27.686 INFO:teuthology.orchestra.run.smithi044.stdout:file_485 2024-09-13T18:35:27.686 INFO:teuthology.orchestra.run.smithi044.stdout:file_486 2024-09-13T18:35:27.686 INFO:teuthology.orchestra.run.smithi044.stdout:file_487 2024-09-13T18:35:27.686 INFO:teuthology.orchestra.run.smithi044.stdout:file_488 2024-09-13T18:35:27.687 INFO:teuthology.orchestra.run.smithi044.stdout:file_489 2024-09-13T18:35:27.687 INFO:teuthology.orchestra.run.smithi044.stdout:file_49 2024-09-13T18:35:27.687 INFO:teuthology.orchestra.run.smithi044.stdout:file_490 2024-09-13T18:35:27.687 INFO:teuthology.orchestra.run.smithi044.stdout:file_491 2024-09-13T18:35:27.687 INFO:teuthology.orchestra.run.smithi044.stdout:file_492 2024-09-13T18:35:27.687 INFO:teuthology.orchestra.run.smithi044.stdout:file_493 2024-09-13T18:35:27.687 INFO:teuthology.orchestra.run.smithi044.stdout:file_494 2024-09-13T18:35:27.687 INFO:teuthology.orchestra.run.smithi044.stdout:file_495 2024-09-13T18:35:27.687 INFO:teuthology.orchestra.run.smithi044.stdout:file_496 2024-09-13T18:35:27.687 INFO:teuthology.orchestra.run.smithi044.stdout:file_497 2024-09-13T18:35:27.687 INFO:teuthology.orchestra.run.smithi044.stdout:file_498 2024-09-13T18:35:27.687 INFO:teuthology.orchestra.run.smithi044.stdout:file_499 2024-09-13T18:35:27.687 INFO:teuthology.orchestra.run.smithi044.stdout:file_5 2024-09-13T18:35:27.687 INFO:teuthology.orchestra.run.smithi044.stdout:file_50 2024-09-13T18:35:27.688 INFO:teuthology.orchestra.run.smithi044.stdout:file_500 2024-09-13T18:35:27.688 INFO:teuthology.orchestra.run.smithi044.stdout:file_501 2024-09-13T18:35:27.688 INFO:teuthology.orchestra.run.smithi044.stdout:file_502 2024-09-13T18:35:27.688 INFO:teuthology.orchestra.run.smithi044.stdout:file_503 2024-09-13T18:35:27.688 INFO:teuthology.orchestra.run.smithi044.stdout:file_504 2024-09-13T18:35:27.688 INFO:teuthology.orchestra.run.smithi044.stdout:file_505 2024-09-13T18:35:27.688 INFO:teuthology.orchestra.run.smithi044.stdout:file_506 2024-09-13T18:35:27.688 INFO:teuthology.orchestra.run.smithi044.stdout:file_507 2024-09-13T18:35:27.688 INFO:teuthology.orchestra.run.smithi044.stdout:file_508 2024-09-13T18:35:27.688 INFO:teuthology.orchestra.run.smithi044.stdout:file_509 2024-09-13T18:35:27.688 INFO:teuthology.orchestra.run.smithi044.stdout:file_51 2024-09-13T18:35:27.688 INFO:teuthology.orchestra.run.smithi044.stdout:file_510 2024-09-13T18:35:27.689 INFO:teuthology.orchestra.run.smithi044.stdout:file_511 2024-09-13T18:35:27.689 INFO:teuthology.orchestra.run.smithi044.stdout:file_512 2024-09-13T18:35:27.689 INFO:teuthology.orchestra.run.smithi044.stdout:file_513 2024-09-13T18:35:27.689 INFO:teuthology.orchestra.run.smithi044.stdout:file_514 2024-09-13T18:35:27.689 INFO:teuthology.orchestra.run.smithi044.stdout:file_515 2024-09-13T18:35:27.689 INFO:teuthology.orchestra.run.smithi044.stdout:file_516 2024-09-13T18:35:27.689 INFO:teuthology.orchestra.run.smithi044.stdout:file_517 2024-09-13T18:35:27.689 INFO:teuthology.orchestra.run.smithi044.stdout:file_518 2024-09-13T18:35:27.689 INFO:teuthology.orchestra.run.smithi044.stdout:file_519 2024-09-13T18:35:27.689 INFO:teuthology.orchestra.run.smithi044.stdout:file_52 2024-09-13T18:35:27.689 INFO:teuthology.orchestra.run.smithi044.stdout:file_520 2024-09-13T18:35:27.689 INFO:teuthology.orchestra.run.smithi044.stdout:file_521 2024-09-13T18:35:27.689 INFO:teuthology.orchestra.run.smithi044.stdout:file_522 2024-09-13T18:35:27.690 INFO:teuthology.orchestra.run.smithi044.stdout:file_523 2024-09-13T18:35:27.690 INFO:teuthology.orchestra.run.smithi044.stdout:file_524 2024-09-13T18:35:27.690 INFO:teuthology.orchestra.run.smithi044.stdout:file_525 2024-09-13T18:35:27.690 INFO:teuthology.orchestra.run.smithi044.stdout:file_526 2024-09-13T18:35:27.690 INFO:teuthology.orchestra.run.smithi044.stdout:file_527 2024-09-13T18:35:27.690 INFO:teuthology.orchestra.run.smithi044.stdout:file_528 2024-09-13T18:35:27.690 INFO:teuthology.orchestra.run.smithi044.stdout:file_529 2024-09-13T18:35:27.690 INFO:teuthology.orchestra.run.smithi044.stdout:file_53 2024-09-13T18:35:27.690 INFO:teuthology.orchestra.run.smithi044.stdout:file_530 2024-09-13T18:35:27.690 INFO:teuthology.orchestra.run.smithi044.stdout:file_531 2024-09-13T18:35:27.690 INFO:teuthology.orchestra.run.smithi044.stdout:file_532 2024-09-13T18:35:27.690 INFO:teuthology.orchestra.run.smithi044.stdout:file_533 2024-09-13T18:35:27.690 INFO:teuthology.orchestra.run.smithi044.stdout:file_534 2024-09-13T18:35:27.691 INFO:teuthology.orchestra.run.smithi044.stdout:file_535 2024-09-13T18:35:27.691 INFO:teuthology.orchestra.run.smithi044.stdout:file_536 2024-09-13T18:35:27.691 INFO:teuthology.orchestra.run.smithi044.stdout:file_537 2024-09-13T18:35:27.691 INFO:teuthology.orchestra.run.smithi044.stdout:file_538 2024-09-13T18:35:27.691 INFO:teuthology.orchestra.run.smithi044.stdout:file_539 2024-09-13T18:35:27.691 INFO:teuthology.orchestra.run.smithi044.stdout:file_54 2024-09-13T18:35:27.691 INFO:teuthology.orchestra.run.smithi044.stdout:file_540 2024-09-13T18:35:27.691 INFO:teuthology.orchestra.run.smithi044.stdout:file_541 2024-09-13T18:35:27.691 INFO:teuthology.orchestra.run.smithi044.stdout:file_542 2024-09-13T18:35:27.691 INFO:teuthology.orchestra.run.smithi044.stdout:file_543 2024-09-13T18:35:27.691 INFO:teuthology.orchestra.run.smithi044.stdout:file_544 2024-09-13T18:35:27.692 INFO:teuthology.orchestra.run.smithi044.stdout:file_545 2024-09-13T18:35:27.692 INFO:teuthology.orchestra.run.smithi044.stdout:file_546 2024-09-13T18:35:27.692 INFO:teuthology.orchestra.run.smithi044.stdout:file_547 2024-09-13T18:35:27.692 INFO:teuthology.orchestra.run.smithi044.stdout:file_548 2024-09-13T18:35:27.692 INFO:teuthology.orchestra.run.smithi044.stdout:file_549 2024-09-13T18:35:27.692 INFO:teuthology.orchestra.run.smithi044.stdout:file_55 2024-09-13T18:35:27.692 INFO:teuthology.orchestra.run.smithi044.stdout:file_550 2024-09-13T18:35:27.692 INFO:teuthology.orchestra.run.smithi044.stdout:file_551 2024-09-13T18:35:27.692 INFO:teuthology.orchestra.run.smithi044.stdout:file_552 2024-09-13T18:35:27.692 INFO:teuthology.orchestra.run.smithi044.stdout:file_553 2024-09-13T18:35:27.692 INFO:teuthology.orchestra.run.smithi044.stdout:file_554 2024-09-13T18:35:27.692 INFO:teuthology.orchestra.run.smithi044.stdout:file_555 2024-09-13T18:35:27.693 INFO:teuthology.orchestra.run.smithi044.stdout:file_556 2024-09-13T18:35:27.693 INFO:teuthology.orchestra.run.smithi044.stdout:file_557 2024-09-13T18:35:27.693 INFO:teuthology.orchestra.run.smithi044.stdout:file_558 2024-09-13T18:35:27.693 INFO:teuthology.orchestra.run.smithi044.stdout:file_559 2024-09-13T18:35:27.693 INFO:teuthology.orchestra.run.smithi044.stdout:file_56 2024-09-13T18:35:27.693 INFO:teuthology.orchestra.run.smithi044.stdout:file_560 2024-09-13T18:35:27.693 INFO:teuthology.orchestra.run.smithi044.stdout:file_561 2024-09-13T18:35:27.693 INFO:teuthology.orchestra.run.smithi044.stdout:file_562 2024-09-13T18:35:27.693 INFO:teuthology.orchestra.run.smithi044.stdout:file_563 2024-09-13T18:35:27.693 INFO:teuthology.orchestra.run.smithi044.stdout:file_564 2024-09-13T18:35:27.693 INFO:teuthology.orchestra.run.smithi044.stdout:file_565 2024-09-13T18:35:27.693 INFO:teuthology.orchestra.run.smithi044.stdout:file_566 2024-09-13T18:35:27.693 INFO:teuthology.orchestra.run.smithi044.stdout:file_567 2024-09-13T18:35:27.694 INFO:teuthology.orchestra.run.smithi044.stdout:file_568 2024-09-13T18:35:27.694 INFO:teuthology.orchestra.run.smithi044.stdout:file_569 2024-09-13T18:35:27.694 INFO:teuthology.orchestra.run.smithi044.stdout:file_57 2024-09-13T18:35:27.694 INFO:teuthology.orchestra.run.smithi044.stdout:file_570 2024-09-13T18:35:27.694 INFO:teuthology.orchestra.run.smithi044.stdout:file_571 2024-09-13T18:35:27.694 INFO:teuthology.orchestra.run.smithi044.stdout:file_572 2024-09-13T18:35:27.694 INFO:teuthology.orchestra.run.smithi044.stdout:file_573 2024-09-13T18:35:27.694 INFO:teuthology.orchestra.run.smithi044.stdout:file_574 2024-09-13T18:35:27.695 INFO:teuthology.orchestra.run.smithi044.stdout:file_575 2024-09-13T18:35:27.695 INFO:teuthology.orchestra.run.smithi044.stdout:file_576 2024-09-13T18:35:27.695 INFO:teuthology.orchestra.run.smithi044.stdout:file_577 2024-09-13T18:35:27.695 INFO:teuthology.orchestra.run.smithi044.stdout:file_578 2024-09-13T18:35:27.695 INFO:teuthology.orchestra.run.smithi044.stdout:file_579 2024-09-13T18:35:27.695 INFO:teuthology.orchestra.run.smithi044.stdout:file_58 2024-09-13T18:35:27.695 INFO:teuthology.orchestra.run.smithi044.stdout:file_580 2024-09-13T18:35:27.695 INFO:teuthology.orchestra.run.smithi044.stdout:file_581 2024-09-13T18:35:27.695 INFO:teuthology.orchestra.run.smithi044.stdout:file_582 2024-09-13T18:35:27.696 INFO:teuthology.orchestra.run.smithi044.stdout:file_583 2024-09-13T18:35:27.696 INFO:teuthology.orchestra.run.smithi044.stdout:file_584 2024-09-13T18:35:27.696 INFO:teuthology.orchestra.run.smithi044.stdout:file_585 2024-09-13T18:35:27.696 INFO:teuthology.orchestra.run.smithi044.stdout:file_586 2024-09-13T18:35:27.696 INFO:teuthology.orchestra.run.smithi044.stdout:file_587 2024-09-13T18:35:27.696 INFO:teuthology.orchestra.run.smithi044.stdout:file_588 2024-09-13T18:35:27.696 INFO:teuthology.orchestra.run.smithi044.stdout:file_589 2024-09-13T18:35:27.696 INFO:teuthology.orchestra.run.smithi044.stdout:file_59 2024-09-13T18:35:27.696 INFO:teuthology.orchestra.run.smithi044.stdout:file_590 2024-09-13T18:35:27.696 INFO:teuthology.orchestra.run.smithi044.stdout:file_591 2024-09-13T18:35:27.696 INFO:teuthology.orchestra.run.smithi044.stdout:file_592 2024-09-13T18:35:27.696 INFO:teuthology.orchestra.run.smithi044.stdout:file_593 2024-09-13T18:35:27.696 INFO:teuthology.orchestra.run.smithi044.stdout:file_594 2024-09-13T18:35:27.696 INFO:teuthology.orchestra.run.smithi044.stdout:file_595 2024-09-13T18:35:27.697 INFO:teuthology.orchestra.run.smithi044.stdout:file_596 2024-09-13T18:35:27.697 INFO:teuthology.orchestra.run.smithi044.stdout:file_597 2024-09-13T18:35:27.697 INFO:teuthology.orchestra.run.smithi044.stdout:file_598 2024-09-13T18:35:27.697 INFO:teuthology.orchestra.run.smithi044.stdout:file_599 2024-09-13T18:35:27.697 INFO:teuthology.orchestra.run.smithi044.stdout:file_6 2024-09-13T18:35:27.697 INFO:teuthology.orchestra.run.smithi044.stdout:file_60 2024-09-13T18:35:27.697 INFO:teuthology.orchestra.run.smithi044.stdout:file_600 2024-09-13T18:35:27.697 INFO:teuthology.orchestra.run.smithi044.stdout:file_601 2024-09-13T18:35:27.697 INFO:teuthology.orchestra.run.smithi044.stdout:file_602 2024-09-13T18:35:27.697 INFO:teuthology.orchestra.run.smithi044.stdout:file_603 2024-09-13T18:35:27.697 INFO:teuthology.orchestra.run.smithi044.stdout:file_604 2024-09-13T18:35:27.697 INFO:teuthology.orchestra.run.smithi044.stdout:file_605 2024-09-13T18:35:27.697 INFO:teuthology.orchestra.run.smithi044.stdout:file_606 2024-09-13T18:35:27.698 INFO:teuthology.orchestra.run.smithi044.stdout:file_607 2024-09-13T18:35:27.698 INFO:teuthology.orchestra.run.smithi044.stdout:file_608 2024-09-13T18:35:27.698 INFO:teuthology.orchestra.run.smithi044.stdout:file_609 2024-09-13T18:35:27.698 INFO:teuthology.orchestra.run.smithi044.stdout:file_61 2024-09-13T18:35:27.698 INFO:teuthology.orchestra.run.smithi044.stdout:file_610 2024-09-13T18:35:27.698 INFO:teuthology.orchestra.run.smithi044.stdout:file_611 2024-09-13T18:35:27.698 INFO:teuthology.orchestra.run.smithi044.stdout:file_612 2024-09-13T18:35:27.698 INFO:teuthology.orchestra.run.smithi044.stdout:file_613 2024-09-13T18:35:27.698 INFO:teuthology.orchestra.run.smithi044.stdout:file_614 2024-09-13T18:35:27.698 INFO:teuthology.orchestra.run.smithi044.stdout:file_615 2024-09-13T18:35:27.698 INFO:teuthology.orchestra.run.smithi044.stdout:file_616 2024-09-13T18:35:27.698 INFO:teuthology.orchestra.run.smithi044.stdout:file_617 2024-09-13T18:35:27.698 INFO:teuthology.orchestra.run.smithi044.stdout:file_618 2024-09-13T18:35:27.698 INFO:teuthology.orchestra.run.smithi044.stdout:file_619 2024-09-13T18:35:27.699 INFO:teuthology.orchestra.run.smithi044.stdout:file_62 2024-09-13T18:35:27.699 INFO:teuthology.orchestra.run.smithi044.stdout:file_620 2024-09-13T18:35:27.699 INFO:teuthology.orchestra.run.smithi044.stdout:file_621 2024-09-13T18:35:27.699 INFO:teuthology.orchestra.run.smithi044.stdout:file_622 2024-09-13T18:35:27.699 INFO:teuthology.orchestra.run.smithi044.stdout:file_623 2024-09-13T18:35:27.699 INFO:teuthology.orchestra.run.smithi044.stdout:file_624 2024-09-13T18:35:27.699 INFO:teuthology.orchestra.run.smithi044.stdout:file_625 2024-09-13T18:35:27.699 INFO:teuthology.orchestra.run.smithi044.stdout:file_626 2024-09-13T18:35:27.699 INFO:teuthology.orchestra.run.smithi044.stdout:file_627 2024-09-13T18:35:27.699 INFO:teuthology.orchestra.run.smithi044.stdout:file_628 2024-09-13T18:35:27.699 INFO:teuthology.orchestra.run.smithi044.stdout:file_629 2024-09-13T18:35:27.699 INFO:teuthology.orchestra.run.smithi044.stdout:file_63 2024-09-13T18:35:27.699 INFO:teuthology.orchestra.run.smithi044.stdout:file_630 2024-09-13T18:35:27.699 INFO:teuthology.orchestra.run.smithi044.stdout:file_631 2024-09-13T18:35:27.700 INFO:teuthology.orchestra.run.smithi044.stdout:file_632 2024-09-13T18:35:27.700 INFO:teuthology.orchestra.run.smithi044.stdout:file_633 2024-09-13T18:35:27.700 INFO:teuthology.orchestra.run.smithi044.stdout:file_634 2024-09-13T18:35:27.700 INFO:teuthology.orchestra.run.smithi044.stdout:file_635 2024-09-13T18:35:27.700 INFO:teuthology.orchestra.run.smithi044.stdout:file_636 2024-09-13T18:35:27.700 INFO:teuthology.orchestra.run.smithi044.stdout:file_637 2024-09-13T18:35:27.700 INFO:teuthology.orchestra.run.smithi044.stdout:file_638 2024-09-13T18:35:27.700 INFO:teuthology.orchestra.run.smithi044.stdout:file_639 2024-09-13T18:35:27.700 INFO:teuthology.orchestra.run.smithi044.stdout:file_64 2024-09-13T18:35:27.700 INFO:teuthology.orchestra.run.smithi044.stdout:file_640 2024-09-13T18:35:27.700 INFO:teuthology.orchestra.run.smithi044.stdout:file_641 2024-09-13T18:35:27.700 INFO:teuthology.orchestra.run.smithi044.stdout:file_642 2024-09-13T18:35:27.701 INFO:teuthology.orchestra.run.smithi044.stdout:file_643 2024-09-13T18:35:27.701 INFO:teuthology.orchestra.run.smithi044.stdout:file_644 2024-09-13T18:35:27.701 INFO:teuthology.orchestra.run.smithi044.stdout:file_645 2024-09-13T18:35:27.701 INFO:teuthology.orchestra.run.smithi044.stdout:file_646 2024-09-13T18:35:27.701 INFO:teuthology.orchestra.run.smithi044.stdout:file_647 2024-09-13T18:35:27.701 INFO:teuthology.orchestra.run.smithi044.stdout:file_648 2024-09-13T18:35:27.701 INFO:teuthology.orchestra.run.smithi044.stdout:file_649 2024-09-13T18:35:27.701 INFO:teuthology.orchestra.run.smithi044.stdout:file_65 2024-09-13T18:35:27.701 INFO:teuthology.orchestra.run.smithi044.stdout:file_650 2024-09-13T18:35:27.701 INFO:teuthology.orchestra.run.smithi044.stdout:file_651 2024-09-13T18:35:27.702 INFO:teuthology.orchestra.run.smithi044.stdout:file_652 2024-09-13T18:35:27.702 INFO:teuthology.orchestra.run.smithi044.stdout:file_653 2024-09-13T18:35:27.702 INFO:teuthology.orchestra.run.smithi044.stdout:file_654 2024-09-13T18:35:27.702 INFO:teuthology.orchestra.run.smithi044.stdout:file_655 2024-09-13T18:35:27.702 INFO:teuthology.orchestra.run.smithi044.stdout:file_656 2024-09-13T18:35:27.702 INFO:teuthology.orchestra.run.smithi044.stdout:file_657 2024-09-13T18:35:27.702 INFO:teuthology.orchestra.run.smithi044.stdout:file_658 2024-09-13T18:35:27.702 INFO:teuthology.orchestra.run.smithi044.stdout:file_659 2024-09-13T18:35:27.702 INFO:teuthology.orchestra.run.smithi044.stdout:file_66 2024-09-13T18:35:27.702 INFO:teuthology.orchestra.run.smithi044.stdout:file_660 2024-09-13T18:35:27.702 INFO:teuthology.orchestra.run.smithi044.stdout:file_661 2024-09-13T18:35:27.702 INFO:teuthology.orchestra.run.smithi044.stdout:file_662 2024-09-13T18:35:27.702 INFO:teuthology.orchestra.run.smithi044.stdout:file_663 2024-09-13T18:35:27.702 INFO:teuthology.orchestra.run.smithi044.stdout:file_664 2024-09-13T18:35:27.703 INFO:teuthology.orchestra.run.smithi044.stdout:file_665 2024-09-13T18:35:27.703 INFO:teuthology.orchestra.run.smithi044.stdout:file_666 2024-09-13T18:35:27.703 INFO:teuthology.orchestra.run.smithi044.stdout:file_667 2024-09-13T18:35:27.703 INFO:teuthology.orchestra.run.smithi044.stdout:file_668 2024-09-13T18:35:27.703 INFO:teuthology.orchestra.run.smithi044.stdout:file_669 2024-09-13T18:35:27.703 INFO:teuthology.orchestra.run.smithi044.stdout:file_67 2024-09-13T18:35:27.703 INFO:teuthology.orchestra.run.smithi044.stdout:file_670 2024-09-13T18:35:27.703 INFO:teuthology.orchestra.run.smithi044.stdout:file_671 2024-09-13T18:35:27.703 INFO:teuthology.orchestra.run.smithi044.stdout:file_672 2024-09-13T18:35:27.703 INFO:teuthology.orchestra.run.smithi044.stdout:file_673 2024-09-13T18:35:27.703 INFO:teuthology.orchestra.run.smithi044.stdout:file_674 2024-09-13T18:35:27.703 INFO:teuthology.orchestra.run.smithi044.stdout:file_675 2024-09-13T18:35:27.703 INFO:teuthology.orchestra.run.smithi044.stdout:file_676 2024-09-13T18:35:27.703 INFO:teuthology.orchestra.run.smithi044.stdout:file_677 2024-09-13T18:35:27.704 INFO:teuthology.orchestra.run.smithi044.stdout:file_678 2024-09-13T18:35:27.704 INFO:teuthology.orchestra.run.smithi044.stdout:file_679 2024-09-13T18:35:27.704 INFO:teuthology.orchestra.run.smithi044.stdout:file_68 2024-09-13T18:35:27.704 INFO:teuthology.orchestra.run.smithi044.stdout:file_680 2024-09-13T18:35:27.704 INFO:teuthology.orchestra.run.smithi044.stdout:file_681 2024-09-13T18:35:27.704 INFO:teuthology.orchestra.run.smithi044.stdout:file_682 2024-09-13T18:35:27.704 INFO:teuthology.orchestra.run.smithi044.stdout:file_683 2024-09-13T18:35:27.704 INFO:teuthology.orchestra.run.smithi044.stdout:file_684 2024-09-13T18:35:27.704 INFO:teuthology.orchestra.run.smithi044.stdout:file_685 2024-09-13T18:35:27.704 INFO:teuthology.orchestra.run.smithi044.stdout:file_686 2024-09-13T18:35:27.704 INFO:teuthology.orchestra.run.smithi044.stdout:file_687 2024-09-13T18:35:27.704 INFO:teuthology.orchestra.run.smithi044.stdout:file_688 2024-09-13T18:35:27.704 INFO:teuthology.orchestra.run.smithi044.stdout:file_689 2024-09-13T18:35:27.705 INFO:teuthology.orchestra.run.smithi044.stdout:file_69 2024-09-13T18:35:27.705 INFO:teuthology.orchestra.run.smithi044.stdout:file_690 2024-09-13T18:35:27.705 INFO:teuthology.orchestra.run.smithi044.stdout:file_691 2024-09-13T18:35:27.705 INFO:teuthology.orchestra.run.smithi044.stdout:file_692 2024-09-13T18:35:27.705 INFO:teuthology.orchestra.run.smithi044.stdout:file_693 2024-09-13T18:35:27.705 INFO:teuthology.orchestra.run.smithi044.stdout:file_694 2024-09-13T18:35:27.705 INFO:teuthology.orchestra.run.smithi044.stdout:file_695 2024-09-13T18:35:27.705 INFO:teuthology.orchestra.run.smithi044.stdout:file_696 2024-09-13T18:35:27.705 INFO:teuthology.orchestra.run.smithi044.stdout:file_697 2024-09-13T18:35:27.705 INFO:teuthology.orchestra.run.smithi044.stdout:file_698 2024-09-13T18:35:27.705 INFO:teuthology.orchestra.run.smithi044.stdout:file_699 2024-09-13T18:35:27.705 INFO:teuthology.orchestra.run.smithi044.stdout:file_7 2024-09-13T18:35:27.705 INFO:teuthology.orchestra.run.smithi044.stdout:file_70 2024-09-13T18:35:27.705 INFO:teuthology.orchestra.run.smithi044.stdout:file_700 2024-09-13T18:35:27.706 INFO:teuthology.orchestra.run.smithi044.stdout:file_701 2024-09-13T18:35:27.706 INFO:teuthology.orchestra.run.smithi044.stdout:file_702 2024-09-13T18:35:27.706 INFO:teuthology.orchestra.run.smithi044.stdout:file_703 2024-09-13T18:35:27.706 INFO:teuthology.orchestra.run.smithi044.stdout:file_704 2024-09-13T18:35:27.706 INFO:teuthology.orchestra.run.smithi044.stdout:file_705 2024-09-13T18:35:27.706 INFO:teuthology.orchestra.run.smithi044.stdout:file_706 2024-09-13T18:35:27.706 INFO:teuthology.orchestra.run.smithi044.stdout:file_707 2024-09-13T18:35:27.706 INFO:teuthology.orchestra.run.smithi044.stdout:file_708 2024-09-13T18:35:27.706 INFO:teuthology.orchestra.run.smithi044.stdout:file_709 2024-09-13T18:35:27.706 INFO:teuthology.orchestra.run.smithi044.stdout:file_71 2024-09-13T18:35:27.706 INFO:teuthology.orchestra.run.smithi044.stdout:file_710 2024-09-13T18:35:27.706 INFO:teuthology.orchestra.run.smithi044.stdout:file_711 2024-09-13T18:35:27.706 INFO:teuthology.orchestra.run.smithi044.stdout:file_712 2024-09-13T18:35:27.706 INFO:teuthology.orchestra.run.smithi044.stdout:file_713 2024-09-13T18:35:27.706 INFO:teuthology.orchestra.run.smithi044.stdout:file_714 2024-09-13T18:35:27.707 INFO:teuthology.orchestra.run.smithi044.stdout:file_715 2024-09-13T18:35:27.707 INFO:teuthology.orchestra.run.smithi044.stdout:file_716 2024-09-13T18:35:27.707 INFO:teuthology.orchestra.run.smithi044.stdout:file_717 2024-09-13T18:35:27.707 INFO:teuthology.orchestra.run.smithi044.stdout:file_718 2024-09-13T18:35:27.707 INFO:teuthology.orchestra.run.smithi044.stdout:file_719 2024-09-13T18:35:27.707 INFO:teuthology.orchestra.run.smithi044.stdout:file_72 2024-09-13T18:35:27.707 INFO:teuthology.orchestra.run.smithi044.stdout:file_720 2024-09-13T18:35:27.707 INFO:teuthology.orchestra.run.smithi044.stdout:file_721 2024-09-13T18:35:27.707 INFO:teuthology.orchestra.run.smithi044.stdout:file_722 2024-09-13T18:35:27.707 INFO:teuthology.orchestra.run.smithi044.stdout:file_723 2024-09-13T18:35:27.707 INFO:teuthology.orchestra.run.smithi044.stdout:file_724 2024-09-13T18:35:27.707 INFO:teuthology.orchestra.run.smithi044.stdout:file_725 2024-09-13T18:35:27.707 INFO:teuthology.orchestra.run.smithi044.stdout:file_726 2024-09-13T18:35:27.708 INFO:teuthology.orchestra.run.smithi044.stdout:file_727 2024-09-13T18:35:27.708 INFO:teuthology.orchestra.run.smithi044.stdout:file_728 2024-09-13T18:35:27.708 INFO:teuthology.orchestra.run.smithi044.stdout:file_729 2024-09-13T18:35:27.708 INFO:teuthology.orchestra.run.smithi044.stdout:file_73 2024-09-13T18:35:27.708 INFO:teuthology.orchestra.run.smithi044.stdout:file_730 2024-09-13T18:35:27.708 INFO:teuthology.orchestra.run.smithi044.stdout:file_731 2024-09-13T18:35:27.708 INFO:teuthology.orchestra.run.smithi044.stdout:file_732 2024-09-13T18:35:27.708 INFO:teuthology.orchestra.run.smithi044.stdout:file_733 2024-09-13T18:35:27.708 INFO:teuthology.orchestra.run.smithi044.stdout:file_734 2024-09-13T18:35:27.708 INFO:teuthology.orchestra.run.smithi044.stdout:file_735 2024-09-13T18:35:27.708 INFO:teuthology.orchestra.run.smithi044.stdout:file_736 2024-09-13T18:35:27.708 INFO:teuthology.orchestra.run.smithi044.stdout:file_737 2024-09-13T18:35:27.708 INFO:teuthology.orchestra.run.smithi044.stdout:file_738 2024-09-13T18:35:27.708 INFO:teuthology.orchestra.run.smithi044.stdout:file_739 2024-09-13T18:35:27.709 INFO:teuthology.orchestra.run.smithi044.stdout:file_74 2024-09-13T18:35:27.709 INFO:teuthology.orchestra.run.smithi044.stdout:file_740 2024-09-13T18:35:27.709 INFO:teuthology.orchestra.run.smithi044.stdout:file_741 2024-09-13T18:35:27.709 INFO:teuthology.orchestra.run.smithi044.stdout:file_742 2024-09-13T18:35:27.709 INFO:teuthology.orchestra.run.smithi044.stdout:file_743 2024-09-13T18:35:27.709 INFO:teuthology.orchestra.run.smithi044.stdout:file_744 2024-09-13T18:35:27.709 INFO:teuthology.orchestra.run.smithi044.stdout:file_745 2024-09-13T18:35:27.709 INFO:teuthology.orchestra.run.smithi044.stdout:file_746 2024-09-13T18:35:27.709 INFO:teuthology.orchestra.run.smithi044.stdout:file_747 2024-09-13T18:35:27.709 INFO:teuthology.orchestra.run.smithi044.stdout:file_748 2024-09-13T18:35:27.709 INFO:teuthology.orchestra.run.smithi044.stdout:file_749 2024-09-13T18:35:27.709 INFO:teuthology.orchestra.run.smithi044.stdout:file_75 2024-09-13T18:35:27.709 INFO:teuthology.orchestra.run.smithi044.stdout:file_750 2024-09-13T18:35:27.710 INFO:teuthology.orchestra.run.smithi044.stdout:file_751 2024-09-13T18:35:27.710 INFO:teuthology.orchestra.run.smithi044.stdout:file_752 2024-09-13T18:35:27.710 INFO:teuthology.orchestra.run.smithi044.stdout:file_753 2024-09-13T18:35:27.710 INFO:teuthology.orchestra.run.smithi044.stdout:file_754 2024-09-13T18:35:27.710 INFO:teuthology.orchestra.run.smithi044.stdout:file_755 2024-09-13T18:35:27.710 INFO:teuthology.orchestra.run.smithi044.stdout:file_756 2024-09-13T18:35:27.710 INFO:teuthology.orchestra.run.smithi044.stdout:file_757 2024-09-13T18:35:27.710 INFO:teuthology.orchestra.run.smithi044.stdout:file_758 2024-09-13T18:35:27.710 INFO:teuthology.orchestra.run.smithi044.stdout:file_759 2024-09-13T18:35:27.710 INFO:teuthology.orchestra.run.smithi044.stdout:file_76 2024-09-13T18:35:27.710 INFO:teuthology.orchestra.run.smithi044.stdout:file_760 2024-09-13T18:35:27.710 INFO:teuthology.orchestra.run.smithi044.stdout:file_761 2024-09-13T18:35:27.710 INFO:teuthology.orchestra.run.smithi044.stdout:file_762 2024-09-13T18:35:27.710 INFO:teuthology.orchestra.run.smithi044.stdout:file_763 2024-09-13T18:35:27.711 INFO:teuthology.orchestra.run.smithi044.stdout:file_764 2024-09-13T18:35:27.711 INFO:teuthology.orchestra.run.smithi044.stdout:file_765 2024-09-13T18:35:27.711 INFO:teuthology.orchestra.run.smithi044.stdout:file_766 2024-09-13T18:35:27.711 INFO:teuthology.orchestra.run.smithi044.stdout:file_767 2024-09-13T18:35:27.711 INFO:teuthology.orchestra.run.smithi044.stdout:file_768 2024-09-13T18:35:27.711 INFO:teuthology.orchestra.run.smithi044.stdout:file_769 2024-09-13T18:35:27.711 INFO:teuthology.orchestra.run.smithi044.stdout:file_77 2024-09-13T18:35:27.711 INFO:teuthology.orchestra.run.smithi044.stdout:file_770 2024-09-13T18:35:27.711 INFO:teuthology.orchestra.run.smithi044.stdout:file_771 2024-09-13T18:35:27.711 INFO:teuthology.orchestra.run.smithi044.stdout:file_772 2024-09-13T18:35:27.711 INFO:teuthology.orchestra.run.smithi044.stdout:file_773 2024-09-13T18:35:27.711 INFO:teuthology.orchestra.run.smithi044.stdout:file_774 2024-09-13T18:35:27.711 INFO:teuthology.orchestra.run.smithi044.stdout:file_775 2024-09-13T18:35:27.711 INFO:teuthology.orchestra.run.smithi044.stdout:file_776 2024-09-13T18:35:27.712 INFO:teuthology.orchestra.run.smithi044.stdout:file_777 2024-09-13T18:35:27.712 INFO:teuthology.orchestra.run.smithi044.stdout:file_778 2024-09-13T18:35:27.712 INFO:teuthology.orchestra.run.smithi044.stdout:file_779 2024-09-13T18:35:27.712 INFO:teuthology.orchestra.run.smithi044.stdout:file_78 2024-09-13T18:35:27.712 INFO:teuthology.orchestra.run.smithi044.stdout:file_780 2024-09-13T18:35:27.712 INFO:teuthology.orchestra.run.smithi044.stdout:file_781 2024-09-13T18:35:27.712 INFO:teuthology.orchestra.run.smithi044.stdout:file_782 2024-09-13T18:35:27.712 INFO:teuthology.orchestra.run.smithi044.stdout:file_783 2024-09-13T18:35:27.712 INFO:teuthology.orchestra.run.smithi044.stdout:file_784 2024-09-13T18:35:27.712 INFO:teuthology.orchestra.run.smithi044.stdout:file_785 2024-09-13T18:35:27.712 INFO:teuthology.orchestra.run.smithi044.stdout:file_786 2024-09-13T18:35:27.712 INFO:teuthology.orchestra.run.smithi044.stdout:file_787 2024-09-13T18:35:27.712 INFO:teuthology.orchestra.run.smithi044.stdout:file_788 2024-09-13T18:35:27.712 INFO:teuthology.orchestra.run.smithi044.stdout:file_789 2024-09-13T18:35:27.713 INFO:teuthology.orchestra.run.smithi044.stdout:file_79 2024-09-13T18:35:27.713 INFO:teuthology.orchestra.run.smithi044.stdout:file_790 2024-09-13T18:35:27.713 INFO:teuthology.orchestra.run.smithi044.stdout:file_791 2024-09-13T18:35:27.713 INFO:teuthology.orchestra.run.smithi044.stdout:file_792 2024-09-13T18:35:27.713 INFO:teuthology.orchestra.run.smithi044.stdout:file_793 2024-09-13T18:35:27.713 INFO:teuthology.orchestra.run.smithi044.stdout:file_794 2024-09-13T18:35:27.713 INFO:teuthology.orchestra.run.smithi044.stdout:file_795 2024-09-13T18:35:27.713 INFO:teuthology.orchestra.run.smithi044.stdout:file_796 2024-09-13T18:35:27.713 INFO:teuthology.orchestra.run.smithi044.stdout:file_797 2024-09-13T18:35:27.713 INFO:teuthology.orchestra.run.smithi044.stdout:file_798 2024-09-13T18:35:27.713 INFO:teuthology.orchestra.run.smithi044.stdout:file_799 2024-09-13T18:35:27.713 INFO:teuthology.orchestra.run.smithi044.stdout:file_8 2024-09-13T18:35:27.714 INFO:teuthology.orchestra.run.smithi044.stdout:file_80 2024-09-13T18:35:27.714 INFO:teuthology.orchestra.run.smithi044.stdout:file_800 2024-09-13T18:35:27.714 INFO:teuthology.orchestra.run.smithi044.stdout:file_801 2024-09-13T18:35:27.714 INFO:teuthology.orchestra.run.smithi044.stdout:file_802 2024-09-13T18:35:27.714 INFO:teuthology.orchestra.run.smithi044.stdout:file_803 2024-09-13T18:35:27.714 INFO:teuthology.orchestra.run.smithi044.stdout:file_804 2024-09-13T18:35:27.714 INFO:teuthology.orchestra.run.smithi044.stdout:file_805 2024-09-13T18:35:27.715 INFO:teuthology.orchestra.run.smithi044.stdout:file_806 2024-09-13T18:35:27.715 INFO:teuthology.orchestra.run.smithi044.stdout:file_807 2024-09-13T18:35:27.715 INFO:teuthology.orchestra.run.smithi044.stdout:file_808 2024-09-13T18:35:27.715 INFO:teuthology.orchestra.run.smithi044.stdout:file_809 2024-09-13T18:35:27.715 INFO:teuthology.orchestra.run.smithi044.stdout:file_81 2024-09-13T18:35:27.715 INFO:teuthology.orchestra.run.smithi044.stdout:file_810 2024-09-13T18:35:27.715 INFO:teuthology.orchestra.run.smithi044.stdout:file_811 2024-09-13T18:35:27.715 INFO:teuthology.orchestra.run.smithi044.stdout:file_812 2024-09-13T18:35:27.715 INFO:teuthology.orchestra.run.smithi044.stdout:file_813 2024-09-13T18:35:27.715 INFO:teuthology.orchestra.run.smithi044.stdout:file_814 2024-09-13T18:35:27.716 INFO:teuthology.orchestra.run.smithi044.stdout:file_815 2024-09-13T18:35:27.716 INFO:teuthology.orchestra.run.smithi044.stdout:file_816 2024-09-13T18:35:27.716 INFO:teuthology.orchestra.run.smithi044.stdout:file_817 2024-09-13T18:35:27.716 INFO:teuthology.orchestra.run.smithi044.stdout:file_818 2024-09-13T18:35:27.716 INFO:teuthology.orchestra.run.smithi044.stdout:file_819 2024-09-13T18:35:27.716 INFO:teuthology.orchestra.run.smithi044.stdout:file_82 2024-09-13T18:35:27.716 INFO:teuthology.orchestra.run.smithi044.stdout:file_820 2024-09-13T18:35:27.716 INFO:teuthology.orchestra.run.smithi044.stdout:file_821 2024-09-13T18:35:27.716 INFO:teuthology.orchestra.run.smithi044.stdout:file_822 2024-09-13T18:35:27.716 INFO:teuthology.orchestra.run.smithi044.stdout:file_823 2024-09-13T18:35:27.716 INFO:teuthology.orchestra.run.smithi044.stdout:file_824 2024-09-13T18:35:27.716 INFO:teuthology.orchestra.run.smithi044.stdout:file_825 2024-09-13T18:35:27.717 INFO:teuthology.orchestra.run.smithi044.stdout:file_826 2024-09-13T18:35:27.717 INFO:teuthology.orchestra.run.smithi044.stdout:file_827 2024-09-13T18:35:27.717 INFO:teuthology.orchestra.run.smithi044.stdout:file_828 2024-09-13T18:35:27.717 INFO:teuthology.orchestra.run.smithi044.stdout:file_829 2024-09-13T18:35:27.717 INFO:teuthology.orchestra.run.smithi044.stdout:file_83 2024-09-13T18:35:27.717 INFO:teuthology.orchestra.run.smithi044.stdout:file_830 2024-09-13T18:35:27.717 INFO:teuthology.orchestra.run.smithi044.stdout:file_831 2024-09-13T18:35:27.717 INFO:teuthology.orchestra.run.smithi044.stdout:file_832 2024-09-13T18:35:27.717 INFO:teuthology.orchestra.run.smithi044.stdout:file_833 2024-09-13T18:35:27.717 INFO:teuthology.orchestra.run.smithi044.stdout:file_834 2024-09-13T18:35:27.717 INFO:teuthology.orchestra.run.smithi044.stdout:file_835 2024-09-13T18:35:27.717 INFO:teuthology.orchestra.run.smithi044.stdout:file_836 2024-09-13T18:35:27.717 INFO:teuthology.orchestra.run.smithi044.stdout:file_837 2024-09-13T18:35:27.718 INFO:teuthology.orchestra.run.smithi044.stdout:file_838 2024-09-13T18:35:27.718 INFO:teuthology.orchestra.run.smithi044.stdout:file_839 2024-09-13T18:35:27.718 INFO:teuthology.orchestra.run.smithi044.stdout:file_84 2024-09-13T18:35:27.718 INFO:teuthology.orchestra.run.smithi044.stdout:file_840 2024-09-13T18:35:27.718 INFO:teuthology.orchestra.run.smithi044.stdout:file_841 2024-09-13T18:35:27.718 INFO:teuthology.orchestra.run.smithi044.stdout:file_842 2024-09-13T18:35:27.718 INFO:teuthology.orchestra.run.smithi044.stdout:file_843 2024-09-13T18:35:27.718 INFO:teuthology.orchestra.run.smithi044.stdout:file_844 2024-09-13T18:35:27.718 INFO:teuthology.orchestra.run.smithi044.stdout:file_845 2024-09-13T18:35:27.718 INFO:teuthology.orchestra.run.smithi044.stdout:file_846 2024-09-13T18:35:27.718 INFO:teuthology.orchestra.run.smithi044.stdout:file_847 2024-09-13T18:35:27.718 INFO:teuthology.orchestra.run.smithi044.stdout:file_848 2024-09-13T18:35:27.718 INFO:teuthology.orchestra.run.smithi044.stdout:file_849 2024-09-13T18:35:27.718 INFO:teuthology.orchestra.run.smithi044.stdout:file_85 2024-09-13T18:35:27.719 INFO:teuthology.orchestra.run.smithi044.stdout:file_850 2024-09-13T18:35:27.719 INFO:teuthology.orchestra.run.smithi044.stdout:file_851 2024-09-13T18:35:27.719 INFO:teuthology.orchestra.run.smithi044.stdout:file_852 2024-09-13T18:35:27.719 INFO:teuthology.orchestra.run.smithi044.stdout:file_853 2024-09-13T18:35:27.719 INFO:teuthology.orchestra.run.smithi044.stdout:file_854 2024-09-13T18:35:27.719 INFO:teuthology.orchestra.run.smithi044.stdout:file_855 2024-09-13T18:35:27.719 INFO:teuthology.orchestra.run.smithi044.stdout:file_856 2024-09-13T18:35:27.719 INFO:teuthology.orchestra.run.smithi044.stdout:file_857 2024-09-13T18:35:27.719 INFO:teuthology.orchestra.run.smithi044.stdout:file_858 2024-09-13T18:35:27.719 INFO:teuthology.orchestra.run.smithi044.stdout:file_859 2024-09-13T18:35:27.719 INFO:teuthology.orchestra.run.smithi044.stdout:file_86 2024-09-13T18:35:27.719 INFO:teuthology.orchestra.run.smithi044.stdout:file_860 2024-09-13T18:35:27.719 INFO:teuthology.orchestra.run.smithi044.stdout:file_861 2024-09-13T18:35:27.720 INFO:teuthology.orchestra.run.smithi044.stdout:file_862 2024-09-13T18:35:27.720 INFO:teuthology.orchestra.run.smithi044.stdout:file_863 2024-09-13T18:35:27.720 INFO:teuthology.orchestra.run.smithi044.stdout:file_864 2024-09-13T18:35:27.720 INFO:teuthology.orchestra.run.smithi044.stdout:file_865 2024-09-13T18:35:27.720 INFO:teuthology.orchestra.run.smithi044.stdout:file_866 2024-09-13T18:35:27.720 INFO:teuthology.orchestra.run.smithi044.stdout:file_867 2024-09-13T18:35:27.720 INFO:teuthology.orchestra.run.smithi044.stdout:file_868 2024-09-13T18:35:27.720 INFO:teuthology.orchestra.run.smithi044.stdout:file_869 2024-09-13T18:35:27.720 INFO:teuthology.orchestra.run.smithi044.stdout:file_87 2024-09-13T18:35:27.720 INFO:teuthology.orchestra.run.smithi044.stdout:file_870 2024-09-13T18:35:27.721 INFO:teuthology.orchestra.run.smithi044.stdout:file_871 2024-09-13T18:35:27.721 INFO:teuthology.orchestra.run.smithi044.stdout:file_872 2024-09-13T18:35:27.721 INFO:teuthology.orchestra.run.smithi044.stdout:file_873 2024-09-13T18:35:27.721 INFO:teuthology.orchestra.run.smithi044.stdout:file_874 2024-09-13T18:35:27.721 INFO:teuthology.orchestra.run.smithi044.stdout:file_875 2024-09-13T18:35:27.721 INFO:teuthology.orchestra.run.smithi044.stdout:file_876 2024-09-13T18:35:27.721 INFO:teuthology.orchestra.run.smithi044.stdout:file_877 2024-09-13T18:35:27.721 INFO:teuthology.orchestra.run.smithi044.stdout:file_878 2024-09-13T18:35:27.721 INFO:teuthology.orchestra.run.smithi044.stdout:file_879 2024-09-13T18:35:27.721 INFO:teuthology.orchestra.run.smithi044.stdout:file_88 2024-09-13T18:35:27.721 INFO:teuthology.orchestra.run.smithi044.stdout:file_880 2024-09-13T18:35:27.721 INFO:teuthology.orchestra.run.smithi044.stdout:file_881 2024-09-13T18:35:27.721 INFO:teuthology.orchestra.run.smithi044.stdout:file_882 2024-09-13T18:35:27.721 INFO:teuthology.orchestra.run.smithi044.stdout:file_883 2024-09-13T18:35:27.722 INFO:teuthology.orchestra.run.smithi044.stdout:file_884 2024-09-13T18:35:27.722 INFO:teuthology.orchestra.run.smithi044.stdout:file_885 2024-09-13T18:35:27.722 INFO:teuthology.orchestra.run.smithi044.stdout:file_886 2024-09-13T18:35:27.722 INFO:teuthology.orchestra.run.smithi044.stdout:file_887 2024-09-13T18:35:27.722 INFO:teuthology.orchestra.run.smithi044.stdout:file_888 2024-09-13T18:35:27.722 INFO:teuthology.orchestra.run.smithi044.stdout:file_889 2024-09-13T18:35:27.722 INFO:teuthology.orchestra.run.smithi044.stdout:file_89 2024-09-13T18:35:27.722 INFO:teuthology.orchestra.run.smithi044.stdout:file_890 2024-09-13T18:35:27.722 INFO:teuthology.orchestra.run.smithi044.stdout:file_891 2024-09-13T18:35:27.722 INFO:teuthology.orchestra.run.smithi044.stdout:file_892 2024-09-13T18:35:27.722 INFO:teuthology.orchestra.run.smithi044.stdout:file_893 2024-09-13T18:35:27.722 INFO:teuthology.orchestra.run.smithi044.stdout:file_894 2024-09-13T18:35:27.722 INFO:teuthology.orchestra.run.smithi044.stdout:file_895 2024-09-13T18:35:27.722 INFO:teuthology.orchestra.run.smithi044.stdout:file_896 2024-09-13T18:35:27.723 INFO:teuthology.orchestra.run.smithi044.stdout:file_897 2024-09-13T18:35:27.723 INFO:teuthology.orchestra.run.smithi044.stdout:file_898 2024-09-13T18:35:27.723 INFO:teuthology.orchestra.run.smithi044.stdout:file_899 2024-09-13T18:35:27.723 INFO:teuthology.orchestra.run.smithi044.stdout:file_9 2024-09-13T18:35:27.723 INFO:teuthology.orchestra.run.smithi044.stdout:file_90 2024-09-13T18:35:27.723 INFO:teuthology.orchestra.run.smithi044.stdout:file_900 2024-09-13T18:35:27.723 INFO:teuthology.orchestra.run.smithi044.stdout:file_901 2024-09-13T18:35:27.723 INFO:teuthology.orchestra.run.smithi044.stdout:file_902 2024-09-13T18:35:27.723 INFO:teuthology.orchestra.run.smithi044.stdout:file_903 2024-09-13T18:35:27.723 INFO:teuthology.orchestra.run.smithi044.stdout:file_904 2024-09-13T18:35:27.723 INFO:teuthology.orchestra.run.smithi044.stdout:file_905 2024-09-13T18:35:27.723 INFO:teuthology.orchestra.run.smithi044.stdout:file_906 2024-09-13T18:35:27.723 INFO:teuthology.orchestra.run.smithi044.stdout:file_907 2024-09-13T18:35:27.724 INFO:teuthology.orchestra.run.smithi044.stdout:file_908 2024-09-13T18:35:27.724 INFO:teuthology.orchestra.run.smithi044.stdout:file_909 2024-09-13T18:35:27.724 INFO:teuthology.orchestra.run.smithi044.stdout:file_91 2024-09-13T18:35:27.724 INFO:teuthology.orchestra.run.smithi044.stdout:file_910 2024-09-13T18:35:27.724 INFO:teuthology.orchestra.run.smithi044.stdout:file_911 2024-09-13T18:35:27.724 INFO:teuthology.orchestra.run.smithi044.stdout:file_912 2024-09-13T18:35:27.724 INFO:teuthology.orchestra.run.smithi044.stdout:file_913 2024-09-13T18:35:27.724 INFO:teuthology.orchestra.run.smithi044.stdout:file_914 2024-09-13T18:35:27.724 INFO:teuthology.orchestra.run.smithi044.stdout:file_915 2024-09-13T18:35:27.724 INFO:teuthology.orchestra.run.smithi044.stdout:file_916 2024-09-13T18:35:27.724 INFO:teuthology.orchestra.run.smithi044.stdout:file_917 2024-09-13T18:35:27.724 INFO:teuthology.orchestra.run.smithi044.stdout:file_918 2024-09-13T18:35:27.724 INFO:teuthology.orchestra.run.smithi044.stdout:file_919 2024-09-13T18:35:27.725 INFO:teuthology.orchestra.run.smithi044.stdout:file_92 2024-09-13T18:35:27.725 INFO:teuthology.orchestra.run.smithi044.stdout:file_920 2024-09-13T18:35:27.725 INFO:teuthology.orchestra.run.smithi044.stdout:file_921 2024-09-13T18:35:27.725 INFO:teuthology.orchestra.run.smithi044.stdout:file_922 2024-09-13T18:35:27.725 INFO:teuthology.orchestra.run.smithi044.stdout:file_923 2024-09-13T18:35:27.725 INFO:teuthology.orchestra.run.smithi044.stdout:file_924 2024-09-13T18:35:27.725 INFO:teuthology.orchestra.run.smithi044.stdout:file_925 2024-09-13T18:35:27.725 INFO:teuthology.orchestra.run.smithi044.stdout:file_926 2024-09-13T18:35:27.725 INFO:teuthology.orchestra.run.smithi044.stdout:file_927 2024-09-13T18:35:27.725 INFO:teuthology.orchestra.run.smithi044.stdout:file_928 2024-09-13T18:35:27.725 INFO:teuthology.orchestra.run.smithi044.stdout:file_929 2024-09-13T18:35:27.725 INFO:teuthology.orchestra.run.smithi044.stdout:file_93 2024-09-13T18:35:27.725 INFO:teuthology.orchestra.run.smithi044.stdout:file_930 2024-09-13T18:35:27.725 INFO:teuthology.orchestra.run.smithi044.stdout:file_931 2024-09-13T18:35:27.726 INFO:teuthology.orchestra.run.smithi044.stdout:file_932 2024-09-13T18:35:27.726 INFO:teuthology.orchestra.run.smithi044.stdout:file_933 2024-09-13T18:35:27.726 INFO:teuthology.orchestra.run.smithi044.stdout:file_934 2024-09-13T18:35:27.726 INFO:teuthology.orchestra.run.smithi044.stdout:file_935 2024-09-13T18:35:27.726 INFO:teuthology.orchestra.run.smithi044.stdout:file_936 2024-09-13T18:35:27.726 INFO:teuthology.orchestra.run.smithi044.stdout:file_937 2024-09-13T18:35:27.726 INFO:teuthology.orchestra.run.smithi044.stdout:file_938 2024-09-13T18:35:27.726 INFO:teuthology.orchestra.run.smithi044.stdout:file_939 2024-09-13T18:35:27.726 INFO:teuthology.orchestra.run.smithi044.stdout:file_94 2024-09-13T18:35:27.726 INFO:teuthology.orchestra.run.smithi044.stdout:file_940 2024-09-13T18:35:27.726 INFO:teuthology.orchestra.run.smithi044.stdout:file_941 2024-09-13T18:35:27.726 INFO:teuthology.orchestra.run.smithi044.stdout:file_942 2024-09-13T18:35:27.726 INFO:teuthology.orchestra.run.smithi044.stdout:file_943 2024-09-13T18:35:27.726 INFO:teuthology.orchestra.run.smithi044.stdout:file_944 2024-09-13T18:35:27.726 INFO:teuthology.orchestra.run.smithi044.stdout:file_945 2024-09-13T18:35:27.727 INFO:teuthology.orchestra.run.smithi044.stdout:file_946 2024-09-13T18:35:27.727 INFO:teuthology.orchestra.run.smithi044.stdout:file_947 2024-09-13T18:35:27.727 INFO:teuthology.orchestra.run.smithi044.stdout:file_948 2024-09-13T18:35:27.727 INFO:teuthology.orchestra.run.smithi044.stdout:file_949 2024-09-13T18:35:27.727 INFO:teuthology.orchestra.run.smithi044.stdout:file_95 2024-09-13T18:35:27.727 INFO:teuthology.orchestra.run.smithi044.stdout:file_950 2024-09-13T18:35:27.727 INFO:teuthology.orchestra.run.smithi044.stdout:file_951 2024-09-13T18:35:27.727 INFO:teuthology.orchestra.run.smithi044.stdout:file_952 2024-09-13T18:35:27.727 INFO:teuthology.orchestra.run.smithi044.stdout:file_953 2024-09-13T18:35:27.727 INFO:teuthology.orchestra.run.smithi044.stdout:file_954 2024-09-13T18:35:27.727 INFO:teuthology.orchestra.run.smithi044.stdout:file_955 2024-09-13T18:35:27.727 INFO:teuthology.orchestra.run.smithi044.stdout:file_956 2024-09-13T18:35:27.727 INFO:teuthology.orchestra.run.smithi044.stdout:file_957 2024-09-13T18:35:27.727 INFO:teuthology.orchestra.run.smithi044.stdout:file_958 2024-09-13T18:35:27.728 INFO:teuthology.orchestra.run.smithi044.stdout:file_959 2024-09-13T18:35:27.728 INFO:teuthology.orchestra.run.smithi044.stdout:file_96 2024-09-13T18:35:27.728 INFO:teuthology.orchestra.run.smithi044.stdout:file_960 2024-09-13T18:35:27.728 INFO:teuthology.orchestra.run.smithi044.stdout:file_961 2024-09-13T18:35:27.728 INFO:teuthology.orchestra.run.smithi044.stdout:file_962 2024-09-13T18:35:27.728 INFO:teuthology.orchestra.run.smithi044.stdout:file_963 2024-09-13T18:35:27.728 INFO:teuthology.orchestra.run.smithi044.stdout:file_964 2024-09-13T18:35:27.728 INFO:teuthology.orchestra.run.smithi044.stdout:file_965 2024-09-13T18:35:27.728 INFO:teuthology.orchestra.run.smithi044.stdout:file_966 2024-09-13T18:35:27.728 INFO:teuthology.orchestra.run.smithi044.stdout:file_967 2024-09-13T18:35:27.728 INFO:teuthology.orchestra.run.smithi044.stdout:file_968 2024-09-13T18:35:27.729 INFO:teuthology.orchestra.run.smithi044.stdout:file_969 2024-09-13T18:35:27.729 INFO:teuthology.orchestra.run.smithi044.stdout:file_97 2024-09-13T18:35:27.729 INFO:teuthology.orchestra.run.smithi044.stdout:file_970 2024-09-13T18:35:27.729 INFO:teuthology.orchestra.run.smithi044.stdout:file_971 2024-09-13T18:35:27.729 INFO:teuthology.orchestra.run.smithi044.stdout:file_972 2024-09-13T18:35:27.729 INFO:teuthology.orchestra.run.smithi044.stdout:file_973 2024-09-13T18:35:27.729 INFO:teuthology.orchestra.run.smithi044.stdout:file_974 2024-09-13T18:35:27.729 INFO:teuthology.orchestra.run.smithi044.stdout:file_975 2024-09-13T18:35:27.729 INFO:teuthology.orchestra.run.smithi044.stdout:file_976 2024-09-13T18:35:27.729 INFO:teuthology.orchestra.run.smithi044.stdout:file_977 2024-09-13T18:35:27.729 INFO:teuthology.orchestra.run.smithi044.stdout:file_978 2024-09-13T18:35:27.729 INFO:teuthology.orchestra.run.smithi044.stdout:file_979 2024-09-13T18:35:27.729 INFO:teuthology.orchestra.run.smithi044.stdout:file_98 2024-09-13T18:35:27.730 INFO:teuthology.orchestra.run.smithi044.stdout:file_980 2024-09-13T18:35:27.730 INFO:teuthology.orchestra.run.smithi044.stdout:file_981 2024-09-13T18:35:27.730 INFO:teuthology.orchestra.run.smithi044.stdout:file_982 2024-09-13T18:35:27.730 INFO:teuthology.orchestra.run.smithi044.stdout:file_983 2024-09-13T18:35:27.730 INFO:teuthology.orchestra.run.smithi044.stdout:file_984 2024-09-13T18:35:27.730 INFO:teuthology.orchestra.run.smithi044.stdout:file_985 2024-09-13T18:35:27.730 INFO:teuthology.orchestra.run.smithi044.stdout:file_986 2024-09-13T18:35:27.730 INFO:teuthology.orchestra.run.smithi044.stdout:file_987 2024-09-13T18:35:27.730 INFO:teuthology.orchestra.run.smithi044.stdout:file_988 2024-09-13T18:35:27.730 INFO:teuthology.orchestra.run.smithi044.stdout:file_989 2024-09-13T18:35:27.730 INFO:teuthology.orchestra.run.smithi044.stdout:file_99 2024-09-13T18:35:27.730 INFO:teuthology.orchestra.run.smithi044.stdout:file_990 2024-09-13T18:35:27.730 INFO:teuthology.orchestra.run.smithi044.stdout:file_991 2024-09-13T18:35:27.730 INFO:teuthology.orchestra.run.smithi044.stdout:file_992 2024-09-13T18:35:27.731 INFO:teuthology.orchestra.run.smithi044.stdout:file_993 2024-09-13T18:35:27.731 INFO:teuthology.orchestra.run.smithi044.stdout:file_994 2024-09-13T18:35:27.731 INFO:teuthology.orchestra.run.smithi044.stdout:file_995 2024-09-13T18:35:27.731 INFO:teuthology.orchestra.run.smithi044.stdout:file_996 2024-09-13T18:35:27.731 INFO:teuthology.orchestra.run.smithi044.stdout:file_997 2024-09-13T18:35:27.731 INFO:teuthology.orchestra.run.smithi044.stdout:file_998 2024-09-13T18:35:27.731 INFO:teuthology.orchestra.run.smithi044.stdout:file_999 2024-09-13T18:35:27.732 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:35:27.733 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:35:27.753 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:35:27.774 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:35:27.774 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:35:27.774 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:35:27.782 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:27.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.892+0000 7f06f7fff700 1 Processor -- start 2024-09-13T18:35:27.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.892+0000 7f06f7fff700 1 -- start start 2024-09-13T18:35:27.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.892+0000 7f06f7fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06f815cd80 0x7f06f806baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:27.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f7fff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f815d160 con 0x7f06f806a640 2024-09-13T18:35:27.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f7fff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f80d2120 con 0x7f06f806b170 2024-09-13T18:35:27.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f7fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f80d1570 con 0x7f06f815cd80 2024-09-13T18:35:27.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f67fc700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f06f806a640 0x7f06f806aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47674/0 (socket says 172.21.15.44:47674) 2024-09-13T18:35:27.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f67fc700 1 -- 172.21.15.44:0/4115706430 learned_addr learned my addr 172.21.15.44:0/4115706430 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:27.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f6ffd700 1 --2- 172.21.15.44:0/4115706430 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06f815cd80 0x7f06f806baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:27.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f5ffb700 1 -- 172.21.15.44:0/4115706430 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2433868607 0 0) 0x7f06f815d160 con 0x7f06f806a640 2024-09-13T18:35:27.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f5ffb700 1 -- 172.21.15.44:0/4115706430 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06e40035d0 con 0x7f06f806a640 2024-09-13T18:35:27.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f5ffb700 1 -- 172.21.15.44:0/4115706430 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1769228579 0 0) 0x7f06f80d2120 con 0x7f06f806b170 2024-09-13T18:35:27.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f5ffb700 1 -- 172.21.15.44:0/4115706430 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06f815d160 con 0x7f06f806b170 2024-09-13T18:35:27.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f5ffb700 1 -- 172.21.15.44:0/4115706430 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2077013833 0 0) 0x7f06e40035d0 con 0x7f06f806a640 2024-09-13T18:35:27.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f6ffd700 1 -- 172.21.15.44:0/4115706430 >> v1:172.21.15.99:6789/0 conn(0x7f06f806b170 legacy=0x7f06f80ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:27.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f6ffd700 1 -- 172.21.15.44:0/4115706430 >> v1:172.21.15.44:6789/0 conn(0x7f06f806a640 legacy=0x7f06f806aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:27.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f6ffd700 1 -- 172.21.15.44:0/4115706430 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f80d25b0 con 0x7f06f815cd80 2024-09-13T18:35:27.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f6ffd700 1 --2- 172.21.15.44:0/4115706430 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06f815cd80 0x7f06f806baa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009880 tx=0x7f06e0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21debd85455e7d7c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:27.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f5ffb700 1 -- 172.21.15.44:0/4115706430 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e80019f0 con 0x7f06f815cd80 2024-09-13T18:35:27.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f5ffb700 1 -- 172.21.15.44:0/4115706430 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e0004030 con 0x7f06f815cd80 2024-09-13T18:35:27.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f5ffb700 1 -- 172.21.15.44:0/4115706430 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e00043c0 con 0x7f06f815cd80 2024-09-13T18:35:27.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f7fff700 1 -- 172.21.15.44:0/4115706430 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06f815cd80 msgr2=0x7f06f806baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:27.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f7fff700 1 --2- 172.21.15.44:0/4115706430 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06f815cd80 0x7f06f806baa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009880 tx=0x7f06e0009b90 comp rx=0 tx=0).stop 2024-09-13T18:35:27.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f7fff700 1 -- 172.21.15.44:0/4115706430 shutdown_connections 2024-09-13T18:35:27.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f7fff700 1 --2- 172.21.15.44:0/4115706430 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06f815cd80 0x7f06f806baa0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:27.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f7fff700 1 -- 172.21.15.44:0/4115706430 >> 172.21.15.44:0/4115706430 conn(0x7f06f80d30b0 msgr2=0x7f06f80d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:27.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f7fff700 1 -- 172.21.15.44:0/4115706430 shutdown_connections 2024-09-13T18:35:27.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.896+0000 7f06f7fff700 1 -- 172.21.15.44:0/4115706430 wait complete. 2024-09-13T18:35:27.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.900+0000 7f06f7fff700 1 Processor -- start 2024-09-13T18:35:27.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.900+0000 7f06f7fff700 1 -- start start 2024-09-13T18:35:27.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.900+0000 7f06f7fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06f806a640 0x7f06f80b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:27.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.900+0000 7f06f7fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06f806b170 0x7f06f80ac760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:27.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.900+0000 7f06f7fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06f815cd80 0x7f06f80b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:27.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.900+0000 7f06f7fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f80a9610 con 0x7f06f806b170 2024-09-13T18:35:27.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.900+0000 7f06f7fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f80ad1e0 con 0x7f06f815cd80 2024-09-13T18:35:27.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.900+0000 7f06f7fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f80ad4c0 con 0x7f06f806a640 2024-09-13T18:35:27.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.900+0000 7f06f67fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06f806b170 0x7f06f80ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:27.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.900+0000 7f06f67fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06f806b170 0x7f06f80ac760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52606/0 (socket says 172.21.15.44:52606) 2024-09-13T18:35:27.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.900+0000 7f06f6ffd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06f806a640 0x7f06f80b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:27.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.900+0000 7f06f67fc700 1 -- 172.21.15.44:0/1789936225 learned_addr learned my addr 172.21.15.44:0/1789936225 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:27.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.900+0000 7f06f77fe700 1 --2- 172.21.15.44:0/1789936225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06f815cd80 0x7f06f80b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:27.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.900+0000 7f06f67fc700 1 -- 172.21.15.44:0/1789936225 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06f806a640 msgr2=0x7f06f80b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:27.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.900+0000 7f06f67fc700 1 --2- 172.21.15.44:0/1789936225 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06f806a640 0x7f06f80b5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:27.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.900+0000 7f06f67fc700 1 -- 172.21.15.44:0/1789936225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06f815cd80 msgr2=0x7f06f80b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:27.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.900+0000 7f06f67fc700 1 --2- 172.21.15.44:0/1789936225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06f815cd80 0x7f06f80b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:27.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.900+0000 7f06f67fc700 1 -- 172.21.15.44:0/1789936225 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e00094b0 con 0x7f06f806b170 2024-09-13T18:35:27.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.900+0000 7f06f77fe700 1 --2- 172.21.15.44:0/1789936225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06f815cd80 0x7f06f80b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:27.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.904+0000 7f06f67fc700 1 --2- 172.21.15.44:0/1789936225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06f806b170 0x7f06f80ac760 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f06e8001f70 tx=0x7f06e800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:27.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.904+0000 7f06ef7fe700 1 -- 172.21.15.44:0/1789936225 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e800acf0 con 0x7f06f806b170 2024-09-13T18:35:27.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.904+0000 7f06ef7fe700 1 -- 172.21.15.44:0/1789936225 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e800ae50 con 0x7f06f806b170 2024-09-13T18:35:27.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.904+0000 7f06f7fff700 1 -- 172.21.15.44:0/1789936225 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f80a98b0 con 0x7f06f806b170 2024-09-13T18:35:27.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.904+0000 7f06ef7fe700 1 -- 172.21.15.44:0/1789936225 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e8007310 con 0x7f06f806b170 2024-09-13T18:35:27.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.904+0000 7f06f7fff700 1 -- 172.21.15.44:0/1789936225 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f815beb0 con 0x7f06f806b170 2024-09-13T18:35:27.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.904+0000 7f06f7fff700 1 -- 172.21.15.44:0/1789936225 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f80a9dd0 con 0x7f06f806b170 2024-09-13T18:35:27.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.904+0000 7f06ef7fe700 1 -- 172.21.15.44:0/1789936225 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f06e8007470 con 0x7f06f806b170 2024-09-13T18:35:27.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.908+0000 7f06ef7fe700 1 --2- 172.21.15.44:0/1789936225 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f06d8066760 0x7f06d8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:27.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.908+0000 7f06ef7fe700 1 -- 172.21.15.44:0/1789936225 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f06e8084160 con 0x7f06f806b170 2024-09-13T18:35:27.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.908+0000 7f06f6ffd700 1 --2- 172.21.15.44:0/1789936225 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f06d8066760 0x7f06d8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:27.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.908+0000 7f06f6ffd700 1 --2- 172.21.15.44:0/1789936225 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f06d8066760 0x7f06d8068c20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f06e00090b0 tx=0x7f06e0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:27.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:27.916+0000 7f06ef7fe700 1 -- 172.21.15.44:0/1789936225 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f06f80a9dd0 con 0x7f06f806b170 2024-09-13T18:35:28.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.096+0000 7f06f7fff700 1 -- 172.21.15.44:0/1789936225 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06f80a9dd0 con 0x7f06f806b170 2024-09-13T18:35:28.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.096+0000 7f06ef7fe700 1 -- 172.21.15.44:0/1789936225 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16894 (secure 0 0 0) 0x7f06f80a9dd0 con 0x7f06f806b170 2024-09-13T18:35:28.104 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:28.104 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":66,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:35:19.260517+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:14.682923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:15.291935+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:6836/3072614790":"2024-09-14T18:35:19.260455+0000","172.21.15.99:6837/3072614790":"2024-09-14T18:35:19.260455+0000","172.21.15.44:6835/1074184606":"2024-09-14T18:35:18.166304+0000","172.21.15.44:6833/1074184606":"2024-09-14T18:35:18.166304+0000","172.21.15.44:6835/1608555972":"2024-09-14T18:34:13.117246+0000","172.21.15.44:6833/1608555972":"2024-09-14T18:34:13.117246+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:28.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.100+0000 7f06f7fff700 1 -- 172.21.15.44:0/1789936225 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f06d8066760 msgr2=0x7f06d8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:28.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.100+0000 7f06f7fff700 1 --2- 172.21.15.44:0/1789936225 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f06d8066760 0x7f06d8068c20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f06e00090b0 tx=0x7f06e0010000 comp rx=0 tx=0).stop 2024-09-13T18:35:28.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.100+0000 7f06f7fff700 1 -- 172.21.15.44:0/1789936225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06f806b170 msgr2=0x7f06f80ac760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:28.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.100+0000 7f06f7fff700 1 --2- 172.21.15.44:0/1789936225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06f806b170 0x7f06f80ac760 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f06e8001f70 tx=0x7f06e800a340 comp rx=0 tx=0).stop 2024-09-13T18:35:28.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.100+0000 7f06f7fff700 1 -- 172.21.15.44:0/1789936225 shutdown_connections 2024-09-13T18:35:28.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.100+0000 7f06f7fff700 1 --2- 172.21.15.44:0/1789936225 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f06d8066760 0x7f06d8068c20 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.100+0000 7f06f7fff700 1 --2- 172.21.15.44:0/1789936225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06f815cd80 0x7f06f80b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.100+0000 7f06f7fff700 1 --2- 172.21.15.44:0/1789936225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06f806b170 0x7f06f80ac760 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.100+0000 7f06f7fff700 1 --2- 172.21.15.44:0/1789936225 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06f806a640 0x7f06f80b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.100+0000 7f06f7fff700 1 -- 172.21.15.44:0/1789936225 >> 172.21.15.44:0/1789936225 conn(0x7f06f80d30b0 msgr2=0x7f06f80b71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:28.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.100+0000 7f06f7fff700 1 -- 172.21.15.44:0/1789936225 shutdown_connections 2024-09-13T18:35:28.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.100+0000 7f06f7fff700 1 -- 172.21.15.44:0/1789936225 wait complete. 2024-09-13T18:35:28.124 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:33:14.682923+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:33:15.291935+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:35:28.125 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:35:28.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.240+0000 7f1598e37700 1 Processor -- start 2024-09-13T18:35:28.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.240+0000 7f1598e37700 1 -- start start 2024-09-13T18:35:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.240+0000 7f1598e37700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1594159760 0x7f15940b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.240+0000 7f1598e37700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f159406d4e0 0x7f1594072120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.240+0000 7f1598e37700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1594072660 con 0x7f1594070bf0 2024-09-13T18:35:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.240+0000 7f1598e37700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1594071d00 con 0x7f1594159760 2024-09-13T18:35:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.240+0000 7f1598e37700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1594071080 con 0x7f159406d4e0 2024-09-13T18:35:28.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.240+0000 7f1592ffd700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1594070bf0 0x7f159406cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47686/0 (socket says 172.21.15.44:47686) 2024-09-13T18:35:28.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.240+0000 7f1592ffd700 1 -- 172.21.15.44:0/3431930882 learned_addr learned my addr 172.21.15.44:0/3431930882 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:28.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.240+0000 7f15937fe700 1 --2- 172.21.15.44:0/3431930882 >> v2:172.21.15.99:3300/0 conn(0x7f1594159760 0x7f15940b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:28.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.240+0000 7f1593fff700 1 --2- 172.21.15.44:0/3431930882 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f159406d4e0 0x7f1594072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:28.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.240+0000 7f15927fc700 1 -- 172.21.15.44:0/3431930882 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254563328 0 0) 0x7f1594072660 con 0x7f1594070bf0 2024-09-13T18:35:28.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.240+0000 7f15927fc700 1 -- 172.21.15.44:0/3431930882 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15800035d0 con 0x7f1594070bf0 2024-09-13T18:35:28.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.244+0000 7f15937fe700 1 -- 172.21.15.44:0/3431930882 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f159406d4e0 msgr2=0x7f1594072120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:28.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.244+0000 7f15937fe700 1 --2- 172.21.15.44:0/3431930882 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f159406d4e0 0x7f1594072120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.244+0000 7f15937fe700 1 -- 172.21.15.44:0/3431930882 >> v1:172.21.15.44:6789/0 conn(0x7f1594070bf0 legacy=0x7f159406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:28.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.244+0000 7f15927fc700 1 -- 172.21.15.44:0/3431930882 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1319317600 0 0) 0x7f15800035d0 con 0x7f1594070bf0 2024-09-13T18:35:28.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.244+0000 7f15937fe700 1 -- 172.21.15.44:0/3431930882 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1594071360 con 0x7f1594159760 2024-09-13T18:35:28.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.244+0000 7f15937fe700 1 --2- 172.21.15.44:0/3431930882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1594159760 0x7f15940b46a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1584009850 tx=0x7f1584009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df2e54353881ff9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:28.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.244+0000 7f15927fc700 1 -- 172.21.15.44:0/3431930882 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584011830 con 0x7f1594159760 2024-09-13T18:35:28.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.244+0000 7f15927fc700 1 -- 172.21.15.44:0/3431930882 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1584011990 con 0x7f1594159760 2024-09-13T18:35:28.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.244+0000 7f15927fc700 1 -- 172.21.15.44:0/3431930882 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584011d40 con 0x7f1594159760 2024-09-13T18:35:28.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.244+0000 7f1598e37700 1 -- 172.21.15.44:0/3431930882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1594159760 msgr2=0x7f15940b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:28.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.244+0000 7f1598e37700 1 --2- 172.21.15.44:0/3431930882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1594159760 0x7f15940b46a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1584009850 tx=0x7f1584009b60 comp rx=0 tx=0).stop 2024-09-13T18:35:28.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.244+0000 7f1598e37700 1 -- 172.21.15.44:0/3431930882 shutdown_connections 2024-09-13T18:35:28.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.244+0000 7f1598e37700 1 --2- 172.21.15.44:0/3431930882 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f159406d4e0 0x7f1594072120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.244+0000 7f1598e37700 1 --2- 172.21.15.44:0/3431930882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1594159760 0x7f15940b46a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.244+0000 7f1598e37700 1 -- 172.21.15.44:0/3431930882 >> 172.21.15.44:0/3431930882 conn(0x7f15940b1810 msgr2=0x7f15940b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.244+0000 7f1598e37700 1 -- 172.21.15.44:0/3431930882 shutdown_connections 2024-09-13T18:35:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.244+0000 7f1598e37700 1 -- 172.21.15.44:0/3431930882 wait complete. 2024-09-13T18:35:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.244+0000 7f1598e37700 1 Processor -- start 2024-09-13T18:35:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.244+0000 7f1598e37700 1 -- start start 2024-09-13T18:35:28.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f1598e37700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f159406d4e0 0x7f15941ee630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:28.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f1598e37700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1594159760 0x7f159415be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:28.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f1598e37700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1594154ae0 0x7f159414df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:28.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f1598e37700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159415cc10 con 0x7f159406d4e0 2024-09-13T18:35:28.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f1598e37700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15941ee210 con 0x7f1594154ae0 2024-09-13T18:35:28.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f1598e37700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15941edc20 con 0x7f1594159760 2024-09-13T18:35:28.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f15937fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f159406d4e0 0x7f15941ee630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:28.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f15937fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f159406d4e0 0x7f15941ee630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52620/0 (socket says 172.21.15.44:52620) 2024-09-13T18:35:28.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f15937fe700 1 -- 172.21.15.44:0/1765818417 learned_addr learned my addr 172.21.15.44:0/1765818417 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:28.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f1592ffd700 1 --2- 172.21.15.44:0/1765818417 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1594159760 0x7f159415be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:28.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f1593fff700 1 --2- 172.21.15.44:0/1765818417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1594154ae0 0x7f159414df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:28.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f15937fe700 1 -- 172.21.15.44:0/1765818417 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1594159760 msgr2=0x7f159415be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:28.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f15937fe700 1 --2- 172.21.15.44:0/1765818417 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1594159760 0x7f159415be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f15937fe700 1 -- 172.21.15.44:0/1765818417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1594154ae0 msgr2=0x7f159414df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:28.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f15937fe700 1 --2- 172.21.15.44:0/1765818417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1594154ae0 0x7f159414df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f15937fe700 1 -- 172.21.15.44:0/1765818417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15840094b0 con 0x7f159406d4e0 2024-09-13T18:35:28.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f1592ffd700 1 --2- 172.21.15.44:0/1765818417 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1594159760 0x7f159415be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:28.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f15937fe700 1 --2- 172.21.15.44:0/1765818417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f159406d4e0 0x7f15941ee630 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f1594072900 tx=0x7f1584004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:28.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f158bfff700 1 -- 172.21.15.44:0/1765818417 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584019a00 con 0x7f159406d4e0 2024-09-13T18:35:28.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f158bfff700 1 -- 172.21.15.44:0/1765818417 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158401e070 con 0x7f159406d4e0 2024-09-13T18:35:28.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f1598e37700 1 -- 172.21.15.44:0/1765818417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15941eeb70 con 0x7f159406d4e0 2024-09-13T18:35:28.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f158bfff700 1 -- 172.21.15.44:0/1765818417 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584019dc0 con 0x7f159406d4e0 2024-09-13T18:35:28.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f1598e37700 1 -- 172.21.15.44:0/1765818417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1594150e30 con 0x7f159406d4e0 2024-09-13T18:35:28.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.248+0000 7f1598e37700 1 -- 172.21.15.44:0/1765818417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15941ee350 con 0x7f159406d4e0 2024-09-13T18:35:28.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.252+0000 7f158bfff700 1 -- 172.21.15.44:0/1765818417 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f158401a420 con 0x7f159406d4e0 2024-09-13T18:35:28.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.252+0000 7f158bfff700 1 --2- 172.21.15.44:0/1765818417 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1574066730 0x7f1574068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:28.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.252+0000 7f158bfff700 1 -- 172.21.15.44:0/1765818417 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f1584085120 con 0x7f159406d4e0 2024-09-13T18:35:28.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.252+0000 7f1592ffd700 1 --2- 172.21.15.44:0/1765818417 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1574066730 0x7f1574068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:28.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.252+0000 7f1592ffd700 1 --2- 172.21.15.44:0/1765818417 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1574066730 0x7f1574068bf0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f159415aef0 tx=0x7f157c007ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:28.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.256+0000 7f158bfff700 1 -- 172.21.15.44:0/1765818417 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f15941ee350 con 0x7f159406d4e0 2024-09-13T18:35:28.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.428+0000 7f1598e37700 1 -- 172.21.15.44:0/1765818417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f15941ee350 con 0x7f159406d4e0 2024-09-13T18:35:28.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.428+0000 7f158bfff700 1 -- 172.21.15.44:0/1765818417 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) v1 ==== 93+0+10 (secure 0 0 0) 0x7f15941ee350 con 0x7f159406d4e0 2024-09-13T18:35:28.434 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:35:28.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.428+0000 7f1598e37700 1 -- 172.21.15.44:0/1765818417 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1574066730 msgr2=0x7f1574068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:28.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.428+0000 7f1598e37700 1 --2- 172.21.15.44:0/1765818417 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1574066730 0x7f1574068bf0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f159415aef0 tx=0x7f157c007ab0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.428+0000 7f1598e37700 1 -- 172.21.15.44:0/1765818417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f159406d4e0 msgr2=0x7f15941ee630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:28.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.428+0000 7f1598e37700 1 --2- 172.21.15.44:0/1765818417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f159406d4e0 0x7f15941ee630 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f1594072900 tx=0x7f1584004770 comp rx=0 tx=0).stop 2024-09-13T18:35:28.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.432+0000 7f1598e37700 1 -- 172.21.15.44:0/1765818417 shutdown_connections 2024-09-13T18:35:28.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.432+0000 7f1598e37700 1 --2- 172.21.15.44:0/1765818417 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1574066730 0x7f1574068bf0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.432+0000 7f1598e37700 1 --2- 172.21.15.44:0/1765818417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1594154ae0 0x7f159414df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.432+0000 7f1598e37700 1 --2- 172.21.15.44:0/1765818417 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1594159760 0x7f159415be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.432+0000 7f1598e37700 1 --2- 172.21.15.44:0/1765818417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f159406d4e0 0x7f15941ee630 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.432+0000 7f1598e37700 1 -- 172.21.15.44:0/1765818417 >> 172.21.15.44:0/1765818417 conn(0x7f15940b1810 msgr2=0x7f15940cebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:28.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.432+0000 7f1598e37700 1 -- 172.21.15.44:0/1765818417 shutdown_connections 2024-09-13T18:35:28.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.432+0000 7f1598e37700 1 -- 172.21.15.44:0/1765818417 wait complete. 2024-09-13T18:35:28.449 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:35:28.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.556+0000 7fd32e662700 1 Processor -- start 2024-09-13T18:35:28.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.556+0000 7fd32e662700 1 -- start start 2024-09-13T18:35:28.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd32e662700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd32806a520 0x7fd32806a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:28.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd32e662700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3280b8430 con 0x7fd32806b900 2024-09-13T18:35:28.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd32e662700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32806ae90 con 0x7fd32815cda0 2024-09-13T18:35:28.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd32e662700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280b64f0 con 0x7fd32806a520 2024-09-13T18:35:28.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd32ce5f700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd32806b900 0x7fd3280b5de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47696/0 (socket says 172.21.15.44:47696) 2024-09-13T18:35:28.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd32ce5f700 1 -- 172.21.15.44:0/1860568364 learned_addr learned my addr 172.21.15.44:0/1860568364 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:28.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd32de61700 1 --2- 172.21.15.44:0/1860568364 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd32806a520 0x7fd32806a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:28.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd31ffff700 1 -- 172.21.15.44:0/1860568364 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3911824875 0 0) 0x7fd3280b8430 con 0x7fd32806b900 2024-09-13T18:35:28.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd31ffff700 1 -- 172.21.15.44:0/1860568364 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3140035d0 con 0x7fd32806b900 2024-09-13T18:35:28.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd31ffff700 1 -- 172.21.15.44:0/1860568364 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3683840467 0 0) 0x7fd3140035d0 con 0x7fd32806b900 2024-09-13T18:35:28.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd31ffff700 1 -- 172.21.15.44:0/1860568364 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd32806a520 msgr2=0x7fd32806a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:28.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd31ffff700 1 --2- 172.21.15.44:0/1860568364 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd32806a520 0x7fd32806a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd31ffff700 1 -- 172.21.15.44:0/1860568364 >> v1:172.21.15.99:6789/0 conn(0x7fd32815cda0 legacy=0x7fd3280ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:28.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd31ffff700 1 -- 172.21.15.44:0/1860568364 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32806bd60 con 0x7fd32806b900 2024-09-13T18:35:28.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd31ffff700 1 -- 172.21.15.44:0/1860568364 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7fd324001670 con 0x7fd32806b900 2024-09-13T18:35:28.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd31ffff700 1 -- 172.21.15.44:0/1860568364 >> v1:172.21.15.44:6789/0 conn(0x7fd32806b900 legacy=0x7fd3280b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:28.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd31ffff700 1 --2- 172.21.15.44:0/1860568364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd314003a50 0x7fd314003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:28.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd31ffff700 1 --2- 172.21.15.44:0/1860568364 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd32806a520 0x7fd314004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:28.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd31ffff700 1 --2- 172.21.15.44:0/1860568364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd314004db0 0x7fd314005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:28.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd31ffff700 1 -- 172.21.15.44:0/1860568364 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280b64f0 con 0x7fd314003a50 2024-09-13T18:35:28.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd31ffff700 1 -- 172.21.15.44:0/1860568364 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31400bae0 con 0x7fd314004db0 2024-09-13T18:35:28.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd31ffff700 1 -- 172.21.15.44:0/1860568364 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31400bca0 con 0x7fd32806a520 2024-09-13T18:35:28.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd32d660700 1 --2- 172.21.15.44:0/1860568364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd314003a50 0x7fd314003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:28.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd32ce5f700 1 --2- 172.21.15.44:0/1860568364 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd32806a520 0x7fd314004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:28.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd32de61700 1 --2- 172.21.15.44:0/1860568364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd314004db0 0x7fd314005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:28.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd32d660700 1 -- 172.21.15.44:0/1860568364 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd32806a520 msgr2=0x7fd314004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:28.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd32d660700 1 --2- 172.21.15.44:0/1860568364 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd32806a520 0x7fd314004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd32d660700 1 -- 172.21.15.44:0/1860568364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd314004db0 msgr2=0x7fd314005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:28.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd32d660700 1 --2- 172.21.15.44:0/1860568364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd314004db0 0x7fd314005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd32d660700 1 -- 172.21.15.44:0/1860568364 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3140035d0 con 0x7fd314003a50 2024-09-13T18:35:28.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd32d660700 1 --2- 172.21.15.44:0/1860568364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd314003a50 0x7fd314003e70 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fd318007fd0 tx=0x7fd3140058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80094335c0141cd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:28.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd31ffff700 1 -- 172.21.15.44:0/1860568364 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3180052d0 con 0x7fd314003a50 2024-09-13T18:35:28.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd31ffff700 1 -- 172.21.15.44:0/1860568364 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd318005430 con 0x7fd314003a50 2024-09-13T18:35:28.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.560+0000 7fd31ffff700 1 -- 172.21.15.44:0/1860568364 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3180055a0 con 0x7fd314003a50 2024-09-13T18:35:28.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32e662700 1 -- 172.21.15.44:0/1860568364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd314003a50 msgr2=0x7fd314003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:28.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32e662700 1 --2- 172.21.15.44:0/1860568364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd314003a50 0x7fd314003e70 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fd318007fd0 tx=0x7fd3140058a0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32de61700 1 -- 172.21.15.44:0/1860568364 reap_dead start 2024-09-13T18:35:28.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32e662700 1 -- 172.21.15.44:0/1860568364 shutdown_connections 2024-09-13T18:35:28.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32e662700 1 -- 172.21.15.44:0/1860568364 >> 172.21.15.44:0/1860568364 conn(0x7fd3280d2cb0 msgr2=0x7fd3280d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:28.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32e662700 1 -- 172.21.15.44:0/1860568364 shutdown_connections 2024-09-13T18:35:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32e662700 1 -- 172.21.15.44:0/1860568364 wait complete. 2024-09-13T18:35:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32e662700 1 Processor -- start 2024-09-13T18:35:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32e662700 1 -- start start 2024-09-13T18:35:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32e662700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3280c95b0 0x7fd32814abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32e662700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3280c67e0 0x7fd328147340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32e662700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd328147880 0x7fd3280b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32e662700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd328146bd0 con 0x7fd3280c95b0 2024-09-13T18:35:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32e662700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd328146eb0 con 0x7fd3280c67e0 2024-09-13T18:35:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32e662700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3281f66c0 con 0x7fd328147880 2024-09-13T18:35:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32d660700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3280c95b0 0x7fd32814abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32d660700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3280c95b0 0x7fd32814abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52640/0 (socket says 172.21.15.44:52640) 2024-09-13T18:35:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32d660700 1 -- 172.21.15.44:0/4035744330 learned_addr learned my addr 172.21.15.44:0/4035744330 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32de61700 1 --2- 172.21.15.44:0/4035744330 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd328147880 0x7fd3280b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:28.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32ce5f700 1 --2- 172.21.15.44:0/4035744330 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3280c67e0 0x7fd328147340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:28.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32d660700 1 -- 172.21.15.44:0/4035744330 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd328147880 msgr2=0x7fd3280b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:28.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32d660700 1 --2- 172.21.15.44:0/4035744330 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd328147880 0x7fd3280b6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32d660700 1 -- 172.21.15.44:0/4035744330 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3280c67e0 msgr2=0x7fd328147340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:28.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32d660700 1 --2- 172.21.15.44:0/4035744330 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3280c67e0 0x7fd328147340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32d660700 1 -- 172.21.15.44:0/4035744330 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3281f69a0 con 0x7fd3280c95b0 2024-09-13T18:35:28.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.564+0000 7fd32d660700 1 --2- 172.21.15.44:0/4035744330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3280c95b0 0x7fd32814abe0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fd3140047d0 tx=0x7fd318001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:28.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.568+0000 7fd31dffb700 1 -- 172.21.15.44:0/4035744330 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd318007240 con 0x7fd3280c95b0 2024-09-13T18:35:28.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.568+0000 7fd31dffb700 1 -- 172.21.15.44:0/4035744330 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3180073a0 con 0x7fd3280c95b0 2024-09-13T18:35:28.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.568+0000 7fd32e662700 1 -- 172.21.15.44:0/4035744330 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3280c6c70 con 0x7fd3280c95b0 2024-09-13T18:35:28.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.568+0000 7fd31dffb700 1 -- 172.21.15.44:0/4035744330 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd318007790 con 0x7fd3280c95b0 2024-09-13T18:35:28.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.568+0000 7fd32e662700 1 -- 172.21.15.44:0/4035744330 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32814a8c0 con 0x7fd3280c95b0 2024-09-13T18:35:28.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.568+0000 7fd32e662700 1 -- 172.21.15.44:0/4035744330 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3280d1120 con 0x7fd3280c95b0 2024-09-13T18:35:28.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.568+0000 7fd31dffb700 1 -- 172.21.15.44:0/4035744330 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd3180036a0 con 0x7fd3280c95b0 2024-09-13T18:35:28.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.568+0000 7fd31dffb700 1 --2- 172.21.15.44:0/4035744330 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd30c066730 0x7fd30c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:28.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.568+0000 7fd31dffb700 1 -- 172.21.15.44:0/4035744330 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fd318084b50 con 0x7fd3280c95b0 2024-09-13T18:35:28.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.572+0000 7fd32ce5f700 1 --2- 172.21.15.44:0/4035744330 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd30c066730 0x7fd30c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:28.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.572+0000 7fd32ce5f700 1 --2- 172.21.15.44:0/4035744330 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd30c066730 0x7fd30c068bf0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd328144a10 tx=0x7fd324000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:28.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.576+0000 7fd31dffb700 1 -- 172.21.15.44:0/4035744330 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd318051e80 con 0x7fd3280c95b0 2024-09-13T18:35:28.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.744+0000 7fd32e662700 1 -- 172.21.15.44:0/4035744330 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd3281f6b30 con 0x7fd3280c95b0 2024-09-13T18:35:28.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.744+0000 7fd31dffb700 1 -- 172.21.15.44:0/4035744330 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v66) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd3180554a0 con 0x7fd3280c95b0 2024-09-13T18:35:28.751 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:35:28.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.748+0000 7fd32e662700 1 -- 172.21.15.44:0/4035744330 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd30c066730 msgr2=0x7fd30c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:28.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.748+0000 7fd32e662700 1 --2- 172.21.15.44:0/4035744330 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd30c066730 0x7fd30c068bf0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd328144a10 tx=0x7fd324000ed0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.748+0000 7fd32e662700 1 -- 172.21.15.44:0/4035744330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3280c95b0 msgr2=0x7fd32814abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:28.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.748+0000 7fd32e662700 1 --2- 172.21.15.44:0/4035744330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3280c95b0 0x7fd32814abe0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fd3140047d0 tx=0x7fd318001120 comp rx=0 tx=0).stop 2024-09-13T18:35:28.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.748+0000 7fd32e662700 1 -- 172.21.15.44:0/4035744330 shutdown_connections 2024-09-13T18:35:28.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.748+0000 7fd32e662700 1 --2- 172.21.15.44:0/4035744330 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd30c066730 0x7fd30c068bf0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.748+0000 7fd32e662700 1 --2- 172.21.15.44:0/4035744330 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd328147880 0x7fd3280b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.748+0000 7fd32e662700 1 --2- 172.21.15.44:0/4035744330 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3280c67e0 0x7fd328147340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.748+0000 7fd32e662700 1 --2- 172.21.15.44:0/4035744330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3280c95b0 0x7fd32814abe0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.748+0000 7fd32e662700 1 -- 172.21.15.44:0/4035744330 >> 172.21.15.44:0/4035744330 conn(0x7fd3280d2cb0 msgr2=0x7fd3280b3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:28.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.748+0000 7fd32e662700 1 -- 172.21.15.44:0/4035744330 shutdown_connections 2024-09-13T18:35:28.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.748+0000 7fd32e662700 1 -- 172.21.15.44:0/4035744330 wait complete. 2024-09-13T18:35:28.766 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:35:28.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.880+0000 7f50e67df700 1 Processor -- start 2024-09-13T18:35:28.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.880+0000 7f50e67df700 1 -- start start 2024-09-13T18:35:28.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.880+0000 7f50e67df700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f50e00d18f0 0x7f50e00d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:28.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.880+0000 7f50e67df700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50e015d270 0x7f50e00cd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:28.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.880+0000 7f50e67df700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e015ad00 con 0x7f50e006bc80 2024-09-13T18:35:28.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.880+0000 7f50e67df700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e00d2210 con 0x7f50e00d18f0 2024-09-13T18:35:28.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.880+0000 7f50e67df700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e015d770 con 0x7f50e015d270 2024-09-13T18:35:28.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.880+0000 7f50e57dd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f50e00d18f0 0x7f50e00d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:28.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.880+0000 7f50e4fdc700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f50e006bc80 0x7f50e006a860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47710/0 (socket says 172.21.15.44:47710) 2024-09-13T18:35:28.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.880+0000 7f50e4fdc700 1 -- 172.21.15.44:0/3362908343 learned_addr learned my addr 172.21.15.44:0/3362908343 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:28.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.880+0000 7f50e5fde700 1 --2- 172.21.15.44:0/3362908343 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50e015d270 0x7f50e00cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.880+0000 7f50e57dd700 1 -- 172.21.15.44:0/3362908343 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50e015d270 msgr2=0x7f50e00cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.880+0000 7f50d7fff700 1 -- 172.21.15.44:0/3362908343 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 468616163 0 0) 0x7f50e015ad00 con 0x7f50e006bc80 2024-09-13T18:35:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.880+0000 7f50e57dd700 1 --2- 172.21.15.44:0/3362908343 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50e015d270 0x7f50e00cd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.880+0000 7f50e57dd700 1 -- 172.21.15.44:0/3362908343 >> v1:172.21.15.44:6789/0 conn(0x7f50e006bc80 legacy=0x7f50e006a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.880+0000 7f50e57dd700 1 -- 172.21.15.44:0/3362908343 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e015da50 con 0x7f50e00d18f0 2024-09-13T18:35:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.880+0000 7f50e57dd700 1 --2- 172.21.15.44:0/3362908343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50e00d18f0 0x7f50e00d1cd0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f50dc009850 tx=0x7f50dc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f369c5c47cca841e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:28.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.880+0000 7f50d7fff700 1 -- 172.21.15.44:0/3362908343 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc011830 con 0x7f50e00d18f0 2024-09-13T18:35:28.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.880+0000 7f50d7fff700 1 -- 172.21.15.44:0/3362908343 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50dc011990 con 0x7f50e00d18f0 2024-09-13T18:35:28.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.880+0000 7f50d7fff700 1 -- 172.21.15.44:0/3362908343 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc011d40 con 0x7f50e00d18f0 2024-09-13T18:35:28.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.884+0000 7f50e67df700 1 -- 172.21.15.44:0/3362908343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50e00d18f0 msgr2=0x7f50e00d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:28.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.884+0000 7f50e67df700 1 --2- 172.21.15.44:0/3362908343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50e00d18f0 0x7f50e00d1cd0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f50dc009850 tx=0x7f50dc009b60 comp rx=0 tx=0).stop 2024-09-13T18:35:28.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.884+0000 7f50e67df700 1 -- 172.21.15.44:0/3362908343 shutdown_connections 2024-09-13T18:35:28.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.884+0000 7f50e67df700 1 --2- 172.21.15.44:0/3362908343 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50e015d270 0x7f50e00cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.884+0000 7f50e67df700 1 --2- 172.21.15.44:0/3362908343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50e00d18f0 0x7f50e00d1cd0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.884+0000 7f50e67df700 1 -- 172.21.15.44:0/3362908343 >> 172.21.15.44:0/3362908343 conn(0x7f50e00b4800 msgr2=0x7f50e00b4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:28.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.884+0000 7f50e67df700 1 -- 172.21.15.44:0/3362908343 shutdown_connections 2024-09-13T18:35:28.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.884+0000 7f50e67df700 1 -- 172.21.15.44:0/3362908343 wait complete. 2024-09-13T18:35:28.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.884+0000 7f50e67df700 1 Processor -- start 2024-09-13T18:35:28.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.884+0000 7f50e67df700 1 -- start start 2024-09-13T18:35:28.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.884+0000 7f50e67df700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50e006bc80 0x7f50e014c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:28.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.884+0000 7f50e67df700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50e00d18f0 0x7f50e00b69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:28.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.884+0000 7f50e67df700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50e015d270 0x7f50e00ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:28.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.884+0000 7f50e67df700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e015b210 con 0x7f50e015d270 2024-09-13T18:35:28.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.884+0000 7f50e67df700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e00b72c0 con 0x7f50e006bc80 2024-09-13T18:35:28.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.884+0000 7f50e67df700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e00b75a0 con 0x7f50e00d18f0 2024-09-13T18:35:28.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.888+0000 7f50e5fde700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50e015d270 0x7f50e00ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:28.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.888+0000 7f50e5fde700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50e015d270 0x7f50e00ca7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52656/0 (socket says 172.21.15.44:52656) 2024-09-13T18:35:28.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.888+0000 7f50e5fde700 1 -- 172.21.15.44:0/4203949317 learned_addr learned my addr 172.21.15.44:0/4203949317 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:28.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.888+0000 7f50e57dd700 1 --2- 172.21.15.44:0/4203949317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50e006bc80 0x7f50e014c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:28.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.888+0000 7f50e4fdc700 1 --2- 172.21.15.44:0/4203949317 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50e00d18f0 0x7f50e00b69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:28.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.888+0000 7f50e5fde700 1 -- 172.21.15.44:0/4203949317 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50e00d18f0 msgr2=0x7f50e00b69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:28.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.888+0000 7f50e5fde700 1 --2- 172.21.15.44:0/4203949317 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50e00d18f0 0x7f50e00b69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.888+0000 7f50e5fde700 1 -- 172.21.15.44:0/4203949317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50e006bc80 msgr2=0x7f50e014c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:28.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.888+0000 7f50e5fde700 1 --2- 172.21.15.44:0/4203949317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50e006bc80 0x7f50e014c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:28.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.888+0000 7f50e5fde700 1 -- 172.21.15.44:0/4203949317 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc0094b0 con 0x7f50e015d270 2024-09-13T18:35:28.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.888+0000 7f50e5fde700 1 --2- 172.21.15.44:0/4203949317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50e015d270 0x7f50e00ca7f0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f50d800ec10 tx=0x7f50d800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:28.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.888+0000 7f50d5ffb700 1 -- 172.21.15.44:0/4203949317 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d800c980 con 0x7f50e015d270 2024-09-13T18:35:28.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.888+0000 7f50d5ffb700 1 -- 172.21.15.44:0/4203949317 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d800f040 con 0x7f50e015d270 2024-09-13T18:35:28.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.888+0000 7f50e67df700 1 -- 172.21.15.44:0/4203949317 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e00b7880 con 0x7f50e015d270 2024-09-13T18:35:28.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.888+0000 7f50d5ffb700 1 -- 172.21.15.44:0/4203949317 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d800cd40 con 0x7f50e015d270 2024-09-13T18:35:28.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.888+0000 7f50e67df700 1 -- 172.21.15.44:0/4203949317 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e014c550 con 0x7f50e015d270 2024-09-13T18:35:28.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.888+0000 7f50e67df700 1 -- 172.21.15.44:0/4203949317 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e015b3c0 con 0x7f50e015d270 2024-09-13T18:35:28.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.892+0000 7f50d5ffb700 1 -- 172.21.15.44:0/4203949317 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f50d8014480 con 0x7f50e015d270 2024-09-13T18:35:28.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.892+0000 7f50d5ffb700 1 --2- 172.21.15.44:0/4203949317 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f50c4066730 0x7f50c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:28.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.892+0000 7f50d5ffb700 1 -- 172.21.15.44:0/4203949317 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f50d8084bc0 con 0x7f50e015d270 2024-09-13T18:35:28.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.892+0000 7f50e57dd700 1 --2- 172.21.15.44:0/4203949317 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f50c4066730 0x7f50c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:28.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.892+0000 7f50e57dd700 1 --2- 172.21.15.44:0/4203949317 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f50c4066730 0x7f50c4068bf0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f50dc009ba0 tx=0x7f50dc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:28.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:28.896+0000 7f50d5ffb700 1 -- 172.21.15.44:0/4203949317 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f50e015b3c0 con 0x7f50e015d270 2024-09-13T18:35:29.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.064+0000 7f50e67df700 1 -- 172.21.15.44:0/4203949317 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f50e006c060 con 0x7f50e015d270 2024-09-13T18:35:29.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.068+0000 7f50d5ffb700 1 -- 172.21.15.44:0/4203949317 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v66) v1 ==== 100+0+11 (secure 0 0 0) 0x7f50d8018070 con 0x7f50e015d270 2024-09-13T18:35:29.073 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:35:29.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.068+0000 7f50e67df700 1 -- 172.21.15.44:0/4203949317 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f50c4066730 msgr2=0x7f50c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:29.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.068+0000 7f50e67df700 1 --2- 172.21.15.44:0/4203949317 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f50c4066730 0x7f50c4068bf0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f50dc009ba0 tx=0x7f50dc008030 comp rx=0 tx=0).stop 2024-09-13T18:35:29.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.068+0000 7f50e67df700 1 -- 172.21.15.44:0/4203949317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50e015d270 msgr2=0x7f50e00ca7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:29.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.068+0000 7f50e67df700 1 --2- 172.21.15.44:0/4203949317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50e015d270 0x7f50e00ca7f0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f50d800ec10 tx=0x7f50d800ef20 comp rx=0 tx=0).stop 2024-09-13T18:35:29.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.068+0000 7f50e67df700 1 -- 172.21.15.44:0/4203949317 shutdown_connections 2024-09-13T18:35:29.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.068+0000 7f50e67df700 1 --2- 172.21.15.44:0/4203949317 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f50c4066730 0x7f50c4068bf0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:29.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.068+0000 7f50e67df700 1 --2- 172.21.15.44:0/4203949317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50e015d270 0x7f50e00ca7f0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:29.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.068+0000 7f50e67df700 1 --2- 172.21.15.44:0/4203949317 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50e00d18f0 0x7f50e00b69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:29.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.068+0000 7f50e67df700 1 --2- 172.21.15.44:0/4203949317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50e006bc80 0x7f50e014c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:29.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.068+0000 7f50e67df700 1 -- 172.21.15.44:0/4203949317 >> 172.21.15.44:0/4203949317 conn(0x7f50e00b4800 msgr2=0x7f50e00b4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:29.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.068+0000 7f50e67df700 1 -- 172.21.15.44:0/4203949317 shutdown_connections 2024-09-13T18:35:29.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.068+0000 7f50e67df700 1 -- 172.21.15.44:0/4203949317 wait complete. 2024-09-13T18:35:29.088 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:35:29.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.196+0000 7fc6889cc700 1 Processor -- start 2024-09-13T18:35:29.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.196+0000 7fc6889cc700 1 -- start start 2024-09-13T18:35:29.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.200+0000 7fc6889cc700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc68413f5d0 0x7fc68406e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:29.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.200+0000 7fc6889cc700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68406f850 con 0x7fc68413d9d0 2024-09-13T18:35:29.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.200+0000 7fc6889cc700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68406efb0 con 0x7fc6840d04e0 2024-09-13T18:35:29.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.200+0000 7fc6889cc700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68413e1a0 con 0x7fc68413f5d0 2024-09-13T18:35:29.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.200+0000 7fc682d9d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc68413d9d0 0x7fc6840cfdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47712/0 (socket says 172.21.15.44:47712) 2024-09-13T18:35:29.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.200+0000 7fc68359e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc68413f5d0 0x7fc68406e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:29.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.200+0000 7fc682d9d700 1 -- 172.21.15.44:0/911613935 learned_addr learned my addr 172.21.15.44:0/911613935 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:29.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.200+0000 7fc68359e700 1 -- 172.21.15.44:0/911613935 >> v1:172.21.15.99:6789/0 conn(0x7fc6840d04e0 legacy=0x7fc68406e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:29.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.200+0000 7fc68359e700 1 -- 172.21.15.44:0/911613935 >> v1:172.21.15.44:6789/0 conn(0x7fc68413d9d0 legacy=0x7fc6840cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:29.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.200+0000 7fc68359e700 1 -- 172.21.15.44:0/911613935 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68406f290 con 0x7fc68413f5d0 2024-09-13T18:35:29.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.200+0000 7fc68359e700 1 --2- 172.21.15.44:0/911613935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc68413f5d0 0x7fc68406e900 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009d90 tx=0x7fc67c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f7437e61049cd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:29.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.200+0000 7fc681d9b700 1 -- 172.21.15.44:0/911613935 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c00e070 con 0x7fc68413f5d0 2024-09-13T18:35:29.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.200+0000 7fc681d9b700 1 -- 172.21.15.44:0/911613935 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c00bbd0 con 0x7fc68413f5d0 2024-09-13T18:35:29.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.200+0000 7fc681d9b700 1 -- 172.21.15.44:0/911613935 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c012430 con 0x7fc68413f5d0 2024-09-13T18:35:29.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.200+0000 7fc6889cc700 1 -- 172.21.15.44:0/911613935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc68413f5d0 msgr2=0x7fc68406e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:29.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.200+0000 7fc6889cc700 1 --2- 172.21.15.44:0/911613935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc68413f5d0 0x7fc68406e900 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009d90 tx=0x7fc67c00b330 comp rx=0 tx=0).stop 2024-09-13T18:35:29.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.200+0000 7fc6889cc700 1 -- 172.21.15.44:0/911613935 shutdown_connections 2024-09-13T18:35:29.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.200+0000 7fc6889cc700 1 --2- 172.21.15.44:0/911613935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc68413f5d0 0x7fc68406e900 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:29.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.200+0000 7fc6889cc700 1 -- 172.21.15.44:0/911613935 >> 172.21.15.44:0/911613935 conn(0x7fc68406a4f0 msgr2=0x7fc684071d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:29.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.200+0000 7fc6889cc700 1 -- 172.21.15.44:0/911613935 shutdown_connections 2024-09-13T18:35:29.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.200+0000 7fc6889cc700 1 -- 172.21.15.44:0/911613935 wait complete. 2024-09-13T18:35:29.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.204+0000 7fc6889cc700 1 Processor -- start 2024-09-13T18:35:29.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.204+0000 7fc6889cc700 1 -- start start 2024-09-13T18:35:29.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.204+0000 7fc6889cc700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6840d04e0 0x7fc684139560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:29.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.204+0000 7fc6889cc700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc68413d9d0 0x7fc68415d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:29.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.204+0000 7fc6889cc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc68413f5d0 0x7fc68415d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:29.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.204+0000 7fc6889cc700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc684157390 con 0x7fc68413f5d0 2024-09-13T18:35:29.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.204+0000 7fc6889cc700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc684139aa0 con 0x7fc6840d04e0 2024-09-13T18:35:29.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.204+0000 7fc6889cc700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68415db30 con 0x7fc68413d9d0 2024-09-13T18:35:29.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.204+0000 7fc68359e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc68413f5d0 0x7fc68415d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:29.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.204+0000 7fc68359e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc68413f5d0 0x7fc68415d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52668/0 (socket says 172.21.15.44:52668) 2024-09-13T18:35:29.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.204+0000 7fc68359e700 1 -- 172.21.15.44:0/2684972810 learned_addr learned my addr 172.21.15.44:0/2684972810 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:29.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.204+0000 7fc682d9d700 1 --2- 172.21.15.44:0/2684972810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6840d04e0 0x7fc684139560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:29.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.204+0000 7fc68259c700 1 --2- 172.21.15.44:0/2684972810 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc68413d9d0 0x7fc68415d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:29.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.204+0000 7fc68359e700 1 -- 172.21.15.44:0/2684972810 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc68413d9d0 msgr2=0x7fc68415d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:29.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.204+0000 7fc68359e700 1 --2- 172.21.15.44:0/2684972810 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc68413d9d0 0x7fc68415d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:29.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.204+0000 7fc68359e700 1 -- 172.21.15.44:0/2684972810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6840d04e0 msgr2=0x7fc684139560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:29.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.204+0000 7fc68359e700 1 --2- 172.21.15.44:0/2684972810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6840d04e0 0x7fc684139560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:29.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.204+0000 7fc68359e700 1 -- 172.21.15.44:0/2684972810 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67c009a70 con 0x7fc68413f5d0 2024-09-13T18:35:29.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.204+0000 7fc68259c700 1 --2- 172.21.15.44:0/2684972810 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc68413d9d0 0x7fc68415d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:29.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.204+0000 7fc68359e700 1 --2- 172.21.15.44:0/2684972810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc68413f5d0 0x7fc68415d5f0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fc6840cd820 tx=0x7fc67c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:29.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.208+0000 7fc67b7fe700 1 -- 172.21.15.44:0/2684972810 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c012430 con 0x7fc68413f5d0 2024-09-13T18:35:29.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.208+0000 7fc67b7fe700 1 -- 172.21.15.44:0/2684972810 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c020070 con 0x7fc68413f5d0 2024-09-13T18:35:29.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.208+0000 7fc6889cc700 1 -- 172.21.15.44:0/2684972810 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc684156a60 con 0x7fc68413f5d0 2024-09-13T18:35:29.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.208+0000 7fc67b7fe700 1 -- 172.21.15.44:0/2684972810 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c004280 con 0x7fc68413f5d0 2024-09-13T18:35:29.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.208+0000 7fc6889cc700 1 -- 172.21.15.44:0/2684972810 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc684157020 con 0x7fc68413f5d0 2024-09-13T18:35:29.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.208+0000 7fc6889cc700 1 -- 172.21.15.44:0/2684972810 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc684157540 con 0x7fc68413f5d0 2024-09-13T18:35:29.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.208+0000 7fc67b7fe700 1 -- 172.21.15.44:0/2684972810 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc67c0043e0 con 0x7fc68413f5d0 2024-09-13T18:35:29.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.208+0000 7fc67b7fe700 1 --2- 172.21.15.44:0/2684972810 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc664066760 0x7fc664068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:29.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.212+0000 7fc67b7fe700 1 -- 172.21.15.44:0/2684972810 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fc67c022070 con 0x7fc68413f5d0 2024-09-13T18:35:29.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.212+0000 7fc682d9d700 1 --2- 172.21.15.44:0/2684972810 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc664066760 0x7fc664068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:29.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.212+0000 7fc682d9d700 1 --2- 172.21.15.44:0/2684972810 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc664066760 0x7fc664068c20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc674005930 tx=0x7fc674009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:29.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.216+0000 7fc67b7fe700 1 -- 172.21.15.44:0/2684972810 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc684157540 con 0x7fc68413f5d0 2024-09-13T18:35:29.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.396+0000 7fc6889cc700 1 -- 172.21.15.44:0/2684972810 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc684157540 con 0x7fc68413f5d0 2024-09-13T18:35:29.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.400+0000 7fc67b7fe700 1 -- 172.21.15.44:0/2684972810 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v66) v1 ==== 80+0+366 (secure 0 0 0) 0x7fc684157540 con 0x7fc68413f5d0 2024-09-13T18:35:29.405 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.99:6836/3072614790 2024-09-14T18:35:19.260455+0000 2024-09-13T18:35:29.405 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.99:6837/3072614790 2024-09-14T18:35:19.260455+0000 2024-09-13T18:35:29.405 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/1074184606 2024-09-14T18:35:18.166304+0000 2024-09-13T18:35:29.405 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/1074184606 2024-09-14T18:35:18.166304+0000 2024-09-13T18:35:29.405 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/1608555972 2024-09-14T18:34:13.117246+0000 2024-09-13T18:35:29.405 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/1608555972 2024-09-14T18:34:13.117246+0000 2024-09-13T18:35:29.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.400+0000 7fc6889cc700 1 -- 172.21.15.44:0/2684972810 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc664066760 msgr2=0x7fc664068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:29.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.400+0000 7fc6889cc700 1 --2- 172.21.15.44:0/2684972810 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc664066760 0x7fc664068c20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc674005930 tx=0x7fc674009040 comp rx=0 tx=0).stop 2024-09-13T18:35:29.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.400+0000 7fc6889cc700 1 -- 172.21.15.44:0/2684972810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc68413f5d0 msgr2=0x7fc68415d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:29.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.400+0000 7fc6889cc700 1 --2- 172.21.15.44:0/2684972810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc68413f5d0 0x7fc68415d5f0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fc6840cd820 tx=0x7fc67c004af0 comp rx=0 tx=0).stop 2024-09-13T18:35:29.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.400+0000 7fc6889cc700 1 -- 172.21.15.44:0/2684972810 shutdown_connections 2024-09-13T18:35:29.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.400+0000 7fc6889cc700 1 --2- 172.21.15.44:0/2684972810 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc664066760 0x7fc664068c20 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:29.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.400+0000 7fc6889cc700 1 --2- 172.21.15.44:0/2684972810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc68413f5d0 0x7fc68415d5f0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:29.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.400+0000 7fc6889cc700 1 --2- 172.21.15.44:0/2684972810 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc68413d9d0 0x7fc68415d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:29.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.400+0000 7fc6889cc700 1 --2- 172.21.15.44:0/2684972810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6840d04e0 0x7fc684139560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:29.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.400+0000 7fc6889cc700 1 -- 172.21.15.44:0/2684972810 >> 172.21.15.44:0/2684972810 conn(0x7fc68406a4f0 msgr2=0x7fc6840b5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:29.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.400+0000 7fc6889cc700 1 -- 172.21.15.44:0/2684972810 shutdown_connections 2024-09-13T18:35:29.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.400+0000 7fc6889cc700 1 -- 172.21.15.44:0/2684972810 wait complete. 2024-09-13T18:35:29.409 INFO:teuthology.orchestra.run.smithi044.stderr:listed 6 entries 2024-09-13T18:35:29.420 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2024-09-13T18:35:29.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:29.420 DEBUG:teuthology.orchestra.run.smithi044:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:35:29.429 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[44943]: fuse finished with error 0 and tester_r 0 2024-09-13T18:35:29.431 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:35:29.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:29.431 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:35:29.595 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:35:29.595 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:35:29.603 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346268k,nr_inodes=4086567,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19562 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275480k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:35:29.603 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:35:29.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:29.603 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:35:29.652 INFO:teuthology.orchestra.run.smithi099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-13T18:35:29.653 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:35:29.656 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:35:29.656 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:35:29.664 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349428k,nr_inodes=4087357,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16693 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276112k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:35:29.664 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:35:29.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:29.665 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T18:35:29.719 INFO:teuthology.orchestra.run.smithi044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T18:35:29.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:35:29.720 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:35:29.720 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:35:29.728 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346268k,nr_inodes=4086567,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19562 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275480k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:35:29.728 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:35:29.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:29.728 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T18:35:29.735 INFO:teuthology.orchestra.run.smithi099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T18:35:29.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:35:29.736 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:35:29.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.856+0000 7f551bb45700 1 Processor -- start 2024-09-13T18:35:29.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.856+0000 7f551bb45700 1 -- start start 2024-09-13T18:35:29.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.856+0000 7f551bb45700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55140cdcc0 0x7f55140b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:29.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.856+0000 7f551bb45700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f55140b2930 0x7f551406ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:29.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.856+0000 7f551bb45700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55140b2dc0 con 0x7f551415b890 2024-09-13T18:35:29.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.856+0000 7f551bb45700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f551415bc70 con 0x7f55140b2930 2024-09-13T18:35:29.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.856+0000 7f551bb45700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55140ccc20 con 0x7f55140cdcc0 2024-09-13T18:35:29.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.856+0000 7f55198e1700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f551415b890 0x7f5514162220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47726/0 (socket says 172.21.15.44:47726) 2024-09-13T18:35:29.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.856+0000 7f55198e1700 1 -- 172.21.15.44:0/1340182888 learned_addr learned my addr 172.21.15.44:0/1340182888 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:29.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.856+0000 7f551a0e2700 1 --2- 172.21.15.44:0/1340182888 >> v2:172.21.15.44:3300/0 conn(0x7f55140b2930 0x7f551406ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:29.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.856+0000 7f55190e0700 1 --2- 172.21.15.44:0/1340182888 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55140cdcc0 0x7f55140b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:29.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.856+0000 7f55188df700 1 -- 172.21.15.44:0/1340182888 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247532832 0 0) 0x7f5510001110 con 0x7f551415b890 2024-09-13T18:35:29.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.856+0000 7f55188df700 1 -- 172.21.15.44:0/1340182888 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54fc0035d0 con 0x7f551415b890 2024-09-13T18:35:29.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.856+0000 7f551a0e2700 1 -- 172.21.15.44:0/1340182888 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55140cdcc0 msgr2=0x7f55140b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:29.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.856+0000 7f551a0e2700 1 --2- 172.21.15.44:0/1340182888 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55140cdcc0 0x7f55140b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:29.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.856+0000 7f551a0e2700 1 -- 172.21.15.44:0/1340182888 >> v1:172.21.15.44:6789/0 conn(0x7f551415b890 legacy=0x7f5514162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:29.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.856+0000 7f551a0e2700 1 -- 172.21.15.44:0/1340182888 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55140ccf00 con 0x7f55140b2930 2024-09-13T18:35:29.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.856+0000 7f551a0e2700 1 --2- 172.21.15.44:0/1340182888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55140b2930 0x7f551406ffe0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f5504009850 tx=0x7f5504009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce853769dde0a6f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:29.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.856+0000 7f55188df700 1 -- 172.21.15.44:0/1340182888 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5504011830 con 0x7f55140b2930 2024-09-13T18:35:29.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.856+0000 7f55188df700 1 -- 172.21.15.44:0/1340182888 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5504011990 con 0x7f55140b2930 2024-09-13T18:35:29.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.856+0000 7f55188df700 1 -- 172.21.15.44:0/1340182888 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5504011d40 con 0x7f55140b2930 2024-09-13T18:35:29.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f551bb45700 1 -- 172.21.15.44:0/1340182888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55140b2930 msgr2=0x7f551406ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:29.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f551bb45700 1 --2- 172.21.15.44:0/1340182888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55140b2930 0x7f551406ffe0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f5504009850 tx=0x7f5504009b60 comp rx=0 tx=0).stop 2024-09-13T18:35:29.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f551bb45700 1 -- 172.21.15.44:0/1340182888 shutdown_connections 2024-09-13T18:35:29.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f551bb45700 1 --2- 172.21.15.44:0/1340182888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55140b2930 0x7f551406ffe0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:29.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f551bb45700 1 --2- 172.21.15.44:0/1340182888 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55140cdcc0 0x7f55140b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:29.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f551bb45700 1 -- 172.21.15.44:0/1340182888 >> 172.21.15.44:0/1340182888 conn(0x7f55140ce980 msgr2=0x7f55140ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:29.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f551bb45700 1 -- 172.21.15.44:0/1340182888 shutdown_connections 2024-09-13T18:35:29.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f551bb45700 1 -- 172.21.15.44:0/1340182888 wait complete. 2024-09-13T18:35:29.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f551bb45700 1 Processor -- start 2024-09-13T18:35:29.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f551bb45700 1 -- start start 2024-09-13T18:35:29.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f551bb45700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55140b2930 0x7f55141f7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:29.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f551bb45700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55140cdcc0 0x7f55141581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f551bb45700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f551415b890 0x7f5514154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f551bb45700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55141559a0 con 0x7f55140cdcc0 2024-09-13T18:35:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f551bb45700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5514155c40 con 0x7f55140b2930 2024-09-13T18:35:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f551bb45700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5514155f20 con 0x7f551415b890 2024-09-13T18:35:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f55190e0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55140cdcc0 0x7f55141581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f55190e0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55140cdcc0 0x7f55141581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52700/0 (socket says 172.21.15.44:52700) 2024-09-13T18:35:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f55190e0700 1 -- 172.21.15.44:0/711798299 learned_addr learned my addr 172.21.15.44:0/711798299 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f55198e1700 1 --2- 172.21.15.44:0/711798299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55140b2930 0x7f55141f7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f551a0e2700 1 --2- 172.21.15.44:0/711798299 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f551415b890 0x7f5514154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f55190e0700 1 -- 172.21.15.44:0/711798299 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f551415b890 msgr2=0x7f5514154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f55190e0700 1 --2- 172.21.15.44:0/711798299 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f551415b890 0x7f5514154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f55190e0700 1 -- 172.21.15.44:0/711798299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55140b2930 msgr2=0x7f55141f7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:29.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.860+0000 7f55190e0700 1 --2- 172.21.15.44:0/711798299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55140b2930 0x7f55141f7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:29.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.864+0000 7f55190e0700 1 -- 172.21.15.44:0/711798299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55040094b0 con 0x7f55140cdcc0 2024-09-13T18:35:29.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.864+0000 7f551a0e2700 1 --2- 172.21.15.44:0/711798299 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f551415b890 0x7f5514154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:29.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.864+0000 7f55190e0700 1 --2- 172.21.15.44:0/711798299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55140cdcc0 0x7f55141581f0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f550c00efc0 tx=0x7f550c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:29.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.864+0000 7f550a7fc700 1 -- 172.21.15.44:0/711798299 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c00cdc0 con 0x7f55140cdcc0 2024-09-13T18:35:29.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.864+0000 7f550a7fc700 1 -- 172.21.15.44:0/711798299 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550c00f040 con 0x7f55140cdcc0 2024-09-13T18:35:29.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.864+0000 7f551bb45700 1 -- 172.21.15.44:0/711798299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5514156200 con 0x7f55140cdcc0 2024-09-13T18:35:29.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.864+0000 7f550a7fc700 1 -- 172.21.15.44:0/711798299 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c0146a0 con 0x7f55140cdcc0 2024-09-13T18:35:29.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.864+0000 7f551bb45700 1 -- 172.21.15.44:0/711798299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5514155010 con 0x7f55140cdcc0 2024-09-13T18:35:29.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.864+0000 7f551bb45700 1 -- 172.21.15.44:0/711798299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55140ce120 con 0x7f55140cdcc0 2024-09-13T18:35:29.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.864+0000 7f550a7fc700 1 -- 172.21.15.44:0/711798299 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f550c014800 con 0x7f55140cdcc0 2024-09-13T18:35:29.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.864+0000 7f550a7fc700 1 --2- 172.21.15.44:0/711798299 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5500066730 0x7f5500068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:29.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.864+0000 7f550a7fc700 1 -- 172.21.15.44:0/711798299 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f550c084bd0 con 0x7f55140cdcc0 2024-09-13T18:35:29.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.864+0000 7f55198e1700 1 --2- 172.21.15.44:0/711798299 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5500066730 0x7f5500068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:29.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.868+0000 7f55198e1700 1 --2- 172.21.15.44:0/711798299 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5500066730 0x7f5500068bf0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5510001270 tx=0x7f5510009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:29.876+0000 7f550a7fc700 1 -- 172.21.15.44:0/711798299 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f550c051e50 con 0x7f55140cdcc0 2024-09-13T18:35:30.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.084+0000 7f551bb45700 1 -- 172.21.15.44:0/711798299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5514156850 con 0x7f55140cdcc0 2024-09-13T18:35:30.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.084+0000 7f550a7fc700 1 -- 172.21.15.44:0/711798299 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4735 (secure 0 0 0) 0x7f5514156850 con 0x7f55140cdcc0 2024-09-13T18:35:30.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:30.090 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":62,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2305930667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2305930667},{"type":"v1","addr":"172.21.15.99:6835","nonce":2305930667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1177460745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1177460745},{"type":"v1","addr":"172.21.15.44:6834","nonce":1177460745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7395,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1292209064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1292209064},{"type":"v1","addr":"172.21.15.44:6835","nonce":1292209064}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:35:20.700105+0000","modified":"2024-09-13T18:35:24.301327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7093},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_7093":{"gid":7093,"name":"d","rank":0,"incarnation":59,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6837/1121392581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1121392581},{"type":"v1","addr":"172.21.15.99:6837","nonce":1121392581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:35:30.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.088+0000 7f551bb45700 1 -- 172.21.15.44:0/711798299 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5500066730 msgr2=0x7f5500068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:30.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.088+0000 7f551bb45700 1 --2- 172.21.15.44:0/711798299 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5500066730 0x7f5500068bf0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5510001270 tx=0x7f5510009040 comp rx=0 tx=0).stop 2024-09-13T18:35:30.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.088+0000 7f551bb45700 1 -- 172.21.15.44:0/711798299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55140cdcc0 msgr2=0x7f55141581f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:30.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.088+0000 7f551bb45700 1 --2- 172.21.15.44:0/711798299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55140cdcc0 0x7f55141581f0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f550c00efc0 tx=0x7f550c00c3a0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.088+0000 7f551bb45700 1 -- 172.21.15.44:0/711798299 shutdown_connections 2024-09-13T18:35:30.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.088+0000 7f551bb45700 1 --2- 172.21.15.44:0/711798299 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5500066730 0x7f5500068bf0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.088+0000 7f551bb45700 1 --2- 172.21.15.44:0/711798299 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f551415b890 0x7f5514154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.088+0000 7f551bb45700 1 --2- 172.21.15.44:0/711798299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55140cdcc0 0x7f55141581f0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.088+0000 7f551bb45700 1 --2- 172.21.15.44:0/711798299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55140b2930 0x7f55141f7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.088+0000 7f551bb45700 1 -- 172.21.15.44:0/711798299 >> 172.21.15.44:0/711798299 conn(0x7f55140ce980 msgr2=0x7f55140aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:30.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.088+0000 7f551bb45700 1 -- 172.21.15.44:0/711798299 shutdown_connections 2024-09-13T18:35:30.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.088+0000 7f551bb45700 1 -- 172.21.15.44:0/711798299 wait complete. 2024-09-13T18:35:30.094 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 62 2024-09-13T18:35:30.106 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:30.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.212+0000 7fcc92e56700 1 Processor -- start 2024-09-13T18:35:30.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.212+0000 7fcc92e56700 1 -- start start 2024-09-13T18:35:30.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.212+0000 7fcc92e56700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcc8c15cec0 0x7fcc8c0cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:30.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.212+0000 7fcc92e56700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcc8c06b310 0x7fcc8c0d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:30.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.212+0000 7fcc92e56700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc8c0d21e0 con 0x7fcc8c15cae0 2024-09-13T18:35:30.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.212+0000 7fcc92e56700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc8c0d1750 con 0x7fcc8c06b310 2024-09-13T18:35:30.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.212+0000 7fcc92e56700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c0d1940 con 0x7fcc8c15cec0 2024-09-13T18:35:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.212+0000 7fcc91e54700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fcc8c15cae0 0x7fcc8c06ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47742/0 (socket says 172.21.15.44:47742) 2024-09-13T18:35:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.212+0000 7fcc91e54700 1 -- 172.21.15.44:0/1934353328 learned_addr learned my addr 172.21.15.44:0/1934353328 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.212+0000 7fcc92655700 1 --2- 172.21.15.44:0/1934353328 >> v2:172.21.15.99:3300/0 conn(0x7fcc8c06b310 0x7fcc8c0d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.212+0000 7fcc91653700 1 --2- 172.21.15.44:0/1934353328 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcc8c15cec0 0x7fcc8c0cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.216+0000 7fcc90e52700 1 -- 172.21.15.44:0/1934353328 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349480465 0 0) 0x7fcc8c0d21e0 con 0x7fcc8c15cae0 2024-09-13T18:35:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.216+0000 7fcc90e52700 1 -- 172.21.15.44:0/1934353328 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc780035d0 con 0x7fcc8c15cae0 2024-09-13T18:35:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.216+0000 7fcc92655700 1 -- 172.21.15.44:0/1934353328 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcc8c15cec0 msgr2=0x7fcc8c0cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.216+0000 7fcc92655700 1 --2- 172.21.15.44:0/1934353328 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcc8c15cec0 0x7fcc8c0cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.216+0000 7fcc92655700 1 -- 172.21.15.44:0/1934353328 >> v1:172.21.15.44:6789/0 conn(0x7fcc8c15cae0 legacy=0x7fcc8c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.216+0000 7fcc90e52700 1 -- 172.21.15.44:0/1934353328 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 143446463 0 0) 0x7fcc780035d0 con 0x7fcc8c15cae0 2024-09-13T18:35:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.216+0000 7fcc92655700 1 -- 172.21.15.44:0/1934353328 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8c0d1c20 con 0x7fcc8c06b310 2024-09-13T18:35:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.216+0000 7fcc91653700 1 --2- 172.21.15.44:0/1934353328 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcc8c15cec0 0x7fcc8c0cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.216+0000 7fcc92655700 1 --2- 172.21.15.44:0/1934353328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc8c06b310 0x7fcc8c0d1210 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009d90 tx=0x7fcc8400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f31c7e39dade5f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:30.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.216+0000 7fcc90e52700 1 -- 172.21.15.44:0/1934353328 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8400e070 con 0x7fcc8c06b310 2024-09-13T18:35:30.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.216+0000 7fcc90e52700 1 -- 172.21.15.44:0/1934353328 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc84003a40 con 0x7fcc8c06b310 2024-09-13T18:35:30.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.216+0000 7fcc90e52700 1 -- 172.21.15.44:0/1934353328 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c001670 con 0x7fcc8c06b310 2024-09-13T18:35:30.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.216+0000 7fcc92e56700 1 -- 172.21.15.44:0/1934353328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc8c06b310 msgr2=0x7fcc8c0d1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:30.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.216+0000 7fcc92e56700 1 --2- 172.21.15.44:0/1934353328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc8c06b310 0x7fcc8c0d1210 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009d90 tx=0x7fcc8400b330 comp rx=0 tx=0).stop 2024-09-13T18:35:30.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.216+0000 7fcc92e56700 1 -- 172.21.15.44:0/1934353328 shutdown_connections 2024-09-13T18:35:30.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.216+0000 7fcc92e56700 1 --2- 172.21.15.44:0/1934353328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc8c06b310 0x7fcc8c0d1210 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.216+0000 7fcc92e56700 1 --2- 172.21.15.44:0/1934353328 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcc8c15cec0 0x7fcc8c0cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.216+0000 7fcc92e56700 1 -- 172.21.15.44:0/1934353328 >> 172.21.15.44:0/1934353328 conn(0x7fcc8c0d2c80 msgr2=0x7fcc8c0d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:30.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.216+0000 7fcc92e56700 1 -- 172.21.15.44:0/1934353328 shutdown_connections 2024-09-13T18:35:30.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.216+0000 7fcc92e56700 1 -- 172.21.15.44:0/1934353328 wait complete. 2024-09-13T18:35:30.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc92e56700 1 Processor -- start 2024-09-13T18:35:30.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc92e56700 1 -- start start 2024-09-13T18:35:30.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc92e56700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc8c06b310 0x7fcc8c0c6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:30.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc92e56700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcc8c15cae0 0x7fcc8c153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:30.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc92e56700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc8c15cec0 0x7fcc8c0c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:30.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc92e56700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c0c6cb0 con 0x7fcc8c06b310 2024-09-13T18:35:30.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc92e56700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c1544c0 con 0x7fcc8c15cec0 2024-09-13T18:35:30.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc92e56700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c0c6ec0 con 0x7fcc8c15cae0 2024-09-13T18:35:30.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc91e54700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc8c06b310 0x7fcc8c0c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:30.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc91e54700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc8c06b310 0x7fcc8c0c6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52704/0 (socket says 172.21.15.44:52704) 2024-09-13T18:35:30.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc91e54700 1 -- 172.21.15.44:0/2809756773 learned_addr learned my addr 172.21.15.44:0/2809756773 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:30.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc92655700 1 --2- 172.21.15.44:0/2809756773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc8c15cec0 0x7fcc8c0c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:30.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc91653700 1 --2- 172.21.15.44:0/2809756773 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcc8c15cae0 0x7fcc8c153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:30.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc91e54700 1 -- 172.21.15.44:0/2809756773 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcc8c15cae0 msgr2=0x7fcc8c153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:30.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc91e54700 1 --2- 172.21.15.44:0/2809756773 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcc8c15cae0 0x7fcc8c153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc91e54700 1 -- 172.21.15.44:0/2809756773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc8c15cec0 msgr2=0x7fcc8c0c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:30.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc91e54700 1 --2- 172.21.15.44:0/2809756773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc8c15cec0 0x7fcc8c0c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc91e54700 1 -- 172.21.15.44:0/2809756773 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc880094b0 con 0x7fcc8c06b310 2024-09-13T18:35:30.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc92655700 1 --2- 172.21.15.44:0/2809756773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc8c15cec0 0x7fcc8c0c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:30.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc91653700 1 --2- 172.21.15.44:0/2809756773 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcc8c15cae0 0x7fcc8c153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:30.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc91e54700 1 --2- 172.21.15.44:0/2809756773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc8c06b310 0x7fcc8c0c6770 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0011e0 tx=0x7fcc7c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:30.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc827fc700 1 -- 172.21.15.44:0/2809756773 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c004ca0 con 0x7fcc8c06b310 2024-09-13T18:35:30.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc827fc700 1 -- 172.21.15.44:0/2809756773 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c004e20 con 0x7fcc8c06b310 2024-09-13T18:35:30.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc92e56700 1 -- 172.21.15.44:0/2809756773 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc84009a70 con 0x7fcc8c06b310 2024-09-13T18:35:30.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc827fc700 1 -- 172.21.15.44:0/2809756773 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c007310 con 0x7fcc8c06b310 2024-09-13T18:35:30.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc92e56700 1 -- 172.21.15.44:0/2809756773 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8c0c7480 con 0x7fcc8c06b310 2024-09-13T18:35:30.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.220+0000 7fcc92e56700 1 -- 172.21.15.44:0/2809756773 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc8c0d1210 con 0x7fcc8c06b310 2024-09-13T18:35:30.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.224+0000 7fcc827fc700 1 -- 172.21.15.44:0/2809756773 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcc7c007470 con 0x7fcc8c06b310 2024-09-13T18:35:30.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.224+0000 7fcc827fc700 1 --2- 172.21.15.44:0/2809756773 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcc70066730 0x7fcc70068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:30.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.224+0000 7fcc827fc700 1 -- 172.21.15.44:0/2809756773 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fcc7c0836a0 con 0x7fcc8c06b310 2024-09-13T18:35:30.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.224+0000 7fcc91653700 1 --2- 172.21.15.44:0/2809756773 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcc70066730 0x7fcc70068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:30.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.224+0000 7fcc91653700 1 --2- 172.21.15.44:0/2809756773 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcc70066730 0x7fcc70068bf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c15cab0 tx=0x7fcc88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:30.234 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:35:30.236 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:35:30.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.232+0000 7fcc827fc700 1 -- 172.21.15.44:0/2809756773 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcc7c050910 con 0x7fcc8c06b310 2024-09-13T18:35:30.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.408+0000 7fcc92e56700 1 -- 172.21.15.44:0/2809756773 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc8c06ac50 con 0x7fcc8c06b310 2024-09-13T18:35:30.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.412+0000 7fcc827fc700 1 -- 172.21.15.44:0/2809756773 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16894 (secure 0 0 0) 0x7fcc7c007720 con 0x7fcc8c06b310 2024-09-13T18:35:30.418 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:30.418 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":66,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:35:19.260517+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:14.682923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:15.291935+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:6836/3072614790":"2024-09-14T18:35:19.260455+0000","172.21.15.99:6837/3072614790":"2024-09-14T18:35:19.260455+0000","172.21.15.44:6835/1074184606":"2024-09-14T18:35:18.166304+0000","172.21.15.44:6833/1074184606":"2024-09-14T18:35:18.166304+0000","172.21.15.44:6835/1608555972":"2024-09-14T18:34:13.117246+0000","172.21.15.44:6833/1608555972":"2024-09-14T18:34:13.117246+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:30.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.412+0000 7fcc92e56700 1 -- 172.21.15.44:0/2809756773 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcc70066730 msgr2=0x7fcc70068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:30.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.412+0000 7fcc92e56700 1 --2- 172.21.15.44:0/2809756773 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcc70066730 0x7fcc70068bf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c15cab0 tx=0x7fcc88008040 comp rx=0 tx=0).stop 2024-09-13T18:35:30.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.412+0000 7fcc92e56700 1 -- 172.21.15.44:0/2809756773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc8c06b310 msgr2=0x7fcc8c0c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:30.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.412+0000 7fcc92e56700 1 --2- 172.21.15.44:0/2809756773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc8c06b310 0x7fcc8c0c6770 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0011e0 tx=0x7fcc7c00ca90 comp rx=0 tx=0).stop 2024-09-13T18:35:30.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.412+0000 7fcc92e56700 1 -- 172.21.15.44:0/2809756773 shutdown_connections 2024-09-13T18:35:30.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.412+0000 7fcc92e56700 1 --2- 172.21.15.44:0/2809756773 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcc70066730 0x7fcc70068bf0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.416+0000 7fcc92e56700 1 --2- 172.21.15.44:0/2809756773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc8c15cec0 0x7fcc8c0c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.416+0000 7fcc92e56700 1 --2- 172.21.15.44:0/2809756773 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcc8c15cae0 0x7fcc8c153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.416+0000 7fcc92e56700 1 --2- 172.21.15.44:0/2809756773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc8c06b310 0x7fcc8c0c6770 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.416+0000 7fcc92e56700 1 -- 172.21.15.44:0/2809756773 >> 172.21.15.44:0/2809756773 conn(0x7fcc8c0d2c80 msgr2=0x7fcc8c0ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:30.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.416+0000 7fcc92e56700 1 -- 172.21.15.44:0/2809756773 shutdown_connections 2024-09-13T18:35:30.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.416+0000 7fcc92e56700 1 -- 172.21.15.44:0/2809756773 wait complete. 2024-09-13T18:35:30.434 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:33:14.682923+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:33:15.291935+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:35:30.435 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:35:30.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.552+0000 7f2021f2b700 1 Processor -- start 2024-09-13T18:35:30.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.552+0000 7f2021f2b700 1 -- start start 2024-09-13T18:35:30.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f2021f2b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c06e4f0 0x7f201c167910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:30.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f2021f2b700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201c0cd730 con 0x7f201c0cebd0 2024-09-13T18:35:30.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f2021f2b700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201c0d0850 con 0x7f201c15ce90 2024-09-13T18:35:30.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f2021f2b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201c0adf30 con 0x7f201c06e4f0 2024-09-13T18:35:30.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f2013fff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f201c0cebd0 0x7f201c06dde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47758/0 (socket says 172.21.15.44:47758) 2024-09-13T18:35:30.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f2013fff700 1 -- 172.21.15.44:0/445426445 learned_addr learned my addr 172.21.15.44:0/445426445 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:30.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f202172a700 1 --2- 172.21.15.44:0/445426445 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c06e4f0 0x7f201c167910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:30.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f20137fe700 1 -- 172.21.15.44:0/445426445 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4075933118 0 0) 0x7f201c0cd730 con 0x7f201c0cebd0 2024-09-13T18:35:30.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f20137fe700 1 -- 172.21.15.44:0/445426445 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20040035d0 con 0x7f201c0cebd0 2024-09-13T18:35:30.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f20137fe700 1 -- 172.21.15.44:0/445426445 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165033685 0 0) 0x7f201c0d0850 con 0x7f201c15ce90 2024-09-13T18:35:30.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f20137fe700 1 -- 172.21.15.44:0/445426445 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f201c0cd730 con 0x7f201c15ce90 2024-09-13T18:35:30.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f202172a700 1 -- 172.21.15.44:0/445426445 >> v1:172.21.15.99:6789/0 conn(0x7f201c15ce90 legacy=0x7f201c0ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:30.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f202172a700 1 -- 172.21.15.44:0/445426445 >> v1:172.21.15.44:6789/0 conn(0x7f201c0cebd0 legacy=0x7f201c06dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:30.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f202172a700 1 -- 172.21.15.44:0/445426445 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c0ae210 con 0x7f201c06e4f0 2024-09-13T18:35:30.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f202172a700 1 --2- 172.21.15.44:0/445426445 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c06e4f0 0x7f201c167910 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2014009dc0 tx=0x7f201400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25662816160c056 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:30.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f20137fe700 1 -- 172.21.15.44:0/445426445 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201400e070 con 0x7f201c06e4f0 2024-09-13T18:35:30.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f20137fe700 1 -- 172.21.15.44:0/445426445 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201400bb20 con 0x7f201c06e4f0 2024-09-13T18:35:30.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f20137fe700 1 -- 172.21.15.44:0/445426445 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201400be90 con 0x7f201c06e4f0 2024-09-13T18:35:30.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f2021f2b700 1 -- 172.21.15.44:0/445426445 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c06e4f0 msgr2=0x7f201c167910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:30.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f2021f2b700 1 --2- 172.21.15.44:0/445426445 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c06e4f0 0x7f201c167910 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2014009dc0 tx=0x7f201400b330 comp rx=0 tx=0).stop 2024-09-13T18:35:30.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f2021f2b700 1 -- 172.21.15.44:0/445426445 shutdown_connections 2024-09-13T18:35:30.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f2021f2b700 1 --2- 172.21.15.44:0/445426445 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c06e4f0 0x7f201c167910 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f2021f2b700 1 -- 172.21.15.44:0/445426445 >> 172.21.15.44:0/445426445 conn(0x7f201c0cf9a0 msgr2=0x7f201c0cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:30.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f2021f2b700 1 -- 172.21.15.44:0/445426445 shutdown_connections 2024-09-13T18:35:30.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.556+0000 7f2021f2b700 1 -- 172.21.15.44:0/445426445 wait complete. 2024-09-13T18:35:30.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.560+0000 7f2021f2b700 1 Processor -- start 2024-09-13T18:35:30.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.560+0000 7f2021f2b700 1 -- start start 2024-09-13T18:35:30.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.560+0000 7f2021f2b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c06e4f0 0x7f201c153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:30.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.560+0000 7f2021f2b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f201c0cebd0 0x7f201c1474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:30.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.560+0000 7f2021f2b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f201c15ce90 0x7f201c1f5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:30.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.560+0000 7f2021f2b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c15a8c0 con 0x7f201c0cebd0 2024-09-13T18:35:30.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.560+0000 7f2021f2b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c1479f0 con 0x7f201c15ce90 2024-09-13T18:35:30.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.560+0000 7f2021f2b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201c06c880 con 0x7f201c06e4f0 2024-09-13T18:35:30.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.560+0000 7f2013fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f201c0cebd0 0x7f201c1474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.560+0000 7f2013fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f201c0cebd0 0x7f201c1474b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52718/0 (socket says 172.21.15.44:52718) 2024-09-13T18:35:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.560+0000 7f2013fff700 1 -- 172.21.15.44:0/1573693042 learned_addr learned my addr 172.21.15.44:0/1573693042 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.560+0000 7f202172a700 1 --2- 172.21.15.44:0/1573693042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f201c15ce90 0x7f201c1f5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.560+0000 7f2020f29700 1 --2- 172.21.15.44:0/1573693042 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c06e4f0 0x7f201c153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.560+0000 7f2013fff700 1 -- 172.21.15.44:0/1573693042 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c06e4f0 msgr2=0x7f201c153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.560+0000 7f2013fff700 1 --2- 172.21.15.44:0/1573693042 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c06e4f0 0x7f201c153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.560+0000 7f2013fff700 1 -- 172.21.15.44:0/1573693042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f201c15ce90 msgr2=0x7f201c1f5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.560+0000 7f2013fff700 1 --2- 172.21.15.44:0/1573693042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f201c15ce90 0x7f201c1f5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.560+0000 7f2013fff700 1 -- 172.21.15.44:0/1573693042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2014009a70 con 0x7f201c0cebd0 2024-09-13T18:35:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.560+0000 7f2013fff700 1 --2- 172.21.15.44:0/1573693042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f201c0cebd0 0x7f201c1474b0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f200c00c560 tx=0x7f200c00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.564+0000 7f20117fa700 1 -- 172.21.15.44:0/1573693042 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c005d90 con 0x7f201c0cebd0 2024-09-13T18:35:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.564+0000 7f2021f2b700 1 -- 172.21.15.44:0/1573693042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f201c15aab0 con 0x7f201c0cebd0 2024-09-13T18:35:30.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.564+0000 7f2021f2b700 1 -- 172.21.15.44:0/1573693042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f201c15b070 con 0x7f201c0cebd0 2024-09-13T18:35:30.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.564+0000 7f20117fa700 1 -- 172.21.15.44:0/1573693042 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200c0070d0 con 0x7f201c0cebd0 2024-09-13T18:35:30.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.564+0000 7f20117fa700 1 -- 172.21.15.44:0/1573693042 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c007460 con 0x7f201c0cebd0 2024-09-13T18:35:30.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.564+0000 7f2021f2b700 1 -- 172.21.15.44:0/1573693042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ffc005310 con 0x7f201c0cebd0 2024-09-13T18:35:30.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.564+0000 7f20117fa700 1 -- 172.21.15.44:0/1573693042 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f200c0075c0 con 0x7f201c0cebd0 2024-09-13T18:35:30.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.564+0000 7f20117fa700 1 --2- 172.21.15.44:0/1573693042 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2008066730 0x7f2008068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:30.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.564+0000 7f20117fa700 1 -- 172.21.15.44:0/1573693042 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f200c0836c0 con 0x7f201c0cebd0 2024-09-13T18:35:30.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.568+0000 7f2020f29700 1 --2- 172.21.15.44:0/1573693042 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2008066730 0x7f2008068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:30.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.568+0000 7f2020f29700 1 --2- 172.21.15.44:0/1573693042 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2008066730 0x7f2008068bf0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2018001850 tx=0x7f2018009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:30.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.576+0000 7f20117fa700 1 -- 172.21.15.44:0/1573693042 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f200c050940 con 0x7f201c0cebd0 2024-09-13T18:35:30.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.744+0000 7f2021f2b700 1 -- 172.21.15.44:0/1573693042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1ffc005b40 con 0x7f201c0cebd0 2024-09-13T18:35:30.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.744+0000 7f20117fa700 1 -- 172.21.15.44:0/1573693042 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) v1 ==== 93+0+10 (secure 0 0 0) 0x7f200c053f60 con 0x7f201c0cebd0 2024-09-13T18:35:30.751 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:35:30.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.748+0000 7f2021f2b700 1 -- 172.21.15.44:0/1573693042 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2008066730 msgr2=0x7f2008068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:30.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.748+0000 7f2021f2b700 1 --2- 172.21.15.44:0/1573693042 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2008066730 0x7f2008068bf0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2018001850 tx=0x7f2018009040 comp rx=0 tx=0).stop 2024-09-13T18:35:30.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.748+0000 7f2021f2b700 1 -- 172.21.15.44:0/1573693042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f201c0cebd0 msgr2=0x7f201c1474b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:30.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.748+0000 7f2021f2b700 1 --2- 172.21.15.44:0/1573693042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f201c0cebd0 0x7f201c1474b0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f200c00c560 tx=0x7f200c00c870 comp rx=0 tx=0).stop 2024-09-13T18:35:30.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.748+0000 7f2021f2b700 1 -- 172.21.15.44:0/1573693042 shutdown_connections 2024-09-13T18:35:30.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.748+0000 7f2021f2b700 1 --2- 172.21.15.44:0/1573693042 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2008066730 0x7f2008068bf0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.748+0000 7f2021f2b700 1 --2- 172.21.15.44:0/1573693042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f201c15ce90 0x7f201c1f5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.748+0000 7f2021f2b700 1 --2- 172.21.15.44:0/1573693042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f201c0cebd0 0x7f201c1474b0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.748+0000 7f2021f2b700 1 --2- 172.21.15.44:0/1573693042 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f201c06e4f0 0x7f201c153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.748+0000 7f2021f2b700 1 -- 172.21.15.44:0/1573693042 >> 172.21.15.44:0/1573693042 conn(0x7f201c0cf9a0 msgr2=0x7f201c0b4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:30.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.748+0000 7f2021f2b700 1 -- 172.21.15.44:0/1573693042 shutdown_connections 2024-09-13T18:35:30.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.748+0000 7f2021f2b700 1 -- 172.21.15.44:0/1573693042 wait complete. 2024-09-13T18:35:30.766 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:35:30.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.884+0000 7f8e5d712700 1 Processor -- start 2024-09-13T18:35:30.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.884+0000 7f8e5d712700 1 -- start start 2024-09-13T18:35:30.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.884+0000 7f8e5d712700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8e580ce300 0x7f8e580ad270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:30.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.884+0000 7f8e5d712700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e580ae000 con 0x7f8e580ad7b0 2024-09-13T18:35:30.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.884+0000 7f8e5d712700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e58070070 con 0x7f8e58146160 2024-09-13T18:35:30.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.884+0000 7f8e5d712700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e580cc820 con 0x7f8e580ce300 2024-09-13T18:35:30.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.884+0000 7f8e577fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8e580ce300 0x7f8e580ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:30.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.884+0000 7f8e577fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8e580ce300 0x7f8e580ad270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52732/0 (socket says 172.21.15.44:52732) 2024-09-13T18:35:30.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.884+0000 7f8e577fe700 1 -- 172.21.15.44:0/4069421349 learned_addr learned my addr 172.21.15.44:0/4069421349 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:30.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.884+0000 7f8e5cf11700 1 --1- 172.21.15.44:0/4069421349 >> v1:172.21.15.44:6789/0 conn(0x7f8e580ad7b0 0x7f8e58070b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47768/0 (socket says 172.21.15.44:47768) 2024-09-13T18:35:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.884+0000 7f8e577fe700 1 -- 172.21.15.44:0/4069421349 >> v1:172.21.15.99:6789/0 conn(0x7f8e58146160 legacy=0x7f8e580cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.884+0000 7f8e577fe700 1 -- 172.21.15.44:0/4069421349 >> v1:172.21.15.44:6789/0 conn(0x7f8e580ad7b0 legacy=0x7f8e58070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.884+0000 7f8e577fe700 1 -- 172.21.15.44:0/4069421349 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e58070350 con 0x7f8e580ce300 2024-09-13T18:35:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.884+0000 7f8e577fe700 1 --2- 172.21.15.44:0/4069421349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e580ce300 0x7f8e580ad270 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c009910 tx=0x7f8e4c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b41c35387ff465 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.884+0000 7f8e56ffd700 1 -- 172.21.15.44:0/4069421349 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c00ba60 con 0x7f8e580ce300 2024-09-13T18:35:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.884+0000 7f8e56ffd700 1 -- 172.21.15.44:0/4069421349 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4c00bbc0 con 0x7f8e580ce300 2024-09-13T18:35:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.884+0000 7f8e56ffd700 1 -- 172.21.15.44:0/4069421349 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c009e60 con 0x7f8e580ce300 2024-09-13T18:35:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.888+0000 7f8e5d712700 1 -- 172.21.15.44:0/4069421349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e580ce300 msgr2=0x7f8e580ad270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.888+0000 7f8e5d712700 1 --2- 172.21.15.44:0/4069421349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e580ce300 0x7f8e580ad270 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c009910 tx=0x7f8e4c009c20 comp rx=0 tx=0).stop 2024-09-13T18:35:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.888+0000 7f8e5d712700 1 -- 172.21.15.44:0/4069421349 shutdown_connections 2024-09-13T18:35:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.888+0000 7f8e5d712700 1 --2- 172.21.15.44:0/4069421349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e580ce300 0x7f8e580ad270 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.888+0000 7f8e5d712700 1 -- 172.21.15.44:0/4069421349 >> 172.21.15.44:0/4069421349 conn(0x7f8e580b0e10 msgr2=0x7f8e580b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:30.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.888+0000 7f8e5d712700 1 -- 172.21.15.44:0/4069421349 shutdown_connections 2024-09-13T18:35:30.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.888+0000 7f8e5d712700 1 -- 172.21.15.44:0/4069421349 wait complete. 2024-09-13T18:35:30.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.888+0000 7f8e5d712700 1 Processor -- start 2024-09-13T18:35:30.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.888+0000 7f8e5d712700 1 -- start start 2024-09-13T18:35:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.888+0000 7f8e5d712700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e580ad7b0 0x7f8e5813de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e5d712700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8e580ce300 0x7f8e58141410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e5d712700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e58146160 0x7f8e5813bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e5d712700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e58140370 con 0x7f8e580ad7b0 2024-09-13T18:35:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e5d712700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e58140650 con 0x7f8e58146160 2024-09-13T18:35:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e5d712700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e58140930 con 0x7f8e580ce300 2024-09-13T18:35:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e57fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e580ad7b0 0x7f8e5813de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e57fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e580ad7b0 0x7f8e5813de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52744/0 (socket says 172.21.15.44:52744) 2024-09-13T18:35:30.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e57fff700 1 -- 172.21.15.44:0/3087238723 learned_addr learned my addr 172.21.15.44:0/3087238723 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:30.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e577fe700 1 --2- 172.21.15.44:0/3087238723 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8e580ce300 0x7f8e58141410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:30.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e5cf11700 1 --2- 172.21.15.44:0/3087238723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e58146160 0x7f8e5813bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:30.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e57fff700 1 -- 172.21.15.44:0/3087238723 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8e580ce300 msgr2=0x7f8e58141410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:30.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e57fff700 1 --2- 172.21.15.44:0/3087238723 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8e580ce300 0x7f8e58141410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e57fff700 1 -- 172.21.15.44:0/3087238723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e58146160 msgr2=0x7f8e5813bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:30.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e57fff700 1 --2- 172.21.15.44:0/3087238723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e58146160 0x7f8e5813bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:30.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e57fff700 1 -- 172.21.15.44:0/3087238723 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c009570 con 0x7f8e580ad7b0 2024-09-13T18:35:30.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e5cf11700 1 --2- 172.21.15.44:0/3087238723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e58146160 0x7f8e5813bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:30.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e57fff700 1 --2- 172.21.15.44:0/3087238723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e580ad7b0 0x7f8e5813de00 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f8e4800c500 tx=0x7f8e4800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:30.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e54ff9700 1 -- 172.21.15.44:0/3087238723 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e480052d0 con 0x7f8e580ad7b0 2024-09-13T18:35:30.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e54ff9700 1 -- 172.21.15.44:0/3087238723 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e48005430 con 0x7f8e580ad7b0 2024-09-13T18:35:30.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e5d712700 1 -- 172.21.15.44:0/3087238723 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e58140c10 con 0x7f8e580ad7b0 2024-09-13T18:35:30.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e54ff9700 1 -- 172.21.15.44:0/3087238723 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e480055a0 con 0x7f8e580ad7b0 2024-09-13T18:35:30.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e5d712700 1 -- 172.21.15.44:0/3087238723 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5813c520 con 0x7f8e580ad7b0 2024-09-13T18:35:30.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e5d712700 1 -- 172.21.15.44:0/3087238723 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e58141950 con 0x7f8e580ad7b0 2024-09-13T18:35:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e54ff9700 1 -- 172.21.15.44:0/3087238723 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8e480038e0 con 0x7f8e580ad7b0 2024-09-13T18:35:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.892+0000 7f8e54ff9700 1 --2- 172.21.15.44:0/3087238723 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8e44066730 0x7f8e44068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.896+0000 7f8e54ff9700 1 -- 172.21.15.44:0/3087238723 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f8e480837d0 con 0x7f8e580ad7b0 2024-09-13T18:35:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.896+0000 7f8e577fe700 1 --2- 172.21.15.44:0/3087238723 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8e44066730 0x7f8e44068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.896+0000 7f8e577fe700 1 --2- 172.21.15.44:0/3087238723 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8e44066730 0x7f8e44068bf0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c006f80 tx=0x7f8e4c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:30.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:30.900+0000 7f8e54ff9700 1 -- 172.21.15.44:0/3087238723 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8e48050930 con 0x7f8e580ad7b0 2024-09-13T18:35:31.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.072+0000 7f8e5d712700 1 -- 172.21.15.44:0/3087238723 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8e58141130 con 0x7f8e580ad7b0 2024-09-13T18:35:31.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.076+0000 7f8e54ff9700 1 -- 172.21.15.44:0/3087238723 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v66) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e58141130 con 0x7f8e580ad7b0 2024-09-13T18:35:31.085 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:35:31.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.076+0000 7f8e5d712700 1 -- 172.21.15.44:0/3087238723 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8e44066730 msgr2=0x7f8e44068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:31.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.076+0000 7f8e5d712700 1 --2- 172.21.15.44:0/3087238723 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8e44066730 0x7f8e44068bf0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c006f80 tx=0x7f8e4c008030 comp rx=0 tx=0).stop 2024-09-13T18:35:31.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.076+0000 7f8e5d712700 1 -- 172.21.15.44:0/3087238723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e580ad7b0 msgr2=0x7f8e5813de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:31.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.076+0000 7f8e5d712700 1 --2- 172.21.15.44:0/3087238723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e580ad7b0 0x7f8e5813de00 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f8e4800c500 tx=0x7f8e4800c8c0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.076+0000 7f8e5d712700 1 -- 172.21.15.44:0/3087238723 shutdown_connections 2024-09-13T18:35:31.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.076+0000 7f8e5d712700 1 --2- 172.21.15.44:0/3087238723 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8e44066730 0x7f8e44068bf0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.076+0000 7f8e5d712700 1 --2- 172.21.15.44:0/3087238723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e58146160 0x7f8e5813bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.076+0000 7f8e5d712700 1 --2- 172.21.15.44:0/3087238723 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8e580ce300 0x7f8e58141410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.076+0000 7f8e5d712700 1 --2- 172.21.15.44:0/3087238723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e580ad7b0 0x7f8e5813de00 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.076+0000 7f8e5d712700 1 -- 172.21.15.44:0/3087238723 >> 172.21.15.44:0/3087238723 conn(0x7f8e580b0e10 msgr2=0x7f8e580cdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:31.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.076+0000 7f8e5d712700 1 -- 172.21.15.44:0/3087238723 shutdown_connections 2024-09-13T18:35:31.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.076+0000 7f8e5d712700 1 -- 172.21.15.44:0/3087238723 wait complete. 2024-09-13T18:35:31.096 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:35:31.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.208+0000 7fefa62af700 1 Processor -- start 2024-09-13T18:35:31.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.208+0000 7fefa62af700 1 -- start start 2024-09-13T18:35:31.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.208+0000 7fefa62af700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fefa00d0b20 0x7fefa00d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:31.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.208+0000 7fefa62af700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fefa006b240 0x7fefa006b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:31.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.208+0000 7fefa62af700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa00ce740 con 0x7fefa015c880 2024-09-13T18:35:31.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.208+0000 7fefa62af700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa00d14a0 con 0x7fefa006b240 2024-09-13T18:35:31.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.208+0000 7fefa62af700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa00cdb30 con 0x7fefa00d0b20 2024-09-13T18:35:31.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.212+0000 7fefa5aae700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fefa006b240 0x7fefa006b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:31.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.212+0000 7fefa4aac700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fefa00d0b20 0x7fefa00d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:31.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.212+0000 7fefa4aac700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fefa00d0b20 0x7fefa00d0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:58018/0 (socket says 172.21.15.44:58018) 2024-09-13T18:35:31.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.212+0000 7fefa4aac700 1 -- 172.21.15.44:0/164484528 learned_addr learned my addr 172.21.15.44:0/164484528 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:31.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.212+0000 7fefa52ad700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fefa015c880 0x7fefa00cebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:59122/0 (socket says 172.21.15.44:59122) 2024-09-13T18:35:31.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.212+0000 7fefa5aae700 1 -- 172.21.15.44:0/164484528 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fefa00d0b20 msgr2=0x7fefa00d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:31.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.212+0000 7fefa5aae700 1 --2- 172.21.15.44:0/164484528 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fefa00d0b20 0x7fefa00d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.212+0000 7fefa5aae700 1 -- 172.21.15.44:0/164484528 >> v1:172.21.15.99:6789/0 conn(0x7fefa015c880 legacy=0x7fefa00cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:31.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.212+0000 7fefa5aae700 1 -- 172.21.15.44:0/164484528 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa00cde10 con 0x7fefa006b240 2024-09-13T18:35:31.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.212+0000 7fef97fff700 1 -- 172.21.15.44:0/164484528 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575504545 0 0) 0x7fefa00ce740 con 0x7fefa015c880 2024-09-13T18:35:31.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.212+0000 7fefa4aac700 1 --2- 172.21.15.44:0/164484528 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fefa00d0b20 0x7fefa00d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:31.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.212+0000 7fefa5aae700 1 --2- 172.21.15.44:0/164484528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefa006b240 0x7fefa006b6d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fef98009d90 tx=0x7fef9800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9b05adf2b7e12e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:31.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.212+0000 7fef97fff700 1 -- 172.21.15.44:0/164484528 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9800e070 con 0x7fefa006b240 2024-09-13T18:35:31.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.212+0000 7fef97fff700 1 -- 172.21.15.44:0/164484528 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9800bb20 con 0x7fefa006b240 2024-09-13T18:35:31.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.212+0000 7fef97fff700 1 -- 172.21.15.44:0/164484528 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef98012430 con 0x7fefa006b240 2024-09-13T18:35:31.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.212+0000 7fefa62af700 1 -- 172.21.15.44:0/164484528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefa006b240 msgr2=0x7fefa006b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:31.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.212+0000 7fefa62af700 1 --2- 172.21.15.44:0/164484528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefa006b240 0x7fefa006b6d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fef98009d90 tx=0x7fef9800b330 comp rx=0 tx=0).stop 2024-09-13T18:35:31.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.212+0000 7fefa62af700 1 -- 172.21.15.44:0/164484528 shutdown_connections 2024-09-13T18:35:31.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.212+0000 7fefa62af700 1 --2- 172.21.15.44:0/164484528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefa006b240 0x7fefa006b6d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.212+0000 7fefa62af700 1 --2- 172.21.15.44:0/164484528 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fefa00d0b20 0x7fefa00d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.212+0000 7fefa62af700 1 -- 172.21.15.44:0/164484528 >> 172.21.15.44:0/164484528 conn(0x7fefa00d3050 msgr2=0x7fefa00d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:31.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.212+0000 7fefa62af700 1 -- 172.21.15.44:0/164484528 shutdown_connections 2024-09-13T18:35:31.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.212+0000 7fefa62af700 1 -- 172.21.15.44:0/164484528 wait complete. 2024-09-13T18:35:31.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fefa62af700 1 Processor -- start 2024-09-13T18:35:31.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fefa62af700 1 -- start start 2024-09-13T18:35:31.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fefa62af700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefa006b240 0x7fefa01f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:31.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fefa62af700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fefa00d0b20 0x7fefa015f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:31.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fefa62af700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefa015c880 0x7fefa015f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:31.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fefa62af700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa01f5550 con 0x7fefa006b240 2024-09-13T18:35:31.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fefa62af700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa00cbc50 con 0x7fefa015c880 2024-09-13T18:35:31.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fefa62af700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa00cbf30 con 0x7fefa00d0b20 2024-09-13T18:35:31.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fefa52ad700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefa006b240 0x7fefa01f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:31.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fefa52ad700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefa006b240 0x7fefa01f5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52746/0 (socket says 172.21.15.44:52746) 2024-09-13T18:35:31.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fefa52ad700 1 -- 172.21.15.44:0/2618823548 learned_addr learned my addr 172.21.15.44:0/2618823548 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:31.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fefa5aae700 1 --2- 172.21.15.44:0/2618823548 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefa015c880 0x7fefa015f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:31.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fefa4aac700 1 --2- 172.21.15.44:0/2618823548 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fefa00d0b20 0x7fefa015f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:31.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fefa52ad700 1 -- 172.21.15.44:0/2618823548 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fefa00d0b20 msgr2=0x7fefa015f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:31.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fefa52ad700 1 --2- 172.21.15.44:0/2618823548 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fefa00d0b20 0x7fefa015f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fefa52ad700 1 -- 172.21.15.44:0/2618823548 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefa015c880 msgr2=0x7fefa015f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:31.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fefa52ad700 1 --2- 172.21.15.44:0/2618823548 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefa015c880 0x7fefa015f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fefa52ad700 1 -- 172.21.15.44:0/2618823548 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef90009570 con 0x7fefa006b240 2024-09-13T18:35:31.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fefa5aae700 1 --2- 172.21.15.44:0/2618823548 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefa015c880 0x7fefa015f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:31.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fefa52ad700 1 --2- 172.21.15.44:0/2618823548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefa006b240 0x7fefa01f5010 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00c580 tx=0x7fef9c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:31.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fef95ffb700 1 -- 172.21.15.44:0/2618823548 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c004ca0 con 0x7fefa006b240 2024-09-13T18:35:31.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fef95ffb700 1 -- 172.21.15.44:0/2618823548 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9c004e20 con 0x7fefa006b240 2024-09-13T18:35:31.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fefa62af700 1 -- 172.21.15.44:0/2618823548 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef98009a70 con 0x7fefa006b240 2024-09-13T18:35:31.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.216+0000 7fef95ffb700 1 -- 172.21.15.44:0/2618823548 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c007310 con 0x7fefa006b240 2024-09-13T18:35:31.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.220+0000 7fefa62af700 1 -- 172.21.15.44:0/2618823548 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa00cc4f0 con 0x7fefa006b240 2024-09-13T18:35:31.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.220+0000 7fefa62af700 1 -- 172.21.15.44:0/2618823548 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa00b1e20 con 0x7fefa006b240 2024-09-13T18:35:31.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.220+0000 7fef95ffb700 1 -- 172.21.15.44:0/2618823548 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fef9c007470 con 0x7fefa006b240 2024-09-13T18:35:31.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.220+0000 7fef95ffb700 1 --2- 172.21.15.44:0/2618823548 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef84066730 0x7fef84068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:31.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.220+0000 7fef95ffb700 1 -- 172.21.15.44:0/2618823548 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fef9c083f10 con 0x7fefa006b240 2024-09-13T18:35:31.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.220+0000 7fefa4aac700 1 --2- 172.21.15.44:0/2618823548 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef84066730 0x7fef84068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:31.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.224+0000 7fefa4aac700 1 --2- 172.21.15.44:0/2618823548 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef84066730 0x7fef84068bf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fefa00d26f0 tx=0x7fef900092e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:31.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.228+0000 7fef95ffb700 1 -- 172.21.15.44:0/2618823548 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fef9c0510e0 con 0x7fefa006b240 2024-09-13T18:35:31.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.396+0000 7fefa62af700 1 -- 172.21.15.44:0/2618823548 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fefa006b6d0 con 0x7fefa006b240 2024-09-13T18:35:31.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.400+0000 7fef95ffb700 1 -- 172.21.15.44:0/2618823548 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v66) v1 ==== 100+0+11 (secure 0 0 0) 0x7fef9c007720 con 0x7fefa006b240 2024-09-13T18:35:31.405 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:35:31.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.400+0000 7fefa62af700 1 -- 172.21.15.44:0/2618823548 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef84066730 msgr2=0x7fef84068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:31.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.400+0000 7fefa62af700 1 --2- 172.21.15.44:0/2618823548 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef84066730 0x7fef84068bf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fefa00d26f0 tx=0x7fef900092e0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.400+0000 7fefa62af700 1 -- 172.21.15.44:0/2618823548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefa006b240 msgr2=0x7fefa01f5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:31.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.400+0000 7fefa62af700 1 --2- 172.21.15.44:0/2618823548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefa006b240 0x7fefa01f5010 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00c580 tx=0x7fef9c00c890 comp rx=0 tx=0).stop 2024-09-13T18:35:31.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.400+0000 7fefa62af700 1 -- 172.21.15.44:0/2618823548 shutdown_connections 2024-09-13T18:35:31.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.400+0000 7fefa62af700 1 --2- 172.21.15.44:0/2618823548 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fef84066730 0x7fef84068bf0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.400+0000 7fefa62af700 1 --2- 172.21.15.44:0/2618823548 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefa015c880 0x7fefa015f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.400+0000 7fefa62af700 1 --2- 172.21.15.44:0/2618823548 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fefa00d0b20 0x7fefa015f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.400+0000 7fefa62af700 1 --2- 172.21.15.44:0/2618823548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefa006b240 0x7fefa01f5010 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.400+0000 7fefa62af700 1 -- 172.21.15.44:0/2618823548 >> 172.21.15.44:0/2618823548 conn(0x7fefa00d3050 msgr2=0x7fefa00b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:31.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.400+0000 7fefa62af700 1 -- 172.21.15.44:0/2618823548 shutdown_connections 2024-09-13T18:35:31.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.400+0000 7fefa62af700 1 -- 172.21.15.44:0/2618823548 wait complete. 2024-09-13T18:35:31.421 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:35:31.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.528+0000 7fed1e604700 1 Processor -- start 2024-09-13T18:35:31.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.528+0000 7fed1e604700 1 -- start start 2024-09-13T18:35:31.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.528+0000 7fed1e604700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fed1815b890 0x7fed18162220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:31.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.528+0000 7fed1e604700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fed180b2b00 0x7fed1806ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:31.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.528+0000 7fed1e604700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed18162760 con 0x7fed180cdcc0 2024-09-13T18:35:31.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.528+0000 7fed1e604700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed1815bc70 con 0x7fed180b2b00 2024-09-13T18:35:31.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.528+0000 7fed1e604700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed180ccc20 con 0x7fed1815b890 2024-09-13T18:35:31.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.528+0000 7fed17fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fed1815b890 0x7fed18162220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:31.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.528+0000 7fed17fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fed1815b890 0x7fed18162220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:58034/0 (socket says 172.21.15.44:58034) 2024-09-13T18:35:31.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.528+0000 7fed17fff700 1 -- 172.21.15.44:0/3228172752 learned_addr learned my addr 172.21.15.44:0/3228172752 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:31.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.528+0000 7fed1cba1700 1 --2- 172.21.15.44:0/3228172752 >> v2:172.21.15.99:3300/0 conn(0x7fed180b2b00 0x7fed1806ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:31.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.528+0000 7fed17fff700 1 -- 172.21.15.44:0/3228172752 >> v2:172.21.15.99:3300/0 conn(0x7fed180b2b00 msgr2=0x7fed1806ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:31.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.528+0000 7fed17fff700 1 --2- 172.21.15.44:0/3228172752 >> v2:172.21.15.99:3300/0 conn(0x7fed180b2b00 0x7fed1806ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.528+0000 7fed17fff700 1 -- 172.21.15.44:0/3228172752 >> v1:172.21.15.99:6789/0 conn(0x7fed180cdcc0 legacy=0x7fed180b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:31.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.528+0000 7fed17fff700 1 -- 172.21.15.44:0/3228172752 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed180ccf00 con 0x7fed1815b890 2024-09-13T18:35:31.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.528+0000 7fed17fff700 1 --2- 172.21.15.44:0/3228172752 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fed1815b890 0x7fed18162220 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fed08009910 tx=0x7fed08009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c77021d287bbdb69 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:31.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.528+0000 7fed177fe700 1 -- 172.21.15.44:0/3228172752 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08011830 con 0x7fed1815b890 2024-09-13T18:35:31.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.528+0000 7fed177fe700 1 -- 172.21.15.44:0/3228172752 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed08011990 con 0x7fed1815b890 2024-09-13T18:35:31.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.528+0000 7fed177fe700 1 -- 172.21.15.44:0/3228172752 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08011d40 con 0x7fed1815b890 2024-09-13T18:35:31.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.532+0000 7fed1e604700 1 -- 172.21.15.44:0/3228172752 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fed1815b890 msgr2=0x7fed18162220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:31.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.532+0000 7fed1e604700 1 --2- 172.21.15.44:0/3228172752 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fed1815b890 0x7fed18162220 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fed08009910 tx=0x7fed08009c20 comp rx=0 tx=0).stop 2024-09-13T18:35:31.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.532+0000 7fed1e604700 1 -- 172.21.15.44:0/3228172752 shutdown_connections 2024-09-13T18:35:31.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.532+0000 7fed1e604700 1 --2- 172.21.15.44:0/3228172752 >> v2:172.21.15.99:3300/0 conn(0x7fed180b2b00 0x7fed1806ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.532+0000 7fed1e604700 1 --2- 172.21.15.44:0/3228172752 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fed1815b890 0x7fed18162220 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.532+0000 7fed1e604700 1 -- 172.21.15.44:0/3228172752 >> 172.21.15.44:0/3228172752 conn(0x7fed180ce980 msgr2=0x7fed180ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:31.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.532+0000 7fed1e604700 1 -- 172.21.15.44:0/3228172752 shutdown_connections 2024-09-13T18:35:31.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.532+0000 7fed1e604700 1 -- 172.21.15.44:0/3228172752 wait complete. 2024-09-13T18:35:31.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.532+0000 7fed1e604700 1 Processor -- start 2024-09-13T18:35:31.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.532+0000 7fed1e604700 1 -- start start 2024-09-13T18:35:31.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed1e604700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed180b2b00 0x7fed181652b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:31.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed1e604700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed180cdcc0 0x7fed18155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:31.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed1e604700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fed1815b890 0x7fed1814f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:31.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed1e604700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed18165b10 con 0x7fed180b2b00 2024-09-13T18:35:31.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed1e604700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed181fa3c0 con 0x7fed180cdcc0 2024-09-13T18:35:31.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed1e604700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed181fa6a0 con 0x7fed1815b890 2024-09-13T18:35:31.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed17fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed180b2b00 0x7fed181652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:31.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed17fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed180b2b00 0x7fed181652b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52756/0 (socket says 172.21.15.44:52756) 2024-09-13T18:35:31.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed17fff700 1 -- 172.21.15.44:0/2237908312 learned_addr learned my addr 172.21.15.44:0/2237908312 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:31.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed1cba1700 1 --2- 172.21.15.44:0/2237908312 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fed1815b890 0x7fed1814f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:31.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed0f7fe700 1 --2- 172.21.15.44:0/2237908312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed180cdcc0 0x7fed18155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:31.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed17fff700 1 -- 172.21.15.44:0/2237908312 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fed1815b890 msgr2=0x7fed1814f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:31.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed17fff700 1 --2- 172.21.15.44:0/2237908312 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fed1815b890 0x7fed1814f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed17fff700 1 -- 172.21.15.44:0/2237908312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed180cdcc0 msgr2=0x7fed18155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:31.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed17fff700 1 --2- 172.21.15.44:0/2237908312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed180cdcc0 0x7fed18155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed17fff700 1 -- 172.21.15.44:0/2237908312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed08009570 con 0x7fed180b2b00 2024-09-13T18:35:31.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed1cba1700 1 --2- 172.21.15.44:0/2237908312 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fed1815b890 0x7fed1814f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:31.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed17fff700 1 --2- 172.21.15.44:0/2237908312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed180b2b00 0x7fed181652b0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fed180ccd60 tx=0x7fed08004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:31.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed157fa700 1 -- 172.21.15.44:0/2237908312 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08004590 con 0x7fed180b2b00 2024-09-13T18:35:31.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed1e604700 1 -- 172.21.15.44:0/2237908312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed181fa980 con 0x7fed180b2b00 2024-09-13T18:35:31.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed1e604700 1 -- 172.21.15.44:0/2237908312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed181657f0 con 0x7fed180b2b00 2024-09-13T18:35:31.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed157fa700 1 -- 172.21.15.44:0/2237908312 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0801e070 con 0x7fed180b2b00 2024-09-13T18:35:31.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed157fa700 1 -- 172.21.15.44:0/2237908312 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed080038c0 con 0x7fed180b2b00 2024-09-13T18:35:31.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed1e604700 1 -- 172.21.15.44:0/2237908312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed180ce120 con 0x7fed180b2b00 2024-09-13T18:35:31.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed157fa700 1 -- 172.21.15.44:0/2237908312 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fed08003a20 con 0x7fed180b2b00 2024-09-13T18:35:31.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.536+0000 7fed157fa700 1 --2- 172.21.15.44:0/2237908312 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fecf8066730 0x7fecf8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:31.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.540+0000 7fed157fa700 1 -- 172.21.15.44:0/2237908312 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fed080853e0 con 0x7fed180b2b00 2024-09-13T18:35:31.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.540+0000 7fed0f7fe700 1 --2- 172.21.15.44:0/2237908312 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fecf8066730 0x7fecf8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:31.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.540+0000 7fed0f7fe700 1 --2- 172.21.15.44:0/2237908312 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fecf8066730 0x7fecf8068bf0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fed1806ce60 tx=0x7fed00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:31.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.544+0000 7fed157fa700 1 -- 172.21.15.44:0/2237908312 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fed080525c0 con 0x7fed180b2b00 2024-09-13T18:35:31.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.752+0000 7fed1e604700 1 -- 172.21.15.44:0/2237908312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed1815fe70 con 0x7fed180b2b00 2024-09-13T18:35:31.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.756+0000 7fed157fa700 1 -- 172.21.15.44:0/2237908312 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4735 (secure 0 0 0) 0x7fed08055be0 con 0x7fed180b2b00 2024-09-13T18:35:31.762 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:31.762 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":62,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2305930667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2305930667},{"type":"v1","addr":"172.21.15.99:6835","nonce":2305930667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1177460745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1177460745},{"type":"v1","addr":"172.21.15.44:6834","nonce":1177460745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7395,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1292209064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1292209064},{"type":"v1","addr":"172.21.15.44:6835","nonce":1292209064}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:35:20.700105+0000","modified":"2024-09-13T18:35:24.301327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7093},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_7093":{"gid":7093,"name":"d","rank":0,"incarnation":59,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6837/1121392581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1121392581},{"type":"v1","addr":"172.21.15.99:6837","nonce":1121392581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:35:31.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.760+0000 7fed1e604700 1 -- 172.21.15.44:0/2237908312 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fecf8066730 msgr2=0x7fecf8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.760+0000 7fed1e604700 1 --2- 172.21.15.44:0/2237908312 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fecf8066730 0x7fecf8068bf0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fed1806ce60 tx=0x7fed00009040 comp rx=0 tx=0).stop 2024-09-13T18:35:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.760+0000 7fed1e604700 1 -- 172.21.15.44:0/2237908312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed180b2b00 msgr2=0x7fed181652b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.760+0000 7fed1e604700 1 --2- 172.21.15.44:0/2237908312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed180b2b00 0x7fed181652b0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fed180ccd60 tx=0x7fed08004770 comp rx=0 tx=0).stop 2024-09-13T18:35:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.760+0000 7fed1e604700 1 -- 172.21.15.44:0/2237908312 shutdown_connections 2024-09-13T18:35:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.760+0000 7fed1e604700 1 --2- 172.21.15.44:0/2237908312 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fecf8066730 0x7fecf8068bf0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.760+0000 7fed1e604700 1 --2- 172.21.15.44:0/2237908312 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fed1815b890 0x7fed1814f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.760+0000 7fed1e604700 1 --2- 172.21.15.44:0/2237908312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed180cdcc0 0x7fed18155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.760+0000 7fed1e604700 1 --2- 172.21.15.44:0/2237908312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed180b2b00 0x7fed181652b0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.760+0000 7fed1e604700 1 -- 172.21.15.44:0/2237908312 >> 172.21.15.44:0/2237908312 conn(0x7fed180ce980 msgr2=0x7fed180af350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.760+0000 7fed1e604700 1 -- 172.21.15.44:0/2237908312 shutdown_connections 2024-09-13T18:35:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.760+0000 7fed1e604700 1 -- 172.21.15.44:0/2237908312 wait complete. 2024-09-13T18:35:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 62 2024-09-13T18:35:31.782 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:31.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f7331d44700 1 Processor -- start 2024-09-13T18:35:31.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f7331d44700 1 -- start start 2024-09-13T18:35:31.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f7331d44700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f732c0b5c00 0x7f732c0b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:31.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f7331d44700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f732c0ce070 0x7f732c0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:31.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f7331d44700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f732c0d11b0 con 0x7f732c15a700 2024-09-13T18:35:31.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f7331d44700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f732c0b6580 con 0x7f732c0ce070 2024-09-13T18:35:31.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f7331d44700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732c15aae0 con 0x7f732c0b5c00 2024-09-13T18:35:31.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f732bfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f732c0b5c00 0x7f732c0b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:31.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f732bfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f732c0b5c00 0x7f732c0b6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:58046/0 (socket says 172.21.15.44:58046) 2024-09-13T18:35:31.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f732bfff700 1 -- 172.21.15.44:0/3105894234 learned_addr learned my addr 172.21.15.44:0/3105894234 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:31.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f7331543700 1 --2- 172.21.15.44:0/3105894234 >> v2:172.21.15.99:3300/0 conn(0x7f732c0ce070 0x7f732c0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:31.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f732bfff700 1 -- 172.21.15.44:0/3105894234 >> v2:172.21.15.99:3300/0 conn(0x7f732c0ce070 msgr2=0x7f732c0ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:31.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f732bfff700 1 --2- 172.21.15.44:0/3105894234 >> v2:172.21.15.99:3300/0 conn(0x7f732c0ce070 0x7f732c0ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f732bfff700 1 -- 172.21.15.44:0/3105894234 >> v1:172.21.15.99:6789/0 conn(0x7f732c15a700 legacy=0x7f732c15db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:31.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f732bfff700 1 -- 172.21.15.44:0/3105894234 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c0d05a0 con 0x7f732c0b5c00 2024-09-13T18:35:31.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f732bfff700 1 --2- 172.21.15.44:0/3105894234 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f732c0b5c00 0x7f732c0b6040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7318009910 tx=0x7f7318009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b949a8f840d8084 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:31.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f732b7fe700 1 -- 172.21.15.44:0/3105894234 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318011830 con 0x7f732c0b5c00 2024-09-13T18:35:31.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f732b7fe700 1 -- 172.21.15.44:0/3105894234 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7318011990 con 0x7f732c0b5c00 2024-09-13T18:35:31.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f732b7fe700 1 -- 172.21.15.44:0/3105894234 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318011d40 con 0x7f732c0b5c00 2024-09-13T18:35:31.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f7331d44700 1 -- 172.21.15.44:0/3105894234 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f732c0b5c00 msgr2=0x7f732c0b6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:31.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f7331d44700 1 --2- 172.21.15.44:0/3105894234 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f732c0b5c00 0x7f732c0b6040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7318009910 tx=0x7f7318009c20 comp rx=0 tx=0).stop 2024-09-13T18:35:31.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f7331d44700 1 -- 172.21.15.44:0/3105894234 shutdown_connections 2024-09-13T18:35:31.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f7331d44700 1 --2- 172.21.15.44:0/3105894234 >> v2:172.21.15.99:3300/0 conn(0x7f732c0ce070 0x7f732c0ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f7331d44700 1 --2- 172.21.15.44:0/3105894234 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f732c0b5c00 0x7f732c0b6040 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f7331d44700 1 -- 172.21.15.44:0/3105894234 >> 172.21.15.44:0/3105894234 conn(0x7f732c06a730 msgr2=0x7f732c071d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:31.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f7331d44700 1 -- 172.21.15.44:0/3105894234 shutdown_connections 2024-09-13T18:35:31.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.892+0000 7f7331d44700 1 -- 172.21.15.44:0/3105894234 wait complete. 2024-09-13T18:35:31.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.896+0000 7f7331d44700 1 Processor -- start 2024-09-13T18:35:31.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.896+0000 7f7331d44700 1 -- start start 2024-09-13T18:35:31.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.896+0000 7f7331d44700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f732c0b5c00 0x7f732c141a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:31.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.896+0000 7f7331d44700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f732c0ce070 0x7f732c152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:31.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.896+0000 7f7331d44700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f732c15a700 0x7f732c1566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:31.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.896+0000 7f7331d44700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732c14f9a0 con 0x7f732c0ce070 2024-09-13T18:35:31.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.896+0000 7f7331d44700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732c06bc90 con 0x7f732c0b5c00 2024-09-13T18:35:31.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.896+0000 7f7331d44700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732c06d900 con 0x7f732c15a700 2024-09-13T18:35:31.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.896+0000 7f732bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f732c0ce070 0x7f732c152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:31.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.896+0000 7f7331543700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f732c15a700 0x7f732c1566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:31.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.896+0000 7f7330d42700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f732c0b5c00 0x7f732c141a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:31.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.896+0000 7f732bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f732c0ce070 0x7f732c152000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52770/0 (socket says 172.21.15.44:52770) 2024-09-13T18:35:31.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.896+0000 7f732bfff700 1 -- 172.21.15.44:0/206220008 learned_addr learned my addr 172.21.15.44:0/206220008 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:31.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.896+0000 7f732bfff700 1 -- 172.21.15.44:0/206220008 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f732c15a700 msgr2=0x7f732c1566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:31.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.896+0000 7f732bfff700 1 --2- 172.21.15.44:0/206220008 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f732c15a700 0x7f732c1566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.896+0000 7f732bfff700 1 -- 172.21.15.44:0/206220008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f732c0b5c00 msgr2=0x7f732c141a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:31.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.896+0000 7f732bfff700 1 --2- 172.21.15.44:0/206220008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f732c0b5c00 0x7f732c141a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:31.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.896+0000 7f732bfff700 1 -- 172.21.15.44:0/206220008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7318009570 con 0x7f732c0ce070 2024-09-13T18:35:31.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.900+0000 7f732bfff700 1 --2- 172.21.15.44:0/206220008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f732c0ce070 0x7f732c152000 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f7318000c00 tx=0x7f7318004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:31.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.900+0000 7f73297fa700 1 -- 172.21.15.44:0/206220008 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318004380 con 0x7f732c0ce070 2024-09-13T18:35:31.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.900+0000 7f73297fa700 1 -- 172.21.15.44:0/206220008 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731801f070 con 0x7f732c0ce070 2024-09-13T18:35:31.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.900+0000 7f7331d44700 1 -- 172.21.15.44:0/206220008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f732c06c460 con 0x7f732c0ce070 2024-09-13T18:35:31.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.900+0000 7f73297fa700 1 -- 172.21.15.44:0/206220008 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73180036c0 con 0x7f732c0ce070 2024-09-13T18:35:31.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.900+0000 7f7331d44700 1 -- 172.21.15.44:0/206220008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f732c06bea0 con 0x7f732c0ce070 2024-09-13T18:35:31.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.900+0000 7f7331d44700 1 -- 172.21.15.44:0/206220008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f732c0ca020 con 0x7f732c0ce070 2024-09-13T18:35:31.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.900+0000 7f73297fa700 1 -- 172.21.15.44:0/206220008 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7318021030 con 0x7f732c0ce070 2024-09-13T18:35:31.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.900+0000 7f73297fa700 1 --2- 172.21.15.44:0/206220008 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7310066730 0x7f7310068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:31.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.900+0000 7f73297fa700 1 -- 172.21.15.44:0/206220008 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f73180854b0 con 0x7f732c0ce070 2024-09-13T18:35:31.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.900+0000 7f7330d42700 1 --2- 172.21.15.44:0/206220008 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7310066730 0x7f7310068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:31.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.904+0000 7f7330d42700 1 --2- 172.21.15.44:0/206220008 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7310066730 0x7f7310068bf0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7320000f60 tx=0x7f7320009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:31.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:31.912+0000 7f73297fa700 1 -- 172.21.15.44:0/206220008 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7318052730 con 0x7f732c0ce070 2024-09-13T18:35:32.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.088+0000 7f7331d44700 1 -- 172.21.15.44:0/206220008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f732c15b960 con 0x7f732c0ce070 2024-09-13T18:35:32.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.088+0000 7f73297fa700 1 -- 172.21.15.44:0/206220008 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16894 (secure 0 0 0) 0x7f7318006da0 con 0x7f732c0ce070 2024-09-13T18:35:32.096 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:32.096 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":66,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:35:19.260517+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:14.682923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:15.291935+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:6836/3072614790":"2024-09-14T18:35:19.260455+0000","172.21.15.99:6837/3072614790":"2024-09-14T18:35:19.260455+0000","172.21.15.44:6835/1074184606":"2024-09-14T18:35:18.166304+0000","172.21.15.44:6833/1074184606":"2024-09-14T18:35:18.166304+0000","172.21.15.44:6835/1608555972":"2024-09-14T18:34:13.117246+0000","172.21.15.44:6833/1608555972":"2024-09-14T18:34:13.117246+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:32.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.092+0000 7f7331d44700 1 -- 172.21.15.44:0/206220008 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7310066730 msgr2=0x7f7310068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:32.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.092+0000 7f7331d44700 1 --2- 172.21.15.44:0/206220008 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7310066730 0x7f7310068bf0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7320000f60 tx=0x7f7320009040 comp rx=0 tx=0).stop 2024-09-13T18:35:32.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.092+0000 7f7331d44700 1 -- 172.21.15.44:0/206220008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f732c0ce070 msgr2=0x7f732c152000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:32.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.092+0000 7f7331d44700 1 --2- 172.21.15.44:0/206220008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f732c0ce070 0x7f732c152000 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f7318000c00 tx=0x7f7318004770 comp rx=0 tx=0).stop 2024-09-13T18:35:32.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.092+0000 7f7331d44700 1 -- 172.21.15.44:0/206220008 shutdown_connections 2024-09-13T18:35:32.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.092+0000 7f7331d44700 1 --2- 172.21.15.44:0/206220008 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7310066730 0x7f7310068bf0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:32.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.092+0000 7f7331d44700 1 --2- 172.21.15.44:0/206220008 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f732c15a700 0x7f732c1566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:32.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.092+0000 7f7331d44700 1 --2- 172.21.15.44:0/206220008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f732c0ce070 0x7f732c152000 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:32.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.092+0000 7f7331d44700 1 --2- 172.21.15.44:0/206220008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f732c0b5c00 0x7f732c141a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:32.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.092+0000 7f7331d44700 1 -- 172.21.15.44:0/206220008 >> 172.21.15.44:0/206220008 conn(0x7f732c06a730 msgr2=0x7f732c15c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:32.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.092+0000 7f7331d44700 1 -- 172.21.15.44:0/206220008 shutdown_connections 2024-09-13T18:35:32.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.092+0000 7f7331d44700 1 -- 172.21.15.44:0/206220008 wait complete. 2024-09-13T18:35:32.111 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:35:32.112 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:35:32.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.220+0000 7f6b61574700 1 Processor -- start 2024-09-13T18:35:32.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.220+0000 7f6b61574700 1 -- start start 2024-09-13T18:35:32.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.220+0000 7f6b61574700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6b5c161eb0 0x7f6b5c0b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:32.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.220+0000 7f6b61574700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6b5c070b30 0x7f6b5c070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:32.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.220+0000 7f6b61574700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b5c0714c0 con 0x7f6b5c0b51f0 2024-09-13T18:35:32.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.220+0000 7f6b61574700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b5c0b3460 con 0x7f6b5c070b30 2024-09-13T18:35:32.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.220+0000 7f6b61574700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c0b3740 con 0x7f6b5c161eb0 2024-09-13T18:35:32.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.220+0000 7f6b5bfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6b5c161eb0 0x7f6b5c0b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:32.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.224+0000 7f6b60d73700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6b5c070b30 0x7f6b5c070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:32.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.224+0000 7f6b5b7fe700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6b5c0b51f0 0x7f6b5c0b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:46414/0 (socket says 172.21.15.44:46414) 2024-09-13T18:35:32.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.224+0000 7f6b5b7fe700 1 -- 172.21.15.44:0/3924639670 learned_addr learned my addr 172.21.15.44:0/3924639670 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:32.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.224+0000 7f6b5affd700 1 -- 172.21.15.44:0/3924639670 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232343881 0 0) 0x7f6b44001110 con 0x7f6b5c0b51f0 2024-09-13T18:35:32.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.224+0000 7f6b5bfff700 1 -- 172.21.15.44:0/3924639670 >> v2:172.21.15.99:3300/0 conn(0x7f6b5c070b30 msgr2=0x7f6b5c070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:32.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.224+0000 7f6b5bfff700 1 --2- 172.21.15.44:0/3924639670 >> v2:172.21.15.99:3300/0 conn(0x7f6b5c070b30 0x7f6b5c070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:32.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.224+0000 7f6b5bfff700 1 -- 172.21.15.44:0/3924639670 >> v1:172.21.15.99:6789/0 conn(0x7f6b5c0b51f0 legacy=0x7f6b5c0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:32.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.224+0000 7f6b5bfff700 1 -- 172.21.15.44:0/3924639670 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5c0b44b0 con 0x7f6b5c161eb0 2024-09-13T18:35:32.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.224+0000 7f6b60d73700 1 --2- 172.21.15.44:0/3924639670 >> v2:172.21.15.99:3300/0 conn(0x7f6b5c070b30 0x7f6b5c070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:32.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.224+0000 7f6b5bfff700 1 --2- 172.21.15.44:0/3924639670 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6b5c161eb0 0x7f6b5c0b4cb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c009850 tx=0x7f6b4c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca5eec3092507797 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:32.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.224+0000 7f6b5affd700 1 -- 172.21.15.44:0/3924639670 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c011830 con 0x7f6b5c161eb0 2024-09-13T18:35:32.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.224+0000 7f6b5affd700 1 -- 172.21.15.44:0/3924639670 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4c011990 con 0x7f6b5c161eb0 2024-09-13T18:35:32.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.224+0000 7f6b5affd700 1 -- 172.21.15.44:0/3924639670 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c011d40 con 0x7f6b5c161eb0 2024-09-13T18:35:32.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.224+0000 7f6b61574700 1 -- 172.21.15.44:0/3924639670 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6b5c161eb0 msgr2=0x7f6b5c0b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:32.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.224+0000 7f6b61574700 1 --2- 172.21.15.44:0/3924639670 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6b5c161eb0 0x7f6b5c0b4cb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c009850 tx=0x7f6b4c009b60 comp rx=0 tx=0).stop 2024-09-13T18:35:32.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.224+0000 7f6b61574700 1 -- 172.21.15.44:0/3924639670 shutdown_connections 2024-09-13T18:35:32.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.224+0000 7f6b61574700 1 --2- 172.21.15.44:0/3924639670 >> v2:172.21.15.99:3300/0 conn(0x7f6b5c070b30 0x7f6b5c070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:32.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.224+0000 7f6b61574700 1 --2- 172.21.15.44:0/3924639670 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6b5c161eb0 0x7f6b5c0b4cb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:32.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.224+0000 7f6b61574700 1 -- 172.21.15.44:0/3924639670 >> 172.21.15.44:0/3924639670 conn(0x7f6b5c0b16a0 msgr2=0x7f6b5c0b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:32.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.224+0000 7f6b61574700 1 -- 172.21.15.44:0/3924639670 shutdown_connections 2024-09-13T18:35:32.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.224+0000 7f6b61574700 1 -- 172.21.15.44:0/3924639670 wait complete. 2024-09-13T18:35:32.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b61574700 1 Processor -- start 2024-09-13T18:35:32.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b61574700 1 -- start start 2024-09-13T18:35:32.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b61574700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b5c070b30 0x7f6b5c158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:32.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b61574700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b5c0b51f0 0x7f6b5c15dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:32.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b61574700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6b5c161eb0 0x7f6b5c15e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:32.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b61574700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c06cd50 con 0x7f6b5c0b51f0 2024-09-13T18:35:32.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b61574700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c0a8e50 con 0x7f6b5c070b30 2024-09-13T18:35:32.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b61574700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c1fa8c0 con 0x7f6b5c161eb0 2024-09-13T18:35:32.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b5b7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b5c0b51f0 0x7f6b5c15dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:32.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b60d73700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6b5c161eb0 0x7f6b5c15e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:32.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b5b7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b5c0b51f0 0x7f6b5c15dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41942/0 (socket says 172.21.15.44:41942) 2024-09-13T18:35:32.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b5b7fe700 1 -- 172.21.15.44:0/1800768634 learned_addr learned my addr 172.21.15.44:0/1800768634 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:32.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b5bfff700 1 --2- 172.21.15.44:0/1800768634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b5c070b30 0x7f6b5c158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:32.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b60d73700 1 -- 172.21.15.44:0/1800768634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b5c070b30 msgr2=0x7f6b5c158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:32.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b60d73700 1 --2- 172.21.15.44:0/1800768634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b5c070b30 0x7f6b5c158550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:32.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b60d73700 1 -- 172.21.15.44:0/1800768634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b5c0b51f0 msgr2=0x7f6b5c15dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:32.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b60d73700 1 --2- 172.21.15.44:0/1800768634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b5c0b51f0 0x7f6b5c15dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:32.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b60d73700 1 -- 172.21.15.44:0/1800768634 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b54009a70 con 0x7f6b5c161eb0 2024-09-13T18:35:32.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b5b7fe700 1 --2- 172.21.15.44:0/1800768634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b5c0b51f0 0x7f6b5c15dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:32.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b5bfff700 1 --2- 172.21.15.44:0/1800768634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b5c070b30 0x7f6b5c158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:32.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b60d73700 1 --2- 172.21.15.44:0/1800768634 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6b5c161eb0 0x7f6b5c15e290 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6b5400efc0 tx=0x7f6b5400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:32.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b58ff9700 1 -- 172.21.15.44:0/1800768634 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5400ca90 con 0x7f6b5c161eb0 2024-09-13T18:35:32.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b58ff9700 1 -- 172.21.15.44:0/1800768634 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5400f040 con 0x7f6b5c161eb0 2024-09-13T18:35:32.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b61574700 1 -- 172.21.15.44:0/1800768634 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4c0094b0 con 0x7f6b5c161eb0 2024-09-13T18:35:32.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.228+0000 7f6b58ff9700 1 -- 172.21.15.44:0/1800768634 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5400ce30 con 0x7f6b5c161eb0 2024-09-13T18:35:32.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.232+0000 7f6b61574700 1 -- 172.21.15.44:0/1800768634 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b5c06c690 con 0x7f6b5c161eb0 2024-09-13T18:35:32.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.232+0000 7f6b61574700 1 -- 172.21.15.44:0/1800768634 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b5c0b3d30 con 0x7f6b5c161eb0 2024-09-13T18:35:32.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.232+0000 7f6b58ff9700 1 -- 172.21.15.44:0/1800768634 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6b54014480 con 0x7f6b5c161eb0 2024-09-13T18:35:32.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.232+0000 7f6b58ff9700 1 --2- 172.21.15.44:0/1800768634 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6b40066730 0x7f6b40068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:32.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.232+0000 7f6b58ff9700 1 -- 172.21.15.44:0/1800768634 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f6b54084770 con 0x7f6b5c161eb0 2024-09-13T18:35:32.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.232+0000 7f6b5bfff700 1 --2- 172.21.15.44:0/1800768634 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6b40066730 0x7f6b40068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:32.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.236+0000 7f6b5bfff700 1 --2- 172.21.15.44:0/1800768634 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6b40066730 0x7f6b40068bf0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c0090b0 tx=0x7f6b4c01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:32.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.244+0000 7f6b58ff9700 1 -- 172.21.15.44:0/1800768634 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6b54051a70 con 0x7f6b5c161eb0 2024-09-13T18:35:32.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.456+0000 7f6b61574700 1 -- 172.21.15.44:0/1800768634 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b5c0d0590 con 0x7f6b5c161eb0 2024-09-13T18:35:33.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.456+0000 7f6b58ff9700 1 -- 172.21.15.44:0/1800768634 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4735 (secure 0 0 0) 0x7f6b54009cc0 con 0x7f6b5c161eb0 2024-09-13T18:35:33.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:33.069 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":62,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2305930667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2305930667},{"type":"v1","addr":"172.21.15.99:6835","nonce":2305930667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1177460745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1177460745},{"type":"v1","addr":"172.21.15.44:6834","nonce":1177460745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7395,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1292209064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1292209064},{"type":"v1","addr":"172.21.15.44:6835","nonce":1292209064}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:35:20.700105+0000","modified":"2024-09-13T18:35:24.301327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7093},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_7093":{"gid":7093,"name":"d","rank":0,"incarnation":59,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6837/1121392581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1121392581},{"type":"v1","addr":"172.21.15.99:6837","nonce":1121392581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:35:33.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.460+0000 7f6b61574700 1 -- 172.21.15.44:0/1800768634 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6b40066730 msgr2=0x7f6b40068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.460+0000 7f6b61574700 1 --2- 172.21.15.44:0/1800768634 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6b40066730 0x7f6b40068bf0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c0090b0 tx=0x7f6b4c01c040 comp rx=0 tx=0).stop 2024-09-13T18:35:33.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.460+0000 7f6b61574700 1 -- 172.21.15.44:0/1800768634 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6b5c161eb0 msgr2=0x7f6b5c15e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.460+0000 7f6b61574700 1 --2- 172.21.15.44:0/1800768634 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6b5c161eb0 0x7f6b5c15e290 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6b5400efc0 tx=0x7f6b5400c3a0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.460+0000 7f6b61574700 1 -- 172.21.15.44:0/1800768634 shutdown_connections 2024-09-13T18:35:33.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.460+0000 7f6b61574700 1 --2- 172.21.15.44:0/1800768634 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6b40066730 0x7f6b40068bf0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.460+0000 7f6b61574700 1 --2- 172.21.15.44:0/1800768634 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6b5c161eb0 0x7f6b5c15e290 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.460+0000 7f6b61574700 1 --2- 172.21.15.44:0/1800768634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b5c0b51f0 0x7f6b5c15dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.460+0000 7f6b61574700 1 --2- 172.21.15.44:0/1800768634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b5c070b30 0x7f6b5c158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.460+0000 7f6b61574700 1 -- 172.21.15.44:0/1800768634 >> 172.21.15.44:0/1800768634 conn(0x7f6b5c0b16a0 msgr2=0x7f6b5c0b0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:33.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.460+0000 7f6b61574700 1 -- 172.21.15.44:0/1800768634 shutdown_connections 2024-09-13T18:35:33.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:32.460+0000 7f6b61574700 1 -- 172.21.15.44:0/1800768634 wait complete. 2024-09-13T18:35:33.071 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 62 2024-09-13T18:35:33.072 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:35:33.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.188+0000 7fc9fa431700 1 Processor -- start 2024-09-13T18:35:33.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.188+0000 7fc9fa431700 1 -- start start 2024-09-13T18:35:33.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.192+0000 7fc9fa431700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc9f40b3ae0 0x7fc9f406a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.192+0000 7fc9fa431700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f413dcb0 con 0x7fc9f406aaf0 2024-09-13T18:35:33.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.192+0000 7fc9fa431700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f415be60 con 0x7fc9f406bbf0 2024-09-13T18:35:33.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.192+0000 7fc9fa431700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f413ffd0 con 0x7fc9f40b3ae0 2024-09-13T18:35:33.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.192+0000 7fc9f8c2e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc9f40b3ae0 0x7fc9f406a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.192+0000 7fc9f8c2e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc9f40b3ae0 0x7fc9f406a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41956/0 (socket says 172.21.15.44:41956) 2024-09-13T18:35:33.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.192+0000 7fc9f8c2e700 1 -- 172.21.15.44:0/4166120783 learned_addr learned my addr 172.21.15.44:0/4166120783 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:33.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.192+0000 7fc9f8c2e700 1 -- 172.21.15.44:0/4166120783 >> v1:172.21.15.99:6789/0 conn(0x7fc9f406bbf0 legacy=0x7fc9f40b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:33.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.192+0000 7fc9f8c2e700 1 -- 172.21.15.44:0/4166120783 >> v1:172.21.15.44:6789/0 conn(0x7fc9f406aaf0 legacy=0x7fc9f415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.192+0000 7fc9f8c2e700 1 -- 172.21.15.44:0/4166120783 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f4140220 con 0x7fc9f40b3ae0 2024-09-13T18:35:33.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.192+0000 7fc9f8c2e700 1 --2- 172.21.15.44:0/4166120783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9f40b3ae0 0x7fc9f406a5b0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0009910 tx=0x7fc9f0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857492b93acb348 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:33.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.192+0000 7fc9ebfff700 1 -- 172.21.15.44:0/4166120783 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0004230 con 0x7fc9f40b3ae0 2024-09-13T18:35:33.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.192+0000 7fc9ebfff700 1 -- 172.21.15.44:0/4166120783 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f0004390 con 0x7fc9f40b3ae0 2024-09-13T18:35:33.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.192+0000 7fc9ebfff700 1 -- 172.21.15.44:0/4166120783 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0009e60 con 0x7fc9f40b3ae0 2024-09-13T18:35:33.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.192+0000 7fc9fa431700 1 -- 172.21.15.44:0/4166120783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9f40b3ae0 msgr2=0x7fc9f406a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.192+0000 7fc9fa431700 1 --2- 172.21.15.44:0/4166120783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9f40b3ae0 0x7fc9f406a5b0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0009910 tx=0x7fc9f0009c20 comp rx=0 tx=0).stop 2024-09-13T18:35:33.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.192+0000 7fc9fa431700 1 -- 172.21.15.44:0/4166120783 shutdown_connections 2024-09-13T18:35:33.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.192+0000 7fc9fa431700 1 --2- 172.21.15.44:0/4166120783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9f40b3ae0 0x7fc9f406a5b0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.192+0000 7fc9fa431700 1 -- 172.21.15.44:0/4166120783 >> 172.21.15.44:0/4166120783 conn(0x7fc9f40b0f00 msgr2=0x7fc9f40b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:33.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.192+0000 7fc9fa431700 1 -- 172.21.15.44:0/4166120783 shutdown_connections 2024-09-13T18:35:33.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.192+0000 7fc9fa431700 1 -- 172.21.15.44:0/4166120783 wait complete. 2024-09-13T18:35:33.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.192+0000 7fc9fa431700 1 Processor -- start 2024-09-13T18:35:33.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.192+0000 7fc9fa431700 1 -- start start 2024-09-13T18:35:33.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.196+0000 7fc9fa431700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9f406aaf0 0x7fc9f40cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.196+0000 7fc9fa431700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9f406bbf0 0x7fc9f41537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.196+0000 7fc9fa431700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9f40b3ae0 0x7fc9f40a8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.196+0000 7fc9fa431700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f40ac8b0 con 0x7fc9f406aaf0 2024-09-13T18:35:33.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.196+0000 7fc9fa431700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f40a9d80 con 0x7fc9f406bbf0 2024-09-13T18:35:33.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.196+0000 7fc9fa431700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f40a9aa0 con 0x7fc9f40b3ae0 2024-09-13T18:35:33.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.196+0000 7fc9f942f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9f406aaf0 0x7fc9f40cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.196+0000 7fc9f942f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9f406aaf0 0x7fc9f40cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41964/0 (socket says 172.21.15.44:41964) 2024-09-13T18:35:33.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.196+0000 7fc9f942f700 1 -- 172.21.15.44:0/971637473 learned_addr learned my addr 172.21.15.44:0/971637473 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:33.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.196+0000 7fc9f8c2e700 1 --2- 172.21.15.44:0/971637473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9f406bbf0 0x7fc9f41537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.196+0000 7fc9f9c30700 1 --2- 172.21.15.44:0/971637473 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9f40b3ae0 0x7fc9f40a8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.196+0000 7fc9f942f700 1 -- 172.21.15.44:0/971637473 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9f40b3ae0 msgr2=0x7fc9f40a8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.196+0000 7fc9f942f700 1 --2- 172.21.15.44:0/971637473 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9f40b3ae0 0x7fc9f40a8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.196+0000 7fc9f942f700 1 -- 172.21.15.44:0/971637473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9f406bbf0 msgr2=0x7fc9f41537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.196+0000 7fc9f942f700 1 --2- 172.21.15.44:0/971637473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9f406bbf0 0x7fc9f41537c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.196+0000 7fc9f942f700 1 -- 172.21.15.44:0/971637473 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f0009570 con 0x7fc9f406aaf0 2024-09-13T18:35:33.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.196+0000 7fc9f942f700 1 --2- 172.21.15.44:0/971637473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9f406aaf0 0x7fc9f40cb370 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fc9e400c4e0 tx=0x7fc9e400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:33.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.196+0000 7fc9e9ffb700 1 -- 172.21.15.44:0/971637473 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4011790 con 0x7fc9f406aaf0 2024-09-13T18:35:33.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.196+0000 7fc9e9ffb700 1 -- 172.21.15.44:0/971637473 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e4011910 con 0x7fc9f406aaf0 2024-09-13T18:35:33.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.196+0000 7fc9fa431700 1 -- 172.21.15.44:0/971637473 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f40acae0 con 0x7fc9f406aaf0 2024-09-13T18:35:33.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.196+0000 7fc9e9ffb700 1 -- 172.21.15.44:0/971637473 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4011cc0 con 0x7fc9f406aaf0 2024-09-13T18:35:33.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.196+0000 7fc9fa431700 1 -- 172.21.15.44:0/971637473 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f40ad0a0 con 0x7fc9f406aaf0 2024-09-13T18:35:33.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.200+0000 7fc9fa431700 1 -- 172.21.15.44:0/971637473 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f406af40 con 0x7fc9f406aaf0 2024-09-13T18:35:33.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.200+0000 7fc9e9ffb700 1 -- 172.21.15.44:0/971637473 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc9e401c460 con 0x7fc9f406aaf0 2024-09-13T18:35:33.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.200+0000 7fc9e9ffb700 1 --2- 172.21.15.44:0/971637473 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc9d8066730 0x7fc9d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.200+0000 7fc9e9ffb700 1 -- 172.21.15.44:0/971637473 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7fc9e4083f80 con 0x7fc9f406aaf0 2024-09-13T18:35:33.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.200+0000 7fc9f8c2e700 1 --2- 172.21.15.44:0/971637473 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc9d8066730 0x7fc9d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.204+0000 7fc9f8c2e700 1 --2- 172.21.15.44:0/971637473 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc9d8066730 0x7fc9d8068bf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0009910 tx=0x7fc9f0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:33.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.208+0000 7fc9e9ffb700 1 -- 172.21.15.44:0/971637473 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc9e40b5db0 con 0x7fc9f406aaf0 2024-09-13T18:35:33.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.420+0000 7fc9fa431700 1 -- 172.21.15.44:0/971637473 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9f4071970 con 0x7fc9f406aaf0 2024-09-13T18:35:33.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.420+0000 7fc9e9ffb700 1 -- 172.21.15.44:0/971637473 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4735 (secure 0 0 0) 0x7fc9e40511f0 con 0x7fc9f406aaf0 2024-09-13T18:35:33.426 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:33.426 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":62,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2305930667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2305930667},{"type":"v1","addr":"172.21.15.99:6835","nonce":2305930667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1177460745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1177460745},{"type":"v1","addr":"172.21.15.44:6834","nonce":1177460745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7395,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1292209064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1292209064},{"type":"v1","addr":"172.21.15.44:6835","nonce":1292209064}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:35:20.700105+0000","modified":"2024-09-13T18:35:24.301327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7093},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_7093":{"gid":7093,"name":"d","rank":0,"incarnation":59,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6837/1121392581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1121392581},{"type":"v1","addr":"172.21.15.99:6837","nonce":1121392581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:35:33.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.420+0000 7fc9fa431700 1 -- 172.21.15.44:0/971637473 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc9d8066730 msgr2=0x7fc9d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.420+0000 7fc9fa431700 1 --2- 172.21.15.44:0/971637473 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc9d8066730 0x7fc9d8068bf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0009910 tx=0x7fc9f0008030 comp rx=0 tx=0).stop 2024-09-13T18:35:33.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.420+0000 7fc9fa431700 1 -- 172.21.15.44:0/971637473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9f406aaf0 msgr2=0x7fc9f40cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.420+0000 7fc9fa431700 1 --2- 172.21.15.44:0/971637473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9f406aaf0 0x7fc9f40cb370 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fc9e400c4e0 tx=0x7fc9e400c7f0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.420+0000 7fc9fa431700 1 -- 172.21.15.44:0/971637473 shutdown_connections 2024-09-13T18:35:33.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.420+0000 7fc9fa431700 1 --2- 172.21.15.44:0/971637473 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc9d8066730 0x7fc9d8068bf0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.420+0000 7fc9fa431700 1 --2- 172.21.15.44:0/971637473 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9f40b3ae0 0x7fc9f40a8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.420+0000 7fc9fa431700 1 --2- 172.21.15.44:0/971637473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9f406bbf0 0x7fc9f41537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.420+0000 7fc9fa431700 1 --2- 172.21.15.44:0/971637473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9f406aaf0 0x7fc9f40cb370 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.420+0000 7fc9fa431700 1 -- 172.21.15.44:0/971637473 >> 172.21.15.44:0/971637473 conn(0x7fc9f40b0f00 msgr2=0x7fc9f4070720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:33.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.420+0000 7fc9fa431700 1 -- 172.21.15.44:0/971637473 shutdown_connections 2024-09-13T18:35:33.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.420+0000 7fc9fa431700 1 -- 172.21.15.44:0/971637473 wait complete. 2024-09-13T18:35:33.430 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 62 2024-09-13T18:35:33.441 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:33.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1acc0f7700 1 Processor -- start 2024-09-13T18:35:33.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1acc0f7700 1 -- start start 2024-09-13T18:35:33.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1acc0f7700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1ac415ac40 0x7f1ac406ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1acc0f7700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ac40ad710 0x7f1ac40adb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1acc0f7700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1ac415e730 0x7f1ac415eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1acc0f7700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac40b3df0 con 0x7f1ac415e730 2024-09-13T18:35:33.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1acc0f7700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac40ae0b0 con 0x7f1ac415ac40 2024-09-13T18:35:33.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1acc0f7700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac415b020 con 0x7f1ac40ad710 2024-09-13T18:35:33.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1aca694700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1ac415e730 0x7f1ac415eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1ac9692700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ac40ad710 0x7f1ac40adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1ac9e93700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1ac415ac40 0x7f1ac406ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1ac9692700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ac40ad710 0x7f1ac40adb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:49038/0 (socket says 172.21.15.44:49038) 2024-09-13T18:35:33.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1ac9692700 1 -- 172.21.15.44:0/2195993851 learned_addr learned my addr 172.21.15.44:0/2195993851 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:33.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1ac9692700 1 -- 172.21.15.44:0/2195993851 >> v2:172.21.15.99:3300/0 conn(0x7f1ac415ac40 msgr2=0x7f1ac406ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:33.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1ac9692700 1 --2- 172.21.15.44:0/2195993851 >> v2:172.21.15.99:3300/0 conn(0x7f1ac415ac40 0x7f1ac406ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1ac9692700 1 -- 172.21.15.44:0/2195993851 >> v2:172.21.15.44:3300/0 conn(0x7f1ac415e730 msgr2=0x7f1ac415eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:33.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1ac9692700 1 --2- 172.21.15.44:0/2195993851 >> v2:172.21.15.44:3300/0 conn(0x7f1ac415e730 0x7f1ac415eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1ac9692700 1 -- 172.21.15.44:0/2195993851 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac406a6f0 con 0x7f1ac40ad710 2024-09-13T18:35:33.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1ac9e93700 1 --2- 172.21.15.44:0/2195993851 >> v2:172.21.15.99:3300/0 conn(0x7f1ac415ac40 0x7f1ac406ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:33.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1ac9692700 1 --2- 172.21.15.44:0/2195993851 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ac40ad710 0x7f1ac40adb70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4071fc0 tx=0x7f1ab8009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f8b8f5d48b6149a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:33.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1ac8e91700 1 -- 172.21.15.44:0/2195993851 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8011830 con 0x7f1ac40ad710 2024-09-13T18:35:33.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1ac8e91700 1 -- 172.21.15.44:0/2195993851 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab8011990 con 0x7f1ac40ad710 2024-09-13T18:35:33.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1ac8e91700 1 -- 172.21.15.44:0/2195993851 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8011d40 con 0x7f1ac40ad710 2024-09-13T18:35:33.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1acc0f7700 1 -- 172.21.15.44:0/2195993851 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ac40ad710 msgr2=0x7f1ac40adb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1acc0f7700 1 --2- 172.21.15.44:0/2195993851 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ac40ad710 0x7f1ac40adb70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4071fc0 tx=0x7f1ab8009c20 comp rx=0 tx=0).stop 2024-09-13T18:35:33.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1acc0f7700 1 -- 172.21.15.44:0/2195993851 shutdown_connections 2024-09-13T18:35:33.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1acc0f7700 1 --2- 172.21.15.44:0/2195993851 >> v2:172.21.15.44:3300/0 conn(0x7f1ac415e730 0x7f1ac415eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1acc0f7700 1 --2- 172.21.15.44:0/2195993851 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ac40ad710 0x7f1ac40adb70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1acc0f7700 1 --2- 172.21.15.44:0/2195993851 >> v2:172.21.15.99:3300/0 conn(0x7f1ac415ac40 0x7f1ac406ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1acc0f7700 1 -- 172.21.15.44:0/2195993851 >> 172.21.15.44:0/2195993851 conn(0x7f1ac40ce980 msgr2=0x7f1ac40ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:33.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1acc0f7700 1 -- 172.21.15.44:0/2195993851 shutdown_connections 2024-09-13T18:35:33.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.548+0000 7f1acc0f7700 1 -- 172.21.15.44:0/2195993851 wait complete. 2024-09-13T18:35:33.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.552+0000 7f1acc0f7700 1 Processor -- start 2024-09-13T18:35:33.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.552+0000 7f1acc0f7700 1 -- start start 2024-09-13T18:35:33.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.552+0000 7f1acc0f7700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ac40ad710 0x7f1ac4150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.552+0000 7f1acc0f7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ac415ac40 0x7f1ac41570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.552+0000 7f1acc0f7700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ac415e730 0x7f1ac40ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.552+0000 7f1acc0f7700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac4150d90 con 0x7f1ac415ac40 2024-09-13T18:35:33.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.552+0000 7f1acc0f7700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac406fd70 con 0x7f1ac415e730 2024-09-13T18:35:33.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.552+0000 7f1acc0f7700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac4070010 con 0x7f1ac40ad710 2024-09-13T18:35:33.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.552+0000 7f1ac9692700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ac415ac40 0x7f1ac41570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.552+0000 7f1ac9692700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ac415ac40 0x7f1ac41570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41976/0 (socket says 172.21.15.44:41976) 2024-09-13T18:35:33.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.552+0000 7f1ac9692700 1 -- 172.21.15.44:0/1647363848 learned_addr learned my addr 172.21.15.44:0/1647363848 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:33.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.552+0000 7f1ac9e93700 1 --2- 172.21.15.44:0/1647363848 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ac40ad710 0x7f1ac4150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.552+0000 7f1aca694700 1 --2- 172.21.15.44:0/1647363848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ac415e730 0x7f1ac40ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.552+0000 7f1ac9692700 1 -- 172.21.15.44:0/1647363848 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ac40ad710 msgr2=0x7f1ac4150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.552+0000 7f1ac9692700 1 --2- 172.21.15.44:0/1647363848 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ac40ad710 0x7f1ac4150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.552+0000 7f1ac9692700 1 -- 172.21.15.44:0/1647363848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ac415e730 msgr2=0x7f1ac40ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.552+0000 7f1ac9692700 1 --2- 172.21.15.44:0/1647363848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ac415e730 0x7f1ac40ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.552+0000 7f1ac9692700 1 -- 172.21.15.44:0/1647363848 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1abc009a70 con 0x7f1ac415ac40 2024-09-13T18:35:33.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.552+0000 7f1ac9692700 1 --2- 172.21.15.44:0/1647363848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ac415ac40 0x7f1ac41570b0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8000c00 tx=0x7f1ab8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:33.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.552+0000 7f1ac27fc700 1 -- 172.21.15.44:0/1647363848 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8004510 con 0x7f1ac415ac40 2024-09-13T18:35:33.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.552+0000 7f1ac27fc700 1 -- 172.21.15.44:0/1647363848 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab801e070 con 0x7f1ac415ac40 2024-09-13T18:35:33.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.552+0000 7f1acc0f7700 1 -- 172.21.15.44:0/1647363848 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab8009570 con 0x7f1ac415ac40 2024-09-13T18:35:33.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.556+0000 7f1ac27fc700 1 -- 172.21.15.44:0/1647363848 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8003900 con 0x7f1ac415ac40 2024-09-13T18:35:33.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.556+0000 7f1acc0f7700 1 -- 172.21.15.44:0/1647363848 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac40705d0 con 0x7f1ac415ac40 2024-09-13T18:35:33.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.556+0000 7f1ac27fc700 1 -- 172.21.15.44:0/1647363848 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1ab8003a60 con 0x7f1ac415ac40 2024-09-13T18:35:33.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.556+0000 7f1acc0f7700 1 -- 172.21.15.44:0/1647363848 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac406a310 con 0x7f1ac415ac40 2024-09-13T18:35:33.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.556+0000 7f1ac27fc700 1 --2- 172.21.15.44:0/1647363848 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1ab0066730 0x7f1ab0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.556+0000 7f1ac27fc700 1 -- 172.21.15.44:0/1647363848 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f1ab8084f90 con 0x7f1ac415ac40 2024-09-13T18:35:33.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.556+0000 7f1ac9e93700 1 --2- 172.21.15.44:0/1647363848 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1ab0066730 0x7f1ab0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.556+0000 7f1ac9e93700 1 --2- 172.21.15.44:0/1647363848 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1ab0066730 0x7f1ab0068bf0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0114e0 tx=0x7f1abc00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:33.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.564+0000 7f1ac27fc700 1 -- 172.21.15.44:0/1647363848 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1ab80b6db0 con 0x7f1ac415ac40 2024-09-13T18:35:33.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.736+0000 7f1acc0f7700 1 -- 172.21.15.44:0/1647363848 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ac4154a70 con 0x7f1ac415ac40 2024-09-13T18:35:33.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.740+0000 7f1ac27fc700 1 -- 172.21.15.44:0/1647363848 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16894 (secure 0 0 0) 0x7f1ab8052350 con 0x7f1ac415ac40 2024-09-13T18:35:33.747 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:33.747 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":66,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:35:19.260517+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:14.682923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:15.291935+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:6836/3072614790":"2024-09-14T18:35:19.260455+0000","172.21.15.99:6837/3072614790":"2024-09-14T18:35:19.260455+0000","172.21.15.44:6835/1074184606":"2024-09-14T18:35:18.166304+0000","172.21.15.44:6833/1074184606":"2024-09-14T18:35:18.166304+0000","172.21.15.44:6835/1608555972":"2024-09-14T18:34:13.117246+0000","172.21.15.44:6833/1608555972":"2024-09-14T18:34:13.117246+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:33.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.740+0000 7f1acc0f7700 1 -- 172.21.15.44:0/1647363848 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1ab0066730 msgr2=0x7f1ab0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.740+0000 7f1acc0f7700 1 --2- 172.21.15.44:0/1647363848 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1ab0066730 0x7f1ab0068bf0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0114e0 tx=0x7f1abc00b040 comp rx=0 tx=0).stop 2024-09-13T18:35:33.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.740+0000 7f1acc0f7700 1 -- 172.21.15.44:0/1647363848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ac415ac40 msgr2=0x7f1ac41570b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.740+0000 7f1acc0f7700 1 --2- 172.21.15.44:0/1647363848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ac415ac40 0x7f1ac41570b0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8000c00 tx=0x7f1ab8004770 comp rx=0 tx=0).stop 2024-09-13T18:35:33.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.744+0000 7f1acc0f7700 1 -- 172.21.15.44:0/1647363848 shutdown_connections 2024-09-13T18:35:33.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.744+0000 7f1acc0f7700 1 --2- 172.21.15.44:0/1647363848 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1ab0066730 0x7f1ab0068bf0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.744+0000 7f1acc0f7700 1 --2- 172.21.15.44:0/1647363848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ac415e730 0x7f1ac40ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.744+0000 7f1acc0f7700 1 --2- 172.21.15.44:0/1647363848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ac415ac40 0x7f1ac41570b0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.744+0000 7f1acc0f7700 1 --2- 172.21.15.44:0/1647363848 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ac40ad710 0x7f1ac4150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.744+0000 7f1acc0f7700 1 -- 172.21.15.44:0/1647363848 >> 172.21.15.44:0/1647363848 conn(0x7f1ac40ce980 msgr2=0x7f1ac40b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:33.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.744+0000 7f1acc0f7700 1 -- 172.21.15.44:0/1647363848 shutdown_connections 2024-09-13T18:35:33.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.744+0000 7f1acc0f7700 1 -- 172.21.15.44:0/1647363848 wait complete. 2024-09-13T18:35:33.762 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:35:33.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.872+0000 7f62f4972700 1 Processor -- start 2024-09-13T18:35:33.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.872+0000 7f62f4972700 1 -- start start 2024-09-13T18:35:33.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62f4972700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f62f0144340 0x7f62f006d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62f4972700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f62f006bdb0 0x7f62f00cd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62f4972700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f0144720 con 0x7f62f015f140 2024-09-13T18:35:33.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62f4972700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f006dd40 con 0x7f62f0144340 2024-09-13T18:35:33.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62f4972700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f006da60 con 0x7f62f006bdb0 2024-09-13T18:35:33.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62ef7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f62f0144340 0x7f62f006d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62effff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f62f015f140 0x7f62f0070c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44374/0 (socket says 172.21.15.44:44374) 2024-09-13T18:35:33.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62effff700 1 -- 172.21.15.44:0/2686145498 learned_addr learned my addr 172.21.15.44:0/2686145498 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:33.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62eeffd700 1 --2- 172.21.15.44:0/2686145498 >> v2:172.21.15.99:3300/0 conn(0x7f62f006bdb0 0x7f62f00cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62ef7fe700 1 -- 172.21.15.44:0/2686145498 >> v2:172.21.15.99:3300/0 conn(0x7f62f006bdb0 msgr2=0x7f62f00cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:33.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62ef7fe700 1 --2- 172.21.15.44:0/2686145498 >> v2:172.21.15.99:3300/0 conn(0x7f62f006bdb0 0x7f62f00cd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62ef7fe700 1 -- 172.21.15.44:0/2686145498 >> v1:172.21.15.44:6789/0 conn(0x7f62f015f140 legacy=0x7f62f0070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62ee7fc700 1 -- 172.21.15.44:0/2686145498 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839889753 0 0) 0x7f62f0144720 con 0x7f62f015f140 2024-09-13T18:35:33.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62ef7fe700 1 -- 172.21.15.44:0/2686145498 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f015e660 con 0x7f62f0144340 2024-09-13T18:35:33.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62eeffd700 1 --2- 172.21.15.44:0/2686145498 >> v2:172.21.15.99:3300/0 conn(0x7f62f006bdb0 0x7f62f00cd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:33.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62ef7fe700 1 --2- 172.21.15.44:0/2686145498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f0144340 0x7f62f006d480 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f62f00ce500 tx=0x7f62d8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95965277a9a9a3ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:33.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62ee7fc700 1 -- 172.21.15.44:0/2686145498 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d8011830 con 0x7f62f0144340 2024-09-13T18:35:33.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62ee7fc700 1 -- 172.21.15.44:0/2686145498 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d8011990 con 0x7f62f0144340 2024-09-13T18:35:33.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62ee7fc700 1 -- 172.21.15.44:0/2686145498 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d8011d20 con 0x7f62f0144340 2024-09-13T18:35:33.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62f4972700 1 -- 172.21.15.44:0/2686145498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f0144340 msgr2=0x7f62f006d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62f4972700 1 --2- 172.21.15.44:0/2686145498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f0144340 0x7f62f006d480 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f62f00ce500 tx=0x7f62d8009b30 comp rx=0 tx=0).stop 2024-09-13T18:35:33.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62f4972700 1 -- 172.21.15.44:0/2686145498 shutdown_connections 2024-09-13T18:35:33.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62f4972700 1 --2- 172.21.15.44:0/2686145498 >> v2:172.21.15.99:3300/0 conn(0x7f62f006bdb0 0x7f62f00cd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62f4972700 1 --2- 172.21.15.44:0/2686145498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f0144340 0x7f62f006d480 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62f4972700 1 -- 172.21.15.44:0/2686145498 >> 172.21.15.44:0/2686145498 conn(0x7f62f00b0e10 msgr2=0x7f62f00b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:33.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62f4972700 1 -- 172.21.15.44:0/2686145498 shutdown_connections 2024-09-13T18:35:33.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.876+0000 7f62f4972700 1 -- 172.21.15.44:0/2686145498 wait complete. 2024-09-13T18:35:33.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62f4972700 1 Processor -- start 2024-09-13T18:35:33.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62f4972700 1 -- start start 2024-09-13T18:35:33.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62f4972700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f62f006bdb0 0x7f62f0133fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62f4972700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f0144340 0x7f62f013f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62f4972700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62f015f140 0x7f62f00ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62f4972700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f013e330 con 0x7f62f0144340 2024-09-13T18:35:33.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62f4972700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f01344f0 con 0x7f62f015f140 2024-09-13T18:35:33.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62f4972700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f00cbad0 con 0x7f62f006bdb0 2024-09-13T18:35:33.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62eeffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f0144340 0x7f62f013f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62eeffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f0144340 0x7f62f013f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41994/0 (socket says 172.21.15.44:41994) 2024-09-13T18:35:33.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62eeffd700 1 -- 172.21.15.44:0/2983591002 learned_addr learned my addr 172.21.15.44:0/2983591002 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:33.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62effff700 1 --2- 172.21.15.44:0/2983591002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62f015f140 0x7f62f00ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62ef7fe700 1 --2- 172.21.15.44:0/2983591002 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f62f006bdb0 0x7f62f0133fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62eeffd700 1 -- 172.21.15.44:0/2983591002 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f62f006bdb0 msgr2=0x7f62f0133fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62eeffd700 1 --2- 172.21.15.44:0/2983591002 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f62f006bdb0 0x7f62f0133fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62eeffd700 1 -- 172.21.15.44:0/2983591002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62f015f140 msgr2=0x7f62f00ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62eeffd700 1 --2- 172.21.15.44:0/2983591002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62f015f140 0x7f62f00ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62eeffd700 1 -- 172.21.15.44:0/2983591002 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e00094b0 con 0x7f62f0144340 2024-09-13T18:35:33.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62eeffd700 1 --2- 172.21.15.44:0/2983591002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f0144340 0x7f62f013f830 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f62e000ebe0 tx=0x7f62e0009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:33.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62e7fff700 1 -- 172.21.15.44:0/2983591002 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e000c910 con 0x7f62f0144340 2024-09-13T18:35:33.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62e7fff700 1 -- 172.21.15.44:0/2983591002 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e000ca70 con 0x7f62f0144340 2024-09-13T18:35:33.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62f4972700 1 -- 172.21.15.44:0/2983591002 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d80094b0 con 0x7f62f0144340 2024-09-13T18:35:33.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62e7fff700 1 -- 172.21.15.44:0/2983591002 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e000ce00 con 0x7f62f0144340 2024-09-13T18:35:33.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.880+0000 7f62f4972700 1 -- 172.21.15.44:0/2983591002 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f00cc090 con 0x7f62f0144340 2024-09-13T18:35:33.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.884+0000 7f62f4972700 1 -- 172.21.15.44:0/2983591002 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f006afe0 con 0x7f62f0144340 2024-09-13T18:35:33.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.884+0000 7f62e7fff700 1 -- 172.21.15.44:0/2983591002 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f62e0013470 con 0x7f62f0144340 2024-09-13T18:35:33.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.884+0000 7f62e7fff700 1 --2- 172.21.15.44:0/2983591002 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f62d0066730 0x7f62d0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.884+0000 7f62e7fff700 1 -- 172.21.15.44:0/2983591002 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f62e0084470 con 0x7f62f0144340 2024-09-13T18:35:33.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.884+0000 7f62ef7fe700 1 --2- 172.21.15.44:0/2983591002 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f62d0066730 0x7f62d0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.888+0000 7f62ef7fe700 1 --2- 172.21.15.44:0/2983591002 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f62d0066730 0x7f62d0068bf0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f62d8000c00 tx=0x7f62d8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:33.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:33.892+0000 7f62e7fff700 1 -- 172.21.15.44:0/2983591002 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f62e0051660 con 0x7f62f0144340 2024-09-13T18:35:34.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.096+0000 7f62f4972700 1 -- 172.21.15.44:0/2983591002 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f62f006d480 con 0x7f62f0144340 2024-09-13T18:35:34.103 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-13T18:35:34.096+0000 7fc22bbc2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:35:34.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.112+0000 7f62e7fff700 1 -- 172.21.15.44:0/2983591002 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v63) v1 ==== 161+0+0 (secure 0 0 0) 0x7f62e0054c80 con 0x7f62f0144340 2024-09-13T18:35:34.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.112+0000 7f62f4972700 1 -- 172.21.15.44:0/2983591002 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f62d0066730 msgr2=0x7f62d0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:34.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.112+0000 7f62f4972700 1 --2- 172.21.15.44:0/2983591002 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f62d0066730 0x7f62d0068bf0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f62d8000c00 tx=0x7f62d8008030 comp rx=0 tx=0).stop 2024-09-13T18:35:34.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.112+0000 7f62f4972700 1 -- 172.21.15.44:0/2983591002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f0144340 msgr2=0x7f62f013f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:34.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.112+0000 7f62f4972700 1 --2- 172.21.15.44:0/2983591002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f0144340 0x7f62f013f830 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f62e000ebe0 tx=0x7f62e0009ed0 comp rx=0 tx=0).stop 2024-09-13T18:35:34.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.112+0000 7f62f4972700 1 -- 172.21.15.44:0/2983591002 shutdown_connections 2024-09-13T18:35:34.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.112+0000 7f62f4972700 1 --2- 172.21.15.44:0/2983591002 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f62d0066730 0x7f62d0068bf0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:34.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.112+0000 7f62f4972700 1 --2- 172.21.15.44:0/2983591002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62f015f140 0x7f62f00ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:34.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.112+0000 7f62f4972700 1 --2- 172.21.15.44:0/2983591002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f0144340 0x7f62f013f830 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:34.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.112+0000 7f62f4972700 1 --2- 172.21.15.44:0/2983591002 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f62f006bdb0 0x7f62f0133fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:34.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.112+0000 7f62f4972700 1 -- 172.21.15.44:0/2983591002 >> 172.21.15.44:0/2983591002 conn(0x7f62f00b0e10 msgr2=0x7f62f0142670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:34.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.112+0000 7f62f4972700 1 -- 172.21.15.44:0/2983591002 shutdown_connections 2024-09-13T18:35:34.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.112+0000 7f62f4972700 1 -- 172.21.15.44:0/2983591002 wait complete. 2024-09-13T18:35:34.122 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:35:34.134 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:35:34.163 INFO:tasks.ceph.mds.d.smithi099.stdout:starting mds.d at 2024-09-13T18:35:34.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.248+0000 7fb98870f700 1 Processor -- start 2024-09-13T18:35:34.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.248+0000 7fb98870f700 1 -- start start 2024-09-13T18:35:34.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.252+0000 7fb98870f700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb9800b2ea0 0x7fb9800b4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:34.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.252+0000 7fb98870f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb9800ccb90 0x7fb9800b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:34.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.252+0000 7fb98870f700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9800cab90 con 0x7fb980146190 2024-09-13T18:35:34.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.252+0000 7fb98870f700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9800b3280 con 0x7fb9800b2ea0 2024-09-13T18:35:34.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.252+0000 7fb98870f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9800c9f80 con 0x7fb9800ccb90 2024-09-13T18:35:34.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.252+0000 7fb9864ab700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb9800b2ea0 0x7fb9800b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:34.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.252+0000 7fb9864ab700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb9800b2ea0 0x7fb9800b4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42002/0 (socket says 172.21.15.44:42002) 2024-09-13T18:35:34.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.252+0000 7fb9864ab700 1 -- 172.21.15.44:0/3438187583 learned_addr learned my addr 172.21.15.44:0/3438187583 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:34.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.252+0000 7fb986cac700 1 --2- 172.21.15.44:0/3438187583 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb9800ccb90 0x7fb9800b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:34.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.252+0000 7fb9864ab700 1 -- 172.21.15.44:0/3438187583 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb9800ccb90 msgr2=0x7fb9800b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:34.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.252+0000 7fb9854a9700 1 -- 172.21.15.44:0/3438187583 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198245590 0 0) 0x7fb9800cab90 con 0x7fb980146190 2024-09-13T18:35:34.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.252+0000 7fb9864ab700 1 --2- 172.21.15.44:0/3438187583 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb9800ccb90 0x7fb9800b4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:34.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.252+0000 7fb9864ab700 1 -- 172.21.15.44:0/3438187583 >> v1:172.21.15.99:6789/0 conn(0x7fb980146190 legacy=0x7fb9800cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:34.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.252+0000 7fb9864ab700 1 -- 172.21.15.44:0/3438187583 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9800ca260 con 0x7fb9800b2ea0 2024-09-13T18:35:34.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.252+0000 7fb986cac700 1 --2- 172.21.15.44:0/3438187583 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb9800ccb90 0x7fb9800b4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:34.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.252+0000 7fb9864ab700 1 --2- 172.21.15.44:0/3438187583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9800b2ea0 0x7fb9800b4570 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009910 tx=0x7fb97c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba69e6f413f45ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:34.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.252+0000 7fb9854a9700 1 -- 172.21.15.44:0/3438187583 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97c011830 con 0x7fb9800b2ea0 2024-09-13T18:35:34.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.252+0000 7fb9854a9700 1 -- 172.21.15.44:0/3438187583 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97c011990 con 0x7fb9800b2ea0 2024-09-13T18:35:34.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.252+0000 7fb9854a9700 1 -- 172.21.15.44:0/3438187583 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97c011d40 con 0x7fb9800b2ea0 2024-09-13T18:35:34.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.252+0000 7fb98870f700 1 -- 172.21.15.44:0/3438187583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9800b2ea0 msgr2=0x7fb9800b4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:34.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.252+0000 7fb98870f700 1 --2- 172.21.15.44:0/3438187583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9800b2ea0 0x7fb9800b4570 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009910 tx=0x7fb97c009c20 comp rx=0 tx=0).stop 2024-09-13T18:35:34.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb98870f700 1 -- 172.21.15.44:0/3438187583 shutdown_connections 2024-09-13T18:35:34.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb98870f700 1 --2- 172.21.15.44:0/3438187583 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb9800ccb90 0x7fb9800b4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:34.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb98870f700 1 --2- 172.21.15.44:0/3438187583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9800b2ea0 0x7fb9800b4570 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:34.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb98870f700 1 -- 172.21.15.44:0/3438187583 >> 172.21.15.44:0/3438187583 conn(0x7fb9800d0b30 msgr2=0x7fb9800d0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:34.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb98870f700 1 -- 172.21.15.44:0/3438187583 shutdown_connections 2024-09-13T18:35:34.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb98870f700 1 -- 172.21.15.44:0/3438187583 wait complete. 2024-09-13T18:35:34.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb98870f700 1 Processor -- start 2024-09-13T18:35:34.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb98870f700 1 -- start start 2024-09-13T18:35:34.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb98870f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb9800b2ea0 0x7fb9801f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:34.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb98870f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9800ccb90 0x7fb980141560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:34.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb98870f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb980146190 0x7fb9800a8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:34.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb98870f700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98015e190 con 0x7fb980146190 2024-09-13T18:35:34.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb98870f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9801f2a50 con 0x7fb9800ccb90 2024-09-13T18:35:34.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb98870f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb98006db50 con 0x7fb9800b2ea0 2024-09-13T18:35:34.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb986cac700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb980146190 0x7fb9800a8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:34.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb986cac700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb980146190 0x7fb9800a8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42018/0 (socket says 172.21.15.44:42018) 2024-09-13T18:35:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb986cac700 1 -- 172.21.15.44:0/4098401466 learned_addr learned my addr 172.21.15.44:0/4098401466 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb9864ab700 1 --2- 172.21.15.44:0/4098401466 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb9800b2ea0 0x7fb9801f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb985caa700 1 --2- 172.21.15.44:0/4098401466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9800ccb90 0x7fb980141560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb986cac700 1 -- 172.21.15.44:0/4098401466 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb9800b2ea0 msgr2=0x7fb9801f2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb986cac700 1 --2- 172.21.15.44:0/4098401466 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb9800b2ea0 0x7fb9801f2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb986cac700 1 -- 172.21.15.44:0/4098401466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9800ccb90 msgr2=0x7fb980141560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb986cac700 1 --2- 172.21.15.44:0/4098401466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9800ccb90 0x7fb980141560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb986cac700 1 -- 172.21.15.44:0/4098401466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb978009a70 con 0x7fb980146190 2024-09-13T18:35:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb9864ab700 1 --2- 172.21.15.44:0/4098401466 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb9800b2ea0 0x7fb9801f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb986cac700 1 --2- 172.21.15.44:0/4098401466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb980146190 0x7fb9800a8540 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fb97800efc0 tx=0x7fb97800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb976ffd700 1 -- 172.21.15.44:0/4098401466 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97800cb40 con 0x7fb980146190 2024-09-13T18:35:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb976ffd700 1 -- 172.21.15.44:0/4098401466 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97800f040 con 0x7fb980146190 2024-09-13T18:35:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb98870f700 1 -- 172.21.15.44:0/4098401466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97c009570 con 0x7fb980146190 2024-09-13T18:35:34.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb976ffd700 1 -- 172.21.15.44:0/4098401466 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb978003a40 con 0x7fb980146190 2024-09-13T18:35:34.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.256+0000 7fb98870f700 1 -- 172.21.15.44:0/4098401466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb98015de20 con 0x7fb980146190 2024-09-13T18:35:34.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.260+0000 7fb98870f700 1 -- 172.21.15.44:0/4098401466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb98006fcd0 con 0x7fb980146190 2024-09-13T18:35:34.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.260+0000 7fb976ffd700 1 -- 172.21.15.44:0/4098401466 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb978014480 con 0x7fb980146190 2024-09-13T18:35:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.260+0000 7fb976ffd700 1 --2- 172.21.15.44:0/4098401466 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb964066730 0x7fb964068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.260+0000 7fb976ffd700 1 -- 172.21.15.44:0/4098401466 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6053+0+0 (secure 0 0 0) 0x7fb978084d90 con 0x7fb980146190 2024-09-13T18:35:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.260+0000 7fb9864ab700 1 --2- 172.21.15.44:0/4098401466 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb964066730 0x7fb964068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.260+0000 7fb9864ab700 1 --2- 172.21.15.44:0/4098401466 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb964066730 0x7fb964068bf0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb97c000c00 tx=0x7fb97c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:34.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.268+0000 7fb976ffd700 1 -- 172.21.15.44:0/4098401466 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb978051f10 con 0x7fb980146190 2024-09-13T18:35:34.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:34.480+0000 7fb98870f700 1 -- 172.21.15.44:0/4098401466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb9800b2aa0 con 0x7fb980146190 2024-09-13T18:35:35.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.116+0000 7fb976ffd700 1 -- 172.21.15.44:0/4098401466 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v64) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb978055530 con 0x7fb980146190 2024-09-13T18:35:35.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.120+0000 7fb98870f700 1 -- 172.21.15.44:0/4098401466 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb964066730 msgr2=0x7fb964068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:35.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.120+0000 7fb98870f700 1 --2- 172.21.15.44:0/4098401466 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb964066730 0x7fb964068bf0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb97c000c00 tx=0x7fb97c008030 comp rx=0 tx=0).stop 2024-09-13T18:35:35.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.120+0000 7fb98870f700 1 -- 172.21.15.44:0/4098401466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb980146190 msgr2=0x7fb9800a8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:35.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.120+0000 7fb98870f700 1 --2- 172.21.15.44:0/4098401466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb980146190 0x7fb9800a8540 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fb97800efc0 tx=0x7fb97800c3a0 comp rx=0 tx=0).stop 2024-09-13T18:35:35.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.120+0000 7fb98870f700 1 -- 172.21.15.44:0/4098401466 shutdown_connections 2024-09-13T18:35:35.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.120+0000 7fb98870f700 1 --2- 172.21.15.44:0/4098401466 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb964066730 0x7fb964068bf0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:35.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.120+0000 7fb98870f700 1 --2- 172.21.15.44:0/4098401466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb980146190 0x7fb9800a8540 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:35.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.120+0000 7fb98870f700 1 --2- 172.21.15.44:0/4098401466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9800ccb90 0x7fb980141560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:35.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.120+0000 7fb98870f700 1 --2- 172.21.15.44:0/4098401466 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb9800b2ea0 0x7fb9801f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:35.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.120+0000 7fb98870f700 1 -- 172.21.15.44:0/4098401466 >> 172.21.15.44:0/4098401466 conn(0x7fb9800d0b30 msgr2=0x7fb9800d10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:35.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.120+0000 7fb98870f700 1 -- 172.21.15.44:0/4098401466 shutdown_connections 2024-09-13T18:35:35.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.120+0000 7fb98870f700 1 -- 172.21.15.44:0/4098401466 wait complete. 2024-09-13T18:35:35.145 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:35:35.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.268+0000 7f95faf82700 1 Processor -- start 2024-09-13T18:35:35.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.268+0000 7f95faf82700 1 -- start start 2024-09-13T18:35:35.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.272+0000 7f95faf82700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f95f40b5da0 0x7f95f41614a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:35.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.272+0000 7f95faf82700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f406aa30 con 0x7f95f40ceaf0 2024-09-13T18:35:35.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.272+0000 7f95faf82700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f40b61b0 con 0x7f95f40ce710 2024-09-13T18:35:35.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.272+0000 7f95faf82700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f40d0660 con 0x7f95f40b5da0 2024-09-13T18:35:35.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.272+0000 7f95f977f700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f95f40ceaf0 0x7f95f4160d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44376/0 (socket says 172.21.15.44:44376) 2024-09-13T18:35:35.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.272+0000 7f95f977f700 1 -- 172.21.15.44:0/1998292676 learned_addr learned my addr 172.21.15.44:0/1998292676 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:35.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.272+0000 7f95fa781700 1 --2- 172.21.15.44:0/1998292676 >> v2:172.21.15.99:3300/0 conn(0x7f95f40b5da0 0x7f95f41614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:35.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.272+0000 7f95f8f7e700 1 -- 172.21.15.44:0/1998292676 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574675844 0 0) 0x7f95f406aa30 con 0x7f95f40ceaf0 2024-09-13T18:35:35.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.272+0000 7f95f8f7e700 1 -- 172.21.15.44:0/1998292676 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95e00035d0 con 0x7f95f40ceaf0 2024-09-13T18:35:35.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.272+0000 7f95fa781700 1 -- 172.21.15.44:0/1998292676 >> v1:172.21.15.99:6789/0 conn(0x7f95f40ce710 legacy=0x7f95f40cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:35.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.272+0000 7f95fa781700 1 -- 172.21.15.44:0/1998292676 >> v1:172.21.15.44:6789/0 conn(0x7f95f40ceaf0 legacy=0x7f95f4160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:35.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.272+0000 7f95fa781700 1 -- 172.21.15.44:0/1998292676 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f40b1e60 con 0x7f95f40b5da0 2024-09-13T18:35:35.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.272+0000 7f95fa781700 1 --2- 172.21.15.44:0/1998292676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95f40b5da0 0x7f95f41614a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f95ec009d90 tx=0x7f95ec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=439c99092d95238d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:35.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.272+0000 7f95f8f7e700 1 -- 172.21.15.44:0/1998292676 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec00e070 con 0x7f95f40b5da0 2024-09-13T18:35:35.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.272+0000 7f95f8f7e700 1 -- 172.21.15.44:0/1998292676 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ec00bb20 con 0x7f95f40b5da0 2024-09-13T18:35:35.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.272+0000 7f95f8f7e700 1 -- 172.21.15.44:0/1998292676 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec012430 con 0x7f95f40b5da0 2024-09-13T18:35:35.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.272+0000 7f95faf82700 1 -- 172.21.15.44:0/1998292676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95f40b5da0 msgr2=0x7f95f41614a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:35.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.272+0000 7f95faf82700 1 --2- 172.21.15.44:0/1998292676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95f40b5da0 0x7f95f41614a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f95ec009d90 tx=0x7f95ec00b330 comp rx=0 tx=0).stop 2024-09-13T18:35:35.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.272+0000 7f95faf82700 1 -- 172.21.15.44:0/1998292676 shutdown_connections 2024-09-13T18:35:35.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.272+0000 7f95faf82700 1 --2- 172.21.15.44:0/1998292676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95f40b5da0 0x7f95f41614a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:35.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.272+0000 7f95faf82700 1 -- 172.21.15.44:0/1998292676 >> 172.21.15.44:0/1998292676 conn(0x7f95f40d3260 msgr2=0x7f95f40cf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:35.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.272+0000 7f95faf82700 1 -- 172.21.15.44:0/1998292676 shutdown_connections 2024-09-13T18:35:35.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.276+0000 7f95faf82700 1 -- 172.21.15.44:0/1998292676 wait complete. 2024-09-13T18:35:35.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.276+0000 7f95faf82700 1 Processor -- start 2024-09-13T18:35:35.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.276+0000 7f95faf82700 1 -- start start 2024-09-13T18:35:35.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.280+0000 7f95faf82700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95f40b5da0 0x7f95f40c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:35.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.280+0000 7f95faf82700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95f40ce710 0x7f95f4153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:35.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.280+0000 7f95faf82700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95f40ceaf0 0x7f95f40d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:35.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.280+0000 7f95faf82700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f40cc540 con 0x7f95f40ce710 2024-09-13T18:35:35.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.280+0000 7f95faf82700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f4158690 con 0x7f95f40b5da0 2024-09-13T18:35:35.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.280+0000 7f95faf82700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f40cadf0 con 0x7f95f40ceaf0 2024-09-13T18:35:35.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.280+0000 7f95f977f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95f40ce710 0x7f95f4153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:35.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.280+0000 7f95f9f80700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95f40b5da0 0x7f95f40c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:35.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.280+0000 7f95f977f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95f40ce710 0x7f95f4153c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42024/0 (socket says 172.21.15.44:42024) 2024-09-13T18:35:35.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.280+0000 7f95f977f700 1 -- 172.21.15.44:0/3311381971 learned_addr learned my addr 172.21.15.44:0/3311381971 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:35.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.280+0000 7f95fa781700 1 --2- 172.21.15.44:0/3311381971 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95f40ceaf0 0x7f95f40d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:35.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.280+0000 7f95f977f700 1 -- 172.21.15.44:0/3311381971 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95f40ceaf0 msgr2=0x7f95f40d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:35.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.280+0000 7f95f977f700 1 --2- 172.21.15.44:0/3311381971 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95f40ceaf0 0x7f95f40d17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:35.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.280+0000 7f95f977f700 1 -- 172.21.15.44:0/3311381971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95f40b5da0 msgr2=0x7f95f40c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:35.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.280+0000 7f95f977f700 1 --2- 172.21.15.44:0/3311381971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95f40b5da0 0x7f95f40c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:35.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.280+0000 7f95f977f700 1 -- 172.21.15.44:0/3311381971 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec009a70 con 0x7f95f40ce710 2024-09-13T18:35:35.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.280+0000 7f95f977f700 1 --2- 172.21.15.44:0/3311381971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95f40ce710 0x7f95f4153c90 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f95f000c4d0 tx=0x7f95f000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:35.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.280+0000 7f95e67fc700 1 -- 172.21.15.44:0/3311381971 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0005d90 con 0x7f95f40ce710 2024-09-13T18:35:35.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.280+0000 7f95e67fc700 1 -- 172.21.15.44:0/3311381971 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f00070d0 con 0x7f95f40ce710 2024-09-13T18:35:35.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.280+0000 7f95faf82700 1 -- 172.21.15.44:0/3311381971 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f40ca550 con 0x7f95f40ce710 2024-09-13T18:35:35.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.280+0000 7f95e67fc700 1 -- 172.21.15.44:0/3311381971 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0007480 con 0x7f95f40ce710 2024-09-13T18:35:35.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.280+0000 7f95faf82700 1 -- 172.21.15.44:0/3311381971 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f40cab10 con 0x7f95f40ce710 2024-09-13T18:35:35.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.280+0000 7f95faf82700 1 -- 172.21.15.44:0/3311381971 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f4158820 con 0x7f95f40ce710 2024-09-13T18:35:35.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.284+0000 7f95e67fc700 1 -- 172.21.15.44:0/3311381971 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f95f00075e0 con 0x7f95f40ce710 2024-09-13T18:35:35.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.284+0000 7f95e67fc700 1 --2- 172.21.15.44:0/3311381971 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f95d8066730 0x7f95d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:35.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.284+0000 7f95e67fc700 1 -- 172.21.15.44:0/3311381971 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f95f00836b0 con 0x7f95f40ce710 2024-09-13T18:35:35.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.284+0000 7f95f9f80700 1 --2- 172.21.15.44:0/3311381971 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f95d8066730 0x7f95d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:35.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.284+0000 7f95f9f80700 1 --2- 172.21.15.44:0/3311381971 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f95d8066730 0x7f95d8068bf0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f95e8000f60 tx=0x7f95e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:35.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.292+0000 7f95e67fc700 1 -- 172.21.15.44:0/3311381971 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f95f00508c0 con 0x7f95f40ce710 2024-09-13T18:35:35.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:35.468+0000 7f95faf82700 1 -- 172.21.15.44:0/3311381971 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f95f40cff50 con 0x7f95f40ce710 2024-09-13T18:35:36.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.384+0000 7f95e67fc700 1 -- 172.21.15.44:0/3311381971 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v68) v1 ==== 181+0+0 (secure 0 0 0) 0x7f95f0053ee0 con 0x7f95f40ce710 2024-09-13T18:35:36.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.388+0000 7f95faf82700 1 -- 172.21.15.44:0/3311381971 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f95d8066730 msgr2=0x7f95d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:36.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.388+0000 7f95faf82700 1 --2- 172.21.15.44:0/3311381971 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f95d8066730 0x7f95d8068bf0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f95e8000f60 tx=0x7f95e8009040 comp rx=0 tx=0).stop 2024-09-13T18:35:36.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.388+0000 7f95faf82700 1 -- 172.21.15.44:0/3311381971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95f40ce710 msgr2=0x7f95f4153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:36.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.388+0000 7f95faf82700 1 --2- 172.21.15.44:0/3311381971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95f40ce710 0x7f95f4153c90 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f95f000c4d0 tx=0x7f95f000c7e0 comp rx=0 tx=0).stop 2024-09-13T18:35:36.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.388+0000 7f95faf82700 1 -- 172.21.15.44:0/3311381971 shutdown_connections 2024-09-13T18:35:36.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.388+0000 7f95faf82700 1 --2- 172.21.15.44:0/3311381971 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f95d8066730 0x7f95d8068bf0 secure :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f95e8000f60 tx=0x7f95e8009040 comp rx=0 tx=0).stop 2024-09-13T18:35:36.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.388+0000 7f95faf82700 1 --2- 172.21.15.44:0/3311381971 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95f40ceaf0 0x7f95f40d17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:36.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.388+0000 7f95faf82700 1 --2- 172.21.15.44:0/3311381971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95f40ce710 0x7f95f4153c90 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:36.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.388+0000 7f95faf82700 1 --2- 172.21.15.44:0/3311381971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95f40b5da0 0x7f95f40c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:36.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.388+0000 7f95faf82700 1 -- 172.21.15.44:0/3311381971 >> 172.21.15.44:0/3311381971 conn(0x7f95f40d3260 msgr2=0x7f95f4154890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:36.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.388+0000 7f95faf82700 1 -- 172.21.15.44:0/3311381971 shutdown_connections 2024-09-13T18:35:36.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.388+0000 7f95faf82700 1 -- 172.21.15.44:0/3311381971 wait complete. 2024-09-13T18:35:36.397 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:35:36.411 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:35:36.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.516+0000 7f53fb59e700 1 Processor -- start 2024-09-13T18:35:36.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.516+0000 7f53fb59e700 1 -- start start 2024-09-13T18:35:36.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53fb59e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f53fc15cbe0 0x7f53fc06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:36.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53fb59e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f53fc0cf1c0 0x7f53fc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:36.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53fb59e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53fc0ce120 con 0x7f53fc0ade50 2024-09-13T18:35:36.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53fb59e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53fc0ce400 con 0x7f53fc15cbe0 2024-09-13T18:35:36.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53fb59e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53fc0ce6e0 con 0x7f53fc0cf1c0 2024-09-13T18:35:36.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53fa59c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f53fc15cbe0 0x7f53fc06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:36.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53fad9d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f53fc0ade50 0x7f53fc0ae2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44382/0 (socket says 172.21.15.44:44382) 2024-09-13T18:35:36.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53fad9d700 1 -- 172.21.15.44:0/2365331502 learned_addr learned my addr 172.21.15.44:0/2365331502 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:36.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53f3fff700 1 --2- 172.21.15.44:0/2365331502 >> v2:172.21.15.99:3300/0 conn(0x7f53fc0cf1c0 0x7f53fc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:36.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53f9d9b700 1 -- 172.21.15.44:0/2365331502 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361309309 0 0) 0x7f53fc0ce120 con 0x7f53fc0ade50 2024-09-13T18:35:36.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53fa59c700 1 -- 172.21.15.44:0/2365331502 >> v2:172.21.15.99:3300/0 conn(0x7f53fc0cf1c0 msgr2=0x7f53fc06e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:36.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53fa59c700 1 --2- 172.21.15.44:0/2365331502 >> v2:172.21.15.99:3300/0 conn(0x7f53fc0cf1c0 0x7f53fc06e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:36.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53fa59c700 1 -- 172.21.15.44:0/2365331502 >> v1:172.21.15.44:6789/0 conn(0x7f53fc0ade50 legacy=0x7f53fc0ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:36.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53fa59c700 1 -- 172.21.15.44:0/2365331502 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc0ce9c0 con 0x7f53fc15cbe0 2024-09-13T18:35:36.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53fa59c700 1 --2- 172.21.15.44:0/2365331502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53fc15cbe0 0x7f53fc06dde0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f53fc071e30 tx=0x7f53ec009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ca2d9617c7a595 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:36.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53f9d9b700 1 -- 172.21.15.44:0/2365331502 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec011830 con 0x7f53fc15cbe0 2024-09-13T18:35:36.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53f9d9b700 1 -- 172.21.15.44:0/2365331502 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ec011990 con 0x7f53fc15cbe0 2024-09-13T18:35:36.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53f9d9b700 1 -- 172.21.15.44:0/2365331502 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec011d20 con 0x7f53fc15cbe0 2024-09-13T18:35:36.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53fb59e700 1 -- 172.21.15.44:0/2365331502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53fc15cbe0 msgr2=0x7f53fc06dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:36.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53fb59e700 1 --2- 172.21.15.44:0/2365331502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53fc15cbe0 0x7f53fc06dde0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f53fc071e30 tx=0x7f53ec009b30 comp rx=0 tx=0).stop 2024-09-13T18:35:36.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53fb59e700 1 -- 172.21.15.44:0/2365331502 shutdown_connections 2024-09-13T18:35:36.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53fb59e700 1 --2- 172.21.15.44:0/2365331502 >> v2:172.21.15.99:3300/0 conn(0x7f53fc0cf1c0 0x7f53fc06e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:36.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53fb59e700 1 --2- 172.21.15.44:0/2365331502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53fc15cbe0 0x7f53fc06dde0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:36.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53fb59e700 1 -- 172.21.15.44:0/2365331502 >> 172.21.15.44:0/2365331502 conn(0x7f53fc0cf9a0 msgr2=0x7f53fc0cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:36.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53fb59e700 1 -- 172.21.15.44:0/2365331502 shutdown_connections 2024-09-13T18:35:36.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.520+0000 7f53fb59e700 1 -- 172.21.15.44:0/2365331502 wait complete. 2024-09-13T18:35:36.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.524+0000 7f53fb59e700 1 Processor -- start 2024-09-13T18:35:36.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.524+0000 7f53fb59e700 1 -- start start 2024-09-13T18:35:36.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.524+0000 7f53fb59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53fc0ade50 0x7f53fc153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:36.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.524+0000 7f53fb59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53fc0cf1c0 0x7f53fc153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:36.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.524+0000 7f53fb59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f53fc15cbe0 0x7f53fc155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:36.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.524+0000 7f53fb59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc06bcf0 con 0x7f53fc0ade50 2024-09-13T18:35:36.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.524+0000 7f53fb59e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc06e100 con 0x7f53fc0cf1c0 2024-09-13T18:35:36.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.524+0000 7f53fb59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc153a40 con 0x7f53fc15cbe0 2024-09-13T18:35:36.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.524+0000 7f53fa59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53fc0ade50 0x7f53fc153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:36.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.524+0000 7f53fa59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53fc0ade50 0x7f53fc153f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42036/0 (socket says 172.21.15.44:42036) 2024-09-13T18:35:36.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.524+0000 7f53fa59c700 1 -- 172.21.15.44:0/4065204277 learned_addr learned my addr 172.21.15.44:0/4065204277 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:36.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.524+0000 7f53f3fff700 1 --2- 172.21.15.44:0/4065204277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53fc0cf1c0 0x7f53fc153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:36.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.524+0000 7f53fad9d700 1 --2- 172.21.15.44:0/4065204277 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f53fc15cbe0 0x7f53fc155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:36.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.528+0000 7f53fa59c700 1 -- 172.21.15.44:0/4065204277 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f53fc15cbe0 msgr2=0x7f53fc155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:36.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.528+0000 7f53fa59c700 1 --2- 172.21.15.44:0/4065204277 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f53fc15cbe0 0x7f53fc155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:36.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.528+0000 7f53fa59c700 1 -- 172.21.15.44:0/4065204277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53fc0cf1c0 msgr2=0x7f53fc153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:36.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.528+0000 7f53fa59c700 1 --2- 172.21.15.44:0/4065204277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53fc0cf1c0 0x7f53fc153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:36.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.528+0000 7f53fa59c700 1 -- 172.21.15.44:0/4065204277 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec0094b0 con 0x7f53fc0ade50 2024-09-13T18:35:36.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.528+0000 7f53f3fff700 1 --2- 172.21.15.44:0/4065204277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53fc0cf1c0 0x7f53fc153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:36.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.528+0000 7f53fa59c700 1 --2- 172.21.15.44:0/4065204277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53fc0ade50 0x7f53fc153f40 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f53ec014040 tx=0x7f53ec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:36.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.528+0000 7f53f2ffd700 1 -- 172.21.15.44:0/4065204277 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec004610 con 0x7f53fc0ade50 2024-09-13T18:35:36.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.528+0000 7f53f2ffd700 1 -- 172.21.15.44:0/4065204277 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ec01e070 con 0x7f53fc0ade50 2024-09-13T18:35:36.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.528+0000 7f53fb59e700 1 -- 172.21.15.44:0/4065204277 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53fc154640 con 0x7f53fc0ade50 2024-09-13T18:35:36.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.528+0000 7f53f2ffd700 1 -- 172.21.15.44:0/4065204277 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec003900 con 0x7f53fc0ade50 2024-09-13T18:35:36.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.528+0000 7f53fb59e700 1 -- 172.21.15.44:0/4065204277 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53fc154c00 con 0x7f53fc0ade50 2024-09-13T18:35:36.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.528+0000 7f53f2ffd700 1 -- 172.21.15.44:0/4065204277 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f53ec003a60 con 0x7f53fc0ade50 2024-09-13T18:35:36.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.528+0000 7f53fb59e700 1 -- 172.21.15.44:0/4065204277 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53fc0ae2e0 con 0x7f53fc0ade50 2024-09-13T18:35:36.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.528+0000 7f53f2ffd700 1 --2- 172.21.15.44:0/4065204277 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f53dc066730 0x7f53dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:36.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.528+0000 7f53f2ffd700 1 -- 172.21.15.44:0/4065204277 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5615+0+0 (secure 0 0 0) 0x7f53ec084ef0 con 0x7f53fc0ade50 2024-09-13T18:35:36.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.532+0000 7f53f3fff700 1 --2- 172.21.15.44:0/4065204277 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f53dc066730 0x7f53dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:36.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.532+0000 7f53f3fff700 1 --2- 172.21.15.44:0/4065204277 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f53dc066730 0x7f53dc068bf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f53fc0cc040 tx=0x7f53e4009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:36.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.536+0000 7f53f2ffd700 1 -- 172.21.15.44:0/4065204277 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f53ec0522b0 con 0x7f53fc0ade50 2024-09-13T18:35:36.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:36.712+0000 7f53fb59e700 1 -- 172.21.15.44:0/4065204277 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f53fc067a90 con 0x7f53fc0ade50 2024-09-13T18:35:37.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.388+0000 7f53f2ffd700 1 -- 172.21.15.44:0/4065204277 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v69) v1 ==== 169+0+0 (secure 0 0 0) 0x7f53ec0200d0 con 0x7f53fc0ade50 2024-09-13T18:35:37.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.392+0000 7f53fb59e700 1 -- 172.21.15.44:0/4065204277 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f53dc066730 msgr2=0x7f53dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.392+0000 7f53fb59e700 1 --2- 172.21.15.44:0/4065204277 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f53dc066730 0x7f53dc068bf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f53fc0cc040 tx=0x7f53e4009240 comp rx=0 tx=0).stop 2024-09-13T18:35:37.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.392+0000 7f53fb59e700 1 -- 172.21.15.44:0/4065204277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53fc0ade50 msgr2=0x7f53fc153f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.392+0000 7f53fb59e700 1 --2- 172.21.15.44:0/4065204277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53fc0ade50 0x7f53fc153f40 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f53ec014040 tx=0x7f53ec004770 comp rx=0 tx=0).stop 2024-09-13T18:35:37.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.396+0000 7f53fb59e700 1 -- 172.21.15.44:0/4065204277 shutdown_connections 2024-09-13T18:35:37.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.396+0000 7f53fb59e700 1 --2- 172.21.15.44:0/4065204277 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f53dc066730 0x7f53dc068bf0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.396+0000 7f53fb59e700 1 --2- 172.21.15.44:0/4065204277 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f53fc15cbe0 0x7f53fc155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.396+0000 7f53fb59e700 1 --2- 172.21.15.44:0/4065204277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53fc0cf1c0 0x7f53fc153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.396+0000 7f53fb59e700 1 --2- 172.21.15.44:0/4065204277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53fc0ade50 0x7f53fc153f40 secure :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f53ec014040 tx=0x7f53ec004770 comp rx=0 tx=0).stop 2024-09-13T18:35:37.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.396+0000 7f53fb59e700 1 -- 172.21.15.44:0/4065204277 >> 172.21.15.44:0/4065204277 conn(0x7f53fc0cf9a0 msgr2=0x7f53fc070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:37.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.396+0000 7f53fb59e700 1 -- 172.21.15.44:0/4065204277 shutdown_connections 2024-09-13T18:35:37.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.396+0000 7f53fb59e700 1 -- 172.21.15.44:0/4065204277 wait complete. 2024-09-13T18:35:37.403 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2024-09-13T18:35:37.419 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:35:37.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.528+0000 7f021a631700 1 Processor -- start 2024-09-13T18:35:37.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.528+0000 7f021a631700 1 -- start start 2024-09-13T18:35:37.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f021a631700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f021406d6f0 0x7f02140ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f021a631700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f02140adbd0 0x7f021415caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f021a631700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021406dad0 con 0x7f021415d030 2024-09-13T18:35:37.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f021a631700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021415d4c0 con 0x7f021406d6f0 2024-09-13T18:35:37.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f021a631700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02140b3850 con 0x7f02140adbd0 2024-09-13T18:35:37.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f021962f700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f021406d6f0 0x7f02140ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f021962f700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f021406d6f0 0x7f02140ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42052/0 (socket says 172.21.15.44:42052) 2024-09-13T18:35:37.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f021962f700 1 -- 172.21.15.44:0/3375061294 learned_addr learned my addr 172.21.15.44:0/3375061294 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:37.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f0218e2e700 1 --2- 172.21.15.44:0/3375061294 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f02140adbd0 0x7f021415caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f021962f700 1 -- 172.21.15.44:0/3375061294 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f02140adbd0 msgr2=0x7f021415caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:37.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f021962f700 1 --2- 172.21.15.44:0/3375061294 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f02140adbd0 0x7f021415caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f021962f700 1 -- 172.21.15.44:0/3375061294 >> v1:172.21.15.99:6789/0 conn(0x7f021415d030 legacy=0x7f02140b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f021962f700 1 -- 172.21.15.44:0/3375061294 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02140ae3c0 con 0x7f021406d6f0 2024-09-13T18:35:37.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f021962f700 1 --2- 172.21.15.44:0/3375061294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f021406d6f0 0x7f02140ce270 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f0210009940 tx=0x7f0210009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a529f6eb377e5789 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:37.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f0207fff700 1 -- 172.21.15.44:0/3375061294 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021000ba20 con 0x7f021406d6f0 2024-09-13T18:35:37.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f0207fff700 1 -- 172.21.15.44:0/3375061294 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0210009e90 con 0x7f021406d6f0 2024-09-13T18:35:37.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f0207fff700 1 -- 172.21.15.44:0/3375061294 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021000bda0 con 0x7f021406d6f0 2024-09-13T18:35:37.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f021a631700 1 -- 172.21.15.44:0/3375061294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f021406d6f0 msgr2=0x7f02140ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f021a631700 1 --2- 172.21.15.44:0/3375061294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f021406d6f0 0x7f02140ce270 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f0210009940 tx=0x7f0210009c50 comp rx=0 tx=0).stop 2024-09-13T18:35:37.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f021a631700 1 -- 172.21.15.44:0/3375061294 shutdown_connections 2024-09-13T18:35:37.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f021a631700 1 --2- 172.21.15.44:0/3375061294 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f02140adbd0 0x7f021415caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f021a631700 1 --2- 172.21.15.44:0/3375061294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f021406d6f0 0x7f02140ce270 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f021a631700 1 -- 172.21.15.44:0/3375061294 >> 172.21.15.44:0/3375061294 conn(0x7f02140b0e10 msgr2=0x7f02140b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:37.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f021a631700 1 -- 172.21.15.44:0/3375061294 shutdown_connections 2024-09-13T18:35:37.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.532+0000 7f021a631700 1 -- 172.21.15.44:0/3375061294 wait complete. 2024-09-13T18:35:37.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.536+0000 7f021a631700 1 Processor -- start 2024-09-13T18:35:37.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.536+0000 7f021a631700 1 -- start start 2024-09-13T18:35:37.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.540+0000 7f021a631700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f021406d6f0 0x7f0214142190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.540+0000 7f021a631700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02140adbd0 0x7f0214142be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.540+0000 7f021a631700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f021415d030 0x7f0214158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.540+0000 7f021a631700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02141426d0 con 0x7f02140adbd0 2024-09-13T18:35:37.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.540+0000 7f021a631700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0214159590 con 0x7f021406d6f0 2024-09-13T18:35:37.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.540+0000 7f021a631700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0214159870 con 0x7f021415d030 2024-09-13T18:35:37.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.540+0000 7f0218e2e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02140adbd0 0x7f0214142be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.540+0000 7f0218e2e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02140adbd0 0x7f0214142be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42058/0 (socket says 172.21.15.44:42058) 2024-09-13T18:35:37.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.540+0000 7f0218e2e700 1 -- 172.21.15.44:0/1985998338 learned_addr learned my addr 172.21.15.44:0/1985998338 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:37.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.540+0000 7f021962f700 1 --2- 172.21.15.44:0/1985998338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f021406d6f0 0x7f0214142190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.540+0000 7f0219e30700 1 --2- 172.21.15.44:0/1985998338 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f021415d030 0x7f0214158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.540+0000 7f0218e2e700 1 -- 172.21.15.44:0/1985998338 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f021415d030 msgr2=0x7f0214158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.540+0000 7f0218e2e700 1 --2- 172.21.15.44:0/1985998338 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f021415d030 0x7f0214158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.540+0000 7f0218e2e700 1 -- 172.21.15.44:0/1985998338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f021406d6f0 msgr2=0x7f0214142190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.540+0000 7f0218e2e700 1 --2- 172.21.15.44:0/1985998338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f021406d6f0 0x7f0214142190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.540+0000 7f0218e2e700 1 -- 172.21.15.44:0/1985998338 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0210009570 con 0x7f02140adbd0 2024-09-13T18:35:37.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.540+0000 7f0218e2e700 1 --2- 172.21.15.44:0/1985998338 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02140adbd0 0x7f0214142be0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f0208007ef0 tx=0x7f020800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:37.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.540+0000 7f0205ffb700 1 -- 172.21.15.44:0/1985998338 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020800edf0 con 0x7f02140adbd0 2024-09-13T18:35:37.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.540+0000 7f0205ffb700 1 -- 172.21.15.44:0/1985998338 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0208014420 con 0x7f02140adbd0 2024-09-13T18:35:37.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.540+0000 7f021a631700 1 -- 172.21.15.44:0/1985998338 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0214159b50 con 0x7f02140adbd0 2024-09-13T18:35:37.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.540+0000 7f0205ffb700 1 -- 172.21.15.44:0/1985998338 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02080147d0 con 0x7f02140adbd0 2024-09-13T18:35:37.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.540+0000 7f021a631700 1 -- 172.21.15.44:0/1985998338 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021415a110 con 0x7f02140adbd0 2024-09-13T18:35:37.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.540+0000 7f0205ffb700 1 -- 172.21.15.44:0/1985998338 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0208014930 con 0x7f02140adbd0 2024-09-13T18:35:37.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.544+0000 7f021a631700 1 -- 172.21.15.44:0/1985998338 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0214071370 con 0x7f02140adbd0 2024-09-13T18:35:37.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.544+0000 7f0205ffb700 1 --2- 172.21.15.44:0/1985998338 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f01f8066760 0x7f01f8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.544+0000 7f0205ffb700 1 -- 172.21.15.44:0/1985998338 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5201+0+0 (secure 0 0 0) 0x7f0208084720 con 0x7f02140adbd0 2024-09-13T18:35:37.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.544+0000 7f021962f700 1 --2- 172.21.15.44:0/1985998338 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f01f8066760 0x7f01f8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.544+0000 7f021962f700 1 --2- 172.21.15.44:0/1985998338 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f01f8066760 0x7f01f8068c20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0210000c00 tx=0x7f0210008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:37.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.552+0000 7f0205ffb700 1 -- 172.21.15.44:0/1985998338 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0208051c00 con 0x7f02140adbd0 2024-09-13T18:35:37.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.720+0000 7f021a631700 1 -- 172.21.15.44:0/1985998338 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0214157e40 con 0x7f02140adbd0 2024-09-13T18:35:37.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.728+0000 7f0205ffb700 1 -- 172.21.15.44:0/1985998338 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0208055220 con 0x7f02140adbd0 2024-09-13T18:35:37.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.728+0000 7f021a631700 1 -- 172.21.15.44:0/1985998338 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f01f8066760 msgr2=0x7f01f8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.728+0000 7f021a631700 1 --2- 172.21.15.44:0/1985998338 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f01f8066760 0x7f01f8068c20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0210000c00 tx=0x7f0210008030 comp rx=0 tx=0).stop 2024-09-13T18:35:37.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.728+0000 7f021a631700 1 -- 172.21.15.44:0/1985998338 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02140adbd0 msgr2=0x7f0214142be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.728+0000 7f021a631700 1 --2- 172.21.15.44:0/1985998338 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02140adbd0 0x7f0214142be0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f0208007ef0 tx=0x7f020800e3c0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.728+0000 7f021a631700 1 -- 172.21.15.44:0/1985998338 shutdown_connections 2024-09-13T18:35:37.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.728+0000 7f021a631700 1 --2- 172.21.15.44:0/1985998338 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f01f8066760 0x7f01f8068c20 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.728+0000 7f021a631700 1 --2- 172.21.15.44:0/1985998338 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f021415d030 0x7f0214158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.728+0000 7f021a631700 1 --2- 172.21.15.44:0/1985998338 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02140adbd0 0x7f0214142be0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.728+0000 7f021a631700 1 --2- 172.21.15.44:0/1985998338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f021406d6f0 0x7f0214142190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.728+0000 7f021a631700 1 -- 172.21.15.44:0/1985998338 >> 172.21.15.44:0/1985998338 conn(0x7f02140b0e10 msgr2=0x7f021406fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:37.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.728+0000 7f021a631700 1 -- 172.21.15.44:0/1985998338 shutdown_connections 2024-09-13T18:35:37.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.728+0000 7f021a631700 1 -- 172.21.15.44:0/1985998338 wait complete. 2024-09-13T18:35:37.748 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_reset' 2024-09-13T18:35:37.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.856+0000 7f04508f7700 1 Processor -- start 2024-09-13T18:35:37.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.856+0000 7f04508f7700 1 -- start start 2024-09-13T18:35:37.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.856+0000 7f04508f7700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f044c160eb0 0x7f044c165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.856+0000 7f04508f7700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f044c071f30 con 0x7f044c1619a0 2024-09-13T18:35:37.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.856+0000 7f04508f7700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f044c1622e0 con 0x7f044c0b33d0 2024-09-13T18:35:37.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.856+0000 7f04508f7700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f044c161df0 con 0x7f044c160eb0 2024-09-13T18:35:37.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.856+0000 7f044b59e700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f044c1619a0 0x7f044c0cb820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44398/0 (socket says 172.21.15.44:44398) 2024-09-13T18:35:37.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.856+0000 7f044b59e700 1 -- 172.21.15.44:0/3528311730 learned_addr learned my addr 172.21.15.44:0/3528311730 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:37.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.856+0000 7f044ad9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f044c160eb0 0x7f044c165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.856+0000 7f0449d9b700 1 -- 172.21.15.44:0/3528311730 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1806705595 0 0) 0x7f044c071f30 con 0x7f044c1619a0 2024-09-13T18:35:37.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.856+0000 7f0449d9b700 1 -- 172.21.15.44:0/3528311730 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04380035d0 con 0x7f044c1619a0 2024-09-13T18:35:37.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.856+0000 7f044ad9d700 1 -- 172.21.15.44:0/3528311730 >> v1:172.21.15.99:6789/0 conn(0x7f044c0b33d0 legacy=0x7f044c161290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.856+0000 7f044ad9d700 1 -- 172.21.15.44:0/3528311730 >> v1:172.21.15.44:6789/0 conn(0x7f044c1619a0 legacy=0x7f044c0cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.856+0000 7f044ad9d700 1 -- 172.21.15.44:0/3528311730 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044c162000 con 0x7f044c160eb0 2024-09-13T18:35:37.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.856+0000 7f044ad9d700 1 --2- 172.21.15.44:0/3528311730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f044c160eb0 0x7f044c165590 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f043c009850 tx=0x7f043c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b0ba437c691d43 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:37.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.856+0000 7f0449d9b700 1 -- 172.21.15.44:0/3528311730 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c011830 con 0x7f044c160eb0 2024-09-13T18:35:37.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.856+0000 7f0449d9b700 1 -- 172.21.15.44:0/3528311730 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043c011990 con 0x7f044c160eb0 2024-09-13T18:35:37.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.856+0000 7f0449d9b700 1 -- 172.21.15.44:0/3528311730 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c011d00 con 0x7f044c160eb0 2024-09-13T18:35:37.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f04508f7700 1 -- 172.21.15.44:0/3528311730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f044c160eb0 msgr2=0x7f044c165590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f04508f7700 1 --2- 172.21.15.44:0/3528311730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f044c160eb0 0x7f044c165590 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f043c009850 tx=0x7f043c009b60 comp rx=0 tx=0).stop 2024-09-13T18:35:37.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f04508f7700 1 -- 172.21.15.44:0/3528311730 shutdown_connections 2024-09-13T18:35:37.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f04508f7700 1 --2- 172.21.15.44:0/3528311730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f044c160eb0 0x7f044c165590 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f04508f7700 1 -- 172.21.15.44:0/3528311730 >> 172.21.15.44:0/3528311730 conn(0x7f044c0b0f00 msgr2=0x7f044c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:37.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f04508f7700 1 -- 172.21.15.44:0/3528311730 shutdown_connections 2024-09-13T18:35:37.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f04508f7700 1 -- 172.21.15.44:0/3528311730 wait complete. 2024-09-13T18:35:37.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f04508f7700 1 Processor -- start 2024-09-13T18:35:37.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f04508f7700 1 -- start start 2024-09-13T18:35:37.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f04508f7700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f044c0b33d0 0x7f044c1fa250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f04508f7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f044c160eb0 0x7f044c0adc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f04508f7700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f044c1619a0 0x7f044c1f75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f04508f7700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044c1fab30 con 0x7f044c160eb0 2024-09-13T18:35:37.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f04508f7700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044c1fae10 con 0x7f044c1619a0 2024-09-13T18:35:37.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f04508f7700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044c1fb0f0 con 0x7f044c0b33d0 2024-09-13T18:35:37.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f044a59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f044c160eb0 0x7f044c0adc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f044a59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f044c160eb0 0x7f044c0adc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42074/0 (socket says 172.21.15.44:42074) 2024-09-13T18:35:37.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f044a59c700 1 -- 172.21.15.44:0/3282952314 learned_addr learned my addr 172.21.15.44:0/3282952314 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:37.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f044ad9d700 1 --2- 172.21.15.44:0/3282952314 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f044c0b33d0 0x7f044c1fa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f044b59e700 1 --2- 172.21.15.44:0/3282952314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f044c1619a0 0x7f044c1f75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f044a59c700 1 -- 172.21.15.44:0/3282952314 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f044c0b33d0 msgr2=0x7f044c1fa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f044a59c700 1 --2- 172.21.15.44:0/3282952314 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f044c0b33d0 0x7f044c1fa250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f044a59c700 1 -- 172.21.15.44:0/3282952314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f044c1619a0 msgr2=0x7f044c1f75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f044a59c700 1 --2- 172.21.15.44:0/3282952314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f044c1619a0 0x7f044c1f75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f044a59c700 1 -- 172.21.15.44:0/3282952314 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c0094b0 con 0x7f044c160eb0 2024-09-13T18:35:37.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f044b59e700 1 --2- 172.21.15.44:0/3282952314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f044c1619a0 0x7f044c1f75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:37.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f044a59c700 1 --2- 172.21.15.44:0/3282952314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f044c160eb0 0x7f044c0adc50 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f043400cc20 tx=0x7f043400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:37.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f04437fe700 1 -- 172.21.15.44:0/3282952314 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0434003c20 con 0x7f044c160eb0 2024-09-13T18:35:37.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f04437fe700 1 -- 172.21.15.44:0/3282952314 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0434003da0 con 0x7f044c160eb0 2024-09-13T18:35:37.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f04437fe700 1 -- 172.21.15.44:0/3282952314 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043400ac60 con 0x7f044c160eb0 2024-09-13T18:35:37.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f04508f7700 1 -- 172.21.15.44:0/3282952314 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f044c1f6df0 con 0x7f044c160eb0 2024-09-13T18:35:37.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.860+0000 7f04508f7700 1 -- 172.21.15.44:0/3282952314 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044c1fa790 con 0x7f044c160eb0 2024-09-13T18:35:37.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.864+0000 7f04508f7700 1 -- 172.21.15.44:0/3282952314 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f044c0721f0 con 0x7f044c160eb0 2024-09-13T18:35:37.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.864+0000 7f04437fe700 1 -- 172.21.15.44:0/3282952314 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f04340050d0 con 0x7f044c160eb0 2024-09-13T18:35:37.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.864+0000 7f04437fe700 1 --2- 172.21.15.44:0/3282952314 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f042c066730 0x7f042c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.864+0000 7f04437fe700 1 -- 172.21.15.44:0/3282952314 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5201+0+0 (secure 0 0 0) 0x7f0434084080 con 0x7f044c160eb0 2024-09-13T18:35:37.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.864+0000 7f044ad9d700 1 --2- 172.21.15.44:0/3282952314 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f042c066730 0x7f042c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.864+0000 7f044ad9d700 1 --2- 172.21.15.44:0/3282952314 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f042c066730 0x7f042c068bf0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f043c0090b0 tx=0x7f043c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:37.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:37.872+0000 7f04437fe700 1 -- 172.21.15.44:0/3282952314 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f04340515e0 con 0x7f044c160eb0 2024-09-13T18:35:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.100+0000 7f04508f7700 1 -- 172.21.15.44:0/3282952314 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_reset"]} v 0) v1 -- 0x7f044c0b3bf0 con 0x7f044c160eb0 2024-09-13T18:35:38.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.392+0000 7f04437fe700 1 -- 172.21.15.44:0/3282952314 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_reset"]}]=0 v373) v1 ==== 140+0+0 (secure 0 0 0) 0x7f0434054c00 con 0x7f044c160eb0 2024-09-13T18:35:38.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.396+0000 7f04508f7700 1 -- 172.21.15.44:0/3282952314 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f042c066730 msgr2=0x7f042c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:38.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.396+0000 7f04508f7700 1 --2- 172.21.15.44:0/3282952314 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f042c066730 0x7f042c068bf0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f043c0090b0 tx=0x7f043c008030 comp rx=0 tx=0).stop 2024-09-13T18:35:38.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.396+0000 7f04508f7700 1 -- 172.21.15.44:0/3282952314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f044c160eb0 msgr2=0x7f044c0adc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:38.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.396+0000 7f04508f7700 1 --2- 172.21.15.44:0/3282952314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f044c160eb0 0x7f044c0adc50 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f043400cc20 tx=0x7f043400a060 comp rx=0 tx=0).stop 2024-09-13T18:35:38.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.396+0000 7f04508f7700 1 -- 172.21.15.44:0/3282952314 shutdown_connections 2024-09-13T18:35:38.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.396+0000 7f04508f7700 1 --2- 172.21.15.44:0/3282952314 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f042c066730 0x7f042c068bf0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.396+0000 7f04508f7700 1 --2- 172.21.15.44:0/3282952314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f044c1619a0 0x7f044c1f75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.396+0000 7f04508f7700 1 --2- 172.21.15.44:0/3282952314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f044c160eb0 0x7f044c0adc50 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.396+0000 7f04508f7700 1 --2- 172.21.15.44:0/3282952314 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f044c0b33d0 0x7f044c1fa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.396+0000 7f04508f7700 1 -- 172.21.15.44:0/3282952314 >> 172.21.15.44:0/3282952314 conn(0x7f044c0b0f00 msgr2=0x7f044c0af040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:38.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.396+0000 7f04508f7700 1 -- 172.21.15.44:0/3282952314 shutdown_connections 2024-09-13T18:35:38.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.396+0000 7f04508f7700 1 -- 172.21.15.44:0/3282952314 wait complete. 2024-09-13T18:35:38.422 INFO:tasks.cephfs_test_runner:That after forcibly modifying the backing store, we can get back into ... ok 2024-09-13T18:35:38.422 INFO:tasks.cephfs_test_runner:Starting test: test_table_tool (tasks.cephfs.test_journal_repair.TestJournalRepair) 2024-09-13T18:35:38.422 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:38.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb646891700 1 Processor -- start 2024-09-13T18:35:38.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb646891700 1 -- start start 2024-09-13T18:35:38.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb646891700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb64015b890 0x7fb640162220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb646891700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb6400b2b00 0x7fb64006ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb646891700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb640162760 con 0x7fb6400cdcc0 2024-09-13T18:35:38.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb646891700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64015bc70 con 0x7fb64015b890 2024-09-13T18:35:38.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb646891700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6400ccc20 con 0x7fb6400b2b00 2024-09-13T18:35:38.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb63f7fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb6400cdcc0 0x7fb6400b23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44400/0 (socket says 172.21.15.44:44400) 2024-09-13T18:35:38.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb63f7fe700 1 -- 172.21.15.44:0/549040404 learned_addr learned my addr 172.21.15.44:0/549040404 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:38.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb644e2e700 1 --2- 172.21.15.44:0/549040404 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb6400b2b00 0x7fb64006ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb63ffff700 1 --2- 172.21.15.44:0/549040404 >> v2:172.21.15.99:3300/0 conn(0x7fb64015b890 0x7fb640162220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb63effd700 1 -- 172.21.15.44:0/549040404 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69561631 0 0) 0x7fb640162760 con 0x7fb6400cdcc0 2024-09-13T18:35:38.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb63effd700 1 -- 172.21.15.44:0/549040404 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb62c0035d0 con 0x7fb6400cdcc0 2024-09-13T18:35:38.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb63effd700 1 -- 172.21.15.44:0/549040404 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4083641730 0 0) 0x7fb62c0035d0 con 0x7fb6400cdcc0 2024-09-13T18:35:38.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb63effd700 1 -- 172.21.15.44:0/549040404 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb6400b2b00 msgr2=0x7fb64006ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:38.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb63effd700 1 --2- 172.21.15.44:0/549040404 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb6400b2b00 0x7fb64006ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb63effd700 1 -- 172.21.15.44:0/549040404 >> v2:172.21.15.99:3300/0 conn(0x7fb64015b890 msgr2=0x7fb640162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:38.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb63effd700 1 --2- 172.21.15.44:0/549040404 >> v2:172.21.15.99:3300/0 conn(0x7fb64015b890 0x7fb640162220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb63effd700 1 -- 172.21.15.44:0/549040404 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6400ccf00 con 0x7fb6400cdcc0 2024-09-13T18:35:38.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb63effd700 1 -- 172.21.15.44:0/549040404 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7fb6300019f0 con 0x7fb6400cdcc0 2024-09-13T18:35:38.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb63effd700 1 -- 172.21.15.44:0/549040404 >> v1:172.21.15.44:6789/0 conn(0x7fb6400cdcc0 legacy=0x7fb6400b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:38.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb63effd700 1 --2- 172.21.15.44:0/549040404 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb6400b2b00 0x7fb62c003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb63effd700 1 --2- 172.21.15.44:0/549040404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb62c003fa0 0x7fb62c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb63effd700 1 --2- 172.21.15.44:0/549040404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb62c004db0 0x7fb62c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb63effd700 1 -- 172.21.15.44:0/549040404 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64015bc70 con 0x7fb62c003fa0 2024-09-13T18:35:38.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb63effd700 1 -- 172.21.15.44:0/549040404 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6400ccc20 con 0x7fb62c004db0 2024-09-13T18:35:38.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb63effd700 1 -- 172.21.15.44:0/549040404 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c00ba80 con 0x7fb6400b2b00 2024-09-13T18:35:38.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb63f7fe700 1 --2- 172.21.15.44:0/549040404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb62c003fa0 0x7fb62c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.540+0000 7fb644e2e700 1 --2- 172.21.15.44:0/549040404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb62c004db0 0x7fb62c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.544+0000 7fb63ffff700 1 --2- 172.21.15.44:0/549040404 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb6400b2b00 0x7fb62c003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.544+0000 7fb63f7fe700 1 -- 172.21.15.44:0/549040404 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb6400b2b00 msgr2=0x7fb62c003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:38.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.544+0000 7fb63f7fe700 1 --2- 172.21.15.44:0/549040404 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb6400b2b00 0x7fb62c003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.544+0000 7fb63f7fe700 1 -- 172.21.15.44:0/549040404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb62c004db0 msgr2=0x7fb62c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:38.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.544+0000 7fb63f7fe700 1 --2- 172.21.15.44:0/549040404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb62c004db0 0x7fb62c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.544+0000 7fb63f7fe700 1 -- 172.21.15.44:0/549040404 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c0035d0 con 0x7fb62c003fa0 2024-09-13T18:35:38.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.544+0000 7fb63f7fe700 1 --2- 172.21.15.44:0/549040404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb62c003fa0 0x7fb62c004870 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fb63000a890 tx=0x7fb62c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe83d51f08301ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:38.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.544+0000 7fb63effd700 1 -- 172.21.15.44:0/549040404 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6300072d0 con 0x7fb62c003fa0 2024-09-13T18:35:38.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.544+0000 7fb63effd700 1 -- 172.21.15.44:0/549040404 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb630007430 con 0x7fb62c003fa0 2024-09-13T18:35:38.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.544+0000 7fb63effd700 1 -- 172.21.15.44:0/549040404 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6300077e0 con 0x7fb62c003fa0 2024-09-13T18:35:38.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.544+0000 7fb646891700 1 -- 172.21.15.44:0/549040404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb62c003fa0 msgr2=0x7fb62c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:38.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.544+0000 7fb646891700 1 --2- 172.21.15.44:0/549040404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb62c003fa0 0x7fb62c004870 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fb63000a890 tx=0x7fb62c0058a0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.544+0000 7fb644e2e700 1 -- 172.21.15.44:0/549040404 reap_dead start 2024-09-13T18:35:38.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.544+0000 7fb646891700 1 -- 172.21.15.44:0/549040404 shutdown_connections 2024-09-13T18:35:38.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.544+0000 7fb646891700 1 -- 172.21.15.44:0/549040404 >> 172.21.15.44:0/549040404 conn(0x7fb6400ce980 msgr2=0x7fb6400ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:38.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.544+0000 7fb646891700 1 -- 172.21.15.44:0/549040404 shutdown_connections 2024-09-13T18:35:38.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.544+0000 7fb646891700 1 -- 172.21.15.44:0/549040404 wait complete. 2024-09-13T18:35:38.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.548+0000 7fb646891700 1 Processor -- start 2024-09-13T18:35:38.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.548+0000 7fb646891700 1 -- start start 2024-09-13T18:35:38.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.548+0000 7fb646891700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb62c003fa0 0x7fb64006b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.548+0000 7fb646891700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb64006be20 0x7fb64014fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.548+0000 7fb646891700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb640156260 0x7fb640156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.548+0000 7fb646891700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb640156c50 con 0x7fb62c003fa0 2024-09-13T18:35:38.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.548+0000 7fb646891700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64006b570 con 0x7fb64006be20 2024-09-13T18:35:38.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.548+0000 7fb646891700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64006cf10 con 0x7fb640156260 2024-09-13T18:35:38.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.548+0000 7fb63ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb62c003fa0 0x7fb64006b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.548+0000 7fb63ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb62c003fa0 0x7fb64006b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42096/0 (socket says 172.21.15.44:42096) 2024-09-13T18:35:38.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.548+0000 7fb63ffff700 1 -- 172.21.15.44:0/1158872426 learned_addr learned my addr 172.21.15.44:0/1158872426 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:38.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.548+0000 7fb63f7fe700 1 --2- 172.21.15.44:0/1158872426 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb64006be20 0x7fb64014fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.548+0000 7fb644e2e700 1 --2- 172.21.15.44:0/1158872426 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb640156260 0x7fb640156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.548+0000 7fb63ffff700 1 -- 172.21.15.44:0/1158872426 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb640156260 msgr2=0x7fb640156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:38.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.548+0000 7fb63ffff700 1 --2- 172.21.15.44:0/1158872426 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb640156260 0x7fb640156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.548+0000 7fb63ffff700 1 -- 172.21.15.44:0/1158872426 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb64006be20 msgr2=0x7fb64014fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:38.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.548+0000 7fb63ffff700 1 --2- 172.21.15.44:0/1158872426 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb64006be20 0x7fb64014fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.548+0000 7fb63ffff700 1 -- 172.21.15.44:0/1158872426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb640164230 con 0x7fb62c003fa0 2024-09-13T18:35:38.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.552+0000 7fb63ffff700 1 --2- 172.21.15.44:0/1158872426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb62c003fa0 0x7fb64006b030 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fb6280116f0 tx=0x7fb628011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:38.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.552+0000 7fb63cff9700 1 -- 172.21.15.44:0/1158872426 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb628015870 con 0x7fb62c003fa0 2024-09-13T18:35:38.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.552+0000 7fb63cff9700 1 -- 172.21.15.44:0/1158872426 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6280159d0 con 0x7fb62c003fa0 2024-09-13T18:35:38.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.552+0000 7fb646891700 1 -- 172.21.15.44:0/1158872426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb64006c300 con 0x7fb62c003fa0 2024-09-13T18:35:38.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.552+0000 7fb63cff9700 1 -- 172.21.15.44:0/1158872426 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb628015d40 con 0x7fb62c003fa0 2024-09-13T18:35:38.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.552+0000 7fb646891700 1 -- 172.21.15.44:0/1158872426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb64006c8c0 con 0x7fb62c003fa0 2024-09-13T18:35:38.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.552+0000 7fb646891700 1 -- 172.21.15.44:0/1158872426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6400ce120 con 0x7fb62c003fa0 2024-09-13T18:35:38.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.552+0000 7fb63cff9700 1 -- 172.21.15.44:0/1158872426 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb6280143e0 con 0x7fb62c003fa0 2024-09-13T18:35:38.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.552+0000 7fb63cff9700 1 --2- 172.21.15.44:0/1158872426 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb620066730 0x7fb620068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.552+0000 7fb63cff9700 1 -- 172.21.15.44:0/1158872426 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5201+0+0 (secure 0 0 0) 0x7fb628084640 con 0x7fb62c003fa0 2024-09-13T18:35:38.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.552+0000 7fb63f7fe700 1 --2- 172.21.15.44:0/1158872426 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb620066730 0x7fb620068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.556+0000 7fb63f7fe700 1 --2- 172.21.15.44:0/1158872426 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb620066730 0x7fb620068bf0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb630000f80 tx=0x7fb630009070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:38.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.560+0000 7fb63cff9700 1 -- 172.21.15.44:0/1158872426 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb628051c30 con 0x7fb62c003fa0 2024-09-13T18:35:38.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.744+0000 7fb646891700 1 -- 172.21.15.44:0/1158872426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb640150050 con 0x7fb62c003fa0 2024-09-13T18:35:38.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.744+0000 7fb63cff9700 1 -- 172.21.15.44:0/1158872426 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+13316 (secure 0 0 0) 0x7fb628055250 con 0x7fb62c003fa0 2024-09-13T18:35:38.750 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:38.750 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":69,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:35:37.378590+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:6836/1121392581":"2024-09-14T18:35:34.098969+0000","172.21.15.99:6837/1121392581":"2024-09-14T18:35:34.098969+0000","172.21.15.99:6836/3072614790":"2024-09-14T18:35:19.260455+0000","172.21.15.99:6837/3072614790":"2024-09-14T18:35:19.260455+0000","172.21.15.44:6835/1074184606":"2024-09-14T18:35:18.166304+0000","172.21.15.44:6833/1074184606":"2024-09-14T18:35:18.166304+0000","172.21.15.44:6835/1608555972":"2024-09-14T18:34:13.117246+0000","172.21.15.44:6833/1608555972":"2024-09-14T18:34:13.117246+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:38.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.748+0000 7fb646891700 1 -- 172.21.15.44:0/1158872426 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb620066730 msgr2=0x7fb620068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:38.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.748+0000 7fb646891700 1 --2- 172.21.15.44:0/1158872426 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb620066730 0x7fb620068bf0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb630000f80 tx=0x7fb630009070 comp rx=0 tx=0).stop 2024-09-13T18:35:38.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.748+0000 7fb646891700 1 -- 172.21.15.44:0/1158872426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb62c003fa0 msgr2=0x7fb64006b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:38.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.748+0000 7fb646891700 1 --2- 172.21.15.44:0/1158872426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb62c003fa0 0x7fb64006b030 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fb6280116f0 tx=0x7fb628011a00 comp rx=0 tx=0).stop 2024-09-13T18:35:38.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.748+0000 7fb646891700 1 -- 172.21.15.44:0/1158872426 shutdown_connections 2024-09-13T18:35:38.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.748+0000 7fb646891700 1 --2- 172.21.15.44:0/1158872426 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb620066730 0x7fb620068bf0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.748+0000 7fb646891700 1 --2- 172.21.15.44:0/1158872426 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb640156260 0x7fb640156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.748+0000 7fb646891700 1 --2- 172.21.15.44:0/1158872426 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb64006be20 0x7fb64014fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.748+0000 7fb646891700 1 --2- 172.21.15.44:0/1158872426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb62c003fa0 0x7fb64006b030 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.748+0000 7fb646891700 1 -- 172.21.15.44:0/1158872426 >> 172.21.15.44:0/1158872426 conn(0x7fb6400ce980 msgr2=0x7fb640071660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:38.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.748+0000 7fb646891700 1 -- 172.21.15.44:0/1158872426 shutdown_connections 2024-09-13T18:35:38.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.748+0000 7fb646891700 1 -- 172.21.15.44:0/1158872426 wait complete. 2024-09-13T18:35:38.770 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:35:38.770 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:35:38.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.884+0000 7faebdb0d700 1 Processor -- start 2024-09-13T18:35:38.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.884+0000 7faebdb0d700 1 -- start start 2024-09-13T18:35:38.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faebdb0d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7faeb815cda0 0x7faeb806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faebdb0d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faeb80ceb70 0x7faeb80b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faebdb0d700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb80b8430 con 0x7faeb806a520 2024-09-13T18:35:38.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faebdb0d700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb806be40 con 0x7faeb815cda0 2024-09-13T18:35:38.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faebdb0d700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80cf350 con 0x7faeb80ceb70 2024-09-13T18:35:38.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faebcb0b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7faeb815cda0 0x7faeb806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faebcb0b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7faeb815cda0 0x7faeb806b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42108/0 (socket says 172.21.15.44:42108) 2024-09-13T18:35:38.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faebcb0b700 1 -- 172.21.15.44:0/2918765631 learned_addr learned my addr 172.21.15.44:0/2918765631 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:38.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faeaffff700 1 --2- 172.21.15.44:0/2918765631 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faeb80ceb70 0x7faeb80b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faebcb0b700 1 -- 172.21.15.44:0/2918765631 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faeb80ceb70 msgr2=0x7faeb80b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:38.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faebcb0b700 1 --2- 172.21.15.44:0/2918765631 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faeb80ceb70 0x7faeb80b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faebcb0b700 1 -- 172.21.15.44:0/2918765631 >> v1:172.21.15.99:6789/0 conn(0x7faeb806a520 legacy=0x7faeb80d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:38.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faeaf7fe700 1 -- 172.21.15.44:0/2918765631 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147615560 0 0) 0x7faeb80b8430 con 0x7faeb806a520 2024-09-13T18:35:38.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faebcb0b700 1 -- 172.21.15.44:0/2918765631 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb80d0880 con 0x7faeb815cda0 2024-09-13T18:35:38.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faebcb0b700 1 --2- 172.21.15.44:0/2918765631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faeb815cda0 0x7faeb806b900 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009910 tx=0x7faeb4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4c8ce4983c0615 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:38.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faeaf7fe700 1 -- 172.21.15.44:0/2918765631 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4011830 con 0x7faeb815cda0 2024-09-13T18:35:38.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faeaf7fe700 1 -- 172.21.15.44:0/2918765631 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb4011990 con 0x7faeb815cda0 2024-09-13T18:35:38.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faeaf7fe700 1 -- 172.21.15.44:0/2918765631 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4011d40 con 0x7faeb815cda0 2024-09-13T18:35:38.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faebdb0d700 1 -- 172.21.15.44:0/2918765631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faeb815cda0 msgr2=0x7faeb806b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:38.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faebdb0d700 1 --2- 172.21.15.44:0/2918765631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faeb815cda0 0x7faeb806b900 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009910 tx=0x7faeb4009c20 comp rx=0 tx=0).stop 2024-09-13T18:35:38.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faebdb0d700 1 -- 172.21.15.44:0/2918765631 shutdown_connections 2024-09-13T18:35:38.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faebdb0d700 1 --2- 172.21.15.44:0/2918765631 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faeb80ceb70 0x7faeb80b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faebdb0d700 1 --2- 172.21.15.44:0/2918765631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faeb815cda0 0x7faeb806b900 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faebdb0d700 1 -- 172.21.15.44:0/2918765631 >> 172.21.15.44:0/2918765631 conn(0x7faeb80d2cb0 msgr2=0x7faeb80d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:38.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faebdb0d700 1 -- 172.21.15.44:0/2918765631 shutdown_connections 2024-09-13T18:35:38.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.888+0000 7faebdb0d700 1 -- 172.21.15.44:0/2918765631 wait complete. 2024-09-13T18:35:38.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faebdb0d700 1 Processor -- start 2024-09-13T18:35:38.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faebdb0d700 1 -- start start 2024-09-13T18:35:38.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faebdb0d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faeb806a520 0x7faeb8150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faebdb0d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faeb80ceb70 0x7faeb8158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faebdb0d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faeb815cda0 0x7faeb8155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faebdb0d700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80c8f50 con 0x7faeb806a520 2024-09-13T18:35:38.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faebdb0d700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80c8340 con 0x7faeb815cda0 2024-09-13T18:35:38.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faebdb0d700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80c8620 con 0x7faeb80ceb70 2024-09-13T18:35:38.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faebcb0b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faeb806a520 0x7faeb8150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faebcb0b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faeb806a520 0x7faeb8150b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42122/0 (socket says 172.21.15.44:42122) 2024-09-13T18:35:38.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faebcb0b700 1 -- 172.21.15.44:0/767040581 learned_addr learned my addr 172.21.15.44:0/767040581 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:38.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faeaffff700 1 --2- 172.21.15.44:0/767040581 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faeb80ceb70 0x7faeb8158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faebd30c700 1 --2- 172.21.15.44:0/767040581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faeb815cda0 0x7faeb8155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faebcb0b700 1 -- 172.21.15.44:0/767040581 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faeb80ceb70 msgr2=0x7faeb8158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:38.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faebcb0b700 1 --2- 172.21.15.44:0/767040581 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faeb80ceb70 0x7faeb8158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faebcb0b700 1 -- 172.21.15.44:0/767040581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faeb815cda0 msgr2=0x7faeb8155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:38.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faebcb0b700 1 --2- 172.21.15.44:0/767040581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faeb815cda0 0x7faeb8155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faebcb0b700 1 -- 172.21.15.44:0/767040581 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb4009570 con 0x7faeb806a520 2024-09-13T18:35:38.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faebcb0b700 1 --2- 172.21.15.44:0/767040581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faeb806a520 0x7faeb8150b30 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7faeb4014040 tx=0x7faeb4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:38.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faead7fa700 1 -- 172.21.15.44:0/767040581 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb401a8f0 con 0x7faeb806a520 2024-09-13T18:35:38.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faead7fa700 1 -- 172.21.15.44:0/767040581 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb401e070 con 0x7faeb806a520 2024-09-13T18:35:38.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faebdb0d700 1 -- 172.21.15.44:0/767040581 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb80c8900 con 0x7faeb806a520 2024-09-13T18:35:38.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faead7fa700 1 -- 172.21.15.44:0/767040581 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb401acb0 con 0x7faeb806a520 2024-09-13T18:35:38.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.892+0000 7faebdb0d700 1 -- 172.21.15.44:0/767040581 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb8151070 con 0x7faeb806a520 2024-09-13T18:35:38.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.896+0000 7faebdb0d700 1 -- 172.21.15.44:0/767040581 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb806b900 con 0x7faeb806a520 2024-09-13T18:35:38.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.896+0000 7faead7fa700 1 -- 172.21.15.44:0/767040581 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faeb402d450 con 0x7faeb806a520 2024-09-13T18:35:38.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.896+0000 7faead7fa700 1 --2- 172.21.15.44:0/767040581 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faea4066760 0x7faea4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.896+0000 7faead7fa700 1 -- 172.21.15.44:0/767040581 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5201+0+0 (secure 0 0 0) 0x7faeb4084e70 con 0x7faeb806a520 2024-09-13T18:35:38.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.896+0000 7faeaffff700 1 --2- 172.21.15.44:0/767040581 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faea4066760 0x7faea4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.900+0000 7faeaffff700 1 --2- 172.21.15.44:0/767040581 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faea4066760 0x7faea4068c20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7faeb81f5e10 tx=0x7faea8009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:38.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:38.904+0000 7faead7fa700 1 -- 172.21.15.44:0/767040581 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faeb40523e0 con 0x7faeb806a520 2024-09-13T18:35:39.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.088+0000 7faebdb0d700 1 -- 172.21.15.44:0/767040581 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faeb815bcf0 con 0x7faeb806a520 2024-09-13T18:35:39.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.088+0000 7faead7fa700 1 -- 172.21.15.44:0/767040581 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7faeb4006da0 con 0x7faeb806a520 2024-09-13T18:35:39.096 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:35:39.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.092+0000 7faebdb0d700 1 -- 172.21.15.44:0/767040581 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faea4066760 msgr2=0x7faea4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:39.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.092+0000 7faebdb0d700 1 --2- 172.21.15.44:0/767040581 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faea4066760 0x7faea4068c20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7faeb81f5e10 tx=0x7faea8009240 comp rx=0 tx=0).stop 2024-09-13T18:35:39.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.092+0000 7faebdb0d700 1 -- 172.21.15.44:0/767040581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faeb806a520 msgr2=0x7faeb8150b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:39.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.092+0000 7faebdb0d700 1 --2- 172.21.15.44:0/767040581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faeb806a520 0x7faeb8150b30 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7faeb4014040 tx=0x7faeb4004770 comp rx=0 tx=0).stop 2024-09-13T18:35:39.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.092+0000 7faebdb0d700 1 -- 172.21.15.44:0/767040581 shutdown_connections 2024-09-13T18:35:39.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.092+0000 7faebdb0d700 1 --2- 172.21.15.44:0/767040581 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faea4066760 0x7faea4068c20 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:39.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.092+0000 7faebdb0d700 1 --2- 172.21.15.44:0/767040581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faeb815cda0 0x7faeb8155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:39.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.092+0000 7faebdb0d700 1 --2- 172.21.15.44:0/767040581 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faeb80ceb70 0x7faeb8158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:39.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.092+0000 7faebdb0d700 1 --2- 172.21.15.44:0/767040581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faeb806a520 0x7faeb8150b30 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:39.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.092+0000 7faebdb0d700 1 -- 172.21.15.44:0/767040581 >> 172.21.15.44:0/767040581 conn(0x7faeb80d2cb0 msgr2=0x7faeb80b5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:39.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.092+0000 7faebdb0d700 1 -- 172.21.15.44:0/767040581 shutdown_connections 2024-09-13T18:35:39.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.092+0000 7faebdb0d700 1 -- 172.21.15.44:0/767040581 wait complete. 2024-09-13T18:35:39.111 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool' 2024-09-13T18:35:39.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c7fff700 1 Processor -- start 2024-09-13T18:35:39.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c7fff700 1 -- start start 2024-09-13T18:35:39.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c7fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f82c8160eb0 0x7f82c8165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:39.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c7fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82c80b33d0 0x7f82c80b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:39.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c7fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f82c8161290 0x7f82c8161740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:39.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c7fff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c80b3d30 con 0x7f82c8161290 2024-09-13T18:35:39.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c7fff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c8071f30 con 0x7f82c8160eb0 2024-09-13T18:35:39.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c7fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c81622e0 con 0x7f82c80b33d0 2024-09-13T18:35:39.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c77fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f82c8161290 0x7f82c8161740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:39.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c77fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f82c8161290 0x7f82c8161740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42136/0 (socket says 172.21.15.44:42136) 2024-09-13T18:35:39.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c77fe700 1 -- 172.21.15.44:0/1435116845 learned_addr learned my addr 172.21.15.44:0/1435116845 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:39.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c6ffd700 1 --2- 172.21.15.44:0/1435116845 >> v2:172.21.15.99:3300/0 conn(0x7f82c8160eb0 0x7f82c8165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:39.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c67fc700 1 --2- 172.21.15.44:0/1435116845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82c80b33d0 0x7f82c80b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:39.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c77fe700 1 -- 172.21.15.44:0/1435116845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82c80b33d0 msgr2=0x7f82c80b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:39.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c77fe700 1 --2- 172.21.15.44:0/1435116845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82c80b33d0 0x7f82c80b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:39.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c77fe700 1 -- 172.21.15.44:0/1435116845 >> v2:172.21.15.99:3300/0 conn(0x7f82c8160eb0 msgr2=0x7f82c8165590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:39.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c77fe700 1 --2- 172.21.15.44:0/1435116845 >> v2:172.21.15.99:3300/0 conn(0x7f82c8160eb0 0x7f82c8165590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:39.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c77fe700 1 -- 172.21.15.44:0/1435116845 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c8162000 con 0x7f82c8161290 2024-09-13T18:35:39.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c67fc700 1 --2- 172.21.15.44:0/1435116845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82c80b33d0 0x7f82c80b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:39.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c6ffd700 1 --2- 172.21.15.44:0/1435116845 >> v2:172.21.15.99:3300/0 conn(0x7f82c8160eb0 0x7f82c8165590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:39.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c77fe700 1 --2- 172.21.15.44:0/1435116845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82c8161290 0x7f82c8161740 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f82c80b33a0 tx=0x7f82b8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d52b0326a2a57d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:39.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c5ffb700 1 -- 172.21.15.44:0/1435116845 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8011830 con 0x7f82c8161290 2024-09-13T18:35:39.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c5ffb700 1 -- 172.21.15.44:0/1435116845 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b8011990 con 0x7f82c8161290 2024-09-13T18:35:39.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.216+0000 7f82c5ffb700 1 -- 172.21.15.44:0/1435116845 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8011d20 con 0x7f82c8161290 2024-09-13T18:35:39.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.220+0000 7f82c7fff700 1 -- 172.21.15.44:0/1435116845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82c8161290 msgr2=0x7f82c8161740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:39.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.220+0000 7f82c7fff700 1 --2- 172.21.15.44:0/1435116845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82c8161290 0x7f82c8161740 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f82c80b33a0 tx=0x7f82b8009bf0 comp rx=0 tx=0).stop 2024-09-13T18:35:39.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.220+0000 7f82c7fff700 1 -- 172.21.15.44:0/1435116845 shutdown_connections 2024-09-13T18:35:39.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.220+0000 7f82c7fff700 1 --2- 172.21.15.44:0/1435116845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82c8161290 0x7f82c8161740 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:39.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.220+0000 7f82c7fff700 1 --2- 172.21.15.44:0/1435116845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82c80b33d0 0x7f82c80b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:39.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.220+0000 7f82c7fff700 1 --2- 172.21.15.44:0/1435116845 >> v2:172.21.15.99:3300/0 conn(0x7f82c8160eb0 0x7f82c8165590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:39.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.220+0000 7f82c7fff700 1 -- 172.21.15.44:0/1435116845 >> 172.21.15.44:0/1435116845 conn(0x7f82c80b0f00 msgr2=0x7f82c80b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:39.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.220+0000 7f82c7fff700 1 -- 172.21.15.44:0/1435116845 shutdown_connections 2024-09-13T18:35:39.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.220+0000 7f82c7fff700 1 -- 172.21.15.44:0/1435116845 wait complete. 2024-09-13T18:35:39.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.220+0000 7f82c7fff700 1 Processor -- start 2024-09-13T18:35:39.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.220+0000 7f82c7fff700 1 -- start start 2024-09-13T18:35:39.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.224+0000 7f82c7fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82c80b33d0 0x7f82c8156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:39.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.224+0000 7f82c7fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82c8160eb0 0x7f82c8154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:39.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.224+0000 7f82c7fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82c8161290 0x7f82c815e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:39.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.224+0000 7f82c7fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c8158970 con 0x7f82c8161290 2024-09-13T18:35:39.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.224+0000 7f82c7fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c8155210 con 0x7f82c80b33d0 2024-09-13T18:35:39.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.224+0000 7f82c7fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c8157b90 con 0x7f82c8160eb0 2024-09-13T18:35:39.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.224+0000 7f82c77fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82c8161290 0x7f82c815e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:39.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.224+0000 7f82c77fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82c8161290 0x7f82c815e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42148/0 (socket says 172.21.15.44:42148) 2024-09-13T18:35:39.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.224+0000 7f82c77fe700 1 -- 172.21.15.44:0/543950444 learned_addr learned my addr 172.21.15.44:0/543950444 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:39.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.224+0000 7f82c67fc700 1 --2- 172.21.15.44:0/543950444 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82c8160eb0 0x7f82c8154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:39.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.224+0000 7f82c6ffd700 1 --2- 172.21.15.44:0/543950444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82c80b33d0 0x7f82c8156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:39.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.224+0000 7f82c77fe700 1 -- 172.21.15.44:0/543950444 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82c8160eb0 msgr2=0x7f82c8154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:39.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.224+0000 7f82c77fe700 1 --2- 172.21.15.44:0/543950444 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82c8160eb0 0x7f82c8154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:39.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.224+0000 7f82c77fe700 1 -- 172.21.15.44:0/543950444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82c80b33d0 msgr2=0x7f82c8156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:39.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.224+0000 7f82c77fe700 1 --2- 172.21.15.44:0/543950444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82c80b33d0 0x7f82c8156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:39.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.224+0000 7f82c77fe700 1 -- 172.21.15.44:0/543950444 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c0009a70 con 0x7f82c8161290 2024-09-13T18:35:39.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.224+0000 7f82c77fe700 1 --2- 172.21.15.44:0/543950444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82c8161290 0x7f82c815e4a0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f82b8014040 tx=0x7f82b8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:39.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.224+0000 7f82bf7fe700 1 -- 172.21.15.44:0/543950444 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8004450 con 0x7f82c8161290 2024-09-13T18:35:39.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.224+0000 7f82bf7fe700 1 -- 172.21.15.44:0/543950444 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b801e070 con 0x7f82c8161290 2024-09-13T18:35:39.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.224+0000 7f82c7fff700 1 -- 172.21.15.44:0/543950444 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b00094b0 con 0x7f82c8161290 2024-09-13T18:35:39.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.224+0000 7f82bf7fe700 1 -- 172.21.15.44:0/543950444 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8003900 con 0x7f82c8161290 2024-09-13T18:35:39.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.224+0000 7f82c7fff700 1 -- 172.21.15.44:0/543950444 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b8009570 con 0x7f82c8161290 2024-09-13T18:35:39.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.228+0000 7f82c7fff700 1 -- 172.21.15.44:0/543950444 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c8158b20 con 0x7f82c8161290 2024-09-13T18:35:39.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.228+0000 7f82bf7fe700 1 -- 172.21.15.44:0/543950444 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f82b8003a60 con 0x7f82c8161290 2024-09-13T18:35:39.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.228+0000 7f82bf7fe700 1 --2- 172.21.15.44:0/543950444 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f82a8066730 0x7f82a8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:39.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.228+0000 7f82bf7fe700 1 -- 172.21.15.44:0/543950444 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5201+0+0 (secure 0 0 0) 0x7f82b8084ca0 con 0x7f82c8161290 2024-09-13T18:35:39.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.228+0000 7f82c6ffd700 1 --2- 172.21.15.44:0/543950444 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f82a8066730 0x7f82a8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:39.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.232+0000 7f82c6ffd700 1 --2- 172.21.15.44:0/543950444 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f82a8066730 0x7f82a8068bf0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009d80 tx=0x7f82b0009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:39.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.236+0000 7f82bf7fe700 1 -- 172.21.15.44:0/543950444 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f82c8158b20 con 0x7f82c8161290 2024-09-13T18:35:39.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:39.472+0000 7f82c7fff700 1 -- 172.21.15.44:0/543950444 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool"]} v 0) v1 -- 0x7f82c8073df0 con 0x7f82c8161290 2024-09-13T18:35:40.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.400+0000 7f82bf7fe700 1 -- 172.21.15.44:0/543950444 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool"]}]=0 v375) v1 ==== 148+0+0 (secure 0 0 0) 0x7f82b8052290 con 0x7f82c8161290 2024-09-13T18:35:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.408+0000 7f82c7fff700 1 -- 172.21.15.44:0/543950444 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f82a8066730 msgr2=0x7f82a8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.408+0000 7f82c7fff700 1 --2- 172.21.15.44:0/543950444 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f82a8066730 0x7f82a8068bf0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009d80 tx=0x7f82b0009240 comp rx=0 tx=0).stop 2024-09-13T18:35:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.408+0000 7f82c7fff700 1 -- 172.21.15.44:0/543950444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82c8161290 msgr2=0x7f82c815e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.408+0000 7f82c7fff700 1 --2- 172.21.15.44:0/543950444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82c8161290 0x7f82c815e4a0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f82b8014040 tx=0x7f82b8004770 comp rx=0 tx=0).stop 2024-09-13T18:35:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.408+0000 7f82c7fff700 1 -- 172.21.15.44:0/543950444 shutdown_connections 2024-09-13T18:35:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.408+0000 7f82c7fff700 1 --2- 172.21.15.44:0/543950444 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f82a8066730 0x7f82a8068bf0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.408+0000 7f82c7fff700 1 --2- 172.21.15.44:0/543950444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82c8161290 0x7f82c815e4a0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.408+0000 7f82c7fff700 1 --2- 172.21.15.44:0/543950444 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82c8160eb0 0x7f82c8154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.408+0000 7f82c7fff700 1 --2- 172.21.15.44:0/543950444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82c80b33d0 0x7f82c8156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.408+0000 7f82c7fff700 1 -- 172.21.15.44:0/543950444 >> 172.21.15.44:0/543950444 conn(0x7f82c80b0f00 msgr2=0x7f82c80cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:40.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.408+0000 7f82c7fff700 1 -- 172.21.15.44:0/543950444 shutdown_connections 2024-09-13T18:35:40.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.408+0000 7f82c7fff700 1 -- 172.21.15.44:0/543950444 wait complete. 2024-09-13T18:35:40.431 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:35:40.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.552+0000 7fe571755700 1 Processor -- start 2024-09-13T18:35:40.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.552+0000 7fe571755700 1 -- start start 2024-09-13T18:35:40.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.552+0000 7fe571755700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe56c1433e0 0x7fe56c15a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:40.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.552+0000 7fe571755700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe56c15b290 0x7fe56c15b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:40.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.552+0000 7fe571755700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe56c06c950 con 0x7fe56c06a310 2024-09-13T18:35:40.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.552+0000 7fe571755700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe56c06cc30 con 0x7fe56c1433e0 2024-09-13T18:35:40.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.552+0000 7fe571755700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c06cf10 con 0x7fe56c15b290 2024-09-13T18:35:40.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.552+0000 7fe56a7fc700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe56c1433e0 0x7fe56c15a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:40.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.552+0000 7fe56a7fc700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe56c1433e0 0x7fe56c15a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42160/0 (socket says 172.21.15.44:42160) 2024-09-13T18:35:40.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.552+0000 7fe56a7fc700 1 -- 172.21.15.44:0/1654025032 learned_addr learned my addr 172.21.15.44:0/1654025032 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:40.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.552+0000 7fe56b7fe700 1 --2- 172.21.15.44:0/1654025032 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe56c15b290 0x7fe56c15b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:40.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.552+0000 7fe56a7fc700 1 -- 172.21.15.44:0/1654025032 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe56c15b290 msgr2=0x7fe56c15b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:40.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.552+0000 7fe56a7fc700 1 --2- 172.21.15.44:0/1654025032 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe56c15b290 0x7fe56c15b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.552+0000 7fe56a7fc700 1 -- 172.21.15.44:0/1654025032 >> v1:172.21.15.99:6789/0 conn(0x7fe56c06a310 legacy=0x7fe56c06a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:40.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.552+0000 7fe56a7fc700 1 -- 172.21.15.44:0/1654025032 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56c06d1f0 con 0x7fe56c1433e0 2024-09-13T18:35:40.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.556+0000 7fe56a7fc700 1 --2- 172.21.15.44:0/1654025032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe56c1433e0 0x7fe56c15a940 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fe55c009910 tx=0x7fe55c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60dadccdfe42e924 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:40.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.556+0000 7fe569ffb700 1 -- 172.21.15.44:0/1654025032 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c004230 con 0x7fe56c1433e0 2024-09-13T18:35:40.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.556+0000 7fe569ffb700 1 -- 172.21.15.44:0/1654025032 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c004390 con 0x7fe56c1433e0 2024-09-13T18:35:40.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.556+0000 7fe569ffb700 1 -- 172.21.15.44:0/1654025032 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c009e60 con 0x7fe56c1433e0 2024-09-13T18:35:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.556+0000 7fe571755700 1 -- 172.21.15.44:0/1654025032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe56c1433e0 msgr2=0x7fe56c15a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.556+0000 7fe571755700 1 --2- 172.21.15.44:0/1654025032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe56c1433e0 0x7fe56c15a940 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fe55c009910 tx=0x7fe55c009c20 comp rx=0 tx=0).stop 2024-09-13T18:35:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.556+0000 7fe571755700 1 -- 172.21.15.44:0/1654025032 shutdown_connections 2024-09-13T18:35:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.556+0000 7fe571755700 1 --2- 172.21.15.44:0/1654025032 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe56c15b290 0x7fe56c15b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.556+0000 7fe571755700 1 --2- 172.21.15.44:0/1654025032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe56c1433e0 0x7fe56c15a940 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.556+0000 7fe571755700 1 -- 172.21.15.44:0/1654025032 >> 172.21.15.44:0/1654025032 conn(0x7fe56c0af620 msgr2=0x7fe56c0afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.556+0000 7fe571755700 1 -- 172.21.15.44:0/1654025032 shutdown_connections 2024-09-13T18:35:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.556+0000 7fe571755700 1 -- 172.21.15.44:0/1654025032 wait complete. 2024-09-13T18:35:40.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.556+0000 7fe571755700 1 Processor -- start 2024-09-13T18:35:40.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.556+0000 7fe571755700 1 -- start start 2024-09-13T18:35:40.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.560+0000 7fe571755700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe56c06a310 0x7fe56c15d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:40.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.560+0000 7fe571755700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe56c1433e0 0x7fe56c1658c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:40.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.560+0000 7fe571755700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe56c15b290 0x7fe56c0cd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:40.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.560+0000 7fe571755700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c167910 con 0x7fe56c1433e0 2024-09-13T18:35:40.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.560+0000 7fe571755700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c15e000 con 0x7fe56c15b290 2024-09-13T18:35:40.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.560+0000 7fe571755700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c165e00 con 0x7fe56c06a310 2024-09-13T18:35:40.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.560+0000 7fe56a7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe56c1433e0 0x7fe56c1658c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:40.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.560+0000 7fe56a7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe56c1433e0 0x7fe56c1658c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42170/0 (socket says 172.21.15.44:42170) 2024-09-13T18:35:40.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.560+0000 7fe56a7fc700 1 -- 172.21.15.44:0/1908963313 learned_addr learned my addr 172.21.15.44:0/1908963313 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:40.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.560+0000 7fe56b7fe700 1 --2- 172.21.15.44:0/1908963313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe56c15b290 0x7fe56c0cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:40.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.560+0000 7fe56affd700 1 --2- 172.21.15.44:0/1908963313 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe56c06a310 0x7fe56c15d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:40.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.560+0000 7fe56a7fc700 1 -- 172.21.15.44:0/1908963313 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe56c06a310 msgr2=0x7fe56c15d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:40.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.560+0000 7fe56a7fc700 1 --2- 172.21.15.44:0/1908963313 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe56c06a310 0x7fe56c15d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.560+0000 7fe56a7fc700 1 -- 172.21.15.44:0/1908963313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe56c15b290 msgr2=0x7fe56c0cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:40.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.560+0000 7fe56a7fc700 1 --2- 172.21.15.44:0/1908963313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe56c15b290 0x7fe56c0cd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.560+0000 7fe56a7fc700 1 -- 172.21.15.44:0/1908963313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c009570 con 0x7fe56c1433e0 2024-09-13T18:35:40.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.560+0000 7fe56a7fc700 1 --2- 172.21.15.44:0/1908963313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe56c1433e0 0x7fe56c1658c0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fe55c004000 tx=0x7fe55c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:40.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.560+0000 7fe5537fe700 1 -- 172.21.15.44:0/1908963313 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c00bc50 con 0x7fe56c1433e0 2024-09-13T18:35:40.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.560+0000 7fe5537fe700 1 -- 172.21.15.44:0/1908963313 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c01f070 con 0x7fe56c1433e0 2024-09-13T18:35:40.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.560+0000 7fe571755700 1 -- 172.21.15.44:0/1908963313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe56c0cca30 con 0x7fe56c1433e0 2024-09-13T18:35:40.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.560+0000 7fe5537fe700 1 -- 172.21.15.44:0/1908963313 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c0036c0 con 0x7fe56c1433e0 2024-09-13T18:35:40.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.560+0000 7fe571755700 1 -- 172.21.15.44:0/1908963313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe56c0ccfb0 con 0x7fe56c1433e0 2024-09-13T18:35:40.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.564+0000 7fe571755700 1 -- 172.21.15.44:0/1908963313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe56c15a940 con 0x7fe56c1433e0 2024-09-13T18:35:40.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.564+0000 7fe5537fe700 1 -- 172.21.15.44:0/1908963313 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe55c021030 con 0x7fe56c1433e0 2024-09-13T18:35:40.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.564+0000 7fe5537fe700 1 --2- 172.21.15.44:0/1908963313 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe558066730 0x7fe558068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:40.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.564+0000 7fe5537fe700 1 -- 172.21.15.44:0/1908963313 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5201+0+0 (secure 0 0 0) 0x7fe55c085300 con 0x7fe56c1433e0 2024-09-13T18:35:40.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.564+0000 7fe56affd700 1 --2- 172.21.15.44:0/1908963313 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe558066730 0x7fe558068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:40.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.564+0000 7fe56affd700 1 --2- 172.21.15.44:0/1908963313 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe558066730 0x7fe558068bf0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe56c15a680 tx=0x7fe560007ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:40.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.572+0000 7fe5537fe700 1 -- 172.21.15.44:0/1908963313 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe55c0528f0 con 0x7fe56c1433e0 2024-09-13T18:35:40.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.744+0000 7fe571755700 1 -- 172.21.15.44:0/1908963313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe56c15a940 con 0x7fe56c1433e0 2024-09-13T18:35:40.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.752+0000 7fe5537fe700 1 -- 172.21.15.44:0/1908963313 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe55c055f10 con 0x7fe56c1433e0 2024-09-13T18:35:40.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.756+0000 7fe571755700 1 -- 172.21.15.44:0/1908963313 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe558066730 msgr2=0x7fe558068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.756+0000 7fe571755700 1 --2- 172.21.15.44:0/1908963313 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe558066730 0x7fe558068bf0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe56c15a680 tx=0x7fe560007ee0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.756+0000 7fe571755700 1 -- 172.21.15.44:0/1908963313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe56c1433e0 msgr2=0x7fe56c1658c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.756+0000 7fe571755700 1 --2- 172.21.15.44:0/1908963313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe56c1433e0 0x7fe56c1658c0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fe55c004000 tx=0x7fe55c004770 comp rx=0 tx=0).stop 2024-09-13T18:35:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.756+0000 7fe571755700 1 -- 172.21.15.44:0/1908963313 shutdown_connections 2024-09-13T18:35:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.756+0000 7fe571755700 1 --2- 172.21.15.44:0/1908963313 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe558066730 0x7fe558068bf0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.756+0000 7fe571755700 1 --2- 172.21.15.44:0/1908963313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe56c15b290 0x7fe56c0cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.756+0000 7fe571755700 1 --2- 172.21.15.44:0/1908963313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe56c1433e0 0x7fe56c1658c0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.756+0000 7fe571755700 1 --2- 172.21.15.44:0/1908963313 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe56c06a310 0x7fe56c15d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.756+0000 7fe571755700 1 -- 172.21.15.44:0/1908963313 >> 172.21.15.44:0/1908963313 conn(0x7fe56c0af620 msgr2=0x7fe56c0b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.756+0000 7fe571755700 1 -- 172.21.15.44:0/1908963313 shutdown_connections 2024-09-13T18:35:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.756+0000 7fe571755700 1 -- 172.21.15.44:0/1908963313 wait complete. 2024-09-13T18:35:40.777 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:35:40.777 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:35:40.791 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:35:40.813 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:35:40.813 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:35:40.814 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:35:40.821 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349428k,nr_inodes=4087357,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16693 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276112k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:35:40.821 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:35:40.821 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:35:40.829 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346268k,nr_inodes=4086567,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19562 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275480k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:35:40.829 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:35:40.829 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:35:40.871 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349428k,nr_inodes=4087357,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16693 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276112k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:35:40.871 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:35:40.871 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:35:40.878 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346268k,nr_inodes=4086567,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19562 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275480k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:35:40.879 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:35:40.879 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:35:41.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.996+0000 7f92ecad7700 1 Processor -- start 2024-09-13T18:35:41.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.996+0000 7f92ecad7700 1 -- start start 2024-09-13T18:35:41.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.996+0000 7f92ecad7700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f92e81603a0 0x7f92e80aca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:41.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.996+0000 7f92ecad7700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e8071db0 con 0x7f92e80cc470 2024-09-13T18:35:41.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.996+0000 7f92ecad7700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e8160780 con 0x7f92e80714f0 2024-09-13T18:35:41.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.996+0000 7f92ecad7700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e80acf40 con 0x7f92e81603a0 2024-09-13T18:35:41.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.996+0000 7f92e5d9b700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f92e80cc470 0x7f92e8070de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44410/0 (socket says 172.21.15.44:44410) 2024-09-13T18:35:41.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.996+0000 7f92e5d9b700 1 -- 172.21.15.44:0/1754945133 learned_addr learned my addr 172.21.15.44:0/1754945133 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:41.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.996+0000 7f92e659c700 1 --2- 172.21.15.44:0/1754945133 >> v2:172.21.15.99:3300/0 conn(0x7f92e81603a0 0x7f92e80aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:41.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.996+0000 7f92e559a700 1 -- 172.21.15.44:0/1754945133 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358140730 0 0) 0x7f92e8071db0 con 0x7f92e80cc470 2024-09-13T18:35:41.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.996+0000 7f92e559a700 1 -- 172.21.15.44:0/1754945133 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92d40035d0 con 0x7f92e80cc470 2024-09-13T18:35:41.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.996+0000 7f92e559a700 1 -- 172.21.15.44:0/1754945133 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2780030230 0 0) 0x7f92e8160780 con 0x7f92e80714f0 2024-09-13T18:35:41.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.996+0000 7f92e559a700 1 -- 172.21.15.44:0/1754945133 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92e8071db0 con 0x7f92e80714f0 2024-09-13T18:35:41.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.996+0000 7f92e659c700 1 -- 172.21.15.44:0/1754945133 >> v1:172.21.15.99:6789/0 conn(0x7f92e80714f0 legacy=0x7f92e80cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:41.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.996+0000 7f92e659c700 1 -- 172.21.15.44:0/1754945133 >> v1:172.21.15.44:6789/0 conn(0x7f92e80cc470 legacy=0x7f92e8070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:41.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.996+0000 7f92e659c700 1 -- 172.21.15.44:0/1754945133 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e8071ad0 con 0x7f92e81603a0 2024-09-13T18:35:41.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:40.996+0000 7f92e659c700 1 --2- 172.21.15.44:0/1754945133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e81603a0 0x7f92e80aca00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f92d8009850 tx=0x7f92d8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cf8721c6236e74a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:41.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.000+0000 7f92e559a700 1 -- 172.21.15.44:0/1754945133 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d8011830 con 0x7f92e81603a0 2024-09-13T18:35:41.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.000+0000 7f92e559a700 1 -- 172.21.15.44:0/1754945133 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d8011990 con 0x7f92e81603a0 2024-09-13T18:35:41.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.000+0000 7f92e559a700 1 -- 172.21.15.44:0/1754945133 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d8011d00 con 0x7f92e81603a0 2024-09-13T18:35:41.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.000+0000 7f92ecad7700 1 -- 172.21.15.44:0/1754945133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e81603a0 msgr2=0x7f92e80aca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:41.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.000+0000 7f92ecad7700 1 --2- 172.21.15.44:0/1754945133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e81603a0 0x7f92e80aca00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f92d8009850 tx=0x7f92d8009b60 comp rx=0 tx=0).stop 2024-09-13T18:35:41.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.000+0000 7f92ecad7700 1 -- 172.21.15.44:0/1754945133 shutdown_connections 2024-09-13T18:35:41.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.000+0000 7f92ecad7700 1 --2- 172.21.15.44:0/1754945133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e81603a0 0x7f92e80aca00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:41.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.000+0000 7f92ecad7700 1 -- 172.21.15.44:0/1754945133 >> 172.21.15.44:0/1754945133 conn(0x7f92e806f5e0 msgr2=0x7f92e80b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:41.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.000+0000 7f92ecad7700 1 -- 172.21.15.44:0/1754945133 shutdown_connections 2024-09-13T18:35:41.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.000+0000 7f92ecad7700 1 -- 172.21.15.44:0/1754945133 wait complete. 2024-09-13T18:35:41.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.000+0000 7f92ecad7700 1 Processor -- start 2024-09-13T18:35:41.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.000+0000 7f92ecad7700 1 -- start start 2024-09-13T18:35:41.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.004+0000 7f92ecad7700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e80714f0 0x7f92e80cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.004+0000 7f92ecad7700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92e80cc470 0x7f92e80c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.004+0000 7f92ecad7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92e81603a0 0x7f92e80c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.004+0000 7f92ecad7700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e80ca030 con 0x7f92e81603a0 2024-09-13T18:35:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.004+0000 7f92ecad7700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e80ca310 con 0x7f92e80714f0 2024-09-13T18:35:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.004+0000 7f92ecad7700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e80ca5f0 con 0x7f92e80cc470 2024-09-13T18:35:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.004+0000 7f92e6d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92e81603a0 0x7f92e80c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.004+0000 7f92e6d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92e81603a0 0x7f92e80c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42172/0 (socket says 172.21.15.44:42172) 2024-09-13T18:35:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.004+0000 7f92e6d9d700 1 -- 172.21.15.44:0/2502626073 learned_addr learned my addr 172.21.15.44:0/2502626073 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.004+0000 7f92e659c700 1 --2- 172.21.15.44:0/2502626073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e80714f0 0x7f92e80cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.004+0000 7f92e5d9b700 1 --2- 172.21.15.44:0/2502626073 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92e80cc470 0x7f92e80c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.004+0000 7f92e6d9d700 1 -- 172.21.15.44:0/2502626073 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92e80cc470 msgr2=0x7f92e80c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.004+0000 7f92e6d9d700 1 --2- 172.21.15.44:0/2502626073 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92e80cc470 0x7f92e80c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.004+0000 7f92e6d9d700 1 -- 172.21.15.44:0/2502626073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e80714f0 msgr2=0x7f92e80cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.004+0000 7f92e6d9d700 1 --2- 172.21.15.44:0/2502626073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e80714f0 0x7f92e80cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.004+0000 7f92e6d9d700 1 -- 172.21.15.44:0/2502626073 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d80094b0 con 0x7f92e81603a0 2024-09-13T18:35:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.004+0000 7f92e6d9d700 1 --2- 172.21.15.44:0/2502626073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92e81603a0 0x7f92e80c7e80 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f92e000cc50 tx=0x7f92e000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.004+0000 7f92deffd700 1 -- 172.21.15.44:0/2502626073 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e0003c20 con 0x7f92e81603a0 2024-09-13T18:35:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.004+0000 7f92deffd700 1 -- 172.21.15.44:0/2502626073 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e0003da0 con 0x7f92e81603a0 2024-09-13T18:35:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.004+0000 7f92deffd700 1 -- 172.21.15.44:0/2502626073 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e000aad0 con 0x7f92e81603a0 2024-09-13T18:35:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.004+0000 7f92ecad7700 1 -- 172.21.15.44:0/2502626073 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e80ca8d0 con 0x7f92e81603a0 2024-09-13T18:35:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.004+0000 7f92ecad7700 1 -- 172.21.15.44:0/2502626073 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e80cb330 con 0x7f92e81603a0 2024-09-13T18:35:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.004+0000 7f92ecad7700 1 -- 172.21.15.44:0/2502626073 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e80cb550 con 0x7f92e81603a0 2024-09-13T18:35:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.008+0000 7f92deffd700 1 -- 172.21.15.44:0/2502626073 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f92e000ac30 con 0x7f92e81603a0 2024-09-13T18:35:41.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.008+0000 7f92deffd700 1 --2- 172.21.15.44:0/2502626073 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f92c8066760 0x7f92c8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:41.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.008+0000 7f92deffd700 1 -- 172.21.15.44:0/2502626073 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5201+0+0 (secure 0 0 0) 0x7f92e0083ee0 con 0x7f92e81603a0 2024-09-13T18:35:41.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.008+0000 7f92e659c700 1 --2- 172.21.15.44:0/2502626073 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f92c8066760 0x7f92c8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:41.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.008+0000 7f92e659c700 1 --2- 172.21.15.44:0/2502626073 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f92c8066760 0x7f92c8068c20 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f92d80090b0 tx=0x7f92d8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:41.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.016+0000 7f92deffd700 1 -- 172.21.15.44:0/2502626073 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f92e0051440 con 0x7f92e81603a0 2024-09-13T18:35:41.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.224+0000 7f92ecad7700 1 -- 172.21.15.44:0/2502626073 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92e80ca170 con 0x7f92e81603a0 2024-09-13T18:35:41.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.224+0000 7f92deffd700 1 -- 172.21.15.44:0/2502626073 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f92e80ca170 con 0x7f92e81603a0 2024-09-13T18:35:41.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:41.230 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":64,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2305930667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2305930667},{"type":"v1","addr":"172.21.15.99:6835","nonce":2305930667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6599,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/131047476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":131047476},{"type":"v1","addr":"172.21.15.99:6837","nonce":131047476}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":6846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1177460745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1177460745},{"type":"v1","addr":"172.21.15.44:6834","nonce":1177460745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7395,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1292209064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1292209064},{"type":"v1","addr":"172.21.15.44:6835","nonce":1292209064}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[]} 2024-09-13T18:35:41.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.224+0000 7f92ecad7700 1 -- 172.21.15.44:0/2502626073 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f92c8066760 msgr2=0x7f92c8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.224+0000 7f92ecad7700 1 --2- 172.21.15.44:0/2502626073 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f92c8066760 0x7f92c8068c20 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f92d80090b0 tx=0x7f92d8008030 comp rx=0 tx=0).stop 2024-09-13T18:35:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.224+0000 7f92ecad7700 1 -- 172.21.15.44:0/2502626073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92e81603a0 msgr2=0x7f92e80c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.224+0000 7f92ecad7700 1 --2- 172.21.15.44:0/2502626073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92e81603a0 0x7f92e80c7e80 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f92e000cc50 tx=0x7f92e000cf60 comp rx=0 tx=0).stop 2024-09-13T18:35:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.224+0000 7f92ecad7700 1 -- 172.21.15.44:0/2502626073 shutdown_connections 2024-09-13T18:35:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.224+0000 7f92ecad7700 1 --2- 172.21.15.44:0/2502626073 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f92c8066760 0x7f92c8068c20 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.224+0000 7f92ecad7700 1 --2- 172.21.15.44:0/2502626073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92e81603a0 0x7f92e80c7e80 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.224+0000 7f92ecad7700 1 --2- 172.21.15.44:0/2502626073 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92e80cc470 0x7f92e80c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.224+0000 7f92ecad7700 1 --2- 172.21.15.44:0/2502626073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e80714f0 0x7f92e80cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.224+0000 7f92ecad7700 1 -- 172.21.15.44:0/2502626073 >> 172.21.15.44:0/2502626073 conn(0x7f92e806f5e0 msgr2=0x7f92e80b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.228+0000 7f92ecad7700 1 -- 172.21.15.44:0/2502626073 shutdown_connections 2024-09-13T18:35:41.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.228+0000 7f92ecad7700 1 -- 172.21.15.44:0/2502626073 wait complete. 2024-09-13T18:35:41.234 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 64 2024-09-13T18:35:41.245 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:35:41.245 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:35:41.246 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:35:41.246 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:35:41.246 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:35:41.246 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:35:41.246 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:35:41.246 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:35:41.247 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:35:41.247 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:35:41.247 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:35:41.247 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:35:41.247 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:35:41.247 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:35:41.247 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:35:41.247 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:35:41.257 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:35:41.257 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:35:41.259 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:35:41.259 DEBUG:teuthology.parallel:result is None 2024-09-13T18:35:41.261 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:35:41.261 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:35:41.263 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:35:41.263 DEBUG:teuthology.parallel:result is None 2024-09-13T18:35:41.265 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:35:41.265 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:35:41.266 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:35:41.266 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:35:41.311 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:35:41.312 DEBUG:teuthology.parallel:result is None 2024-09-13T18:35:41.313 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:35:41.313 DEBUG:teuthology.parallel:result is None 2024-09-13T18:35:41.313 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:35:41.333 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-13T18:35:41.349 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-13T18:35:41.395 INFO:tasks.ceph.mds.d.smithi099.stdout:starting mds.d at 2024-09-13T18:35:41.395 INFO:tasks.ceph.mds.b.smithi099.stdout:starting mds.b at 2024-09-13T18:35:41.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.416+0000 7fc06cc17700 1 Processor -- start 2024-09-13T18:35:41.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.416+0000 7fc06cc17700 1 -- start start 2024-09-13T18:35:41.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.420+0000 7fc06cc17700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc0681573d0 0x7fc0680b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:41.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.420+0000 7fc06cc17700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0680720c0 con 0x7fc068071c90 2024-09-13T18:35:41.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.420+0000 7fc06cc17700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0680b2750 con 0x7fc06806e420 2024-09-13T18:35:41.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.420+0000 7fc06cc17700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0680722f0 con 0x7fc0681573d0 2024-09-13T18:35:41.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.420+0000 7fc066d9d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc068071c90 0x7fc0680ad840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44422/0 (socket says 172.21.15.44:44422) 2024-09-13T18:35:41.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.420+0000 7fc06659c700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc0681573d0 0x7fc0680b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:41.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.420+0000 7fc066d9d700 1 -- 172.21.15.44:0/2057650373 learned_addr learned my addr 172.21.15.44:0/2057650373 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:41.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.420+0000 7fc065d9b700 1 -- 172.21.15.44:0/2057650373 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951153683 0 0) 0x7fc0680720c0 con 0x7fc068071c90 2024-09-13T18:35:41.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.420+0000 7fc065d9b700 1 -- 172.21.15.44:0/2057650373 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0540035d0 con 0x7fc068071c90 2024-09-13T18:35:41.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.420+0000 7fc06659c700 1 -- 172.21.15.44:0/2057650373 >> v1:172.21.15.99:6789/0 conn(0x7fc06806e420 legacy=0x7fc068071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:41.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.420+0000 7fc06659c700 1 -- 172.21.15.44:0/2057650373 >> v1:172.21.15.44:6789/0 conn(0x7fc068071c90 legacy=0x7fc0680ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:41.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.420+0000 7fc06659c700 1 -- 172.21.15.44:0/2057650373 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0680b29a0 con 0x7fc0681573d0 2024-09-13T18:35:41.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.420+0000 7fc06659c700 1 --2- 172.21.15.44:0/2057650373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0681573d0 0x7fc0680b3480 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc058009850 tx=0x7fc058009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e17b5707cb33b817 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:41.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.420+0000 7fc065d9b700 1 -- 172.21.15.44:0/2057650373 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc058011830 con 0x7fc0681573d0 2024-09-13T18:35:41.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.420+0000 7fc065d9b700 1 -- 172.21.15.44:0/2057650373 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc058011990 con 0x7fc0681573d0 2024-09-13T18:35:41.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.420+0000 7fc065d9b700 1 -- 172.21.15.44:0/2057650373 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc058011d40 con 0x7fc0681573d0 2024-09-13T18:35:41.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.424+0000 7fc06cc17700 1 -- 172.21.15.44:0/2057650373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0681573d0 msgr2=0x7fc0680b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:41.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.424+0000 7fc06cc17700 1 --2- 172.21.15.44:0/2057650373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0681573d0 0x7fc0680b3480 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc058009850 tx=0x7fc058009b60 comp rx=0 tx=0).stop 2024-09-13T18:35:41.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.424+0000 7fc06cc17700 1 -- 172.21.15.44:0/2057650373 shutdown_connections 2024-09-13T18:35:41.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.424+0000 7fc06cc17700 1 --2- 172.21.15.44:0/2057650373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0681573d0 0x7fc0680b3480 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:41.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.424+0000 7fc06cc17700 1 -- 172.21.15.44:0/2057650373 >> 172.21.15.44:0/2057650373 conn(0x7fc06806d900 msgr2=0x7fc06806dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:41.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.424+0000 7fc06cc17700 1 -- 172.21.15.44:0/2057650373 shutdown_connections 2024-09-13T18:35:41.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.424+0000 7fc06cc17700 1 -- 172.21.15.44:0/2057650373 wait complete. 2024-09-13T18:35:41.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.424+0000 7fc06cc17700 1 Processor -- start 2024-09-13T18:35:41.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.424+0000 7fc06cc17700 1 -- start start 2024-09-13T18:35:41.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.424+0000 7fc06cc17700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc06806e420 0x7fc0681f3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:41.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.424+0000 7fc06cc17700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc068071c90 0x7fc068152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:41.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.428+0000 7fc06cc17700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0681573d0 0x7fc0680ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:41.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.428+0000 7fc06cc17700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0680ae8f0 con 0x7fc0681573d0 2024-09-13T18:35:41.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.428+0000 7fc06cc17700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0681532f0 con 0x7fc068071c90 2024-09-13T18:35:41.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.428+0000 7fc06cc17700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0680add80 con 0x7fc06806e420 2024-09-13T18:35:41.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.428+0000 7fc066d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0681573d0 0x7fc0680ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:41.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.428+0000 7fc06659c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc06806e420 0x7fc0681f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:41.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.428+0000 7fc066d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0681573d0 0x7fc0680ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42228/0 (socket says 172.21.15.44:42228) 2024-09-13T18:35:41.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.428+0000 7fc066d9d700 1 -- 172.21.15.44:0/3688936844 learned_addr learned my addr 172.21.15.44:0/3688936844 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:41.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.428+0000 7fc05ffff700 1 --2- 172.21.15.44:0/3688936844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc068071c90 0x7fc068152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:41.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.428+0000 7fc066d9d700 1 -- 172.21.15.44:0/3688936844 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc06806e420 msgr2=0x7fc0681f3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:41.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.428+0000 7fc066d9d700 1 --2- 172.21.15.44:0/3688936844 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc06806e420 0x7fc0681f3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:41.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.428+0000 7fc066d9d700 1 -- 172.21.15.44:0/3688936844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc068071c90 msgr2=0x7fc068152db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:41.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.428+0000 7fc066d9d700 1 --2- 172.21.15.44:0/3688936844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc068071c90 0x7fc068152db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:41.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.428+0000 7fc066d9d700 1 -- 172.21.15.44:0/3688936844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0580094b0 con 0x7fc0681573d0 2024-09-13T18:35:41.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.428+0000 7fc06659c700 1 --2- 172.21.15.44:0/3688936844 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc06806e420 0x7fc0681f3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:41.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.428+0000 7fc066d9d700 1 --2- 172.21.15.44:0/3688936844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0681573d0 0x7fc0680ad840 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fc06000cb70 tx=0x7fc06000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:41.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.428+0000 7fc05effd700 1 -- 172.21.15.44:0/3688936844 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc060007480 con 0x7fc0681573d0 2024-09-13T18:35:41.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.428+0000 7fc06cc17700 1 -- 172.21.15.44:0/3688936844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0680ae050 con 0x7fc0681573d0 2024-09-13T18:35:41.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.428+0000 7fc05effd700 1 -- 172.21.15.44:0/3688936844 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0600075e0 con 0x7fc0681573d0 2024-09-13T18:35:41.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.428+0000 7fc05effd700 1 -- 172.21.15.44:0/3688936844 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc060007950 con 0x7fc0681573d0 2024-09-13T18:35:41.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.428+0000 7fc06cc17700 1 -- 172.21.15.44:0/3688936844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0680ae610 con 0x7fc0681573d0 2024-09-13T18:35:41.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.432+0000 7fc06cc17700 1 -- 172.21.15.44:0/3688936844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0680b3480 con 0x7fc0681573d0 2024-09-13T18:35:41.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.432+0000 7fc05effd700 1 -- 172.21.15.44:0/3688936844 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc06001b3b0 con 0x7fc0681573d0 2024-09-13T18:35:41.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.432+0000 7fc05effd700 1 --2- 172.21.15.44:0/3688936844 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc048066760 0x7fc048068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:41.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.432+0000 7fc05effd700 1 -- 172.21.15.44:0/3688936844 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5201+0+0 (secure 0 0 0) 0x7fc060083890 con 0x7fc0681573d0 2024-09-13T18:35:41.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.432+0000 7fc06659c700 1 --2- 172.21.15.44:0/3688936844 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc048066760 0x7fc048068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:41.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.432+0000 7fc06659c700 1 --2- 172.21.15.44:0/3688936844 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc048066760 0x7fc048068c20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc0580090b0 tx=0x7fc05801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:41.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.440+0000 7fc05effd700 1 -- 172.21.15.44:0/3688936844 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc060050d80 con 0x7fc0681573d0 2024-09-13T18:35:41.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:41.632+0000 7fc06cc17700 1 -- 172.21.15.44:0/3688936844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc06815afd0 con 0x7fc0681573d0 2024-09-13T18:35:42.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.432+0000 7fc05effd700 1 -- 172.21.15.44:0/3688936844 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v74) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc060017080 con 0x7fc0681573d0 2024-09-13T18:35:42.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.436+0000 7fc06cc17700 1 -- 172.21.15.44:0/3688936844 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc048066760 msgr2=0x7fc048068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:42.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.436+0000 7fc06cc17700 1 --2- 172.21.15.44:0/3688936844 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc048066760 0x7fc048068c20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc0580090b0 tx=0x7fc05801c040 comp rx=0 tx=0).stop 2024-09-13T18:35:42.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.436+0000 7fc06cc17700 1 -- 172.21.15.44:0/3688936844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0681573d0 msgr2=0x7fc0680ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:42.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.436+0000 7fc06cc17700 1 --2- 172.21.15.44:0/3688936844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0681573d0 0x7fc0680ad840 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fc06000cb70 tx=0x7fc06000cba0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.436+0000 7fc06cc17700 1 -- 172.21.15.44:0/3688936844 shutdown_connections 2024-09-13T18:35:42.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.436+0000 7fc06cc17700 1 --2- 172.21.15.44:0/3688936844 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc048066760 0x7fc048068c20 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.436+0000 7fc06cc17700 1 --2- 172.21.15.44:0/3688936844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0681573d0 0x7fc0680ad840 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.436+0000 7fc06cc17700 1 --2- 172.21.15.44:0/3688936844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc068071c90 0x7fc068152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.436+0000 7fc06cc17700 1 --2- 172.21.15.44:0/3688936844 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc06806e420 0x7fc0681f3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.436+0000 7fc06cc17700 1 -- 172.21.15.44:0/3688936844 >> 172.21.15.44:0/3688936844 conn(0x7fc06806d900 msgr2=0x7fc068153d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:42.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.436+0000 7fc06cc17700 1 -- 172.21.15.44:0/3688936844 shutdown_connections 2024-09-13T18:35:42.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.436+0000 7fc06cc17700 1 -- 172.21.15.44:0/3688936844 wait complete. 2024-09-13T18:35:42.446 INFO:teuthology.orchestra.run.smithi044.stderr: removed all blocklist entries 2024-09-13T18:35:42.462 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:35:42.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.620+0000 7fb8192e7700 1 Processor -- start 2024-09-13T18:35:42.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.620+0000 7fb8192e7700 1 -- start start 2024-09-13T18:35:42.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.624+0000 7fb8192e7700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb80c034ad0 0x7fb80c00c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:42.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.624+0000 7fb8192e7700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb80c04fd70 0x7fb80c007830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:42.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.624+0000 7fb8192e7700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb80c00ae90 con 0x7fb80c0df930 2024-09-13T18:35:42.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.624+0000 7fb8192e7700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb80c039520 con 0x7fb80c034ad0 2024-09-13T18:35:42.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.624+0000 7fb8192e7700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c052a50 con 0x7fb80c04fd70 2024-09-13T18:35:42.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.624+0000 7fb818ae6700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb80c04fd70 0x7fb80c007830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:42.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.624+0000 7fb8137fe700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb80c034ad0 0x7fb80c00c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:42.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.624+0000 7fb813fff700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb80c0df930 0x7fb80c038e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:55450/0 (socket says 172.21.15.44:55450) 2024-09-13T18:35:42.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.624+0000 7fb813fff700 1 -- 172.21.15.44:0/2380580651 learned_addr learned my addr 172.21.15.44:0/2380580651 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:42.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.624+0000 7fb818ae6700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb80c04fd70 0x7fb80c007830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:53944/0 (socket says 172.21.15.44:53944) 2024-09-13T18:35:42.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.624+0000 7fb818ae6700 1 -- 172.21.15.44:0/2380580651 >> v2:172.21.15.99:3300/0 conn(0x7fb80c034ad0 msgr2=0x7fb80c00c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:42.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.624+0000 7fb818ae6700 1 --2- 172.21.15.44:0/2380580651 >> v2:172.21.15.99:3300/0 conn(0x7fb80c034ad0 0x7fb80c00c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.624+0000 7fb818ae6700 1 -- 172.21.15.44:0/2380580651 >> v1:172.21.15.99:6789/0 conn(0x7fb80c0df930 legacy=0x7fb80c038e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:42.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.624+0000 7fb818ae6700 1 -- 172.21.15.44:0/2380580651 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c052cf0 con 0x7fb80c04fd70 2024-09-13T18:35:42.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.624+0000 7fb8137fe700 1 --2- 172.21.15.44:0/2380580651 >> v2:172.21.15.99:3300/0 conn(0x7fb80c034ad0 0x7fb80c00c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:42.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.624+0000 7fb818ae6700 1 --2- 172.21.15.44:0/2380580651 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb80c04fd70 0x7fb80c007830 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb81404f480 tx=0x7fb814074840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f35abfbac85be8d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:42.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.624+0000 7fb812ffd700 1 -- 172.21.15.44:0/2380580651 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81404f010 con 0x7fb80c04fd70 2024-09-13T18:35:42.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.628+0000 7fb812ffd700 1 -- 172.21.15.44:0/2380580651 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8140730f0 con 0x7fb80c04fd70 2024-09-13T18:35:42.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.628+0000 7fb812ffd700 1 -- 172.21.15.44:0/2380580651 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8140734c0 con 0x7fb80c04fd70 2024-09-13T18:35:42.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.628+0000 7fb8192e7700 1 -- 172.21.15.44:0/2380580651 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb80c04fd70 msgr2=0x7fb80c007830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:42.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.628+0000 7fb8192e7700 1 --2- 172.21.15.44:0/2380580651 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb80c04fd70 0x7fb80c007830 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb81404f480 tx=0x7fb814074840 comp rx=0 tx=0).stop 2024-09-13T18:35:42.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.628+0000 7fb8192e7700 1 -- 172.21.15.44:0/2380580651 shutdown_connections 2024-09-13T18:35:42.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.628+0000 7fb8192e7700 1 --2- 172.21.15.44:0/2380580651 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb80c04fd70 0x7fb80c007830 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.628+0000 7fb8192e7700 1 --2- 172.21.15.44:0/2380580651 >> v2:172.21.15.99:3300/0 conn(0x7fb80c034ad0 0x7fb80c00c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.628+0000 7fb8192e7700 1 -- 172.21.15.44:0/2380580651 >> 172.21.15.44:0/2380580651 conn(0x7fb80c01eb00 msgr2=0x7fb80c038700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:42.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.628+0000 7fb8192e7700 1 -- 172.21.15.44:0/2380580651 shutdown_connections 2024-09-13T18:35:42.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.628+0000 7fb8192e7700 1 -- 172.21.15.44:0/2380580651 wait complete. 2024-09-13T18:35:42.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb8192e7700 1 Processor -- start 2024-09-13T18:35:42.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb8192e7700 1 -- start start 2024-09-13T18:35:42.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb8192e7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb80c034ad0 0x7fb80c173ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:42.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb8192e7700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb80c04fd70 0x7fb80c0dfd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:42.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb8192e7700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb80c0df930 0x7fb80c01f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:42.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb8192e7700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c174020 con 0x7fb80c034ad0 2024-09-13T18:35:42.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb8192e7700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c0e1170 con 0x7fb80c0df930 2024-09-13T18:35:42.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb8192e7700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c0e0560 con 0x7fb80c04fd70 2024-09-13T18:35:42.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb813fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb80c034ad0 0x7fb80c173ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:42.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb813fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb80c034ad0 0x7fb80c173ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37576/0 (socket says 172.21.15.44:37576) 2024-09-13T18:35:42.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb813fff700 1 -- 172.21.15.44:0/3593878169 learned_addr learned my addr 172.21.15.44:0/3593878169 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:42.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb8137fe700 1 --2- 172.21.15.44:0/3593878169 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb80c04fd70 0x7fb80c0dfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:42.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb818ae6700 1 --2- 172.21.15.44:0/3593878169 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb80c0df930 0x7fb80c01f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:42.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb813fff700 1 -- 172.21.15.44:0/3593878169 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb80c04fd70 msgr2=0x7fb80c0dfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:42.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb813fff700 1 --2- 172.21.15.44:0/3593878169 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb80c04fd70 0x7fb80c0dfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb813fff700 1 -- 172.21.15.44:0/3593878169 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb80c0df930 msgr2=0x7fb80c01f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:42.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb813fff700 1 --2- 172.21.15.44:0/3593878169 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb80c0df930 0x7fb80c01f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb813fff700 1 -- 172.21.15.44:0/3593878169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80400b750 con 0x7fb80c034ad0 2024-09-13T18:35:42.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb813fff700 1 --2- 172.21.15.44:0/3593878169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb80c034ad0 0x7fb80c173ae0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fb80800c4d0 tx=0x7fb80800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:42.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb810ff9700 1 -- 172.21.15.44:0/3593878169 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb808005de0 con 0x7fb80c034ad0 2024-09-13T18:35:42.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb810ff9700 1 -- 172.21.15.44:0/3593878169 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80800ce80 con 0x7fb80c034ad0 2024-09-13T18:35:42.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb8192e7700 1 -- 172.21.15.44:0/3593878169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb81404f5c0 con 0x7fb80c034ad0 2024-09-13T18:35:42.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb810ff9700 1 -- 172.21.15.44:0/3593878169 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8080072d0 con 0x7fb80c034ad0 2024-09-13T18:35:42.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.632+0000 7fb8192e7700 1 -- 172.21.15.44:0/3593878169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb80c0e0b20 con 0x7fb80c034ad0 2024-09-13T18:35:42.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.636+0000 7fb8192e7700 1 -- 172.21.15.44:0/3593878169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80c00b320 con 0x7fb80c034ad0 2024-09-13T18:35:42.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.636+0000 7fb810ff9700 1 -- 172.21.15.44:0/3593878169 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb808007430 con 0x7fb80c034ad0 2024-09-13T18:35:42.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.636+0000 7fb810ff9700 1 --2- 172.21.15.44:0/3593878169 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb800066730 0x7fb800068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:42.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.636+0000 7fb810ff9700 1 -- 172.21.15.44:0/3593878169 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb808083040 con 0x7fb80c034ad0 2024-09-13T18:35:42.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.636+0000 7fb8137fe700 1 --2- 172.21.15.44:0/3593878169 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb800066730 0x7fb800068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:42.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.636+0000 7fb8137fe700 1 --2- 172.21.15.44:0/3593878169 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb800066730 0x7fb800068bf0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb80c04c730 tx=0x7fb80400b450 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:42.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.644+0000 7fb810ff9700 1 -- 172.21.15.44:0/3593878169 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb808050720 con 0x7fb80c034ad0 2024-09-13T18:35:42.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.884+0000 7fb8192e7700 1 -- 172.21.15.44:0/3593878169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb80c04f5f0 con 0x7fb80c034ad0 2024-09-13T18:35:42.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.884+0000 7fb810ff9700 1 -- 172.21.15.44:0/3593878169 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb808017090 con 0x7fb80c034ad0 2024-09-13T18:35:42.892 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:42.892 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:35:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_dump": [ 2024-09-13T18:35:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.a", 2024-09-13T18:35:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rmm4/RGxAAtGPYfgzYpmE4yHhoggZJ8Q==", 2024-09-13T18:35:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:35:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:35:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:35:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:35:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:35:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.b", 2024-09-13T18:35:42.894 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rm8qC+JhAAhdkL3zbxM9+GI8+khy+cSg==", 2024-09-13T18:35:42.894 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:35:42.894 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:35:42.894 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:35:42.894 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:35:42.894 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:35:42.894 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:42.894 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:42.894 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.c", 2024-09-13T18:35:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rmr/OCIhAAvBF106ILl0AZlzCZ+S990Q==", 2024-09-13T18:35:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:35:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:35:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:35:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:35:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:35:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.d", 2024-09-13T18:35:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+RmSHbxKRAAAGsAWnIPUDUk3Y0aYryf+w==", 2024-09-13T18:35:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:35:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:35:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:35:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:35:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:35:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.0", 2024-09-13T18:35:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC6g+Rmw8xKHxAArYof7SeFMvQGq5AnVMbiog==", 2024-09-13T18:35:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:35:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:35:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:35:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:35:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.1", 2024-09-13T18:35:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC9g+RmLRFsMxAAC0SXlbIRvFc3byOy742GSg==", 2024-09-13T18:35:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:35:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:35:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:35:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:35:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.2", 2024-09-13T18:35:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDAg+RmvbTXNxAAyoLLo9RMD7817x8cdlYjWg==", 2024-09-13T18:35:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:35:42.898 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:35:42.898 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:35:42.898 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:35:42.898 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:42.898 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:42.898 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:42.898 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.3", 2024-09-13T18:35:42.898 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDDg+Rm4/jKOhAAYVOXNUkd3Z9CXAzbxJw34g==", 2024-09-13T18:35:42.898 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:35:42.899 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:35:42.899 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:35:42.899 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:35:42.899 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:42.899 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:42.899 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:42.899 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.4", 2024-09-13T18:35:42.899 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDJg+RmEZwhJBAAqtUZtMmRzRulAa6cnyvSmQ==", 2024-09-13T18:35:42.899 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:35:42.899 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:35:42.899 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:35:42.899 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:35:42.899 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:42.899 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:42.900 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:42.900 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.5", 2024-09-13T18:35:42.900 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDMg+RmCqBKKRAA7oP48mScYw7mkNGahg+ptw==", 2024-09-13T18:35:42.900 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:35:42.900 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:35:42.900 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:35:42.900 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:35:42.900 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:42.900 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:42.900 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:42.900 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.6", 2024-09-13T18:35:42.900 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDPg+RmbjDyLxAAIRb9i9TtRsDg+M9SnEegug==", 2024-09-13T18:35:42.900 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:35:42.901 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:35:42.901 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:35:42.901 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:35:42.901 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:42.901 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:42.901 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:42.901 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.7", 2024-09-13T18:35:42.901 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDSg+RmA4v7NhAAVe6GV0DVksIWiq6KQvMgVg==", 2024-09-13T18:35:42.901 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:35:42.901 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:35:42.901 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:35:42.901 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:35:42.901 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:42.901 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:42.902 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:42.902 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.0", 2024-09-13T18:35:42.902 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rm7FEGMBAAosZ34edcGJmTiY8UhPtung==", 2024-09-13T18:35:42.902 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:35:42.902 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:35:42.902 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow r", 2024-09-13T18:35:42.902 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:35:42.902 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:42.902 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:42.902 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:42.902 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.1", 2024-09-13T18:35:42.902 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rmpu2zNhAAc0mOfL8c/MYij8KYpvsjRw==", 2024-09-13T18:35:42.902 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:35:42.902 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:35:42.903 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-13T18:35:42.903 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-13T18:35:42.903 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-13T18:35:42.903 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:42.903 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:42.903 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:42.903 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.2", 2024-09-13T18:35:42.903 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rm0xw5MxAAWu4i4+IAjW5QzQwiILs6bg==", 2024-09-13T18:35:42.903 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:35:42.903 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:35:42.903 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-13T18:35:42.903 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-13T18:35:42.903 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-13T18:35:42.903 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:42.904 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:42.904 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:42.904 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.3", 2024-09-13T18:35:42.904 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+RmZdTZORAA26aYb0Nz0g+rRBG+zAu/EQ==", 2024-09-13T18:35:42.904 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:35:42.904 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:35:42.904 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-13T18:35:42.904 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-13T18:35:42.904 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-13T18:35:42.904 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:42.904 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:42.904 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:42.904 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.admin", 2024-09-13T18:35:42.905 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+RmVt6IDBAALp4ZMLL2ehaE9O4vCSZzxQ==", 2024-09-13T18:35:42.905 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:35:42.905 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-13T18:35:42.905 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:35:42.905 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:35:42.905 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:35:42.905 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:42.905 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:42.905 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:42.905 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.x", 2024-09-13T18:35:42.905 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+RmBmEBGBAARTj0TQ0laAEW0n888vMZrA==", 2024-09-13T18:35:42.905 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:35:42.905 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-13T18:35:42.905 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-13T18:35:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:35:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.y", 2024-09-13T18:35:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rm1KSoFBAALCTzYRRxF7MPxQHL3ETGqQ==", 2024-09-13T18:35:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:35:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-13T18:35:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-13T18:35:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:35:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:42.906 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-13T18:35:42.906 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:35:42.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.888+0000 7fb8192e7700 1 -- 172.21.15.44:0/3593878169 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb800066730 msgr2=0x7fb800068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:42.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.888+0000 7fb8192e7700 1 --2- 172.21.15.44:0/3593878169 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb800066730 0x7fb800068bf0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb80c04c730 tx=0x7fb80400b450 comp rx=0 tx=0).stop 2024-09-13T18:35:42.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.888+0000 7fb8192e7700 1 -- 172.21.15.44:0/3593878169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb80c034ad0 msgr2=0x7fb80c173ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:42.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.888+0000 7fb8192e7700 1 --2- 172.21.15.44:0/3593878169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb80c034ad0 0x7fb80c173ae0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fb80800c4d0 tx=0x7fb80800c7e0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.888+0000 7fb8192e7700 1 -- 172.21.15.44:0/3593878169 shutdown_connections 2024-09-13T18:35:42.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.888+0000 7fb8192e7700 1 --2- 172.21.15.44:0/3593878169 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb800066730 0x7fb800068bf0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.888+0000 7fb8192e7700 1 --2- 172.21.15.44:0/3593878169 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb80c0df930 0x7fb80c01f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.888+0000 7fb8192e7700 1 --2- 172.21.15.44:0/3593878169 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb80c04fd70 0x7fb80c0dfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.888+0000 7fb8192e7700 1 --2- 172.21.15.44:0/3593878169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb80c034ad0 0x7fb80c173ae0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.888+0000 7fb8192e7700 1 -- 172.21.15.44:0/3593878169 >> 172.21.15.44:0/3593878169 conn(0x7fb80c01eb00 msgr2=0x7fb80c04eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:42.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.888+0000 7fb8192e7700 1 -- 172.21.15.44:0/3593878169 shutdown_connections 2024-09-13T18:35:42.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:42.888+0000 7fb8192e7700 1 -- 172.21.15.44:0/3593878169 wait complete. 2024-09-13T18:35:42.910 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.024+0000 7f7f29d29700 1 Processor -- start 2024-09-13T18:35:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.024+0000 7f7f29d29700 1 -- start start 2024-09-13T18:35:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.024+0000 7f7f29d29700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7f240b3ae0 0x7f7f2406cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.024+0000 7f7f29d29700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f2406aa90 0x7f7f240ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.024+0000 7f7f29d29700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2406af40 con 0x7f7f24159720 2024-09-13T18:35:43.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.024+0000 7f7f29d29700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2406d690 con 0x7f7f240b3ae0 2024-09-13T18:35:43.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.024+0000 7f7f29d29700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f240cbfe0 con 0x7f7f2406aa90 2024-09-13T18:35:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.028+0000 7f7f23fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7f240b3ae0 0x7f7f2406cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.028+0000 7f7f23fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7f240b3ae0 0x7f7f2406cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:49776/0 (socket says 172.21.15.44:49776) 2024-09-13T18:35:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.028+0000 7f7f29528700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f2406aa90 0x7f7f240ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.028+0000 7f7f23fff700 1 -- 172.21.15.44:0/1131144989 learned_addr learned my addr 172.21.15.44:0/1131144989 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.028+0000 7f7f28d27700 1 --1- 172.21.15.44:0/1131144989 >> v1:172.21.15.99:6789/0 conn(0x7f7f24159720 0x7f7f240b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:55460/0 (socket says 172.21.15.44:55460) 2024-09-13T18:35:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.028+0000 7f7f29528700 1 -- 172.21.15.44:0/1131144989 >> v2:172.21.15.99:3300/0 conn(0x7f7f240b3ae0 msgr2=0x7f7f2406cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.028+0000 7f7f29528700 1 --2- 172.21.15.44:0/1131144989 >> v2:172.21.15.99:3300/0 conn(0x7f7f240b3ae0 0x7f7f2406cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.028+0000 7f7f29528700 1 -- 172.21.15.44:0/1131144989 >> v1:172.21.15.99:6789/0 conn(0x7f7f24159720 legacy=0x7f7f240b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.028+0000 7f7f29528700 1 -- 172.21.15.44:0/1131144989 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f240cc2c0 con 0x7f7f2406aa90 2024-09-13T18:35:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.028+0000 7f7f29528700 1 --2- 172.21.15.44:0/1131144989 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f2406aa90 0x7f7f240ccac0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009d90 tx=0x7f7f1c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d2e438f1bf25591 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.028+0000 7f7f237fe700 1 -- 172.21.15.44:0/1131144989 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c00e070 con 0x7f7f2406aa90 2024-09-13T18:35:43.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.028+0000 7f7f237fe700 1 -- 172.21.15.44:0/1131144989 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1c00bb20 con 0x7f7f2406aa90 2024-09-13T18:35:43.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.028+0000 7f7f237fe700 1 -- 172.21.15.44:0/1131144989 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c012430 con 0x7f7f2406aa90 2024-09-13T18:35:43.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.028+0000 7f7f29d29700 1 -- 172.21.15.44:0/1131144989 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f2406aa90 msgr2=0x7f7f240ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.028+0000 7f7f29d29700 1 --2- 172.21.15.44:0/1131144989 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f2406aa90 0x7f7f240ccac0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009d90 tx=0x7f7f1c00b330 comp rx=0 tx=0).stop 2024-09-13T18:35:43.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.028+0000 7f7f29d29700 1 -- 172.21.15.44:0/1131144989 shutdown_connections 2024-09-13T18:35:43.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.028+0000 7f7f29d29700 1 --2- 172.21.15.44:0/1131144989 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f2406aa90 0x7f7f240ccac0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.028+0000 7f7f29d29700 1 --2- 172.21.15.44:0/1131144989 >> v2:172.21.15.99:3300/0 conn(0x7f7f240b3ae0 0x7f7f2406cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.028+0000 7f7f29d29700 1 -- 172.21.15.44:0/1131144989 >> 172.21.15.44:0/1131144989 conn(0x7f7f240b0f00 msgr2=0x7f7f240b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:43.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.028+0000 7f7f29d29700 1 -- 172.21.15.44:0/1131144989 shutdown_connections 2024-09-13T18:35:43.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.028+0000 7f7f29d29700 1 -- 172.21.15.44:0/1131144989 wait complete. 2024-09-13T18:35:43.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.032+0000 7f7f29d29700 1 Processor -- start 2024-09-13T18:35:43.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.032+0000 7f7f29d29700 1 -- start start 2024-09-13T18:35:43.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.032+0000 7f7f29d29700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f2406aa90 0x7f7f241f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.032+0000 7f7f29d29700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f240b3ae0 0x7f7f24153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.032+0000 7f7f29d29700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f24159720 0x7f7f2415a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.032+0000 7f7f29d29700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f24146f20 con 0x7f7f2406aa90 2024-09-13T18:35:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.032+0000 7f7f29d29700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f241f70e0 con 0x7f7f24159720 2024-09-13T18:35:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.032+0000 7f7f29d29700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f241523f0 con 0x7f7f240b3ae0 2024-09-13T18:35:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.032+0000 7f7f28d27700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f2406aa90 0x7f7f241f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.032+0000 7f7f23fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f240b3ae0 0x7f7f24153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.032+0000 7f7f28d27700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f2406aa90 0x7f7f241f6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37588/0 (socket says 172.21.15.44:37588) 2024-09-13T18:35:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.032+0000 7f7f28d27700 1 -- 172.21.15.44:0/1135079294 learned_addr learned my addr 172.21.15.44:0/1135079294 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.032+0000 7f7f29528700 1 --2- 172.21.15.44:0/1135079294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f24159720 0x7f7f2415a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.032+0000 7f7f28d27700 1 -- 172.21.15.44:0/1135079294 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f240b3ae0 msgr2=0x7f7f24153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.032+0000 7f7f28d27700 1 --2- 172.21.15.44:0/1135079294 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f240b3ae0 0x7f7f24153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.032+0000 7f7f28d27700 1 -- 172.21.15.44:0/1135079294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f24159720 msgr2=0x7f7f2415a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.032+0000 7f7f28d27700 1 --2- 172.21.15.44:0/1135079294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f24159720 0x7f7f2415a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.032+0000 7f7f28d27700 1 -- 172.21.15.44:0/1135079294 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1c009a70 con 0x7f7f2406aa90 2024-09-13T18:35:43.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.032+0000 7f7f28d27700 1 --2- 172.21.15.44:0/1135079294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f2406aa90 0x7f7f241f6ba0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c00c410 tx=0x7f7f0c00c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.032+0000 7f7f217fa700 1 -- 172.21.15.44:0/1135079294 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c005cd0 con 0x7f7f2406aa90 2024-09-13T18:35:43.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.032+0000 7f7f217fa700 1 -- 172.21.15.44:0/1135079294 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0c005e30 con 0x7f7f2406aa90 2024-09-13T18:35:43.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.032+0000 7f7f29d29700 1 -- 172.21.15.44:0/1135079294 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f241526d0 con 0x7f7f2406aa90 2024-09-13T18:35:43.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.032+0000 7f7f217fa700 1 -- 172.21.15.44:0/1135079294 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c0072f0 con 0x7f7f2406aa90 2024-09-13T18:35:43.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.036+0000 7f7f29d29700 1 -- 172.21.15.44:0/1135079294 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f24152c90 con 0x7f7f2406aa90 2024-09-13T18:35:43.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.036+0000 7f7f217fa700 1 -- 172.21.15.44:0/1135079294 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7f0c007450 con 0x7f7f2406aa90 2024-09-13T18:35:43.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.036+0000 7f7f29d29700 1 -- 172.21.15.44:0/1135079294 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f24159b00 con 0x7f7f2406aa90 2024-09-13T18:35:43.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.036+0000 7f7f217fa700 1 --2- 172.21.15.44:0/1135079294 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7f04066730 0x7f7f04068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.040+0000 7f7f217fa700 1 -- 172.21.15.44:0/1135079294 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7f0c0831e0 con 0x7f7f2406aa90 2024-09-13T18:35:43.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.040+0000 7f7f23fff700 1 --2- 172.21.15.44:0/1135079294 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7f04066730 0x7f7f04068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.040+0000 7f7f23fff700 1 --2- 172.21.15.44:0/1135079294 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7f04066730 0x7f7f04068bf0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7f241579b0 tx=0x7f7f140092e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.044+0000 7f7f217fa700 1 -- 172.21.15.44:0/1135079294 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7f0c050820 con 0x7f7f2406aa90 2024-09-13T18:35:43.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.224+0000 7f7f29d29700 1 -- 172.21.15.44:0/1135079294 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f240ccac0 con 0x7f7f2406aa90 2024-09-13T18:35:43.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.228+0000 7f7f217fa700 1 -- 172.21.15.44:0/1135079294 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+12797 (secure 0 0 0) 0x7f7f0c053e40 con 0x7f7f2406aa90 2024-09-13T18:35:43.234 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:43.235 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":74,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:35:42.425879+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:43.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.232+0000 7f7f29d29700 1 -- 172.21.15.44:0/1135079294 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7f04066730 msgr2=0x7f7f04068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.232+0000 7f7f29d29700 1 --2- 172.21.15.44:0/1135079294 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7f04066730 0x7f7f04068bf0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7f241579b0 tx=0x7f7f140092e0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.232+0000 7f7f29d29700 1 -- 172.21.15.44:0/1135079294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f2406aa90 msgr2=0x7f7f241f6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.232+0000 7f7f29d29700 1 --2- 172.21.15.44:0/1135079294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f2406aa90 0x7f7f241f6ba0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c00c410 tx=0x7f7f0c00c720 comp rx=0 tx=0).stop 2024-09-13T18:35:43.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.232+0000 7f7f29d29700 1 -- 172.21.15.44:0/1135079294 shutdown_connections 2024-09-13T18:35:43.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.232+0000 7f7f29d29700 1 --2- 172.21.15.44:0/1135079294 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7f04066730 0x7f7f04068bf0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.232+0000 7f7f29d29700 1 --2- 172.21.15.44:0/1135079294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f24159720 0x7f7f2415a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.232+0000 7f7f29d29700 1 --2- 172.21.15.44:0/1135079294 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7f240b3ae0 0x7f7f24153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.232+0000 7f7f29d29700 1 --2- 172.21.15.44:0/1135079294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f2406aa90 0x7f7f241f6ba0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.232+0000 7f7f29d29700 1 -- 172.21.15.44:0/1135079294 >> 172.21.15.44:0/1135079294 conn(0x7f7f240b0f00 msgr2=0x7f7f240b2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:43.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.232+0000 7f7f29d29700 1 -- 172.21.15.44:0/1135079294 shutdown_connections 2024-09-13T18:35:43.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.232+0000 7f7f29d29700 1 -- 172.21.15.44:0/1135079294 wait complete. 2024-09-13T18:35:43.251 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:35:43.251 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:35:43.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.368+0000 7fc48e913700 1 Processor -- start 2024-09-13T18:35:43.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.368+0000 7fc48e913700 1 -- start start 2024-09-13T18:35:43.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.368+0000 7fc48e913700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc48806b5f0 0x7fc48806a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.368+0000 7fc48e913700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc48815ce70 0x7fc4880cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.368+0000 7fc48e913700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4880d1bc0 con 0x7fc48815ca90 2024-09-13T18:35:43.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.368+0000 7fc48e913700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4880cdac0 con 0x7fc48815ce70 2024-09-13T18:35:43.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.368+0000 7fc48e913700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48806ac20 con 0x7fc48806b5f0 2024-09-13T18:35:43.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.368+0000 7fc48d911700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc48815ca90 0x7fc48806aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43796/0 (socket says 172.21.15.44:43796) 2024-09-13T18:35:43.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.368+0000 7fc48d911700 1 -- 172.21.15.44:0/3014227132 learned_addr learned my addr 172.21.15.44:0/3014227132 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:43.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.372+0000 7fc48d110700 1 --2- 172.21.15.44:0/3014227132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc48806b5f0 0x7fc48806a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.372+0000 7fc48e112700 1 --2- 172.21.15.44:0/3014227132 >> v2:172.21.15.99:3300/0 conn(0x7fc48815ce70 0x7fc4880cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.372+0000 7fc48c90f700 1 -- 172.21.15.44:0/3014227132 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 715290016 0 0) 0x7fc4880d1bc0 con 0x7fc48815ca90 2024-09-13T18:35:43.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.372+0000 7fc48c90f700 1 -- 172.21.15.44:0/3014227132 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4740035d0 con 0x7fc48815ca90 2024-09-13T18:35:43.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.372+0000 7fc48e112700 1 -- 172.21.15.44:0/3014227132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc48806b5f0 msgr2=0x7fc48806a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:43.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.372+0000 7fc48e112700 1 --2- 172.21.15.44:0/3014227132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc48806b5f0 0x7fc48806a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.372+0000 7fc48e112700 1 -- 172.21.15.44:0/3014227132 >> v1:172.21.15.44:6789/0 conn(0x7fc48815ca90 legacy=0x7fc48806aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.372+0000 7fc48e112700 1 -- 172.21.15.44:0/3014227132 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4880d1290 con 0x7fc48815ce70 2024-09-13T18:35:43.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.372+0000 7fc48e112700 1 --2- 172.21.15.44:0/3014227132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc48815ce70 0x7fc4880cdec0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc480009d90 tx=0x7fc48000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e56f4dd4470814d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.372+0000 7fc48c90f700 1 -- 172.21.15.44:0/3014227132 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48000e070 con 0x7fc48815ce70 2024-09-13T18:35:43.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.372+0000 7fc48c90f700 1 -- 172.21.15.44:0/3014227132 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48000bb20 con 0x7fc48815ce70 2024-09-13T18:35:43.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.372+0000 7fc48c90f700 1 -- 172.21.15.44:0/3014227132 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48000be90 con 0x7fc48815ce70 2024-09-13T18:35:43.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.372+0000 7fc48e913700 1 -- 172.21.15.44:0/3014227132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc48815ce70 msgr2=0x7fc4880cdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.372+0000 7fc48e913700 1 --2- 172.21.15.44:0/3014227132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc48815ce70 0x7fc4880cdec0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc480009d90 tx=0x7fc48000b330 comp rx=0 tx=0).stop 2024-09-13T18:35:43.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.372+0000 7fc48e913700 1 -- 172.21.15.44:0/3014227132 shutdown_connections 2024-09-13T18:35:43.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.372+0000 7fc48e913700 1 --2- 172.21.15.44:0/3014227132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc48815ce70 0x7fc4880cdec0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.372+0000 7fc48e913700 1 --2- 172.21.15.44:0/3014227132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc48806b5f0 0x7fc48806a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.372+0000 7fc48e913700 1 -- 172.21.15.44:0/3014227132 >> 172.21.15.44:0/3014227132 conn(0x7fc4880d2c10 msgr2=0x7fc4880d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:43.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.372+0000 7fc48e913700 1 -- 172.21.15.44:0/3014227132 shutdown_connections 2024-09-13T18:35:43.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.372+0000 7fc48e913700 1 -- 172.21.15.44:0/3014227132 wait complete. 2024-09-13T18:35:43.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.376+0000 7fc48e913700 1 Processor -- start 2024-09-13T18:35:43.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.376+0000 7fc48e913700 1 -- start start 2024-09-13T18:35:43.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.376+0000 7fc48e913700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc48806b5f0 0x7fc48815a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.376+0000 7fc48e913700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc48815ca90 0x7fc4880cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.376+0000 7fc48e913700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc48815ce70 0x7fc4880cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.376+0000 7fc48e913700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4880cbab0 con 0x7fc48815ca90 2024-09-13T18:35:43.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.376+0000 7fc48e913700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4880caa10 con 0x7fc48806b5f0 2024-09-13T18:35:43.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.376+0000 7fc48e913700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4880cacf0 con 0x7fc48815ce70 2024-09-13T18:35:43.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.376+0000 7fc48d110700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc48815ca90 0x7fc4880cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.376+0000 7fc48d110700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc48815ca90 0x7fc4880cc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37594/0 (socket says 172.21.15.44:37594) 2024-09-13T18:35:43.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.376+0000 7fc48d110700 1 -- 172.21.15.44:0/4197543908 learned_addr learned my addr 172.21.15.44:0/4197543908 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:43.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.376+0000 7fc48e112700 1 --2- 172.21.15.44:0/4197543908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc48815ce70 0x7fc4880cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.376+0000 7fc48d911700 1 --2- 172.21.15.44:0/4197543908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc48806b5f0 0x7fc48815a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.376+0000 7fc48d110700 1 -- 172.21.15.44:0/4197543908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc48815ce70 msgr2=0x7fc4880cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.376+0000 7fc48d110700 1 --2- 172.21.15.44:0/4197543908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc48815ce70 0x7fc4880cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.376+0000 7fc48d110700 1 -- 172.21.15.44:0/4197543908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc48806b5f0 msgr2=0x7fc48815a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.376+0000 7fc48d110700 1 --2- 172.21.15.44:0/4197543908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc48806b5f0 0x7fc48815a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.376+0000 7fc48d110700 1 -- 172.21.15.44:0/4197543908 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc480009a70 con 0x7fc48815ca90 2024-09-13T18:35:43.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.376+0000 7fc48d110700 1 --2- 172.21.15.44:0/4197543908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc48815ca90 0x7fc4880cc120 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fc48400e840 tx=0x7fc48400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.376+0000 7fc47e7fc700 1 -- 172.21.15.44:0/4197543908 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4840095a0 con 0x7fc48815ca90 2024-09-13T18:35:43.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.380+0000 7fc47e7fc700 1 -- 172.21.15.44:0/4197543908 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc484013680 con 0x7fc48815ca90 2024-09-13T18:35:43.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.380+0000 7fc47e7fc700 1 -- 172.21.15.44:0/4197543908 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4840139f0 con 0x7fc48815ca90 2024-09-13T18:35:43.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.380+0000 7fc48e913700 1 -- 172.21.15.44:0/4197543908 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4880cafd0 con 0x7fc48815ca90 2024-09-13T18:35:43.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.380+0000 7fc48e913700 1 -- 172.21.15.44:0/4197543908 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4880cb590 con 0x7fc48815ca90 2024-09-13T18:35:43.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.380+0000 7fc48e913700 1 -- 172.21.15.44:0/4197543908 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4880d1b90 con 0x7fc48815ca90 2024-09-13T18:35:43.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.380+0000 7fc47e7fc700 1 -- 172.21.15.44:0/4197543908 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc484013b50 con 0x7fc48815ca90 2024-09-13T18:35:43.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.380+0000 7fc47e7fc700 1 --2- 172.21.15.44:0/4197543908 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc46c066730 0x7fc46c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.380+0000 7fc47e7fc700 1 -- 172.21.15.44:0/4197543908 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc484083c70 con 0x7fc48815ca90 2024-09-13T18:35:43.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.380+0000 7fc48d911700 1 --2- 172.21.15.44:0/4197543908 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc46c066730 0x7fc46c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.384+0000 7fc48d911700 1 --2- 172.21.15.44:0/4197543908 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc46c066730 0x7fc46c068bf0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc478007fd0 tx=0x7fc478009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.388+0000 7fc47e7fc700 1 -- 172.21.15.44:0/4197543908 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc484051330 con 0x7fc48815ca90 2024-09-13T18:35:43.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.560+0000 7fc48e913700 1 -- 172.21.15.44:0/4197543908 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc48806a520 con 0x7fc48815ca90 2024-09-13T18:35:43.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.564+0000 7fc47e7fc700 1 -- 172.21.15.44:0/4197543908 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc484017020 con 0x7fc48815ca90 2024-09-13T18:35:43.569 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:35:43.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.564+0000 7fc48e913700 1 -- 172.21.15.44:0/4197543908 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc46c066730 msgr2=0x7fc46c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.564+0000 7fc48e913700 1 --2- 172.21.15.44:0/4197543908 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc46c066730 0x7fc46c068bf0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc478007fd0 tx=0x7fc478009040 comp rx=0 tx=0).stop 2024-09-13T18:35:43.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.564+0000 7fc48e913700 1 -- 172.21.15.44:0/4197543908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc48815ca90 msgr2=0x7fc4880cc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.564+0000 7fc48e913700 1 --2- 172.21.15.44:0/4197543908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc48815ca90 0x7fc4880cc120 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fc48400e840 tx=0x7fc48400eb50 comp rx=0 tx=0).stop 2024-09-13T18:35:43.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.564+0000 7fc48e913700 1 -- 172.21.15.44:0/4197543908 shutdown_connections 2024-09-13T18:35:43.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.564+0000 7fc48e913700 1 --2- 172.21.15.44:0/4197543908 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc46c066730 0x7fc46c068bf0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.564+0000 7fc48e913700 1 --2- 172.21.15.44:0/4197543908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc48815ce70 0x7fc4880cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.564+0000 7fc48e913700 1 --2- 172.21.15.44:0/4197543908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc48815ca90 0x7fc4880cc120 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.564+0000 7fc48e913700 1 --2- 172.21.15.44:0/4197543908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc48806b5f0 0x7fc48815a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.564+0000 7fc48e913700 1 -- 172.21.15.44:0/4197543908 >> 172.21.15.44:0/4197543908 conn(0x7fc4880d2c10 msgr2=0x7fc48815d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:43.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.564+0000 7fc48e913700 1 -- 172.21.15.44:0/4197543908 shutdown_connections 2024-09-13T18:35:43.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.564+0000 7fc48e913700 1 -- 172.21.15.44:0/4197543908 wait complete. 2024-09-13T18:35:43.585 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:35:43.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1516591700 1 Processor -- start 2024-09-13T18:35:43.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1516591700 1 -- start start 2024-09-13T18:35:43.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1516591700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1510162130 0x7f151006b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1516591700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f151006ccf0 0x7f151006d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1516591700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f151006a3b0 con 0x7f15100b31c0 2024-09-13T18:35:43.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1516591700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f151006b030 con 0x7f1510162130 2024-09-13T18:35:43.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1516591700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151006a690 con 0x7f151006ccf0 2024-09-13T18:35:43.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f151558f700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f15100b31c0 0x7f15100b35a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43804/0 (socket says 172.21.15.44:43804) 2024-09-13T18:35:43.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f151558f700 1 -- 172.21.15.44:0/4085798990 learned_addr learned my addr 172.21.15.44:0/4085798990 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:43.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1514d8e700 1 --2- 172.21.15.44:0/4085798990 >> v2:172.21.15.99:3300/0 conn(0x7f1510162130 0x7f151006b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1515d90700 1 --2- 172.21.15.44:0/4085798990 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f151006ccf0 0x7f151006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1503fff700 1 -- 172.21.15.44:0/4085798990 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899891312 0 0) 0x7f151006a3b0 con 0x7f15100b31c0 2024-09-13T18:35:43.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1503fff700 1 -- 172.21.15.44:0/4085798990 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14fc0035d0 con 0x7f15100b31c0 2024-09-13T18:35:43.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1503fff700 1 -- 172.21.15.44:0/4085798990 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1313007834 0 0) 0x7f14fc0035d0 con 0x7f15100b31c0 2024-09-13T18:35:43.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1503fff700 1 -- 172.21.15.44:0/4085798990 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f151006ccf0 msgr2=0x7f151006d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:43.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1503fff700 1 --2- 172.21.15.44:0/4085798990 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f151006ccf0 0x7f151006d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1503fff700 1 -- 172.21.15.44:0/4085798990 >> v2:172.21.15.99:3300/0 conn(0x7f1510162130 msgr2=0x7f151006b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:43.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1503fff700 1 --2- 172.21.15.44:0/4085798990 >> v2:172.21.15.99:3300/0 conn(0x7f1510162130 0x7f151006b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1503fff700 1 -- 172.21.15.44:0/4085798990 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151006a970 con 0x7f15100b31c0 2024-09-13T18:35:43.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1503fff700 1 -- 172.21.15.44:0/4085798990 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f1504001670 con 0x7f15100b31c0 2024-09-13T18:35:43.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1503fff700 1 -- 172.21.15.44:0/4085798990 >> v1:172.21.15.44:6789/0 conn(0x7f15100b31c0 legacy=0x7f15100b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1503fff700 1 --2- 172.21.15.44:0/4085798990 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f151006ccf0 0x7f14fc003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1503fff700 1 --2- 172.21.15.44:0/4085798990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14fc003fa0 0x7f14fc004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1503fff700 1 --2- 172.21.15.44:0/4085798990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14fc004db0 0x7f14fc005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1503fff700 1 -- 172.21.15.44:0/4085798990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151006b030 con 0x7f14fc004db0 2024-09-13T18:35:43.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1503fff700 1 -- 172.21.15.44:0/4085798990 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151006a690 con 0x7f14fc003fa0 2024-09-13T18:35:43.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1503fff700 1 -- 172.21.15.44:0/4085798990 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc00ba30 con 0x7f151006ccf0 2024-09-13T18:35:43.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1515d90700 1 --2- 172.21.15.44:0/4085798990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14fc004db0 0x7f14fc005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f151558f700 1 --2- 172.21.15.44:0/4085798990 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f151006ccf0 0x7f14fc003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1514d8e700 1 --2- 172.21.15.44:0/4085798990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14fc003fa0 0x7f14fc004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1515d90700 1 -- 172.21.15.44:0/4085798990 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f151006ccf0 msgr2=0x7f14fc003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:43.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1515d90700 1 --2- 172.21.15.44:0/4085798990 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f151006ccf0 0x7f14fc003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1515d90700 1 -- 172.21.15.44:0/4085798990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14fc003fa0 msgr2=0x7f14fc004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:43.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1515d90700 1 --2- 172.21.15.44:0/4085798990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14fc003fa0 0x7f14fc004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.692+0000 7f1515d90700 1 -- 172.21.15.44:0/4085798990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14fc0035d0 con 0x7f14fc004db0 2024-09-13T18:35:43.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.696+0000 7f1515d90700 1 --2- 172.21.15.44:0/4085798990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14fc004db0 0x7f14fc005230 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f150c009b40 tx=0x7f14fc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de20e3ad0a0ae5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.696+0000 7f1503fff700 1 -- 172.21.15.44:0/4085798990 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c00e660 con 0x7f14fc004db0 2024-09-13T18:35:43.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.696+0000 7f1503fff700 1 -- 172.21.15.44:0/4085798990 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150c00e7c0 con 0x7f14fc004db0 2024-09-13T18:35:43.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.696+0000 7f1503fff700 1 -- 172.21.15.44:0/4085798990 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c00eb30 con 0x7f14fc004db0 2024-09-13T18:35:43.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.696+0000 7f1516591700 1 -- 172.21.15.44:0/4085798990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14fc004db0 msgr2=0x7f14fc005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.696+0000 7f1516591700 1 --2- 172.21.15.44:0/4085798990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14fc004db0 0x7f14fc005230 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f150c009b40 tx=0x7f14fc0058a0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.696+0000 7f1515d90700 1 -- 172.21.15.44:0/4085798990 reap_dead start 2024-09-13T18:35:43.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.696+0000 7f1516591700 1 -- 172.21.15.44:0/4085798990 shutdown_connections 2024-09-13T18:35:43.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.696+0000 7f1516591700 1 -- 172.21.15.44:0/4085798990 >> 172.21.15.44:0/4085798990 conn(0x7f151006d900 msgr2=0x7f151006dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:43.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.696+0000 7f1516591700 1 -- 172.21.15.44:0/4085798990 shutdown_connections 2024-09-13T18:35:43.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.696+0000 7f1516591700 1 -- 172.21.15.44:0/4085798990 wait complete. 2024-09-13T18:35:43.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.696+0000 7f1516591700 1 Processor -- start 2024-09-13T18:35:43.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.696+0000 7f1516591700 1 -- start start 2024-09-13T18:35:43.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.700+0000 7f1516591700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f14fc004db0 0x7f1510153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.700+0000 7f1516591700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15101643b0 0x7f15100cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.700+0000 7f1516591700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15100ce1e0 0x7f15100ce690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.700+0000 7f1516591700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1510164c10 con 0x7f15100ce1e0 2024-09-13T18:35:43.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.700+0000 7f1516591700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1510164ef0 con 0x7f15101643b0 2024-09-13T18:35:43.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.700+0000 7f1516591700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15101651d0 con 0x7f14fc004db0 2024-09-13T18:35:43.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.700+0000 7f1515d90700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15100ce1e0 0x7f15100ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.700+0000 7f1515d90700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15100ce1e0 0x7f15100ce690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37626/0 (socket says 172.21.15.44:37626) 2024-09-13T18:35:43.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.700+0000 7f151558f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f14fc004db0 0x7f1510153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.700+0000 7f1515d90700 1 -- 172.21.15.44:0/4142520675 learned_addr learned my addr 172.21.15.44:0/4142520675 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:43.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.700+0000 7f1514d8e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15101643b0 0x7f15100cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.700+0000 7f1515d90700 1 -- 172.21.15.44:0/4142520675 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f14fc004db0 msgr2=0x7f1510153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.700+0000 7f1515d90700 1 --2- 172.21.15.44:0/4142520675 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f14fc004db0 0x7f1510153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.700+0000 7f1515d90700 1 -- 172.21.15.44:0/4142520675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15101643b0 msgr2=0x7f15100cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.700+0000 7f1515d90700 1 --2- 172.21.15.44:0/4142520675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15101643b0 0x7f15100cdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.700+0000 7f1515d90700 1 -- 172.21.15.44:0/4142520675 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15101654b0 con 0x7f15100ce1e0 2024-09-13T18:35:43.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.700+0000 7f1515d90700 1 --2- 172.21.15.44:0/4142520675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15100ce1e0 0x7f15100ce690 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f14fc004710 tx=0x7f150c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.700+0000 7f1501ffb700 1 -- 172.21.15.44:0/4142520675 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c00e660 con 0x7f15100ce1e0 2024-09-13T18:35:43.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.700+0000 7f1501ffb700 1 -- 172.21.15.44:0/4142520675 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150c013bb0 con 0x7f15100ce1e0 2024-09-13T18:35:43.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.700+0000 7f1501ffb700 1 -- 172.21.15.44:0/4142520675 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c01c450 con 0x7f15100ce1e0 2024-09-13T18:35:43.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.700+0000 7f1516591700 1 -- 172.21.15.44:0/4142520675 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1510164830 con 0x7f15100ce1e0 2024-09-13T18:35:43.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.700+0000 7f1516591700 1 -- 172.21.15.44:0/4142520675 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1510152440 con 0x7f15100ce1e0 2024-09-13T18:35:43.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.704+0000 7f1516591700 1 -- 172.21.15.44:0/4142520675 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15100cbc00 con 0x7f15100ce1e0 2024-09-13T18:35:43.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.704+0000 7f1501ffb700 1 -- 172.21.15.44:0/4142520675 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f150c01c5b0 con 0x7f15100ce1e0 2024-09-13T18:35:43.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.704+0000 7f1501ffb700 1 --2- 172.21.15.44:0/4142520675 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f14f4066760 0x7f14f4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.704+0000 7f1501ffb700 1 -- 172.21.15.44:0/4142520675 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f150c000e40 con 0x7f15100ce1e0 2024-09-13T18:35:43.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.704+0000 7f151558f700 1 --2- 172.21.15.44:0/4142520675 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f14f4066760 0x7f14f4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.704+0000 7f151558f700 1 --2- 172.21.15.44:0/4142520675 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f14f4066760 0x7f14f4068c20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f151006b4e0 tx=0x7f15040079a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.712+0000 7f1501ffb700 1 -- 172.21.15.44:0/4142520675 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f15100cbc00 con 0x7f15100ce1e0 2024-09-13T18:35:43.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.888+0000 7f1516591700 1 -- 172.21.15.44:0/4142520675 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f15100cbc00 con 0x7f15100ce1e0 2024-09-13T18:35:43.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.888+0000 7f1501ffb700 1 -- 172.21.15.44:0/4142520675 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) v1 ==== 84+0+65 (secure 0 0 0) 0x7f15100cbc00 con 0x7f15100ce1e0 2024-09-13T18:35:43.896 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:43.896 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-09-13T18:35:43.896 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:43.897 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2024-09-13T18:35:43.897 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2024-09-13T18:35:43.897 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:43.897 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-09-13T18:35:43.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.892+0000 7f1516591700 1 -- 172.21.15.44:0/4142520675 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f14f4066760 msgr2=0x7f14f4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.892+0000 7f1516591700 1 --2- 172.21.15.44:0/4142520675 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f14f4066760 0x7f14f4068c20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f151006b4e0 tx=0x7f15040079a0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.892+0000 7f1516591700 1 -- 172.21.15.44:0/4142520675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15100ce1e0 msgr2=0x7f15100ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.892+0000 7f1516591700 1 --2- 172.21.15.44:0/4142520675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15100ce1e0 0x7f15100ce690 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f14fc004710 tx=0x7f150c0047e0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.892+0000 7f1516591700 1 -- 172.21.15.44:0/4142520675 shutdown_connections 2024-09-13T18:35:43.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.892+0000 7f1516591700 1 --2- 172.21.15.44:0/4142520675 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f14f4066760 0x7f14f4068c20 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.892+0000 7f1516591700 1 --2- 172.21.15.44:0/4142520675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15100ce1e0 0x7f15100ce690 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.892+0000 7f1516591700 1 --2- 172.21.15.44:0/4142520675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15101643b0 0x7f15100cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.892+0000 7f1516591700 1 --2- 172.21.15.44:0/4142520675 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f14fc004db0 0x7f1510153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.892+0000 7f1516591700 1 -- 172.21.15.44:0/4142520675 >> 172.21.15.44:0/4142520675 conn(0x7f151006d900 msgr2=0x7f15101613b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:43.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.892+0000 7f1516591700 1 -- 172.21.15.44:0/4142520675 shutdown_connections 2024-09-13T18:35:43.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:43.892+0000 7f1516591700 1 -- 172.21.15.44:0/4142520675 wait complete. 2024-09-13T18:35:43.917 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:35:43.917 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:35:44.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.036+0000 7f9684eb4700 1 Processor -- start 2024-09-13T18:35:44.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.036+0000 7f9684eb4700 1 -- start start 2024-09-13T18:35:44.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f9684eb4700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96800ce710 0x7f96800b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f9684eb4700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f96800ceaf0 0x7f96800cff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f9684eb4700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968006aa30 con 0x7f96800cd280 2024-09-13T18:35:44.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f9684eb4700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96800b1e60 con 0x7f96800ceaf0 2024-09-13T18:35:44.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f9684eb4700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96800b18a0 con 0x7f96800ce710 2024-09-13T18:35:44.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f967effd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f96800ceaf0 0x7f96800cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f967effd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f96800ceaf0 0x7f96800cff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37634/0 (socket says 172.21.15.44:37634) 2024-09-13T18:35:44.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f967effd700 1 -- 172.21.15.44:0/3739730439 learned_addr learned my addr 172.21.15.44:0/3739730439 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:44.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f967f7fe700 1 --2- 172.21.15.44:0/3739730439 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96800ce710 0x7f96800b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f967effd700 1 -- 172.21.15.44:0/3739730439 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96800ce710 msgr2=0x7f96800b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:44.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f967effd700 1 --2- 172.21.15.44:0/3739730439 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96800ce710 0x7f96800b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f967effd700 1 -- 172.21.15.44:0/3739730439 >> v1:172.21.15.99:6789/0 conn(0x7f96800cd280 legacy=0x7f96800cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f967effd700 1 -- 172.21.15.44:0/3739730439 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96800b1b80 con 0x7f96800ceaf0 2024-09-13T18:35:44.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f967effd700 1 --2- 172.21.15.44:0/3739730439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96800ceaf0 0x7f96800cff50 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f9670009910 tx=0x7f9670009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a0fde88079c6cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f967e7fc700 1 -- 172.21.15.44:0/3739730439 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9670011830 con 0x7f96800ceaf0 2024-09-13T18:35:44.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f967e7fc700 1 -- 172.21.15.44:0/3739730439 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9670011990 con 0x7f96800ceaf0 2024-09-13T18:35:44.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f967e7fc700 1 -- 172.21.15.44:0/3739730439 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9670011d40 con 0x7f96800ceaf0 2024-09-13T18:35:44.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f9684eb4700 1 -- 172.21.15.44:0/3739730439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96800ceaf0 msgr2=0x7f96800cff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f9684eb4700 1 --2- 172.21.15.44:0/3739730439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96800ceaf0 0x7f96800cff50 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f9670009910 tx=0x7f9670009c20 comp rx=0 tx=0).stop 2024-09-13T18:35:44.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f9684eb4700 1 -- 172.21.15.44:0/3739730439 shutdown_connections 2024-09-13T18:35:44.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f9684eb4700 1 --2- 172.21.15.44:0/3739730439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96800ceaf0 0x7f96800cff50 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f9684eb4700 1 --2- 172.21.15.44:0/3739730439 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96800ce710 0x7f96800b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f9684eb4700 1 -- 172.21.15.44:0/3739730439 >> 172.21.15.44:0/3739730439 conn(0x7f96800d3260 msgr2=0x7f96800cf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:44.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f9684eb4700 1 -- 172.21.15.44:0/3739730439 shutdown_connections 2024-09-13T18:35:44.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.040+0000 7f9684eb4700 1 -- 172.21.15.44:0/3739730439 wait complete. 2024-09-13T18:35:44.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f9684eb4700 1 Processor -- start 2024-09-13T18:35:44.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f9684eb4700 1 -- start start 2024-09-13T18:35:44.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f9684eb4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96800cd280 0x7f96801f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f9684eb4700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96800ce710 0x7f96800cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f9684eb4700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96800ceaf0 0x7f96800cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f9684eb4700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9680150b20 con 0x7f96800cd280 2024-09-13T18:35:44.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f9684eb4700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968014f960 con 0x7f96800ce710 2024-09-13T18:35:44.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f9684eb4700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96801f35d0 con 0x7f96800ceaf0 2024-09-13T18:35:44.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f967f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96800cd280 0x7f96801f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f967f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96800cd280 0x7f96801f3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37636/0 (socket says 172.21.15.44:37636) 2024-09-13T18:35:44.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f967f7fe700 1 -- 172.21.15.44:0/2611134362 learned_addr learned my addr 172.21.15.44:0/2611134362 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:44.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f967ffff700 1 --2- 172.21.15.44:0/2611134362 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96800ceaf0 0x7f96800cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f967effd700 1 --2- 172.21.15.44:0/2611134362 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96800ce710 0x7f96800cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f967f7fe700 1 -- 172.21.15.44:0/2611134362 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96800ceaf0 msgr2=0x7f96800cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f967f7fe700 1 --2- 172.21.15.44:0/2611134362 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96800ceaf0 0x7f96800cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f967f7fe700 1 -- 172.21.15.44:0/2611134362 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96800ce710 msgr2=0x7f96800cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f967f7fe700 1 --2- 172.21.15.44:0/2611134362 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96800ce710 0x7f96800cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f967f7fe700 1 -- 172.21.15.44:0/2611134362 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9670009570 con 0x7f96800cd280 2024-09-13T18:35:44.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f967f7fe700 1 --2- 172.21.15.44:0/2611134362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96800cd280 0x7f96801f3090 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f966800e9d0 tx=0x7f966800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f9677fff700 1 -- 172.21.15.44:0/2611134362 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9668009720 con 0x7f96800cd280 2024-09-13T18:35:44.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f9677fff700 1 -- 172.21.15.44:0/2611134362 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966800c850 con 0x7f96800cd280 2024-09-13T18:35:44.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f9684eb4700 1 -- 172.21.15.44:0/2611134362 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968014fea0 con 0x7f96800cd280 2024-09-13T18:35:44.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f9677fff700 1 -- 172.21.15.44:0/2611134362 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966800cbc0 con 0x7f96800cd280 2024-09-13T18:35:44.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.044+0000 7f9684eb4700 1 -- 172.21.15.44:0/2611134362 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9680150460 con 0x7f96800cd280 2024-09-13T18:35:44.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.048+0000 7f9684eb4700 1 -- 172.21.15.44:0/2611134362 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f968015bfb0 con 0x7f96800cd280 2024-09-13T18:35:44.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.048+0000 7f9677fff700 1 -- 172.21.15.44:0/2611134362 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f966800cd20 con 0x7f96800cd280 2024-09-13T18:35:44.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.048+0000 7f9677fff700 1 --2- 172.21.15.44:0/2611134362 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9660066730 0x7f9660068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.048+0000 7f9677fff700 1 -- 172.21.15.44:0/2611134362 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9668083ed0 con 0x7f96800cd280 2024-09-13T18:35:44.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.048+0000 7f967effd700 1 --2- 172.21.15.44:0/2611134362 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9660066730 0x7f9660068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.048+0000 7f967effd700 1 --2- 172.21.15.44:0/2611134362 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9660066730 0x7f9660068bf0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9670014040 tx=0x7f9670008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.056+0000 7f9677fff700 1 -- 172.21.15.44:0/2611134362 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9668051590 con 0x7f96800cd280 2024-09-13T18:35:44.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.228+0000 7f9684eb4700 1 -- 172.21.15.44:0/2611134362 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f96800b5da0 con 0x7f96800cd280 2024-09-13T18:35:44.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.452+0000 7f9677fff700 1 -- 172.21.15.44:0/2611134362 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v75) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9668054bb0 con 0x7f96800cd280 2024-09-13T18:35:44.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.460+0000 7f9684eb4700 1 -- 172.21.15.44:0/2611134362 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9660066730 msgr2=0x7f9660068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.460+0000 7f9684eb4700 1 --2- 172.21.15.44:0/2611134362 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9660066730 0x7f9660068bf0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9670014040 tx=0x7f9670008030 comp rx=0 tx=0).stop 2024-09-13T18:35:44.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.460+0000 7f9684eb4700 1 -- 172.21.15.44:0/2611134362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96800cd280 msgr2=0x7f96801f3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.460+0000 7f9684eb4700 1 --2- 172.21.15.44:0/2611134362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96800cd280 0x7f96801f3090 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f966800e9d0 tx=0x7f966800ece0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.460+0000 7f9684eb4700 1 -- 172.21.15.44:0/2611134362 shutdown_connections 2024-09-13T18:35:44.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.460+0000 7f9684eb4700 1 --2- 172.21.15.44:0/2611134362 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9660066730 0x7f9660068bf0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.460+0000 7f9684eb4700 1 --2- 172.21.15.44:0/2611134362 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96800ceaf0 0x7f96800cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.460+0000 7f9684eb4700 1 --2- 172.21.15.44:0/2611134362 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96800ce710 0x7f96800cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.460+0000 7f9684eb4700 1 --2- 172.21.15.44:0/2611134362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96800cd280 0x7f96801f3090 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.460+0000 7f9684eb4700 1 -- 172.21.15.44:0/2611134362 >> 172.21.15.44:0/2611134362 conn(0x7f96800d3260 msgr2=0x7f96800b6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:44.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.460+0000 7f9684eb4700 1 -- 172.21.15.44:0/2611134362 shutdown_connections 2024-09-13T18:35:44.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.460+0000 7f9684eb4700 1 -- 172.21.15.44:0/2611134362 wait complete. 2024-09-13T18:35:44.472 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2024-09-13T18:35:44.483 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:35:44.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.608+0000 7fc9e0ec7700 1 Processor -- start 2024-09-13T18:35:44.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.608+0000 7fc9e0ec7700 1 -- start start 2024-09-13T18:35:44.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.608+0000 7fc9e0ec7700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc9dc06b900 0x7fc9dc0b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.608+0000 7fc9e0ec7700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9dc06a520 0x7fc9dc06a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.608+0000 7fc9e0ec7700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9dc0b8430 con 0x7fc9dc15cda0 2024-09-13T18:35:44.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.608+0000 7fc9e0ec7700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9dc06ae90 con 0x7fc9dc06b900 2024-09-13T18:35:44.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.608+0000 7fc9e0ec7700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc06bd60 con 0x7fc9dc06a520 2024-09-13T18:35:44.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.608+0000 7fc9db7fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc9dc15cda0 0x7fc9dc0ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43820/0 (socket says 172.21.15.44:43820) 2024-09-13T18:35:44.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.608+0000 7fc9db7fe700 1 -- 172.21.15.44:0/3957268869 learned_addr learned my addr 172.21.15.44:0/3957268869 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:44.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.608+0000 7fc9dbfff700 1 --2- 172.21.15.44:0/3957268869 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9dc06a520 0x7fc9dc06a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.608+0000 7fc9d2ffd700 1 --2- 172.21.15.44:0/3957268869 >> v2:172.21.15.99:3300/0 conn(0x7fc9dc06b900 0x7fc9dc0b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.608+0000 7fc9daffd700 1 -- 172.21.15.44:0/3957268869 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2175780042 0 0) 0x7fc9dc0b8430 con 0x7fc9dc15cda0 2024-09-13T18:35:44.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.608+0000 7fc9daffd700 1 -- 172.21.15.44:0/3957268869 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9c80035d0 con 0x7fc9dc15cda0 2024-09-13T18:35:44.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.608+0000 7fc9daffd700 1 -- 172.21.15.44:0/3957268869 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1820595398 0 0) 0x7fc9c80035d0 con 0x7fc9dc15cda0 2024-09-13T18:35:44.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.608+0000 7fc9daffd700 1 -- 172.21.15.44:0/3957268869 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9dc06a520 msgr2=0x7fc9dc06a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:44.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.608+0000 7fc9daffd700 1 --2- 172.21.15.44:0/3957268869 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9dc06a520 0x7fc9dc06a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.608+0000 7fc9daffd700 1 -- 172.21.15.44:0/3957268869 >> v2:172.21.15.99:3300/0 conn(0x7fc9dc06b900 msgr2=0x7fc9dc0b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:44.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.608+0000 7fc9daffd700 1 --2- 172.21.15.44:0/3957268869 >> v2:172.21.15.99:3300/0 conn(0x7fc9dc06b900 0x7fc9dc0b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.608+0000 7fc9daffd700 1 -- 172.21.15.44:0/3957268869 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9dc0cf350 con 0x7fc9dc15cda0 2024-09-13T18:35:44.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.608+0000 7fc9dbfff700 1 --2- 172.21.15.44:0/3957268869 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9dc06a520 0x7fc9dc06a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:44.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.608+0000 7fc9daffd700 1 -- 172.21.15.44:0/3957268869 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7fc9cc001670 con 0x7fc9dc15cda0 2024-09-13T18:35:44.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9daffd700 1 -- 172.21.15.44:0/3957268869 >> v1:172.21.15.44:6789/0 conn(0x7fc9dc15cda0 legacy=0x7fc9dc0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9daffd700 1 --2- 172.21.15.44:0/3957268869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9c8003a20 0x7fc9c8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9daffd700 1 --2- 172.21.15.44:0/3957268869 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9dc06a520 0x7fc9c8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9daffd700 1 --2- 172.21.15.44:0/3957268869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9c8004db0 0x7fc9c8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9daffd700 1 -- 172.21.15.44:0/3957268869 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc06ae90 con 0x7fc9c8004db0 2024-09-13T18:35:44.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9daffd700 1 -- 172.21.15.44:0/3957268869 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc06bd60 con 0x7fc9c8003a20 2024-09-13T18:35:44.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9daffd700 1 -- 172.21.15.44:0/3957268869 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c800ba30 con 0x7fc9dc06a520 2024-09-13T18:35:44.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9d2ffd700 1 --2- 172.21.15.44:0/3957268869 >> v2:172.21.15.99:3300/0 conn(0x7fc9dc06b900 0x7fc9dc0b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:44.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9dbfff700 1 --2- 172.21.15.44:0/3957268869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9c8004db0 0x7fc9c8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9db7fe700 1 --2- 172.21.15.44:0/3957268869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9c8003a20 0x7fc9c8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9d2ffd700 1 --2- 172.21.15.44:0/3957268869 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9dc06a520 0x7fc9c8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9dbfff700 1 -- 172.21.15.44:0/3957268869 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9dc06a520 msgr2=0x7fc9c8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:44.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9dbfff700 1 --2- 172.21.15.44:0/3957268869 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9dc06a520 0x7fc9c8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9dbfff700 1 -- 172.21.15.44:0/3957268869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9c8003a20 msgr2=0x7fc9c8003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:44.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9dbfff700 1 --2- 172.21.15.44:0/3957268869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9c8003a20 0x7fc9c8003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9dbfff700 1 -- 172.21.15.44:0/3957268869 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d4009a70 con 0x7fc9c8004db0 2024-09-13T18:35:44.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9dbfff700 1 --2- 172.21.15.44:0/3957268869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9c8004db0 0x7fc9c8005230 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400e350 tx=0x7fc9c80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e27fca2cdd722c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9daffd700 1 -- 172.21.15.44:0/3957268869 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d400edf0 con 0x7fc9c8004db0 2024-09-13T18:35:44.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9daffd700 1 -- 172.21.15.44:0/3957268869 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d400f040 con 0x7fc9c8004db0 2024-09-13T18:35:44.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9daffd700 1 -- 172.21.15.44:0/3957268869 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d40146a0 con 0x7fc9c8004db0 2024-09-13T18:35:44.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9e0ec7700 1 -- 172.21.15.44:0/3957268869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9c8004db0 msgr2=0x7fc9c8005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9e0ec7700 1 --2- 172.21.15.44:0/3957268869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9c8004db0 0x7fc9c8005230 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400e350 tx=0x7fc9c80058a0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9dbfff700 1 -- 172.21.15.44:0/3957268869 reap_dead start 2024-09-13T18:35:44.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9e0ec7700 1 -- 172.21.15.44:0/3957268869 shutdown_connections 2024-09-13T18:35:44.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9e0ec7700 1 -- 172.21.15.44:0/3957268869 >> 172.21.15.44:0/3957268869 conn(0x7fc9dc0d2cb0 msgr2=0x7fc9dc0d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:44.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9e0ec7700 1 -- 172.21.15.44:0/3957268869 shutdown_connections 2024-09-13T18:35:44.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9e0ec7700 1 -- 172.21.15.44:0/3957268869 wait complete. 2024-09-13T18:35:44.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.612+0000 7fc9e0ec7700 1 Processor -- start 2024-09-13T18:35:44.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9e0ec7700 1 -- start start 2024-09-13T18:35:44.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9e0ec7700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9c8004db0 0x7fc9dc154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9e0ec7700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9dc0c85f0 0x7fc9dc0c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9e0ec7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9dc157470 0x7fc9dc1578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9e0ec7700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc157e30 con 0x7fc9dc157470 2024-09-13T18:35:44.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9e0ec7700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc1f6d40 con 0x7fc9dc0c85f0 2024-09-13T18:35:44.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9e0ec7700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc0c90b0 con 0x7fc9c8004db0 2024-09-13T18:35:44.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9dbfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9dc157470 0x7fc9dc1578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9db7fe700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9c8004db0 0x7fc9dc154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9dbfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9dc157470 0x7fc9dc1578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37662/0 (socket says 172.21.15.44:37662) 2024-09-13T18:35:44.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9dbfff700 1 -- 172.21.15.44:0/1087279076 learned_addr learned my addr 172.21.15.44:0/1087279076 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:44.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9d2ffd700 1 --2- 172.21.15.44:0/1087279076 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9dc0c85f0 0x7fc9dc0c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9dbfff700 1 -- 172.21.15.44:0/1087279076 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9c8004db0 msgr2=0x7fc9dc154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9dbfff700 1 --2- 172.21.15.44:0/1087279076 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9c8004db0 0x7fc9dc154350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9dbfff700 1 -- 172.21.15.44:0/1087279076 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9dc0c85f0 msgr2=0x7fc9dc0c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9dbfff700 1 --2- 172.21.15.44:0/1087279076 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9dc0c85f0 0x7fc9dc0c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9dbfff700 1 -- 172.21.15.44:0/1087279076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9dc1f5f80 con 0x7fc9dc157470 2024-09-13T18:35:44.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9db7fe700 1 --2- 172.21.15.44:0/1087279076 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9c8004db0 0x7fc9dc154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:44.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9dbfff700 1 --2- 172.21.15.44:0/1087279076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9dc157470 0x7fc9dc1578f0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4017040 tx=0x7fc9d4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9d8ff9700 1 -- 172.21.15.44:0/1087279076 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4014e10 con 0x7fc9dc157470 2024-09-13T18:35:44.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9d8ff9700 1 -- 172.21.15.44:0/1087279076 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d4022070 con 0x7fc9dc157470 2024-09-13T18:35:44.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9e0ec7700 1 -- 172.21.15.44:0/1087279076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9dc1f6260 con 0x7fc9dc157470 2024-09-13T18:35:44.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9d8ff9700 1 -- 172.21.15.44:0/1087279076 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4028670 con 0x7fc9dc157470 2024-09-13T18:35:44.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.616+0000 7fc9e0ec7700 1 -- 172.21.15.44:0/1087279076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9dc1f6820 con 0x7fc9dc157470 2024-09-13T18:35:44.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.620+0000 7fc9e0ec7700 1 -- 172.21.15.44:0/1087279076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9dc06a950 con 0x7fc9dc157470 2024-09-13T18:35:44.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.620+0000 7fc9d8ff9700 1 -- 172.21.15.44:0/1087279076 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc9d401e430 con 0x7fc9dc157470 2024-09-13T18:35:44.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.620+0000 7fc9d8ff9700 1 --2- 172.21.15.44:0/1087279076 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc9bc066760 0x7fc9bc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.620+0000 7fc9d8ff9700 1 -- 172.21.15.44:0/1087279076 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fc9d4024070 con 0x7fc9dc157470 2024-09-13T18:35:44.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.620+0000 7fc9db7fe700 1 --2- 172.21.15.44:0/1087279076 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc9bc066760 0x7fc9bc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.620+0000 7fc9db7fe700 1 --2- 172.21.15.44:0/1087279076 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc9bc066760 0x7fc9bc068c20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc000c00 tx=0x7fc9cc0079a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.628+0000 7fc9d8ff9700 1 -- 172.21.15.44:0/1087279076 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc9d40533b0 con 0x7fc9dc157470 2024-09-13T18:35:44.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:44.800+0000 7fc9e0ec7700 1 -- 172.21.15.44:0/1087279076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc9dc0ceb00 con 0x7fc9dc157470 2024-09-13T18:35:45.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.456+0000 7fc9d8ff9700 1 -- 172.21.15.44:0/1087279076 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v76) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc9d40180d0 con 0x7fc9dc157470 2024-09-13T18:35:45.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.476+0000 7fc9e0ec7700 1 -- 172.21.15.44:0/1087279076 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc9bc066760 msgr2=0x7fc9bc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.476+0000 7fc9e0ec7700 1 --2- 172.21.15.44:0/1087279076 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc9bc066760 0x7fc9bc068c20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc000c00 tx=0x7fc9cc0079a0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.476+0000 7fc9e0ec7700 1 -- 172.21.15.44:0/1087279076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9dc157470 msgr2=0x7fc9dc1578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.476+0000 7fc9e0ec7700 1 --2- 172.21.15.44:0/1087279076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9dc157470 0x7fc9dc1578f0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4017040 tx=0x7fc9d4009750 comp rx=0 tx=0).stop 2024-09-13T18:35:45.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.476+0000 7fc9e0ec7700 1 -- 172.21.15.44:0/1087279076 shutdown_connections 2024-09-13T18:35:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.476+0000 7fc9e0ec7700 1 --2- 172.21.15.44:0/1087279076 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc9bc066760 0x7fc9bc068c20 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.476+0000 7fc9e0ec7700 1 --2- 172.21.15.44:0/1087279076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9dc157470 0x7fc9dc1578f0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.476+0000 7fc9e0ec7700 1 --2- 172.21.15.44:0/1087279076 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9dc0c85f0 0x7fc9dc0c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.476+0000 7fc9e0ec7700 1 --2- 172.21.15.44:0/1087279076 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9c8004db0 0x7fc9dc154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.476+0000 7fc9e0ec7700 1 -- 172.21.15.44:0/1087279076 >> 172.21.15.44:0/1087279076 conn(0x7fc9dc0d2cb0 msgr2=0x7fc9dc0b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.476+0000 7fc9e0ec7700 1 -- 172.21.15.44:0/1087279076 shutdown_connections 2024-09-13T18:35:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.476+0000 7fc9e0ec7700 1 -- 172.21.15.44:0/1087279076 wait complete. 2024-09-13T18:35:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2024-09-13T18:35:45.497 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:35:45.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.608+0000 7f821a806700 1 Processor -- start 2024-09-13T18:35:45.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.608+0000 7f821a806700 1 -- start start 2024-09-13T18:35:45.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f821a806700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f821406b900 0x7f82140b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f821a806700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f821406a520 0x7f821406a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f821a806700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82140b8430 con 0x7f821415cda0 2024-09-13T18:35:45.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f821a806700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821406ae70 con 0x7f821406a520 2024-09-13T18:35:45.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f821a806700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821406bd60 con 0x7f821406b900 2024-09-13T18:35:45.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f821a005700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f821406a520 0x7f821406a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f8219804700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f821415cda0 0x7f82140ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43822/0 (socket says 172.21.15.44:43822) 2024-09-13T18:35:45.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f8219804700 1 -- 172.21.15.44:0/2082500072 learned_addr learned my addr 172.21.15.44:0/2082500072 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:45.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f8219003700 1 --2- 172.21.15.44:0/2082500072 >> v2:172.21.15.99:3300/0 conn(0x7f821406b900 0x7f82140b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f821a005700 1 -- 172.21.15.44:0/2082500072 >> v2:172.21.15.99:3300/0 conn(0x7f821406b900 msgr2=0x7f82140b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f821a005700 1 --2- 172.21.15.44:0/2082500072 >> v2:172.21.15.99:3300/0 conn(0x7f821406b900 0x7f82140b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f821a005700 1 -- 172.21.15.44:0/2082500072 >> v1:172.21.15.44:6789/0 conn(0x7f821415cda0 legacy=0x7f82140ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f821a005700 1 -- 172.21.15.44:0/2082500072 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82140cf350 con 0x7f821406a520 2024-09-13T18:35:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f8218802700 1 -- 172.21.15.44:0/2082500072 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1066436537 0 0) 0x7f82140b8430 con 0x7f821415cda0 2024-09-13T18:35:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f821a005700 1 --2- 172.21.15.44:0/2082500072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f821406a520 0x7f821406a930 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f82140cf280 tx=0x7f820c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e2ff991a694ef5b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f8218802700 1 -- 172.21.15.44:0/2082500072 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c00e070 con 0x7f821406a520 2024-09-13T18:35:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f8218802700 1 -- 172.21.15.44:0/2082500072 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c00bb20 con 0x7f821406a520 2024-09-13T18:35:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f8218802700 1 -- 172.21.15.44:0/2082500072 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c012430 con 0x7f821406a520 2024-09-13T18:35:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f821a806700 1 -- 172.21.15.44:0/2082500072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f821406a520 msgr2=0x7f821406a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f821a806700 1 --2- 172.21.15.44:0/2082500072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f821406a520 0x7f821406a930 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f82140cf280 tx=0x7f820c00b330 comp rx=0 tx=0).stop 2024-09-13T18:35:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f821a806700 1 -- 172.21.15.44:0/2082500072 shutdown_connections 2024-09-13T18:35:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f821a806700 1 --2- 172.21.15.44:0/2082500072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f821406a520 0x7f821406a930 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f821a806700 1 --2- 172.21.15.44:0/2082500072 >> v2:172.21.15.99:3300/0 conn(0x7f821406b900 0x7f82140b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f821a806700 1 -- 172.21.15.44:0/2082500072 >> 172.21.15.44:0/2082500072 conn(0x7f82140d2cb0 msgr2=0x7f82140d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f821a806700 1 -- 172.21.15.44:0/2082500072 shutdown_connections 2024-09-13T18:35:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.612+0000 7f821a806700 1 -- 172.21.15.44:0/2082500072 wait complete. 2024-09-13T18:35:45.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.616+0000 7f821a806700 1 Processor -- start 2024-09-13T18:35:45.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.616+0000 7f821a806700 1 -- start start 2024-09-13T18:35:45.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f821a806700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f821406a520 0x7f82141510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f821a806700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f821406b900 0x7f82140c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f821a806700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f821415cda0 0x7f82140c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f821a806700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821415f010 con 0x7f821406b900 2024-09-13T18:35:45.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f821a806700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82140c9700 con 0x7f821406a520 2024-09-13T18:35:45.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f821a806700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821415e6e0 con 0x7f821415cda0 2024-09-13T18:35:45.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f8219003700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f821406b900 0x7f82140c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f8219003700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f821406b900 0x7f82140c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37692/0 (socket says 172.21.15.44:37692) 2024-09-13T18:35:45.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f8219003700 1 -- 172.21.15.44:0/3356691644 learned_addr learned my addr 172.21.15.44:0/3356691644 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:45.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f821a005700 1 --2- 172.21.15.44:0/3356691644 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f821415cda0 0x7f82140c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f8219804700 1 --2- 172.21.15.44:0/3356691644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f821406a520 0x7f82141510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f8219003700 1 -- 172.21.15.44:0/3356691644 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f821415cda0 msgr2=0x7f82140c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f8219003700 1 --2- 172.21.15.44:0/3356691644 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f821415cda0 0x7f82140c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f8219003700 1 -- 172.21.15.44:0/3356691644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f821406a520 msgr2=0x7f82141510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f8219003700 1 --2- 172.21.15.44:0/3356691644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f821406a520 0x7f82141510d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f8219003700 1 -- 172.21.15.44:0/3356691644 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c009a70 con 0x7f821406b900 2024-09-13T18:35:45.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f8219804700 1 --2- 172.21.15.44:0/3356691644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f821406a520 0x7f82141510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:45.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f8219003700 1 --2- 172.21.15.44:0/3356691644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f821406b900 0x7f82140c9090 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f820400e9d0 tx=0x7f820400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:45.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f820a7fc700 1 -- 172.21.15.44:0/3356691644 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8204009720 con 0x7f821406b900 2024-09-13T18:35:45.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f820a7fc700 1 -- 172.21.15.44:0/3356691644 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820400c850 con 0x7f821406b900 2024-09-13T18:35:45.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f820a7fc700 1 -- 172.21.15.44:0/3356691644 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820400cbc0 con 0x7f821406b900 2024-09-13T18:35:45.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f821a806700 1 -- 172.21.15.44:0/3356691644 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821415e9c0 con 0x7f821406b900 2024-09-13T18:35:45.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f821a806700 1 -- 172.21.15.44:0/3356691644 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82140c62e0 con 0x7f821406b900 2024-09-13T18:35:45.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.620+0000 7f821a806700 1 -- 172.21.15.44:0/3356691644 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82140c67b0 con 0x7f821406b900 2024-09-13T18:35:45.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.624+0000 7f820a7fc700 1 -- 172.21.15.44:0/3356691644 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f820400cd20 con 0x7f821406b900 2024-09-13T18:35:45.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.624+0000 7f820a7fc700 1 --2- 172.21.15.44:0/3356691644 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f81f8066760 0x7f81f8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.624+0000 7f820a7fc700 1 -- 172.21.15.44:0/3356691644 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f8204084120 con 0x7f821406b900 2024-09-13T18:35:45.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.624+0000 7f8219804700 1 --2- 172.21.15.44:0/3356691644 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f81f8066760 0x7f81f8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.624+0000 7f8219804700 1 --2- 172.21.15.44:0/3356691644 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f81f8066760 0x7f81f8068c20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8210000f60 tx=0x7f8210009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:45.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.632+0000 7f820a7fc700 1 -- 172.21.15.44:0/3356691644 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8204051580 con 0x7f821406b900 2024-09-13T18:35:45.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.836+0000 7f821a806700 1 -- 172.21.15.44:0/3356691644 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f821406a930 con 0x7f821406b900 2024-09-13T18:35:45.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.852+0000 7f820a7fc700 1 -- 172.21.15.44:0/3356691644 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v66) v1 ==== 174+0+0 (secure 0 0 0) 0x7f8204054ba0 con 0x7f821406b900 2024-09-13T18:35:45.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.856+0000 7f821a806700 1 -- 172.21.15.44:0/3356691644 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f81f8066760 msgr2=0x7f81f8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.856+0000 7f821a806700 1 --2- 172.21.15.44:0/3356691644 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f81f8066760 0x7f81f8068c20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8210000f60 tx=0x7f8210009040 comp rx=0 tx=0).stop 2024-09-13T18:35:45.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.856+0000 7f821a806700 1 -- 172.21.15.44:0/3356691644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f821406b900 msgr2=0x7f82140c9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.856+0000 7f821a806700 1 --2- 172.21.15.44:0/3356691644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f821406b900 0x7f82140c9090 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f820400e9d0 tx=0x7f820400ed90 comp rx=0 tx=0).stop 2024-09-13T18:35:45.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.856+0000 7f821a806700 1 -- 172.21.15.44:0/3356691644 shutdown_connections 2024-09-13T18:35:45.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.856+0000 7f821a806700 1 --2- 172.21.15.44:0/3356691644 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f81f8066760 0x7f81f8068c20 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.856+0000 7f821a806700 1 --2- 172.21.15.44:0/3356691644 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f821415cda0 0x7f82140c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.856+0000 7f821a806700 1 --2- 172.21.15.44:0/3356691644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f821406b900 0x7f82140c9090 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.856+0000 7f821a806700 1 --2- 172.21.15.44:0/3356691644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f821406a520 0x7f82141510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.856+0000 7f821a806700 1 -- 172.21.15.44:0/3356691644 >> 172.21.15.44:0/3356691644 conn(0x7f82140d2cb0 msgr2=0x7f82140d1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:45.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.856+0000 7f821a806700 1 -- 172.21.15.44:0/3356691644 shutdown_connections 2024-09-13T18:35:45.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.856+0000 7f821a806700 1 -- 172.21.15.44:0/3356691644 wait complete. 2024-09-13T18:35:45.865 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 10 and data pool 11 2024-09-13T18:35:45.884 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:45.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddee6f700 1 Processor -- start 2024-09-13T18:35:45.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddee6f700 1 -- start start 2024-09-13T18:35:45.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddee6f700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5dd81540b0 0x7f5dd815bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddee6f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5dd815dd10 0x7f5dd806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddee6f700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd8154490 con 0x7f5dd815c090 2024-09-13T18:35:45.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddee6f700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd815c530 con 0x7f5dd81540b0 2024-09-13T18:35:45.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddee6f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd815c810 con 0x7f5dd815dd10 2024-09-13T18:35:45.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddd40c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5dd815dd10 0x7f5dd806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddcc0b700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5dd81540b0 0x7f5dd815bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddd40c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5dd815dd10 0x7f5dd806fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:54068/0 (socket says 172.21.15.44:54068) 2024-09-13T18:35:45.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5dcffff700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f5dd815c090 0x7f5dd815d600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:55476/0 (socket says 172.21.15.44:55476) 2024-09-13T18:35:45.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddd40c700 1 -- 172.21.15.44:0/1002585898 learned_addr learned my addr 172.21.15.44:0/1002585898 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:45.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5dcf7fe700 1 -- 172.21.15.44:0/1002585898 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1711466423 0 0) 0x7f5dd8154490 con 0x7f5dd815c090 2024-09-13T18:35:45.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5dcf7fe700 1 -- 172.21.15.44:0/1002585898 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dc00035d0 con 0x7f5dd815c090 2024-09-13T18:35:45.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddcc0b700 1 -- 172.21.15.44:0/1002585898 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5dd815dd10 msgr2=0x7f5dd806fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:45.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddcc0b700 1 --2- 172.21.15.44:0/1002585898 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5dd815dd10 0x7f5dd806fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddcc0b700 1 -- 172.21.15.44:0/1002585898 >> v1:172.21.15.99:6789/0 conn(0x7f5dd815c090 legacy=0x7f5dd815d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddcc0b700 1 -- 172.21.15.44:0/1002585898 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd815caf0 con 0x7f5dd81540b0 2024-09-13T18:35:45.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddd40c700 1 --2- 172.21.15.44:0/1002585898 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5dd815dd10 0x7f5dd806fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:45.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddcc0b700 1 --2- 172.21.15.44:0/1002585898 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5dd81540b0 0x7f5dd815bb50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009850 tx=0x7f5dd4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59a5e9ca50999697 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:45.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5dcf7fe700 1 -- 172.21.15.44:0/1002585898 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4011830 con 0x7f5dd81540b0 2024-09-13T18:35:45.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5dcf7fe700 1 -- 172.21.15.44:0/1002585898 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd4011990 con 0x7f5dd81540b0 2024-09-13T18:35:45.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5dcf7fe700 1 -- 172.21.15.44:0/1002585898 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4011d40 con 0x7f5dd81540b0 2024-09-13T18:35:45.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddee6f700 1 -- 172.21.15.44:0/1002585898 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5dd81540b0 msgr2=0x7f5dd815bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddee6f700 1 --2- 172.21.15.44:0/1002585898 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5dd81540b0 0x7f5dd815bb50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009850 tx=0x7f5dd4009b60 comp rx=0 tx=0).stop 2024-09-13T18:35:45.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddee6f700 1 -- 172.21.15.44:0/1002585898 shutdown_connections 2024-09-13T18:35:45.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddee6f700 1 --2- 172.21.15.44:0/1002585898 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5dd815dd10 0x7f5dd806fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddee6f700 1 --2- 172.21.15.44:0/1002585898 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5dd81540b0 0x7f5dd815bb50 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddee6f700 1 -- 172.21.15.44:0/1002585898 >> 172.21.15.44:0/1002585898 conn(0x7f5dd80ce980 msgr2=0x7f5dd80ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:45.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddee6f700 1 -- 172.21.15.44:0/1002585898 shutdown_connections 2024-09-13T18:35:45.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.980+0000 7f5ddee6f700 1 -- 172.21.15.44:0/1002585898 wait complete. 2024-09-13T18:35:45.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.984+0000 7f5ddee6f700 1 Processor -- start 2024-09-13T18:35:45.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.984+0000 7f5ddee6f700 1 -- start start 2024-09-13T18:35:45.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.988+0000 7f5ddee6f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5dd81540b0 0x7f5dd81483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.988+0000 7f5ddee6f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5dd815c090 0x7f5dd80b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.988+0000 7f5ddee6f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5dd815dd10 0x7f5dd80b3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.988+0000 7f5ddee6f700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd80a84b0 con 0x7f5dd815dd10 2024-09-13T18:35:45.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.988+0000 7f5ddee6f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd80a8700 con 0x7f5dd815c090 2024-09-13T18:35:45.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.988+0000 7f5ddee6f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd80a89e0 con 0x7f5dd81540b0 2024-09-13T18:35:45.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.988+0000 7f5ddd40c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5dd815dd10 0x7f5dd80b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.988+0000 7f5ddcc0b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5dd81540b0 0x7f5dd81483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.988+0000 7f5dcffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5dd815c090 0x7f5dd80b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.988+0000 7f5ddcc0b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5dd81540b0 0x7f5dd81483d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:54078/0 (socket says 172.21.15.44:54078) 2024-09-13T18:35:45.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.988+0000 7f5ddcc0b700 1 -- 172.21.15.44:0/3572591449 learned_addr learned my addr 172.21.15.44:0/3572591449 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:45.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.988+0000 7f5ddcc0b700 1 -- 172.21.15.44:0/3572591449 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5dd815c090 msgr2=0x7f5dd80b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.988+0000 7f5ddcc0b700 1 --2- 172.21.15.44:0/3572591449 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5dd815c090 0x7f5dd80b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.988+0000 7f5ddcc0b700 1 -- 172.21.15.44:0/3572591449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5dd815dd10 msgr2=0x7f5dd80b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.988+0000 7f5ddcc0b700 1 --2- 172.21.15.44:0/3572591449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5dd815dd10 0x7f5dd80b3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.988+0000 7f5ddcc0b700 1 -- 172.21.15.44:0/3572591449 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd0009b30 con 0x7f5dd81540b0 2024-09-13T18:35:45.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.988+0000 7f5ddcc0b700 1 --2- 172.21.15.44:0/3572591449 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5dd81540b0 0x7f5dd81483d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5dd40090b0 tx=0x7f5dd4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:45.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.988+0000 7f5dcd7fa700 1 -- 172.21.15.44:0/3572591449 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4004380 con 0x7f5dd81540b0 2024-09-13T18:35:45.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.988+0000 7f5dcd7fa700 1 -- 172.21.15.44:0/3572591449 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd401f070 con 0x7f5dd81540b0 2024-09-13T18:35:45.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.988+0000 7f5ddee6f700 1 -- 172.21.15.44:0/3572591449 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd40094b0 con 0x7f5dd81540b0 2024-09-13T18:35:45.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.988+0000 7f5dcd7fa700 1 -- 172.21.15.44:0/3572591449 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd40036c0 con 0x7f5dd81540b0 2024-09-13T18:35:45.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.988+0000 7f5ddee6f700 1 -- 172.21.15.44:0/3572591449 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd80a8fa0 con 0x7f5dd81540b0 2024-09-13T18:35:45.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.988+0000 7f5ddee6f700 1 -- 172.21.15.44:0/3572591449 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd80ab830 con 0x7f5dd81540b0 2024-09-13T18:35:45.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.992+0000 7f5dcd7fa700 1 -- 172.21.15.44:0/3572591449 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5dd4021030 con 0x7f5dd81540b0 2024-09-13T18:35:45.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.992+0000 7f5dcd7fa700 1 --2- 172.21.15.44:0/3572591449 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5dc4066730 0x7f5dc4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.992+0000 7f5dcd7fa700 1 -- 172.21.15.44:0/3572591449 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5dd4085b90 con 0x7f5dd81540b0 2024-09-13T18:35:45.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.992+0000 7f5dcffff700 1 --2- 172.21.15.44:0/3572591449 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5dc4066730 0x7f5dc4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:45.992+0000 7f5dcffff700 1 --2- 172.21.15.44:0/3572591449 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5dc4066730 0x7f5dc4068bf0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5dd80af1e0 tx=0x7f5dc8007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:46.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.000+0000 7f5dcd7fa700 1 -- 172.21.15.44:0/3572591449 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5dd4053190 con 0x7f5dd81540b0 2024-09-13T18:35:46.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.176+0000 7f5ddee6f700 1 -- 172.21.15.44:0/3572591449 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5dd815bb50 con 0x7f5dd81540b0 2024-09-13T18:35:46.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.180+0000 7f5dcd7fa700 1 -- 172.21.15.44:0/3572591449 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f5dd4006ce0 con 0x7f5dd81540b0 2024-09-13T18:35:46.187 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:46.187 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":77,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:35:45.841016+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:44.271295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:44.844157+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:46.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.184+0000 7f5ddee6f700 1 -- 172.21.15.44:0/3572591449 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5dc4066730 msgr2=0x7f5dc4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:46.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.184+0000 7f5ddee6f700 1 --2- 172.21.15.44:0/3572591449 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5dc4066730 0x7f5dc4068bf0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5dd80af1e0 tx=0x7f5dc8007de0 comp rx=0 tx=0).stop 2024-09-13T18:35:46.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.184+0000 7f5ddee6f700 1 -- 172.21.15.44:0/3572591449 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5dd81540b0 msgr2=0x7f5dd81483d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:46.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.184+0000 7f5ddee6f700 1 --2- 172.21.15.44:0/3572591449 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5dd81540b0 0x7f5dd81483d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5dd40090b0 tx=0x7f5dd4004770 comp rx=0 tx=0).stop 2024-09-13T18:35:46.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.184+0000 7f5ddee6f700 1 -- 172.21.15.44:0/3572591449 shutdown_connections 2024-09-13T18:35:46.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.184+0000 7f5ddee6f700 1 --2- 172.21.15.44:0/3572591449 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5dc4066730 0x7f5dc4068bf0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:46.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.184+0000 7f5ddee6f700 1 --2- 172.21.15.44:0/3572591449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5dd815dd10 0x7f5dd80b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:46.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.184+0000 7f5ddee6f700 1 --2- 172.21.15.44:0/3572591449 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5dd815c090 0x7f5dd80b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:46.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.184+0000 7f5ddee6f700 1 --2- 172.21.15.44:0/3572591449 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5dd81540b0 0x7f5dd81483d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:46.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.184+0000 7f5ddee6f700 1 -- 172.21.15.44:0/3572591449 >> 172.21.15.44:0/3572591449 conn(0x7f5dd80ce980 msgr2=0x7f5dd80cd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:46.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.184+0000 7f5ddee6f700 1 -- 172.21.15.44:0/3572591449 shutdown_connections 2024-09-13T18:35:46.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.184+0000 7f5ddee6f700 1 -- 172.21.15.44:0/3572591449 wait complete. 2024-09-13T18:35:46.203 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:46.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.308+0000 7f013080a700 1 Processor -- start 2024-09-13T18:35:46.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.308+0000 7f013080a700 1 -- start start 2024-09-13T18:35:46.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.312+0000 7f013080a700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f012c0b3ae0 0x7f012c06a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:46.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.312+0000 7f013080a700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012c13dcb0 con 0x7f012c06bbf0 2024-09-13T18:35:46.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.312+0000 7f013080a700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012c15be60 con 0x7f012c06aaf0 2024-09-13T18:35:46.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.312+0000 7f013080a700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f012c13ffd0 con 0x7f012c0b3ae0 2024-09-13T18:35:46.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.312+0000 7f012a59c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f012c0b3ae0 0x7f012c06a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:46.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.312+0000 7f012a59c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f012c0b3ae0 0x7f012c06a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37712/0 (socket says 172.21.15.44:37712) 2024-09-13T18:35:46.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.312+0000 7f012a59c700 1 -- 172.21.15.44:0/304897912 learned_addr learned my addr 172.21.15.44:0/304897912 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:46.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.312+0000 7f012a59c700 1 -- 172.21.15.44:0/304897912 >> v1:172.21.15.99:6789/0 conn(0x7f012c06aaf0 legacy=0x7f012c15e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:46.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.312+0000 7f012a59c700 1 -- 172.21.15.44:0/304897912 >> v1:172.21.15.44:6789/0 conn(0x7f012c06bbf0 legacy=0x7f012c0b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:46.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.312+0000 7f012a59c700 1 -- 172.21.15.44:0/304897912 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012c140220 con 0x7f012c0b3ae0 2024-09-13T18:35:46.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.312+0000 7f012a59c700 1 --2- 172.21.15.44:0/304897912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f012c0b3ae0 0x7f012c06a5b0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f011c009910 tx=0x7f011c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86fdc11a5f2c7586 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:46.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.312+0000 7f0129d9b700 1 -- 172.21.15.44:0/304897912 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c004230 con 0x7f012c0b3ae0 2024-09-13T18:35:46.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.312+0000 7f0129d9b700 1 -- 172.21.15.44:0/304897912 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011c004390 con 0x7f012c0b3ae0 2024-09-13T18:35:46.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.312+0000 7f0129d9b700 1 -- 172.21.15.44:0/304897912 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c009e60 con 0x7f012c0b3ae0 2024-09-13T18:35:46.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.312+0000 7f013080a700 1 -- 172.21.15.44:0/304897912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f012c0b3ae0 msgr2=0x7f012c06a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:46.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.312+0000 7f013080a700 1 --2- 172.21.15.44:0/304897912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f012c0b3ae0 0x7f012c06a5b0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f011c009910 tx=0x7f011c009c20 comp rx=0 tx=0).stop 2024-09-13T18:35:46.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.312+0000 7f013080a700 1 -- 172.21.15.44:0/304897912 shutdown_connections 2024-09-13T18:35:46.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.312+0000 7f013080a700 1 --2- 172.21.15.44:0/304897912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f012c0b3ae0 0x7f012c06a5b0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:46.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.312+0000 7f013080a700 1 -- 172.21.15.44:0/304897912 >> 172.21.15.44:0/304897912 conn(0x7f012c0b0f00 msgr2=0x7f012c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:46.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.312+0000 7f013080a700 1 -- 172.21.15.44:0/304897912 shutdown_connections 2024-09-13T18:35:46.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.312+0000 7f013080a700 1 -- 172.21.15.44:0/304897912 wait complete. 2024-09-13T18:35:46.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.316+0000 7f013080a700 1 Processor -- start 2024-09-13T18:35:46.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.316+0000 7f013080a700 1 -- start start 2024-09-13T18:35:46.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.316+0000 7f013080a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f012c06aaf0 0x7f012c150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:46.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.316+0000 7f013080a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f012c06bbf0 0x7f012c15d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:46.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.316+0000 7f013080a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f012c0b3ae0 0x7f012c158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:46.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.316+0000 7f013080a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c15e270 con 0x7f012c06bbf0 2024-09-13T18:35:46.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.316+0000 7f013080a700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c156e40 con 0x7f012c06aaf0 2024-09-13T18:35:46.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.316+0000 7f013080a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012c156550 con 0x7f012c0b3ae0 2024-09-13T18:35:46.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.316+0000 7f012a59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f012c06bbf0 0x7f012c15d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:46.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.316+0000 7f012a59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f012c06bbf0 0x7f012c15d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37724/0 (socket says 172.21.15.44:37724) 2024-09-13T18:35:46.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.316+0000 7f012a59c700 1 -- 172.21.15.44:0/596458358 learned_addr learned my addr 172.21.15.44:0/596458358 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:46.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.316+0000 7f012b59e700 1 --2- 172.21.15.44:0/596458358 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f012c0b3ae0 0x7f012c158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:46.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.316+0000 7f012ad9d700 1 --2- 172.21.15.44:0/596458358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f012c06aaf0 0x7f012c150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:46.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.320+0000 7f012a59c700 1 -- 172.21.15.44:0/596458358 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f012c0b3ae0 msgr2=0x7f012c158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:46.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.320+0000 7f012a59c700 1 --2- 172.21.15.44:0/596458358 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f012c0b3ae0 0x7f012c158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:46.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.320+0000 7f012a59c700 1 -- 172.21.15.44:0/596458358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f012c06aaf0 msgr2=0x7f012c150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:46.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.320+0000 7f012a59c700 1 --2- 172.21.15.44:0/596458358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f012c06aaf0 0x7f012c150e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:46.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.320+0000 7f012a59c700 1 -- 172.21.15.44:0/596458358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011c009570 con 0x7f012c06bbf0 2024-09-13T18:35:46.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.320+0000 7f012b59e700 1 --2- 172.21.15.44:0/596458358 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f012c0b3ae0 0x7f012c158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:46.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.320+0000 7f012a59c700 1 --2- 172.21.15.44:0/596458358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f012c06bbf0 0x7f012c15d740 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f012c06b360 tx=0x7f011c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:46.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.320+0000 7f01137fe700 1 -- 172.21.15.44:0/596458358 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c00bca0 con 0x7f012c06bbf0 2024-09-13T18:35:46.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.320+0000 7f01137fe700 1 -- 172.21.15.44:0/596458358 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011c01f070 con 0x7f012c06bbf0 2024-09-13T18:35:46.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.320+0000 7f013080a700 1 -- 172.21.15.44:0/596458358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f012c15df90 con 0x7f012c06bbf0 2024-09-13T18:35:46.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.320+0000 7f01137fe700 1 -- 172.21.15.44:0/596458358 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c0036c0 con 0x7f012c06bbf0 2024-09-13T18:35:46.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.320+0000 7f013080a700 1 -- 172.21.15.44:0/596458358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f012c156ad0 con 0x7f012c06bbf0 2024-09-13T18:35:46.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.320+0000 7f013080a700 1 -- 172.21.15.44:0/596458358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f012c156fd0 con 0x7f012c06bbf0 2024-09-13T18:35:46.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.320+0000 7f01137fe700 1 -- 172.21.15.44:0/596458358 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f011c021030 con 0x7f012c06bbf0 2024-09-13T18:35:46.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.320+0000 7f01137fe700 1 --2- 172.21.15.44:0/596458358 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0118066730 0x7f0118068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:46.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.320+0000 7f01137fe700 1 -- 172.21.15.44:0/596458358 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f011c0856b0 con 0x7f012c06bbf0 2024-09-13T18:35:46.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.320+0000 7f012ad9d700 1 --2- 172.21.15.44:0/596458358 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0118066730 0x7f0118068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:46.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.324+0000 7f012ad9d700 1 --2- 172.21.15.44:0/596458358 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0118066730 0x7f0118068bf0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f01200018a0 tx=0x7f0120009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:46.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.328+0000 7f01137fe700 1 -- 172.21.15.44:0/596458358 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f011c052ab0 con 0x7f012c06bbf0 2024-09-13T18:35:46.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.500+0000 7f013080a700 1 -- 172.21.15.44:0/596458358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f012c156fd0 con 0x7f012c06bbf0 2024-09-13T18:35:46.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.504+0000 7f01137fe700 1 -- 172.21.15.44:0/596458358 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f011c0560d0 con 0x7f012c06bbf0 2024-09-13T18:35:46.512 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:46.512 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":77,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:35:45.841016+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:44.271295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:44.844157+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:46.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.508+0000 7f013080a700 1 -- 172.21.15.44:0/596458358 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0118066730 msgr2=0x7f0118068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:46.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.508+0000 7f013080a700 1 --2- 172.21.15.44:0/596458358 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0118066730 0x7f0118068bf0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f01200018a0 tx=0x7f0120009040 comp rx=0 tx=0).stop 2024-09-13T18:35:46.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.508+0000 7f013080a700 1 -- 172.21.15.44:0/596458358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f012c06bbf0 msgr2=0x7f012c15d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:46.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.508+0000 7f013080a700 1 --2- 172.21.15.44:0/596458358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f012c06bbf0 0x7f012c15d740 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f012c06b360 tx=0x7f011c004770 comp rx=0 tx=0).stop 2024-09-13T18:35:46.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.508+0000 7f013080a700 1 -- 172.21.15.44:0/596458358 shutdown_connections 2024-09-13T18:35:46.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.508+0000 7f013080a700 1 --2- 172.21.15.44:0/596458358 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0118066730 0x7f0118068bf0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:46.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.508+0000 7f013080a700 1 --2- 172.21.15.44:0/596458358 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f012c0b3ae0 0x7f012c158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:46.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.508+0000 7f013080a700 1 --2- 172.21.15.44:0/596458358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f012c06bbf0 0x7f012c15d740 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:46.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.508+0000 7f013080a700 1 --2- 172.21.15.44:0/596458358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f012c06aaf0 0x7f012c150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:46.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.508+0000 7f013080a700 1 -- 172.21.15.44:0/596458358 >> 172.21.15.44:0/596458358 conn(0x7f012c0b0f00 msgr2=0x7f012c0661c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:46.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.508+0000 7f013080a700 1 -- 172.21.15.44:0/596458358 shutdown_connections 2024-09-13T18:35:46.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.508+0000 7f013080a700 1 -- 172.21.15.44:0/596458358 wait complete. 2024-09-13T18:35:46.528 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:35:46.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.648+0000 7f8ed759e700 1 Processor -- start 2024-09-13T18:35:46.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.648+0000 7f8ed759e700 1 -- start start 2024-09-13T18:35:46.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.648+0000 7f8ed759e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ed0007b20 0x7f8ed0039e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:46.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.648+0000 7f8ed759e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8ed00514d0 0x7f8ed003a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:46.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.648+0000 7f8ed759e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed00e5460 con 0x7f8ed00372b0 2024-09-13T18:35:46.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.648+0000 7f8ed759e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed0055dc0 con 0x7f8ed00514d0 2024-09-13T18:35:46.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.648+0000 7f8ed759e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed00e0f10 con 0x7f8ed0007b20 2024-09-13T18:35:46.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.648+0000 7f8ed659c700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8ed00372b0 0x7f8ed0007410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43836/0 (socket says 172.21.15.44:43836) 2024-09-13T18:35:46.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.648+0000 7f8ed659c700 1 -- 172.21.15.44:0/3675346076 learned_addr learned my addr 172.21.15.44:0/3675346076 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:46.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.648+0000 7f8ed6d9d700 1 --2- 172.21.15.44:0/3675346076 >> v2:172.21.15.99:3300/0 conn(0x7f8ed00514d0 0x7f8ed003a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:46.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.648+0000 7f8ed5d9b700 1 --2- 172.21.15.44:0/3675346076 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ed0007b20 0x7f8ed0039e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:46.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.648+0000 7f8ed559a700 1 -- 172.21.15.44:0/3675346076 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021705297 0 0) 0x7f8ed00e5460 con 0x7f8ed00372b0 2024-09-13T18:35:46.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.648+0000 7f8ed559a700 1 -- 172.21.15.44:0/3675346076 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ec00035d0 con 0x7f8ed00372b0 2024-09-13T18:35:46.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.648+0000 7f8ed6d9d700 1 -- 172.21.15.44:0/3675346076 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ed0007b20 msgr2=0x7f8ed0039e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:46.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.648+0000 7f8ed6d9d700 1 --2- 172.21.15.44:0/3675346076 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ed0007b20 0x7f8ed0039e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:46.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.648+0000 7f8ed6d9d700 1 -- 172.21.15.44:0/3675346076 >> v1:172.21.15.44:6789/0 conn(0x7f8ed00372b0 legacy=0x7f8ed0007410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:46.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.648+0000 7f8ed6d9d700 1 -- 172.21.15.44:0/3675346076 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed00e4590 con 0x7f8ed00514d0 2024-09-13T18:35:46.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.648+0000 7f8ed5d9b700 1 --2- 172.21.15.44:0/3675346076 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ed0007b20 0x7f8ed0039e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:46.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.648+0000 7f8ed6d9d700 1 --2- 172.21.15.44:0/3675346076 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ed00514d0 0x7f8ed003a340 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8ed804f480 tx=0x7f8ed8074840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d27b5bdc77adcba1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:46.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.652+0000 7f8ed559a700 1 -- 172.21.15.44:0/3675346076 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed804f010 con 0x7f8ed00514d0 2024-09-13T18:35:46.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.652+0000 7f8ed559a700 1 -- 172.21.15.44:0/3675346076 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed80730f0 con 0x7f8ed00514d0 2024-09-13T18:35:46.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.652+0000 7f8ed559a700 1 -- 172.21.15.44:0/3675346076 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed80734c0 con 0x7f8ed00514d0 2024-09-13T18:35:46.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.652+0000 7f8ed759e700 1 -- 172.21.15.44:0/3675346076 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ed00514d0 msgr2=0x7f8ed003a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:46.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.652+0000 7f8ed759e700 1 --2- 172.21.15.44:0/3675346076 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ed00514d0 0x7f8ed003a340 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8ed804f480 tx=0x7f8ed8074840 comp rx=0 tx=0).stop 2024-09-13T18:35:46.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.652+0000 7f8ed759e700 1 -- 172.21.15.44:0/3675346076 shutdown_connections 2024-09-13T18:35:46.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.652+0000 7f8ed759e700 1 --2- 172.21.15.44:0/3675346076 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ed00514d0 0x7f8ed003a340 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:46.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.652+0000 7f8ed759e700 1 --2- 172.21.15.44:0/3675346076 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ed0007b20 0x7f8ed0039e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:46.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.652+0000 7f8ed759e700 1 -- 172.21.15.44:0/3675346076 >> 172.21.15.44:0/3675346076 conn(0x7f8ed001e270 msgr2=0x7f8ed0054ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:46.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.652+0000 7f8ed759e700 1 -- 172.21.15.44:0/3675346076 shutdown_connections 2024-09-13T18:35:46.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.652+0000 7f8ed759e700 1 -- 172.21.15.44:0/3675346076 wait complete. 2024-09-13T18:35:46.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.656+0000 7f8ed759e700 1 Processor -- start 2024-09-13T18:35:46.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.656+0000 7f8ed759e700 1 -- start start 2024-09-13T18:35:46.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.656+0000 7f8ed759e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ed0007b20 0x7f8ed00da010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:46.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.656+0000 7f8ed759e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed00372b0 0x7f8ed00e1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:46.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.656+0000 7f8ed759e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ed00514d0 0x7f8ed00df0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:46.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.656+0000 7f8ed759e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed00da550 con 0x7f8ed00372b0 2024-09-13T18:35:46.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.656+0000 7f8ed759e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed016a510 con 0x7f8ed0007b20 2024-09-13T18:35:46.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.656+0000 7f8ed759e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed016a7f0 con 0x7f8ed00514d0 2024-09-13T18:35:46.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.656+0000 7f8ed5d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed00372b0 0x7f8ed00e1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:46.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.656+0000 7f8ed5d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed00372b0 0x7f8ed00e1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37726/0 (socket says 172.21.15.44:37726) 2024-09-13T18:35:46.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.656+0000 7f8ed659c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ed0007b20 0x7f8ed00da010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:46.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.656+0000 7f8ed5d9b700 1 -- 172.21.15.44:0/1288814996 learned_addr learned my addr 172.21.15.44:0/1288814996 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:46.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.656+0000 7f8ed6d9d700 1 --2- 172.21.15.44:0/1288814996 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ed00514d0 0x7f8ed00df0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:46.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.660+0000 7f8ed5d9b700 1 -- 172.21.15.44:0/1288814996 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ed00514d0 msgr2=0x7f8ed00df0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:46.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.660+0000 7f8ed5d9b700 1 --2- 172.21.15.44:0/1288814996 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ed00514d0 0x7f8ed00df0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:46.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.660+0000 7f8ed5d9b700 1 -- 172.21.15.44:0/1288814996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ed0007b20 msgr2=0x7f8ed00da010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:46.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.660+0000 7f8ed5d9b700 1 --2- 172.21.15.44:0/1288814996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ed0007b20 0x7f8ed00da010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:46.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.660+0000 7f8ed5d9b700 1 -- 172.21.15.44:0/1288814996 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc0094b0 con 0x7f8ed00372b0 2024-09-13T18:35:46.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.660+0000 7f8ed6d9d700 1 --2- 172.21.15.44:0/1288814996 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ed00514d0 0x7f8ed00df0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:46.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.660+0000 7f8ed5d9b700 1 --2- 172.21.15.44:0/1288814996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed00372b0 0x7f8ed00e1230 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00e9b0 tx=0x7f8ecc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:46.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.660+0000 7f8ec6ffd700 1 -- 172.21.15.44:0/1288814996 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc00ee50 con 0x7f8ed00372b0 2024-09-13T18:35:46.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.660+0000 7f8ec6ffd700 1 -- 172.21.15.44:0/1288814996 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ecc00c850 con 0x7f8ed00372b0 2024-09-13T18:35:46.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.660+0000 7f8ed759e700 1 -- 172.21.15.44:0/1288814996 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed804f5c0 con 0x7f8ed00372b0 2024-09-13T18:35:46.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.660+0000 7f8ec6ffd700 1 -- 172.21.15.44:0/1288814996 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc00cc00 con 0x7f8ed00372b0 2024-09-13T18:35:46.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.660+0000 7f8ed759e700 1 -- 172.21.15.44:0/1288814996 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed016adb0 con 0x7f8ed00372b0 2024-09-13T18:35:46.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.660+0000 7f8ed759e700 1 -- 172.21.15.44:0/1288814996 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed0005e10 con 0x7f8ed00372b0 2024-09-13T18:35:46.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.660+0000 7f8ec6ffd700 1 -- 172.21.15.44:0/1288814996 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8ecc004020 con 0x7f8ed00372b0 2024-09-13T18:35:46.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.660+0000 7f8ec6ffd700 1 --2- 172.21.15.44:0/1288814996 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8eb8066730 0x7f8eb8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:46.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.664+0000 7f8ec6ffd700 1 -- 172.21.15.44:0/1288814996 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ecc0841a0 con 0x7f8ed00372b0 2024-09-13T18:35:46.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.664+0000 7f8ed659c700 1 --2- 172.21.15.44:0/1288814996 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8eb8066730 0x7f8eb8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:46.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.664+0000 7f8ed659c700 1 --2- 172.21.15.44:0/1288814996 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8eb8066730 0x7f8eb8068bf0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8001360 tx=0x7f8ec8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:46.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.668+0000 7f8ec6ffd700 1 -- 172.21.15.44:0/1288814996 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8ecc0514f0 con 0x7f8ed00372b0 2024-09-13T18:35:46.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:46.880+0000 7f8ed759e700 1 -- 172.21.15.44:0/1288814996 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8ed000f020 con 0x7f8ed00372b0 2024-09-13T18:35:47.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:47.860+0000 7f8ec6ffd700 1 -- 172.21.15.44:0/1288814996 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v69) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8ecc054b10 con 0x7f8ed00372b0 2024-09-13T18:35:47.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:47.868+0000 7f8ed759e700 1 -- 172.21.15.44:0/1288814996 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8eb8066730 msgr2=0x7f8eb8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:47.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:47.868+0000 7f8ed759e700 1 --2- 172.21.15.44:0/1288814996 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8eb8066730 0x7f8eb8068bf0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8001360 tx=0x7f8ec8009040 comp rx=0 tx=0).stop 2024-09-13T18:35:47.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:47.868+0000 7f8ed759e700 1 -- 172.21.15.44:0/1288814996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed00372b0 msgr2=0x7f8ed00e1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:47.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:47.868+0000 7f8ed759e700 1 --2- 172.21.15.44:0/1288814996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed00372b0 0x7f8ed00e1230 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00e9b0 tx=0x7f8ecc00ecc0 comp rx=0 tx=0).stop 2024-09-13T18:35:47.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:47.868+0000 7f8ed759e700 1 -- 172.21.15.44:0/1288814996 shutdown_connections 2024-09-13T18:35:47.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:47.868+0000 7f8ed759e700 1 --2- 172.21.15.44:0/1288814996 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8eb8066730 0x7f8eb8068bf0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:47.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:47.868+0000 7f8ed759e700 1 --2- 172.21.15.44:0/1288814996 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ed00514d0 0x7f8ed00df0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:47.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:47.868+0000 7f8ed759e700 1 --2- 172.21.15.44:0/1288814996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed00372b0 0x7f8ed00e1230 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:47.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:47.868+0000 7f8ed759e700 1 --2- 172.21.15.44:0/1288814996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ed0007b20 0x7f8ed00da010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:47.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:47.868+0000 7f8ed759e700 1 -- 172.21.15.44:0/1288814996 >> 172.21.15.44:0/1288814996 conn(0x7f8ed001e270 msgr2=0x7f8ed0034b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:47.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:47.868+0000 7f8ed759e700 1 -- 172.21.15.44:0/1288814996 shutdown_connections 2024-09-13T18:35:47.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:47.868+0000 7f8ed759e700 1 -- 172.21.15.44:0/1288814996 wait complete. 2024-09-13T18:35:47.891 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:35:47.891 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:35:48.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.012+0000 7f09a022c700 1 Processor -- start 2024-09-13T18:35:48.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.012+0000 7f09a022c700 1 -- start start 2024-09-13T18:35:48.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f09a022c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f099815cda0 0x7f09980d1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:48.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f09a022c700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09980d0880 con 0x7f09980b5e00 2024-09-13T18:35:48.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f09a022c700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09980d16e0 con 0x7f09980ce260 2024-09-13T18:35:48.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f09a022c700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09980cde50 con 0x7f099815cda0 2024-09-13T18:35:48.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099d7c7700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f09980b5e00 0x7f09980b6240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43842/0 (socket says 172.21.15.44:43842) 2024-09-13T18:35:48.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099d7c7700 1 -- 172.21.15.44:0/1249824757 learned_addr learned my addr 172.21.15.44:0/1249824757 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:48.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099dfc8700 1 --2- 172.21.15.44:0/1249824757 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f099815cda0 0x7f09980d1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:48.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099cfc6700 1 -- 172.21.15.44:0/1249824757 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867820774 0 0) 0x7f09980d0880 con 0x7f09980b5e00 2024-09-13T18:35:48.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099cfc6700 1 -- 172.21.15.44:0/1249824757 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09840035d0 con 0x7f09980b5e00 2024-09-13T18:35:48.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099cfc6700 1 -- 172.21.15.44:0/1249824757 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779642458 0 0) 0x7f09980d16e0 con 0x7f09980ce260 2024-09-13T18:35:48.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099cfc6700 1 -- 172.21.15.44:0/1249824757 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09980d0880 con 0x7f09980ce260 2024-09-13T18:35:48.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099cfc6700 1 -- 172.21.15.44:0/1249824757 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 40388110 0 0) 0x7f09840035d0 con 0x7f09980b5e00 2024-09-13T18:35:48.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099cfc6700 1 -- 172.21.15.44:0/1249824757 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f099815cda0 msgr2=0x7f09980d1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:48.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099cfc6700 1 --2- 172.21.15.44:0/1249824757 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f099815cda0 0x7f09980d1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:48.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099cfc6700 1 -- 172.21.15.44:0/1249824757 >> v1:172.21.15.99:6789/0 conn(0x7f09980ce260 legacy=0x7f09980ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:48.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099cfc6700 1 -- 172.21.15.44:0/1249824757 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09980b6950 con 0x7f09980b5e00 2024-09-13T18:35:48.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099cfc6700 1 -- 172.21.15.44:0/1249824757 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f098c001670 con 0x7f09980b5e00 2024-09-13T18:35:48.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099cfc6700 1 -- 172.21.15.44:0/1249824757 >> v1:172.21.15.44:6789/0 conn(0x7f09980b5e00 legacy=0x7f09980b6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:48.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099cfc6700 1 --2- 172.21.15.44:0/1249824757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0984003be0 0x7f0984003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:48.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099cfc6700 1 --2- 172.21.15.44:0/1249824757 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f099815cda0 0x7f0984004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:48.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099cfc6700 1 --2- 172.21.15.44:0/1249824757 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0984004db0 0x7f0984005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:48.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099cfc6700 1 -- 172.21.15.44:0/1249824757 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09980cde50 con 0x7f0984003be0 2024-09-13T18:35:48.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099cfc6700 1 -- 172.21.15.44:0/1249824757 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098400bb30 con 0x7f0984004db0 2024-09-13T18:35:48.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099cfc6700 1 -- 172.21.15.44:0/1249824757 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098400bcf0 con 0x7f099815cda0 2024-09-13T18:35:48.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099dfc8700 1 --2- 172.21.15.44:0/1249824757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0984003be0 0x7f0984003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:48.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099d7c7700 1 --2- 172.21.15.44:0/1249824757 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f099815cda0 0x7f0984004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:48.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099e7c9700 1 --2- 172.21.15.44:0/1249824757 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0984004db0 0x7f0984005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:48.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099dfc8700 1 -- 172.21.15.44:0/1249824757 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f099815cda0 msgr2=0x7f0984004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:48.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099dfc8700 1 --2- 172.21.15.44:0/1249824757 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f099815cda0 0x7f0984004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:48.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099dfc8700 1 -- 172.21.15.44:0/1249824757 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0984004db0 msgr2=0x7f0984005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:48.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099dfc8700 1 --2- 172.21.15.44:0/1249824757 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0984004db0 0x7f0984005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:48.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099dfc8700 1 -- 172.21.15.44:0/1249824757 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09840035d0 con 0x7f0984003be0 2024-09-13T18:35:48.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099e7c9700 1 --2- 172.21.15.44:0/1249824757 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0984004db0 0x7f0984005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:48.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099dfc8700 1 --2- 172.21.15.44:0/1249824757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0984003be0 0x7f0984003fe0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f0994009b70 tx=0x7f09840058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f030ec18771f8bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:48.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099cfc6700 1 -- 172.21.15.44:0/1249824757 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099400e6c0 con 0x7f0984003be0 2024-09-13T18:35:48.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099cfc6700 1 -- 172.21.15.44:0/1249824757 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099400e820 con 0x7f0984003be0 2024-09-13T18:35:48.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.016+0000 7f099cfc6700 1 -- 172.21.15.44:0/1249824757 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099400eb90 con 0x7f0984003be0 2024-09-13T18:35:48.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.020+0000 7f09a022c700 1 -- 172.21.15.44:0/1249824757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0984003be0 msgr2=0x7f0984003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:48.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.020+0000 7f09a022c700 1 --2- 172.21.15.44:0/1249824757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0984003be0 0x7f0984003fe0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f0994009b70 tx=0x7f09840058a0 comp rx=0 tx=0).stop 2024-09-13T18:35:48.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.020+0000 7f099e7c9700 1 -- 172.21.15.44:0/1249824757 reap_dead start 2024-09-13T18:35:48.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.020+0000 7f09a022c700 1 -- 172.21.15.44:0/1249824757 shutdown_connections 2024-09-13T18:35:48.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.020+0000 7f09a022c700 1 -- 172.21.15.44:0/1249824757 >> 172.21.15.44:0/1249824757 conn(0x7f09980d2cb0 msgr2=0x7f09980d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:48.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.020+0000 7f09a022c700 1 -- 172.21.15.44:0/1249824757 shutdown_connections 2024-09-13T18:35:48.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.020+0000 7f09a022c700 1 -- 172.21.15.44:0/1249824757 wait complete. 2024-09-13T18:35:48.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.020+0000 7f09a022c700 1 Processor -- start 2024-09-13T18:35:48.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.020+0000 7f09a022c700 1 -- start start 2024-09-13T18:35:48.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.024+0000 7f09a022c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0984003be0 0x7f0998159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:48.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.024+0000 7f09a022c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0998154fb0 0x7f0998152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:48.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.024+0000 7f09a022c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09980c87d0 0x7f09980c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:48.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.024+0000 7f09a022c700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09980c9190 con 0x7f09980c87d0 2024-09-13T18:35:48.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.024+0000 7f09a022c700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09981563a0 con 0x7f0984003be0 2024-09-13T18:35:48.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.024+0000 7f09a022c700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0998153200 con 0x7f0998154fb0 2024-09-13T18:35:48.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.024+0000 7f099e7c9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09980c87d0 0x7f09980c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:48.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.024+0000 7f099e7c9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09980c87d0 0x7f09980c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37744/0 (socket says 172.21.15.44:37744) 2024-09-13T18:35:48.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.024+0000 7f099e7c9700 1 -- 172.21.15.44:0/2004672000 learned_addr learned my addr 172.21.15.44:0/2004672000 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:48.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.024+0000 7f099d7c7700 1 --2- 172.21.15.44:0/2004672000 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0998154fb0 0x7f0998152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:48.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.024+0000 7f099dfc8700 1 --2- 172.21.15.44:0/2004672000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0984003be0 0x7f0998159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:48.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.024+0000 7f099e7c9700 1 -- 172.21.15.44:0/2004672000 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0998154fb0 msgr2=0x7f0998152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:48.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.024+0000 7f099e7c9700 1 --2- 172.21.15.44:0/2004672000 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0998154fb0 0x7f0998152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:48.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.024+0000 7f099e7c9700 1 -- 172.21.15.44:0/2004672000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0984003be0 msgr2=0x7f0998159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:48.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.024+0000 7f099e7c9700 1 --2- 172.21.15.44:0/2004672000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0984003be0 0x7f0998159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:48.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.024+0000 7f099e7c9700 1 -- 172.21.15.44:0/2004672000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0998155790 con 0x7f09980c87d0 2024-09-13T18:35:48.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.024+0000 7f099e7c9700 1 --2- 172.21.15.44:0/2004672000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09980c87d0 0x7f09980c8c50 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f09980d2710 tx=0x7f099000dee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:48.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.024+0000 7f098a7fc700 1 -- 172.21.15.44:0/2004672000 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990003e30 con 0x7f09980c87d0 2024-09-13T18:35:48.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.024+0000 7f098a7fc700 1 -- 172.21.15.44:0/2004672000 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0990005070 con 0x7f09980c87d0 2024-09-13T18:35:48.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.024+0000 7f09a022c700 1 -- 172.21.15.44:0/2004672000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0998155a70 con 0x7f09980c87d0 2024-09-13T18:35:48.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.024+0000 7f098a7fc700 1 -- 172.21.15.44:0/2004672000 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990005420 con 0x7f09980c87d0 2024-09-13T18:35:48.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.024+0000 7f09a022c700 1 -- 172.21.15.44:0/2004672000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0998156030 con 0x7f09980c87d0 2024-09-13T18:35:48.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.024+0000 7f09a022c700 1 -- 172.21.15.44:0/2004672000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09980b6240 con 0x7f09980c87d0 2024-09-13T18:35:48.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.028+0000 7f098a7fc700 1 -- 172.21.15.44:0/2004672000 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0990005580 con 0x7f09980c87d0 2024-09-13T18:35:48.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.028+0000 7f098a7fc700 1 --2- 172.21.15.44:0/2004672000 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f097c066760 0x7f097c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:48.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.028+0000 7f098a7fc700 1 -- 172.21.15.44:0/2004672000 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0990083c20 con 0x7f09980c87d0 2024-09-13T18:35:48.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.028+0000 7f099dfc8700 1 --2- 172.21.15.44:0/2004672000 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f097c066760 0x7f097c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:48.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.028+0000 7f099dfc8700 1 --2- 172.21.15.44:0/2004672000 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f097c066760 0x7f097c068c20 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f09940090b0 tx=0x7f099401e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:48.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.036+0000 7f098a7fc700 1 -- 172.21.15.44:0/2004672000 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0990050f90 con 0x7f09980c87d0 2024-09-13T18:35:48.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.244+0000 7f09a022c700 1 -- 172.21.15.44:0/2004672000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f09981564e0 con 0x7f09980c87d0 2024-09-13T18:35:48.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.864+0000 7f098a7fc700 1 -- 172.21.15.44:0/2004672000 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v70) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0990018070 con 0x7f09980c87d0 2024-09-13T18:35:48.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.868+0000 7f09a022c700 1 -- 172.21.15.44:0/2004672000 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f097c066760 msgr2=0x7f097c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:48.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.868+0000 7f09a022c700 1 --2- 172.21.15.44:0/2004672000 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f097c066760 0x7f097c068c20 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f09940090b0 tx=0x7f099401e040 comp rx=0 tx=0).stop 2024-09-13T18:35:48.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.868+0000 7f09a022c700 1 -- 172.21.15.44:0/2004672000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09980c87d0 msgr2=0x7f09980c8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:48.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.868+0000 7f09a022c700 1 --2- 172.21.15.44:0/2004672000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09980c87d0 0x7f09980c8c50 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f09980d2710 tx=0x7f099000dee0 comp rx=0 tx=0).stop 2024-09-13T18:35:48.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.868+0000 7f09a022c700 1 -- 172.21.15.44:0/2004672000 shutdown_connections 2024-09-13T18:35:48.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.868+0000 7f09a022c700 1 --2- 172.21.15.44:0/2004672000 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f097c066760 0x7f097c068c20 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:48.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.868+0000 7f09a022c700 1 --2- 172.21.15.44:0/2004672000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09980c87d0 0x7f09980c8c50 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:48.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.868+0000 7f09a022c700 1 --2- 172.21.15.44:0/2004672000 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0998154fb0 0x7f0998152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:48.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.868+0000 7f09a022c700 1 --2- 172.21.15.44:0/2004672000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0984003be0 0x7f0998159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:48.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.868+0000 7f09a022c700 1 -- 172.21.15.44:0/2004672000 >> 172.21.15.44:0/2004672000 conn(0x7f09980d2cb0 msgr2=0x7f099806a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:48.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.872+0000 7f09a022c700 1 -- 172.21.15.44:0/2004672000 shutdown_connections 2024-09-13T18:35:48.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:48.872+0000 7f09a022c700 1 -- 172.21.15.44:0/2004672000 wait complete. 2024-09-13T18:35:48.894 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:35:48.894 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:35:49.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.008+0000 7f0a5c976700 1 Processor -- start 2024-09-13T18:35:49.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.008+0000 7f0a5c976700 1 -- start start 2024-09-13T18:35:49.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.008+0000 7f0a5c976700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a580cb130 0x7f0a5815d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.008+0000 7f0a5c976700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0a5815d640 0x7f0a58071810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.008+0000 7f0a5c976700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a580cc860 con 0x7f0a58071d50 2024-09-13T18:35:49.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.008+0000 7f0a5c976700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a580713f0 con 0x7f0a5815d640 2024-09-13T18:35:49.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.008+0000 7f0a5c976700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a580ce0e0 con 0x7f0a580cb130 2024-09-13T18:35:49.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.008+0000 7f0a5759e700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0a58071d50 0x7f0a580b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43856/0 (socket says 172.21.15.44:43856) 2024-09-13T18:35:49.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.008+0000 7f0a5759e700 1 -- 172.21.15.44:0/2377632080 learned_addr learned my addr 172.21.15.44:0/2377632080 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:49.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.008+0000 7f0a4ffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0a5815d640 0x7f0a58071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.008+0000 7f0a56d9d700 1 --2- 172.21.15.44:0/2377632080 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a580cb130 0x7f0a5815d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.012+0000 7f0a4ffff700 1 -- 172.21.15.44:0/2377632080 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a580cb130 msgr2=0x7f0a5815d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:49.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.012+0000 7f0a4ffff700 1 --2- 172.21.15.44:0/2377632080 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a580cb130 0x7f0a5815d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.012+0000 7f0a4ffff700 1 -- 172.21.15.44:0/2377632080 >> v1:172.21.15.44:6789/0 conn(0x7f0a58071d50 legacy=0x7f0a580b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.012+0000 7f0a4ffff700 1 -- 172.21.15.44:0/2377632080 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a580cb510 con 0x7f0a5815d640 2024-09-13T18:35:49.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.012+0000 7f0a56d9d700 1 --2- 172.21.15.44:0/2377632080 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a580cb130 0x7f0a5815d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:49.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.012+0000 7f0a4ffff700 1 --2- 172.21.15.44:0/2377632080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a5815d640 0x7f0a58071810 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f0a40009850 tx=0x7f0a40009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba87a3ba54008fef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:49.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.012+0000 7f0a5659c700 1 -- 172.21.15.44:0/2377632080 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40011830 con 0x7f0a5815d640 2024-09-13T18:35:49.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.012+0000 7f0a5659c700 1 -- 172.21.15.44:0/2377632080 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a40011990 con 0x7f0a5815d640 2024-09-13T18:35:49.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.012+0000 7f0a5659c700 1 -- 172.21.15.44:0/2377632080 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40011d20 con 0x7f0a5815d640 2024-09-13T18:35:49.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.012+0000 7f0a5c976700 1 -- 172.21.15.44:0/2377632080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a5815d640 msgr2=0x7f0a58071810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.012+0000 7f0a5c976700 1 --2- 172.21.15.44:0/2377632080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a5815d640 0x7f0a58071810 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f0a40009850 tx=0x7f0a40009b60 comp rx=0 tx=0).stop 2024-09-13T18:35:49.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.012+0000 7f0a5c976700 1 -- 172.21.15.44:0/2377632080 shutdown_connections 2024-09-13T18:35:49.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.012+0000 7f0a5c976700 1 --2- 172.21.15.44:0/2377632080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a5815d640 0x7f0a58071810 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.012+0000 7f0a5c976700 1 --2- 172.21.15.44:0/2377632080 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a580cb130 0x7f0a5815d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.012+0000 7f0a5c976700 1 -- 172.21.15.44:0/2377632080 >> 172.21.15.44:0/2377632080 conn(0x7f0a580b0f00 msgr2=0x7f0a580b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:49.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.012+0000 7f0a5c976700 1 -- 172.21.15.44:0/2377632080 shutdown_connections 2024-09-13T18:35:49.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.012+0000 7f0a5c976700 1 -- 172.21.15.44:0/2377632080 wait complete. 2024-09-13T18:35:49.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.012+0000 7f0a5c976700 1 Processor -- start 2024-09-13T18:35:49.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.012+0000 7f0a5c976700 1 -- start start 2024-09-13T18:35:49.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.016+0000 7f0a5c976700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a58071d50 0x7f0a5806cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.016+0000 7f0a5c976700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a580cb130 0x7f0a580c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.016+0000 7f0a5c976700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a5815d640 0x7f0a58144c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.016+0000 7f0a5c976700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a580c5670 con 0x7f0a58071d50 2024-09-13T18:35:49.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.016+0000 7f0a5c976700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a580c47b0 con 0x7f0a5815d640 2024-09-13T18:35:49.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.016+0000 7f0a5c976700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a580c49f0 con 0x7f0a580cb130 2024-09-13T18:35:49.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.016+0000 7f0a56d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a58071d50 0x7f0a5806cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.016+0000 7f0a56d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a58071d50 0x7f0a5806cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37750/0 (socket says 172.21.15.44:37750) 2024-09-13T18:35:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.016+0000 7f0a56d9d700 1 -- 172.21.15.44:0/2675438229 learned_addr learned my addr 172.21.15.44:0/2675438229 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.016+0000 7f0a4ffff700 1 --2- 172.21.15.44:0/2675438229 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a580cb130 0x7f0a580c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.016+0000 7f0a5759e700 1 --2- 172.21.15.44:0/2675438229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a5815d640 0x7f0a58144c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.016+0000 7f0a56d9d700 1 -- 172.21.15.44:0/2675438229 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a580cb130 msgr2=0x7f0a580c4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.016+0000 7f0a56d9d700 1 --2- 172.21.15.44:0/2675438229 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a580cb130 0x7f0a580c4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.016+0000 7f0a56d9d700 1 -- 172.21.15.44:0/2675438229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a5815d640 msgr2=0x7f0a58144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.016+0000 7f0a56d9d700 1 --2- 172.21.15.44:0/2675438229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a5815d640 0x7f0a58144c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.016+0000 7f0a56d9d700 1 -- 172.21.15.44:0/2675438229 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a400094b0 con 0x7f0a58071d50 2024-09-13T18:35:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.016+0000 7f0a5759e700 1 --2- 172.21.15.44:0/2675438229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a5815d640 0x7f0a58144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.016+0000 7f0a56d9d700 1 --2- 172.21.15.44:0/2675438229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a58071d50 0x7f0a5806cf90 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800e790 tx=0x7f0a4800eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.016+0000 7f0a4f7fe700 1 -- 172.21.15.44:0/2675438229 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a48004230 con 0x7f0a58071d50 2024-09-13T18:35:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.016+0000 7f0a4f7fe700 1 -- 172.21.15.44:0/2675438229 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a48004390 con 0x7f0a58071d50 2024-09-13T18:35:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.016+0000 7f0a5c976700 1 -- 172.21.15.44:0/2675438229 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a580c4cd0 con 0x7f0a58071d50 2024-09-13T18:35:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.016+0000 7f0a4f7fe700 1 -- 172.21.15.44:0/2675438229 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a480036c0 con 0x7f0a58071d50 2024-09-13T18:35:49.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.016+0000 7f0a5c976700 1 -- 172.21.15.44:0/2675438229 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a580c5290 con 0x7f0a58071d50 2024-09-13T18:35:49.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.020+0000 7f0a5c976700 1 -- 172.21.15.44:0/2675438229 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a58146530 con 0x7f0a58071d50 2024-09-13T18:35:49.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.020+0000 7f0a4f7fe700 1 -- 172.21.15.44:0/2675438229 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0a48003840 con 0x7f0a58071d50 2024-09-13T18:35:49.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.020+0000 7f0a4f7fe700 1 --2- 172.21.15.44:0/2675438229 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0a38066730 0x7f0a38068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.020+0000 7f0a4f7fe700 1 -- 172.21.15.44:0/2675438229 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a48083c10 con 0x7f0a58071d50 2024-09-13T18:35:49.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.020+0000 7f0a4ffff700 1 --2- 172.21.15.44:0/2675438229 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0a38066730 0x7f0a38068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.020+0000 7f0a4ffff700 1 --2- 172.21.15.44:0/2675438229 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0a38066730 0x7f0a38068bf0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0a40009850 tx=0x7f0a40008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:49.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.028+0000 7f0a4f7fe700 1 -- 172.21.15.44:0/2675438229 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0a48050ef0 con 0x7f0a58071d50 2024-09-13T18:35:49.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.240+0000 7f0a5c976700 1 -- 172.21.15.44:0/2675438229 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a580cc9f0 con 0x7f0a58071d50 2024-09-13T18:35:49.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.244+0000 7f0a4f7fe700 1 -- 172.21.15.44:0/2675438229 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f0a480094e0 con 0x7f0a58071d50 2024-09-13T18:35:49.249 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:49.249 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":70,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3463035694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3463035694},{"type":"v1","addr":"172.21.15.99:6837","nonce":3463035694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7438,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2910652037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2910652037},{"type":"v1","addr":"172.21.15.44:6833","nonce":2910652037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7456,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2231812307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2231812307},{"type":"v1","addr":"172.21.15.99:6835","nonce":2231812307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:35:45.841782+0000","modified":"2024-09-13T18:35:48.860780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7626},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7626":{"gid":7626,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/1921610909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1921610909},{"type":"v1","addr":"172.21.15.44:6835","nonce":1921610909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:35:49.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.244+0000 7f0a5c976700 1 -- 172.21.15.44:0/2675438229 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0a38066730 msgr2=0x7f0a38068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.244+0000 7f0a5c976700 1 --2- 172.21.15.44:0/2675438229 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0a38066730 0x7f0a38068bf0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0a40009850 tx=0x7f0a40008030 comp rx=0 tx=0).stop 2024-09-13T18:35:49.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.244+0000 7f0a5c976700 1 -- 172.21.15.44:0/2675438229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a58071d50 msgr2=0x7f0a5806cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.244+0000 7f0a5c976700 1 --2- 172.21.15.44:0/2675438229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a58071d50 0x7f0a5806cf90 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800e790 tx=0x7f0a4800eaa0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.244+0000 7f0a5c976700 1 -- 172.21.15.44:0/2675438229 shutdown_connections 2024-09-13T18:35:49.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.244+0000 7f0a5c976700 1 --2- 172.21.15.44:0/2675438229 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0a38066730 0x7f0a38068bf0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.244+0000 7f0a5c976700 1 --2- 172.21.15.44:0/2675438229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a5815d640 0x7f0a58144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.244+0000 7f0a5c976700 1 --2- 172.21.15.44:0/2675438229 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a580cb130 0x7f0a580c4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.244+0000 7f0a5c976700 1 --2- 172.21.15.44:0/2675438229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a58071d50 0x7f0a5806cf90 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.244+0000 7f0a5c976700 1 -- 172.21.15.44:0/2675438229 >> 172.21.15.44:0/2675438229 conn(0x7f0a580b0f00 msgr2=0x7f0a581e73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:49.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.244+0000 7f0a5c976700 1 -- 172.21.15.44:0/2675438229 shutdown_connections 2024-09-13T18:35:49.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.244+0000 7f0a5c976700 1 -- 172.21.15.44:0/2675438229 wait complete. 2024-09-13T18:35:49.253 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 70 2024-09-13T18:35:49.264 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:49.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.376+0000 7f580668b700 1 Processor -- start 2024-09-13T18:35:49.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.376+0000 7f580668b700 1 -- start start 2024-09-13T18:35:49.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.376+0000 7f580668b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58000b31c0 0x7f58000b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.376+0000 7f580668b700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f58000cd450 0x7f58000cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.376+0000 7f580668b700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58000cbe90 con 0x7f58001517f0 2024-09-13T18:35:49.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.376+0000 7f580668b700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58000b3b70 con 0x7f58000cd450 2024-09-13T18:35:49.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.376+0000 7f580668b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580006c6e0 con 0x7f58000b31c0 2024-09-13T18:35:49.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.376+0000 7f5805689700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f58001517f0 0x7f58000cb780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:55502/0 (socket says 172.21.15.44:55502) 2024-09-13T18:35:49.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.376+0000 7f5805689700 1 -- 172.21.15.44:0/8849031 learned_addr learned my addr 172.21.15.44:0/8849031 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:49.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.376+0000 7f5805e8a700 1 --2- 172.21.15.44:0/8849031 >> v2:172.21.15.99:3300/0 conn(0x7f58000cd450 0x7f58000cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.380+0000 7f5804e88700 1 --2- 172.21.15.44:0/8849031 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58000b31c0 0x7f58000b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.380+0000 7f5805e8a700 1 -- 172.21.15.44:0/8849031 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58000b31c0 msgr2=0x7f58000b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:49.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.380+0000 7f5805e8a700 1 --2- 172.21.15.44:0/8849031 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58000b31c0 0x7f58000b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.380+0000 7f5805e8a700 1 -- 172.21.15.44:0/8849031 >> v1:172.21.15.99:6789/0 conn(0x7f58001517f0 legacy=0x7f58000cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.380+0000 7f5805e8a700 1 -- 172.21.15.44:0/8849031 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580006c9c0 con 0x7f58000cd450 2024-09-13T18:35:49.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.380+0000 7f5805e8a700 1 --2- 172.21.15.44:0/8849031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58000cd450 0x7f58000cd8e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f57f8009dc0 tx=0x7f57f800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4de9337adb00380 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:49.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.380+0000 7f57f7fff700 1 -- 172.21.15.44:0/8849031 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f800e070 con 0x7f58000cd450 2024-09-13T18:35:49.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.380+0000 7f57f7fff700 1 -- 172.21.15.44:0/8849031 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f800bae0 con 0x7f58000cd450 2024-09-13T18:35:49.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.380+0000 7f57f7fff700 1 -- 172.21.15.44:0/8849031 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f800be90 con 0x7f58000cd450 2024-09-13T18:35:49.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.380+0000 7f580668b700 1 -- 172.21.15.44:0/8849031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58000cd450 msgr2=0x7f58000cd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.380+0000 7f580668b700 1 --2- 172.21.15.44:0/8849031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58000cd450 0x7f58000cd8e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f57f8009dc0 tx=0x7f57f800b330 comp rx=0 tx=0).stop 2024-09-13T18:35:49.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.380+0000 7f580668b700 1 -- 172.21.15.44:0/8849031 shutdown_connections 2024-09-13T18:35:49.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.380+0000 7f580668b700 1 --2- 172.21.15.44:0/8849031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58000cd450 0x7f58000cd8e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.380+0000 7f580668b700 1 --2- 172.21.15.44:0/8849031 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58000b31c0 0x7f58000b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.380+0000 7f580668b700 1 -- 172.21.15.44:0/8849031 >> 172.21.15.44:0/8849031 conn(0x7f580006d900 msgr2=0x7f580006dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:49.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.380+0000 7f580668b700 1 -- 172.21.15.44:0/8849031 shutdown_connections 2024-09-13T18:35:49.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.380+0000 7f580668b700 1 -- 172.21.15.44:0/8849031 wait complete. 2024-09-13T18:35:49.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.384+0000 7f580668b700 1 Processor -- start 2024-09-13T18:35:49.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.384+0000 7f580668b700 1 -- start start 2024-09-13T18:35:49.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.384+0000 7f580668b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58000b31c0 0x7f5800146ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.384+0000 7f580668b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58000cd450 0x7f580014d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.384+0000 7f580668b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58001517f0 0x7f580014aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.384+0000 7f580668b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5800148780 con 0x7f58000cd450 2024-09-13T18:35:49.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.384+0000 7f580668b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580014e830 con 0x7f58001517f0 2024-09-13T18:35:49.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.384+0000 7f580668b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580014e270 con 0x7f58000b31c0 2024-09-13T18:35:49.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.384+0000 7f5804e88700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58000cd450 0x7f580014d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.384+0000 7f5804e88700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58000cd450 0x7f580014d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37764/0 (socket says 172.21.15.44:37764) 2024-09-13T18:35:49.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.384+0000 7f5804e88700 1 -- 172.21.15.44:0/2500236865 learned_addr learned my addr 172.21.15.44:0/2500236865 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:49.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.384+0000 7f5805e8a700 1 --2- 172.21.15.44:0/2500236865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58001517f0 0x7f580014aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.384+0000 7f5805689700 1 --2- 172.21.15.44:0/2500236865 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58000b31c0 0x7f5800146ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.384+0000 7f5804e88700 1 -- 172.21.15.44:0/2500236865 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58000b31c0 msgr2=0x7f5800146ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.384+0000 7f5804e88700 1 --2- 172.21.15.44:0/2500236865 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58000b31c0 0x7f5800146ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.384+0000 7f5804e88700 1 -- 172.21.15.44:0/2500236865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58001517f0 msgr2=0x7f580014aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.384+0000 7f5804e88700 1 --2- 172.21.15.44:0/2500236865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58001517f0 0x7f580014aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.388+0000 7f5804e88700 1 -- 172.21.15.44:0/2500236865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f8009a70 con 0x7f58000cd450 2024-09-13T18:35:49.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.388+0000 7f5804e88700 1 --2- 172.21.15.44:0/2500236865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58000cd450 0x7f580014d820 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f57f000ea00 tx=0x7f57f000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:49.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.388+0000 7f57f5ffb700 1 -- 172.21.15.44:0/2500236865 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f0009720 con 0x7f58000cd450 2024-09-13T18:35:49.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.388+0000 7f57f5ffb700 1 -- 172.21.15.44:0/2500236865 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f000eea0 con 0x7f58000cd450 2024-09-13T18:35:49.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.388+0000 7f580668b700 1 -- 172.21.15.44:0/2500236865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f580014e550 con 0x7f58000cd450 2024-09-13T18:35:49.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.388+0000 7f57f5ffb700 1 -- 172.21.15.44:0/2500236865 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f000ca50 con 0x7f58000cd450 2024-09-13T18:35:49.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.388+0000 7f580668b700 1 -- 172.21.15.44:0/2500236865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5800147840 con 0x7f58000cd450 2024-09-13T18:35:49.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.388+0000 7f580668b700 1 -- 172.21.15.44:0/2500236865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f580006e9c0 con 0x7f58000cd450 2024-09-13T18:35:49.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.388+0000 7f57f5ffb700 1 -- 172.21.15.44:0/2500236865 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f57f000cbb0 con 0x7f58000cd450 2024-09-13T18:35:49.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.388+0000 7f57f5ffb700 1 --2- 172.21.15.44:0/2500236865 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f57e4066730 0x7f57e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.388+0000 7f57f5ffb700 1 -- 172.21.15.44:0/2500236865 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57f0084060 con 0x7f58000cd450 2024-09-13T18:35:49.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.388+0000 7f5805689700 1 --2- 172.21.15.44:0/2500236865 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f57e4066730 0x7f57e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.392+0000 7f5805689700 1 --2- 172.21.15.44:0/2500236865 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f57e4066730 0x7f57e4068bf0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f57fc005930 tx=0x7f57fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:49.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.396+0000 7f57f5ffb700 1 -- 172.21.15.44:0/2500236865 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f57f0051460 con 0x7f58000cd450 2024-09-13T18:35:49.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.572+0000 7f580668b700 1 -- 172.21.15.44:0/2500236865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58000cbc70 con 0x7f58000cd450 2024-09-13T18:35:49.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.576+0000 7f57f5ffb700 1 -- 172.21.15.44:0/2500236865 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16508 (secure 0 0 0) 0x7f57f0054a80 con 0x7f58000cd450 2024-09-13T18:35:49.582 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:49.582 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":78,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:35:46.845184+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:44.271295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:44.844157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:49.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.576+0000 7f580668b700 1 -- 172.21.15.44:0/2500236865 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f57e4066730 msgr2=0x7f57e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.576+0000 7f580668b700 1 --2- 172.21.15.44:0/2500236865 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f57e4066730 0x7f57e4068bf0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f57fc005930 tx=0x7f57fc009040 comp rx=0 tx=0).stop 2024-09-13T18:35:49.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.576+0000 7f580668b700 1 -- 172.21.15.44:0/2500236865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58000cd450 msgr2=0x7f580014d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.576+0000 7f580668b700 1 --2- 172.21.15.44:0/2500236865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58000cd450 0x7f580014d820 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f57f000ea00 tx=0x7f57f000ed10 comp rx=0 tx=0).stop 2024-09-13T18:35:49.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.576+0000 7f580668b700 1 -- 172.21.15.44:0/2500236865 shutdown_connections 2024-09-13T18:35:49.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.576+0000 7f580668b700 1 --2- 172.21.15.44:0/2500236865 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f57e4066730 0x7f57e4068bf0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.576+0000 7f580668b700 1 --2- 172.21.15.44:0/2500236865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58001517f0 0x7f580014aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.576+0000 7f580668b700 1 --2- 172.21.15.44:0/2500236865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58000cd450 0x7f580014d820 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.576+0000 7f580668b700 1 --2- 172.21.15.44:0/2500236865 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58000b31c0 0x7f5800146ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.576+0000 7f580668b700 1 -- 172.21.15.44:0/2500236865 >> 172.21.15.44:0/2500236865 conn(0x7f580006d900 msgr2=0x7f58000af590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:49.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.576+0000 7f580668b700 1 -- 172.21.15.44:0/2500236865 shutdown_connections 2024-09-13T18:35:49.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.576+0000 7f580668b700 1 -- 172.21.15.44:0/2500236865 wait complete. 2024-09-13T18:35:49.598 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:35:49.598 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:35:49.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.708+0000 7fe3d5d27700 1 Processor -- start 2024-09-13T18:35:49.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.708+0000 7fe3d5d27700 1 -- start start 2024-09-13T18:35:49.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.708+0000 7fe3d5d27700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3d0159780 0x7fe3d006b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.708+0000 7fe3d5d27700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d006bd80 con 0x7fe3d006b940 2024-09-13T18:35:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.708+0000 7fe3d5d27700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d00b3960 con 0x7fe3d00b33e0 2024-09-13T18:35:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.708+0000 7fe3d5d27700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00b3c40 con 0x7fe3d0159780 2024-09-13T18:35:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.708+0000 7fe3cffff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe3d006b940 0x7fe3d00b2cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43866/0 (socket says 172.21.15.44:43866) 2024-09-13T18:35:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.712+0000 7fe3cffff700 1 -- 172.21.15.44:0/3813805812 learned_addr learned my addr 172.21.15.44:0/3813805812 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:49.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.712+0000 7fe3d4d25700 1 --2- 172.21.15.44:0/3813805812 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3d0159780 0x7fe3d006b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.712+0000 7fe3cf7fe700 1 -- 172.21.15.44:0/3813805812 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749465872 0 0) 0x7fe3d006bd80 con 0x7fe3d006b940 2024-09-13T18:35:49.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.712+0000 7fe3cf7fe700 1 -- 172.21.15.44:0/3813805812 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3c00035d0 con 0x7fe3d006b940 2024-09-13T18:35:49.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.712+0000 7fe3cf7fe700 1 -- 172.21.15.44:0/3813805812 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062228863 0 0) 0x7fe3d00b3960 con 0x7fe3d00b33e0 2024-09-13T18:35:49.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.712+0000 7fe3cf7fe700 1 -- 172.21.15.44:0/3813805812 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3d006bd80 con 0x7fe3d00b33e0 2024-09-13T18:35:49.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.712+0000 7fe3cf7fe700 1 -- 172.21.15.44:0/3813805812 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1883226328 0 0) 0x7fe3c00035d0 con 0x7fe3d006b940 2024-09-13T18:35:49.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.712+0000 7fe3d4d25700 1 -- 172.21.15.44:0/3813805812 >> v1:172.21.15.99:6789/0 conn(0x7fe3d00b33e0 legacy=0x7fe3d00cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.712+0000 7fe3d4d25700 1 -- 172.21.15.44:0/3813805812 >> v1:172.21.15.44:6789/0 conn(0x7fe3d006b940 legacy=0x7fe3d00b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.712+0000 7fe3d4d25700 1 -- 172.21.15.44:0/3813805812 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d00b3f20 con 0x7fe3d0159780 2024-09-13T18:35:49.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.712+0000 7fe3d4d25700 1 --2- 172.21.15.44:0/3813805812 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3d0159780 0x7fe3d006b400 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009880 tx=0x7fe3c4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a222fdeec61125f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:49.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.712+0000 7fe3cf7fe700 1 -- 172.21.15.44:0/3813805812 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc001670 con 0x7fe3d0159780 2024-09-13T18:35:49.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.712+0000 7fe3cf7fe700 1 -- 172.21.15.44:0/3813805812 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c4004030 con 0x7fe3d0159780 2024-09-13T18:35:49.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.712+0000 7fe3cf7fe700 1 -- 172.21.15.44:0/3813805812 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c40043c0 con 0x7fe3d0159780 2024-09-13T18:35:49.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.712+0000 7fe3d5d27700 1 -- 172.21.15.44:0/3813805812 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3d0159780 msgr2=0x7fe3d006b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.712+0000 7fe3d5d27700 1 --2- 172.21.15.44:0/3813805812 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3d0159780 0x7fe3d006b400 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009880 tx=0x7fe3c4009b90 comp rx=0 tx=0).stop 2024-09-13T18:35:49.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.712+0000 7fe3d5d27700 1 -- 172.21.15.44:0/3813805812 shutdown_connections 2024-09-13T18:35:49.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.712+0000 7fe3d5d27700 1 --2- 172.21.15.44:0/3813805812 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3d0159780 0x7fe3d006b400 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.712+0000 7fe3d5d27700 1 -- 172.21.15.44:0/3813805812 >> 172.21.15.44:0/3813805812 conn(0x7fe3d006a4f0 msgr2=0x7fe3d006a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:49.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.712+0000 7fe3d5d27700 1 -- 172.21.15.44:0/3813805812 shutdown_connections 2024-09-13T18:35:49.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.712+0000 7fe3d5d27700 1 -- 172.21.15.44:0/3813805812 wait complete. 2024-09-13T18:35:49.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3d5d27700 1 Processor -- start 2024-09-13T18:35:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3d5d27700 1 -- start start 2024-09-13T18:35:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3d5d27700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3d006b940 0x7fe3d0149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3d5d27700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3d00b33e0 0x7fe3d015bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3d5d27700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d0159780 0x7fe3d0148b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3d5d27700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d014a460 con 0x7fe3d00b33e0 2024-09-13T18:35:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3d5d27700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d0156630 con 0x7fe3d0159780 2024-09-13T18:35:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3d5d27700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d014a880 con 0x7fe3d006b940 2024-09-13T18:35:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3cffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3d00b33e0 0x7fe3d015bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3d4d25700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3d006b940 0x7fe3d0149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3d4d25700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3d006b940 0x7fe3d0149200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:54212/0 (socket says 172.21.15.44:54212) 2024-09-13T18:35:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3d4d25700 1 -- 172.21.15.44:0/736863997 learned_addr learned my addr 172.21.15.44:0/736863997 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3d5526700 1 --2- 172.21.15.44:0/736863997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d0159780 0x7fe3d0148b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3cffff700 1 -- 172.21.15.44:0/736863997 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3d006b940 msgr2=0x7fe3d0149200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3cffff700 1 --2- 172.21.15.44:0/736863997 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3d006b940 0x7fe3d0149200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3cffff700 1 -- 172.21.15.44:0/736863997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d0159780 msgr2=0x7fe3d0148b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3cffff700 1 --2- 172.21.15.44:0/736863997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d0159780 0x7fe3d0148b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3cffff700 1 -- 172.21.15.44:0/736863997 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c40094b0 con 0x7fe3d00b33e0 2024-09-13T18:35:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3cffff700 1 --2- 172.21.15.44:0/736863997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3d00b33e0 0x7fe3d015bdf0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00c550 tx=0x7fe3bc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3cd7fa700 1 -- 172.21.15.44:0/736863997 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc004ca0 con 0x7fe3d00b33e0 2024-09-13T18:35:49.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3cd7fa700 1 -- 172.21.15.44:0/736863997 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc004e20 con 0x7fe3d00b33e0 2024-09-13T18:35:49.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3d5d27700 1 -- 172.21.15.44:0/736863997 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d01497e0 con 0x7fe3d00b33e0 2024-09-13T18:35:49.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3cd7fa700 1 -- 172.21.15.44:0/736863997 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc007310 con 0x7fe3d00b33e0 2024-09-13T18:35:49.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.716+0000 7fe3d5d27700 1 -- 172.21.15.44:0/736863997 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d0149da0 con 0x7fe3d00b33e0 2024-09-13T18:35:49.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.720+0000 7fe3d5d27700 1 -- 172.21.15.44:0/736863997 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d014a5a0 con 0x7fe3d00b33e0 2024-09-13T18:35:49.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.720+0000 7fe3cd7fa700 1 -- 172.21.15.44:0/736863997 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe3bc007470 con 0x7fe3d00b33e0 2024-09-13T18:35:49.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.720+0000 7fe3cd7fa700 1 --2- 172.21.15.44:0/736863997 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe3b4066730 0x7fe3b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.720+0000 7fe3cd7fa700 1 -- 172.21.15.44:0/736863997 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3bc083d90 con 0x7fe3d00b33e0 2024-09-13T18:35:49.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.720+0000 7fe3d4d25700 1 --2- 172.21.15.44:0/736863997 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe3b4066730 0x7fe3b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.724+0000 7fe3d4d25700 1 --2- 172.21.15.44:0/736863997 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe3b4066730 0x7fe3b4068bf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4000c00 tx=0x7fe3c4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:49.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.728+0000 7fe3cd7fa700 1 -- 172.21.15.44:0/736863997 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe3d014a5a0 con 0x7fe3d00b33e0 2024-09-13T18:35:49.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.896+0000 7fe3d5d27700 1 -- 172.21.15.44:0/736863997 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe3d00cbfe0 con 0x7fe3b4066730 2024-09-13T18:35:49.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.916+0000 7fe3cd7fa700 1 -- 172.21.15.44:0/736863997 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+272963 (secure 0 0 0) 0x7fe3c4020070 con 0x7fe3b4066730 2024-09-13T18:35:49.926 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:49.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.920+0000 7fe3d5d27700 1 -- 172.21.15.44:0/736863997 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe3b4066730 msgr2=0x7fe3b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.920+0000 7fe3d5d27700 1 --2- 172.21.15.44:0/736863997 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe3b4066730 0x7fe3b4068bf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4000c00 tx=0x7fe3c4010000 comp rx=0 tx=0).stop 2024-09-13T18:35:49.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.920+0000 7fe3d5d27700 1 -- 172.21.15.44:0/736863997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3d00b33e0 msgr2=0x7fe3d015bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.920+0000 7fe3d5d27700 1 --2- 172.21.15.44:0/736863997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3d00b33e0 0x7fe3d015bdf0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00c550 tx=0x7fe3bc00c860 comp rx=0 tx=0).stop 2024-09-13T18:35:49.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.920+0000 7fe3d5d27700 1 -- 172.21.15.44:0/736863997 shutdown_connections 2024-09-13T18:35:49.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.920+0000 7fe3d5d27700 1 --2- 172.21.15.44:0/736863997 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe3b4066730 0x7fe3b4068bf0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.920+0000 7fe3d5d27700 1 --2- 172.21.15.44:0/736863997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d0159780 0x7fe3d0148b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.920+0000 7fe3d5d27700 1 --2- 172.21.15.44:0/736863997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3d00b33e0 0x7fe3d015bdf0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.920+0000 7fe3d5d27700 1 --2- 172.21.15.44:0/736863997 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3d006b940 0x7fe3d0149200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.920+0000 7fe3d5d27700 1 -- 172.21.15.44:0/736863997 >> 172.21.15.44:0/736863997 conn(0x7fe3d006a4f0 msgr2=0x7fe3d00cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:49.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.920+0000 7fe3d5d27700 1 -- 172.21.15.44:0/736863997 shutdown_connections 2024-09-13T18:35:49.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:49.920+0000 7fe3d5d27700 1 -- 172.21.15.44:0/736863997 wait complete. 2024-09-13T18:35:49.929 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:35:49.942 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":341,"stamp":"2024-09-13T18:35:48.506545+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":287472,"kb_used_data":8200,"kb_used_omap":12,"kb_used_meta":279155,"kb_avail":754687248,"statfs":{"total":773094113280,"available":772799741952,"internally_reserved":0,"allocated":8396800,"data_stored":4246136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":285855288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.059163"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":211,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.954373+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:35:41.954373+0000","last_peered":"2024-09-13T18:35:41.954373+0000","last_clean":"2024-09-13T18:35:41.954373+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:35:41.954373+0000","last_undegraded":"2024-09-13T18:35:41.954373+0000","last_fullsized":"2024-09-13T18:35:41.954373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574958,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1495040,"data_stored":973543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.38700000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.024,"5min":1.099,"15min":1.163},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75,"15min":0.79000000000000004},"min":{"1min":0.56299999999999994,"5min":0.436,"15min":0.436},"max":{"1min":1.0900000000000001,"5min":1.288,"15min":1.288},"last":0.64400000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.82299999999999995,"15min":0.874},"min":{"1min":0.59199999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.155,"5min":1.288,"15min":1.7689999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.878,"15min":0.93500000000000005},"min":{"1min":0.65200000000000002,"5min":0.54100000000000004,"15min":0.52600000000000002},"max":{"1min":1.1240000000000001,"5min":1.3009999999999999,"15min":1.6140000000000001},"last":1.0129999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.81599999999999995,"15min":0.84599999999999997},"min":{"1min":0.61899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.101,"5min":1.2270000000000001,"15min":1.3340000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.82799999999999996,"15min":0.88600000000000001},"min":{"1min":0.49299999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2390000000000001,"5min":1.524,"15min":1.6659999999999999},"last":0.94699999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.88100000000000001,"15min":0.89000000000000001},"min":{"1min":0.61399999999999999,"5min":0.54300000000000004,"15min":0.52600000000000002},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.88,"15min":0.88100000000000001},"min":{"1min":0.64500000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0940000000000001,"5min":1.486,"15min":1.486},"last":1.097}]},{"osd":4,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.86099999999999999,"15min":0.88200000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.038,"5min":1.4590000000000001,"15min":1.7290000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.0129999999999999,"15min":1.0369999999999999},"min":{"1min":0.70299999999999996,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1639999999999999,"5min":1.49,"15min":1.7050000000000001},"last":1.075}]},{"osd":5,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.95699999999999996,"15min":0.95599999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.196,"5min":1.4159999999999999,"15min":1.4259999999999999},"last":1.147},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.048,"15min":1.0509999999999999},"min":{"1min":0.73299999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2170000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.1200000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.0429999999999999,"15min":1.083},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.58099999999999996},"max":{"1min":1.212,"5min":1.4730000000000001,"15min":2.077},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0940000000000001,"15min":1.0760000000000001},"min":{"1min":0.81999999999999995,"5min":0.74399999999999999,"15min":0.69099999999999995},"max":{"1min":1.258,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.98399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31996,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":901120,"data_stored":383175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78800000000000003,"15min":0.82099999999999995},"min":{"1min":0.47899999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.1799999999999999,"5min":1.22,"15min":1.2270000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.77500000000000002,"15min":0.81699999999999995},"min":{"1min":0.56599999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0880000000000001,"5min":1.2470000000000001,"15min":1.361},"last":0.748}]},{"osd":1,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.76900000000000002,"15min":0.81000000000000005},"min":{"1min":0.55900000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0389999999999999,"5min":1.266,"15min":1.266},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.877,"5min":0.81999999999999995,"15min":0.82499999999999996},"min":{"1min":0.52700000000000002,"5min":0.48299999999999998,"15min":0.48099999999999998},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.86699999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.79500000000000004,"15min":0.80900000000000005},"min":{"1min":0.55900000000000005,"5min":0.47399999999999998,"15min":0.46899999999999997},"max":{"1min":1.1319999999999999,"5min":1.141,"15min":1.254},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.84199999999999997,"15min":0.85899999999999999},"min":{"1min":0.60099999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.101,"5min":1.248,"15min":1.248},"last":0.96999999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.89900000000000002,"15min":0.876},"min":{"1min":0.60099999999999998,"5min":0.57599999999999996,"15min":0.52300000000000002},"max":{"1min":1.1870000000000001,"5min":1.238,"15min":1.238},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.89200000000000002,"15min":0.93600000000000005},"min":{"1min":0.68899999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1839999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.84799999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.85399999999999998,"15min":0.88300000000000001},"min":{"1min":0.68300000000000005,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1679999999999999,"5min":1.236,"15min":1.248},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.95899999999999996,"15min":0.98999999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2709999999999999,"5min":1.407,"15min":1.407},"last":0.63100000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.022,"15min":1.038},"min":{"1min":0.81699999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.226,"5min":1.355,"15min":1.355},"last":1.069},{"interface":"front","average":{"1min":0.997,"5min":0.96599999999999997,"15min":0.97999999999999998},"min":{"1min":0.67800000000000005,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2130000000000001,"5min":1.353,"15min":1.4990000000000001},"last":0.91900000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.98799999999999999,"15min":1},"min":{"1min":0.65900000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2470000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0980000000000001,"15min":1.1080000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76000000000000001},"max":{"1min":1.3120000000000001,"5min":1.367,"15min":1.3740000000000001},"last":1.008}]}]},{"osd":5,"up_from":13,"seq":55834574958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31996,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":901120,"data_stored":383175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77000000000000002,"15min":0.82399999999999995},"min":{"1min":0.52200000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.147,"5min":1.3280000000000001,"15min":1.3640000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.78500000000000003,"15min":0.84999999999999998},"min":{"1min":0.60299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0980000000000001,"5min":1.2190000000000001,"15min":1.482},"last":1.1559999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.78500000000000003,"15min":0.79800000000000004},"min":{"1min":0.626,"5min":0.42499999999999999,"15min":0.40999999999999998},"max":{"1min":1.224,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.84699999999999998,"15min":0.91700000000000004},"min":{"1min":0.63300000000000001,"5min":0.50900000000000001,"15min":0.45200000000000001},"max":{"1min":1.1890000000000001,"5min":1.218,"15min":1.4850000000000001},"last":0.81599999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92000000000000004,"15min":0.94799999999999995},"min":{"1min":0.65100000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1830000000000001,"5min":1.2430000000000001,"15min":1.4179999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.92300000000000004,"15min":0.98899999999999999},"min":{"1min":0.71199999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.252,"5min":1.3029999999999999,"15min":1.4690000000000001},"last":0.86299999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.88100000000000001,"15min":0.93100000000000005},"min":{"1min":0.70499999999999996,"5min":0.55800000000000005,"15min":0.51700000000000002},"max":{"1min":1.153,"5min":1.2010000000000001,"15min":1.4510000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.88,"15min":0.93100000000000005},"min":{"1min":0.70799999999999996,"5min":0.61199999999999999,"15min":0.55300000000000005},"max":{"1min":1.1279999999999999,"5min":1.335,"15min":1.4990000000000001},"last":0.92700000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.92800000000000005,"15min":0.96099999999999997},"min":{"1min":0.60999999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.077,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.099},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.95899999999999996,"15min":1.0169999999999999},"min":{"1min":0.61799999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.143,"5min":1.3759999999999999,"15min":1.542},"last":1.028}]},{"osd":6,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.97099999999999997,"15min":1.0169999999999999},"min":{"1min":0.72399999999999998,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3129999999999999,"5min":1.4259999999999999,"15min":1.698},"last":1.079},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.107,"15min":1.1499999999999999},"min":{"1min":0.94999999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.286,"5min":1.52,"15min":1.581},"last":0.998}]},{"osd":7,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0620000000000001,"15min":1.155},"min":{"1min":0.83399999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.272,"5min":1.552,"15min":1.847},"last":1.256},{"interface":"front","average":{"1min":1.038,"5min":1.0600000000000001,"15min":1.125},"min":{"1min":0.81899999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.216,"5min":1.4259999999999999,"15min":1.8100000000000001},"last":1.198}]}]},{"osd":4,"up_from":13,"seq":55834574958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45948,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325892,"statfs":{"total":96636764160,"available":96589713408,"internally_reserved":0,"allocated":901120,"data_stored":383175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.80900000000000005,"15min":0.88},"min":{"1min":0.54900000000000004,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.119,"5min":1.1930000000000001,"15min":1.3720000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.874,"15min":0.94599999999999995},"min":{"1min":0.69399999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1479999999999999,"5min":1.3280000000000001,"15min":1.5229999999999999},"last":1.163}]},{"osd":1,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.76300000000000001,"15min":0.79500000000000004},"min":{"1min":0.68400000000000005,"5min":0.441,"15min":0.435},"max":{"1min":1.012,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.81999999999999995,"15min":0.84599999999999997},"min":{"1min":0.60499999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.91700000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78300000000000003,"15min":0.83899999999999997},"min":{"1min":0.55300000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0780000000000001,"5min":1.171,"15min":1.171},"last":0.879},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.86199999999999999,"15min":0.85399999999999998},"min":{"1min":0.66700000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1719999999999999,"5min":1.331,"15min":1.331},"last":1.03}]},{"osd":3,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.89200000000000002,"15min":0.95699999999999996},"min":{"1min":0.68899999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.163,"5min":1.268,"15min":1.639},"last":1.2769999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.91200000000000003,"15min":0.97099999999999997},"min":{"1min":0.65000000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.119,"5min":1.2629999999999999,"15min":1.8300000000000001},"last":0.83399999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.91500000000000004,"15min":0.96399999999999997},"min":{"1min":0.65900000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.381,"5min":1.518,"15min":2.3889999999999998},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0389999999999999,"15min":1.095},"min":{"1min":0.70599999999999996,"5min":0.626,"15min":0.626},"max":{"1min":1.2969999999999999,"5min":1.375,"15min":2.0049999999999999},"last":1.605}]},{"osd":6,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.95499999999999996,"15min":0.91200000000000003},"min":{"1min":0.64300000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2829999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.083},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.075,"15min":1.0960000000000001},"min":{"1min":0.94599999999999995,"5min":0.70099999999999996,"15min":0.63500000000000001},"max":{"1min":1.423,"5min":1.4259999999999999,"15min":1.794},"last":1.3400000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.046,"15min":1.069},"min":{"1min":0.89800000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.228,"5min":1.643,"15min":1.669},"last":1.659},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.048,"15min":1.03},"min":{"1min":0.70099999999999996,"5min":0.69499999999999995,"15min":0.61799999999999999},"max":{"1min":1.357,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.2410000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31996,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":901120,"data_stored":383175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61499999999999999,"15min":0.66500000000000004},"min":{"1min":0.505,"5min":0.22,"15min":0.22},"max":{"1min":0.88300000000000001,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.59899999999999998,"15min":0.65900000000000003},"min":{"1min":0.52700000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.1970000000000001},"last":0.66800000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.64800000000000002,"15min":0.69499999999999995},"min":{"1min":0.504,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0920000000000001,"5min":1.379,"15min":1.379},"last":0.627},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.71399999999999997,"15min":0.79400000000000004},"min":{"1min":0.54800000000000004,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.042,"5min":1.397,"15min":2.0030000000000001},"last":1.1419999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.72299999999999998,"15min":0.76900000000000002},"min":{"1min":0.60799999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1970000000000001,"5min":1.3300000000000001,"15min":1.333},"last":0.872},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.78800000000000003,"15min":0.86699999999999999},"min":{"1min":0.66400000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.2430000000000001,"5min":1.423,"15min":1.423},"last":1.2070000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.871,"15min":0.93700000000000006},"min":{"1min":0.77400000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.04,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":1.1779999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.93500000000000005,"15min":1.016},"min":{"1min":0.74199999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.393,"5min":1.587,"15min":1.587},"last":1.3440000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.004,"15min":1.1299999999999999},"min":{"1min":0.80600000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5620000000000001,"5min":1.6200000000000001,"15min":2.2320000000000002},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.96999999999999997,"15min":1.079},"min":{"1min":0.81299999999999994,"5min":0.53900000000000003,"15min":0.53600000000000003},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.718},"last":1.252}]},{"osd":6,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.0229999999999999,"15min":1.1060000000000001},"min":{"1min":0.84299999999999997,"5min":0.496,"15min":0.496},"max":{"1min":1.3999999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.0489999999999999,"15min":1.179},"min":{"1min":0.96199999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4790000000000001,"5min":1.51,"15min":2.1819999999999999},"last":1.321}]},{"osd":7,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.01,"15min":1.083},"min":{"1min":0.871,"5min":0.624,"15min":0.624},"max":{"1min":1.2050000000000001,"5min":1.3759999999999999,"15min":1.4670000000000001},"last":0.998},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.0649999999999999,"15min":1.153},"min":{"1min":0.97599999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.444,"5min":1.548,"15min":1.5920000000000001},"last":1.22}]}]},{"osd":2,"up_from":13,"seq":55834574959,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40188,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331652,"statfs":{"total":96636764160,"available":96595611648,"internally_reserved":0,"allocated":901120,"data_stored":383175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.628,"15min":0.66000000000000003},"min":{"1min":0.498,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":1.056,"5min":1.1020000000000001,"15min":1.1919999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.69899999999999995,"15min":0.77100000000000002},"min":{"1min":0.56899999999999995,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.014,"5min":1.036,"15min":1.4370000000000001},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.64900000000000002,"15min":0.69599999999999995},"min":{"1min":0.52200000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2629999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.67200000000000004,"15min":0.72299999999999998},"min":{"1min":0.58799999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.65500000000000003,"15min":0.67000000000000004},"min":{"1min":0.56200000000000006,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.89300000000000002,"5min":1.0489999999999999,"15min":1.1619999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.83099999999999996,"15min":0.85499999999999998},"min":{"1min":0.57999999999999996,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.248,"5min":1.3460000000000001,"15min":1.548},"last":0.85499999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.95399999999999996,"15min":0.97399999999999998},"min":{"1min":0.83599999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.272,"5min":1.653,"15min":1.653},"last":1.111},{"interface":"front","average":{"1min":0.998,"5min":0.95499999999999996,"15min":1.028},"min":{"1min":0.78600000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.347,"5min":1.51,"15min":2.3849999999999998},"last":0.996}]},{"osd":5,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.92200000000000004,"15min":0.92300000000000004},"min":{"1min":0.67300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2390000000000001,"5min":1.4730000000000001,"15min":1.498},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0189999999999999,"15min":1.05},"min":{"1min":0.76700000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.3260000000000001,"5min":1.7549999999999999,"15min":1.869},"last":1.254}]},{"osd":6,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.0169999999999999,"15min":1.0860000000000001},"min":{"1min":0.81200000000000006,"5min":0.502,"15min":0.502},"max":{"1min":1.454,"5min":1.6120000000000001,"15min":2.762},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.997,"15min":1.0349999999999999},"min":{"1min":0.81899999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2270000000000001,"5min":1.5509999999999999,"15min":1.988},"last":1.022}]},{"osd":7,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0700000000000001,"15min":1.1419999999999999},"min":{"1min":0.92500000000000004,"5min":0.61099999999999999,"15min":0.59799999999999998},"max":{"1min":1.4099999999999999,"5min":1.8240000000000001,"15min":2.6800000000000002},"last":1.171},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0680000000000001,"15min":1.0720000000000001},"min":{"1min":0.871,"5min":0.64100000000000001,"15min":0.52800000000000002},"max":{"1min":1.2829999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.149}]}]},{"osd":1,"up_from":13,"seq":55834574959,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31996,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":901120,"data_stored":383175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.63600000000000001,"15min":0.63300000000000001},"min":{"1min":0.46899999999999997,"5min":0.34300000000000003,"15min":0.33200000000000002},"max":{"1min":1.01,"5min":1.087,"15min":1.107},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.68400000000000005,"15min":0.72999999999999998},"min":{"1min":0.51600000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.048,"5min":1.341,"15min":1.3560000000000001},"last":0.745}]},{"osd":2,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.61099999999999999,"15min":0.63},"min":{"1min":0.51500000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.88900000000000001,"5min":1.133,"15min":1.1879999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.73699999999999999,"15min":0.748},"min":{"1min":0.36399999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.139,"5min":1.617,"15min":1.617},"last":0.47599999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.57599999999999996,"5min":0.375,"15min":0.375},"max":{"1min":1.052,"5min":1.415,"15min":1.415},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.75700000000000001,"15min":0.78400000000000003},"min":{"1min":0.56599999999999995,"5min":0.35999999999999999,"15min":0.35699999999999998},"max":{"1min":1.111,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.51000000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.94699999999999995,"15min":0.95699999999999996},"min":{"1min":0.81200000000000006,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2769999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.96199999999999997,"15min":0.97299999999999998},"min":{"1min":0.73799999999999999,"5min":0.57599999999999996,"15min":0.54100000000000004},"max":{"1min":1.1830000000000001,"5min":1.52,"15min":1.994},"last":0.96899999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.97299999999999998,"15min":0.97599999999999998},"min":{"1min":0.78100000000000003,"5min":0.71399999999999997,"15min":0.49299999999999999},"max":{"1min":1.3160000000000001,"5min":1.7,"15min":2.0960000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0549999999999999,"15min":1.077},"min":{"1min":0.746,"5min":0.626,"15min":0.626},"max":{"1min":1.355,"5min":1.8939999999999999,"15min":2.7280000000000002},"last":0.94699999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.0269999999999999,"15min":1.071},"min":{"1min":0.85599999999999998,"5min":0.56599999999999995,"15min":0.53100000000000003},"max":{"1min":1.4219999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0469999999999999,"15min":1.081},"min":{"1min":0.76600000000000001,"5min":0.64700000000000002,"15min":0.63100000000000001},"max":{"1min":1.2969999999999999,"5min":1.9710000000000001,"15min":2.0489999999999999},"last":0.86399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.103,"15min":1.0960000000000001},"min":{"1min":0.873,"5min":0.72499999999999998,"15min":0.67400000000000004},"max":{"1min":1.4830000000000001,"5min":2.0070000000000001,"15min":2.5579999999999998},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.077,"15min":1.111},"min":{"1min":0.97999999999999998,"5min":0.55200000000000005,"15min":0.51300000000000001},"max":{"1min":1.49,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.93200000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574959,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40772,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331068,"statfs":{"total":96636764160,"available":96595013632,"internally_reserved":0,"allocated":1495040,"data_stored":973543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.57999999999999996,"15min":0.59899999999999998},"min":{"1min":0.47499999999999998,"5min":0.192,"15min":0.192},"max":{"1min":0.95499999999999996,"5min":1.23,"15min":1.23},"last":0.745},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.65500000000000003,"15min":0.68799999999999994},"min":{"1min":0.56699999999999995,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.056,"5min":1.1220000000000001,"15min":1.1759999999999999},"last":0.58199999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.65500000000000003,"15min":0.69499999999999995},"min":{"1min":0.47299999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.02,"5min":1.494,"15min":1.494},"last":0.872},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.69899999999999995,"15min":0.71599999999999997},"min":{"1min":0.5,"5min":0.223,"15min":0.223},"max":{"1min":0.96499999999999997,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.91500000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.66600000000000004,"15min":0.64300000000000002},"min":{"1min":0.54700000000000004,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.0409999999999999,"5min":1.137,"15min":1.137},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.79300000000000004,"15min":0.81999999999999995},"min":{"1min":0.69799999999999995,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.246,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.1120000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.94199999999999995,"15min":0.95999999999999996},"min":{"1min":0.69899999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.1970000000000001,"5min":1.764,"15min":1.764},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.89100000000000001,"15min":0.90600000000000003},"min":{"1min":0.72699999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.4810000000000001},"last":0.71299999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.95999999999999996,"15min":0.96899999999999997},"min":{"1min":0.81399999999999995,"5min":0.63700000000000001,"15min":0.59299999999999997},"max":{"1min":1.3540000000000001,"5min":1.365,"15min":1.3939999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.056,"5min":1.0109999999999999,"15min":1.0449999999999999},"min":{"1min":0.84599999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3100000000000001,"5min":1.637,"15min":1.637},"last":1.0669999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.048,"15min":1.083},"min":{"1min":0.76200000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.357,"5min":1.718,"15min":1.718},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0629999999999999,"15min":1.1060000000000001},"min":{"1min":0.84499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.341,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.1579999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0569999999999999,"15min":1.105},"min":{"1min":0.74399999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.403,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.081,"5min":1.026,"15min":1.04},"min":{"1min":0.80300000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.413,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.97099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:35:49.948 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:35:50.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.072+0000 7fdb10d14700 1 Processor -- start 2024-09-13T18:35:50.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.072+0000 7fdb10d14700 1 -- start start 2024-09-13T18:35:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.072+0000 7fdb10d14700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb0c151900 0x7fdb0c0b2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.072+0000 7fdb10d14700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0c15b340 con 0x7fdb0c0b26a0 2024-09-13T18:35:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.072+0000 7fdb10d14700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0c15b620 con 0x7fdb0c0b4e30 2024-09-13T18:35:50.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.072+0000 7fdb10d14700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c15b900 con 0x7fdb0c151900 2024-09-13T18:35:50.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.072+0000 7fdb0affd700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fdb0c0b26a0 0x7fdb0c0b4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43872/0 (socket says 172.21.15.44:43872) 2024-09-13T18:35:50.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.072+0000 7fdb0affd700 1 -- 172.21.15.44:0/1033504987 learned_addr learned my addr 172.21.15.44:0/1033504987 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:50.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.072+0000 7fdb0b7fe700 1 --2- 172.21.15.44:0/1033504987 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb0c151900 0x7fdb0c0b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.072+0000 7fdb0a7fc700 1 -- 172.21.15.44:0/1033504987 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2390150064 0 0) 0x7fdb0c15b340 con 0x7fdb0c0b26a0 2024-09-13T18:35:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.072+0000 7fdb0a7fc700 1 -- 172.21.15.44:0/1033504987 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaf40035d0 con 0x7fdb0c0b26a0 2024-09-13T18:35:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.072+0000 7fdb0a7fc700 1 -- 172.21.15.44:0/1033504987 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254684466 0 0) 0x7fdb0c15b620 con 0x7fdb0c0b4e30 2024-09-13T18:35:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.072+0000 7fdb0a7fc700 1 -- 172.21.15.44:0/1033504987 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb0c15b340 con 0x7fdb0c0b4e30 2024-09-13T18:35:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.072+0000 7fdb0b7fe700 1 -- 172.21.15.44:0/1033504987 >> v1:172.21.15.99:6789/0 conn(0x7fdb0c0b4e30 legacy=0x7fdb0c071a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.072+0000 7fdb0a7fc700 1 -- 172.21.15.44:0/1033504987 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2750289590 0 0) 0x7fdaf40035d0 con 0x7fdb0c0b26a0 2024-09-13T18:35:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.072+0000 7fdb0b7fe700 1 -- 172.21.15.44:0/1033504987 >> v1:172.21.15.44:6789/0 conn(0x7fdb0c0b26a0 legacy=0x7fdb0c0b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.072+0000 7fdb0b7fe700 1 -- 172.21.15.44:0/1033504987 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c15bbe0 con 0x7fdb0c151900 2024-09-13T18:35:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.072+0000 7fdb0b7fe700 1 --2- 172.21.15.44:0/1033504987 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb0c151900 0x7fdb0c0b2160 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009dc0 tx=0x7fdb0400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c0141a17cf35e08 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.072+0000 7fdb0a7fc700 1 -- 172.21.15.44:0/1033504987 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0400e070 con 0x7fdb0c151900 2024-09-13T18:35:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.072+0000 7fdb0a7fc700 1 -- 172.21.15.44:0/1033504987 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb04003a40 con 0x7fdb0c151900 2024-09-13T18:35:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.072+0000 7fdb0a7fc700 1 -- 172.21.15.44:0/1033504987 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb00001670 con 0x7fdb0c151900 2024-09-13T18:35:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.076+0000 7fdb10d14700 1 -- 172.21.15.44:0/1033504987 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb0c151900 msgr2=0x7fdb0c0b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.076+0000 7fdb10d14700 1 --2- 172.21.15.44:0/1033504987 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb0c151900 0x7fdb0c0b2160 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009dc0 tx=0x7fdb0400b330 comp rx=0 tx=0).stop 2024-09-13T18:35:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.076+0000 7fdb10d14700 1 -- 172.21.15.44:0/1033504987 shutdown_connections 2024-09-13T18:35:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.076+0000 7fdb10d14700 1 --2- 172.21.15.44:0/1033504987 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb0c151900 0x7fdb0c0b2160 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.076+0000 7fdb10d14700 1 -- 172.21.15.44:0/1033504987 >> 172.21.15.44:0/1033504987 conn(0x7fdb0c0cbb60 msgr2=0x7fdb0c0cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.076+0000 7fdb10d14700 1 -- 172.21.15.44:0/1033504987 shutdown_connections 2024-09-13T18:35:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.076+0000 7fdb10d14700 1 -- 172.21.15.44:0/1033504987 wait complete. 2024-09-13T18:35:50.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.076+0000 7fdb10d14700 1 Processor -- start 2024-09-13T18:35:50.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.076+0000 7fdb10d14700 1 -- start start 2024-09-13T18:35:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.076+0000 7fdb10d14700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb0c0b26a0 0x7fdb0c14ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.076+0000 7fdb10d14700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb0c0b4e30 0x7fdb0c14e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.076+0000 7fdb10d14700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb0c151900 0x7fdb0c0c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.076+0000 7fdb10d14700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c14f050 con 0x7fdb0c0b26a0 2024-09-13T18:35:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.076+0000 7fdb10d14700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c0c6380 con 0x7fdb0c0b4e30 2024-09-13T18:35:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.076+0000 7fdb10d14700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c0c6660 con 0x7fdb0c151900 2024-09-13T18:35:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.076+0000 7fdb0b7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb0c0b26a0 0x7fdb0c14ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.076+0000 7fdb0b7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb0c0b26a0 0x7fdb0c14ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37770/0 (socket says 172.21.15.44:37770) 2024-09-13T18:35:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.076+0000 7fdb0b7fe700 1 -- 172.21.15.44:0/2391940557 learned_addr learned my addr 172.21.15.44:0/2391940557 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.080+0000 7fdb0bfff700 1 --2- 172.21.15.44:0/2391940557 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb0c151900 0x7fdb0c0c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.080+0000 7fdb0affd700 1 --2- 172.21.15.44:0/2391940557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb0c0b4e30 0x7fdb0c14e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.080+0000 7fdb0b7fe700 1 -- 172.21.15.44:0/2391940557 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb0c151900 msgr2=0x7fdb0c0c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.080+0000 7fdb0b7fe700 1 --2- 172.21.15.44:0/2391940557 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb0c151900 0x7fdb0c0c4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.080+0000 7fdb0b7fe700 1 -- 172.21.15.44:0/2391940557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb0c0b4e30 msgr2=0x7fdb0c14e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.080+0000 7fdb0b7fe700 1 --2- 172.21.15.44:0/2391940557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb0c0b4e30 0x7fdb0c14e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.080+0000 7fdb0b7fe700 1 -- 172.21.15.44:0/2391940557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb04009a70 con 0x7fdb0c0b26a0 2024-09-13T18:35:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.080+0000 7fdb0bfff700 1 --2- 172.21.15.44:0/2391940557 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb0c151900 0x7fdb0c0c4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.080+0000 7fdb0b7fe700 1 --2- 172.21.15.44:0/2391940557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb0c0b26a0 0x7fdb0c14ca10 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fdb04000f80 tx=0x7fdb04004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.080+0000 7fdaf3fff700 1 -- 172.21.15.44:0/2391940557 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb040044b0 con 0x7fdb0c0b26a0 2024-09-13T18:35:50.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.080+0000 7fdaf3fff700 1 -- 172.21.15.44:0/2391940557 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb04004630 con 0x7fdb0c0b26a0 2024-09-13T18:35:50.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.080+0000 7fdb10d14700 1 -- 172.21.15.44:0/2391940557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0c0c6940 con 0x7fdb0c0b26a0 2024-09-13T18:35:50.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.080+0000 7fdaf3fff700 1 -- 172.21.15.44:0/2391940557 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0401c460 con 0x7fdb0c0b26a0 2024-09-13T18:35:50.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.080+0000 7fdb10d14700 1 -- 172.21.15.44:0/2391940557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0c14ec80 con 0x7fdb0c0b26a0 2024-09-13T18:35:50.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.080+0000 7fdb10d14700 1 -- 172.21.15.44:0/2391940557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0c14ee10 con 0x7fdb0c0b26a0 2024-09-13T18:35:50.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.080+0000 7fdaf3fff700 1 -- 172.21.15.44:0/2391940557 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdb0401c5c0 con 0x7fdb0c0b26a0 2024-09-13T18:35:50.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.084+0000 7fdaf3fff700 1 --2- 172.21.15.44:0/2391940557 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdaf8066730 0x7fdaf8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.084+0000 7fdaf3fff700 1 -- 172.21.15.44:0/2391940557 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb04085820 con 0x7fdb0c0b26a0 2024-09-13T18:35:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.084+0000 7fdb0affd700 1 --2- 172.21.15.44:0/2391940557 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdaf8066730 0x7fdaf8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.084+0000 7fdb0affd700 1 --2- 172.21.15.44:0/2391940557 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdaf8066730 0x7fdaf8068bf0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0b3d50 tx=0x7fdb000014d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.092+0000 7fdaf3fff700 1 -- 172.21.15.44:0/2391940557 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdb0c14ee10 con 0x7fdb0c0b26a0 2024-09-13T18:35:50.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.264+0000 7fdb10d14700 1 -- 172.21.15.44:0/2391940557 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb0c0cccb0 con 0x7fdaf8066730 2024-09-13T18:35:50.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.280+0000 7fdaf3fff700 1 -- 172.21.15.44:0/2391940557 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+272963 (secure 0 0 0) 0x7fdb00001c30 con 0x7fdaf8066730 2024-09-13T18:35:50.289 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:50.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.284+0000 7fdb10d14700 1 -- 172.21.15.44:0/2391940557 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdaf8066730 msgr2=0x7fdaf8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.284+0000 7fdb10d14700 1 --2- 172.21.15.44:0/2391940557 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdaf8066730 0x7fdaf8068bf0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0b3d50 tx=0x7fdb000014d0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.284+0000 7fdb10d14700 1 -- 172.21.15.44:0/2391940557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb0c0b26a0 msgr2=0x7fdb0c14ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.284+0000 7fdb10d14700 1 --2- 172.21.15.44:0/2391940557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb0c0b26a0 0x7fdb0c14ca10 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fdb04000f80 tx=0x7fdb04004af0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.284+0000 7fdb10d14700 1 -- 172.21.15.44:0/2391940557 shutdown_connections 2024-09-13T18:35:50.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.284+0000 7fdb10d14700 1 --2- 172.21.15.44:0/2391940557 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdaf8066730 0x7fdaf8068bf0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.284+0000 7fdb10d14700 1 --2- 172.21.15.44:0/2391940557 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb0c151900 0x7fdb0c0c4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.284+0000 7fdb10d14700 1 --2- 172.21.15.44:0/2391940557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb0c0b4e30 0x7fdb0c14e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.284+0000 7fdb10d14700 1 --2- 172.21.15.44:0/2391940557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb0c0b26a0 0x7fdb0c14ca10 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.284+0000 7fdb10d14700 1 -- 172.21.15.44:0/2391940557 >> 172.21.15.44:0/2391940557 conn(0x7fdb0c0cbb60 msgr2=0x7fdb0c1505b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.284+0000 7fdb10d14700 1 -- 172.21.15.44:0/2391940557 shutdown_connections 2024-09-13T18:35:50.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.284+0000 7fdb10d14700 1 -- 172.21.15.44:0/2391940557 wait complete. 2024-09-13T18:35:50.294 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:35:50.306 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":341,"stamp":"2024-09-13T18:35:48.506545+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":287472,"kb_used_data":8200,"kb_used_omap":12,"kb_used_meta":279155,"kb_avail":754687248,"statfs":{"total":773094113280,"available":772799741952,"internally_reserved":0,"allocated":8396800,"data_stored":4246136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":285855288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.059163"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:45.444730+0000","last_change":"2024-09-13T18:35:45.444730+0000","last_active":"2024-09-13T18:35:45.444730+0000","last_peered":"2024-09-13T18:35:45.444730+0000","last_clean":"2024-09-13T18:35:45.444730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:45.444730+0000","last_undegraded":"2024-09-13T18:35:45.444730+0000","last_fullsized":"2024-09-13T18:35:45.444730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:44.441179+0000","last_change":"2024-09-13T18:35:44.441179+0000","last_active":"2024-09-13T18:35:44.441179+0000","last_peered":"2024-09-13T18:35:44.441179+0000","last_clean":"2024-09-13T18:35:44.441179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:44.441179+0000","last_undegraded":"2024-09-13T18:35:44.441179+0000","last_fullsized":"2024-09-13T18:35:44.441179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":211,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.954373+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:35:41.954373+0000","last_peered":"2024-09-13T18:35:41.954373+0000","last_clean":"2024-09-13T18:35:41.954373+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:35:41.954373+0000","last_undegraded":"2024-09-13T18:35:41.954373+0000","last_fullsized":"2024-09-13T18:35:41.954373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574958,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1495040,"data_stored":973543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.38700000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.024,"5min":1.099,"15min":1.163},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75,"15min":0.79000000000000004},"min":{"1min":0.56299999999999994,"5min":0.436,"15min":0.436},"max":{"1min":1.0900000000000001,"5min":1.288,"15min":1.288},"last":0.64400000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.82299999999999995,"15min":0.874},"min":{"1min":0.59199999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.155,"5min":1.288,"15min":1.7689999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.878,"15min":0.93500000000000005},"min":{"1min":0.65200000000000002,"5min":0.54100000000000004,"15min":0.52600000000000002},"max":{"1min":1.1240000000000001,"5min":1.3009999999999999,"15min":1.6140000000000001},"last":1.0129999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.81599999999999995,"15min":0.84599999999999997},"min":{"1min":0.61899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.101,"5min":1.2270000000000001,"15min":1.3340000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.82799999999999996,"15min":0.88600000000000001},"min":{"1min":0.49299999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2390000000000001,"5min":1.524,"15min":1.6659999999999999},"last":0.94699999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.88100000000000001,"15min":0.89000000000000001},"min":{"1min":0.61399999999999999,"5min":0.54300000000000004,"15min":0.52600000000000002},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.88,"15min":0.88100000000000001},"min":{"1min":0.64500000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0940000000000001,"5min":1.486,"15min":1.486},"last":1.097}]},{"osd":4,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.86099999999999999,"15min":0.88200000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.038,"5min":1.4590000000000001,"15min":1.7290000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.0129999999999999,"15min":1.0369999999999999},"min":{"1min":0.70299999999999996,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1639999999999999,"5min":1.49,"15min":1.7050000000000001},"last":1.075}]},{"osd":5,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.95699999999999996,"15min":0.95599999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.196,"5min":1.4159999999999999,"15min":1.4259999999999999},"last":1.147},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.048,"15min":1.0509999999999999},"min":{"1min":0.73299999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2170000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.1200000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.0429999999999999,"15min":1.083},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.58099999999999996},"max":{"1min":1.212,"5min":1.4730000000000001,"15min":2.077},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0940000000000001,"15min":1.0760000000000001},"min":{"1min":0.81999999999999995,"5min":0.74399999999999999,"15min":0.69099999999999995},"max":{"1min":1.258,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.98399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31996,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":901120,"data_stored":383175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78800000000000003,"15min":0.82099999999999995},"min":{"1min":0.47899999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.1799999999999999,"5min":1.22,"15min":1.2270000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.77500000000000002,"15min":0.81699999999999995},"min":{"1min":0.56599999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0880000000000001,"5min":1.2470000000000001,"15min":1.361},"last":0.748}]},{"osd":1,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.76900000000000002,"15min":0.81000000000000005},"min":{"1min":0.55900000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0389999999999999,"5min":1.266,"15min":1.266},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.877,"5min":0.81999999999999995,"15min":0.82499999999999996},"min":{"1min":0.52700000000000002,"5min":0.48299999999999998,"15min":0.48099999999999998},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.86699999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.79500000000000004,"15min":0.80900000000000005},"min":{"1min":0.55900000000000005,"5min":0.47399999999999998,"15min":0.46899999999999997},"max":{"1min":1.1319999999999999,"5min":1.141,"15min":1.254},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.84199999999999997,"15min":0.85899999999999999},"min":{"1min":0.60099999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.101,"5min":1.248,"15min":1.248},"last":0.96999999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.89900000000000002,"15min":0.876},"min":{"1min":0.60099999999999998,"5min":0.57599999999999996,"15min":0.52300000000000002},"max":{"1min":1.1870000000000001,"5min":1.238,"15min":1.238},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.89200000000000002,"15min":0.93600000000000005},"min":{"1min":0.68899999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1839999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.84799999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.85399999999999998,"15min":0.88300000000000001},"min":{"1min":0.68300000000000005,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1679999999999999,"5min":1.236,"15min":1.248},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.95899999999999996,"15min":0.98999999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2709999999999999,"5min":1.407,"15min":1.407},"last":0.63100000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.022,"15min":1.038},"min":{"1min":0.81699999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.226,"5min":1.355,"15min":1.355},"last":1.069},{"interface":"front","average":{"1min":0.997,"5min":0.96599999999999997,"15min":0.97999999999999998},"min":{"1min":0.67800000000000005,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2130000000000001,"5min":1.353,"15min":1.4990000000000001},"last":0.91900000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.98799999999999999,"15min":1},"min":{"1min":0.65900000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2470000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0980000000000001,"15min":1.1080000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76000000000000001},"max":{"1min":1.3120000000000001,"5min":1.367,"15min":1.3740000000000001},"last":1.008}]}]},{"osd":5,"up_from":13,"seq":55834574958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31996,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":901120,"data_stored":383175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77000000000000002,"15min":0.82399999999999995},"min":{"1min":0.52200000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.147,"5min":1.3280000000000001,"15min":1.3640000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.78500000000000003,"15min":0.84999999999999998},"min":{"1min":0.60299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0980000000000001,"5min":1.2190000000000001,"15min":1.482},"last":1.1559999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.78500000000000003,"15min":0.79800000000000004},"min":{"1min":0.626,"5min":0.42499999999999999,"15min":0.40999999999999998},"max":{"1min":1.224,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.84699999999999998,"15min":0.91700000000000004},"min":{"1min":0.63300000000000001,"5min":0.50900000000000001,"15min":0.45200000000000001},"max":{"1min":1.1890000000000001,"5min":1.218,"15min":1.4850000000000001},"last":0.81599999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92000000000000004,"15min":0.94799999999999995},"min":{"1min":0.65100000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1830000000000001,"5min":1.2430000000000001,"15min":1.4179999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.92300000000000004,"15min":0.98899999999999999},"min":{"1min":0.71199999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.252,"5min":1.3029999999999999,"15min":1.4690000000000001},"last":0.86299999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.88100000000000001,"15min":0.93100000000000005},"min":{"1min":0.70499999999999996,"5min":0.55800000000000005,"15min":0.51700000000000002},"max":{"1min":1.153,"5min":1.2010000000000001,"15min":1.4510000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.88,"15min":0.93100000000000005},"min":{"1min":0.70799999999999996,"5min":0.61199999999999999,"15min":0.55300000000000005},"max":{"1min":1.1279999999999999,"5min":1.335,"15min":1.4990000000000001},"last":0.92700000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.92800000000000005,"15min":0.96099999999999997},"min":{"1min":0.60999999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.077,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.099},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.95899999999999996,"15min":1.0169999999999999},"min":{"1min":0.61799999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.143,"5min":1.3759999999999999,"15min":1.542},"last":1.028}]},{"osd":6,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.97099999999999997,"15min":1.0169999999999999},"min":{"1min":0.72399999999999998,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3129999999999999,"5min":1.4259999999999999,"15min":1.698},"last":1.079},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.107,"15min":1.1499999999999999},"min":{"1min":0.94999999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.286,"5min":1.52,"15min":1.581},"last":0.998}]},{"osd":7,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0620000000000001,"15min":1.155},"min":{"1min":0.83399999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.272,"5min":1.552,"15min":1.847},"last":1.256},{"interface":"front","average":{"1min":1.038,"5min":1.0600000000000001,"15min":1.125},"min":{"1min":0.81899999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.216,"5min":1.4259999999999999,"15min":1.8100000000000001},"last":1.198}]}]},{"osd":4,"up_from":13,"seq":55834574958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45948,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325892,"statfs":{"total":96636764160,"available":96589713408,"internally_reserved":0,"allocated":901120,"data_stored":383175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.80900000000000005,"15min":0.88},"min":{"1min":0.54900000000000004,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.119,"5min":1.1930000000000001,"15min":1.3720000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.874,"15min":0.94599999999999995},"min":{"1min":0.69399999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1479999999999999,"5min":1.3280000000000001,"15min":1.5229999999999999},"last":1.163}]},{"osd":1,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.76300000000000001,"15min":0.79500000000000004},"min":{"1min":0.68400000000000005,"5min":0.441,"15min":0.435},"max":{"1min":1.012,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.81999999999999995,"15min":0.84599999999999997},"min":{"1min":0.60499999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.91700000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78300000000000003,"15min":0.83899999999999997},"min":{"1min":0.55300000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0780000000000001,"5min":1.171,"15min":1.171},"last":0.879},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.86199999999999999,"15min":0.85399999999999998},"min":{"1min":0.66700000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1719999999999999,"5min":1.331,"15min":1.331},"last":1.03}]},{"osd":3,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.89200000000000002,"15min":0.95699999999999996},"min":{"1min":0.68899999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.163,"5min":1.268,"15min":1.639},"last":1.2769999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.91200000000000003,"15min":0.97099999999999997},"min":{"1min":0.65000000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.119,"5min":1.2629999999999999,"15min":1.8300000000000001},"last":0.83399999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.91500000000000004,"15min":0.96399999999999997},"min":{"1min":0.65900000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.381,"5min":1.518,"15min":2.3889999999999998},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0389999999999999,"15min":1.095},"min":{"1min":0.70599999999999996,"5min":0.626,"15min":0.626},"max":{"1min":1.2969999999999999,"5min":1.375,"15min":2.0049999999999999},"last":1.605}]},{"osd":6,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.95499999999999996,"15min":0.91200000000000003},"min":{"1min":0.64300000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2829999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.083},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.075,"15min":1.0960000000000001},"min":{"1min":0.94599999999999995,"5min":0.70099999999999996,"15min":0.63500000000000001},"max":{"1min":1.423,"5min":1.4259999999999999,"15min":1.794},"last":1.3400000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.046,"15min":1.069},"min":{"1min":0.89800000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.228,"5min":1.643,"15min":1.669},"last":1.659},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.048,"15min":1.03},"min":{"1min":0.70099999999999996,"5min":0.69499999999999995,"15min":0.61799999999999999},"max":{"1min":1.357,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.2410000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31996,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":901120,"data_stored":383175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61499999999999999,"15min":0.66500000000000004},"min":{"1min":0.505,"5min":0.22,"15min":0.22},"max":{"1min":0.88300000000000001,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.59899999999999998,"15min":0.65900000000000003},"min":{"1min":0.52700000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.1970000000000001},"last":0.66800000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.64800000000000002,"15min":0.69499999999999995},"min":{"1min":0.504,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0920000000000001,"5min":1.379,"15min":1.379},"last":0.627},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.71399999999999997,"15min":0.79400000000000004},"min":{"1min":0.54800000000000004,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.042,"5min":1.397,"15min":2.0030000000000001},"last":1.1419999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.72299999999999998,"15min":0.76900000000000002},"min":{"1min":0.60799999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1970000000000001,"5min":1.3300000000000001,"15min":1.333},"last":0.872},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.78800000000000003,"15min":0.86699999999999999},"min":{"1min":0.66400000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.2430000000000001,"5min":1.423,"15min":1.423},"last":1.2070000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.871,"15min":0.93700000000000006},"min":{"1min":0.77400000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.04,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":1.1779999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.93500000000000005,"15min":1.016},"min":{"1min":0.74199999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.393,"5min":1.587,"15min":1.587},"last":1.3440000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.004,"15min":1.1299999999999999},"min":{"1min":0.80600000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5620000000000001,"5min":1.6200000000000001,"15min":2.2320000000000002},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.96999999999999997,"15min":1.079},"min":{"1min":0.81299999999999994,"5min":0.53900000000000003,"15min":0.53600000000000003},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.718},"last":1.252}]},{"osd":6,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.0229999999999999,"15min":1.1060000000000001},"min":{"1min":0.84299999999999997,"5min":0.496,"15min":0.496},"max":{"1min":1.3999999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.0489999999999999,"15min":1.179},"min":{"1min":0.96199999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4790000000000001,"5min":1.51,"15min":2.1819999999999999},"last":1.321}]},{"osd":7,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.01,"15min":1.083},"min":{"1min":0.871,"5min":0.624,"15min":0.624},"max":{"1min":1.2050000000000001,"5min":1.3759999999999999,"15min":1.4670000000000001},"last":0.998},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.0649999999999999,"15min":1.153},"min":{"1min":0.97599999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.444,"5min":1.548,"15min":1.5920000000000001},"last":1.22}]}]},{"osd":2,"up_from":13,"seq":55834574959,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40188,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331652,"statfs":{"total":96636764160,"available":96595611648,"internally_reserved":0,"allocated":901120,"data_stored":383175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.628,"15min":0.66000000000000003},"min":{"1min":0.498,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":1.056,"5min":1.1020000000000001,"15min":1.1919999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.69899999999999995,"15min":0.77100000000000002},"min":{"1min":0.56899999999999995,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.014,"5min":1.036,"15min":1.4370000000000001},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.64900000000000002,"15min":0.69599999999999995},"min":{"1min":0.52200000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2629999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.67200000000000004,"15min":0.72299999999999998},"min":{"1min":0.58799999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.65500000000000003,"15min":0.67000000000000004},"min":{"1min":0.56200000000000006,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.89300000000000002,"5min":1.0489999999999999,"15min":1.1619999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.83099999999999996,"15min":0.85499999999999998},"min":{"1min":0.57999999999999996,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.248,"5min":1.3460000000000001,"15min":1.548},"last":0.85499999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.95399999999999996,"15min":0.97399999999999998},"min":{"1min":0.83599999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.272,"5min":1.653,"15min":1.653},"last":1.111},{"interface":"front","average":{"1min":0.998,"5min":0.95499999999999996,"15min":1.028},"min":{"1min":0.78600000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.347,"5min":1.51,"15min":2.3849999999999998},"last":0.996}]},{"osd":5,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.92200000000000004,"15min":0.92300000000000004},"min":{"1min":0.67300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2390000000000001,"5min":1.4730000000000001,"15min":1.498},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0189999999999999,"15min":1.05},"min":{"1min":0.76700000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.3260000000000001,"5min":1.7549999999999999,"15min":1.869},"last":1.254}]},{"osd":6,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.0169999999999999,"15min":1.0860000000000001},"min":{"1min":0.81200000000000006,"5min":0.502,"15min":0.502},"max":{"1min":1.454,"5min":1.6120000000000001,"15min":2.762},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.997,"15min":1.0349999999999999},"min":{"1min":0.81899999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2270000000000001,"5min":1.5509999999999999,"15min":1.988},"last":1.022}]},{"osd":7,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0700000000000001,"15min":1.1419999999999999},"min":{"1min":0.92500000000000004,"5min":0.61099999999999999,"15min":0.59799999999999998},"max":{"1min":1.4099999999999999,"5min":1.8240000000000001,"15min":2.6800000000000002},"last":1.171},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0680000000000001,"15min":1.0720000000000001},"min":{"1min":0.871,"5min":0.64100000000000001,"15min":0.52800000000000002},"max":{"1min":1.2829999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.149}]}]},{"osd":1,"up_from":13,"seq":55834574959,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31996,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":901120,"data_stored":383175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.63600000000000001,"15min":0.63300000000000001},"min":{"1min":0.46899999999999997,"5min":0.34300000000000003,"15min":0.33200000000000002},"max":{"1min":1.01,"5min":1.087,"15min":1.107},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.68400000000000005,"15min":0.72999999999999998},"min":{"1min":0.51600000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.048,"5min":1.341,"15min":1.3560000000000001},"last":0.745}]},{"osd":2,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.61099999999999999,"15min":0.63},"min":{"1min":0.51500000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.88900000000000001,"5min":1.133,"15min":1.1879999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.73699999999999999,"15min":0.748},"min":{"1min":0.36399999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.139,"5min":1.617,"15min":1.617},"last":0.47599999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.57599999999999996,"5min":0.375,"15min":0.375},"max":{"1min":1.052,"5min":1.415,"15min":1.415},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.75700000000000001,"15min":0.78400000000000003},"min":{"1min":0.56599999999999995,"5min":0.35999999999999999,"15min":0.35699999999999998},"max":{"1min":1.111,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.51000000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.94699999999999995,"15min":0.95699999999999996},"min":{"1min":0.81200000000000006,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2769999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.96199999999999997,"15min":0.97299999999999998},"min":{"1min":0.73799999999999999,"5min":0.57599999999999996,"15min":0.54100000000000004},"max":{"1min":1.1830000000000001,"5min":1.52,"15min":1.994},"last":0.96899999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.97299999999999998,"15min":0.97599999999999998},"min":{"1min":0.78100000000000003,"5min":0.71399999999999997,"15min":0.49299999999999999},"max":{"1min":1.3160000000000001,"5min":1.7,"15min":2.0960000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0549999999999999,"15min":1.077},"min":{"1min":0.746,"5min":0.626,"15min":0.626},"max":{"1min":1.355,"5min":1.8939999999999999,"15min":2.7280000000000002},"last":0.94699999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.0269999999999999,"15min":1.071},"min":{"1min":0.85599999999999998,"5min":0.56599999999999995,"15min":0.53100000000000003},"max":{"1min":1.4219999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0469999999999999,"15min":1.081},"min":{"1min":0.76600000000000001,"5min":0.64700000000000002,"15min":0.63100000000000001},"max":{"1min":1.2969999999999999,"5min":1.9710000000000001,"15min":2.0489999999999999},"last":0.86399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.103,"15min":1.0960000000000001},"min":{"1min":0.873,"5min":0.72499999999999998,"15min":0.67400000000000004},"max":{"1min":1.4830000000000001,"5min":2.0070000000000001,"15min":2.5579999999999998},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.077,"15min":1.111},"min":{"1min":0.97999999999999998,"5min":0.55200000000000005,"15min":0.51300000000000001},"max":{"1min":1.49,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.93200000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574959,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40772,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331068,"statfs":{"total":96636764160,"available":96595013632,"internally_reserved":0,"allocated":1495040,"data_stored":973543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.57999999999999996,"15min":0.59899999999999998},"min":{"1min":0.47499999999999998,"5min":0.192,"15min":0.192},"max":{"1min":0.95499999999999996,"5min":1.23,"15min":1.23},"last":0.745},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.65500000000000003,"15min":0.68799999999999994},"min":{"1min":0.56699999999999995,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.056,"5min":1.1220000000000001,"15min":1.1759999999999999},"last":0.58199999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.65500000000000003,"15min":0.69499999999999995},"min":{"1min":0.47299999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.02,"5min":1.494,"15min":1.494},"last":0.872},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.69899999999999995,"15min":0.71599999999999997},"min":{"1min":0.5,"5min":0.223,"15min":0.223},"max":{"1min":0.96499999999999997,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.91500000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.66600000000000004,"15min":0.64300000000000002},"min":{"1min":0.54700000000000004,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.0409999999999999,"5min":1.137,"15min":1.137},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.79300000000000004,"15min":0.81999999999999995},"min":{"1min":0.69799999999999995,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.246,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.1120000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.94199999999999995,"15min":0.95999999999999996},"min":{"1min":0.69899999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.1970000000000001,"5min":1.764,"15min":1.764},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.89100000000000001,"15min":0.90600000000000003},"min":{"1min":0.72699999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.4810000000000001},"last":0.71299999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.95999999999999996,"15min":0.96899999999999997},"min":{"1min":0.81399999999999995,"5min":0.63700000000000001,"15min":0.59299999999999997},"max":{"1min":1.3540000000000001,"5min":1.365,"15min":1.3939999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.056,"5min":1.0109999999999999,"15min":1.0449999999999999},"min":{"1min":0.84599999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3100000000000001,"5min":1.637,"15min":1.637},"last":1.0669999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.048,"15min":1.083},"min":{"1min":0.76200000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.357,"5min":1.718,"15min":1.718},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0629999999999999,"15min":1.1060000000000001},"min":{"1min":0.84499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.341,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.1579999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0569999999999999,"15min":1.105},"min":{"1min":0.74399999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.403,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.081,"5min":1.026,"15min":1.04},"min":{"1min":0.80300000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.413,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.97099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:35:50.311 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:35:50.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.424+0000 7f29e72ad700 1 Processor -- start 2024-09-13T18:35:50.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.424+0000 7f29e72ad700 1 -- start start 2024-09-13T18:35:50.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.424+0000 7f29e72ad700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f29e00b3ae0 0x7f29e006cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.424+0000 7f29e72ad700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f29e006aa90 0x7f29e00ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.424+0000 7f29e72ad700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e006af40 con 0x7f29e0159720 2024-09-13T18:35:50.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.424+0000 7f29e72ad700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e006d690 con 0x7f29e00b3ae0 2024-09-13T18:35:50.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.424+0000 7f29e72ad700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00cbfe0 con 0x7f29e006aa90 2024-09-13T18:35:50.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.424+0000 7f29e5aaa700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f29e00b3ae0 0x7f29e006cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.424+0000 7f29e62ab700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f29e0159720 0x7f29e00b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43886/0 (socket says 172.21.15.44:43886) 2024-09-13T18:35:50.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.424+0000 7f29e62ab700 1 -- 172.21.15.44:0/2324502778 learned_addr learned my addr 172.21.15.44:0/2324502778 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:50.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.424+0000 7f29e6aac700 1 --2- 172.21.15.44:0/2324502778 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f29e006aa90 0x7f29e00ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.424+0000 7f29e5aaa700 1 -- 172.21.15.44:0/2324502778 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f29e006aa90 msgr2=0x7f29e00ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:50.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.424+0000 7f29e5aaa700 1 --2- 172.21.15.44:0/2324502778 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f29e006aa90 0x7f29e00ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.424+0000 7f29e5aaa700 1 -- 172.21.15.44:0/2324502778 >> v1:172.21.15.44:6789/0 conn(0x7f29e0159720 legacy=0x7f29e00b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.424+0000 7f29e5aaa700 1 -- 172.21.15.44:0/2324502778 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e00cc2c0 con 0x7f29e00b3ae0 2024-09-13T18:35:50.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.424+0000 7f29e5aaa700 1 --2- 172.21.15.44:0/2324502778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29e00b3ae0 0x7f29e006cf90 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009850 tx=0x7f29d0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e309b6c9195b6c1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.424+0000 7f29e52a9700 1 -- 172.21.15.44:0/2324502778 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0011830 con 0x7f29e00b3ae0 2024-09-13T18:35:50.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.428+0000 7f29e52a9700 1 -- 172.21.15.44:0/2324502778 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d0011990 con 0x7f29e00b3ae0 2024-09-13T18:35:50.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.428+0000 7f29e52a9700 1 -- 172.21.15.44:0/2324502778 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0011d20 con 0x7f29e00b3ae0 2024-09-13T18:35:50.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.428+0000 7f29e72ad700 1 -- 172.21.15.44:0/2324502778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29e00b3ae0 msgr2=0x7f29e006cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.428+0000 7f29e72ad700 1 --2- 172.21.15.44:0/2324502778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29e00b3ae0 0x7f29e006cf90 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009850 tx=0x7f29d0009b60 comp rx=0 tx=0).stop 2024-09-13T18:35:50.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.428+0000 7f29e72ad700 1 -- 172.21.15.44:0/2324502778 shutdown_connections 2024-09-13T18:35:50.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.428+0000 7f29e72ad700 1 --2- 172.21.15.44:0/2324502778 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f29e006aa90 0x7f29e00ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.428+0000 7f29e72ad700 1 --2- 172.21.15.44:0/2324502778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29e00b3ae0 0x7f29e006cf90 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.428+0000 7f29e72ad700 1 -- 172.21.15.44:0/2324502778 >> 172.21.15.44:0/2324502778 conn(0x7f29e00b0f00 msgr2=0x7f29e00b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.428+0000 7f29e72ad700 1 -- 172.21.15.44:0/2324502778 shutdown_connections 2024-09-13T18:35:50.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.428+0000 7f29e72ad700 1 -- 172.21.15.44:0/2324502778 wait complete. 2024-09-13T18:35:50.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.428+0000 7f29e72ad700 1 Processor -- start 2024-09-13T18:35:50.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.428+0000 7f29e72ad700 1 -- start start 2024-09-13T18:35:50.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.428+0000 7f29e72ad700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29e006aa90 0x7f29e014e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.428+0000 7f29e72ad700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f29e00b3ae0 0x7f29e0143c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.428+0000 7f29e72ad700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e0159720 0x7f29e0154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.428+0000 7f29e72ad700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e014f290 con 0x7f29e006aa90 2024-09-13T18:35:50.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.428+0000 7f29e72ad700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e0146b10 con 0x7f29e0159720 2024-09-13T18:35:50.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.428+0000 7f29e72ad700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e014f470 con 0x7f29e00b3ae0 2024-09-13T18:35:50.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.428+0000 7f29e62ab700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29e006aa90 0x7f29e014e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.428+0000 7f29e62ab700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29e006aa90 0x7f29e014e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37786/0 (socket says 172.21.15.44:37786) 2024-09-13T18:35:50.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.428+0000 7f29e62ab700 1 -- 172.21.15.44:0/2678178034 learned_addr learned my addr 172.21.15.44:0/2678178034 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:50.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.428+0000 7f29e6aac700 1 --2- 172.21.15.44:0/2678178034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e0159720 0x7f29e0154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.428+0000 7f29e5aaa700 1 --2- 172.21.15.44:0/2678178034 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f29e00b3ae0 0x7f29e0143c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.432+0000 7f29e62ab700 1 -- 172.21.15.44:0/2678178034 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f29e00b3ae0 msgr2=0x7f29e0143c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.432+0000 7f29e62ab700 1 --2- 172.21.15.44:0/2678178034 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f29e00b3ae0 0x7f29e0143c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.432+0000 7f29e62ab700 1 -- 172.21.15.44:0/2678178034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e0159720 msgr2=0x7f29e0154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.432+0000 7f29e62ab700 1 --2- 172.21.15.44:0/2678178034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e0159720 0x7f29e0154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.432+0000 7f29e62ab700 1 -- 172.21.15.44:0/2678178034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d00094b0 con 0x7f29e006aa90 2024-09-13T18:35:50.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.432+0000 7f29e5aaa700 1 --2- 172.21.15.44:0/2678178034 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f29e00b3ae0 0x7f29e0143c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:50.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.432+0000 7f29e62ab700 1 --2- 172.21.15.44:0/2678178034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29e006aa90 0x7f29e014e840 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f29dc00cbc0 tx=0x7f29dc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.432+0000 7f29d6ffd700 1 -- 172.21.15.44:0/2678178034 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc007480 con 0x7f29e006aa90 2024-09-13T18:35:50.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.432+0000 7f29d6ffd700 1 -- 172.21.15.44:0/2678178034 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29dc0075e0 con 0x7f29e006aa90 2024-09-13T18:35:50.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.432+0000 7f29e72ad700 1 -- 172.21.15.44:0/2678178034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e014f750 con 0x7f29e006aa90 2024-09-13T18:35:50.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.432+0000 7f29d6ffd700 1 -- 172.21.15.44:0/2678178034 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc007950 con 0x7f29e006aa90 2024-09-13T18:35:50.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.432+0000 7f29e72ad700 1 -- 172.21.15.44:0/2678178034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e014fd10 con 0x7f29e006aa90 2024-09-13T18:35:50.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.432+0000 7f29e72ad700 1 -- 172.21.15.44:0/2678178034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e00cdc70 con 0x7f29e006aa90 2024-09-13T18:35:50.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.432+0000 7f29d6ffd700 1 -- 172.21.15.44:0/2678178034 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f29dc01b3b0 con 0x7f29e006aa90 2024-09-13T18:35:50.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.436+0000 7f29d6ffd700 1 --2- 172.21.15.44:0/2678178034 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f29cc066730 0x7f29cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.436+0000 7f29d6ffd700 1 -- 172.21.15.44:0/2678178034 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29dc083a50 con 0x7f29e006aa90 2024-09-13T18:35:50.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.436+0000 7f29e5aaa700 1 --2- 172.21.15.44:0/2678178034 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f29cc066730 0x7f29cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.436+0000 7f29e5aaa700 1 --2- 172.21.15.44:0/2678178034 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f29cc066730 0x7f29cc068bf0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f29d0000c00 tx=0x7f29d0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.444+0000 7f29d6ffd700 1 -- 172.21.15.44:0/2678178034 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f29dc050de0 con 0x7f29e006aa90 2024-09-13T18:35:50.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.616+0000 7f29e72ad700 1 -- 172.21.15.44:0/2678178034 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f29e014ff00 con 0x7f29cc066730 2024-09-13T18:35:50.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.628+0000 7f29d6ffd700 1 -- 172.21.15.44:0/2678178034 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287813 (secure 0 0 0) 0x7f29e014ff00 con 0x7f29cc066730 2024-09-13T18:35:50.640 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:50.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.636+0000 7f29e72ad700 1 -- 172.21.15.44:0/2678178034 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f29cc066730 msgr2=0x7f29cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.636+0000 7f29e72ad700 1 --2- 172.21.15.44:0/2678178034 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f29cc066730 0x7f29cc068bf0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f29d0000c00 tx=0x7f29d0008030 comp rx=0 tx=0).stop 2024-09-13T18:35:50.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.636+0000 7f29e72ad700 1 -- 172.21.15.44:0/2678178034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29e006aa90 msgr2=0x7f29e014e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.636+0000 7f29e72ad700 1 --2- 172.21.15.44:0/2678178034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29e006aa90 0x7f29e014e840 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f29dc00cbc0 tx=0x7f29dc00cbf0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.636+0000 7f29e72ad700 1 -- 172.21.15.44:0/2678178034 shutdown_connections 2024-09-13T18:35:50.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.636+0000 7f29e72ad700 1 --2- 172.21.15.44:0/2678178034 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f29cc066730 0x7f29cc068bf0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.636+0000 7f29e72ad700 1 --2- 172.21.15.44:0/2678178034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e0159720 0x7f29e0154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.636+0000 7f29e72ad700 1 --2- 172.21.15.44:0/2678178034 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f29e00b3ae0 0x7f29e0143c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.636+0000 7f29e72ad700 1 --2- 172.21.15.44:0/2678178034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29e006aa90 0x7f29e014e840 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.636+0000 7f29e72ad700 1 -- 172.21.15.44:0/2678178034 >> 172.21.15.44:0/2678178034 conn(0x7f29e00b0f00 msgr2=0x7f29e00cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.636+0000 7f29e72ad700 1 -- 172.21.15.44:0/2678178034 shutdown_connections 2024-09-13T18:35:50.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.636+0000 7f29e72ad700 1 -- 172.21.15.44:0/2678178034 wait complete. 2024-09-13T18:35:50.644 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:35:50.656 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":342,"stamp":"2024-09-13T18:35:50.507127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":287976,"kb_used_data":8648,"kb_used_omap":12,"kb_used_meta":279155,"kb_avail":754686744,"statfs":{"total":773094113280,"available":772799225856,"internally_reserved":0,"allocated":8855552,"data_stored":4452196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":285855288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001939"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867944+0000","last_change":"2024-09-13T18:35:45.876759+0000","last_active":"2024-09-13T18:35:46.867944+0000","last_peered":"2024-09-13T18:35:46.867944+0000","last_clean":"2024-09-13T18:35:46.867944+0000","last_became_active":"2024-09-13T18:35:45.876258+0000","last_became_peered":"2024-09-13T18:35:45.876258+0000","last_unstale":"2024-09-13T18:35:46.867944+0000","last_undegraded":"2024-09-13T18:35:46.867944+0000","last_fullsized":"2024-09-13T18:35:46.867944+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:52.148220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867399+0000","last_change":"2024-09-13T18:35:45.862965+0000","last_active":"2024-09-13T18:35:46.867399+0000","last_peered":"2024-09-13T18:35:46.867399+0000","last_clean":"2024-09-13T18:35:46.867399+0000","last_became_active":"2024-09-13T18:35:45.862683+0000","last_became_peered":"2024-09-13T18:35:45.862683+0000","last_unstale":"2024-09-13T18:35:46.867399+0000","last_undegraded":"2024-09-13T18:35:46.867399+0000","last_fullsized":"2024-09-13T18:35:46.867399+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:15.023455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.753408+0000","last_change":"2024-09-13T18:35:45.879740+0000","last_active":"2024-09-13T18:35:47.753408+0000","last_peered":"2024-09-13T18:35:47.753408+0000","last_clean":"2024-09-13T18:35:47.753408+0000","last_became_active":"2024-09-13T18:35:45.876578+0000","last_became_peered":"2024-09-13T18:35:45.876578+0000","last_unstale":"2024-09-13T18:35:47.753408+0000","last_undegraded":"2024-09-13T18:35:47.753408+0000","last_fullsized":"2024-09-13T18:35:47.753408+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:52.159676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.862781+0000","last_change":"2024-09-13T18:35:45.877617+0000","last_active":"2024-09-13T18:35:46.862781+0000","last_peered":"2024-09-13T18:35:46.862781+0000","last_clean":"2024-09-13T18:35:46.862781+0000","last_became_active":"2024-09-13T18:35:45.877379+0000","last_became_peered":"2024-09-13T18:35:45.877379+0000","last_unstale":"2024-09-13T18:35:46.862781+0000","last_undegraded":"2024-09-13T18:35:46.862781+0000","last_fullsized":"2024-09-13T18:35:46.862781+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:50.667404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750670+0000","last_change":"2024-09-13T18:35:45.869430+0000","last_active":"2024-09-13T18:35:47.750670+0000","last_peered":"2024-09-13T18:35:47.750670+0000","last_clean":"2024-09-13T18:35:47.750670+0000","last_became_active":"2024-09-13T18:35:45.869165+0000","last_became_peered":"2024-09-13T18:35:45.869165+0000","last_unstale":"2024-09-13T18:35:47.750670+0000","last_undegraded":"2024-09-13T18:35:47.750670+0000","last_fullsized":"2024-09-13T18:35:47.750670+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:40.120251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867162+0000","last_change":"2024-09-13T18:35:45.865094+0000","last_active":"2024-09-13T18:35:46.867162+0000","last_peered":"2024-09-13T18:35:46.867162+0000","last_clean":"2024-09-13T18:35:46.867162+0000","last_became_active":"2024-09-13T18:35:45.864826+0000","last_became_peered":"2024-09-13T18:35:45.864826+0000","last_unstale":"2024-09-13T18:35:46.867162+0000","last_undegraded":"2024-09-13T18:35:46.867162+0000","last_fullsized":"2024-09-13T18:35:46.867162+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:01.309115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752309+0000","last_change":"2024-09-13T18:35:45.872362+0000","last_active":"2024-09-13T18:35:47.752309+0000","last_peered":"2024-09-13T18:35:47.752309+0000","last_clean":"2024-09-13T18:35:47.752309+0000","last_became_active":"2024-09-13T18:35:45.872103+0000","last_became_peered":"2024-09-13T18:35:45.872103+0000","last_unstale":"2024-09-13T18:35:47.752309+0000","last_undegraded":"2024-09-13T18:35:47.752309+0000","last_fullsized":"2024-09-13T18:35:47.752309+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:58.389866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867384+0000","last_change":"2024-09-13T18:35:45.870529+0000","last_active":"2024-09-13T18:35:46.867384+0000","last_peered":"2024-09-13T18:35:46.867384+0000","last_clean":"2024-09-13T18:35:46.867384+0000","last_became_active":"2024-09-13T18:35:45.870318+0000","last_became_peered":"2024-09-13T18:35:45.870318+0000","last_unstale":"2024-09-13T18:35:46.867384+0000","last_undegraded":"2024-09-13T18:35:46.867384+0000","last_fullsized":"2024-09-13T18:35:46.867384+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:44.606188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751173+0000","last_change":"2024-09-13T18:35:45.877476+0000","last_active":"2024-09-13T18:35:47.751173+0000","last_peered":"2024-09-13T18:35:47.751173+0000","last_clean":"2024-09-13T18:35:47.751173+0000","last_became_active":"2024-09-13T18:35:45.877180+0000","last_became_peered":"2024-09-13T18:35:45.877180+0000","last_unstale":"2024-09-13T18:35:47.751173+0000","last_undegraded":"2024-09-13T18:35:47.751173+0000","last_fullsized":"2024-09-13T18:35:47.751173+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:54.814862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751614+0000","last_change":"2024-09-13T18:35:45.874208+0000","last_active":"2024-09-13T18:35:47.751614+0000","last_peered":"2024-09-13T18:35:47.751614+0000","last_clean":"2024-09-13T18:35:47.751614+0000","last_became_active":"2024-09-13T18:35:45.873944+0000","last_became_peered":"2024-09-13T18:35:45.873944+0000","last_unstale":"2024-09-13T18:35:47.751614+0000","last_undegraded":"2024-09-13T18:35:47.751614+0000","last_fullsized":"2024-09-13T18:35:47.751614+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:01.309115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867785+0000","last_change":"2024-09-13T18:35:45.881425+0000","last_active":"2024-09-13T18:35:46.867785+0000","last_peered":"2024-09-13T18:35:46.867785+0000","last_clean":"2024-09-13T18:35:46.867785+0000","last_became_active":"2024-09-13T18:35:45.881174+0000","last_became_peered":"2024-09-13T18:35:45.881174+0000","last_unstale":"2024-09-13T18:35:46.867785+0000","last_undegraded":"2024-09-13T18:35:46.867785+0000","last_fullsized":"2024-09-13T18:35:46.867785+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:46.619282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.862927+0000","last_change":"2024-09-13T18:35:45.874046+0000","last_active":"2024-09-13T18:35:46.862927+0000","last_peered":"2024-09-13T18:35:46.862927+0000","last_clean":"2024-09-13T18:35:46.862927+0000","last_became_active":"2024-09-13T18:35:45.873686+0000","last_became_peered":"2024-09-13T18:35:45.873686+0000","last_unstale":"2024-09-13T18:35:46.862927+0000","last_undegraded":"2024-09-13T18:35:46.862927+0000","last_fullsized":"2024-09-13T18:35:46.862927+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:22.588146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750636+0000","last_change":"2024-09-13T18:35:45.864467+0000","last_active":"2024-09-13T18:35:47.750636+0000","last_peered":"2024-09-13T18:35:47.750636+0000","last_clean":"2024-09-13T18:35:47.750636+0000","last_became_active":"2024-09-13T18:35:45.864174+0000","last_became_peered":"2024-09-13T18:35:45.864174+0000","last_unstale":"2024-09-13T18:35:47.750636+0000","last_undegraded":"2024-09-13T18:35:47.750636+0000","last_fullsized":"2024-09-13T18:35:47.750636+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:07.323249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751491+0000","last_change":"2024-09-13T18:35:45.857007+0000","last_active":"2024-09-13T18:35:47.751491+0000","last_peered":"2024-09-13T18:35:47.751491+0000","last_clean":"2024-09-13T18:35:47.751491+0000","last_became_active":"2024-09-13T18:35:45.856701+0000","last_became_peered":"2024-09-13T18:35:45.856701+0000","last_unstale":"2024-09-13T18:35:47.751491+0000","last_undegraded":"2024-09-13T18:35:47.751491+0000","last_fullsized":"2024-09-13T18:35:47.751491+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:47.409939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750188+0000","last_change":"2024-09-13T18:35:45.868193+0000","last_active":"2024-09-13T18:35:47.750188+0000","last_peered":"2024-09-13T18:35:47.750188+0000","last_clean":"2024-09-13T18:35:47.750188+0000","last_became_active":"2024-09-13T18:35:45.867834+0000","last_became_peered":"2024-09-13T18:35:45.867834+0000","last_unstale":"2024-09-13T18:35:47.750188+0000","last_undegraded":"2024-09-13T18:35:47.750188+0000","last_fullsized":"2024-09-13T18:35:47.750188+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:58.389866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751038+0000","last_change":"2024-09-13T18:35:45.875555+0000","last_active":"2024-09-13T18:35:47.751038+0000","last_peered":"2024-09-13T18:35:47.751038+0000","last_clean":"2024-09-13T18:35:47.751038+0000","last_became_active":"2024-09-13T18:35:45.875248+0000","last_became_peered":"2024-09-13T18:35:45.875248+0000","last_unstale":"2024-09-13T18:35:47.751038+0000","last_undegraded":"2024-09-13T18:35:47.751038+0000","last_fullsized":"2024-09-13T18:35:47.751038+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:30.257132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751427+0000","last_change":"2024-09-13T18:35:45.877626+0000","last_active":"2024-09-13T18:35:47.751427+0000","last_peered":"2024-09-13T18:35:47.751427+0000","last_clean":"2024-09-13T18:35:47.751427+0000","last_became_active":"2024-09-13T18:35:45.877189+0000","last_became_peered":"2024-09-13T18:35:45.877189+0000","last_unstale":"2024-09-13T18:35:47.751427+0000","last_undegraded":"2024-09-13T18:35:47.751427+0000","last_fullsized":"2024-09-13T18:35:47.751427+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:19.096857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.863308+0000","last_change":"2024-09-13T18:35:45.869053+0000","last_active":"2024-09-13T18:35:46.863308+0000","last_peered":"2024-09-13T18:35:46.863308+0000","last_clean":"2024-09-13T18:35:46.863308+0000","last_became_active":"2024-09-13T18:35:45.868465+0000","last_became_peered":"2024-09-13T18:35:45.868465+0000","last_unstale":"2024-09-13T18:35:46.863308+0000","last_undegraded":"2024-09-13T18:35:46.863308+0000","last_fullsized":"2024-09-13T18:35:46.863308+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:01.353338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867063+0000","last_change":"2024-09-13T18:35:45.869650+0000","last_active":"2024-09-13T18:35:46.867063+0000","last_peered":"2024-09-13T18:35:46.867063+0000","last_clean":"2024-09-13T18:35:46.867063+0000","last_became_active":"2024-09-13T18:35:45.869324+0000","last_became_peered":"2024-09-13T18:35:45.869324+0000","last_unstale":"2024-09-13T18:35:46.867063+0000","last_undegraded":"2024-09-13T18:35:46.867063+0000","last_fullsized":"2024-09-13T18:35:46.867063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:59.343927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750666+0000","last_change":"2024-09-13T18:35:45.868766+0000","last_active":"2024-09-13T18:35:47.750666+0000","last_peered":"2024-09-13T18:35:47.750666+0000","last_clean":"2024-09-13T18:35:47.750666+0000","last_became_active":"2024-09-13T18:35:45.868529+0000","last_became_peered":"2024-09-13T18:35:45.868529+0000","last_unstale":"2024-09-13T18:35:47.750666+0000","last_undegraded":"2024-09-13T18:35:47.750666+0000","last_fullsized":"2024-09-13T18:35:47.750666+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:30.257132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751546+0000","last_change":"2024-09-13T18:35:45.864445+0000","last_active":"2024-09-13T18:35:47.751546+0000","last_peered":"2024-09-13T18:35:47.751546+0000","last_clean":"2024-09-13T18:35:47.751546+0000","last_became_active":"2024-09-13T18:35:45.864156+0000","last_became_peered":"2024-09-13T18:35:45.864156+0000","last_unstale":"2024-09-13T18:35:47.751546+0000","last_undegraded":"2024-09-13T18:35:47.751546+0000","last_fullsized":"2024-09-13T18:35:47.751546+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:44.606188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751482+0000","last_change":"2024-09-13T18:35:45.871414+0000","last_active":"2024-09-13T18:35:47.751482+0000","last_peered":"2024-09-13T18:35:47.751482+0000","last_clean":"2024-09-13T18:35:47.751482+0000","last_became_active":"2024-09-13T18:35:45.871152+0000","last_became_peered":"2024-09-13T18:35:45.871152+0000","last_unstale":"2024-09-13T18:35:47.751482+0000","last_undegraded":"2024-09-13T18:35:47.751482+0000","last_fullsized":"2024-09-13T18:35:47.751482+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:55.692347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867608+0000","last_change":"2024-09-13T18:35:45.873614+0000","last_active":"2024-09-13T18:35:46.867608+0000","last_peered":"2024-09-13T18:35:46.867608+0000","last_clean":"2024-09-13T18:35:46.867608+0000","last_became_active":"2024-09-13T18:35:45.872765+0000","last_became_peered":"2024-09-13T18:35:45.872765+0000","last_unstale":"2024-09-13T18:35:46.867608+0000","last_undegraded":"2024-09-13T18:35:46.867608+0000","last_fullsized":"2024-09-13T18:35:46.867608+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:03.036681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.866584+0000","last_change":"2024-09-13T18:35:45.876738+0000","last_active":"2024-09-13T18:35:46.866584+0000","last_peered":"2024-09-13T18:35:46.866584+0000","last_clean":"2024-09-13T18:35:46.866584+0000","last_became_active":"2024-09-13T18:35:45.876477+0000","last_became_peered":"2024-09-13T18:35:45.876477+0000","last_unstale":"2024-09-13T18:35:46.866584+0000","last_undegraded":"2024-09-13T18:35:46.866584+0000","last_fullsized":"2024-09-13T18:35:46.866584+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:41.431194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751968+0000","last_change":"2024-09-13T18:35:45.866671+0000","last_active":"2024-09-13T18:35:47.751968+0000","last_peered":"2024-09-13T18:35:47.751968+0000","last_clean":"2024-09-13T18:35:47.751968+0000","last_became_active":"2024-09-13T18:35:45.866407+0000","last_became_peered":"2024-09-13T18:35:45.866407+0000","last_unstale":"2024-09-13T18:35:47.751968+0000","last_undegraded":"2024-09-13T18:35:47.751968+0000","last_fullsized":"2024-09-13T18:35:47.751968+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:20.347955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752289+0000","last_change":"2024-09-13T18:35:45.858753+0000","last_active":"2024-09-13T18:35:47.752289+0000","last_peered":"2024-09-13T18:35:47.752289+0000","last_clean":"2024-09-13T18:35:47.752289+0000","last_became_active":"2024-09-13T18:35:45.858450+0000","last_became_peered":"2024-09-13T18:35:45.858450+0000","last_unstale":"2024-09-13T18:35:47.752289+0000","last_undegraded":"2024-09-13T18:35:47.752289+0000","last_fullsized":"2024-09-13T18:35:47.752289+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:43.230611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.753423+0000","last_change":"2024-09-13T18:35:45.875391+0000","last_active":"2024-09-13T18:35:47.753423+0000","last_peered":"2024-09-13T18:35:47.753423+0000","last_clean":"2024-09-13T18:35:47.753423+0000","last_became_active":"2024-09-13T18:35:45.875132+0000","last_became_peered":"2024-09-13T18:35:45.875132+0000","last_unstale":"2024-09-13T18:35:47.753423+0000","last_undegraded":"2024-09-13T18:35:47.753423+0000","last_fullsized":"2024-09-13T18:35:47.753423+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:36.122059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752893+0000","last_change":"2024-09-13T18:35:45.874261+0000","last_active":"2024-09-13T18:35:47.752893+0000","last_peered":"2024-09-13T18:35:47.752893+0000","last_clean":"2024-09-13T18:35:47.752893+0000","last_became_active":"2024-09-13T18:35:45.873999+0000","last_became_peered":"2024-09-13T18:35:45.873999+0000","last_unstale":"2024-09-13T18:35:47.752893+0000","last_undegraded":"2024-09-13T18:35:47.752893+0000","last_fullsized":"2024-09-13T18:35:47.752893+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:15.023455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.753057+0000","last_change":"2024-09-13T18:35:45.876353+0000","last_active":"2024-09-13T18:35:47.753057+0000","last_peered":"2024-09-13T18:35:47.753057+0000","last_clean":"2024-09-13T18:35:47.753057+0000","last_became_active":"2024-09-13T18:35:45.876112+0000","last_became_peered":"2024-09-13T18:35:45.876112+0000","last_unstale":"2024-09-13T18:35:47.753057+0000","last_undegraded":"2024-09-13T18:35:47.753057+0000","last_fullsized":"2024-09-13T18:35:47.753057+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:51.309657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752189+0000","last_change":"2024-09-13T18:35:45.864039+0000","last_active":"2024-09-13T18:35:47.752189+0000","last_peered":"2024-09-13T18:35:47.752189+0000","last_clean":"2024-09-13T18:35:47.752189+0000","last_became_active":"2024-09-13T18:35:45.863779+0000","last_became_peered":"2024-09-13T18:35:45.863779+0000","last_unstale":"2024-09-13T18:35:47.752189+0000","last_undegraded":"2024-09-13T18:35:47.752189+0000","last_fullsized":"2024-09-13T18:35:47.752189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:59.894861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752645+0000","last_change":"2024-09-13T18:35:45.857417+0000","last_active":"2024-09-13T18:35:47.752645+0000","last_peered":"2024-09-13T18:35:47.752645+0000","last_clean":"2024-09-13T18:35:47.752645+0000","last_became_active":"2024-09-13T18:35:45.856926+0000","last_became_peered":"2024-09-13T18:35:45.856926+0000","last_unstale":"2024-09-13T18:35:47.752645+0000","last_undegraded":"2024-09-13T18:35:47.752645+0000","last_fullsized":"2024-09-13T18:35:47.752645+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:38.812584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867538+0000","last_change":"2024-09-13T18:35:45.878207+0000","last_active":"2024-09-13T18:35:46.867538+0000","last_peered":"2024-09-13T18:35:46.867538+0000","last_clean":"2024-09-13T18:35:46.867538+0000","last_became_active":"2024-09-13T18:35:45.877783+0000","last_became_peered":"2024-09-13T18:35:45.877783+0000","last_unstale":"2024-09-13T18:35:46.867538+0000","last_undegraded":"2024-09-13T18:35:46.867538+0000","last_fullsized":"2024-09-13T18:35:46.867538+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:20.347955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867716+0000","last_change":"2024-09-13T18:35:45.877134+0000","last_active":"2024-09-13T18:35:46.867716+0000","last_peered":"2024-09-13T18:35:46.867716+0000","last_clean":"2024-09-13T18:35:46.867716+0000","last_became_active":"2024-09-13T18:35:45.876866+0000","last_became_peered":"2024-09-13T18:35:45.876866+0000","last_unstale":"2024-09-13T18:35:46.867716+0000","last_undegraded":"2024-09-13T18:35:46.867716+0000","last_fullsized":"2024-09-13T18:35:46.867716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:40.180096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"77'4","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868203+0000","last_change":"2024-09-13T18:35:45.472260+0000","last_active":"2024-09-13T18:35:46.868203+0000","last_peered":"2024-09-13T18:35:46.868203+0000","last_clean":"2024-09-13T18:35:46.868203+0000","last_became_active":"2024-09-13T18:35:45.472013+0000","last_became_peered":"2024-09-13T18:35:45.472013+0000","last_unstale":"2024-09-13T18:35:46.868203+0000","last_undegraded":"2024-09-13T18:35:46.868203+0000","last_fullsized":"2024-09-13T18:35:46.868203+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:50.687732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751492+0000","last_change":"2024-09-13T18:35:45.877758+0000","last_active":"2024-09-13T18:35:47.751492+0000","last_peered":"2024-09-13T18:35:47.751492+0000","last_clean":"2024-09-13T18:35:47.751492+0000","last_became_active":"2024-09-13T18:35:45.877517+0000","last_became_peered":"2024-09-13T18:35:45.877517+0000","last_unstale":"2024-09-13T18:35:47.751492+0000","last_undegraded":"2024-09-13T18:35:47.751492+0000","last_fullsized":"2024-09-13T18:35:47.751492+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:00.410986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"77'1","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752378+0000","last_change":"2024-09-13T18:35:45.475090+0000","last_active":"2024-09-13T18:35:47.752378+0000","last_peered":"2024-09-13T18:35:47.752378+0000","last_clean":"2024-09-13T18:35:47.752378+0000","last_became_active":"2024-09-13T18:35:45.474539+0000","last_became_peered":"2024-09-13T18:35:45.474539+0000","last_unstale":"2024-09-13T18:35:47.752378+0000","last_undegraded":"2024-09-13T18:35:47.752378+0000","last_fullsized":"2024-09-13T18:35:47.752378+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:54.688796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868155+0000","last_change":"2024-09-13T18:35:45.874995+0000","last_active":"2024-09-13T18:35:46.868155+0000","last_peered":"2024-09-13T18:35:46.868155+0000","last_clean":"2024-09-13T18:35:46.868155+0000","last_became_active":"2024-09-13T18:35:45.874551+0000","last_became_peered":"2024-09-13T18:35:45.874551+0000","last_unstale":"2024-09-13T18:35:46.868155+0000","last_undegraded":"2024-09-13T18:35:46.868155+0000","last_fullsized":"2024-09-13T18:35:46.868155+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:55.692347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"77'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751893+0000","last_change":"2024-09-13T18:35:45.479623+0000","last_active":"2024-09-13T18:35:47.751893+0000","last_peered":"2024-09-13T18:35:47.751893+0000","last_clean":"2024-09-13T18:35:47.751893+0000","last_became_active":"2024-09-13T18:35:45.478940+0000","last_became_peered":"2024-09-13T18:35:45.478940+0000","last_unstale":"2024-09-13T18:35:47.751893+0000","last_undegraded":"2024-09-13T18:35:47.751893+0000","last_fullsized":"2024-09-13T18:35:47.751893+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:17.606974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867970+0000","last_change":"2024-09-13T18:35:45.876410+0000","last_active":"2024-09-13T18:35:46.867970+0000","last_peered":"2024-09-13T18:35:46.867970+0000","last_clean":"2024-09-13T18:35:46.867970+0000","last_became_active":"2024-09-13T18:35:45.875838+0000","last_became_peered":"2024-09-13T18:35:45.875838+0000","last_unstale":"2024-09-13T18:35:46.867970+0000","last_undegraded":"2024-09-13T18:35:46.867970+0000","last_fullsized":"2024-09-13T18:35:46.867970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:54.586051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"77'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868363+0000","last_change":"2024-09-13T18:35:45.475413+0000","last_active":"2024-09-13T18:35:46.868363+0000","last_peered":"2024-09-13T18:35:46.868363+0000","last_clean":"2024-09-13T18:35:46.868363+0000","last_became_active":"2024-09-13T18:35:45.472574+0000","last_became_peered":"2024-09-13T18:35:45.472574+0000","last_unstale":"2024-09-13T18:35:46.868363+0000","last_undegraded":"2024-09-13T18:35:46.868363+0000","last_fullsized":"2024-09-13T18:35:46.868363+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:33.355019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752424+0000","last_change":"2024-09-13T18:35:45.878094+0000","last_active":"2024-09-13T18:35:47.752424+0000","last_peered":"2024-09-13T18:35:47.752424+0000","last_clean":"2024-09-13T18:35:47.752424+0000","last_became_active":"2024-09-13T18:35:45.877814+0000","last_became_peered":"2024-09-13T18:35:45.877814+0000","last_unstale":"2024-09-13T18:35:47.752424+0000","last_undegraded":"2024-09-13T18:35:47.752424+0000","last_fullsized":"2024-09-13T18:35:47.752424+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:55.000037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"77'1","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.753241+0000","last_change":"2024-09-13T18:35:45.471479+0000","last_active":"2024-09-13T18:35:47.753241+0000","last_peered":"2024-09-13T18:35:47.753241+0000","last_clean":"2024-09-13T18:35:47.753241+0000","last_became_active":"2024-09-13T18:35:45.470872+0000","last_became_peered":"2024-09-13T18:35:45.470872+0000","last_unstale":"2024-09-13T18:35:47.753241+0000","last_undegraded":"2024-09-13T18:35:47.753241+0000","last_fullsized":"2024-09-13T18:35:47.753241+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:09.491088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751812+0000","last_change":"2024-09-13T18:35:45.870694+0000","last_active":"2024-09-13T18:35:47.751812+0000","last_peered":"2024-09-13T18:35:47.751812+0000","last_clean":"2024-09-13T18:35:47.751812+0000","last_became_active":"2024-09-13T18:35:45.870440+0000","last_became_peered":"2024-09-13T18:35:45.870440+0000","last_unstale":"2024-09-13T18:35:47.751812+0000","last_undegraded":"2024-09-13T18:35:47.751812+0000","last_fullsized":"2024-09-13T18:35:47.751812+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:59.343927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"77'1","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867336+0000","last_change":"2024-09-13T18:35:45.476256+0000","last_active":"2024-09-13T18:35:46.867336+0000","last_peered":"2024-09-13T18:35:46.867336+0000","last_clean":"2024-09-13T18:35:46.867336+0000","last_became_active":"2024-09-13T18:35:45.475700+0000","last_became_peered":"2024-09-13T18:35:45.475700+0000","last_unstale":"2024-09-13T18:35:46.867336+0000","last_undegraded":"2024-09-13T18:35:46.867336+0000","last_fullsized":"2024-09-13T18:35:46.867336+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:38.409813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751595+0000","last_change":"2024-09-13T18:35:45.866791+0000","last_active":"2024-09-13T18:35:47.751595+0000","last_peered":"2024-09-13T18:35:47.751595+0000","last_clean":"2024-09-13T18:35:47.751595+0000","last_became_active":"2024-09-13T18:35:45.866500+0000","last_became_peered":"2024-09-13T18:35:45.866500+0000","last_unstale":"2024-09-13T18:35:47.751595+0000","last_undegraded":"2024-09-13T18:35:47.751595+0000","last_fullsized":"2024-09-13T18:35:47.751595+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:34.358571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.862182+0000","last_change":"2024-09-13T18:35:45.474040+0000","last_active":"2024-09-13T18:35:46.862182+0000","last_peered":"2024-09-13T18:35:46.862182+0000","last_clean":"2024-09-13T18:35:46.862182+0000","last_became_active":"2024-09-13T18:35:45.473789+0000","last_became_peered":"2024-09-13T18:35:45.473789+0000","last_unstale":"2024-09-13T18:35:46.862182+0000","last_undegraded":"2024-09-13T18:35:46.862182+0000","last_fullsized":"2024-09-13T18:35:46.862182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:35.507796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750302+0000","last_change":"2024-09-13T18:35:45.866054+0000","last_active":"2024-09-13T18:35:47.750302+0000","last_peered":"2024-09-13T18:35:47.750302+0000","last_clean":"2024-09-13T18:35:47.750302+0000","last_became_active":"2024-09-13T18:35:45.865813+0000","last_became_peered":"2024-09-13T18:35:45.865813+0000","last_unstale":"2024-09-13T18:35:47.750302+0000","last_undegraded":"2024-09-13T18:35:47.750302+0000","last_fullsized":"2024-09-13T18:35:47.750302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:38.812584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751771+0000","last_change":"2024-09-13T18:35:45.471039+0000","last_active":"2024-09-13T18:35:47.751771+0000","last_peered":"2024-09-13T18:35:47.751771+0000","last_clean":"2024-09-13T18:35:47.751771+0000","last_became_active":"2024-09-13T18:35:45.470385+0000","last_became_peered":"2024-09-13T18:35:45.470385+0000","last_unstale":"2024-09-13T18:35:47.751771+0000","last_undegraded":"2024-09-13T18:35:47.751771+0000","last_fullsized":"2024-09-13T18:35:47.751771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:01.737904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752519+0000","last_change":"2024-09-13T18:35:45.865766+0000","last_active":"2024-09-13T18:35:47.752519+0000","last_peered":"2024-09-13T18:35:47.752519+0000","last_clean":"2024-09-13T18:35:47.752519+0000","last_became_active":"2024-09-13T18:35:45.865502+0000","last_became_peered":"2024-09-13T18:35:45.865502+0000","last_unstale":"2024-09-13T18:35:47.752519+0000","last_undegraded":"2024-09-13T18:35:47.752519+0000","last_fullsized":"2024-09-13T18:35:47.752519+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:26.729086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752093+0000","last_change":"2024-09-13T18:35:45.473795+0000","last_active":"2024-09-13T18:35:47.752093+0000","last_peered":"2024-09-13T18:35:47.752093+0000","last_clean":"2024-09-13T18:35:47.752093+0000","last_became_active":"2024-09-13T18:35:45.473538+0000","last_became_peered":"2024-09-13T18:35:45.473538+0000","last_unstale":"2024-09-13T18:35:47.752093+0000","last_undegraded":"2024-09-13T18:35:47.752093+0000","last_fullsized":"2024-09-13T18:35:47.752093+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.189564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868027+0000","last_change":"2024-09-13T18:35:45.878966+0000","last_active":"2024-09-13T18:35:46.868027+0000","last_peered":"2024-09-13T18:35:46.868027+0000","last_clean":"2024-09-13T18:35:46.868027+0000","last_became_active":"2024-09-13T18:35:45.878641+0000","last_became_peered":"2024-09-13T18:35:45.878641+0000","last_unstale":"2024-09-13T18:35:46.868027+0000","last_undegraded":"2024-09-13T18:35:46.868027+0000","last_fullsized":"2024-09-13T18:35:46.868027+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:09.286582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867569+0000","last_change":"2024-09-13T18:35:45.476004+0000","last_active":"2024-09-13T18:35:46.867569+0000","last_peered":"2024-09-13T18:35:46.867569+0000","last_clean":"2024-09-13T18:35:46.867569+0000","last_became_active":"2024-09-13T18:35:45.475714+0000","last_became_peered":"2024-09-13T18:35:45.475714+0000","last_unstale":"2024-09-13T18:35:46.867569+0000","last_undegraded":"2024-09-13T18:35:46.867569+0000","last_fullsized":"2024-09-13T18:35:46.867569+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:31.562480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868345+0000","last_change":"2024-09-13T18:35:45.865035+0000","last_active":"2024-09-13T18:35:46.868345+0000","last_peered":"2024-09-13T18:35:46.868345+0000","last_clean":"2024-09-13T18:35:46.868345+0000","last_became_active":"2024-09-13T18:35:45.864789+0000","last_became_peered":"2024-09-13T18:35:45.864789+0000","last_unstale":"2024-09-13T18:35:46.868345+0000","last_undegraded":"2024-09-13T18:35:46.868345+0000","last_fullsized":"2024-09-13T18:35:46.868345+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:30.257132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"77'3","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.753574+0000","last_change":"2024-09-13T18:35:45.470804+0000","last_active":"2024-09-13T18:35:47.753574+0000","last_peered":"2024-09-13T18:35:47.753574+0000","last_clean":"2024-09-13T18:35:47.753574+0000","last_became_active":"2024-09-13T18:35:45.470525+0000","last_became_peered":"2024-09-13T18:35:45.470525+0000","last_unstale":"2024-09-13T18:35:47.753574+0000","last_undegraded":"2024-09-13T18:35:47.753574+0000","last_fullsized":"2024-09-13T18:35:47.753574+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:45.615730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750932+0000","last_change":"2024-09-13T18:35:45.869421+0000","last_active":"2024-09-13T18:35:47.750932+0000","last_peered":"2024-09-13T18:35:47.750932+0000","last_clean":"2024-09-13T18:35:47.750932+0000","last_became_active":"2024-09-13T18:35:45.868871+0000","last_became_peered":"2024-09-13T18:35:45.868871+0000","last_unstale":"2024-09-13T18:35:47.750932+0000","last_undegraded":"2024-09-13T18:35:47.750932+0000","last_fullsized":"2024-09-13T18:35:47.750932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:51.181872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"77'6","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.863213+0000","last_change":"2024-09-13T18:35:45.474787+0000","last_active":"2024-09-13T18:35:46.863213+0000","last_peered":"2024-09-13T18:35:46.863213+0000","last_clean":"2024-09-13T18:35:46.863213+0000","last_became_active":"2024-09-13T18:35:45.474485+0000","last_became_peered":"2024-09-13T18:35:45.474485+0000","last_unstale":"2024-09-13T18:35:46.863213+0000","last_undegraded":"2024-09-13T18:35:46.863213+0000","last_fullsized":"2024-09-13T18:35:46.863213+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:17.606974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867409+0000","last_change":"2024-09-13T18:35:45.873510+0000","last_active":"2024-09-13T18:35:46.867409+0000","last_peered":"2024-09-13T18:35:46.867409+0000","last_clean":"2024-09-13T18:35:46.867409+0000","last_became_active":"2024-09-13T18:35:45.873219+0000","last_became_peered":"2024-09-13T18:35:45.873219+0000","last_unstale":"2024-09-13T18:35:46.867409+0000","last_undegraded":"2024-09-13T18:35:46.867409+0000","last_fullsized":"2024-09-13T18:35:46.867409+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:13.815647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"77'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.862913+0000","last_change":"2024-09-13T18:35:45.469363+0000","last_active":"2024-09-13T18:35:46.862913+0000","last_peered":"2024-09-13T18:35:46.862913+0000","last_clean":"2024-09-13T18:35:46.862913+0000","last_became_active":"2024-09-13T18:35:45.469041+0000","last_became_peered":"2024-09-13T18:35:45.469041+0000","last_unstale":"2024-09-13T18:35:46.862913+0000","last_undegraded":"2024-09-13T18:35:46.862913+0000","last_fullsized":"2024-09-13T18:35:46.862913+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:16.170228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.753079+0000","last_change":"2024-09-13T18:35:45.871494+0000","last_active":"2024-09-13T18:35:47.753079+0000","last_peered":"2024-09-13T18:35:47.753079+0000","last_clean":"2024-09-13T18:35:47.753079+0000","last_became_active":"2024-09-13T18:35:45.871221+0000","last_became_peered":"2024-09-13T18:35:45.871221+0000","last_unstale":"2024-09-13T18:35:47.753079+0000","last_undegraded":"2024-09-13T18:35:47.753079+0000","last_fullsized":"2024-09-13T18:35:47.753079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:06.327113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867491+0000","last_change":"2024-09-13T18:35:45.476416+0000","last_active":"2024-09-13T18:35:46.867491+0000","last_peered":"2024-09-13T18:35:46.867491+0000","last_clean":"2024-09-13T18:35:46.867491+0000","last_became_active":"2024-09-13T18:35:45.476022+0000","last_became_peered":"2024-09-13T18:35:45.476022+0000","last_unstale":"2024-09-13T18:35:46.867491+0000","last_undegraded":"2024-09-13T18:35:46.867491+0000","last_fullsized":"2024-09-13T18:35:46.867491+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:55.012378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750111+0000","last_change":"2024-09-13T18:35:45.864653+0000","last_active":"2024-09-13T18:35:47.750111+0000","last_peered":"2024-09-13T18:35:47.750111+0000","last_clean":"2024-09-13T18:35:47.750111+0000","last_became_active":"2024-09-13T18:35:45.864318+0000","last_became_peered":"2024-09-13T18:35:45.864318+0000","last_unstale":"2024-09-13T18:35:47.750111+0000","last_undegraded":"2024-09-13T18:35:47.750111+0000","last_fullsized":"2024-09-13T18:35:47.750111+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:26.729086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752532+0000","last_change":"2024-09-13T18:35:45.467618+0000","last_active":"2024-09-13T18:35:47.752532+0000","last_peered":"2024-09-13T18:35:47.752532+0000","last_clean":"2024-09-13T18:35:47.752532+0000","last_became_active":"2024-09-13T18:35:45.467320+0000","last_became_peered":"2024-09-13T18:35:45.467320+0000","last_unstale":"2024-09-13T18:35:47.752532+0000","last_undegraded":"2024-09-13T18:35:47.752532+0000","last_fullsized":"2024-09-13T18:35:47.752532+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:43.233122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751905+0000","last_change":"2024-09-13T18:35:45.875808+0000","last_active":"2024-09-13T18:35:47.751905+0000","last_peered":"2024-09-13T18:35:47.751905+0000","last_clean":"2024-09-13T18:35:47.751905+0000","last_became_active":"2024-09-13T18:35:45.875530+0000","last_became_peered":"2024-09-13T18:35:45.875530+0000","last_unstale":"2024-09-13T18:35:47.751905+0000","last_undegraded":"2024-09-13T18:35:47.751905+0000","last_fullsized":"2024-09-13T18:35:47.751905+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:37.987527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"77'8","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751160+0000","last_change":"2024-09-13T18:35:45.473402+0000","last_active":"2024-09-13T18:35:47.751160+0000","last_peered":"2024-09-13T18:35:47.751160+0000","last_clean":"2024-09-13T18:35:47.751160+0000","last_became_active":"2024-09-13T18:35:45.473008+0000","last_became_peered":"2024-09-13T18:35:45.473008+0000","last_unstale":"2024-09-13T18:35:47.751160+0000","last_undegraded":"2024-09-13T18:35:47.751160+0000","last_fullsized":"2024-09-13T18:35:47.751160+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:38.409813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751858+0000","last_change":"2024-09-13T18:35:45.871474+0000","last_active":"2024-09-13T18:35:47.751858+0000","last_peered":"2024-09-13T18:35:47.751858+0000","last_clean":"2024-09-13T18:35:47.751858+0000","last_became_active":"2024-09-13T18:35:45.871217+0000","last_became_peered":"2024-09-13T18:35:45.871217+0000","last_unstale":"2024-09-13T18:35:47.751858+0000","last_undegraded":"2024-09-13T18:35:47.751858+0000","last_fullsized":"2024-09-13T18:35:47.751858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:49.973795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"77'1","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868257+0000","last_change":"2024-09-13T18:35:45.478297+0000","last_active":"2024-09-13T18:35:46.868257+0000","last_peered":"2024-09-13T18:35:46.868257+0000","last_clean":"2024-09-13T18:35:46.868257+0000","last_became_active":"2024-09-13T18:35:45.478053+0000","last_became_peered":"2024-09-13T18:35:45.478053+0000","last_unstale":"2024-09-13T18:35:46.868257+0000","last_undegraded":"2024-09-13T18:35:46.868257+0000","last_fullsized":"2024-09-13T18:35:46.868257+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:17.606974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868129+0000","last_change":"2024-09-13T18:35:45.876572+0000","last_active":"2024-09-13T18:35:46.868129+0000","last_peered":"2024-09-13T18:35:46.868129+0000","last_clean":"2024-09-13T18:35:46.868129+0000","last_became_active":"2024-09-13T18:35:45.875417+0000","last_became_peered":"2024-09-13T18:35:45.875417+0000","last_unstale":"2024-09-13T18:35:46.868129+0000","last_undegraded":"2024-09-13T18:35:46.868129+0000","last_fullsized":"2024-09-13T18:35:46.868129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:43.880737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"77'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752083+0000","last_change":"2024-09-13T18:35:45.479816+0000","last_active":"2024-09-13T18:35:47.752083+0000","last_peered":"2024-09-13T18:35:47.752083+0000","last_clean":"2024-09-13T18:35:47.752083+0000","last_became_active":"2024-09-13T18:35:45.479485+0000","last_became_peered":"2024-09-13T18:35:45.479485+0000","last_unstale":"2024-09-13T18:35:47.752083+0000","last_undegraded":"2024-09-13T18:35:47.752083+0000","last_fullsized":"2024-09-13T18:35:47.752083+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:07.537701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.863074+0000","last_change":"2024-09-13T18:35:45.873901+0000","last_active":"2024-09-13T18:35:46.863074+0000","last_peered":"2024-09-13T18:35:46.863074+0000","last_clean":"2024-09-13T18:35:46.863074+0000","last_became_active":"2024-09-13T18:35:45.873394+0000","last_became_peered":"2024-09-13T18:35:45.873394+0000","last_unstale":"2024-09-13T18:35:46.863074+0000","last_undegraded":"2024-09-13T18:35:46.863074+0000","last_fullsized":"2024-09-13T18:35:46.863074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:48.183275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"77'1","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867271+0000","last_change":"2024-09-13T18:35:45.478481+0000","last_active":"2024-09-13T18:35:46.867271+0000","last_peered":"2024-09-13T18:35:46.867271+0000","last_clean":"2024-09-13T18:35:46.867271+0000","last_became_active":"2024-09-13T18:35:45.478253+0000","last_became_peered":"2024-09-13T18:35:45.478253+0000","last_unstale":"2024-09-13T18:35:46.867271+0000","last_undegraded":"2024-09-13T18:35:46.867271+0000","last_fullsized":"2024-09-13T18:35:46.867271+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:21.109027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751126+0000","last_change":"2024-09-13T18:35:45.866854+0000","last_active":"2024-09-13T18:35:47.751126+0000","last_peered":"2024-09-13T18:35:47.751126+0000","last_clean":"2024-09-13T18:35:47.751126+0000","last_became_active":"2024-09-13T18:35:45.866582+0000","last_became_peered":"2024-09-13T18:35:45.866582+0000","last_unstale":"2024-09-13T18:35:47.751126+0000","last_undegraded":"2024-09-13T18:35:47.751126+0000","last_fullsized":"2024-09-13T18:35:47.751126+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:09.552413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868315+0000","last_change":"2024-09-13T18:35:45.474320+0000","last_active":"2024-09-13T18:35:46.868315+0000","last_peered":"2024-09-13T18:35:46.868315+0000","last_clean":"2024-09-13T18:35:46.868315+0000","last_became_active":"2024-09-13T18:35:45.474063+0000","last_became_peered":"2024-09-13T18:35:45.474063+0000","last_unstale":"2024-09-13T18:35:46.868315+0000","last_undegraded":"2024-09-13T18:35:46.868315+0000","last_fullsized":"2024-09-13T18:35:46.868315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:31.964679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.753069+0000","last_change":"2024-09-13T18:35:45.875977+0000","last_active":"2024-09-13T18:35:47.753069+0000","last_peered":"2024-09-13T18:35:47.753069+0000","last_clean":"2024-09-13T18:35:47.753069+0000","last_became_active":"2024-09-13T18:35:45.875677+0000","last_became_peered":"2024-09-13T18:35:45.875677+0000","last_unstale":"2024-09-13T18:35:47.753069+0000","last_undegraded":"2024-09-13T18:35:47.753069+0000","last_fullsized":"2024-09-13T18:35:47.753069+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:40:45.913103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867627+0000","last_change":"2024-09-13T18:35:45.472200+0000","last_active":"2024-09-13T18:35:46.867627+0000","last_peered":"2024-09-13T18:35:46.867627+0000","last_clean":"2024-09-13T18:35:46.867627+0000","last_became_active":"2024-09-13T18:35:45.471935+0000","last_became_peered":"2024-09-13T18:35:45.471935+0000","last_unstale":"2024-09-13T18:35:46.867627+0000","last_undegraded":"2024-09-13T18:35:46.867627+0000","last_fullsized":"2024-09-13T18:35:46.867627+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:07.537701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752441+0000","last_change":"2024-09-13T18:35:45.881555+0000","last_active":"2024-09-13T18:35:47.752441+0000","last_peered":"2024-09-13T18:35:47.752441+0000","last_clean":"2024-09-13T18:35:47.752441+0000","last_became_active":"2024-09-13T18:35:45.881253+0000","last_became_peered":"2024-09-13T18:35:45.881253+0000","last_unstale":"2024-09-13T18:35:47.752441+0000","last_undegraded":"2024-09-13T18:35:47.752441+0000","last_fullsized":"2024-09-13T18:35:47.752441+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:45.677365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752673+0000","last_change":"2024-09-13T18:35:45.476046+0000","last_active":"2024-09-13T18:35:47.752673+0000","last_peered":"2024-09-13T18:35:47.752673+0000","last_clean":"2024-09-13T18:35:47.752673+0000","last_became_active":"2024-09-13T18:35:45.475714+0000","last_became_peered":"2024-09-13T18:35:45.475714+0000","last_unstale":"2024-09-13T18:35:47.752673+0000","last_undegraded":"2024-09-13T18:35:47.752673+0000","last_fullsized":"2024-09-13T18:35:47.752673+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:45.692277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752770+0000","last_change":"2024-09-13T18:35:45.880070+0000","last_active":"2024-09-13T18:35:47.752770+0000","last_peered":"2024-09-13T18:35:47.752770+0000","last_clean":"2024-09-13T18:35:47.752770+0000","last_became_active":"2024-09-13T18:35:45.879228+0000","last_became_peered":"2024-09-13T18:35:45.879228+0000","last_unstale":"2024-09-13T18:35:47.752770+0000","last_undegraded":"2024-09-13T18:35:47.752770+0000","last_fullsized":"2024-09-13T18:35:47.752770+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:43.579248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.749962+0000","last_change":"2024-09-13T18:35:45.474876+0000","last_active":"2024-09-13T18:35:47.749962+0000","last_peered":"2024-09-13T18:35:47.749962+0000","last_clean":"2024-09-13T18:35:47.749962+0000","last_became_active":"2024-09-13T18:35:45.474574+0000","last_became_peered":"2024-09-13T18:35:45.474574+0000","last_unstale":"2024-09-13T18:35:47.749962+0000","last_undegraded":"2024-09-13T18:35:47.749962+0000","last_fullsized":"2024-09-13T18:35:47.749962+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:19.344403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751932+0000","last_change":"2024-09-13T18:35:45.872962+0000","last_active":"2024-09-13T18:35:47.751932+0000","last_peered":"2024-09-13T18:35:47.751932+0000","last_clean":"2024-09-13T18:35:47.751932+0000","last_became_active":"2024-09-13T18:35:45.872642+0000","last_became_peered":"2024-09-13T18:35:45.872642+0000","last_unstale":"2024-09-13T18:35:47.751932+0000","last_undegraded":"2024-09-13T18:35:47.751932+0000","last_fullsized":"2024-09-13T18:35:47.751932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:43.230611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"77'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868311+0000","last_change":"2024-09-13T18:35:45.478020+0000","last_active":"2024-09-13T18:35:46.868311+0000","last_peered":"2024-09-13T18:35:46.868311+0000","last_clean":"2024-09-13T18:35:46.868311+0000","last_became_active":"2024-09-13T18:35:45.477089+0000","last_became_peered":"2024-09-13T18:35:45.477089+0000","last_unstale":"2024-09-13T18:35:46.868311+0000","last_undegraded":"2024-09-13T18:35:46.868311+0000","last_fullsized":"2024-09-13T18:35:46.868311+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:35.507796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752653+0000","last_change":"2024-09-13T18:35:45.871442+0000","last_active":"2024-09-13T18:35:47.752653+0000","last_peered":"2024-09-13T18:35:47.752653+0000","last_clean":"2024-09-13T18:35:47.752653+0000","last_became_active":"2024-09-13T18:35:45.871168+0000","last_became_peered":"2024-09-13T18:35:45.871168+0000","last_unstale":"2024-09-13T18:35:47.752653+0000","last_undegraded":"2024-09-13T18:35:47.752653+0000","last_fullsized":"2024-09-13T18:35:47.752653+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:07.323249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752728+0000","last_change":"2024-09-13T18:35:45.468863+0000","last_active":"2024-09-13T18:35:47.752728+0000","last_peered":"2024-09-13T18:35:47.752728+0000","last_clean":"2024-09-13T18:35:47.752728+0000","last_became_active":"2024-09-13T18:35:45.468536+0000","last_became_peered":"2024-09-13T18:35:45.468536+0000","last_unstale":"2024-09-13T18:35:47.752728+0000","last_undegraded":"2024-09-13T18:35:47.752728+0000","last_fullsized":"2024-09-13T18:35:47.752728+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:39.722520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867758+0000","last_change":"2024-09-13T18:35:45.880515+0000","last_active":"2024-09-13T18:35:46.867758+0000","last_peered":"2024-09-13T18:35:46.867758+0000","last_clean":"2024-09-13T18:35:46.867758+0000","last_became_active":"2024-09-13T18:35:45.880224+0000","last_became_peered":"2024-09-13T18:35:45.880224+0000","last_unstale":"2024-09-13T18:35:46.867758+0000","last_undegraded":"2024-09-13T18:35:46.867758+0000","last_fullsized":"2024-09-13T18:35:46.867758+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:41.900603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751246+0000","last_change":"2024-09-13T18:35:45.469580+0000","last_active":"2024-09-13T18:35:47.751246+0000","last_peered":"2024-09-13T18:35:47.751246+0000","last_clean":"2024-09-13T18:35:47.751246+0000","last_became_active":"2024-09-13T18:35:45.468979+0000","last_became_peered":"2024-09-13T18:35:45.468979+0000","last_unstale":"2024-09-13T18:35:47.751246+0000","last_undegraded":"2024-09-13T18:35:47.751246+0000","last_fullsized":"2024-09-13T18:35:47.751246+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:01.152777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868019+0000","last_change":"2024-09-13T18:35:45.872941+0000","last_active":"2024-09-13T18:35:46.868019+0000","last_peered":"2024-09-13T18:35:46.868019+0000","last_clean":"2024-09-13T18:35:46.868019+0000","last_became_active":"2024-09-13T18:35:45.872656+0000","last_became_peered":"2024-09-13T18:35:45.872656+0000","last_unstale":"2024-09-13T18:35:46.868019+0000","last_undegraded":"2024-09-13T18:35:46.868019+0000","last_fullsized":"2024-09-13T18:35:46.868019+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:10.494639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751803+0000","last_change":"2024-09-13T18:35:45.475279+0000","last_active":"2024-09-13T18:35:47.751803+0000","last_peered":"2024-09-13T18:35:47.751803+0000","last_clean":"2024-09-13T18:35:47.751803+0000","last_became_active":"2024-09-13T18:35:45.475006+0000","last_became_peered":"2024-09-13T18:35:45.475006+0000","last_unstale":"2024-09-13T18:35:47.751803+0000","last_undegraded":"2024-09-13T18:35:47.751803+0000","last_fullsized":"2024-09-13T18:35:47.751803+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:48.970243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751596+0000","last_change":"2024-09-13T18:35:45.878210+0000","last_active":"2024-09-13T18:35:47.751596+0000","last_peered":"2024-09-13T18:35:47.751596+0000","last_clean":"2024-09-13T18:35:47.751596+0000","last_became_active":"2024-09-13T18:35:45.877953+0000","last_became_peered":"2024-09-13T18:35:45.877953+0000","last_unstale":"2024-09-13T18:35:47.751596+0000","last_undegraded":"2024-09-13T18:35:47.751596+0000","last_fullsized":"2024-09-13T18:35:47.751596+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:28.328066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750912+0000","last_change":"2024-09-13T18:35:45.472124+0000","last_active":"2024-09-13T18:35:47.750912+0000","last_peered":"2024-09-13T18:35:47.750912+0000","last_clean":"2024-09-13T18:35:47.750912+0000","last_became_active":"2024-09-13T18:35:45.471924+0000","last_became_peered":"2024-09-13T18:35:45.471924+0000","last_unstale":"2024-09-13T18:35:47.750912+0000","last_undegraded":"2024-09-13T18:35:47.750912+0000","last_fullsized":"2024-09-13T18:35:47.750912+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:51.427343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867324+0000","last_change":"2024-09-13T18:35:45.874081+0000","last_active":"2024-09-13T18:35:46.867324+0000","last_peered":"2024-09-13T18:35:46.867324+0000","last_clean":"2024-09-13T18:35:46.867324+0000","last_became_active":"2024-09-13T18:35:45.871264+0000","last_became_peered":"2024-09-13T18:35:45.871264+0000","last_unstale":"2024-09-13T18:35:46.867324+0000","last_undegraded":"2024-09-13T18:35:46.867324+0000","last_fullsized":"2024-09-13T18:35:46.867324+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:49.973795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.862414+0000","last_change":"2024-09-13T18:35:45.473298+0000","last_active":"2024-09-13T18:35:46.862414+0000","last_peered":"2024-09-13T18:35:46.862414+0000","last_clean":"2024-09-13T18:35:46.862414+0000","last_became_active":"2024-09-13T18:35:45.473004+0000","last_became_peered":"2024-09-13T18:35:45.473004+0000","last_unstale":"2024-09-13T18:35:46.862414+0000","last_undegraded":"2024-09-13T18:35:46.862414+0000","last_fullsized":"2024-09-13T18:35:46.862414+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:48.859206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.862302+0000","last_change":"2024-09-13T18:35:45.876925+0000","last_active":"2024-09-13T18:35:46.862302+0000","last_peered":"2024-09-13T18:35:46.862302+0000","last_clean":"2024-09-13T18:35:46.862302+0000","last_became_active":"2024-09-13T18:35:45.876686+0000","last_became_peered":"2024-09-13T18:35:45.876686+0000","last_unstale":"2024-09-13T18:35:46.862302+0000","last_undegraded":"2024-09-13T18:35:46.862302+0000","last_fullsized":"2024-09-13T18:35:46.862302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:25.249970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751182+0000","last_change":"2024-09-13T18:35:45.472921+0000","last_active":"2024-09-13T18:35:47.751182+0000","last_peered":"2024-09-13T18:35:47.751182+0000","last_clean":"2024-09-13T18:35:47.751182+0000","last_became_active":"2024-09-13T18:35:45.471185+0000","last_became_peered":"2024-09-13T18:35:45.471185+0000","last_unstale":"2024-09-13T18:35:47.751182+0000","last_undegraded":"2024-09-13T18:35:47.751182+0000","last_fullsized":"2024-09-13T18:35:47.751182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:55.012378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.866854+0000","last_change":"2024-09-13T18:35:45.878091+0000","last_active":"2024-09-13T18:35:46.866854+0000","last_peered":"2024-09-13T18:35:46.866854+0000","last_clean":"2024-09-13T18:35:46.866854+0000","last_became_active":"2024-09-13T18:35:45.877792+0000","last_became_peered":"2024-09-13T18:35:45.877792+0000","last_unstale":"2024-09-13T18:35:46.866854+0000","last_undegraded":"2024-09-13T18:35:46.866854+0000","last_fullsized":"2024-09-13T18:35:46.866854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:22.588146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867685+0000","last_change":"2024-09-13T18:35:45.472252+0000","last_active":"2024-09-13T18:35:46.867685+0000","last_peered":"2024-09-13T18:35:46.867685+0000","last_clean":"2024-09-13T18:35:46.867685+0000","last_became_active":"2024-09-13T18:35:45.471993+0000","last_became_peered":"2024-09-13T18:35:45.471993+0000","last_unstale":"2024-09-13T18:35:46.867685+0000","last_undegraded":"2024-09-13T18:35:46.867685+0000","last_fullsized":"2024-09-13T18:35:46.867685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:39.116699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752983+0000","last_change":"2024-09-13T18:35:45.881030+0000","last_active":"2024-09-13T18:35:47.752983+0000","last_peered":"2024-09-13T18:35:47.752983+0000","last_clean":"2024-09-13T18:35:47.752983+0000","last_became_active":"2024-09-13T18:35:45.879544+0000","last_became_peered":"2024-09-13T18:35:45.879544+0000","last_unstale":"2024-09-13T18:35:47.752983+0000","last_undegraded":"2024-09-13T18:35:47.752983+0000","last_fullsized":"2024-09-13T18:35:47.752983+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:31.102728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"77'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867046+0000","last_change":"2024-09-13T18:35:45.475112+0000","last_active":"2024-09-13T18:35:46.867046+0000","last_peered":"2024-09-13T18:35:46.867046+0000","last_clean":"2024-09-13T18:35:46.867046+0000","last_became_active":"2024-09-13T18:35:45.472591+0000","last_became_peered":"2024-09-13T18:35:45.472591+0000","last_unstale":"2024-09-13T18:35:46.867046+0000","last_undegraded":"2024-09-13T18:35:46.867046+0000","last_fullsized":"2024-09-13T18:35:46.867046+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:18.796198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":215,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T18:35:45.861709+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:35:45.861709+0000","last_peered":"2024-09-13T18:35:45.861709+0000","last_clean":"2024-09-13T18:35:45.861709+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:35:45.861709+0000","last_undegraded":"2024-09-13T18:35:45.861709+0000","last_fullsized":"2024-09-13T18:35:45.861709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574959,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32644,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339196,"statfs":{"total":96636764160,"available":96603336704,"internally_reserved":0,"allocated":1552384,"data_stored":999326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.38700000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.024,"5min":1.099,"15min":1.163},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75,"15min":0.79000000000000004},"min":{"1min":0.56299999999999994,"5min":0.436,"15min":0.436},"max":{"1min":1.0900000000000001,"5min":1.288,"15min":1.288},"last":0.79200000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.82299999999999995,"15min":0.874},"min":{"1min":0.59199999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.155,"5min":1.288,"15min":1.7689999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.878,"15min":0.93500000000000005},"min":{"1min":0.65200000000000002,"5min":0.54100000000000004,"15min":0.52600000000000002},"max":{"1min":1.1240000000000001,"5min":1.3009999999999999,"15min":1.6140000000000001},"last":1.175}]},{"osd":2,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.81599999999999995,"15min":0.84599999999999997},"min":{"1min":0.61899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.101,"5min":1.2270000000000001,"15min":1.3340000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.82799999999999996,"15min":0.88600000000000001},"min":{"1min":0.49299999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2390000000000001,"5min":1.524,"15min":1.6659999999999999},"last":0.86399999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.88100000000000001,"15min":0.89000000000000001},"min":{"1min":0.61399999999999999,"5min":0.54300000000000004,"15min":0.52600000000000002},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.873,"5min":0.88,"15min":0.88100000000000001},"min":{"1min":0.64500000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0940000000000001,"5min":1.486,"15min":1.486},"last":1.1990000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.86099999999999999,"15min":0.88200000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.038,"5min":1.4590000000000001,"15min":1.7290000000000001},"last":1.038},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.0129999999999999,"15min":1.0369999999999999},"min":{"1min":0.70299999999999996,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1639999999999999,"5min":1.49,"15min":1.7050000000000001},"last":1.226}]},{"osd":5,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.95699999999999996,"15min":0.95599999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.196,"5min":1.4159999999999999,"15min":1.4259999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.048,"15min":1.0509999999999999},"min":{"1min":0.73299999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2170000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.2649999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.0429999999999999,"15min":1.083},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.58099999999999996},"max":{"1min":1.212,"5min":1.4730000000000001,"15min":2.077},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0940000000000001,"15min":1.0760000000000001},"min":{"1min":0.81999999999999995,"5min":0.74399999999999999,"15min":0.69099999999999995},"max":{"1min":1.258,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.323}]}]},{"osd":6,"up_from":13,"seq":55834574961,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":958464,"data_stored":408434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78800000000000003,"15min":0.82099999999999995},"min":{"1min":0.47899999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.1799999999999999,"5min":1.22,"15min":1.2270000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.77500000000000002,"15min":0.81699999999999995},"min":{"1min":0.56599999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0880000000000001,"5min":1.2470000000000001,"15min":1.361},"last":0.70099999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.76900000000000002,"15min":0.81000000000000005},"min":{"1min":0.55900000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0389999999999999,"5min":1.266,"15min":1.266},"last":0.746},{"interface":"front","average":{"1min":0.877,"5min":0.81999999999999995,"15min":0.82499999999999996},"min":{"1min":0.52700000000000002,"5min":0.48299999999999998,"15min":0.48099999999999998},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.59299999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.79500000000000004,"15min":0.80900000000000005},"min":{"1min":0.55900000000000005,"5min":0.47399999999999998,"15min":0.46899999999999997},"max":{"1min":1.1319999999999999,"5min":1.141,"15min":1.254},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.84199999999999997,"15min":0.85899999999999999},"min":{"1min":0.60099999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.101,"5min":1.248,"15min":1.248},"last":0.94999999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.89900000000000002,"15min":0.876},"min":{"1min":0.60099999999999998,"5min":0.57599999999999996,"15min":0.52300000000000002},"max":{"1min":1.1870000000000001,"5min":1.238,"15min":1.238},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.89200000000000002,"15min":0.93600000000000005},"min":{"1min":0.68899999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1839999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.046}]},{"osd":4,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.85399999999999998,"15min":0.88300000000000001},"min":{"1min":0.68300000000000005,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1679999999999999,"5min":1.236,"15min":1.248},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.95899999999999996,"15min":0.98999999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2709999999999999,"5min":1.407,"15min":1.407},"last":0.89000000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.022,"15min":1.038},"min":{"1min":0.81699999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.226,"5min":1.355,"15min":1.355},"last":1.123},{"interface":"front","average":{"1min":0.997,"5min":0.96599999999999997,"15min":0.97999999999999998},"min":{"1min":0.67800000000000005,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2130000000000001,"5min":1.353,"15min":1.4990000000000001},"last":1.105}]},{"osd":7,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.98799999999999999,"15min":1},"min":{"1min":0.65900000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2470000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.069},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0980000000000001,"15min":1.1080000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76000000000000001},"max":{"1min":1.3120000000000001,"5min":1.367,"15min":1.3740000000000001},"last":1.1970000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574959,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":954368,"data_stored":408432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77000000000000002,"15min":0.82399999999999995},"min":{"1min":0.52200000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.147,"5min":1.3280000000000001,"15min":1.3640000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.78500000000000003,"15min":0.84999999999999998},"min":{"1min":0.60299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0980000000000001,"5min":1.2190000000000001,"15min":1.482},"last":1.048}]},{"osd":1,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.78500000000000003,"15min":0.79800000000000004},"min":{"1min":0.626,"5min":0.42499999999999999,"15min":0.40999999999999998},"max":{"1min":1.224,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.84699999999999998,"15min":0.91700000000000004},"min":{"1min":0.63300000000000001,"5min":0.50900000000000001,"15min":0.45200000000000001},"max":{"1min":1.1890000000000001,"5min":1.218,"15min":1.4850000000000001},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92000000000000004,"15min":0.94799999999999995},"min":{"1min":0.65100000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1830000000000001,"5min":1.2430000000000001,"15min":1.4179999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.92300000000000004,"15min":0.98899999999999999},"min":{"1min":0.71199999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.252,"5min":1.3029999999999999,"15min":1.4690000000000001},"last":0.83199999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.88100000000000001,"15min":0.93100000000000005},"min":{"1min":0.70499999999999996,"5min":0.55800000000000005,"15min":0.51700000000000002},"max":{"1min":1.153,"5min":1.2010000000000001,"15min":1.4510000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.88,"15min":0.93100000000000005},"min":{"1min":0.70799999999999996,"5min":0.61199999999999999,"15min":0.55300000000000005},"max":{"1min":1.1279999999999999,"5min":1.335,"15min":1.4990000000000001},"last":0.91600000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.92800000000000005,"15min":0.96099999999999997},"min":{"1min":0.60999999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.077,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.95899999999999996,"15min":1.0169999999999999},"min":{"1min":0.61799999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.143,"5min":1.3759999999999999,"15min":1.542},"last":0.94699999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.97099999999999997,"15min":1.0169999999999999},"min":{"1min":0.72399999999999998,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3129999999999999,"5min":1.4259999999999999,"15min":1.698},"last":1.079},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.107,"15min":1.1499999999999999},"min":{"1min":0.94999999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.286,"5min":1.52,"15min":1.581},"last":1.0309999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0620000000000001,"15min":1.155},"min":{"1min":0.83399999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.272,"5min":1.552,"15min":1.847},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.038,"5min":1.0600000000000001,"15min":1.125},"min":{"1min":0.81899999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.216,"5min":1.4259999999999999,"15min":1.8100000000000001},"last":1.0029999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574959,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46008,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325832,"statfs":{"total":96636764160,"available":96589651968,"internally_reserved":0,"allocated":954368,"data_stored":408412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.80900000000000005,"15min":0.88},"min":{"1min":0.54900000000000004,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.119,"5min":1.1930000000000001,"15min":1.3720000000000001},"last":0.629},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.874,"15min":0.94599999999999995},"min":{"1min":0.69399999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1479999999999999,"5min":1.3280000000000001,"15min":1.5229999999999999},"last":0.97499999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.76300000000000001,"15min":0.79500000000000004},"min":{"1min":0.68400000000000005,"5min":0.441,"15min":0.435},"max":{"1min":1.012,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.81999999999999995,"15min":0.84599999999999997},"min":{"1min":0.60499999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.88900000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78300000000000003,"15min":0.83899999999999997},"min":{"1min":0.55300000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0780000000000001,"5min":1.171,"15min":1.171},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.86199999999999999,"15min":0.85399999999999998},"min":{"1min":0.66700000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1719999999999999,"5min":1.331,"15min":1.331},"last":0.754}]},{"osd":3,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.89200000000000002,"15min":0.95699999999999996},"min":{"1min":0.68899999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.163,"5min":1.268,"15min":1.639},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.91200000000000003,"15min":0.97099999999999997},"min":{"1min":0.65000000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.119,"5min":1.2629999999999999,"15min":1.8300000000000001},"last":0.80200000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.91500000000000004,"15min":0.96399999999999997},"min":{"1min":0.65900000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.381,"5min":1.518,"15min":2.3889999999999998},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0389999999999999,"15min":1.095},"min":{"1min":0.70599999999999996,"5min":0.626,"15min":0.626},"max":{"1min":1.2969999999999999,"5min":1.375,"15min":2.0049999999999999},"last":1.012}]},{"osd":6,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.95499999999999996,"15min":0.91200000000000003},"min":{"1min":0.64300000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2829999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.075,"15min":1.0960000000000001},"min":{"1min":0.94599999999999995,"5min":0.70099999999999996,"15min":0.63500000000000001},"max":{"1min":1.423,"5min":1.4259999999999999,"15min":1.794},"last":0.99299999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.046,"15min":1.069},"min":{"1min":0.89800000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.228,"5min":1.643,"15min":1.669},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.048,"15min":1.03},"min":{"1min":0.70099999999999996,"5min":0.69499999999999995,"15min":0.61799999999999999},"max":{"1min":1.357,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.028}]}]},{"osd":3,"up_from":13,"seq":55834574962,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":958464,"data_stored":408454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61499999999999999,"15min":0.66500000000000004},"min":{"1min":0.505,"5min":0.22,"15min":0.22},"max":{"1min":0.88300000000000001,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.59899999999999998,"15min":0.65900000000000003},"min":{"1min":0.52700000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.1970000000000001},"last":1.008}]},{"osd":1,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.64800000000000002,"15min":0.69499999999999995},"min":{"1min":0.504,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0920000000000001,"5min":1.379,"15min":1.379},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.71399999999999997,"15min":0.79400000000000004},"min":{"1min":0.54800000000000004,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.042,"5min":1.397,"15min":2.0030000000000001},"last":0.66700000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.72299999999999998,"15min":0.76900000000000002},"min":{"1min":0.60799999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1970000000000001,"5min":1.3300000000000001,"15min":1.333},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.78800000000000003,"15min":0.86699999999999999},"min":{"1min":0.66400000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.2430000000000001,"5min":1.423,"15min":1.423},"last":0.96899999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.871,"15min":0.93700000000000006},"min":{"1min":0.77400000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.04,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.93500000000000005,"15min":1.016},"min":{"1min":0.74199999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.393,"5min":1.587,"15min":1.587},"last":0.91600000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.004,"15min":1.1299999999999999},"min":{"1min":0.80600000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5620000000000001,"5min":1.6200000000000001,"15min":2.2320000000000002},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.96999999999999997,"15min":1.079},"min":{"1min":0.81299999999999994,"5min":0.53900000000000003,"15min":0.53600000000000003},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.718},"last":1.133}]},{"osd":6,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.0229999999999999,"15min":1.1060000000000001},"min":{"1min":0.84299999999999997,"5min":0.496,"15min":0.496},"max":{"1min":1.3999999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.048},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.0489999999999999,"15min":1.179},"min":{"1min":0.96199999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4790000000000001,"5min":1.51,"15min":2.1819999999999999},"last":1.0720000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.01,"15min":1.083},"min":{"1min":0.871,"5min":0.624,"15min":0.624},"max":{"1min":1.2050000000000001,"5min":1.3759999999999999,"15min":1.4670000000000001},"last":1.206},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.0649999999999999,"15min":1.153},"min":{"1min":0.97599999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.444,"5min":1.548,"15min":1.5920000000000001},"last":1.113}]}]},{"osd":2,"up_from":13,"seq":55834574960,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40256,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331584,"statfs":{"total":96636764160,"available":96595542016,"internally_reserved":0,"allocated":962560,"data_stored":409906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.628,"15min":0.66000000000000003},"min":{"1min":0.498,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":1.056,"5min":1.1020000000000001,"15min":1.1919999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.69899999999999995,"15min":0.77100000000000002},"min":{"1min":0.56899999999999995,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.014,"5min":1.036,"15min":1.4370000000000001},"last":1.026}]},{"osd":1,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.64900000000000002,"15min":0.69599999999999995},"min":{"1min":0.52200000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2629999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.67200000000000004,"15min":0.72299999999999998},"min":{"1min":0.58799999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.90000000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.65500000000000003,"15min":0.67000000000000004},"min":{"1min":0.56200000000000006,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.89300000000000002,"5min":1.0489999999999999,"15min":1.1619999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.83099999999999996,"15min":0.85499999999999998},"min":{"1min":0.57999999999999996,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.248,"5min":1.3460000000000001,"15min":1.548},"last":1.1870000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.95399999999999996,"15min":0.97399999999999998},"min":{"1min":0.83599999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.272,"5min":1.653,"15min":1.653},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.998,"5min":0.95499999999999996,"15min":1.028},"min":{"1min":0.78600000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.347,"5min":1.51,"15min":2.3849999999999998},"last":1.2709999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.92200000000000004,"15min":0.92300000000000004},"min":{"1min":0.67300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2390000000000001,"5min":1.4730000000000001,"15min":1.498},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0189999999999999,"15min":1.05},"min":{"1min":0.76700000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.3260000000000001,"5min":1.7549999999999999,"15min":1.869},"last":1.0860000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.0169999999999999,"15min":1.0860000000000001},"min":{"1min":0.81200000000000006,"5min":0.502,"15min":0.502},"max":{"1min":1.454,"5min":1.6120000000000001,"15min":2.762},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.997,"15min":1.0349999999999999},"min":{"1min":0.81899999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2270000000000001,"5min":1.5509999999999999,"15min":1.988},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0700000000000001,"15min":1.1419999999999999},"min":{"1min":0.92500000000000004,"5min":0.61099999999999999,"15min":0.59799999999999998},"max":{"1min":1.4099999999999999,"5min":1.8240000000000001,"15min":2.6800000000000002},"last":1.496},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0680000000000001,"15min":1.0720000000000001},"min":{"1min":0.871,"5min":0.64100000000000001,"15min":0.52800000000000002},"max":{"1min":1.2829999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.127}]}]},{"osd":1,"up_from":13,"seq":55834574960,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":970752,"data_stored":410522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.63600000000000001,"15min":0.63300000000000001},"min":{"1min":0.46899999999999997,"5min":0.34300000000000003,"15min":0.33200000000000002},"max":{"1min":1.01,"5min":1.087,"15min":1.107},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.68400000000000005,"15min":0.72999999999999998},"min":{"1min":0.51600000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.048,"5min":1.341,"15min":1.3560000000000001},"last":0.67300000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.61099999999999999,"15min":0.63},"min":{"1min":0.51500000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.88900000000000001,"5min":1.133,"15min":1.1879999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.73699999999999999,"15min":0.748},"min":{"1min":0.36399999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.139,"5min":1.617,"15min":1.617},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.57599999999999996,"5min":0.375,"15min":0.375},"max":{"1min":1.052,"5min":1.415,"15min":1.415},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.75700000000000001,"15min":0.78400000000000003},"min":{"1min":0.56599999999999995,"5min":0.35999999999999999,"15min":0.35699999999999998},"max":{"1min":1.111,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.59099999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.94699999999999995,"15min":0.95699999999999996},"min":{"1min":0.81200000000000006,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2769999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.96199999999999997,"15min":0.97299999999999998},"min":{"1min":0.73799999999999999,"5min":0.57599999999999996,"15min":0.54100000000000004},"max":{"1min":1.1830000000000001,"5min":1.52,"15min":1.994},"last":0.52300000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.97299999999999998,"15min":0.97599999999999998},"min":{"1min":0.78100000000000003,"5min":0.71399999999999997,"15min":0.49299999999999999},"max":{"1min":1.3160000000000001,"5min":1.7,"15min":2.0960000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0549999999999999,"15min":1.077},"min":{"1min":0.746,"5min":0.626,"15min":0.626},"max":{"1min":1.355,"5min":1.8939999999999999,"15min":2.7280000000000002},"last":0.874}]},{"osd":6,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.0269999999999999,"15min":1.071},"min":{"1min":0.85599999999999998,"5min":0.56599999999999995,"15min":0.53100000000000003},"max":{"1min":1.4219999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.751},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0469999999999999,"15min":1.081},"min":{"1min":0.76600000000000001,"5min":0.64700000000000002,"15min":0.63100000000000001},"max":{"1min":1.2969999999999999,"5min":1.9710000000000001,"15min":2.0489999999999999},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.103,"15min":1.0960000000000001},"min":{"1min":0.873,"5min":0.72499999999999998,"15min":0.67400000000000004},"max":{"1min":1.4830000000000001,"5min":2.0070000000000001,"15min":2.5579999999999998},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.077,"15min":1.111},"min":{"1min":0.97999999999999998,"5min":0.55200000000000005,"15min":0.51300000000000001},"max":{"1min":1.49,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.85399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40820,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331020,"statfs":{"total":96636764160,"available":96594964480,"internally_reserved":0,"allocated":1544192,"data_stored":998710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.57999999999999996,"15min":0.59899999999999998},"min":{"1min":0.47499999999999998,"5min":0.192,"15min":0.192},"max":{"1min":0.95499999999999996,"5min":1.23,"15min":1.23},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.65500000000000003,"15min":0.68799999999999994},"min":{"1min":0.56699999999999995,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.056,"5min":1.1220000000000001,"15min":1.1759999999999999},"last":0.70699999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.65500000000000003,"15min":0.69499999999999995},"min":{"1min":0.47299999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.02,"5min":1.494,"15min":1.494},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.69899999999999995,"15min":0.71599999999999997},"min":{"1min":0.5,"5min":0.223,"15min":0.223},"max":{"1min":0.96499999999999997,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.60799999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.66600000000000004,"15min":0.64300000000000002},"min":{"1min":0.54700000000000004,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.0409999999999999,"5min":1.137,"15min":1.137},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.79300000000000004,"15min":0.81999999999999995},"min":{"1min":0.69799999999999995,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.246,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.64200000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.94199999999999995,"15min":0.95999999999999996},"min":{"1min":0.69899999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.1970000000000001,"5min":1.764,"15min":1.764},"last":1.145},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.89100000000000001,"15min":0.90600000000000003},"min":{"1min":0.72699999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.4810000000000001},"last":0.85299999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.95999999999999996,"15min":0.96899999999999997},"min":{"1min":0.81399999999999995,"5min":0.63700000000000001,"15min":0.59299999999999997},"max":{"1min":1.3540000000000001,"5min":1.365,"15min":1.3939999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.056,"5min":1.0109999999999999,"15min":1.0449999999999999},"min":{"1min":0.84599999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3100000000000001,"5min":1.637,"15min":1.637},"last":0.92900000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.048,"15min":1.083},"min":{"1min":0.76200000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.357,"5min":1.718,"15min":1.718},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0629999999999999,"15min":1.1060000000000001},"min":{"1min":0.84499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.341,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.21}]},{"osd":7,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0569999999999999,"15min":1.105},"min":{"1min":0.74399999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.403,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.026,"15min":1.04},"min":{"1min":0.80300000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.413,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.1020000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:35:50.662 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:35:50.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.772+0000 7f65d967b700 1 Processor -- start 2024-09-13T18:35:50.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.772+0000 7f65d967b700 1 -- start start 2024-09-13T18:35:50.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.772+0000 7f65d967b700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f65d4159870 0x7f65d406d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.772+0000 7f65d967b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f65d40b3f90 0x7f65d406bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.772+0000 7f65d967b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65d4070ba0 0x7f65d4070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.772+0000 7f65d967b700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d406dbe0 con 0x7f65d40b3f90 2024-09-13T18:35:50.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.772+0000 7f65d967b700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d4071530 con 0x7f65d4159870 2024-09-13T18:35:50.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.772+0000 7f65d967b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d406c600 con 0x7f65d4070ba0 2024-09-13T18:35:50.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.772+0000 7f65d37fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f65d40b3f90 0x7f65d406bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.772+0000 7f65d37fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f65d40b3f90 0x7f65d406bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37802/0 (socket says 172.21.15.44:37802) 2024-09-13T18:35:50.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.772+0000 7f65d37fe700 1 -- 172.21.15.44:0/3863462954 learned_addr learned my addr 172.21.15.44:0/3863462954 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:50.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.772+0000 7f65d3fff700 1 --2- 172.21.15.44:0/3863462954 >> v2:172.21.15.99:3300/0 conn(0x7f65d4159870 0x7f65d406d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.772+0000 7f65d8e7a700 1 --2- 172.21.15.44:0/3863462954 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65d4070ba0 0x7f65d4070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.772+0000 7f65d37fe700 1 -- 172.21.15.44:0/3863462954 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65d4070ba0 msgr2=0x7f65d4070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:50.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.772+0000 7f65d37fe700 1 --2- 172.21.15.44:0/3863462954 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65d4070ba0 0x7f65d4070ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.772+0000 7f65d37fe700 1 -- 172.21.15.44:0/3863462954 >> v2:172.21.15.99:3300/0 conn(0x7f65d4159870 msgr2=0x7f65d406d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:50.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.772+0000 7f65d37fe700 1 --2- 172.21.15.44:0/3863462954 >> v2:172.21.15.99:3300/0 conn(0x7f65d4159870 0x7f65d406d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.772+0000 7f65d37fe700 1 -- 172.21.15.44:0/3863462954 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d406c8e0 con 0x7f65d40b3f90 2024-09-13T18:35:50.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.772+0000 7f65d37fe700 1 --2- 172.21.15.44:0/3863462954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d40b3f90 0x7f65d406bcb0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f65d40b2470 tx=0x7f65c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f476fb838d226fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.772+0000 7f65d2ffd700 1 -- 172.21.15.44:0/3863462954 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c400e070 con 0x7f65d40b3f90 2024-09-13T18:35:50.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.772+0000 7f65d2ffd700 1 -- 172.21.15.44:0/3863462954 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c400b910 con 0x7f65d40b3f90 2024-09-13T18:35:50.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.772+0000 7f65d2ffd700 1 -- 172.21.15.44:0/3863462954 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c400bcc0 con 0x7f65d40b3f90 2024-09-13T18:35:50.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.776+0000 7f65d967b700 1 -- 172.21.15.44:0/3863462954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d40b3f90 msgr2=0x7f65d406bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.776+0000 7f65d967b700 1 --2- 172.21.15.44:0/3863462954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d40b3f90 0x7f65d406bcb0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f65d40b2470 tx=0x7f65c400b330 comp rx=0 tx=0).stop 2024-09-13T18:35:50.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.776+0000 7f65d967b700 1 -- 172.21.15.44:0/3863462954 shutdown_connections 2024-09-13T18:35:50.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.776+0000 7f65d967b700 1 --2- 172.21.15.44:0/3863462954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d40b3f90 0x7f65d406bcb0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.776+0000 7f65d967b700 1 --2- 172.21.15.44:0/3863462954 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65d4070ba0 0x7f65d4070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.776+0000 7f65d967b700 1 --2- 172.21.15.44:0/3863462954 >> v2:172.21.15.99:3300/0 conn(0x7f65d4159870 0x7f65d406d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.776+0000 7f65d967b700 1 -- 172.21.15.44:0/3863462954 >> 172.21.15.44:0/3863462954 conn(0x7f65d40b1630 msgr2=0x7f65d40b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.776+0000 7f65d967b700 1 -- 172.21.15.44:0/3863462954 shutdown_connections 2024-09-13T18:35:50.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.776+0000 7f65d967b700 1 -- 172.21.15.44:0/3863462954 wait complete. 2024-09-13T18:35:50.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.776+0000 7f65d967b700 1 Processor -- start 2024-09-13T18:35:50.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.776+0000 7f65d967b700 1 -- start start 2024-09-13T18:35:50.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.776+0000 7f65d967b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65d4070ba0 0x7f65d414c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.776+0000 7f65d967b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d40b3f90 0x7f65d4152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.776+0000 7f65d967b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65d4159870 0x7f65d40cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.776+0000 7f65d967b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d414c4d0 con 0x7f65d40b3f90 2024-09-13T18:35:50.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.776+0000 7f65d967b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d4151480 con 0x7f65d4159870 2024-09-13T18:35:50.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.776+0000 7f65d967b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d4151760 con 0x7f65d4070ba0 2024-09-13T18:35:50.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.780+0000 7f65d37fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d40b3f90 0x7f65d4152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.780+0000 7f65d37fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d40b3f90 0x7f65d4152520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37806/0 (socket says 172.21.15.44:37806) 2024-09-13T18:35:50.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.780+0000 7f65d37fe700 1 -- 172.21.15.44:0/1743037332 learned_addr learned my addr 172.21.15.44:0/1743037332 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:50.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.780+0000 7f65d8e7a700 1 --2- 172.21.15.44:0/1743037332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65d4159870 0x7f65d40cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.780+0000 7f65d3fff700 1 --2- 172.21.15.44:0/1743037332 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65d4070ba0 0x7f65d414c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.780+0000 7f65d37fe700 1 -- 172.21.15.44:0/1743037332 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65d4070ba0 msgr2=0x7f65d414c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.780+0000 7f65d37fe700 1 --2- 172.21.15.44:0/1743037332 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65d4070ba0 0x7f65d414c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.780+0000 7f65d37fe700 1 -- 172.21.15.44:0/1743037332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65d4159870 msgr2=0x7f65d40cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.780+0000 7f65d37fe700 1 --2- 172.21.15.44:0/1743037332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65d4159870 0x7f65d40cfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.780+0000 7f65d37fe700 1 -- 172.21.15.44:0/1743037332 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c4009b30 con 0x7f65d40b3f90 2024-09-13T18:35:50.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.780+0000 7f65d37fe700 1 --2- 172.21.15.44:0/1743037332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d40b3f90 0x7f65d4152520 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f65c400b370 tx=0x7f65c4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.780+0000 7f65d0ff9700 1 -- 172.21.15.44:0/1743037332 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c40092e0 con 0x7f65d40b3f90 2024-09-13T18:35:50.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.780+0000 7f65d0ff9700 1 -- 172.21.15.44:0/1743037332 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c400ce80 con 0x7f65d40b3f90 2024-09-13T18:35:50.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.780+0000 7f65d967b700 1 -- 172.21.15.44:0/1743037332 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d4151a40 con 0x7f65d40b3f90 2024-09-13T18:35:50.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.780+0000 7f65d0ff9700 1 -- 172.21.15.44:0/1743037332 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c40044b0 con 0x7f65d40b3f90 2024-09-13T18:35:50.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.780+0000 7f65d967b700 1 -- 172.21.15.44:0/1743037332 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d4152000 con 0x7f65d40b3f90 2024-09-13T18:35:50.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.780+0000 7f65d967b700 1 -- 172.21.15.44:0/1743037332 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d40b4ea0 con 0x7f65d40b3f90 2024-09-13T18:35:50.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.784+0000 7f65d0ff9700 1 -- 172.21.15.44:0/1743037332 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f65c4004610 con 0x7f65d40b3f90 2024-09-13T18:35:50.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.784+0000 7f65d0ff9700 1 --2- 172.21.15.44:0/1743037332 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f65b4066730 0x7f65b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.784+0000 7f65d0ff9700 1 -- 172.21.15.44:0/1743037332 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65c4085480 con 0x7f65d40b3f90 2024-09-13T18:35:50.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.784+0000 7f65d3fff700 1 --2- 172.21.15.44:0/1743037332 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f65b4066730 0x7f65b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.784+0000 7f65d3fff700 1 --2- 172.21.15.44:0/1743037332 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f65b4066730 0x7f65b4068bf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009bf0 tx=0x7f65bc009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:50.792+0000 7f65d0ff9700 1 -- 172.21.15.44:0/1743037332 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f65c40563c0 con 0x7f65d40b3f90 2024-09-13T18:35:51.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.028+0000 7f65d967b700 1 -- 172.21.15.44:0/1743037332 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f65d406c280 con 0x7f65d40b3f90 2024-09-13T18:35:51.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.028+0000 7f65d0ff9700 1 -- 172.21.15.44:0/1743037332 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1174 (secure 0 0 0) 0x7f65c40204b0 con 0x7f65d40b3f90 2024-09-13T18:35:51.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:51.035 INFO:teuthology.orchestra.run.smithi044.stdout:{"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":554,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":78,"num_osds":8,"num_up_osds":8,"osd_up_since":1726252008,"num_in_osds":8,"osd_in_since":1726251999,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592730,"bytes_used":294887424,"bytes_avail":772799225856,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":70,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":7626}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":15,"modified":"2024-09-13T18:35:34.502385+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T18:35:51.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.032+0000 7f65d967b700 1 -- 172.21.15.44:0/1743037332 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f65b4066730 msgr2=0x7f65b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.032+0000 7f65d967b700 1 --2- 172.21.15.44:0/1743037332 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f65b4066730 0x7f65b4068bf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009bf0 tx=0x7f65bc009240 comp rx=0 tx=0).stop 2024-09-13T18:35:51.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.032+0000 7f65d967b700 1 -- 172.21.15.44:0/1743037332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d40b3f90 msgr2=0x7f65d4152520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.032+0000 7f65d967b700 1 --2- 172.21.15.44:0/1743037332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d40b3f90 0x7f65d4152520 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f65c400b370 tx=0x7f65c4004af0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.032+0000 7f65d967b700 1 -- 172.21.15.44:0/1743037332 shutdown_connections 2024-09-13T18:35:51.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.032+0000 7f65d967b700 1 --2- 172.21.15.44:0/1743037332 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f65b4066730 0x7f65b4068bf0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.032+0000 7f65d967b700 1 --2- 172.21.15.44:0/1743037332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65d4159870 0x7f65d40cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.032+0000 7f65d967b700 1 --2- 172.21.15.44:0/1743037332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d40b3f90 0x7f65d4152520 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.032+0000 7f65d967b700 1 --2- 172.21.15.44:0/1743037332 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f65d4070ba0 0x7f65d414c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.032+0000 7f65d967b700 1 -- 172.21.15.44:0/1743037332 >> 172.21.15.44:0/1743037332 conn(0x7f65d40b1630 msgr2=0x7f65d40b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:51.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.032+0000 7f65d967b700 1 -- 172.21.15.44:0/1743037332 shutdown_connections 2024-09-13T18:35:51.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.032+0000 7f65d967b700 1 -- 172.21.15.44:0/1743037332 wait complete. 2024-09-13T18:35:51.054 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T18:35:51.054 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:35:51.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.164+0000 7f6e79ba7700 1 Processor -- start 2024-09-13T18:35:51.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.164+0000 7f6e79ba7700 1 -- start start 2024-09-13T18:35:51.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.164+0000 7f6e79ba7700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6e7406fb30 0x7f6e740adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.164+0000 7f6e79ba7700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e7406bb90 0x7f6e740cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.164+0000 7f6e79ba7700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6e7406d150 0x7f6e7406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.164+0000 7f6e79ba7700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e7406cd30 con 0x7f6e7406d150 2024-09-13T18:35:51.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.164+0000 7f6e79ba7700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e7406a780 con 0x7f6e7406fb30 2024-09-13T18:35:51.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.164+0000 7f6e79ba7700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e74159470 con 0x7f6e7406bb90 2024-09-13T18:35:51.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.164+0000 7f6e793a6700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6e7406d150 0x7f6e7406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.164+0000 7f6e73fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e7406bb90 0x7f6e740cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.164+0000 7f6e78ba5700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6e7406fb30 0x7f6e740adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.164+0000 7f6e793a6700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6e7406d150 0x7f6e7406d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37816/0 (socket says 172.21.15.44:37816) 2024-09-13T18:35:51.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.164+0000 7f6e73fff700 1 --2- 172.21.15.44:0/1523072079 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e7406bb90 0x7f6e740cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:54276/0 (socket says 172.21.15.44:54276) 2024-09-13T18:35:51.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.164+0000 7f6e793a6700 1 -- 172.21.15.44:0/1523072079 learned_addr learned my addr 172.21.15.44:0/1523072079 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:51.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.168+0000 7f6e793a6700 1 -- 172.21.15.44:0/1523072079 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e7406bb90 msgr2=0x7f6e740cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:51.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.168+0000 7f6e793a6700 1 --2- 172.21.15.44:0/1523072079 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e7406bb90 0x7f6e740cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.168+0000 7f6e793a6700 1 -- 172.21.15.44:0/1523072079 >> v2:172.21.15.99:3300/0 conn(0x7f6e7406fb30 msgr2=0x7f6e740adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:51.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.168+0000 7f6e793a6700 1 --2- 172.21.15.44:0/1523072079 >> v2:172.21.15.99:3300/0 conn(0x7f6e7406fb30 0x7f6e740adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.168+0000 7f6e793a6700 1 -- 172.21.15.44:0/1523072079 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7406c0b0 con 0x7f6e7406d150 2024-09-13T18:35:51.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.168+0000 7f6e78ba5700 1 --2- 172.21.15.44:0/1523072079 >> v2:172.21.15.99:3300/0 conn(0x7f6e7406fb30 0x7f6e740adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:51.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.168+0000 7f6e793a6700 1 --2- 172.21.15.44:0/1523072079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e7406d150 0x7f6e7406d580 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f6e740b3de0 tx=0x7f6e6c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be6cfaaecfe4fc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.168+0000 7f6e737fe700 1 -- 172.21.15.44:0/1523072079 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c011830 con 0x7f6e7406d150 2024-09-13T18:35:51.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.168+0000 7f6e737fe700 1 -- 172.21.15.44:0/1523072079 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6c011990 con 0x7f6e7406d150 2024-09-13T18:35:51.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.168+0000 7f6e737fe700 1 -- 172.21.15.44:0/1523072079 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c011d20 con 0x7f6e7406d150 2024-09-13T18:35:51.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.168+0000 7f6e79ba7700 1 -- 172.21.15.44:0/1523072079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e7406d150 msgr2=0x7f6e7406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.168+0000 7f6e79ba7700 1 --2- 172.21.15.44:0/1523072079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e7406d150 0x7f6e7406d580 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f6e740b3de0 tx=0x7f6e6c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.168+0000 7f6e79ba7700 1 -- 172.21.15.44:0/1523072079 shutdown_connections 2024-09-13T18:35:51.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.168+0000 7f6e79ba7700 1 --2- 172.21.15.44:0/1523072079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e7406d150 0x7f6e7406d580 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.168+0000 7f6e79ba7700 1 --2- 172.21.15.44:0/1523072079 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e7406bb90 0x7f6e740cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.168+0000 7f6e79ba7700 1 --2- 172.21.15.44:0/1523072079 >> v2:172.21.15.99:3300/0 conn(0x7f6e7406fb30 0x7f6e740adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.168+0000 7f6e79ba7700 1 -- 172.21.15.44:0/1523072079 >> 172.21.15.44:0/1523072079 conn(0x7f6e740b0f00 msgr2=0x7f6e740b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:51.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.168+0000 7f6e79ba7700 1 -- 172.21.15.44:0/1523072079 shutdown_connections 2024-09-13T18:35:51.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.168+0000 7f6e79ba7700 1 -- 172.21.15.44:0/1523072079 wait complete. 2024-09-13T18:35:51.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.168+0000 7f6e79ba7700 1 Processor -- start 2024-09-13T18:35:51.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.168+0000 7f6e79ba7700 1 -- start start 2024-09-13T18:35:51.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e79ba7700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e7406bb90 0x7f6e7415be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e79ba7700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e7406d150 0x7f6e7414cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e79ba7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e7406fb30 0x7f6e7414ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e79ba7700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7415c500 con 0x7f6e7406fb30 2024-09-13T18:35:51.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e79ba7700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e741f23b0 con 0x7f6e7406d150 2024-09-13T18:35:51.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e79ba7700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7415b7c0 con 0x7f6e7406bb90 2024-09-13T18:35:51.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e793a6700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e7406fb30 0x7f6e7414ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e78ba5700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e7406bb90 0x7f6e7415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e793a6700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e7406fb30 0x7f6e7414ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37826/0 (socket says 172.21.15.44:37826) 2024-09-13T18:35:51.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e793a6700 1 -- 172.21.15.44:0/1481370405 learned_addr learned my addr 172.21.15.44:0/1481370405 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:51.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e73fff700 1 --2- 172.21.15.44:0/1481370405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e7406d150 0x7f6e7414cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e793a6700 1 -- 172.21.15.44:0/1481370405 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e7406bb90 msgr2=0x7f6e7415be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e793a6700 1 --2- 172.21.15.44:0/1481370405 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e7406bb90 0x7f6e7415be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e793a6700 1 -- 172.21.15.44:0/1481370405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e7406d150 msgr2=0x7f6e7414cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e793a6700 1 --2- 172.21.15.44:0/1481370405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e7406d150 0x7f6e7414cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e793a6700 1 -- 172.21.15.44:0/1481370405 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e680094b0 con 0x7f6e7406fb30 2024-09-13T18:35:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e78ba5700 1 --2- 172.21.15.44:0/1481370405 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e7406bb90 0x7f6e7415be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e793a6700 1 --2- 172.21.15.44:0/1481370405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e7406fb30 0x7f6e7414ad10 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f6e740cb530 tx=0x7f6e6c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e717fa700 1 -- 172.21.15.44:0/1481370405 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c004450 con 0x7f6e7406fb30 2024-09-13T18:35:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e717fa700 1 -- 172.21.15.44:0/1481370405 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6c0045b0 con 0x7f6e7406fb30 2024-09-13T18:35:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e79ba7700 1 -- 172.21.15.44:0/1481370405 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6c009570 con 0x7f6e7406fb30 2024-09-13T18:35:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e717fa700 1 -- 172.21.15.44:0/1481370405 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c003900 con 0x7f6e7406fb30 2024-09-13T18:35:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e79ba7700 1 -- 172.21.15.44:0/1481370405 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e741f2880 con 0x7f6e7406fb30 2024-09-13T18:35:51.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.172+0000 7f6e79ba7700 1 -- 172.21.15.44:0/1481370405 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e7406d580 con 0x7f6e7406fb30 2024-09-13T18:35:51.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.176+0000 7f6e717fa700 1 -- 172.21.15.44:0/1481370405 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6e6c021070 con 0x7f6e7406fb30 2024-09-13T18:35:51.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.176+0000 7f6e717fa700 1 --2- 172.21.15.44:0/1481370405 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6e60066730 0x7f6e60068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.176+0000 7f6e717fa700 1 -- 172.21.15.44:0/1481370405 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e6c0854d0 con 0x7f6e7406fb30 2024-09-13T18:35:51.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.176+0000 7f6e78ba5700 1 --2- 172.21.15.44:0/1481370405 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6e60066730 0x7f6e60068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.176+0000 7f6e78ba5700 1 --2- 172.21.15.44:0/1481370405 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6e60066730 0x7f6e60068bf0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6e7415bd90 tx=0x7f6e68009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.180+0000 7f6e717fa700 1 -- 172.21.15.44:0/1481370405 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6e6c0528d0 con 0x7f6e7406fb30 2024-09-13T18:35:51.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.352+0000 7f6e79ba7700 1 -- 172.21.15.44:0/1481370405 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e740cb150 con 0x7f6e60066730 2024-09-13T18:35:51.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.368+0000 7f6e717fa700 1 -- 172.21.15.44:0/1481370405 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287813 (secure 0 0 0) 0x7f6e740cb150 con 0x7f6e60066730 2024-09-13T18:35:51.381 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:51.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.372+0000 7f6e79ba7700 1 -- 172.21.15.44:0/1481370405 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6e60066730 msgr2=0x7f6e60068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.372+0000 7f6e79ba7700 1 --2- 172.21.15.44:0/1481370405 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6e60066730 0x7f6e60068bf0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6e7415bd90 tx=0x7f6e68009240 comp rx=0 tx=0).stop 2024-09-13T18:35:51.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.372+0000 7f6e79ba7700 1 -- 172.21.15.44:0/1481370405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e7406fb30 msgr2=0x7f6e7414ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.372+0000 7f6e79ba7700 1 --2- 172.21.15.44:0/1481370405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e7406fb30 0x7f6e7414ad10 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f6e740cb530 tx=0x7f6e6c004770 comp rx=0 tx=0).stop 2024-09-13T18:35:51.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.372+0000 7f6e79ba7700 1 -- 172.21.15.44:0/1481370405 shutdown_connections 2024-09-13T18:35:51.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.372+0000 7f6e79ba7700 1 --2- 172.21.15.44:0/1481370405 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6e60066730 0x7f6e60068bf0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.372+0000 7f6e79ba7700 1 --2- 172.21.15.44:0/1481370405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e7406fb30 0x7f6e7414ad10 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.372+0000 7f6e79ba7700 1 --2- 172.21.15.44:0/1481370405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e7406d150 0x7f6e7414cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.372+0000 7f6e79ba7700 1 --2- 172.21.15.44:0/1481370405 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e7406bb90 0x7f6e7415be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.372+0000 7f6e79ba7700 1 -- 172.21.15.44:0/1481370405 >> 172.21.15.44:0/1481370405 conn(0x7f6e740b0f00 msgr2=0x7f6e740afdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:51.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.372+0000 7f6e79ba7700 1 -- 172.21.15.44:0/1481370405 shutdown_connections 2024-09-13T18:35:51.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:51.372+0000 7f6e79ba7700 1 -- 172.21.15.44:0/1481370405 wait complete. 2024-09-13T18:35:51.384 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:35:51.393 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":342,"stamp":"2024-09-13T18:35:50.507127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":287976,"kb_used_data":8648,"kb_used_omap":12,"kb_used_meta":279155,"kb_avail":754686744,"statfs":{"total":773094113280,"available":772799225856,"internally_reserved":0,"allocated":8855552,"data_stored":4452196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":285855288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001939"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867944+0000","last_change":"2024-09-13T18:35:45.876759+0000","last_active":"2024-09-13T18:35:46.867944+0000","last_peered":"2024-09-13T18:35:46.867944+0000","last_clean":"2024-09-13T18:35:46.867944+0000","last_became_active":"2024-09-13T18:35:45.876258+0000","last_became_peered":"2024-09-13T18:35:45.876258+0000","last_unstale":"2024-09-13T18:35:46.867944+0000","last_undegraded":"2024-09-13T18:35:46.867944+0000","last_fullsized":"2024-09-13T18:35:46.867944+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:52.148220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867399+0000","last_change":"2024-09-13T18:35:45.862965+0000","last_active":"2024-09-13T18:35:46.867399+0000","last_peered":"2024-09-13T18:35:46.867399+0000","last_clean":"2024-09-13T18:35:46.867399+0000","last_became_active":"2024-09-13T18:35:45.862683+0000","last_became_peered":"2024-09-13T18:35:45.862683+0000","last_unstale":"2024-09-13T18:35:46.867399+0000","last_undegraded":"2024-09-13T18:35:46.867399+0000","last_fullsized":"2024-09-13T18:35:46.867399+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:15.023455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.753408+0000","last_change":"2024-09-13T18:35:45.879740+0000","last_active":"2024-09-13T18:35:47.753408+0000","last_peered":"2024-09-13T18:35:47.753408+0000","last_clean":"2024-09-13T18:35:47.753408+0000","last_became_active":"2024-09-13T18:35:45.876578+0000","last_became_peered":"2024-09-13T18:35:45.876578+0000","last_unstale":"2024-09-13T18:35:47.753408+0000","last_undegraded":"2024-09-13T18:35:47.753408+0000","last_fullsized":"2024-09-13T18:35:47.753408+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:52.159676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.862781+0000","last_change":"2024-09-13T18:35:45.877617+0000","last_active":"2024-09-13T18:35:46.862781+0000","last_peered":"2024-09-13T18:35:46.862781+0000","last_clean":"2024-09-13T18:35:46.862781+0000","last_became_active":"2024-09-13T18:35:45.877379+0000","last_became_peered":"2024-09-13T18:35:45.877379+0000","last_unstale":"2024-09-13T18:35:46.862781+0000","last_undegraded":"2024-09-13T18:35:46.862781+0000","last_fullsized":"2024-09-13T18:35:46.862781+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:50.667404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750670+0000","last_change":"2024-09-13T18:35:45.869430+0000","last_active":"2024-09-13T18:35:47.750670+0000","last_peered":"2024-09-13T18:35:47.750670+0000","last_clean":"2024-09-13T18:35:47.750670+0000","last_became_active":"2024-09-13T18:35:45.869165+0000","last_became_peered":"2024-09-13T18:35:45.869165+0000","last_unstale":"2024-09-13T18:35:47.750670+0000","last_undegraded":"2024-09-13T18:35:47.750670+0000","last_fullsized":"2024-09-13T18:35:47.750670+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:40.120251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867162+0000","last_change":"2024-09-13T18:35:45.865094+0000","last_active":"2024-09-13T18:35:46.867162+0000","last_peered":"2024-09-13T18:35:46.867162+0000","last_clean":"2024-09-13T18:35:46.867162+0000","last_became_active":"2024-09-13T18:35:45.864826+0000","last_became_peered":"2024-09-13T18:35:45.864826+0000","last_unstale":"2024-09-13T18:35:46.867162+0000","last_undegraded":"2024-09-13T18:35:46.867162+0000","last_fullsized":"2024-09-13T18:35:46.867162+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:01.309115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752309+0000","last_change":"2024-09-13T18:35:45.872362+0000","last_active":"2024-09-13T18:35:47.752309+0000","last_peered":"2024-09-13T18:35:47.752309+0000","last_clean":"2024-09-13T18:35:47.752309+0000","last_became_active":"2024-09-13T18:35:45.872103+0000","last_became_peered":"2024-09-13T18:35:45.872103+0000","last_unstale":"2024-09-13T18:35:47.752309+0000","last_undegraded":"2024-09-13T18:35:47.752309+0000","last_fullsized":"2024-09-13T18:35:47.752309+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:58.389866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867384+0000","last_change":"2024-09-13T18:35:45.870529+0000","last_active":"2024-09-13T18:35:46.867384+0000","last_peered":"2024-09-13T18:35:46.867384+0000","last_clean":"2024-09-13T18:35:46.867384+0000","last_became_active":"2024-09-13T18:35:45.870318+0000","last_became_peered":"2024-09-13T18:35:45.870318+0000","last_unstale":"2024-09-13T18:35:46.867384+0000","last_undegraded":"2024-09-13T18:35:46.867384+0000","last_fullsized":"2024-09-13T18:35:46.867384+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:44.606188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751173+0000","last_change":"2024-09-13T18:35:45.877476+0000","last_active":"2024-09-13T18:35:47.751173+0000","last_peered":"2024-09-13T18:35:47.751173+0000","last_clean":"2024-09-13T18:35:47.751173+0000","last_became_active":"2024-09-13T18:35:45.877180+0000","last_became_peered":"2024-09-13T18:35:45.877180+0000","last_unstale":"2024-09-13T18:35:47.751173+0000","last_undegraded":"2024-09-13T18:35:47.751173+0000","last_fullsized":"2024-09-13T18:35:47.751173+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:54.814862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751614+0000","last_change":"2024-09-13T18:35:45.874208+0000","last_active":"2024-09-13T18:35:47.751614+0000","last_peered":"2024-09-13T18:35:47.751614+0000","last_clean":"2024-09-13T18:35:47.751614+0000","last_became_active":"2024-09-13T18:35:45.873944+0000","last_became_peered":"2024-09-13T18:35:45.873944+0000","last_unstale":"2024-09-13T18:35:47.751614+0000","last_undegraded":"2024-09-13T18:35:47.751614+0000","last_fullsized":"2024-09-13T18:35:47.751614+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:01.309115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867785+0000","last_change":"2024-09-13T18:35:45.881425+0000","last_active":"2024-09-13T18:35:46.867785+0000","last_peered":"2024-09-13T18:35:46.867785+0000","last_clean":"2024-09-13T18:35:46.867785+0000","last_became_active":"2024-09-13T18:35:45.881174+0000","last_became_peered":"2024-09-13T18:35:45.881174+0000","last_unstale":"2024-09-13T18:35:46.867785+0000","last_undegraded":"2024-09-13T18:35:46.867785+0000","last_fullsized":"2024-09-13T18:35:46.867785+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:46.619282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.862927+0000","last_change":"2024-09-13T18:35:45.874046+0000","last_active":"2024-09-13T18:35:46.862927+0000","last_peered":"2024-09-13T18:35:46.862927+0000","last_clean":"2024-09-13T18:35:46.862927+0000","last_became_active":"2024-09-13T18:35:45.873686+0000","last_became_peered":"2024-09-13T18:35:45.873686+0000","last_unstale":"2024-09-13T18:35:46.862927+0000","last_undegraded":"2024-09-13T18:35:46.862927+0000","last_fullsized":"2024-09-13T18:35:46.862927+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:22.588146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750636+0000","last_change":"2024-09-13T18:35:45.864467+0000","last_active":"2024-09-13T18:35:47.750636+0000","last_peered":"2024-09-13T18:35:47.750636+0000","last_clean":"2024-09-13T18:35:47.750636+0000","last_became_active":"2024-09-13T18:35:45.864174+0000","last_became_peered":"2024-09-13T18:35:45.864174+0000","last_unstale":"2024-09-13T18:35:47.750636+0000","last_undegraded":"2024-09-13T18:35:47.750636+0000","last_fullsized":"2024-09-13T18:35:47.750636+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:07.323249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751491+0000","last_change":"2024-09-13T18:35:45.857007+0000","last_active":"2024-09-13T18:35:47.751491+0000","last_peered":"2024-09-13T18:35:47.751491+0000","last_clean":"2024-09-13T18:35:47.751491+0000","last_became_active":"2024-09-13T18:35:45.856701+0000","last_became_peered":"2024-09-13T18:35:45.856701+0000","last_unstale":"2024-09-13T18:35:47.751491+0000","last_undegraded":"2024-09-13T18:35:47.751491+0000","last_fullsized":"2024-09-13T18:35:47.751491+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:47.409939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750188+0000","last_change":"2024-09-13T18:35:45.868193+0000","last_active":"2024-09-13T18:35:47.750188+0000","last_peered":"2024-09-13T18:35:47.750188+0000","last_clean":"2024-09-13T18:35:47.750188+0000","last_became_active":"2024-09-13T18:35:45.867834+0000","last_became_peered":"2024-09-13T18:35:45.867834+0000","last_unstale":"2024-09-13T18:35:47.750188+0000","last_undegraded":"2024-09-13T18:35:47.750188+0000","last_fullsized":"2024-09-13T18:35:47.750188+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:58.389866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751038+0000","last_change":"2024-09-13T18:35:45.875555+0000","last_active":"2024-09-13T18:35:47.751038+0000","last_peered":"2024-09-13T18:35:47.751038+0000","last_clean":"2024-09-13T18:35:47.751038+0000","last_became_active":"2024-09-13T18:35:45.875248+0000","last_became_peered":"2024-09-13T18:35:45.875248+0000","last_unstale":"2024-09-13T18:35:47.751038+0000","last_undegraded":"2024-09-13T18:35:47.751038+0000","last_fullsized":"2024-09-13T18:35:47.751038+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:30.257132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751427+0000","last_change":"2024-09-13T18:35:45.877626+0000","last_active":"2024-09-13T18:35:47.751427+0000","last_peered":"2024-09-13T18:35:47.751427+0000","last_clean":"2024-09-13T18:35:47.751427+0000","last_became_active":"2024-09-13T18:35:45.877189+0000","last_became_peered":"2024-09-13T18:35:45.877189+0000","last_unstale":"2024-09-13T18:35:47.751427+0000","last_undegraded":"2024-09-13T18:35:47.751427+0000","last_fullsized":"2024-09-13T18:35:47.751427+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:19.096857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.863308+0000","last_change":"2024-09-13T18:35:45.869053+0000","last_active":"2024-09-13T18:35:46.863308+0000","last_peered":"2024-09-13T18:35:46.863308+0000","last_clean":"2024-09-13T18:35:46.863308+0000","last_became_active":"2024-09-13T18:35:45.868465+0000","last_became_peered":"2024-09-13T18:35:45.868465+0000","last_unstale":"2024-09-13T18:35:46.863308+0000","last_undegraded":"2024-09-13T18:35:46.863308+0000","last_fullsized":"2024-09-13T18:35:46.863308+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:01.353338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867063+0000","last_change":"2024-09-13T18:35:45.869650+0000","last_active":"2024-09-13T18:35:46.867063+0000","last_peered":"2024-09-13T18:35:46.867063+0000","last_clean":"2024-09-13T18:35:46.867063+0000","last_became_active":"2024-09-13T18:35:45.869324+0000","last_became_peered":"2024-09-13T18:35:45.869324+0000","last_unstale":"2024-09-13T18:35:46.867063+0000","last_undegraded":"2024-09-13T18:35:46.867063+0000","last_fullsized":"2024-09-13T18:35:46.867063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:59.343927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750666+0000","last_change":"2024-09-13T18:35:45.868766+0000","last_active":"2024-09-13T18:35:47.750666+0000","last_peered":"2024-09-13T18:35:47.750666+0000","last_clean":"2024-09-13T18:35:47.750666+0000","last_became_active":"2024-09-13T18:35:45.868529+0000","last_became_peered":"2024-09-13T18:35:45.868529+0000","last_unstale":"2024-09-13T18:35:47.750666+0000","last_undegraded":"2024-09-13T18:35:47.750666+0000","last_fullsized":"2024-09-13T18:35:47.750666+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:30.257132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751546+0000","last_change":"2024-09-13T18:35:45.864445+0000","last_active":"2024-09-13T18:35:47.751546+0000","last_peered":"2024-09-13T18:35:47.751546+0000","last_clean":"2024-09-13T18:35:47.751546+0000","last_became_active":"2024-09-13T18:35:45.864156+0000","last_became_peered":"2024-09-13T18:35:45.864156+0000","last_unstale":"2024-09-13T18:35:47.751546+0000","last_undegraded":"2024-09-13T18:35:47.751546+0000","last_fullsized":"2024-09-13T18:35:47.751546+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:44.606188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751482+0000","last_change":"2024-09-13T18:35:45.871414+0000","last_active":"2024-09-13T18:35:47.751482+0000","last_peered":"2024-09-13T18:35:47.751482+0000","last_clean":"2024-09-13T18:35:47.751482+0000","last_became_active":"2024-09-13T18:35:45.871152+0000","last_became_peered":"2024-09-13T18:35:45.871152+0000","last_unstale":"2024-09-13T18:35:47.751482+0000","last_undegraded":"2024-09-13T18:35:47.751482+0000","last_fullsized":"2024-09-13T18:35:47.751482+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:55.692347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867608+0000","last_change":"2024-09-13T18:35:45.873614+0000","last_active":"2024-09-13T18:35:46.867608+0000","last_peered":"2024-09-13T18:35:46.867608+0000","last_clean":"2024-09-13T18:35:46.867608+0000","last_became_active":"2024-09-13T18:35:45.872765+0000","last_became_peered":"2024-09-13T18:35:45.872765+0000","last_unstale":"2024-09-13T18:35:46.867608+0000","last_undegraded":"2024-09-13T18:35:46.867608+0000","last_fullsized":"2024-09-13T18:35:46.867608+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:03.036681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.866584+0000","last_change":"2024-09-13T18:35:45.876738+0000","last_active":"2024-09-13T18:35:46.866584+0000","last_peered":"2024-09-13T18:35:46.866584+0000","last_clean":"2024-09-13T18:35:46.866584+0000","last_became_active":"2024-09-13T18:35:45.876477+0000","last_became_peered":"2024-09-13T18:35:45.876477+0000","last_unstale":"2024-09-13T18:35:46.866584+0000","last_undegraded":"2024-09-13T18:35:46.866584+0000","last_fullsized":"2024-09-13T18:35:46.866584+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:41.431194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751968+0000","last_change":"2024-09-13T18:35:45.866671+0000","last_active":"2024-09-13T18:35:47.751968+0000","last_peered":"2024-09-13T18:35:47.751968+0000","last_clean":"2024-09-13T18:35:47.751968+0000","last_became_active":"2024-09-13T18:35:45.866407+0000","last_became_peered":"2024-09-13T18:35:45.866407+0000","last_unstale":"2024-09-13T18:35:47.751968+0000","last_undegraded":"2024-09-13T18:35:47.751968+0000","last_fullsized":"2024-09-13T18:35:47.751968+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:20.347955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752289+0000","last_change":"2024-09-13T18:35:45.858753+0000","last_active":"2024-09-13T18:35:47.752289+0000","last_peered":"2024-09-13T18:35:47.752289+0000","last_clean":"2024-09-13T18:35:47.752289+0000","last_became_active":"2024-09-13T18:35:45.858450+0000","last_became_peered":"2024-09-13T18:35:45.858450+0000","last_unstale":"2024-09-13T18:35:47.752289+0000","last_undegraded":"2024-09-13T18:35:47.752289+0000","last_fullsized":"2024-09-13T18:35:47.752289+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:43.230611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.753423+0000","last_change":"2024-09-13T18:35:45.875391+0000","last_active":"2024-09-13T18:35:47.753423+0000","last_peered":"2024-09-13T18:35:47.753423+0000","last_clean":"2024-09-13T18:35:47.753423+0000","last_became_active":"2024-09-13T18:35:45.875132+0000","last_became_peered":"2024-09-13T18:35:45.875132+0000","last_unstale":"2024-09-13T18:35:47.753423+0000","last_undegraded":"2024-09-13T18:35:47.753423+0000","last_fullsized":"2024-09-13T18:35:47.753423+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:36.122059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752893+0000","last_change":"2024-09-13T18:35:45.874261+0000","last_active":"2024-09-13T18:35:47.752893+0000","last_peered":"2024-09-13T18:35:47.752893+0000","last_clean":"2024-09-13T18:35:47.752893+0000","last_became_active":"2024-09-13T18:35:45.873999+0000","last_became_peered":"2024-09-13T18:35:45.873999+0000","last_unstale":"2024-09-13T18:35:47.752893+0000","last_undegraded":"2024-09-13T18:35:47.752893+0000","last_fullsized":"2024-09-13T18:35:47.752893+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:15.023455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.753057+0000","last_change":"2024-09-13T18:35:45.876353+0000","last_active":"2024-09-13T18:35:47.753057+0000","last_peered":"2024-09-13T18:35:47.753057+0000","last_clean":"2024-09-13T18:35:47.753057+0000","last_became_active":"2024-09-13T18:35:45.876112+0000","last_became_peered":"2024-09-13T18:35:45.876112+0000","last_unstale":"2024-09-13T18:35:47.753057+0000","last_undegraded":"2024-09-13T18:35:47.753057+0000","last_fullsized":"2024-09-13T18:35:47.753057+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:51.309657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752189+0000","last_change":"2024-09-13T18:35:45.864039+0000","last_active":"2024-09-13T18:35:47.752189+0000","last_peered":"2024-09-13T18:35:47.752189+0000","last_clean":"2024-09-13T18:35:47.752189+0000","last_became_active":"2024-09-13T18:35:45.863779+0000","last_became_peered":"2024-09-13T18:35:45.863779+0000","last_unstale":"2024-09-13T18:35:47.752189+0000","last_undegraded":"2024-09-13T18:35:47.752189+0000","last_fullsized":"2024-09-13T18:35:47.752189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:59.894861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752645+0000","last_change":"2024-09-13T18:35:45.857417+0000","last_active":"2024-09-13T18:35:47.752645+0000","last_peered":"2024-09-13T18:35:47.752645+0000","last_clean":"2024-09-13T18:35:47.752645+0000","last_became_active":"2024-09-13T18:35:45.856926+0000","last_became_peered":"2024-09-13T18:35:45.856926+0000","last_unstale":"2024-09-13T18:35:47.752645+0000","last_undegraded":"2024-09-13T18:35:47.752645+0000","last_fullsized":"2024-09-13T18:35:47.752645+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:38.812584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867538+0000","last_change":"2024-09-13T18:35:45.878207+0000","last_active":"2024-09-13T18:35:46.867538+0000","last_peered":"2024-09-13T18:35:46.867538+0000","last_clean":"2024-09-13T18:35:46.867538+0000","last_became_active":"2024-09-13T18:35:45.877783+0000","last_became_peered":"2024-09-13T18:35:45.877783+0000","last_unstale":"2024-09-13T18:35:46.867538+0000","last_undegraded":"2024-09-13T18:35:46.867538+0000","last_fullsized":"2024-09-13T18:35:46.867538+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:20.347955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867716+0000","last_change":"2024-09-13T18:35:45.877134+0000","last_active":"2024-09-13T18:35:46.867716+0000","last_peered":"2024-09-13T18:35:46.867716+0000","last_clean":"2024-09-13T18:35:46.867716+0000","last_became_active":"2024-09-13T18:35:45.876866+0000","last_became_peered":"2024-09-13T18:35:45.876866+0000","last_unstale":"2024-09-13T18:35:46.867716+0000","last_undegraded":"2024-09-13T18:35:46.867716+0000","last_fullsized":"2024-09-13T18:35:46.867716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:40.180096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"77'4","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868203+0000","last_change":"2024-09-13T18:35:45.472260+0000","last_active":"2024-09-13T18:35:46.868203+0000","last_peered":"2024-09-13T18:35:46.868203+0000","last_clean":"2024-09-13T18:35:46.868203+0000","last_became_active":"2024-09-13T18:35:45.472013+0000","last_became_peered":"2024-09-13T18:35:45.472013+0000","last_unstale":"2024-09-13T18:35:46.868203+0000","last_undegraded":"2024-09-13T18:35:46.868203+0000","last_fullsized":"2024-09-13T18:35:46.868203+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:50.687732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751492+0000","last_change":"2024-09-13T18:35:45.877758+0000","last_active":"2024-09-13T18:35:47.751492+0000","last_peered":"2024-09-13T18:35:47.751492+0000","last_clean":"2024-09-13T18:35:47.751492+0000","last_became_active":"2024-09-13T18:35:45.877517+0000","last_became_peered":"2024-09-13T18:35:45.877517+0000","last_unstale":"2024-09-13T18:35:47.751492+0000","last_undegraded":"2024-09-13T18:35:47.751492+0000","last_fullsized":"2024-09-13T18:35:47.751492+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:00.410986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"77'1","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752378+0000","last_change":"2024-09-13T18:35:45.475090+0000","last_active":"2024-09-13T18:35:47.752378+0000","last_peered":"2024-09-13T18:35:47.752378+0000","last_clean":"2024-09-13T18:35:47.752378+0000","last_became_active":"2024-09-13T18:35:45.474539+0000","last_became_peered":"2024-09-13T18:35:45.474539+0000","last_unstale":"2024-09-13T18:35:47.752378+0000","last_undegraded":"2024-09-13T18:35:47.752378+0000","last_fullsized":"2024-09-13T18:35:47.752378+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:54.688796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868155+0000","last_change":"2024-09-13T18:35:45.874995+0000","last_active":"2024-09-13T18:35:46.868155+0000","last_peered":"2024-09-13T18:35:46.868155+0000","last_clean":"2024-09-13T18:35:46.868155+0000","last_became_active":"2024-09-13T18:35:45.874551+0000","last_became_peered":"2024-09-13T18:35:45.874551+0000","last_unstale":"2024-09-13T18:35:46.868155+0000","last_undegraded":"2024-09-13T18:35:46.868155+0000","last_fullsized":"2024-09-13T18:35:46.868155+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:55.692347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"77'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751893+0000","last_change":"2024-09-13T18:35:45.479623+0000","last_active":"2024-09-13T18:35:47.751893+0000","last_peered":"2024-09-13T18:35:47.751893+0000","last_clean":"2024-09-13T18:35:47.751893+0000","last_became_active":"2024-09-13T18:35:45.478940+0000","last_became_peered":"2024-09-13T18:35:45.478940+0000","last_unstale":"2024-09-13T18:35:47.751893+0000","last_undegraded":"2024-09-13T18:35:47.751893+0000","last_fullsized":"2024-09-13T18:35:47.751893+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:17.606974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867970+0000","last_change":"2024-09-13T18:35:45.876410+0000","last_active":"2024-09-13T18:35:46.867970+0000","last_peered":"2024-09-13T18:35:46.867970+0000","last_clean":"2024-09-13T18:35:46.867970+0000","last_became_active":"2024-09-13T18:35:45.875838+0000","last_became_peered":"2024-09-13T18:35:45.875838+0000","last_unstale":"2024-09-13T18:35:46.867970+0000","last_undegraded":"2024-09-13T18:35:46.867970+0000","last_fullsized":"2024-09-13T18:35:46.867970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:54.586051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"77'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868363+0000","last_change":"2024-09-13T18:35:45.475413+0000","last_active":"2024-09-13T18:35:46.868363+0000","last_peered":"2024-09-13T18:35:46.868363+0000","last_clean":"2024-09-13T18:35:46.868363+0000","last_became_active":"2024-09-13T18:35:45.472574+0000","last_became_peered":"2024-09-13T18:35:45.472574+0000","last_unstale":"2024-09-13T18:35:46.868363+0000","last_undegraded":"2024-09-13T18:35:46.868363+0000","last_fullsized":"2024-09-13T18:35:46.868363+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:33.355019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752424+0000","last_change":"2024-09-13T18:35:45.878094+0000","last_active":"2024-09-13T18:35:47.752424+0000","last_peered":"2024-09-13T18:35:47.752424+0000","last_clean":"2024-09-13T18:35:47.752424+0000","last_became_active":"2024-09-13T18:35:45.877814+0000","last_became_peered":"2024-09-13T18:35:45.877814+0000","last_unstale":"2024-09-13T18:35:47.752424+0000","last_undegraded":"2024-09-13T18:35:47.752424+0000","last_fullsized":"2024-09-13T18:35:47.752424+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:55.000037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"77'1","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.753241+0000","last_change":"2024-09-13T18:35:45.471479+0000","last_active":"2024-09-13T18:35:47.753241+0000","last_peered":"2024-09-13T18:35:47.753241+0000","last_clean":"2024-09-13T18:35:47.753241+0000","last_became_active":"2024-09-13T18:35:45.470872+0000","last_became_peered":"2024-09-13T18:35:45.470872+0000","last_unstale":"2024-09-13T18:35:47.753241+0000","last_undegraded":"2024-09-13T18:35:47.753241+0000","last_fullsized":"2024-09-13T18:35:47.753241+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:09.491088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751812+0000","last_change":"2024-09-13T18:35:45.870694+0000","last_active":"2024-09-13T18:35:47.751812+0000","last_peered":"2024-09-13T18:35:47.751812+0000","last_clean":"2024-09-13T18:35:47.751812+0000","last_became_active":"2024-09-13T18:35:45.870440+0000","last_became_peered":"2024-09-13T18:35:45.870440+0000","last_unstale":"2024-09-13T18:35:47.751812+0000","last_undegraded":"2024-09-13T18:35:47.751812+0000","last_fullsized":"2024-09-13T18:35:47.751812+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:59.343927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"77'1","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867336+0000","last_change":"2024-09-13T18:35:45.476256+0000","last_active":"2024-09-13T18:35:46.867336+0000","last_peered":"2024-09-13T18:35:46.867336+0000","last_clean":"2024-09-13T18:35:46.867336+0000","last_became_active":"2024-09-13T18:35:45.475700+0000","last_became_peered":"2024-09-13T18:35:45.475700+0000","last_unstale":"2024-09-13T18:35:46.867336+0000","last_undegraded":"2024-09-13T18:35:46.867336+0000","last_fullsized":"2024-09-13T18:35:46.867336+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:38.409813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751595+0000","last_change":"2024-09-13T18:35:45.866791+0000","last_active":"2024-09-13T18:35:47.751595+0000","last_peered":"2024-09-13T18:35:47.751595+0000","last_clean":"2024-09-13T18:35:47.751595+0000","last_became_active":"2024-09-13T18:35:45.866500+0000","last_became_peered":"2024-09-13T18:35:45.866500+0000","last_unstale":"2024-09-13T18:35:47.751595+0000","last_undegraded":"2024-09-13T18:35:47.751595+0000","last_fullsized":"2024-09-13T18:35:47.751595+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:34.358571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.862182+0000","last_change":"2024-09-13T18:35:45.474040+0000","last_active":"2024-09-13T18:35:46.862182+0000","last_peered":"2024-09-13T18:35:46.862182+0000","last_clean":"2024-09-13T18:35:46.862182+0000","last_became_active":"2024-09-13T18:35:45.473789+0000","last_became_peered":"2024-09-13T18:35:45.473789+0000","last_unstale":"2024-09-13T18:35:46.862182+0000","last_undegraded":"2024-09-13T18:35:46.862182+0000","last_fullsized":"2024-09-13T18:35:46.862182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:35.507796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750302+0000","last_change":"2024-09-13T18:35:45.866054+0000","last_active":"2024-09-13T18:35:47.750302+0000","last_peered":"2024-09-13T18:35:47.750302+0000","last_clean":"2024-09-13T18:35:47.750302+0000","last_became_active":"2024-09-13T18:35:45.865813+0000","last_became_peered":"2024-09-13T18:35:45.865813+0000","last_unstale":"2024-09-13T18:35:47.750302+0000","last_undegraded":"2024-09-13T18:35:47.750302+0000","last_fullsized":"2024-09-13T18:35:47.750302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:38.812584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751771+0000","last_change":"2024-09-13T18:35:45.471039+0000","last_active":"2024-09-13T18:35:47.751771+0000","last_peered":"2024-09-13T18:35:47.751771+0000","last_clean":"2024-09-13T18:35:47.751771+0000","last_became_active":"2024-09-13T18:35:45.470385+0000","last_became_peered":"2024-09-13T18:35:45.470385+0000","last_unstale":"2024-09-13T18:35:47.751771+0000","last_undegraded":"2024-09-13T18:35:47.751771+0000","last_fullsized":"2024-09-13T18:35:47.751771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:01.737904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752519+0000","last_change":"2024-09-13T18:35:45.865766+0000","last_active":"2024-09-13T18:35:47.752519+0000","last_peered":"2024-09-13T18:35:47.752519+0000","last_clean":"2024-09-13T18:35:47.752519+0000","last_became_active":"2024-09-13T18:35:45.865502+0000","last_became_peered":"2024-09-13T18:35:45.865502+0000","last_unstale":"2024-09-13T18:35:47.752519+0000","last_undegraded":"2024-09-13T18:35:47.752519+0000","last_fullsized":"2024-09-13T18:35:47.752519+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:26.729086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752093+0000","last_change":"2024-09-13T18:35:45.473795+0000","last_active":"2024-09-13T18:35:47.752093+0000","last_peered":"2024-09-13T18:35:47.752093+0000","last_clean":"2024-09-13T18:35:47.752093+0000","last_became_active":"2024-09-13T18:35:45.473538+0000","last_became_peered":"2024-09-13T18:35:45.473538+0000","last_unstale":"2024-09-13T18:35:47.752093+0000","last_undegraded":"2024-09-13T18:35:47.752093+0000","last_fullsized":"2024-09-13T18:35:47.752093+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.189564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868027+0000","last_change":"2024-09-13T18:35:45.878966+0000","last_active":"2024-09-13T18:35:46.868027+0000","last_peered":"2024-09-13T18:35:46.868027+0000","last_clean":"2024-09-13T18:35:46.868027+0000","last_became_active":"2024-09-13T18:35:45.878641+0000","last_became_peered":"2024-09-13T18:35:45.878641+0000","last_unstale":"2024-09-13T18:35:46.868027+0000","last_undegraded":"2024-09-13T18:35:46.868027+0000","last_fullsized":"2024-09-13T18:35:46.868027+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:09.286582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867569+0000","last_change":"2024-09-13T18:35:45.476004+0000","last_active":"2024-09-13T18:35:46.867569+0000","last_peered":"2024-09-13T18:35:46.867569+0000","last_clean":"2024-09-13T18:35:46.867569+0000","last_became_active":"2024-09-13T18:35:45.475714+0000","last_became_peered":"2024-09-13T18:35:45.475714+0000","last_unstale":"2024-09-13T18:35:46.867569+0000","last_undegraded":"2024-09-13T18:35:46.867569+0000","last_fullsized":"2024-09-13T18:35:46.867569+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:31.562480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868345+0000","last_change":"2024-09-13T18:35:45.865035+0000","last_active":"2024-09-13T18:35:46.868345+0000","last_peered":"2024-09-13T18:35:46.868345+0000","last_clean":"2024-09-13T18:35:46.868345+0000","last_became_active":"2024-09-13T18:35:45.864789+0000","last_became_peered":"2024-09-13T18:35:45.864789+0000","last_unstale":"2024-09-13T18:35:46.868345+0000","last_undegraded":"2024-09-13T18:35:46.868345+0000","last_fullsized":"2024-09-13T18:35:46.868345+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:30.257132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"77'3","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.753574+0000","last_change":"2024-09-13T18:35:45.470804+0000","last_active":"2024-09-13T18:35:47.753574+0000","last_peered":"2024-09-13T18:35:47.753574+0000","last_clean":"2024-09-13T18:35:47.753574+0000","last_became_active":"2024-09-13T18:35:45.470525+0000","last_became_peered":"2024-09-13T18:35:45.470525+0000","last_unstale":"2024-09-13T18:35:47.753574+0000","last_undegraded":"2024-09-13T18:35:47.753574+0000","last_fullsized":"2024-09-13T18:35:47.753574+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:45.615730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750932+0000","last_change":"2024-09-13T18:35:45.869421+0000","last_active":"2024-09-13T18:35:47.750932+0000","last_peered":"2024-09-13T18:35:47.750932+0000","last_clean":"2024-09-13T18:35:47.750932+0000","last_became_active":"2024-09-13T18:35:45.868871+0000","last_became_peered":"2024-09-13T18:35:45.868871+0000","last_unstale":"2024-09-13T18:35:47.750932+0000","last_undegraded":"2024-09-13T18:35:47.750932+0000","last_fullsized":"2024-09-13T18:35:47.750932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:51.181872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"77'6","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.863213+0000","last_change":"2024-09-13T18:35:45.474787+0000","last_active":"2024-09-13T18:35:46.863213+0000","last_peered":"2024-09-13T18:35:46.863213+0000","last_clean":"2024-09-13T18:35:46.863213+0000","last_became_active":"2024-09-13T18:35:45.474485+0000","last_became_peered":"2024-09-13T18:35:45.474485+0000","last_unstale":"2024-09-13T18:35:46.863213+0000","last_undegraded":"2024-09-13T18:35:46.863213+0000","last_fullsized":"2024-09-13T18:35:46.863213+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:17.606974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867409+0000","last_change":"2024-09-13T18:35:45.873510+0000","last_active":"2024-09-13T18:35:46.867409+0000","last_peered":"2024-09-13T18:35:46.867409+0000","last_clean":"2024-09-13T18:35:46.867409+0000","last_became_active":"2024-09-13T18:35:45.873219+0000","last_became_peered":"2024-09-13T18:35:45.873219+0000","last_unstale":"2024-09-13T18:35:46.867409+0000","last_undegraded":"2024-09-13T18:35:46.867409+0000","last_fullsized":"2024-09-13T18:35:46.867409+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:13.815647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"77'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.862913+0000","last_change":"2024-09-13T18:35:45.469363+0000","last_active":"2024-09-13T18:35:46.862913+0000","last_peered":"2024-09-13T18:35:46.862913+0000","last_clean":"2024-09-13T18:35:46.862913+0000","last_became_active":"2024-09-13T18:35:45.469041+0000","last_became_peered":"2024-09-13T18:35:45.469041+0000","last_unstale":"2024-09-13T18:35:46.862913+0000","last_undegraded":"2024-09-13T18:35:46.862913+0000","last_fullsized":"2024-09-13T18:35:46.862913+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:16.170228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.753079+0000","last_change":"2024-09-13T18:35:45.871494+0000","last_active":"2024-09-13T18:35:47.753079+0000","last_peered":"2024-09-13T18:35:47.753079+0000","last_clean":"2024-09-13T18:35:47.753079+0000","last_became_active":"2024-09-13T18:35:45.871221+0000","last_became_peered":"2024-09-13T18:35:45.871221+0000","last_unstale":"2024-09-13T18:35:47.753079+0000","last_undegraded":"2024-09-13T18:35:47.753079+0000","last_fullsized":"2024-09-13T18:35:47.753079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:06.327113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867491+0000","last_change":"2024-09-13T18:35:45.476416+0000","last_active":"2024-09-13T18:35:46.867491+0000","last_peered":"2024-09-13T18:35:46.867491+0000","last_clean":"2024-09-13T18:35:46.867491+0000","last_became_active":"2024-09-13T18:35:45.476022+0000","last_became_peered":"2024-09-13T18:35:45.476022+0000","last_unstale":"2024-09-13T18:35:46.867491+0000","last_undegraded":"2024-09-13T18:35:46.867491+0000","last_fullsized":"2024-09-13T18:35:46.867491+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:55.012378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750111+0000","last_change":"2024-09-13T18:35:45.864653+0000","last_active":"2024-09-13T18:35:47.750111+0000","last_peered":"2024-09-13T18:35:47.750111+0000","last_clean":"2024-09-13T18:35:47.750111+0000","last_became_active":"2024-09-13T18:35:45.864318+0000","last_became_peered":"2024-09-13T18:35:45.864318+0000","last_unstale":"2024-09-13T18:35:47.750111+0000","last_undegraded":"2024-09-13T18:35:47.750111+0000","last_fullsized":"2024-09-13T18:35:47.750111+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:26.729086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752532+0000","last_change":"2024-09-13T18:35:45.467618+0000","last_active":"2024-09-13T18:35:47.752532+0000","last_peered":"2024-09-13T18:35:47.752532+0000","last_clean":"2024-09-13T18:35:47.752532+0000","last_became_active":"2024-09-13T18:35:45.467320+0000","last_became_peered":"2024-09-13T18:35:45.467320+0000","last_unstale":"2024-09-13T18:35:47.752532+0000","last_undegraded":"2024-09-13T18:35:47.752532+0000","last_fullsized":"2024-09-13T18:35:47.752532+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:43.233122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751905+0000","last_change":"2024-09-13T18:35:45.875808+0000","last_active":"2024-09-13T18:35:47.751905+0000","last_peered":"2024-09-13T18:35:47.751905+0000","last_clean":"2024-09-13T18:35:47.751905+0000","last_became_active":"2024-09-13T18:35:45.875530+0000","last_became_peered":"2024-09-13T18:35:45.875530+0000","last_unstale":"2024-09-13T18:35:47.751905+0000","last_undegraded":"2024-09-13T18:35:47.751905+0000","last_fullsized":"2024-09-13T18:35:47.751905+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:37.987527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"77'8","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751160+0000","last_change":"2024-09-13T18:35:45.473402+0000","last_active":"2024-09-13T18:35:47.751160+0000","last_peered":"2024-09-13T18:35:47.751160+0000","last_clean":"2024-09-13T18:35:47.751160+0000","last_became_active":"2024-09-13T18:35:45.473008+0000","last_became_peered":"2024-09-13T18:35:45.473008+0000","last_unstale":"2024-09-13T18:35:47.751160+0000","last_undegraded":"2024-09-13T18:35:47.751160+0000","last_fullsized":"2024-09-13T18:35:47.751160+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:38.409813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751858+0000","last_change":"2024-09-13T18:35:45.871474+0000","last_active":"2024-09-13T18:35:47.751858+0000","last_peered":"2024-09-13T18:35:47.751858+0000","last_clean":"2024-09-13T18:35:47.751858+0000","last_became_active":"2024-09-13T18:35:45.871217+0000","last_became_peered":"2024-09-13T18:35:45.871217+0000","last_unstale":"2024-09-13T18:35:47.751858+0000","last_undegraded":"2024-09-13T18:35:47.751858+0000","last_fullsized":"2024-09-13T18:35:47.751858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:49.973795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"77'1","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868257+0000","last_change":"2024-09-13T18:35:45.478297+0000","last_active":"2024-09-13T18:35:46.868257+0000","last_peered":"2024-09-13T18:35:46.868257+0000","last_clean":"2024-09-13T18:35:46.868257+0000","last_became_active":"2024-09-13T18:35:45.478053+0000","last_became_peered":"2024-09-13T18:35:45.478053+0000","last_unstale":"2024-09-13T18:35:46.868257+0000","last_undegraded":"2024-09-13T18:35:46.868257+0000","last_fullsized":"2024-09-13T18:35:46.868257+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:17.606974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868129+0000","last_change":"2024-09-13T18:35:45.876572+0000","last_active":"2024-09-13T18:35:46.868129+0000","last_peered":"2024-09-13T18:35:46.868129+0000","last_clean":"2024-09-13T18:35:46.868129+0000","last_became_active":"2024-09-13T18:35:45.875417+0000","last_became_peered":"2024-09-13T18:35:45.875417+0000","last_unstale":"2024-09-13T18:35:46.868129+0000","last_undegraded":"2024-09-13T18:35:46.868129+0000","last_fullsized":"2024-09-13T18:35:46.868129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:43.880737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"77'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752083+0000","last_change":"2024-09-13T18:35:45.479816+0000","last_active":"2024-09-13T18:35:47.752083+0000","last_peered":"2024-09-13T18:35:47.752083+0000","last_clean":"2024-09-13T18:35:47.752083+0000","last_became_active":"2024-09-13T18:35:45.479485+0000","last_became_peered":"2024-09-13T18:35:45.479485+0000","last_unstale":"2024-09-13T18:35:47.752083+0000","last_undegraded":"2024-09-13T18:35:47.752083+0000","last_fullsized":"2024-09-13T18:35:47.752083+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:07.537701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.863074+0000","last_change":"2024-09-13T18:35:45.873901+0000","last_active":"2024-09-13T18:35:46.863074+0000","last_peered":"2024-09-13T18:35:46.863074+0000","last_clean":"2024-09-13T18:35:46.863074+0000","last_became_active":"2024-09-13T18:35:45.873394+0000","last_became_peered":"2024-09-13T18:35:45.873394+0000","last_unstale":"2024-09-13T18:35:46.863074+0000","last_undegraded":"2024-09-13T18:35:46.863074+0000","last_fullsized":"2024-09-13T18:35:46.863074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:48.183275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"77'1","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867271+0000","last_change":"2024-09-13T18:35:45.478481+0000","last_active":"2024-09-13T18:35:46.867271+0000","last_peered":"2024-09-13T18:35:46.867271+0000","last_clean":"2024-09-13T18:35:46.867271+0000","last_became_active":"2024-09-13T18:35:45.478253+0000","last_became_peered":"2024-09-13T18:35:45.478253+0000","last_unstale":"2024-09-13T18:35:46.867271+0000","last_undegraded":"2024-09-13T18:35:46.867271+0000","last_fullsized":"2024-09-13T18:35:46.867271+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:21.109027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751126+0000","last_change":"2024-09-13T18:35:45.866854+0000","last_active":"2024-09-13T18:35:47.751126+0000","last_peered":"2024-09-13T18:35:47.751126+0000","last_clean":"2024-09-13T18:35:47.751126+0000","last_became_active":"2024-09-13T18:35:45.866582+0000","last_became_peered":"2024-09-13T18:35:45.866582+0000","last_unstale":"2024-09-13T18:35:47.751126+0000","last_undegraded":"2024-09-13T18:35:47.751126+0000","last_fullsized":"2024-09-13T18:35:47.751126+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:09.552413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868315+0000","last_change":"2024-09-13T18:35:45.474320+0000","last_active":"2024-09-13T18:35:46.868315+0000","last_peered":"2024-09-13T18:35:46.868315+0000","last_clean":"2024-09-13T18:35:46.868315+0000","last_became_active":"2024-09-13T18:35:45.474063+0000","last_became_peered":"2024-09-13T18:35:45.474063+0000","last_unstale":"2024-09-13T18:35:46.868315+0000","last_undegraded":"2024-09-13T18:35:46.868315+0000","last_fullsized":"2024-09-13T18:35:46.868315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:31.964679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.753069+0000","last_change":"2024-09-13T18:35:45.875977+0000","last_active":"2024-09-13T18:35:47.753069+0000","last_peered":"2024-09-13T18:35:47.753069+0000","last_clean":"2024-09-13T18:35:47.753069+0000","last_became_active":"2024-09-13T18:35:45.875677+0000","last_became_peered":"2024-09-13T18:35:45.875677+0000","last_unstale":"2024-09-13T18:35:47.753069+0000","last_undegraded":"2024-09-13T18:35:47.753069+0000","last_fullsized":"2024-09-13T18:35:47.753069+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:40:45.913103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867627+0000","last_change":"2024-09-13T18:35:45.472200+0000","last_active":"2024-09-13T18:35:46.867627+0000","last_peered":"2024-09-13T18:35:46.867627+0000","last_clean":"2024-09-13T18:35:46.867627+0000","last_became_active":"2024-09-13T18:35:45.471935+0000","last_became_peered":"2024-09-13T18:35:45.471935+0000","last_unstale":"2024-09-13T18:35:46.867627+0000","last_undegraded":"2024-09-13T18:35:46.867627+0000","last_fullsized":"2024-09-13T18:35:46.867627+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:07.537701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752441+0000","last_change":"2024-09-13T18:35:45.881555+0000","last_active":"2024-09-13T18:35:47.752441+0000","last_peered":"2024-09-13T18:35:47.752441+0000","last_clean":"2024-09-13T18:35:47.752441+0000","last_became_active":"2024-09-13T18:35:45.881253+0000","last_became_peered":"2024-09-13T18:35:45.881253+0000","last_unstale":"2024-09-13T18:35:47.752441+0000","last_undegraded":"2024-09-13T18:35:47.752441+0000","last_fullsized":"2024-09-13T18:35:47.752441+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:45.677365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752673+0000","last_change":"2024-09-13T18:35:45.476046+0000","last_active":"2024-09-13T18:35:47.752673+0000","last_peered":"2024-09-13T18:35:47.752673+0000","last_clean":"2024-09-13T18:35:47.752673+0000","last_became_active":"2024-09-13T18:35:45.475714+0000","last_became_peered":"2024-09-13T18:35:45.475714+0000","last_unstale":"2024-09-13T18:35:47.752673+0000","last_undegraded":"2024-09-13T18:35:47.752673+0000","last_fullsized":"2024-09-13T18:35:47.752673+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:45.692277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752770+0000","last_change":"2024-09-13T18:35:45.880070+0000","last_active":"2024-09-13T18:35:47.752770+0000","last_peered":"2024-09-13T18:35:47.752770+0000","last_clean":"2024-09-13T18:35:47.752770+0000","last_became_active":"2024-09-13T18:35:45.879228+0000","last_became_peered":"2024-09-13T18:35:45.879228+0000","last_unstale":"2024-09-13T18:35:47.752770+0000","last_undegraded":"2024-09-13T18:35:47.752770+0000","last_fullsized":"2024-09-13T18:35:47.752770+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:43.579248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.749962+0000","last_change":"2024-09-13T18:35:45.474876+0000","last_active":"2024-09-13T18:35:47.749962+0000","last_peered":"2024-09-13T18:35:47.749962+0000","last_clean":"2024-09-13T18:35:47.749962+0000","last_became_active":"2024-09-13T18:35:45.474574+0000","last_became_peered":"2024-09-13T18:35:45.474574+0000","last_unstale":"2024-09-13T18:35:47.749962+0000","last_undegraded":"2024-09-13T18:35:47.749962+0000","last_fullsized":"2024-09-13T18:35:47.749962+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:19.344403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751932+0000","last_change":"2024-09-13T18:35:45.872962+0000","last_active":"2024-09-13T18:35:47.751932+0000","last_peered":"2024-09-13T18:35:47.751932+0000","last_clean":"2024-09-13T18:35:47.751932+0000","last_became_active":"2024-09-13T18:35:45.872642+0000","last_became_peered":"2024-09-13T18:35:45.872642+0000","last_unstale":"2024-09-13T18:35:47.751932+0000","last_undegraded":"2024-09-13T18:35:47.751932+0000","last_fullsized":"2024-09-13T18:35:47.751932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:43.230611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"77'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868311+0000","last_change":"2024-09-13T18:35:45.478020+0000","last_active":"2024-09-13T18:35:46.868311+0000","last_peered":"2024-09-13T18:35:46.868311+0000","last_clean":"2024-09-13T18:35:46.868311+0000","last_became_active":"2024-09-13T18:35:45.477089+0000","last_became_peered":"2024-09-13T18:35:45.477089+0000","last_unstale":"2024-09-13T18:35:46.868311+0000","last_undegraded":"2024-09-13T18:35:46.868311+0000","last_fullsized":"2024-09-13T18:35:46.868311+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:35.507796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752653+0000","last_change":"2024-09-13T18:35:45.871442+0000","last_active":"2024-09-13T18:35:47.752653+0000","last_peered":"2024-09-13T18:35:47.752653+0000","last_clean":"2024-09-13T18:35:47.752653+0000","last_became_active":"2024-09-13T18:35:45.871168+0000","last_became_peered":"2024-09-13T18:35:45.871168+0000","last_unstale":"2024-09-13T18:35:47.752653+0000","last_undegraded":"2024-09-13T18:35:47.752653+0000","last_fullsized":"2024-09-13T18:35:47.752653+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:07.323249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752728+0000","last_change":"2024-09-13T18:35:45.468863+0000","last_active":"2024-09-13T18:35:47.752728+0000","last_peered":"2024-09-13T18:35:47.752728+0000","last_clean":"2024-09-13T18:35:47.752728+0000","last_became_active":"2024-09-13T18:35:45.468536+0000","last_became_peered":"2024-09-13T18:35:45.468536+0000","last_unstale":"2024-09-13T18:35:47.752728+0000","last_undegraded":"2024-09-13T18:35:47.752728+0000","last_fullsized":"2024-09-13T18:35:47.752728+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:39.722520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867758+0000","last_change":"2024-09-13T18:35:45.880515+0000","last_active":"2024-09-13T18:35:46.867758+0000","last_peered":"2024-09-13T18:35:46.867758+0000","last_clean":"2024-09-13T18:35:46.867758+0000","last_became_active":"2024-09-13T18:35:45.880224+0000","last_became_peered":"2024-09-13T18:35:45.880224+0000","last_unstale":"2024-09-13T18:35:46.867758+0000","last_undegraded":"2024-09-13T18:35:46.867758+0000","last_fullsized":"2024-09-13T18:35:46.867758+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:41.900603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751246+0000","last_change":"2024-09-13T18:35:45.469580+0000","last_active":"2024-09-13T18:35:47.751246+0000","last_peered":"2024-09-13T18:35:47.751246+0000","last_clean":"2024-09-13T18:35:47.751246+0000","last_became_active":"2024-09-13T18:35:45.468979+0000","last_became_peered":"2024-09-13T18:35:45.468979+0000","last_unstale":"2024-09-13T18:35:47.751246+0000","last_undegraded":"2024-09-13T18:35:47.751246+0000","last_fullsized":"2024-09-13T18:35:47.751246+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:01.152777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868019+0000","last_change":"2024-09-13T18:35:45.872941+0000","last_active":"2024-09-13T18:35:46.868019+0000","last_peered":"2024-09-13T18:35:46.868019+0000","last_clean":"2024-09-13T18:35:46.868019+0000","last_became_active":"2024-09-13T18:35:45.872656+0000","last_became_peered":"2024-09-13T18:35:45.872656+0000","last_unstale":"2024-09-13T18:35:46.868019+0000","last_undegraded":"2024-09-13T18:35:46.868019+0000","last_fullsized":"2024-09-13T18:35:46.868019+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:10.494639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751803+0000","last_change":"2024-09-13T18:35:45.475279+0000","last_active":"2024-09-13T18:35:47.751803+0000","last_peered":"2024-09-13T18:35:47.751803+0000","last_clean":"2024-09-13T18:35:47.751803+0000","last_became_active":"2024-09-13T18:35:45.475006+0000","last_became_peered":"2024-09-13T18:35:45.475006+0000","last_unstale":"2024-09-13T18:35:47.751803+0000","last_undegraded":"2024-09-13T18:35:47.751803+0000","last_fullsized":"2024-09-13T18:35:47.751803+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:48.970243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751596+0000","last_change":"2024-09-13T18:35:45.878210+0000","last_active":"2024-09-13T18:35:47.751596+0000","last_peered":"2024-09-13T18:35:47.751596+0000","last_clean":"2024-09-13T18:35:47.751596+0000","last_became_active":"2024-09-13T18:35:45.877953+0000","last_became_peered":"2024-09-13T18:35:45.877953+0000","last_unstale":"2024-09-13T18:35:47.751596+0000","last_undegraded":"2024-09-13T18:35:47.751596+0000","last_fullsized":"2024-09-13T18:35:47.751596+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:28.328066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750912+0000","last_change":"2024-09-13T18:35:45.472124+0000","last_active":"2024-09-13T18:35:47.750912+0000","last_peered":"2024-09-13T18:35:47.750912+0000","last_clean":"2024-09-13T18:35:47.750912+0000","last_became_active":"2024-09-13T18:35:45.471924+0000","last_became_peered":"2024-09-13T18:35:45.471924+0000","last_unstale":"2024-09-13T18:35:47.750912+0000","last_undegraded":"2024-09-13T18:35:47.750912+0000","last_fullsized":"2024-09-13T18:35:47.750912+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:51.427343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867324+0000","last_change":"2024-09-13T18:35:45.874081+0000","last_active":"2024-09-13T18:35:46.867324+0000","last_peered":"2024-09-13T18:35:46.867324+0000","last_clean":"2024-09-13T18:35:46.867324+0000","last_became_active":"2024-09-13T18:35:45.871264+0000","last_became_peered":"2024-09-13T18:35:45.871264+0000","last_unstale":"2024-09-13T18:35:46.867324+0000","last_undegraded":"2024-09-13T18:35:46.867324+0000","last_fullsized":"2024-09-13T18:35:46.867324+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:49.973795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.862414+0000","last_change":"2024-09-13T18:35:45.473298+0000","last_active":"2024-09-13T18:35:46.862414+0000","last_peered":"2024-09-13T18:35:46.862414+0000","last_clean":"2024-09-13T18:35:46.862414+0000","last_became_active":"2024-09-13T18:35:45.473004+0000","last_became_peered":"2024-09-13T18:35:45.473004+0000","last_unstale":"2024-09-13T18:35:46.862414+0000","last_undegraded":"2024-09-13T18:35:46.862414+0000","last_fullsized":"2024-09-13T18:35:46.862414+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:48.859206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.862302+0000","last_change":"2024-09-13T18:35:45.876925+0000","last_active":"2024-09-13T18:35:46.862302+0000","last_peered":"2024-09-13T18:35:46.862302+0000","last_clean":"2024-09-13T18:35:46.862302+0000","last_became_active":"2024-09-13T18:35:45.876686+0000","last_became_peered":"2024-09-13T18:35:45.876686+0000","last_unstale":"2024-09-13T18:35:46.862302+0000","last_undegraded":"2024-09-13T18:35:46.862302+0000","last_fullsized":"2024-09-13T18:35:46.862302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:25.249970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751182+0000","last_change":"2024-09-13T18:35:45.472921+0000","last_active":"2024-09-13T18:35:47.751182+0000","last_peered":"2024-09-13T18:35:47.751182+0000","last_clean":"2024-09-13T18:35:47.751182+0000","last_became_active":"2024-09-13T18:35:45.471185+0000","last_became_peered":"2024-09-13T18:35:45.471185+0000","last_unstale":"2024-09-13T18:35:47.751182+0000","last_undegraded":"2024-09-13T18:35:47.751182+0000","last_fullsized":"2024-09-13T18:35:47.751182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:55.012378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.866854+0000","last_change":"2024-09-13T18:35:45.878091+0000","last_active":"2024-09-13T18:35:46.866854+0000","last_peered":"2024-09-13T18:35:46.866854+0000","last_clean":"2024-09-13T18:35:46.866854+0000","last_became_active":"2024-09-13T18:35:45.877792+0000","last_became_peered":"2024-09-13T18:35:45.877792+0000","last_unstale":"2024-09-13T18:35:46.866854+0000","last_undegraded":"2024-09-13T18:35:46.866854+0000","last_fullsized":"2024-09-13T18:35:46.866854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:22.588146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867685+0000","last_change":"2024-09-13T18:35:45.472252+0000","last_active":"2024-09-13T18:35:46.867685+0000","last_peered":"2024-09-13T18:35:46.867685+0000","last_clean":"2024-09-13T18:35:46.867685+0000","last_became_active":"2024-09-13T18:35:45.471993+0000","last_became_peered":"2024-09-13T18:35:45.471993+0000","last_unstale":"2024-09-13T18:35:46.867685+0000","last_undegraded":"2024-09-13T18:35:46.867685+0000","last_fullsized":"2024-09-13T18:35:46.867685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:39.116699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752983+0000","last_change":"2024-09-13T18:35:45.881030+0000","last_active":"2024-09-13T18:35:47.752983+0000","last_peered":"2024-09-13T18:35:47.752983+0000","last_clean":"2024-09-13T18:35:47.752983+0000","last_became_active":"2024-09-13T18:35:45.879544+0000","last_became_peered":"2024-09-13T18:35:45.879544+0000","last_unstale":"2024-09-13T18:35:47.752983+0000","last_undegraded":"2024-09-13T18:35:47.752983+0000","last_fullsized":"2024-09-13T18:35:47.752983+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:31.102728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"77'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867046+0000","last_change":"2024-09-13T18:35:45.475112+0000","last_active":"2024-09-13T18:35:46.867046+0000","last_peered":"2024-09-13T18:35:46.867046+0000","last_clean":"2024-09-13T18:35:46.867046+0000","last_became_active":"2024-09-13T18:35:45.472591+0000","last_became_peered":"2024-09-13T18:35:45.472591+0000","last_unstale":"2024-09-13T18:35:46.867046+0000","last_undegraded":"2024-09-13T18:35:46.867046+0000","last_fullsized":"2024-09-13T18:35:46.867046+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:18.796198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":215,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T18:35:45.861709+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:35:45.861709+0000","last_peered":"2024-09-13T18:35:45.861709+0000","last_clean":"2024-09-13T18:35:45.861709+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:35:45.861709+0000","last_undegraded":"2024-09-13T18:35:45.861709+0000","last_fullsized":"2024-09-13T18:35:45.861709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574959,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32644,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339196,"statfs":{"total":96636764160,"available":96603336704,"internally_reserved":0,"allocated":1552384,"data_stored":999326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.38700000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.024,"5min":1.099,"15min":1.163},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75,"15min":0.79000000000000004},"min":{"1min":0.56299999999999994,"5min":0.436,"15min":0.436},"max":{"1min":1.0900000000000001,"5min":1.288,"15min":1.288},"last":0.79200000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.82299999999999995,"15min":0.874},"min":{"1min":0.59199999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.155,"5min":1.288,"15min":1.7689999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.878,"15min":0.93500000000000005},"min":{"1min":0.65200000000000002,"5min":0.54100000000000004,"15min":0.52600000000000002},"max":{"1min":1.1240000000000001,"5min":1.3009999999999999,"15min":1.6140000000000001},"last":1.175}]},{"osd":2,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.81599999999999995,"15min":0.84599999999999997},"min":{"1min":0.61899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.101,"5min":1.2270000000000001,"15min":1.3340000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.82799999999999996,"15min":0.88600000000000001},"min":{"1min":0.49299999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2390000000000001,"5min":1.524,"15min":1.6659999999999999},"last":0.86399999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.88100000000000001,"15min":0.89000000000000001},"min":{"1min":0.61399999999999999,"5min":0.54300000000000004,"15min":0.52600000000000002},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.873,"5min":0.88,"15min":0.88100000000000001},"min":{"1min":0.64500000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0940000000000001,"5min":1.486,"15min":1.486},"last":1.1990000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.86099999999999999,"15min":0.88200000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.038,"5min":1.4590000000000001,"15min":1.7290000000000001},"last":1.038},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.0129999999999999,"15min":1.0369999999999999},"min":{"1min":0.70299999999999996,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1639999999999999,"5min":1.49,"15min":1.7050000000000001},"last":1.226}]},{"osd":5,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.95699999999999996,"15min":0.95599999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.196,"5min":1.4159999999999999,"15min":1.4259999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.048,"15min":1.0509999999999999},"min":{"1min":0.73299999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2170000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.2649999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.0429999999999999,"15min":1.083},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.58099999999999996},"max":{"1min":1.212,"5min":1.4730000000000001,"15min":2.077},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0940000000000001,"15min":1.0760000000000001},"min":{"1min":0.81999999999999995,"5min":0.74399999999999999,"15min":0.69099999999999995},"max":{"1min":1.258,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.323}]}]},{"osd":6,"up_from":13,"seq":55834574961,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":958464,"data_stored":408434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78800000000000003,"15min":0.82099999999999995},"min":{"1min":0.47899999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.1799999999999999,"5min":1.22,"15min":1.2270000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.77500000000000002,"15min":0.81699999999999995},"min":{"1min":0.56599999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0880000000000001,"5min":1.2470000000000001,"15min":1.361},"last":0.70099999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.76900000000000002,"15min":0.81000000000000005},"min":{"1min":0.55900000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0389999999999999,"5min":1.266,"15min":1.266},"last":0.746},{"interface":"front","average":{"1min":0.877,"5min":0.81999999999999995,"15min":0.82499999999999996},"min":{"1min":0.52700000000000002,"5min":0.48299999999999998,"15min":0.48099999999999998},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.59299999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.79500000000000004,"15min":0.80900000000000005},"min":{"1min":0.55900000000000005,"5min":0.47399999999999998,"15min":0.46899999999999997},"max":{"1min":1.1319999999999999,"5min":1.141,"15min":1.254},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.84199999999999997,"15min":0.85899999999999999},"min":{"1min":0.60099999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.101,"5min":1.248,"15min":1.248},"last":0.94999999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.89900000000000002,"15min":0.876},"min":{"1min":0.60099999999999998,"5min":0.57599999999999996,"15min":0.52300000000000002},"max":{"1min":1.1870000000000001,"5min":1.238,"15min":1.238},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.89200000000000002,"15min":0.93600000000000005},"min":{"1min":0.68899999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1839999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.046}]},{"osd":4,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.85399999999999998,"15min":0.88300000000000001},"min":{"1min":0.68300000000000005,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1679999999999999,"5min":1.236,"15min":1.248},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.95899999999999996,"15min":0.98999999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2709999999999999,"5min":1.407,"15min":1.407},"last":0.89000000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.022,"15min":1.038},"min":{"1min":0.81699999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.226,"5min":1.355,"15min":1.355},"last":1.123},{"interface":"front","average":{"1min":0.997,"5min":0.96599999999999997,"15min":0.97999999999999998},"min":{"1min":0.67800000000000005,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2130000000000001,"5min":1.353,"15min":1.4990000000000001},"last":1.105}]},{"osd":7,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.98799999999999999,"15min":1},"min":{"1min":0.65900000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2470000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.069},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0980000000000001,"15min":1.1080000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76000000000000001},"max":{"1min":1.3120000000000001,"5min":1.367,"15min":1.3740000000000001},"last":1.1970000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574959,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":954368,"data_stored":408432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77000000000000002,"15min":0.82399999999999995},"min":{"1min":0.52200000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.147,"5min":1.3280000000000001,"15min":1.3640000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.78500000000000003,"15min":0.84999999999999998},"min":{"1min":0.60299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0980000000000001,"5min":1.2190000000000001,"15min":1.482},"last":1.048}]},{"osd":1,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.78500000000000003,"15min":0.79800000000000004},"min":{"1min":0.626,"5min":0.42499999999999999,"15min":0.40999999999999998},"max":{"1min":1.224,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.84699999999999998,"15min":0.91700000000000004},"min":{"1min":0.63300000000000001,"5min":0.50900000000000001,"15min":0.45200000000000001},"max":{"1min":1.1890000000000001,"5min":1.218,"15min":1.4850000000000001},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92000000000000004,"15min":0.94799999999999995},"min":{"1min":0.65100000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1830000000000001,"5min":1.2430000000000001,"15min":1.4179999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.92300000000000004,"15min":0.98899999999999999},"min":{"1min":0.71199999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.252,"5min":1.3029999999999999,"15min":1.4690000000000001},"last":0.83199999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.88100000000000001,"15min":0.93100000000000005},"min":{"1min":0.70499999999999996,"5min":0.55800000000000005,"15min":0.51700000000000002},"max":{"1min":1.153,"5min":1.2010000000000001,"15min":1.4510000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.88,"15min":0.93100000000000005},"min":{"1min":0.70799999999999996,"5min":0.61199999999999999,"15min":0.55300000000000005},"max":{"1min":1.1279999999999999,"5min":1.335,"15min":1.4990000000000001},"last":0.91600000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.92800000000000005,"15min":0.96099999999999997},"min":{"1min":0.60999999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.077,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.95899999999999996,"15min":1.0169999999999999},"min":{"1min":0.61799999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.143,"5min":1.3759999999999999,"15min":1.542},"last":0.94699999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.97099999999999997,"15min":1.0169999999999999},"min":{"1min":0.72399999999999998,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3129999999999999,"5min":1.4259999999999999,"15min":1.698},"last":1.079},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.107,"15min":1.1499999999999999},"min":{"1min":0.94999999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.286,"5min":1.52,"15min":1.581},"last":1.0309999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0620000000000001,"15min":1.155},"min":{"1min":0.83399999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.272,"5min":1.552,"15min":1.847},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.038,"5min":1.0600000000000001,"15min":1.125},"min":{"1min":0.81899999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.216,"5min":1.4259999999999999,"15min":1.8100000000000001},"last":1.0029999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574959,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46008,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325832,"statfs":{"total":96636764160,"available":96589651968,"internally_reserved":0,"allocated":954368,"data_stored":408412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.80900000000000005,"15min":0.88},"min":{"1min":0.54900000000000004,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.119,"5min":1.1930000000000001,"15min":1.3720000000000001},"last":0.629},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.874,"15min":0.94599999999999995},"min":{"1min":0.69399999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1479999999999999,"5min":1.3280000000000001,"15min":1.5229999999999999},"last":0.97499999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.76300000000000001,"15min":0.79500000000000004},"min":{"1min":0.68400000000000005,"5min":0.441,"15min":0.435},"max":{"1min":1.012,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.81999999999999995,"15min":0.84599999999999997},"min":{"1min":0.60499999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.88900000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78300000000000003,"15min":0.83899999999999997},"min":{"1min":0.55300000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0780000000000001,"5min":1.171,"15min":1.171},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.86199999999999999,"15min":0.85399999999999998},"min":{"1min":0.66700000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1719999999999999,"5min":1.331,"15min":1.331},"last":0.754}]},{"osd":3,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.89200000000000002,"15min":0.95699999999999996},"min":{"1min":0.68899999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.163,"5min":1.268,"15min":1.639},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.91200000000000003,"15min":0.97099999999999997},"min":{"1min":0.65000000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.119,"5min":1.2629999999999999,"15min":1.8300000000000001},"last":0.80200000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.91500000000000004,"15min":0.96399999999999997},"min":{"1min":0.65900000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.381,"5min":1.518,"15min":2.3889999999999998},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0389999999999999,"15min":1.095},"min":{"1min":0.70599999999999996,"5min":0.626,"15min":0.626},"max":{"1min":1.2969999999999999,"5min":1.375,"15min":2.0049999999999999},"last":1.012}]},{"osd":6,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.95499999999999996,"15min":0.91200000000000003},"min":{"1min":0.64300000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2829999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.075,"15min":1.0960000000000001},"min":{"1min":0.94599999999999995,"5min":0.70099999999999996,"15min":0.63500000000000001},"max":{"1min":1.423,"5min":1.4259999999999999,"15min":1.794},"last":0.99299999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.046,"15min":1.069},"min":{"1min":0.89800000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.228,"5min":1.643,"15min":1.669},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.048,"15min":1.03},"min":{"1min":0.70099999999999996,"5min":0.69499999999999995,"15min":0.61799999999999999},"max":{"1min":1.357,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.028}]}]},{"osd":3,"up_from":13,"seq":55834574962,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":958464,"data_stored":408454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61499999999999999,"15min":0.66500000000000004},"min":{"1min":0.505,"5min":0.22,"15min":0.22},"max":{"1min":0.88300000000000001,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.59899999999999998,"15min":0.65900000000000003},"min":{"1min":0.52700000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.1970000000000001},"last":1.008}]},{"osd":1,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.64800000000000002,"15min":0.69499999999999995},"min":{"1min":0.504,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0920000000000001,"5min":1.379,"15min":1.379},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.71399999999999997,"15min":0.79400000000000004},"min":{"1min":0.54800000000000004,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.042,"5min":1.397,"15min":2.0030000000000001},"last":0.66700000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.72299999999999998,"15min":0.76900000000000002},"min":{"1min":0.60799999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1970000000000001,"5min":1.3300000000000001,"15min":1.333},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.78800000000000003,"15min":0.86699999999999999},"min":{"1min":0.66400000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.2430000000000001,"5min":1.423,"15min":1.423},"last":0.96899999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.871,"15min":0.93700000000000006},"min":{"1min":0.77400000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.04,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.93500000000000005,"15min":1.016},"min":{"1min":0.74199999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.393,"5min":1.587,"15min":1.587},"last":0.91600000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.004,"15min":1.1299999999999999},"min":{"1min":0.80600000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5620000000000001,"5min":1.6200000000000001,"15min":2.2320000000000002},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.96999999999999997,"15min":1.079},"min":{"1min":0.81299999999999994,"5min":0.53900000000000003,"15min":0.53600000000000003},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.718},"last":1.133}]},{"osd":6,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.0229999999999999,"15min":1.1060000000000001},"min":{"1min":0.84299999999999997,"5min":0.496,"15min":0.496},"max":{"1min":1.3999999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.048},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.0489999999999999,"15min":1.179},"min":{"1min":0.96199999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4790000000000001,"5min":1.51,"15min":2.1819999999999999},"last":1.0720000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.01,"15min":1.083},"min":{"1min":0.871,"5min":0.624,"15min":0.624},"max":{"1min":1.2050000000000001,"5min":1.3759999999999999,"15min":1.4670000000000001},"last":1.206},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.0649999999999999,"15min":1.153},"min":{"1min":0.97599999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.444,"5min":1.548,"15min":1.5920000000000001},"last":1.113}]}]},{"osd":2,"up_from":13,"seq":55834574960,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40256,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331584,"statfs":{"total":96636764160,"available":96595542016,"internally_reserved":0,"allocated":962560,"data_stored":409906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.628,"15min":0.66000000000000003},"min":{"1min":0.498,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":1.056,"5min":1.1020000000000001,"15min":1.1919999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.69899999999999995,"15min":0.77100000000000002},"min":{"1min":0.56899999999999995,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.014,"5min":1.036,"15min":1.4370000000000001},"last":1.026}]},{"osd":1,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.64900000000000002,"15min":0.69599999999999995},"min":{"1min":0.52200000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2629999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.67200000000000004,"15min":0.72299999999999998},"min":{"1min":0.58799999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.90000000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.65500000000000003,"15min":0.67000000000000004},"min":{"1min":0.56200000000000006,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.89300000000000002,"5min":1.0489999999999999,"15min":1.1619999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.83099999999999996,"15min":0.85499999999999998},"min":{"1min":0.57999999999999996,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.248,"5min":1.3460000000000001,"15min":1.548},"last":1.1870000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.95399999999999996,"15min":0.97399999999999998},"min":{"1min":0.83599999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.272,"5min":1.653,"15min":1.653},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.998,"5min":0.95499999999999996,"15min":1.028},"min":{"1min":0.78600000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.347,"5min":1.51,"15min":2.3849999999999998},"last":1.2709999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.92200000000000004,"15min":0.92300000000000004},"min":{"1min":0.67300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2390000000000001,"5min":1.4730000000000001,"15min":1.498},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0189999999999999,"15min":1.05},"min":{"1min":0.76700000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.3260000000000001,"5min":1.7549999999999999,"15min":1.869},"last":1.0860000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.0169999999999999,"15min":1.0860000000000001},"min":{"1min":0.81200000000000006,"5min":0.502,"15min":0.502},"max":{"1min":1.454,"5min":1.6120000000000001,"15min":2.762},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.997,"15min":1.0349999999999999},"min":{"1min":0.81899999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2270000000000001,"5min":1.5509999999999999,"15min":1.988},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0700000000000001,"15min":1.1419999999999999},"min":{"1min":0.92500000000000004,"5min":0.61099999999999999,"15min":0.59799999999999998},"max":{"1min":1.4099999999999999,"5min":1.8240000000000001,"15min":2.6800000000000002},"last":1.496},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0680000000000001,"15min":1.0720000000000001},"min":{"1min":0.871,"5min":0.64100000000000001,"15min":0.52800000000000002},"max":{"1min":1.2829999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.127}]}]},{"osd":1,"up_from":13,"seq":55834574960,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":970752,"data_stored":410522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.63600000000000001,"15min":0.63300000000000001},"min":{"1min":0.46899999999999997,"5min":0.34300000000000003,"15min":0.33200000000000002},"max":{"1min":1.01,"5min":1.087,"15min":1.107},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.68400000000000005,"15min":0.72999999999999998},"min":{"1min":0.51600000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.048,"5min":1.341,"15min":1.3560000000000001},"last":0.67300000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.61099999999999999,"15min":0.63},"min":{"1min":0.51500000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.88900000000000001,"5min":1.133,"15min":1.1879999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.73699999999999999,"15min":0.748},"min":{"1min":0.36399999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.139,"5min":1.617,"15min":1.617},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.57599999999999996,"5min":0.375,"15min":0.375},"max":{"1min":1.052,"5min":1.415,"15min":1.415},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.75700000000000001,"15min":0.78400000000000003},"min":{"1min":0.56599999999999995,"5min":0.35999999999999999,"15min":0.35699999999999998},"max":{"1min":1.111,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.59099999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.94699999999999995,"15min":0.95699999999999996},"min":{"1min":0.81200000000000006,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2769999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.96199999999999997,"15min":0.97299999999999998},"min":{"1min":0.73799999999999999,"5min":0.57599999999999996,"15min":0.54100000000000004},"max":{"1min":1.1830000000000001,"5min":1.52,"15min":1.994},"last":0.52300000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.97299999999999998,"15min":0.97599999999999998},"min":{"1min":0.78100000000000003,"5min":0.71399999999999997,"15min":0.49299999999999999},"max":{"1min":1.3160000000000001,"5min":1.7,"15min":2.0960000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0549999999999999,"15min":1.077},"min":{"1min":0.746,"5min":0.626,"15min":0.626},"max":{"1min":1.355,"5min":1.8939999999999999,"15min":2.7280000000000002},"last":0.874}]},{"osd":6,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.0269999999999999,"15min":1.071},"min":{"1min":0.85599999999999998,"5min":0.56599999999999995,"15min":0.53100000000000003},"max":{"1min":1.4219999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.751},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0469999999999999,"15min":1.081},"min":{"1min":0.76600000000000001,"5min":0.64700000000000002,"15min":0.63100000000000001},"max":{"1min":1.2969999999999999,"5min":1.9710000000000001,"15min":2.0489999999999999},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.103,"15min":1.0960000000000001},"min":{"1min":0.873,"5min":0.72499999999999998,"15min":0.67400000000000004},"max":{"1min":1.4830000000000001,"5min":2.0070000000000001,"15min":2.5579999999999998},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.077,"15min":1.111},"min":{"1min":0.97999999999999998,"5min":0.55200000000000005,"15min":0.51300000000000001},"max":{"1min":1.49,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.85399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40820,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331020,"statfs":{"total":96636764160,"available":96594964480,"internally_reserved":0,"allocated":1544192,"data_stored":998710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.57999999999999996,"15min":0.59899999999999998},"min":{"1min":0.47499999999999998,"5min":0.192,"15min":0.192},"max":{"1min":0.95499999999999996,"5min":1.23,"15min":1.23},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.65500000000000003,"15min":0.68799999999999994},"min":{"1min":0.56699999999999995,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.056,"5min":1.1220000000000001,"15min":1.1759999999999999},"last":0.70699999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.65500000000000003,"15min":0.69499999999999995},"min":{"1min":0.47299999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.02,"5min":1.494,"15min":1.494},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.69899999999999995,"15min":0.71599999999999997},"min":{"1min":0.5,"5min":0.223,"15min":0.223},"max":{"1min":0.96499999999999997,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.60799999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.66600000000000004,"15min":0.64300000000000002},"min":{"1min":0.54700000000000004,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.0409999999999999,"5min":1.137,"15min":1.137},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.79300000000000004,"15min":0.81999999999999995},"min":{"1min":0.69799999999999995,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.246,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.64200000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.94199999999999995,"15min":0.95999999999999996},"min":{"1min":0.69899999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.1970000000000001,"5min":1.764,"15min":1.764},"last":1.145},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.89100000000000001,"15min":0.90600000000000003},"min":{"1min":0.72699999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.4810000000000001},"last":0.85299999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.95999999999999996,"15min":0.96899999999999997},"min":{"1min":0.81399999999999995,"5min":0.63700000000000001,"15min":0.59299999999999997},"max":{"1min":1.3540000000000001,"5min":1.365,"15min":1.3939999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.056,"5min":1.0109999999999999,"15min":1.0449999999999999},"min":{"1min":0.84599999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3100000000000001,"5min":1.637,"15min":1.637},"last":0.92900000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.048,"15min":1.083},"min":{"1min":0.76200000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.357,"5min":1.718,"15min":1.718},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0629999999999999,"15min":1.1060000000000001},"min":{"1min":0.84499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.341,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.21}]},{"osd":7,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0569999999999999,"15min":1.105},"min":{"1min":0.74399999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.403,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.026,"15min":1.04},"min":{"1min":0.80300000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.413,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.1020000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:35:51.769 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-09-13T18:35:51.764+0000 7fa19426f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:35:54.400 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:35:54.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.520+0000 7fe86ac3b700 1 Processor -- start 2024-09-13T18:35:54.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.520+0000 7fe86ac3b700 1 -- start start 2024-09-13T18:35:54.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.520+0000 7fe86ac3b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe86415cae0 0x7fe8640cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.520+0000 7fe86ac3b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe86415cec0 0x7fe8640d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.520+0000 7fe86ac3b700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8640d21e0 con 0x7fe86406ac00 2024-09-13T18:35:54.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.520+0000 7fe86ac3b700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8640d1750 con 0x7fe86415cec0 2024-09-13T18:35:54.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.520+0000 7fe86ac3b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8640d1940 con 0x7fe86415cae0 2024-09-13T18:35:54.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.520+0000 7fe869438700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe86415cec0 0x7fe8640d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.520+0000 7fe869438700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe86415cec0 0x7fe8640d1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49872/0 (socket says 172.21.15.44:49872) 2024-09-13T18:35:54.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.520+0000 7fe86a43a700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe86406ac00 0x7fe8640cdfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43202/0 (socket says 172.21.15.44:43202) 2024-09-13T18:35:54.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.520+0000 7fe869438700 1 -- 172.21.15.44:0/2334391366 learned_addr learned my addr 172.21.15.44:0/2334391366 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:54.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.524+0000 7fe869c39700 1 --2- 172.21.15.44:0/2334391366 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe86415cae0 0x7fe8640cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.524+0000 7fe869438700 1 -- 172.21.15.44:0/2334391366 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe86415cae0 msgr2=0x7fe8640cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:54.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.524+0000 7fe869438700 1 --2- 172.21.15.44:0/2334391366 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe86415cae0 0x7fe8640cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.524+0000 7fe869438700 1 -- 172.21.15.44:0/2334391366 >> v1:172.21.15.44:6789/0 conn(0x7fe86406ac00 legacy=0x7fe8640cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.524+0000 7fe869438700 1 -- 172.21.15.44:0/2334391366 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8640d1c20 con 0x7fe86415cec0 2024-09-13T18:35:54.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.524+0000 7fe869c39700 1 --2- 172.21.15.44:0/2334391366 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe86415cae0 0x7fe8640cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:54.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.524+0000 7fe869438700 1 --2- 172.21.15.44:0/2334391366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe86415cec0 0x7fe8640d1210 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fe860009910 tx=0x7fe860009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ac7469af6c5b4c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:54.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.524+0000 7fe868c37700 1 -- 172.21.15.44:0/2334391366 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86000ba60 con 0x7fe86415cec0 2024-09-13T18:35:54.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.524+0000 7fe868c37700 1 -- 172.21.15.44:0/2334391366 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86000bbc0 con 0x7fe86415cec0 2024-09-13T18:35:54.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.524+0000 7fe868c37700 1 -- 172.21.15.44:0/2334391366 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe860009e60 con 0x7fe86415cec0 2024-09-13T18:35:54.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.524+0000 7fe86ac3b700 1 -- 172.21.15.44:0/2334391366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe86415cec0 msgr2=0x7fe8640d1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.524+0000 7fe86ac3b700 1 --2- 172.21.15.44:0/2334391366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe86415cec0 0x7fe8640d1210 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fe860009910 tx=0x7fe860009c20 comp rx=0 tx=0).stop 2024-09-13T18:35:54.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.524+0000 7fe86ac3b700 1 -- 172.21.15.44:0/2334391366 shutdown_connections 2024-09-13T18:35:54.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.524+0000 7fe86ac3b700 1 --2- 172.21.15.44:0/2334391366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe86415cec0 0x7fe8640d1210 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.524+0000 7fe86ac3b700 1 --2- 172.21.15.44:0/2334391366 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe86415cae0 0x7fe8640cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.524+0000 7fe86ac3b700 1 -- 172.21.15.44:0/2334391366 >> 172.21.15.44:0/2334391366 conn(0x7fe8640d2c80 msgr2=0x7fe8640d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:54.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.524+0000 7fe86ac3b700 1 -- 172.21.15.44:0/2334391366 shutdown_connections 2024-09-13T18:35:54.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.524+0000 7fe86ac3b700 1 -- 172.21.15.44:0/2334391366 wait complete. 2024-09-13T18:35:54.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.524+0000 7fe86ac3b700 1 Processor -- start 2024-09-13T18:35:54.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.524+0000 7fe86ac3b700 1 -- start start 2024-09-13T18:35:54.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe86ac3b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe86406ac00 0x7fe864159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe86ac3b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe86415cae0 0x7fe864155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe86ac3b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe86415cec0 0x7fe864155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe86ac3b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8640cad80 con 0x7fe86406ac00 2024-09-13T18:35:54.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe86ac3b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe864155660 con 0x7fe86415cae0 2024-09-13T18:35:54.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe86ac3b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8640caaa0 con 0x7fe86415cec0 2024-09-13T18:35:54.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe869c39700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe86406ac00 0x7fe864159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe869c39700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe86406ac00 0x7fe864159560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49874/0 (socket says 172.21.15.44:49874) 2024-09-13T18:35:54.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe869c39700 1 -- 172.21.15.44:0/3952448200 learned_addr learned my addr 172.21.15.44:0/3952448200 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:54.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe86a43a700 1 --2- 172.21.15.44:0/3952448200 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe86415cec0 0x7fe864155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe869438700 1 --2- 172.21.15.44:0/3952448200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe86415cae0 0x7fe864155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe869c39700 1 -- 172.21.15.44:0/3952448200 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe86415cec0 msgr2=0x7fe864155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe869c39700 1 --2- 172.21.15.44:0/3952448200 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe86415cec0 0x7fe864155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe869c39700 1 -- 172.21.15.44:0/3952448200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe86415cae0 msgr2=0x7fe864155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe869c39700 1 --2- 172.21.15.44:0/3952448200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe86415cae0 0x7fe864155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe869c39700 1 -- 172.21.15.44:0/3952448200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe860009570 con 0x7fe86406ac00 2024-09-13T18:35:54.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe86a43a700 1 --2- 172.21.15.44:0/3952448200 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe86415cec0 0x7fe864155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:54.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe869438700 1 --2- 172.21.15.44:0/3952448200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe86415cae0 0x7fe864155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:54.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe869c39700 1 --2- 172.21.15.44:0/3952448200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe86406ac00 0x7fe864159560 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fe85800c770 tx=0x7fe85800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:54.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe8567fc700 1 -- 172.21.15.44:0/3952448200 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe858011800 con 0x7fe86406ac00 2024-09-13T18:35:54.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe8567fc700 1 -- 172.21.15.44:0/3952448200 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe858011960 con 0x7fe86406ac00 2024-09-13T18:35:54.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe8567fc700 1 -- 172.21.15.44:0/3952448200 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe858011d10 con 0x7fe86406ac00 2024-09-13T18:35:54.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe86ac3b700 1 -- 172.21.15.44:0/3952448200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe86415e2c0 con 0x7fe86406ac00 2024-09-13T18:35:54.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe86ac3b700 1 -- 172.21.15.44:0/3952448200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8640ca730 con 0x7fe86406ac00 2024-09-13T18:35:54.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe86ac3b700 1 -- 172.21.15.44:0/3952448200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe86415e120 con 0x7fe86406ac00 2024-09-13T18:35:54.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.528+0000 7fe8567fc700 1 -- 172.21.15.44:0/3952448200 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe858018360 con 0x7fe86406ac00 2024-09-13T18:35:54.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.532+0000 7fe8567fc700 1 --2- 172.21.15.44:0/3952448200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe848066730 0x7fe848068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.532+0000 7fe8567fc700 1 -- 172.21.15.44:0/3952448200 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe858084190 con 0x7fe86406ac00 2024-09-13T18:35:54.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.532+0000 7fe869438700 1 --2- 172.21.15.44:0/3952448200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe848066730 0x7fe848068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.532+0000 7fe869438700 1 --2- 172.21.15.44:0/3952448200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe848066730 0x7fe848068bf0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe8640cd5f0 tx=0x7fe860008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:54.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.536+0000 7fe8567fc700 1 -- 172.21.15.44:0/3952448200 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe86415e120 con 0x7fe86406ac00 2024-09-13T18:35:54.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.704+0000 7fe86ac3b700 1 -- 172.21.15.44:0/3952448200 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe8640b1d30 con 0x7fe848066730 2024-09-13T18:35:54.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.724+0000 7fe8567fc700 1 -- 172.21.15.44:0/3952448200 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287693 (secure 0 0 0) 0x7fe8640b1d30 con 0x7fe848066730 2024-09-13T18:35:54.734 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:54.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.728+0000 7fe86ac3b700 1 -- 172.21.15.44:0/3952448200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe848066730 msgr2=0x7fe848068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.728+0000 7fe86ac3b700 1 --2- 172.21.15.44:0/3952448200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe848066730 0x7fe848068bf0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe8640cd5f0 tx=0x7fe860008030 comp rx=0 tx=0).stop 2024-09-13T18:35:54.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.728+0000 7fe86ac3b700 1 -- 172.21.15.44:0/3952448200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe86406ac00 msgr2=0x7fe864159560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.728+0000 7fe86ac3b700 1 --2- 172.21.15.44:0/3952448200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe86406ac00 0x7fe864159560 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fe85800c770 tx=0x7fe85800cb30 comp rx=0 tx=0).stop 2024-09-13T18:35:54.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.728+0000 7fe86ac3b700 1 -- 172.21.15.44:0/3952448200 shutdown_connections 2024-09-13T18:35:54.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.728+0000 7fe86ac3b700 1 --2- 172.21.15.44:0/3952448200 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe848066730 0x7fe848068bf0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.728+0000 7fe86ac3b700 1 --2- 172.21.15.44:0/3952448200 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe86415cec0 0x7fe864155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.728+0000 7fe86ac3b700 1 --2- 172.21.15.44:0/3952448200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe86415cae0 0x7fe864155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.728+0000 7fe86ac3b700 1 --2- 172.21.15.44:0/3952448200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe86406ac00 0x7fe864159560 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.728+0000 7fe86ac3b700 1 -- 172.21.15.44:0/3952448200 >> 172.21.15.44:0/3952448200 conn(0x7fe8640d2c80 msgr2=0x7fe8640b6170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:54.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.728+0000 7fe86ac3b700 1 -- 172.21.15.44:0/3952448200 shutdown_connections 2024-09-13T18:35:54.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.728+0000 7fe86ac3b700 1 -- 172.21.15.44:0/3952448200 wait complete. 2024-09-13T18:35:54.737 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:35:54.751 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2024-09-13T18:35:54.508508+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":287976,"kb_used_data":8648,"kb_used_omap":12,"kb_used_meta":279155,"kb_avail":754686744,"statfs":{"total":773094113280,"available":772799225856,"internally_reserved":0,"allocated":8855552,"data_stored":4452196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":285855288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.658888"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867944+0000","last_change":"2024-09-13T18:35:45.876759+0000","last_active":"2024-09-13T18:35:46.867944+0000","last_peered":"2024-09-13T18:35:46.867944+0000","last_clean":"2024-09-13T18:35:46.867944+0000","last_became_active":"2024-09-13T18:35:45.876258+0000","last_became_peered":"2024-09-13T18:35:45.876258+0000","last_unstale":"2024-09-13T18:35:46.867944+0000","last_undegraded":"2024-09-13T18:35:46.867944+0000","last_fullsized":"2024-09-13T18:35:46.867944+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:52.148220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867399+0000","last_change":"2024-09-13T18:35:45.862965+0000","last_active":"2024-09-13T18:35:46.867399+0000","last_peered":"2024-09-13T18:35:46.867399+0000","last_clean":"2024-09-13T18:35:46.867399+0000","last_became_active":"2024-09-13T18:35:45.862683+0000","last_became_peered":"2024-09-13T18:35:45.862683+0000","last_unstale":"2024-09-13T18:35:46.867399+0000","last_undegraded":"2024-09-13T18:35:46.867399+0000","last_fullsized":"2024-09-13T18:35:46.867399+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:15.023455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.753408+0000","last_change":"2024-09-13T18:35:45.879740+0000","last_active":"2024-09-13T18:35:47.753408+0000","last_peered":"2024-09-13T18:35:47.753408+0000","last_clean":"2024-09-13T18:35:47.753408+0000","last_became_active":"2024-09-13T18:35:45.876578+0000","last_became_peered":"2024-09-13T18:35:45.876578+0000","last_unstale":"2024-09-13T18:35:47.753408+0000","last_undegraded":"2024-09-13T18:35:47.753408+0000","last_fullsized":"2024-09-13T18:35:47.753408+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:52.159676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.862781+0000","last_change":"2024-09-13T18:35:45.877617+0000","last_active":"2024-09-13T18:35:46.862781+0000","last_peered":"2024-09-13T18:35:46.862781+0000","last_clean":"2024-09-13T18:35:46.862781+0000","last_became_active":"2024-09-13T18:35:45.877379+0000","last_became_peered":"2024-09-13T18:35:45.877379+0000","last_unstale":"2024-09-13T18:35:46.862781+0000","last_undegraded":"2024-09-13T18:35:46.862781+0000","last_fullsized":"2024-09-13T18:35:46.862781+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:50.667404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750670+0000","last_change":"2024-09-13T18:35:45.869430+0000","last_active":"2024-09-13T18:35:47.750670+0000","last_peered":"2024-09-13T18:35:47.750670+0000","last_clean":"2024-09-13T18:35:47.750670+0000","last_became_active":"2024-09-13T18:35:45.869165+0000","last_became_peered":"2024-09-13T18:35:45.869165+0000","last_unstale":"2024-09-13T18:35:47.750670+0000","last_undegraded":"2024-09-13T18:35:47.750670+0000","last_fullsized":"2024-09-13T18:35:47.750670+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:40.120251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867162+0000","last_change":"2024-09-13T18:35:45.865094+0000","last_active":"2024-09-13T18:35:46.867162+0000","last_peered":"2024-09-13T18:35:46.867162+0000","last_clean":"2024-09-13T18:35:46.867162+0000","last_became_active":"2024-09-13T18:35:45.864826+0000","last_became_peered":"2024-09-13T18:35:45.864826+0000","last_unstale":"2024-09-13T18:35:46.867162+0000","last_undegraded":"2024-09-13T18:35:46.867162+0000","last_fullsized":"2024-09-13T18:35:46.867162+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:01.309115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752309+0000","last_change":"2024-09-13T18:35:45.872362+0000","last_active":"2024-09-13T18:35:47.752309+0000","last_peered":"2024-09-13T18:35:47.752309+0000","last_clean":"2024-09-13T18:35:47.752309+0000","last_became_active":"2024-09-13T18:35:45.872103+0000","last_became_peered":"2024-09-13T18:35:45.872103+0000","last_unstale":"2024-09-13T18:35:47.752309+0000","last_undegraded":"2024-09-13T18:35:47.752309+0000","last_fullsized":"2024-09-13T18:35:47.752309+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:58.389866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867384+0000","last_change":"2024-09-13T18:35:45.870529+0000","last_active":"2024-09-13T18:35:46.867384+0000","last_peered":"2024-09-13T18:35:46.867384+0000","last_clean":"2024-09-13T18:35:46.867384+0000","last_became_active":"2024-09-13T18:35:45.870318+0000","last_became_peered":"2024-09-13T18:35:45.870318+0000","last_unstale":"2024-09-13T18:35:46.867384+0000","last_undegraded":"2024-09-13T18:35:46.867384+0000","last_fullsized":"2024-09-13T18:35:46.867384+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:44.606188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751173+0000","last_change":"2024-09-13T18:35:45.877476+0000","last_active":"2024-09-13T18:35:47.751173+0000","last_peered":"2024-09-13T18:35:47.751173+0000","last_clean":"2024-09-13T18:35:47.751173+0000","last_became_active":"2024-09-13T18:35:45.877180+0000","last_became_peered":"2024-09-13T18:35:45.877180+0000","last_unstale":"2024-09-13T18:35:47.751173+0000","last_undegraded":"2024-09-13T18:35:47.751173+0000","last_fullsized":"2024-09-13T18:35:47.751173+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:54.814862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751614+0000","last_change":"2024-09-13T18:35:45.874208+0000","last_active":"2024-09-13T18:35:47.751614+0000","last_peered":"2024-09-13T18:35:47.751614+0000","last_clean":"2024-09-13T18:35:47.751614+0000","last_became_active":"2024-09-13T18:35:45.873944+0000","last_became_peered":"2024-09-13T18:35:45.873944+0000","last_unstale":"2024-09-13T18:35:47.751614+0000","last_undegraded":"2024-09-13T18:35:47.751614+0000","last_fullsized":"2024-09-13T18:35:47.751614+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:01.309115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867785+0000","last_change":"2024-09-13T18:35:45.881425+0000","last_active":"2024-09-13T18:35:46.867785+0000","last_peered":"2024-09-13T18:35:46.867785+0000","last_clean":"2024-09-13T18:35:46.867785+0000","last_became_active":"2024-09-13T18:35:45.881174+0000","last_became_peered":"2024-09-13T18:35:45.881174+0000","last_unstale":"2024-09-13T18:35:46.867785+0000","last_undegraded":"2024-09-13T18:35:46.867785+0000","last_fullsized":"2024-09-13T18:35:46.867785+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:46.619282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.862927+0000","last_change":"2024-09-13T18:35:45.874046+0000","last_active":"2024-09-13T18:35:46.862927+0000","last_peered":"2024-09-13T18:35:46.862927+0000","last_clean":"2024-09-13T18:35:46.862927+0000","last_became_active":"2024-09-13T18:35:45.873686+0000","last_became_peered":"2024-09-13T18:35:45.873686+0000","last_unstale":"2024-09-13T18:35:46.862927+0000","last_undegraded":"2024-09-13T18:35:46.862927+0000","last_fullsized":"2024-09-13T18:35:46.862927+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:22.588146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750636+0000","last_change":"2024-09-13T18:35:45.864467+0000","last_active":"2024-09-13T18:35:47.750636+0000","last_peered":"2024-09-13T18:35:47.750636+0000","last_clean":"2024-09-13T18:35:47.750636+0000","last_became_active":"2024-09-13T18:35:45.864174+0000","last_became_peered":"2024-09-13T18:35:45.864174+0000","last_unstale":"2024-09-13T18:35:47.750636+0000","last_undegraded":"2024-09-13T18:35:47.750636+0000","last_fullsized":"2024-09-13T18:35:47.750636+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:07.323249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751491+0000","last_change":"2024-09-13T18:35:45.857007+0000","last_active":"2024-09-13T18:35:47.751491+0000","last_peered":"2024-09-13T18:35:47.751491+0000","last_clean":"2024-09-13T18:35:47.751491+0000","last_became_active":"2024-09-13T18:35:45.856701+0000","last_became_peered":"2024-09-13T18:35:45.856701+0000","last_unstale":"2024-09-13T18:35:47.751491+0000","last_undegraded":"2024-09-13T18:35:47.751491+0000","last_fullsized":"2024-09-13T18:35:47.751491+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:47.409939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750188+0000","last_change":"2024-09-13T18:35:45.868193+0000","last_active":"2024-09-13T18:35:47.750188+0000","last_peered":"2024-09-13T18:35:47.750188+0000","last_clean":"2024-09-13T18:35:47.750188+0000","last_became_active":"2024-09-13T18:35:45.867834+0000","last_became_peered":"2024-09-13T18:35:45.867834+0000","last_unstale":"2024-09-13T18:35:47.750188+0000","last_undegraded":"2024-09-13T18:35:47.750188+0000","last_fullsized":"2024-09-13T18:35:47.750188+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:58.389866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751038+0000","last_change":"2024-09-13T18:35:45.875555+0000","last_active":"2024-09-13T18:35:47.751038+0000","last_peered":"2024-09-13T18:35:47.751038+0000","last_clean":"2024-09-13T18:35:47.751038+0000","last_became_active":"2024-09-13T18:35:45.875248+0000","last_became_peered":"2024-09-13T18:35:45.875248+0000","last_unstale":"2024-09-13T18:35:47.751038+0000","last_undegraded":"2024-09-13T18:35:47.751038+0000","last_fullsized":"2024-09-13T18:35:47.751038+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:30.257132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751427+0000","last_change":"2024-09-13T18:35:45.877626+0000","last_active":"2024-09-13T18:35:47.751427+0000","last_peered":"2024-09-13T18:35:47.751427+0000","last_clean":"2024-09-13T18:35:47.751427+0000","last_became_active":"2024-09-13T18:35:45.877189+0000","last_became_peered":"2024-09-13T18:35:45.877189+0000","last_unstale":"2024-09-13T18:35:47.751427+0000","last_undegraded":"2024-09-13T18:35:47.751427+0000","last_fullsized":"2024-09-13T18:35:47.751427+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:19.096857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.863308+0000","last_change":"2024-09-13T18:35:45.869053+0000","last_active":"2024-09-13T18:35:46.863308+0000","last_peered":"2024-09-13T18:35:46.863308+0000","last_clean":"2024-09-13T18:35:46.863308+0000","last_became_active":"2024-09-13T18:35:45.868465+0000","last_became_peered":"2024-09-13T18:35:45.868465+0000","last_unstale":"2024-09-13T18:35:46.863308+0000","last_undegraded":"2024-09-13T18:35:46.863308+0000","last_fullsized":"2024-09-13T18:35:46.863308+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:01.353338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867063+0000","last_change":"2024-09-13T18:35:45.869650+0000","last_active":"2024-09-13T18:35:46.867063+0000","last_peered":"2024-09-13T18:35:46.867063+0000","last_clean":"2024-09-13T18:35:46.867063+0000","last_became_active":"2024-09-13T18:35:45.869324+0000","last_became_peered":"2024-09-13T18:35:45.869324+0000","last_unstale":"2024-09-13T18:35:46.867063+0000","last_undegraded":"2024-09-13T18:35:46.867063+0000","last_fullsized":"2024-09-13T18:35:46.867063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:59.343927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750666+0000","last_change":"2024-09-13T18:35:45.868766+0000","last_active":"2024-09-13T18:35:47.750666+0000","last_peered":"2024-09-13T18:35:47.750666+0000","last_clean":"2024-09-13T18:35:47.750666+0000","last_became_active":"2024-09-13T18:35:45.868529+0000","last_became_peered":"2024-09-13T18:35:45.868529+0000","last_unstale":"2024-09-13T18:35:47.750666+0000","last_undegraded":"2024-09-13T18:35:47.750666+0000","last_fullsized":"2024-09-13T18:35:47.750666+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:30.257132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751546+0000","last_change":"2024-09-13T18:35:45.864445+0000","last_active":"2024-09-13T18:35:47.751546+0000","last_peered":"2024-09-13T18:35:47.751546+0000","last_clean":"2024-09-13T18:35:47.751546+0000","last_became_active":"2024-09-13T18:35:45.864156+0000","last_became_peered":"2024-09-13T18:35:45.864156+0000","last_unstale":"2024-09-13T18:35:47.751546+0000","last_undegraded":"2024-09-13T18:35:47.751546+0000","last_fullsized":"2024-09-13T18:35:47.751546+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:44.606188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751482+0000","last_change":"2024-09-13T18:35:45.871414+0000","last_active":"2024-09-13T18:35:47.751482+0000","last_peered":"2024-09-13T18:35:47.751482+0000","last_clean":"2024-09-13T18:35:47.751482+0000","last_became_active":"2024-09-13T18:35:45.871152+0000","last_became_peered":"2024-09-13T18:35:45.871152+0000","last_unstale":"2024-09-13T18:35:47.751482+0000","last_undegraded":"2024-09-13T18:35:47.751482+0000","last_fullsized":"2024-09-13T18:35:47.751482+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:55.692347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867608+0000","last_change":"2024-09-13T18:35:45.873614+0000","last_active":"2024-09-13T18:35:46.867608+0000","last_peered":"2024-09-13T18:35:46.867608+0000","last_clean":"2024-09-13T18:35:46.867608+0000","last_became_active":"2024-09-13T18:35:45.872765+0000","last_became_peered":"2024-09-13T18:35:45.872765+0000","last_unstale":"2024-09-13T18:35:46.867608+0000","last_undegraded":"2024-09-13T18:35:46.867608+0000","last_fullsized":"2024-09-13T18:35:46.867608+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:03.036681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.866584+0000","last_change":"2024-09-13T18:35:45.876738+0000","last_active":"2024-09-13T18:35:46.866584+0000","last_peered":"2024-09-13T18:35:46.866584+0000","last_clean":"2024-09-13T18:35:46.866584+0000","last_became_active":"2024-09-13T18:35:45.876477+0000","last_became_peered":"2024-09-13T18:35:45.876477+0000","last_unstale":"2024-09-13T18:35:46.866584+0000","last_undegraded":"2024-09-13T18:35:46.866584+0000","last_fullsized":"2024-09-13T18:35:46.866584+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:41.431194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751968+0000","last_change":"2024-09-13T18:35:45.866671+0000","last_active":"2024-09-13T18:35:47.751968+0000","last_peered":"2024-09-13T18:35:47.751968+0000","last_clean":"2024-09-13T18:35:47.751968+0000","last_became_active":"2024-09-13T18:35:45.866407+0000","last_became_peered":"2024-09-13T18:35:45.866407+0000","last_unstale":"2024-09-13T18:35:47.751968+0000","last_undegraded":"2024-09-13T18:35:47.751968+0000","last_fullsized":"2024-09-13T18:35:47.751968+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:20.347955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752289+0000","last_change":"2024-09-13T18:35:45.858753+0000","last_active":"2024-09-13T18:35:47.752289+0000","last_peered":"2024-09-13T18:35:47.752289+0000","last_clean":"2024-09-13T18:35:47.752289+0000","last_became_active":"2024-09-13T18:35:45.858450+0000","last_became_peered":"2024-09-13T18:35:45.858450+0000","last_unstale":"2024-09-13T18:35:47.752289+0000","last_undegraded":"2024-09-13T18:35:47.752289+0000","last_fullsized":"2024-09-13T18:35:47.752289+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:43.230611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.753423+0000","last_change":"2024-09-13T18:35:45.875391+0000","last_active":"2024-09-13T18:35:47.753423+0000","last_peered":"2024-09-13T18:35:47.753423+0000","last_clean":"2024-09-13T18:35:47.753423+0000","last_became_active":"2024-09-13T18:35:45.875132+0000","last_became_peered":"2024-09-13T18:35:45.875132+0000","last_unstale":"2024-09-13T18:35:47.753423+0000","last_undegraded":"2024-09-13T18:35:47.753423+0000","last_fullsized":"2024-09-13T18:35:47.753423+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:36.122059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752893+0000","last_change":"2024-09-13T18:35:45.874261+0000","last_active":"2024-09-13T18:35:47.752893+0000","last_peered":"2024-09-13T18:35:47.752893+0000","last_clean":"2024-09-13T18:35:47.752893+0000","last_became_active":"2024-09-13T18:35:45.873999+0000","last_became_peered":"2024-09-13T18:35:45.873999+0000","last_unstale":"2024-09-13T18:35:47.752893+0000","last_undegraded":"2024-09-13T18:35:47.752893+0000","last_fullsized":"2024-09-13T18:35:47.752893+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:15.023455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.753057+0000","last_change":"2024-09-13T18:35:45.876353+0000","last_active":"2024-09-13T18:35:47.753057+0000","last_peered":"2024-09-13T18:35:47.753057+0000","last_clean":"2024-09-13T18:35:47.753057+0000","last_became_active":"2024-09-13T18:35:45.876112+0000","last_became_peered":"2024-09-13T18:35:45.876112+0000","last_unstale":"2024-09-13T18:35:47.753057+0000","last_undegraded":"2024-09-13T18:35:47.753057+0000","last_fullsized":"2024-09-13T18:35:47.753057+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:51.309657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752189+0000","last_change":"2024-09-13T18:35:45.864039+0000","last_active":"2024-09-13T18:35:47.752189+0000","last_peered":"2024-09-13T18:35:47.752189+0000","last_clean":"2024-09-13T18:35:47.752189+0000","last_became_active":"2024-09-13T18:35:45.863779+0000","last_became_peered":"2024-09-13T18:35:45.863779+0000","last_unstale":"2024-09-13T18:35:47.752189+0000","last_undegraded":"2024-09-13T18:35:47.752189+0000","last_fullsized":"2024-09-13T18:35:47.752189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:59.894861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752645+0000","last_change":"2024-09-13T18:35:45.857417+0000","last_active":"2024-09-13T18:35:47.752645+0000","last_peered":"2024-09-13T18:35:47.752645+0000","last_clean":"2024-09-13T18:35:47.752645+0000","last_became_active":"2024-09-13T18:35:45.856926+0000","last_became_peered":"2024-09-13T18:35:45.856926+0000","last_unstale":"2024-09-13T18:35:47.752645+0000","last_undegraded":"2024-09-13T18:35:47.752645+0000","last_fullsized":"2024-09-13T18:35:47.752645+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:38.812584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867538+0000","last_change":"2024-09-13T18:35:45.878207+0000","last_active":"2024-09-13T18:35:46.867538+0000","last_peered":"2024-09-13T18:35:46.867538+0000","last_clean":"2024-09-13T18:35:46.867538+0000","last_became_active":"2024-09-13T18:35:45.877783+0000","last_became_peered":"2024-09-13T18:35:45.877783+0000","last_unstale":"2024-09-13T18:35:46.867538+0000","last_undegraded":"2024-09-13T18:35:46.867538+0000","last_fullsized":"2024-09-13T18:35:46.867538+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:20.347955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867716+0000","last_change":"2024-09-13T18:35:45.877134+0000","last_active":"2024-09-13T18:35:46.867716+0000","last_peered":"2024-09-13T18:35:46.867716+0000","last_clean":"2024-09-13T18:35:46.867716+0000","last_became_active":"2024-09-13T18:35:45.876866+0000","last_became_peered":"2024-09-13T18:35:45.876866+0000","last_unstale":"2024-09-13T18:35:46.867716+0000","last_undegraded":"2024-09-13T18:35:46.867716+0000","last_fullsized":"2024-09-13T18:35:46.867716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:40.180096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"77'4","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868203+0000","last_change":"2024-09-13T18:35:45.472260+0000","last_active":"2024-09-13T18:35:46.868203+0000","last_peered":"2024-09-13T18:35:46.868203+0000","last_clean":"2024-09-13T18:35:46.868203+0000","last_became_active":"2024-09-13T18:35:45.472013+0000","last_became_peered":"2024-09-13T18:35:45.472013+0000","last_unstale":"2024-09-13T18:35:46.868203+0000","last_undegraded":"2024-09-13T18:35:46.868203+0000","last_fullsized":"2024-09-13T18:35:46.868203+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:50.687732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751492+0000","last_change":"2024-09-13T18:35:45.877758+0000","last_active":"2024-09-13T18:35:47.751492+0000","last_peered":"2024-09-13T18:35:47.751492+0000","last_clean":"2024-09-13T18:35:47.751492+0000","last_became_active":"2024-09-13T18:35:45.877517+0000","last_became_peered":"2024-09-13T18:35:45.877517+0000","last_unstale":"2024-09-13T18:35:47.751492+0000","last_undegraded":"2024-09-13T18:35:47.751492+0000","last_fullsized":"2024-09-13T18:35:47.751492+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:00.410986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"77'1","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752378+0000","last_change":"2024-09-13T18:35:45.475090+0000","last_active":"2024-09-13T18:35:47.752378+0000","last_peered":"2024-09-13T18:35:47.752378+0000","last_clean":"2024-09-13T18:35:47.752378+0000","last_became_active":"2024-09-13T18:35:45.474539+0000","last_became_peered":"2024-09-13T18:35:45.474539+0000","last_unstale":"2024-09-13T18:35:47.752378+0000","last_undegraded":"2024-09-13T18:35:47.752378+0000","last_fullsized":"2024-09-13T18:35:47.752378+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:54.688796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868155+0000","last_change":"2024-09-13T18:35:45.874995+0000","last_active":"2024-09-13T18:35:46.868155+0000","last_peered":"2024-09-13T18:35:46.868155+0000","last_clean":"2024-09-13T18:35:46.868155+0000","last_became_active":"2024-09-13T18:35:45.874551+0000","last_became_peered":"2024-09-13T18:35:45.874551+0000","last_unstale":"2024-09-13T18:35:46.868155+0000","last_undegraded":"2024-09-13T18:35:46.868155+0000","last_fullsized":"2024-09-13T18:35:46.868155+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:55.692347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"77'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751893+0000","last_change":"2024-09-13T18:35:45.479623+0000","last_active":"2024-09-13T18:35:47.751893+0000","last_peered":"2024-09-13T18:35:47.751893+0000","last_clean":"2024-09-13T18:35:47.751893+0000","last_became_active":"2024-09-13T18:35:45.478940+0000","last_became_peered":"2024-09-13T18:35:45.478940+0000","last_unstale":"2024-09-13T18:35:47.751893+0000","last_undegraded":"2024-09-13T18:35:47.751893+0000","last_fullsized":"2024-09-13T18:35:47.751893+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:17.606974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867970+0000","last_change":"2024-09-13T18:35:45.876410+0000","last_active":"2024-09-13T18:35:46.867970+0000","last_peered":"2024-09-13T18:35:46.867970+0000","last_clean":"2024-09-13T18:35:46.867970+0000","last_became_active":"2024-09-13T18:35:45.875838+0000","last_became_peered":"2024-09-13T18:35:45.875838+0000","last_unstale":"2024-09-13T18:35:46.867970+0000","last_undegraded":"2024-09-13T18:35:46.867970+0000","last_fullsized":"2024-09-13T18:35:46.867970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:54.586051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"77'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868363+0000","last_change":"2024-09-13T18:35:45.475413+0000","last_active":"2024-09-13T18:35:46.868363+0000","last_peered":"2024-09-13T18:35:46.868363+0000","last_clean":"2024-09-13T18:35:46.868363+0000","last_became_active":"2024-09-13T18:35:45.472574+0000","last_became_peered":"2024-09-13T18:35:45.472574+0000","last_unstale":"2024-09-13T18:35:46.868363+0000","last_undegraded":"2024-09-13T18:35:46.868363+0000","last_fullsized":"2024-09-13T18:35:46.868363+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:33.355019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752424+0000","last_change":"2024-09-13T18:35:45.878094+0000","last_active":"2024-09-13T18:35:47.752424+0000","last_peered":"2024-09-13T18:35:47.752424+0000","last_clean":"2024-09-13T18:35:47.752424+0000","last_became_active":"2024-09-13T18:35:45.877814+0000","last_became_peered":"2024-09-13T18:35:45.877814+0000","last_unstale":"2024-09-13T18:35:47.752424+0000","last_undegraded":"2024-09-13T18:35:47.752424+0000","last_fullsized":"2024-09-13T18:35:47.752424+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:55.000037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"77'1","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.753241+0000","last_change":"2024-09-13T18:35:45.471479+0000","last_active":"2024-09-13T18:35:47.753241+0000","last_peered":"2024-09-13T18:35:47.753241+0000","last_clean":"2024-09-13T18:35:47.753241+0000","last_became_active":"2024-09-13T18:35:45.470872+0000","last_became_peered":"2024-09-13T18:35:45.470872+0000","last_unstale":"2024-09-13T18:35:47.753241+0000","last_undegraded":"2024-09-13T18:35:47.753241+0000","last_fullsized":"2024-09-13T18:35:47.753241+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:09.491088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751812+0000","last_change":"2024-09-13T18:35:45.870694+0000","last_active":"2024-09-13T18:35:47.751812+0000","last_peered":"2024-09-13T18:35:47.751812+0000","last_clean":"2024-09-13T18:35:47.751812+0000","last_became_active":"2024-09-13T18:35:45.870440+0000","last_became_peered":"2024-09-13T18:35:45.870440+0000","last_unstale":"2024-09-13T18:35:47.751812+0000","last_undegraded":"2024-09-13T18:35:47.751812+0000","last_fullsized":"2024-09-13T18:35:47.751812+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:59.343927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"77'1","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867336+0000","last_change":"2024-09-13T18:35:45.476256+0000","last_active":"2024-09-13T18:35:46.867336+0000","last_peered":"2024-09-13T18:35:46.867336+0000","last_clean":"2024-09-13T18:35:46.867336+0000","last_became_active":"2024-09-13T18:35:45.475700+0000","last_became_peered":"2024-09-13T18:35:45.475700+0000","last_unstale":"2024-09-13T18:35:46.867336+0000","last_undegraded":"2024-09-13T18:35:46.867336+0000","last_fullsized":"2024-09-13T18:35:46.867336+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:38.409813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751595+0000","last_change":"2024-09-13T18:35:45.866791+0000","last_active":"2024-09-13T18:35:47.751595+0000","last_peered":"2024-09-13T18:35:47.751595+0000","last_clean":"2024-09-13T18:35:47.751595+0000","last_became_active":"2024-09-13T18:35:45.866500+0000","last_became_peered":"2024-09-13T18:35:45.866500+0000","last_unstale":"2024-09-13T18:35:47.751595+0000","last_undegraded":"2024-09-13T18:35:47.751595+0000","last_fullsized":"2024-09-13T18:35:47.751595+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:34.358571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.862182+0000","last_change":"2024-09-13T18:35:45.474040+0000","last_active":"2024-09-13T18:35:46.862182+0000","last_peered":"2024-09-13T18:35:46.862182+0000","last_clean":"2024-09-13T18:35:46.862182+0000","last_became_active":"2024-09-13T18:35:45.473789+0000","last_became_peered":"2024-09-13T18:35:45.473789+0000","last_unstale":"2024-09-13T18:35:46.862182+0000","last_undegraded":"2024-09-13T18:35:46.862182+0000","last_fullsized":"2024-09-13T18:35:46.862182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:35.507796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750302+0000","last_change":"2024-09-13T18:35:45.866054+0000","last_active":"2024-09-13T18:35:47.750302+0000","last_peered":"2024-09-13T18:35:47.750302+0000","last_clean":"2024-09-13T18:35:47.750302+0000","last_became_active":"2024-09-13T18:35:45.865813+0000","last_became_peered":"2024-09-13T18:35:45.865813+0000","last_unstale":"2024-09-13T18:35:47.750302+0000","last_undegraded":"2024-09-13T18:35:47.750302+0000","last_fullsized":"2024-09-13T18:35:47.750302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:38.812584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751771+0000","last_change":"2024-09-13T18:35:45.471039+0000","last_active":"2024-09-13T18:35:47.751771+0000","last_peered":"2024-09-13T18:35:47.751771+0000","last_clean":"2024-09-13T18:35:47.751771+0000","last_became_active":"2024-09-13T18:35:45.470385+0000","last_became_peered":"2024-09-13T18:35:45.470385+0000","last_unstale":"2024-09-13T18:35:47.751771+0000","last_undegraded":"2024-09-13T18:35:47.751771+0000","last_fullsized":"2024-09-13T18:35:47.751771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:01.737904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752519+0000","last_change":"2024-09-13T18:35:45.865766+0000","last_active":"2024-09-13T18:35:47.752519+0000","last_peered":"2024-09-13T18:35:47.752519+0000","last_clean":"2024-09-13T18:35:47.752519+0000","last_became_active":"2024-09-13T18:35:45.865502+0000","last_became_peered":"2024-09-13T18:35:45.865502+0000","last_unstale":"2024-09-13T18:35:47.752519+0000","last_undegraded":"2024-09-13T18:35:47.752519+0000","last_fullsized":"2024-09-13T18:35:47.752519+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:26.729086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752093+0000","last_change":"2024-09-13T18:35:45.473795+0000","last_active":"2024-09-13T18:35:47.752093+0000","last_peered":"2024-09-13T18:35:47.752093+0000","last_clean":"2024-09-13T18:35:47.752093+0000","last_became_active":"2024-09-13T18:35:45.473538+0000","last_became_peered":"2024-09-13T18:35:45.473538+0000","last_unstale":"2024-09-13T18:35:47.752093+0000","last_undegraded":"2024-09-13T18:35:47.752093+0000","last_fullsized":"2024-09-13T18:35:47.752093+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.189564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868027+0000","last_change":"2024-09-13T18:35:45.878966+0000","last_active":"2024-09-13T18:35:46.868027+0000","last_peered":"2024-09-13T18:35:46.868027+0000","last_clean":"2024-09-13T18:35:46.868027+0000","last_became_active":"2024-09-13T18:35:45.878641+0000","last_became_peered":"2024-09-13T18:35:45.878641+0000","last_unstale":"2024-09-13T18:35:46.868027+0000","last_undegraded":"2024-09-13T18:35:46.868027+0000","last_fullsized":"2024-09-13T18:35:46.868027+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:09.286582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867569+0000","last_change":"2024-09-13T18:35:45.476004+0000","last_active":"2024-09-13T18:35:46.867569+0000","last_peered":"2024-09-13T18:35:46.867569+0000","last_clean":"2024-09-13T18:35:46.867569+0000","last_became_active":"2024-09-13T18:35:45.475714+0000","last_became_peered":"2024-09-13T18:35:45.475714+0000","last_unstale":"2024-09-13T18:35:46.867569+0000","last_undegraded":"2024-09-13T18:35:46.867569+0000","last_fullsized":"2024-09-13T18:35:46.867569+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:31.562480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868345+0000","last_change":"2024-09-13T18:35:45.865035+0000","last_active":"2024-09-13T18:35:46.868345+0000","last_peered":"2024-09-13T18:35:46.868345+0000","last_clean":"2024-09-13T18:35:46.868345+0000","last_became_active":"2024-09-13T18:35:45.864789+0000","last_became_peered":"2024-09-13T18:35:45.864789+0000","last_unstale":"2024-09-13T18:35:46.868345+0000","last_undegraded":"2024-09-13T18:35:46.868345+0000","last_fullsized":"2024-09-13T18:35:46.868345+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:30.257132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"77'3","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.753574+0000","last_change":"2024-09-13T18:35:45.470804+0000","last_active":"2024-09-13T18:35:47.753574+0000","last_peered":"2024-09-13T18:35:47.753574+0000","last_clean":"2024-09-13T18:35:47.753574+0000","last_became_active":"2024-09-13T18:35:45.470525+0000","last_became_peered":"2024-09-13T18:35:45.470525+0000","last_unstale":"2024-09-13T18:35:47.753574+0000","last_undegraded":"2024-09-13T18:35:47.753574+0000","last_fullsized":"2024-09-13T18:35:47.753574+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:45.615730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750932+0000","last_change":"2024-09-13T18:35:45.869421+0000","last_active":"2024-09-13T18:35:47.750932+0000","last_peered":"2024-09-13T18:35:47.750932+0000","last_clean":"2024-09-13T18:35:47.750932+0000","last_became_active":"2024-09-13T18:35:45.868871+0000","last_became_peered":"2024-09-13T18:35:45.868871+0000","last_unstale":"2024-09-13T18:35:47.750932+0000","last_undegraded":"2024-09-13T18:35:47.750932+0000","last_fullsized":"2024-09-13T18:35:47.750932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:51.181872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"77'6","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.863213+0000","last_change":"2024-09-13T18:35:45.474787+0000","last_active":"2024-09-13T18:35:46.863213+0000","last_peered":"2024-09-13T18:35:46.863213+0000","last_clean":"2024-09-13T18:35:46.863213+0000","last_became_active":"2024-09-13T18:35:45.474485+0000","last_became_peered":"2024-09-13T18:35:45.474485+0000","last_unstale":"2024-09-13T18:35:46.863213+0000","last_undegraded":"2024-09-13T18:35:46.863213+0000","last_fullsized":"2024-09-13T18:35:46.863213+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:17.606974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867409+0000","last_change":"2024-09-13T18:35:45.873510+0000","last_active":"2024-09-13T18:35:46.867409+0000","last_peered":"2024-09-13T18:35:46.867409+0000","last_clean":"2024-09-13T18:35:46.867409+0000","last_became_active":"2024-09-13T18:35:45.873219+0000","last_became_peered":"2024-09-13T18:35:45.873219+0000","last_unstale":"2024-09-13T18:35:46.867409+0000","last_undegraded":"2024-09-13T18:35:46.867409+0000","last_fullsized":"2024-09-13T18:35:46.867409+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:13.815647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"77'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.862913+0000","last_change":"2024-09-13T18:35:45.469363+0000","last_active":"2024-09-13T18:35:46.862913+0000","last_peered":"2024-09-13T18:35:46.862913+0000","last_clean":"2024-09-13T18:35:46.862913+0000","last_became_active":"2024-09-13T18:35:45.469041+0000","last_became_peered":"2024-09-13T18:35:45.469041+0000","last_unstale":"2024-09-13T18:35:46.862913+0000","last_undegraded":"2024-09-13T18:35:46.862913+0000","last_fullsized":"2024-09-13T18:35:46.862913+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:16.170228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.753079+0000","last_change":"2024-09-13T18:35:45.871494+0000","last_active":"2024-09-13T18:35:47.753079+0000","last_peered":"2024-09-13T18:35:47.753079+0000","last_clean":"2024-09-13T18:35:47.753079+0000","last_became_active":"2024-09-13T18:35:45.871221+0000","last_became_peered":"2024-09-13T18:35:45.871221+0000","last_unstale":"2024-09-13T18:35:47.753079+0000","last_undegraded":"2024-09-13T18:35:47.753079+0000","last_fullsized":"2024-09-13T18:35:47.753079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:06.327113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867491+0000","last_change":"2024-09-13T18:35:45.476416+0000","last_active":"2024-09-13T18:35:46.867491+0000","last_peered":"2024-09-13T18:35:46.867491+0000","last_clean":"2024-09-13T18:35:46.867491+0000","last_became_active":"2024-09-13T18:35:45.476022+0000","last_became_peered":"2024-09-13T18:35:45.476022+0000","last_unstale":"2024-09-13T18:35:46.867491+0000","last_undegraded":"2024-09-13T18:35:46.867491+0000","last_fullsized":"2024-09-13T18:35:46.867491+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:55.012378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750111+0000","last_change":"2024-09-13T18:35:45.864653+0000","last_active":"2024-09-13T18:35:47.750111+0000","last_peered":"2024-09-13T18:35:47.750111+0000","last_clean":"2024-09-13T18:35:47.750111+0000","last_became_active":"2024-09-13T18:35:45.864318+0000","last_became_peered":"2024-09-13T18:35:45.864318+0000","last_unstale":"2024-09-13T18:35:47.750111+0000","last_undegraded":"2024-09-13T18:35:47.750111+0000","last_fullsized":"2024-09-13T18:35:47.750111+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:26.729086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752532+0000","last_change":"2024-09-13T18:35:45.467618+0000","last_active":"2024-09-13T18:35:47.752532+0000","last_peered":"2024-09-13T18:35:47.752532+0000","last_clean":"2024-09-13T18:35:47.752532+0000","last_became_active":"2024-09-13T18:35:45.467320+0000","last_became_peered":"2024-09-13T18:35:45.467320+0000","last_unstale":"2024-09-13T18:35:47.752532+0000","last_undegraded":"2024-09-13T18:35:47.752532+0000","last_fullsized":"2024-09-13T18:35:47.752532+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:43.233122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751905+0000","last_change":"2024-09-13T18:35:45.875808+0000","last_active":"2024-09-13T18:35:47.751905+0000","last_peered":"2024-09-13T18:35:47.751905+0000","last_clean":"2024-09-13T18:35:47.751905+0000","last_became_active":"2024-09-13T18:35:45.875530+0000","last_became_peered":"2024-09-13T18:35:45.875530+0000","last_unstale":"2024-09-13T18:35:47.751905+0000","last_undegraded":"2024-09-13T18:35:47.751905+0000","last_fullsized":"2024-09-13T18:35:47.751905+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:37.987527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"77'8","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751160+0000","last_change":"2024-09-13T18:35:45.473402+0000","last_active":"2024-09-13T18:35:47.751160+0000","last_peered":"2024-09-13T18:35:47.751160+0000","last_clean":"2024-09-13T18:35:47.751160+0000","last_became_active":"2024-09-13T18:35:45.473008+0000","last_became_peered":"2024-09-13T18:35:45.473008+0000","last_unstale":"2024-09-13T18:35:47.751160+0000","last_undegraded":"2024-09-13T18:35:47.751160+0000","last_fullsized":"2024-09-13T18:35:47.751160+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:38.409813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751858+0000","last_change":"2024-09-13T18:35:45.871474+0000","last_active":"2024-09-13T18:35:47.751858+0000","last_peered":"2024-09-13T18:35:47.751858+0000","last_clean":"2024-09-13T18:35:47.751858+0000","last_became_active":"2024-09-13T18:35:45.871217+0000","last_became_peered":"2024-09-13T18:35:45.871217+0000","last_unstale":"2024-09-13T18:35:47.751858+0000","last_undegraded":"2024-09-13T18:35:47.751858+0000","last_fullsized":"2024-09-13T18:35:47.751858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:49.973795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"77'1","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868257+0000","last_change":"2024-09-13T18:35:45.478297+0000","last_active":"2024-09-13T18:35:46.868257+0000","last_peered":"2024-09-13T18:35:46.868257+0000","last_clean":"2024-09-13T18:35:46.868257+0000","last_became_active":"2024-09-13T18:35:45.478053+0000","last_became_peered":"2024-09-13T18:35:45.478053+0000","last_unstale":"2024-09-13T18:35:46.868257+0000","last_undegraded":"2024-09-13T18:35:46.868257+0000","last_fullsized":"2024-09-13T18:35:46.868257+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:17.606974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868129+0000","last_change":"2024-09-13T18:35:45.876572+0000","last_active":"2024-09-13T18:35:46.868129+0000","last_peered":"2024-09-13T18:35:46.868129+0000","last_clean":"2024-09-13T18:35:46.868129+0000","last_became_active":"2024-09-13T18:35:45.875417+0000","last_became_peered":"2024-09-13T18:35:45.875417+0000","last_unstale":"2024-09-13T18:35:46.868129+0000","last_undegraded":"2024-09-13T18:35:46.868129+0000","last_fullsized":"2024-09-13T18:35:46.868129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:43.880737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"77'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752083+0000","last_change":"2024-09-13T18:35:45.479816+0000","last_active":"2024-09-13T18:35:47.752083+0000","last_peered":"2024-09-13T18:35:47.752083+0000","last_clean":"2024-09-13T18:35:47.752083+0000","last_became_active":"2024-09-13T18:35:45.479485+0000","last_became_peered":"2024-09-13T18:35:45.479485+0000","last_unstale":"2024-09-13T18:35:47.752083+0000","last_undegraded":"2024-09-13T18:35:47.752083+0000","last_fullsized":"2024-09-13T18:35:47.752083+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:07.537701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.863074+0000","last_change":"2024-09-13T18:35:45.873901+0000","last_active":"2024-09-13T18:35:46.863074+0000","last_peered":"2024-09-13T18:35:46.863074+0000","last_clean":"2024-09-13T18:35:46.863074+0000","last_became_active":"2024-09-13T18:35:45.873394+0000","last_became_peered":"2024-09-13T18:35:45.873394+0000","last_unstale":"2024-09-13T18:35:46.863074+0000","last_undegraded":"2024-09-13T18:35:46.863074+0000","last_fullsized":"2024-09-13T18:35:46.863074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:48.183275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"77'1","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867271+0000","last_change":"2024-09-13T18:35:45.478481+0000","last_active":"2024-09-13T18:35:46.867271+0000","last_peered":"2024-09-13T18:35:46.867271+0000","last_clean":"2024-09-13T18:35:46.867271+0000","last_became_active":"2024-09-13T18:35:45.478253+0000","last_became_peered":"2024-09-13T18:35:45.478253+0000","last_unstale":"2024-09-13T18:35:46.867271+0000","last_undegraded":"2024-09-13T18:35:46.867271+0000","last_fullsized":"2024-09-13T18:35:46.867271+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:21.109027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751126+0000","last_change":"2024-09-13T18:35:45.866854+0000","last_active":"2024-09-13T18:35:47.751126+0000","last_peered":"2024-09-13T18:35:47.751126+0000","last_clean":"2024-09-13T18:35:47.751126+0000","last_became_active":"2024-09-13T18:35:45.866582+0000","last_became_peered":"2024-09-13T18:35:45.866582+0000","last_unstale":"2024-09-13T18:35:47.751126+0000","last_undegraded":"2024-09-13T18:35:47.751126+0000","last_fullsized":"2024-09-13T18:35:47.751126+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:09.552413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868315+0000","last_change":"2024-09-13T18:35:45.474320+0000","last_active":"2024-09-13T18:35:46.868315+0000","last_peered":"2024-09-13T18:35:46.868315+0000","last_clean":"2024-09-13T18:35:46.868315+0000","last_became_active":"2024-09-13T18:35:45.474063+0000","last_became_peered":"2024-09-13T18:35:45.474063+0000","last_unstale":"2024-09-13T18:35:46.868315+0000","last_undegraded":"2024-09-13T18:35:46.868315+0000","last_fullsized":"2024-09-13T18:35:46.868315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:31.964679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.753069+0000","last_change":"2024-09-13T18:35:45.875977+0000","last_active":"2024-09-13T18:35:47.753069+0000","last_peered":"2024-09-13T18:35:47.753069+0000","last_clean":"2024-09-13T18:35:47.753069+0000","last_became_active":"2024-09-13T18:35:45.875677+0000","last_became_peered":"2024-09-13T18:35:45.875677+0000","last_unstale":"2024-09-13T18:35:47.753069+0000","last_undegraded":"2024-09-13T18:35:47.753069+0000","last_fullsized":"2024-09-13T18:35:47.753069+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:40:45.913103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867627+0000","last_change":"2024-09-13T18:35:45.472200+0000","last_active":"2024-09-13T18:35:46.867627+0000","last_peered":"2024-09-13T18:35:46.867627+0000","last_clean":"2024-09-13T18:35:46.867627+0000","last_became_active":"2024-09-13T18:35:45.471935+0000","last_became_peered":"2024-09-13T18:35:45.471935+0000","last_unstale":"2024-09-13T18:35:46.867627+0000","last_undegraded":"2024-09-13T18:35:46.867627+0000","last_fullsized":"2024-09-13T18:35:46.867627+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:07.537701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752441+0000","last_change":"2024-09-13T18:35:45.881555+0000","last_active":"2024-09-13T18:35:47.752441+0000","last_peered":"2024-09-13T18:35:47.752441+0000","last_clean":"2024-09-13T18:35:47.752441+0000","last_became_active":"2024-09-13T18:35:45.881253+0000","last_became_peered":"2024-09-13T18:35:45.881253+0000","last_unstale":"2024-09-13T18:35:47.752441+0000","last_undegraded":"2024-09-13T18:35:47.752441+0000","last_fullsized":"2024-09-13T18:35:47.752441+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:45.677365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752673+0000","last_change":"2024-09-13T18:35:45.476046+0000","last_active":"2024-09-13T18:35:47.752673+0000","last_peered":"2024-09-13T18:35:47.752673+0000","last_clean":"2024-09-13T18:35:47.752673+0000","last_became_active":"2024-09-13T18:35:45.475714+0000","last_became_peered":"2024-09-13T18:35:45.475714+0000","last_unstale":"2024-09-13T18:35:47.752673+0000","last_undegraded":"2024-09-13T18:35:47.752673+0000","last_fullsized":"2024-09-13T18:35:47.752673+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:45.692277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752770+0000","last_change":"2024-09-13T18:35:45.880070+0000","last_active":"2024-09-13T18:35:47.752770+0000","last_peered":"2024-09-13T18:35:47.752770+0000","last_clean":"2024-09-13T18:35:47.752770+0000","last_became_active":"2024-09-13T18:35:45.879228+0000","last_became_peered":"2024-09-13T18:35:45.879228+0000","last_unstale":"2024-09-13T18:35:47.752770+0000","last_undegraded":"2024-09-13T18:35:47.752770+0000","last_fullsized":"2024-09-13T18:35:47.752770+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:43.579248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.749962+0000","last_change":"2024-09-13T18:35:45.474876+0000","last_active":"2024-09-13T18:35:47.749962+0000","last_peered":"2024-09-13T18:35:47.749962+0000","last_clean":"2024-09-13T18:35:47.749962+0000","last_became_active":"2024-09-13T18:35:45.474574+0000","last_became_peered":"2024-09-13T18:35:45.474574+0000","last_unstale":"2024-09-13T18:35:47.749962+0000","last_undegraded":"2024-09-13T18:35:47.749962+0000","last_fullsized":"2024-09-13T18:35:47.749962+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:19.344403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751932+0000","last_change":"2024-09-13T18:35:45.872962+0000","last_active":"2024-09-13T18:35:47.751932+0000","last_peered":"2024-09-13T18:35:47.751932+0000","last_clean":"2024-09-13T18:35:47.751932+0000","last_became_active":"2024-09-13T18:35:45.872642+0000","last_became_peered":"2024-09-13T18:35:45.872642+0000","last_unstale":"2024-09-13T18:35:47.751932+0000","last_undegraded":"2024-09-13T18:35:47.751932+0000","last_fullsized":"2024-09-13T18:35:47.751932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:43.230611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"77'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868311+0000","last_change":"2024-09-13T18:35:45.478020+0000","last_active":"2024-09-13T18:35:46.868311+0000","last_peered":"2024-09-13T18:35:46.868311+0000","last_clean":"2024-09-13T18:35:46.868311+0000","last_became_active":"2024-09-13T18:35:45.477089+0000","last_became_peered":"2024-09-13T18:35:45.477089+0000","last_unstale":"2024-09-13T18:35:46.868311+0000","last_undegraded":"2024-09-13T18:35:46.868311+0000","last_fullsized":"2024-09-13T18:35:46.868311+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:35.507796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752653+0000","last_change":"2024-09-13T18:35:45.871442+0000","last_active":"2024-09-13T18:35:47.752653+0000","last_peered":"2024-09-13T18:35:47.752653+0000","last_clean":"2024-09-13T18:35:47.752653+0000","last_became_active":"2024-09-13T18:35:45.871168+0000","last_became_peered":"2024-09-13T18:35:45.871168+0000","last_unstale":"2024-09-13T18:35:47.752653+0000","last_undegraded":"2024-09-13T18:35:47.752653+0000","last_fullsized":"2024-09-13T18:35:47.752653+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:07.323249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"78'1","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:49.429122+0000","last_change":"2024-09-13T18:35:45.468863+0000","last_active":"2024-09-13T18:35:49.429122+0000","last_peered":"2024-09-13T18:35:49.429122+0000","last_clean":"2024-09-13T18:35:49.429122+0000","last_became_active":"2024-09-13T18:35:45.468536+0000","last_became_peered":"2024-09-13T18:35:45.468536+0000","last_unstale":"2024-09-13T18:35:49.429122+0000","last_undegraded":"2024-09-13T18:35:49.429122+0000","last_fullsized":"2024-09-13T18:35:49.429122+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:39.722520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867758+0000","last_change":"2024-09-13T18:35:45.880515+0000","last_active":"2024-09-13T18:35:46.867758+0000","last_peered":"2024-09-13T18:35:46.867758+0000","last_clean":"2024-09-13T18:35:46.867758+0000","last_became_active":"2024-09-13T18:35:45.880224+0000","last_became_peered":"2024-09-13T18:35:45.880224+0000","last_unstale":"2024-09-13T18:35:46.867758+0000","last_undegraded":"2024-09-13T18:35:46.867758+0000","last_fullsized":"2024-09-13T18:35:46.867758+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:41.900603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751246+0000","last_change":"2024-09-13T18:35:45.469580+0000","last_active":"2024-09-13T18:35:47.751246+0000","last_peered":"2024-09-13T18:35:47.751246+0000","last_clean":"2024-09-13T18:35:47.751246+0000","last_became_active":"2024-09-13T18:35:45.468979+0000","last_became_peered":"2024-09-13T18:35:45.468979+0000","last_unstale":"2024-09-13T18:35:47.751246+0000","last_undegraded":"2024-09-13T18:35:47.751246+0000","last_fullsized":"2024-09-13T18:35:47.751246+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:01.152777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.868019+0000","last_change":"2024-09-13T18:35:45.872941+0000","last_active":"2024-09-13T18:35:46.868019+0000","last_peered":"2024-09-13T18:35:46.868019+0000","last_clean":"2024-09-13T18:35:46.868019+0000","last_became_active":"2024-09-13T18:35:45.872656+0000","last_became_peered":"2024-09-13T18:35:45.872656+0000","last_unstale":"2024-09-13T18:35:46.868019+0000","last_undegraded":"2024-09-13T18:35:46.868019+0000","last_fullsized":"2024-09-13T18:35:46.868019+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:10.494639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751803+0000","last_change":"2024-09-13T18:35:45.475279+0000","last_active":"2024-09-13T18:35:47.751803+0000","last_peered":"2024-09-13T18:35:47.751803+0000","last_clean":"2024-09-13T18:35:47.751803+0000","last_became_active":"2024-09-13T18:35:45.475006+0000","last_became_peered":"2024-09-13T18:35:45.475006+0000","last_unstale":"2024-09-13T18:35:47.751803+0000","last_undegraded":"2024-09-13T18:35:47.751803+0000","last_fullsized":"2024-09-13T18:35:47.751803+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:48.970243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751596+0000","last_change":"2024-09-13T18:35:45.878210+0000","last_active":"2024-09-13T18:35:47.751596+0000","last_peered":"2024-09-13T18:35:47.751596+0000","last_clean":"2024-09-13T18:35:47.751596+0000","last_became_active":"2024-09-13T18:35:45.877953+0000","last_became_peered":"2024-09-13T18:35:45.877953+0000","last_unstale":"2024-09-13T18:35:47.751596+0000","last_undegraded":"2024-09-13T18:35:47.751596+0000","last_fullsized":"2024-09-13T18:35:47.751596+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:28.328066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.750912+0000","last_change":"2024-09-13T18:35:45.472124+0000","last_active":"2024-09-13T18:35:47.750912+0000","last_peered":"2024-09-13T18:35:47.750912+0000","last_clean":"2024-09-13T18:35:47.750912+0000","last_became_active":"2024-09-13T18:35:45.471924+0000","last_became_peered":"2024-09-13T18:35:45.471924+0000","last_unstale":"2024-09-13T18:35:47.750912+0000","last_undegraded":"2024-09-13T18:35:47.750912+0000","last_fullsized":"2024-09-13T18:35:47.750912+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:51.427343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867324+0000","last_change":"2024-09-13T18:35:45.874081+0000","last_active":"2024-09-13T18:35:46.867324+0000","last_peered":"2024-09-13T18:35:46.867324+0000","last_clean":"2024-09-13T18:35:46.867324+0000","last_became_active":"2024-09-13T18:35:45.871264+0000","last_became_peered":"2024-09-13T18:35:45.871264+0000","last_unstale":"2024-09-13T18:35:46.867324+0000","last_undegraded":"2024-09-13T18:35:46.867324+0000","last_fullsized":"2024-09-13T18:35:46.867324+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:49.973795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.862414+0000","last_change":"2024-09-13T18:35:45.473298+0000","last_active":"2024-09-13T18:35:46.862414+0000","last_peered":"2024-09-13T18:35:46.862414+0000","last_clean":"2024-09-13T18:35:46.862414+0000","last_became_active":"2024-09-13T18:35:45.473004+0000","last_became_peered":"2024-09-13T18:35:45.473004+0000","last_unstale":"2024-09-13T18:35:46.862414+0000","last_undegraded":"2024-09-13T18:35:46.862414+0000","last_fullsized":"2024-09-13T18:35:46.862414+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:48.859206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.862302+0000","last_change":"2024-09-13T18:35:45.876925+0000","last_active":"2024-09-13T18:35:46.862302+0000","last_peered":"2024-09-13T18:35:46.862302+0000","last_clean":"2024-09-13T18:35:46.862302+0000","last_became_active":"2024-09-13T18:35:45.876686+0000","last_became_peered":"2024-09-13T18:35:45.876686+0000","last_unstale":"2024-09-13T18:35:46.862302+0000","last_undegraded":"2024-09-13T18:35:46.862302+0000","last_fullsized":"2024-09-13T18:35:46.862302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:25.249970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.751182+0000","last_change":"2024-09-13T18:35:45.472921+0000","last_active":"2024-09-13T18:35:47.751182+0000","last_peered":"2024-09-13T18:35:47.751182+0000","last_clean":"2024-09-13T18:35:47.751182+0000","last_became_active":"2024-09-13T18:35:45.471185+0000","last_became_peered":"2024-09-13T18:35:45.471185+0000","last_unstale":"2024-09-13T18:35:47.751182+0000","last_undegraded":"2024-09-13T18:35:47.751182+0000","last_fullsized":"2024-09-13T18:35:47.751182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:55.012378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.866854+0000","last_change":"2024-09-13T18:35:45.878091+0000","last_active":"2024-09-13T18:35:46.866854+0000","last_peered":"2024-09-13T18:35:46.866854+0000","last_clean":"2024-09-13T18:35:46.866854+0000","last_became_active":"2024-09-13T18:35:45.877792+0000","last_became_peered":"2024-09-13T18:35:45.877792+0000","last_unstale":"2024-09-13T18:35:46.866854+0000","last_undegraded":"2024-09-13T18:35:46.866854+0000","last_fullsized":"2024-09-13T18:35:46.866854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:22.588146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867685+0000","last_change":"2024-09-13T18:35:45.472252+0000","last_active":"2024-09-13T18:35:46.867685+0000","last_peered":"2024-09-13T18:35:46.867685+0000","last_clean":"2024-09-13T18:35:46.867685+0000","last_became_active":"2024-09-13T18:35:45.471993+0000","last_became_peered":"2024-09-13T18:35:45.471993+0000","last_unstale":"2024-09-13T18:35:46.867685+0000","last_undegraded":"2024-09-13T18:35:46.867685+0000","last_fullsized":"2024-09-13T18:35:46.867685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:39.116699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:47.752983+0000","last_change":"2024-09-13T18:35:45.881030+0000","last_active":"2024-09-13T18:35:47.752983+0000","last_peered":"2024-09-13T18:35:47.752983+0000","last_clean":"2024-09-13T18:35:47.752983+0000","last_became_active":"2024-09-13T18:35:45.879544+0000","last_became_peered":"2024-09-13T18:35:45.879544+0000","last_unstale":"2024-09-13T18:35:47.752983+0000","last_undegraded":"2024-09-13T18:35:47.752983+0000","last_fullsized":"2024-09-13T18:35:47.752983+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:45.444730+0000","last_clean_scrub_stamp":"2024-09-13T18:35:45.444730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:31.102728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"77'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-13T18:35:46.867046+0000","last_change":"2024-09-13T18:35:45.475112+0000","last_active":"2024-09-13T18:35:46.867046+0000","last_peered":"2024-09-13T18:35:46.867046+0000","last_clean":"2024-09-13T18:35:46.867046+0000","last_became_active":"2024-09-13T18:35:45.472591+0000","last_became_peered":"2024-09-13T18:35:45.472591+0000","last_unstale":"2024-09-13T18:35:46.867046+0000","last_undegraded":"2024-09-13T18:35:46.867046+0000","last_fullsized":"2024-09-13T18:35:46.867046+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:44.441179+0000","last_clean_scrub_stamp":"2024-09-13T18:35:44.441179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:18.796198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":215,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-13T18:35:45.861709+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:35:45.861709+0000","last_peered":"2024-09-13T18:35:45.861709+0000","last_clean":"2024-09-13T18:35:45.861709+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:35:45.861709+0000","last_undegraded":"2024-09-13T18:35:45.861709+0000","last_fullsized":"2024-09-13T18:35:45.861709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574960,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32644,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339196,"statfs":{"total":96636764160,"available":96603336704,"internally_reserved":0,"allocated":1552384,"data_stored":999326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.38700000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.024,"5min":1.099,"15min":1.163},"last":0.874},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75,"15min":0.79000000000000004},"min":{"1min":0.56299999999999994,"5min":0.436,"15min":0.436},"max":{"1min":1.0900000000000001,"5min":1.288,"15min":1.288},"last":0.81399999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.82299999999999995,"15min":0.874},"min":{"1min":0.59199999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.155,"5min":1.288,"15min":1.7689999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.878,"15min":0.93500000000000005},"min":{"1min":0.65200000000000002,"5min":0.54100000000000004,"15min":0.52600000000000002},"max":{"1min":1.1240000000000001,"5min":1.3009999999999999,"15min":1.6140000000000001},"last":0.56999999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.81599999999999995,"15min":0.84599999999999997},"min":{"1min":0.61899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.101,"5min":1.2270000000000001,"15min":1.3340000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.82799999999999996,"15min":0.88600000000000001},"min":{"1min":0.49299999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2390000000000001,"5min":1.524,"15min":1.6659999999999999},"last":1.0509999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.88100000000000001,"15min":0.89000000000000001},"min":{"1min":0.61399999999999999,"5min":0.54300000000000004,"15min":0.52600000000000002},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.873,"5min":0.88,"15min":0.88100000000000001},"min":{"1min":0.64500000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0940000000000001,"5min":1.486,"15min":1.486},"last":0.93899999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.86099999999999999,"15min":0.88200000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.038,"5min":1.4590000000000001,"15min":1.7290000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.0129999999999999,"15min":1.0369999999999999},"min":{"1min":0.70299999999999996,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1639999999999999,"5min":1.49,"15min":1.7050000000000001},"last":0.97999999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.95699999999999996,"15min":0.95599999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.196,"5min":1.4159999999999999,"15min":1.4259999999999999},"last":0.753},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.048,"15min":1.0509999999999999},"min":{"1min":0.73299999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2170000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.008}]},{"osd":6,"last update":"Fri Sep 13 18:35:02 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.0429999999999999,"15min":1.083},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.58099999999999996},"max":{"1min":1.212,"5min":1.4730000000000001,"15min":2.077},"last":1.093},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0940000000000001,"15min":1.0760000000000001},"min":{"1min":0.81999999999999995,"5min":0.74399999999999999,"15min":0.69099999999999995},"max":{"1min":1.258,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.0309999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574962,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":958464,"data_stored":408434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78800000000000003,"15min":0.82099999999999995},"min":{"1min":0.47899999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.1799999999999999,"5min":1.22,"15min":1.2270000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.77500000000000002,"15min":0.81699999999999995},"min":{"1min":0.56599999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0880000000000001,"5min":1.2470000000000001,"15min":1.361},"last":0.88800000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.76900000000000002,"15min":0.81000000000000005},"min":{"1min":0.55900000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0389999999999999,"5min":1.266,"15min":1.266},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.81999999999999995,"15min":0.82499999999999996},"min":{"1min":0.52700000000000002,"5min":0.48299999999999998,"15min":0.48099999999999998},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.92200000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.79500000000000004,"15min":0.80900000000000005},"min":{"1min":0.55900000000000005,"5min":0.47399999999999998,"15min":0.46899999999999997},"max":{"1min":1.1319999999999999,"5min":1.141,"15min":1.254},"last":1.038},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.84199999999999997,"15min":0.85899999999999999},"min":{"1min":0.60099999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.101,"5min":1.248,"15min":1.248},"last":0.84599999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.89900000000000002,"15min":0.876},"min":{"1min":0.60099999999999998,"5min":0.57599999999999996,"15min":0.52300000000000002},"max":{"1min":1.1870000000000001,"5min":1.238,"15min":1.238},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.89200000000000002,"15min":0.93600000000000005},"min":{"1min":0.68899999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1839999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.98399999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.85399999999999998,"15min":0.88300000000000001},"min":{"1min":0.68300000000000005,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1679999999999999,"5min":1.236,"15min":1.248},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.95899999999999996,"15min":0.98999999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2709999999999999,"5min":1.407,"15min":1.407},"last":1.008}]},{"osd":5,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.022,"15min":1.038},"min":{"1min":0.81699999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.226,"5min":1.355,"15min":1.355},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.997,"5min":0.96599999999999997,"15min":0.97999999999999998},"min":{"1min":0.67800000000000005,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2130000000000001,"5min":1.353,"15min":1.4990000000000001},"last":0.81000000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.98799999999999999,"15min":1},"min":{"1min":0.65900000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2470000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0980000000000001,"15min":1.1080000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76000000000000001},"max":{"1min":1.3120000000000001,"5min":1.367,"15min":1.3740000000000001},"last":1.091}]}]},{"osd":5,"up_from":13,"seq":55834574960,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":954368,"data_stored":408432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77000000000000002,"15min":0.82399999999999995},"min":{"1min":0.52200000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.147,"5min":1.3280000000000001,"15min":1.3640000000000001},"last":0.627},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.78500000000000003,"15min":0.84999999999999998},"min":{"1min":0.60299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0980000000000001,"5min":1.2190000000000001,"15min":1.482},"last":0.76600000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.78500000000000003,"15min":0.79800000000000004},"min":{"1min":0.626,"5min":0.42499999999999999,"15min":0.40999999999999998},"max":{"1min":1.224,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.84699999999999998,"15min":0.91700000000000004},"min":{"1min":0.63300000000000001,"5min":0.50900000000000001,"15min":0.45200000000000001},"max":{"1min":1.1890000000000001,"5min":1.218,"15min":1.4850000000000001},"last":0.80700000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92000000000000004,"15min":0.94799999999999995},"min":{"1min":0.65100000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1830000000000001,"5min":1.2430000000000001,"15min":1.4179999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.92300000000000004,"15min":0.98899999999999999},"min":{"1min":0.71199999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.252,"5min":1.3029999999999999,"15min":1.4690000000000001},"last":1.012}]},{"osd":3,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.88100000000000001,"15min":0.93100000000000005},"min":{"1min":0.70499999999999996,"5min":0.55800000000000005,"15min":0.51700000000000002},"max":{"1min":1.153,"5min":1.2010000000000001,"15min":1.4510000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.88,"15min":0.93100000000000005},"min":{"1min":0.70799999999999996,"5min":0.61199999999999999,"15min":0.55300000000000005},"max":{"1min":1.1279999999999999,"5min":1.335,"15min":1.4990000000000001},"last":1.1679999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.92800000000000005,"15min":0.96099999999999997},"min":{"1min":0.60999999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.077,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.95899999999999996,"15min":1.0169999999999999},"min":{"1min":0.61799999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.143,"5min":1.3759999999999999,"15min":1.542},"last":1.1439999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.97099999999999997,"15min":1.0169999999999999},"min":{"1min":0.72399999999999998,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3129999999999999,"5min":1.4259999999999999,"15min":1.698},"last":1.036},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.107,"15min":1.1499999999999999},"min":{"1min":0.94999999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.286,"5min":1.52,"15min":1.581},"last":1.129}]},{"osd":7,"last update":"Fri Sep 13 18:35:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0620000000000001,"15min":1.155},"min":{"1min":0.83399999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.272,"5min":1.552,"15min":1.847},"last":1.101},{"interface":"front","average":{"1min":1.038,"5min":1.0600000000000001,"15min":1.125},"min":{"1min":0.81899999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.216,"5min":1.4259999999999999,"15min":1.8100000000000001},"last":1.2549999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574960,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46008,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325832,"statfs":{"total":96636764160,"available":96589651968,"internally_reserved":0,"allocated":954368,"data_stored":408412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.80900000000000005,"15min":0.88},"min":{"1min":0.54900000000000004,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.119,"5min":1.1930000000000001,"15min":1.3720000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.874,"15min":0.94599999999999995},"min":{"1min":0.69399999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1479999999999999,"5min":1.3280000000000001,"15min":1.5229999999999999},"last":0.74299999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.76300000000000001,"15min":0.79500000000000004},"min":{"1min":0.68400000000000005,"5min":0.441,"15min":0.435},"max":{"1min":1.012,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.81999999999999995,"15min":0.84599999999999997},"min":{"1min":0.60499999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.0700000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78300000000000003,"15min":0.83899999999999997},"min":{"1min":0.55300000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0780000000000001,"5min":1.171,"15min":1.171},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.86199999999999999,"15min":0.85399999999999998},"min":{"1min":0.66700000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1719999999999999,"5min":1.331,"15min":1.331},"last":0.83799999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.89200000000000002,"15min":0.95699999999999996},"min":{"1min":0.68899999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.163,"5min":1.268,"15min":1.639},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.91200000000000003,"15min":0.97099999999999997},"min":{"1min":0.65000000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.119,"5min":1.2629999999999999,"15min":1.8300000000000001},"last":1.1870000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.91500000000000004,"15min":0.96399999999999997},"min":{"1min":0.65900000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.381,"5min":1.518,"15min":2.3889999999999998},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0389999999999999,"15min":1.095},"min":{"1min":0.70599999999999996,"5min":0.626,"15min":0.626},"max":{"1min":1.2969999999999999,"5min":1.375,"15min":2.0049999999999999},"last":1.0609999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.95499999999999996,"15min":0.91200000000000003},"min":{"1min":0.64300000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2829999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.04},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.075,"15min":1.0960000000000001},"min":{"1min":0.94599999999999995,"5min":0.70099999999999996,"15min":0.63500000000000001},"max":{"1min":1.423,"5min":1.4259999999999999,"15min":1.794},"last":1.149}]},{"osd":7,"last update":"Fri Sep 13 18:35:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.046,"15min":1.069},"min":{"1min":0.89800000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.228,"5min":1.643,"15min":1.669},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.048,"15min":1.03},"min":{"1min":0.70099999999999996,"5min":0.69499999999999995,"15min":0.61799999999999999},"max":{"1min":1.357,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.113}]}]},{"osd":3,"up_from":13,"seq":55834574963,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":958464,"data_stored":408454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61499999999999999,"15min":0.66500000000000004},"min":{"1min":0.505,"5min":0.22,"15min":0.22},"max":{"1min":0.88300000000000001,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.59899999999999998,"15min":0.65900000000000003},"min":{"1min":0.52700000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.1970000000000001},"last":0.71299999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.64800000000000002,"15min":0.69499999999999995},"min":{"1min":0.504,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0920000000000001,"5min":1.379,"15min":1.379},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.71399999999999997,"15min":0.79400000000000004},"min":{"1min":0.54800000000000004,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.042,"5min":1.397,"15min":2.0030000000000001},"last":1.0509999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.72299999999999998,"15min":0.76900000000000002},"min":{"1min":0.60799999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1970000000000001,"5min":1.3300000000000001,"15min":1.333},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.78800000000000003,"15min":0.86699999999999999},"min":{"1min":0.66400000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.2430000000000001,"5min":1.423,"15min":1.423},"last":1.296}]},{"osd":4,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.871,"15min":0.93700000000000006},"min":{"1min":0.77400000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.04,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.93500000000000005,"15min":1.016},"min":{"1min":0.74199999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.393,"5min":1.587,"15min":1.587},"last":1.111}]},{"osd":5,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.004,"15min":1.1299999999999999},"min":{"1min":0.80600000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5620000000000001,"5min":1.6200000000000001,"15min":2.2320000000000002},"last":1.244},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.96999999999999997,"15min":1.079},"min":{"1min":0.81299999999999994,"5min":0.53900000000000003,"15min":0.53600000000000003},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.718},"last":1.0109999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.0229999999999999,"15min":1.1060000000000001},"min":{"1min":0.84299999999999997,"5min":0.496,"15min":0.496},"max":{"1min":1.3999999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.0489999999999999,"15min":1.179},"min":{"1min":0.96199999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4790000000000001,"5min":1.51,"15min":2.1819999999999999},"last":1.381}]},{"osd":7,"last update":"Fri Sep 13 18:35:08 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.01,"15min":1.083},"min":{"1min":0.871,"5min":0.624,"15min":0.624},"max":{"1min":1.2050000000000001,"5min":1.3759999999999999,"15min":1.4670000000000001},"last":1.218},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.0649999999999999,"15min":1.153},"min":{"1min":0.97599999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.444,"5min":1.548,"15min":1.5920000000000001},"last":1.2669999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574961,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40256,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331584,"statfs":{"total":96636764160,"available":96595542016,"internally_reserved":0,"allocated":962560,"data_stored":409906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.628,"15min":0.66000000000000003},"min":{"1min":0.498,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":1.056,"5min":1.1020000000000001,"15min":1.1919999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.69899999999999995,"15min":0.77100000000000002},"min":{"1min":0.56899999999999995,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.014,"5min":1.036,"15min":1.4370000000000001},"last":0.69899999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.64900000000000002,"15min":0.69599999999999995},"min":{"1min":0.52200000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2629999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.67200000000000004,"15min":0.72299999999999998},"min":{"1min":0.58799999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.56499999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.65500000000000003,"15min":0.67000000000000004},"min":{"1min":0.56200000000000006,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.89300000000000002,"5min":1.0489999999999999,"15min":1.1619999999999999},"last":0.752},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.83099999999999996,"15min":0.85499999999999998},"min":{"1min":0.57999999999999996,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.248,"5min":1.3460000000000001,"15min":1.548},"last":0.82399999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.95399999999999996,"15min":0.97399999999999998},"min":{"1min":0.83599999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.272,"5min":1.653,"15min":1.653},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.998,"5min":0.95499999999999996,"15min":1.028},"min":{"1min":0.78600000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.347,"5min":1.51,"15min":2.3849999999999998},"last":0.85599999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.92200000000000004,"15min":0.92300000000000004},"min":{"1min":0.67300000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2390000000000001,"5min":1.4730000000000001,"15min":1.498},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0189999999999999,"15min":1.05},"min":{"1min":0.76700000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.3260000000000001,"5min":1.7549999999999999,"15min":1.869},"last":1.0229999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.0169999999999999,"15min":1.0860000000000001},"min":{"1min":0.81200000000000006,"5min":0.502,"15min":0.502},"max":{"1min":1.454,"5min":1.6120000000000001,"15min":2.762},"last":1.125},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.997,"15min":1.0349999999999999},"min":{"1min":0.81899999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2270000000000001,"5min":1.5509999999999999,"15min":1.988},"last":1.091}]},{"osd":7,"last update":"Fri Sep 13 18:35:11 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0700000000000001,"15min":1.1419999999999999},"min":{"1min":0.92500000000000004,"5min":0.61099999999999999,"15min":0.59799999999999998},"max":{"1min":1.4099999999999999,"5min":1.8240000000000001,"15min":2.6800000000000002},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0680000000000001,"15min":1.0720000000000001},"min":{"1min":0.871,"5min":0.64100000000000001,"15min":0.52800000000000002},"max":{"1min":1.2829999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.96199999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":970752,"data_stored":410522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.63600000000000001,"15min":0.63300000000000001},"min":{"1min":0.46899999999999997,"5min":0.34300000000000003,"15min":0.33200000000000002},"max":{"1min":1.01,"5min":1.087,"15min":1.107},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.68400000000000005,"15min":0.72999999999999998},"min":{"1min":0.51600000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.048,"5min":1.341,"15min":1.3560000000000001},"last":0.76600000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.61099999999999999,"15min":0.63},"min":{"1min":0.51500000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.88900000000000001,"5min":1.133,"15min":1.1879999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.73699999999999999,"15min":0.748},"min":{"1min":0.36399999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.139,"5min":1.617,"15min":1.617},"last":0.51400000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.57599999999999996,"5min":0.375,"15min":0.375},"max":{"1min":1.052,"5min":1.415,"15min":1.415},"last":0.629},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.75700000000000001,"15min":0.78400000000000003},"min":{"1min":0.56599999999999995,"5min":0.35999999999999999,"15min":0.35699999999999998},"max":{"1min":1.111,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.65200000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.94699999999999995,"15min":0.95699999999999996},"min":{"1min":0.81200000000000006,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2769999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.877},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.96199999999999997,"15min":0.97299999999999998},"min":{"1min":0.73799999999999999,"5min":0.57599999999999996,"15min":0.54100000000000004},"max":{"1min":1.1830000000000001,"5min":1.52,"15min":1.994},"last":0.97499999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.97299999999999998,"15min":0.97599999999999998},"min":{"1min":0.78100000000000003,"5min":0.71399999999999997,"15min":0.49299999999999999},"max":{"1min":1.3160000000000001,"5min":1.7,"15min":2.0960000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0549999999999999,"15min":1.077},"min":{"1min":0.746,"5min":0.626,"15min":0.626},"max":{"1min":1.355,"5min":1.8939999999999999,"15min":2.7280000000000002},"last":1.0600000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.0269999999999999,"15min":1.071},"min":{"1min":0.85599999999999998,"5min":0.56599999999999995,"15min":0.53100000000000003},"max":{"1min":1.4219999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.141},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0469999999999999,"15min":1.081},"min":{"1min":0.76600000000000001,"5min":0.64700000000000002,"15min":0.63100000000000001},"max":{"1min":1.2969999999999999,"5min":1.9710000000000001,"15min":2.0489999999999999},"last":0.91300000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.103,"15min":1.0960000000000001},"min":{"1min":0.873,"5min":0.72499999999999998,"15min":0.67400000000000004},"max":{"1min":1.4830000000000001,"5min":2.0070000000000001,"15min":2.5579999999999998},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.077,"15min":1.111},"min":{"1min":0.97999999999999998,"5min":0.55200000000000005,"15min":0.51300000000000001},"max":{"1min":1.49,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.179}]}]},{"osd":0,"up_from":13,"seq":55834574961,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40820,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331020,"statfs":{"total":96636764160,"available":96594964480,"internally_reserved":0,"allocated":1544192,"data_stored":998710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.57999999999999996,"15min":0.59899999999999998},"min":{"1min":0.47499999999999998,"5min":0.192,"15min":0.192},"max":{"1min":0.95499999999999996,"5min":1.23,"15min":1.23},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.65500000000000003,"15min":0.68799999999999994},"min":{"1min":0.56699999999999995,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.056,"5min":1.1220000000000001,"15min":1.1759999999999999},"last":0.69699999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.65500000000000003,"15min":0.69499999999999995},"min":{"1min":0.47299999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.02,"5min":1.494,"15min":1.494},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.69899999999999995,"15min":0.71599999999999997},"min":{"1min":0.5,"5min":0.223,"15min":0.223},"max":{"1min":0.96499999999999997,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.95099999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.66600000000000004,"15min":0.64300000000000002},"min":{"1min":0.54700000000000004,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.0409999999999999,"5min":1.137,"15min":1.137},"last":0.625},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.79300000000000004,"15min":0.81999999999999995},"min":{"1min":0.69799999999999995,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.246,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.83399999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.94199999999999995,"15min":0.95999999999999996},"min":{"1min":0.69899999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.1970000000000001,"5min":1.764,"15min":1.764},"last":1.3160000000000001},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.89100000000000001,"15min":0.90600000000000003},"min":{"1min":0.72699999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.4810000000000001},"last":1.1970000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.95999999999999996,"15min":0.96899999999999997},"min":{"1min":0.81399999999999995,"5min":0.63700000000000001,"15min":0.59299999999999997},"max":{"1min":1.3540000000000001,"5min":1.365,"15min":1.3939999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.0109999999999999,"15min":1.0449999999999999},"min":{"1min":0.84599999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3100000000000001,"5min":1.637,"15min":1.637},"last":1.1599999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.048,"15min":1.083},"min":{"1min":0.76200000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.357,"5min":1.718,"15min":1.718},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0629999999999999,"15min":1.1060000000000001},"min":{"1min":0.84499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.341,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.3740000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0569999999999999,"15min":1.105},"min":{"1min":0.74399999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.403,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.218},{"interface":"front","average":{"1min":1.081,"5min":1.026,"15min":1.04},"min":{"1min":0.80300000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.413,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.1259999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:35:54.757 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:35:54.757 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:35:54.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.884+0000 7f15ba22f700 1 Processor -- start 2024-09-13T18:35:54.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.884+0000 7f15ba22f700 1 -- start start 2024-09-13T18:35:54.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.884+0000 7f15ba22f700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f15b40b4880 0x7f15b4070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.884+0000 7f15ba22f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15b40c8b20 0x7f15b40c9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.884+0000 7f15ba22f700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b40cdbc0 con 0x7f15b4070860 2024-09-13T18:35:54.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.884+0000 7f15ba22f700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b4070cd0 con 0x7f15b40b4880 2024-09-13T18:35:54.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.884+0000 7f15ba22f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b40cde60 con 0x7f15b40c8b20 2024-09-13T18:35:54.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.884+0000 7f15b8a2c700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f15b4070860 0x7f15b40c8410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43206/0 (socket says 172.21.15.44:43206) 2024-09-13T18:35:54.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.884+0000 7f15b8a2c700 1 -- 172.21.15.44:0/3688376088 learned_addr learned my addr 172.21.15.44:0/3688376088 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:54.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.884+0000 7f15b922d700 1 --2- 172.21.15.44:0/3688376088 >> v2:172.21.15.44:3300/0 conn(0x7f15b40b4880 0x7f15b4070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.884+0000 7f15b9a2e700 1 --2- 172.21.15.44:0/3688376088 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15b40c8b20 0x7f15b40c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.884+0000 7f15abfff700 1 -- 172.21.15.44:0/3688376088 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3926230389 0 0) 0x7f15b40cdbc0 con 0x7f15b4070860 2024-09-13T18:35:54.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.884+0000 7f15b922d700 1 -- 172.21.15.44:0/3688376088 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15b40c8b20 msgr2=0x7f15b40c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:54.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.884+0000 7f15b922d700 1 --2- 172.21.15.44:0/3688376088 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15b40c8b20 0x7f15b40c9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.884+0000 7f15b922d700 1 -- 172.21.15.44:0/3688376088 >> v1:172.21.15.44:6789/0 conn(0x7f15b4070860 legacy=0x7f15b40c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.884+0000 7f15b922d700 1 -- 172.21.15.44:0/3688376088 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b40ce140 con 0x7f15b40b4880 2024-09-13T18:35:54.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.884+0000 7f15b922d700 1 --2- 172.21.15.44:0/3688376088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15b40b4880 0x7f15b4070320 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f15b0009850 tx=0x7f15b0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7314073283ac6b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:54.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.884+0000 7f15abfff700 1 -- 172.21.15.44:0/3688376088 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b0011830 con 0x7f15b40b4880 2024-09-13T18:35:54.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.884+0000 7f15abfff700 1 -- 172.21.15.44:0/3688376088 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b0011990 con 0x7f15b40b4880 2024-09-13T18:35:54.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.884+0000 7f15abfff700 1 -- 172.21.15.44:0/3688376088 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b0011d20 con 0x7f15b40b4880 2024-09-13T18:35:54.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.888+0000 7f15ba22f700 1 -- 172.21.15.44:0/3688376088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15b40b4880 msgr2=0x7f15b4070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.888+0000 7f15ba22f700 1 --2- 172.21.15.44:0/3688376088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15b40b4880 0x7f15b4070320 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f15b0009850 tx=0x7f15b0009b60 comp rx=0 tx=0).stop 2024-09-13T18:35:54.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.888+0000 7f15ba22f700 1 -- 172.21.15.44:0/3688376088 shutdown_connections 2024-09-13T18:35:54.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.888+0000 7f15ba22f700 1 --2- 172.21.15.44:0/3688376088 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15b40c8b20 0x7f15b40c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.888+0000 7f15ba22f700 1 --2- 172.21.15.44:0/3688376088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15b40b4880 0x7f15b4070320 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.888+0000 7f15ba22f700 1 -- 172.21.15.44:0/3688376088 >> 172.21.15.44:0/3688376088 conn(0x7f15b40cba60 msgr2=0x7f15b40cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:54.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.888+0000 7f15ba22f700 1 -- 172.21.15.44:0/3688376088 shutdown_connections 2024-09-13T18:35:54.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.888+0000 7f15ba22f700 1 -- 172.21.15.44:0/3688376088 wait complete. 2024-09-13T18:35:54.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.888+0000 7f15ba22f700 1 Processor -- start 2024-09-13T18:35:54.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.888+0000 7f15ba22f700 1 -- start start 2024-09-13T18:35:54.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.892+0000 7f15ba22f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15b4070860 0x7f15b41f1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.892+0000 7f15ba22f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15b40b4880 0x7f15b4139f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.892+0000 7f15ba22f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15b40c8b20 0x7f15b413dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.892+0000 7f15ba22f700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b4139b40 con 0x7f15b40b4880 2024-09-13T18:35:54.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.892+0000 7f15ba22f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b41f2280 con 0x7f15b40c8b20 2024-09-13T18:35:54.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.892+0000 7f15ba22f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b413bd20 con 0x7f15b4070860 2024-09-13T18:35:54.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.892+0000 7f15b8a2c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15b40b4880 0x7f15b4139f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.892+0000 7f15b8a2c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15b40b4880 0x7f15b4139f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49892/0 (socket says 172.21.15.44:49892) 2024-09-13T18:35:54.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.892+0000 7f15b8a2c700 1 -- 172.21.15.44:0/3323568335 learned_addr learned my addr 172.21.15.44:0/3323568335 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:54.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.892+0000 7f15b922d700 1 --2- 172.21.15.44:0/3323568335 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15b4070860 0x7f15b41f1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.892+0000 7f15b9a2e700 1 --2- 172.21.15.44:0/3323568335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15b40c8b20 0x7f15b413dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.892+0000 7f15b8a2c700 1 -- 172.21.15.44:0/3323568335 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15b4070860 msgr2=0x7f15b41f1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.892+0000 7f15b8a2c700 1 --2- 172.21.15.44:0/3323568335 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15b4070860 0x7f15b41f1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.892+0000 7f15b8a2c700 1 -- 172.21.15.44:0/3323568335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15b40c8b20 msgr2=0x7f15b413dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.892+0000 7f15b8a2c700 1 --2- 172.21.15.44:0/3323568335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15b40c8b20 0x7f15b413dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.892+0000 7f15b8a2c700 1 -- 172.21.15.44:0/3323568335 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b00094b0 con 0x7f15b40b4880 2024-09-13T18:35:54.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.892+0000 7f15b8a2c700 1 --2- 172.21.15.44:0/3323568335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15b40b4880 0x7f15b4139f60 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f15a400c580 tx=0x7f15a400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:54.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.892+0000 7f15a9ffb700 1 -- 172.21.15.44:0/3323568335 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a4004ca0 con 0x7f15b40b4880 2024-09-13T18:35:54.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.892+0000 7f15a9ffb700 1 -- 172.21.15.44:0/3323568335 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a4004e20 con 0x7f15b40b4880 2024-09-13T18:35:54.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.892+0000 7f15a9ffb700 1 -- 172.21.15.44:0/3323568335 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a4007310 con 0x7f15b40b4880 2024-09-13T18:35:54.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.892+0000 7f15ba22f700 1 -- 172.21.15.44:0/3323568335 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b40b4de0 con 0x7f15b40b4880 2024-09-13T18:35:54.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.892+0000 7f15ba22f700 1 -- 172.21.15.44:0/3323568335 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b4139760 con 0x7f15b40b4880 2024-09-13T18:35:54.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.896+0000 7f15ba22f700 1 -- 172.21.15.44:0/3323568335 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b4139c80 con 0x7f15b40b4880 2024-09-13T18:35:54.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.896+0000 7f15a9ffb700 1 -- 172.21.15.44:0/3323568335 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f15a4007470 con 0x7f15b40b4880 2024-09-13T18:35:54.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.896+0000 7f15a9ffb700 1 --2- 172.21.15.44:0/3323568335 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1598066760 0x7f1598068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.896+0000 7f15a9ffb700 1 -- 172.21.15.44:0/3323568335 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15a4083f70 con 0x7f15b40b4880 2024-09-13T18:35:54.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.896+0000 7f15b922d700 1 --2- 172.21.15.44:0/3323568335 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1598066760 0x7f1598068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.896+0000 7f15b922d700 1 --2- 172.21.15.44:0/3323568335 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1598066760 0x7f1598068c20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f15b00090b0 tx=0x7f15b0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:54.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:54.900+0000 7f15a9ffb700 1 -- 172.21.15.44:0/3323568335 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f15b4139c80 con 0x7f15b40b4880 2024-09-13T18:35:55.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.136+0000 7f15ba22f700 1 -- 172.21.15.44:0/3323568335 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f15b4139c80 con 0x7f15b40b4880 2024-09-13T18:35:55.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.144+0000 7f15a9ffb700 1 -- 172.21.15.44:0/3323568335 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f15b4139c80 con 0x7f15b40b4880 2024-09-13T18:35:55.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.148+0000 7f15ba22f700 1 -- 172.21.15.44:0/3323568335 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1598066760 msgr2=0x7f1598068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.148+0000 7f15ba22f700 1 --2- 172.21.15.44:0/3323568335 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1598066760 0x7f1598068c20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f15b00090b0 tx=0x7f15b0008030 comp rx=0 tx=0).stop 2024-09-13T18:35:55.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.148+0000 7f15ba22f700 1 -- 172.21.15.44:0/3323568335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15b40b4880 msgr2=0x7f15b4139f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.148+0000 7f15ba22f700 1 --2- 172.21.15.44:0/3323568335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15b40b4880 0x7f15b4139f60 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f15a400c580 tx=0x7f15a400c940 comp rx=0 tx=0).stop 2024-09-13T18:35:55.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.148+0000 7f15ba22f700 1 -- 172.21.15.44:0/3323568335 shutdown_connections 2024-09-13T18:35:55.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.148+0000 7f15ba22f700 1 --2- 172.21.15.44:0/3323568335 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1598066760 0x7f1598068c20 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.148+0000 7f15ba22f700 1 --2- 172.21.15.44:0/3323568335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15b40c8b20 0x7f15b413dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.148+0000 7f15ba22f700 1 --2- 172.21.15.44:0/3323568335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15b40b4880 0x7f15b4139f60 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.148+0000 7f15ba22f700 1 --2- 172.21.15.44:0/3323568335 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15b4070860 0x7f15b41f1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.148+0000 7f15ba22f700 1 -- 172.21.15.44:0/3323568335 >> 172.21.15.44:0/3323568335 conn(0x7f15b40cba60 msgr2=0x7f15b40c91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:55.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.148+0000 7f15ba22f700 1 -- 172.21.15.44:0/3323568335 shutdown_connections 2024-09-13T18:35:55.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.148+0000 7f15ba22f700 1 -- 172.21.15.44:0/3323568335 wait complete. 2024-09-13T18:35:55.156 INFO:teuthology.orchestra.run.smithi044.stderr:updated caps for client.0 2024-09-13T18:35:55.169 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:35:55.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.280+0000 7fc77d2d3700 1 Processor -- start 2024-09-13T18:35:55.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.280+0000 7fc77d2d3700 1 -- start start 2024-09-13T18:35:55.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.280+0000 7fc77d2d3700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc77815ec00 0x7fc778161460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.280+0000 7fc77d2d3700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc7780cfb60 0x7fc778070f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.280+0000 7fc77d2d3700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc778070a90 con 0x7fc7780b43f0 2024-09-13T18:35:55.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.280+0000 7fc77d2d3700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc778161db0 con 0x7fc77815ec00 2024-09-13T18:35:55.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.280+0000 7fc77d2d3700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc778162090 con 0x7fc7780cfb60 2024-09-13T18:35:55.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.280+0000 7fc777fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc77815ec00 0x7fc778161460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.280+0000 7fc7777fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc7780b43f0 0x7fc7780cf450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43212/0 (socket says 172.21.15.44:43212) 2024-09-13T18:35:55.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.280+0000 7fc7777fe700 1 -- 172.21.15.44:0/2999340933 learned_addr learned my addr 172.21.15.44:0/2999340933 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:55.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.280+0000 7fc77cad2700 1 --2- 172.21.15.44:0/2999340933 >> v2:172.21.15.99:3300/0 conn(0x7fc7780cfb60 0x7fc778070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.280+0000 7fc776ffd700 1 -- 172.21.15.44:0/2999340933 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128858359 0 0) 0x7fc778070a90 con 0x7fc7780b43f0 2024-09-13T18:35:55.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.280+0000 7fc776ffd700 1 -- 172.21.15.44:0/2999340933 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7640035d0 con 0x7fc7780b43f0 2024-09-13T18:35:55.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.280+0000 7fc777fff700 1 -- 172.21.15.44:0/2999340933 >> v2:172.21.15.99:3300/0 conn(0x7fc7780cfb60 msgr2=0x7fc778070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:55.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.280+0000 7fc777fff700 1 --2- 172.21.15.44:0/2999340933 >> v2:172.21.15.99:3300/0 conn(0x7fc7780cfb60 0x7fc778070f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.280+0000 7fc777fff700 1 -- 172.21.15.44:0/2999340933 >> v1:172.21.15.44:6789/0 conn(0x7fc7780b43f0 legacy=0x7fc7780cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.280+0000 7fc777fff700 1 -- 172.21.15.44:0/2999340933 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc778162370 con 0x7fc77815ec00 2024-09-13T18:35:55.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.280+0000 7fc777fff700 1 --2- 172.21.15.44:0/2999340933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77815ec00 0x7fc778161460 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fc7780aecd0 tx=0x7fc760009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42dbb277c011c85 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:55.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.280+0000 7fc776ffd700 1 -- 172.21.15.44:0/2999340933 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc760011830 con 0x7fc77815ec00 2024-09-13T18:35:55.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.280+0000 7fc776ffd700 1 -- 172.21.15.44:0/2999340933 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc760011990 con 0x7fc77815ec00 2024-09-13T18:35:55.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.280+0000 7fc776ffd700 1 -- 172.21.15.44:0/2999340933 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc760011d20 con 0x7fc77815ec00 2024-09-13T18:35:55.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.284+0000 7fc77d2d3700 1 -- 172.21.15.44:0/2999340933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77815ec00 msgr2=0x7fc778161460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.284+0000 7fc77d2d3700 1 --2- 172.21.15.44:0/2999340933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77815ec00 0x7fc778161460 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fc7780aecd0 tx=0x7fc760009b30 comp rx=0 tx=0).stop 2024-09-13T18:35:55.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.284+0000 7fc77d2d3700 1 -- 172.21.15.44:0/2999340933 shutdown_connections 2024-09-13T18:35:55.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.284+0000 7fc77d2d3700 1 --2- 172.21.15.44:0/2999340933 >> v2:172.21.15.99:3300/0 conn(0x7fc7780cfb60 0x7fc778070f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.284+0000 7fc77d2d3700 1 --2- 172.21.15.44:0/2999340933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77815ec00 0x7fc778161460 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.284+0000 7fc77d2d3700 1 -- 172.21.15.44:0/2999340933 >> 172.21.15.44:0/2999340933 conn(0x7fc7780b11d0 msgr2=0x7fc7780b15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:55.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.284+0000 7fc77d2d3700 1 -- 172.21.15.44:0/2999340933 shutdown_connections 2024-09-13T18:35:55.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.284+0000 7fc77d2d3700 1 -- 172.21.15.44:0/2999340933 wait complete. 2024-09-13T18:35:55.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.284+0000 7fc77d2d3700 1 Processor -- start 2024-09-13T18:35:55.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.284+0000 7fc77d2d3700 1 -- start start 2024-09-13T18:35:55.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.288+0000 7fc77d2d3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc7780b43f0 0x7fc7781577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.288+0000 7fc77d2d3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7780cfb60 0x7fc77814e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.288+0000 7fc77d2d3700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc77815ec00 0x7fc77806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.288+0000 7fc77d2d3700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77806ca80 con 0x7fc7780cfb60 2024-09-13T18:35:55.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.288+0000 7fc77d2d3700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc778158cf0 con 0x7fc77815ec00 2024-09-13T18:35:55.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.288+0000 7fc77d2d3700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77806bc50 con 0x7fc7780b43f0 2024-09-13T18:35:55.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.288+0000 7fc7777fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7780cfb60 0x7fc77814e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.288+0000 7fc7777fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7780cfb60 0x7fc77814e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49922/0 (socket says 172.21.15.44:49922) 2024-09-13T18:35:55.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.288+0000 7fc7777fe700 1 -- 172.21.15.44:0/2115169822 learned_addr learned my addr 172.21.15.44:0/2115169822 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:55.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.288+0000 7fc777fff700 1 --2- 172.21.15.44:0/2115169822 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc7780b43f0 0x7fc7781577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.288+0000 7fc77cad2700 1 --2- 172.21.15.44:0/2115169822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc77815ec00 0x7fc77806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.288+0000 7fc7777fe700 1 -- 172.21.15.44:0/2115169822 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc7780b43f0 msgr2=0x7fc7781577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.288+0000 7fc7777fe700 1 --2- 172.21.15.44:0/2115169822 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc7780b43f0 0x7fc7781577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.288+0000 7fc7777fe700 1 -- 172.21.15.44:0/2115169822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc77815ec00 msgr2=0x7fc77806c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.288+0000 7fc7777fe700 1 --2- 172.21.15.44:0/2115169822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc77815ec00 0x7fc77806c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.288+0000 7fc7777fe700 1 -- 172.21.15.44:0/2115169822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7600094b0 con 0x7fc7780cfb60 2024-09-13T18:35:55.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.288+0000 7fc7777fe700 1 --2- 172.21.15.44:0/2115169822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7780cfb60 0x7fc77814e400 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fc76800cb90 tx=0x7fc76800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:55.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.288+0000 7fc774ff9700 1 -- 172.21.15.44:0/2115169822 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76800a770 con 0x7fc7780cfb60 2024-09-13T18:35:55.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.288+0000 7fc774ff9700 1 -- 172.21.15.44:0/2115169822 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76800a8d0 con 0x7fc7780cfb60 2024-09-13T18:35:55.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.288+0000 7fc77d2d3700 1 -- 172.21.15.44:0/2115169822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77806bf30 con 0x7fc7780cfb60 2024-09-13T18:35:55.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.288+0000 7fc774ff9700 1 -- 172.21.15.44:0/2115169822 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76800ac40 con 0x7fc7780cfb60 2024-09-13T18:35:55.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.288+0000 7fc77d2d3700 1 -- 172.21.15.44:0/2115169822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc778158980 con 0x7fc7780cfb60 2024-09-13T18:35:55.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.288+0000 7fc77d2d3700 1 -- 172.21.15.44:0/2115169822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc778070f00 con 0x7fc7780cfb60 2024-09-13T18:35:55.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.292+0000 7fc774ff9700 1 -- 172.21.15.44:0/2115169822 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc76801b3b0 con 0x7fc7780cfb60 2024-09-13T18:35:55.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.292+0000 7fc774ff9700 1 --2- 172.21.15.44:0/2115169822 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc758066730 0x7fc758068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.292+0000 7fc774ff9700 1 -- 172.21.15.44:0/2115169822 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc768083b40 con 0x7fc7780cfb60 2024-09-13T18:35:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.292+0000 7fc777fff700 1 --2- 172.21.15.44:0/2115169822 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc758066730 0x7fc758068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.292+0000 7fc777fff700 1 --2- 172.21.15.44:0/2115169822 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc758066730 0x7fc758068bf0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc760000c00 tx=0x7fc760008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:55.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.296+0000 7fc774ff9700 1 -- 172.21.15.44:0/2115169822 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc768050e40 con 0x7fc7780cfb60 2024-09-13T18:35:55.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.504+0000 7fc77d2d3700 1 -- 172.21.15.44:0/2115169822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc778160af0 con 0x7fc7780cfb60 2024-09-13T18:35:55.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.508+0000 7fc774ff9700 1 -- 172.21.15.44:0/2115169822 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4736 (secure 0 0 0) 0x7fc768054460 con 0x7fc7780cfb60 2024-09-13T18:35:55.514 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:55.514 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":70,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3463035694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3463035694},{"type":"v1","addr":"172.21.15.99:6837","nonce":3463035694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7438,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2910652037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2910652037},{"type":"v1","addr":"172.21.15.44:6833","nonce":2910652037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7456,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2231812307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2231812307},{"type":"v1","addr":"172.21.15.99:6835","nonce":2231812307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:35:45.841782+0000","modified":"2024-09-13T18:35:48.860780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7626},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7626":{"gid":7626,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/1921610909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1921610909},{"type":"v1","addr":"172.21.15.44:6835","nonce":1921610909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:35:55.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.508+0000 7fc77d2d3700 1 -- 172.21.15.44:0/2115169822 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc758066730 msgr2=0x7fc758068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.508+0000 7fc77d2d3700 1 --2- 172.21.15.44:0/2115169822 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc758066730 0x7fc758068bf0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc760000c00 tx=0x7fc760008030 comp rx=0 tx=0).stop 2024-09-13T18:35:55.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.508+0000 7fc77d2d3700 1 -- 172.21.15.44:0/2115169822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7780cfb60 msgr2=0x7fc77814e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.508+0000 7fc77d2d3700 1 --2- 172.21.15.44:0/2115169822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7780cfb60 0x7fc77814e400 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fc76800cb90 tx=0x7fc76800cbc0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.508+0000 7fc77d2d3700 1 -- 172.21.15.44:0/2115169822 shutdown_connections 2024-09-13T18:35:55.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.508+0000 7fc77d2d3700 1 --2- 172.21.15.44:0/2115169822 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc758066730 0x7fc758068bf0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.508+0000 7fc77d2d3700 1 --2- 172.21.15.44:0/2115169822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc77815ec00 0x7fc77806c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.508+0000 7fc77d2d3700 1 --2- 172.21.15.44:0/2115169822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7780cfb60 0x7fc77814e400 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.508+0000 7fc77d2d3700 1 --2- 172.21.15.44:0/2115169822 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc7780b43f0 0x7fc7781577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.508+0000 7fc77d2d3700 1 -- 172.21.15.44:0/2115169822 >> 172.21.15.44:0/2115169822 conn(0x7fc7780b11d0 msgr2=0x7fc77815fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:55.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.508+0000 7fc77d2d3700 1 -- 172.21.15.44:0/2115169822 shutdown_connections 2024-09-13T18:35:55.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:55.508+0000 7fc77d2d3700 1 -- 172.21.15.44:0/2115169822 wait complete. 2024-09-13T18:35:55.518 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 70 2024-09-13T18:35:55.933 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:35:45.841782+0000', 'modified': '2024-09-13T18:35:48.860780+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7626}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7626': {'gid': 7626, 'name': 'a', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.44:6835/1921610909', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 1921610909}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 1921610909}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:35:55.934 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:35:55.934 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:35:56.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.056+0000 7f0dcf59e700 1 Processor -- start 2024-09-13T18:35:56.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.056+0000 7f0dcf59e700 1 -- start start 2024-09-13T18:35:56.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.056+0000 7f0dcf59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0dd01573e0 0x7f0dd0070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.056+0000 7f0dcf59e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0dd015a630 0x7f0dd006c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.056+0000 7f0dcf59e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd0071540 con 0x7f0dd00710e0 2024-09-13T18:35:56.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.056+0000 7f0dcf59e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd00cc1b0 con 0x7f0dd015a630 2024-09-13T18:35:56.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.056+0000 7f0dcf59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd015ac50 con 0x7f0dd01573e0 2024-09-13T18:35:56.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.056+0000 7f0dcdd9b700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0dd00710e0 0x7f0dd0159f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43220/0 (socket says 172.21.15.44:43220) 2024-09-13T18:35:56.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.056+0000 7f0dcdd9b700 1 -- 172.21.15.44:0/2727426171 learned_addr learned my addr 172.21.15.44:0/2727426171 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:56.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.056+0000 7f0dce59c700 1 --2- 172.21.15.44:0/2727426171 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0dd01573e0 0x7f0dd0070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.056+0000 7f0dced9d700 1 --2- 172.21.15.44:0/2727426171 >> v2:172.21.15.99:3300/0 conn(0x7f0dd015a630 0x7f0dd006c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.056+0000 7f0dcd59a700 1 -- 172.21.15.44:0/2727426171 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281506629 0 0) 0x7f0dd0071540 con 0x7f0dd00710e0 2024-09-13T18:35:56.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.056+0000 7f0dcd59a700 1 -- 172.21.15.44:0/2727426171 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0db80035d0 con 0x7f0dd00710e0 2024-09-13T18:35:56.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.056+0000 7f0dce59c700 1 -- 172.21.15.44:0/2727426171 >> v2:172.21.15.99:3300/0 conn(0x7f0dd015a630 msgr2=0x7f0dd006c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:56.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.056+0000 7f0dce59c700 1 --2- 172.21.15.44:0/2727426171 >> v2:172.21.15.99:3300/0 conn(0x7f0dd015a630 0x7f0dd006c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.056+0000 7f0dce59c700 1 -- 172.21.15.44:0/2727426171 >> v1:172.21.15.44:6789/0 conn(0x7f0dd00710e0 legacy=0x7f0dd0159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.056+0000 7f0dce59c700 1 -- 172.21.15.44:0/2727426171 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd00cb3f0 con 0x7f0dd01573e0 2024-09-13T18:35:56.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.060+0000 7f0dce59c700 1 --2- 172.21.15.44:0/2727426171 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0dd01573e0 0x7f0dd0070ba0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4009880 tx=0x7f0dc4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ba987f01f926f95 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:56.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.060+0000 7f0dcd59a700 1 -- 172.21.15.44:0/2727426171 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4011830 con 0x7f0dd01573e0 2024-09-13T18:35:56.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.060+0000 7f0dcd59a700 1 -- 172.21.15.44:0/2727426171 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc4011990 con 0x7f0dd01573e0 2024-09-13T18:35:56.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.060+0000 7f0dcd59a700 1 -- 172.21.15.44:0/2727426171 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4011d00 con 0x7f0dd01573e0 2024-09-13T18:35:56.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.060+0000 7f0dcf59e700 1 -- 172.21.15.44:0/2727426171 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0dd01573e0 msgr2=0x7f0dd0070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.060+0000 7f0dcf59e700 1 --2- 172.21.15.44:0/2727426171 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0dd01573e0 0x7f0dd0070ba0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4009880 tx=0x7f0dc4009b90 comp rx=0 tx=0).stop 2024-09-13T18:35:56.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.060+0000 7f0dcf59e700 1 -- 172.21.15.44:0/2727426171 shutdown_connections 2024-09-13T18:35:56.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.060+0000 7f0dcf59e700 1 --2- 172.21.15.44:0/2727426171 >> v2:172.21.15.99:3300/0 conn(0x7f0dd015a630 0x7f0dd006c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.060+0000 7f0dcf59e700 1 --2- 172.21.15.44:0/2727426171 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0dd01573e0 0x7f0dd0070ba0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.060+0000 7f0dcf59e700 1 -- 172.21.15.44:0/2727426171 >> 172.21.15.44:0/2727426171 conn(0x7f0dd00b0e10 msgr2=0x7f0dd00b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:56.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.060+0000 7f0dcf59e700 1 -- 172.21.15.44:0/2727426171 shutdown_connections 2024-09-13T18:35:56.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.060+0000 7f0dcf59e700 1 -- 172.21.15.44:0/2727426171 wait complete. 2024-09-13T18:35:56.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.064+0000 7f0dcf59e700 1 Processor -- start 2024-09-13T18:35:56.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.064+0000 7f0dcf59e700 1 -- start start 2024-09-13T18:35:56.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.064+0000 7f0dcf59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dd00710e0 0x7f0dd0143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.064+0000 7f0dcf59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0dd01573e0 0x7f0dd00ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.064+0000 7f0dcf59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dd015a630 0x7f0dd00ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.064+0000 7f0dcf59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd0143650 con 0x7f0dd015a630 2024-09-13T18:35:56.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.064+0000 7f0dcf59e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd0155330 con 0x7f0dd00710e0 2024-09-13T18:35:56.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.064+0000 7f0dcf59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd014e5d0 con 0x7f0dd01573e0 2024-09-13T18:35:56.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.064+0000 7f0dced9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dd015a630 0x7f0dd00ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.064+0000 7f0dce59c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dd00710e0 0x7f0dd0143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.064+0000 7f0dced9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dd015a630 0x7f0dd00ace00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49938/0 (socket says 172.21.15.44:49938) 2024-09-13T18:35:56.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.064+0000 7f0dcdd9b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0dd01573e0 0x7f0dd00ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.064+0000 7f0dced9d700 1 -- 172.21.15.44:0/408902679 learned_addr learned my addr 172.21.15.44:0/408902679 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:56.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.068+0000 7f0dced9d700 1 -- 172.21.15.44:0/408902679 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0dd01573e0 msgr2=0x7f0dd00ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.068+0000 7f0dced9d700 1 --2- 172.21.15.44:0/408902679 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0dd01573e0 0x7f0dd00ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.068+0000 7f0dced9d700 1 -- 172.21.15.44:0/408902679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dd00710e0 msgr2=0x7f0dd0143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.068+0000 7f0dced9d700 1 --2- 172.21.15.44:0/408902679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dd00710e0 0x7f0dd0143110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.068+0000 7f0dced9d700 1 -- 172.21.15.44:0/408902679 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc40094b0 con 0x7f0dd015a630 2024-09-13T18:35:56.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.068+0000 7f0dce59c700 1 --2- 172.21.15.44:0/408902679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dd00710e0 0x7f0dd0143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:56.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.068+0000 7f0dced9d700 1 --2- 172.21.15.44:0/408902679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dd015a630 0x7f0dd00ace00 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f0dc800efc0 tx=0x7f0dc800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:56.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.068+0000 7f0dbeffd700 1 -- 172.21.15.44:0/408902679 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc800ca70 con 0x7f0dd015a630 2024-09-13T18:35:56.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.068+0000 7f0dbeffd700 1 -- 172.21.15.44:0/408902679 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc800f040 con 0x7f0dd015a630 2024-09-13T18:35:56.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.068+0000 7f0dbeffd700 1 -- 172.21.15.44:0/408902679 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc800ce10 con 0x7f0dd015a630 2024-09-13T18:35:56.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.068+0000 7f0dcf59e700 1 -- 172.21.15.44:0/408902679 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd014e8b0 con 0x7f0dd015a630 2024-09-13T18:35:56.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.068+0000 7f0dcf59e700 1 -- 172.21.15.44:0/408902679 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd014ee70 con 0x7f0dd015a630 2024-09-13T18:35:56.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.068+0000 7f0dbeffd700 1 -- 172.21.15.44:0/408902679 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0dc8014480 con 0x7f0dd015a630 2024-09-13T18:35:56.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.068+0000 7f0dbeffd700 1 --2- 172.21.15.44:0/408902679 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0db0066760 0x7f0db0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.072+0000 7f0dbeffd700 1 -- 172.21.15.44:0/408902679 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0dc8084890 con 0x7f0dd015a630 2024-09-13T18:35:56.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.072+0000 7f0dce59c700 1 --2- 172.21.15.44:0/408902679 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0db0066760 0x7f0db0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.072+0000 7f0dce59c700 1 --2- 172.21.15.44:0/408902679 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0db0066760 0x7f0db0068c20 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4000c00 tx=0x7f0dc4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.072+0000 7f0dd7bc7740 1 Processor -- start 2024-09-13T18:35:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.072+0000 7f0dd7bc7740 1 -- start start 2024-09-13T18:35:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dd7bc7740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x208c230 0x208c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dd7bc7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x206ae90 0x2054890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dd7bc7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x2054dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dd7bc7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fb3d80 con 0x208cb50 2024-09-13T18:35:56.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dd7bc7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fb1510 con 0x206ae90 2024-09-13T18:35:56.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dd7bc7740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x1face00 con 0x208c230 2024-09-13T18:35:56.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dced9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x2054dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dced9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x2054dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49954/0 (socket says 172.21.15.44:49954) 2024-09-13T18:35:56.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dced9d700 1 -- 172.21.15.44:0/1180140785 learned_addr learned my addr 172.21.15.44:0/1180140785 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:56.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dce59c700 1 --2- 172.21.15.44:0/1180140785 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x208c230 0x208c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dcdd9b700 1 --2- 172.21.15.44:0/1180140785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x206ae90 0x2054890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dced9d700 1 -- 172.21.15.44:0/1180140785 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x208c230 msgr2=0x208c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:56.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dced9d700 1 --2- 172.21.15.44:0/1180140785 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x208c230 0x208c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dced9d700 1 -- 172.21.15.44:0/1180140785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x206ae90 msgr2=0x2054890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:56.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dced9d700 1 --2- 172.21.15.44:0/1180140785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x206ae90 0x2054890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dced9d700 1 -- 172.21.15.44:0/1180140785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1e1f960 con 0x208cb50 2024-09-13T18:35:56.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dced9d700 1 --2- 172.21.15.44:0/1180140785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x2054dd0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8051d30 tx=0x7f0dc8055fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621ddb6a23ea5787 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:56.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0daffff700 1 -- 172.21.15.44:0/1180140785 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8059660 con 0x208cb50 2024-09-13T18:35:56.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0daffff700 1 -- 172.21.15.44:0/1180140785 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc805dc20 con 0x208cb50 2024-09-13T18:35:56.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0daffff700 1 -- 172.21.15.44:0/1180140785 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8053bd0 con 0x208cb50 2024-09-13T18:35:56.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/1180140785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 msgr2=0x2054dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dd7bc7740 1 --2- 172.21.15.44:0/1180140785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x2054dd0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8051d30 tx=0x7f0dc8055fb0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/1180140785 shutdown_connections 2024-09-13T18:35:56.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dd7bc7740 1 --2- 172.21.15.44:0/1180140785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x2054dd0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dd7bc7740 1 --2- 172.21.15.44:0/1180140785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x206ae90 0x2054890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dd7bc7740 1 --2- 172.21.15.44:0/1180140785 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x208c230 0x208c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/1180140785 >> 172.21.15.44:0/1180140785 conn(0x1dd44d0 msgr2=0x206de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:56.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/1180140785 shutdown_connections 2024-09-13T18:35:56.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.076+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/1180140785 wait complete. 2024-09-13T18:35:56.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dd7bc7740 1 -- start start 2024-09-13T18:35:56.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dd7bc7740 1 Processor -- start 2024-09-13T18:35:56.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dd7bc7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x206ae90 0x208ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dd7bc7740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x208c230 0x2046d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dd7bc7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x2084610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dd7bc7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f6a730 con 0x208cb50 2024-09-13T18:35:56.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dd7bc7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f705b0 con 0x206ae90 2024-09-13T18:35:56.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dd7bc7740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e58aa0 con 0x208c230 2024-09-13T18:35:56.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dd7bc7740 10 client.0 _ll_register_callbacks cb 0x1fa6610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:35:56.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dced9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x2084610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dcdd9b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x208c230 0x2046d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dced9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x2084610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49962/0 (socket says 172.21.15.44:49962) 2024-09-13T18:35:56.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dced9d700 1 -- 172.21.15.44:0/1661649606 learned_addr learned my addr 172.21.15.44:0/1661649606 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:56.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dce59c700 1 --2- 172.21.15.44:0/1661649606 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x206ae90 0x208ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dced9d700 1 -- 172.21.15.44:0/1661649606 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x208c230 msgr2=0x2046d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:56.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dced9d700 1 --2- 172.21.15.44:0/1661649606 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x208c230 0x2046d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dced9d700 1 -- 172.21.15.44:0/1661649606 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x206ae90 msgr2=0x208ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:56.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dced9d700 1 --2- 172.21.15.44:0/1661649606 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x206ae90 0x208ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dced9d700 1 -- 172.21.15.44:0/1661649606 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd014ee70 con 0x208cb50 2024-09-13T18:35:56.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dced9d700 1 --2- 172.21.15.44:0/1661649606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x2084610 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8051d30 tx=0x7f0dc8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec349ad732748b92 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:56.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-13T18:35:56.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dad7fa700 1 -- 172.21.15.44:0/1661649606 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc80721d0 con 0x208cb50 2024-09-13T18:35:56.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dad7fa700 1 -- 172.21.15.44:0/1661649606 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0dc8059660 con 0x208cb50 2024-09-13T18:35:56.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.080+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/1661649606 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1de11e0 con 0x208cb50 2024-09-13T18:35:56.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dad7fa700 1 -- 172.21.15.44:0/1661649606 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0dc805d790 con 0x208cb50 2024-09-13T18:35:56.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dd7bc7740 10 client.7791 fetch_fsmap learned FSMap version 70 2024-09-13T18:35:56.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/1661649606 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x1f73220 con 0x208cb50 2024-09-13T18:35:56.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dad7fa700 1 -- 172.21.15.44:0/1661649606 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1de11e0 con 0x208cb50 2024-09-13T18:35:56.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dad7fa700 1 -- 172.21.15.44:0/1661649606 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f0dc8073b70 con 0x208cb50 2024-09-13T18:35:56.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dd7bc7740 10 client.7791 fetch_fsmap finished waiting for FSMap version 70 2024-09-13T18:35:56.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dd7bc7740 10 client.7791 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:35:56.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dd7bc7740 20 client.7791 populate_metadata read hostname 'smithi044' 2024-09-13T18:35:56.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dd7bc7740 1 --2- 172.21.15.44:0/1661649606 >> [v2:172.21.15.44:6834/1921610909,v1:172.21.15.44:6835/1921610909] conn(0x2041a60 0x2041e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dd7bc7740 4 client.7791 mds_command: new command op to 7626 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:35:56.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/1661649606 --> [v2:172.21.15.44:6834/1921610909,v1:172.21.15.44:6835/1921610909] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1e2b460 con 0x2041a60 2024-09-13T18:35:56.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dce59c700 1 --2- 172.21.15.44:0/1661649606 >> [v2:172.21.15.44:6834/1921610909,v1:172.21.15.44:6835/1921610909] conn(0x2041a60 0x2041e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dad7fa700 10 client.7791 ms_handle_connect on v2:172.21.15.44:6834/1921610909 2024-09-13T18:35:56.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dce59c700 1 --2- 172.21.15.44:0/1661649606 >> [v2:172.21.15.44:6834/1921610909,v1:172.21.15.44:6835/1921610909] conn(0x2041a60 0x2041e40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffabb550c56eb4ce server_cookie=4fd204b78b209c04 in_seq=0 out_seq=0 2024-09-13T18:35:56.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dad7fa700 1 -- 172.21.15.44:0/1661649606 <== mds.0 v2:172.21.15.44:6834/1921610909 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x1e2b460 con 0x2041a60 2024-09-13T18:35:56.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dad7fa700 10 client.7791 handle_command_reply: tid=0 2024-09-13T18:35:56.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dd7bc7740 1 client.7791 shutdown 2024-09-13T18:35:56.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/1661649606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 msgr2=0x2084610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dd7bc7740 1 --2- 172.21.15.44:0/1661649606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x2084610 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8051d30 tx=0x7f0dc8013000 comp rx=0 tx=0).stop 2024-09-13T18:35:56.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/1661649606 shutdown_connections 2024-09-13T18:35:56.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dd7bc7740 1 --2- 172.21.15.44:0/1661649606 >> [v2:172.21.15.44:6834/1921610909,v1:172.21.15.44:6835/1921610909] conn(0x2041a60 0x2041e40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dd7bc7740 1 --2- 172.21.15.44:0/1661649606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x2084610 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dd7bc7740 1 --2- 172.21.15.44:0/1661649606 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x208c230 0x2046d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dd7bc7740 1 --2- 172.21.15.44:0/1661649606 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x206ae90 0x208ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/1661649606 >> 172.21.15.44:0/1661649606 conn(0x1dd44d0 msgr2=0x2085230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:56.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dad7fa700 0 client.7791 ms_handle_reset on v2:172.21.15.44:6834/1921610909 2024-09-13T18:35:56.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/1661649606 shutdown_connections 2024-09-13T18:35:56.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/1661649606 wait complete. 2024-09-13T18:35:56.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.084+0000 7f0dd7bc7740 20 client.7791 trim_cache size 0 max 16384 2024-09-13T18:35:56.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dd7bc7740 1 Processor -- start 2024-09-13T18:35:56.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dd7bc7740 1 -- start start 2024-09-13T18:35:56.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dd7bc7740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x206ae90 0x208b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dd7bc7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x208c230 0x20566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dd7bc7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x2044360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dd7bc7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f6be70 con 0x208cb50 2024-09-13T18:35:56.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dd7bc7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f6f0e0 con 0x208c230 2024-09-13T18:35:56.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dd7bc7740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f55020 con 0x206ae90 2024-09-13T18:35:56.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dced9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x2044360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dced9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x2044360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49976/0 (socket says 172.21.15.44:49976) 2024-09-13T18:35:56.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dced9d700 1 -- 172.21.15.44:0/3019939221 learned_addr learned my addr 172.21.15.44:0/3019939221 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:56.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dcdd9b700 1 --2- 172.21.15.44:0/3019939221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x208c230 0x20566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dce59c700 1 --2- 172.21.15.44:0/3019939221 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x206ae90 0x208b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dced9d700 1 -- 172.21.15.44:0/3019939221 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x206ae90 msgr2=0x208b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:56.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dced9d700 1 --2- 172.21.15.44:0/3019939221 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x206ae90 0x208b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dced9d700 1 -- 172.21.15.44:0/3019939221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x208c230 msgr2=0x20566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:56.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dced9d700 1 --2- 172.21.15.44:0/3019939221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x208c230 0x20566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dced9d700 1 -- 172.21.15.44:0/3019939221 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1f59450 con 0x208cb50 2024-09-13T18:35:56.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dcdd9b700 1 --2- 172.21.15.44:0/3019939221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x208c230 0x20566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:56.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dce59c700 1 --2- 172.21.15.44:0/3019939221 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x206ae90 0x208b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:56.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dced9d700 1 --2- 172.21.15.44:0/3019939221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x2044360 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8055e90 tx=0x7f0dc8070040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dbe9564df8be92 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:56.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dbcff9700 1 -- 172.21.15.44:0/3019939221 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8055fb0 con 0x208cb50 2024-09-13T18:35:56.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dbcff9700 1 -- 172.21.15.44:0/3019939221 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc80721c0 con 0x208cb50 2024-09-13T18:35:56.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dbcff9700 1 -- 172.21.15.44:0/3019939221 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8059660 con 0x208cb50 2024-09-13T18:35:56.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/3019939221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 msgr2=0x2044360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dd7bc7740 1 --2- 172.21.15.44:0/3019939221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x2044360 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8055e90 tx=0x7f0dc8070040 comp rx=0 tx=0).stop 2024-09-13T18:35:56.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/3019939221 shutdown_connections 2024-09-13T18:35:56.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dd7bc7740 1 --2- 172.21.15.44:0/3019939221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x2044360 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dd7bc7740 1 --2- 172.21.15.44:0/3019939221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x208c230 0x20566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dd7bc7740 1 --2- 172.21.15.44:0/3019939221 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x206ae90 0x208b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/3019939221 >> 172.21.15.44:0/3019939221 conn(0x1dd44d0 msgr2=0x2055fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:56.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/3019939221 shutdown_connections 2024-09-13T18:35:56.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/3019939221 wait complete. 2024-09-13T18:35:56.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dd7bc7740 1 -- start start 2024-09-13T18:35:56.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.108+0000 7f0dd7bc7740 1 Processor -- start 2024-09-13T18:35:56.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dd7bc7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x206ae90 0x2091a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dd7bc7740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x208c230 0x2090ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dd7bc7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x20ec450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dd7bc7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x2092260 con 0x208cb50 2024-09-13T18:35:56.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dd7bc7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x206a800 con 0x206ae90 2024-09-13T18:35:56.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dd7bc7740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x2092450 con 0x208c230 2024-09-13T18:35:56.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dd7bc7740 10 client.0 _ll_register_callbacks cb 0x1f5ece0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:35:56.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dced9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x20ec450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dced9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x20ec450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49988/0 (socket says 172.21.15.44:49988) 2024-09-13T18:35:56.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dced9d700 1 -- 172.21.15.44:0/3711334816 learned_addr learned my addr 172.21.15.44:0/3711334816 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:56.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dcdd9b700 1 --2- 172.21.15.44:0/3711334816 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x208c230 0x2090ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dce59c700 1 --2- 172.21.15.44:0/3711334816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x206ae90 0x2091a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dced9d700 1 -- 172.21.15.44:0/3711334816 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x208c230 msgr2=0x2090ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:56.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dced9d700 1 --2- 172.21.15.44:0/3711334816 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x208c230 0x2090ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dced9d700 1 -- 172.21.15.44:0/3711334816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x206ae90 msgr2=0x2091a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:56.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dced9d700 1 --2- 172.21.15.44:0/3711334816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x206ae90 0x2091a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dced9d700 1 -- 172.21.15.44:0/3711334816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1f73220 con 0x208cb50 2024-09-13T18:35:56.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dced9d700 1 --2- 172.21.15.44:0/3711334816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x20ec450 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8051d30 tx=0x7f0dc8058000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58417b5a050e1724 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:56.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-13T18:35:56.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dad7fa700 1 -- 172.21.15.44:0/3711334816 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8055fb0 con 0x208cb50 2024-09-13T18:35:56.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dad7fa700 1 -- 172.21.15.44:0/3711334816 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0dc8059660 con 0x208cb50 2024-09-13T18:35:56.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/3711334816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0dc805dc20 con 0x208cb50 2024-09-13T18:35:56.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dad7fa700 1 -- 172.21.15.44:0/3711334816 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0dc8051620 con 0x208cb50 2024-09-13T18:35:56.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dd7bc7740 10 client.7797 fetch_fsmap learned FSMap version 70 2024-09-13T18:35:56.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/3711334816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x1f4d720 con 0x208cb50 2024-09-13T18:35:56.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dad7fa700 1 -- 172.21.15.44:0/3711334816 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc805dc20 con 0x208cb50 2024-09-13T18:35:56.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dad7fa700 1 -- 172.21.15.44:0/3711334816 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f0dc8051780 con 0x208cb50 2024-09-13T18:35:56.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dd7bc7740 10 client.7797 fetch_fsmap finished waiting for FSMap version 70 2024-09-13T18:35:56.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dd7bc7740 10 client.7797 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:35:56.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dd7bc7740 20 client.7797 populate_metadata read hostname 'smithi044' 2024-09-13T18:35:56.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dd7bc7740 1 --2- 172.21.15.44:0/3711334816 >> [v2:172.21.15.44:6834/1921610909,v1:172.21.15.44:6835/1921610909] conn(0x20ed6e0 0x20edac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dd7bc7740 4 client.7797 mds_command: new command op to 7626 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:35:56.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/3711334816 --> [v2:172.21.15.44:6834/1921610909,v1:172.21.15.44:6835/1921610909] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1e501e0 con 0x20ed6e0 2024-09-13T18:35:56.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dce59c700 1 --2- 172.21.15.44:0/3711334816 >> [v2:172.21.15.44:6834/1921610909,v1:172.21.15.44:6835/1921610909] conn(0x20ed6e0 0x20edac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dce59c700 1 --2- 172.21.15.44:0/3711334816 >> [v2:172.21.15.44:6834/1921610909,v1:172.21.15.44:6835/1921610909] conn(0x20ed6e0 0x20edac0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68af514ef94aa176 server_cookie=711d30d2226d4ef9 in_seq=0 out_seq=0 2024-09-13T18:35:56.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dad7fa700 10 client.7797 ms_handle_connect on v2:172.21.15.44:6834/1921610909 2024-09-13T18:35:56.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.112+0000 7f0dad7fa700 1 -- 172.21.15.44:0/3711334816 <== mds.0 v2:172.21.15.44:6834/1921610909 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x1e501e0 con 0x20ed6e0 2024-09-13T18:35:56.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dad7fa700 10 client.7797 handle_command_reply: tid=0 2024-09-13T18:35:56.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dd7bc7740 1 client.7797 shutdown 2024-09-13T18:35:56.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/3711334816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 msgr2=0x20ec450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dd7bc7740 1 --2- 172.21.15.44:0/3711334816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x20ec450 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8051d30 tx=0x7f0dc8058000 comp rx=0 tx=0).stop 2024-09-13T18:35:56.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/3711334816 shutdown_connections 2024-09-13T18:35:56.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dd7bc7740 1 --2- 172.21.15.44:0/3711334816 >> [v2:172.21.15.44:6834/1921610909,v1:172.21.15.44:6835/1921610909] conn(0x20ed6e0 0x20edac0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dd7bc7740 1 --2- 172.21.15.44:0/3711334816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x208cb50 0x20ec450 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dd7bc7740 1 --2- 172.21.15.44:0/3711334816 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x208c230 0x2090ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dd7bc7740 1 --2- 172.21.15.44:0/3711334816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x206ae90 0x2091a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dad7fa700 0 client.7797 ms_handle_reset on v2:172.21.15.44:6834/1921610909 2024-09-13T18:35:56.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/3711334816 >> 172.21.15.44:0/3711334816 conn(0x1dd44d0 msgr2=0x2041130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:56.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/3711334816 shutdown_connections 2024-09-13T18:35:56.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dd7bc7740 1 -- 172.21.15.44:0/3711334816 wait complete. 2024-09-13T18:35:56.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dd7bc7740 20 client.7797 trim_cache size 0 max 16384 2024-09-13T18:35:56.126 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:35:56.126 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "c8e1d12d-7fb9-4a33-982e-b895bb77262c", 2024-09-13T18:35:56.126 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-13T18:35:56.126 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 7626, 2024-09-13T18:35:56.126 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-13T18:35:56.126 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-13T18:35:56.126 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-13T18:35:56.126 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 10.271464091, 2024-09-13T18:35:56.126 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 70, 2024-09-13T18:35:56.126 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 78, 2024-09-13T18:35:56.127 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 78, 2024-09-13T18:35:56.127 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 14.769218405 2024-09-13T18:35:56.127 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:35:56.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dcf59e700 1 -- 172.21.15.44:0/408902679 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0db0066760 msgr2=0x7f0db0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dcf59e700 1 --2- 172.21.15.44:0/408902679 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0db0066760 0x7f0db0068c20 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4000c00 tx=0x7f0dc4008030 comp rx=0 tx=0).stop 2024-09-13T18:35:56.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dcf59e700 1 -- 172.21.15.44:0/408902679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dd015a630 msgr2=0x7f0dd00ace00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dcf59e700 1 --2- 172.21.15.44:0/408902679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dd015a630 0x7f0dd00ace00 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f0dc800efc0 tx=0x7f0dc800c0c0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dcf59e700 1 -- 172.21.15.44:0/408902679 shutdown_connections 2024-09-13T18:35:56.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dcf59e700 1 --2- 172.21.15.44:0/408902679 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0db0066760 0x7f0db0068c20 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dcf59e700 1 --2- 172.21.15.44:0/408902679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dd015a630 0x7f0dd00ace00 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dcf59e700 1 --2- 172.21.15.44:0/408902679 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0dd01573e0 0x7f0dd00ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dcf59e700 1 --2- 172.21.15.44:0/408902679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dd00710e0 0x7f0dd0143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dcf59e700 1 -- 172.21.15.44:0/408902679 >> 172.21.15.44:0/408902679 conn(0x7f0dd00b0e10 msgr2=0x7f0dd00ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:56.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dcf59e700 1 -- 172.21.15.44:0/408902679 shutdown_connections 2024-09-13T18:35:56.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.116+0000 7f0dcf59e700 1 -- 172.21.15.44:0/408902679 wait complete. 2024-09-13T18:35:56.136 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:35:56.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.252+0000 7fd35ffff700 1 Processor -- start 2024-09-13T18:35:56.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.252+0000 7fd35ffff700 1 -- start start 2024-09-13T18:35:56.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.252+0000 7fd35ffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd36006bbf0 0x7fd3600b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.252+0000 7fd35ffff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd36013dcb0 con 0x7fd3600b3910 2024-09-13T18:35:56.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.252+0000 7fd35ffff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd36015be60 con 0x7fd36006acc0 2024-09-13T18:35:56.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.252+0000 7fd35ffff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd36006b130 con 0x7fd36006bbf0 2024-09-13T18:35:56.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.252+0000 7fd35effd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd36006bbf0 0x7fd3600b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.252+0000 7fd35e7fc700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd3600b3910 0x7fd36006a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43234/0 (socket says 172.21.15.44:43234) 2024-09-13T18:35:56.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.252+0000 7fd35e7fc700 1 -- 172.21.15.44:0/2267793535 learned_addr learned my addr 172.21.15.44:0/2267793535 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:56.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.252+0000 7fd35effd700 1 -- 172.21.15.44:0/2267793535 >> v1:172.21.15.99:6789/0 conn(0x7fd36006acc0 legacy=0x7fd36015e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.252+0000 7fd35effd700 1 -- 172.21.15.44:0/2267793535 >> v1:172.21.15.44:6789/0 conn(0x7fd3600b3910 legacy=0x7fd36006a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.252+0000 7fd35dffb700 1 -- 172.21.15.44:0/2267793535 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231720705 0 0) 0x7fd36013dcb0 con 0x7fd3600b3910 2024-09-13T18:35:56.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.252+0000 7fd35effd700 1 -- 172.21.15.44:0/2267793535 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3600b3d70 con 0x7fd36006bbf0 2024-09-13T18:35:56.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.252+0000 7fd35effd700 1 --2- 172.21.15.44:0/2267793535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd36006bbf0 0x7fd3600b33d0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fd354009850 tx=0x7fd354009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5928569b6c9b18 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:56.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.252+0000 7fd35dffb700 1 -- 172.21.15.44:0/2267793535 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd354011830 con 0x7fd36006bbf0 2024-09-13T18:35:56.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.252+0000 7fd35dffb700 1 -- 172.21.15.44:0/2267793535 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd354011990 con 0x7fd36006bbf0 2024-09-13T18:35:56.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.252+0000 7fd35dffb700 1 -- 172.21.15.44:0/2267793535 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd354011d20 con 0x7fd36006bbf0 2024-09-13T18:35:56.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.252+0000 7fd35ffff700 1 -- 172.21.15.44:0/2267793535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd36006bbf0 msgr2=0x7fd3600b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.252+0000 7fd35ffff700 1 --2- 172.21.15.44:0/2267793535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd36006bbf0 0x7fd3600b33d0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fd354009850 tx=0x7fd354009b60 comp rx=0 tx=0).stop 2024-09-13T18:35:56.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.252+0000 7fd35ffff700 1 -- 172.21.15.44:0/2267793535 shutdown_connections 2024-09-13T18:35:56.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.252+0000 7fd35ffff700 1 --2- 172.21.15.44:0/2267793535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd36006bbf0 0x7fd3600b33d0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.252+0000 7fd35ffff700 1 -- 172.21.15.44:0/2267793535 >> 172.21.15.44:0/2267793535 conn(0x7fd3600b0f00 msgr2=0x7fd3600b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:56.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.252+0000 7fd35ffff700 1 -- 172.21.15.44:0/2267793535 shutdown_connections 2024-09-13T18:35:56.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.256+0000 7fd35ffff700 1 -- 172.21.15.44:0/2267793535 wait complete. 2024-09-13T18:35:56.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.256+0000 7fd35ffff700 1 Processor -- start 2024-09-13T18:35:56.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.256+0000 7fd35ffff700 1 -- start start 2024-09-13T18:35:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.256+0000 7fd35ffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd36006acc0 0x7fd360157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.256+0000 7fd35ffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd36006bbf0 0x7fd3601e5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.256+0000 7fd35ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3600b3910 0x7fd3601e5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.256+0000 7fd35ffff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd360142de0 con 0x7fd3600b3910 2024-09-13T18:35:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.256+0000 7fd35ffff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd360143bb0 con 0x7fd36006acc0 2024-09-13T18:35:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.256+0000 7fd35ffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd360143030 con 0x7fd36006bbf0 2024-09-13T18:35:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.256+0000 7fd35f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3600b3910 0x7fd3601e5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.256+0000 7fd35f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3600b3910 0x7fd3601e5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50018/0 (socket says 172.21.15.44:50018) 2024-09-13T18:35:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.256+0000 7fd35f7fe700 1 -- 172.21.15.44:0/2998426429 learned_addr learned my addr 172.21.15.44:0/2998426429 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.260+0000 7fd35e7fc700 1 --2- 172.21.15.44:0/2998426429 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd36006bbf0 0x7fd3601e5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.260+0000 7fd35effd700 1 --2- 172.21.15.44:0/2998426429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd36006acc0 0x7fd360157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.260+0000 7fd35f7fe700 1 -- 172.21.15.44:0/2998426429 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd36006bbf0 msgr2=0x7fd3601e5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.260+0000 7fd35f7fe700 1 --2- 172.21.15.44:0/2998426429 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd36006bbf0 0x7fd3601e5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.260+0000 7fd35f7fe700 1 -- 172.21.15.44:0/2998426429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd36006acc0 msgr2=0x7fd360157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.260+0000 7fd35f7fe700 1 --2- 172.21.15.44:0/2998426429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd36006acc0 0x7fd360157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.260+0000 7fd35f7fe700 1 -- 172.21.15.44:0/2998426429 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3540094b0 con 0x7fd3600b3910 2024-09-13T18:35:56.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.260+0000 7fd35e7fc700 1 --2- 172.21.15.44:0/2998426429 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd36006bbf0 0x7fd3601e5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:56.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.260+0000 7fd35f7fe700 1 --2- 172.21.15.44:0/2998426429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3600b3910 0x7fd3601e5650 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fd35800c480 tx=0x7fd35800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:56.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.260+0000 7fd3477fe700 1 -- 172.21.15.44:0/2998426429 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3580052d0 con 0x7fd3600b3910 2024-09-13T18:35:56.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.260+0000 7fd35ffff700 1 -- 172.21.15.44:0/2998426429 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd360143310 con 0x7fd3600b3910 2024-09-13T18:35:56.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.260+0000 7fd3477fe700 1 -- 172.21.15.44:0/2998426429 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd358005430 con 0x7fd3600b3910 2024-09-13T18:35:56.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.260+0000 7fd3477fe700 1 -- 172.21.15.44:0/2998426429 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3580055a0 con 0x7fd3600b3910 2024-09-13T18:35:56.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.260+0000 7fd35ffff700 1 -- 172.21.15.44:0/2998426429 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3601438d0 con 0x7fd3600b3910 2024-09-13T18:35:56.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.260+0000 7fd35ffff700 1 -- 172.21.15.44:0/2998426429 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36013ff50 con 0x7fd3600b3910 2024-09-13T18:35:56.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.264+0000 7fd3477fe700 1 -- 172.21.15.44:0/2998426429 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd3580038e0 con 0x7fd3600b3910 2024-09-13T18:35:56.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.264+0000 7fd3477fe700 1 --2- 172.21.15.44:0/2998426429 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd34c066730 0x7fd34c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.264+0000 7fd3477fe700 1 -- 172.21.15.44:0/2998426429 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd358083650 con 0x7fd3600b3910 2024-09-13T18:35:56.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.264+0000 7fd35effd700 1 --2- 172.21.15.44:0/2998426429 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd34c066730 0x7fd34c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.264+0000 7fd35effd700 1 --2- 172.21.15.44:0/2998426429 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd34c066730 0x7fd34c068bf0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd3540090b0 tx=0x7fd354008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:56.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.272+0000 7fd3477fe700 1 -- 172.21.15.44:0/2998426429 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd3580509d0 con 0x7fd3600b3910 2024-09-13T18:35:56.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.472+0000 7fd35ffff700 1 -- 172.21.15.44:0/2998426429 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd360140ac0 con 0x7fd3600b3910 2024-09-13T18:35:56.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.476+0000 7fd3477fe700 1 -- 172.21.15.44:0/2998426429 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v70) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd358053ff0 con 0x7fd3600b3910 2024-09-13T18:35:56.485 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:35:56.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.476+0000 7fd35ffff700 1 -- 172.21.15.44:0/2998426429 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd34c066730 msgr2=0x7fd34c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.476+0000 7fd35ffff700 1 --2- 172.21.15.44:0/2998426429 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd34c066730 0x7fd34c068bf0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd3540090b0 tx=0x7fd354008030 comp rx=0 tx=0).stop 2024-09-13T18:35:56.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.476+0000 7fd35ffff700 1 -- 172.21.15.44:0/2998426429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3600b3910 msgr2=0x7fd3601e5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.476+0000 7fd35ffff700 1 --2- 172.21.15.44:0/2998426429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3600b3910 0x7fd3601e5650 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fd35800c480 tx=0x7fd35800c840 comp rx=0 tx=0).stop 2024-09-13T18:35:56.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.476+0000 7fd35ffff700 1 -- 172.21.15.44:0/2998426429 shutdown_connections 2024-09-13T18:35:56.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.476+0000 7fd35ffff700 1 --2- 172.21.15.44:0/2998426429 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd34c066730 0x7fd34c068bf0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.476+0000 7fd35ffff700 1 --2- 172.21.15.44:0/2998426429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3600b3910 0x7fd3601e5650 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.476+0000 7fd35ffff700 1 --2- 172.21.15.44:0/2998426429 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd36006bbf0 0x7fd3601e5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.476+0000 7fd35ffff700 1 --2- 172.21.15.44:0/2998426429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd36006acc0 0x7fd360157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.476+0000 7fd35ffff700 1 -- 172.21.15.44:0/2998426429 >> 172.21.15.44:0/2998426429 conn(0x7fd3600b0f00 msgr2=0x7fd3600cd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:56.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.476+0000 7fd35ffff700 1 -- 172.21.15.44:0/2998426429 shutdown_connections 2024-09-13T18:35:56.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:56.476+0000 7fd35ffff700 1 -- 172.21.15.44:0/2998426429 wait complete. 2024-09-13T18:35:56.496 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:35:56.496 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:35:56.497 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-13T18:35:56.497 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:35:56.497 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:35:56.497 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:35:56.497 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:35:56.497 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:35:56.497 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:35:56.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:56.498 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-13T18:35:56.505 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:35:56.506 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:35:56.506 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:35:56.506 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:35:56.506 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-13T18:35:56.506 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:35:56.506 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:35:56.506 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-13T18:35:56.506 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:35:56.506 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:35:56.506 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:35:56.506 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:35:56.507 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:35:56.507 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42067sec preferred_lft 42067sec 2024-09-13T18:35:56.507 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-13T18:35:56.507 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:35:56.507 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:35:56.507 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:35:56.507 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:35:56.507 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:80:b2:e4:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:35:56.507 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:35:56.507 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:35:56.507 INFO:teuthology.orchestra.run.smithi044.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:35:56.507 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 2e:69:eb:1c:57:57 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:35:56.507 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:35:56.508 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:35:56.508 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::8842:91ff:feed:2c53/64 scope link 2024-09-13T18:35:56.508 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:35:56.508 INFO:teuthology.orchestra.run.smithi044.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:35:56.508 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 2e:69:eb:1c:57:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:35:56.508 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::2c69:ebff:fe1c:5757/64 scope link 2024-09-13T18:35:56.508 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:35:56.508 INFO:teuthology.orchestra.run.smithi044.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:35:56.508 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 86:e5:07:ac:f1:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:35:56.508 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::84e5:7ff:feac:f11b/64 scope link 2024-09-13T18:35:56.508 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:35:56.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:56.509 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:35:56.522 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-13T18:35:56.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:56.524 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-13T18:35:56.578 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-13T18:35:56.578 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:35:56.578 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:35:56.578 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:35:56.578 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:35:56.578 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:35:56.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:56.578 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2024-09-13T18:35:56.579 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-13T18:35:56.579 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:35:56.579 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:35:56.579 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:35:56.579 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-13T18:35:56.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:56.619 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-13T18:35:56.625 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:35:56.626 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:35:56.626 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:35:56.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:56.626 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-13T18:35:56.685 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:35:56.685 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:35:56.685 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:35:56.691 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:35:56.691 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:35:56.691 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:35:56.697 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:35:56.758 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:35:56.758 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:35:56.772 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:35:56.773 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:35:56.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:56.773 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:35:56.780 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:35:56.780 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:35:56.826 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:35:56.846 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:35:56.847 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:35:56.855 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:35:56.856 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:35:56.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:56.857 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:35:56.922 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2024-09-13T18:35:56.916+0000 7fed06f88640 -1 init, newargv = 0x564c856a4a70 newargc=15 2024-09-13T18:35:56.922 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[46486]: starting ceph client 2024-09-13T18:35:56.930 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[46486]: starting fuse 2024-09-13T18:35:57.964 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:35:57.982 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:35:57.982 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:35:58.039 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:35:58.040 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:35:58.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:58.040 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:35:58.048 INFO:teuthology.orchestra.run.smithi044.stdout:52 2024-09-13T18:35:58.048 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T18:35:58.048 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:35:58.048 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2024-09-13T18:35:58.048 DEBUG:teuthology.orchestra.run.smithi044:> import re 2024-09-13T18:35:58.048 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:35:58.049 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2024-09-13T18:35:58.049 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:35:58.049 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2024-09-13T18:35:58.049 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:35:58.049 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2024-09-13T18:35:58.049 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:35:58.049 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:35:58.049 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2024-09-13T18:35:58.049 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2024-09-13T18:35:58.049 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2024-09-13T18:35:58.049 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2024-09-13T18:35:58.049 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:35:58.049 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2024-09-13T18:35:58.049 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:35:58.049 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:35:58.050 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:35:58.050 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2024-09-13T18:35:58.050 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2024-09-13T18:35:58.050 DEBUG:teuthology.orchestra.run.smithi044:> return f 2024-09-13T18:35:58.050 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:35:58.050 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:35:58.050 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.0")) 2024-09-13T18:35:58.050 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:35:58.134 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.0.46486.asok 2024-09-13T18:35:58.318 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46486.asok 2024-09-13T18:35:58.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:58.318 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46486.asok status 2024-09-13T18:35:58.465 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:35:58.465 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2024-09-13T18:35:58.465 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:35:58.465 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:35:58.466 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "0", 2024-09-13T18:35:58.466 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2024-09-13T18:35:58.466 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:35:58.466 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "46486", 2024-09-13T18:35:58.466 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2024-09-13T18:35:58.466 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:58.466 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2024-09-13T18:35:58.466 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2024-09-13T18:35:58.466 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 7815, 2024-09-13T18:35:58.466 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2024-09-13T18:35:58.466 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2024-09-13T18:35:58.466 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2024-09-13T18:35:58.467 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 7815 2024-09-13T18:35:58.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:58.467 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:35:58.467 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-13T18:35:58.467 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:35:58.467 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3808762181 2024-09-13T18:35:58.467 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:58.468 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:58.468 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:35:58.468 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-13T18:35:58.468 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:35:58.468 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3808762181 2024-09-13T18:35:58.468 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:58.468 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.7815 192.168.0.1:0/3808762181", 2024-09-13T18:35:58.468 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/3808762181", 2024-09-13T18:35:58.468 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2024-09-13T18:35:58.468 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 70, 2024-09-13T18:35:58.469 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 78, 2024-09-13T18:35:58.469 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:35:58.469 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2024-09-13T18:35:58.469 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2024-09-13T18:35:58.469 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:35:58.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:58.477 DEBUG:teuthology.orchestra.run.smithi044:> stat --file-system '--printf=%T 2024-09-13T18:35:58.478 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:35:58.500 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2024-09-13T18:35:58.500 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:35:58.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:58.501 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:35:58.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:58.562 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch foo) 2024-09-13T18:35:58.593 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:35:58.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.752+0000 7f11dbfff700 1 Processor -- start 2024-09-13T18:35:58.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.752+0000 7f11dbfff700 1 -- start start 2024-09-13T18:35:58.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11dbfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f11dc165590 0x7f11dc1619a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:58.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11dbfff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11dc071f30 con 0x7f11dc0b3ae0 2024-09-13T18:35:58.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11dbfff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11dc1622e0 con 0x7f11dc160eb0 2024-09-13T18:35:58.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11dbfff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc162000 con 0x7f11dc165590 2024-09-13T18:35:58.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11da7fc700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f11dc0b3ae0 0x7f11dc161290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43242/0 (socket says 172.21.15.44:43242) 2024-09-13T18:35:58.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11da7fc700 1 -- 172.21.15.44:0/111220293 learned_addr learned my addr 172.21.15.44:0/111220293 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:35:58.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11db7fe700 1 --2- 172.21.15.44:0/111220293 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f11dc165590 0x7f11dc1619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:58.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11d9ffb700 1 -- 172.21.15.44:0/111220293 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1045221675 0 0) 0x7f11dc071f30 con 0x7f11dc0b3ae0 2024-09-13T18:35:58.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11d9ffb700 1 -- 172.21.15.44:0/111220293 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11c40035d0 con 0x7f11dc0b3ae0 2024-09-13T18:35:58.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11d9ffb700 1 -- 172.21.15.44:0/111220293 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1999365867 0 0) 0x7f11c40035d0 con 0x7f11dc0b3ae0 2024-09-13T18:35:58.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11d9ffb700 1 -- 172.21.15.44:0/111220293 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f11dc165590 msgr2=0x7f11dc1619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:58.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11d9ffb700 1 --2- 172.21.15.44:0/111220293 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f11dc165590 0x7f11dc1619a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:58.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11d9ffb700 1 -- 172.21.15.44:0/111220293 >> v1:172.21.15.99:6789/0 conn(0x7f11dc160eb0 legacy=0x7f11dc0b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:58.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11d9ffb700 1 -- 172.21.15.44:0/111220293 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc164ab0 con 0x7f11dc0b3ae0 2024-09-13T18:35:58.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11d9ffb700 1 -- 172.21.15.44:0/111220293 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f11d00019f0 con 0x7f11dc0b3ae0 2024-09-13T18:35:58.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11d9ffb700 1 -- 172.21.15.44:0/111220293 >> v1:172.21.15.44:6789/0 conn(0x7f11dc0b3ae0 legacy=0x7f11dc161290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:58.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11d9ffb700 1 --2- 172.21.15.44:0/111220293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11c4003a50 0x7f11c4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:58.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11d9ffb700 1 --2- 172.21.15.44:0/111220293 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f11dc165590 0x7f11c4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:58.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11d9ffb700 1 --2- 172.21.15.44:0/111220293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11c4004db0 0x7f11c4005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:58.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11d9ffb700 1 -- 172.21.15.44:0/111220293 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc162000 con 0x7f11c4003a50 2024-09-13T18:35:58.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11d9ffb700 1 -- 172.21.15.44:0/111220293 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c400ba30 con 0x7f11c4004db0 2024-09-13T18:35:58.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11d9ffb700 1 -- 172.21.15.44:0/111220293 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c400bbf0 con 0x7f11dc165590 2024-09-13T18:35:58.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11daffd700 1 --2- 172.21.15.44:0/111220293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11c4003a50 0x7f11c4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:58.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11da7fc700 1 --2- 172.21.15.44:0/111220293 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f11dc165590 0x7f11c4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:58.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11db7fe700 1 --2- 172.21.15.44:0/111220293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11c4004db0 0x7f11c4005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:58.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11daffd700 1 -- 172.21.15.44:0/111220293 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f11dc165590 msgr2=0x7f11c4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:58.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11daffd700 1 --2- 172.21.15.44:0/111220293 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f11dc165590 0x7f11c4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:58.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11daffd700 1 -- 172.21.15.44:0/111220293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11c4004db0 msgr2=0x7f11c4005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:58.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11daffd700 1 --2- 172.21.15.44:0/111220293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11c4004db0 0x7f11c4005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:58.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11daffd700 1 -- 172.21.15.44:0/111220293 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c40035d0 con 0x7f11c4003a50 2024-09-13T18:35:58.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11daffd700 1 --2- 172.21.15.44:0/111220293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11c4003a50 0x7f11c4003e30 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0018f0 tx=0x7f11c40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e69ac6abdc7ad50 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:58.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11d9ffb700 1 -- 172.21.15.44:0/111220293 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc001390 con 0x7f11c4003a50 2024-09-13T18:35:58.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11d9ffb700 1 -- 172.21.15.44:0/111220293 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11cc012620 con 0x7f11c4003a50 2024-09-13T18:35:58.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11d9ffb700 1 -- 172.21.15.44:0/111220293 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc0129d0 con 0x7f11c4003a50 2024-09-13T18:35:58.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11dbfff700 1 -- 172.21.15.44:0/111220293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11c4003a50 msgr2=0x7f11c4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:58.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11dbfff700 1 --2- 172.21.15.44:0/111220293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11c4003a50 0x7f11c4003e30 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0018f0 tx=0x7f11c40058a0 comp rx=0 tx=0).stop 2024-09-13T18:35:58.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11db7fe700 1 -- 172.21.15.44:0/111220293 reap_dead start 2024-09-13T18:35:58.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11dbfff700 1 -- 172.21.15.44:0/111220293 shutdown_connections 2024-09-13T18:35:58.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11dbfff700 1 -- 172.21.15.44:0/111220293 >> 172.21.15.44:0/111220293 conn(0x7f11dc0b0f00 msgr2=0x7f11dc0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:58.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11dbfff700 1 -- 172.21.15.44:0/111220293 shutdown_connections 2024-09-13T18:35:58.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.756+0000 7f11dbfff700 1 -- 172.21.15.44:0/111220293 wait complete. 2024-09-13T18:35:58.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.760+0000 7f11dbfff700 1 Processor -- start 2024-09-13T18:35:58.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.760+0000 7f11dbfff700 1 -- start start 2024-09-13T18:35:58.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.760+0000 7f11dbfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11c4003a50 0x7f11dc06ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:58.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.760+0000 7f11dbfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f11dc15f4a0 0x7f11dc15f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:58.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.760+0000 7f11dbfff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11dc1f9d30 0x7f11dc1fa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:58.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.760+0000 7f11dbfff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc1fa6f0 con 0x7f11c4003a50 2024-09-13T18:35:58.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.760+0000 7f11dbfff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc0cc3b0 con 0x7f11dc1f9d30 2024-09-13T18:35:58.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.760+0000 7f11dbfff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc0cc690 con 0x7f11dc15f4a0 2024-09-13T18:35:58.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.760+0000 7f11daffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11c4003a50 0x7f11dc06ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:58.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.760+0000 7f11daffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11c4003a50 0x7f11dc06ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50030/0 (socket says 172.21.15.44:50030) 2024-09-13T18:35:58.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.760+0000 7f11daffd700 1 -- 172.21.15.44:0/3278011608 learned_addr learned my addr 172.21.15.44:0/3278011608 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:58.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.760+0000 7f11da7fc700 1 --2- 172.21.15.44:0/3278011608 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f11dc15f4a0 0x7f11dc15f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:58.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.760+0000 7f11db7fe700 1 --2- 172.21.15.44:0/3278011608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11dc1f9d30 0x7f11dc1fa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:58.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.760+0000 7f11daffd700 1 -- 172.21.15.44:0/3278011608 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f11dc15f4a0 msgr2=0x7f11dc15f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:58.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.760+0000 7f11daffd700 1 --2- 172.21.15.44:0/3278011608 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f11dc15f4a0 0x7f11dc15f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:58.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.760+0000 7f11daffd700 1 -- 172.21.15.44:0/3278011608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11dc1f9d30 msgr2=0x7f11dc1fa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:58.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.760+0000 7f11daffd700 1 --2- 172.21.15.44:0/3278011608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11dc1f9d30 0x7f11dc1fa1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:58.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.760+0000 7f11daffd700 1 -- 172.21.15.44:0/3278011608 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc0cc970 con 0x7f11c4003a50 2024-09-13T18:35:58.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.764+0000 7f11daffd700 1 --2- 172.21.15.44:0/3278011608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11c4003a50 0x7f11dc06ce10 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f11cc000c00 tx=0x7f11cc001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:58.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.764+0000 7f11c37fe700 1 -- 172.21.15.44:0/3278011608 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc006a90 con 0x7f11c4003a50 2024-09-13T18:35:58.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.764+0000 7f11c37fe700 1 -- 172.21.15.44:0/3278011608 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11cc006bf0 con 0x7f11c4003a50 2024-09-13T18:35:58.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.764+0000 7f11dbfff700 1 -- 172.21.15.44:0/3278011608 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11dc0ccc50 con 0x7f11c4003a50 2024-09-13T18:35:58.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.764+0000 7f11c37fe700 1 -- 172.21.15.44:0/3278011608 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc012790 con 0x7f11c4003a50 2024-09-13T18:35:58.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.764+0000 7f11dbfff700 1 -- 172.21.15.44:0/3278011608 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11dc1fab10 con 0x7f11c4003a50 2024-09-13T18:35:58.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.764+0000 7f11dbfff700 1 -- 172.21.15.44:0/3278011608 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11dc161290 con 0x7f11c4003a50 2024-09-13T18:35:58.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.764+0000 7f11c37fe700 1 -- 172.21.15.44:0/3278011608 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f11cc023070 con 0x7f11c4003a50 2024-09-13T18:35:58.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.768+0000 7f11c37fe700 1 --2- 172.21.15.44:0/3278011608 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f11c8066730 0x7f11c8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:58.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.768+0000 7f11c37fe700 1 -- 172.21.15.44:0/3278011608 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11cc085880 con 0x7f11c4003a50 2024-09-13T18:35:58.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.768+0000 7f11da7fc700 1 --2- 172.21.15.44:0/3278011608 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f11c8066730 0x7f11c8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:58.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.768+0000 7f11da7fc700 1 --2- 172.21.15.44:0/3278011608 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f11c8066730 0x7f11c8068bf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f11dc15f430 tx=0x7f11d0006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:58.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.772+0000 7f11c37fe700 1 -- 172.21.15.44:0/3278011608 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f11cc052d60 con 0x7f11c4003a50 2024-09-13T18:35:58.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.984+0000 7f11dbfff700 1 -- 172.21.15.44:0/3278011608 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11dc15d0c0 con 0x7f11c4003a50 2024-09-13T18:35:58.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.984+0000 7f11c37fe700 1 -- 172.21.15.44:0/3278011608 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f11cc056380 con 0x7f11c4003a50 2024-09-13T18:35:58.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:58.990 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":70,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3463035694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3463035694},{"type":"v1","addr":"172.21.15.99:6837","nonce":3463035694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7438,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2910652037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2910652037},{"type":"v1","addr":"172.21.15.44:6833","nonce":2910652037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7456,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2231812307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2231812307},{"type":"v1","addr":"172.21.15.99:6835","nonce":2231812307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:35:45.841782+0000","modified":"2024-09-13T18:35:48.860780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7626},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7626":{"gid":7626,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/1921610909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1921610909},{"type":"v1","addr":"172.21.15.44:6835","nonce":1921610909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:35:58.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.988+0000 7f11dbfff700 1 -- 172.21.15.44:0/3278011608 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f11c8066730 msgr2=0x7f11c8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:58.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.988+0000 7f11dbfff700 1 --2- 172.21.15.44:0/3278011608 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f11c8066730 0x7f11c8068bf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f11dc15f430 tx=0x7f11d0006040 comp rx=0 tx=0).stop 2024-09-13T18:35:58.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.988+0000 7f11dbfff700 1 -- 172.21.15.44:0/3278011608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11c4003a50 msgr2=0x7f11dc06ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:58.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.988+0000 7f11dbfff700 1 --2- 172.21.15.44:0/3278011608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11c4003a50 0x7f11dc06ce10 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f11cc000c00 tx=0x7f11cc001230 comp rx=0 tx=0).stop 2024-09-13T18:35:58.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.988+0000 7f11dbfff700 1 -- 172.21.15.44:0/3278011608 shutdown_connections 2024-09-13T18:35:58.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.988+0000 7f11dbfff700 1 --2- 172.21.15.44:0/3278011608 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f11c8066730 0x7f11c8068bf0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:58.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.988+0000 7f11dbfff700 1 --2- 172.21.15.44:0/3278011608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11dc1f9d30 0x7f11dc1fa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:58.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.988+0000 7f11dbfff700 1 --2- 172.21.15.44:0/3278011608 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f11dc15f4a0 0x7f11dc15f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:58.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.988+0000 7f11dbfff700 1 --2- 172.21.15.44:0/3278011608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11c4003a50 0x7f11dc06ce10 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:58.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.988+0000 7f11dbfff700 1 -- 172.21.15.44:0/3278011608 >> 172.21.15.44:0/3278011608 conn(0x7f11dc0b0f00 msgr2=0x7f11dc163770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:58.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.988+0000 7f11dbfff700 1 -- 172.21.15.44:0/3278011608 shutdown_connections 2024-09-13T18:35:58.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:58.988+0000 7f11dbfff700 1 -- 172.21.15.44:0/3278011608 wait complete. 2024-09-13T18:35:58.997 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 70 2024-09-13T18:35:59.012 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-13T18:35:59.143 INFO:teuthology.orchestra.run.smithi044.stdout:{"message":"","return_code":0} 2024-09-13T18:35:59.143 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-13T18:35:59.144 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show inode 2024-09-13T18:35:59.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.172+0000 7f4bc7ebc500 1 -- start start 2024-09-13T18:35:59.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.172+0000 7f4bc7ebc500 1 Processor -- start 2024-09-13T18:35:59.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.172+0000 7f4bc7ebc500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc4197f800 0x55cc41a24580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.172+0000 7f4bc7ebc500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cc4197f400 0x55cc41a24b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.172+0000 7f4bc7ebc500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4197f000 0x55cc41a25080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.172+0000 7f4bc7ebc500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc41a00640 con 0x55cc4197f000 2024-09-13T18:35:59.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.172+0000 7f4bc7ebc500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc41a00780 con 0x55cc4197f800 2024-09-13T18:35:59.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.172+0000 7f4bc7ebc500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc41a00a00 con 0x55cc4197f400 2024-09-13T18:35:59.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.172+0000 7f4bc6e77700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4197f000 0x55cc41a25080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.172+0000 7f4bc6e77700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4197f000 0x55cc41a25080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50034/0 (socket says 172.21.15.44:50034) 2024-09-13T18:35:59.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.172+0000 7f4bc6e77700 1 -- 172.21.15.44:0/3051673015 learned_addr learned my addr 172.21.15.44:0/3051673015 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.172+0000 7f4bc6676700 1 --2- 172.21.15.44:0/3051673015 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc4197f800 0x55cc41a24580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc5e75700 1 --2- 172.21.15.44:0/3051673015 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cc4197f400 0x55cc41a24b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc6e77700 1 -- 172.21.15.44:0/3051673015 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cc4197f400 msgr2=0x55cc41a24b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc6e77700 1 --2- 172.21.15.44:0/3051673015 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cc4197f400 0x55cc41a24b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc6e77700 1 -- 172.21.15.44:0/3051673015 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc4197f800 msgr2=0x55cc41a24580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc6e77700 1 --2- 172.21.15.44:0/3051673015 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc4197f800 0x55cc41a24580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc6e77700 1 -- 172.21.15.44:0/3051673015 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc419a29c0 con 0x55cc4197f000 2024-09-13T18:35:59.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc5e75700 1 --2- 172.21.15.44:0/3051673015 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cc4197f400 0x55cc41a24b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:59.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc6e77700 1 --2- 172.21.15.44:0/3051673015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4197f000 0x55cc41a25080 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x55cc4274ee70 tx=0x55cc42758000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fa60484fa5560a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc3e71700 1 -- 172.21.15.44:0/3051673015 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cc419cf600 con 0x55cc4197f000 2024-09-13T18:35:59.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc3e71700 1 -- 172.21.15.44:0/3051673015 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cc42770180 con 0x55cc4197f000 2024-09-13T18:35:59.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc3e71700 1 -- 172.21.15.44:0/3051673015 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cc419cf1e0 con 0x55cc4197f000 2024-09-13T18:35:59.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc7ebc500 1 -- 172.21.15.44:0/3051673015 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc419a21a0 con 0x55cc4197f000 2024-09-13T18:35:59.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc7ebc500 1 -- 172.21.15.44:0/3051673015 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55cc419a29c0 con 0x55cc4197f000 2024-09-13T18:35:59.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc7ebc500 4 waiting for MDS map... 2024-09-13T18:35:59.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc3e71700 1 -- 172.21.15.44:0/3051673015 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x55cc419b8c40 con 0x55cc4197f000 2024-09-13T18:35:59.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc3e71700 1 -- 172.21.15.44:0/3051673015 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x55cc419c0f00 con 0x55cc4197f000 2024-09-13T18:35:59.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc7ebc500 4 Got MDS map 70 2024-09-13T18:35:59.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc7ebc500 10 main: main 2024-09-13T18:35:59.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc7ebc500 4 main: connecting to RADOS... 2024-09-13T18:35:59.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc7ebc500 1 Processor -- start 2024-09-13T18:35:59.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc7ebc500 1 -- start start 2024-09-13T18:35:59.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc7ebc500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc41c72400 0x55cc41a25600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc7ebc500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cc41c72800 0x55cc41a25b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc7ebc500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc41c72c00 0x55cc41a26100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc7ebc500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc419b5e00 con 0x55cc41c72400 2024-09-13T18:35:59.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc7ebc500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc41a00780 con 0x55cc41c72c00 2024-09-13T18:35:59.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc7ebc500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc41a00640 con 0x55cc41c72800 2024-09-13T18:35:59.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc5e75700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc41c72400 0x55cc41a25600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc5e75700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc41c72400 0x55cc41a25600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50042/0 (socket says 172.21.15.44:50042) 2024-09-13T18:35:59.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc5e75700 1 -- 172.21.15.44:0/2575544859 learned_addr learned my addr 172.21.15.44:0/2575544859 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc6676700 1 --2- 172.21.15.44:0/2575544859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cc41c72800 0x55cc41a25b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.176+0000 7f4bc5e75700 1 --2- 172.21.15.44:0/2575544859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc41c72c00 0x55cc41a26100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc6676700 1 -- 172.21.15.44:0/2575544859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc41c72c00 msgr2=0x55cc41a26100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc6676700 1 --2- 172.21.15.44:0/2575544859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc41c72c00 0x55cc41a26100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc6676700 1 -- 172.21.15.44:0/2575544859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc41c72400 msgr2=0x55cc41a25600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc6676700 1 --2- 172.21.15.44:0/2575544859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc41c72400 0x55cc41a25600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc6676700 1 -- 172.21.15.44:0/2575544859 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc419a2340 con 0x55cc41c72800 2024-09-13T18:35:59.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc5e75700 1 --2- 172.21.15.44:0/2575544859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc41c72400 0x55cc41a25600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:59.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc6676700 1 --2- 172.21.15.44:0/2575544859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cc41c72800 0x55cc41a25b80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55cc4274c330 tx=0x55cc41cea120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fad8313423afea1e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc1e6d700 1 -- 172.21.15.44:0/2575544859 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cc419cf600 con 0x55cc41c72800 2024-09-13T18:35:59.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc1e6d700 1 -- 172.21.15.44:0/2575544859 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cc42770180 con 0x55cc41c72800 2024-09-13T18:35:59.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc1e6d700 1 -- 172.21.15.44:0/2575544859 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cc419cf1e0 con 0x55cc41c72800 2024-09-13T18:35:59.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc7ebc500 1 -- 172.21.15.44:0/2575544859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cc41c72800 msgr2=0x55cc41a25b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc7ebc500 1 --2- 172.21.15.44:0/2575544859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cc41c72800 0x55cc41a25b80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55cc4274c330 tx=0x55cc41cea120 comp rx=0 tx=0).stop 2024-09-13T18:35:59.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc7ebc500 1 -- 172.21.15.44:0/2575544859 shutdown_connections 2024-09-13T18:35:59.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc7ebc500 1 --2- 172.21.15.44:0/2575544859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc41c72c00 0x55cc41a26100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc7ebc500 1 --2- 172.21.15.44:0/2575544859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cc41c72800 0x55cc41a25b80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc7ebc500 1 --2- 172.21.15.44:0/2575544859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc41c72400 0x55cc41a25600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc7ebc500 1 -- 172.21.15.44:0/2575544859 >> 172.21.15.44:0/2575544859 conn(0x55cc4197ec00 msgr2=0x55cc41a3b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc7ebc500 1 -- 172.21.15.44:0/2575544859 shutdown_connections 2024-09-13T18:35:59.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc7ebc500 1 -- 172.21.15.44:0/2575544859 wait complete. 2024-09-13T18:35:59.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc7ebc500 1 Processor -- start 2024-09-13T18:35:59.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc7ebc500 1 -- start start 2024-09-13T18:35:59.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc7ebc500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc41c72400 0x55cc41a27180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc7ebc500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cc41c72800 0x55cc41a26c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc7ebc500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc41c72c00 0x55cc41a26680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc7ebc500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc41a00500 con 0x55cc41c72c00 2024-09-13T18:35:59.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc7ebc500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc41a003c0 con 0x55cc41c72400 2024-09-13T18:35:59.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc7ebc500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc41a00280 con 0x55cc41c72800 2024-09-13T18:35:59.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc5e75700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc41c72c00 0x55cc41a26680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc6676700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cc41c72800 0x55cc41a26c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc5e75700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc41c72c00 0x55cc41a26680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50050/0 (socket says 172.21.15.44:50050) 2024-09-13T18:35:59.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc5e75700 1 -- 172.21.15.44:0/4273567920 learned_addr learned my addr 172.21.15.44:0/4273567920 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.180+0000 7f4bc5e75700 1 --2- 172.21.15.44:0/4273567920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc41c72400 0x55cc41a27180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.184+0000 7f4bc6676700 1 -- 172.21.15.44:0/4273567920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc41c72400 msgr2=0x55cc41a27180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.184+0000 7f4bc6676700 1 --2- 172.21.15.44:0/4273567920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc41c72400 0x55cc41a27180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.184+0000 7f4bc6676700 1 -- 172.21.15.44:0/4273567920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc41c72c00 msgr2=0x55cc41a26680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.184+0000 7f4bc6676700 1 --2- 172.21.15.44:0/4273567920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc41c72c00 0x55cc41a26680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.184+0000 7f4bc6676700 1 -- 172.21.15.44:0/4273567920 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc419a2000 con 0x55cc41c72800 2024-09-13T18:35:59.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.184+0000 7f4bc5e75700 1 --2- 172.21.15.44:0/4273567920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc41c72c00 0x55cc41a26680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:59.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.184+0000 7f4bc6676700 1 --2- 172.21.15.44:0/4273567920 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cc41c72800 0x55cc41a26c00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55cc4274c4e0 tx=0x55cc42758060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.184+0000 7f4bc066a700 1 -- 172.21.15.44:0/4273567920 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cc419cf080 con 0x55cc41c72800 2024-09-13T18:35:59.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.184+0000 7f4bc066a700 1 -- 172.21.15.44:0/4273567920 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cc42771680 con 0x55cc41c72800 2024-09-13T18:35:59.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.184+0000 7f4bc7ebc500 1 -- 172.21.15.44:0/4273567920 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cc419a2ea0 con 0x55cc41c72800 2024-09-13T18:35:59.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.184+0000 7f4bc066a700 1 -- 172.21.15.44:0/4273567920 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cc419cf600 con 0x55cc41c72800 2024-09-13T18:35:59.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.184+0000 7f4bc7ebc500 1 -- 172.21.15.44:0/4273567920 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc419a2340 con 0x55cc41c72800 2024-09-13T18:35:59.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.184+0000 7f4bc7ebc500 4 main: resolving pool 10 2024-09-13T18:35:59.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.184+0000 7f4bc066a700 1 -- 172.21.15.44:0/4273567920 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x55cc419de840 con 0x55cc41c72800 2024-09-13T18:35:59.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc066a700 1 --2- 172.21.15.44:0/4273567920 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55cc41d00400 0x55cc41a27700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc066a700 1 -- 172.21.15.44:0/4273567920 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x55cc419b8a80 con 0x55cc41c72800 2024-09-13T18:35:59.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc7ebc500 4 main: creating IoCtx.. 2024-09-13T18:35:59.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc7ebc500 1 --2- 172.21.15.44:0/4273567920 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x55cc41c73000 0x55cc41a26100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc7ebc500 1 -- 172.21.15.44:0/4273567920 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:1 10.13 10:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78) v8 -- 0x55cc41c73400 con 0x55cc41c73000 2024-09-13T18:35:59.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc5e75700 1 --2- 172.21.15.44:0/4273567920 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55cc41d00400 0x55cc41a27700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc5e75700 1 --2- 172.21.15.44:0/4273567920 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x55cc41c73000 0x55cc41a26100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc5e75700 1 --2- 172.21.15.44:0/4273567920 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x55cc41c73000 0x55cc41a26100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc5e75700 1 --2- 172.21.15.44:0/4273567920 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55cc41d00400 0x55cc41a27700 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x55cc4274cff0 tx=0x55cc41ceb080 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc5e75700 1 -- 172.21.15.44:0/4273567920 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x55cc4276eb40 con 0x55cc41c73000 2024-09-13T18:35:59.195 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:35:59.195 INFO:teuthology.orchestra.run.smithi044.stdout: "0": { 2024-09-13T18:35:59.195 INFO:teuthology.orchestra.run.smithi044.stdout: "data": { 2024-09-13T18:35:59.195 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 2, 2024-09-13T18:35:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: "inotable": { 2024-09-13T18:35:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: "projected_free": [ 2024-09-13T18:35:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: "start": 1099511628777, 2024-09-13T18:35:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: "len": 1099511626775 2024-09-13T18:35:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-13T18:35:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: "free": [ 2024-09-13T18:35:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: "start": 1099511628777, 2024-09-13T18:35:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: "len": 1099511626775 2024-09-13T18:35:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-13T18:35:59.196 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.197 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.197 INFO:teuthology.orchestra.run.smithi044.stdout: "result": 0 2024-09-13T18:35:59.197 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.197 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:35:59.197 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:59.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc7ebc500 1 -- 172.21.15.44:0/4273567920 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x55cc41c73000 msgr2=0x55cc41a26100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc7ebc500 1 --2- 172.21.15.44:0/4273567920 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x55cc41c73000 0x55cc41a26100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc7ebc500 1 -- 172.21.15.44:0/4273567920 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55cc41d00400 msgr2=0x55cc41a27700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc7ebc500 1 --2- 172.21.15.44:0/4273567920 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55cc41d00400 0x55cc41a27700 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x55cc4274cff0 tx=0x55cc41ceb080 comp rx=0 tx=0).stop 2024-09-13T18:35:59.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc7ebc500 1 -- 172.21.15.44:0/4273567920 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cc41c72800 msgr2=0x55cc41a26c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc7ebc500 1 --2- 172.21.15.44:0/4273567920 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cc41c72800 0x55cc41a26c00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55cc4274c4e0 tx=0x55cc42758060 comp rx=0 tx=0).stop 2024-09-13T18:35:59.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc6676700 1 -- 172.21.15.44:0/4273567920 reap_dead start 2024-09-13T18:35:59.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc7ebc500 1 -- 172.21.15.44:0/4273567920 shutdown_connections 2024-09-13T18:35:59.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc7ebc500 1 -- 172.21.15.44:0/4273567920 >> 172.21.15.44:0/4273567920 conn(0x55cc4197ec00 msgr2=0x55cc41a3b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc7ebc500 1 -- 172.21.15.44:0/4273567920 shutdown_connections 2024-09-13T18:35:59.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc7ebc500 1 -- 172.21.15.44:0/4273567920 wait complete. 2024-09-13T18:35:59.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc7ebc500 1 -- 172.21.15.44:0/3051673015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4197f000 msgr2=0x55cc41a25080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc7ebc500 1 --2- 172.21.15.44:0/3051673015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4197f000 0x55cc41a25080 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x55cc4274ee70 tx=0x55cc42758000 comp rx=0 tx=0).stop 2024-09-13T18:35:59.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc7ebc500 1 -- 172.21.15.44:0/3051673015 shutdown_connections 2024-09-13T18:35:59.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc7ebc500 1 --2- 172.21.15.44:0/3051673015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4197f000 0x55cc41a25080 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc7ebc500 1 --2- 172.21.15.44:0/3051673015 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55cc4197f400 0x55cc41a24b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc7ebc500 1 --2- 172.21.15.44:0/3051673015 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc4197f800 0x55cc41a24580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc7ebc500 1 -- 172.21.15.44:0/3051673015 >> 172.21.15.44:0/3051673015 conn(0x55cc4197fc00 msgr2=0x55cc41a3b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc7ebc500 1 -- 172.21.15.44:0/3051673015 shutdown_connections 2024-09-13T18:35:59.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.188+0000 7f4bc7ebc500 1 -- 172.21.15.44:0/3051673015 wait complete. 2024-09-13T18:35:59.201 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'inode'] in time 0:00:00.057451, result: { "0": { "data": { "version": 2, "inotable": { "projected_free": [ { "start": 1099511628777, "len": 1099511626775 } ], "free": [ { "start": 1099511628777, "len": 1099511626775 } ] } }, "result": 0 } } 2024-09-13T18:35:59.201 INFO:tasks.cephfs.test_journal_repair:{ "0": { "data": { "version": 2, "inotable": { "projected_free": [ { "start": 1099511628777, "len": 1099511626775 } ], "free": [ { "start": 1099511628777, "len": 1099511626775 } ] } }, "result": 0 } } 2024-09-13T18:35:59.201 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show snap 2024-09-13T18:35:59.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.276+0000 7f8faf093500 1 -- start start 2024-09-13T18:35:59.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.276+0000 7f8faf093500 1 Processor -- start 2024-09-13T18:35:59.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.276+0000 7f8faf093500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x555e86995800 0x555e86a3a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.276+0000 7f8faf093500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555e86995400 0x555e86a3ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.276+0000 7f8faf093500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e86995000 0x555e86a3b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.276+0000 7f8faf093500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e86a16a00 con 0x555e86995000 2024-09-13T18:35:59.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.276+0000 7f8faf093500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e869cbe00 con 0x555e86995400 2024-09-13T18:35:59.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.276+0000 7f8faf093500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x555e86a16640 con 0x555e86995800 2024-09-13T18:35:59.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.276+0000 7f8fae04e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e86995000 0x555e86a3b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.276+0000 7f8fae04e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e86995000 0x555e86a3b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50060/0 (socket says 172.21.15.44:50060) 2024-09-13T18:35:59.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.276+0000 7f8fae04e700 1 -- 172.21.15.44:0/3823414058 learned_addr learned my addr 172.21.15.44:0/3823414058 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.276+0000 7f8fad84d700 1 --2- 172.21.15.44:0/3823414058 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x555e86995800 0x555e86a3a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.276+0000 7f8fad04c700 1 --2- 172.21.15.44:0/3823414058 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555e86995400 0x555e86a3ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.276+0000 7f8fae04e700 1 -- 172.21.15.44:0/3823414058 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x555e86995800 msgr2=0x555e86a3a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.276+0000 7f8fae04e700 1 --2- 172.21.15.44:0/3823414058 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x555e86995800 0x555e86a3a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.276+0000 7f8fae04e700 1 -- 172.21.15.44:0/3823414058 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555e86995400 msgr2=0x555e86a3ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.276+0000 7f8fae04e700 1 --2- 172.21.15.44:0/3823414058 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555e86995400 0x555e86a3ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.276+0000 7f8fae04e700 1 -- 172.21.15.44:0/3823414058 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e869b89c0 con 0x555e86995000 2024-09-13T18:35:59.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.276+0000 7f8fae04e700 1 --2- 172.21.15.44:0/3823414058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e86995000 0x555e86a3b080 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x555e86af2e10 tx=0x555e8780c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43502c477c0c476 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8fab048700 1 -- 172.21.15.44:0/3823414058 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555e869e5600 con 0x555e86995000 2024-09-13T18:35:59.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8fab048700 1 -- 172.21.15.44:0/3823414058 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555e87770000 con 0x555e86995000 2024-09-13T18:35:59.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8faf093500 1 -- 172.21.15.44:0/3823414058 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555e869b8b60 con 0x555e86995000 2024-09-13T18:35:59.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8faf093500 1 -- 172.21.15.44:0/3823414058 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x555e869b8340 con 0x555e86995000 2024-09-13T18:35:59.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8faf093500 4 waiting for MDS map... 2024-09-13T18:35:59.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8fab048700 1 -- 172.21.15.44:0/3823414058 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555e869e51e0 con 0x555e86995000 2024-09-13T18:35:59.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8fab048700 1 -- 172.21.15.44:0/3823414058 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x555e869cec40 con 0x555e86995000 2024-09-13T18:35:59.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8fab048700 1 -- 172.21.15.44:0/3823414058 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x555e8781a900 con 0x555e86995000 2024-09-13T18:35:59.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8faf093500 4 Got MDS map 70 2024-09-13T18:35:59.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8faf093500 10 main: main 2024-09-13T18:35:59.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8faf093500 4 main: connecting to RADOS... 2024-09-13T18:35:59.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8faf093500 1 Processor -- start 2024-09-13T18:35:59.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8faf093500 1 -- start start 2024-09-13T18:35:59.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8faf093500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e86c7e400 0x555e86a3b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8faf093500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555e86c7e800 0x555e86a3bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8faf093500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x555e86c7ec00 0x555e86a3c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8faf093500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e86a16500 con 0x555e86c7e400 2024-09-13T18:35:59.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8faf093500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e86a163c0 con 0x555e86c7e800 2024-09-13T18:35:59.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8faf093500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x555e86a16280 con 0x555e86c7ec00 2024-09-13T18:35:59.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8fad04c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e86c7e400 0x555e86a3b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8fad04c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e86c7e400 0x555e86a3b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50076/0 (socket says 172.21.15.44:50076) 2024-09-13T18:35:59.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8fad04c700 1 -- 172.21.15.44:0/1961282853 learned_addr learned my addr 172.21.15.44:0/1961282853 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8fad84d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555e86c7e800 0x555e86a3bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8fad04c700 1 --2- 172.21.15.44:0/1961282853 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x555e86c7ec00 0x555e86a3c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8fad04c700 1 -- 172.21.15.44:0/1961282853 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x555e86c7ec00 msgr2=0x555e86a3c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8fad04c700 1 --2- 172.21.15.44:0/1961282853 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x555e86c7ec00 0x555e86a3c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8fad04c700 1 -- 172.21.15.44:0/1961282853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555e86c7e800 msgr2=0x555e86a3bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8fad04c700 1 --2- 172.21.15.44:0/1961282853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555e86c7e800 0x555e86a3bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.280+0000 7f8fad04c700 1 -- 172.21.15.44:0/1961282853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e869b8000 con 0x555e86c7e400 2024-09-13T18:35:59.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8fad04c700 1 --2- 172.21.15.44:0/1961282853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e86c7e400 0x555e86a3b600 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x555e86ce6120 tx=0x555e86c92c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5e941e3923e213 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8fa9044700 1 -- 172.21.15.44:0/1961282853 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555e869e5600 con 0x555e86c7e400 2024-09-13T18:35:59.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8fa9044700 1 -- 172.21.15.44:0/1961282853 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555e87770c00 con 0x555e86c7e400 2024-09-13T18:35:59.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8fa9044700 1 -- 172.21.15.44:0/1961282853 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555e869e51e0 con 0x555e86c7e400 2024-09-13T18:35:59.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8faf093500 1 -- 172.21.15.44:0/1961282853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e86c7e400 msgr2=0x555e86a3b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8faf093500 1 --2- 172.21.15.44:0/1961282853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e86c7e400 0x555e86a3b600 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x555e86ce6120 tx=0x555e86c92c60 comp rx=0 tx=0).stop 2024-09-13T18:35:59.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8faf093500 1 -- 172.21.15.44:0/1961282853 shutdown_connections 2024-09-13T18:35:59.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8faf093500 1 --2- 172.21.15.44:0/1961282853 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x555e86c7ec00 0x555e86a3c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8faf093500 1 --2- 172.21.15.44:0/1961282853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555e86c7e800 0x555e86a3bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8faf093500 1 --2- 172.21.15.44:0/1961282853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e86c7e400 0x555e86a3b600 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8faf093500 1 -- 172.21.15.44:0/1961282853 >> 172.21.15.44:0/1961282853 conn(0x555e86994c00 msgr2=0x555e86a85800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8faf093500 1 -- 172.21.15.44:0/1961282853 shutdown_connections 2024-09-13T18:35:59.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8faf093500 1 -- 172.21.15.44:0/1961282853 wait complete. 2024-09-13T18:35:59.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8faf093500 1 Processor -- start 2024-09-13T18:35:59.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8faf093500 1 -- start start 2024-09-13T18:35:59.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8faf093500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e86c7e400 0x555e86a3d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8faf093500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x555e86c7e800 0x555e86a3cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8faf093500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555e86c7ec00 0x555e86a3c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8faf093500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e86a16280 con 0x555e86c7e400 2024-09-13T18:35:59.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8faf093500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e86a163c0 con 0x555e86c7ec00 2024-09-13T18:35:59.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8faf093500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x555e86a16640 con 0x555e86c7e800 2024-09-13T18:35:59.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8fad04c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e86c7e400 0x555e86a3d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8fad04c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e86c7e400 0x555e86a3d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50086/0 (socket says 172.21.15.44:50086) 2024-09-13T18:35:59.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8fad04c700 1 -- 172.21.15.44:0/1026893357 learned_addr learned my addr 172.21.15.44:0/1026893357 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8fad84d700 1 --2- 172.21.15.44:0/1026893357 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x555e86c7e800 0x555e86a3cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.284+0000 7f8fad04c700 1 --2- 172.21.15.44:0/1026893357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555e86c7ec00 0x555e86a3c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.288+0000 7f8fad04c700 1 -- 172.21.15.44:0/1026893357 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x555e86c7e800 msgr2=0x555e86a3cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.288+0000 7f8fad04c700 1 --2- 172.21.15.44:0/1026893357 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x555e86c7e800 0x555e86a3cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.288+0000 7f8fad04c700 1 -- 172.21.15.44:0/1026893357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555e86c7ec00 msgr2=0x555e86a3c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.288+0000 7f8fad04c700 1 --2- 172.21.15.44:0/1026893357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555e86c7ec00 0x555e86a3c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.288+0000 7f8fad04c700 1 -- 172.21.15.44:0/1026893357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e869b89c0 con 0x555e86c7e400 2024-09-13T18:35:59.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.288+0000 7f8fad04c700 1 --2- 172.21.15.44:0/1026893357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e86c7e400 0x555e86a3d180 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x555e86af2ab0 tx=0x555e86c92cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.288+0000 7f8fa7841700 1 -- 172.21.15.44:0/1026893357 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555e869e4dc0 con 0x555e86c7e400 2024-09-13T18:35:59.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.288+0000 7f8fa7841700 1 -- 172.21.15.44:0/1026893357 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555e87770d80 con 0x555e86c7e400 2024-09-13T18:35:59.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.288+0000 7f8faf093500 1 -- 172.21.15.44:0/1026893357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555e869b8b60 con 0x555e86c7e400 2024-09-13T18:35:59.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.288+0000 7f8fa7841700 1 -- 172.21.15.44:0/1026893357 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555e869e5600 con 0x555e86c7e400 2024-09-13T18:35:59.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.288+0000 7f8faf093500 1 -- 172.21.15.44:0/1026893357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555e869b8340 con 0x555e86c7e400 2024-09-13T18:35:59.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.288+0000 7f8faf093500 4 main: resolving pool 10 2024-09-13T18:35:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.288+0000 7f8fa7841700 1 -- 172.21.15.44:0/1026893357 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x555e869f4b00 con 0x555e86c7e400 2024-09-13T18:35:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.288+0000 7f8fa7841700 1 --2- 172.21.15.44:0/1026893357 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x555e86df4000 0x555e86a3d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8fa7841700 1 -- 172.21.15.44:0/1026893357 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x555e869cea80 con 0x555e86c7e400 2024-09-13T18:35:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8faf093500 4 main: creating IoCtx.. 2024-09-13T18:35:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8faf093500 1 --2- 172.21.15.44:0/1026893357 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x555e86c7f000 0x555e86a3c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8faf093500 1 -- 172.21.15.44:0/1026893357 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:1 10.d 10:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78) v8 -- 0x555e86c7f400 con 0x555e86c7f000 2024-09-13T18:35:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8fad84d700 1 --2- 172.21.15.44:0/1026893357 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x555e86df4000 0x555e86a3d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8fad04c700 1 --2- 172.21.15.44:0/1026893357 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x555e86c7f000 0x555e86a3c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8fad04c700 1 --2- 172.21.15.44:0/1026893357 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x555e86c7f000 0x555e86a3c100 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8fad84d700 1 --2- 172.21.15.44:0/1026893357 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x555e86df4000 0x555e86a3d700 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x555e869ebaa0 tx=0x555e86a6b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8fad04c700 1 -- 172.21.15.44:0/1026893357 <== osd.6 v2:172.21.15.99:6808/2907584318 1 ==== osd_op_reply(1 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x555e87808b40 con 0x555e86c7f000 2024-09-13T18:35:59.300 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:35:59.300 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 1, 2024-09-13T18:35:59.300 INFO:teuthology.orchestra.run.smithi044.stdout: "snapserver": { 2024-09-13T18:35:59.300 INFO:teuthology.orchestra.run.smithi044.stdout: "last_snap": 1, 2024-09-13T18:35:59.300 INFO:teuthology.orchestra.run.smithi044.stdout: "last_created": 1, 2024-09-13T18:35:59.300 INFO:teuthology.orchestra.run.smithi044.stdout: "last_destroyed": 1, 2024-09-13T18:35:59.300 INFO:teuthology.orchestra.run.smithi044.stdout: "pending_noop": [], 2024-09-13T18:35:59.300 INFO:teuthology.orchestra.run.smithi044.stdout: "snaps": [], 2024-09-13T18:35:59.301 INFO:teuthology.orchestra.run.smithi044.stdout: "need_to_purge": {}, 2024-09-13T18:35:59.301 INFO:teuthology.orchestra.run.smithi044.stdout: "pending_update": [], 2024-09-13T18:35:59.301 INFO:teuthology.orchestra.run.smithi044.stdout: "pending_destroy": [] 2024-09-13T18:35:59.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.301 INFO:teuthology.orchestra.run.smithi044.stdout: "result": 0 2024-09-13T18:35:59.301 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:35:59.301 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:59.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8faf093500 1 -- 172.21.15.44:0/1026893357 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x555e86c7f000 msgr2=0x555e86a3c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8faf093500 1 --2- 172.21.15.44:0/1026893357 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x555e86c7f000 0x555e86a3c100 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8faf093500 1 -- 172.21.15.44:0/1026893357 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x555e86df4000 msgr2=0x555e86a3d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8faf093500 1 --2- 172.21.15.44:0/1026893357 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x555e86df4000 0x555e86a3d700 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x555e869ebaa0 tx=0x555e86a6b260 comp rx=0 tx=0).stop 2024-09-13T18:35:59.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8faf093500 1 -- 172.21.15.44:0/1026893357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e86c7e400 msgr2=0x555e86a3d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8faf093500 1 --2- 172.21.15.44:0/1026893357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e86c7e400 0x555e86a3d180 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x555e86af2ab0 tx=0x555e86c92cc0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8fad84d700 1 -- 172.21.15.44:0/1026893357 reap_dead start 2024-09-13T18:35:59.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8faf093500 1 -- 172.21.15.44:0/1026893357 shutdown_connections 2024-09-13T18:35:59.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8faf093500 1 -- 172.21.15.44:0/1026893357 >> 172.21.15.44:0/1026893357 conn(0x555e86994c00 msgr2=0x555e86a85800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8faf093500 1 -- 172.21.15.44:0/1026893357 shutdown_connections 2024-09-13T18:35:59.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8faf093500 1 -- 172.21.15.44:0/1026893357 wait complete. 2024-09-13T18:35:59.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8faf093500 1 -- 172.21.15.44:0/3823414058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e86995000 msgr2=0x555e86a3b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8faf093500 1 --2- 172.21.15.44:0/3823414058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e86995000 0x555e86a3b080 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x555e86af2e10 tx=0x555e8780c240 comp rx=0 tx=0).stop 2024-09-13T18:35:59.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8faf093500 1 -- 172.21.15.44:0/3823414058 shutdown_connections 2024-09-13T18:35:59.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8faf093500 1 --2- 172.21.15.44:0/3823414058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e86995000 0x555e86a3b080 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8faf093500 1 --2- 172.21.15.44:0/3823414058 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555e86995400 0x555e86a3ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8faf093500 1 --2- 172.21.15.44:0/3823414058 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x555e86995800 0x555e86a3a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8faf093500 1 -- 172.21.15.44:0/3823414058 >> 172.21.15.44:0/3823414058 conn(0x555e86995c00 msgr2=0x555e86a85000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.292+0000 7f8faf093500 1 -- 172.21.15.44:0/3823414058 shutdown_connections 2024-09-13T18:35:59.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.296+0000 7f8faf093500 1 -- 172.21.15.44:0/3823414058 wait complete. 2024-09-13T18:35:59.305 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'snap'] in time 0:00:00.104006, result: { "version": 1, "snapserver": { "last_snap": 1, "last_created": 1, "last_destroyed": 1, "pending_noop": [], "snaps": [], "need_to_purge": {}, "pending_update": [], "pending_destroy": [] }, "result": 0 } 2024-09-13T18:35:59.305 INFO:tasks.cephfs.test_journal_repair:{ "version": 1, "snapserver": { "last_snap": 1, "last_created": 1, "last_destroyed": 1, "pending_noop": [], "snaps": [], "need_to_purge": {}, "pending_update": [], "pending_destroy": [] }, "result": 0 } 2024-09-13T18:35:59.305 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show session 2024-09-13T18:35:59.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.340+0000 7fa56695c500 1 -- start start 2024-09-13T18:35:59.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.340+0000 7fa56695c500 1 Processor -- start 2024-09-13T18:35:59.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.340+0000 7fa56695c500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56006f8cd800 0x56006f972580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.340+0000 7fa56695c500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56006f8cd400 0x56006f972b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.340+0000 7fa56695c500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56006f8cd000 0x56006f973080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.340+0000 7fa56695c500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56006f94ea00 con 0x56006f8cd400 2024-09-13T18:35:59.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.340+0000 7fa56695c500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56006f94e780 con 0x56006f8cd000 2024-09-13T18:35:59.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.340+0000 7fa56695c500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x56006f94e640 con 0x56006f8cd800 2024-09-13T18:35:59.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.340+0000 7fa564915700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56006f8cd400 0x56006f972b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.340+0000 7fa564915700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56006f8cd400 0x56006f972b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50116/0 (socket says 172.21.15.44:50116) 2024-09-13T18:35:59.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.340+0000 7fa564915700 1 -- 172.21.15.44:0/4253315505 learned_addr learned my addr 172.21.15.44:0/4253315505 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.340+0000 7fa565917700 1 --2- 172.21.15.44:0/4253315505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56006f8cd000 0x56006f973080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.340+0000 7fa565116700 1 --2- 172.21.15.44:0/4253315505 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56006f8cd800 0x56006f972580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.344+0000 7fa565917700 1 -- 172.21.15.44:0/4253315505 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56006f8cd800 msgr2=0x56006f972580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.344+0000 7fa565917700 1 --2- 172.21.15.44:0/4253315505 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56006f8cd800 0x56006f972580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.344+0000 7fa565917700 1 -- 172.21.15.44:0/4253315505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56006f8cd400 msgr2=0x56006f972b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.344+0000 7fa565917700 1 --2- 172.21.15.44:0/4253315505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56006f8cd400 0x56006f972b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.344+0000 7fa565917700 1 -- 172.21.15.44:0/4253315505 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56006f8f09c0 con 0x56006f8cd000 2024-09-13T18:35:59.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.344+0000 7fa564915700 1 --2- 172.21.15.44:0/4253315505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56006f8cd400 0x56006f972b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:59.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.344+0000 7fa565917700 1 --2- 172.21.15.44:0/4253315505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56006f8cd000 0x56006f973080 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x5600706a4d80 tx=0x5600706c6c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40b2081e4d9efba1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.344+0000 7fa562911700 1 -- 172.21.15.44:0/4253315505 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56006f91d600 con 0x56006f8cd000 2024-09-13T18:35:59.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.344+0000 7fa562911700 1 -- 172.21.15.44:0/4253315505 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56006f918480 con 0x56006f8cd000 2024-09-13T18:35:59.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.344+0000 7fa562911700 1 -- 172.21.15.44:0/4253315505 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56006f91d1e0 con 0x56006f8cd000 2024-09-13T18:35:59.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.344+0000 7fa56695c500 1 -- 172.21.15.44:0/4253315505 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56006f8f0b60 con 0x56006f8cd000 2024-09-13T18:35:59.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.344+0000 7fa56695c500 1 -- 172.21.15.44:0/4253315505 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x56006f8f0340 con 0x56006f8cd000 2024-09-13T18:35:59.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.344+0000 7fa56695c500 4 waiting for MDS map... 2024-09-13T18:35:59.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.344+0000 7fa562911700 1 -- 172.21.15.44:0/4253315505 <== mon.1 v2:172.21.15.99:3300/0 4 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x56006f906c40 con 0x56006f8cd000 2024-09-13T18:35:59.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.344+0000 7fa562911700 1 -- 172.21.15.44:0/4253315505 <== mon.1 v2:172.21.15.99:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x5600706bc900 con 0x56006f8cd000 2024-09-13T18:35:59.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.344+0000 7fa56695c500 4 Got MDS map 70 2024-09-13T18:35:59.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.344+0000 7fa56695c500 10 main: main 2024-09-13T18:35:59.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.344+0000 7fa56695c500 4 main: connecting to RADOS... 2024-09-13T18:35:59.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.344+0000 7fa56695c500 1 Processor -- start 2024-09-13T18:35:59.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.344+0000 7fa56695c500 1 -- start start 2024-09-13T18:35:59.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa56695c500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560070756400 0x56006f973600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa56695c500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560070756800 0x56006f973b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa56695c500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560070756c00 0x56006f974100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa56695c500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56006f903e00 con 0x560070756c00 2024-09-13T18:35:59.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa56695c500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56006f94ea00 con 0x560070756800 2024-09-13T18:35:59.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa56695c500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x56006f94e500 con 0x560070756400 2024-09-13T18:35:59.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa565116700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560070756800 0x56006f973b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa564915700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560070756c00 0x56006f974100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa565116700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560070756800 0x56006f973b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:53122/0 (socket says 172.21.15.44:53122) 2024-09-13T18:35:59.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa564915700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560070756c00 0x56006f974100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50118/0 (socket says 172.21.15.44:50118) 2024-09-13T18:35:59.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa565116700 1 -- 172.21.15.44:0/994221172 learned_addr learned my addr 172.21.15.44:0/994221172 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa564915700 1 --2- 172.21.15.44:0/994221172 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560070756400 0x56006f973600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa564915700 1 -- 172.21.15.44:0/994221172 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560070756400 msgr2=0x56006f973600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa564915700 1 --2- 172.21.15.44:0/994221172 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560070756400 0x56006f973600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa564915700 1 -- 172.21.15.44:0/994221172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560070756800 msgr2=0x56006f973b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa564915700 1 --2- 172.21.15.44:0/994221172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560070756800 0x56006f973b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa564915700 1 -- 172.21.15.44:0/994221172 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56006f8f0000 con 0x560070756c00 2024-09-13T18:35:59.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa565116700 1 --2- 172.21.15.44:0/994221172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560070756800 0x56006f973b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:59.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa564915700 1 --2- 172.21.15.44:0/994221172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560070756c00 0x56006f974100 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x56006fc1a180 tx=0x56006fc240c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40111f70c80af055 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa56090d700 1 -- 172.21.15.44:0/994221172 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56006f91d080 con 0x560070756c00 2024-09-13T18:35:59.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa56090d700 1 -- 172.21.15.44:0/994221172 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56006f918480 con 0x560070756c00 2024-09-13T18:35:59.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa56090d700 1 -- 172.21.15.44:0/994221172 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56006f91d600 con 0x560070756c00 2024-09-13T18:35:59.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa56695c500 1 -- 172.21.15.44:0/994221172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560070756c00 msgr2=0x56006f974100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa56695c500 1 --2- 172.21.15.44:0/994221172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560070756c00 0x56006f974100 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x56006fc1a180 tx=0x56006fc240c0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa56695c500 1 -- 172.21.15.44:0/994221172 shutdown_connections 2024-09-13T18:35:59.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa56695c500 1 --2- 172.21.15.44:0/994221172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560070756c00 0x56006f974100 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa56695c500 1 --2- 172.21.15.44:0/994221172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560070756800 0x56006f973b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa56695c500 1 --2- 172.21.15.44:0/994221172 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560070756400 0x56006f973600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa56695c500 1 -- 172.21.15.44:0/994221172 >> 172.21.15.44:0/994221172 conn(0x56006f8ccc00 msgr2=0x56006f9bd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa56695c500 1 -- 172.21.15.44:0/994221172 shutdown_connections 2024-09-13T18:35:59.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.348+0000 7fa56695c500 1 -- 172.21.15.44:0/994221172 wait complete. 2024-09-13T18:35:59.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.352+0000 7fa56695c500 1 Processor -- start 2024-09-13T18:35:59.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.352+0000 7fa56695c500 1 -- start start 2024-09-13T18:35:59.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.352+0000 7fa56695c500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560070756400 0x56006f975180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.352+0000 7fa56695c500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560070756800 0x56006f974c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.352+0000 7fa56695c500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560070756c00 0x56006f974680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.352+0000 7fa56695c500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56006f94e3c0 con 0x560070756400 2024-09-13T18:35:59.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.352+0000 7fa56695c500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56006f94e280 con 0x560070756c00 2024-09-13T18:35:59.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.352+0000 7fa56695c500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x56006f94e140 con 0x560070756800 2024-09-13T18:35:59.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.352+0000 7fa564915700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560070756400 0x56006f975180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.352+0000 7fa564915700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560070756400 0x56006f975180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50128/0 (socket says 172.21.15.44:50128) 2024-09-13T18:35:59.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.352+0000 7fa564915700 1 -- 172.21.15.44:0/1434741816 learned_addr learned my addr 172.21.15.44:0/1434741816 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.352+0000 7fa565116700 1 --2- 172.21.15.44:0/1434741816 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560070756800 0x56006f974c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.352+0000 7fa564915700 1 --2- 172.21.15.44:0/1434741816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560070756c00 0x56006f974680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.352+0000 7fa564915700 1 -- 172.21.15.44:0/1434741816 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560070756800 msgr2=0x56006f974c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.352+0000 7fa564915700 1 --2- 172.21.15.44:0/1434741816 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x560070756800 0x56006f974c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.352+0000 7fa564915700 1 -- 172.21.15.44:0/1434741816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560070756c00 msgr2=0x56006f974680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.352+0000 7fa564915700 1 --2- 172.21.15.44:0/1434741816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560070756c00 0x56006f974680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.352+0000 7fa564915700 1 -- 172.21.15.44:0/1434741816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56006f8f01a0 con 0x560070756400 2024-09-13T18:35:59.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.352+0000 7fa564915700 1 --2- 172.21.15.44:0/1434741816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560070756400 0x56006f975180 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x56006fc1b440 tx=0x56006fc24300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.356+0000 7fa55f10a700 1 -- 172.21.15.44:0/1434741816 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56006f91d1e0 con 0x560070756400 2024-09-13T18:35:59.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.356+0000 7fa55f10a700 1 -- 172.21.15.44:0/1434741816 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5600706c1500 con 0x560070756400 2024-09-13T18:35:59.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.356+0000 7fa55f10a700 1 -- 172.21.15.44:0/1434741816 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56006f91cdc0 con 0x560070756400 2024-09-13T18:35:59.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.356+0000 7fa56695c500 1 -- 172.21.15.44:0/1434741816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56006f8f0000 con 0x560070756400 2024-09-13T18:35:59.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.356+0000 7fa56695c500 1 -- 172.21.15.44:0/1434741816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56006f8f09c0 con 0x560070756400 2024-09-13T18:35:59.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.356+0000 7fa56695c500 4 main: resolving pool 10 2024-09-13T18:35:59.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.356+0000 7fa55f10a700 1 -- 172.21.15.44:0/1434741816 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x56006f92c840 con 0x560070756400 2024-09-13T18:35:59.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.356+0000 7fa55f10a700 1 --2- 172.21.15.44:0/1434741816 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x56006fbbe800 0x56006f975700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.356+0000 7fa55f10a700 1 -- 172.21.15.44:0/1434741816 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x56006f906a80 con 0x560070756400 2024-09-13T18:35:59.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.356+0000 7fa56695c500 4 main: creating IoCtx.. 2024-09-13T18:35:59.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.360+0000 7fa56695c500 1 --2- 172.21.15.44:0/1434741816 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x560070757000 0x56006f974100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.360+0000 7fa56695c500 1 -- 172.21.15.44:0/1434741816 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:1 10.b 10:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78) v8 -- 0x560070757400 con 0x560070757000 2024-09-13T18:35:59.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.360+0000 7fa565116700 1 --2- 172.21.15.44:0/1434741816 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x56006fbbe800 0x56006f975700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.360+0000 7fa564915700 1 --2- 172.21.15.44:0/1434741816 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x560070757000 0x56006f974100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.360+0000 7fa565116700 1 --2- 172.21.15.44:0/1434741816 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x56006fbbe800 0x56006f975700 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x56006fc1a090 tx=0x56006fc240c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.360+0000 7fa564915700 1 --2- 172.21.15.44:0/1434741816 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x560070757000 0x56006f974100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.360+0000 7fa564915700 1 -- 172.21.15.44:0/1434741816 <== osd.6 v2:172.21.15.99:6808/2907584318 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv3 ondisk = 0) v8 ==== 159+0+14 (crc 0 0 0) 0x5600706b4b40 con 0x560070757000 2024-09-13T18:35:59.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.360+0000 7fa56695c500 1 -- 172.21.15.44:0/1434741816 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:2 10.b 10:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78) v8 -- 0x560070757800 con 0x560070757000 2024-09-13T18:35:59.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.360+0000 7fa564915700 1 -- 172.21.15.44:0/1434741816 <== osd.6 v2:172.21.15.99:6808/2907584318 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=472b] v0'0 uv3 ondisk = 0) v8 ==== 159+0+472 (crc 0 0 0) 0x5600706b4b40 con 0x560070757000 2024-09-13T18:35:59.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.360+0000 7fa56695c500 1 -- 172.21.15.44:0/1434741816 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:3 10.b 10:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78) v8 -- 0x56006fbbec00 con 0x560070757000 2024-09-13T18:35:59.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.360+0000 7fa564915700 1 -- 172.21.15.44:0/1434741816 <== osd.6 v2:172.21.15.99:6808/2907584318 3 ==== osd_op_reply(3 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 159+0+5 (crc 0 0 0) 0x5600706b4b40 con 0x560070757000 2024-09-13T18:35:59.368 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:35:59.369 INFO:teuthology.orchestra.run.smithi044.stdout: "0": { 2024-09-13T18:35:59.369 INFO:teuthology.orchestra.run.smithi044.stdout: "data": { 2024-09-13T18:35:59.369 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions": [ 2024-09-13T18:35:59.369 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:59.369 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 7815, 2024-09-13T18:35:59.369 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": { 2024-09-13T18:35:59.369 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2024-09-13T18:35:59.369 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2024-09-13T18:35:59.369 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 7815 2024-09-13T18:35:59.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.369 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:35:59.369 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "any", 2024-09-13T18:35:59.370 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:35:59.370 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3808762181 2024-09-13T18:35:59.370 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.370 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "open", 2024-09-13T18:35:59.370 INFO:teuthology.orchestra.run.smithi044.stdout: "num_leases": 0, 2024-09-13T18:35:59.370 INFO:teuthology.orchestra.run.smithi044.stdout: "num_caps": 0, 2024-09-13T18:35:59.370 INFO:teuthology.orchestra.run.smithi044.stdout: "request_load_avg": 0, 2024-09-13T18:35:59.370 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 0, 2024-09-13T18:35:59.370 INFO:teuthology.orchestra.run.smithi044.stdout: "requests_in_flight": 0, 2024-09-13T18:35:59.370 INFO:teuthology.orchestra.run.smithi044.stdout: "num_completed_requests": 2, 2024-09-13T18:35:59.370 INFO:teuthology.orchestra.run.smithi044.stdout: "num_completed_flushes": 0, 2024-09-13T18:35:59.370 INFO:teuthology.orchestra.run.smithi044.stdout: "reconnecting": false, 2024-09-13T18:35:59.371 INFO:teuthology.orchestra.run.smithi044.stdout: "recall_caps": { 2024-09-13T18:35:59.371 INFO:teuthology.orchestra.run.smithi044.stdout: "value": 0, 2024-09-13T18:35:59.371 INFO:teuthology.orchestra.run.smithi044.stdout: "halflife": 60 2024-09-13T18:35:59.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.371 INFO:teuthology.orchestra.run.smithi044.stdout: "release_caps": { 2024-09-13T18:35:59.371 INFO:teuthology.orchestra.run.smithi044.stdout: "value": 0, 2024-09-13T18:35:59.371 INFO:teuthology.orchestra.run.smithi044.stdout: "halflife": 60 2024-09-13T18:35:59.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.371 INFO:teuthology.orchestra.run.smithi044.stdout: "recall_caps_throttle": { 2024-09-13T18:35:59.371 INFO:teuthology.orchestra.run.smithi044.stdout: "value": 0, 2024-09-13T18:35:59.371 INFO:teuthology.orchestra.run.smithi044.stdout: "halflife": 1.5 2024-09-13T18:35:59.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.371 INFO:teuthology.orchestra.run.smithi044.stdout: "recall_caps_throttle2o": { 2024-09-13T18:35:59.372 INFO:teuthology.orchestra.run.smithi044.stdout: "value": 0, 2024-09-13T18:35:59.372 INFO:teuthology.orchestra.run.smithi044.stdout: "halflife": 0.5 2024-09-13T18:35:59.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.372 INFO:teuthology.orchestra.run.smithi044.stdout: "session_cache_liveness": { 2024-09-13T18:35:59.372 INFO:teuthology.orchestra.run.smithi044.stdout: "value": 0, 2024-09-13T18:35:59.372 INFO:teuthology.orchestra.run.smithi044.stdout: "halflife": 300 2024-09-13T18:35:59.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.372 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_acquisition": { 2024-09-13T18:35:59.372 INFO:teuthology.orchestra.run.smithi044.stdout: "value": 0, 2024-09-13T18:35:59.372 INFO:teuthology.orchestra.run.smithi044.stdout: "halflife": 30 2024-09-13T18:35:59.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.372 INFO:teuthology.orchestra.run.smithi044.stdout: "last_trim_completed_requests_tid": 0, 2024-09-13T18:35:59.372 INFO:teuthology.orchestra.run.smithi044.stdout: "last_trim_completed_flushes_tid": 0, 2024-09-13T18:35:59.373 INFO:teuthology.orchestra.run.smithi044.stdout: "delegated_inos": [], 2024-09-13T18:35:59.373 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": "client.7815 192.168.0.1:0/3808762181", 2024-09-13T18:35:59.373 INFO:teuthology.orchestra.run.smithi044.stdout: "completed_requests": [ 2024-09-13T18:35:59.373 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:59.373 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2, 2024-09-13T18:35:59.373 INFO:teuthology.orchestra.run.smithi044.stdout: "created_ino": "0x0" 2024-09-13T18:35:59.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.373 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:59.373 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 7, 2024-09-13T18:35:59.373 INFO:teuthology.orchestra.run.smithi044.stdout: "created_ino": "0x10000000000" 2024-09-13T18:35:59.373 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.373 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-13T18:35:59.373 INFO:teuthology.orchestra.run.smithi044.stdout: "prealloc_inos": [ 2024-09-13T18:35:59.373 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:59.374 INFO:teuthology.orchestra.run.smithi044.stdout: "start": "0x10000000001", 2024-09-13T18:35:59.374 INFO:teuthology.orchestra.run.smithi044.stdout: "length": 1000 2024-09-13T18:35:59.374 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.374 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-13T18:35:59.374 INFO:teuthology.orchestra.run.smithi044.stdout: "client_metadata": { 2024-09-13T18:35:59.374 INFO:teuthology.orchestra.run.smithi044.stdout: "client_features": { 2024-09-13T18:35:59.374 INFO:teuthology.orchestra.run.smithi044.stdout: "feature_bits": "0x00000000003fffff" 2024-09-13T18:35:59.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.374 INFO:teuthology.orchestra.run.smithi044.stdout: "metric_spec": { 2024-09-13T18:35:59.374 INFO:teuthology.orchestra.run.smithi044.stdout: "metric_flags": { 2024-09-13T18:35:59.374 INFO:teuthology.orchestra.run.smithi044.stdout: "feature_bits": "0x000000000000ffff" 2024-09-13T18:35:59.374 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.374 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:35:59.375 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:35:59.375 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "0", 2024-09-13T18:35:59.375 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2024-09-13T18:35:59.375 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:35:59.375 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "46486", 2024-09-13T18:35:59.375 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2024-09-13T18:35:59.375 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.375 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.375 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-13T18:35:59.375 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.375 INFO:teuthology.orchestra.run.smithi044.stdout: "result": 0 2024-09-13T18:35:59.375 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.375 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:35:59.375 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:59.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.360+0000 7fa56695c500 1 -- 172.21.15.44:0/1434741816 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x560070757000 msgr2=0x56006f974100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.360+0000 7fa56695c500 1 --2- 172.21.15.44:0/1434741816 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x560070757000 0x56006f974100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.364+0000 7fa56695c500 1 -- 172.21.15.44:0/1434741816 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x56006fbbe800 msgr2=0x56006f975700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.364+0000 7fa56695c500 1 --2- 172.21.15.44:0/1434741816 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x56006fbbe800 0x56006f975700 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x56006fc1a090 tx=0x56006fc240c0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.364+0000 7fa56695c500 1 -- 172.21.15.44:0/1434741816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560070756400 msgr2=0x56006f975180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.364+0000 7fa56695c500 1 --2- 172.21.15.44:0/1434741816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560070756400 0x56006f975180 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x56006fc1b440 tx=0x56006fc24300 comp rx=0 tx=0).stop 2024-09-13T18:35:59.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.364+0000 7fa565116700 1 -- 172.21.15.44:0/1434741816 reap_dead start 2024-09-13T18:35:59.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.364+0000 7fa56695c500 1 -- 172.21.15.44:0/1434741816 shutdown_connections 2024-09-13T18:35:59.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.364+0000 7fa56695c500 1 -- 172.21.15.44:0/1434741816 >> 172.21.15.44:0/1434741816 conn(0x56006f8ccc00 msgr2=0x56006f9bd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.364+0000 7fa56695c500 1 -- 172.21.15.44:0/1434741816 shutdown_connections 2024-09-13T18:35:59.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.364+0000 7fa56695c500 1 -- 172.21.15.44:0/1434741816 wait complete. 2024-09-13T18:35:59.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.364+0000 7fa56695c500 1 -- 172.21.15.44:0/4253315505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56006f8cd000 msgr2=0x56006f973080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.364+0000 7fa56695c500 1 --2- 172.21.15.44:0/4253315505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56006f8cd000 0x56006f973080 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x5600706a4d80 tx=0x5600706c6c00 comp rx=0 tx=0).stop 2024-09-13T18:35:59.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.364+0000 7fa56695c500 1 -- 172.21.15.44:0/4253315505 shutdown_connections 2024-09-13T18:35:59.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.364+0000 7fa56695c500 1 --2- 172.21.15.44:0/4253315505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56006f8cd000 0x56006f973080 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.364+0000 7fa56695c500 1 --2- 172.21.15.44:0/4253315505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56006f8cd400 0x56006f972b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.364+0000 7fa56695c500 1 --2- 172.21.15.44:0/4253315505 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56006f8cd800 0x56006f972580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.364+0000 7fa56695c500 1 -- 172.21.15.44:0/4253315505 >> 172.21.15.44:0/4253315505 conn(0x56006f8cdc00 msgr2=0x56006f9bd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.364+0000 7fa56695c500 1 -- 172.21.15.44:0/4253315505 shutdown_connections 2024-09-13T18:35:59.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.364+0000 7fa56695c500 1 -- 172.21.15.44:0/4253315505 wait complete. 2024-09-13T18:35:59.379 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'session'] in time 0:00:00.073544, result: { "0": { "data": { "sessions": [ { "id": 7815, "entity": { "name": { "type": "client", "num": 7815 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 3808762181 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 2, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.7815 192.168.0.1:0/3808762181", "completed_requests": [ { "tid": 2, "created_ino": "0x0" }, { "tid": 7, "created_ino": "0x10000000000" } ], "prealloc_inos": [ { "start": "0x10000000001", "length": 1000 } ], "client_metadata": { "client_features": { "feature_bits": "0x00000000003fffff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "entity_id": "0", "hostname": "smithi044", "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "46486", "root": "/" } } ] }, "result": 0 } } 2024-09-13T18:35:59.379 INFO:tasks.cephfs.test_journal_repair:{ "0": { "data": { "sessions": [ { "id": 7815, "entity": { "name": { "type": "client", "num": 7815 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 3808762181 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 2, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.7815 192.168.0.1:0/3808762181", "completed_requests": [ { "tid": 2, "created_ino": "0x0" }, { "tid": 7, "created_ino": "0x10000000000" } ], "prealloc_inos": [ { "start": "0x10000000001", "length": 1000 } ], "client_metadata": { "client_features": { "feature_bits": "0x00000000003fffff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "entity_id": "0", "hostname": "smithi044", "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "46486", "root": "/" } } ] }, "result": 0 } } 2024-09-13T18:35:59.379 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show inode 2024-09-13T18:35:59.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.412+0000 7f2b04cba500 1 -- start start 2024-09-13T18:35:59.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.412+0000 7f2b04cba500 1 Processor -- start 2024-09-13T18:35:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b04cba500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a54567800 0x562a5460c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b04cba500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562a54567400 0x562a5460cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b04cba500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a54567000 0x562a5460d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b04cba500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a545e8780 con 0x562a54567800 2024-09-13T18:35:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b04cba500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a545e8a00 con 0x562a54567000 2024-09-13T18:35:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b04cba500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a545e8640 con 0x562a54567400 2024-09-13T18:35:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b03474700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a54567800 0x562a5460c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b02c73700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562a54567400 0x562a5460cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b03c75700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a54567000 0x562a5460d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b03474700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a54567800 0x562a5460c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50134/0 (socket says 172.21.15.44:50134) 2024-09-13T18:35:59.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b02c73700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562a54567400 0x562a5460cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:42884/0 (socket says 172.21.15.44:42884) 2024-09-13T18:35:59.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b03474700 1 -- 172.21.15.44:0/1164959989 learned_addr learned my addr 172.21.15.44:0/1164959989 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b03474700 1 -- 172.21.15.44:0/1164959989 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562a54567400 msgr2=0x562a5460cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b03474700 1 --2- 172.21.15.44:0/1164959989 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562a54567400 0x562a5460cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b03474700 1 -- 172.21.15.44:0/1164959989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a54567000 msgr2=0x562a5460d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b03474700 1 --2- 172.21.15.44:0/1164959989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a54567000 0x562a5460d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b03474700 1 -- 172.21.15.44:0/1164959989 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a5458a9c0 con 0x562a54567800 2024-09-13T18:35:59.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b02c73700 1 --2- 172.21.15.44:0/1164959989 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562a54567400 0x562a5460cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:59.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b03474700 1 --2- 172.21.15.44:0/1164959989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a54567800 0x562a5460c580 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x562a546c6d50 tx=0x562a55350c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b234afac7932f94 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b00c6f700 1 -- 172.21.15.44:0/1164959989 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a545b7080 con 0x562a54567800 2024-09-13T18:35:59.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b00c6f700 1 -- 172.21.15.44:0/1164959989 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a5534e300 con 0x562a54567800 2024-09-13T18:35:59.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b00c6f700 1 -- 172.21.15.44:0/1164959989 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a545b7600 con 0x562a54567800 2024-09-13T18:35:59.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b04cba500 1 -- 172.21.15.44:0/1164959989 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a5458a1a0 con 0x562a54567800 2024-09-13T18:35:59.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b04cba500 1 -- 172.21.15.44:0/1164959989 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x562a5458a9c0 con 0x562a54567800 2024-09-13T18:35:59.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b04cba500 4 waiting for MDS map... 2024-09-13T18:35:59.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b00c6f700 1 -- 172.21.15.44:0/1164959989 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x562a545a0c40 con 0x562a54567800 2024-09-13T18:35:59.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b00c6f700 1 -- 172.21.15.44:0/1164959989 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x562a545a8f00 con 0x562a54567800 2024-09-13T18:35:59.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b04cba500 4 Got MDS map 70 2024-09-13T18:35:59.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b04cba500 10 main: main 2024-09-13T18:35:59.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.416+0000 7f2b04cba500 4 main: connecting to RADOS... 2024-09-13T18:35:59.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b04cba500 1 Processor -- start 2024-09-13T18:35:59.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b04cba500 1 -- start start 2024-09-13T18:35:59.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b04cba500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a54862800 0x562a5460d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b04cba500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562a54862c00 0x562a5460db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b04cba500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a54863000 0x562a5460e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b04cba500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a5459de00 con 0x562a54862800 2024-09-13T18:35:59.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b04cba500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a545e8a00 con 0x562a54863000 2024-09-13T18:35:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b04cba500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a545e8780 con 0x562a54862c00 2024-09-13T18:35:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b03c75700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a54862800 0x562a5460d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b03c75700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a54862800 0x562a5460d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50142/0 (socket says 172.21.15.44:50142) 2024-09-13T18:35:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b03c75700 1 -- 172.21.15.44:0/2789657356 learned_addr learned my addr 172.21.15.44:0/2789657356 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b02c73700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a54863000 0x562a5460e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b03474700 1 --2- 172.21.15.44:0/2789657356 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562a54862c00 0x562a5460db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b03c75700 1 -- 172.21.15.44:0/2789657356 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562a54862c00 msgr2=0x562a5460db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b03c75700 1 --2- 172.21.15.44:0/2789657356 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562a54862c00 0x562a5460db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b03c75700 1 -- 172.21.15.44:0/2789657356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a54863000 msgr2=0x562a5460e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b03c75700 1 --2- 172.21.15.44:0/2789657356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a54863000 0x562a5460e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b03c75700 1 -- 172.21.15.44:0/2789657356 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a5458ab60 con 0x562a54862800 2024-09-13T18:35:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b03c75700 1 --2- 172.21.15.44:0/2789657356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a54862800 0x562a5460d600 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x562a546c42a0 tx=0x562a54870c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c6511412d1f7e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2afec6b700 1 -- 172.21.15.44:0/2789657356 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a545b7080 con 0x562a54862800 2024-09-13T18:35:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2afec6b700 1 -- 172.21.15.44:0/2789657356 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a5534ea80 con 0x562a54862800 2024-09-13T18:35:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2afec6b700 1 -- 172.21.15.44:0/2789657356 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a545b7600 con 0x562a54862800 2024-09-13T18:35:59.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b04cba500 1 -- 172.21.15.44:0/2789657356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a54862800 msgr2=0x562a5460d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b04cba500 1 --2- 172.21.15.44:0/2789657356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a54862800 0x562a5460d600 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x562a546c42a0 tx=0x562a54870c00 comp rx=0 tx=0).stop 2024-09-13T18:35:59.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b04cba500 1 -- 172.21.15.44:0/2789657356 shutdown_connections 2024-09-13T18:35:59.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b04cba500 1 --2- 172.21.15.44:0/2789657356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a54863000 0x562a5460e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b04cba500 1 --2- 172.21.15.44:0/2789657356 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562a54862c00 0x562a5460db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b04cba500 1 --2- 172.21.15.44:0/2789657356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a54862800 0x562a5460d600 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b04cba500 1 -- 172.21.15.44:0/2789657356 >> 172.21.15.44:0/2789657356 conn(0x562a54566c00 msgr2=0x562a54657800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b04cba500 1 -- 172.21.15.44:0/2789657356 shutdown_connections 2024-09-13T18:35:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b04cba500 1 -- 172.21.15.44:0/2789657356 wait complete. 2024-09-13T18:35:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.420+0000 7f2b04cba500 1 Processor -- start 2024-09-13T18:35:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2b04cba500 1 -- start start 2024-09-13T18:35:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2b04cba500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562a54862800 0x562a5460f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2b04cba500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a54862c00 0x562a5460ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2b04cba500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a54863000 0x562a5460e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2b04cba500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a545e8500 con 0x562a54862c00 2024-09-13T18:35:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2b04cba500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a545e83c0 con 0x562a54863000 2024-09-13T18:35:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2b04cba500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a545e8280 con 0x562a54862800 2024-09-13T18:35:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2b03474700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a54862c00 0x562a5460ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2b03474700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a54862c00 0x562a5460ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50146/0 (socket says 172.21.15.44:50146) 2024-09-13T18:35:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2b03474700 1 -- 172.21.15.44:0/4257313255 learned_addr learned my addr 172.21.15.44:0/4257313255 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2b03c75700 1 --2- 172.21.15.44:0/4257313255 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562a54862800 0x562a5460f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2b02c73700 1 --2- 172.21.15.44:0/4257313255 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a54863000 0x562a5460e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2b03474700 1 -- 172.21.15.44:0/4257313255 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562a54862800 msgr2=0x562a5460f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2b03474700 1 --2- 172.21.15.44:0/4257313255 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562a54862800 0x562a5460f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2b03474700 1 -- 172.21.15.44:0/4257313255 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a54863000 msgr2=0x562a5460e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2b03474700 1 --2- 172.21.15.44:0/4257313255 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a54863000 0x562a5460e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2b03474700 1 -- 172.21.15.44:0/4257313255 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a5458a340 con 0x562a54862c00 2024-09-13T18:35:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2b02c73700 1 --2- 172.21.15.44:0/4257313255 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a54863000 0x562a5460e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2b03c75700 1 --2- 172.21.15.44:0/4257313255 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562a54862800 0x562a5460f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2b03474700 1 --2- 172.21.15.44:0/4257313255 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a54862c00 0x562a5460ec00 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x562a546c4fc0 tx=0x562a55350de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2afd468700 1 -- 172.21.15.44:0/4257313255 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a545b71e0 con 0x562a54862c00 2024-09-13T18:35:59.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2afd468700 1 -- 172.21.15.44:0/4257313255 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a5534ec00 con 0x562a54862c00 2024-09-13T18:35:59.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2b04cba500 1 -- 172.21.15.44:0/4257313255 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562a5458a000 con 0x562a54862c00 2024-09-13T18:35:59.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2afd468700 1 -- 172.21.15.44:0/4257313255 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a545b6f20 con 0x562a54862c00 2024-09-13T18:35:59.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2b04cba500 1 -- 172.21.15.44:0/4257313255 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a5458aea0 con 0x562a54862c00 2024-09-13T18:35:59.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.424+0000 7f2b04cba500 4 main: resolving pool 10 2024-09-13T18:35:59.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2afd468700 1 -- 172.21.15.44:0/4257313255 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x562a545c6840 con 0x562a54862c00 2024-09-13T18:35:59.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2afd468700 1 --2- 172.21.15.44:0/4257313255 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x562a548da800 0x562a5460f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2afd468700 1 -- 172.21.15.44:0/4257313255 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x562a545a0a80 con 0x562a54862c00 2024-09-13T18:35:59.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2b04cba500 4 main: creating IoCtx.. 2024-09-13T18:35:59.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2b04cba500 1 --2- 172.21.15.44:0/4257313255 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x562a54863400 0x562a5460e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2b04cba500 1 -- 172.21.15.44:0/4257313255 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:1 10.13 10:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78) v8 -- 0x562a54863800 con 0x562a54863400 2024-09-13T18:35:59.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2b03c75700 1 --2- 172.21.15.44:0/4257313255 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x562a548da800 0x562a5460f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2b02c73700 1 --2- 172.21.15.44:0/4257313255 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x562a54863400 0x562a5460e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2b02c73700 1 --2- 172.21.15.44:0/4257313255 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x562a54863400 0x562a5460e100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2b03c75700 1 --2- 172.21.15.44:0/4257313255 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x562a548da800 0x562a5460f700 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x562a546c42a0 tx=0x562a5463d320 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2b02c73700 1 -- 172.21.15.44:0/4257313255 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x562a553e4b40 con 0x562a54863400 2024-09-13T18:35:59.436 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:35:59.437 INFO:teuthology.orchestra.run.smithi044.stdout: "0": { 2024-09-13T18:35:59.437 INFO:teuthology.orchestra.run.smithi044.stdout: "data": { 2024-09-13T18:35:59.437 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 2, 2024-09-13T18:35:59.437 INFO:teuthology.orchestra.run.smithi044.stdout: "inotable": { 2024-09-13T18:35:59.437 INFO:teuthology.orchestra.run.smithi044.stdout: "projected_free": [ 2024-09-13T18:35:59.437 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:59.437 INFO:teuthology.orchestra.run.smithi044.stdout: "start": 1099511628777, 2024-09-13T18:35:59.437 INFO:teuthology.orchestra.run.smithi044.stdout: "len": 1099511626775 2024-09-13T18:35:59.437 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.437 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-13T18:35:59.437 INFO:teuthology.orchestra.run.smithi044.stdout: "free": [ 2024-09-13T18:35:59.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:59.438 INFO:teuthology.orchestra.run.smithi044.stdout: "start": 1099511628777, 2024-09-13T18:35:59.438 INFO:teuthology.orchestra.run.smithi044.stdout: "len": 1099511626775 2024-09-13T18:35:59.438 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.438 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-13T18:35:59.438 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.438 INFO:teuthology.orchestra.run.smithi044.stdout: "result": 0 2024-09-13T18:35:59.438 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.438 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:35:59.438 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:59.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2b04cba500 1 -- 172.21.15.44:0/4257313255 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x562a54863400 msgr2=0x562a5460e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2b04cba500 1 --2- 172.21.15.44:0/4257313255 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x562a54863400 0x562a5460e100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2b04cba500 1 -- 172.21.15.44:0/4257313255 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x562a548da800 msgr2=0x562a5460f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2b04cba500 1 --2- 172.21.15.44:0/4257313255 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x562a548da800 0x562a5460f700 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x562a546c42a0 tx=0x562a5463d320 comp rx=0 tx=0).stop 2024-09-13T18:35:59.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2b04cba500 1 -- 172.21.15.44:0/4257313255 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a54862c00 msgr2=0x562a5460ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2b04cba500 1 --2- 172.21.15.44:0/4257313255 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a54862c00 0x562a5460ec00 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x562a546c4fc0 tx=0x562a55350de0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2b02c73700 1 -- 172.21.15.44:0/4257313255 reap_dead start 2024-09-13T18:35:59.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2b04cba500 1 -- 172.21.15.44:0/4257313255 shutdown_connections 2024-09-13T18:35:59.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2b04cba500 1 -- 172.21.15.44:0/4257313255 >> 172.21.15.44:0/4257313255 conn(0x562a54566c00 msgr2=0x562a54657800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2b04cba500 1 -- 172.21.15.44:0/4257313255 shutdown_connections 2024-09-13T18:35:59.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2b04cba500 1 -- 172.21.15.44:0/4257313255 wait complete. 2024-09-13T18:35:59.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2b04cba500 1 -- 172.21.15.44:0/1164959989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a54567800 msgr2=0x562a5460c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.428+0000 7f2b04cba500 1 --2- 172.21.15.44:0/1164959989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a54567800 0x562a5460c580 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x562a546c6d50 tx=0x562a55350c00 comp rx=0 tx=0).stop 2024-09-13T18:35:59.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.432+0000 7f2b04cba500 1 -- 172.21.15.44:0/1164959989 shutdown_connections 2024-09-13T18:35:59.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.432+0000 7f2b04cba500 1 --2- 172.21.15.44:0/1164959989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a54567000 0x562a5460d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.432+0000 7f2b04cba500 1 --2- 172.21.15.44:0/1164959989 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x562a54567400 0x562a5460cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.432+0000 7f2b04cba500 1 --2- 172.21.15.44:0/1164959989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a54567800 0x562a5460c580 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.432+0000 7f2b04cba500 1 -- 172.21.15.44:0/1164959989 >> 172.21.15.44:0/1164959989 conn(0x562a54567c00 msgr2=0x562a54657000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.432+0000 7f2b04cba500 1 -- 172.21.15.44:0/1164959989 shutdown_connections 2024-09-13T18:35:59.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.432+0000 7f2b04cba500 1 -- 172.21.15.44:0/1164959989 wait complete. 2024-09-13T18:35:59.442 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'inode'] in time 0:00:00.063141, result: { "0": { "data": { "version": 2, "inotable": { "projected_free": [ { "start": 1099511628777, "len": 1099511626775 } ], "free": [ { "start": 1099511628777, "len": 1099511626775 } ] } }, "result": 0 } } 2024-09-13T18:35:59.443 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show session 2024-09-13T18:35:59.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e7ad7a500 1 -- start start 2024-09-13T18:35:59.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e7ad7a500 1 Processor -- start 2024-09-13T18:35:59.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e7ad7a500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4a99b7800 0x55d4a9a5c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e7ad7a500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d4a99b7400 0x55d4a9a5cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e7ad7a500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d4a99b7000 0x55d4a9a5d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e7ad7a500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4a9a38a00 con 0x55d4a99b7800 2024-09-13T18:35:59.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e7ad7a500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4a9a38780 con 0x55d4a99b7000 2024-09-13T18:35:59.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e7ad7a500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4a9a38640 con 0x55d4a99b7400 2024-09-13T18:35:59.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e79534700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4a99b7800 0x55d4a9a5c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e79534700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4a99b7800 0x55d4a9a5c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50164/0 (socket says 172.21.15.44:50164) 2024-09-13T18:35:59.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e79534700 1 -- 172.21.15.44:0/3678073401 learned_addr learned my addr 172.21.15.44:0/3678073401 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e78d33700 1 --2- 172.21.15.44:0/3678073401 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d4a99b7400 0x55d4a9a5cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e79d35700 1 --2- 172.21.15.44:0/3678073401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d4a99b7000 0x55d4a9a5d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e79534700 1 -- 172.21.15.44:0/3678073401 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d4a99b7400 msgr2=0x55d4a9a5cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e79534700 1 --2- 172.21.15.44:0/3678073401 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d4a99b7400 0x55d4a9a5cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e79534700 1 -- 172.21.15.44:0/3678073401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d4a99b7000 msgr2=0x55d4a9a5d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e79534700 1 --2- 172.21.15.44:0/3678073401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d4a99b7000 0x55d4a9a5d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e79534700 1 -- 172.21.15.44:0/3678073401 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4a99da9c0 con 0x55d4a99b7800 2024-09-13T18:35:59.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e79534700 1 --2- 172.21.15.44:0/3678073401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4a99b7800 0x55d4a9a5c580 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x55d4aa790d50 tx=0x55d4aa796c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61c97d4c5f9b128 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e76d2f700 1 -- 172.21.15.44:0/3678073401 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d4a9a07080 con 0x55d4a99b7800 2024-09-13T18:35:59.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e76d2f700 1 -- 172.21.15.44:0/3678073401 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4aa7ae300 con 0x55d4a99b7800 2024-09-13T18:35:59.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e76d2f700 1 -- 172.21.15.44:0/3678073401 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d4a9a07600 con 0x55d4a99b7800 2024-09-13T18:35:59.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/3678073401 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4a99da1a0 con 0x55d4a99b7800 2024-09-13T18:35:59.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/3678073401 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55d4a99da9c0 con 0x55d4a99b7800 2024-09-13T18:35:59.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.520+0000 7f0e7ad7a500 4 waiting for MDS map... 2024-09-13T18:35:59.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.524+0000 7f0e76d2f700 1 -- 172.21.15.44:0/3678073401 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x55d4a99f0c40 con 0x55d4a99b7800 2024-09-13T18:35:59.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.524+0000 7f0e76d2f700 1 -- 172.21.15.44:0/3678073401 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x55d4a99f8f00 con 0x55d4a99b7800 2024-09-13T18:35:59.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.524+0000 7f0e7ad7a500 4 Got MDS map 70 2024-09-13T18:35:59.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.524+0000 7f0e7ad7a500 10 main: main 2024-09-13T18:35:59.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.524+0000 7f0e7ad7a500 4 main: connecting to RADOS... 2024-09-13T18:35:59.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.524+0000 7f0e7ad7a500 1 Processor -- start 2024-09-13T18:35:59.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.524+0000 7f0e7ad7a500 1 -- start start 2024-09-13T18:35:59.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.524+0000 7f0e7ad7a500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d4a9ca8400 0x55d4a9a5d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.524+0000 7f0e7ad7a500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d4a9ca8800 0x55d4a9a5db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.524+0000 7f0e7ad7a500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4a9ca8c00 0x55d4a9a5e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.524+0000 7f0e7ad7a500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4a99ede00 con 0x55d4a9ca8c00 2024-09-13T18:35:59.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.524+0000 7f0e7ad7a500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4a9a38780 con 0x55d4a9ca8800 2024-09-13T18:35:59.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.524+0000 7f0e7ad7a500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4a9a38a00 con 0x55d4a9ca8400 2024-09-13T18:35:59.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.524+0000 7f0e78d33700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4a9ca8c00 0x55d4a9a5e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.524+0000 7f0e79534700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d4a9ca8800 0x55d4a9a5db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.524+0000 7f0e78d33700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4a9ca8c00 0x55d4a9a5e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50166/0 (socket says 172.21.15.44:50166) 2024-09-13T18:35:59.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.524+0000 7f0e79d35700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d4a9ca8400 0x55d4a9a5d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.524+0000 7f0e78d33700 1 -- 172.21.15.44:0/2046059466 learned_addr learned my addr 172.21.15.44:0/2046059466 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e78d33700 1 -- 172.21.15.44:0/2046059466 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d4a9ca8400 msgr2=0x55d4a9a5d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e78d33700 1 --2- 172.21.15.44:0/2046059466 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d4a9ca8400 0x55d4a9a5d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e78d33700 1 -- 172.21.15.44:0/2046059466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d4a9ca8800 msgr2=0x55d4a9a5db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e78d33700 1 --2- 172.21.15.44:0/2046059466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d4a9ca8800 0x55d4a9a5db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e78d33700 1 -- 172.21.15.44:0/2046059466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4a99dab60 con 0x55d4a9ca8c00 2024-09-13T18:35:59.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e79534700 1 --2- 172.21.15.44:0/2046059466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d4a9ca8800 0x55d4a9a5db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:59.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e78d33700 1 --2- 172.21.15.44:0/2046059466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4a9ca8c00 0x55d4a9a5e100 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x55d4aa78e210 tx=0x55d4a9cc0c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0a1692187a4df9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e74d2b700 1 -- 172.21.15.44:0/2046059466 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d4a9a07080 con 0x55d4a9ca8c00 2024-09-13T18:35:59.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e74d2b700 1 -- 172.21.15.44:0/2046059466 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4aa7aea80 con 0x55d4a9ca8c00 2024-09-13T18:35:59.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e74d2b700 1 -- 172.21.15.44:0/2046059466 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d4a9a07600 con 0x55d4a9ca8c00 2024-09-13T18:35:59.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/2046059466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4a9ca8c00 msgr2=0x55d4a9a5e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e7ad7a500 1 --2- 172.21.15.44:0/2046059466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4a9ca8c00 0x55d4a9a5e100 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x55d4aa78e210 tx=0x55d4a9cc0c00 comp rx=0 tx=0).stop 2024-09-13T18:35:59.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/2046059466 shutdown_connections 2024-09-13T18:35:59.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e7ad7a500 1 --2- 172.21.15.44:0/2046059466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4a9ca8c00 0x55d4a9a5e100 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e7ad7a500 1 --2- 172.21.15.44:0/2046059466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d4a9ca8800 0x55d4a9a5db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e7ad7a500 1 --2- 172.21.15.44:0/2046059466 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d4a9ca8400 0x55d4a9a5d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/2046059466 >> 172.21.15.44:0/2046059466 conn(0x55d4a99b6c00 msgr2=0x55d4a9aa7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/2046059466 shutdown_connections 2024-09-13T18:35:59.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/2046059466 wait complete. 2024-09-13T18:35:59.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e7ad7a500 1 Processor -- start 2024-09-13T18:35:59.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e7ad7a500 1 -- start start 2024-09-13T18:35:59.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e7ad7a500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d4a9ca8400 0x55d4a9a5f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e7ad7a500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4a9ca8800 0x55d4a9a5ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e7ad7a500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d4a9ca8c00 0x55d4a9a5e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e7ad7a500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4a9a38500 con 0x55d4a9ca8800 2024-09-13T18:35:59.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e7ad7a500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4a9a383c0 con 0x55d4a9ca8c00 2024-09-13T18:35:59.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e7ad7a500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4a9a38280 con 0x55d4a9ca8400 2024-09-13T18:35:59.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e79534700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4a9ca8800 0x55d4a9a5ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e79534700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4a9ca8800 0x55d4a9a5ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50172/0 (socket says 172.21.15.44:50172) 2024-09-13T18:35:59.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e79534700 1 -- 172.21.15.44:0/3180583080 learned_addr learned my addr 172.21.15.44:0/3180583080 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e79d35700 1 --2- 172.21.15.44:0/3180583080 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d4a9ca8400 0x55d4a9a5f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.528+0000 7f0e78d33700 1 --2- 172.21.15.44:0/3180583080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d4a9ca8c00 0x55d4a9a5e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.532+0000 7f0e79534700 1 -- 172.21.15.44:0/3180583080 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d4a9ca8400 msgr2=0x55d4a9a5f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.532+0000 7f0e79534700 1 --2- 172.21.15.44:0/3180583080 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d4a9ca8400 0x55d4a9a5f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.532+0000 7f0e79534700 1 -- 172.21.15.44:0/3180583080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d4a9ca8c00 msgr2=0x55d4a9a5e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.532+0000 7f0e79534700 1 --2- 172.21.15.44:0/3180583080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d4a9ca8c00 0x55d4a9a5e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.532+0000 7f0e79534700 1 -- 172.21.15.44:0/3180583080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4a99da340 con 0x55d4a9ca8800 2024-09-13T18:35:59.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.532+0000 7f0e78d33700 1 --2- 172.21.15.44:0/3180583080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d4a9ca8c00 0x55d4a9a5e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:59.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.532+0000 7f0e79534700 1 --2- 172.21.15.44:0/3180583080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4a9ca8800 0x55d4a9a5ec00 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x55d4aa78ef90 tx=0x55d4aa796de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.532+0000 7f0e73528700 1 -- 172.21.15.44:0/3180583080 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d4a9a071e0 con 0x55d4a9ca8800 2024-09-13T18:35:59.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.532+0000 7f0e73528700 1 -- 172.21.15.44:0/3180583080 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4aa7aed80 con 0x55d4a9ca8800 2024-09-13T18:35:59.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.532+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/3180583080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d4a99da000 con 0x55d4a9ca8800 2024-09-13T18:35:59.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.532+0000 7f0e73528700 1 -- 172.21.15.44:0/3180583080 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d4a9a06f20 con 0x55d4a9ca8800 2024-09-13T18:35:59.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.532+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/3180583080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4a99daea0 con 0x55d4a9ca8800 2024-09-13T18:35:59.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.532+0000 7f0e7ad7a500 4 main: resolving pool 10 2024-09-13T18:35:59.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.532+0000 7f0e73528700 1 -- 172.21.15.44:0/3180583080 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x55d4a9a16840 con 0x55d4a9ca8800 2024-09-13T18:35:59.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.532+0000 7f0e73528700 1 --2- 172.21.15.44:0/3180583080 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55d4a9e02000 0x55d4a9a5f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.532+0000 7f0e73528700 1 -- 172.21.15.44:0/3180583080 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x55d4a99f0a80 con 0x55d4a9ca8800 2024-09-13T18:35:59.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.532+0000 7f0e7ad7a500 4 main: creating IoCtx.. 2024-09-13T18:35:59.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.532+0000 7f0e7ad7a500 1 --2- 172.21.15.44:0/3180583080 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55d4a9ca9000 0x55d4a9a5e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.532+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/3180583080 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:1 10.b 10:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78) v8 -- 0x55d4a9ca9400 con 0x55d4a9ca9000 2024-09-13T18:35:59.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.532+0000 7f0e79d35700 1 --2- 172.21.15.44:0/3180583080 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55d4a9e02000 0x55d4a9a5f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.536+0000 7f0e78d33700 1 --2- 172.21.15.44:0/3180583080 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55d4a9ca9000 0x55d4a9a5e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.536+0000 7f0e79d35700 1 --2- 172.21.15.44:0/3180583080 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55d4a9e02000 0x55d4a9a5f700 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x55d4aa790270 tx=0x55d4a9cc1020 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.536+0000 7f0e78d33700 1 --2- 172.21.15.44:0/3180583080 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55d4a9ca9000 0x55d4a9a5e100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.536+0000 7f0e78d33700 1 -- 172.21.15.44:0/3180583080 <== osd.6 v2:172.21.15.99:6808/2907584318 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv3 ondisk = 0) v8 ==== 159+0+14 (crc 0 0 0) 0x55d4aa79cb40 con 0x55d4a9ca9000 2024-09-13T18:35:59.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.536+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/3180583080 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:2 10.b 10:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78) v8 -- 0x55d4a9ca9800 con 0x55d4a9ca9000 2024-09-13T18:35:59.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.536+0000 7f0e78d33700 1 -- 172.21.15.44:0/3180583080 <== osd.6 v2:172.21.15.99:6808/2907584318 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=472b] v0'0 uv3 ondisk = 0) v8 ==== 159+0+472 (crc 0 0 0) 0x55d4aa79cb40 con 0x55d4a9ca9000 2024-09-13T18:35:59.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.536+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/3180583080 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:3 10.b 10:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78) v8 -- 0x55d4a9e02400 con 0x55d4a9ca9000 2024-09-13T18:35:59.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.536+0000 7f0e78d33700 1 -- 172.21.15.44:0/3180583080 <== osd.6 v2:172.21.15.99:6808/2907584318 3 ==== osd_op_reply(3 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 159+0+5 (crc 0 0 0) 0x55d4aa79cb40 con 0x55d4a9ca9000 2024-09-13T18:35:59.544 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:35:59.544 INFO:teuthology.orchestra.run.smithi044.stdout: "0": { 2024-09-13T18:35:59.544 INFO:teuthology.orchestra.run.smithi044.stdout: "data": { 2024-09-13T18:35:59.544 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions": [ 2024-09-13T18:35:59.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:59.544 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 7815, 2024-09-13T18:35:59.544 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": { 2024-09-13T18:35:59.545 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2024-09-13T18:35:59.545 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2024-09-13T18:35:59.545 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 7815 2024-09-13T18:35:59.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.545 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:35:59.545 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "any", 2024-09-13T18:35:59.545 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:35:59.545 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3808762181 2024-09-13T18:35:59.545 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.545 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "open", 2024-09-13T18:35:59.545 INFO:teuthology.orchestra.run.smithi044.stdout: "num_leases": 0, 2024-09-13T18:35:59.545 INFO:teuthology.orchestra.run.smithi044.stdout: "num_caps": 0, 2024-09-13T18:35:59.545 INFO:teuthology.orchestra.run.smithi044.stdout: "request_load_avg": 0, 2024-09-13T18:35:59.546 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 0, 2024-09-13T18:35:59.546 INFO:teuthology.orchestra.run.smithi044.stdout: "requests_in_flight": 0, 2024-09-13T18:35:59.546 INFO:teuthology.orchestra.run.smithi044.stdout: "num_completed_requests": 2, 2024-09-13T18:35:59.546 INFO:teuthology.orchestra.run.smithi044.stdout: "num_completed_flushes": 0, 2024-09-13T18:35:59.546 INFO:teuthology.orchestra.run.smithi044.stdout: "reconnecting": false, 2024-09-13T18:35:59.546 INFO:teuthology.orchestra.run.smithi044.stdout: "recall_caps": { 2024-09-13T18:35:59.546 INFO:teuthology.orchestra.run.smithi044.stdout: "value": 0, 2024-09-13T18:35:59.546 INFO:teuthology.orchestra.run.smithi044.stdout: "halflife": 60 2024-09-13T18:35:59.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.546 INFO:teuthology.orchestra.run.smithi044.stdout: "release_caps": { 2024-09-13T18:35:59.546 INFO:teuthology.orchestra.run.smithi044.stdout: "value": 0, 2024-09-13T18:35:59.546 INFO:teuthology.orchestra.run.smithi044.stdout: "halflife": 60 2024-09-13T18:35:59.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.546 INFO:teuthology.orchestra.run.smithi044.stdout: "recall_caps_throttle": { 2024-09-13T18:35:59.547 INFO:teuthology.orchestra.run.smithi044.stdout: "value": 0, 2024-09-13T18:35:59.547 INFO:teuthology.orchestra.run.smithi044.stdout: "halflife": 1.5 2024-09-13T18:35:59.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.547 INFO:teuthology.orchestra.run.smithi044.stdout: "recall_caps_throttle2o": { 2024-09-13T18:35:59.547 INFO:teuthology.orchestra.run.smithi044.stdout: "value": 0, 2024-09-13T18:35:59.547 INFO:teuthology.orchestra.run.smithi044.stdout: "halflife": 0.5 2024-09-13T18:35:59.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.547 INFO:teuthology.orchestra.run.smithi044.stdout: "session_cache_liveness": { 2024-09-13T18:35:59.547 INFO:teuthology.orchestra.run.smithi044.stdout: "value": 0, 2024-09-13T18:35:59.547 INFO:teuthology.orchestra.run.smithi044.stdout: "halflife": 300 2024-09-13T18:35:59.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.547 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_acquisition": { 2024-09-13T18:35:59.547 INFO:teuthology.orchestra.run.smithi044.stdout: "value": 0, 2024-09-13T18:35:59.547 INFO:teuthology.orchestra.run.smithi044.stdout: "halflife": 30 2024-09-13T18:35:59.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.548 INFO:teuthology.orchestra.run.smithi044.stdout: "last_trim_completed_requests_tid": 0, 2024-09-13T18:35:59.548 INFO:teuthology.orchestra.run.smithi044.stdout: "last_trim_completed_flushes_tid": 0, 2024-09-13T18:35:59.548 INFO:teuthology.orchestra.run.smithi044.stdout: "delegated_inos": [], 2024-09-13T18:35:59.548 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": "client.7815 192.168.0.1:0/3808762181", 2024-09-13T18:35:59.548 INFO:teuthology.orchestra.run.smithi044.stdout: "completed_requests": [ 2024-09-13T18:35:59.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:59.548 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 2, 2024-09-13T18:35:59.548 INFO:teuthology.orchestra.run.smithi044.stdout: "created_ino": "0x0" 2024-09-13T18:35:59.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.548 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:59.548 INFO:teuthology.orchestra.run.smithi044.stdout: "tid": 7, 2024-09-13T18:35:59.548 INFO:teuthology.orchestra.run.smithi044.stdout: "created_ino": "0x10000000000" 2024-09-13T18:35:59.548 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.549 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-13T18:35:59.549 INFO:teuthology.orchestra.run.smithi044.stdout: "prealloc_inos": [ 2024-09-13T18:35:59.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:59.549 INFO:teuthology.orchestra.run.smithi044.stdout: "start": "0x10000000001", 2024-09-13T18:35:59.549 INFO:teuthology.orchestra.run.smithi044.stdout: "length": 1000 2024-09-13T18:35:59.549 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.549 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-13T18:35:59.549 INFO:teuthology.orchestra.run.smithi044.stdout: "client_metadata": { 2024-09-13T18:35:59.549 INFO:teuthology.orchestra.run.smithi044.stdout: "client_features": { 2024-09-13T18:35:59.549 INFO:teuthology.orchestra.run.smithi044.stdout: "feature_bits": "0x00000000003fffff" 2024-09-13T18:35:59.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.549 INFO:teuthology.orchestra.run.smithi044.stdout: "metric_spec": { 2024-09-13T18:35:59.549 INFO:teuthology.orchestra.run.smithi044.stdout: "metric_flags": { 2024-09-13T18:35:59.549 INFO:teuthology.orchestra.run.smithi044.stdout: "feature_bits": "0x000000000000ffff" 2024-09-13T18:35:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:35:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:35:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "0", 2024-09-13T18:35:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2024-09-13T18:35:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:35:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "46486", 2024-09-13T18:35:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2024-09-13T18:35:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-13T18:35:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: "result": 0 2024-09-13T18:35:59.550 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.551 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:35:59.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.536+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/3180583080 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55d4a9ca9000 msgr2=0x55d4a9a5e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.536+0000 7f0e7ad7a500 1 --2- 172.21.15.44:0/3180583080 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55d4a9ca9000 0x55d4a9a5e100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.536+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/3180583080 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55d4a9e02000 msgr2=0x55d4a9a5f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.536+0000 7f0e7ad7a500 1 --2- 172.21.15.44:0/3180583080 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55d4a9e02000 0x55d4a9a5f700 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x55d4aa790270 tx=0x55d4a9cc1020 comp rx=0 tx=0).stop 2024-09-13T18:35:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.536+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/3180583080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4a9ca8800 msgr2=0x55d4a9a5ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.536+0000 7f0e7ad7a500 1 --2- 172.21.15.44:0/3180583080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4a9ca8800 0x55d4a9a5ec00 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x55d4aa78ef90 tx=0x55d4aa796de0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.536+0000 7f0e78d33700 1 -- 172.21.15.44:0/3180583080 reap_dead start 2024-09-13T18:35:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.540+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/3180583080 shutdown_connections 2024-09-13T18:35:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.540+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/3180583080 >> 172.21.15.44:0/3180583080 conn(0x55d4a99b6c00 msgr2=0x55d4a9aa7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.540+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/3180583080 shutdown_connections 2024-09-13T18:35:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.540+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/3180583080 wait complete. 2024-09-13T18:35:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.540+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/3678073401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4a99b7800 msgr2=0x55d4a9a5c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.540+0000 7f0e7ad7a500 1 --2- 172.21.15.44:0/3678073401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4a99b7800 0x55d4a9a5c580 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x55d4aa790d50 tx=0x55d4aa796c00 comp rx=0 tx=0).stop 2024-09-13T18:35:59.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.540+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/3678073401 shutdown_connections 2024-09-13T18:35:59.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.540+0000 7f0e7ad7a500 1 --2- 172.21.15.44:0/3678073401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d4a99b7000 0x55d4a9a5d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.540+0000 7f0e7ad7a500 1 --2- 172.21.15.44:0/3678073401 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55d4a99b7400 0x55d4a9a5cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.540+0000 7f0e7ad7a500 1 --2- 172.21.15.44:0/3678073401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4a99b7800 0x55d4a9a5c580 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.540+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/3678073401 >> 172.21.15.44:0/3678073401 conn(0x55d4a99b7c00 msgr2=0x55d4a9aa7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.540+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/3678073401 shutdown_connections 2024-09-13T18:35:59.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.540+0000 7f0e7ad7a500 1 -- 172.21.15.44:0/3678073401 wait complete. 2024-09-13T18:35:59.554 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'session'] in time 0:00:00.111600, result: { "0": { "data": { "sessions": [ { "id": 7815, "entity": { "name": { "type": "client", "num": 7815 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 3808762181 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 2, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.7815 192.168.0.1:0/3808762181", "completed_requests": [ { "tid": 2, "created_ino": "0x0" }, { "tid": 7, "created_ino": "0x10000000000" } ], "prealloc_inos": [ { "start": "0x10000000001", "length": 1000 } ], "client_metadata": { "client_features": { "feature_bits": "0x00000000003fffff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "entity_id": "0", "hostname": "smithi044", "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "46486", "root": "/" } } ] }, "result": 0 } } 2024-09-13T18:35:59.554 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show snap 2024-09-13T18:35:59.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.588+0000 7fc174534500 1 -- start start 2024-09-13T18:35:59.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.588+0000 7fc174534500 1 Processor -- start 2024-09-13T18:35:59.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.588+0000 7fc174534500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fc4e617800 0x55fc4e6bc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.588+0000 7fc174534500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc4e617400 0x55fc4e6bcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.588+0000 7fc174534500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fc4e617000 0x55fc4e6bd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.588+0000 7fc174534500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc4e698a00 con 0x55fc4e617800 2024-09-13T18:35:59.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.588+0000 7fc174534500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc4e64de00 con 0x55fc4e617400 2024-09-13T18:35:59.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.588+0000 7fc174534500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc4e698640 con 0x55fc4e617000 2024-09-13T18:35:59.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.588+0000 7fc172cee700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fc4e617800 0x55fc4e6bc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.588+0000 7fc172cee700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fc4e617800 0x55fc4e6bc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50200/0 (socket says 172.21.15.44:50200) 2024-09-13T18:35:59.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.588+0000 7fc172cee700 1 -- 172.21.15.44:0/3857873610 learned_addr learned my addr 172.21.15.44:0/3857873610 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.588+0000 7fc1724ed700 1 --2- 172.21.15.44:0/3857873610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc4e617400 0x55fc4e6bcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.588+0000 7fc1734ef700 1 --2- 172.21.15.44:0/3857873610 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fc4e617000 0x55fc4e6bd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.588+0000 7fc172cee700 1 -- 172.21.15.44:0/3857873610 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fc4e617000 msgr2=0x55fc4e6bd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.588+0000 7fc172cee700 1 --2- 172.21.15.44:0/3857873610 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fc4e617000 0x55fc4e6bd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.588+0000 7fc172cee700 1 -- 172.21.15.44:0/3857873610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc4e617400 msgr2=0x55fc4e6bcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.588+0000 7fc172cee700 1 --2- 172.21.15.44:0/3857873610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc4e617400 0x55fc4e6bcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.588+0000 7fc172cee700 1 -- 172.21.15.44:0/3857873610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc4e63a9c0 con 0x55fc4e617800 2024-09-13T18:35:59.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.588+0000 7fc172cee700 1 --2- 172.21.15.44:0/3857873610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fc4e617800 0x55fc4e6bc580 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x55fc4e776d20 tx=0x55fc4e6ec240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec1fb42e7a9c1d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc1704e9700 1 -- 172.21.15.44:0/3857873610 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fc4e667080 con 0x55fc4e617800 2024-09-13T18:35:59.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc1704e9700 1 -- 172.21.15.44:0/3857873610 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc4f3f6300 con 0x55fc4e617800 2024-09-13T18:35:59.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc174534500 1 -- 172.21.15.44:0/3857873610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc4e63a1a0 con 0x55fc4e617800 2024-09-13T18:35:59.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc174534500 1 -- 172.21.15.44:0/3857873610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55fc4e63a9c0 con 0x55fc4e617800 2024-09-13T18:35:59.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc174534500 4 waiting for MDS map... 2024-09-13T18:35:59.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc1704e9700 1 -- 172.21.15.44:0/3857873610 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fc4e667600 con 0x55fc4e617800 2024-09-13T18:35:59.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc1704e9700 1 -- 172.21.15.44:0/3857873610 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x55fc4e650c40 con 0x55fc4e617800 2024-09-13T18:35:59.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc1704e9700 1 -- 172.21.15.44:0/3857873610 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x55fc4e658f00 con 0x55fc4e617800 2024-09-13T18:35:59.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc174534500 4 Got MDS map 70 2024-09-13T18:35:59.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc174534500 10 main: main 2024-09-13T18:35:59.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc174534500 4 main: connecting to RADOS... 2024-09-13T18:35:59.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc174534500 1 Processor -- start 2024-09-13T18:35:59.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc174534500 1 -- start start 2024-09-13T18:35:59.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc174534500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc4e90a400 0x55fc4e6bd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc174534500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fc4e90a800 0x55fc4e6bdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc174534500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fc4e90ac00 0x55fc4e6be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc174534500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc4e698500 con 0x55fc4e90a800 2024-09-13T18:35:59.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc174534500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc4e6983c0 con 0x55fc4e90a400 2024-09-13T18:35:59.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc174534500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc4e698280 con 0x55fc4e90ac00 2024-09-13T18:35:59.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc172cee700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fc4e90a800 0x55fc4e6bdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc172cee700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fc4e90a800 0x55fc4e6bdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50214/0 (socket says 172.21.15.44:50214) 2024-09-13T18:35:59.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc172cee700 1 -- 172.21.15.44:0/1680467610 learned_addr learned my addr 172.21.15.44:0/1680467610 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc1724ed700 1 --2- 172.21.15.44:0/1680467610 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fc4e90ac00 0x55fc4e6be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc1734ef700 1 --2- 172.21.15.44:0/1680467610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc4e90a400 0x55fc4e6bd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc172cee700 1 -- 172.21.15.44:0/1680467610 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fc4e90ac00 msgr2=0x55fc4e6be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc172cee700 1 --2- 172.21.15.44:0/1680467610 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fc4e90ac00 0x55fc4e6be100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc172cee700 1 -- 172.21.15.44:0/1680467610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc4e90a400 msgr2=0x55fc4e6bd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc172cee700 1 --2- 172.21.15.44:0/1680467610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc4e90a400 0x55fc4e6bd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc172cee700 1 -- 172.21.15.44:0/1680467610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc4e63ab60 con 0x55fc4e90a800 2024-09-13T18:35:59.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc172cee700 1 --2- 172.21.15.44:0/1680467610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fc4e90a800 0x55fc4e6bdb80 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x55fc4e774240 tx=0x55fc4e6ec3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44567f848442f67f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc16e4e5700 1 -- 172.21.15.44:0/1680467610 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fc4e6671e0 con 0x55fc4e90a800 2024-09-13T18:35:59.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc16e4e5700 1 -- 172.21.15.44:0/1680467610 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc4f3f7800 con 0x55fc4e90a800 2024-09-13T18:35:59.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc16e4e5700 1 -- 172.21.15.44:0/1680467610 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fc4e666f20 con 0x55fc4e90a800 2024-09-13T18:35:59.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc174534500 1 -- 172.21.15.44:0/1680467610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fc4e90a800 msgr2=0x55fc4e6bdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc174534500 1 --2- 172.21.15.44:0/1680467610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fc4e90a800 0x55fc4e6bdb80 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x55fc4e774240 tx=0x55fc4e6ec3c0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc174534500 1 -- 172.21.15.44:0/1680467610 shutdown_connections 2024-09-13T18:35:59.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc174534500 1 --2- 172.21.15.44:0/1680467610 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fc4e90ac00 0x55fc4e6be100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc174534500 1 --2- 172.21.15.44:0/1680467610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fc4e90a800 0x55fc4e6bdb80 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc174534500 1 --2- 172.21.15.44:0/1680467610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc4e90a400 0x55fc4e6bd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.592+0000 7fc174534500 1 -- 172.21.15.44:0/1680467610 >> 172.21.15.44:0/1680467610 conn(0x55fc4e616c00 msgr2=0x55fc4e6e5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc174534500 1 -- 172.21.15.44:0/1680467610 shutdown_connections 2024-09-13T18:35:59.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc174534500 1 -- 172.21.15.44:0/1680467610 wait complete. 2024-09-13T18:35:59.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc174534500 1 Processor -- start 2024-09-13T18:35:59.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc174534500 1 -- start start 2024-09-13T18:35:59.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc174534500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fc4e90a400 0x55fc4e6bf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc174534500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fc4e90a800 0x55fc4e6bec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc174534500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc4e90ac00 0x55fc4e6be680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc174534500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc4e698a00 con 0x55fc4e90a400 2024-09-13T18:35:59.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc174534500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc4e698280 con 0x55fc4e90ac00 2024-09-13T18:35:59.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc174534500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc4e698640 con 0x55fc4e90a800 2024-09-13T18:35:59.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc1734ef700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fc4e90a400 0x55fc4e6bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc1734ef700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fc4e90a400 0x55fc4e6bf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50222/0 (socket says 172.21.15.44:50222) 2024-09-13T18:35:59.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc1734ef700 1 -- 172.21.15.44:0/460327098 learned_addr learned my addr 172.21.15.44:0/460327098 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc1724ed700 1 --2- 172.21.15.44:0/460327098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc4e90ac00 0x55fc4e6be680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc172cee700 1 --2- 172.21.15.44:0/460327098 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fc4e90a800 0x55fc4e6bec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc1734ef700 1 -- 172.21.15.44:0/460327098 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fc4e90a800 msgr2=0x55fc4e6bec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc1734ef700 1 --2- 172.21.15.44:0/460327098 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fc4e90a800 0x55fc4e6bec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc1734ef700 1 -- 172.21.15.44:0/460327098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc4e90ac00 msgr2=0x55fc4e6be680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc1734ef700 1 --2- 172.21.15.44:0/460327098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc4e90ac00 0x55fc4e6be680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc1734ef700 1 -- 172.21.15.44:0/460327098 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc4e63a1a0 con 0x55fc4e90a400 2024-09-13T18:35:59.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc1724ed700 1 --2- 172.21.15.44:0/460327098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc4e90ac00 0x55fc4e6be680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:59.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc1734ef700 1 --2- 172.21.15.44:0/460327098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fc4e90a400 0x55fc4e6bf180 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x55fc4e775110 tx=0x55fc4e96ab40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc16cce2700 1 -- 172.21.15.44:0/460327098 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fc4e6671e0 con 0x55fc4e90a400 2024-09-13T18:35:59.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc16cce2700 1 -- 172.21.15.44:0/460327098 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc4e662480 con 0x55fc4e90a400 2024-09-13T18:35:59.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc174534500 1 -- 172.21.15.44:0/460327098 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fc4e63a9c0 con 0x55fc4e90a400 2024-09-13T18:35:59.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc16cce2700 1 -- 172.21.15.44:0/460327098 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fc4e666f20 con 0x55fc4e90a400 2024-09-13T18:35:59.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc174534500 1 -- 172.21.15.44:0/460327098 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc4e63ab60 con 0x55fc4e90a400 2024-09-13T18:35:59.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.596+0000 7fc174534500 4 main: resolving pool 10 2024-09-13T18:35:59.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.600+0000 7fc16cce2700 1 -- 172.21.15.44:0/460327098 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x55fc4e676b00 con 0x55fc4e90a400 2024-09-13T18:35:59.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.600+0000 7fc16cce2700 1 --2- 172.21.15.44:0/460327098 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55fc4ea60000 0x55fc4e6bf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.600+0000 7fc16cce2700 1 -- 172.21.15.44:0/460327098 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x55fc4e650a80 con 0x55fc4e90a400 2024-09-13T18:35:59.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.600+0000 7fc174534500 4 main: creating IoCtx.. 2024-09-13T18:35:59.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.600+0000 7fc174534500 1 --2- 172.21.15.44:0/460327098 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55fc4e90b000 0x55fc4e6be100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.600+0000 7fc174534500 1 -- 172.21.15.44:0/460327098 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:1 10.d 10:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78) v8 -- 0x55fc4e90b400 con 0x55fc4e90b000 2024-09-13T18:35:59.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.600+0000 7fc172cee700 1 --2- 172.21.15.44:0/460327098 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55fc4ea60000 0x55fc4e6bf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.600+0000 7fc1724ed700 1 --2- 172.21.15.44:0/460327098 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55fc4e90b000 0x55fc4e6be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.600+0000 7fc172cee700 1 --2- 172.21.15.44:0/460327098 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55fc4ea60000 0x55fc4e6bf700 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x55fc4e774240 tx=0x55fc4e96bce0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.600+0000 7fc1724ed700 1 --2- 172.21.15.44:0/460327098 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55fc4e90b000 0x55fc4e6be100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.604+0000 7fc1724ed700 1 -- 172.21.15.44:0/460327098 <== osd.6 v2:172.21.15.99:6808/2907584318 1 ==== osd_op_reply(1 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x55fc4f488b40 con 0x55fc4e90b000 2024-09-13T18:35:59.611 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:35:59.611 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 1, 2024-09-13T18:35:59.611 INFO:teuthology.orchestra.run.smithi044.stdout: "snapserver": { 2024-09-13T18:35:59.611 INFO:teuthology.orchestra.run.smithi044.stdout: "last_snap": 1, 2024-09-13T18:35:59.612 INFO:teuthology.orchestra.run.smithi044.stdout: "last_created": 1, 2024-09-13T18:35:59.612 INFO:teuthology.orchestra.run.smithi044.stdout: "last_destroyed": 1, 2024-09-13T18:35:59.612 INFO:teuthology.orchestra.run.smithi044.stdout: "pending_noop": [], 2024-09-13T18:35:59.612 INFO:teuthology.orchestra.run.smithi044.stdout: "snaps": [], 2024-09-13T18:35:59.612 INFO:teuthology.orchestra.run.smithi044.stdout: "need_to_purge": {}, 2024-09-13T18:35:59.612 INFO:teuthology.orchestra.run.smithi044.stdout: "pending_update": [], 2024-09-13T18:35:59.612 INFO:teuthology.orchestra.run.smithi044.stdout: "pending_destroy": [] 2024-09-13T18:35:59.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.612 INFO:teuthology.orchestra.run.smithi044.stdout: "result": 0 2024-09-13T18:35:59.612 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:35:59.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:59.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.604+0000 7fc174534500 1 -- 172.21.15.44:0/460327098 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55fc4e90b000 msgr2=0x55fc4e6be100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.604+0000 7fc174534500 1 --2- 172.21.15.44:0/460327098 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55fc4e90b000 0x55fc4e6be100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.604+0000 7fc174534500 1 -- 172.21.15.44:0/460327098 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55fc4ea60000 msgr2=0x55fc4e6bf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.604+0000 7fc174534500 1 --2- 172.21.15.44:0/460327098 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55fc4ea60000 0x55fc4e6bf700 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x55fc4e774240 tx=0x55fc4e96bce0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.604+0000 7fc174534500 1 -- 172.21.15.44:0/460327098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fc4e90a400 msgr2=0x55fc4e6bf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.604+0000 7fc174534500 1 --2- 172.21.15.44:0/460327098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fc4e90a400 0x55fc4e6bf180 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x55fc4e775110 tx=0x55fc4e96ab40 comp rx=0 tx=0).stop 2024-09-13T18:35:59.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.604+0000 7fc1724ed700 1 -- 172.21.15.44:0/460327098 reap_dead start 2024-09-13T18:35:59.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.604+0000 7fc174534500 1 -- 172.21.15.44:0/460327098 shutdown_connections 2024-09-13T18:35:59.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.604+0000 7fc174534500 1 -- 172.21.15.44:0/460327098 >> 172.21.15.44:0/460327098 conn(0x55fc4e616c00 msgr2=0x55fc4e6e5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.604+0000 7fc174534500 1 -- 172.21.15.44:0/460327098 shutdown_connections 2024-09-13T18:35:59.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.604+0000 7fc174534500 1 -- 172.21.15.44:0/460327098 wait complete. 2024-09-13T18:35:59.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.604+0000 7fc174534500 1 -- 172.21.15.44:0/3857873610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fc4e617800 msgr2=0x55fc4e6bc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.604+0000 7fc174534500 1 --2- 172.21.15.44:0/3857873610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fc4e617800 0x55fc4e6bc580 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x55fc4e776d20 tx=0x55fc4e6ec240 comp rx=0 tx=0).stop 2024-09-13T18:35:59.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.604+0000 7fc174534500 1 -- 172.21.15.44:0/3857873610 shutdown_connections 2024-09-13T18:35:59.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.604+0000 7fc174534500 1 --2- 172.21.15.44:0/3857873610 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55fc4e617000 0x55fc4e6bd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.604+0000 7fc174534500 1 --2- 172.21.15.44:0/3857873610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc4e617400 0x55fc4e6bcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.604+0000 7fc174534500 1 --2- 172.21.15.44:0/3857873610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fc4e617800 0x55fc4e6bc580 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.604+0000 7fc174534500 1 -- 172.21.15.44:0/3857873610 >> 172.21.15.44:0/3857873610 conn(0x55fc4e617c00 msgr2=0x55fc4e6e5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.604+0000 7fc174534500 1 -- 172.21.15.44:0/3857873610 shutdown_connections 2024-09-13T18:35:59.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.604+0000 7fc174534500 1 -- 172.21.15.44:0/3857873610 wait complete. 2024-09-13T18:35:59.616 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'snap'] in time 0:00:00.061327, result: { "version": 1, "snapserver": { "last_snap": 1, "last_created": 1, "last_destroyed": 1, "pending_noop": [], "snaps": [], "need_to_purge": {}, "pending_update": [], "pending_destroy": [] }, "result": 0 } 2024-09-13T18:35:59.616 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all reset session 2024-09-13T18:35:59.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.648+0000 7f36ee131500 1 -- start start 2024-09-13T18:35:59.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.648+0000 7f36ee131500 1 Processor -- start 2024-09-13T18:35:59.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.648+0000 7f36ee131500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a13dc35800 0x55a13dcda580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.648+0000 7f36ee131500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a13dc35400 0x55a13dcdab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.648+0000 7f36ee131500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a13dc35000 0x55a13dcdb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.648+0000 7f36ee131500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a13dcb6a00 con 0x55a13dc35000 2024-09-13T18:35:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.648+0000 7f36ee131500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a13dcb6780 con 0x55a13dc35400 2024-09-13T18:35:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.648+0000 7f36ee131500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a13dcb6640 con 0x55a13dc35800 2024-09-13T18:35:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ed0ec700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a13dc35000 0x55a13dcdb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ec8eb700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a13dc35800 0x55a13dcda580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ed0ec700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a13dc35000 0x55a13dcdb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50252/0 (socket says 172.21.15.44:50252) 2024-09-13T18:35:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ec8eb700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a13dc35800 0x55a13dcda580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:42976/0 (socket says 172.21.15.44:42976) 2024-09-13T18:35:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ed0ec700 1 -- 172.21.15.44:0/902110009 learned_addr learned my addr 172.21.15.44:0/902110009 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ec0ea700 1 --2- 172.21.15.44:0/902110009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a13dc35400 0x55a13dcdab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ed0ec700 1 -- 172.21.15.44:0/902110009 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a13dc35800 msgr2=0x55a13dcda580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ed0ec700 1 --2- 172.21.15.44:0/902110009 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a13dc35800 0x55a13dcda580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ed0ec700 1 -- 172.21.15.44:0/902110009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a13dc35400 msgr2=0x55a13dcdab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ed0ec700 1 --2- 172.21.15.44:0/902110009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a13dc35400 0x55a13dcdab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ed0ec700 1 -- 172.21.15.44:0/902110009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a13dc589c0 con 0x55a13dc35000 2024-09-13T18:35:59.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ed0ec700 1 --2- 172.21.15.44:0/902110009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a13dc35000 0x55a13dcdb080 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x55a13dd94d80 tx=0x55a13ea0cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a2ba27324fd1f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ea0e6700 1 -- 172.21.15.44:0/902110009 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a13dc85600 con 0x55a13dc35000 2024-09-13T18:35:59.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ea0e6700 1 -- 172.21.15.44:0/902110009 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a13dc80180 con 0x55a13dc35000 2024-09-13T18:35:59.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ea0e6700 1 -- 172.21.15.44:0/902110009 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a13dc851e0 con 0x55a13dc35000 2024-09-13T18:35:59.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ee131500 1 -- 172.21.15.44:0/902110009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a13dc58b60 con 0x55a13dc35000 2024-09-13T18:35:59.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ee131500 1 -- 172.21.15.44:0/902110009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55a13dc58340 con 0x55a13dc35000 2024-09-13T18:35:59.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ee131500 4 waiting for MDS map... 2024-09-13T18:35:59.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ea0e6700 1 -- 172.21.15.44:0/902110009 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x55a13dc6ec40 con 0x55a13dc35000 2024-09-13T18:35:59.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ea0e6700 1 -- 172.21.15.44:0/902110009 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x55a13df24900 con 0x55a13dc35000 2024-09-13T18:35:59.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ee131500 4 Got MDS map 70 2024-09-13T18:35:59.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ee131500 10 main: main 2024-09-13T18:35:59.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ee131500 4 main: connecting to RADOS... 2024-09-13T18:35:59.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ee131500 1 Processor -- start 2024-09-13T18:35:59.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.652+0000 7f36ee131500 1 -- start start 2024-09-13T18:35:59.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ee131500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a13df30400 0x55a13dcdb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ee131500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a13df30800 0x55a13dcdbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ee131500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a13df30c00 0x55a13dcdc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ee131500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a13dc6be00 con 0x55a13df30400 2024-09-13T18:35:59.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ee131500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a13dcb6780 con 0x55a13df30800 2024-09-13T18:35:59.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ee131500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a13dcb6500 con 0x55a13df30c00 2024-09-13T18:35:59.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ec0ea700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a13df30400 0x55a13dcdb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ec0ea700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a13df30400 0x55a13dcdb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50260/0 (socket says 172.21.15.44:50260) 2024-09-13T18:35:59.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ec0ea700 1 -- 172.21.15.44:0/3638161108 learned_addr learned my addr 172.21.15.44:0/3638161108 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ec8eb700 1 --2- 172.21.15.44:0/3638161108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a13df30800 0x55a13dcdbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ec0ea700 1 --2- 172.21.15.44:0/3638161108 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a13df30c00 0x55a13dcdc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ec8eb700 1 -- 172.21.15.44:0/3638161108 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a13df30c00 msgr2=0x55a13dcdc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ec8eb700 1 --2- 172.21.15.44:0/3638161108 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a13df30c00 0x55a13dcdc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ec8eb700 1 -- 172.21.15.44:0/3638161108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a13df30400 msgr2=0x55a13dcdb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ec8eb700 1 --2- 172.21.15.44:0/3638161108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a13df30400 0x55a13dcdb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ec8eb700 1 -- 172.21.15.44:0/3638161108 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a13dc58000 con 0x55a13df30800 2024-09-13T18:35:59.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ec0ea700 1 --2- 172.21.15.44:0/3638161108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a13df30400 0x55a13dcdb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:59.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ec8eb700 1 --2- 172.21.15.44:0/3638161108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a13df30800 0x55a13dcdbb80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x55a13df96180 tx=0x55a13dfa0120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=feec857fb8b2eea0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36e80e2700 1 -- 172.21.15.44:0/3638161108 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a13dc85080 con 0x55a13df30800 2024-09-13T18:35:59.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36e80e2700 1 -- 172.21.15.44:0/3638161108 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a13ea20a80 con 0x55a13df30800 2024-09-13T18:35:59.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36e80e2700 1 -- 172.21.15.44:0/3638161108 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a13dc85600 con 0x55a13df30800 2024-09-13T18:35:59.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ee131500 1 -- 172.21.15.44:0/3638161108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a13df30800 msgr2=0x55a13dcdbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ee131500 1 --2- 172.21.15.44:0/3638161108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a13df30800 0x55a13dcdbb80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x55a13df96180 tx=0x55a13dfa0120 comp rx=0 tx=0).stop 2024-09-13T18:35:59.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ee131500 1 -- 172.21.15.44:0/3638161108 shutdown_connections 2024-09-13T18:35:59.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ee131500 1 --2- 172.21.15.44:0/3638161108 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a13df30c00 0x55a13dcdc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ee131500 1 --2- 172.21.15.44:0/3638161108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a13df30800 0x55a13dcdbb80 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ee131500 1 --2- 172.21.15.44:0/3638161108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a13df30400 0x55a13dcdb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ee131500 1 -- 172.21.15.44:0/3638161108 >> 172.21.15.44:0/3638161108 conn(0x55a13dc34c00 msgr2=0x55a13dd25800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ee131500 1 -- 172.21.15.44:0/3638161108 shutdown_connections 2024-09-13T18:35:59.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ee131500 1 -- 172.21.15.44:0/3638161108 wait complete. 2024-09-13T18:35:59.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ee131500 1 Processor -- start 2024-09-13T18:35:59.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.656+0000 7f36ee131500 1 -- start start 2024-09-13T18:35:59.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36ee131500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a13df30400 0x55a13dcdd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36ee131500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a13df30800 0x55a13dcdcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36ee131500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a13df30c00 0x55a13dcdc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36ee131500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a13dcb63c0 con 0x55a13df30400 2024-09-13T18:35:59.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36ee131500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a13dcb6280 con 0x55a13df30800 2024-09-13T18:35:59.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36ee131500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a13dcb6140 con 0x55a13df30c00 2024-09-13T18:35:59.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36ec0ea700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a13df30400 0x55a13dcdd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36ec8eb700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a13df30800 0x55a13dcdcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36ec0ea700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a13df30400 0x55a13dcdd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50268/0 (socket says 172.21.15.44:50268) 2024-09-13T18:35:59.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36ec0ea700 1 -- 172.21.15.44:0/808205003 learned_addr learned my addr 172.21.15.44:0/808205003 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36ec0ea700 1 --2- 172.21.15.44:0/808205003 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a13df30c00 0x55a13dcdc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36ec8eb700 1 -- 172.21.15.44:0/808205003 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a13df30c00 msgr2=0x55a13dcdc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36ec8eb700 1 --2- 172.21.15.44:0/808205003 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a13df30c00 0x55a13dcdc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36ec8eb700 1 -- 172.21.15.44:0/808205003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a13df30400 msgr2=0x55a13dcdd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36ec8eb700 1 --2- 172.21.15.44:0/808205003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a13df30400 0x55a13dcdd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36ec8eb700 1 -- 172.21.15.44:0/808205003 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a13dc581a0 con 0x55a13df30800 2024-09-13T18:35:59.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36ec0ea700 1 --2- 172.21.15.44:0/808205003 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a13df30c00 0x55a13dcdc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:59.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36ec8eb700 1 --2- 172.21.15.44:0/808205003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a13df30800 0x55a13dcdcc00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x55a13dd94000 tx=0x55a13dfa0360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36e68df700 1 -- 172.21.15.44:0/808205003 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a13dc851e0 con 0x55a13df30800 2024-09-13T18:35:59.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36ee131500 1 -- 172.21.15.44:0/808205003 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a13dc58000 con 0x55a13df30800 2024-09-13T18:35:59.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36e68df700 1 -- 172.21.15.44:0/808205003 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a13dc80480 con 0x55a13df30800 2024-09-13T18:35:59.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36ee131500 1 -- 172.21.15.44:0/808205003 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a13dc589c0 con 0x55a13df30800 2024-09-13T18:35:59.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36ee131500 4 main: resolving pool 10 2024-09-13T18:35:59.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.660+0000 7f36e68df700 1 -- 172.21.15.44:0/808205003 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a13dc84dc0 con 0x55a13df30800 2024-09-13T18:35:59.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.664+0000 7f36e68df700 1 -- 172.21.15.44:0/808205003 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x55a13dc94840 con 0x55a13df30800 2024-09-13T18:35:59.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.664+0000 7f36e68df700 1 --2- 172.21.15.44:0/808205003 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55a13dfaa400 0x55a13dcdd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.664+0000 7f36e68df700 1 -- 172.21.15.44:0/808205003 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x55a13dc6ea80 con 0x55a13df30800 2024-09-13T18:35:59.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.664+0000 7f36ee131500 4 main: creating IoCtx.. 2024-09-13T18:35:59.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.664+0000 7f36ee131500 1 --2- 172.21.15.44:0/808205003 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55a13df31000 0x55a13dcdc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.664+0000 7f36ee131500 1 -- 172.21.15.44:0/808205003 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:1 10.b 10:d0630e4c:::mds0_sessionmap:head [omap-clear,omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) v8 -- 0x55a13df31400 con 0x55a13df31000 2024-09-13T18:35:59.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.664+0000 7f36ec0ea700 1 --2- 172.21.15.44:0/808205003 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55a13dfaa400 0x55a13dcdd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.664+0000 7f36ec0ea700 1 --2- 172.21.15.44:0/808205003 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55a13df31000 0x55a13dcdc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.664+0000 7f36ec0ea700 1 --2- 172.21.15.44:0/808205003 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55a13dfaa400 0x55a13dcdd700 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55a13dfe2780 tx=0x55a13dfa0f00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.664+0000 7f36ec0ea700 1 --2- 172.21.15.44:0/808205003 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55a13df31000 0x55a13dcdc100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.668+0000 7f36ec0ea700 1 -- 172.21.15.44:0/808205003 <== osd.6 v2:172.21.15.99:6808/2907584318 1 ==== osd_op_reply(1 mds0_sessionmap [omap-clear,omap-set-header] v78'4 uv4 ondisk = 0) v8 ==== 201+0+0 (crc 0 0 0) 0x55a13eaa8b40 con 0x55a13df31000 2024-09-13T18:35:59.674 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:35:59.674 INFO:teuthology.orchestra.run.smithi044.stdout: "0": { 2024-09-13T18:35:59.674 INFO:teuthology.orchestra.run.smithi044.stdout: "data": {}, 2024-09-13T18:35:59.674 INFO:teuthology.orchestra.run.smithi044.stdout: "result": 0 2024-09-13T18:35:59.674 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.674 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:35:59.675 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:59.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.668+0000 7f36ee131500 1 -- 172.21.15.44:0/808205003 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55a13df31000 msgr2=0x55a13dcdc100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.668+0000 7f36ee131500 1 --2- 172.21.15.44:0/808205003 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55a13df31000 0x55a13dcdc100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.668+0000 7f36ee131500 1 -- 172.21.15.44:0/808205003 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55a13dfaa400 msgr2=0x55a13dcdd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.668+0000 7f36ee131500 1 --2- 172.21.15.44:0/808205003 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55a13dfaa400 0x55a13dcdd700 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55a13dfe2780 tx=0x55a13dfa0f00 comp rx=0 tx=0).stop 2024-09-13T18:35:59.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.668+0000 7f36ee131500 1 -- 172.21.15.44:0/808205003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a13df30800 msgr2=0x55a13dcdcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.668+0000 7f36ee131500 1 --2- 172.21.15.44:0/808205003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a13df30800 0x55a13dcdcc00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x55a13dd94000 tx=0x55a13dfa0360 comp rx=0 tx=0).stop 2024-09-13T18:35:59.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.668+0000 7f36ec8eb700 1 -- 172.21.15.44:0/808205003 reap_dead start 2024-09-13T18:35:59.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.668+0000 7f36ee131500 1 -- 172.21.15.44:0/808205003 shutdown_connections 2024-09-13T18:35:59.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.668+0000 7f36ee131500 1 -- 172.21.15.44:0/808205003 >> 172.21.15.44:0/808205003 conn(0x55a13dc34c00 msgr2=0x55a13dd25800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.668+0000 7f36ee131500 1 -- 172.21.15.44:0/808205003 shutdown_connections 2024-09-13T18:35:59.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.668+0000 7f36ee131500 1 -- 172.21.15.44:0/808205003 wait complete. 2024-09-13T18:35:59.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.668+0000 7f36ee131500 1 -- 172.21.15.44:0/902110009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a13dc35000 msgr2=0x55a13dcdb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.668+0000 7f36ee131500 1 --2- 172.21.15.44:0/902110009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a13dc35000 0x55a13dcdb080 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x55a13dd94d80 tx=0x55a13ea0cc00 comp rx=0 tx=0).stop 2024-09-13T18:35:59.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.668+0000 7f36ee131500 1 -- 172.21.15.44:0/902110009 shutdown_connections 2024-09-13T18:35:59.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.668+0000 7f36ee131500 1 --2- 172.21.15.44:0/902110009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a13dc35000 0x55a13dcdb080 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.668+0000 7f36ee131500 1 --2- 172.21.15.44:0/902110009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a13dc35400 0x55a13dcdab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.668+0000 7f36ee131500 1 --2- 172.21.15.44:0/902110009 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a13dc35800 0x55a13dcda580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.668+0000 7f36ee131500 1 -- 172.21.15.44:0/902110009 >> 172.21.15.44:0/902110009 conn(0x55a13dc35c00 msgr2=0x55a13dd25000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.668+0000 7f36ee131500 1 -- 172.21.15.44:0/902110009 shutdown_connections 2024-09-13T18:35:59.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.668+0000 7f36ee131500 1 -- 172.21.15.44:0/902110009 wait complete. 2024-09-13T18:35:59.679 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'reset', 'session'] in time 0:00:00.062972, result: { "0": { "data": {}, "result": 0 } } 2024-09-13T18:35:59.679 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all reset inode 2024-09-13T18:35:59.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.756+0000 7f1d64c62500 1 -- start start 2024-09-13T18:35:59.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.756+0000 7f1d64c62500 1 Processor -- start 2024-09-13T18:35:59.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.756+0000 7f1d64c62500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13933b800 0x55b1393e0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.756+0000 7f1d64c62500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b13933b400 0x55b1393e0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.756+0000 7f1d64c62500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55b13933b000 0x55b1393e1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.756+0000 7f1d64c62500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b139371e00 con 0x55b13933b800 2024-09-13T18:35:59.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.756+0000 7f1d64c62500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1393bca00 con 0x55b13933b400 2024-09-13T18:35:59.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.756+0000 7f1d64c62500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b1393bc640 con 0x55b13933b000 2024-09-13T18:35:59.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.756+0000 7f1d6341c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13933b800 0x55b1393e0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.756+0000 7f1d6341c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13933b800 0x55b1393e0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50278/0 (socket says 172.21.15.44:50278) 2024-09-13T18:35:59.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.756+0000 7f1d6341c700 1 -- 172.21.15.44:0/1237826476 learned_addr learned my addr 172.21.15.44:0/1237826476 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.756+0000 7f1d62c1b700 1 --2- 172.21.15.44:0/1237826476 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b13933b400 0x55b1393e0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.756+0000 7f1d63c1d700 1 --2- 172.21.15.44:0/1237826476 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55b13933b000 0x55b1393e1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d6341c700 1 -- 172.21.15.44:0/1237826476 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55b13933b000 msgr2=0x55b1393e1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d6341c700 1 --2- 172.21.15.44:0/1237826476 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55b13933b000 0x55b1393e1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d6341c700 1 -- 172.21.15.44:0/1237826476 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b13933b400 msgr2=0x55b1393e0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d6341c700 1 --2- 172.21.15.44:0/1237826476 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b13933b400 0x55b1393e0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d6341c700 1 -- 172.21.15.44:0/1237826476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b13935e9c0 con 0x55b13933b800 2024-09-13T18:35:59.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d6341c700 1 --2- 172.21.15.44:0/1237826476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13933b800 0x55b1393e0580 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x55b13a114d20 tx=0x55b139411260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f042585b66682588 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d60c17700 1 -- 172.21.15.44:0/1237826476 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b13938b080 con 0x55b13933b800 2024-09-13T18:35:59.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d60c17700 1 -- 172.21.15.44:0/1237826476 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b139386480 con 0x55b13933b800 2024-09-13T18:35:59.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d60c17700 1 -- 172.21.15.44:0/1237826476 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b13938b600 con 0x55b13933b800 2024-09-13T18:35:59.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d64c62500 1 -- 172.21.15.44:0/1237826476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b13935e1a0 con 0x55b13933b800 2024-09-13T18:35:59.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d64c62500 1 -- 172.21.15.44:0/1237826476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55b13935e9c0 con 0x55b13933b800 2024-09-13T18:35:59.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d64c62500 4 waiting for MDS map... 2024-09-13T18:35:59.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d60c17700 1 -- 172.21.15.44:0/1237826476 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x55b139374c40 con 0x55b13933b800 2024-09-13T18:35:59.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d60c17700 1 -- 172.21.15.44:0/1237826476 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x55b13937cf00 con 0x55b13933b800 2024-09-13T18:35:59.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d64c62500 4 Got MDS map 70 2024-09-13T18:35:59.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d64c62500 10 main: main 2024-09-13T18:35:59.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d64c62500 4 main: connecting to RADOS... 2024-09-13T18:35:59.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d64c62500 1 Processor -- start 2024-09-13T18:35:59.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d64c62500 1 -- start start 2024-09-13T18:35:59.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d64c62500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55b13962c400 0x55b1393e1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d64c62500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b13962c800 0x55b1393e1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d64c62500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13962cc00 0x55b1393e2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d64c62500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1393bc500 con 0x55b13962cc00 2024-09-13T18:35:59.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d64c62500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1393bc3c0 con 0x55b13962c800 2024-09-13T18:35:59.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d64c62500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b1393bc640 con 0x55b13962c400 2024-09-13T18:35:59.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d62c1b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13962cc00 0x55b1393e2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d62c1b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13962cc00 0x55b1393e2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50284/0 (socket says 172.21.15.44:50284) 2024-09-13T18:35:59.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d62c1b700 1 -- 172.21.15.44:0/1521088276 learned_addr learned my addr 172.21.15.44:0/1521088276 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d63c1d700 1 --2- 172.21.15.44:0/1521088276 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55b13962c400 0x55b1393e1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.760+0000 7f1d6341c700 1 --2- 172.21.15.44:0/1521088276 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b13962c800 0x55b1393e1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.764+0000 7f1d62c1b700 1 -- 172.21.15.44:0/1521088276 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55b13962c400 msgr2=0x55b1393e1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.764+0000 7f1d62c1b700 1 --2- 172.21.15.44:0/1521088276 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55b13962c400 0x55b1393e1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.764+0000 7f1d62c1b700 1 -- 172.21.15.44:0/1521088276 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b13962c800 msgr2=0x55b1393e1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.764+0000 7f1d62c1b700 1 --2- 172.21.15.44:0/1521088276 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b13962c800 0x55b1393e1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.764+0000 7f1d62c1b700 1 -- 172.21.15.44:0/1521088276 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b13935eb60 con 0x55b13962cc00 2024-09-13T18:35:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.764+0000 7f1d62c1b700 1 --2- 172.21.15.44:0/1521088276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13962cc00 0x55b1393e2100 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x55b13a1122a0 tx=0x55b139690000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1007c5ce9ca4ca2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.764+0000 7f1d5ec13700 1 -- 172.21.15.44:0/1521088276 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b13938b080 con 0x55b13962cc00 2024-09-13T18:35:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.764+0000 7f1d5ec13700 1 -- 172.21.15.44:0/1521088276 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b13a11b800 con 0x55b13962cc00 2024-09-13T18:35:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.764+0000 7f1d5ec13700 1 -- 172.21.15.44:0/1521088276 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b13938b600 con 0x55b13962cc00 2024-09-13T18:35:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.764+0000 7f1d64c62500 1 -- 172.21.15.44:0/1521088276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13962cc00 msgr2=0x55b1393e2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.764+0000 7f1d64c62500 1 --2- 172.21.15.44:0/1521088276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13962cc00 0x55b1393e2100 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x55b13a1122a0 tx=0x55b139690000 comp rx=0 tx=0).stop 2024-09-13T18:35:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.764+0000 7f1d64c62500 1 -- 172.21.15.44:0/1521088276 shutdown_connections 2024-09-13T18:35:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.764+0000 7f1d64c62500 1 --2- 172.21.15.44:0/1521088276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13962cc00 0x55b1393e2100 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.764+0000 7f1d64c62500 1 --2- 172.21.15.44:0/1521088276 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b13962c800 0x55b1393e1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.764+0000 7f1d64c62500 1 --2- 172.21.15.44:0/1521088276 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55b13962c400 0x55b1393e1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.764+0000 7f1d64c62500 1 -- 172.21.15.44:0/1521088276 >> 172.21.15.44:0/1521088276 conn(0x55b13933ac00 msgr2=0x55b13942b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.764+0000 7f1d64c62500 1 -- 172.21.15.44:0/1521088276 shutdown_connections 2024-09-13T18:35:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.764+0000 7f1d64c62500 1 -- 172.21.15.44:0/1521088276 wait complete. 2024-09-13T18:35:59.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.764+0000 7f1d64c62500 1 Processor -- start 2024-09-13T18:35:59.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.764+0000 7f1d64c62500 1 -- start start 2024-09-13T18:35:59.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.768+0000 7f1d64c62500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13962c400 0x55b1393e3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.768+0000 7f1d64c62500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b13962c800 0x55b1393e2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.768+0000 7f1d64c62500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55b13962cc00 0x55b1393e2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.768+0000 7f1d64c62500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1393bc280 con 0x55b13962c400 2024-09-13T18:35:59.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.768+0000 7f1d64c62500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1393bc140 con 0x55b13962c800 2024-09-13T18:35:59.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.768+0000 7f1d64c62500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b1393bc000 con 0x55b13962cc00 2024-09-13T18:35:59.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.768+0000 7f1d63c1d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13962c400 0x55b1393e3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.768+0000 7f1d63c1d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13962c400 0x55b1393e3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50294/0 (socket says 172.21.15.44:50294) 2024-09-13T18:35:59.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.768+0000 7f1d63c1d700 1 -- 172.21.15.44:0/1207764323 learned_addr learned my addr 172.21.15.44:0/1207764323 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.768+0000 7f1d6341c700 1 --2- 172.21.15.44:0/1207764323 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b13962c800 0x55b1393e2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.768+0000 7f1d62c1b700 1 --2- 172.21.15.44:0/1207764323 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55b13962cc00 0x55b1393e2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.768+0000 7f1d63c1d700 1 -- 172.21.15.44:0/1207764323 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55b13962cc00 msgr2=0x55b1393e2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.768+0000 7f1d63c1d700 1 --2- 172.21.15.44:0/1207764323 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55b13962cc00 0x55b1393e2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.768+0000 7f1d63c1d700 1 -- 172.21.15.44:0/1207764323 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b13962c800 msgr2=0x55b1393e2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.768+0000 7f1d63c1d700 1 --2- 172.21.15.44:0/1207764323 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b13962c800 0x55b1393e2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.768+0000 7f1d63c1d700 1 -- 172.21.15.44:0/1207764323 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b13935e340 con 0x55b13962c400 2024-09-13T18:35:59.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.768+0000 7f1d63c1d700 1 --2- 172.21.15.44:0/1207764323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13962c400 0x55b1393e3180 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x55b13a112f90 tx=0x55b139690d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.768+0000 7f1d5d410700 1 -- 172.21.15.44:0/1207764323 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b13938b080 con 0x55b13962c400 2024-09-13T18:35:59.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.768+0000 7f1d5d410700 1 -- 172.21.15.44:0/1207764323 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b13a11b200 con 0x55b13962c400 2024-09-13T18:35:59.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.768+0000 7f1d64c62500 1 -- 172.21.15.44:0/1207764323 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b13935e000 con 0x55b13962c400 2024-09-13T18:35:59.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.768+0000 7f1d5d410700 1 -- 172.21.15.44:0/1207764323 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b13938b600 con 0x55b13962c400 2024-09-13T18:35:59.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.768+0000 7f1d64c62500 1 -- 172.21.15.44:0/1207764323 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b13935eea0 con 0x55b13962c400 2024-09-13T18:35:59.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.768+0000 7f1d64c62500 4 main: resolving pool 10 2024-09-13T18:35:59.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.772+0000 7f1d5d410700 1 -- 172.21.15.44:0/1207764323 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x55b13939a840 con 0x55b13962c400 2024-09-13T18:35:59.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.772+0000 7f1d5d410700 1 --2- 172.21.15.44:0/1207764323 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55b13978c000 0x55b1393e3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.772+0000 7f1d5d410700 1 -- 172.21.15.44:0/1207764323 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x55b139374a80 con 0x55b13962c400 2024-09-13T18:35:59.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.772+0000 7f1d64c62500 4 main: creating IoCtx.. 2024-09-13T18:35:59.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.772+0000 7f1d64c62500 1 --2- 172.21.15.44:0/1207764323 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x55b13962d000 0x55b1393e2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.772+0000 7f1d64c62500 1 -- 172.21.15.44:0/1207764323 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:1 10.13 10:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) v8 -- 0x55b13962d400 con 0x55b13962d000 2024-09-13T18:35:59.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.772+0000 7f1d6341c700 1 --2- 172.21.15.44:0/1207764323 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55b13978c000 0x55b1393e3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.772+0000 7f1d62c1b700 1 --2- 172.21.15.44:0/1207764323 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x55b13962d000 0x55b1393e2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.772+0000 7f1d6341c700 1 --2- 172.21.15.44:0/1207764323 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55b13978c000 0x55b1393e3700 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x55b13a115050 tx=0x55b139411320 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.772+0000 7f1d62c1b700 1 --2- 172.21.15.44:0/1207764323 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x55b13962d000 0x55b1393e2100 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.776+0000 7f1d62c1b700 1 -- 172.21.15.44:0/1207764323 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v78'4 uv4 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x55b13a124b40 con 0x55b13962d000 2024-09-13T18:35:59.782 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:35:59.783 INFO:teuthology.orchestra.run.smithi044.stdout: "0": { 2024-09-13T18:35:59.783 INFO:teuthology.orchestra.run.smithi044.stdout: "data": {}, 2024-09-13T18:35:59.783 INFO:teuthology.orchestra.run.smithi044.stdout: "result": 0 2024-09-13T18:35:59.783 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.783 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:35:59.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:59.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.776+0000 7f1d64c62500 1 -- 172.21.15.44:0/1207764323 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x55b13962d000 msgr2=0x55b1393e2100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.776+0000 7f1d64c62500 1 --2- 172.21.15.44:0/1207764323 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x55b13962d000 0x55b1393e2100 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.776+0000 7f1d64c62500 1 -- 172.21.15.44:0/1207764323 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55b13978c000 msgr2=0x55b1393e3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.776+0000 7f1d64c62500 1 --2- 172.21.15.44:0/1207764323 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55b13978c000 0x55b1393e3700 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x55b13a115050 tx=0x55b139411320 comp rx=0 tx=0).stop 2024-09-13T18:35:59.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.776+0000 7f1d64c62500 1 -- 172.21.15.44:0/1207764323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13962c400 msgr2=0x55b1393e3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.776+0000 7f1d64c62500 1 --2- 172.21.15.44:0/1207764323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13962c400 0x55b1393e3180 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x55b13a112f90 tx=0x55b139690d20 comp rx=0 tx=0).stop 2024-09-13T18:35:59.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.776+0000 7f1d62c1b700 1 -- 172.21.15.44:0/1207764323 reap_dead start 2024-09-13T18:35:59.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.776+0000 7f1d64c62500 1 -- 172.21.15.44:0/1207764323 shutdown_connections 2024-09-13T18:35:59.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.776+0000 7f1d64c62500 1 -- 172.21.15.44:0/1207764323 >> 172.21.15.44:0/1207764323 conn(0x55b13933ac00 msgr2=0x55b13942b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.776+0000 7f1d64c62500 1 -- 172.21.15.44:0/1207764323 shutdown_connections 2024-09-13T18:35:59.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.776+0000 7f1d64c62500 1 -- 172.21.15.44:0/1207764323 wait complete. 2024-09-13T18:35:59.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.776+0000 7f1d64c62500 1 -- 172.21.15.44:0/1237826476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13933b800 msgr2=0x55b1393e0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.776+0000 7f1d64c62500 1 --2- 172.21.15.44:0/1237826476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13933b800 0x55b1393e0580 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x55b13a114d20 tx=0x55b139411260 comp rx=0 tx=0).stop 2024-09-13T18:35:59.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.776+0000 7f1d64c62500 1 -- 172.21.15.44:0/1237826476 shutdown_connections 2024-09-13T18:35:59.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.776+0000 7f1d64c62500 1 --2- 172.21.15.44:0/1237826476 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55b13933b000 0x55b1393e1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.776+0000 7f1d64c62500 1 --2- 172.21.15.44:0/1237826476 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b13933b400 0x55b1393e0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.776+0000 7f1d64c62500 1 --2- 172.21.15.44:0/1237826476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13933b800 0x55b1393e0580 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.776+0000 7f1d64c62500 1 -- 172.21.15.44:0/1237826476 >> 172.21.15.44:0/1237826476 conn(0x55b13933bc00 msgr2=0x55b13942b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.776+0000 7f1d64c62500 1 -- 172.21.15.44:0/1237826476 shutdown_connections 2024-09-13T18:35:59.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.776+0000 7f1d64c62500 1 -- 172.21.15.44:0/1237826476 wait complete. 2024-09-13T18:35:59.788 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'reset', 'inode'] in time 0:00:00.108499, result: { "0": { "data": {}, "result": 0 } } 2024-09-13T18:35:59.788 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all reset snap 2024-09-13T18:35:59.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.824+0000 7f6756c61500 1 -- start start 2024-09-13T18:35:59.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.824+0000 7f6756c61500 1 Processor -- start 2024-09-13T18:35:59.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.824+0000 7f6756c61500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559b76c21800 0x559b76cc7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.824+0000 7f6756c61500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b76c21400 0x559b76cc7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.824+0000 7f6756c61500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b76c21000 0x559b76cc7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.824+0000 7f6756c61500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b76ca2a00 con 0x559b76c21000 2024-09-13T18:35:59.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.824+0000 7f6756c61500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b76ca2640 con 0x559b76c21400 2024-09-13T18:35:59.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.824+0000 7f6756c61500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b76ca2500 con 0x559b76c21800 2024-09-13T18:35:59.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6755c1c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b76c21000 0x559b76cc7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6755c1c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b76c21000 0x559b76cc7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50312/0 (socket says 172.21.15.44:50312) 2024-09-13T18:35:59.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6754c1a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b76c21400 0x559b76cc7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6755c1c700 1 -- 172.21.15.44:0/3632389440 learned_addr learned my addr 172.21.15.44:0/3632389440 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f675541b700 1 --2- 172.21.15.44:0/3632389440 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559b76c21800 0x559b76cc7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6755c1c700 1 -- 172.21.15.44:0/3632389440 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559b76c21800 msgr2=0x559b76cc7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6755c1c700 1 --2- 172.21.15.44:0/3632389440 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559b76c21800 0x559b76cc7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6755c1c700 1 -- 172.21.15.44:0/3632389440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b76c21400 msgr2=0x559b76cc7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6755c1c700 1 --2- 172.21.15.44:0/3632389440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b76c21400 0x559b76cc7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6755c1c700 1 -- 172.21.15.44:0/3632389440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b76c449c0 con 0x559b76c21000 2024-09-13T18:35:59.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6755c1c700 1 --2- 172.21.15.44:0/3632389440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b76c21000 0x559b76cc7080 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x559b76d82e40 tx=0x559b779f8c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a460b88b02672efb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6752c16700 1 -- 172.21.15.44:0/3632389440 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559b76c71600 con 0x559b76c21000 2024-09-13T18:35:59.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6752c16700 1 -- 172.21.15.44:0/3632389440 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559b76f0a000 con 0x559b76c21000 2024-09-13T18:35:59.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6752c16700 1 -- 172.21.15.44:0/3632389440 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559b76c711e0 con 0x559b76c21000 2024-09-13T18:35:59.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6756c61500 1 -- 172.21.15.44:0/3632389440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559b76c44b60 con 0x559b76c21000 2024-09-13T18:35:59.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6756c61500 1 -- 172.21.15.44:0/3632389440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x559b76c44340 con 0x559b76c21000 2024-09-13T18:35:59.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6756c61500 4 waiting for MDS map... 2024-09-13T18:35:59.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6752c16700 1 -- 172.21.15.44:0/3632389440 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x559b76c5ac40 con 0x559b76c21000 2024-09-13T18:35:59.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6752c16700 1 -- 172.21.15.44:0/3632389440 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x559b77a16300 con 0x559b76c21000 2024-09-13T18:35:59.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6756c61500 4 Got MDS map 70 2024-09-13T18:35:59.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6756c61500 10 main: main 2024-09-13T18:35:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6756c61500 4 main: connecting to RADOS... 2024-09-13T18:35:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6756c61500 1 Processor -- start 2024-09-13T18:35:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6756c61500 1 -- start start 2024-09-13T18:35:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6756c61500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b77aaa400 0x559b76cc6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6756c61500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559b77aaa800 0x559b76cc6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6756c61500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b77aaac00 0x559b76cc8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6756c61500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b76c57e00 con 0x559b77aaa400 2024-09-13T18:35:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6756c61500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b76ca2640 con 0x559b77aaac00 2024-09-13T18:35:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6756c61500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b76ca23c0 con 0x559b77aaa800 2024-09-13T18:35:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6754c1a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b77aaa400 0x559b76cc6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6754c1a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b77aaa400 0x559b76cc6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50324/0 (socket says 172.21.15.44:50324) 2024-09-13T18:35:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f675541b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559b77aaa800 0x559b76cc6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6754c1a700 1 -- 172.21.15.44:0/1798255071 learned_addr learned my addr 172.21.15.44:0/1798255071 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6754c1a700 1 --2- 172.21.15.44:0/1798255071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b77aaac00 0x559b76cc8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6754c1a700 1 -- 172.21.15.44:0/1798255071 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559b77aaa800 msgr2=0x559b76cc6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6754c1a700 1 --2- 172.21.15.44:0/1798255071 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559b77aaa800 0x559b76cc6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6754c1a700 1 -- 172.21.15.44:0/1798255071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b77aaac00 msgr2=0x559b76cc8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6754c1a700 1 --2- 172.21.15.44:0/1798255071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b77aaac00 0x559b76cc8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.828+0000 7f6754c1a700 1 -- 172.21.15.44:0/1798255071 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b76c44000 con 0x559b77aaa400 2024-09-13T18:35:59.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.832+0000 7f6754c1a700 1 --2- 172.21.15.44:0/1798255071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b77aaa400 0x559b76cc6b00 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x559b76d80450 tx=0x559b76f24c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60477cd269bf446 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.832+0000 7f6750c12700 1 -- 172.21.15.44:0/1798255071 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559b76c71600 con 0x559b77aaa400 2024-09-13T18:35:59.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.832+0000 7f6750c12700 1 -- 172.21.15.44:0/1798255071 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559b76f0a180 con 0x559b77aaa400 2024-09-13T18:35:59.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.832+0000 7f6750c12700 1 -- 172.21.15.44:0/1798255071 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559b76c711e0 con 0x559b77aaa400 2024-09-13T18:35:59.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.832+0000 7f6756c61500 1 -- 172.21.15.44:0/1798255071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b77aaa400 msgr2=0x559b76cc6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.832+0000 7f6756c61500 1 --2- 172.21.15.44:0/1798255071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b77aaa400 0x559b76cc6b00 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x559b76d80450 tx=0x559b76f24c60 comp rx=0 tx=0).stop 2024-09-13T18:35:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.832+0000 7f6756c61500 1 -- 172.21.15.44:0/1798255071 shutdown_connections 2024-09-13T18:35:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.832+0000 7f6756c61500 1 --2- 172.21.15.44:0/1798255071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b77aaac00 0x559b76cc8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.832+0000 7f6756c61500 1 --2- 172.21.15.44:0/1798255071 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559b77aaa800 0x559b76cc6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.832+0000 7f6756c61500 1 --2- 172.21.15.44:0/1798255071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b77aaa400 0x559b76cc6b00 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.832+0000 7f6756c61500 1 -- 172.21.15.44:0/1798255071 >> 172.21.15.44:0/1798255071 conn(0x559b76c20c00 msgr2=0x559b76d11800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.832+0000 7f6756c61500 1 -- 172.21.15.44:0/1798255071 shutdown_connections 2024-09-13T18:35:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.832+0000 7f6756c61500 1 -- 172.21.15.44:0/1798255071 wait complete. 2024-09-13T18:35:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.832+0000 7f6756c61500 1 Processor -- start 2024-09-13T18:35:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.832+0000 7f6756c61500 1 -- start start 2024-09-13T18:35:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.836+0000 7f6756c61500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559b77aaa400 0x559b76cc6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.836+0000 7f6756c61500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b77aaa800 0x559b76cc6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.836+0000 7f6756c61500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b77aaac00 0x559b76cc8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.836+0000 7f6756c61500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b76ca2280 con 0x559b77aaac00 2024-09-13T18:35:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.836+0000 7f6756c61500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b76ca2140 con 0x559b77aaa800 2024-09-13T18:35:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.836+0000 7f6756c61500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b76ca2000 con 0x559b77aaa400 2024-09-13T18:35:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.836+0000 7f6754c1a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b77aaac00 0x559b76cc8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.836+0000 7f6754c1a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b77aaac00 0x559b76cc8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50332/0 (socket says 172.21.15.44:50332) 2024-09-13T18:35:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.836+0000 7f675541b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b77aaa800 0x559b76cc6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.836+0000 7f6754c1a700 1 -- 172.21.15.44:0/3866751987 learned_addr learned my addr 172.21.15.44:0/3866751987 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.836+0000 7f6754c1a700 1 --2- 172.21.15.44:0/3866751987 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559b77aaa400 0x559b76cc6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.836+0000 7f6754c1a700 1 -- 172.21.15.44:0/3866751987 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559b77aaa400 msgr2=0x559b76cc6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.836+0000 7f6754c1a700 1 --2- 172.21.15.44:0/3866751987 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559b77aaa400 0x559b76cc6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.836+0000 7f6754c1a700 1 -- 172.21.15.44:0/3866751987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b77aaa800 msgr2=0x559b76cc6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.836+0000 7f6754c1a700 1 --2- 172.21.15.44:0/3866751987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b77aaa800 0x559b76cc6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.836+0000 7f6754c1a700 1 -- 172.21.15.44:0/3866751987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b76c449c0 con 0x559b77aaac00 2024-09-13T18:35:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.836+0000 7f6754c1a700 1 --2- 172.21.15.44:0/3866751987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b77aaac00 0x559b76cc8100 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x559b76d81110 tx=0x559b76cf7080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.836+0000 7f674f40f700 1 -- 172.21.15.44:0/3866751987 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559b76c70dc0 con 0x559b77aaac00 2024-09-13T18:35:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.836+0000 7f674f40f700 1 -- 172.21.15.44:0/3866751987 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559b76f0a300 con 0x559b77aaac00 2024-09-13T18:35:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.836+0000 7f6756c61500 1 -- 172.21.15.44:0/3866751987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559b76c44b60 con 0x559b77aaac00 2024-09-13T18:35:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.836+0000 7f674f40f700 1 -- 172.21.15.44:0/3866751987 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559b76c71600 con 0x559b77aaac00 2024-09-13T18:35:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.836+0000 7f6756c61500 1 -- 172.21.15.44:0/3866751987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559b76c44ea0 con 0x559b77aaac00 2024-09-13T18:35:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.836+0000 7f6756c61500 4 main: resolving pool 10 2024-09-13T18:35:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.840+0000 7f674f40f700 1 -- 172.21.15.44:0/3866751987 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x559b76c80840 con 0x559b77aaac00 2024-09-13T18:35:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.840+0000 7f674f40f700 1 --2- 172.21.15.44:0/3866751987 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559b77080000 0x559b77082000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.840+0000 7f674f40f700 1 -- 172.21.15.44:0/3866751987 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x559b76c5aa80 con 0x559b77aaac00 2024-09-13T18:35:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.840+0000 7f6756c61500 4 main: creating IoCtx.. 2024-09-13T18:35:59.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.840+0000 7f6756c61500 1 --2- 172.21.15.44:0/3866751987 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x559b77aab000 0x559b76cc8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.840+0000 7f675541b700 1 --2- 172.21.15.44:0/3866751987 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559b77080000 0x559b77082000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.840+0000 7f6756c61500 1 -- 172.21.15.44:0/3866751987 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:1 10.d 10:b50e409b:::mds_snaptable:head [writefull 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) v8 -- 0x559b77aab400 con 0x559b77aab000 2024-09-13T18:35:59.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.840+0000 7f6754c1a700 1 --2- 172.21.15.44:0/3866751987 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x559b77aab000 0x559b76cc8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.840+0000 7f675541b700 1 --2- 172.21.15.44:0/3866751987 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559b77080000 0x559b77082000 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x559b76c778f0 tx=0x559b76f25da0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.844+0000 7f6754c1a700 1 --2- 172.21.15.44:0/3866751987 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x559b77aab000 0x559b76cc8680 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.844+0000 7f6754c1a700 1 -- 172.21.15.44:0/3866751987 <== osd.6 v2:172.21.15.99:6808/2907584318 1 ==== osd_op_reply(1 mds_snaptable [writefull 0~70] v78'2 uv2 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x559b77a9eb40 con 0x559b77aab000 2024-09-13T18:35:59.852 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:35:59.852 INFO:teuthology.orchestra.run.smithi044.stdout: "result": 0 2024-09-13T18:35:59.852 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:35:59.852 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:59.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.844+0000 7f6756c61500 1 -- 172.21.15.44:0/3866751987 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x559b77aab000 msgr2=0x559b76cc8680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.844+0000 7f6756c61500 1 --2- 172.21.15.44:0/3866751987 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x559b77aab000 0x559b76cc8680 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.844+0000 7f6756c61500 1 -- 172.21.15.44:0/3866751987 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559b77080000 msgr2=0x559b77082000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.844+0000 7f6756c61500 1 --2- 172.21.15.44:0/3866751987 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559b77080000 0x559b77082000 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x559b76c778f0 tx=0x559b76f25da0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.844+0000 7f6756c61500 1 -- 172.21.15.44:0/3866751987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b77aaac00 msgr2=0x559b76cc8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.844+0000 7f6756c61500 1 --2- 172.21.15.44:0/3866751987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b77aaac00 0x559b76cc8100 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x559b76d81110 tx=0x559b76cf7080 comp rx=0 tx=0).stop 2024-09-13T18:35:59.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.844+0000 7f675541b700 1 -- 172.21.15.44:0/3866751987 reap_dead start 2024-09-13T18:35:59.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.844+0000 7f6756c61500 1 -- 172.21.15.44:0/3866751987 shutdown_connections 2024-09-13T18:35:59.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.844+0000 7f6756c61500 1 -- 172.21.15.44:0/3866751987 >> 172.21.15.44:0/3866751987 conn(0x559b76c20c00 msgr2=0x559b76d11800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.844+0000 7f6756c61500 1 -- 172.21.15.44:0/3866751987 shutdown_connections 2024-09-13T18:35:59.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.844+0000 7f6756c61500 1 -- 172.21.15.44:0/3866751987 wait complete. 2024-09-13T18:35:59.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.848+0000 7f6756c61500 1 -- 172.21.15.44:0/3632389440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b76c21000 msgr2=0x559b76cc7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.848+0000 7f6756c61500 1 --2- 172.21.15.44:0/3632389440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b76c21000 0x559b76cc7080 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x559b76d82e40 tx=0x559b779f8c00 comp rx=0 tx=0).stop 2024-09-13T18:35:59.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.848+0000 7f6756c61500 1 -- 172.21.15.44:0/3632389440 shutdown_connections 2024-09-13T18:35:59.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.848+0000 7f6756c61500 1 --2- 172.21.15.44:0/3632389440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b76c21000 0x559b76cc7080 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.848+0000 7f6756c61500 1 --2- 172.21.15.44:0/3632389440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b76c21400 0x559b76cc7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.848+0000 7f6756c61500 1 --2- 172.21.15.44:0/3632389440 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559b76c21800 0x559b76cc7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.848+0000 7f6756c61500 1 -- 172.21.15.44:0/3632389440 >> 172.21.15.44:0/3632389440 conn(0x559b76c21c00 msgr2=0x559b76d11000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.848+0000 7f6756c61500 1 -- 172.21.15.44:0/3632389440 shutdown_connections 2024-09-13T18:35:59.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.848+0000 7f6756c61500 1 -- 172.21.15.44:0/3632389440 wait complete. 2024-09-13T18:35:59.857 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'reset', 'snap'] in time 0:00:00.069340, result: { "result": 0 } 2024-09-13T18:35:59.857 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show inode 2024-09-13T18:35:59.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.892+0000 7f0c1a69e500 1 -- start start 2024-09-13T18:35:59.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.892+0000 7f0c1a69e500 1 Processor -- start 2024-09-13T18:35:59.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c1a69e500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56554e7cb000 0x56554e870580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c1a69e500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56554e7cb400 0x56554e870b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c1a69e500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56554e7cb800 0x56554e871080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c1a69e500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56554e84ca00 con 0x56554e7cb800 2024-09-13T18:35:59.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c1a69e500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56554e84c780 con 0x56554e7cb000 2024-09-13T18:35:59.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c1a69e500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x56554e84c640 con 0x56554e7cb400 2024-09-13T18:35:59.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c19659700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56554e7cb800 0x56554e871080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c18657700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56554e7cb400 0x56554e870b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c19659700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56554e7cb800 0x56554e871080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50336/0 (socket says 172.21.15.44:50336) 2024-09-13T18:35:59.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c19659700 1 -- 172.21.15.44:0/2544158777 learned_addr learned my addr 172.21.15.44:0/2544158777 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c18e58700 1 --2- 172.21.15.44:0/2544158777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56554e7cb000 0x56554e870580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c18657700 1 -- 172.21.15.44:0/2544158777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56554e7cb000 msgr2=0x56554e870580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c18657700 1 --2- 172.21.15.44:0/2544158777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56554e7cb000 0x56554e870580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c18657700 1 -- 172.21.15.44:0/2544158777 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56554e7cb800 msgr2=0x56554e871080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c18657700 1 --2- 172.21.15.44:0/2544158777 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56554e7cb800 0x56554e871080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c18657700 1 -- 172.21.15.44:0/2544158777 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56554e7ee9c0 con 0x56554e7cb400 2024-09-13T18:35:59.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c19659700 1 --2- 172.21.15.44:0/2544158777 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56554e7cb800 0x56554e871080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:59.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c18657700 1 --2- 172.21.15.44:0/2544158777 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56554e7cb400 0x56554e870b00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x56554f538e10 tx=0x56554f5b0480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86efc6a433f7ad5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c16653700 1 -- 172.21.15.44:0/2544158777 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56554e81b600 con 0x56554e7cb400 2024-09-13T18:35:59.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c16653700 1 -- 172.21.15.44:0/2544158777 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56554e816480 con 0x56554e7cb400 2024-09-13T18:35:59.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c16653700 1 -- 172.21.15.44:0/2544158777 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56554e81b1e0 con 0x56554e7cb400 2024-09-13T18:35:59.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c1a69e500 1 -- 172.21.15.44:0/2544158777 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56554e7eeb60 con 0x56554e7cb400 2024-09-13T18:35:59.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c1a69e500 1 -- 172.21.15.44:0/2544158777 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({fsmap=0}) v3 -- 0x56554e7ee340 con 0x56554e7cb400 2024-09-13T18:35:59.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c1a69e500 4 waiting for MDS map... 2024-09-13T18:35:59.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.896+0000 7f0c16653700 1 -- 172.21.15.44:0/2544158777 <== mon.2 v2:172.21.15.99:3301/0 4 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x56554e804c40 con 0x56554e7cb400 2024-09-13T18:35:59.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c16653700 1 -- 172.21.15.44:0/2544158777 <== mon.2 v2:172.21.15.99:3301/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x56554eac2300 con 0x56554e7cb400 2024-09-13T18:35:59.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c1a69e500 4 Got MDS map 70 2024-09-13T18:35:59.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c1a69e500 10 main: main 2024-09-13T18:35:59.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c1a69e500 4 main: connecting to RADOS... 2024-09-13T18:35:59.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c1a69e500 1 Processor -- start 2024-09-13T18:35:59.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c1a69e500 1 -- start start 2024-09-13T18:35:59.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c1a69e500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56554eac8800 0x56554e871600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c1a69e500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56554eac8c00 0x56554e871b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c1a69e500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56554eac9000 0x56554e872100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c1a69e500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56554e801e00 con 0x56554eac8800 2024-09-13T18:35:59.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c1a69e500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56554e84ca00 con 0x56554eac8c00 2024-09-13T18:35:59.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c1a69e500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x56554e84c500 con 0x56554eac9000 2024-09-13T18:35:59.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c19659700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56554eac8800 0x56554e871600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c19659700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56554eac8800 0x56554e871600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50350/0 (socket says 172.21.15.44:50350) 2024-09-13T18:35:59.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c19659700 1 -- 172.21.15.44:0/4078492456 learned_addr learned my addr 172.21.15.44:0/4078492456 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c19659700 1 -- 172.21.15.44:0/4078492456 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56554eac9000 msgr2=0x56554e872100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c19659700 1 --2- 172.21.15.44:0/4078492456 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56554eac9000 0x56554e872100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c19659700 1 -- 172.21.15.44:0/4078492456 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56554eac8c00 msgr2=0x56554e871b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c19659700 1 --2- 172.21.15.44:0/4078492456 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56554eac8c00 0x56554e871b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c19659700 1 -- 172.21.15.44:0/4078492456 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56554e7ee000 con 0x56554eac8800 2024-09-13T18:35:59.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c19659700 1 --2- 172.21.15.44:0/4078492456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56554eac8800 0x56554e871600 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x56554f5a62a0 tx=0x56554f5b0000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79c6fd20074886a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c1464f700 1 -- 172.21.15.44:0/4078492456 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56554e81b080 con 0x56554eac8800 2024-09-13T18:35:59.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c1464f700 1 -- 172.21.15.44:0/4078492456 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56554f5acf00 con 0x56554eac8800 2024-09-13T18:35:59.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.900+0000 7f0c1464f700 1 -- 172.21.15.44:0/4078492456 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56554e81b600 con 0x56554eac8800 2024-09-13T18:35:59.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c1a69e500 1 -- 172.21.15.44:0/4078492456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56554eac8800 msgr2=0x56554e871600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c1a69e500 1 --2- 172.21.15.44:0/4078492456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56554eac8800 0x56554e871600 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x56554f5a62a0 tx=0x56554f5b0000 comp rx=0 tx=0).stop 2024-09-13T18:35:59.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c1a69e500 1 -- 172.21.15.44:0/4078492456 shutdown_connections 2024-09-13T18:35:59.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c1a69e500 1 --2- 172.21.15.44:0/4078492456 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56554eac9000 0x56554e872100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c1a69e500 1 --2- 172.21.15.44:0/4078492456 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56554eac8c00 0x56554e871b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c1a69e500 1 --2- 172.21.15.44:0/4078492456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56554eac8800 0x56554e871600 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c1a69e500 1 -- 172.21.15.44:0/4078492456 >> 172.21.15.44:0/4078492456 conn(0x56554eac8400 msgr2=0x56554e8bb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c1a69e500 1 -- 172.21.15.44:0/4078492456 shutdown_connections 2024-09-13T18:35:59.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c1a69e500 1 -- 172.21.15.44:0/4078492456 wait complete. 2024-09-13T18:35:59.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c1a69e500 1 Processor -- start 2024-09-13T18:35:59.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c1a69e500 1 -- start start 2024-09-13T18:35:59.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c1a69e500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56554eac8800 0x56554e873180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c1a69e500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56554eac8c00 0x56554e872c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c1a69e500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56554eac9000 0x56554e872680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c1a69e500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56554e84c3c0 con 0x56554eac8c00 2024-09-13T18:35:59.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c1a69e500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56554e84c280 con 0x56554eac8800 2024-09-13T18:35:59.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c1a69e500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x56554e84c140 con 0x56554eac9000 2024-09-13T18:35:59.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c18e58700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56554eac8c00 0x56554e872c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c18657700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56554eac9000 0x56554e872680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c18e58700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56554eac8c00 0x56554e872c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50356/0 (socket says 172.21.15.44:50356) 2024-09-13T18:35:59.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c18e58700 1 -- 172.21.15.44:0/565799864 learned_addr learned my addr 172.21.15.44:0/565799864 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:35:59.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c19659700 1 --2- 172.21.15.44:0/565799864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56554eac8800 0x56554e873180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c18e58700 1 -- 172.21.15.44:0/565799864 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56554eac9000 msgr2=0x56554e872680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c18e58700 1 --2- 172.21.15.44:0/565799864 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56554eac9000 0x56554e872680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c18e58700 1 -- 172.21.15.44:0/565799864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56554eac8800 msgr2=0x56554e873180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c18e58700 1 --2- 172.21.15.44:0/565799864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56554eac8800 0x56554e873180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c18e58700 1 -- 172.21.15.44:0/565799864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56554e7ee1a0 con 0x56554eac8c00 2024-09-13T18:35:59.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.904+0000 7f0c18e58700 1 --2- 172.21.15.44:0/565799864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56554eac8c00 0x56554e872c00 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x56554f5a6fc0 tx=0x56554eae0c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.908+0000 7f0c12e4c700 1 -- 172.21.15.44:0/565799864 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56554e81b080 con 0x56554eac8c00 2024-09-13T18:35:59.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.908+0000 7f0c12e4c700 1 -- 172.21.15.44:0/565799864 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56554f5ad800 con 0x56554eac8c00 2024-09-13T18:35:59.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.908+0000 7f0c1a69e500 1 -- 172.21.15.44:0/565799864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56554e7ee000 con 0x56554eac8c00 2024-09-13T18:35:59.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.908+0000 7f0c12e4c700 1 -- 172.21.15.44:0/565799864 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56554e81b600 con 0x56554eac8c00 2024-09-13T18:35:59.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.908+0000 7f0c1a69e500 1 -- 172.21.15.44:0/565799864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56554e7ee9c0 con 0x56554eac8c00 2024-09-13T18:35:59.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.908+0000 7f0c1a69e500 4 main: resolving pool 10 2024-09-13T18:35:59.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.912+0000 7f0c12e4c700 1 -- 172.21.15.44:0/565799864 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x56554e82a840 con 0x56554eac8c00 2024-09-13T18:35:59.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.912+0000 7f0c12e4c700 1 --2- 172.21.15.44:0/565799864 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x56554eac9800 0x56554e873700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.912+0000 7f0c12e4c700 1 -- 172.21.15.44:0/565799864 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x56554e804a80 con 0x56554eac8c00 2024-09-13T18:35:59.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.912+0000 7f0c1a69e500 4 main: creating IoCtx.. 2024-09-13T18:35:59.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.912+0000 7f0c19659700 1 --2- 172.21.15.44:0/565799864 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x56554eac9800 0x56554e873700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.912+0000 7f0c1a69e500 1 --2- 172.21.15.44:0/565799864 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x56554eac9c00 0x56554e872100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.912+0000 7f0c1a69e500 1 -- 172.21.15.44:0/565799864 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:1 10.13 10:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78) v8 -- 0x56554ec22000 con 0x56554eac9c00 2024-09-13T18:35:59.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.912+0000 7f0c18657700 1 --2- 172.21.15.44:0/565799864 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x56554eac9c00 0x56554e872100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.916+0000 7f0c19659700 1 --2- 172.21.15.44:0/565799864 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x56554eac9800 0x56554e873700 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x56554f5a62a0 tx=0x56554f5b0120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.916+0000 7f0c18657700 1 --2- 172.21.15.44:0/565799864 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x56554eac9c00 0x56554e872100 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.916+0000 7f0c18657700 1 -- 172.21.15.44:0/565799864 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv4 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x56554f650b40 con 0x56554eac9c00 2024-09-13T18:35:59.922 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:35:59.922 INFO:teuthology.orchestra.run.smithi044.stdout: "0": { 2024-09-13T18:35:59.922 INFO:teuthology.orchestra.run.smithi044.stdout: "data": { 2024-09-13T18:35:59.923 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 1, 2024-09-13T18:35:59.923 INFO:teuthology.orchestra.run.smithi044.stdout: "inotable": { 2024-09-13T18:35:59.923 INFO:teuthology.orchestra.run.smithi044.stdout: "projected_free": [ 2024-09-13T18:35:59.923 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:59.923 INFO:teuthology.orchestra.run.smithi044.stdout: "start": 1099511627776, 2024-09-13T18:35:59.923 INFO:teuthology.orchestra.run.smithi044.stdout: "len": 1099511627776 2024-09-13T18:35:59.923 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.923 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-13T18:35:59.923 INFO:teuthology.orchestra.run.smithi044.stdout: "free": [ 2024-09-13T18:35:59.923 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:35:59.923 INFO:teuthology.orchestra.run.smithi044.stdout: "start": 1099511627776, 2024-09-13T18:35:59.923 INFO:teuthology.orchestra.run.smithi044.stdout: "len": 1099511627776 2024-09-13T18:35:59.923 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.924 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-13T18:35:59.924 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:35:59.924 INFO:teuthology.orchestra.run.smithi044.stdout: "result": 0 2024-09-13T18:35:59.924 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:35:59.924 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:35:59.924 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:35:59.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.916+0000 7f0c1a69e500 1 -- 172.21.15.44:0/565799864 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x56554eac9c00 msgr2=0x56554e872100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.916+0000 7f0c1a69e500 1 --2- 172.21.15.44:0/565799864 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x56554eac9c00 0x56554e872100 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.916+0000 7f0c1a69e500 1 -- 172.21.15.44:0/565799864 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x56554eac9800 msgr2=0x56554e873700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.916+0000 7f0c1a69e500 1 --2- 172.21.15.44:0/565799864 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x56554eac9800 0x56554e873700 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x56554f5a62a0 tx=0x56554f5b0120 comp rx=0 tx=0).stop 2024-09-13T18:35:59.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.916+0000 7f0c1a69e500 1 -- 172.21.15.44:0/565799864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56554eac8c00 msgr2=0x56554e872c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.916+0000 7f0c1a69e500 1 --2- 172.21.15.44:0/565799864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56554eac8c00 0x56554e872c00 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x56554f5a6fc0 tx=0x56554eae0c00 comp rx=0 tx=0).stop 2024-09-13T18:35:59.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.916+0000 7f0c18e58700 1 -- 172.21.15.44:0/565799864 reap_dead start 2024-09-13T18:35:59.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.916+0000 7f0c1a69e500 1 -- 172.21.15.44:0/565799864 shutdown_connections 2024-09-13T18:35:59.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.916+0000 7f0c1a69e500 1 -- 172.21.15.44:0/565799864 >> 172.21.15.44:0/565799864 conn(0x56554eac8400 msgr2=0x56554e8bb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.916+0000 7f0c1a69e500 1 -- 172.21.15.44:0/565799864 shutdown_connections 2024-09-13T18:35:59.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.916+0000 7f0c1a69e500 1 -- 172.21.15.44:0/565799864 wait complete. 2024-09-13T18:35:59.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.916+0000 7f0c1a69e500 1 -- 172.21.15.44:0/2544158777 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56554e7cb400 msgr2=0x56554e870b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.916+0000 7f0c1a69e500 1 --2- 172.21.15.44:0/2544158777 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56554e7cb400 0x56554e870b00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x56554f538e10 tx=0x56554f5b0480 comp rx=0 tx=0).stop 2024-09-13T18:35:59.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.916+0000 7f0c1a69e500 1 -- 172.21.15.44:0/2544158777 shutdown_connections 2024-09-13T18:35:59.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.916+0000 7f0c1a69e500 1 --2- 172.21.15.44:0/2544158777 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56554e7cb800 0x56554e871080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.916+0000 7f0c1a69e500 1 --2- 172.21.15.44:0/2544158777 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56554e7cb400 0x56554e870b00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.916+0000 7f0c1a69e500 1 --2- 172.21.15.44:0/2544158777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56554e7cb000 0x56554e870580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.916+0000 7f0c1a69e500 1 -- 172.21.15.44:0/2544158777 >> 172.21.15.44:0/2544158777 conn(0x56554e7cac00 msgr2=0x56554e8bb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.916+0000 7f0c1a69e500 1 -- 172.21.15.44:0/2544158777 shutdown_connections 2024-09-13T18:35:59.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:35:59.916+0000 7f0c1a69e500 1 -- 172.21.15.44:0/2544158777 wait complete. 2024-09-13T18:35:59.929 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'inode'] in time 0:00:00.071610, result: { "0": { "data": { "version": 1, "inotable": { "projected_free": [ { "start": 1099511627776, "len": 1099511627776 } ], "free": [ { "start": 1099511627776, "len": 1099511627776 } ] } }, "result": 0 } } 2024-09-13T18:35:59.929 INFO:tasks.cephfs.test_journal_repair:{ "0": { "data": { "version": 1, "inotable": { "projected_free": [ { "start": 1099511627776, "len": 1099511627776 } ], "free": [ { "start": 1099511627776, "len": 1099511627776 } ] } }, "result": 0 } } 2024-09-13T18:35:59.929 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show snap 2024-09-13T18:36:00.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.008+0000 7f37ae224500 1 -- start start 2024-09-13T18:36:00.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.008+0000 7f37ae224500 1 Processor -- start 2024-09-13T18:36:00.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.008+0000 7f37ae224500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0b0db5800 0x55a0b0e5a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.008+0000 7f37ae224500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0b0db5400 0x55a0b0e5ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.008+0000 7f37ae224500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0b0db5000 0x55a0b0e5b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.008+0000 7f37ae224500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b0e36a00 con 0x55a0b0db5400 2024-09-13T18:36:00.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.008+0000 7f37ae224500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b0e36780 con 0x55a0b0db5000 2024-09-13T18:36:00.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.008+0000 7f37ae224500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0b0e36640 con 0x55a0b0db5800 2024-09-13T18:36:00.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.008+0000 7f37ac1dd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0b0db5400 0x55a0b0e5ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.008+0000 7f37ac1dd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0b0db5400 0x55a0b0e5ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50370/0 (socket says 172.21.15.44:50370) 2024-09-13T18:36:00.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.008+0000 7f37ac1dd700 1 -- 172.21.15.44:0/926533965 learned_addr learned my addr 172.21.15.44:0/926533965 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:00.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.008+0000 7f37ac9de700 1 --2- 172.21.15.44:0/926533965 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0b0db5800 0x55a0b0e5a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.008+0000 7f37ad1df700 1 --2- 172.21.15.44:0/926533965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0b0db5000 0x55a0b0e5b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.008+0000 7f37ac1dd700 1 -- 172.21.15.44:0/926533965 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0b0db5800 msgr2=0x55a0b0e5a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.008+0000 7f37ac1dd700 1 --2- 172.21.15.44:0/926533965 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0b0db5800 0x55a0b0e5a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.008+0000 7f37ac1dd700 1 -- 172.21.15.44:0/926533965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0b0db5000 msgr2=0x55a0b0e5b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.008+0000 7f37ac1dd700 1 --2- 172.21.15.44:0/926533965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0b0db5000 0x55a0b0e5b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.008+0000 7f37ac1dd700 1 -- 172.21.15.44:0/926533965 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0b0dd89c0 con 0x55a0b0db5400 2024-09-13T18:36:00.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.008+0000 7f37ad1df700 1 --2- 172.21.15.44:0/926533965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0b0db5000 0x55a0b0e5b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:00.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.008+0000 7f37ac1dd700 1 --2- 172.21.15.44:0/926533965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0b0db5400 0x55a0b0e5ab00 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x55a0b1b7ae10 tx=0x55a0b1b84360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250dc78743166b54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37aa1d9700 1 -- 172.21.15.44:0/926533965 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a0b0e05600 con 0x55a0b0db5400 2024-09-13T18:36:00.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37aa1d9700 1 -- 172.21.15.44:0/926533965 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a0b0e00180 con 0x55a0b0db5400 2024-09-13T18:36:00.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ae224500 1 -- 172.21.15.44:0/926533965 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0b0dd8b60 con 0x55a0b0db5400 2024-09-13T18:36:00.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ae224500 1 -- 172.21.15.44:0/926533965 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55a0b0dd8340 con 0x55a0b0db5400 2024-09-13T18:36:00.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ae224500 4 waiting for MDS map... 2024-09-13T18:36:00.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37aa1d9700 1 -- 172.21.15.44:0/926533965 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a0b0e051e0 con 0x55a0b0db5400 2024-09-13T18:36:00.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37aa1d9700 1 -- 172.21.15.44:0/926533965 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x55a0b0deec40 con 0x55a0b0db5400 2024-09-13T18:36:00.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37aa1d9700 1 -- 172.21.15.44:0/926533965 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x55a0b10aa900 con 0x55a0b0db5400 2024-09-13T18:36:00.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ae224500 4 Got MDS map 70 2024-09-13T18:36:00.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ae224500 10 main: main 2024-09-13T18:36:00.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ae224500 4 main: connecting to RADOS... 2024-09-13T18:36:00.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ae224500 1 Processor -- start 2024-09-13T18:36:00.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ae224500 1 -- start start 2024-09-13T18:36:00.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ae224500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0b1c3c400 0x55a0b0e5b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ae224500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0b1c3c800 0x55a0b0e5bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ae224500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0b1c3cc00 0x55a0b0e5c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ae224500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b0debe00 con 0x55a0b1c3c800 2024-09-13T18:36:00.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ae224500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b0e36780 con 0x55a0b1c3c400 2024-09-13T18:36:00.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ae224500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0b0e36500 con 0x55a0b1c3cc00 2024-09-13T18:36:00.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ac9de700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0b1c3c800 0x55a0b0e5bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ac1dd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0b1c3cc00 0x55a0b0e5c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ac1dd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0b1c3cc00 0x55a0b0e5c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:43100/0 (socket says 172.21.15.44:43100) 2024-09-13T18:36:00.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ac1dd700 1 -- 172.21.15.44:0/1797031714 learned_addr learned my addr 172.21.15.44:0/1797031714 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:00.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ad1df700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0b1c3c400 0x55a0b0e5b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ac1dd700 1 -- 172.21.15.44:0/1797031714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0b1c3c400 msgr2=0x55a0b0e5b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ac1dd700 1 --2- 172.21.15.44:0/1797031714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0b1c3c400 0x55a0b0e5b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ac1dd700 1 -- 172.21.15.44:0/1797031714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0b1c3c800 msgr2=0x55a0b0e5bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ac1dd700 1 --2- 172.21.15.44:0/1797031714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0b1c3c800 0x55a0b0e5bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ac1dd700 1 -- 172.21.15.44:0/1797031714 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0b0dd8000 con 0x55a0b1c3cc00 2024-09-13T18:36:00.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.012+0000 7f37ac1dd700 1 --2- 172.21.15.44:0/1797031714 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0b1c3cc00 0x55a0b0e5c100 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55a0b1b78330 tx=0x55a0b0e686c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43fab1de6f7d507f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.016+0000 7f37a81d5700 1 -- 172.21.15.44:0/1797031714 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a0b0e04f20 con 0x55a0b1c3cc00 2024-09-13T18:36:00.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.016+0000 7f37a81d5700 1 -- 172.21.15.44:0/1797031714 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a0b1b96d80 con 0x55a0b1c3cc00 2024-09-13T18:36:00.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.016+0000 7f37a81d5700 1 -- 172.21.15.44:0/1797031714 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a0b0e05600 con 0x55a0b1c3cc00 2024-09-13T18:36:00.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.016+0000 7f37ae224500 1 -- 172.21.15.44:0/1797031714 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0b1c3cc00 msgr2=0x55a0b0e5c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.016+0000 7f37ae224500 1 --2- 172.21.15.44:0/1797031714 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0b1c3cc00 0x55a0b0e5c100 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55a0b1b78330 tx=0x55a0b0e686c0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.016+0000 7f37ae224500 1 -- 172.21.15.44:0/1797031714 shutdown_connections 2024-09-13T18:36:00.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.016+0000 7f37ae224500 1 --2- 172.21.15.44:0/1797031714 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0b1c3cc00 0x55a0b0e5c100 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.016+0000 7f37ae224500 1 --2- 172.21.15.44:0/1797031714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0b1c3c800 0x55a0b0e5bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.016+0000 7f37ae224500 1 --2- 172.21.15.44:0/1797031714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0b1c3c400 0x55a0b0e5b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.016+0000 7f37ae224500 1 -- 172.21.15.44:0/1797031714 >> 172.21.15.44:0/1797031714 conn(0x55a0b0db4c00 msgr2=0x55a0b0e71800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.016+0000 7f37ae224500 1 -- 172.21.15.44:0/1797031714 shutdown_connections 2024-09-13T18:36:00.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.016+0000 7f37ae224500 1 -- 172.21.15.44:0/1797031714 wait complete. 2024-09-13T18:36:00.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.016+0000 7f37ae224500 1 Processor -- start 2024-09-13T18:36:00.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.016+0000 7f37ae224500 1 -- start start 2024-09-13T18:36:00.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.016+0000 7f37ae224500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0b1c3c400 0x55a0b0e5d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.016+0000 7f37ae224500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0b1c3c800 0x55a0b0e5cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.016+0000 7f37ae224500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0b1c3cc00 0x55a0b0e5c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.016+0000 7f37ae224500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b0e363c0 con 0x55a0b1c3c400 2024-09-13T18:36:00.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.016+0000 7f37ae224500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b0e36280 con 0x55a0b1c3c800 2024-09-13T18:36:00.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.016+0000 7f37ae224500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0b0e36140 con 0x55a0b1c3cc00 2024-09-13T18:36:00.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.016+0000 7f37ad1df700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0b1c3c400 0x55a0b0e5d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.020+0000 7f37ad1df700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0b1c3c400 0x55a0b0e5d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50396/0 (socket says 172.21.15.44:50396) 2024-09-13T18:36:00.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.020+0000 7f37ac9de700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0b1c3c800 0x55a0b0e5cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.020+0000 7f37ad1df700 1 -- 172.21.15.44:0/1445660858 learned_addr learned my addr 172.21.15.44:0/1445660858 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:00.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.020+0000 7f37ac1dd700 1 --2- 172.21.15.44:0/1445660858 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0b1c3cc00 0x55a0b0e5c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.020+0000 7f37ad1df700 1 -- 172.21.15.44:0/1445660858 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0b1c3cc00 msgr2=0x55a0b0e5c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.020+0000 7f37ad1df700 1 --2- 172.21.15.44:0/1445660858 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0b1c3cc00 0x55a0b0e5c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.020+0000 7f37ad1df700 1 -- 172.21.15.44:0/1445660858 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0b1c3c800 msgr2=0x55a0b0e5cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.020+0000 7f37ad1df700 1 --2- 172.21.15.44:0/1445660858 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0b1c3c800 0x55a0b0e5cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.020+0000 7f37ad1df700 1 -- 172.21.15.44:0/1445660858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0b0dd89c0 con 0x55a0b1c3c400 2024-09-13T18:36:00.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.020+0000 7f37ad1df700 1 --2- 172.21.15.44:0/1445660858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0b1c3c400 0x55a0b0e5d180 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x55a0b1b790e0 tx=0x55a0b1b84000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.020+0000 7f37a69d2700 1 -- 172.21.15.44:0/1445660858 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a0b0e05080 con 0x55a0b1c3c400 2024-09-13T18:36:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.020+0000 7f37a69d2700 1 -- 172.21.15.44:0/1445660858 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a0b1b96300 con 0x55a0b1c3c400 2024-09-13T18:36:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.020+0000 7f37ae224500 1 -- 172.21.15.44:0/1445660858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a0b0dd8b60 con 0x55a0b1c3c400 2024-09-13T18:36:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.020+0000 7f37a69d2700 1 -- 172.21.15.44:0/1445660858 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a0b0e04f20 con 0x55a0b1c3c400 2024-09-13T18:36:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.020+0000 7f37ae224500 1 -- 172.21.15.44:0/1445660858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0b0dd8340 con 0x55a0b1c3c400 2024-09-13T18:36:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.020+0000 7f37ae224500 4 main: resolving pool 10 2024-09-13T18:36:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.020+0000 7f37a69d2700 1 -- 172.21.15.44:0/1445660858 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x55a0b0e14840 con 0x55a0b1c3c400 2024-09-13T18:36:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37a69d2700 1 --2- 172.21.15.44:0/1445660858 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55a0b1202000 0x55a0b0e5d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37a69d2700 1 -- 172.21.15.44:0/1445660858 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x55a0b0deea80 con 0x55a0b1c3c400 2024-09-13T18:36:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ae224500 4 main: creating IoCtx.. 2024-09-13T18:36:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ae224500 1 --2- 172.21.15.44:0/1445660858 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55a0b1c3d000 0x55a0b0e5c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ac9de700 1 --2- 172.21.15.44:0/1445660858 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55a0b1202000 0x55a0b0e5d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ae224500 1 -- 172.21.15.44:0/1445660858 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:1 10.d 10:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78) v8 -- 0x55a0b1c3d400 con 0x55a0b1c3d000 2024-09-13T18:36:00.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ac1dd700 1 --2- 172.21.15.44:0/1445660858 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55a0b1c3d000 0x55a0b0e5c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ac9de700 1 --2- 172.21.15.44:0/1445660858 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55a0b1202000 0x55a0b0e5d700 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x55a0b1b7a090 tx=0x55a0b10b9ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ac1dd700 1 --2- 172.21.15.44:0/1445660858 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55a0b1c3d000 0x55a0b0e5c100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ac1dd700 1 -- 172.21.15.44:0/1445660858 <== osd.6 v2:172.21.15.99:6808/2907584318 1 ==== osd_op_reply(1 mds_snaptable [read 0~70 out=70b] v0'0 uv2 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x55a0b1c30b40 con 0x55a0b1c3d000 2024-09-13T18:36:00.032 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:36:00.032 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 1, 2024-09-13T18:36:00.032 INFO:teuthology.orchestra.run.smithi044.stdout: "snapserver": { 2024-09-13T18:36:00.033 INFO:teuthology.orchestra.run.smithi044.stdout: "last_snap": 1, 2024-09-13T18:36:00.033 INFO:teuthology.orchestra.run.smithi044.stdout: "last_created": 1, 2024-09-13T18:36:00.033 INFO:teuthology.orchestra.run.smithi044.stdout: "last_destroyed": 1, 2024-09-13T18:36:00.033 INFO:teuthology.orchestra.run.smithi044.stdout: "pending_noop": [], 2024-09-13T18:36:00.033 INFO:teuthology.orchestra.run.smithi044.stdout: "snaps": [], 2024-09-13T18:36:00.033 INFO:teuthology.orchestra.run.smithi044.stdout: "need_to_purge": {}, 2024-09-13T18:36:00.033 INFO:teuthology.orchestra.run.smithi044.stdout: "pending_update": [], 2024-09-13T18:36:00.033 INFO:teuthology.orchestra.run.smithi044.stdout: "pending_destroy": [] 2024-09-13T18:36:00.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:00.033 INFO:teuthology.orchestra.run.smithi044.stdout: "result": 0 2024-09-13T18:36:00.033 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:36:00.033 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:00.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ae224500 1 -- 172.21.15.44:0/1445660858 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55a0b1c3d000 msgr2=0x55a0b0e5c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ae224500 1 --2- 172.21.15.44:0/1445660858 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55a0b1c3d000 0x55a0b0e5c100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ae224500 1 -- 172.21.15.44:0/1445660858 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55a0b1202000 msgr2=0x55a0b0e5d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ae224500 1 --2- 172.21.15.44:0/1445660858 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55a0b1202000 0x55a0b0e5d700 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x55a0b1b7a090 tx=0x55a0b10b9ec0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ae224500 1 -- 172.21.15.44:0/1445660858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0b1c3c400 msgr2=0x55a0b0e5d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ae224500 1 --2- 172.21.15.44:0/1445660858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0b1c3c400 0x55a0b0e5d180 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x55a0b1b790e0 tx=0x55a0b1b84000 comp rx=0 tx=0).stop 2024-09-13T18:36:00.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ac9de700 1 -- 172.21.15.44:0/1445660858 reap_dead start 2024-09-13T18:36:00.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ae224500 1 -- 172.21.15.44:0/1445660858 shutdown_connections 2024-09-13T18:36:00.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ae224500 1 -- 172.21.15.44:0/1445660858 >> 172.21.15.44:0/1445660858 conn(0x55a0b0db4c00 msgr2=0x55a0b0e71800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ae224500 1 -- 172.21.15.44:0/1445660858 shutdown_connections 2024-09-13T18:36:00.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ae224500 1 -- 172.21.15.44:0/1445660858 wait complete. 2024-09-13T18:36:00.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ae224500 1 -- 172.21.15.44:0/926533965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0b0db5400 msgr2=0x55a0b0e5ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ae224500 1 --2- 172.21.15.44:0/926533965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0b0db5400 0x55a0b0e5ab00 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x55a0b1b7ae10 tx=0x55a0b1b84360 comp rx=0 tx=0).stop 2024-09-13T18:36:00.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ae224500 1 -- 172.21.15.44:0/926533965 shutdown_connections 2024-09-13T18:36:00.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ae224500 1 --2- 172.21.15.44:0/926533965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0b0db5000 0x55a0b0e5b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ae224500 1 --2- 172.21.15.44:0/926533965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0b0db5400 0x55a0b0e5ab00 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ae224500 1 --2- 172.21.15.44:0/926533965 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a0b0db5800 0x55a0b0e5a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ae224500 1 -- 172.21.15.44:0/926533965 >> 172.21.15.44:0/926533965 conn(0x55a0b0db5c00 msgr2=0x55a0b0e71000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ae224500 1 -- 172.21.15.44:0/926533965 shutdown_connections 2024-09-13T18:36:00.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.024+0000 7f37ae224500 1 -- 172.21.15.44:0/926533965 wait complete. 2024-09-13T18:36:00.037 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'snap'] in time 0:00:00.108145, result: { "version": 1, "snapserver": { "last_snap": 1, "last_created": 1, "last_destroyed": 1, "pending_noop": [], "snaps": [], "need_to_purge": {}, "pending_update": [], "pending_destroy": [] }, "result": 0 } 2024-09-13T18:36:00.037 INFO:tasks.cephfs.test_journal_repair:{ "version": 1, "snapserver": { "last_snap": 1, "last_created": 1, "last_destroyed": 1, "pending_noop": [], "snaps": [], "need_to_purge": {}, "pending_update": [], "pending_destroy": [] }, "result": 0 } 2024-09-13T18:36:00.037 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show session 2024-09-13T18:36:00.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.068+0000 7fac505a7500 1 -- start start 2024-09-13T18:36:00.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.068+0000 7fac505a7500 1 Processor -- start 2024-09-13T18:36:00.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac505a7500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559977da7800 0x559977e4c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac505a7500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559977da7400 0x559977e4cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac505a7500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559977da7000 0x559977e4d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac505a7500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x559977ddde00 con 0x559977da7800 2024-09-13T18:36:00.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac505a7500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559977e28a00 con 0x559977da7000 2024-09-13T18:36:00.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac505a7500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x559977e28640 con 0x559977da7400 2024-09-13T18:36:00.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac4ed61700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559977da7800 0x559977e4c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac4f562700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559977da7000 0x559977e4d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac4ed61700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559977da7800 0x559977e4c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50404/0 (socket says 172.21.15.44:50404) 2024-09-13T18:36:00.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac4ed61700 1 -- 172.21.15.44:0/237919254 learned_addr learned my addr 172.21.15.44:0/237919254 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:00.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac4e560700 1 --2- 172.21.15.44:0/237919254 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559977da7400 0x559977e4cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac4ed61700 1 -- 172.21.15.44:0/237919254 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559977da7400 msgr2=0x559977e4cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac4ed61700 1 --2- 172.21.15.44:0/237919254 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559977da7400 0x559977e4cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac4ed61700 1 -- 172.21.15.44:0/237919254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559977da7000 msgr2=0x559977e4d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac4ed61700 1 --2- 172.21.15.44:0/237919254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559977da7000 0x559977e4d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac4ed61700 1 -- 172.21.15.44:0/237919254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559977dca9c0 con 0x559977da7800 2024-09-13T18:36:00.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac4e560700 1 --2- 172.21.15.44:0/237919254 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559977da7400 0x559977e4cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:00.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac4f562700 1 --2- 172.21.15.44:0/237919254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559977da7000 0x559977e4d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:00.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac4ed61700 1 --2- 172.21.15.44:0/237919254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559977da7800 0x559977e4c580 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x559978b82cf0 tx=0x559977e7d260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625559f399b547ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac4c55c700 1 -- 172.21.15.44:0/237919254 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559977df7080 con 0x559977da7800 2024-09-13T18:36:00.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac4c55c700 1 -- 172.21.15.44:0/237919254 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559978b94300 con 0x559977da7800 2024-09-13T18:36:00.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac4c55c700 1 -- 172.21.15.44:0/237919254 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559977df7600 con 0x559977da7800 2024-09-13T18:36:00.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac505a7500 1 -- 172.21.15.44:0/237919254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559977dca1a0 con 0x559977da7800 2024-09-13T18:36:00.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac505a7500 1 -- 172.21.15.44:0/237919254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x559977dcab60 con 0x559977da7800 2024-09-13T18:36:00.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac505a7500 4 waiting for MDS map... 2024-09-13T18:36:00.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac4c55c700 1 -- 172.21.15.44:0/237919254 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x559977de0c40 con 0x559977da7800 2024-09-13T18:36:00.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac4c55c700 1 -- 172.21.15.44:0/237919254 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x559977de8f00 con 0x559977da7800 2024-09-13T18:36:00.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac505a7500 4 Got MDS map 70 2024-09-13T18:36:00.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac505a7500 10 main: main 2024-09-13T18:36:00.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.072+0000 7fac505a7500 4 main: connecting to RADOS... 2024-09-13T18:36:00.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac505a7500 1 Processor -- start 2024-09-13T18:36:00.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac505a7500 1 -- start start 2024-09-13T18:36:00.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac505a7500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599780a6c00 0x559977e4d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac505a7500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5599780a7000 0x559977e4db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac505a7500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599780a7400 0x559977e4e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac505a7500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x559977e28500 con 0x5599780a6c00 2024-09-13T18:36:00.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac505a7500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559977e283c0 con 0x5599780a7400 2024-09-13T18:36:00.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac505a7500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x559977e28640 con 0x5599780a7000 2024-09-13T18:36:00.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac4f562700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599780a6c00 0x559977e4d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac4ed61700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5599780a7000 0x559977e4db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac4ed61700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5599780a7000 0x559977e4db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:43120/0 (socket says 172.21.15.44:43120) 2024-09-13T18:36:00.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac4ed61700 1 -- 172.21.15.44:0/3810976134 learned_addr learned my addr 172.21.15.44:0/3810976134 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:00.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac4f562700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599780a6c00 0x559977e4d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50416/0 (socket says 172.21.15.44:50416) 2024-09-13T18:36:00.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac4e560700 1 --2- 172.21.15.44:0/3810976134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599780a7400 0x559977e4e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac4f562700 1 -- 172.21.15.44:0/3810976134 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5599780a7000 msgr2=0x559977e4db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac4f562700 1 --2- 172.21.15.44:0/3810976134 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5599780a7000 0x559977e4db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac4f562700 1 -- 172.21.15.44:0/3810976134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599780a7400 msgr2=0x559977e4e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac4f562700 1 --2- 172.21.15.44:0/3810976134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599780a7400 0x559977e4e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac4f562700 1 -- 172.21.15.44:0/3810976134 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559977dca340 con 0x5599780a6c00 2024-09-13T18:36:00.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac4e560700 1 --2- 172.21.15.44:0/3810976134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599780a7400 0x559977e4e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:00.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac4f562700 1 --2- 172.21.15.44:0/3810976134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599780a6c00 0x559977e4d600 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x559978b80210 tx=0x559978104000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3f50cff0a920ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac4a558700 1 -- 172.21.15.44:0/3810976134 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559977df7080 con 0x5599780a6c00 2024-09-13T18:36:00.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac4a558700 1 -- 172.21.15.44:0/3810976134 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559978b94f00 con 0x5599780a6c00 2024-09-13T18:36:00.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac4a558700 1 -- 172.21.15.44:0/3810976134 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559977df7600 con 0x5599780a6c00 2024-09-13T18:36:00.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac505a7500 1 -- 172.21.15.44:0/3810976134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599780a6c00 msgr2=0x559977e4d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac505a7500 1 --2- 172.21.15.44:0/3810976134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599780a6c00 0x559977e4d600 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x559978b80210 tx=0x559978104000 comp rx=0 tx=0).stop 2024-09-13T18:36:00.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac505a7500 1 -- 172.21.15.44:0/3810976134 shutdown_connections 2024-09-13T18:36:00.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac505a7500 1 --2- 172.21.15.44:0/3810976134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599780a7400 0x559977e4e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac505a7500 1 --2- 172.21.15.44:0/3810976134 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5599780a7000 0x559977e4db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac505a7500 1 --2- 172.21.15.44:0/3810976134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599780a6c00 0x559977e4d600 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac505a7500 1 -- 172.21.15.44:0/3810976134 >> 172.21.15.44:0/3810976134 conn(0x559977da6c00 msgr2=0x559977e97800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac505a7500 1 -- 172.21.15.44:0/3810976134 shutdown_connections 2024-09-13T18:36:00.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.076+0000 7fac505a7500 1 -- 172.21.15.44:0/3810976134 wait complete. 2024-09-13T18:36:00.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac505a7500 1 Processor -- start 2024-09-13T18:36:00.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac505a7500 1 -- start start 2024-09-13T18:36:00.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac505a7500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599780a6c00 0x559977e4f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac505a7500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599780a7000 0x559977e4ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac505a7500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5599780a7400 0x559977e4e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac505a7500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x559977e28280 con 0x5599780a6c00 2024-09-13T18:36:00.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac505a7500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559977e28140 con 0x5599780a7000 2024-09-13T18:36:00.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac505a7500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x559977e28000 con 0x5599780a7400 2024-09-13T18:36:00.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac4f562700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599780a6c00 0x559977e4f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac4f562700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599780a6c00 0x559977e4f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50424/0 (socket says 172.21.15.44:50424) 2024-09-13T18:36:00.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac4f562700 1 -- 172.21.15.44:0/234301803 learned_addr learned my addr 172.21.15.44:0/234301803 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:00.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac4ed61700 1 --2- 172.21.15.44:0/234301803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599780a7000 0x559977e4ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac4e560700 1 --2- 172.21.15.44:0/234301803 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5599780a7400 0x559977e4e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac4f562700 1 -- 172.21.15.44:0/234301803 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5599780a7400 msgr2=0x559977e4e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac4f562700 1 --2- 172.21.15.44:0/234301803 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5599780a7400 0x559977e4e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac4f562700 1 -- 172.21.15.44:0/234301803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599780a7000 msgr2=0x559977e4ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac4f562700 1 --2- 172.21.15.44:0/234301803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599780a7000 0x559977e4ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac4f562700 1 -- 172.21.15.44:0/234301803 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559977dca9c0 con 0x5599780a6c00 2024-09-13T18:36:00.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac4e560700 1 --2- 172.21.15.44:0/234301803 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5599780a7400 0x559977e4e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:00.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac4f562700 1 --2- 172.21.15.44:0/234301803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599780a6c00 0x559977e4f180 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x559978b80ed0 tx=0x559978c30120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac48d55700 1 -- 172.21.15.44:0/234301803 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559977df6dc0 con 0x5599780a6c00 2024-09-13T18:36:00.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac48d55700 1 -- 172.21.15.44:0/234301803 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559978b94c00 con 0x5599780a6c00 2024-09-13T18:36:00.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac505a7500 1 -- 172.21.15.44:0/234301803 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559977dca1a0 con 0x5599780a6c00 2024-09-13T18:36:00.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac48d55700 1 -- 172.21.15.44:0/234301803 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559977df7080 con 0x5599780a6c00 2024-09-13T18:36:00.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac505a7500 1 -- 172.21.15.44:0/234301803 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559977dcab60 con 0x5599780a6c00 2024-09-13T18:36:00.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.080+0000 7fac505a7500 4 main: resolving pool 10 2024-09-13T18:36:00.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.084+0000 7fac48d55700 1 -- 172.21.15.44:0/234301803 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x559977e06840 con 0x5599780a6c00 2024-09-13T18:36:00.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.084+0000 7fac48d55700 1 --2- 172.21.15.44:0/234301803 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559978114800 0x559977e4f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.084+0000 7fac48d55700 1 -- 172.21.15.44:0/234301803 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x559977de0a80 con 0x5599780a6c00 2024-09-13T18:36:00.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.084+0000 7fac4ed61700 1 --2- 172.21.15.44:0/234301803 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559978114800 0x559977e4f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.084+0000 7fac505a7500 4 main: creating IoCtx.. 2024-09-13T18:36:00.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.084+0000 7fac505a7500 1 --2- 172.21.15.44:0/234301803 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x5599780a7800 0x559977e4e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.084+0000 7fac505a7500 1 -- 172.21.15.44:0/234301803 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:1 10.b 10:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78) v8 -- 0x5599780a7c00 con 0x5599780a7800 2024-09-13T18:36:00.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.084+0000 7fac4e560700 1 --2- 172.21.15.44:0/234301803 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x5599780a7800 0x559977e4e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.084+0000 7fac4ed61700 1 --2- 172.21.15.44:0/234301803 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559978114800 0x559977e4f700 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x559978b83b30 tx=0x559977e7d320 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.084+0000 7fac4e560700 1 --2- 172.21.15.44:0/234301803 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x5599780a7800 0x559977e4e100 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.088+0000 7fac4e560700 1 -- 172.21.15.44:0/234301803 <== osd.6 v2:172.21.15.99:6808/2907584318 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv4 ondisk = 0) v8 ==== 159+0+14 (crc 0 0 0) 0x559978b12b40 con 0x5599780a7800 2024-09-13T18:36:00.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.088+0000 7fac505a7500 1 -- 172.21.15.44:0/234301803 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:2 10.b 10:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78) v8 -- 0x559978114c00 con 0x5599780a7800 2024-09-13T18:36:00.095 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:36:00.095 INFO:teuthology.orchestra.run.smithi044.stdout: "0": { 2024-09-13T18:36:00.096 INFO:teuthology.orchestra.run.smithi044.stdout: "data": { 2024-09-13T18:36:00.096 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions": [] 2024-09-13T18:36:00.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:00.096 INFO:teuthology.orchestra.run.smithi044.stdout: "result": 0 2024-09-13T18:36:00.096 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:00.096 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:36:00.096 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:00.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.088+0000 7fac4e560700 1 -- 172.21.15.44:0/234301803 <== osd.6 v2:172.21.15.99:6808/2907584318 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 159+0+5 (crc 0 0 0) 0x559978b12b40 con 0x5599780a7800 2024-09-13T18:36:00.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.088+0000 7fac505a7500 1 -- 172.21.15.44:0/234301803 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x5599780a7800 msgr2=0x559977e4e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.088+0000 7fac505a7500 1 --2- 172.21.15.44:0/234301803 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x5599780a7800 0x559977e4e100 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.088+0000 7fac505a7500 1 -- 172.21.15.44:0/234301803 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559978114800 msgr2=0x559977e4f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.088+0000 7fac505a7500 1 --2- 172.21.15.44:0/234301803 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559978114800 0x559977e4f700 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x559978b83b30 tx=0x559977e7d320 comp rx=0 tx=0).stop 2024-09-13T18:36:00.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.088+0000 7fac505a7500 1 -- 172.21.15.44:0/234301803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599780a6c00 msgr2=0x559977e4f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.088+0000 7fac505a7500 1 --2- 172.21.15.44:0/234301803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599780a6c00 0x559977e4f180 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x559978b80ed0 tx=0x559978c30120 comp rx=0 tx=0).stop 2024-09-13T18:36:00.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.088+0000 7fac4e560700 1 -- 172.21.15.44:0/234301803 reap_dead start 2024-09-13T18:36:00.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.088+0000 7fac505a7500 1 -- 172.21.15.44:0/234301803 shutdown_connections 2024-09-13T18:36:00.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.088+0000 7fac505a7500 1 -- 172.21.15.44:0/234301803 >> 172.21.15.44:0/234301803 conn(0x559977da6c00 msgr2=0x559977e97800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.088+0000 7fac505a7500 1 -- 172.21.15.44:0/234301803 shutdown_connections 2024-09-13T18:36:00.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.088+0000 7fac505a7500 1 -- 172.21.15.44:0/234301803 wait complete. 2024-09-13T18:36:00.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.088+0000 7fac505a7500 1 -- 172.21.15.44:0/237919254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559977da7800 msgr2=0x559977e4c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.088+0000 7fac505a7500 1 --2- 172.21.15.44:0/237919254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559977da7800 0x559977e4c580 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x559978b82cf0 tx=0x559977e7d260 comp rx=0 tx=0).stop 2024-09-13T18:36:00.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.088+0000 7fac505a7500 1 -- 172.21.15.44:0/237919254 shutdown_connections 2024-09-13T18:36:00.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.088+0000 7fac505a7500 1 --2- 172.21.15.44:0/237919254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559977da7000 0x559977e4d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.088+0000 7fac505a7500 1 --2- 172.21.15.44:0/237919254 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559977da7400 0x559977e4cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.088+0000 7fac505a7500 1 --2- 172.21.15.44:0/237919254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559977da7800 0x559977e4c580 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.088+0000 7fac505a7500 1 -- 172.21.15.44:0/237919254 >> 172.21.15.44:0/237919254 conn(0x559977da7c00 msgr2=0x559977e97000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.088+0000 7fac505a7500 1 -- 172.21.15.44:0/237919254 shutdown_connections 2024-09-13T18:36:00.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.088+0000 7fac505a7500 1 -- 172.21.15.44:0/237919254 wait complete. 2024-09-13T18:36:00.100 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'session'] in time 0:00:00.062397, result: { "0": { "data": { "sessions": [] }, "result": 0 } } 2024-09-13T18:36:00.100 INFO:tasks.cephfs.test_journal_repair:{ "0": { "data": { "sessions": [] }, "result": 0 } } 2024-09-13T18:36:00.100 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show session 2024-09-13T18:36:00.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.136+0000 7feb368f9500 1 -- start start 2024-09-13T18:36:00.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.136+0000 7feb368f9500 1 Processor -- start 2024-09-13T18:36:00.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb368f9500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559a85786000 0x559a84a3d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb368f9500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a84997c00 0x559a84a3cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb368f9500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a85786c00 0x559a84a3c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb368f9500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a849cde00 con 0x559a84997c00 2024-09-13T18:36:00.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb368f9500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a84a18a00 con 0x559a85786c00 2024-09-13T18:36:00.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb368f9500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x559a84a18280 con 0x559a85786000 2024-09-13T18:36:00.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb348b2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a84997c00 0x559a84a3cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb348b2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a84997c00 0x559a84a3cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50428/0 (socket says 172.21.15.44:50428) 2024-09-13T18:36:00.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb348b2700 1 -- 172.21.15.44:0/1388062481 learned_addr learned my addr 172.21.15.44:0/1388062481 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:00.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb358b4700 1 --2- 172.21.15.44:0/1388062481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a85786c00 0x559a84a3c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb350b3700 1 --2- 172.21.15.44:0/1388062481 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559a85786000 0x559a84a3d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb348b2700 1 -- 172.21.15.44:0/1388062481 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559a85786000 msgr2=0x559a84a3d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb348b2700 1 --2- 172.21.15.44:0/1388062481 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559a85786000 0x559a84a3d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb348b2700 1 -- 172.21.15.44:0/1388062481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a85786c00 msgr2=0x559a84a3c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb348b2700 1 --2- 172.21.15.44:0/1388062481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a85786c00 0x559a84a3c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb348b2700 1 -- 172.21.15.44:0/1388062481 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a849ba000 con 0x559a84997c00 2024-09-13T18:36:00.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb358b4700 1 --2- 172.21.15.44:0/1388062481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a85786c00 0x559a84a3c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:00.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb350b3700 1 --2- 172.21.15.44:0/1388062481 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559a85786000 0x559a84a3d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:00.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb348b2700 1 --2- 172.21.15.44:0/1388062481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a84997c00 0x559a84a3cb00 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x559a8576ec00 tx=0x559a85798d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad11843dfdc7ee0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb328ae700 1 -- 172.21.15.44:0/1388062481 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559a849e7080 con 0x559a84997c00 2024-09-13T18:36:00.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb328ae700 1 -- 172.21.15.44:0/1388062481 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559a85828000 con 0x559a84997c00 2024-09-13T18:36:00.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb328ae700 1 -- 172.21.15.44:0/1388062481 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559a849e7600 con 0x559a84997c00 2024-09-13T18:36:00.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb368f9500 1 -- 172.21.15.44:0/1388062481 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559a849baea0 con 0x559a84997c00 2024-09-13T18:36:00.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb368f9500 1 -- 172.21.15.44:0/1388062481 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x559a849bab60 con 0x559a84997c00 2024-09-13T18:36:00.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb368f9500 4 waiting for MDS map... 2024-09-13T18:36:00.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb328ae700 1 -- 172.21.15.44:0/1388062481 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x559a849d0c40 con 0x559a84997c00 2024-09-13T18:36:00.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb328ae700 1 -- 172.21.15.44:0/1388062481 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x559a85824900 con 0x559a84997c00 2024-09-13T18:36:00.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb368f9500 4 Got MDS map 70 2024-09-13T18:36:00.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb368f9500 10 main: main 2024-09-13T18:36:00.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.140+0000 7feb368f9500 4 main: connecting to RADOS... 2024-09-13T18:36:00.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.144+0000 7feb368f9500 1 Processor -- start 2024-09-13T18:36:00.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.144+0000 7feb368f9500 1 -- start start 2024-09-13T18:36:00.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.144+0000 7feb368f9500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559a84997800 0x559a84a3db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.144+0000 7feb368f9500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a84997400 0x559a84a3e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.144+0000 7feb368f9500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a85787400 0x559a84a3e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.144+0000 7feb368f9500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a84a183c0 con 0x559a85787400 2024-09-13T18:36:00.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.144+0000 7feb368f9500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a84a18500 con 0x559a84997400 2024-09-13T18:36:00.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.144+0000 7feb368f9500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x559a84a18280 con 0x559a84997800 2024-09-13T18:36:00.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.144+0000 7feb348b2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a85787400 0x559a84a3e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.144+0000 7feb348b2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a85787400 0x559a84a3e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50440/0 (socket says 172.21.15.44:50440) 2024-09-13T18:36:00.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.144+0000 7feb348b2700 1 -- 172.21.15.44:0/3541652055 learned_addr learned my addr 172.21.15.44:0/3541652055 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:00.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.144+0000 7feb358b4700 1 --2- 172.21.15.44:0/3541652055 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559a84997800 0x559a84a3db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.144+0000 7feb350b3700 1 --2- 172.21.15.44:0/3541652055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a84997400 0x559a84a3e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.144+0000 7feb348b2700 1 -- 172.21.15.44:0/3541652055 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559a84997800 msgr2=0x559a84a3db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.144+0000 7feb348b2700 1 --2- 172.21.15.44:0/3541652055 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559a84997800 0x559a84a3db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.144+0000 7feb348b2700 1 -- 172.21.15.44:0/3541652055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a84997400 msgr2=0x559a84a3e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.144+0000 7feb348b2700 1 --2- 172.21.15.44:0/3541652055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a84997400 0x559a84a3e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.144+0000 7feb348b2700 1 -- 172.21.15.44:0/3541652055 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a849ba1a0 con 0x559a85787400 2024-09-13T18:36:00.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.144+0000 7feb348b2700 1 --2- 172.21.15.44:0/3541652055 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a85787400 0x559a84a3e680 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x559a85898060 tx=0x559a84a6d140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2903c032466fd1d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb308aa700 1 -- 172.21.15.44:0/3541652055 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559a849e7080 con 0x559a85787400 2024-09-13T18:36:00.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb308aa700 1 -- 172.21.15.44:0/3541652055 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559a85829200 con 0x559a85787400 2024-09-13T18:36:00.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb308aa700 1 -- 172.21.15.44:0/3541652055 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559a849e7600 con 0x559a85787400 2024-09-13T18:36:00.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb368f9500 1 -- 172.21.15.44:0/3541652055 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a85787400 msgr2=0x559a84a3e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb368f9500 1 --2- 172.21.15.44:0/3541652055 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a85787400 0x559a84a3e680 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x559a85898060 tx=0x559a84a6d140 comp rx=0 tx=0).stop 2024-09-13T18:36:00.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb368f9500 1 -- 172.21.15.44:0/3541652055 shutdown_connections 2024-09-13T18:36:00.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb368f9500 1 --2- 172.21.15.44:0/3541652055 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a85787400 0x559a84a3e680 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb368f9500 1 --2- 172.21.15.44:0/3541652055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a84997400 0x559a84a3e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb368f9500 1 --2- 172.21.15.44:0/3541652055 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559a84997800 0x559a84a3db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb368f9500 1 -- 172.21.15.44:0/3541652055 >> 172.21.15.44:0/3541652055 conn(0x559a85787000 msgr2=0x559a84a87000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb368f9500 1 -- 172.21.15.44:0/3541652055 shutdown_connections 2024-09-13T18:36:00.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb368f9500 1 -- 172.21.15.44:0/3541652055 wait complete. 2024-09-13T18:36:00.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb368f9500 1 Processor -- start 2024-09-13T18:36:00.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb368f9500 1 -- start start 2024-09-13T18:36:00.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb368f9500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559a84997400 0x559a84a3f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb368f9500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a84997800 0x559a84a3f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb368f9500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a85787400 0x559a84a3ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb368f9500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a84a18a00 con 0x559a85787400 2024-09-13T18:36:00.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb368f9500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a84a18140 con 0x559a84997800 2024-09-13T18:36:00.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb368f9500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x559a84a18000 con 0x559a84997400 2024-09-13T18:36:00.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb348b2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a85787400 0x559a84a3ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb348b2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a85787400 0x559a84a3ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50452/0 (socket says 172.21.15.44:50452) 2024-09-13T18:36:00.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb348b2700 1 -- 172.21.15.44:0/211645796 learned_addr learned my addr 172.21.15.44:0/211645796 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:00.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb358b4700 1 --2- 172.21.15.44:0/211645796 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559a84997400 0x559a84a3f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.148+0000 7feb350b3700 1 --2- 172.21.15.44:0/211645796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a84997800 0x559a84a3f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.152+0000 7feb348b2700 1 -- 172.21.15.44:0/211645796 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559a84997400 msgr2=0x559a84a3f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.152+0000 7feb348b2700 1 --2- 172.21.15.44:0/211645796 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559a84997400 0x559a84a3f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.152+0000 7feb348b2700 1 -- 172.21.15.44:0/211645796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a84997800 msgr2=0x559a84a3f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.152+0000 7feb348b2700 1 --2- 172.21.15.44:0/211645796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a84997800 0x559a84a3f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.152+0000 7feb348b2700 1 -- 172.21.15.44:0/211645796 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a849ba000 con 0x559a85787400 2024-09-13T18:36:00.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.152+0000 7feb348b2700 1 --2- 172.21.15.44:0/211645796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a85787400 0x559a84a3ec00 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x559a858982d0 tx=0x559a85844c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.152+0000 7feb2f0a7700 1 -- 172.21.15.44:0/211645796 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559a849e71e0 con 0x559a85787400 2024-09-13T18:36:00.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.152+0000 7feb2f0a7700 1 -- 172.21.15.44:0/211645796 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559a85828a80 con 0x559a85787400 2024-09-13T18:36:00.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.152+0000 7feb368f9500 1 -- 172.21.15.44:0/211645796 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559a849baea0 con 0x559a85787400 2024-09-13T18:36:00.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.152+0000 7feb2f0a7700 1 -- 172.21.15.44:0/211645796 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559a849e7080 con 0x559a85787400 2024-09-13T18:36:00.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.152+0000 7feb368f9500 1 -- 172.21.15.44:0/211645796 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559a858aa000 con 0x559a85787400 2024-09-13T18:36:00.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.152+0000 7feb368f9500 4 main: resolving pool 10 2024-09-13T18:36:00.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.152+0000 7feb2f0a7700 1 -- 172.21.15.44:0/211645796 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x559a849f6840 con 0x559a85787400 2024-09-13T18:36:00.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.156+0000 7feb2f0a7700 1 --2- 172.21.15.44:0/211645796 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559a858a6400 0x559a84cea000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.156+0000 7feb2f0a7700 1 -- 172.21.15.44:0/211645796 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x559a849d0a80 con 0x559a85787400 2024-09-13T18:36:00.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.156+0000 7feb368f9500 4 main: creating IoCtx.. 2024-09-13T18:36:00.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.156+0000 7feb368f9500 1 --2- 172.21.15.44:0/211645796 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x559a85787800 0x559a84a3e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.156+0000 7feb368f9500 1 -- 172.21.15.44:0/211645796 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:1 10.b 10:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78) v8 -- 0x559a85787c00 con 0x559a85787800 2024-09-13T18:36:00.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.156+0000 7feb358b4700 1 --2- 172.21.15.44:0/211645796 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559a858a6400 0x559a84cea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.156+0000 7feb350b3700 1 --2- 172.21.15.44:0/211645796 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x559a85787800 0x559a84a3e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.156+0000 7feb358b4700 1 --2- 172.21.15.44:0/211645796 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559a858a6400 0x559a84cea000 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x559a8576e2a0 tx=0x559a85844cc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.156+0000 7feb350b3700 1 --2- 172.21.15.44:0/211645796 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x559a85787800 0x559a84a3e680 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.156+0000 7feb350b3700 1 -- 172.21.15.44:0/211645796 <== osd.6 v2:172.21.15.99:6808/2907584318 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv4 ondisk = 0) v8 ==== 159+0+14 (crc 0 0 0) 0x559a85772b40 con 0x559a85787800 2024-09-13T18:36:00.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.156+0000 7feb368f9500 1 -- 172.21.15.44:0/211645796 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:2 10.b 10:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78) v8 -- 0x559a858a6800 con 0x559a85787800 2024-09-13T18:36:00.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.156+0000 7feb350b3700 1 -- 172.21.15.44:0/211645796 <== osd.6 v2:172.21.15.99:6808/2907584318 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 159+0+5 (crc 0 0 0) 0x559a85772b40 con 0x559a85787800 2024-09-13T18:36:00.164 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:36:00.164 INFO:teuthology.orchestra.run.smithi044.stdout: "0": { 2024-09-13T18:36:00.164 INFO:teuthology.orchestra.run.smithi044.stdout: "data": { 2024-09-13T18:36:00.164 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions": [] 2024-09-13T18:36:00.164 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:00.165 INFO:teuthology.orchestra.run.smithi044.stdout: "result": 0 2024-09-13T18:36:00.165 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:00.165 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:36:00.165 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:00.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.156+0000 7feb368f9500 1 -- 172.21.15.44:0/211645796 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x559a85787800 msgr2=0x559a84a3e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.156+0000 7feb368f9500 1 --2- 172.21.15.44:0/211645796 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x559a85787800 0x559a84a3e680 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.156+0000 7feb368f9500 1 -- 172.21.15.44:0/211645796 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559a858a6400 msgr2=0x559a84cea000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.156+0000 7feb368f9500 1 --2- 172.21.15.44:0/211645796 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x559a858a6400 0x559a84cea000 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x559a8576e2a0 tx=0x559a85844cc0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.156+0000 7feb368f9500 1 -- 172.21.15.44:0/211645796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a85787400 msgr2=0x559a84a3ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.156+0000 7feb368f9500 1 --2- 172.21.15.44:0/211645796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a85787400 0x559a84a3ec00 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x559a858982d0 tx=0x559a85844c00 comp rx=0 tx=0).stop 2024-09-13T18:36:00.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.156+0000 7feb350b3700 1 -- 172.21.15.44:0/211645796 reap_dead start 2024-09-13T18:36:00.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.156+0000 7feb368f9500 1 -- 172.21.15.44:0/211645796 shutdown_connections 2024-09-13T18:36:00.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.156+0000 7feb368f9500 1 -- 172.21.15.44:0/211645796 >> 172.21.15.44:0/211645796 conn(0x559a85787000 msgr2=0x559a84a87000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.160+0000 7feb368f9500 1 -- 172.21.15.44:0/211645796 shutdown_connections 2024-09-13T18:36:00.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.160+0000 7feb368f9500 1 -- 172.21.15.44:0/211645796 wait complete. 2024-09-13T18:36:00.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.160+0000 7feb368f9500 1 -- 172.21.15.44:0/1388062481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a84997c00 msgr2=0x559a84a3cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.160+0000 7feb368f9500 1 --2- 172.21.15.44:0/1388062481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a84997c00 0x559a84a3cb00 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x559a8576ec00 tx=0x559a85798d20 comp rx=0 tx=0).stop 2024-09-13T18:36:00.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.160+0000 7feb368f9500 1 -- 172.21.15.44:0/1388062481 shutdown_connections 2024-09-13T18:36:00.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.160+0000 7feb368f9500 1 --2- 172.21.15.44:0/1388062481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559a85786c00 0x559a84a3c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.160+0000 7feb368f9500 1 --2- 172.21.15.44:0/1388062481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a84997c00 0x559a84a3cb00 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.160+0000 7feb368f9500 1 --2- 172.21.15.44:0/1388062481 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x559a85786000 0x559a84a3d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.160+0000 7feb368f9500 1 -- 172.21.15.44:0/1388062481 >> 172.21.15.44:0/1388062481 conn(0x559a84996c00 msgr2=0x559a84a88000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.160+0000 7feb368f9500 1 -- 172.21.15.44:0/1388062481 shutdown_connections 2024-09-13T18:36:00.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.160+0000 7feb368f9500 1 -- 172.21.15.44:0/1388062481 wait complete. 2024-09-13T18:36:00.169 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'session'] in time 0:00:00.069364, result: { "0": { "data": { "sessions": [] }, "result": 0 } } 2024-09-13T18:36:00.170 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show inode 2024-09-13T18:36:00.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e19fce500 1 -- start start 2024-09-13T18:36:00.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e19fce500 1 Processor -- start 2024-09-13T18:36:00.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e19fce500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576e500b800 0x5576e50b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e19fce500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5576e500b400 0x5576e50b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e19fce500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576e500b000 0x5576e50b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e19fce500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576e508c780 con 0x5576e500b800 2024-09-13T18:36:00.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e19fce500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576e508ca00 con 0x5576e500b000 2024-09-13T18:36:00.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e19fce500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5576e508c640 con 0x5576e500b400 2024-09-13T18:36:00.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e18788700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576e500b800 0x5576e50b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e18788700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576e500b800 0x5576e50b0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50470/0 (socket says 172.21.15.44:50470) 2024-09-13T18:36:00.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e18788700 1 -- 172.21.15.44:0/45296743 learned_addr learned my addr 172.21.15.44:0/45296743 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:00.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e17f87700 1 --2- 172.21.15.44:0/45296743 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5576e500b400 0x5576e50b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e18f89700 1 --2- 172.21.15.44:0/45296743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576e500b000 0x5576e50b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e18788700 1 -- 172.21.15.44:0/45296743 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5576e500b400 msgr2=0x5576e50b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e18788700 1 --2- 172.21.15.44:0/45296743 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5576e500b400 0x5576e50b0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e18788700 1 -- 172.21.15.44:0/45296743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576e500b000 msgr2=0x5576e50b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e18788700 1 --2- 172.21.15.44:0/45296743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576e500b000 0x5576e50b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e18788700 1 -- 172.21.15.44:0/45296743 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576e502e9c0 con 0x5576e500b800 2024-09-13T18:36:00.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e18f89700 1 --2- 172.21.15.44:0/45296743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576e500b000 0x5576e50b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:00.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e18788700 1 --2- 172.21.15.44:0/45296743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576e500b800 0x5576e50b0580 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x5576e516ad50 tx=0x5576e5de2c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1120319e6cb2c689 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e15f83700 1 -- 172.21.15.44:0/45296743 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5576e505b080 con 0x5576e500b800 2024-09-13T18:36:00.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e15f83700 1 -- 172.21.15.44:0/45296743 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5576e5df8300 con 0x5576e500b800 2024-09-13T18:36:00.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e15f83700 1 -- 172.21.15.44:0/45296743 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5576e505b600 con 0x5576e500b800 2024-09-13T18:36:00.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e19fce500 1 -- 172.21.15.44:0/45296743 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5576e502e1a0 con 0x5576e500b800 2024-09-13T18:36:00.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e19fce500 1 -- 172.21.15.44:0/45296743 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5576e502e9c0 con 0x5576e500b800 2024-09-13T18:36:00.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e19fce500 4 waiting for MDS map... 2024-09-13T18:36:00.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e15f83700 1 -- 172.21.15.44:0/45296743 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x5576e5044c40 con 0x5576e500b800 2024-09-13T18:36:00.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e15f83700 1 -- 172.21.15.44:0/45296743 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x5576e504cf00 con 0x5576e500b800 2024-09-13T18:36:00.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.204+0000 7f5e19fce500 4 Got MDS map 70 2024-09-13T18:36:00.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.208+0000 7f5e19fce500 10 main: main 2024-09-13T18:36:00.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.208+0000 7f5e19fce500 4 main: connecting to RADOS... 2024-09-13T18:36:00.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.208+0000 7f5e19fce500 1 Processor -- start 2024-09-13T18:36:00.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.208+0000 7f5e19fce500 1 -- start start 2024-09-13T18:36:00.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.208+0000 7f5e19fce500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576e5e94400 0x5576e50b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.208+0000 7f5e19fce500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576e5e94800 0x5576e50b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.208+0000 7f5e19fce500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5576e5e94c00 0x5576e50b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.208+0000 7f5e19fce500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576e5041e00 con 0x5576e5e94400 2024-09-13T18:36:00.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.208+0000 7f5e19fce500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576e508ca00 con 0x5576e5e94800 2024-09-13T18:36:00.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.208+0000 7f5e19fce500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5576e508c780 con 0x5576e5e94c00 2024-09-13T18:36:00.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.208+0000 7f5e18f89700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576e5e94400 0x5576e50b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.208+0000 7f5e18f89700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576e5e94400 0x5576e50b1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50478/0 (socket says 172.21.15.44:50478) 2024-09-13T18:36:00.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.208+0000 7f5e17f87700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5576e5e94c00 0x5576e50b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.208+0000 7f5e18f89700 1 -- 172.21.15.44:0/3388063426 learned_addr learned my addr 172.21.15.44:0/3388063426 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:00.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.208+0000 7f5e18788700 1 --2- 172.21.15.44:0/3388063426 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576e5e94800 0x5576e50b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e18f89700 1 -- 172.21.15.44:0/3388063426 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5576e5e94c00 msgr2=0x5576e50b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e18f89700 1 --2- 172.21.15.44:0/3388063426 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5576e5e94c00 0x5576e50b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e18f89700 1 -- 172.21.15.44:0/3388063426 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576e5e94800 msgr2=0x5576e50b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e18f89700 1 --2- 172.21.15.44:0/3388063426 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576e5e94800 0x5576e50b1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e18f89700 1 -- 172.21.15.44:0/3388063426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576e502eb60 con 0x5576e5e94400 2024-09-13T18:36:00.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e18788700 1 --2- 172.21.15.44:0/3388063426 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576e5e94800 0x5576e50b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:00.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e18f89700 1 --2- 172.21.15.44:0/3388063426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576e5e94400 0x5576e50b1600 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x5576e516c2d0 tx=0x5576e530ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a0520ea858d408 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e13f7f700 1 -- 172.21.15.44:0/3388063426 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5576e505b080 con 0x5576e5e94400 2024-09-13T18:36:00.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e13f7f700 1 -- 172.21.15.44:0/3388063426 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5576e5df8a80 con 0x5576e5e94400 2024-09-13T18:36:00.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e13f7f700 1 -- 172.21.15.44:0/3388063426 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5576e505b600 con 0x5576e5e94400 2024-09-13T18:36:00.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e19fce500 1 -- 172.21.15.44:0/3388063426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576e5e94400 msgr2=0x5576e50b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e19fce500 1 --2- 172.21.15.44:0/3388063426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576e5e94400 0x5576e50b1600 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x5576e516c2d0 tx=0x5576e530ec00 comp rx=0 tx=0).stop 2024-09-13T18:36:00.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e19fce500 1 -- 172.21.15.44:0/3388063426 shutdown_connections 2024-09-13T18:36:00.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e19fce500 1 --2- 172.21.15.44:0/3388063426 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5576e5e94c00 0x5576e50b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e19fce500 1 --2- 172.21.15.44:0/3388063426 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576e5e94800 0x5576e50b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e19fce500 1 --2- 172.21.15.44:0/3388063426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576e5e94400 0x5576e50b1600 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e19fce500 1 -- 172.21.15.44:0/3388063426 >> 172.21.15.44:0/3388063426 conn(0x5576e500ac00 msgr2=0x5576e50fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e19fce500 1 -- 172.21.15.44:0/3388063426 shutdown_connections 2024-09-13T18:36:00.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e19fce500 1 -- 172.21.15.44:0/3388063426 wait complete. 2024-09-13T18:36:00.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e19fce500 1 Processor -- start 2024-09-13T18:36:00.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e19fce500 1 -- start start 2024-09-13T18:36:00.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e19fce500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5576e5e94400 0x5576e50b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e19fce500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576e5e94800 0x5576e50b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e19fce500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576e5e94c00 0x5576e50b2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e19fce500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576e508c500 con 0x5576e5e94800 2024-09-13T18:36:00.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e19fce500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576e508c3c0 con 0x5576e5e94c00 2024-09-13T18:36:00.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e19fce500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5576e508c280 con 0x5576e5e94400 2024-09-13T18:36:00.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e18788700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576e5e94800 0x5576e50b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e18f89700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5576e5e94400 0x5576e50b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e18f89700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5576e5e94400 0x5576e50b3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:43218/0 (socket says 172.21.15.44:43218) 2024-09-13T18:36:00.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.212+0000 7f5e18788700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576e5e94800 0x5576e50b2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50486/0 (socket says 172.21.15.44:50486) 2024-09-13T18:36:00.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.216+0000 7f5e18f89700 1 -- 172.21.15.44:0/1186858916 learned_addr learned my addr 172.21.15.44:0/1186858916 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:00.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.216+0000 7f5e17f87700 1 --2- 172.21.15.44:0/1186858916 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576e5e94c00 0x5576e50b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.216+0000 7f5e18f89700 1 -- 172.21.15.44:0/1186858916 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576e5e94c00 msgr2=0x5576e50b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.216+0000 7f5e18f89700 1 --2- 172.21.15.44:0/1186858916 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576e5e94c00 0x5576e50b2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.216+0000 7f5e18f89700 1 -- 172.21.15.44:0/1186858916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576e5e94800 msgr2=0x5576e50b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.216+0000 7f5e18f89700 1 --2- 172.21.15.44:0/1186858916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576e5e94800 0x5576e50b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.216+0000 7f5e18f89700 1 -- 172.21.15.44:0/1186858916 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576e502e340 con 0x5576e5e94400 2024-09-13T18:36:00.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.216+0000 7f5e18788700 1 --2- 172.21.15.44:0/1186858916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576e5e94800 0x5576e50b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:00.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.216+0000 7f5e18f89700 1 --2- 172.21.15.44:0/1186858916 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5576e5e94400 0x5576e50b3180 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x5576e516cf90 tx=0x5576e50e10e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.216+0000 7f5e1277c700 1 -- 172.21.15.44:0/1186858916 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5576e505adc0 con 0x5576e5e94400 2024-09-13T18:36:00.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.216+0000 7f5e1277c700 1 -- 172.21.15.44:0/1186858916 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5576e5056480 con 0x5576e5e94400 2024-09-13T18:36:00.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.216+0000 7f5e19fce500 1 -- 172.21.15.44:0/1186858916 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5576e502e000 con 0x5576e5e94400 2024-09-13T18:36:00.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.216+0000 7f5e1277c700 1 -- 172.21.15.44:0/1186858916 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5576e505b080 con 0x5576e5e94400 2024-09-13T18:36:00.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.216+0000 7f5e19fce500 1 -- 172.21.15.44:0/1186858916 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5576e502eea0 con 0x5576e5e94400 2024-09-13T18:36:00.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.216+0000 7f5e19fce500 4 main: resolving pool 10 2024-09-13T18:36:00.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.220+0000 7f5e1277c700 1 -- 172.21.15.44:0/1186858916 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x5576e506a840 con 0x5576e5e94400 2024-09-13T18:36:00.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.220+0000 7f5e1277c700 1 --2- 172.21.15.44:0/1186858916 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5576e5380800 0x5576e50b3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.220+0000 7f5e1277c700 1 -- 172.21.15.44:0/1186858916 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x5576e5044a80 con 0x5576e5e94400 2024-09-13T18:36:00.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.220+0000 7f5e19fce500 4 main: creating IoCtx.. 2024-09-13T18:36:00.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.220+0000 7f5e19fce500 1 --2- 172.21.15.44:0/1186858916 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x5576e5e95000 0x5576e50b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.220+0000 7f5e19fce500 1 -- 172.21.15.44:0/1186858916 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:1 10.13 10:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78) v8 -- 0x5576e5e95400 con 0x5576e5e95000 2024-09-13T18:36:00.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.220+0000 7f5e18788700 1 --2- 172.21.15.44:0/1186858916 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5576e5380800 0x5576e50b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.220+0000 7f5e17f87700 1 --2- 172.21.15.44:0/1186858916 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x5576e5e95000 0x5576e50b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.220+0000 7f5e18788700 1 --2- 172.21.15.44:0/1186858916 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5576e5380800 0x5576e50b3700 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x5576e516b260 tx=0x5576e5de2de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.220+0000 7f5e17f87700 1 --2- 172.21.15.44:0/1186858916 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x5576e5e95000 0x5576e50b2100 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.220+0000 7f5e17f87700 1 -- 172.21.15.44:0/1186858916 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv4 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x5576e5e86b40 con 0x5576e5e95000 2024-09-13T18:36:00.230 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:36:00.230 INFO:teuthology.orchestra.run.smithi044.stdout: "0": { 2024-09-13T18:36:00.230 INFO:teuthology.orchestra.run.smithi044.stdout: "data": { 2024-09-13T18:36:00.230 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 1, 2024-09-13T18:36:00.230 INFO:teuthology.orchestra.run.smithi044.stdout: "inotable": { 2024-09-13T18:36:00.230 INFO:teuthology.orchestra.run.smithi044.stdout: "projected_free": [ 2024-09-13T18:36:00.230 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:00.231 INFO:teuthology.orchestra.run.smithi044.stdout: "start": 1099511627776, 2024-09-13T18:36:00.231 INFO:teuthology.orchestra.run.smithi044.stdout: "len": 1099511627776 2024-09-13T18:36:00.231 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:00.231 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-13T18:36:00.231 INFO:teuthology.orchestra.run.smithi044.stdout: "free": [ 2024-09-13T18:36:00.231 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:00.231 INFO:teuthology.orchestra.run.smithi044.stdout: "start": 1099511627776, 2024-09-13T18:36:00.231 INFO:teuthology.orchestra.run.smithi044.stdout: "len": 1099511627776 2024-09-13T18:36:00.231 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:00.231 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-13T18:36:00.231 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:00.231 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:00.231 INFO:teuthology.orchestra.run.smithi044.stdout: "result": 0 2024-09-13T18:36:00.231 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:00.232 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:36:00.232 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:00.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.220+0000 7f5e19fce500 1 -- 172.21.15.44:0/1186858916 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x5576e5e95000 msgr2=0x5576e50b2100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.220+0000 7f5e19fce500 1 --2- 172.21.15.44:0/1186858916 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x5576e5e95000 0x5576e50b2100 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.220+0000 7f5e19fce500 1 -- 172.21.15.44:0/1186858916 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5576e5380800 msgr2=0x5576e50b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.220+0000 7f5e19fce500 1 --2- 172.21.15.44:0/1186858916 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5576e5380800 0x5576e50b3700 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x5576e516b260 tx=0x5576e5de2de0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.220+0000 7f5e19fce500 1 -- 172.21.15.44:0/1186858916 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5576e5e94400 msgr2=0x5576e50b3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.220+0000 7f5e19fce500 1 --2- 172.21.15.44:0/1186858916 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5576e5e94400 0x5576e50b3180 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x5576e516cf90 tx=0x5576e50e10e0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.220+0000 7f5e17f87700 1 -- 172.21.15.44:0/1186858916 reap_dead start 2024-09-13T18:36:00.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.220+0000 7f5e19fce500 1 -- 172.21.15.44:0/1186858916 shutdown_connections 2024-09-13T18:36:00.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.220+0000 7f5e19fce500 1 -- 172.21.15.44:0/1186858916 >> 172.21.15.44:0/1186858916 conn(0x5576e500ac00 msgr2=0x5576e50fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.220+0000 7f5e19fce500 1 -- 172.21.15.44:0/1186858916 shutdown_connections 2024-09-13T18:36:00.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.220+0000 7f5e19fce500 1 -- 172.21.15.44:0/1186858916 wait complete. 2024-09-13T18:36:00.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.224+0000 7f5e19fce500 1 -- 172.21.15.44:0/45296743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576e500b800 msgr2=0x5576e50b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.224+0000 7f5e19fce500 1 --2- 172.21.15.44:0/45296743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576e500b800 0x5576e50b0580 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x5576e516ad50 tx=0x5576e5de2c00 comp rx=0 tx=0).stop 2024-09-13T18:36:00.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.224+0000 7f5e19fce500 1 -- 172.21.15.44:0/45296743 shutdown_connections 2024-09-13T18:36:00.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.224+0000 7f5e19fce500 1 --2- 172.21.15.44:0/45296743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5576e500b000 0x5576e50b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.224+0000 7f5e19fce500 1 --2- 172.21.15.44:0/45296743 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5576e500b400 0x5576e50b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.224+0000 7f5e19fce500 1 --2- 172.21.15.44:0/45296743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576e500b800 0x5576e50b0580 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.224+0000 7f5e19fce500 1 -- 172.21.15.44:0/45296743 >> 172.21.15.44:0/45296743 conn(0x5576e500bc00 msgr2=0x5576e50fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.224+0000 7f5e19fce500 1 -- 172.21.15.44:0/45296743 shutdown_connections 2024-09-13T18:36:00.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.224+0000 7f5e19fce500 1 -- 172.21.15.44:0/45296743 wait complete. 2024-09-13T18:36:00.235 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'inode'] in time 0:00:00.065421, result: { "0": { "data": { "version": 1, "inotable": { "projected_free": [ { "start": 1099511627776, "len": 1099511627776 } ], "free": [ { "start": 1099511627776, "len": 1099511627776 } ] } }, "result": 0 } } 2024-09-13T18:36:00.235 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show snap 2024-09-13T18:36:00.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.268+0000 7f9854132500 1 -- start start 2024-09-13T18:36:00.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.268+0000 7f9854132500 1 Processor -- start 2024-09-13T18:36:00.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.268+0000 7f9854132500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3634eb800 0x55e363590580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.268+0000 7f9854132500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3634eb400 0x55e363590b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.268+0000 7f9854132500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e3634eb000 0x55e363591080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.268+0000 7f9854132500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e36356ca00 con 0x55e3634eb800 2024-09-13T18:36:00.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.268+0000 7f9854132500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e36356c780 con 0x55e3634eb400 2024-09-13T18:36:00.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.268+0000 7f9854132500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e36356c640 con 0x55e3634eb000 2024-09-13T18:36:00.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.268+0000 7f98528ec700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3634eb800 0x55e363590580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.268+0000 7f98530ed700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e3634eb000 0x55e363591080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.268+0000 7f98528ec700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3634eb800 0x55e363590580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50500/0 (socket says 172.21.15.44:50500) 2024-09-13T18:36:00.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.268+0000 7f98528ec700 1 -- 172.21.15.44:0/4098181296 learned_addr learned my addr 172.21.15.44:0/4098181296 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:00.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.268+0000 7f98520eb700 1 --2- 172.21.15.44:0/4098181296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3634eb400 0x55e363590b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.268+0000 7f98528ec700 1 -- 172.21.15.44:0/4098181296 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e3634eb000 msgr2=0x55e363591080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.268+0000 7f98528ec700 1 --2- 172.21.15.44:0/4098181296 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e3634eb000 0x55e363591080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.268+0000 7f98528ec700 1 -- 172.21.15.44:0/4098181296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3634eb400 msgr2=0x55e363590b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.268+0000 7f98528ec700 1 --2- 172.21.15.44:0/4098181296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3634eb400 0x55e363590b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.272+0000 7f98528ec700 1 -- 172.21.15.44:0/4098181296 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e36350e9c0 con 0x55e3634eb800 2024-09-13T18:36:00.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.272+0000 7f98530ed700 1 --2- 172.21.15.44:0/4098181296 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e3634eb000 0x55e363591080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:00.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.272+0000 7f98520eb700 1 --2- 172.21.15.44:0/4098181296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3634eb400 0x55e363590b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:00.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.272+0000 7f98528ec700 1 --2- 172.21.15.44:0/4098181296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3634eb800 0x55e363590580 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x55e363648e10 tx=0x55e36436e480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dacbbe628154e0e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.272+0000 7f98500e7700 1 -- 172.21.15.44:0/4098181296 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e36353b600 con 0x55e3634eb800 2024-09-13T18:36:00.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.272+0000 7f98500e7700 1 -- 172.21.15.44:0/4098181296 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e363536480 con 0x55e3634eb800 2024-09-13T18:36:00.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.272+0000 7f98500e7700 1 -- 172.21.15.44:0/4098181296 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e36353b1e0 con 0x55e3634eb800 2024-09-13T18:36:00.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.272+0000 7f9854132500 1 -- 172.21.15.44:0/4098181296 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e36350eb60 con 0x55e3634eb800 2024-09-13T18:36:00.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.272+0000 7f9854132500 1 -- 172.21.15.44:0/4098181296 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55e36350e340 con 0x55e3634eb800 2024-09-13T18:36:00.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.272+0000 7f9854132500 4 waiting for MDS map... 2024-09-13T18:36:00.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.272+0000 7f98500e7700 1 -- 172.21.15.44:0/4098181296 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x55e363524c40 con 0x55e3634eb800 2024-09-13T18:36:00.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.272+0000 7f98500e7700 1 -- 172.21.15.44:0/4098181296 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x55e364370900 con 0x55e3634eb800 2024-09-13T18:36:00.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.272+0000 7f9854132500 4 Got MDS map 70 2024-09-13T18:36:00.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.272+0000 7f9854132500 10 main: main 2024-09-13T18:36:00.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.272+0000 7f9854132500 4 main: connecting to RADOS... 2024-09-13T18:36:00.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.272+0000 7f9854132500 1 Processor -- start 2024-09-13T18:36:00.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.276+0000 7f9854132500 1 -- start start 2024-09-13T18:36:00.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.276+0000 7f9854132500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e3637e4c00 0x55e363591600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.276+0000 7f9854132500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3637e5000 0x55e363591b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.276+0000 7f9854132500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3637e5400 0x55e363592100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.276+0000 7f9854132500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e363521e00 con 0x55e3637e5000 2024-09-13T18:36:00.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.276+0000 7f9854132500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e36356c780 con 0x55e3637e5400 2024-09-13T18:36:00.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.276+0000 7f9854132500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e36356c500 con 0x55e3637e4c00 2024-09-13T18:36:00.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.276+0000 7f98528ec700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3637e5000 0x55e363591b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.276+0000 7f98528ec700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3637e5000 0x55e363591b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50502/0 (socket says 172.21.15.44:50502) 2024-09-13T18:36:00.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.276+0000 7f98530ed700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e3637e4c00 0x55e363591600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.276+0000 7f98528ec700 1 -- 172.21.15.44:0/1096236655 learned_addr learned my addr 172.21.15.44:0/1096236655 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:00.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.276+0000 7f98520eb700 1 --2- 172.21.15.44:0/1096236655 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3637e5400 0x55e363592100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.284 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:36:00.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.276+0000 7f98528ec700 1 -- 172.21.15.44:0/1096236655 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e3637e4c00 msgr2=0x55e363591600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.276+0000 7f98528ec700 1 --2- 172.21.15.44:0/1096236655 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e3637e4c00 0x55e363591600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.276+0000 7f98528ec700 1 -- 172.21.15.44:0/1096236655 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3637e5400 msgr2=0x55e363592100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.276+0000 7f98528ec700 1 --2- 172.21.15.44:0/1096236655 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3637e5400 0x55e363592100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.276+0000 7f98528ec700 1 -- 172.21.15.44:0/1096236655 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e36350e000 con 0x55e3637e5000 2024-09-13T18:36:00.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.276+0000 7f98528ec700 1 --2- 172.21.15.44:0/1096236655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3637e5000 0x55e363591b80 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x55e3638460c0 tx=0x55e3635c1020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a62d037f1486ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.276+0000 7f984e0e3700 1 -- 172.21.15.44:0/1096236655 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e36353af20 con 0x55e3637e5000 2024-09-13T18:36:00.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.276+0000 7f984e0e3700 1 -- 172.21.15.44:0/1096236655 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e3642d4a80 con 0x55e3637e5000 2024-09-13T18:36:00.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.276+0000 7f984e0e3700 1 -- 172.21.15.44:0/1096236655 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e36353b600 con 0x55e3637e5000 2024-09-13T18:36:00.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f9854132500 1 -- 172.21.15.44:0/1096236655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3637e5000 msgr2=0x55e363591b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f9854132500 1 --2- 172.21.15.44:0/1096236655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3637e5000 0x55e363591b80 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x55e3638460c0 tx=0x55e3635c1020 comp rx=0 tx=0).stop 2024-09-13T18:36:00.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f9854132500 1 -- 172.21.15.44:0/1096236655 shutdown_connections 2024-09-13T18:36:00.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f9854132500 1 --2- 172.21.15.44:0/1096236655 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3637e5400 0x55e363592100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f9854132500 1 --2- 172.21.15.44:0/1096236655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3637e5000 0x55e363591b80 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f9854132500 1 --2- 172.21.15.44:0/1096236655 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e3637e4c00 0x55e363591600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f9854132500 1 -- 172.21.15.44:0/1096236655 >> 172.21.15.44:0/1096236655 conn(0x55e3634eac00 msgr2=0x55e3635db800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f9854132500 1 -- 172.21.15.44:0/1096236655 shutdown_connections 2024-09-13T18:36:00.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f9854132500 1 -- 172.21.15.44:0/1096236655 wait complete. 2024-09-13T18:36:00.288 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:36:00.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f9854132500 1 Processor -- start 2024-09-13T18:36:00.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f9854132500 1 -- start start 2024-09-13T18:36:00.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f9854132500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3637e4c00 0x55e363593180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f9854132500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3637e5000 0x55e363592c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f9854132500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e3637e5400 0x55e363592680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f9854132500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e36356c3c0 con 0x55e3637e4c00 2024-09-13T18:36:00.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f9854132500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e36356c280 con 0x55e3637e5000 2024-09-13T18:36:00.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f9854132500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e36356c140 con 0x55e3637e5400 2024-09-13T18:36:00.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f98530ed700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3637e4c00 0x55e363593180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f98520eb700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e3637e5400 0x55e363592680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f98520eb700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e3637e5400 0x55e363592680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:43250/0 (socket says 172.21.15.44:43250) 2024-09-13T18:36:00.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f98520eb700 1 -- 172.21.15.44:0/793814229 learned_addr learned my addr 172.21.15.44:0/793814229 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:00.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f98530ed700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3637e4c00 0x55e363593180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50518/0 (socket says 172.21.15.44:50518) 2024-09-13T18:36:00.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f98528ec700 1 --2- 172.21.15.44:0/793814229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3637e5000 0x55e363592c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f98520eb700 1 -- 172.21.15.44:0/793814229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3637e5000 msgr2=0x55e363592c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f98520eb700 1 --2- 172.21.15.44:0/793814229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3637e5000 0x55e363592c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f98520eb700 1 -- 172.21.15.44:0/793814229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3637e4c00 msgr2=0x55e363593180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f98520eb700 1 --2- 172.21.15.44:0/793814229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3637e4c00 0x55e363593180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f98520eb700 1 -- 172.21.15.44:0/793814229 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e36350e9c0 con 0x55e3637e5400 2024-09-13T18:36:00.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.280+0000 7f98530ed700 1 --2- 172.21.15.44:0/793814229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3637e4c00 0x55e363593180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:00.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.284+0000 7f98520eb700 1 --2- 172.21.15.44:0/793814229 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e3637e5400 0x55e363592680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55e363847440 tx=0x55e363848660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.284+0000 7f984c8e0700 1 -- 172.21.15.44:0/793814229 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e36353af20 con 0x55e3637e5400 2024-09-13T18:36:00.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.284+0000 7f984c8e0700 1 -- 172.21.15.44:0/793814229 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e3642d5800 con 0x55e3637e5400 2024-09-13T18:36:00.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.284+0000 7f9854132500 1 -- 172.21.15.44:0/793814229 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e36350eb60 con 0x55e3637e5400 2024-09-13T18:36:00.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.284+0000 7f984c8e0700 1 -- 172.21.15.44:0/793814229 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e36353b600 con 0x55e3637e5400 2024-09-13T18:36:00.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.284+0000 7f9854132500 1 -- 172.21.15.44:0/793814229 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e36350e340 con 0x55e3637e5400 2024-09-13T18:36:00.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.284+0000 7f9854132500 4 main: resolving pool 10 2024-09-13T18:36:00.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.284+0000 7f984c8e0700 1 -- 172.21.15.44:0/793814229 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x55e36354a840 con 0x55e3637e5400 2024-09-13T18:36:00.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.284+0000 7f984c8e0700 1 --2- 172.21.15.44:0/793814229 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55e363859000 0x55e363593700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.284+0000 7f984c8e0700 1 -- 172.21.15.44:0/793814229 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x55e363524a80 con 0x55e3637e5400 2024-09-13T18:36:00.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.284+0000 7f9854132500 4 main: creating IoCtx.. 2024-09-13T18:36:00.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.284+0000 7f9854132500 1 --2- 172.21.15.44:0/793814229 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55e3637e5800 0x55e363592100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.284+0000 7f98530ed700 1 --2- 172.21.15.44:0/793814229 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55e363859000 0x55e363593700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.284+0000 7f9854132500 1 -- 172.21.15.44:0/793814229 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- osd_op(unknown.0.0:1 10.d 10:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78) v8 -- 0x55e3637e5c00 con 0x55e3637e5800 2024-09-13T18:36:00.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f98528ec700 1 --2- 172.21.15.44:0/793814229 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55e3637e5800 0x55e363592100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f98528ec700 1 --2- 172.21.15.44:0/793814229 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55e3637e5800 0x55e363592100 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f98530ed700 1 --2- 172.21.15.44:0/793814229 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55e363859000 0x55e363593700 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x55e3635418f0 tx=0x55e363848120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f98528ec700 1 -- 172.21.15.44:0/793814229 <== osd.6 v2:172.21.15.99:6808/2907584318 1 ==== osd_op_reply(1 mds_snaptable [read 0~70 out=70b] v0'0 uv2 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x55e363650b40 con 0x55e3637e5800 2024-09-13T18:36:00.296 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:36:00.296 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 1, 2024-09-13T18:36:00.296 INFO:teuthology.orchestra.run.smithi044.stdout: "snapserver": { 2024-09-13T18:36:00.296 INFO:teuthology.orchestra.run.smithi044.stdout: "last_snap": 1, 2024-09-13T18:36:00.297 INFO:teuthology.orchestra.run.smithi044.stdout: "last_created": 1, 2024-09-13T18:36:00.297 INFO:teuthology.orchestra.run.smithi044.stdout: "last_destroyed": 1, 2024-09-13T18:36:00.297 INFO:teuthology.orchestra.run.smithi044.stdout: "pending_noop": [], 2024-09-13T18:36:00.297 INFO:teuthology.orchestra.run.smithi044.stdout: "snaps": [], 2024-09-13T18:36:00.297 INFO:teuthology.orchestra.run.smithi044.stdout: "need_to_purge": {}, 2024-09-13T18:36:00.297 INFO:teuthology.orchestra.run.smithi044.stdout: "pending_update": [], 2024-09-13T18:36:00.297 INFO:teuthology.orchestra.run.smithi044.stdout: "pending_destroy": [] 2024-09-13T18:36:00.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:00.297 INFO:teuthology.orchestra.run.smithi044.stdout: "result": 0 2024-09-13T18:36:00.297 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:36:00.297 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:00.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f9854132500 1 -- 172.21.15.44:0/793814229 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55e3637e5800 msgr2=0x55e363592100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f9854132500 1 --2- 172.21.15.44:0/793814229 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x55e3637e5800 0x55e363592100 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f9854132500 1 -- 172.21.15.44:0/793814229 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55e363859000 msgr2=0x55e363593700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f9854132500 1 --2- 172.21.15.44:0/793814229 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55e363859000 0x55e363593700 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x55e3635418f0 tx=0x55e363848120 comp rx=0 tx=0).stop 2024-09-13T18:36:00.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f9854132500 1 -- 172.21.15.44:0/793814229 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e3637e5400 msgr2=0x55e363592680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f9854132500 1 --2- 172.21.15.44:0/793814229 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e3637e5400 0x55e363592680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55e363847440 tx=0x55e363848660 comp rx=0 tx=0).stop 2024-09-13T18:36:00.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f98520eb700 1 -- 172.21.15.44:0/793814229 reap_dead start 2024-09-13T18:36:00.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f9854132500 1 -- 172.21.15.44:0/793814229 shutdown_connections 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f9854132500 1 -- 172.21.15.44:0/793814229 >> 172.21.15.44:0/793814229 conn(0x55e3634eac00 msgr2=0x55e3635db800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f9854132500 1 -- 172.21.15.44:0/793814229 shutdown_connections 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f9854132500 1 -- 172.21.15.44:0/793814229 wait complete. 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f9854132500 1 -- 172.21.15.44:0/4098181296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3634eb800 msgr2=0x55e363590580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f9854132500 1 --2- 172.21.15.44:0/4098181296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3634eb800 0x55e363590580 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x55e363648e10 tx=0x55e36436e480 comp rx=0 tx=0).stop 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f9854132500 1 -- 172.21.15.44:0/4098181296 shutdown_connections 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f9854132500 1 --2- 172.21.15.44:0/4098181296 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55e3634eb000 0x55e363591080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f9854132500 1 --2- 172.21.15.44:0/4098181296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3634eb400 0x55e363590b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f9854132500 1 --2- 172.21.15.44:0/4098181296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3634eb800 0x55e363590580 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f9854132500 1 -- 172.21.15.44:0/4098181296 >> 172.21.15.44:0/4098181296 conn(0x55e3634ebc00 msgr2=0x55e3635db000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f9854132500 1 -- 172.21.15.44:0/4098181296 shutdown_connections 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.288+0000 7f9854132500 1 -- 172.21.15.44:0/4098181296 wait complete. 2024-09-13T18:36:00.301 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'snap'] in time 0:00:00.066008, result: { "version": 1, "snapserver": { "last_snap": 1, "last_created": 1, "last_destroyed": 1, "pending_noop": [], "snaps": [], "need_to_purge": {}, "pending_update": [], "pending_destroy": [] }, "result": 0 } 2024-09-13T18:36:00.301 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:36:00.302 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:36:00.398 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:36:00.419 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:36:00.419 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:36:00.419 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:00.427 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:00.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.584+0000 7f40c7fff700 1 Processor -- start 2024-09-13T18:36:00.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.584+0000 7f40c7fff700 1 -- start start 2024-09-13T18:36:00.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40c7fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f40c80b3ae0 0x7f40c8165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40c7fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40c8161290 0x7f40c8161700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40c7fff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c8071f30 con 0x7f40c8160eb0 2024-09-13T18:36:00.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40c7fff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c81622e0 con 0x7f40c80b3ae0 2024-09-13T18:36:00.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40c7fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c8162000 con 0x7f40c8161290 2024-09-13T18:36:00.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40bffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f40c80b3ae0 0x7f40c8165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40bffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f40c80b3ae0 0x7f40c8165590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50530/0 (socket says 172.21.15.44:50530) 2024-09-13T18:36:00.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40bffff700 1 -- 172.21.15.44:0/1667848301 learned_addr learned my addr 172.21.15.44:0/1667848301 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:00.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40c77fe700 1 --2- 172.21.15.44:0/1667848301 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40c8161290 0x7f40c8161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40bffff700 1 -- 172.21.15.44:0/1667848301 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40c8161290 msgr2=0x7f40c8161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40bffff700 1 --2- 172.21.15.44:0/1667848301 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40c8161290 0x7f40c8161700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40bffff700 1 -- 172.21.15.44:0/1667848301 >> v1:172.21.15.99:6789/0 conn(0x7f40c8160eb0 legacy=0x7f40c80b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40bffff700 1 -- 172.21.15.44:0/1667848301 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c8164ab0 con 0x7f40c80b3ae0 2024-09-13T18:36:00.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40c77fe700 1 --2- 172.21.15.44:0/1667848301 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40c8161290 0x7f40c8161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:00.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40bffff700 1 --2- 172.21.15.44:0/1667848301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40c80b3ae0 0x7f40c8165590 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f40b0009910 tx=0x7f40b0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60dda5a06bd46bda server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40c67fc700 1 -- 172.21.15.44:0/1667848301 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b0004230 con 0x7f40c80b3ae0 2024-09-13T18:36:00.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40c67fc700 1 -- 172.21.15.44:0/1667848301 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b0004390 con 0x7f40c80b3ae0 2024-09-13T18:36:00.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40c67fc700 1 -- 172.21.15.44:0/1667848301 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b0009e60 con 0x7f40c80b3ae0 2024-09-13T18:36:00.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40c7fff700 1 -- 172.21.15.44:0/1667848301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40c80b3ae0 msgr2=0x7f40c8165590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40c7fff700 1 --2- 172.21.15.44:0/1667848301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40c80b3ae0 0x7f40c8165590 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f40b0009910 tx=0x7f40b0009c20 comp rx=0 tx=0).stop 2024-09-13T18:36:00.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40c7fff700 1 -- 172.21.15.44:0/1667848301 shutdown_connections 2024-09-13T18:36:00.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40c7fff700 1 --2- 172.21.15.44:0/1667848301 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40c8161290 0x7f40c8161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40c7fff700 1 --2- 172.21.15.44:0/1667848301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40c80b3ae0 0x7f40c8165590 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40c7fff700 1 -- 172.21.15.44:0/1667848301 >> 172.21.15.44:0/1667848301 conn(0x7f40c80b0f00 msgr2=0x7f40c80b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40c7fff700 1 -- 172.21.15.44:0/1667848301 shutdown_connections 2024-09-13T18:36:00.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.588+0000 7f40c7fff700 1 -- 172.21.15.44:0/1667848301 wait complete. 2024-09-13T18:36:00.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.592+0000 7f40c7fff700 1 Processor -- start 2024-09-13T18:36:00.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.592+0000 7f40c7fff700 1 -- start start 2024-09-13T18:36:00.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.592+0000 7f40c7fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40c80b3ae0 0x7f40c814fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.592+0000 7f40c7fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40c8160eb0 0x7f40c815baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.592+0000 7f40c7fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40c8161290 0x7f40c806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.592+0000 7f40c7fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c814ffa0 con 0x7f40c8160eb0 2024-09-13T18:36:00.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.592+0000 7f40c7fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c815aa50 con 0x7f40c8161290 2024-09-13T18:36:00.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.592+0000 7f40c7fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c815ad30 con 0x7f40c80b3ae0 2024-09-13T18:36:00.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.592+0000 7f40bffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40c8160eb0 0x7f40c815baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.592+0000 7f40bffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40c8160eb0 0x7f40c815baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50546/0 (socket says 172.21.15.44:50546) 2024-09-13T18:36:00.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.592+0000 7f40bffff700 1 -- 172.21.15.44:0/3254434009 learned_addr learned my addr 172.21.15.44:0/3254434009 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:00.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.592+0000 7f40c77fe700 1 --2- 172.21.15.44:0/3254434009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40c8161290 0x7f40c806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.592+0000 7f40c6ffd700 1 --2- 172.21.15.44:0/3254434009 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40c80b3ae0 0x7f40c814fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.592+0000 7f40bffff700 1 -- 172.21.15.44:0/3254434009 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40c80b3ae0 msgr2=0x7f40c814fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.592+0000 7f40bffff700 1 --2- 172.21.15.44:0/3254434009 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40c80b3ae0 0x7f40c814fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.592+0000 7f40bffff700 1 -- 172.21.15.44:0/3254434009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40c8161290 msgr2=0x7f40c806b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.592+0000 7f40bffff700 1 --2- 172.21.15.44:0/3254434009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40c8161290 0x7f40c806b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.592+0000 7f40bffff700 1 -- 172.21.15.44:0/3254434009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b0009570 con 0x7f40c8160eb0 2024-09-13T18:36:00.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.592+0000 7f40bffff700 1 --2- 172.21.15.44:0/3254434009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40c8160eb0 0x7f40c815baf0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f40b0004000 tx=0x7f40b0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.596+0000 7f40bf7fe700 1 -- 172.21.15.44:0/3254434009 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b000bbd0 con 0x7f40c8160eb0 2024-09-13T18:36:00.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.596+0000 7f40bf7fe700 1 -- 172.21.15.44:0/3254434009 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b001f070 con 0x7f40c8160eb0 2024-09-13T18:36:00.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.596+0000 7f40c7fff700 1 -- 172.21.15.44:0/3254434009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c815b010 con 0x7f40c8160eb0 2024-09-13T18:36:00.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.596+0000 7f40bf7fe700 1 -- 172.21.15.44:0/3254434009 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b00036c0 con 0x7f40c8160eb0 2024-09-13T18:36:00.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.596+0000 7f40c7fff700 1 -- 172.21.15.44:0/3254434009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c815b5d0 con 0x7f40c8160eb0 2024-09-13T18:36:00.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.596+0000 7f40c7fff700 1 -- 172.21.15.44:0/3254434009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c815b7f0 con 0x7f40c8160eb0 2024-09-13T18:36:00.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.596+0000 7f40bf7fe700 1 -- 172.21.15.44:0/3254434009 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f40b0021030 con 0x7f40c8160eb0 2024-09-13T18:36:00.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.596+0000 7f40bf7fe700 1 --2- 172.21.15.44:0/3254434009 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f40a8066730 0x7f40a8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.596+0000 7f40bf7fe700 1 -- 172.21.15.44:0/3254434009 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40b00855f0 con 0x7f40c8160eb0 2024-09-13T18:36:00.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.596+0000 7f40c6ffd700 1 --2- 172.21.15.44:0/3254434009 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f40a8066730 0x7f40a8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.600+0000 7f40c6ffd700 1 --2- 172.21.15.44:0/3254434009 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f40a8066730 0x7f40a8068bf0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f40b8005150 tx=0x7f40b8007ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.604+0000 7f40bf7fe700 1 -- 172.21.15.44:0/3254434009 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f40b00529f0 con 0x7f40c8160eb0 2024-09-13T18:36:00.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.780+0000 7f40c7fff700 1 -- 172.21.15.44:0/3254434009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40c815b7f0 con 0x7f40c8160eb0 2024-09-13T18:36:00.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.780+0000 7f40bf7fe700 1 -- 172.21.15.44:0/3254434009 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16508 (secure 0 0 0) 0x7f40b0056010 con 0x7f40c8160eb0 2024-09-13T18:36:00.789 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:00.789 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":78,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:35:46.845184+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:44.271295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:44.844157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:00.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.784+0000 7f40c7fff700 1 -- 172.21.15.44:0/3254434009 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f40a8066730 msgr2=0x7f40a8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.784+0000 7f40c7fff700 1 --2- 172.21.15.44:0/3254434009 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f40a8066730 0x7f40a8068bf0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f40b8005150 tx=0x7f40b8007ee0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.784+0000 7f40c7fff700 1 -- 172.21.15.44:0/3254434009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40c8160eb0 msgr2=0x7f40c815baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.784+0000 7f40c7fff700 1 --2- 172.21.15.44:0/3254434009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40c8160eb0 0x7f40c815baf0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f40b0004000 tx=0x7f40b0004770 comp rx=0 tx=0).stop 2024-09-13T18:36:00.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.784+0000 7f40c7fff700 1 -- 172.21.15.44:0/3254434009 shutdown_connections 2024-09-13T18:36:00.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.784+0000 7f40c7fff700 1 --2- 172.21.15.44:0/3254434009 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f40a8066730 0x7f40a8068bf0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.784+0000 7f40c7fff700 1 --2- 172.21.15.44:0/3254434009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40c8161290 0x7f40c806b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.784+0000 7f40c7fff700 1 --2- 172.21.15.44:0/3254434009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40c8160eb0 0x7f40c815baf0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.784+0000 7f40c7fff700 1 --2- 172.21.15.44:0/3254434009 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40c80b3ae0 0x7f40c814fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.784+0000 7f40c7fff700 1 -- 172.21.15.44:0/3254434009 >> 172.21.15.44:0/3254434009 conn(0x7f40c80b0f00 msgr2=0x7f40c8070280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.784+0000 7f40c7fff700 1 -- 172.21.15.44:0/3254434009 shutdown_connections 2024-09-13T18:36:00.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.784+0000 7f40c7fff700 1 -- 172.21.15.44:0/3254434009 wait complete. 2024-09-13T18:36:00.804 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:35:44.271295+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:35:44.844157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:36:00.804 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:36:00.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.920+0000 7fbdb51f6700 1 Processor -- start 2024-09-13T18:36:00.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.920+0000 7fbdb51f6700 1 -- start start 2024-09-13T18:36:00.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.920+0000 7fbdb51f6700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbdb0159550 0x7fbdb006b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.920+0000 7fbdb51f6700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbdb015deb0 0x7fbdb015b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.920+0000 7fbdb51f6700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb006d120 con 0x7fbdb015d330 2024-09-13T18:36:00.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.920+0000 7fbdb51f6700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb006bc20 con 0x7fbdb0159550 2024-09-13T18:36:00.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.920+0000 7fbdb51f6700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb006bf00 con 0x7fbdb015deb0 2024-09-13T18:36:00.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.920+0000 7fbdaf7fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fbdb015d330 0x7fbdb015d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43382/0 (socket says 172.21.15.44:43382) 2024-09-13T18:36:00.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.920+0000 7fbdaf7fe700 1 -- 172.21.15.44:0/2791071094 learned_addr learned my addr 172.21.15.44:0/2791071094 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:00.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.920+0000 7fbdb49f5700 1 --2- 172.21.15.44:0/2791071094 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbdb015deb0 0x7fbdb015b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.920+0000 7fbdaffff700 1 --2- 172.21.15.44:0/2791071094 >> v2:172.21.15.99:3300/0 conn(0x7fbdb0159550 0x7fbdb006b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.920+0000 7fbdb49f5700 1 -- 172.21.15.44:0/2791071094 >> v2:172.21.15.99:3300/0 conn(0x7fbdb0159550 msgr2=0x7fbdb006b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.920+0000 7fbdb49f5700 1 --2- 172.21.15.44:0/2791071094 >> v2:172.21.15.99:3300/0 conn(0x7fbdb0159550 0x7fbdb006b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.920+0000 7fbdb49f5700 1 -- 172.21.15.44:0/2791071094 >> v1:172.21.15.44:6789/0 conn(0x7fbdb015d330 legacy=0x7fbdb015d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.920+0000 7fbdaeffd700 1 -- 172.21.15.44:0/2791071094 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1444155959 0 0) 0x7fbdb006d120 con 0x7fbdb015d330 2024-09-13T18:36:00.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.920+0000 7fbdb49f5700 1 -- 172.21.15.44:0/2791071094 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb006c1e0 con 0x7fbdb015deb0 2024-09-13T18:36:00.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.920+0000 7fbdb49f5700 1 --2- 172.21.15.44:0/2791071094 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbdb015deb0 0x7fbdb015b4c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009d90 tx=0x7fbda800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5a23d2f263817cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.920+0000 7fbdaeffd700 1 -- 172.21.15.44:0/2791071094 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda800bd20 con 0x7fbdb015deb0 2024-09-13T18:36:00.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.920+0000 7fbdaeffd700 1 -- 172.21.15.44:0/2791071094 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda800be80 con 0x7fbdb015deb0 2024-09-13T18:36:00.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.920+0000 7fbdaeffd700 1 -- 172.21.15.44:0/2791071094 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda80116a0 con 0x7fbdb015deb0 2024-09-13T18:36:00.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.924+0000 7fbdb51f6700 1 -- 172.21.15.44:0/2791071094 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbdb015deb0 msgr2=0x7fbdb015b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.924+0000 7fbdb51f6700 1 --2- 172.21.15.44:0/2791071094 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbdb015deb0 0x7fbdb015b4c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009d90 tx=0x7fbda800b330 comp rx=0 tx=0).stop 2024-09-13T18:36:00.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.924+0000 7fbdb51f6700 1 -- 172.21.15.44:0/2791071094 shutdown_connections 2024-09-13T18:36:00.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.924+0000 7fbdb51f6700 1 --2- 172.21.15.44:0/2791071094 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbdb015deb0 0x7fbdb015b4c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.924+0000 7fbdb51f6700 1 --2- 172.21.15.44:0/2791071094 >> v2:172.21.15.99:3300/0 conn(0x7fbdb0159550 0x7fbdb006b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.924+0000 7fbdb51f6700 1 -- 172.21.15.44:0/2791071094 >> 172.21.15.44:0/2791071094 conn(0x7fbdb00cf000 msgr2=0x7fbdb00cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.924+0000 7fbdb51f6700 1 -- 172.21.15.44:0/2791071094 shutdown_connections 2024-09-13T18:36:00.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.924+0000 7fbdb51f6700 1 -- 172.21.15.44:0/2791071094 wait complete. 2024-09-13T18:36:00.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.924+0000 7fbdb51f6700 1 Processor -- start 2024-09-13T18:36:00.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.924+0000 7fbdb51f6700 1 -- start start 2024-09-13T18:36:00.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdb51f6700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbdb0159550 0x7fbdb0149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdb51f6700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdb015d330 0x7fbdb00ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdb51f6700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdb015deb0 0x7fbdb00b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdb51f6700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb014a010 con 0x7fbdb015deb0 2024-09-13T18:36:00.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdb51f6700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb00acda0 con 0x7fbdb015d330 2024-09-13T18:36:00.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdb51f6700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb00ad080 con 0x7fbdb0159550 2024-09-13T18:36:00.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdb49f5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdb015deb0 0x7fbdb00b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdb49f5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdb015deb0 0x7fbdb00b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50548/0 (socket says 172.21.15.44:50548) 2024-09-13T18:36:00.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdb49f5700 1 -- 172.21.15.44:0/1969315607 learned_addr learned my addr 172.21.15.44:0/1969315607 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:00.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdaffff700 1 --2- 172.21.15.44:0/1969315607 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbdb0159550 0x7fbdb0149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdaf7fe700 1 --2- 172.21.15.44:0/1969315607 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdb015d330 0x7fbdb00ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdaffff700 1 -- 172.21.15.44:0/1969315607 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdb015d330 msgr2=0x7fbdb00ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdaffff700 1 --2- 172.21.15.44:0/1969315607 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdb015d330 0x7fbdb00ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdaffff700 1 -- 172.21.15.44:0/1969315607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdb015deb0 msgr2=0x7fbdb00b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdaffff700 1 --2- 172.21.15.44:0/1969315607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdb015deb0 0x7fbdb00b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdaffff700 1 -- 172.21.15.44:0/1969315607 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda8009a70 con 0x7fbdb0159550 2024-09-13T18:36:00.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdb49f5700 1 --2- 172.21.15.44:0/1969315607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdb015deb0 0x7fbdb00b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:00.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdaffff700 1 --2- 172.21.15.44:0/1969315607 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbdb0159550 0x7fbdb0149ad0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbda000e8e0 tx=0x7fbda000ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdacff9700 1 -- 172.21.15.44:0/1969315607 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda0013680 con 0x7fbdb0159550 2024-09-13T18:36:00.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdacff9700 1 -- 172.21.15.44:0/1969315607 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda00137e0 con 0x7fbdb0159550 2024-09-13T18:36:00.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdb51f6700 1 -- 172.21.15.44:0/1969315607 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb00ad360 con 0x7fbdb0159550 2024-09-13T18:36:00.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdacff9700 1 -- 172.21.15.44:0/1969315607 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda0013b90 con 0x7fbdb0159550 2024-09-13T18:36:00.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdb51f6700 1 -- 172.21.15.44:0/1969315607 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb00ad920 con 0x7fbdb0159550 2024-09-13T18:36:00.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.928+0000 7fbdb51f6700 1 -- 172.21.15.44:0/1969315607 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb00b4870 con 0x7fbdb0159550 2024-09-13T18:36:00.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.932+0000 7fbdacff9700 1 -- 172.21.15.44:0/1969315607 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbda0013cf0 con 0x7fbdb0159550 2024-09-13T18:36:00.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.932+0000 7fbdacff9700 1 --2- 172.21.15.44:0/1969315607 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbd9c066760 0x7fbd9c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.932+0000 7fbdacff9700 1 -- 172.21.15.44:0/1969315607 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbda0084170 con 0x7fbdb0159550 2024-09-13T18:36:00.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.932+0000 7fbdaf7fe700 1 --2- 172.21.15.44:0/1969315607 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbd9c066760 0x7fbd9c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.932+0000 7fbdaf7fe700 1 --2- 172.21.15.44:0/1969315607 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbd9c066760 0x7fbd9c068c20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fbdb014d480 tx=0x7fbda4007e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:00.940+0000 7fbdacff9700 1 -- 172.21.15.44:0/1969315607 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbda0051450 con 0x7fbdb0159550 2024-09-13T18:36:01.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.112+0000 7fbdb51f6700 1 -- 172.21.15.44:0/1969315607 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbdb00adb10 con 0x7fbdb0159550 2024-09-13T18:36:01.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.112+0000 7fbdacff9700 1 -- 172.21.15.44:0/1969315607 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbda0059e60 con 0x7fbdb0159550 2024-09-13T18:36:01.120 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:36:01.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.116+0000 7fbdb51f6700 1 -- 172.21.15.44:0/1969315607 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbd9c066760 msgr2=0x7fbd9c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:01.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.116+0000 7fbdb51f6700 1 --2- 172.21.15.44:0/1969315607 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbd9c066760 0x7fbd9c068c20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fbdb014d480 tx=0x7fbda4007e00 comp rx=0 tx=0).stop 2024-09-13T18:36:01.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.116+0000 7fbdb51f6700 1 -- 172.21.15.44:0/1969315607 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbdb0159550 msgr2=0x7fbdb0149ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:01.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.116+0000 7fbdb51f6700 1 --2- 172.21.15.44:0/1969315607 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbdb0159550 0x7fbdb0149ad0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbda000e8e0 tx=0x7fbda000ebf0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.116+0000 7fbdb51f6700 1 -- 172.21.15.44:0/1969315607 shutdown_connections 2024-09-13T18:36:01.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.116+0000 7fbdb51f6700 1 --2- 172.21.15.44:0/1969315607 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbd9c066760 0x7fbd9c068c20 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.116+0000 7fbdb51f6700 1 --2- 172.21.15.44:0/1969315607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdb015deb0 0x7fbdb00b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.116+0000 7fbdb51f6700 1 --2- 172.21.15.44:0/1969315607 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdb015d330 0x7fbdb00ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.116+0000 7fbdb51f6700 1 --2- 172.21.15.44:0/1969315607 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbdb0159550 0x7fbdb0149ad0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.116+0000 7fbdb51f6700 1 -- 172.21.15.44:0/1969315607 >> 172.21.15.44:0/1969315607 conn(0x7fbdb00cf000 msgr2=0x7fbdb015d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:01.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.116+0000 7fbdb51f6700 1 -- 172.21.15.44:0/1969315607 shutdown_connections 2024-09-13T18:36:01.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.116+0000 7fbdb51f6700 1 -- 172.21.15.44:0/1969315607 wait complete. 2024-09-13T18:36:01.140 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:36:01.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.256+0000 7f3680eb9700 1 Processor -- start 2024-09-13T18:36:01.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.256+0000 7f3680eb9700 1 -- start start 2024-09-13T18:36:01.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f3680eb9700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f367c070a30 0x7f367c0c8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f3680eb9700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f367c0c8950 0x7f367c0c9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f3680eb9700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f367c0cdbc0 con 0x7f367c0b4880 2024-09-13T18:36:01.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f3680eb9700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f367c0cde60 con 0x7f367c0c8950 2024-09-13T18:36:01.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f3680eb9700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367c0ce140 con 0x7f367c070a30 2024-09-13T18:36:01.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f367bfff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f367c0c8950 0x7f367c0c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f367bfff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f367c0c8950 0x7f367c0c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50558/0 (socket says 172.21.15.44:50558) 2024-09-13T18:36:01.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f367bfff700 1 -- 172.21.15.44:0/3627443002 learned_addr learned my addr 172.21.15.44:0/3627443002 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:01.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f367b7fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f367c0b4880 0x7f367c070320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43398/0 (socket says 172.21.15.44:43398) 2024-09-13T18:36:01.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f367affd700 1 --2- 172.21.15.44:0/3627443002 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f367c070a30 0x7f367c0c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f367bfff700 1 -- 172.21.15.44:0/3627443002 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f367c070a30 msgr2=0x7f367c0c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:01.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f367bfff700 1 --2- 172.21.15.44:0/3627443002 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f367c070a30 0x7f367c0c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f367bfff700 1 -- 172.21.15.44:0/3627443002 >> v1:172.21.15.44:6789/0 conn(0x7f367c0b4880 legacy=0x7f367c070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:01.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f367bfff700 1 -- 172.21.15.44:0/3627443002 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367c0ce420 con 0x7f367c0c8950 2024-09-13T18:36:01.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f367bfff700 1 --2- 172.21.15.44:0/3627443002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f367c0c8950 0x7f367c0c9630 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f3674009e50 tx=0x7f367400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5907e00ac48827 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:01.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f367a7fc700 1 -- 172.21.15.44:0/3627443002 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367400e070 con 0x7f367c0c8950 2024-09-13T18:36:01.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f367a7fc700 1 -- 172.21.15.44:0/3627443002 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367400b910 con 0x7f367c0c8950 2024-09-13T18:36:01.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f367a7fc700 1 -- 172.21.15.44:0/3627443002 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367400bcc0 con 0x7f367c0c8950 2024-09-13T18:36:01.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f3680eb9700 1 -- 172.21.15.44:0/3627443002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f367c0c8950 msgr2=0x7f367c0c9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:01.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f3680eb9700 1 --2- 172.21.15.44:0/3627443002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f367c0c8950 0x7f367c0c9630 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f3674009e50 tx=0x7f367400b330 comp rx=0 tx=0).stop 2024-09-13T18:36:01.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f3680eb9700 1 -- 172.21.15.44:0/3627443002 shutdown_connections 2024-09-13T18:36:01.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f3680eb9700 1 --2- 172.21.15.44:0/3627443002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f367c0c8950 0x7f367c0c9630 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f3680eb9700 1 --2- 172.21.15.44:0/3627443002 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f367c070a30 0x7f367c0c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f3680eb9700 1 -- 172.21.15.44:0/3627443002 >> 172.21.15.44:0/3627443002 conn(0x7f367c0cba60 msgr2=0x7f367c0cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:01.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f3680eb9700 1 -- 172.21.15.44:0/3627443002 shutdown_connections 2024-09-13T18:36:01.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f3680eb9700 1 -- 172.21.15.44:0/3627443002 wait complete. 2024-09-13T18:36:01.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.260+0000 7f3680eb9700 1 Processor -- start 2024-09-13T18:36:01.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.264+0000 7f3680eb9700 1 -- start start 2024-09-13T18:36:01.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.264+0000 7f3680eb9700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f367c070a30 0x7f367c151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.264+0000 7f3680eb9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f367c0b4880 0x7f367c15d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.264+0000 7f3680eb9700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f367c0c8950 0x7f367c15d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.264+0000 7f3680eb9700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367c13bf10 con 0x7f367c0b4880 2024-09-13T18:36:01.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.264+0000 7f3680eb9700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367c13b8e0 con 0x7f367c070a30 2024-09-13T18:36:01.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.264+0000 7f3680eb9700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367c13ab10 con 0x7f367c0c8950 2024-09-13T18:36:01.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.264+0000 7f367affd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f367c0b4880 0x7f367c15d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.264+0000 7f367affd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f367c0b4880 0x7f367c15d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50560/0 (socket says 172.21.15.44:50560) 2024-09-13T18:36:01.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.264+0000 7f367affd700 1 -- 172.21.15.44:0/2263742559 learned_addr learned my addr 172.21.15.44:0/2263742559 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:01.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.264+0000 7f367bfff700 1 --2- 172.21.15.44:0/2263742559 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f367c0c8950 0x7f367c15d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.264+0000 7f367b7fe700 1 --2- 172.21.15.44:0/2263742559 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f367c070a30 0x7f367c151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.264+0000 7f367affd700 1 -- 172.21.15.44:0/2263742559 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f367c0c8950 msgr2=0x7f367c15d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:01.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.264+0000 7f367affd700 1 --2- 172.21.15.44:0/2263742559 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f367c0c8950 0x7f367c15d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.264+0000 7f367affd700 1 -- 172.21.15.44:0/2263742559 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f367c070a30 msgr2=0x7f367c151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:01.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.264+0000 7f367affd700 1 --2- 172.21.15.44:0/2263742559 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f367c070a30 0x7f367c151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.264+0000 7f367affd700 1 -- 172.21.15.44:0/2263742559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3674009b30 con 0x7f367c0b4880 2024-09-13T18:36:01.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.264+0000 7f367affd700 1 --2- 172.21.15.44:0/2263742559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f367c0b4880 0x7f367c15d380 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f366c00e9d0 tx=0x7f366c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:01.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.264+0000 7f3663fff700 1 -- 172.21.15.44:0/2263742559 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366c009720 con 0x7f367c0b4880 2024-09-13T18:36:01.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.264+0000 7f3663fff700 1 -- 172.21.15.44:0/2263742559 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366c00ee70 con 0x7f367c0b4880 2024-09-13T18:36:01.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.264+0000 7f3663fff700 1 -- 172.21.15.44:0/2263742559 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366c00ca50 con 0x7f367c0b4880 2024-09-13T18:36:01.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.264+0000 7f3680eb9700 1 -- 172.21.15.44:0/2263742559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f367c0b4de0 con 0x7f367c0b4880 2024-09-13T18:36:01.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.264+0000 7f3680eb9700 1 -- 172.21.15.44:0/2263742559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f367c13bb30 con 0x7f367c0b4880 2024-09-13T18:36:01.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.268+0000 7f3663fff700 1 -- 172.21.15.44:0/2263742559 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f366c00cbb0 con 0x7f367c0b4880 2024-09-13T18:36:01.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.268+0000 7f3680eb9700 1 -- 172.21.15.44:0/2263742559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f367c0c8410 con 0x7f367c0b4880 2024-09-13T18:36:01.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.268+0000 7f3663fff700 1 --2- 172.21.15.44:0/2263742559 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3668066730 0x7f3668068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.268+0000 7f3663fff700 1 -- 172.21.15.44:0/2263742559 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f366c0840f0 con 0x7f367c0b4880 2024-09-13T18:36:01.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.268+0000 7f367b7fe700 1 --2- 172.21.15.44:0/2263742559 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3668066730 0x7f3668068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.272+0000 7f367b7fe700 1 --2- 172.21.15.44:0/2263742559 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3668066730 0x7f3668068bf0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3670000f60 tx=0x7f3670007ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:01.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.276+0000 7f3663fff700 1 -- 172.21.15.44:0/2263742559 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f366c051450 con 0x7f367c0b4880 2024-09-13T18:36:01.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.452+0000 7f3680eb9700 1 -- 172.21.15.44:0/2263742559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f367c161470 con 0x7f367c0b4880 2024-09-13T18:36:01.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.452+0000 7f3663fff700 1 -- 172.21.15.44:0/2263742559 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) v1 ==== 104+0+11 (secure 0 0 0) 0x7f366c059e60 con 0x7f367c0b4880 2024-09-13T18:36:01.459 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:36:01.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.456+0000 7f3680eb9700 1 -- 172.21.15.44:0/2263742559 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3668066730 msgr2=0x7f3668068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:01.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.456+0000 7f3680eb9700 1 --2- 172.21.15.44:0/2263742559 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3668066730 0x7f3668068bf0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3670000f60 tx=0x7f3670007ef0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.456+0000 7f3680eb9700 1 -- 172.21.15.44:0/2263742559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f367c0b4880 msgr2=0x7f367c15d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:01.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.456+0000 7f3680eb9700 1 --2- 172.21.15.44:0/2263742559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f367c0b4880 0x7f367c15d380 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f366c00e9d0 tx=0x7f366c00ece0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.456+0000 7f3680eb9700 1 -- 172.21.15.44:0/2263742559 shutdown_connections 2024-09-13T18:36:01.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.456+0000 7f3680eb9700 1 --2- 172.21.15.44:0/2263742559 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f3668066730 0x7f3668068bf0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.456+0000 7f3680eb9700 1 --2- 172.21.15.44:0/2263742559 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f367c0c8950 0x7f367c15d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.456+0000 7f3680eb9700 1 --2- 172.21.15.44:0/2263742559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f367c0b4880 0x7f367c15d380 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.456+0000 7f3680eb9700 1 --2- 172.21.15.44:0/2263742559 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f367c070a30 0x7f367c151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.456+0000 7f3680eb9700 1 -- 172.21.15.44:0/2263742559 >> 172.21.15.44:0/2263742559 conn(0x7f367c0cba60 msgr2=0x7f367c0b2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:01.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.456+0000 7f3680eb9700 1 -- 172.21.15.44:0/2263742559 shutdown_connections 2024-09-13T18:36:01.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.456+0000 7f3680eb9700 1 -- 172.21.15.44:0/2263742559 wait complete. 2024-09-13T18:36:01.474 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:36:01.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.584+0000 7fb672366700 1 Processor -- start 2024-09-13T18:36:01.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.584+0000 7fb672366700 1 -- start start 2024-09-13T18:36:01.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.584+0000 7fb672366700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb66c144340 0x7fb66c06d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.584+0000 7fb672366700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb66c0cdc90 0x7fb66c06fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.584+0000 7fb672366700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb66c144720 con 0x7fb66c06bdb0 2024-09-13T18:36:01.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.584+0000 7fb672366700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb66c06dd40 con 0x7fb66c0cdc90 2024-09-13T18:36:01.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.584+0000 7fb672366700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c06da60 con 0x7fb66c144340 2024-09-13T18:36:01.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.584+0000 7fb671b65700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb66c0cdc90 0x7fb66c06fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.584+0000 7fb671364700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb66c144340 0x7fb66c06d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.584+0000 7fb671b65700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb66c0cdc90 0x7fb66c06fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:53538/0 (socket says 172.21.15.44:53538) 2024-09-13T18:36:01.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.584+0000 7fb671b65700 1 -- 172.21.15.44:0/2562303732 learned_addr learned my addr 172.21.15.44:0/2562303732 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:01.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.584+0000 7fb670b63700 1 --1- 172.21.15.44:0/2562303732 >> v1:172.21.15.99:6789/0 conn(0x7fb66c06bdb0 0x7fb66c0cd580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:38596/0 (socket says 172.21.15.44:38596) 2024-09-13T18:36:01.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.584+0000 7fb65ffff700 1 -- 172.21.15.44:0/2562303732 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3480809260 0 0) 0x7fb66c144720 con 0x7fb66c06bdb0 2024-09-13T18:36:01.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.584+0000 7fb65ffff700 1 -- 172.21.15.44:0/2562303732 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6580035d0 con 0x7fb66c06bdb0 2024-09-13T18:36:01.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.584+0000 7fb671b65700 1 -- 172.21.15.44:0/2562303732 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb66c144340 msgr2=0x7fb66c06d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:01.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.584+0000 7fb671b65700 1 --2- 172.21.15.44:0/2562303732 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb66c144340 0x7fb66c06d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.584+0000 7fb671b65700 1 -- 172.21.15.44:0/2562303732 >> v1:172.21.15.99:6789/0 conn(0x7fb66c06bdb0 legacy=0x7fb66c0cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:01.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.584+0000 7fb671b65700 1 -- 172.21.15.44:0/2562303732 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c15e660 con 0x7fb66c0cdc90 2024-09-13T18:36:01.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.588+0000 7fb671b65700 1 --2- 172.21.15.44:0/2562303732 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb66c0cdc90 0x7fb66c06fa90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb664009910 tx=0x7fb664009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c52945491c65bcd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:01.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.588+0000 7fb65ffff700 1 -- 172.21.15.44:0/2562303732 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb664011830 con 0x7fb66c0cdc90 2024-09-13T18:36:01.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.588+0000 7fb65ffff700 1 -- 172.21.15.44:0/2562303732 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb664011990 con 0x7fb66c0cdc90 2024-09-13T18:36:01.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.588+0000 7fb65ffff700 1 -- 172.21.15.44:0/2562303732 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb664011d00 con 0x7fb66c0cdc90 2024-09-13T18:36:01.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.588+0000 7fb672366700 1 -- 172.21.15.44:0/2562303732 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb66c0cdc90 msgr2=0x7fb66c06fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:01.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.588+0000 7fb672366700 1 --2- 172.21.15.44:0/2562303732 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb66c0cdc90 0x7fb66c06fa90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb664009910 tx=0x7fb664009c20 comp rx=0 tx=0).stop 2024-09-13T18:36:01.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.588+0000 7fb672366700 1 -- 172.21.15.44:0/2562303732 shutdown_connections 2024-09-13T18:36:01.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.588+0000 7fb672366700 1 --2- 172.21.15.44:0/2562303732 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb66c0cdc90 0x7fb66c06fa90 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.588+0000 7fb672366700 1 --2- 172.21.15.44:0/2562303732 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb66c144340 0x7fb66c06d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.588+0000 7fb672366700 1 -- 172.21.15.44:0/2562303732 >> 172.21.15.44:0/2562303732 conn(0x7fb66c0b0e10 msgr2=0x7fb66c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:01.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.588+0000 7fb672366700 1 -- 172.21.15.44:0/2562303732 shutdown_connections 2024-09-13T18:36:01.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.588+0000 7fb672366700 1 -- 172.21.15.44:0/2562303732 wait complete. 2024-09-13T18:36:01.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.588+0000 7fb672366700 1 Processor -- start 2024-09-13T18:36:01.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.588+0000 7fb672366700 1 -- start start 2024-09-13T18:36:01.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb672366700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb66c06bdb0 0x7fb66c142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb672366700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb66c0cdc90 0x7fb66c0aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb672366700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb66c144340 0x7fb66c0ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb672366700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c133370 con 0x7fb66c0cdc90 2024-09-13T18:36:01.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb672366700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c0ad930 con 0x7fb66c144340 2024-09-13T18:36:01.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb672366700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c133090 con 0x7fb66c06bdb0 2024-09-13T18:36:01.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb670b63700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb66c0cdc90 0x7fb66c0aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb670b63700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb66c0cdc90 0x7fb66c0aceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50568/0 (socket says 172.21.15.44:50568) 2024-09-13T18:36:01.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb670b63700 1 -- 172.21.15.44:0/909121845 learned_addr learned my addr 172.21.15.44:0/909121845 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:01.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb671b65700 1 --2- 172.21.15.44:0/909121845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb66c144340 0x7fb66c0ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb671364700 1 --2- 172.21.15.44:0/909121845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb66c06bdb0 0x7fb66c142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb670b63700 1 -- 172.21.15.44:0/909121845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb66c06bdb0 msgr2=0x7fb66c142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:01.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb670b63700 1 --2- 172.21.15.44:0/909121845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb66c06bdb0 0x7fb66c142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb670b63700 1 -- 172.21.15.44:0/909121845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb66c144340 msgr2=0x7fb66c0ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:01.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb670b63700 1 --2- 172.21.15.44:0/909121845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb66c144340 0x7fb66c0ad3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb670b63700 1 -- 172.21.15.44:0/909121845 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb664009570 con 0x7fb66c0cdc90 2024-09-13T18:36:01.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb670b63700 1 --2- 172.21.15.44:0/909121845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb66c0cdc90 0x7fb66c0aceb0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fb66800cbf0 tx=0x7fb66800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:01.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb65dffb700 1 -- 172.21.15.44:0/909121845 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66800aad0 con 0x7fb66c0cdc90 2024-09-13T18:36:01.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb65dffb700 1 -- 172.21.15.44:0/909121845 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66800ac30 con 0x7fb66c0cdc90 2024-09-13T18:36:01.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb672366700 1 -- 172.21.15.44:0/909121845 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb66c1f3ae0 con 0x7fb66c0cdc90 2024-09-13T18:36:01.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb65dffb700 1 -- 172.21.15.44:0/909121845 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb668007070 con 0x7fb66c0cdc90 2024-09-13T18:36:01.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb672366700 1 -- 172.21.15.44:0/909121845 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb66c1f40a0 con 0x7fb66c0cdc90 2024-09-13T18:36:01.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb672366700 1 -- 172.21.15.44:0/909121845 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb66c1f3940 con 0x7fb66c0cdc90 2024-09-13T18:36:01.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.592+0000 7fb65dffb700 1 -- 172.21.15.44:0/909121845 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb6680071d0 con 0x7fb66c0cdc90 2024-09-13T18:36:01.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.596+0000 7fb65dffb700 1 --2- 172.21.15.44:0/909121845 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb650066730 0x7fb650068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.596+0000 7fb65dffb700 1 -- 172.21.15.44:0/909121845 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb668083fe0 con 0x7fb66c0cdc90 2024-09-13T18:36:01.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.596+0000 7fb671364700 1 --2- 172.21.15.44:0/909121845 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb650066730 0x7fb650068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.596+0000 7fb671364700 1 --2- 172.21.15.44:0/909121845 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb650066730 0x7fb650068bf0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb660009b80 tx=0x7fb660008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:01.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.600+0000 7fb65dffb700 1 -- 172.21.15.44:0/909121845 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb66c1f3940 con 0x7fb66c0cdc90 2024-09-13T18:36:01.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.780+0000 7fb672366700 1 -- 172.21.15.44:0/909121845 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb66c1f3940 con 0x7fb66c0cdc90 2024-09-13T18:36:01.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.780+0000 7fb65dffb700 1 -- 172.21.15.44:0/909121845 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb66c1f3940 con 0x7fb66c0cdc90 2024-09-13T18:36:01.787 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:36:01.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.784+0000 7fb672366700 1 -- 172.21.15.44:0/909121845 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb650066730 msgr2=0x7fb650068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:01.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.784+0000 7fb672366700 1 --2- 172.21.15.44:0/909121845 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb650066730 0x7fb650068bf0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb660009b80 tx=0x7fb660008040 comp rx=0 tx=0).stop 2024-09-13T18:36:01.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.784+0000 7fb672366700 1 -- 172.21.15.44:0/909121845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb66c0cdc90 msgr2=0x7fb66c0aceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:01.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.784+0000 7fb672366700 1 --2- 172.21.15.44:0/909121845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb66c0cdc90 0x7fb66c0aceb0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fb66800cbf0 tx=0x7fb66800cf00 comp rx=0 tx=0).stop 2024-09-13T18:36:01.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.784+0000 7fb672366700 1 -- 172.21.15.44:0/909121845 shutdown_connections 2024-09-13T18:36:01.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.784+0000 7fb672366700 1 --2- 172.21.15.44:0/909121845 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fb650066730 0x7fb650068bf0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.784+0000 7fb672366700 1 --2- 172.21.15.44:0/909121845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb66c144340 0x7fb66c0ad3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.784+0000 7fb672366700 1 --2- 172.21.15.44:0/909121845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb66c0cdc90 0x7fb66c0aceb0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.784+0000 7fb672366700 1 --2- 172.21.15.44:0/909121845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb66c06bdb0 0x7fb66c142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.784+0000 7fb672366700 1 -- 172.21.15.44:0/909121845 >> 172.21.15.44:0/909121845 conn(0x7fb66c0b0e10 msgr2=0x7fb66c0714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:01.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.784+0000 7fb672366700 1 -- 172.21.15.44:0/909121845 shutdown_connections 2024-09-13T18:36:01.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.784+0000 7fb672366700 1 -- 172.21.15.44:0/909121845 wait complete. 2024-09-13T18:36:01.803 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:36:01.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.912+0000 7f572650e700 1 Processor -- start 2024-09-13T18:36:01.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.912+0000 7f572650e700 1 -- start start 2024-09-13T18:36:01.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.912+0000 7f572650e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f572006b900 0x7f57200b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.912+0000 7f572650e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f572006a520 0x7f572006a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.912+0000 7f572650e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57200b8430 con 0x7f572015cda0 2024-09-13T18:36:01.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.912+0000 7f572650e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572006ae70 con 0x7f572006a520 2024-09-13T18:36:01.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.912+0000 7f572650e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572006bd60 con 0x7f572006b900 2024-09-13T18:36:01.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.912+0000 7f572550c700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f572015cda0 0x7f57200ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43412/0 (socket says 172.21.15.44:43412) 2024-09-13T18:36:01.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.912+0000 7f572550c700 1 -- 172.21.15.44:0/131297749 learned_addr learned my addr 172.21.15.44:0/131297749 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:01.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.912+0000 7f5725d0d700 1 --2- 172.21.15.44:0/131297749 >> v2:172.21.15.44:3300/0 conn(0x7f572006a520 0x7f572006a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.912+0000 7f5724d0b700 1 --2- 172.21.15.44:0/131297749 >> v2:172.21.15.99:3300/0 conn(0x7f572006b900 0x7f57200b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.912+0000 7f5717fff700 1 -- 172.21.15.44:0/131297749 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 898893722 0 0) 0x7f57200b8430 con 0x7f572015cda0 2024-09-13T18:36:01.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.912+0000 7f5717fff700 1 -- 172.21.15.44:0/131297749 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f570c0035d0 con 0x7f572015cda0 2024-09-13T18:36:01.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.912+0000 7f5725d0d700 1 -- 172.21.15.44:0/131297749 >> v2:172.21.15.99:3300/0 conn(0x7f572006b900 msgr2=0x7f57200b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:01.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.912+0000 7f5725d0d700 1 --2- 172.21.15.44:0/131297749 >> v2:172.21.15.99:3300/0 conn(0x7f572006b900 0x7f57200b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.912+0000 7f5725d0d700 1 -- 172.21.15.44:0/131297749 >> v1:172.21.15.44:6789/0 conn(0x7f572015cda0 legacy=0x7f57200ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:01.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.912+0000 7f5725d0d700 1 -- 172.21.15.44:0/131297749 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57200cf350 con 0x7f572006a520 2024-09-13T18:36:01.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.912+0000 7f5725d0d700 1 --2- 172.21.15.44:0/131297749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f572006a520 0x7f572006a930 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f57200cf280 tx=0x7f571800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a3f72790df6657 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:01.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.916+0000 7f5717fff700 1 -- 172.21.15.44:0/131297749 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571800e070 con 0x7f572006a520 2024-09-13T18:36:01.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.916+0000 7f5717fff700 1 -- 172.21.15.44:0/131297749 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571800bb20 con 0x7f572006a520 2024-09-13T18:36:01.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.916+0000 7f5717fff700 1 -- 172.21.15.44:0/131297749 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5718012430 con 0x7f572006a520 2024-09-13T18:36:01.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.916+0000 7f572650e700 1 -- 172.21.15.44:0/131297749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f572006a520 msgr2=0x7f572006a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:01.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.916+0000 7f572650e700 1 --2- 172.21.15.44:0/131297749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f572006a520 0x7f572006a930 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f57200cf280 tx=0x7f571800b330 comp rx=0 tx=0).stop 2024-09-13T18:36:01.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.916+0000 7f572650e700 1 -- 172.21.15.44:0/131297749 shutdown_connections 2024-09-13T18:36:01.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.916+0000 7f572650e700 1 --2- 172.21.15.44:0/131297749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f572006a520 0x7f572006a930 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.916+0000 7f572650e700 1 --2- 172.21.15.44:0/131297749 >> v2:172.21.15.99:3300/0 conn(0x7f572006b900 0x7f57200b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.916+0000 7f572650e700 1 -- 172.21.15.44:0/131297749 >> 172.21.15.44:0/131297749 conn(0x7f57200d2cb0 msgr2=0x7f57200d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:01.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.916+0000 7f572650e700 1 -- 172.21.15.44:0/131297749 shutdown_connections 2024-09-13T18:36:01.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.916+0000 7f572650e700 1 -- 172.21.15.44:0/131297749 wait complete. 2024-09-13T18:36:01.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.916+0000 7f572650e700 1 Processor -- start 2024-09-13T18:36:01.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.916+0000 7f572650e700 1 -- start start 2024-09-13T18:36:01.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.916+0000 7f572650e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f572006a520 0x7f57201f3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.916+0000 7f572650e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f572006b900 0x7f572015f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.916+0000 7f572650e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f572015cda0 0x7f572015dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.916+0000 7f572650e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572015fc50 con 0x7f572006a520 2024-09-13T18:36:01.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.916+0000 7f572650e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572015e160 con 0x7f572006b900 2024-09-13T18:36:01.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.916+0000 7f572650e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5720154aa0 con 0x7f572015cda0 2024-09-13T18:36:01.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.920+0000 7f572550c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f572006a520 0x7f57201f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.920+0000 7f572550c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f572006a520 0x7f57201f3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50598/0 (socket says 172.21.15.44:50598) 2024-09-13T18:36:01.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.920+0000 7f572550c700 1 -- 172.21.15.44:0/2439927345 learned_addr learned my addr 172.21.15.44:0/2439927345 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:01.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.920+0000 7f5725d0d700 1 --2- 172.21.15.44:0/2439927345 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f572015cda0 0x7f572015dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.920+0000 7f5724d0b700 1 --2- 172.21.15.44:0/2439927345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f572006b900 0x7f572015f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.920+0000 7f572550c700 1 -- 172.21.15.44:0/2439927345 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f572015cda0 msgr2=0x7f572015dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:01.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.920+0000 7f572550c700 1 --2- 172.21.15.44:0/2439927345 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f572015cda0 0x7f572015dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.920+0000 7f572550c700 1 -- 172.21.15.44:0/2439927345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f572006b900 msgr2=0x7f572015f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:01.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.920+0000 7f572550c700 1 --2- 172.21.15.44:0/2439927345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f572006b900 0x7f572015f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.920+0000 7f572550c700 1 -- 172.21.15.44:0/2439927345 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5718009a70 con 0x7f572006a520 2024-09-13T18:36:01.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.920+0000 7f572550c700 1 --2- 172.21.15.44:0/2439927345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f572006a520 0x7f57201f3760 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f571c00c4d0 tx=0x7f571c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:01.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.920+0000 7f5715ffb700 1 -- 172.21.15.44:0/2439927345 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c005d90 con 0x7f572006a520 2024-09-13T18:36:01.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.920+0000 7f5715ffb700 1 -- 172.21.15.44:0/2439927345 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571c00ce80 con 0x7f572006a520 2024-09-13T18:36:01.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.920+0000 7f5715ffb700 1 -- 172.21.15.44:0/2439927345 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c007310 con 0x7f572006a520 2024-09-13T18:36:01.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.920+0000 7f572650e700 1 -- 172.21.15.44:0/2439927345 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572015e370 con 0x7f572006a520 2024-09-13T18:36:01.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.920+0000 7f572650e700 1 -- 172.21.15.44:0/2439927345 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57200c6bc0 con 0x7f572006a520 2024-09-13T18:36:01.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.920+0000 7f572650e700 1 -- 172.21.15.44:0/2439927345 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f572006a930 con 0x7f572006a520 2024-09-13T18:36:01.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.924+0000 7f5715ffb700 1 -- 172.21.15.44:0/2439927345 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f571c007470 con 0x7f572006a520 2024-09-13T18:36:01.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.924+0000 7f5715ffb700 1 --2- 172.21.15.44:0/2439927345 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5704066730 0x7f5704068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.924+0000 7f5715ffb700 1 -- 172.21.15.44:0/2439927345 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f571c083470 con 0x7f572006a520 2024-09-13T18:36:01.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.924+0000 7f5724d0b700 1 --2- 172.21.15.44:0/2439927345 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5704066730 0x7f5704068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.924+0000 7f5724d0b700 1 --2- 172.21.15.44:0/2439927345 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5704066730 0x7f5704068bf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f57200c8b80 tx=0x7f5710009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:01.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:01.928+0000 7f5715ffb700 1 -- 172.21.15.44:0/2439927345 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f571c050870 con 0x7f572006a520 2024-09-13T18:36:02.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.116+0000 7f572650e700 1 -- 172.21.15.44:0/2439927345 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5720074560 con 0x7f572006a520 2024-09-13T18:36:02.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.120+0000 7f5715ffb700 1 -- 172.21.15.44:0/2439927345 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v78) v1 ==== 80+0+0 (secure 0 0 0) 0x7f571c053e90 con 0x7f572006a520 2024-09-13T18:36:02.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.120+0000 7f572650e700 1 -- 172.21.15.44:0/2439927345 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5704066730 msgr2=0x7f5704068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:02.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.120+0000 7f572650e700 1 --2- 172.21.15.44:0/2439927345 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5704066730 0x7f5704068bf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f57200c8b80 tx=0x7f5710009240 comp rx=0 tx=0).stop 2024-09-13T18:36:02.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.120+0000 7f572650e700 1 -- 172.21.15.44:0/2439927345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f572006a520 msgr2=0x7f57201f3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:02.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.120+0000 7f572650e700 1 --2- 172.21.15.44:0/2439927345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f572006a520 0x7f57201f3760 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f571c00c4d0 tx=0x7f571c00c7e0 comp rx=0 tx=0).stop 2024-09-13T18:36:02.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.120+0000 7f572650e700 1 -- 172.21.15.44:0/2439927345 shutdown_connections 2024-09-13T18:36:02.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.120+0000 7f572650e700 1 --2- 172.21.15.44:0/2439927345 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5704066730 0x7f5704068bf0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:02.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.120+0000 7f572650e700 1 --2- 172.21.15.44:0/2439927345 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f572015cda0 0x7f572015dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:02.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.120+0000 7f572650e700 1 --2- 172.21.15.44:0/2439927345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f572006b900 0x7f572015f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:02.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.120+0000 7f572650e700 1 --2- 172.21.15.44:0/2439927345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f572006a520 0x7f57201f3760 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:02.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.120+0000 7f572650e700 1 -- 172.21.15.44:0/2439927345 >> 172.21.15.44:0/2439927345 conn(0x7f57200d2cb0 msgr2=0x7f57200b6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:02.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.120+0000 7f572650e700 1 -- 172.21.15.44:0/2439927345 shutdown_connections 2024-09-13T18:36:02.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.120+0000 7f572650e700 1 -- 172.21.15.44:0/2439927345 wait complete. 2024-09-13T18:36:02.128 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-13T18:36:02.143 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2024-09-13T18:36:02.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:02.143 DEBUG:teuthology.orchestra.run.smithi044:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:36:02.154 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[46486]: fuse finished with error 0 and tester_r 0 2024-09-13T18:36:02.155 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:36:02.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:02.156 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:36:02.277 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:36:02.277 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:02.286 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346268k,nr_inodes=4086567,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19562 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275480k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:36:02.286 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:36:02.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:02.286 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:36:02.292 INFO:teuthology.orchestra.run.smithi099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-13T18:36:02.293 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:36:02.293 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:36:02.293 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:02.328 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349428k,nr_inodes=4087357,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16693 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276112k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:36:02.328 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:36:02.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:02.328 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T18:36:02.334 INFO:teuthology.orchestra.run.smithi044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T18:36:02.335 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:36:02.335 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:36:02.335 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:02.343 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346268k,nr_inodes=4086567,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19562 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275480k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:36:02.343 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:36:02.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:02.343 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T18:36:02.349 INFO:teuthology.orchestra.run.smithi099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T18:36:02.350 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:36:02.350 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:36:02.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f601c91b700 1 Processor -- start 2024-09-13T18:36:02.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f601c91b700 1 -- start start 2024-09-13T18:36:02.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f601c91b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6018159720 0x7f601806cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:02.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f601c91b700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f601806aa90 0x7f60180b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:02.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f601c91b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60180b3910 0x7f6018070c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:02.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f601c91b700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60180b3da0 con 0x7f6018159720 2024-09-13T18:36:02.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f601c91b700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f601806af00 con 0x7f601806aa90 2024-09-13T18:36:02.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f601c91b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601806d690 con 0x7f60180b3910 2024-09-13T18:36:02.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f6016d9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6018159720 0x7f601806cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:02.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f6016d9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6018159720 0x7f601806cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46144/0 (socket says 172.21.15.44:46144) 2024-09-13T18:36:02.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f6016d9d700 1 -- 172.21.15.44:0/864745929 learned_addr learned my addr 172.21.15.44:0/864745929 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:02.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f601759e700 1 --2- 172.21.15.44:0/864745929 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60180b3910 0x7f6018070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:02.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f601659c700 1 --2- 172.21.15.44:0/864745929 >> v2:172.21.15.99:3300/0 conn(0x7f601806aa90 0x7f60180b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:02.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f6016d9d700 1 -- 172.21.15.44:0/864745929 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60180b3910 msgr2=0x7f6018070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:02.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f6016d9d700 1 --2- 172.21.15.44:0/864745929 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60180b3910 0x7f6018070c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:02.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f6016d9d700 1 -- 172.21.15.44:0/864745929 >> v2:172.21.15.99:3300/0 conn(0x7f601806aa90 msgr2=0x7f60180b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:02.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f6016d9d700 1 --2- 172.21.15.44:0/864745929 >> v2:172.21.15.99:3300/0 conn(0x7f601806aa90 0x7f60180b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:02.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f6016d9d700 1 -- 172.21.15.44:0/864745929 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60180cbfe0 con 0x7f6018159720 2024-09-13T18:36:02.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f601759e700 1 --2- 172.21.15.44:0/864745929 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60180b3910 0x7f6018070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:02.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f601659c700 1 --2- 172.21.15.44:0/864745929 >> v2:172.21.15.99:3300/0 conn(0x7f601806aa90 0x7f60180b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:02.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f6016d9d700 1 --2- 172.21.15.44:0/864745929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6018159720 0x7f601806cf90 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f601806b160 tx=0x7f600c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd13a835f6c5b4de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:02.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f6015d9b700 1 -- 172.21.15.44:0/864745929 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c00b8a0 con 0x7f6018159720 2024-09-13T18:36:02.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f6015d9b700 1 -- 172.21.15.44:0/864745929 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600c00ba00 con 0x7f6018159720 2024-09-13T18:36:02.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.468+0000 7f6015d9b700 1 -- 172.21.15.44:0/864745929 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c00bd90 con 0x7f6018159720 2024-09-13T18:36:02.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.472+0000 7f601c91b700 1 -- 172.21.15.44:0/864745929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6018159720 msgr2=0x7f601806cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:02.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.472+0000 7f601c91b700 1 --2- 172.21.15.44:0/864745929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6018159720 0x7f601806cf90 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f601806b160 tx=0x7f600c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:36:02.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.472+0000 7f601c91b700 1 -- 172.21.15.44:0/864745929 shutdown_connections 2024-09-13T18:36:02.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.472+0000 7f601c91b700 1 --2- 172.21.15.44:0/864745929 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60180b3910 0x7f6018070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:02.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.472+0000 7f601c91b700 1 --2- 172.21.15.44:0/864745929 >> v2:172.21.15.99:3300/0 conn(0x7f601806aa90 0x7f60180b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:02.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.472+0000 7f601c91b700 1 --2- 172.21.15.44:0/864745929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6018159720 0x7f601806cf90 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:02.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.472+0000 7f601c91b700 1 -- 172.21.15.44:0/864745929 >> 172.21.15.44:0/864745929 conn(0x7f60180b0f00 msgr2=0x7f60180b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:02.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.472+0000 7f601c91b700 1 -- 172.21.15.44:0/864745929 shutdown_connections 2024-09-13T18:36:02.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.472+0000 7f601c91b700 1 -- 172.21.15.44:0/864745929 wait complete. 2024-09-13T18:36:02.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.476+0000 7f601c91b700 1 Processor -- start 2024-09-13T18:36:02.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.476+0000 7f601c91b700 1 -- start start 2024-09-13T18:36:02.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.476+0000 7f601c91b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f601806aa90 0x7f601814cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:02.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.476+0000 7f601c91b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60180b3910 0x7f60181f11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:02.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.476+0000 7f601c91b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6018159720 0x7f601815b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:02.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.476+0000 7f601c91b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60181f0da0 con 0x7f60180b3910 2024-09-13T18:36:02.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.476+0000 7f601659c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60180b3910 0x7f60181f11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:02.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.476+0000 7f601c91b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601814f8d0 con 0x7f601806aa90 2024-09-13T18:36:02.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.476+0000 7f601659c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60180b3910 0x7f60181f11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46148/0 (socket says 172.21.15.44:46148) 2024-09-13T18:36:02.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.476+0000 7f601659c700 1 -- 172.21.15.44:0/3742709895 learned_addr learned my addr 172.21.15.44:0/3742709895 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:02.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.476+0000 7f601c91b700 1 -- 172.21.15.44:0/3742709895 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601815c6c0 con 0x7f6018159720 2024-09-13T18:36:02.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.476+0000 7f6016d9d700 1 --2- 172.21.15.44:0/3742709895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f601806aa90 0x7f601814cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:02.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.476+0000 7f601759e700 1 --2- 172.21.15.44:0/3742709895 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6018159720 0x7f601815b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:02.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.476+0000 7f601659c700 1 -- 172.21.15.44:0/3742709895 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6018159720 msgr2=0x7f601815b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:02.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.476+0000 7f601659c700 1 --2- 172.21.15.44:0/3742709895 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6018159720 0x7f601815b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:02.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.476+0000 7f601659c700 1 -- 172.21.15.44:0/3742709895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f601806aa90 msgr2=0x7f601814cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:02.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.476+0000 7f601659c700 1 --2- 172.21.15.44:0/3742709895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f601806aa90 0x7f601814cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:02.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.476+0000 7f601659c700 1 -- 172.21.15.44:0/3742709895 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c009570 con 0x7f60180b3910 2024-09-13T18:36:02.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.476+0000 7f6016d9d700 1 --2- 172.21.15.44:0/3742709895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f601806aa90 0x7f601814cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:02.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.476+0000 7f601659c700 1 --2- 172.21.15.44:0/3742709895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60180b3910 0x7f60181f11c0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f600800d830 tx=0x7f600800dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:02.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.476+0000 7f5fff7fe700 1 -- 172.21.15.44:0/3742709895 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008004030 con 0x7f60180b3910 2024-09-13T18:36:02.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.476+0000 7f5fff7fe700 1 -- 172.21.15.44:0/3742709895 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6008004190 con 0x7f60180b3910 2024-09-13T18:36:02.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.476+0000 7f601c91b700 1 -- 172.21.15.44:0/3742709895 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60181f07b0 con 0x7f60180b3910 2024-09-13T18:36:02.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.480+0000 7f5fff7fe700 1 -- 172.21.15.44:0/3742709895 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008004500 con 0x7f60180b3910 2024-09-13T18:36:02.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.480+0000 7f601c91b700 1 -- 172.21.15.44:0/3742709895 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60181f1700 con 0x7f60180b3910 2024-09-13T18:36:02.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.480+0000 7f601c91b700 1 -- 172.21.15.44:0/3742709895 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60180b33d0 con 0x7f60180b3910 2024-09-13T18:36:02.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.480+0000 7f5fff7fe700 1 -- 172.21.15.44:0/3742709895 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f60080036c0 con 0x7f60180b3910 2024-09-13T18:36:02.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.480+0000 7f5fff7fe700 1 --2- 172.21.15.44:0/3742709895 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6004066730 0x7f6004068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:02.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.480+0000 7f5fff7fe700 1 -- 172.21.15.44:0/3742709895 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6008084740 con 0x7f60180b3910 2024-09-13T18:36:02.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.480+0000 7f6016d9d700 1 --2- 172.21.15.44:0/3742709895 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6004066730 0x7f6004068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:02.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.480+0000 7f6016d9d700 1 --2- 172.21.15.44:0/3742709895 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6004066730 0x7f6004068bf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f600c000c00 tx=0x7f600c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:02.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.488+0000 7f5fff7fe700 1 -- 172.21.15.44:0/3742709895 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6008051ac0 con 0x7f60180b3910 2024-09-13T18:36:02.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.696+0000 7f601c91b700 1 -- 172.21.15.44:0/3742709895 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60180cb550 con 0x7f60180b3910 2024-09-13T18:36:02.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.700+0000 7f5fff7fe700 1 -- 172.21.15.44:0/3742709895 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f60080094c0 con 0x7f60180b3910 2024-09-13T18:36:02.705 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:02.705 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":70,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3463035694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3463035694},{"type":"v1","addr":"172.21.15.99:6837","nonce":3463035694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7438,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2910652037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2910652037},{"type":"v1","addr":"172.21.15.44:6833","nonce":2910652037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7456,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2231812307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2231812307},{"type":"v1","addr":"172.21.15.99:6835","nonce":2231812307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:35:45.841782+0000","modified":"2024-09-13T18:35:48.860780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7626},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7626":{"gid":7626,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/1921610909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1921610909},{"type":"v1","addr":"172.21.15.44:6835","nonce":1921610909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:36:02.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.700+0000 7f601c91b700 1 -- 172.21.15.44:0/3742709895 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6004066730 msgr2=0x7f6004068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:02.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.700+0000 7f601c91b700 1 --2- 172.21.15.44:0/3742709895 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6004066730 0x7f6004068bf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f600c000c00 tx=0x7f600c008030 comp rx=0 tx=0).stop 2024-09-13T18:36:02.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.700+0000 7f601c91b700 1 -- 172.21.15.44:0/3742709895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60180b3910 msgr2=0x7f60181f11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:02.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.700+0000 7f601c91b700 1 --2- 172.21.15.44:0/3742709895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60180b3910 0x7f60181f11c0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f600800d830 tx=0x7f600800dbf0 comp rx=0 tx=0).stop 2024-09-13T18:36:02.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.700+0000 7f601c91b700 1 -- 172.21.15.44:0/3742709895 shutdown_connections 2024-09-13T18:36:02.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.700+0000 7f601c91b700 1 --2- 172.21.15.44:0/3742709895 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6004066730 0x7f6004068bf0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:02.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.700+0000 7f601c91b700 1 --2- 172.21.15.44:0/3742709895 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6018159720 0x7f601815b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:02.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.700+0000 7f601c91b700 1 --2- 172.21.15.44:0/3742709895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60180b3910 0x7f60181f11c0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:02.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.700+0000 7f601c91b700 1 --2- 172.21.15.44:0/3742709895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f601806aa90 0x7f601814cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:02.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.700+0000 7f601c91b700 1 -- 172.21.15.44:0/3742709895 >> 172.21.15.44:0/3742709895 conn(0x7f60180b0f00 msgr2=0x7f60180b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:02.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.700+0000 7f601c91b700 1 -- 172.21.15.44:0/3742709895 shutdown_connections 2024-09-13T18:36:02.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.700+0000 7f601c91b700 1 -- 172.21.15.44:0/3742709895 wait complete. 2024-09-13T18:36:02.710 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 70 2024-09-13T18:36:02.720 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:02.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.828+0000 7f43b94b5700 1 Processor -- start 2024-09-13T18:36:02.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.828+0000 7f43b94b5700 1 -- start start 2024-09-13T18:36:02.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.828+0000 7f43b94b5700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f43b40b3ae0 0x7f43b406a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:02.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.828+0000 7f43b94b5700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b413dcb0 con 0x7f43b406bbf0 2024-09-13T18:36:02.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.828+0000 7f43b94b5700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b415be60 con 0x7f43b406aaf0 2024-09-13T18:36:02.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.828+0000 7f43b94b5700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b413ffd0 con 0x7f43b40b3ae0 2024-09-13T18:36:02.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.828+0000 7f43b37fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f43b40b3ae0 0x7f43b406a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:02.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.828+0000 7f43b3fff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f43b406bbf0 0x7f43b40b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:32854/0 (socket says 172.21.15.44:32854) 2024-09-13T18:36:02.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.828+0000 7f43b3fff700 1 -- 172.21.15.44:0/4261770279 learned_addr learned my addr 172.21.15.44:0/4261770279 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:02.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.832+0000 7f43b37fe700 1 -- 172.21.15.44:0/4261770279 >> v1:172.21.15.99:6789/0 conn(0x7f43b406aaf0 legacy=0x7f43b415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:02.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.832+0000 7f43b37fe700 1 -- 172.21.15.44:0/4261770279 >> v1:172.21.15.44:6789/0 conn(0x7f43b406bbf0 legacy=0x7f43b40b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:02.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.832+0000 7f43b37fe700 1 -- 172.21.15.44:0/4261770279 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b4140220 con 0x7f43b40b3ae0 2024-09-13T18:36:02.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.832+0000 7f43b37fe700 1 --2- 172.21.15.44:0/4261770279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43b40b3ae0 0x7f43b406a5b0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009850 tx=0x7f43a4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc10ac7fe51b31b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:02.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.832+0000 7f43b2ffd700 1 -- 172.21.15.44:0/4261770279 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a4011830 con 0x7f43b40b3ae0 2024-09-13T18:36:02.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.832+0000 7f43b2ffd700 1 -- 172.21.15.44:0/4261770279 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a4011990 con 0x7f43b40b3ae0 2024-09-13T18:36:02.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.832+0000 7f43b2ffd700 1 -- 172.21.15.44:0/4261770279 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a4011d20 con 0x7f43b40b3ae0 2024-09-13T18:36:02.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.832+0000 7f43b94b5700 1 -- 172.21.15.44:0/4261770279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43b40b3ae0 msgr2=0x7f43b406a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:02.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.832+0000 7f43b94b5700 1 --2- 172.21.15.44:0/4261770279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43b40b3ae0 0x7f43b406a5b0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009850 tx=0x7f43a4009b60 comp rx=0 tx=0).stop 2024-09-13T18:36:02.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.832+0000 7f43b94b5700 1 -- 172.21.15.44:0/4261770279 shutdown_connections 2024-09-13T18:36:02.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.832+0000 7f43b94b5700 1 --2- 172.21.15.44:0/4261770279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43b40b3ae0 0x7f43b406a5b0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:02.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.832+0000 7f43b94b5700 1 -- 172.21.15.44:0/4261770279 >> 172.21.15.44:0/4261770279 conn(0x7f43b40b0f00 msgr2=0x7f43b40b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:02.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.832+0000 7f43b94b5700 1 -- 172.21.15.44:0/4261770279 shutdown_connections 2024-09-13T18:36:02.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.832+0000 7f43b94b5700 1 -- 172.21.15.44:0/4261770279 wait complete. 2024-09-13T18:36:02.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b94b5700 1 Processor -- start 2024-09-13T18:36:02.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b94b5700 1 -- start start 2024-09-13T18:36:02.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b94b5700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43b406aaf0 0x7f43b4071330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:02.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b94b5700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f43b406bbf0 0x7f43b40cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:02.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b94b5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43b40b3ae0 0x7f43b40cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:02.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b94b5700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b41f6a30 con 0x7f43b40b3ae0 2024-09-13T18:36:02.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b94b5700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b41f5e20 con 0x7f43b406aaf0 2024-09-13T18:36:02.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b94b5700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b41f6100 con 0x7f43b406bbf0 2024-09-13T18:36:02.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b8cb4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43b40b3ae0 0x7f43b40cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:02.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b8cb4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43b40b3ae0 0x7f43b40cc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46164/0 (socket says 172.21.15.44:46164) 2024-09-13T18:36:02.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b8cb4700 1 -- 172.21.15.44:0/1541351629 learned_addr learned my addr 172.21.15.44:0/1541351629 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:02.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b37fe700 1 --2- 172.21.15.44:0/1541351629 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f43b406bbf0 0x7f43b40cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:02.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b3fff700 1 --2- 172.21.15.44:0/1541351629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43b406aaf0 0x7f43b4071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:02.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b8cb4700 1 -- 172.21.15.44:0/1541351629 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f43b406bbf0 msgr2=0x7f43b40cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:02.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b8cb4700 1 --2- 172.21.15.44:0/1541351629 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f43b406bbf0 0x7f43b40cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:02.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b8cb4700 1 -- 172.21.15.44:0/1541351629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43b406aaf0 msgr2=0x7f43b4071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:02.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b8cb4700 1 --2- 172.21.15.44:0/1541351629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43b406aaf0 0x7f43b4071330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:02.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b8cb4700 1 -- 172.21.15.44:0/1541351629 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a40094b0 con 0x7f43b40b3ae0 2024-09-13T18:36:02.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b8cb4700 1 --2- 172.21.15.44:0/1541351629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43b40b3ae0 0x7f43b40cc8c0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00cba0 tx=0x7f43ac00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:02.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b0ff9700 1 -- 172.21.15.44:0/1541351629 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac003c20 con 0x7f43b40b3ae0 2024-09-13T18:36:02.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b0ff9700 1 -- 172.21.15.44:0/1541351629 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac003d80 con 0x7f43b40b3ae0 2024-09-13T18:36:02.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b94b5700 1 -- 172.21.15.44:0/1541351629 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b41f63e0 con 0x7f43b40b3ae0 2024-09-13T18:36:02.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b0ff9700 1 -- 172.21.15.44:0/1541351629 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac00aae0 con 0x7f43b40b3ae0 2024-09-13T18:36:02.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.836+0000 7f43b94b5700 1 -- 172.21.15.44:0/1541351629 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b4071870 con 0x7f43b40b3ae0 2024-09-13T18:36:02.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.840+0000 7f43b94b5700 1 -- 172.21.15.44:0/1541351629 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b406af40 con 0x7f43b40b3ae0 2024-09-13T18:36:02.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.840+0000 7f43b0ff9700 1 -- 172.21.15.44:0/1541351629 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f43ac00ac40 con 0x7f43b40b3ae0 2024-09-13T18:36:02.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.840+0000 7f43b0ff9700 1 --2- 172.21.15.44:0/1541351629 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f43a0066730 0x7f43a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:02.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.840+0000 7f43b0ff9700 1 -- 172.21.15.44:0/1541351629 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43ac084130 con 0x7f43b40b3ae0 2024-09-13T18:36:02.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.840+0000 7f43b3fff700 1 --2- 172.21.15.44:0/1541351629 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f43a0066730 0x7f43a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:02.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.844+0000 7f43b3fff700 1 --2- 172.21.15.44:0/1541351629 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f43a0066730 0x7f43a0068bf0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f43a8005930 tx=0x7f43a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:02.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:02.848+0000 7f43b0ff9700 1 -- 172.21.15.44:0/1541351629 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f43ac0514a0 con 0x7f43b40b3ae0 2024-09-13T18:36:03.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.024+0000 7f43b94b5700 1 -- 172.21.15.44:0/1541351629 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43b41f6b70 con 0x7f43b40b3ae0 2024-09-13T18:36:03.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.028+0000 7f43b0ff9700 1 -- 172.21.15.44:0/1541351629 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16508 (secure 0 0 0) 0x7f43ac054ac0 con 0x7f43b40b3ae0 2024-09-13T18:36:03.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:03.035 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":78,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:35:46.845184+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:44.271295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:44.844157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:03.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.032+0000 7f43b94b5700 1 -- 172.21.15.44:0/1541351629 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f43a0066730 msgr2=0x7f43a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:03.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.032+0000 7f43b94b5700 1 --2- 172.21.15.44:0/1541351629 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f43a0066730 0x7f43a0068bf0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f43a8005930 tx=0x7f43a8009040 comp rx=0 tx=0).stop 2024-09-13T18:36:03.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.032+0000 7f43b94b5700 1 -- 172.21.15.44:0/1541351629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43b40b3ae0 msgr2=0x7f43b40cc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:03.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.032+0000 7f43b94b5700 1 --2- 172.21.15.44:0/1541351629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43b40b3ae0 0x7f43b40cc8c0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00cba0 tx=0x7f43ac00ceb0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.032+0000 7f43b94b5700 1 -- 172.21.15.44:0/1541351629 shutdown_connections 2024-09-13T18:36:03.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.032+0000 7f43b94b5700 1 --2- 172.21.15.44:0/1541351629 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f43a0066730 0x7f43a0068bf0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.032+0000 7f43b94b5700 1 --2- 172.21.15.44:0/1541351629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43b40b3ae0 0x7f43b40cc8c0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.032+0000 7f43b94b5700 1 --2- 172.21.15.44:0/1541351629 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f43b406bbf0 0x7f43b40cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.032+0000 7f43b94b5700 1 --2- 172.21.15.44:0/1541351629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43b406aaf0 0x7f43b4071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.032+0000 7f43b94b5700 1 -- 172.21.15.44:0/1541351629 >> 172.21.15.44:0/1541351629 conn(0x7f43b40b0f00 msgr2=0x7f43b4066110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:03.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.032+0000 7f43b94b5700 1 -- 172.21.15.44:0/1541351629 shutdown_connections 2024-09-13T18:36:03.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.032+0000 7f43b94b5700 1 -- 172.21.15.44:0/1541351629 wait complete. 2024-09-13T18:36:03.052 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:35:44.271295+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:35:44.844157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:36:03.053 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:36:03.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.172+0000 7f8a7532a700 1 Processor -- start 2024-09-13T18:36:03.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.172+0000 7f8a7532a700 1 -- start start 2024-09-13T18:36:03.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.172+0000 7f8a7532a700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8a70144560 0x7f8a700b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:03.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.172+0000 7f8a7532a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a700b5ca0 0x7f8a70072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:03.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.172+0000 7f8a7532a700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a700b4a40 con 0x7f8a70071d00 2024-09-13T18:36:03.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.172+0000 7f8a7532a700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a70144940 con 0x7f8a70144560 2024-09-13T18:36:03.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.172+0000 7f8a7532a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a700726b0 con 0x7f8a700b5ca0 2024-09-13T18:36:03.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.172+0000 7f8a6f7fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8a70071d00 0x7f8a7015e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:32858/0 (socket says 172.21.15.44:32858) 2024-09-13T18:36:03.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.172+0000 7f8a6f7fe700 1 -- 172.21.15.44:0/2924282918 learned_addr learned my addr 172.21.15.44:0/2924282918 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:03.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.172+0000 7f8a74b29700 1 --2- 172.21.15.44:0/2924282918 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a700b5ca0 0x7f8a70072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:03.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.172+0000 7f8a6ffff700 1 --2- 172.21.15.44:0/2924282918 >> v2:172.21.15.99:3300/0 conn(0x7f8a70144560 0x7f8a700b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:03.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.172+0000 7f8a6effd700 1 -- 172.21.15.44:0/2924282918 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2572634740 0 0) 0x7f8a700b4a40 con 0x7f8a70071d00 2024-09-13T18:36:03.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.172+0000 7f8a6effd700 1 -- 172.21.15.44:0/2924282918 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a5c0035d0 con 0x7f8a70071d00 2024-09-13T18:36:03.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.176+0000 7f8a74b29700 1 -- 172.21.15.44:0/2924282918 >> v2:172.21.15.99:3300/0 conn(0x7f8a70144560 msgr2=0x7f8a700b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:03.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.176+0000 7f8a74b29700 1 --2- 172.21.15.44:0/2924282918 >> v2:172.21.15.99:3300/0 conn(0x7f8a70144560 0x7f8a700b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.176+0000 7f8a6effd700 1 -- 172.21.15.44:0/2924282918 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 514912857 0 0) 0x7f8a5c0035d0 con 0x7f8a70071d00 2024-09-13T18:36:03.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.176+0000 7f8a74b29700 1 -- 172.21.15.44:0/2924282918 >> v1:172.21.15.44:6789/0 conn(0x7f8a70071d00 legacy=0x7f8a7015e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:03.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.176+0000 7f8a74b29700 1 -- 172.21.15.44:0/2924282918 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a700cd4b0 con 0x7f8a700b5ca0 2024-09-13T18:36:03.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.176+0000 7f8a74b29700 1 --2- 172.21.15.44:0/2924282918 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a700b5ca0 0x7f8a70072170 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009d90 tx=0x7f8a6800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fe626a85e50bec3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:03.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.176+0000 7f8a6effd700 1 -- 172.21.15.44:0/2924282918 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6800e070 con 0x7f8a700b5ca0 2024-09-13T18:36:03.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.176+0000 7f8a6effd700 1 -- 172.21.15.44:0/2924282918 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a68003a40 con 0x7f8a700b5ca0 2024-09-13T18:36:03.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.176+0000 7f8a6effd700 1 -- 172.21.15.44:0/2924282918 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a60001670 con 0x7f8a700b5ca0 2024-09-13T18:36:03.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.176+0000 7f8a7532a700 1 -- 172.21.15.44:0/2924282918 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a700b5ca0 msgr2=0x7f8a70072170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:03.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.176+0000 7f8a7532a700 1 --2- 172.21.15.44:0/2924282918 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a700b5ca0 0x7f8a70072170 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009d90 tx=0x7f8a6800b330 comp rx=0 tx=0).stop 2024-09-13T18:36:03.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.176+0000 7f8a7532a700 1 -- 172.21.15.44:0/2924282918 shutdown_connections 2024-09-13T18:36:03.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.176+0000 7f8a7532a700 1 --2- 172.21.15.44:0/2924282918 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a700b5ca0 0x7f8a70072170 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.176+0000 7f8a7532a700 1 --2- 172.21.15.44:0/2924282918 >> v2:172.21.15.99:3300/0 conn(0x7f8a70144560 0x7f8a700b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.176+0000 7f8a7532a700 1 -- 172.21.15.44:0/2924282918 >> 172.21.15.44:0/2924282918 conn(0x7f8a7006a310 msgr2=0x7f8a7006a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:03.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.176+0000 7f8a7532a700 1 -- 172.21.15.44:0/2924282918 shutdown_connections 2024-09-13T18:36:03.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.176+0000 7f8a7532a700 1 -- 172.21.15.44:0/2924282918 wait complete. 2024-09-13T18:36:03.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a7532a700 1 Processor -- start 2024-09-13T18:36:03.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a7532a700 1 -- start start 2024-09-13T18:36:03.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a7532a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a70071d00 0x7f8a700b4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:03.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a7532a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a700b5ca0 0x7f8a701efbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:03.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a7532a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a70144560 0x7f8a7015e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:03.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a7532a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7015dde0 con 0x7f8a700b5ca0 2024-09-13T18:36:03.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a7532a700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7015d160 con 0x7f8a70144560 2024-09-13T18:36:03.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a7532a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7015d440 con 0x7f8a70071d00 2024-09-13T18:36:03.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a6f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a700b5ca0 0x7f8a701efbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:03.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a6f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a700b5ca0 0x7f8a701efbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46174/0 (socket says 172.21.15.44:46174) 2024-09-13T18:36:03.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a6f7fe700 1 -- 172.21.15.44:0/858949133 learned_addr learned my addr 172.21.15.44:0/858949133 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:03.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a6ffff700 1 --2- 172.21.15.44:0/858949133 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a70071d00 0x7f8a700b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:03.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a74b29700 1 --2- 172.21.15.44:0/858949133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a70144560 0x7f8a7015e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:03.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a6f7fe700 1 -- 172.21.15.44:0/858949133 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a70071d00 msgr2=0x7f8a700b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:03.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a6f7fe700 1 --2- 172.21.15.44:0/858949133 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a70071d00 0x7f8a700b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a6f7fe700 1 -- 172.21.15.44:0/858949133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a70144560 msgr2=0x7f8a7015e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:03.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a6f7fe700 1 --2- 172.21.15.44:0/858949133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a70144560 0x7f8a7015e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a6f7fe700 1 -- 172.21.15.44:0/858949133 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a68009a70 con 0x7f8a700b5ca0 2024-09-13T18:36:03.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a74b29700 1 --2- 172.21.15.44:0/858949133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a70144560 0x7f8a7015e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:03.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a6f7fe700 1 --2- 172.21.15.44:0/858949133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a700b5ca0 0x7f8a701efbd0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f8a6000c780 tx=0x7f8a6000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:03.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a6cff9700 1 -- 172.21.15.44:0/858949133 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a60004ca0 con 0x7f8a700b5ca0 2024-09-13T18:36:03.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a6cff9700 1 -- 172.21.15.44:0/858949133 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a60004e00 con 0x7f8a700b5ca0 2024-09-13T18:36:03.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a7532a700 1 -- 172.21.15.44:0/858949133 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a7015d720 con 0x7f8a700b5ca0 2024-09-13T18:36:03.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.180+0000 7f8a6cff9700 1 -- 172.21.15.44:0/858949133 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a600072f0 con 0x7f8a700b5ca0 2024-09-13T18:36:03.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.184+0000 7f8a7532a700 1 -- 172.21.15.44:0/858949133 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a700b4760 con 0x7f8a700b5ca0 2024-09-13T18:36:03.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.184+0000 7f8a7532a700 1 -- 172.21.15.44:0/858949133 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a7015df20 con 0x7f8a700b5ca0 2024-09-13T18:36:03.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.184+0000 7f8a6cff9700 1 -- 172.21.15.44:0/858949133 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8a60007450 con 0x7f8a700b5ca0 2024-09-13T18:36:03.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.184+0000 7f8a6cff9700 1 --2- 172.21.15.44:0/858949133 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8a50066730 0x7f8a50068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:03.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.184+0000 7f8a6cff9700 1 -- 172.21.15.44:0/858949133 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a60083e10 con 0x7f8a700b5ca0 2024-09-13T18:36:03.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.184+0000 7f8a6ffff700 1 --2- 172.21.15.44:0/858949133 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8a50066730 0x7f8a50068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:03.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.188+0000 7f8a6ffff700 1 --2- 172.21.15.44:0/858949133 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8a50066730 0x7f8a50068bf0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8a70159b10 tx=0x7f8a58009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:03.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.196+0000 7f8a6cff9700 1 -- 172.21.15.44:0/858949133 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8a60087030 con 0x7f8a700b5ca0 2024-09-13T18:36:03.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.360+0000 7f8a7532a700 1 -- 172.21.15.44:0/858949133 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8a700cd180 con 0x7f8a700b5ca0 2024-09-13T18:36:03.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.360+0000 7f8a6cff9700 1 -- 172.21.15.44:0/858949133 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8a60051170 con 0x7f8a700b5ca0 2024-09-13T18:36:03.367 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:36:03.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.364+0000 7f8a7532a700 1 -- 172.21.15.44:0/858949133 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8a50066730 msgr2=0x7f8a50068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:03.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.364+0000 7f8a7532a700 1 --2- 172.21.15.44:0/858949133 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8a50066730 0x7f8a50068bf0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8a70159b10 tx=0x7f8a58009240 comp rx=0 tx=0).stop 2024-09-13T18:36:03.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.364+0000 7f8a7532a700 1 -- 172.21.15.44:0/858949133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a700b5ca0 msgr2=0x7f8a701efbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:03.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.364+0000 7f8a7532a700 1 --2- 172.21.15.44:0/858949133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a700b5ca0 0x7f8a701efbd0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f8a6000c780 tx=0x7f8a6000ca90 comp rx=0 tx=0).stop 2024-09-13T18:36:03.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.364+0000 7f8a7532a700 1 -- 172.21.15.44:0/858949133 shutdown_connections 2024-09-13T18:36:03.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.364+0000 7f8a7532a700 1 --2- 172.21.15.44:0/858949133 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8a50066730 0x7f8a50068bf0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.364+0000 7f8a7532a700 1 --2- 172.21.15.44:0/858949133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a70144560 0x7f8a7015e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.364+0000 7f8a7532a700 1 --2- 172.21.15.44:0/858949133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a700b5ca0 0x7f8a701efbd0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.364+0000 7f8a7532a700 1 --2- 172.21.15.44:0/858949133 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a70071d00 0x7f8a700b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.364+0000 7f8a7532a700 1 -- 172.21.15.44:0/858949133 >> 172.21.15.44:0/858949133 conn(0x7f8a7006a310 msgr2=0x7f8a700cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:03.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.364+0000 7f8a7532a700 1 -- 172.21.15.44:0/858949133 shutdown_connections 2024-09-13T18:36:03.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.364+0000 7f8a7532a700 1 -- 172.21.15.44:0/858949133 wait complete. 2024-09-13T18:36:03.382 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:36:03.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.492+0000 7ffa46464700 1 Processor -- start 2024-09-13T18:36:03.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.492+0000 7ffa46464700 1 -- start start 2024-09-13T18:36:03.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.492+0000 7ffa46464700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffa4006bcb0 0x7ffa400b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:03.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.492+0000 7ffa46464700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffa400cc8b0 0x7ffa400aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:03.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.492+0000 7ffa46464700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa400ccea0 con 0x7ffa4006c090 2024-09-13T18:36:03.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.492+0000 7ffa46464700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa400b2f80 con 0x7ffa400cc8b0 2024-09-13T18:36:03.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.492+0000 7ffa46464700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa400b3260 con 0x7ffa4006bcb0 2024-09-13T18:36:03.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.492+0000 7ffa45c63700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ffa4006c090 0x7ffa4006c540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:32874/0 (socket says 172.21.15.44:32874) 2024-09-13T18:36:03.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.492+0000 7ffa45c63700 1 -- 172.21.15.44:0/1143521751 learned_addr learned my addr 172.21.15.44:0/1143521751 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:03.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.496+0000 7ffa45462700 1 --2- 172.21.15.44:0/1143521751 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffa4006bcb0 0x7ffa400b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:03.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.496+0000 7ffa44c61700 1 --2- 172.21.15.44:0/1143521751 >> v2:172.21.15.99:3300/0 conn(0x7ffa400cc8b0 0x7ffa400aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:03.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.496+0000 7ffa37fff700 1 -- 172.21.15.44:0/1143521751 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 593088064 0 0) 0x7ffa400ccea0 con 0x7ffa4006c090 2024-09-13T18:36:03.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.496+0000 7ffa37fff700 1 -- 172.21.15.44:0/1143521751 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa2c0035d0 con 0x7ffa4006c090 2024-09-13T18:36:03.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.496+0000 7ffa44c61700 1 -- 172.21.15.44:0/1143521751 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffa4006bcb0 msgr2=0x7ffa400b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:03.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.496+0000 7ffa44c61700 1 --2- 172.21.15.44:0/1143521751 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffa4006bcb0 0x7ffa400b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.496+0000 7ffa44c61700 1 -- 172.21.15.44:0/1143521751 >> v1:172.21.15.44:6789/0 conn(0x7ffa4006c090 legacy=0x7ffa4006c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:03.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.496+0000 7ffa44c61700 1 -- 172.21.15.44:0/1143521751 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa400b3540 con 0x7ffa400cc8b0 2024-09-13T18:36:03.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.496+0000 7ffa44c61700 1 --2- 172.21.15.44:0/1143521751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa400cc8b0 0x7ffa400aeae0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009850 tx=0x7ffa3c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e27cfaf16c937e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:03.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.496+0000 7ffa37fff700 1 -- 172.21.15.44:0/1143521751 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c011830 con 0x7ffa400cc8b0 2024-09-13T18:36:03.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.496+0000 7ffa37fff700 1 -- 172.21.15.44:0/1143521751 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3c011990 con 0x7ffa400cc8b0 2024-09-13T18:36:03.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.496+0000 7ffa37fff700 1 -- 172.21.15.44:0/1143521751 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c011d00 con 0x7ffa400cc8b0 2024-09-13T18:36:03.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.496+0000 7ffa46464700 1 -- 172.21.15.44:0/1143521751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa400cc8b0 msgr2=0x7ffa400aeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:03.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.496+0000 7ffa46464700 1 --2- 172.21.15.44:0/1143521751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa400cc8b0 0x7ffa400aeae0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009850 tx=0x7ffa3c009b60 comp rx=0 tx=0).stop 2024-09-13T18:36:03.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.496+0000 7ffa46464700 1 -- 172.21.15.44:0/1143521751 shutdown_connections 2024-09-13T18:36:03.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.496+0000 7ffa46464700 1 --2- 172.21.15.44:0/1143521751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa400cc8b0 0x7ffa400aeae0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.496+0000 7ffa46464700 1 --2- 172.21.15.44:0/1143521751 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffa4006bcb0 0x7ffa400b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.496+0000 7ffa46464700 1 -- 172.21.15.44:0/1143521751 >> 172.21.15.44:0/1143521751 conn(0x7ffa400b1cd0 msgr2=0x7ffa400cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:03.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.496+0000 7ffa46464700 1 -- 172.21.15.44:0/1143521751 shutdown_connections 2024-09-13T18:36:03.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.496+0000 7ffa46464700 1 -- 172.21.15.44:0/1143521751 wait complete. 2024-09-13T18:36:03.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.500+0000 7ffa46464700 1 Processor -- start 2024-09-13T18:36:03.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.500+0000 7ffa46464700 1 -- start start 2024-09-13T18:36:03.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.500+0000 7ffa46464700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa4006bcb0 0x7ffa40155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:03.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.500+0000 7ffa46464700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa4006c090 0x7ffa401567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:03.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.500+0000 7ffa46464700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffa400cc8b0 0x7ffa401f2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:03.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.500+0000 7ffa46464700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa40154fd0 con 0x7ffa4006bcb0 2024-09-13T18:36:03.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.500+0000 7ffa46464700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa401543c0 con 0x7ffa4006c090 2024-09-13T18:36:03.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.500+0000 7ffa46464700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa401546a0 con 0x7ffa400cc8b0 2024-09-13T18:36:03.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.500+0000 7ffa45462700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa4006bcb0 0x7ffa40155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:03.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.504+0000 7ffa45462700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa4006bcb0 0x7ffa40155460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46190/0 (socket says 172.21.15.44:46190) 2024-09-13T18:36:03.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.504+0000 7ffa45462700 1 -- 172.21.15.44:0/3741464411 learned_addr learned my addr 172.21.15.44:0/3741464411 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:03.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.504+0000 7ffa45c63700 1 --2- 172.21.15.44:0/3741464411 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffa400cc8b0 0x7ffa401f2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:03.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.504+0000 7ffa44c61700 1 --2- 172.21.15.44:0/3741464411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa4006c090 0x7ffa401567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:03.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.504+0000 7ffa45462700 1 -- 172.21.15.44:0/3741464411 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffa400cc8b0 msgr2=0x7ffa401f2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:03.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.504+0000 7ffa45462700 1 --2- 172.21.15.44:0/3741464411 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffa400cc8b0 0x7ffa401f2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.504+0000 7ffa45462700 1 -- 172.21.15.44:0/3741464411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa4006c090 msgr2=0x7ffa401567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:03.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.504+0000 7ffa45462700 1 --2- 172.21.15.44:0/3741464411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa4006c090 0x7ffa401567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.504+0000 7ffa45462700 1 -- 172.21.15.44:0/3741464411 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3c0094b0 con 0x7ffa4006bcb0 2024-09-13T18:36:03.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.504+0000 7ffa45c63700 1 --2- 172.21.15.44:0/3741464411 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffa400cc8b0 0x7ffa401f2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:03.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.504+0000 7ffa44c61700 1 --2- 172.21.15.44:0/3741464411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa4006c090 0x7ffa401567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:03.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.504+0000 7ffa45462700 1 --2- 172.21.15.44:0/3741464411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa4006bcb0 0x7ffa40155460 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000e840 tx=0x7ffa3000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:03.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.504+0000 7ffa35ffb700 1 -- 172.21.15.44:0/3741464411 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa300095a0 con 0x7ffa4006bcb0 2024-09-13T18:36:03.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.504+0000 7ffa35ffb700 1 -- 172.21.15.44:0/3741464411 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3000c690 con 0x7ffa4006bcb0 2024-09-13T18:36:03.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.504+0000 7ffa46464700 1 -- 172.21.15.44:0/3741464411 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa40154980 con 0x7ffa4006bcb0 2024-09-13T18:36:03.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.504+0000 7ffa35ffb700 1 -- 172.21.15.44:0/3741464411 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3000ca00 con 0x7ffa4006bcb0 2024-09-13T18:36:03.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.504+0000 7ffa46464700 1 -- 172.21.15.44:0/3741464411 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4014bf90 con 0x7ffa4006bcb0 2024-09-13T18:36:03.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.504+0000 7ffa46464700 1 -- 172.21.15.44:0/3741464411 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa40072310 con 0x7ffa4006bcb0 2024-09-13T18:36:03.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.504+0000 7ffa35ffb700 1 -- 172.21.15.44:0/3741464411 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffa3000cb60 con 0x7ffa4006bcb0 2024-09-13T18:36:03.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.508+0000 7ffa35ffb700 1 --2- 172.21.15.44:0/3741464411 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ffa24066730 0x7ffa24068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:03.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.508+0000 7ffa35ffb700 1 -- 172.21.15.44:0/3741464411 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa30084140 con 0x7ffa4006bcb0 2024-09-13T18:36:03.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.508+0000 7ffa44c61700 1 --2- 172.21.15.44:0/3741464411 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ffa24066730 0x7ffa24068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:03.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.508+0000 7ffa44c61700 1 --2- 172.21.15.44:0/3741464411 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ffa24066730 0x7ffa24068bf0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009850 tx=0x7ffa3c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:03.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.516+0000 7ffa35ffb700 1 -- 172.21.15.44:0/3741464411 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffa300514b0 con 0x7ffa4006bcb0 2024-09-13T18:36:03.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.692+0000 7ffa46464700 1 -- 172.21.15.44:0/3741464411 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffa400b5780 con 0x7ffa4006bcb0 2024-09-13T18:36:03.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.692+0000 7ffa35ffb700 1 -- 172.21.15.44:0/3741464411 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffa30054ad0 con 0x7ffa4006bcb0 2024-09-13T18:36:03.699 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:36:03.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.692+0000 7ffa46464700 1 -- 172.21.15.44:0/3741464411 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ffa24066730 msgr2=0x7ffa24068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:03.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.692+0000 7ffa46464700 1 --2- 172.21.15.44:0/3741464411 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ffa24066730 0x7ffa24068bf0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009850 tx=0x7ffa3c008030 comp rx=0 tx=0).stop 2024-09-13T18:36:03.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.692+0000 7ffa46464700 1 -- 172.21.15.44:0/3741464411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa4006bcb0 msgr2=0x7ffa40155460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:03.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.692+0000 7ffa46464700 1 --2- 172.21.15.44:0/3741464411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa4006bcb0 0x7ffa40155460 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000e840 tx=0x7ffa3000ec00 comp rx=0 tx=0).stop 2024-09-13T18:36:03.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.696+0000 7ffa46464700 1 -- 172.21.15.44:0/3741464411 shutdown_connections 2024-09-13T18:36:03.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.696+0000 7ffa46464700 1 --2- 172.21.15.44:0/3741464411 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ffa24066730 0x7ffa24068bf0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.696+0000 7ffa46464700 1 --2- 172.21.15.44:0/3741464411 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffa400cc8b0 0x7ffa401f2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.696+0000 7ffa46464700 1 --2- 172.21.15.44:0/3741464411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa4006c090 0x7ffa401567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.696+0000 7ffa46464700 1 --2- 172.21.15.44:0/3741464411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa4006bcb0 0x7ffa40155460 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.696+0000 7ffa46464700 1 -- 172.21.15.44:0/3741464411 >> 172.21.15.44:0/3741464411 conn(0x7ffa400b1cd0 msgr2=0x7ffa40070aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:03.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.696+0000 7ffa46464700 1 -- 172.21.15.44:0/3741464411 shutdown_connections 2024-09-13T18:36:03.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.696+0000 7ffa46464700 1 -- 172.21.15.44:0/3741464411 wait complete. 2024-09-13T18:36:03.714 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:36:03.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.828+0000 7fcd2fcc2700 1 Processor -- start 2024-09-13T18:36:03.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.828+0000 7fcd2fcc2700 1 -- start start 2024-09-13T18:36:03.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.828+0000 7fcd2fcc2700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcd2815cda0 0x7fcd280d1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:03.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.828+0000 7fcd2fcc2700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcd280b5e00 0x7fcd280b6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:03.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.828+0000 7fcd2fcc2700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd280d0880 con 0x7fcd280b6780 2024-09-13T18:36:03.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.828+0000 7fcd2fcc2700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd280cde50 con 0x7fcd280b5e00 2024-09-13T18:36:03.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.828+0000 7fcd2fcc2700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd280d16e0 con 0x7fcd2815cda0 2024-09-13T18:36:03.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.828+0000 7fcd2d25d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcd280b5e00 0x7fcd280b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:03.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.828+0000 7fcd2e25f700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fcd280b6780 0x7fcd2806a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:32890/0 (socket says 172.21.15.44:32890) 2024-09-13T18:36:03.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.828+0000 7fcd2e25f700 1 -- 172.21.15.44:0/3995283105 learned_addr learned my addr 172.21.15.44:0/3995283105 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:03.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.828+0000 7fcd2da5e700 1 --2- 172.21.15.44:0/3995283105 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcd2815cda0 0x7fcd280d1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:03.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.828+0000 7fcd2d25d700 1 -- 172.21.15.44:0/3995283105 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcd2815cda0 msgr2=0x7fcd280d1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:03.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.828+0000 7fcd2d25d700 1 --2- 172.21.15.44:0/3995283105 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcd2815cda0 0x7fcd280d1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.828+0000 7fcd2d25d700 1 -- 172.21.15.44:0/3995283105 >> v1:172.21.15.44:6789/0 conn(0x7fcd280b6780 legacy=0x7fcd2806a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:03.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.828+0000 7fcd2d25d700 1 -- 172.21.15.44:0/3995283105 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd280d0ad0 con 0x7fcd280b5e00 2024-09-13T18:36:03.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.828+0000 7fcd2da5e700 1 --2- 172.21.15.44:0/3995283105 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcd2815cda0 0x7fcd280d1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:03.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.832+0000 7fcd2d25d700 1 --2- 172.21.15.44:0/3995283105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd280b5e00 0x7fcd280b6240 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fcd18009880 tx=0x7fcd18009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42d9cca6c6db80b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:03.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.832+0000 7fcd2ca5c700 1 -- 172.21.15.44:0/3995283105 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18011830 con 0x7fcd280b5e00 2024-09-13T18:36:03.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.832+0000 7fcd2ca5c700 1 -- 172.21.15.44:0/3995283105 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd18011990 con 0x7fcd280b5e00 2024-09-13T18:36:03.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.832+0000 7fcd2ca5c700 1 -- 172.21.15.44:0/3995283105 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18011d20 con 0x7fcd280b5e00 2024-09-13T18:36:03.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.832+0000 7fcd2fcc2700 1 -- 172.21.15.44:0/3995283105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd280b5e00 msgr2=0x7fcd280b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:03.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.832+0000 7fcd2fcc2700 1 --2- 172.21.15.44:0/3995283105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd280b5e00 0x7fcd280b6240 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fcd18009880 tx=0x7fcd18009b90 comp rx=0 tx=0).stop 2024-09-13T18:36:03.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.832+0000 7fcd2fcc2700 1 -- 172.21.15.44:0/3995283105 shutdown_connections 2024-09-13T18:36:03.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.832+0000 7fcd2fcc2700 1 --2- 172.21.15.44:0/3995283105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd280b5e00 0x7fcd280b6240 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.832+0000 7fcd2fcc2700 1 --2- 172.21.15.44:0/3995283105 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcd2815cda0 0x7fcd280d1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.832+0000 7fcd2fcc2700 1 -- 172.21.15.44:0/3995283105 >> 172.21.15.44:0/3995283105 conn(0x7fcd280d2cb0 msgr2=0x7fcd280d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:03.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.832+0000 7fcd2fcc2700 1 -- 172.21.15.44:0/3995283105 shutdown_connections 2024-09-13T18:36:03.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.832+0000 7fcd2fcc2700 1 -- 172.21.15.44:0/3995283105 wait complete. 2024-09-13T18:36:03.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.832+0000 7fcd2fcc2700 1 Processor -- start 2024-09-13T18:36:03.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.832+0000 7fcd2fcc2700 1 -- start start 2024-09-13T18:36:03.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.836+0000 7fcd2fcc2700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd280b5e00 0x7fcd28156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:03.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.836+0000 7fcd2fcc2700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcd280b6780 0x7fcd28153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:03.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.836+0000 7fcd2fcc2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd2815cda0 0x7fcd280c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:03.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.836+0000 7fcd2fcc2700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd281567d0 con 0x7fcd2815cda0 2024-09-13T18:36:03.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.836+0000 7fcd2fcc2700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd28153f40 con 0x7fcd280b5e00 2024-09-13T18:36:03.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.836+0000 7fcd2fcc2700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd281541e0 con 0x7fcd280b6780 2024-09-13T18:36:03.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.836+0000 7fcd2e25f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd2815cda0 0x7fcd280c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:03.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.836+0000 7fcd2e25f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd2815cda0 0x7fcd280c8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46210/0 (socket says 172.21.15.44:46210) 2024-09-13T18:36:03.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.836+0000 7fcd2e25f700 1 -- 172.21.15.44:0/3847166445 learned_addr learned my addr 172.21.15.44:0/3847166445 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:03.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.836+0000 7fcd2d25d700 1 --2- 172.21.15.44:0/3847166445 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcd280b6780 0x7fcd28153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:03.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.836+0000 7fcd2da5e700 1 --2- 172.21.15.44:0/3847166445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd280b5e00 0x7fcd28156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:03.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.836+0000 7fcd2e25f700 1 -- 172.21.15.44:0/3847166445 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcd280b6780 msgr2=0x7fcd28153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:03.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.836+0000 7fcd2e25f700 1 --2- 172.21.15.44:0/3847166445 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcd280b6780 0x7fcd28153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.836+0000 7fcd2e25f700 1 -- 172.21.15.44:0/3847166445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd280b5e00 msgr2=0x7fcd28156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:03.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.836+0000 7fcd2e25f700 1 --2- 172.21.15.44:0/3847166445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd280b5e00 0x7fcd28156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:03.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.836+0000 7fcd2e25f700 1 -- 172.21.15.44:0/3847166445 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd240094b0 con 0x7fcd2815cda0 2024-09-13T18:36:03.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.836+0000 7fcd2e25f700 1 --2- 172.21.15.44:0/3847166445 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd2815cda0 0x7fcd280c8b40 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fcd2000cb10 tx=0x7fcd2000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:03.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.836+0000 7fcd1e7fc700 1 -- 172.21.15.44:0/3847166445 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd20007480 con 0x7fcd2815cda0 2024-09-13T18:36:03.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.836+0000 7fcd1e7fc700 1 -- 172.21.15.44:0/3847166445 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd200075e0 con 0x7fcd2815cda0 2024-09-13T18:36:03.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.836+0000 7fcd2fcc2700 1 -- 172.21.15.44:0/3847166445 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd180094b0 con 0x7fcd2815cda0 2024-09-13T18:36:03.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.836+0000 7fcd1e7fc700 1 -- 172.21.15.44:0/3847166445 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd20007950 con 0x7fcd2815cda0 2024-09-13T18:36:03.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.836+0000 7fcd2fcc2700 1 -- 172.21.15.44:0/3847166445 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd28154a80 con 0x7fcd2815cda0 2024-09-13T18:36:03.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.840+0000 7fcd2fcc2700 1 -- 172.21.15.44:0/3847166445 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd280b6240 con 0x7fcd2815cda0 2024-09-13T18:36:03.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.840+0000 7fcd1e7fc700 1 -- 172.21.15.44:0/3847166445 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcd2001b3b0 con 0x7fcd2815cda0 2024-09-13T18:36:03.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.840+0000 7fcd1e7fc700 1 --2- 172.21.15.44:0/3847166445 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcd0c066730 0x7fcd0c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:03.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.840+0000 7fcd1e7fc700 1 -- 172.21.15.44:0/3847166445 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd20083e20 con 0x7fcd2815cda0 2024-09-13T18:36:03.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.840+0000 7fcd2da5e700 1 --2- 172.21.15.44:0/3847166445 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcd0c066730 0x7fcd0c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:03.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.840+0000 7fcd2da5e700 1 --2- 172.21.15.44:0/3847166445 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcd0c066730 0x7fcd0c068bf0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fcd24009ce0 tx=0x7fcd24009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:03.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:03.848+0000 7fcd1e7fc700 1 -- 172.21.15.44:0/3847166445 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcd20051240 con 0x7fcd2815cda0 2024-09-13T18:36:04.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.020+0000 7fcd2fcc2700 1 -- 172.21.15.44:0/3847166445 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcd2806b040 con 0x7fcd2815cda0 2024-09-13T18:36:04.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.020+0000 7fcd1e7fc700 1 -- 172.21.15.44:0/3847166445 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcd20054860 con 0x7fcd2815cda0 2024-09-13T18:36:04.026 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:36:04.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.020+0000 7fcd2fcc2700 1 -- 172.21.15.44:0/3847166445 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcd0c066730 msgr2=0x7fcd0c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.020+0000 7fcd2fcc2700 1 --2- 172.21.15.44:0/3847166445 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcd0c066730 0x7fcd0c068bf0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fcd24009ce0 tx=0x7fcd24009240 comp rx=0 tx=0).stop 2024-09-13T18:36:04.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.020+0000 7fcd2fcc2700 1 -- 172.21.15.44:0/3847166445 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd2815cda0 msgr2=0x7fcd280c8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.020+0000 7fcd2fcc2700 1 --2- 172.21.15.44:0/3847166445 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd2815cda0 0x7fcd280c8b40 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fcd2000cb10 tx=0x7fcd2000cb40 comp rx=0 tx=0).stop 2024-09-13T18:36:04.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.020+0000 7fcd2fcc2700 1 -- 172.21.15.44:0/3847166445 shutdown_connections 2024-09-13T18:36:04.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.020+0000 7fcd2fcc2700 1 --2- 172.21.15.44:0/3847166445 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcd0c066730 0x7fcd0c068bf0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.020+0000 7fcd2fcc2700 1 --2- 172.21.15.44:0/3847166445 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd2815cda0 0x7fcd280c8b40 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.020+0000 7fcd2fcc2700 1 --2- 172.21.15.44:0/3847166445 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcd280b6780 0x7fcd28153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.020+0000 7fcd2fcc2700 1 --2- 172.21.15.44:0/3847166445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd280b5e00 0x7fcd28156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.020+0000 7fcd2fcc2700 1 -- 172.21.15.44:0/3847166445 >> 172.21.15.44:0/3847166445 conn(0x7fcd280d2cb0 msgr2=0x7fcd280d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:04.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.020+0000 7fcd2fcc2700 1 -- 172.21.15.44:0/3847166445 shutdown_connections 2024-09-13T18:36:04.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.020+0000 7fcd2fcc2700 1 -- 172.21.15.44:0/3847166445 wait complete. 2024-09-13T18:36:04.041 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:36:04.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.152+0000 7fdcf2eff700 1 Processor -- start 2024-09-13T18:36:04.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.156+0000 7fdcf2eff700 1 -- start start 2024-09-13T18:36:04.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.156+0000 7fdcf2eff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdce4006c80 0x7fdce400aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:04.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.156+0000 7fdcf2eff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce401d380 con 0x7fdce400a5b0 2024-09-13T18:36:04.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.156+0000 7fdcf2eff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce401df20 con 0x7fdce40e0760 2024-09-13T18:36:04.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.156+0000 7fdcf2eff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce400af60 con 0x7fdce4006c80 2024-09-13T18:36:04.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.156+0000 7fdcf26fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdce4006c80 0x7fdce400aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:04.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.156+0000 7fdcf26fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdce4006c80 0x7fdce400aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46220/0 (socket says 172.21.15.44:46220) 2024-09-13T18:36:04.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.156+0000 7fdcf16fc700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fdce400a5b0 0x7fdce4006570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:32906/0 (socket says 172.21.15.44:32906) 2024-09-13T18:36:04.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.156+0000 7fdcf26fe700 1 -- 172.21.15.44:0/943000989 learned_addr learned my addr 172.21.15.44:0/943000989 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:04.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.156+0000 7fdcf26fe700 1 -- 172.21.15.44:0/943000989 >> v1:172.21.15.99:6789/0 conn(0x7fdce40e0760 legacy=0x7fdce401d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:04.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.156+0000 7fdcf26fe700 1 -- 172.21.15.44:0/943000989 >> v1:172.21.15.44:6789/0 conn(0x7fdce400a5b0 legacy=0x7fdce4006570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.156+0000 7fdcf26fe700 1 -- 172.21.15.44:0/943000989 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce401c770 con 0x7fdce4006c80 2024-09-13T18:36:04.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.156+0000 7fdcf26fe700 1 --2- 172.21.15.44:0/943000989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdce4006c80 0x7fdce400aa20 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fdcec063990 tx=0x7fdcec04f750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e1800623b3705f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:04.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.156+0000 7fdcf0efb700 1 -- 172.21.15.44:0/943000989 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec0730f0 con 0x7fdce4006c80 2024-09-13T18:36:04.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.156+0000 7fdcf0efb700 1 -- 172.21.15.44:0/943000989 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcec08e070 con 0x7fdce4006c80 2024-09-13T18:36:04.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.156+0000 7fdcf0efb700 1 -- 172.21.15.44:0/943000989 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec073470 con 0x7fdce4006c80 2024-09-13T18:36:04.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.156+0000 7fdcf2eff700 1 -- 172.21.15.44:0/943000989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdce4006c80 msgr2=0x7fdce400aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.156+0000 7fdcf2eff700 1 --2- 172.21.15.44:0/943000989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdce4006c80 0x7fdce400aa20 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fdcec063990 tx=0x7fdcec04f750 comp rx=0 tx=0).stop 2024-09-13T18:36:04.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.156+0000 7fdcf2eff700 1 -- 172.21.15.44:0/943000989 shutdown_connections 2024-09-13T18:36:04.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.156+0000 7fdcf2eff700 1 --2- 172.21.15.44:0/943000989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdce4006c80 0x7fdce400aa20 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.156+0000 7fdcf2eff700 1 -- 172.21.15.44:0/943000989 >> 172.21.15.44:0/943000989 conn(0x7fdce4036140 msgr2=0x7fdce4036550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:04.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.156+0000 7fdcf2eff700 1 -- 172.21.15.44:0/943000989 shutdown_connections 2024-09-13T18:36:04.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.156+0000 7fdcf2eff700 1 -- 172.21.15.44:0/943000989 wait complete. 2024-09-13T18:36:04.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.160+0000 7fdcf2eff700 1 Processor -- start 2024-09-13T18:36:04.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.160+0000 7fdcf2eff700 1 -- start start 2024-09-13T18:36:04.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdcf2eff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdce4006c80 0x7fdce40d7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:04.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdcf2eff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdce400a5b0 0x7fdce41664c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:04.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdcf2eff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdce40e0760 0x7fdce404e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:04.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdcf2eff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce404bb70 con 0x7fdce4006c80 2024-09-13T18:36:04.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdcf2eff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce404be50 con 0x7fdce40e0760 2024-09-13T18:36:04.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdcf2eff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce404c130 con 0x7fdce400a5b0 2024-09-13T18:36:04.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdcf1efd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdce4006c80 0x7fdce40d7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:04.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdcf1efd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdce4006c80 0x7fdce40d7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46232/0 (socket says 172.21.15.44:46232) 2024-09-13T18:36:04.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdcf1efd700 1 -- 172.21.15.44:0/3414387446 learned_addr learned my addr 172.21.15.44:0/3414387446 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:04.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdcf16fc700 1 --2- 172.21.15.44:0/3414387446 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdce400a5b0 0x7fdce41664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:04.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdcf26fe700 1 --2- 172.21.15.44:0/3414387446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdce40e0760 0x7fdce404e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:04.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdcf1efd700 1 -- 172.21.15.44:0/3414387446 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdce400a5b0 msgr2=0x7fdce41664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdcf1efd700 1 --2- 172.21.15.44:0/3414387446 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdce400a5b0 0x7fdce41664c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdcf1efd700 1 -- 172.21.15.44:0/3414387446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdce40e0760 msgr2=0x7fdce404e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdcf1efd700 1 --2- 172.21.15.44:0/3414387446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdce40e0760 0x7fdce404e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdcf1efd700 1 -- 172.21.15.44:0/3414387446 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcec04f5c0 con 0x7fdce4006c80 2024-09-13T18:36:04.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdcf1efd700 1 --2- 172.21.15.44:0/3414387446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdce4006c80 0x7fdce40d7860 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fdce800c4d0 tx=0x7fdce800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:04.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdce27fc700 1 -- 172.21.15.44:0/3414387446 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce8011790 con 0x7fdce4006c80 2024-09-13T18:36:04.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdce27fc700 1 -- 172.21.15.44:0/3414387446 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce80118f0 con 0x7fdce4006c80 2024-09-13T18:36:04.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdcf2eff700 1 -- 172.21.15.44:0/3414387446 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce404c410 con 0x7fdce4006c80 2024-09-13T18:36:04.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdce27fc700 1 -- 172.21.15.44:0/3414387446 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce8011ca0 con 0x7fdce4006c80 2024-09-13T18:36:04.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdcf2eff700 1 -- 172.21.15.44:0/3414387446 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce4037480 con 0x7fdce4006c80 2024-09-13T18:36:04.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdce27fc700 1 -- 172.21.15.44:0/3414387446 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdce8012420 con 0x7fdce4006c80 2024-09-13T18:36:04.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdcf2eff700 1 -- 172.21.15.44:0/3414387446 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce400aa20 con 0x7fdce4006c80 2024-09-13T18:36:04.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.164+0000 7fdce27fc700 1 --2- 172.21.15.44:0/3414387446 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdcd0066760 0x7fdcd0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:04.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.168+0000 7fdce27fc700 1 -- 172.21.15.44:0/3414387446 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdce8083d20 con 0x7fdce4006c80 2024-09-13T18:36:04.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.168+0000 7fdcf16fc700 1 --2- 172.21.15.44:0/3414387446 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdcd0066760 0x7fdcd0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:04.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.168+0000 7fdcf16fc700 1 --2- 172.21.15.44:0/3414387446 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdcd0066760 0x7fdcd0068c20 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fdce40db990 tx=0x7fdcdc007d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:04.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.172+0000 7fdce27fc700 1 -- 172.21.15.44:0/3414387446 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdce8051090 con 0x7fdce4006c80 2024-09-13T18:36:04.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.388+0000 7fdcf2eff700 1 -- 172.21.15.44:0/3414387446 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdce4036da0 con 0x7fdce4006c80 2024-09-13T18:36:04.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.388+0000 7fdce27fc700 1 -- 172.21.15.44:0/3414387446 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4736 (secure 0 0 0) 0x7fdce80546b0 con 0x7fdce4006c80 2024-09-13T18:36:04.394 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:04.395 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":70,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3463035694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3463035694},{"type":"v1","addr":"172.21.15.99:6837","nonce":3463035694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7438,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2910652037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2910652037},{"type":"v1","addr":"172.21.15.44:6833","nonce":2910652037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7456,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2231812307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2231812307},{"type":"v1","addr":"172.21.15.99:6835","nonce":2231812307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:35:45.841782+0000","modified":"2024-09-13T18:35:48.860780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7626},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7626":{"gid":7626,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/1921610909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1921610909},{"type":"v1","addr":"172.21.15.44:6835","nonce":1921610909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:36:04.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.388+0000 7fdcf2eff700 1 -- 172.21.15.44:0/3414387446 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdcd0066760 msgr2=0x7fdcd0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.392+0000 7fdcf2eff700 1 --2- 172.21.15.44:0/3414387446 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdcd0066760 0x7fdcd0068c20 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fdce40db990 tx=0x7fdcdc007d90 comp rx=0 tx=0).stop 2024-09-13T18:36:04.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.392+0000 7fdcf2eff700 1 -- 172.21.15.44:0/3414387446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdce4006c80 msgr2=0x7fdce40d7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.392+0000 7fdcf2eff700 1 --2- 172.21.15.44:0/3414387446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdce4006c80 0x7fdce40d7860 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fdce800c4d0 tx=0x7fdce800c890 comp rx=0 tx=0).stop 2024-09-13T18:36:04.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.392+0000 7fdcf2eff700 1 -- 172.21.15.44:0/3414387446 shutdown_connections 2024-09-13T18:36:04.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.392+0000 7fdcf2eff700 1 --2- 172.21.15.44:0/3414387446 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fdcd0066760 0x7fdcd0068c20 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.392+0000 7fdcf2eff700 1 --2- 172.21.15.44:0/3414387446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdce40e0760 0x7fdce404e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.392+0000 7fdcf2eff700 1 --2- 172.21.15.44:0/3414387446 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdce400a5b0 0x7fdce41664c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.392+0000 7fdcf2eff700 1 --2- 172.21.15.44:0/3414387446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdce4006c80 0x7fdce40d7860 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.392+0000 7fdcf2eff700 1 -- 172.21.15.44:0/3414387446 >> 172.21.15.44:0/3414387446 conn(0x7fdce4036140 msgr2=0x7fdce4052190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:04.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.392+0000 7fdcf2eff700 1 -- 172.21.15.44:0/3414387446 shutdown_connections 2024-09-13T18:36:04.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.392+0000 7fdcf2eff700 1 -- 172.21.15.44:0/3414387446 wait complete. 2024-09-13T18:36:04.399 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 70 2024-09-13T18:36:04.411 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:04.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.516+0000 7f2a9f2cc700 1 Processor -- start 2024-09-13T18:36:04.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.516+0000 7f2a9f2cc700 1 -- start start 2024-09-13T18:36:04.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.516+0000 7f2a9f2cc700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2a98159720 0x7f2a9806cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:04.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.516+0000 7f2a9f2cc700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2a9806aa90 0x7f2a980b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:04.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.516+0000 7f2a9f2cc700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a9806aed0 con 0x7f2a980b3910 2024-09-13T18:36:04.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.516+0000 7f2a9f2cc700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a980b3da0 con 0x7f2a98159720 2024-09-13T18:36:04.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.516+0000 7f2a9f2cc700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9806d690 con 0x7f2a9806aa90 2024-09-13T18:36:04.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.516+0000 7f2a9e2ca700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2a98159720 0x7f2a9806cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:04.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.516+0000 7f2a9eacb700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2a980b3910 0x7f2a98070c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:32914/0 (socket says 172.21.15.44:32914) 2024-09-13T18:36:04.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.516+0000 7f2a9eacb700 1 -- 172.21.15.44:0/519891805 learned_addr learned my addr 172.21.15.44:0/519891805 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:04.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.516+0000 7f2a9dac9700 1 --2- 172.21.15.44:0/519891805 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2a9806aa90 0x7f2a980b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:04.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.520+0000 7f2a9d2c8700 1 -- 172.21.15.44:0/519891805 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3031564162 0 0) 0x7f2a9806aed0 con 0x7f2a980b3910 2024-09-13T18:36:04.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.520+0000 7f2a9d2c8700 1 -- 172.21.15.44:0/519891805 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a840035d0 con 0x7f2a980b3910 2024-09-13T18:36:04.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.520+0000 7f2a9e2ca700 1 -- 172.21.15.44:0/519891805 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2a9806aa90 msgr2=0x7f2a980b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:04.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.520+0000 7f2a9e2ca700 1 --2- 172.21.15.44:0/519891805 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2a9806aa90 0x7f2a980b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.520+0000 7f2a9e2ca700 1 -- 172.21.15.44:0/519891805 >> v1:172.21.15.44:6789/0 conn(0x7f2a980b3910 legacy=0x7f2a98070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.520+0000 7f2a9e2ca700 1 -- 172.21.15.44:0/519891805 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a980cbfe0 con 0x7f2a98159720 2024-09-13T18:36:04.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.520+0000 7f2a9e2ca700 1 --2- 172.21.15.44:0/519891805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a98159720 0x7f2a9806cf90 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f2a88009850 tx=0x7f2a88009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8bdd6572bcb49d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:04.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.520+0000 7f2a9d2c8700 1 -- 172.21.15.44:0/519891805 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a88011830 con 0x7f2a98159720 2024-09-13T18:36:04.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.520+0000 7f2a9d2c8700 1 -- 172.21.15.44:0/519891805 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a88011990 con 0x7f2a98159720 2024-09-13T18:36:04.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.520+0000 7f2a9d2c8700 1 -- 172.21.15.44:0/519891805 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a88011d40 con 0x7f2a98159720 2024-09-13T18:36:04.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.520+0000 7f2a9f2cc700 1 -- 172.21.15.44:0/519891805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a98159720 msgr2=0x7f2a9806cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.520+0000 7f2a9f2cc700 1 --2- 172.21.15.44:0/519891805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a98159720 0x7f2a9806cf90 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f2a88009850 tx=0x7f2a88009b60 comp rx=0 tx=0).stop 2024-09-13T18:36:04.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.520+0000 7f2a9f2cc700 1 -- 172.21.15.44:0/519891805 shutdown_connections 2024-09-13T18:36:04.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.520+0000 7f2a9f2cc700 1 --2- 172.21.15.44:0/519891805 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2a9806aa90 0x7f2a980b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.520+0000 7f2a9f2cc700 1 --2- 172.21.15.44:0/519891805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a98159720 0x7f2a9806cf90 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.520+0000 7f2a9f2cc700 1 -- 172.21.15.44:0/519891805 >> 172.21.15.44:0/519891805 conn(0x7f2a980b0f00 msgr2=0x7f2a980b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:04.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.520+0000 7f2a9f2cc700 1 -- 172.21.15.44:0/519891805 shutdown_connections 2024-09-13T18:36:04.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.520+0000 7f2a9f2cc700 1 -- 172.21.15.44:0/519891805 wait complete. 2024-09-13T18:36:04.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.520+0000 7f2a9f2cc700 1 Processor -- start 2024-09-13T18:36:04.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.520+0000 7f2a9f2cc700 1 -- start start 2024-09-13T18:36:04.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.524+0000 7f2a9f2cc700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2a9806aa90 0x7f2a98159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:04.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.524+0000 7f2a9f2cc700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a980b3910 0x7f2a981523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:04.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.524+0000 7f2a9f2cc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a98159720 0x7f2a980ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:04.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.524+0000 7f2a9f2cc700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a981647f0 con 0x7f2a98159720 2024-09-13T18:36:04.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.524+0000 7f2a9f2cc700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a98164ad0 con 0x7f2a980b3910 2024-09-13T18:36:04.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.524+0000 7f2a9f2cc700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a98164db0 con 0x7f2a9806aa90 2024-09-13T18:36:04.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.524+0000 7f2a9eacb700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a98159720 0x7f2a980ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:04.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.524+0000 7f2a9eacb700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a98159720 0x7f2a980ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46254/0 (socket says 172.21.15.44:46254) 2024-09-13T18:36:04.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.524+0000 7f2a9eacb700 1 -- 172.21.15.44:0/97830297 learned_addr learned my addr 172.21.15.44:0/97830297 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:04.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.524+0000 7f2a9dac9700 1 --2- 172.21.15.44:0/97830297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a980b3910 0x7f2a981523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:04.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.524+0000 7f2a9e2ca700 1 --2- 172.21.15.44:0/97830297 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2a9806aa90 0x7f2a98159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:04.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.524+0000 7f2a9eacb700 1 -- 172.21.15.44:0/97830297 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2a9806aa90 msgr2=0x7f2a98159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.524+0000 7f2a9eacb700 1 --2- 172.21.15.44:0/97830297 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2a9806aa90 0x7f2a98159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.524+0000 7f2a9eacb700 1 -- 172.21.15.44:0/97830297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a980b3910 msgr2=0x7f2a981523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.524+0000 7f2a9eacb700 1 --2- 172.21.15.44:0/97830297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a980b3910 0x7f2a981523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.524+0000 7f2a9eacb700 1 -- 172.21.15.44:0/97830297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a880094b0 con 0x7f2a98159720 2024-09-13T18:36:04.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.524+0000 7f2a9eacb700 1 --2- 172.21.15.44:0/97830297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a98159720 0x7f2a980ae540 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f2a9000cb40 tx=0x7f2a9000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:04.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.524+0000 7f2a8effd700 1 -- 172.21.15.44:0/97830297 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a90007500 con 0x7f2a98159720 2024-09-13T18:36:04.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.524+0000 7f2a8effd700 1 -- 172.21.15.44:0/97830297 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a90007660 con 0x7f2a98159720 2024-09-13T18:36:04.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.524+0000 7f2a8effd700 1 -- 172.21.15.44:0/97830297 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a900079f0 con 0x7f2a98159720 2024-09-13T18:36:04.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.524+0000 7f2a9f2cc700 1 -- 172.21.15.44:0/97830297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a98165090 con 0x7f2a98159720 2024-09-13T18:36:04.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.524+0000 7f2a9f2cc700 1 -- 172.21.15.44:0/97830297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a9815a2e0 con 0x7f2a98159720 2024-09-13T18:36:04.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.524+0000 7f2a9f2cc700 1 -- 172.21.15.44:0/97830297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a981655b0 con 0x7f2a98159720 2024-09-13T18:36:04.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.528+0000 7f2a8effd700 1 -- 172.21.15.44:0/97830297 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2a9001b3b0 con 0x7f2a98159720 2024-09-13T18:36:04.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.528+0000 7f2a8effd700 1 --2- 172.21.15.44:0/97830297 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2a7c066760 0x7f2a7c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:04.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.528+0000 7f2a8effd700 1 -- 172.21.15.44:0/97830297 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a90083aa0 con 0x7f2a98159720 2024-09-13T18:36:04.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.528+0000 7f2a9e2ca700 1 --2- 172.21.15.44:0/97830297 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2a7c066760 0x7f2a7c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:04.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.528+0000 7f2a9e2ca700 1 --2- 172.21.15.44:0/97830297 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2a7c066760 0x7f2a7c068c20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2a880090b0 tx=0x7f2a8801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:04.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.536+0000 7f2a8effd700 1 -- 172.21.15.44:0/97830297 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2a90050ea0 con 0x7f2a98159720 2024-09-13T18:36:04.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.708+0000 7f2a9f2cc700 1 -- 172.21.15.44:0/97830297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a980b33d0 con 0x7f2a98159720 2024-09-13T18:36:04.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.708+0000 7f2a8effd700 1 -- 172.21.15.44:0/97830297 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16508 (secure 0 0 0) 0x7f2a900544c0 con 0x7f2a98159720 2024-09-13T18:36:04.717 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:04.717 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":78,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:35:46.845184+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:44.271295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:44.844157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:04.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.712+0000 7f2a9f2cc700 1 -- 172.21.15.44:0/97830297 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2a7c066760 msgr2=0x7f2a7c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.712+0000 7f2a9f2cc700 1 --2- 172.21.15.44:0/97830297 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2a7c066760 0x7f2a7c068c20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2a880090b0 tx=0x7f2a8801c040 comp rx=0 tx=0).stop 2024-09-13T18:36:04.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.712+0000 7f2a9f2cc700 1 -- 172.21.15.44:0/97830297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a98159720 msgr2=0x7f2a980ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.712+0000 7f2a9f2cc700 1 --2- 172.21.15.44:0/97830297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a98159720 0x7f2a980ae540 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f2a9000cb40 tx=0x7f2a9000cb70 comp rx=0 tx=0).stop 2024-09-13T18:36:04.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.712+0000 7f2a9f2cc700 1 -- 172.21.15.44:0/97830297 shutdown_connections 2024-09-13T18:36:04.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.712+0000 7f2a9f2cc700 1 --2- 172.21.15.44:0/97830297 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2a7c066760 0x7f2a7c068c20 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.712+0000 7f2a9f2cc700 1 --2- 172.21.15.44:0/97830297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a98159720 0x7f2a980ae540 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.712+0000 7f2a9f2cc700 1 --2- 172.21.15.44:0/97830297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a980b3910 0x7f2a981523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.712+0000 7f2a9f2cc700 1 --2- 172.21.15.44:0/97830297 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2a9806aa90 0x7f2a98159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.712+0000 7f2a9f2cc700 1 -- 172.21.15.44:0/97830297 >> 172.21.15.44:0/97830297 conn(0x7f2a980b0f00 msgr2=0x7f2a98156e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:04.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.712+0000 7f2a9f2cc700 1 -- 172.21.15.44:0/97830297 shutdown_connections 2024-09-13T18:36:04.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.712+0000 7f2a9f2cc700 1 -- 172.21.15.44:0/97830297 wait complete. 2024-09-13T18:36:04.733 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:36:04.733 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:36:04.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.840+0000 7f5d9188b700 1 Processor -- start 2024-09-13T18:36:04.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.840+0000 7f5d9188b700 1 -- start start 2024-09-13T18:36:04.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.844+0000 7f5d9188b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d8c0adba0 0x7f5d8c0b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:04.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.844+0000 7f5d9188b700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d8c15b020 con 0x7f5d8c0ad710 2024-09-13T18:36:04.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.844+0000 7f5d9188b700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d8c06a6f0 con 0x7f5d8c15ac40 2024-09-13T18:36:04.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.844+0000 7f5d9188b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c0b3df0 con 0x7f5d8c0adba0 2024-09-13T18:36:04.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.844+0000 7f5d8a7fc700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5d8c0ad710 0x7f5d8c0b21d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:32918/0 (socket says 172.21.15.44:32918) 2024-09-13T18:36:04.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.844+0000 7f5d8a7fc700 1 -- 172.21.15.44:0/282125039 learned_addr learned my addr 172.21.15.44:0/282125039 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:04.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.844+0000 7f5d8b7fe700 1 --2- 172.21.15.44:0/282125039 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d8c0adba0 0x7f5d8c0b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:04.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.844+0000 7f5d89ffb700 1 -- 172.21.15.44:0/282125039 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855763002 0 0) 0x7f5d8c15b020 con 0x7f5d8c0ad710 2024-09-13T18:36:04.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.844+0000 7f5d89ffb700 1 -- 172.21.15.44:0/282125039 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d740035d0 con 0x7f5d8c0ad710 2024-09-13T18:36:04.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.844+0000 7f5d8b7fe700 1 -- 172.21.15.44:0/282125039 >> v1:172.21.15.99:6789/0 conn(0x7f5d8c15ac40 legacy=0x7f5d8c06ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.844+0000 7f5d8b7fe700 1 -- 172.21.15.44:0/282125039 >> v1:172.21.15.44:6789/0 conn(0x7f5d8c0ad710 legacy=0x7f5d8c0b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.844+0000 7f5d8b7fe700 1 -- 172.21.15.44:0/282125039 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c06a9d0 con 0x7f5d8c0adba0 2024-09-13T18:36:04.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.844+0000 7f5d8b7fe700 1 --2- 172.21.15.44:0/282125039 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d8c0adba0 0x7f5d8c0b28e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5d84009dc0 tx=0x7f5d8400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a4f1d31d6d0cc28 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:04.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.844+0000 7f5d89ffb700 1 -- 172.21.15.44:0/282125039 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8400e070 con 0x7f5d8c0adba0 2024-09-13T18:36:04.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.844+0000 7f5d89ffb700 1 -- 172.21.15.44:0/282125039 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8400bb20 con 0x7f5d8c0adba0 2024-09-13T18:36:04.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.844+0000 7f5d89ffb700 1 -- 172.21.15.44:0/282125039 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8400be90 con 0x7f5d8c0adba0 2024-09-13T18:36:04.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.844+0000 7f5d9188b700 1 -- 172.21.15.44:0/282125039 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d8c0adba0 msgr2=0x7f5d8c0b28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.844+0000 7f5d9188b700 1 --2- 172.21.15.44:0/282125039 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d8c0adba0 0x7f5d8c0b28e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5d84009dc0 tx=0x7f5d8400b330 comp rx=0 tx=0).stop 2024-09-13T18:36:04.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.844+0000 7f5d9188b700 1 -- 172.21.15.44:0/282125039 shutdown_connections 2024-09-13T18:36:04.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.844+0000 7f5d9188b700 1 --2- 172.21.15.44:0/282125039 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d8c0adba0 0x7f5d8c0b28e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.844+0000 7f5d9188b700 1 -- 172.21.15.44:0/282125039 >> 172.21.15.44:0/282125039 conn(0x7f5d8c0ce980 msgr2=0x7f5d8c0ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:04.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.844+0000 7f5d9188b700 1 -- 172.21.15.44:0/282125039 shutdown_connections 2024-09-13T18:36:04.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.844+0000 7f5d9188b700 1 -- 172.21.15.44:0/282125039 wait complete. 2024-09-13T18:36:04.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d9188b700 1 Processor -- start 2024-09-13T18:36:04.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d9188b700 1 -- start start 2024-09-13T18:36:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d9188b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d8c0ad710 0x7f5d8c06b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d9188b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d8c0adba0 0x7f5d8c14a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d9188b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d8c15ac40 0x7f5d8c15cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d9188b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c14dbd0 con 0x7f5d8c0adba0 2024-09-13T18:36:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d9188b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c14deb0 con 0x7f5d8c15ac40 2024-09-13T18:36:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d9188b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c14e190 con 0x7f5d8c0ad710 2024-09-13T18:36:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d8a7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d8c0adba0 0x7f5d8c14a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d8affd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d8c0ad710 0x7f5d8c06b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d8b7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d8c15ac40 0x7f5d8c15cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:04.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d8a7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d8c0adba0 0x7f5d8c14a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46266/0 (socket says 172.21.15.44:46266) 2024-09-13T18:36:04.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d8a7fc700 1 -- 172.21.15.44:0/2608880617 learned_addr learned my addr 172.21.15.44:0/2608880617 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:04.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d8b7fe700 1 -- 172.21.15.44:0/2608880617 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d8c0ad710 msgr2=0x7f5d8c06b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d8b7fe700 1 --2- 172.21.15.44:0/2608880617 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d8c0ad710 0x7f5d8c06b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d8b7fe700 1 -- 172.21.15.44:0/2608880617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d8c0adba0 msgr2=0x7f5d8c14a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d8b7fe700 1 --2- 172.21.15.44:0/2608880617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d8c0adba0 0x7f5d8c14a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d8b7fe700 1 -- 172.21.15.44:0/2608880617 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d84009a70 con 0x7f5d8c15ac40 2024-09-13T18:36:04.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d8b7fe700 1 --2- 172.21.15.44:0/2608880617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d8c15ac40 0x7f5d8c15cda0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5d84016000 tx=0x7f5d84004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:04.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d73fff700 1 -- 172.21.15.44:0/2608880617 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84007000 con 0x7f5d8c15ac40 2024-09-13T18:36:04.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d73fff700 1 -- 172.21.15.44:0/2608880617 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d84020070 con 0x7f5d8c15ac40 2024-09-13T18:36:04.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d9188b700 1 -- 172.21.15.44:0/2608880617 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d8c14e470 con 0x7f5d8c15ac40 2024-09-13T18:36:04.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d73fff700 1 -- 172.21.15.44:0/2608880617 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d840098f0 con 0x7f5d8c15ac40 2024-09-13T18:36:04.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.848+0000 7f5d9188b700 1 -- 172.21.15.44:0/2608880617 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d8c14abc0 con 0x7f5d8c15ac40 2024-09-13T18:36:04.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.852+0000 7f5d9188b700 1 -- 172.21.15.44:0/2608880617 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d8c0cb260 con 0x7f5d8c15ac40 2024-09-13T18:36:04.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.852+0000 7f5d73fff700 1 -- 172.21.15.44:0/2608880617 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5d84027480 con 0x7f5d8c15ac40 2024-09-13T18:36:04.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.852+0000 7f5d73fff700 1 --2- 172.21.15.44:0/2608880617 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5d78066730 0x7f5d78068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:04.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.852+0000 7f5d73fff700 1 -- 172.21.15.44:0/2608880617 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d84022070 con 0x7f5d8c15ac40 2024-09-13T18:36:04.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.852+0000 7f5d8affd700 1 --2- 172.21.15.44:0/2608880617 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5d78066730 0x7f5d78068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:04.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.856+0000 7f5d8affd700 1 --2- 172.21.15.44:0/2608880617 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5d78066730 0x7f5d78068bf0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5d800018a0 tx=0x7f5d80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:04.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:04.864+0000 7f5d73fff700 1 -- 172.21.15.44:0/2608880617 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5d84053880 con 0x7f5d8c15ac40 2024-09-13T18:36:05.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.076+0000 7f5d9188b700 1 -- 172.21.15.44:0/2608880617 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d8c14e990 con 0x7f5d8c15ac40 2024-09-13T18:36:05.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.080+0000 7f5d73fff700 1 -- 172.21.15.44:0/2608880617 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f5d8c14e990 con 0x7f5d8c15ac40 2024-09-13T18:36:05.086 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:05.086 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":70,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3463035694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3463035694},{"type":"v1","addr":"172.21.15.99:6837","nonce":3463035694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7438,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2910652037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2910652037},{"type":"v1","addr":"172.21.15.44:6833","nonce":2910652037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7456,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2231812307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2231812307},{"type":"v1","addr":"172.21.15.99:6835","nonce":2231812307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:35:45.841782+0000","modified":"2024-09-13T18:35:48.860780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7626},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7626":{"gid":7626,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/1921610909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1921610909},{"type":"v1","addr":"172.21.15.44:6835","nonce":1921610909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:36:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.080+0000 7f5d9188b700 1 -- 172.21.15.44:0/2608880617 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5d78066730 msgr2=0x7f5d78068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.080+0000 7f5d9188b700 1 --2- 172.21.15.44:0/2608880617 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5d78066730 0x7f5d78068bf0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5d800018a0 tx=0x7f5d80009040 comp rx=0 tx=0).stop 2024-09-13T18:36:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.080+0000 7f5d9188b700 1 -- 172.21.15.44:0/2608880617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d8c15ac40 msgr2=0x7f5d8c15cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.080+0000 7f5d9188b700 1 --2- 172.21.15.44:0/2608880617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d8c15ac40 0x7f5d8c15cda0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5d84016000 tx=0x7f5d84004af0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.084+0000 7f5d9188b700 1 -- 172.21.15.44:0/2608880617 shutdown_connections 2024-09-13T18:36:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.084+0000 7f5d9188b700 1 --2- 172.21.15.44:0/2608880617 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5d78066730 0x7f5d78068bf0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.084+0000 7f5d9188b700 1 --2- 172.21.15.44:0/2608880617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d8c15ac40 0x7f5d8c15cda0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.084+0000 7f5d9188b700 1 --2- 172.21.15.44:0/2608880617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d8c0adba0 0x7f5d8c14a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.084+0000 7f5d9188b700 1 --2- 172.21.15.44:0/2608880617 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d8c0ad710 0x7f5d8c06b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.084+0000 7f5d9188b700 1 -- 172.21.15.44:0/2608880617 >> 172.21.15.44:0/2608880617 conn(0x7f5d8c0ce980 msgr2=0x7f5d8c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:05.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.084+0000 7f5d9188b700 1 -- 172.21.15.44:0/2608880617 shutdown_connections 2024-09-13T18:36:05.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.084+0000 7f5d9188b700 1 -- 172.21.15.44:0/2608880617 wait complete. 2024-09-13T18:36:05.091 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 70 2024-09-13T18:36:05.107 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:36:05.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.216+0000 7f7289d24700 1 Processor -- start 2024-09-13T18:36:05.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.216+0000 7f7289d24700 1 -- start start 2024-09-13T18:36:05.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.216+0000 7f7289d24700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f72840b3ae0 0x7f7284165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:05.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.216+0000 7f7289d24700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7284161290 0x7f7284161740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:05.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.216+0000 7f7289d24700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7284071f30 con 0x7f7284160eb0 2024-09-13T18:36:05.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.216+0000 7f7289d24700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72841622e0 con 0x7f7284161290 2024-09-13T18:36:05.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.216+0000 7f7289d24700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7284162000 con 0x7f72840b3ae0 2024-09-13T18:36:05.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.216+0000 7f7288d22700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7284160eb0 0x7f72840b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:32924/0 (socket says 172.21.15.44:32924) 2024-09-13T18:36:05.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.216+0000 7f7288d22700 1 -- 172.21.15.44:0/1391329018 learned_addr learned my addr 172.21.15.44:0/1391329018 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:05.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.216+0000 7f7289523700 1 --2- 172.21.15.44:0/1391329018 >> v2:172.21.15.99:3300/0 conn(0x7f7284161290 0x7f7284161740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:05.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.220+0000 7f7283fff700 1 --2- 172.21.15.44:0/1391329018 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f72840b3ae0 0x7f7284165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:05.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.220+0000 7f72837fe700 1 -- 172.21.15.44:0/1391329018 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822664879 0 0) 0x7f7284071f30 con 0x7f7284160eb0 2024-09-13T18:36:05.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.220+0000 7f72837fe700 1 -- 172.21.15.44:0/1391329018 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f726c0035d0 con 0x7f7284160eb0 2024-09-13T18:36:05.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.220+0000 7f7289523700 1 -- 172.21.15.44:0/1391329018 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f72840b3ae0 msgr2=0x7f7284165590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:05.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.220+0000 7f7289523700 1 --2- 172.21.15.44:0/1391329018 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f72840b3ae0 0x7f7284165590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.220+0000 7f7289523700 1 -- 172.21.15.44:0/1391329018 >> v1:172.21.15.44:6789/0 conn(0x7f7284160eb0 legacy=0x7f72840b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:05.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.220+0000 7f72837fe700 1 -- 172.21.15.44:0/1391329018 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2445757178 0 0) 0x7f726c0035d0 con 0x7f7284160eb0 2024-09-13T18:36:05.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.220+0000 7f7289523700 1 -- 172.21.15.44:0/1391329018 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7284164ab0 con 0x7f7284161290 2024-09-13T18:36:05.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.220+0000 7f7289523700 1 --2- 172.21.15.44:0/1391329018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7284161290 0x7f7284161740 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f727c009d90 tx=0x7f727c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8247a90fd43c1e28 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:05.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.220+0000 7f72837fe700 1 -- 172.21.15.44:0/1391329018 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c00e070 con 0x7f7284161290 2024-09-13T18:36:05.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.220+0000 7f72837fe700 1 -- 172.21.15.44:0/1391329018 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727c003a40 con 0x7f7284161290 2024-09-13T18:36:05.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.220+0000 7f72837fe700 1 -- 172.21.15.44:0/1391329018 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7278001670 con 0x7f7284161290 2024-09-13T18:36:05.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.220+0000 7f7289d24700 1 -- 172.21.15.44:0/1391329018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7284161290 msgr2=0x7f7284161740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:05.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.220+0000 7f7289d24700 1 --2- 172.21.15.44:0/1391329018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7284161290 0x7f7284161740 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f727c009d90 tx=0x7f727c00b330 comp rx=0 tx=0).stop 2024-09-13T18:36:05.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.220+0000 7f7289d24700 1 -- 172.21.15.44:0/1391329018 shutdown_connections 2024-09-13T18:36:05.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.220+0000 7f7289d24700 1 --2- 172.21.15.44:0/1391329018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7284161290 0x7f7284161740 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.220+0000 7f7289d24700 1 --2- 172.21.15.44:0/1391329018 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f72840b3ae0 0x7f7284165590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.220+0000 7f7289d24700 1 -- 172.21.15.44:0/1391329018 >> 172.21.15.44:0/1391329018 conn(0x7f72840b0f00 msgr2=0x7f72840b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:05.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.220+0000 7f7289d24700 1 -- 172.21.15.44:0/1391329018 shutdown_connections 2024-09-13T18:36:05.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.220+0000 7f7289d24700 1 -- 172.21.15.44:0/1391329018 wait complete. 2024-09-13T18:36:05.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f7289d24700 1 Processor -- start 2024-09-13T18:36:05.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f7289d24700 1 -- start start 2024-09-13T18:36:05.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f7289d24700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72840b3ae0 0x7f7284159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:05.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f7289d24700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7284160eb0 0x7f72841ede40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:05.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f7289d24700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7284161290 0x7f72841eea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:05.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f7289d24700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72841ed080 con 0x7f7284161290 2024-09-13T18:36:05.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f7289d24700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72841ed360 con 0x7f72840b3ae0 2024-09-13T18:36:05.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f7289d24700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72841ed640 con 0x7f7284160eb0 2024-09-13T18:36:05.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f7289523700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7284161290 0x7f72841eea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:05.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f7289523700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7284161290 0x7f72841eea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46274/0 (socket says 172.21.15.44:46274) 2024-09-13T18:36:05.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f7289523700 1 -- 172.21.15.44:0/2511662229 learned_addr learned my addr 172.21.15.44:0/2511662229 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:05.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f7283fff700 1 --2- 172.21.15.44:0/2511662229 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7284160eb0 0x7f72841ede40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:05.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f7288d22700 1 --2- 172.21.15.44:0/2511662229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72840b3ae0 0x7f7284159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:05.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f7289523700 1 -- 172.21.15.44:0/2511662229 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7284160eb0 msgr2=0x7f72841ede40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:05.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f7289523700 1 --2- 172.21.15.44:0/2511662229 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7284160eb0 0x7f72841ede40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f7289523700 1 -- 172.21.15.44:0/2511662229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72840b3ae0 msgr2=0x7f7284159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:05.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f7289523700 1 --2- 172.21.15.44:0/2511662229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72840b3ae0 0x7f7284159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f7289523700 1 -- 172.21.15.44:0/2511662229 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727c009a70 con 0x7f7284161290 2024-09-13T18:36:05.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f7289523700 1 --2- 172.21.15.44:0/2511662229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7284161290 0x7f72841eea80 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f727c00b370 tx=0x7f727c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:05.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f72817fa700 1 -- 172.21.15.44:0/2511662229 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c0045c0 con 0x7f7284161290 2024-09-13T18:36:05.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f72817fa700 1 -- 172.21.15.44:0/2511662229 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727c004760 con 0x7f7284161290 2024-09-13T18:36:05.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f7289d24700 1 -- 172.21.15.44:0/2511662229 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72841ed920 con 0x7f7284161290 2024-09-13T18:36:05.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f72817fa700 1 -- 172.21.15.44:0/2511662229 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c01b430 con 0x7f7284161290 2024-09-13T18:36:05.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.224+0000 7f7289d24700 1 -- 172.21.15.44:0/2511662229 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72841ee380 con 0x7f7284161290 2024-09-13T18:36:05.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.228+0000 7f7289d24700 1 -- 172.21.15.44:0/2511662229 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72841edb60 con 0x7f7284161290 2024-09-13T18:36:05.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.228+0000 7f72817fa700 1 -- 172.21.15.44:0/2511662229 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f727c01b590 con 0x7f7284161290 2024-09-13T18:36:05.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.228+0000 7f72817fa700 1 --2- 172.21.15.44:0/2511662229 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7270066730 0x7f7270068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:05.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.228+0000 7f72817fa700 1 -- 172.21.15.44:0/2511662229 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f727c0858f0 con 0x7f7284161290 2024-09-13T18:36:05.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.228+0000 7f7288d22700 1 --2- 172.21.15.44:0/2511662229 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7270066730 0x7f7270068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:05.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.232+0000 7f7288d22700 1 --2- 172.21.15.44:0/2511662229 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7270066730 0x7f7270068bf0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f72780011e0 tx=0x7f7278001530 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:05.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.236+0000 7f72817fa700 1 -- 172.21.15.44:0/2511662229 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f72841edb60 con 0x7f7284161290 2024-09-13T18:36:05.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.444+0000 7f7289d24700 1 -- 172.21.15.44:0/2511662229 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72841edb60 con 0x7f7284161290 2024-09-13T18:36:05.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.444+0000 7f72817fa700 1 -- 172.21.15.44:0/2511662229 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f72841edb60 con 0x7f7284161290 2024-09-13T18:36:05.450 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:05.450 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":70,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3463035694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3463035694},{"type":"v1","addr":"172.21.15.99:6837","nonce":3463035694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7438,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2910652037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2910652037},{"type":"v1","addr":"172.21.15.44:6833","nonce":2910652037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7456,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2231812307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2231812307},{"type":"v1","addr":"172.21.15.99:6835","nonce":2231812307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:35:45.841782+0000","modified":"2024-09-13T18:35:48.860780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7626},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7626":{"gid":7626,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/1921610909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1921610909},{"type":"v1","addr":"172.21.15.44:6835","nonce":1921610909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:36:05.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.444+0000 7f7289d24700 1 -- 172.21.15.44:0/2511662229 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7270066730 msgr2=0x7f7270068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:05.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.444+0000 7f7289d24700 1 --2- 172.21.15.44:0/2511662229 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7270066730 0x7f7270068bf0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f72780011e0 tx=0x7f7278001530 comp rx=0 tx=0).stop 2024-09-13T18:36:05.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.444+0000 7f7289d24700 1 -- 172.21.15.44:0/2511662229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7284161290 msgr2=0x7f72841eea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:05.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.444+0000 7f7289d24700 1 --2- 172.21.15.44:0/2511662229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7284161290 0x7f72841eea80 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f727c00b370 tx=0x7f727c004af0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.448+0000 7f7289d24700 1 -- 172.21.15.44:0/2511662229 shutdown_connections 2024-09-13T18:36:05.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.448+0000 7f7289d24700 1 --2- 172.21.15.44:0/2511662229 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7270066730 0x7f7270068bf0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.448+0000 7f7289d24700 1 --2- 172.21.15.44:0/2511662229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7284161290 0x7f72841eea80 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.448+0000 7f7289d24700 1 --2- 172.21.15.44:0/2511662229 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7284160eb0 0x7f72841ede40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.448+0000 7f7289d24700 1 --2- 172.21.15.44:0/2511662229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72840b3ae0 0x7f7284159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.448+0000 7f7289d24700 1 -- 172.21.15.44:0/2511662229 >> 172.21.15.44:0/2511662229 conn(0x7f72840b0f00 msgr2=0x7f72840b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:05.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.448+0000 7f7289d24700 1 -- 172.21.15.44:0/2511662229 shutdown_connections 2024-09-13T18:36:05.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.448+0000 7f7289d24700 1 -- 172.21.15.44:0/2511662229 wait complete. 2024-09-13T18:36:05.454 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 70 2024-09-13T18:36:05.466 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:05.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.572+0000 7f52fb46e700 1 Processor -- start 2024-09-13T18:36:05.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.572+0000 7f52fb46e700 1 -- start start 2024-09-13T18:36:05.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.572+0000 7f52fb46e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f52f415cd80 0x7f52f406baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:05.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.572+0000 7f52fb46e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52f406a640 0x7f52f406aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:05.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.572+0000 7f52fb46e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f415d160 con 0x7f52f406afa0 2024-09-13T18:36:05.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.572+0000 7f52fb46e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f40d1570 con 0x7f52f415cd80 2024-09-13T18:36:05.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.572+0000 7f52fb46e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f406b450 con 0x7f52f406a640 2024-09-13T18:36:05.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.572+0000 7f52fa46c700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f52f415cd80 0x7f52f406baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:05.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.572+0000 7f52f9c6b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52f406a640 0x7f52f406aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:05.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.572+0000 7f52fac6d700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f52f406afa0 0x7f52f40b5e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:56184/0 (socket says 172.21.15.44:56184) 2024-09-13T18:36:05.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.572+0000 7f52fac6d700 1 -- 172.21.15.44:0/2340634676 learned_addr learned my addr 172.21.15.44:0/2340634676 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:05.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.576+0000 7f52f946a700 1 -- 172.21.15.44:0/2340634676 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271467162 0 0) 0x7f52f415d160 con 0x7f52f406afa0 2024-09-13T18:36:05.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.576+0000 7f52f946a700 1 -- 172.21.15.44:0/2340634676 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52e00035d0 con 0x7f52f406afa0 2024-09-13T18:36:05.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.576+0000 7f52f9c6b700 1 -- 172.21.15.44:0/2340634676 >> v2:172.21.15.99:3300/0 conn(0x7f52f415cd80 msgr2=0x7f52f406baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:05.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.576+0000 7f52f9c6b700 1 --2- 172.21.15.44:0/2340634676 >> v2:172.21.15.99:3300/0 conn(0x7f52f415cd80 0x7f52f406baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.576+0000 7f52f9c6b700 1 -- 172.21.15.44:0/2340634676 >> v1:172.21.15.99:6789/0 conn(0x7f52f406afa0 legacy=0x7f52f40b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:05.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.576+0000 7f52f9c6b700 1 -- 172.21.15.44:0/2340634676 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f40d2120 con 0x7f52f406a640 2024-09-13T18:36:05.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.576+0000 7f52fa46c700 1 --2- 172.21.15.44:0/2340634676 >> v2:172.21.15.99:3300/0 conn(0x7f52f415cd80 0x7f52f406baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:05.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.576+0000 7f52f9c6b700 1 --2- 172.21.15.44:0/2340634676 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52f406a640 0x7f52f406aa60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009850 tx=0x7f52f0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59fb757aafcf4974 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:05.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.576+0000 7f52f946a700 1 -- 172.21.15.44:0/2340634676 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0011830 con 0x7f52f406a640 2024-09-13T18:36:05.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.576+0000 7f52f946a700 1 -- 172.21.15.44:0/2340634676 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f0011990 con 0x7f52f406a640 2024-09-13T18:36:05.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.576+0000 7f52f946a700 1 -- 172.21.15.44:0/2340634676 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0011d40 con 0x7f52f406a640 2024-09-13T18:36:05.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.576+0000 7f52fb46e700 1 -- 172.21.15.44:0/2340634676 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52f406a640 msgr2=0x7f52f406aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:05.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.576+0000 7f52fb46e700 1 --2- 172.21.15.44:0/2340634676 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52f406a640 0x7f52f406aa60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009850 tx=0x7f52f0009b60 comp rx=0 tx=0).stop 2024-09-13T18:36:05.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.576+0000 7f52fb46e700 1 -- 172.21.15.44:0/2340634676 shutdown_connections 2024-09-13T18:36:05.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.576+0000 7f52fb46e700 1 --2- 172.21.15.44:0/2340634676 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52f406a640 0x7f52f406aa60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.576+0000 7f52fb46e700 1 --2- 172.21.15.44:0/2340634676 >> v2:172.21.15.99:3300/0 conn(0x7f52f415cd80 0x7f52f406baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.576+0000 7f52fb46e700 1 -- 172.21.15.44:0/2340634676 >> 172.21.15.44:0/2340634676 conn(0x7f52f40d30b0 msgr2=0x7f52f40d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:05.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.576+0000 7f52fb46e700 1 -- 172.21.15.44:0/2340634676 shutdown_connections 2024-09-13T18:36:05.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.576+0000 7f52fb46e700 1 -- 172.21.15.44:0/2340634676 wait complete. 2024-09-13T18:36:05.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52fb46e700 1 Processor -- start 2024-09-13T18:36:05.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52fb46e700 1 -- start start 2024-09-13T18:36:05.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52fb46e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52f406a640 0x7f52f40b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:05.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52fb46e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52f406afa0 0x7f52f415f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:05.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52fb46e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52f415cd80 0x7f52f415f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:05.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52fb46e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f41f5fc0 con 0x7f52f406a640 2024-09-13T18:36:05.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52fb46e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f41f62a0 con 0x7f52f415cd80 2024-09-13T18:36:05.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52fb46e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f41f6580 con 0x7f52f406afa0 2024-09-13T18:36:05.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52fa46c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52f406a640 0x7f52f40b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:05.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52fa46c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52f406a640 0x7f52f40b6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46282/0 (socket says 172.21.15.44:46282) 2024-09-13T18:36:05.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52fa46c700 1 -- 172.21.15.44:0/452281435 learned_addr learned my addr 172.21.15.44:0/452281435 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:05.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52f9c6b700 1 --2- 172.21.15.44:0/452281435 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52f406afa0 0x7f52f415f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:05.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52fac6d700 1 --2- 172.21.15.44:0/452281435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52f415cd80 0x7f52f415f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:05.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52fa46c700 1 -- 172.21.15.44:0/452281435 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52f406afa0 msgr2=0x7f52f415f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:05.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52fa46c700 1 --2- 172.21.15.44:0/452281435 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52f406afa0 0x7f52f415f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52fa46c700 1 -- 172.21.15.44:0/452281435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52f415cd80 msgr2=0x7f52f415f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:05.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52fa46c700 1 --2- 172.21.15.44:0/452281435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52f415cd80 0x7f52f415f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52fa46c700 1 -- 172.21.15.44:0/452281435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e40094b0 con 0x7f52f406a640 2024-09-13T18:36:05.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52fa46c700 1 --2- 172.21.15.44:0/452281435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52f406a640 0x7f52f40b6ba0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f52e400ebe0 tx=0x7f52e400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:05.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52eaffd700 1 -- 172.21.15.44:0/452281435 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4009770 con 0x7f52f406a640 2024-09-13T18:36:05.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52eaffd700 1 -- 172.21.15.44:0/452281435 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e400c850 con 0x7f52f406a640 2024-09-13T18:36:05.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52fb46e700 1 -- 172.21.15.44:0/452281435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f00094b0 con 0x7f52f406a640 2024-09-13T18:36:05.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52eaffd700 1 -- 172.21.15.44:0/452281435 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e400cbe0 con 0x7f52f406a640 2024-09-13T18:36:05.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.580+0000 7f52fb46e700 1 -- 172.21.15.44:0/452281435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f40cadb0 con 0x7f52f406a640 2024-09-13T18:36:05.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.584+0000 7f52fb46e700 1 -- 172.21.15.44:0/452281435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f406aa60 con 0x7f52f406a640 2024-09-13T18:36:05.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.584+0000 7f52eaffd700 1 -- 172.21.15.44:0/452281435 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f52e400cd40 con 0x7f52f406a640 2024-09-13T18:36:05.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.584+0000 7f52eaffd700 1 --2- 172.21.15.44:0/452281435 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f52d8066730 0x7f52d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:05.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.584+0000 7f52eaffd700 1 -- 172.21.15.44:0/452281435 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52e4084470 con 0x7f52f406a640 2024-09-13T18:36:05.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.584+0000 7f52f9c6b700 1 --2- 172.21.15.44:0/452281435 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f52d8066730 0x7f52d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:05.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.588+0000 7f52f9c6b700 1 --2- 172.21.15.44:0/452281435 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f52d8066730 0x7f52d8068bf0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009850 tx=0x7f52f0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:05.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.592+0000 7f52eaffd700 1 -- 172.21.15.44:0/452281435 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f52e40517e0 con 0x7f52f406a640 2024-09-13T18:36:05.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.764+0000 7f52fb46e700 1 -- 172.21.15.44:0/452281435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52f40b74b0 con 0x7f52f406a640 2024-09-13T18:36:05.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.768+0000 7f52eaffd700 1 -- 172.21.15.44:0/452281435 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16508 (secure 0 0 0) 0x7f52e4054e00 con 0x7f52f406a640 2024-09-13T18:36:05.774 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:05.775 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":78,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:35:46.845184+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:44.271295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:44.844157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:05.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.768+0000 7f52fb46e700 1 -- 172.21.15.44:0/452281435 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f52d8066730 msgr2=0x7f52d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:05.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.768+0000 7f52fb46e700 1 --2- 172.21.15.44:0/452281435 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f52d8066730 0x7f52d8068bf0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009850 tx=0x7f52f0008030 comp rx=0 tx=0).stop 2024-09-13T18:36:05.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.768+0000 7f52fb46e700 1 -- 172.21.15.44:0/452281435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52f406a640 msgr2=0x7f52f40b6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:05.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.768+0000 7f52fb46e700 1 --2- 172.21.15.44:0/452281435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52f406a640 0x7f52f40b6ba0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f52e400ebe0 tx=0x7f52e400eef0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.768+0000 7f52fb46e700 1 -- 172.21.15.44:0/452281435 shutdown_connections 2024-09-13T18:36:05.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.768+0000 7f52fb46e700 1 --2- 172.21.15.44:0/452281435 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f52d8066730 0x7f52d8068bf0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.768+0000 7f52fb46e700 1 --2- 172.21.15.44:0/452281435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52f415cd80 0x7f52f415f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.768+0000 7f52fb46e700 1 --2- 172.21.15.44:0/452281435 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f52f406afa0 0x7f52f415f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.768+0000 7f52fb46e700 1 --2- 172.21.15.44:0/452281435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52f406a640 0x7f52f40b6ba0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.768+0000 7f52fb46e700 1 -- 172.21.15.44:0/452281435 >> 172.21.15.44:0/452281435 conn(0x7f52f40d30b0 msgr2=0x7f52f40b79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:05.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.772+0000 7f52fb46e700 1 -- 172.21.15.44:0/452281435 shutdown_connections 2024-09-13T18:36:05.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.772+0000 7f52fb46e700 1 -- 172.21.15.44:0/452281435 wait complete. 2024-09-13T18:36:05.791 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:36:05.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.900+0000 7fab72131700 1 Processor -- start 2024-09-13T18:36:05.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.900+0000 7fab72131700 1 -- start start 2024-09-13T18:36:05.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab72131700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab6c06b900 0x7fab6c0b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:05.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab72131700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fab6c06a520 0x7fab6c06a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:05.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab72131700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6c06aeb0 con 0x7fab6c15cda0 2024-09-13T18:36:05.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab72131700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6c0b8430 con 0x7fab6c06a520 2024-09-13T18:36:05.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab72131700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c06bd60 con 0x7fab6c06b900 2024-09-13T18:36:05.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab71930700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fab6c06a520 0x7fab6c06a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:05.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab71930700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fab6c06a520 0x7fab6c06a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46288/0 (socket says 172.21.15.44:46288) 2024-09-13T18:36:05.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab71930700 1 -- 172.21.15.44:0/1121785618 learned_addr learned my addr 172.21.15.44:0/1121785618 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:05.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab7092e700 1 --2- 172.21.15.44:0/1121785618 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab6c06b900 0x7fab6c0b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:05.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab71930700 1 -- 172.21.15.44:0/1121785618 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab6c06b900 msgr2=0x7fab6c0b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:05.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab71930700 1 --2- 172.21.15.44:0/1121785618 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab6c06b900 0x7fab6c0b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab71930700 1 -- 172.21.15.44:0/1121785618 >> v1:172.21.15.99:6789/0 conn(0x7fab6c15cda0 legacy=0x7fab6c0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:05.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab71930700 1 -- 172.21.15.44:0/1121785618 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c0cf350 con 0x7fab6c06a520 2024-09-13T18:36:05.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab7092e700 1 --2- 172.21.15.44:0/1121785618 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab6c06b900 0x7fab6c0b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:05.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab71930700 1 --2- 172.21.15.44:0/1121785618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab6c06a520 0x7fab6c06a970 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fab64009910 tx=0x7fab64009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122d367663f0b60d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:05.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab63fff700 1 -- 172.21.15.44:0/1121785618 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6400ba60 con 0x7fab6c06a520 2024-09-13T18:36:05.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab63fff700 1 -- 172.21.15.44:0/1121785618 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6400bbc0 con 0x7fab6c06a520 2024-09-13T18:36:05.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab63fff700 1 -- 172.21.15.44:0/1121785618 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab64009e60 con 0x7fab6c06a520 2024-09-13T18:36:05.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab72131700 1 -- 172.21.15.44:0/1121785618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab6c06a520 msgr2=0x7fab6c06a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:05.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab72131700 1 --2- 172.21.15.44:0/1121785618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab6c06a520 0x7fab6c06a970 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fab64009910 tx=0x7fab64009c20 comp rx=0 tx=0).stop 2024-09-13T18:36:05.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab72131700 1 -- 172.21.15.44:0/1121785618 shutdown_connections 2024-09-13T18:36:05.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab72131700 1 --2- 172.21.15.44:0/1121785618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab6c06a520 0x7fab6c06a970 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab72131700 1 --2- 172.21.15.44:0/1121785618 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab6c06b900 0x7fab6c0b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab72131700 1 -- 172.21.15.44:0/1121785618 >> 172.21.15.44:0/1121785618 conn(0x7fab6c0d2cb0 msgr2=0x7fab6c0d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:05.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab72131700 1 -- 172.21.15.44:0/1121785618 shutdown_connections 2024-09-13T18:36:05.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.904+0000 7fab72131700 1 -- 172.21.15.44:0/1121785618 wait complete. 2024-09-13T18:36:05.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab72131700 1 Processor -- start 2024-09-13T18:36:05.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab72131700 1 -- start start 2024-09-13T18:36:05.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab72131700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab6c06a520 0x7fab6c15a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:05.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab72131700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab6c06b900 0x7fab6c0cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:05.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab72131700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab6c15cda0 0x7fab6c15f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:05.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab72131700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c15a650 con 0x7fab6c06a520 2024-09-13T18:36:05.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab72131700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0cc270 con 0x7fab6c06b900 2024-09-13T18:36:05.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab72131700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c15d320 con 0x7fab6c15cda0 2024-09-13T18:36:05.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab7112f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab6c06a520 0x7fab6c15a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:05.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab7112f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab6c06a520 0x7fab6c15a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46296/0 (socket says 172.21.15.44:46296) 2024-09-13T18:36:05.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab7112f700 1 -- 172.21.15.44:0/23592088 learned_addr learned my addr 172.21.15.44:0/23592088 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:05.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab7092e700 1 --2- 172.21.15.44:0/23592088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab6c06b900 0x7fab6c0cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:05.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab71930700 1 --2- 172.21.15.44:0/23592088 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab6c15cda0 0x7fab6c15f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:05.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab7112f700 1 -- 172.21.15.44:0/23592088 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab6c15cda0 msgr2=0x7fab6c15f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:05.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab7112f700 1 --2- 172.21.15.44:0/23592088 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab6c15cda0 0x7fab6c15f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab7112f700 1 -- 172.21.15.44:0/23592088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab6c06b900 msgr2=0x7fab6c0cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:05.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab7112f700 1 --2- 172.21.15.44:0/23592088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab6c06b900 0x7fab6c0cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:05.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab7112f700 1 -- 172.21.15.44:0/23592088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab64009570 con 0x7fab6c06a520 2024-09-13T18:36:05.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab7112f700 1 --2- 172.21.15.44:0/23592088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab6c06a520 0x7fab6c15a110 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00c500 tx=0x7fab5c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:05.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab61ffb700 1 -- 172.21.15.44:0/23592088 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c0052d0 con 0x7fab6c06a520 2024-09-13T18:36:05.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab61ffb700 1 -- 172.21.15.44:0/23592088 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5c005430 con 0x7fab6c06a520 2024-09-13T18:36:05.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab72131700 1 -- 172.21.15.44:0/23592088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6c15d600 con 0x7fab6c06a520 2024-09-13T18:36:05.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab61ffb700 1 -- 172.21.15.44:0/23592088 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c0055a0 con 0x7fab6c06a520 2024-09-13T18:36:05.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.908+0000 7fab72131700 1 -- 172.21.15.44:0/23592088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6c0cadd0 con 0x7fab6c06a520 2024-09-13T18:36:05.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.912+0000 7fab72131700 1 -- 172.21.15.44:0/23592088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6c15d180 con 0x7fab6c06a520 2024-09-13T18:36:05.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.912+0000 7fab61ffb700 1 -- 172.21.15.44:0/23592088 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fab5c0038e0 con 0x7fab6c06a520 2024-09-13T18:36:05.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.912+0000 7fab61ffb700 1 --2- 172.21.15.44:0/23592088 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fab58066730 0x7fab58068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:05.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.912+0000 7fab61ffb700 1 -- 172.21.15.44:0/23592088 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab5c083430 con 0x7fab6c06a520 2024-09-13T18:36:05.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.912+0000 7fab7092e700 1 --2- 172.21.15.44:0/23592088 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fab58066730 0x7fab58068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:05.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.912+0000 7fab7092e700 1 --2- 172.21.15.44:0/23592088 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fab58066730 0x7fab58068bf0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fab6c15b2e0 tx=0x7fab68003d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:05.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:05.920+0000 7fab61ffb700 1 -- 172.21.15.44:0/23592088 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fab6c15d180 con 0x7fab6c06a520 2024-09-13T18:36:06.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.132+0000 7fab72131700 1 -- 172.21.15.44:0/23592088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fab6c15db20 con 0x7fab6c06a520 2024-09-13T18:36:06.141 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-13T18:36:06.136+0000 7fc22bbc2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:36:06.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.152+0000 7fab61ffb700 1 -- 172.21.15.44:0/23592088 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v71) v1 ==== 161+0+0 (secure 0 0 0) 0x7fab6c15db20 con 0x7fab6c06a520 2024-09-13T18:36:06.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.156+0000 7fab72131700 1 -- 172.21.15.44:0/23592088 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fab58066730 msgr2=0x7fab58068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:06.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.156+0000 7fab72131700 1 --2- 172.21.15.44:0/23592088 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fab58066730 0x7fab58068bf0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fab6c15b2e0 tx=0x7fab68003d90 comp rx=0 tx=0).stop 2024-09-13T18:36:06.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.156+0000 7fab72131700 1 -- 172.21.15.44:0/23592088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab6c06a520 msgr2=0x7fab6c15a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:06.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.156+0000 7fab72131700 1 --2- 172.21.15.44:0/23592088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab6c06a520 0x7fab6c15a110 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00c500 tx=0x7fab5c00c8c0 comp rx=0 tx=0).stop 2024-09-13T18:36:06.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.156+0000 7fab72131700 1 -- 172.21.15.44:0/23592088 shutdown_connections 2024-09-13T18:36:06.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.156+0000 7fab72131700 1 --2- 172.21.15.44:0/23592088 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fab58066730 0x7fab58068bf0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:06.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.156+0000 7fab72131700 1 --2- 172.21.15.44:0/23592088 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab6c15cda0 0x7fab6c15f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:06.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.156+0000 7fab72131700 1 --2- 172.21.15.44:0/23592088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab6c06b900 0x7fab6c0cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:06.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.156+0000 7fab72131700 1 --2- 172.21.15.44:0/23592088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab6c06a520 0x7fab6c15a110 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:06.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.156+0000 7fab72131700 1 -- 172.21.15.44:0/23592088 >> 172.21.15.44:0/23592088 conn(0x7fab6c0d2cb0 msgr2=0x7fab6c0b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:06.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.156+0000 7fab72131700 1 -- 172.21.15.44:0/23592088 shutdown_connections 2024-09-13T18:36:06.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.156+0000 7fab72131700 1 -- 172.21.15.44:0/23592088 wait complete. 2024-09-13T18:36:06.163 INFO:tasks.ceph.mds.a.smithi044.stderr: -1420> 2024-09-13T18:35:51.764+0000 7fa19426f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:36:06.164 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:36:06.178 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:36:06.198 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-13T18:36:06.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.283+0000 7fe15759e700 1 Processor -- start 2024-09-13T18:36:06.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.283+0000 7fe15759e700 1 -- start start 2024-09-13T18:36:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe15759e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe15815a940 0x7fe15806b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe15759e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe15815da40 0x7fe15815b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:06.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe15759e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15806d120 con 0x7fe158159550 2024-09-13T18:36:06.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe15759e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15806bc20 con 0x7fe15815a940 2024-09-13T18:36:06.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe15759e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15806bf00 con 0x7fe15815da40 2024-09-13T18:36:06.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe155d9b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe15815a940 0x7fe15806b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:06.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe155d9b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe15815a940 0x7fe15806b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46318/0 (socket says 172.21.15.44:46318) 2024-09-13T18:36:06.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe155d9b700 1 -- 172.21.15.44:0/1078197270 learned_addr learned my addr 172.21.15.44:0/1078197270 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:06.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe156d9d700 1 --2- 172.21.15.44:0/1078197270 >> v2:172.21.15.99:3300/0 conn(0x7fe15815da40 0x7fe15815b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:06.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe155d9b700 1 -- 172.21.15.44:0/1078197270 >> v2:172.21.15.99:3300/0 conn(0x7fe15815da40 msgr2=0x7fe15815b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:06.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe155d9b700 1 --2- 172.21.15.44:0/1078197270 >> v2:172.21.15.99:3300/0 conn(0x7fe15815da40 0x7fe15815b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:06.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe155d9b700 1 -- 172.21.15.44:0/1078197270 >> v1:172.21.15.99:6789/0 conn(0x7fe158159550 legacy=0x7fe15815d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:06.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe155d9b700 1 -- 172.21.15.44:0/1078197270 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15806c1e0 con 0x7fe15815a940 2024-09-13T18:36:06.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe155d9b700 1 --2- 172.21.15.44:0/1078197270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe15815a940 0x7fe15806b540 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fe1580b50a0 tx=0x7fe14c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9805cbbce92d468 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:06.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe15559a700 1 -- 172.21.15.44:0/1078197270 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c011830 con 0x7fe15815a940 2024-09-13T18:36:06.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe15559a700 1 -- 172.21.15.44:0/1078197270 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c011990 con 0x7fe15815a940 2024-09-13T18:36:06.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe15559a700 1 -- 172.21.15.44:0/1078197270 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c011d20 con 0x7fe15815a940 2024-09-13T18:36:06.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe15759e700 1 -- 172.21.15.44:0/1078197270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe15815a940 msgr2=0x7fe15806b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:06.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe15759e700 1 --2- 172.21.15.44:0/1078197270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe15815a940 0x7fe15806b540 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fe1580b50a0 tx=0x7fe14c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:36:06.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe15759e700 1 -- 172.21.15.44:0/1078197270 shutdown_connections 2024-09-13T18:36:06.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe15759e700 1 --2- 172.21.15.44:0/1078197270 >> v2:172.21.15.99:3300/0 conn(0x7fe15815da40 0x7fe15815b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:06.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe15759e700 1 --2- 172.21.15.44:0/1078197270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe15815a940 0x7fe15806b540 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:06.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe15759e700 1 -- 172.21.15.44:0/1078197270 >> 172.21.15.44:0/1078197270 conn(0x7fe1580cf000 msgr2=0x7fe1580cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:06.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe15759e700 1 -- 172.21.15.44:0/1078197270 shutdown_connections 2024-09-13T18:36:06.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.287+0000 7fe15759e700 1 -- 172.21.15.44:0/1078197270 wait complete. 2024-09-13T18:36:06.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.291+0000 7fe15759e700 1 Processor -- start 2024-09-13T18:36:06.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.291+0000 7fe15759e700 1 -- start start 2024-09-13T18:36:06.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.291+0000 7fe15759e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe158159550 0x7fe158151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:06.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.291+0000 7fe15759e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe15815a940 0x7fe15814e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:06.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.291+0000 7fe15759e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe15815da40 0x7fe15814f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:06.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.291+0000 7fe15759e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1581561d0 con 0x7fe158159550 2024-09-13T18:36:06.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.291+0000 7fe15759e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe158155b50 con 0x7fe15815a940 2024-09-13T18:36:06.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.291+0000 7fe15759e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15814e7a0 con 0x7fe15815da40 2024-09-13T18:36:06.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.291+0000 7fe15659c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe158159550 0x7fe158151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:06.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.291+0000 7fe15659c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe158159550 0x7fe158151700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46334/0 (socket says 172.21.15.44:46334) 2024-09-13T18:36:06.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.291+0000 7fe15659c700 1 -- 172.21.15.44:0/68938549 learned_addr learned my addr 172.21.15.44:0/68938549 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:06.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.291+0000 7fe156d9d700 1 --2- 172.21.15.44:0/68938549 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe15815da40 0x7fe15814f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:06.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.291+0000 7fe155d9b700 1 --2- 172.21.15.44:0/68938549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe15815a940 0x7fe15814e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:06.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.291+0000 7fe15659c700 1 -- 172.21.15.44:0/68938549 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe15815da40 msgr2=0x7fe15814f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:06.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.291+0000 7fe15659c700 1 --2- 172.21.15.44:0/68938549 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe15815da40 0x7fe15814f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:06.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.291+0000 7fe15659c700 1 -- 172.21.15.44:0/68938549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe15815a940 msgr2=0x7fe15814e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:06.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.291+0000 7fe15659c700 1 --2- 172.21.15.44:0/68938549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe15815a940 0x7fe15814e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:06.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.291+0000 7fe15659c700 1 -- 172.21.15.44:0/68938549 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c009570 con 0x7fe158159550 2024-09-13T18:36:06.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.291+0000 7fe15659c700 1 --2- 172.21.15.44:0/68938549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe158159550 0x7fe158151700 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fe14800e940 tx=0x7fe14800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:06.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.291+0000 7fe146ffd700 1 -- 172.21.15.44:0/68938549 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe148006a80 con 0x7fe158159550 2024-09-13T18:36:06.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.295+0000 7fe146ffd700 1 -- 172.21.15.44:0/68938549 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe148006be0 con 0x7fe158159550 2024-09-13T18:36:06.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.295+0000 7fe15759e700 1 -- 172.21.15.44:0/68938549 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe158151de0 con 0x7fe158159550 2024-09-13T18:36:06.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.295+0000 7fe146ffd700 1 -- 172.21.15.44:0/68938549 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe148007030 con 0x7fe158159550 2024-09-13T18:36:06.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.295+0000 7fe15759e700 1 -- 172.21.15.44:0/68938549 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe158155df0 con 0x7fe158159550 2024-09-13T18:36:06.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.295+0000 7fe15759e700 1 -- 172.21.15.44:0/68938549 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1580cf3e0 con 0x7fe158159550 2024-09-13T18:36:06.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.295+0000 7fe146ffd700 1 -- 172.21.15.44:0/68938549 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe148007190 con 0x7fe158159550 2024-09-13T18:36:06.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.295+0000 7fe146ffd700 1 --2- 172.21.15.44:0/68938549 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe138066730 0x7fe138068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:06.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.295+0000 7fe146ffd700 1 -- 172.21.15.44:0/68938549 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe148086140 con 0x7fe158159550 2024-09-13T18:36:06.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.295+0000 7fe155d9b700 1 --2- 172.21.15.44:0/68938549 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe138066730 0x7fe138068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:06.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.299+0000 7fe155d9b700 1 --2- 172.21.15.44:0/68938549 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe138066730 0x7fe138068bf0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe1580b50a0 tx=0x7fe14c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:06.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.303+0000 7fe146ffd700 1 -- 172.21.15.44:0/68938549 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe148053450 con 0x7fe158159550 2024-09-13T18:36:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:06.507+0000 7fe15759e700 1 -- 172.21.15.44:0/68938549 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe15806b540 con 0x7fe158159550 2024-09-13T18:36:07.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.167+0000 7fe146ffd700 1 -- 172.21.15.44:0/68938549 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v72) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe14805be60 con 0x7fe158159550 2024-09-13T18:36:07.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.171+0000 7fe15759e700 1 -- 172.21.15.44:0/68938549 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe138066730 msgr2=0x7fe138068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:07.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.171+0000 7fe15759e700 1 --2- 172.21.15.44:0/68938549 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe138066730 0x7fe138068bf0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe1580b50a0 tx=0x7fe14c008030 comp rx=0 tx=0).stop 2024-09-13T18:36:07.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.171+0000 7fe15759e700 1 -- 172.21.15.44:0/68938549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe158159550 msgr2=0x7fe158151700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:07.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.171+0000 7fe15759e700 1 --2- 172.21.15.44:0/68938549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe158159550 0x7fe158151700 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fe14800e940 tx=0x7fe14800ec50 comp rx=0 tx=0).stop 2024-09-13T18:36:07.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.171+0000 7fe15759e700 1 -- 172.21.15.44:0/68938549 shutdown_connections 2024-09-13T18:36:07.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.171+0000 7fe15759e700 1 --2- 172.21.15.44:0/68938549 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe138066730 0x7fe138068bf0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:07.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.171+0000 7fe15759e700 1 --2- 172.21.15.44:0/68938549 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe15815da40 0x7fe15814f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:07.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.171+0000 7fe15759e700 1 --2- 172.21.15.44:0/68938549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe15815a940 0x7fe15814e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:07.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.171+0000 7fe15759e700 1 --2- 172.21.15.44:0/68938549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe158159550 0x7fe158151700 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:07.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.171+0000 7fe15759e700 1 -- 172.21.15.44:0/68938549 >> 172.21.15.44:0/68938549 conn(0x7fe1580cf000 msgr2=0x7fe15806a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:07.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.171+0000 7fe15759e700 1 -- 172.21.15.44:0/68938549 shutdown_connections 2024-09-13T18:36:07.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.171+0000 7fe15759e700 1 -- 172.21.15.44:0/68938549 wait complete. 2024-09-13T18:36:07.195 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:36:07.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.319+0000 7f941d41d700 1 Processor -- start 2024-09-13T18:36:07.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.319+0000 7f941d41d700 1 -- start start 2024-09-13T18:36:07.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.319+0000 7f941d41d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94180cb860 0x7f9418071430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:07.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.319+0000 7f941d41d700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9418071970 0x7f94180cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:07.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.319+0000 7f941d41d700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9418071dd0 con 0x7f9418159710 2024-09-13T18:36:07.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.319+0000 7f941d41d700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94180b21e0 con 0x7f9418071970 2024-09-13T18:36:07.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.319+0000 7f941d41d700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94180b24c0 con 0x7f94180cb860 2024-09-13T18:36:07.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.319+0000 7f9417fff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9418159710 0x7f941806c2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:32936/0 (socket says 172.21.15.44:32936) 2024-09-13T18:36:07.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.319+0000 7f9417fff700 1 -- 172.21.15.44:0/3464356599 learned_addr learned my addr 172.21.15.44:0/3464356599 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:07.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.319+0000 7f940f7fe700 1 --2- 172.21.15.44:0/3464356599 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94180cb860 0x7f9418071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:07.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.319+0000 7f941cc1c700 1 --2- 172.21.15.44:0/3464356599 >> v2:172.21.15.99:3300/0 conn(0x7f9418071970 0x7f94180cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:07.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.319+0000 7f94177fe700 1 -- 172.21.15.44:0/3464356599 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322298293 0 0) 0x7f9418071dd0 con 0x7f9418159710 2024-09-13T18:36:07.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.319+0000 7f94177fe700 1 -- 172.21.15.44:0/3464356599 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94040057e0 con 0x7f9418159710 2024-09-13T18:36:07.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.319+0000 7f940f7fe700 1 -- 172.21.15.44:0/3464356599 >> v2:172.21.15.99:3300/0 conn(0x7f9418071970 msgr2=0x7f94180cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:07.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.319+0000 7f940f7fe700 1 --2- 172.21.15.44:0/3464356599 >> v2:172.21.15.99:3300/0 conn(0x7f9418071970 0x7f94180cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:07.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.319+0000 7f940f7fe700 1 -- 172.21.15.44:0/3464356599 >> v1:172.21.15.44:6789/0 conn(0x7f9418159710 legacy=0x7f941806c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:07.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.319+0000 7f940f7fe700 1 -- 172.21.15.44:0/3464356599 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94180b27a0 con 0x7f94180cb860 2024-09-13T18:36:07.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.319+0000 7f940f7fe700 1 --2- 172.21.15.44:0/3464356599 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94180cb860 0x7f9418071430 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9400009850 tx=0x7f9400009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab69e56f3d06dc1a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:07.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.319+0000 7f94177fe700 1 -- 172.21.15.44:0/3464356599 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9400011830 con 0x7f94180cb860 2024-09-13T18:36:07.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.319+0000 7f94177fe700 1 -- 172.21.15.44:0/3464356599 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9400011990 con 0x7f94180cb860 2024-09-13T18:36:07.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.319+0000 7f94177fe700 1 -- 172.21.15.44:0/3464356599 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9400011d00 con 0x7f94180cb860 2024-09-13T18:36:07.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.323+0000 7f941d41d700 1 -- 172.21.15.44:0/3464356599 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94180cb860 msgr2=0x7f9418071430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:07.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.323+0000 7f941d41d700 1 --2- 172.21.15.44:0/3464356599 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94180cb860 0x7f9418071430 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9400009850 tx=0x7f9400009b60 comp rx=0 tx=0).stop 2024-09-13T18:36:07.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.323+0000 7f941d41d700 1 -- 172.21.15.44:0/3464356599 shutdown_connections 2024-09-13T18:36:07.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.323+0000 7f941d41d700 1 --2- 172.21.15.44:0/3464356599 >> v2:172.21.15.99:3300/0 conn(0x7f9418071970 0x7f94180cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:07.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.323+0000 7f941d41d700 1 --2- 172.21.15.44:0/3464356599 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94180cb860 0x7f9418071430 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:07.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.323+0000 7f941d41d700 1 -- 172.21.15.44:0/3464356599 >> 172.21.15.44:0/3464356599 conn(0x7f94180cf460 msgr2=0x7f94180cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:07.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.323+0000 7f941d41d700 1 -- 172.21.15.44:0/3464356599 shutdown_connections 2024-09-13T18:36:07.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.323+0000 7f941d41d700 1 -- 172.21.15.44:0/3464356599 wait complete. 2024-09-13T18:36:07.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.323+0000 7f941d41d700 1 Processor -- start 2024-09-13T18:36:07.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.323+0000 7f941d41d700 1 -- start start 2024-09-13T18:36:07.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.327+0000 7f941d41d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9418071970 0x7f9418155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:07.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.327+0000 7f941d41d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94180cb860 0x7f9418149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:07.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.327+0000 7f941d41d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9418159710 0x7f9418149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:07.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.327+0000 7f941d41d700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94180b02a0 con 0x7f9418071970 2024-09-13T18:36:07.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.327+0000 7f941d41d700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94180af6d0 con 0x7f9418159710 2024-09-13T18:36:07.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.327+0000 7f941d41d700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9418149eb0 con 0x7f94180cb860 2024-09-13T18:36:07.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.327+0000 7f9417fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9418071970 0x7f9418155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:07.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.327+0000 7f9417fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9418071970 0x7f9418155a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46340/0 (socket says 172.21.15.44:46340) 2024-09-13T18:36:07.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.327+0000 7f9417fff700 1 -- 172.21.15.44:0/1973684703 learned_addr learned my addr 172.21.15.44:0/1973684703 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:07.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.327+0000 7f940f7fe700 1 --2- 172.21.15.44:0/1973684703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94180cb860 0x7f9418149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:07.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.327+0000 7f941cc1c700 1 --2- 172.21.15.44:0/1973684703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9418159710 0x7f9418149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:07.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.327+0000 7f9417fff700 1 -- 172.21.15.44:0/1973684703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94180cb860 msgr2=0x7f9418149430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:07.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.327+0000 7f9417fff700 1 --2- 172.21.15.44:0/1973684703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94180cb860 0x7f9418149430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:07.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.327+0000 7f9417fff700 1 -- 172.21.15.44:0/1973684703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9418159710 msgr2=0x7f9418149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:07.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.327+0000 7f9417fff700 1 --2- 172.21.15.44:0/1973684703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9418159710 0x7f9418149970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:07.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.327+0000 7f9417fff700 1 -- 172.21.15.44:0/1973684703 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94000094b0 con 0x7f9418071970 2024-09-13T18:36:07.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.327+0000 7f9417fff700 1 --2- 172.21.15.44:0/1973684703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9418071970 0x7f9418155a50 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f940800c4d0 tx=0x7f940800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:07.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.327+0000 7f94157fa700 1 -- 172.21.15.44:0/1973684703 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9408005d90 con 0x7f9418071970 2024-09-13T18:36:07.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.327+0000 7f94157fa700 1 -- 172.21.15.44:0/1973684703 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94080070d0 con 0x7f9418071970 2024-09-13T18:36:07.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.327+0000 7f94157fa700 1 -- 172.21.15.44:0/1973684703 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9408007440 con 0x7f9418071970 2024-09-13T18:36:07.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.327+0000 7f941d41d700 1 -- 172.21.15.44:0/1973684703 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94180af970 con 0x7f9418071970 2024-09-13T18:36:07.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.327+0000 7f941d41d700 1 -- 172.21.15.44:0/1973684703 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94180aff30 con 0x7f9418071970 2024-09-13T18:36:07.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.331+0000 7f941d41d700 1 -- 172.21.15.44:0/1973684703 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941806c2f0 con 0x7f9418071970 2024-09-13T18:36:07.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.331+0000 7f94157fa700 1 -- 172.21.15.44:0/1973684703 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f94080075a0 con 0x7f9418071970 2024-09-13T18:36:07.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.331+0000 7f94157fa700 1 --2- 172.21.15.44:0/1973684703 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f93f8066760 0x7f93f8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:07.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.331+0000 7f94157fa700 1 -- 172.21.15.44:0/1973684703 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f94080833e0 con 0x7f9418071970 2024-09-13T18:36:07.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.331+0000 7f940f7fe700 1 --2- 172.21.15.44:0/1973684703 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f93f8066760 0x7f93f8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:07.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.331+0000 7f940f7fe700 1 --2- 172.21.15.44:0/1973684703 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f93f8066760 0x7f93f8068c20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f94000090b0 tx=0x7f9400008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:07.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.343+0000 7f94157fa700 1 -- 172.21.15.44:0/1973684703 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9408050830 con 0x7f9418071970 2024-09-13T18:36:07.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:07.515+0000 7f941d41d700 1 -- 172.21.15.44:0/1973684703 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9418153a10 con 0x7f9418071970 2024-09-13T18:36:08.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.175+0000 7f94157fa700 1 -- 172.21.15.44:0/1973684703 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v80) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9408053e50 con 0x7f9418071970 2024-09-13T18:36:08.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.183+0000 7f941d41d700 1 -- 172.21.15.44:0/1973684703 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f93f8066760 msgr2=0x7f93f8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:08.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.183+0000 7f941d41d700 1 --2- 172.21.15.44:0/1973684703 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f93f8066760 0x7f93f8068c20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f94000090b0 tx=0x7f9400008030 comp rx=0 tx=0).stop 2024-09-13T18:36:08.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.183+0000 7f941d41d700 1 -- 172.21.15.44:0/1973684703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9418071970 msgr2=0x7f9418155a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:08.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.183+0000 7f941d41d700 1 --2- 172.21.15.44:0/1973684703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9418071970 0x7f9418155a50 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f940800c4d0 tx=0x7f940800c7e0 comp rx=0 tx=0).stop 2024-09-13T18:36:08.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.183+0000 7f941d41d700 1 -- 172.21.15.44:0/1973684703 shutdown_connections 2024-09-13T18:36:08.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.183+0000 7f941d41d700 1 --2- 172.21.15.44:0/1973684703 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f93f8066760 0x7f93f8068c20 secure :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f94000090b0 tx=0x7f9400008030 comp rx=0 tx=0).stop 2024-09-13T18:36:08.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.183+0000 7f941d41d700 1 --2- 172.21.15.44:0/1973684703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9418159710 0x7f9418149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:08.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.183+0000 7f941d41d700 1 --2- 172.21.15.44:0/1973684703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94180cb860 0x7f9418149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:08.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.183+0000 7f941d41d700 1 --2- 172.21.15.44:0/1973684703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9418071970 0x7f9418155a50 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:08.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.183+0000 7f941d41d700 1 -- 172.21.15.44:0/1973684703 >> 172.21.15.44:0/1973684703 conn(0x7f94180cf460 msgr2=0x7f9418070320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:08.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.183+0000 7f941d41d700 1 -- 172.21.15.44:0/1973684703 shutdown_connections 2024-09-13T18:36:08.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.183+0000 7f941d41d700 1 -- 172.21.15.44:0/1973684703 wait complete. 2024-09-13T18:36:08.191 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:36:08.205 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:36:08.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.319+0000 7f9a5635a700 1 Processor -- start 2024-09-13T18:36:08.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.319+0000 7f9a5635a700 1 -- start start 2024-09-13T18:36:08.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a5635a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a5006c420 0x7f9a5006a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:08.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a5635a700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9a5006c800 0x7f9a500cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:08.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a5635a700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5015a0c0 con 0x7f9a500cb850 2024-09-13T18:36:08.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a5635a700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5015a3a0 con 0x7f9a5006c800 2024-09-13T18:36:08.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a5635a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5015a680 con 0x7f9a5006c420 2024-09-13T18:36:08.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a47fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9a5006c800 0x7f9a500cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:08.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a47fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9a5006c800 0x7f9a500cb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46354/0 (socket says 172.21.15.44:46354) 2024-09-13T18:36:08.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a47fff700 1 -- 172.21.15.44:0/1725428993 learned_addr learned my addr 172.21.15.44:0/1725428993 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:08.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a4ffff700 1 --2- 172.21.15.44:0/1725428993 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a5006c420 0x7f9a5006a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:08.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a47fff700 1 -- 172.21.15.44:0/1725428993 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a5006c420 msgr2=0x7f9a5006a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:08.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a47fff700 1 --2- 172.21.15.44:0/1725428993 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a5006c420 0x7f9a5006a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:08.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a47fff700 1 -- 172.21.15.44:0/1725428993 >> v1:172.21.15.99:6789/0 conn(0x7f9a500cb850 legacy=0x7f9a5006e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:08.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a47fff700 1 -- 172.21.15.44:0/1725428993 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5015a960 con 0x7f9a5006c800 2024-09-13T18:36:08.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a47fff700 1 --2- 172.21.15.44:0/1725428993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a5006c800 0x7f9a500cb310 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f9a38009910 tx=0x7f9a38009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d657c85a60e9a603 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:08.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a4f7fe700 1 -- 172.21.15.44:0/1725428993 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a38011830 con 0x7f9a5006c800 2024-09-13T18:36:08.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a4f7fe700 1 -- 172.21.15.44:0/1725428993 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a38011990 con 0x7f9a5006c800 2024-09-13T18:36:08.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a4f7fe700 1 -- 172.21.15.44:0/1725428993 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a38011d40 con 0x7f9a5006c800 2024-09-13T18:36:08.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a5635a700 1 -- 172.21.15.44:0/1725428993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a5006c800 msgr2=0x7f9a500cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:08.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a5635a700 1 --2- 172.21.15.44:0/1725428993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a5006c800 0x7f9a500cb310 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f9a38009910 tx=0x7f9a38009c20 comp rx=0 tx=0).stop 2024-09-13T18:36:08.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a5635a700 1 -- 172.21.15.44:0/1725428993 shutdown_connections 2024-09-13T18:36:08.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a5635a700 1 --2- 172.21.15.44:0/1725428993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a5006c800 0x7f9a500cb310 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:08.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a5635a700 1 --2- 172.21.15.44:0/1725428993 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a5006c420 0x7f9a5006a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:08.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a5635a700 1 -- 172.21.15.44:0/1725428993 >> 172.21.15.44:0/1725428993 conn(0x7f9a5006d900 msgr2=0x7f9a5006dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:08.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a5635a700 1 -- 172.21.15.44:0/1725428993 shutdown_connections 2024-09-13T18:36:08.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.323+0000 7f9a5635a700 1 -- 172.21.15.44:0/1725428993 wait complete. 2024-09-13T18:36:08.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a5635a700 1 Processor -- start 2024-09-13T18:36:08.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a5635a700 1 -- start start 2024-09-13T18:36:08.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a5635a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a5006c420 0x7f9a501594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:08.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a5635a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a5006c800 0x7f9a5014bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:08.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a5635a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a500cb850 0x7f9a500cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:08.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a5635a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a50148540 con 0x7f9a500cb850 2024-09-13T18:36:08.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a5635a700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5014cfc0 con 0x7f9a5006c420 2024-09-13T18:36:08.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a5635a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5014c1a0 con 0x7f9a5006c800 2024-09-13T18:36:08.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a47fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a5006c800 0x7f9a5014bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:08.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a548f7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a500cb850 0x7f9a500cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:08.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a4ffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a5006c420 0x7f9a501594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:08.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a47fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a5006c800 0x7f9a5014bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:47252/0 (socket says 172.21.15.44:47252) 2024-09-13T18:36:08.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a47fff700 1 -- 172.21.15.44:0/4109426352 learned_addr learned my addr 172.21.15.44:0/4109426352 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:08.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a548f7700 1 -- 172.21.15.44:0/4109426352 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a5006c800 msgr2=0x7f9a5014bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:08.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a548f7700 1 --2- 172.21.15.44:0/4109426352 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a5006c800 0x7f9a5014bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:08.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a548f7700 1 -- 172.21.15.44:0/4109426352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a5006c420 msgr2=0x7f9a501594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:08.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a548f7700 1 --2- 172.21.15.44:0/4109426352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a5006c420 0x7f9a501594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:08.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a548f7700 1 -- 172.21.15.44:0/4109426352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a38009570 con 0x7f9a500cb850 2024-09-13T18:36:08.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a548f7700 1 --2- 172.21.15.44:0/4109426352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a500cb850 0x7f9a500cde50 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f9a4800cae0 tx=0x7f9a4800cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:08.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a4d7fa700 1 -- 172.21.15.44:0/4109426352 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a48003c20 con 0x7f9a500cb850 2024-09-13T18:36:08.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a4d7fa700 1 -- 172.21.15.44:0/4109426352 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a48003d80 con 0x7f9a500cb850 2024-09-13T18:36:08.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a5635a700 1 -- 172.21.15.44:0/4109426352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5014c440 con 0x7f9a500cb850 2024-09-13T18:36:08.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a4d7fa700 1 -- 172.21.15.44:0/4109426352 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4800aa20 con 0x7f9a500cb850 2024-09-13T18:36:08.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.327+0000 7f9a5635a700 1 -- 172.21.15.44:0/4109426352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5014ca00 con 0x7f9a500cb850 2024-09-13T18:36:08.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.331+0000 7f9a5635a700 1 -- 172.21.15.44:0/4109426352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a500aeb00 con 0x7f9a500cb850 2024-09-13T18:36:08.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.331+0000 7f9a4d7fa700 1 -- 172.21.15.44:0/4109426352 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9a4800ab80 con 0x7f9a500cb850 2024-09-13T18:36:08.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.331+0000 7f9a4d7fa700 1 --2- 172.21.15.44:0/4109426352 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9a30066730 0x7f9a30068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:08.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.331+0000 7f9a4d7fa700 1 -- 172.21.15.44:0/4109426352 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f9a48083e60 con 0x7f9a500cb850 2024-09-13T18:36:08.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.331+0000 7f9a4ffff700 1 --2- 172.21.15.44:0/4109426352 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9a30066730 0x7f9a30068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:08.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.335+0000 7f9a4ffff700 1 --2- 172.21.15.44:0/4109426352 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9a30066730 0x7f9a30068bf0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009bf0 tx=0x7f9a40009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:08.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.339+0000 7f9a4d7fa700 1 -- 172.21.15.44:0/4109426352 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9a48051320 con 0x7f9a500cb850 2024-09-13T18:36:08.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:08.515+0000 7f9a5635a700 1 -- 172.21.15.44:0/4109426352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9a5014d8c0 con 0x7f9a500cb850 2024-09-13T18:36:09.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.187+0000 7f9a4d7fa700 1 -- 172.21.15.44:0/4109426352 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v81) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9a5014d8c0 con 0x7f9a500cb850 2024-09-13T18:36:09.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.195+0000 7f9a5635a700 1 -- 172.21.15.44:0/4109426352 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9a30066730 msgr2=0x7f9a30068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:09.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.195+0000 7f9a5635a700 1 --2- 172.21.15.44:0/4109426352 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9a30066730 0x7f9a30068bf0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009bf0 tx=0x7f9a40009240 comp rx=0 tx=0).stop 2024-09-13T18:36:09.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.195+0000 7f9a5635a700 1 -- 172.21.15.44:0/4109426352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a500cb850 msgr2=0x7f9a500cde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:09.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.195+0000 7f9a5635a700 1 --2- 172.21.15.44:0/4109426352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a500cb850 0x7f9a500cde50 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f9a4800cae0 tx=0x7f9a4800cdf0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.195+0000 7f9a5635a700 1 -- 172.21.15.44:0/4109426352 shutdown_connections 2024-09-13T18:36:09.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.195+0000 7f9a5635a700 1 --2- 172.21.15.44:0/4109426352 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9a30066730 0x7f9a30068bf0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.195+0000 7f9a5635a700 1 --2- 172.21.15.44:0/4109426352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a500cb850 0x7f9a500cde50 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.195+0000 7f9a5635a700 1 --2- 172.21.15.44:0/4109426352 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a5006c800 0x7f9a5014bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.195+0000 7f9a5635a700 1 --2- 172.21.15.44:0/4109426352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a5006c420 0x7f9a501594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.195+0000 7f9a5635a700 1 -- 172.21.15.44:0/4109426352 >> 172.21.15.44:0/4109426352 conn(0x7f9a5006d900 msgr2=0x7f9a50070420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:09.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.195+0000 7f9a5635a700 1 -- 172.21.15.44:0/4109426352 shutdown_connections 2024-09-13T18:36:09.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.195+0000 7f9a5635a700 1 -- 172.21.15.44:0/4109426352 wait complete. 2024-09-13T18:36:09.204 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2024-09-13T18:36:09.216 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:36:09.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.327+0000 7f09c6de2700 1 Processor -- start 2024-09-13T18:36:09.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.327+0000 7f09c6de2700 1 -- start start 2024-09-13T18:36:09.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.327+0000 7f09c6de2700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f09c015aae0 0x7f09c006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:09.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.327+0000 7f09c6de2700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f09c015e060 0x7f09c006e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:09.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.327+0000 7f09c6de2700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c00ae320 con 0x7f09c015a700 2024-09-13T18:36:09.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.327+0000 7f09c6de2700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c00ae580 con 0x7f09c015e060 2024-09-13T18:36:09.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.327+0000 7f09c6de2700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c0160a70 con 0x7f09c015aae0 2024-09-13T18:36:09.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.327+0000 7f09c65e1700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f09c015e060 0x7f09c006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:09.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.327+0000 7f09c65e1700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f09c015e060 0x7f09c006e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46366/0 (socket says 172.21.15.44:46366) 2024-09-13T18:36:09.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.327+0000 7f09c65e1700 1 -- 172.21.15.44:0/2155938314 learned_addr learned my addr 172.21.15.44:0/2155938314 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:09.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.331+0000 7f09c55df700 1 --2- 172.21.15.44:0/2155938314 >> v2:172.21.15.99:3300/0 conn(0x7f09c015aae0 0x7f09c006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:09.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.331+0000 7f09c65e1700 1 -- 172.21.15.44:0/2155938314 >> v2:172.21.15.99:3300/0 conn(0x7f09c015aae0 msgr2=0x7f09c006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:09.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.331+0000 7f09c65e1700 1 --2- 172.21.15.44:0/2155938314 >> v2:172.21.15.99:3300/0 conn(0x7f09c015aae0 0x7f09c006dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.331+0000 7f09c65e1700 1 -- 172.21.15.44:0/2155938314 >> v1:172.21.15.99:6789/0 conn(0x7f09c015a700 legacy=0x7f09c00adc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:09.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.331+0000 7f09c65e1700 1 -- 172.21.15.44:0/2155938314 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c0160d50 con 0x7f09c015e060 2024-09-13T18:36:09.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.331+0000 7f09c65e1700 1 --2- 172.21.15.44:0/2155938314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09c015e060 0x7f09c006e320 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f09b8009e50 tx=0x7f09b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a59b1c583e5d045 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:09.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.331+0000 7f09c4dde700 1 -- 172.21.15.44:0/2155938314 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b800e070 con 0x7f09c015e060 2024-09-13T18:36:09.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.331+0000 7f09c4dde700 1 -- 172.21.15.44:0/2155938314 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b800b980 con 0x7f09c015e060 2024-09-13T18:36:09.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.331+0000 7f09c4dde700 1 -- 172.21.15.44:0/2155938314 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b800bd30 con 0x7f09c015e060 2024-09-13T18:36:09.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.331+0000 7f09c6de2700 1 -- 172.21.15.44:0/2155938314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09c015e060 msgr2=0x7f09c006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:09.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.331+0000 7f09c6de2700 1 --2- 172.21.15.44:0/2155938314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09c015e060 0x7f09c006e320 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f09b8009e50 tx=0x7f09b800b330 comp rx=0 tx=0).stop 2024-09-13T18:36:09.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.331+0000 7f09c6de2700 1 -- 172.21.15.44:0/2155938314 shutdown_connections 2024-09-13T18:36:09.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.331+0000 7f09c6de2700 1 --2- 172.21.15.44:0/2155938314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09c015e060 0x7f09c006e320 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.331+0000 7f09c6de2700 1 --2- 172.21.15.44:0/2155938314 >> v2:172.21.15.99:3300/0 conn(0x7f09c015aae0 0x7f09c006dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.331+0000 7f09c6de2700 1 -- 172.21.15.44:0/2155938314 >> 172.21.15.44:0/2155938314 conn(0x7f09c00cf9a0 msgr2=0x7f09c00cfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:09.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.331+0000 7f09c6de2700 1 -- 172.21.15.44:0/2155938314 shutdown_connections 2024-09-13T18:36:09.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.331+0000 7f09c6de2700 1 -- 172.21.15.44:0/2155938314 wait complete. 2024-09-13T18:36:09.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.331+0000 7f09c6de2700 1 Processor -- start 2024-09-13T18:36:09.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.331+0000 7f09c6de2700 1 -- start start 2024-09-13T18:36:09.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09c6de2700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f09c015a700 0x7f09c00b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:09.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09c6de2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09c015aae0 0x7f09c0160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:09.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09c6de2700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09c015e060 0x7f09c0157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:09.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09c6de2700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c0160590 con 0x7f09c015aae0 2024-09-13T18:36:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09c6de2700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c006bb10 con 0x7f09c015e060 2024-09-13T18:36:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09c6de2700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c006bdf0 con 0x7f09c015a700 2024-09-13T18:36:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09c55df700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09c015aae0 0x7f09c0160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09c55df700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09c015aae0 0x7f09c0160050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46370/0 (socket says 172.21.15.44:46370) 2024-09-13T18:36:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09c55df700 1 -- 172.21.15.44:0/2299800748 learned_addr learned my addr 172.21.15.44:0/2299800748 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09c65e1700 1 --2- 172.21.15.44:0/2299800748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09c015e060 0x7f09c0157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09c5de0700 1 --2- 172.21.15.44:0/2299800748 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f09c015a700 0x7f09c00b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09c55df700 1 -- 172.21.15.44:0/2299800748 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f09c015a700 msgr2=0x7f09c00b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09c55df700 1 --2- 172.21.15.44:0/2299800748 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f09c015a700 0x7f09c00b4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09c55df700 1 -- 172.21.15.44:0/2299800748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09c015e060 msgr2=0x7f09c0157260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09c55df700 1 --2- 172.21.15.44:0/2299800748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09c015e060 0x7f09c0157260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09c55df700 1 -- 172.21.15.44:0/2299800748 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b8009b30 con 0x7f09c015aae0 2024-09-13T18:36:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09c55df700 1 --2- 172.21.15.44:0/2299800748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09c015aae0 0x7f09c0160050 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f09b000e810 tx=0x7f09b000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:09.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09b67fc700 1 -- 172.21.15.44:0/2299800748 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b0013610 con 0x7f09c015aae0 2024-09-13T18:36:09.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09b67fc700 1 -- 172.21.15.44:0/2299800748 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b0013770 con 0x7f09c015aae0 2024-09-13T18:36:09.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09c6de2700 1 -- 172.21.15.44:0/2299800748 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c006c0d0 con 0x7f09c015aae0 2024-09-13T18:36:09.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09b67fc700 1 -- 172.21.15.44:0/2299800748 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b0013b20 con 0x7f09c015aae0 2024-09-13T18:36:09.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09c6de2700 1 -- 172.21.15.44:0/2299800748 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c01577a0 con 0x7f09c015aae0 2024-09-13T18:36:09.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09c6de2700 1 -- 172.21.15.44:0/2299800748 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c00b2bb0 con 0x7f09c015aae0 2024-09-13T18:36:09.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09b67fc700 1 -- 172.21.15.44:0/2299800748 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f09b0013c80 con 0x7f09c015aae0 2024-09-13T18:36:09.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09b67fc700 1 --2- 172.21.15.44:0/2299800748 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f09a4066730 0x7f09a4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:09.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09b67fc700 1 -- 172.21.15.44:0/2299800748 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f09b0083b60 con 0x7f09c015aae0 2024-09-13T18:36:09.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.335+0000 7f09c5de0700 1 --2- 172.21.15.44:0/2299800748 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f09a4066730 0x7f09a4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:09.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.339+0000 7f09c5de0700 1 --2- 172.21.15.44:0/2299800748 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f09a4066730 0x7f09a4068bf0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f09bc000f60 tx=0x7f09bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:09.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.339+0000 7f09b67fc700 1 -- 172.21.15.44:0/2299800748 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f09b00511e0 con 0x7f09c015aae0 2024-09-13T18:36:09.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.515+0000 7f09c6de2700 1 -- 172.21.15.44:0/2299800748 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f09c00adc10 con 0x7f09c015aae0 2024-09-13T18:36:09.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.519+0000 7f09b67fc700 1 -- 172.21.15.44:0/2299800748 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f09b0054800 con 0x7f09c015aae0 2024-09-13T18:36:09.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.523+0000 7f09c6de2700 1 -- 172.21.15.44:0/2299800748 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f09a4066730 msgr2=0x7f09a4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:09.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.523+0000 7f09c6de2700 1 --2- 172.21.15.44:0/2299800748 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f09a4066730 0x7f09a4068bf0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f09bc000f60 tx=0x7f09bc009040 comp rx=0 tx=0).stop 2024-09-13T18:36:09.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.523+0000 7f09c6de2700 1 -- 172.21.15.44:0/2299800748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09c015aae0 msgr2=0x7f09c0160050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:09.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.523+0000 7f09c6de2700 1 --2- 172.21.15.44:0/2299800748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09c015aae0 0x7f09c0160050 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f09b000e810 tx=0x7f09b000ebd0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.523+0000 7f09c6de2700 1 -- 172.21.15.44:0/2299800748 shutdown_connections 2024-09-13T18:36:09.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.523+0000 7f09c6de2700 1 --2- 172.21.15.44:0/2299800748 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f09a4066730 0x7f09a4068bf0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.523+0000 7f09c6de2700 1 --2- 172.21.15.44:0/2299800748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09c015e060 0x7f09c0157260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.523+0000 7f09c6de2700 1 --2- 172.21.15.44:0/2299800748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09c015aae0 0x7f09c0160050 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.523+0000 7f09c6de2700 1 --2- 172.21.15.44:0/2299800748 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f09c015a700 0x7f09c00b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.523+0000 7f09c6de2700 1 -- 172.21.15.44:0/2299800748 >> 172.21.15.44:0/2299800748 conn(0x7f09c00cf9a0 msgr2=0x7f09c00b0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:09.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.523+0000 7f09c6de2700 1 -- 172.21.15.44:0/2299800748 shutdown_connections 2024-09-13T18:36:09.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.523+0000 7f09c6de2700 1 -- 172.21.15.44:0/2299800748 wait complete. 2024-09-13T18:36:09.543 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool' 2024-09-13T18:36:09.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc7308c700 1 Processor -- start 2024-09-13T18:36:09.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc7308c700 1 -- start start 2024-09-13T18:36:09.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc7308c700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbc6c165590 0x7fbc6c1619a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:09.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc7308c700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6c071f30 con 0x7fbc6c0b3ae0 2024-09-13T18:36:09.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc7308c700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6c1622e0 con 0x7fbc6c160eb0 2024-09-13T18:36:09.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc7308c700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6c162000 con 0x7fbc6c165590 2024-09-13T18:36:09.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71889700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fbc6c0b3ae0 0x7fbc6c161290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:32944/0 (socket says 172.21.15.44:32944) 2024-09-13T18:36:09.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71889700 1 -- 172.21.15.44:0/65002343 learned_addr learned my addr 172.21.15.44:0/65002343 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:09.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc7288b700 1 --2- 172.21.15.44:0/65002343 >> v2:172.21.15.99:3300/0 conn(0x7fbc6c165590 0x7fbc6c1619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:09.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71088700 1 -- 172.21.15.44:0/65002343 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257558481 0 0) 0x7fbc6c071f30 con 0x7fbc6c0b3ae0 2024-09-13T18:36:09.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71088700 1 -- 172.21.15.44:0/65002343 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc580035d0 con 0x7fbc6c0b3ae0 2024-09-13T18:36:09.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71088700 1 -- 172.21.15.44:0/65002343 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3338811553 0 0) 0x7fbc580035d0 con 0x7fbc6c0b3ae0 2024-09-13T18:36:09.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71088700 1 -- 172.21.15.44:0/65002343 >> v2:172.21.15.99:3300/0 conn(0x7fbc6c165590 msgr2=0x7fbc6c1619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:09.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71088700 1 --2- 172.21.15.44:0/65002343 >> v2:172.21.15.99:3300/0 conn(0x7fbc6c165590 0x7fbc6c1619a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71088700 1 -- 172.21.15.44:0/65002343 >> v1:172.21.15.99:6789/0 conn(0x7fbc6c160eb0 legacy=0x7fbc6c0b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:09.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71088700 1 -- 172.21.15.44:0/65002343 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c164ab0 con 0x7fbc6c0b3ae0 2024-09-13T18:36:09.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71088700 1 -- 172.21.15.44:0/65002343 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7fbc5c001670 con 0x7fbc6c0b3ae0 2024-09-13T18:36:09.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71088700 1 -- 172.21.15.44:0/65002343 >> v1:172.21.15.44:6789/0 conn(0x7fbc6c0b3ae0 legacy=0x7fbc6c161290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:09.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71088700 1 --2- 172.21.15.44:0/65002343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc58003a20 0x7fbc58003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:09.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71088700 1 --2- 172.21.15.44:0/65002343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc58004870 0x7fbc58004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:09.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71088700 1 --2- 172.21.15.44:0/65002343 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc58005230 0x7fbc5800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:09.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71088700 1 -- 172.21.15.44:0/65002343 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c162000 con 0x7fbc58004870 2024-09-13T18:36:09.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71088700 1 -- 172.21.15.44:0/65002343 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5800c0d0 con 0x7fbc58003a20 2024-09-13T18:36:09.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71088700 1 -- 172.21.15.44:0/65002343 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5800c290 con 0x7fbc58005230 2024-09-13T18:36:09.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71889700 1 --2- 172.21.15.44:0/65002343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc58004870 0x7fbc58004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:09.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc7208a700 1 --2- 172.21.15.44:0/65002343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc58003a20 0x7fbc58003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:09.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc7288b700 1 --2- 172.21.15.44:0/65002343 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc58005230 0x7fbc5800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:09.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71889700 1 -- 172.21.15.44:0/65002343 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc58005230 msgr2=0x7fbc5800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:09.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71889700 1 --2- 172.21.15.44:0/65002343 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc58005230 0x7fbc5800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71889700 1 -- 172.21.15.44:0/65002343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc58003a20 msgr2=0x7fbc58003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:09.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71889700 1 --2- 172.21.15.44:0/65002343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc58003a20 0x7fbc58003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc7288b700 1 -- 172.21.15.44:0/65002343 reap_dead start 2024-09-13T18:36:09.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71889700 1 -- 172.21.15.44:0/65002343 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc580035d0 con 0x7fbc58004870 2024-09-13T18:36:09.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71889700 1 --2- 172.21.15.44:0/65002343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc58004870 0x7fbc58004cf0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00c320 tx=0x7fbc580058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa68ac78d28e337 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:09.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71088700 1 -- 172.21.15.44:0/65002343 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c007c30 con 0x7fbc58004870 2024-09-13T18:36:09.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71088700 1 -- 172.21.15.44:0/65002343 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5c00cde0 con 0x7fbc58004870 2024-09-13T18:36:09.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.651+0000 7fbc71088700 1 -- 172.21.15.44:0/65002343 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c005bc0 con 0x7fbc58004870 2024-09-13T18:36:09.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.655+0000 7fbc7308c700 1 -- 172.21.15.44:0/65002343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc58004870 msgr2=0x7fbc58004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:09.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.655+0000 7fbc7308c700 1 --2- 172.21.15.44:0/65002343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc58004870 0x7fbc58004cf0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00c320 tx=0x7fbc580058a0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.655+0000 7fbc7308c700 1 -- 172.21.15.44:0/65002343 shutdown_connections 2024-09-13T18:36:09.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.655+0000 7fbc7308c700 1 --2- 172.21.15.44:0/65002343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc58004870 0x7fbc58004cf0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.655+0000 7fbc7308c700 1 -- 172.21.15.44:0/65002343 >> 172.21.15.44:0/65002343 conn(0x7fbc6c0b0f00 msgr2=0x7fbc6c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:09.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.655+0000 7fbc7308c700 1 -- 172.21.15.44:0/65002343 shutdown_connections 2024-09-13T18:36:09.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.655+0000 7fbc7308c700 1 -- 172.21.15.44:0/65002343 wait complete. 2024-09-13T18:36:09.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.655+0000 7fbc7308c700 1 Processor -- start 2024-09-13T18:36:09.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.655+0000 7fbc7308c700 1 -- start start 2024-09-13T18:36:09.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.655+0000 7fbc7308c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc58004870 0x7fbc6c155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:09.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.655+0000 7fbc7308c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc6c155940 0x7fbc6c154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:09.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.655+0000 7fbc7308c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc6c1ea830 0x7fbc6c1eacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:09.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.659+0000 7fbc7308c700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c06b680 con 0x7fbc6c1ea830 2024-09-13T18:36:09.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.659+0000 7fbc7308c700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c1eb7d0 con 0x7fbc58004870 2024-09-13T18:36:09.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.659+0000 7fbc7308c700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c1ebab0 con 0x7fbc6c155940 2024-09-13T18:36:09.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.659+0000 7fbc7288b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc6c1ea830 0x7fbc6c1eacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:09.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.659+0000 7fbc7288b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc6c1ea830 0x7fbc6c1eacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46390/0 (socket says 172.21.15.44:46390) 2024-09-13T18:36:09.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.659+0000 7fbc7288b700 1 -- 172.21.15.44:0/3800818088 learned_addr learned my addr 172.21.15.44:0/3800818088 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:09.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.659+0000 7fbc7208a700 1 --2- 172.21.15.44:0/3800818088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc58004870 0x7fbc6c155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:09.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.659+0000 7fbc71889700 1 --2- 172.21.15.44:0/3800818088 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc6c155940 0x7fbc6c154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:09.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.659+0000 7fbc7288b700 1 -- 172.21.15.44:0/3800818088 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc6c155940 msgr2=0x7fbc6c154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:09.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.659+0000 7fbc7288b700 1 --2- 172.21.15.44:0/3800818088 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc6c155940 0x7fbc6c154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.659+0000 7fbc7288b700 1 -- 172.21.15.44:0/3800818088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc58004870 msgr2=0x7fbc6c155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:09.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.659+0000 7fbc7288b700 1 --2- 172.21.15.44:0/3800818088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc58004870 0x7fbc6c155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.659+0000 7fbc7288b700 1 -- 172.21.15.44:0/3800818088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c1ebd90 con 0x7fbc6c1ea830 2024-09-13T18:36:09.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.659+0000 7fbc7208a700 1 --2- 172.21.15.44:0/3800818088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc58004870 0x7fbc6c155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:09.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.659+0000 7fbc7288b700 1 --2- 172.21.15.44:0/3800818088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc6c1ea830 0x7fbc6c1eacc0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c071f00 tx=0x7fbc64009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:09.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.659+0000 7fbc62ffd700 1 -- 172.21.15.44:0/3800818088 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6400e070 con 0x7fbc6c1ea830 2024-09-13T18:36:09.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.659+0000 7fbc62ffd700 1 -- 172.21.15.44:0/3800818088 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc64003d10 con 0x7fbc6c1ea830 2024-09-13T18:36:09.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.659+0000 7fbc7308c700 1 -- 172.21.15.44:0/3800818088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc6c06b310 con 0x7fbc6c1ea830 2024-09-13T18:36:09.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.659+0000 7fbc62ffd700 1 -- 172.21.15.44:0/3800818088 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc64011730 con 0x7fbc6c1ea830 2024-09-13T18:36:09.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.659+0000 7fbc7308c700 1 -- 172.21.15.44:0/3800818088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6c1eb200 con 0x7fbc6c1ea830 2024-09-13T18:36:09.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.659+0000 7fbc7308c700 1 -- 172.21.15.44:0/3800818088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc6c161290 con 0x7fbc6c1ea830 2024-09-13T18:36:09.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.659+0000 7fbc62ffd700 1 -- 172.21.15.44:0/3800818088 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbc64011890 con 0x7fbc6c1ea830 2024-09-13T18:36:09.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.663+0000 7fbc62ffd700 1 --2- 172.21.15.44:0/3800818088 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbc50066730 0x7fbc50068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:09.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.663+0000 7fbc62ffd700 1 -- 172.21.15.44:0/3800818088 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbc64084080 con 0x7fbc6c1ea830 2024-09-13T18:36:09.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.663+0000 7fbc7208a700 1 --2- 172.21.15.44:0/3800818088 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbc50066730 0x7fbc50068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:09.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.663+0000 7fbc7208a700 1 --2- 172.21.15.44:0/3800818088 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbc50066730 0x7fbc50068bf0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c15c830 tx=0x7fbc68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:09.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.667+0000 7fbc62ffd700 1 -- 172.21.15.44:0/3800818088 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbc64051780 con 0x7fbc6c1ea830 2024-09-13T18:36:09.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:09.903+0000 7fbc7308c700 1 -- 172.21.15.44:0/3800818088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool"]} v 0) v1 -- 0x7fbc6c06b7c0 con 0x7fbc6c1ea830 2024-09-13T18:36:10.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.187+0000 7fbc62ffd700 1 -- 172.21.15.44:0/3800818088 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool"]}]=0 v402) v1 ==== 145+0+0 (secure 0 0 0) 0x7fbc64054da0 con 0x7fbc6c1ea830 2024-09-13T18:36:10.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.191+0000 7fbc7308c700 1 -- 172.21.15.44:0/3800818088 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbc50066730 msgr2=0x7fbc50068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:10.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.191+0000 7fbc7308c700 1 --2- 172.21.15.44:0/3800818088 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbc50066730 0x7fbc50068bf0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c15c830 tx=0x7fbc68009040 comp rx=0 tx=0).stop 2024-09-13T18:36:10.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.191+0000 7fbc7308c700 1 -- 172.21.15.44:0/3800818088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc6c1ea830 msgr2=0x7fbc6c1eacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:10.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.191+0000 7fbc7308c700 1 --2- 172.21.15.44:0/3800818088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc6c1ea830 0x7fbc6c1eacc0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c071f00 tx=0x7fbc64009f70 comp rx=0 tx=0).stop 2024-09-13T18:36:10.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.191+0000 7fbc7308c700 1 -- 172.21.15.44:0/3800818088 shutdown_connections 2024-09-13T18:36:10.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.191+0000 7fbc7308c700 1 --2- 172.21.15.44:0/3800818088 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbc50066730 0x7fbc50068bf0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.191+0000 7fbc7308c700 1 --2- 172.21.15.44:0/3800818088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc6c1ea830 0x7fbc6c1eacc0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.191+0000 7fbc7308c700 1 --2- 172.21.15.44:0/3800818088 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbc6c155940 0x7fbc6c154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.191+0000 7fbc7308c700 1 --2- 172.21.15.44:0/3800818088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc58004870 0x7fbc6c155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.191+0000 7fbc7308c700 1 -- 172.21.15.44:0/3800818088 >> 172.21.15.44:0/3800818088 conn(0x7fbc6c0b0f00 msgr2=0x7fbc6c163be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:10.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.191+0000 7fbc7308c700 1 -- 172.21.15.44:0/3800818088 shutdown_connections 2024-09-13T18:36:10.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.191+0000 7fbc7308c700 1 -- 172.21.15.44:0/3800818088 wait complete. 2024-09-13T18:36:10.217 INFO:tasks.cephfs_test_runner:test_table_tool (tasks.cephfs.test_journal_repair.TestJournalRepair) ... ok 2024-09-13T18:36:10.217 INFO:tasks.cephfs_test_runner:Starting test: test_table_tool_take_inos (tasks.cephfs.test_journal_repair.TestJournalRepair) 2024-09-13T18:36:10.217 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:10.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.331+0000 7f0ca2709700 1 Processor -- start 2024-09-13T18:36:10.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.331+0000 7f0ca2709700 1 -- start start 2024-09-13T18:36:10.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.331+0000 7f0ca2709700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c9c0b2b00 0x7f0c9c06ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:10.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.331+0000 7f0ca2709700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c9c15bc70 con 0x7f0c9c15b890 2024-09-13T18:36:10.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.331+0000 7f0ca2709700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c9c0ccc20 con 0x7f0c9c0cdcc0 2024-09-13T18:36:10.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.331+0000 7f0ca2709700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c0ccf00 con 0x7f0c9c0b2b00 2024-09-13T18:36:10.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.331+0000 7f0c9bfff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0c9c15b890 0x7f0c9c162220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:32960/0 (socket says 172.21.15.44:32960) 2024-09-13T18:36:10.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.331+0000 7f0c9bfff700 1 -- 172.21.15.44:0/4054025421 learned_addr learned my addr 172.21.15.44:0/4054025421 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:10.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.331+0000 7f0ca0ca6700 1 --2- 172.21.15.44:0/4054025421 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c9c0b2b00 0x7f0c9c06ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:10.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.331+0000 7f0c9affd700 1 -- 172.21.15.44:0/4054025421 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 526670559 0 0) 0x7f0c9c15bc70 con 0x7f0c9c15b890 2024-09-13T18:36:10.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.331+0000 7f0c9affd700 1 -- 172.21.15.44:0/4054025421 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c880035d0 con 0x7f0c9c15b890 2024-09-13T18:36:10.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.331+0000 7f0c9affd700 1 -- 172.21.15.44:0/4054025421 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3655236021 0 0) 0x7f0c9c0ccc20 con 0x7f0c9c0cdcc0 2024-09-13T18:36:10.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.331+0000 7f0c9affd700 1 -- 172.21.15.44:0/4054025421 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c9c15bc70 con 0x7f0c9c0cdcc0 2024-09-13T18:36:10.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.331+0000 7f0c9affd700 1 -- 172.21.15.44:0/4054025421 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2179106117 0 0) 0x7f0c880035d0 con 0x7f0c9c15b890 2024-09-13T18:36:10.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.331+0000 7f0ca0ca6700 1 -- 172.21.15.44:0/4054025421 >> v1:172.21.15.99:6789/0 conn(0x7f0c9c0cdcc0 legacy=0x7f0c9c0b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:10.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.331+0000 7f0ca0ca6700 1 -- 172.21.15.44:0/4054025421 >> v1:172.21.15.44:6789/0 conn(0x7f0c9c15b890 legacy=0x7f0c9c162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:10.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.331+0000 7f0ca0ca6700 1 -- 172.21.15.44:0/4054025421 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c0cd1e0 con 0x7f0c9c0b2b00 2024-09-13T18:36:10.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.331+0000 7f0ca0ca6700 1 --2- 172.21.15.44:0/4054025421 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c9c0b2b00 0x7f0c9c06ffe0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009880 tx=0x7f0c8c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d5278d4adae597d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:10.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.331+0000 7f0c9affd700 1 -- 172.21.15.44:0/4054025421 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c940019f0 con 0x7f0c9c0b2b00 2024-09-13T18:36:10.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.331+0000 7f0c9affd700 1 -- 172.21.15.44:0/4054025421 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8c004030 con 0x7f0c9c0b2b00 2024-09-13T18:36:10.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.331+0000 7f0c9affd700 1 -- 172.21.15.44:0/4054025421 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c0043a0 con 0x7f0c9c0b2b00 2024-09-13T18:36:10.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.335+0000 7f0ca2709700 1 -- 172.21.15.44:0/4054025421 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c9c0b2b00 msgr2=0x7f0c9c06ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:10.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.335+0000 7f0ca2709700 1 --2- 172.21.15.44:0/4054025421 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c9c0b2b00 0x7f0c9c06ffe0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009880 tx=0x7f0c8c009b90 comp rx=0 tx=0).stop 2024-09-13T18:36:10.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.335+0000 7f0ca2709700 1 -- 172.21.15.44:0/4054025421 shutdown_connections 2024-09-13T18:36:10.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.335+0000 7f0ca2709700 1 --2- 172.21.15.44:0/4054025421 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c9c0b2b00 0x7f0c9c06ffe0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.335+0000 7f0ca2709700 1 -- 172.21.15.44:0/4054025421 >> 172.21.15.44:0/4054025421 conn(0x7f0c9c0ce980 msgr2=0x7f0c9c0ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:10.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.335+0000 7f0ca2709700 1 -- 172.21.15.44:0/4054025421 shutdown_connections 2024-09-13T18:36:10.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.335+0000 7f0ca2709700 1 -- 172.21.15.44:0/4054025421 wait complete. 2024-09-13T18:36:10.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.335+0000 7f0ca2709700 1 Processor -- start 2024-09-13T18:36:10.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.335+0000 7f0ca2709700 1 -- start start 2024-09-13T18:36:10.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.335+0000 7f0ca2709700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c9c0b2b00 0x7f0c9c06a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:10.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.335+0000 7f0ca2709700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c9c0cdcc0 0x7f0c9c15ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:10.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.335+0000 7f0ca2709700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c9c15b890 0x7f0c9c1f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:10.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.335+0000 7f0ca2709700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c156750 con 0x7f0c9c0b2b00 2024-09-13T18:36:10.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.335+0000 7f0ca2709700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c151730 con 0x7f0c9c0cdcc0 2024-09-13T18:36:10.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.335+0000 7f0ca2709700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c1563b0 con 0x7f0c9c15b890 2024-09-13T18:36:10.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.335+0000 7f0c9bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c9c0b2b00 0x7f0c9c06a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:10.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.335+0000 7f0c9bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c9c0b2b00 0x7f0c9c06a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46394/0 (socket says 172.21.15.44:46394) 2024-09-13T18:36:10.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.335+0000 7f0c9bfff700 1 -- 172.21.15.44:0/3332184732 learned_addr learned my addr 172.21.15.44:0/3332184732 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:10.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.339+0000 7f0ca0ca6700 1 --2- 172.21.15.44:0/3332184732 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c9c15b890 0x7f0c9c1f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:10.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.339+0000 7f0c9b7fe700 1 --2- 172.21.15.44:0/3332184732 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c9c0cdcc0 0x7f0c9c15ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:10.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.339+0000 7f0c9bfff700 1 -- 172.21.15.44:0/3332184732 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c9c15b890 msgr2=0x7f0c9c1f62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:10.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.339+0000 7f0c9bfff700 1 --2- 172.21.15.44:0/3332184732 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c9c15b890 0x7f0c9c1f62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.339+0000 7f0c9bfff700 1 -- 172.21.15.44:0/3332184732 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c9c0cdcc0 msgr2=0x7f0c9c15ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:10.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.339+0000 7f0c9bfff700 1 --2- 172.21.15.44:0/3332184732 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c9c0cdcc0 0x7f0c9c15ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.339+0000 7f0c9bfff700 1 -- 172.21.15.44:0/3332184732 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c0094b0 con 0x7f0c9c0b2b00 2024-09-13T18:36:10.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.339+0000 7f0c9bfff700 1 --2- 172.21.15.44:0/3332184732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c9c0b2b00 0x7f0c9c06a620 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400cc50 tx=0x7f0c9400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:10.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.339+0000 7f0c98ff9700 1 -- 172.21.15.44:0/3332184732 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9400aad0 con 0x7f0c9c0b2b00 2024-09-13T18:36:10.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.339+0000 7f0c98ff9700 1 -- 172.21.15.44:0/3332184732 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9400ac30 con 0x7f0c9c0b2b00 2024-09-13T18:36:10.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.339+0000 7f0ca2709700 1 -- 172.21.15.44:0/3332184732 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9c1f67f0 con 0x7f0c9c0b2b00 2024-09-13T18:36:10.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.339+0000 7f0c98ff9700 1 -- 172.21.15.44:0/3332184732 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c940070d0 con 0x7f0c9c0b2b00 2024-09-13T18:36:10.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.339+0000 7f0ca2709700 1 -- 172.21.15.44:0/3332184732 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9c06b2c0 con 0x7f0c9c0b2b00 2024-09-13T18:36:10.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.339+0000 7f0ca2709700 1 -- 172.21.15.44:0/3332184732 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c9c0cc880 con 0x7f0c9c0b2b00 2024-09-13T18:36:10.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.339+0000 7f0c98ff9700 1 -- 172.21.15.44:0/3332184732 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0c94007230 con 0x7f0c9c0b2b00 2024-09-13T18:36:10.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.339+0000 7f0c98ff9700 1 --2- 172.21.15.44:0/3332184732 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0c7c066780 0x7f0c7c068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:10.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.343+0000 7f0c98ff9700 1 -- 172.21.15.44:0/3332184732 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0c94083c80 con 0x7f0c9c0b2b00 2024-09-13T18:36:10.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.343+0000 7f0c9b7fe700 1 --2- 172.21.15.44:0/3332184732 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0c7c066780 0x7f0c7c068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:10.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.343+0000 7f0c9b7fe700 1 --2- 172.21.15.44:0/3332184732 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0c7c066780 0x7f0c7c068c40 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c15e5d0 tx=0x7f0c84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:10.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.351+0000 7f0c98ff9700 1 -- 172.21.15.44:0/3332184732 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0c940513d0 con 0x7f0c9c0b2b00 2024-09-13T18:36:10.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.519+0000 7f0ca2709700 1 -- 172.21.15.44:0/3332184732 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c9c160e80 con 0x7f0c9c0b2b00 2024-09-13T18:36:10.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.523+0000 7f0c98ff9700 1 -- 172.21.15.44:0/3332184732 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+12927 (secure 0 0 0) 0x7f0c94018020 con 0x7f0c9c0b2b00 2024-09-13T18:36:10.531 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:10.531 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":81,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:36:09.171368+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/1921610909":"2024-09-14T18:36:06.136802+0000","172.21.15.44:6834/1921610909":"2024-09-14T18:36:06.136802+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:10.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.527+0000 7f0ca2709700 1 -- 172.21.15.44:0/3332184732 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0c7c066780 msgr2=0x7f0c7c068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:10.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.527+0000 7f0ca2709700 1 --2- 172.21.15.44:0/3332184732 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0c7c066780 0x7f0c7c068c40 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c15e5d0 tx=0x7f0c84009040 comp rx=0 tx=0).stop 2024-09-13T18:36:10.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.527+0000 7f0ca2709700 1 -- 172.21.15.44:0/3332184732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c9c0b2b00 msgr2=0x7f0c9c06a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:10.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.527+0000 7f0ca2709700 1 --2- 172.21.15.44:0/3332184732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c9c0b2b00 0x7f0c9c06a620 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400cc50 tx=0x7f0c9400cf60 comp rx=0 tx=0).stop 2024-09-13T18:36:10.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.527+0000 7f0ca2709700 1 -- 172.21.15.44:0/3332184732 shutdown_connections 2024-09-13T18:36:10.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.527+0000 7f0ca2709700 1 --2- 172.21.15.44:0/3332184732 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0c7c066780 0x7f0c7c068c40 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.527+0000 7f0ca2709700 1 --2- 172.21.15.44:0/3332184732 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c9c15b890 0x7f0c9c1f62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.527+0000 7f0ca2709700 1 --2- 172.21.15.44:0/3332184732 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c9c0cdcc0 0x7f0c9c15ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.527+0000 7f0ca2709700 1 --2- 172.21.15.44:0/3332184732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c9c0b2b00 0x7f0c9c06a620 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.527+0000 7f0ca2709700 1 -- 172.21.15.44:0/3332184732 >> 172.21.15.44:0/3332184732 conn(0x7f0c9c0ce980 msgr2=0x7f0c9c071450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:10.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.527+0000 7f0ca2709700 1 -- 172.21.15.44:0/3332184732 shutdown_connections 2024-09-13T18:36:10.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.527+0000 7f0ca2709700 1 -- 172.21.15.44:0/3332184732 wait complete. 2024-09-13T18:36:10.547 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:36:10.548 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:36:10.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.659+0000 7f8daf1b9700 1 Processor -- start 2024-09-13T18:36:10.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.659+0000 7f8daf1b9700 1 -- start start 2024-09-13T18:36:10.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.663+0000 7f8daf1b9700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8da80ae0f0 0x7f8da80b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:10.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.663+0000 7f8daf1b9700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8da80b3d50 0x7f8da8071590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:10.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.663+0000 7f8daf1b9700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8da80b4590 con 0x7f8da80cf360 2024-09-13T18:36:10.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.663+0000 7f8daf1b9700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8da80cf740 con 0x7f8da80ae0f0 2024-09-13T18:36:10.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.663+0000 7f8daf1b9700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da80b4b50 con 0x7f8da80b3d50 2024-09-13T18:36:10.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.663+0000 7f8dad9b6700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8da80ae0f0 0x7f8da80b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:10.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.663+0000 7f8dad9b6700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8da80ae0f0 0x7f8da80b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46398/0 (socket says 172.21.15.44:46398) 2024-09-13T18:36:10.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.663+0000 7f8dad9b6700 1 -- 172.21.15.44:0/1777590458 learned_addr learned my addr 172.21.15.44:0/1777590458 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:10.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.663+0000 7f8dae9b8700 1 --2- 172.21.15.44:0/1777590458 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8da80b3d50 0x7f8da8071590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:10.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.663+0000 7f8dad9b6700 1 -- 172.21.15.44:0/1777590458 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8da80b3d50 msgr2=0x7f8da8071590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:10.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.663+0000 7f8dad9b6700 1 --2- 172.21.15.44:0/1777590458 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8da80b3d50 0x7f8da8071590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.663+0000 7f8dad9b6700 1 -- 172.21.15.44:0/1777590458 >> v1:172.21.15.99:6789/0 conn(0x7f8da80cf360 legacy=0x7f8da80ad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:10.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.663+0000 7f8dad9b6700 1 -- 172.21.15.44:0/1777590458 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da80b4870 con 0x7f8da80ae0f0 2024-09-13T18:36:10.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.663+0000 7f8dad9b6700 1 --2- 172.21.15.44:0/1777590458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da80ae0f0 0x7f8da80b3810 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c009940 tx=0x7f8d9c009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c5c033bc87f945 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:10.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.663+0000 7f8dad1b5700 1 -- 172.21.15.44:0/1777590458 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c011830 con 0x7f8da80ae0f0 2024-09-13T18:36:10.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.663+0000 7f8dad1b5700 1 -- 172.21.15.44:0/1777590458 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9c011990 con 0x7f8da80ae0f0 2024-09-13T18:36:10.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.663+0000 7f8dad1b5700 1 -- 172.21.15.44:0/1777590458 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c011d20 con 0x7f8da80ae0f0 2024-09-13T18:36:10.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.663+0000 7f8daf1b9700 1 -- 172.21.15.44:0/1777590458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da80ae0f0 msgr2=0x7f8da80b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:10.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.663+0000 7f8daf1b9700 1 --2- 172.21.15.44:0/1777590458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da80ae0f0 0x7f8da80b3810 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c009940 tx=0x7f8d9c009c50 comp rx=0 tx=0).stop 2024-09-13T18:36:10.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.667+0000 7f8daf1b9700 1 -- 172.21.15.44:0/1777590458 shutdown_connections 2024-09-13T18:36:10.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.667+0000 7f8daf1b9700 1 --2- 172.21.15.44:0/1777590458 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8da80b3d50 0x7f8da8071590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.667+0000 7f8daf1b9700 1 --2- 172.21.15.44:0/1777590458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da80ae0f0 0x7f8da80b3810 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.667+0000 7f8daf1b9700 1 -- 172.21.15.44:0/1777590458 >> 172.21.15.44:0/1777590458 conn(0x7f8da80b1810 msgr2=0x7f8da80b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:10.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.667+0000 7f8daf1b9700 1 -- 172.21.15.44:0/1777590458 shutdown_connections 2024-09-13T18:36:10.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.667+0000 7f8daf1b9700 1 -- 172.21.15.44:0/1777590458 wait complete. 2024-09-13T18:36:10.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.667+0000 7f8daf1b9700 1 Processor -- start 2024-09-13T18:36:10.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.667+0000 7f8daf1b9700 1 -- start start 2024-09-13T18:36:10.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.667+0000 7f8daf1b9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da80ae0f0 0x7f8da813f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:10.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.667+0000 7f8daf1b9700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8da80b3d50 0x7f8da806c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:10.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.667+0000 7f8daf1b9700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8da80cf360 0x7f8da806cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:10.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.667+0000 7f8daf1b9700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da806d540 con 0x7f8da80ae0f0 2024-09-13T18:36:10.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.667+0000 7f8daf1b9700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da806d820 con 0x7f8da80b3d50 2024-09-13T18:36:10.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.667+0000 7f8daf1b9700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da806db00 con 0x7f8da80cf360 2024-09-13T18:36:10.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.667+0000 7f8dae1b7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da80ae0f0 0x7f8da813f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:10.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.667+0000 7f8dae1b7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da80ae0f0 0x7f8da813f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46414/0 (socket says 172.21.15.44:46414) 2024-09-13T18:36:10.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.667+0000 7f8dae1b7700 1 -- 172.21.15.44:0/460151523 learned_addr learned my addr 172.21.15.44:0/460151523 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:10.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.671+0000 7f8dad9b6700 1 --2- 172.21.15.44:0/460151523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8da80b3d50 0x7f8da806c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:10.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.671+0000 7f8dae9b8700 1 --2- 172.21.15.44:0/460151523 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8da80cf360 0x7f8da806cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:10.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.671+0000 7f8dae1b7700 1 -- 172.21.15.44:0/460151523 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8da80cf360 msgr2=0x7f8da806cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:10.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.671+0000 7f8dae1b7700 1 --2- 172.21.15.44:0/460151523 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8da80cf360 0x7f8da806cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.671+0000 7f8dae1b7700 1 -- 172.21.15.44:0/460151523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8da80b3d50 msgr2=0x7f8da806c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:10.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.671+0000 7f8dae1b7700 1 --2- 172.21.15.44:0/460151523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8da80b3d50 0x7f8da806c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.671+0000 7f8dae1b7700 1 -- 172.21.15.44:0/460151523 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c009570 con 0x7f8da80ae0f0 2024-09-13T18:36:10.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.671+0000 7f8dae1b7700 1 --2- 172.21.15.44:0/460151523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da80ae0f0 0x7f8da813f600 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f8da400cbd0 tx=0x7f8da400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:10.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.671+0000 7f8d9affd700 1 -- 172.21.15.44:0/460151523 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da4003c20 con 0x7f8da80ae0f0 2024-09-13T18:36:10.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.671+0000 7f8d9affd700 1 -- 172.21.15.44:0/460151523 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da4003d80 con 0x7f8da80ae0f0 2024-09-13T18:36:10.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.671+0000 7f8daf1b9700 1 -- 172.21.15.44:0/460151523 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da806dde0 con 0x7f8da80ae0f0 2024-09-13T18:36:10.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.671+0000 7f8d9affd700 1 -- 172.21.15.44:0/460151523 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da400aae0 con 0x7f8da80ae0f0 2024-09-13T18:36:10.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.671+0000 7f8daf1b9700 1 -- 172.21.15.44:0/460151523 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da806d180 con 0x7f8da80ae0f0 2024-09-13T18:36:10.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.671+0000 7f8daf1b9700 1 -- 172.21.15.44:0/460151523 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8da806d310 con 0x7f8da80ae0f0 2024-09-13T18:36:10.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.675+0000 7f8d9affd700 1 -- 172.21.15.44:0/460151523 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8da400ac40 con 0x7f8da80ae0f0 2024-09-13T18:36:10.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.675+0000 7f8d9affd700 1 --2- 172.21.15.44:0/460151523 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8d8c066730 0x7f8d8c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:10.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.675+0000 7f8d9affd700 1 -- 172.21.15.44:0/460151523 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8da4083e90 con 0x7f8da80ae0f0 2024-09-13T18:36:10.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.675+0000 7f8dad9b6700 1 --2- 172.21.15.44:0/460151523 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8d8c066730 0x7f8d8c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:10.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.675+0000 7f8dad9b6700 1 --2- 172.21.15.44:0/460151523 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8d8c066730 0x7f8d8c068bf0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c009910 tx=0x7f8d9c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:10.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.683+0000 7f8d9affd700 1 -- 172.21.15.44:0/460151523 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8da4051460 con 0x7f8da80ae0f0 2024-09-13T18:36:10.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.851+0000 7f8daf1b9700 1 -- 172.21.15.44:0/460151523 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8da80cc180 con 0x7f8da80ae0f0 2024-09-13T18:36:10.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.855+0000 7f8d9affd700 1 -- 172.21.15.44:0/460151523 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8da4085020 con 0x7f8da80ae0f0 2024-09-13T18:36:10.861 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:36:10.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.855+0000 7f8daf1b9700 1 -- 172.21.15.44:0/460151523 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8d8c066730 msgr2=0x7f8d8c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:10.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.855+0000 7f8daf1b9700 1 --2- 172.21.15.44:0/460151523 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8d8c066730 0x7f8d8c068bf0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c009910 tx=0x7f8d9c008030 comp rx=0 tx=0).stop 2024-09-13T18:36:10.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.855+0000 7f8daf1b9700 1 -- 172.21.15.44:0/460151523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da80ae0f0 msgr2=0x7f8da813f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:10.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.855+0000 7f8daf1b9700 1 --2- 172.21.15.44:0/460151523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da80ae0f0 0x7f8da813f600 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f8da400cbd0 tx=0x7f8da400cee0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.855+0000 7f8daf1b9700 1 -- 172.21.15.44:0/460151523 shutdown_connections 2024-09-13T18:36:10.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.855+0000 7f8daf1b9700 1 --2- 172.21.15.44:0/460151523 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8d8c066730 0x7f8d8c068bf0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.855+0000 7f8daf1b9700 1 --2- 172.21.15.44:0/460151523 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8da80cf360 0x7f8da806cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.855+0000 7f8daf1b9700 1 --2- 172.21.15.44:0/460151523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8da80b3d50 0x7f8da806c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.855+0000 7f8daf1b9700 1 --2- 172.21.15.44:0/460151523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da80ae0f0 0x7f8da813f600 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.855+0000 7f8daf1b9700 1 -- 172.21.15.44:0/460151523 >> 172.21.15.44:0/460151523 conn(0x7f8da80b1810 msgr2=0x7f8da80b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:10.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.855+0000 7f8daf1b9700 1 -- 172.21.15.44:0/460151523 shutdown_connections 2024-09-13T18:36:10.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.855+0000 7f8daf1b9700 1 -- 172.21.15.44:0/460151523 wait complete. 2024-09-13T18:36:10.876 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool_take_inos' 2024-09-13T18:36:10.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.983+0000 7fe4f0a12700 1 Processor -- start 2024-09-13T18:36:10.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.983+0000 7fe4f0a12700 1 -- start start 2024-09-13T18:36:10.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.983+0000 7fe4f0a12700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe4ec0b3ae0 0x7fe4ec06cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:10.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.983+0000 7fe4f0a12700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe4ec06aa90 0x7fe4ec0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:10.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.983+0000 7fe4f0a12700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ec06af40 con 0x7fe4ec159720 2024-09-13T18:36:10.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.983+0000 7fe4f0a12700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ec06d690 con 0x7fe4ec06aa90 2024-09-13T18:36:10.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.983+0000 7fe4f0a12700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec0cbfe0 con 0x7fe4ec0b3ae0 2024-09-13T18:36:10.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.983+0000 7fe4eb59e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe4ec06aa90 0x7fe4ec0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:10.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.983+0000 7fe4eb59e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe4ec06aa90 0x7fe4ec0ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46426/0 (socket says 172.21.15.44:46426) 2024-09-13T18:36:10.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.983+0000 7fe4eb59e700 1 -- 172.21.15.44:0/1975504674 learned_addr learned my addr 172.21.15.44:0/1975504674 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:10.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.983+0000 7fe4ea59c700 1 --2- 172.21.15.44:0/1975504674 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe4ec0b3ae0 0x7fe4ec06cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:10.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.983+0000 7fe4ea59c700 1 -- 172.21.15.44:0/1975504674 >> v2:172.21.15.44:3300/0 conn(0x7fe4ec06aa90 msgr2=0x7fe4ec0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:10.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.983+0000 7fe4ea59c700 1 --2- 172.21.15.44:0/1975504674 >> v2:172.21.15.44:3300/0 conn(0x7fe4ec06aa90 0x7fe4ec0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.983+0000 7fe4ea59c700 1 -- 172.21.15.44:0/1975504674 >> v1:172.21.15.99:6789/0 conn(0x7fe4ec159720 legacy=0x7fe4ec0b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:10.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.983+0000 7fe4e9d9b700 1 -- 172.21.15.44:0/1975504674 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3278392925 0 0) 0x7fe4ec06af40 con 0x7fe4ec159720 2024-09-13T18:36:10.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.983+0000 7fe4ea59c700 1 -- 172.21.15.44:0/1975504674 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec0cc2c0 con 0x7fe4ec0b3ae0 2024-09-13T18:36:10.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.983+0000 7fe4ea59c700 1 --2- 172.21.15.44:0/1975504674 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe4ec0b3ae0 0x7fe4ec06cf90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009d90 tx=0x7fe4dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34a11a4b2706b3f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:10.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.987+0000 7fe4e9d9b700 1 -- 172.21.15.44:0/1975504674 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc00e070 con 0x7fe4ec0b3ae0 2024-09-13T18:36:10.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.987+0000 7fe4e9d9b700 1 -- 172.21.15.44:0/1975504674 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4dc00bb20 con 0x7fe4ec0b3ae0 2024-09-13T18:36:10.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.987+0000 7fe4e9d9b700 1 -- 172.21.15.44:0/1975504674 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc012430 con 0x7fe4ec0b3ae0 2024-09-13T18:36:10.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.987+0000 7fe4f0a12700 1 -- 172.21.15.44:0/1975504674 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe4ec0b3ae0 msgr2=0x7fe4ec06cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:10.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.987+0000 7fe4f0a12700 1 --2- 172.21.15.44:0/1975504674 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe4ec0b3ae0 0x7fe4ec06cf90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009d90 tx=0x7fe4dc00b330 comp rx=0 tx=0).stop 2024-09-13T18:36:10.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.987+0000 7fe4f0a12700 1 -- 172.21.15.44:0/1975504674 shutdown_connections 2024-09-13T18:36:10.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.987+0000 7fe4f0a12700 1 --2- 172.21.15.44:0/1975504674 >> v2:172.21.15.44:3300/0 conn(0x7fe4ec06aa90 0x7fe4ec0ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.987+0000 7fe4f0a12700 1 --2- 172.21.15.44:0/1975504674 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe4ec0b3ae0 0x7fe4ec06cf90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.987+0000 7fe4f0a12700 1 -- 172.21.15.44:0/1975504674 >> 172.21.15.44:0/1975504674 conn(0x7fe4ec0b0f00 msgr2=0x7fe4ec0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:10.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.987+0000 7fe4f0a12700 1 -- 172.21.15.44:0/1975504674 shutdown_connections 2024-09-13T18:36:10.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.987+0000 7fe4f0a12700 1 -- 172.21.15.44:0/1975504674 wait complete. 2024-09-13T18:36:11.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.987+0000 7fe4f0a12700 1 Processor -- start 2024-09-13T18:36:11.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.987+0000 7fe4f0a12700 1 -- start start 2024-09-13T18:36:11.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.991+0000 7fe4f0a12700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4ec06aa90 0x7fe4ec0af280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:11.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.991+0000 7fe4f0a12700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4ec0b3ae0 0x7fe4ec148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:11.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.991+0000 7fe4f0a12700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe4ec159720 0x7fe4ec0b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:11.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.991+0000 7fe4f0a12700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec0afa60 con 0x7fe4ec06aa90 2024-09-13T18:36:11.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.991+0000 7fe4f0a12700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec0af7c0 con 0x7fe4ec0b3ae0 2024-09-13T18:36:11.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.991+0000 7fe4f0a12700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec0addf0 con 0x7fe4ec159720 2024-09-13T18:36:11.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.991+0000 7fe4ead9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4ec06aa90 0x7fe4ec0af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:11.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.991+0000 7fe4ead9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4ec06aa90 0x7fe4ec0af280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46428/0 (socket says 172.21.15.44:46428) 2024-09-13T18:36:11.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.991+0000 7fe4ead9d700 1 -- 172.21.15.44:0/2495230298 learned_addr learned my addr 172.21.15.44:0/2495230298 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:11.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.991+0000 7fe4eb59e700 1 --2- 172.21.15.44:0/2495230298 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe4ec159720 0x7fe4ec0b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:11.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.991+0000 7fe4ea59c700 1 --2- 172.21.15.44:0/2495230298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4ec0b3ae0 0x7fe4ec148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:11.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.991+0000 7fe4ead9d700 1 -- 172.21.15.44:0/2495230298 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe4ec159720 msgr2=0x7fe4ec0b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:11.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.991+0000 7fe4ead9d700 1 --2- 172.21.15.44:0/2495230298 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe4ec159720 0x7fe4ec0b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:11.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.991+0000 7fe4ead9d700 1 -- 172.21.15.44:0/2495230298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4ec0b3ae0 msgr2=0x7fe4ec148180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:11.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.991+0000 7fe4ead9d700 1 --2- 172.21.15.44:0/2495230298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4ec0b3ae0 0x7fe4ec148180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:11.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.991+0000 7fe4ead9d700 1 -- 172.21.15.44:0/2495230298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc009a70 con 0x7fe4ec06aa90 2024-09-13T18:36:11.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.991+0000 7fe4ead9d700 1 --2- 172.21.15.44:0/2495230298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4ec06aa90 0x7fe4ec0af280 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400c520 tx=0x7fe4d400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:11.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.991+0000 7fe4e37fe700 1 -- 172.21.15.44:0/2495230298 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d40054e0 con 0x7fe4ec06aa90 2024-09-13T18:36:11.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.991+0000 7fe4e37fe700 1 -- 172.21.15.44:0/2495230298 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d40036a0 con 0x7fe4ec06aa90 2024-09-13T18:36:11.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.991+0000 7fe4f0a12700 1 -- 172.21.15.44:0/2495230298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ec0ae0d0 con 0x7fe4ec06aa90 2024-09-13T18:36:11.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.991+0000 7fe4e37fe700 1 -- 172.21.15.44:0/2495230298 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4003a50 con 0x7fe4ec06aa90 2024-09-13T18:36:11.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.991+0000 7fe4f0a12700 1 -- 172.21.15.44:0/2495230298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ec0ae690 con 0x7fe4ec06aa90 2024-09-13T18:36:11.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.991+0000 7fe4f0a12700 1 -- 172.21.15.44:0/2495230298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ec0ae880 con 0x7fe4ec06aa90 2024-09-13T18:36:11.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.995+0000 7fe4e37fe700 1 -- 172.21.15.44:0/2495230298 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe4d4003bb0 con 0x7fe4ec06aa90 2024-09-13T18:36:11.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.995+0000 7fe4e37fe700 1 --2- 172.21.15.44:0/2495230298 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe4cc066760 0x7fe4cc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:11.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.995+0000 7fe4e37fe700 1 -- 172.21.15.44:0/2495230298 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe4d4083260 con 0x7fe4ec06aa90 2024-09-13T18:36:11.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.995+0000 7fe4ea59c700 1 --2- 172.21.15.44:0/2495230298 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe4cc066760 0x7fe4cc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:11.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.995+0000 7fe4ea59c700 1 --2- 172.21.15.44:0/2495230298 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe4cc066760 0x7fe4cc068c20 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc014040 tx=0x7fe4dc011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:11.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:10.999+0000 7fe4e37fe700 1 -- 172.21.15.44:0/2495230298 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe4d4050830 con 0x7fe4ec06aa90 2024-09-13T18:36:11.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:11.239+0000 7fe4f0a12700 1 -- 172.21.15.44:0/2495230298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool_take_inos"]} v 0) v1 -- 0x7fe4ec0ccac0 con 0x7fe4ec06aa90 2024-09-13T18:36:12.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.195+0000 7fe4e37fe700 1 -- 172.21.15.44:0/2495230298 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool_take_inos"]}]=0 v404) v1 ==== 158+0+0 (secure 0 0 0) 0x7fe4d4003e60 con 0x7fe4ec06aa90 2024-09-13T18:36:12.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.199+0000 7fe4f0a12700 1 -- 172.21.15.44:0/2495230298 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe4cc066760 msgr2=0x7fe4cc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.199+0000 7fe4f0a12700 1 --2- 172.21.15.44:0/2495230298 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe4cc066760 0x7fe4cc068c20 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc014040 tx=0x7fe4dc011000 comp rx=0 tx=0).stop 2024-09-13T18:36:12.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.199+0000 7fe4f0a12700 1 -- 172.21.15.44:0/2495230298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4ec06aa90 msgr2=0x7fe4ec0af280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.199+0000 7fe4f0a12700 1 --2- 172.21.15.44:0/2495230298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4ec06aa90 0x7fe4ec0af280 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400c520 tx=0x7fe4d400c830 comp rx=0 tx=0).stop 2024-09-13T18:36:12.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.199+0000 7fe4f0a12700 1 -- 172.21.15.44:0/2495230298 shutdown_connections 2024-09-13T18:36:12.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.199+0000 7fe4f0a12700 1 --2- 172.21.15.44:0/2495230298 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe4cc066760 0x7fe4cc068c20 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.199+0000 7fe4f0a12700 1 --2- 172.21.15.44:0/2495230298 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe4ec159720 0x7fe4ec0b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.199+0000 7fe4f0a12700 1 --2- 172.21.15.44:0/2495230298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4ec0b3ae0 0x7fe4ec148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.199+0000 7fe4f0a12700 1 --2- 172.21.15.44:0/2495230298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4ec06aa90 0x7fe4ec0af280 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.199+0000 7fe4f0a12700 1 -- 172.21.15.44:0/2495230298 >> 172.21.15.44:0/2495230298 conn(0x7fe4ec0b0f00 msgr2=0x7fe4ec06fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:12.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.199+0000 7fe4f0a12700 1 -- 172.21.15.44:0/2495230298 shutdown_connections 2024-09-13T18:36:12.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.199+0000 7fe4f0a12700 1 -- 172.21.15.44:0/2495230298 wait complete. 2024-09-13T18:36:12.226 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:36:12.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.347+0000 7f82e6a82700 1 Processor -- start 2024-09-13T18:36:12.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.347+0000 7f82e6a82700 1 -- start start 2024-09-13T18:36:12.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.347+0000 7f82e6a82700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e00b2df0 0x7f82e015a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.347+0000 7f82e6a82700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e00b4590 con 0x7f82e006c700 2024-09-13T18:36:12.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.347+0000 7f82e6a82700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e006cae0 con 0x7f82e015d470 2024-09-13T18:36:12.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.347+0000 7f82e6a82700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e015ae40 con 0x7f82e00b2df0 2024-09-13T18:36:12.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.347+0000 7f82e481e700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f82e006c700 0x7f82e006b530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54730/0 (socket says 172.21.15.44:54730) 2024-09-13T18:36:12.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.347+0000 7f82e481e700 1 -- 172.21.15.44:0/1353406111 learned_addr learned my addr 172.21.15.44:0/1353406111 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:12.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.347+0000 7f82e501f700 1 --2- 172.21.15.44:0/1353406111 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e00b2df0 0x7f82e015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.347+0000 7f82df7fe700 1 -- 172.21.15.44:0/1353406111 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1698735549 0 0) 0x7f82e00b4590 con 0x7f82e006c700 2024-09-13T18:36:12.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.347+0000 7f82df7fe700 1 -- 172.21.15.44:0/1353406111 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82cc0035d0 con 0x7f82e006c700 2024-09-13T18:36:12.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.347+0000 7f82df7fe700 1 -- 172.21.15.44:0/1353406111 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3042724568 0 0) 0x7f82cc0035d0 con 0x7f82e006c700 2024-09-13T18:36:12.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.347+0000 7f82df7fe700 1 -- 172.21.15.44:0/1353406111 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e00b2df0 msgr2=0x7f82e015a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:12.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.347+0000 7f82df7fe700 1 --2- 172.21.15.44:0/1353406111 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e00b2df0 0x7f82e015a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.347+0000 7f82df7fe700 1 -- 172.21.15.44:0/1353406111 >> v1:172.21.15.99:6789/0 conn(0x7f82e015d470 legacy=0x7f82e00b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.347+0000 7f82df7fe700 1 -- 172.21.15.44:0/1353406111 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e015da50 con 0x7f82e006c700 2024-09-13T18:36:12.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.347+0000 7f82df7fe700 1 -- 172.21.15.44:0/1353406111 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f82d0001690 con 0x7f82e006c700 2024-09-13T18:36:12.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82df7fe700 1 -- 172.21.15.44:0/1353406111 >> v1:172.21.15.44:6789/0 conn(0x7f82e006c700 legacy=0x7f82e006b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82df7fe700 1 --2- 172.21.15.44:0/1353406111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82cc003a50 0x7f82cc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82df7fe700 1 --2- 172.21.15.44:0/1353406111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82cc004400 0x7f82cc0048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82df7fe700 1 --2- 172.21.15.44:0/1353406111 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e00b2df0 0x7f82cc005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82df7fe700 1 -- 172.21.15.44:0/1353406111 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e015ae40 con 0x7f82cc004400 2024-09-13T18:36:12.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82df7fe700 1 -- 172.21.15.44:0/1353406111 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc00ba30 con 0x7f82cc003a50 2024-09-13T18:36:12.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82df7fe700 1 -- 172.21.15.44:0/1353406111 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc00bbf0 con 0x7f82e00b2df0 2024-09-13T18:36:12.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82dffff700 1 --2- 172.21.15.44:0/1353406111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82cc004400 0x7f82cc0048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82e481e700 1 --2- 172.21.15.44:0/1353406111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82cc003a50 0x7f82cc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82e501f700 1 --2- 172.21.15.44:0/1353406111 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e00b2df0 0x7f82cc005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82dffff700 1 -- 172.21.15.44:0/1353406111 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e00b2df0 msgr2=0x7f82cc005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:12.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82dffff700 1 --2- 172.21.15.44:0/1353406111 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e00b2df0 0x7f82cc005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82dffff700 1 -- 172.21.15.44:0/1353406111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82cc003a50 msgr2=0x7f82cc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:12.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82dffff700 1 --2- 172.21.15.44:0/1353406111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82cc003a50 0x7f82cc003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82dffff700 1 -- 172.21.15.44:0/1353406111 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc0035d0 con 0x7f82cc004400 2024-09-13T18:36:12.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82e501f700 1 --2- 172.21.15.44:0/1353406111 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e00b2df0 0x7f82cc005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:12.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82dffff700 1 --2- 172.21.15.44:0/1353406111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82cc004400 0x7f82cc0048d0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f82c80018f0 tx=0x7f82cc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67230d20bfdb1eee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:12.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82df7fe700 1 -- 172.21.15.44:0/1353406111 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c8001390 con 0x7f82cc004400 2024-09-13T18:36:12.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82df7fe700 1 -- 172.21.15.44:0/1353406111 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c800c690 con 0x7f82cc004400 2024-09-13T18:36:12.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82df7fe700 1 -- 172.21.15.44:0/1353406111 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c800ca40 con 0x7f82cc004400 2024-09-13T18:36:12.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82e6a82700 1 -- 172.21.15.44:0/1353406111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82cc004400 msgr2=0x7f82cc0048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82e6a82700 1 --2- 172.21.15.44:0/1353406111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82cc004400 0x7f82cc0048d0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f82c80018f0 tx=0x7f82cc0058a0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82e501f700 1 -- 172.21.15.44:0/1353406111 reap_dead start 2024-09-13T18:36:12.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82e6a82700 1 -- 172.21.15.44:0/1353406111 shutdown_connections 2024-09-13T18:36:12.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82e6a82700 1 -- 172.21.15.44:0/1353406111 >> 172.21.15.44:0/1353406111 conn(0x7f82e006d900 msgr2=0x7f82e006dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:12.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82e6a82700 1 -- 172.21.15.44:0/1353406111 shutdown_connections 2024-09-13T18:36:12.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.351+0000 7f82e6a82700 1 -- 172.21.15.44:0/1353406111 wait complete. 2024-09-13T18:36:12.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.355+0000 7f82e6a82700 1 Processor -- start 2024-09-13T18:36:12.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.355+0000 7f82e6a82700 1 -- start start 2024-09-13T18:36:12.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.355+0000 7f82e6a82700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82cc004400 0x7f82e00cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.355+0000 7f82e6a82700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e01516c0 0x7f82e0158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.355+0000 7f82e6a82700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82e0151b40 0x7f82e0158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.355+0000 7f82e6a82700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00ce3c0 con 0x7f82cc004400 2024-09-13T18:36:12.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.355+0000 7f82e6a82700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00cd320 con 0x7f82e0151b40 2024-09-13T18:36:12.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.355+0000 7f82e6a82700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00cd600 con 0x7f82e01516c0 2024-09-13T18:36:12.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.355+0000 7f82e481e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82cc004400 0x7f82e00cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.355+0000 7f82e481e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82cc004400 0x7f82e00cca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37890/0 (socket says 172.21.15.44:37890) 2024-09-13T18:36:12.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.355+0000 7f82e481e700 1 -- 172.21.15.44:0/62813839 learned_addr learned my addr 172.21.15.44:0/62813839 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:12.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.355+0000 7f82dffff700 1 --2- 172.21.15.44:0/62813839 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e01516c0 0x7f82e0158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.355+0000 7f82e501f700 1 --2- 172.21.15.44:0/62813839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82e0151b40 0x7f82e0158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.355+0000 7f82e481e700 1 -- 172.21.15.44:0/62813839 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e01516c0 msgr2=0x7f82e0158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.355+0000 7f82e481e700 1 --2- 172.21.15.44:0/62813839 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e01516c0 0x7f82e0158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.355+0000 7f82e481e700 1 -- 172.21.15.44:0/62813839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82e0151b40 msgr2=0x7f82e0158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.355+0000 7f82e481e700 1 --2- 172.21.15.44:0/62813839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82e0151b40 0x7f82e0158f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.355+0000 7f82e481e700 1 -- 172.21.15.44:0/62813839 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e00cd8e0 con 0x7f82cc004400 2024-09-13T18:36:12.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.355+0000 7f82e481e700 1 --2- 172.21.15.44:0/62813839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82cc004400 0x7f82e00cca90 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f82d000eb20 tx=0x7f82d000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:12.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.355+0000 7f82dd7fa700 1 -- 172.21.15.44:0/62813839 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d000c550 con 0x7f82cc004400 2024-09-13T18:36:12.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.355+0000 7f82dd7fa700 1 -- 172.21.15.44:0/62813839 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d000c6d0 con 0x7f82cc004400 2024-09-13T18:36:12.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.355+0000 7f82e6a82700 1 -- 172.21.15.44:0/62813839 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e00cdbc0 con 0x7f82cc004400 2024-09-13T18:36:12.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.355+0000 7f82dd7fa700 1 -- 172.21.15.44:0/62813839 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d000ca80 con 0x7f82cc004400 2024-09-13T18:36:12.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.359+0000 7f82e6a82700 1 -- 172.21.15.44:0/62813839 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e00ccfd0 con 0x7f82cc004400 2024-09-13T18:36:12.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.359+0000 7f82e6a82700 1 -- 172.21.15.44:0/62813839 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e015a900 con 0x7f82cc004400 2024-09-13T18:36:12.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.359+0000 7f82dd7fa700 1 -- 172.21.15.44:0/62813839 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f82d000cbe0 con 0x7f82cc004400 2024-09-13T18:36:12.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.359+0000 7f82dd7fa700 1 --2- 172.21.15.44:0/62813839 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f82c0066730 0x7f82c0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.359+0000 7f82dd7fa700 1 -- 172.21.15.44:0/62813839 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f82d00839e0 con 0x7f82cc004400 2024-09-13T18:36:12.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.363+0000 7f82dffff700 1 --2- 172.21.15.44:0/62813839 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f82c0066730 0x7f82c0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.363+0000 7f82dffff700 1 --2- 172.21.15.44:0/62813839 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f82c0066730 0x7f82c0068bf0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f82c8014040 tx=0x7f82c8005040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:12.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.371+0000 7f82dd7fa700 1 -- 172.21.15.44:0/62813839 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f82d00510e0 con 0x7f82cc004400 2024-09-13T18:36:12.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.539+0000 7f82e6a82700 1 -- 172.21.15.44:0/62813839 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f82e015b170 con 0x7f82cc004400 2024-09-13T18:36:12.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.543+0000 7f82dd7fa700 1 -- 172.21.15.44:0/62813839 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f82d0054700 con 0x7f82cc004400 2024-09-13T18:36:12.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.543+0000 7f82e6a82700 1 -- 172.21.15.44:0/62813839 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f82c0066730 msgr2=0x7f82c0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.543+0000 7f82e6a82700 1 --2- 172.21.15.44:0/62813839 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f82c0066730 0x7f82c0068bf0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f82c8014040 tx=0x7f82c8005040 comp rx=0 tx=0).stop 2024-09-13T18:36:12.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.543+0000 7f82e6a82700 1 -- 172.21.15.44:0/62813839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82cc004400 msgr2=0x7f82e00cca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.543+0000 7f82e6a82700 1 --2- 172.21.15.44:0/62813839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82cc004400 0x7f82e00cca90 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f82d000eb20 tx=0x7f82d000ee30 comp rx=0 tx=0).stop 2024-09-13T18:36:12.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.543+0000 7f82e6a82700 1 -- 172.21.15.44:0/62813839 shutdown_connections 2024-09-13T18:36:12.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.543+0000 7f82e6a82700 1 --2- 172.21.15.44:0/62813839 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f82c0066730 0x7f82c0068bf0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.543+0000 7f82e6a82700 1 --2- 172.21.15.44:0/62813839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82e0151b40 0x7f82e0158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.543+0000 7f82e6a82700 1 --2- 172.21.15.44:0/62813839 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e01516c0 0x7f82e0158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.543+0000 7f82e6a82700 1 --2- 172.21.15.44:0/62813839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82cc004400 0x7f82e00cca90 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.543+0000 7f82e6a82700 1 -- 172.21.15.44:0/62813839 >> 172.21.15.44:0/62813839 conn(0x7f82e006d900 msgr2=0x7f82e015bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:12.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.543+0000 7f82e6a82700 1 -- 172.21.15.44:0/62813839 shutdown_connections 2024-09-13T18:36:12.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.543+0000 7f82e6a82700 1 -- 172.21.15.44:0/62813839 wait complete. 2024-09-13T18:36:12.566 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:36:12.566 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:36:12.584 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:36:12.606 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:36:12.606 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:36:12.606 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:12.614 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349428k,nr_inodes=4087357,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16693 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276112k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:36:12.614 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:36:12.615 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:12.657 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346268k,nr_inodes=4086567,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19562 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275480k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:36:12.658 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:36:12.658 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:12.665 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349428k,nr_inodes=4087357,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16693 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276112k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:36:12.665 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:36:12.665 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:12.674 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346268k,nr_inodes=4086567,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19562 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275480k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:36:12.675 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:36:12.675 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:36:12.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcf03fff700 1 Processor -- start 2024-09-13T18:36:12.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcf03fff700 1 -- start start 2024-09-13T18:36:12.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcf03fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf04160f30 0x7fcf0406c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcf03fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcf0406ac30 0x7fcf040d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcf03fff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf040d0a60 con 0x7fcf040cede0 2024-09-13T18:36:12.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcf03fff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf040cde10 con 0x7fcf0406ac30 2024-09-13T18:36:12.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcf03fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf040ce0f0 con 0x7fcf04160f30 2024-09-13T18:36:12.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcf037fe700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcf0406ac30 0x7fcf040d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcf02ffd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf04160f30 0x7fcf0406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcefbfff700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fcf040cede0 0x7fcf0406a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:43092/0 (socket says 172.21.15.44:43092) 2024-09-13T18:36:12.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcefbfff700 1 -- 172.21.15.44:0/3048189502 learned_addr learned my addr 172.21.15.44:0/3048189502 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:12.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcf037fe700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcf0406ac30 0x7fcf040d0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:35250/0 (socket says 172.21.15.44:35250) 2024-09-13T18:36:12.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcf02ffd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf04160f30 0x7fcf0406c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:51812/0 (socket says 172.21.15.44:51812) 2024-09-13T18:36:12.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcf02ffd700 1 -- 172.21.15.44:0/3048189502 >> v2:172.21.15.99:3300/0 conn(0x7fcf0406ac30 msgr2=0x7fcf040d0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:12.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcf02ffd700 1 --2- 172.21.15.44:0/3048189502 >> v2:172.21.15.99:3300/0 conn(0x7fcf0406ac30 0x7fcf040d0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcf02ffd700 1 -- 172.21.15.44:0/3048189502 >> v1:172.21.15.99:6789/0 conn(0x7fcf040cede0 legacy=0x7fcf0406a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcf02ffd700 1 -- 172.21.15.44:0/3048189502 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf040ce3d0 con 0x7fcf04160f30 2024-09-13T18:36:12.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcf037fe700 1 --2- 172.21.15.44:0/3048189502 >> v2:172.21.15.99:3300/0 conn(0x7fcf0406ac30 0x7fcf040d0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:12.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcf02ffd700 1 --2- 172.21.15.44:0/3048189502 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf04160f30 0x7fcf0406c670 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fceec009850 tx=0x7fceec009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0b3b42a6926442b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:12.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcf027fc700 1 -- 172.21.15.44:0/3048189502 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec011830 con 0x7fcf04160f30 2024-09-13T18:36:12.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcf027fc700 1 -- 172.21.15.44:0/3048189502 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceec011990 con 0x7fcf04160f30 2024-09-13T18:36:12.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcf027fc700 1 -- 172.21.15.44:0/3048189502 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec011d40 con 0x7fcf04160f30 2024-09-13T18:36:12.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcf03fff700 1 -- 172.21.15.44:0/3048189502 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf04160f30 msgr2=0x7fcf0406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.791+0000 7fcf03fff700 1 --2- 172.21.15.44:0/3048189502 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf04160f30 0x7fcf0406c670 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fceec009850 tx=0x7fceec009b60 comp rx=0 tx=0).stop 2024-09-13T18:36:12.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.795+0000 7fcf03fff700 1 -- 172.21.15.44:0/3048189502 shutdown_connections 2024-09-13T18:36:12.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.795+0000 7fcf03fff700 1 --2- 172.21.15.44:0/3048189502 >> v2:172.21.15.99:3300/0 conn(0x7fcf0406ac30 0x7fcf040d0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.795+0000 7fcf03fff700 1 --2- 172.21.15.44:0/3048189502 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf04160f30 0x7fcf0406c670 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.795+0000 7fcf03fff700 1 -- 172.21.15.44:0/3048189502 >> 172.21.15.44:0/3048189502 conn(0x7fcf040d2c80 msgr2=0x7fcf040d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:12.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.795+0000 7fcf03fff700 1 -- 172.21.15.44:0/3048189502 shutdown_connections 2024-09-13T18:36:12.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.795+0000 7fcf03fff700 1 -- 172.21.15.44:0/3048189502 wait complete. 2024-09-13T18:36:12.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.795+0000 7fcf03fff700 1 Processor -- start 2024-09-13T18:36:12.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.795+0000 7fcf03fff700 1 -- start start 2024-09-13T18:36:12.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.795+0000 7fcf03fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf0406ac30 0x7fcf040c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.795+0000 7fcf03fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf040cede0 0x7fcf040cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.795+0000 7fcf03fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf04160f30 0x7fcf041583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.795+0000 7fcf03fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf040c95a0 con 0x7fcf040cede0 2024-09-13T18:36:12.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.795+0000 7fcf03fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf040c92c0 con 0x7fcf04160f30 2024-09-13T18:36:12.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.795+0000 7fcf03fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf041fa220 con 0x7fcf0406ac30 2024-09-13T18:36:12.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.799+0000 7fcefbfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf040cede0 0x7fcf040cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.799+0000 7fcf037fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf04160f30 0x7fcf041583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.799+0000 7fcf02ffd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf0406ac30 0x7fcf040c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.799+0000 7fcefbfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf040cede0 0x7fcf040cb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37896/0 (socket says 172.21.15.44:37896) 2024-09-13T18:36:12.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.799+0000 7fcf037fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf04160f30 0x7fcf041583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:35258/0 (socket says 172.21.15.44:35258) 2024-09-13T18:36:12.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.799+0000 7fcefbfff700 1 -- 172.21.15.44:0/3084104447 learned_addr learned my addr 172.21.15.44:0/3084104447 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:12.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.799+0000 7fcf02ffd700 1 -- 172.21.15.44:0/3084104447 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf04160f30 msgr2=0x7fcf041583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.799+0000 7fcf02ffd700 1 --2- 172.21.15.44:0/3084104447 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf04160f30 0x7fcf041583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.799+0000 7fcf02ffd700 1 -- 172.21.15.44:0/3084104447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf040cede0 msgr2=0x7fcf040cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.799+0000 7fcf02ffd700 1 --2- 172.21.15.44:0/3084104447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf040cede0 0x7fcf040cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.799+0000 7fcf02ffd700 1 -- 172.21.15.44:0/3084104447 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcefc009a70 con 0x7fcf0406ac30 2024-09-13T18:36:12.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.799+0000 7fcefbfff700 1 --2- 172.21.15.44:0/3084104447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf040cede0 0x7fcf040cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:12.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.799+0000 7fcf02ffd700 1 --2- 172.21.15.44:0/3084104447 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf0406ac30 0x7fcf040c89c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fceec016000 tx=0x7fceec004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:12.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.799+0000 7fcefb7fe700 1 -- 172.21.15.44:0/3084104447 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec0045d0 con 0x7fcf0406ac30 2024-09-13T18:36:12.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.799+0000 7fcefb7fe700 1 -- 172.21.15.44:0/3084104447 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceec01e070 con 0x7fcf0406ac30 2024-09-13T18:36:12.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.799+0000 7fcefb7fe700 1 -- 172.21.15.44:0/3084104447 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec003900 con 0x7fcf0406ac30 2024-09-13T18:36:12.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.799+0000 7fcf03fff700 1 -- 172.21.15.44:0/3084104447 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceec0094b0 con 0x7fcf0406ac30 2024-09-13T18:36:12.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.799+0000 7fcf03fff700 1 -- 172.21.15.44:0/3084104447 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf041fa7e0 con 0x7fcf0406ac30 2024-09-13T18:36:12.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.799+0000 7fcf03fff700 1 -- 172.21.15.44:0/3084104447 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf041fa080 con 0x7fcf0406ac30 2024-09-13T18:36:12.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.803+0000 7fcefb7fe700 1 -- 172.21.15.44:0/3084104447 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fceec003a60 con 0x7fcf0406ac30 2024-09-13T18:36:12.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.803+0000 7fcefb7fe700 1 --2- 172.21.15.44:0/3084104447 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcee4066760 0x7fcee4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.803+0000 7fcefb7fe700 1 -- 172.21.15.44:0/3084104447 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fceec084e90 con 0x7fcf0406ac30 2024-09-13T18:36:12.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.803+0000 7fcefbfff700 1 --2- 172.21.15.44:0/3084104447 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcee4066760 0x7fcee4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.803+0000 7fcefbfff700 1 --2- 172.21.15.44:0/3084104447 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcee4066760 0x7fcee4068c20 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fcf040cb5c0 tx=0x7fcef4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:12.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:12.811+0000 7fcefb7fe700 1 -- 172.21.15.44:0/3084104447 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcf041fa080 con 0x7fcf0406ac30 2024-09-13T18:36:13.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.027+0000 7fcf03fff700 1 -- 172.21.15.44:0/3084104447 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf041fa080 con 0x7fcf0406ac30 2024-09-13T18:36:13.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.027+0000 7fcefb7fe700 1 -- 172.21.15.44:0/3084104447 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fceec020de0 con 0x7fcf0406ac30 2024-09-13T18:36:13.035 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:13.035 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":72,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3463035694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3463035694},{"type":"v1","addr":"172.21.15.99:6837","nonce":3463035694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7438,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2910652037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2910652037},{"type":"v1","addr":"172.21.15.44:6833","nonce":2910652037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7456,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2231812307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2231812307},{"type":"v1","addr":"172.21.15.99:6835","nonce":2231812307}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8124,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2445675445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2445675445},{"type":"v1","addr":"172.21.15.44:6835","nonce":2445675445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[]} 2024-09-13T18:36:13.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.031+0000 7fcf03fff700 1 -- 172.21.15.44:0/3084104447 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcee4066760 msgr2=0x7fcee4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.031+0000 7fcf03fff700 1 --2- 172.21.15.44:0/3084104447 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcee4066760 0x7fcee4068c20 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fcf040cb5c0 tx=0x7fcef4009040 comp rx=0 tx=0).stop 2024-09-13T18:36:13.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.031+0000 7fcf03fff700 1 -- 172.21.15.44:0/3084104447 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf0406ac30 msgr2=0x7fcf040c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.031+0000 7fcf03fff700 1 --2- 172.21.15.44:0/3084104447 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf0406ac30 0x7fcf040c89c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fceec016000 tx=0x7fceec004770 comp rx=0 tx=0).stop 2024-09-13T18:36:13.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.031+0000 7fcf03fff700 1 -- 172.21.15.44:0/3084104447 shutdown_connections 2024-09-13T18:36:13.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.031+0000 7fcf03fff700 1 --2- 172.21.15.44:0/3084104447 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fcee4066760 0x7fcee4068c20 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.031+0000 7fcf03fff700 1 --2- 172.21.15.44:0/3084104447 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf04160f30 0x7fcf041583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.031+0000 7fcf03fff700 1 --2- 172.21.15.44:0/3084104447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf040cede0 0x7fcf040cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.031+0000 7fcf03fff700 1 --2- 172.21.15.44:0/3084104447 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf0406ac30 0x7fcf040c89c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.031+0000 7fcf03fff700 1 -- 172.21.15.44:0/3084104447 >> 172.21.15.44:0/3084104447 conn(0x7fcf040d2c80 msgr2=0x7fcf040b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:13.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.031+0000 7fcf03fff700 1 -- 172.21.15.44:0/3084104447 shutdown_connections 2024-09-13T18:36:13.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.031+0000 7fcf03fff700 1 -- 172.21.15.44:0/3084104447 wait complete. 2024-09-13T18:36:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 72 2024-09-13T18:36:13.050 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:36:13.051 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:36:13.051 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:36:13.051 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:36:13.051 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:36:13.051 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:36:13.051 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:36:13.052 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:36:13.052 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:36:13.052 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:36:13.052 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:36:13.052 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:36:13.052 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:36:13.052 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:36:13.053 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:36:13.053 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:36:13.061 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:36:13.062 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:36:13.063 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:36:13.064 DEBUG:teuthology.parallel:result is None 2024-09-13T18:36:13.065 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:36:13.065 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:36:13.067 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:36:13.067 DEBUG:teuthology.parallel:result is None 2024-09-13T18:36:13.070 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:36:13.070 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:36:13.070 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:36:13.071 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:36:13.112 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:36:13.112 DEBUG:teuthology.parallel:result is None 2024-09-13T18:36:13.113 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:36:13.113 DEBUG:teuthology.parallel:result is None 2024-09-13T18:36:13.113 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:36:13.138 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-13T18:36:13.154 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-13T18:36:13.199 INFO:tasks.ceph.mds.d.smithi099.stdout:starting mds.d at 2024-09-13T18:36:13.200 INFO:tasks.ceph.mds.b.smithi099.stdout:starting mds.b at 2024-09-13T18:36:13.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.215+0000 7f12bb42f700 1 Processor -- start 2024-09-13T18:36:13.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.215+0000 7f12bb42f700 1 -- start start 2024-09-13T18:36:13.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.219+0000 7f12bb42f700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f12b40b4550 0x7f12b40b4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:13.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.219+0000 7f12bb42f700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b40ac960 con 0x7f12b40b4170 2024-09-13T18:36:13.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.219+0000 7f12bb42f700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b40acc00 con 0x7f12b4071a90 2024-09-13T18:36:13.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.219+0000 7f12bb42f700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b4072630 con 0x7f12b40b4550 2024-09-13T18:36:13.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.219+0000 7f12ba42d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f12b40b4170 0x7f12b40cc940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54742/0 (socket says 172.21.15.44:54742) 2024-09-13T18:36:13.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.219+0000 7f12ba42d700 1 -- 172.21.15.44:0/146266813 learned_addr learned my addr 172.21.15.44:0/146266813 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:13.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.219+0000 7f12b9c2c700 1 --2- 172.21.15.44:0/146266813 >> v2:172.21.15.99:3300/0 conn(0x7f12b40b4550 0x7f12b40b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:13.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.219+0000 7f12b942b700 1 -- 172.21.15.44:0/146266813 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307606669 0 0) 0x7f12b40ac960 con 0x7f12b40b4170 2024-09-13T18:36:13.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.219+0000 7f12b942b700 1 -- 172.21.15.44:0/146266813 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12a00035d0 con 0x7f12b40b4170 2024-09-13T18:36:13.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.219+0000 7f12b9c2c700 1 -- 172.21.15.44:0/146266813 >> v1:172.21.15.99:6789/0 conn(0x7f12b4071a90 legacy=0x7f12b4071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.219+0000 7f12b9c2c700 1 -- 172.21.15.44:0/146266813 >> v1:172.21.15.44:6789/0 conn(0x7f12b40b4170 legacy=0x7f12b40cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.219+0000 7f12b9c2c700 1 -- 172.21.15.44:0/146266813 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b40acee0 con 0x7f12b40b4550 2024-09-13T18:36:13.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.219+0000 7f12b9c2c700 1 --2- 172.21.15.44:0/146266813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12b40b4550 0x7f12b40b4990 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009850 tx=0x7f12a4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e3d0f975ca365bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:13.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.219+0000 7f12b942b700 1 -- 172.21.15.44:0/146266813 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4011830 con 0x7f12b40b4550 2024-09-13T18:36:13.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.219+0000 7f12b942b700 1 -- 172.21.15.44:0/146266813 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a4011990 con 0x7f12b40b4550 2024-09-13T18:36:13.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.219+0000 7f12b942b700 1 -- 172.21.15.44:0/146266813 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4011d40 con 0x7f12b40b4550 2024-09-13T18:36:13.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.219+0000 7f12bb42f700 1 -- 172.21.15.44:0/146266813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12b40b4550 msgr2=0x7f12b40b4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.219+0000 7f12bb42f700 1 --2- 172.21.15.44:0/146266813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12b40b4550 0x7f12b40b4990 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009850 tx=0x7f12a4009b60 comp rx=0 tx=0).stop 2024-09-13T18:36:13.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.219+0000 7f12bb42f700 1 -- 172.21.15.44:0/146266813 shutdown_connections 2024-09-13T18:36:13.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.219+0000 7f12bb42f700 1 --2- 172.21.15.44:0/146266813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12b40b4550 0x7f12b40b4990 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.219+0000 7f12bb42f700 1 -- 172.21.15.44:0/146266813 >> 172.21.15.44:0/146266813 conn(0x7f12b40cfad0 msgr2=0x7f12b40cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:13.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.219+0000 7f12bb42f700 1 -- 172.21.15.44:0/146266813 shutdown_connections 2024-09-13T18:36:13.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.219+0000 7f12bb42f700 1 -- 172.21.15.44:0/146266813 wait complete. 2024-09-13T18:36:13.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.223+0000 7f12bb42f700 1 Processor -- start 2024-09-13T18:36:13.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.223+0000 7f12bb42f700 1 -- start start 2024-09-13T18:36:13.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.223+0000 7f12bb42f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12b4071a90 0x7f12b41501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:13.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.223+0000 7f12bb42f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f12b40b4170 0x7f12b4158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:13.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.223+0000 7f12bb42f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12b40b4550 0x7f12b406dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:13.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.223+0000 7f12bb42f700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b406d8a0 con 0x7f12b4071a90 2024-09-13T18:36:13.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.223+0000 7f12bb42f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b406c290 con 0x7f12b40b4550 2024-09-13T18:36:13.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.223+0000 7f12bb42f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b406b1f0 con 0x7f12b40b4170 2024-09-13T18:36:13.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.223+0000 7f12ba42d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12b4071a90 0x7f12b41501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:13.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.223+0000 7f12ba42d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12b4071a90 0x7f12b41501f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37944/0 (socket says 172.21.15.44:37944) 2024-09-13T18:36:13.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.223+0000 7f12ba42d700 1 -- 172.21.15.44:0/197970554 learned_addr learned my addr 172.21.15.44:0/197970554 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:13.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.223+0000 7f12b9c2c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f12b40b4170 0x7f12b4158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:13.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.223+0000 7f12bac2e700 1 --2- 172.21.15.44:0/197970554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12b40b4550 0x7f12b406dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:13.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.223+0000 7f12b9c2c700 1 -- 172.21.15.44:0/197970554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12b40b4550 msgr2=0x7f12b406dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.223+0000 7f12b9c2c700 1 --2- 172.21.15.44:0/197970554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12b40b4550 0x7f12b406dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.223+0000 7f12b9c2c700 1 -- 172.21.15.44:0/197970554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12b4071a90 msgr2=0x7f12b41501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.223+0000 7f12b9c2c700 1 --2- 172.21.15.44:0/197970554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12b4071a90 0x7f12b41501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.223+0000 7f12b9c2c700 1 -- 172.21.15.44:0/197970554 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a40094b0 con 0x7f12b40b4170 2024-09-13T18:36:13.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.223+0000 7f12bac2e700 1 --2- 172.21.15.44:0/197970554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12b40b4550 0x7f12b406dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:13.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.223+0000 7f12ba42d700 1 --2- 172.21.15.44:0/197970554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12b4071a90 0x7f12b41501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:13.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.223+0000 7f12b9c2c700 1 --2- 172.21.15.44:0/197970554 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f12b40b4170 0x7f12b4158cb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f12a4016000 tx=0x7f12a4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:13.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.227+0000 7f12aaffd700 1 -- 172.21.15.44:0/197970554 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4019980 con 0x7f12b40b4170 2024-09-13T18:36:13.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.227+0000 7f12bb42f700 1 -- 172.21.15.44:0/197970554 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b406b4d0 con 0x7f12b40b4170 2024-09-13T18:36:13.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.227+0000 7f12aaffd700 1 -- 172.21.15.44:0/197970554 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a401e070 con 0x7f12b40b4170 2024-09-13T18:36:13.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.227+0000 7f12aaffd700 1 -- 172.21.15.44:0/197970554 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4019d20 con 0x7f12b40b4170 2024-09-13T18:36:13.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.227+0000 7f12bb42f700 1 -- 172.21.15.44:0/197970554 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b406ba90 con 0x7f12b40b4170 2024-09-13T18:36:13.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.231+0000 7f12bb42f700 1 -- 172.21.15.44:0/197970554 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b40b4990 con 0x7f12b40b4170 2024-09-13T18:36:13.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.231+0000 7f12aaffd700 1 -- 172.21.15.44:0/197970554 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f12a402d450 con 0x7f12b40b4170 2024-09-13T18:36:13.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.231+0000 7f12aaffd700 1 --2- 172.21.15.44:0/197970554 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1298066730 0x7f1298068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:13.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.231+0000 7f12aaffd700 1 -- 172.21.15.44:0/197970554 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f12a4085160 con 0x7f12b40b4170 2024-09-13T18:36:13.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.231+0000 7f12ba42d700 1 --2- 172.21.15.44:0/197970554 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1298066730 0x7f1298068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:13.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.231+0000 7f12ba42d700 1 --2- 172.21.15.44:0/197970554 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1298066730 0x7f1298068bf0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f12b00011e0 tx=0x7f12b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:13.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.239+0000 7f12aaffd700 1 -- 172.21.15.44:0/197970554 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f12a4052860 con 0x7f12b40b4170 2024-09-13T18:36:13.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:13.419+0000 7f12bb42f700 1 -- 172.21.15.44:0/197970554 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f12b40cd560 con 0x7f12b40b4170 2024-09-13T18:36:14.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.235+0000 7f12aaffd700 1 -- 172.21.15.44:0/197970554 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v86) v1 ==== 97+0+0 (secure 0 0 0) 0x7f12a4006ce0 con 0x7f12b40b4170 2024-09-13T18:36:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.239+0000 7f12bb42f700 1 -- 172.21.15.44:0/197970554 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1298066730 msgr2=0x7f1298068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.239+0000 7f12bb42f700 1 --2- 172.21.15.44:0/197970554 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1298066730 0x7f1298068bf0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f12b00011e0 tx=0x7f12b0009040 comp rx=0 tx=0).stop 2024-09-13T18:36:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.239+0000 7f12bb42f700 1 -- 172.21.15.44:0/197970554 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f12b40b4170 msgr2=0x7f12b4158cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.239+0000 7f12bb42f700 1 --2- 172.21.15.44:0/197970554 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f12b40b4170 0x7f12b4158cb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f12a4016000 tx=0x7f12a4004770 comp rx=0 tx=0).stop 2024-09-13T18:36:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.239+0000 7f12bb42f700 1 -- 172.21.15.44:0/197970554 shutdown_connections 2024-09-13T18:36:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.239+0000 7f12bb42f700 1 --2- 172.21.15.44:0/197970554 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1298066730 0x7f1298068bf0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.239+0000 7f12bb42f700 1 --2- 172.21.15.44:0/197970554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12b40b4550 0x7f12b406dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.239+0000 7f12bb42f700 1 --2- 172.21.15.44:0/197970554 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f12b40b4170 0x7f12b4158cb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.239+0000 7f12bb42f700 1 --2- 172.21.15.44:0/197970554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12b4071a90 0x7f12b41501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.239+0000 7f12bb42f700 1 -- 172.21.15.44:0/197970554 >> 172.21.15.44:0/197970554 conn(0x7f12b40cfad0 msgr2=0x7f12b415b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:14.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.239+0000 7f12bb42f700 1 -- 172.21.15.44:0/197970554 shutdown_connections 2024-09-13T18:36:14.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.239+0000 7f12bb42f700 1 -- 172.21.15.44:0/197970554 wait complete. 2024-09-13T18:36:14.248 INFO:teuthology.orchestra.run.smithi044.stderr: removed all blocklist entries 2024-09-13T18:36:14.264 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:36:14.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.379+0000 7f7c167aa700 1 Processor -- start 2024-09-13T18:36:14.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.379+0000 7f7c167aa700 1 -- start start 2024-09-13T18:36:14.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.379+0000 7f7c167aa700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7c100cb2a0 0x7f7c1015a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.379+0000 7f7c167aa700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c1006b040 0x7f7c10070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.379+0000 7f7c167aa700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c10071f10 con 0x7f7c1006bcc0 2024-09-13T18:36:14.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.379+0000 7f7c167aa700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c1006a310 con 0x7f7c100cb2a0 2024-09-13T18:36:14.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.379+0000 7f7c167aa700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1006abb0 con 0x7f7c1006b040 2024-09-13T18:36:14.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.379+0000 7f7c14fa7700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7c100cb2a0 0x7f7c1015a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.379+0000 7f7c14fa7700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7c100cb2a0 0x7f7c1015a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:35318/0 (socket says 172.21.15.44:35318) 2024-09-13T18:36:14.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.379+0000 7f7c157a8700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7c1006bcc0 0x7f7c1006c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:43112/0 (socket says 172.21.15.44:43112) 2024-09-13T18:36:14.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.379+0000 7f7c14fa7700 1 -- 172.21.15.44:0/2412622202 learned_addr learned my addr 172.21.15.44:0/2412622202 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:14.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.379+0000 7f7c15fa9700 1 --2- 172.21.15.44:0/2412622202 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c1006b040 0x7f7c10070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.379+0000 7f7c14fa7700 1 -- 172.21.15.44:0/2412622202 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c1006b040 msgr2=0x7f7c10070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:14.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.379+0000 7f7c14fa7700 1 --2- 172.21.15.44:0/2412622202 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c1006b040 0x7f7c10070320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.379+0000 7f7c14fa7700 1 -- 172.21.15.44:0/2412622202 >> v1:172.21.15.99:6789/0 conn(0x7f7c1006bcc0 legacy=0x7f7c1006c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.379+0000 7f7c14fa7700 1 -- 172.21.15.44:0/2412622202 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c100cba10 con 0x7f7c100cb2a0 2024-09-13T18:36:14.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.383+0000 7f7c14fa7700 1 --2- 172.21.15.44:0/2412622202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c100cb2a0 0x7f7c1015a850 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7c04009910 tx=0x7f7c04009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c312e79b0ffe9c64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:14.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.383+0000 7f7c03fff700 1 -- 172.21.15.44:0/2412622202 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04011830 con 0x7f7c100cb2a0 2024-09-13T18:36:14.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.383+0000 7f7c03fff700 1 -- 172.21.15.44:0/2412622202 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c04011990 con 0x7f7c100cb2a0 2024-09-13T18:36:14.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.383+0000 7f7c03fff700 1 -- 172.21.15.44:0/2412622202 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04011d40 con 0x7f7c100cb2a0 2024-09-13T18:36:14.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.383+0000 7f7c167aa700 1 -- 172.21.15.44:0/2412622202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c100cb2a0 msgr2=0x7f7c1015a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.383+0000 7f7c167aa700 1 --2- 172.21.15.44:0/2412622202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c100cb2a0 0x7f7c1015a850 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7c04009910 tx=0x7f7c04009c20 comp rx=0 tx=0).stop 2024-09-13T18:36:14.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.383+0000 7f7c167aa700 1 -- 172.21.15.44:0/2412622202 shutdown_connections 2024-09-13T18:36:14.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.383+0000 7f7c167aa700 1 --2- 172.21.15.44:0/2412622202 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c1006b040 0x7f7c10070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.383+0000 7f7c167aa700 1 --2- 172.21.15.44:0/2412622202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c100cb2a0 0x7f7c1015a850 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.383+0000 7f7c167aa700 1 -- 172.21.15.44:0/2412622202 >> 172.21.15.44:0/2412622202 conn(0x7f7c1006d900 msgr2=0x7f7c1006dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:14.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.383+0000 7f7c167aa700 1 -- 172.21.15.44:0/2412622202 shutdown_connections 2024-09-13T18:36:14.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.383+0000 7f7c167aa700 1 -- 172.21.15.44:0/2412622202 wait complete. 2024-09-13T18:36:14.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c167aa700 1 Processor -- start 2024-09-13T18:36:14.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c167aa700 1 -- start start 2024-09-13T18:36:14.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c167aa700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c1006b040 0x7f7c100ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c167aa700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c1006bcc0 0x7f7c100b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c167aa700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c10145950 0x7f7c100b3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c167aa700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100a8890 con 0x7f7c10145950 2024-09-13T18:36:14.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c167aa700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100a8b70 con 0x7f7c1006bcc0 2024-09-13T18:36:14.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c167aa700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100a8e50 con 0x7f7c1006b040 2024-09-13T18:36:14.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c15fa9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c10145950 0x7f7c100b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c15fa9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c10145950 0x7f7c100b3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37946/0 (socket says 172.21.15.44:37946) 2024-09-13T18:36:14.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c15fa9700 1 -- 172.21.15.44:0/3475412115 learned_addr learned my addr 172.21.15.44:0/3475412115 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:14.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c157a8700 1 --2- 172.21.15.44:0/3475412115 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c1006b040 0x7f7c100ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c14fa7700 1 --2- 172.21.15.44:0/3475412115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c1006bcc0 0x7f7c100b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c15fa9700 1 -- 172.21.15.44:0/3475412115 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c1006b040 msgr2=0x7f7c100ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c15fa9700 1 --2- 172.21.15.44:0/3475412115 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c1006b040 0x7f7c100ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c15fa9700 1 -- 172.21.15.44:0/3475412115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c1006bcc0 msgr2=0x7f7c100b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c15fa9700 1 --2- 172.21.15.44:0/3475412115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c1006bcc0 0x7f7c100b31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c15fa9700 1 -- 172.21.15.44:0/3475412115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c04009570 con 0x7f7c10145950 2024-09-13T18:36:14.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c14fa7700 1 --2- 172.21.15.44:0/3475412115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c1006bcc0 0x7f7c100b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:14.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c15fa9700 1 --2- 172.21.15.44:0/3475412115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c10145950 0x7f7c100b3710 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800ec10 tx=0x7f7c0800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:14.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c01ffb700 1 -- 172.21.15.44:0/3475412115 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800cb50 con 0x7f7c10145950 2024-09-13T18:36:14.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c01ffb700 1 -- 172.21.15.44:0/3475412115 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0800f040 con 0x7f7c10145950 2024-09-13T18:36:14.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c167aa700 1 -- 172.21.15.44:0/3475412115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c100a9130 con 0x7f7c10145950 2024-09-13T18:36:14.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c01ffb700 1 -- 172.21.15.44:0/3475412115 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08014480 con 0x7f7c10145950 2024-09-13T18:36:14.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.387+0000 7f7c167aa700 1 -- 172.21.15.44:0/3475412115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c100ae770 con 0x7f7c10145950 2024-09-13T18:36:14.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.391+0000 7f7c167aa700 1 -- 172.21.15.44:0/3475412115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c10145f70 con 0x7f7c10145950 2024-09-13T18:36:14.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.391+0000 7f7c01ffb700 1 -- 172.21.15.44:0/3475412115 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7c080145e0 con 0x7f7c10145950 2024-09-13T18:36:14.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.391+0000 7f7c01ffb700 1 --2- 172.21.15.44:0/3475412115 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7bf4066760 0x7f7bf4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.391+0000 7f7c01ffb700 1 -- 172.21.15.44:0/3475412115 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7c080844d0 con 0x7f7c10145950 2024-09-13T18:36:14.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.391+0000 7f7c157a8700 1 --2- 172.21.15.44:0/3475412115 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7bf4066760 0x7f7bf4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.395+0000 7f7c157a8700 1 --2- 172.21.15.44:0/3475412115 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7bf4066760 0x7f7bf4068c20 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c000f60 tx=0x7f7c0c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:14.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.399+0000 7f7c01ffb700 1 -- 172.21.15.44:0/3475412115 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7c10145f70 con 0x7f7c10145950 2024-09-13T18:36:14.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.635+0000 7f7c167aa700 1 -- 172.21.15.44:0/3475412115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7c10145f70 con 0x7f7c10145950 2024-09-13T18:36:14.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.635+0000 7f7c01ffb700 1 -- 172.21.15.44:0/3475412115 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7c10145f70 con 0x7f7c10145950 2024-09-13T18:36:14.642 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:14.643 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:36:14.643 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_dump": [ 2024-09-13T18:36:14.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:14.643 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.a", 2024-09-13T18:36:14.643 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rmm4/RGxAAtGPYfgzYpmE4yHhoggZJ8Q==", 2024-09-13T18:36:14.643 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:36:14.643 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:36:14.643 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:36:14.643 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:36:14.643 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:36:14.643 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:14.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:14.643 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:14.644 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.b", 2024-09-13T18:36:14.644 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rm8qC+JhAAhdkL3zbxM9+GI8+khy+cSg==", 2024-09-13T18:36:14.644 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:36:14.644 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:36:14.644 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:36:14.644 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:36:14.644 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:36:14.644 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:14.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:14.644 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:14.644 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.c", 2024-09-13T18:36:14.644 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rmr/OCIhAAvBF106ILl0AZlzCZ+S990Q==", 2024-09-13T18:36:14.644 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:36:14.644 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:36:14.645 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:36:14.645 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:36:14.645 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:36:14.645 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:14.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:14.645 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:14.645 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.d", 2024-09-13T18:36:14.645 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+RmSHbxKRAAAGsAWnIPUDUk3Y0aYryf+w==", 2024-09-13T18:36:14.645 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:36:14.645 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:36:14.645 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:36:14.645 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:36:14.645 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:36:14.645 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:14.646 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:14.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:14.646 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.0", 2024-09-13T18:36:14.646 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC6g+Rmw8xKHxAArYof7SeFMvQGq5AnVMbiog==", 2024-09-13T18:36:14.646 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:36:14.646 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:36:14.646 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:36:14.646 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:36:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.1", 2024-09-13T18:36:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC9g+RmLRFsMxAAC0SXlbIRvFc3byOy742GSg==", 2024-09-13T18:36:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:36:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:36:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:36:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:36:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:14.647 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:14.648 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.2", 2024-09-13T18:36:14.648 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDAg+RmvbTXNxAAyoLLo9RMD7817x8cdlYjWg==", 2024-09-13T18:36:14.648 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:36:14.648 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:36:14.648 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:36:14.648 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:36:14.648 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:14.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:14.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:14.648 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.3", 2024-09-13T18:36:14.648 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDDg+Rm4/jKOhAAYVOXNUkd3Z9CXAzbxJw34g==", 2024-09-13T18:36:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:36:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:36:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:36:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:36:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.4", 2024-09-13T18:36:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDJg+RmEZwhJBAAqtUZtMmRzRulAa6cnyvSmQ==", 2024-09-13T18:36:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:36:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:36:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:36:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:36:14.649 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.5", 2024-09-13T18:36:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDMg+RmCqBKKRAA7oP48mScYw7mkNGahg+ptw==", 2024-09-13T18:36:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:36:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:36:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:36:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:36:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.6", 2024-09-13T18:36:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDPg+RmbjDyLxAAIRb9i9TtRsDg+M9SnEegug==", 2024-09-13T18:36:14.650 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:36:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:36:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:36:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:36:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.7", 2024-09-13T18:36:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQDSg+RmA4v7NhAAVe6GV0DVksIWiq6KQvMgVg==", 2024-09-13T18:36:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:36:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-13T18:36:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-13T18:36:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:36:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:14.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:14.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:14.652 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.0", 2024-09-13T18:36:14.652 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rm7FEGMBAAosZ34edcGJmTiY8UhPtung==", 2024-09-13T18:36:14.652 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:36:14.652 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:36:14.652 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow r", 2024-09-13T18:36:14.652 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:36:14.652 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:14.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:14.652 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:14.652 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.1", 2024-09-13T18:36:14.652 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rmpu2zNhAAc0mOfL8c/MYij8KYpvsjRw==", 2024-09-13T18:36:14.652 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:36:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:36:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-13T18:36:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-13T18:36:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-13T18:36:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.2", 2024-09-13T18:36:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rm0xw5MxAAWu4i4+IAjW5QzQwiILs6bg==", 2024-09-13T18:36:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:36:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:36:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-13T18:36:14.653 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-13T18:36:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-13T18:36:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.3", 2024-09-13T18:36:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+RmZdTZORAA26aYb0Nz0g+rRBG+zAu/EQ==", 2024-09-13T18:36:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:36:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-13T18:36:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-13T18:36:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-13T18:36:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-13T18:36:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:14.654 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.admin", 2024-09-13T18:36:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+RmVt6IDBAALp4ZMLL2ehaE9O4vCSZzxQ==", 2024-09-13T18:36:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:36:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-13T18:36:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-13T18:36:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-13T18:36:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:36:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.x", 2024-09-13T18:36:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+RmBmEBGBAARTj0TQ0laAEW0n888vMZrA==", 2024-09-13T18:36:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:36:14.655 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-13T18:36:14.656 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-13T18:36:14.656 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:36:14.656 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:14.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:14.656 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:14.656 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.y", 2024-09-13T18:36:14.656 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQC3g+Rm1KSoFBAALCTzYRRxF7MPxQHL3ETGqQ==", 2024-09-13T18:36:14.656 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-13T18:36:14.656 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-13T18:36:14.656 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-13T18:36:14.656 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-13T18:36:14.656 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:14.656 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:14.657 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-13T18:36:14.657 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:36:14.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.635+0000 7f7c167aa700 1 -- 172.21.15.44:0/3475412115 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7bf4066760 msgr2=0x7f7bf4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.635+0000 7f7c167aa700 1 --2- 172.21.15.44:0/3475412115 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7bf4066760 0x7f7bf4068c20 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c000f60 tx=0x7f7c0c007d30 comp rx=0 tx=0).stop 2024-09-13T18:36:14.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.635+0000 7f7c167aa700 1 -- 172.21.15.44:0/3475412115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c10145950 msgr2=0x7f7c100b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.635+0000 7f7c167aa700 1 --2- 172.21.15.44:0/3475412115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c10145950 0x7f7c100b3710 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800ec10 tx=0x7f7c0800c0c0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.639+0000 7f7c167aa700 1 -- 172.21.15.44:0/3475412115 shutdown_connections 2024-09-13T18:36:14.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.639+0000 7f7c167aa700 1 --2- 172.21.15.44:0/3475412115 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7bf4066760 0x7f7bf4068c20 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.639+0000 7f7c167aa700 1 --2- 172.21.15.44:0/3475412115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c10145950 0x7f7c100b3710 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.639+0000 7f7c167aa700 1 --2- 172.21.15.44:0/3475412115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c1006bcc0 0x7f7c100b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.639+0000 7f7c167aa700 1 --2- 172.21.15.44:0/3475412115 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c1006b040 0x7f7c100ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.639+0000 7f7c167aa700 1 -- 172.21.15.44:0/3475412115 >> 172.21.15.44:0/3475412115 conn(0x7f7c1006d900 msgr2=0x7f7c100af540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:14.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.639+0000 7f7c167aa700 1 -- 172.21.15.44:0/3475412115 shutdown_connections 2024-09-13T18:36:14.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.639+0000 7f7c167aa700 1 -- 172.21.15.44:0/3475412115 wait complete. 2024-09-13T18:36:14.660 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.767+0000 7efdeffff700 1 Processor -- start 2024-09-13T18:36:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.767+0000 7efdeffff700 1 -- start start 2024-09-13T18:36:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.767+0000 7efdeffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdf0160eb0 0x7efdf0165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.767+0000 7efdeffff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efdf00b33d0 0x7efdf00b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.767+0000 7efdeffff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf00b3d30 con 0x7efdf0161290 2024-09-13T18:36:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.767+0000 7efdeffff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf0071f30 con 0x7efdf00b33d0 2024-09-13T18:36:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.767+0000 7efdeffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf01622e0 con 0x7efdf0160eb0 2024-09-13T18:36:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.767+0000 7efdef7fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7efdf0161290 0x7efdf0161740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54754/0 (socket says 172.21.15.44:54754) 2024-09-13T18:36:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.767+0000 7efdef7fe700 1 -- 172.21.15.44:0/1624048181 learned_addr learned my addr 172.21.15.44:0/1624048181 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.767+0000 7efdee7fc700 1 --2- 172.21.15.44:0/1624048181 >> v2:172.21.15.99:3300/0 conn(0x7efdf00b33d0 0x7efdf00b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.767+0000 7efdeeffd700 1 --2- 172.21.15.44:0/1624048181 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdf0160eb0 0x7efdf0165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.767+0000 7efdedffb700 1 -- 172.21.15.44:0/1624048181 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382493427 0 0) 0x7efdf00b3d30 con 0x7efdf0161290 2024-09-13T18:36:14.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.767+0000 7efdedffb700 1 -- 172.21.15.44:0/1624048181 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efddc0035d0 con 0x7efdf0161290 2024-09-13T18:36:14.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.767+0000 7efdee7fc700 1 -- 172.21.15.44:0/1624048181 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdf0160eb0 msgr2=0x7efdf0165590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:14.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.767+0000 7efdee7fc700 1 --2- 172.21.15.44:0/1624048181 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdf0160eb0 0x7efdf0165590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.767+0000 7efdee7fc700 1 -- 172.21.15.44:0/1624048181 >> v1:172.21.15.44:6789/0 conn(0x7efdf0161290 legacy=0x7efdf0161740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.767+0000 7efdee7fc700 1 -- 172.21.15.44:0/1624048181 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf0162000 con 0x7efdf00b33d0 2024-09-13T18:36:14.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.767+0000 7efdee7fc700 1 --2- 172.21.15.44:0/1624048181 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdf00b33d0 0x7efdf00b37f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7efde8009d90 tx=0x7efde800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e189374a69093e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.767+0000 7efdedffb700 1 -- 172.21.15.44:0/1624048181 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde800e070 con 0x7efdf00b33d0 2024-09-13T18:36:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.767+0000 7efdedffb700 1 -- 172.21.15.44:0/1624048181 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde800bb20 con 0x7efdf00b33d0 2024-09-13T18:36:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.767+0000 7efdedffb700 1 -- 172.21.15.44:0/1624048181 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8012430 con 0x7efdf00b33d0 2024-09-13T18:36:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdeffff700 1 -- 172.21.15.44:0/1624048181 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdf00b33d0 msgr2=0x7efdf00b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdeffff700 1 --2- 172.21.15.44:0/1624048181 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdf00b33d0 0x7efdf00b37f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7efde8009d90 tx=0x7efde800b330 comp rx=0 tx=0).stop 2024-09-13T18:36:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdeffff700 1 -- 172.21.15.44:0/1624048181 shutdown_connections 2024-09-13T18:36:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdeffff700 1 --2- 172.21.15.44:0/1624048181 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdf00b33d0 0x7efdf00b37f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdeffff700 1 --2- 172.21.15.44:0/1624048181 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdf0160eb0 0x7efdf0165590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdeffff700 1 -- 172.21.15.44:0/1624048181 >> 172.21.15.44:0/1624048181 conn(0x7efdf00b0f00 msgr2=0x7efdf00b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdeffff700 1 -- 172.21.15.44:0/1624048181 shutdown_connections 2024-09-13T18:36:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdeffff700 1 -- 172.21.15.44:0/1624048181 wait complete. 2024-09-13T18:36:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdeffff700 1 Processor -- start 2024-09-13T18:36:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdeffff700 1 -- start start 2024-09-13T18:36:14.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdeffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdf00b33d0 0x7efdf00a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdeffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdf0160eb0 0x7efdf015ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdeffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdf0161290 0x7efdf006c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdeffff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf00a9480 con 0x7efdf0161290 2024-09-13T18:36:14.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdeffff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf00a9760 con 0x7efdf00b33d0 2024-09-13T18:36:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdeffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf00a9a40 con 0x7efdf0160eb0 2024-09-13T18:36:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdef7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdf0161290 0x7efdf006c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdef7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdf0161290 0x7efdf006c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37958/0 (socket says 172.21.15.44:37958) 2024-09-13T18:36:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdef7fe700 1 -- 172.21.15.44:0/229161430 learned_addr learned my addr 172.21.15.44:0/229161430 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdeeffd700 1 --2- 172.21.15.44:0/229161430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdf00b33d0 0x7efdf00a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdee7fc700 1 --2- 172.21.15.44:0/229161430 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdf0160eb0 0x7efdf015ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdef7fe700 1 -- 172.21.15.44:0/229161430 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdf0160eb0 msgr2=0x7efdf015ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdef7fe700 1 --2- 172.21.15.44:0/229161430 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdf0160eb0 0x7efdf015ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdef7fe700 1 -- 172.21.15.44:0/229161430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdf00b33d0 msgr2=0x7efdf00a8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdef7fe700 1 --2- 172.21.15.44:0/229161430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdf00b33d0 0x7efdf00a8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdef7fe700 1 -- 172.21.15.44:0/229161430 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde8009a70 con 0x7efdf0161290 2024-09-13T18:36:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdef7fe700 1 --2- 172.21.15.44:0/229161430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdf0161290 0x7efdf006c210 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7efde000c4d0 tx=0x7efde000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efde77fe700 1 -- 172.21.15.44:0/229161430 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0005d90 con 0x7efdf0161290 2024-09-13T18:36:14.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efde77fe700 1 -- 172.21.15.44:0/229161430 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde00070d0 con 0x7efdf0161290 2024-09-13T18:36:14.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efdeffff700 1 -- 172.21.15.44:0/229161430 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf00a9d20 con 0x7efdf0161290 2024-09-13T18:36:14.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.771+0000 7efde77fe700 1 -- 172.21.15.44:0/229161430 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0007460 con 0x7efdf0161290 2024-09-13T18:36:14.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.775+0000 7efdeffff700 1 -- 172.21.15.44:0/229161430 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf006c750 con 0x7efdf0161290 2024-09-13T18:36:14.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.775+0000 7efdeffff700 1 -- 172.21.15.44:0/229161430 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf00ab630 con 0x7efdf0161290 2024-09-13T18:36:14.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.775+0000 7efde77fe700 1 -- 172.21.15.44:0/229161430 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efde00075c0 con 0x7efdf0161290 2024-09-13T18:36:14.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.775+0000 7efde77fe700 1 --2- 172.21.15.44:0/229161430 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efdd0066760 0x7efdd0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.775+0000 7efde77fe700 1 -- 172.21.15.44:0/229161430 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efde0083170 con 0x7efdf0161290 2024-09-13T18:36:14.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.775+0000 7efdeeffd700 1 --2- 172.21.15.44:0/229161430 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efdd0066760 0x7efdd0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.775+0000 7efdeeffd700 1 --2- 172.21.15.44:0/229161430 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efdd0066760 0x7efdd0068c20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7efdd8009bf0 tx=0x7efdd8009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:14.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.783+0000 7efde77fe700 1 -- 172.21.15.44:0/229161430 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efde00508c0 con 0x7efdf0161290 2024-09-13T18:36:14.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.959+0000 7efdeffff700 1 -- 172.21.15.44:0/229161430 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdf0165590 con 0x7efdf0161290 2024-09-13T18:36:14.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.959+0000 7efde77fe700 1 -- 172.21.15.44:0/229161430 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+12798 (secure 0 0 0) 0x7efde0053ee0 con 0x7efdf0161290 2024-09-13T18:36:14.967 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:14.967 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":86,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:36:14.228468+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:14.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.963+0000 7efdeffff700 1 -- 172.21.15.44:0/229161430 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efdd0066760 msgr2=0x7efdd0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.963+0000 7efdeffff700 1 --2- 172.21.15.44:0/229161430 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efdd0066760 0x7efdd0068c20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7efdd8009bf0 tx=0x7efdd8009240 comp rx=0 tx=0).stop 2024-09-13T18:36:14.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.963+0000 7efdeffff700 1 -- 172.21.15.44:0/229161430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdf0161290 msgr2=0x7efdf006c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.963+0000 7efdeffff700 1 --2- 172.21.15.44:0/229161430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdf0161290 0x7efdf006c210 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7efde000c4d0 tx=0x7efde000c7e0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.963+0000 7efdeffff700 1 -- 172.21.15.44:0/229161430 shutdown_connections 2024-09-13T18:36:14.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.963+0000 7efdeffff700 1 --2- 172.21.15.44:0/229161430 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efdd0066760 0x7efdd0068c20 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.963+0000 7efdeffff700 1 --2- 172.21.15.44:0/229161430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdf0161290 0x7efdf006c210 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.963+0000 7efdeffff700 1 --2- 172.21.15.44:0/229161430 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdf0160eb0 0x7efdf015ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.963+0000 7efdeffff700 1 --2- 172.21.15.44:0/229161430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdf00b33d0 0x7efdf00a8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.963+0000 7efdeffff700 1 -- 172.21.15.44:0/229161430 >> 172.21.15.44:0/229161430 conn(0x7efdf00b0f00 msgr2=0x7efdf00b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:14.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.963+0000 7efdeffff700 1 -- 172.21.15.44:0/229161430 shutdown_connections 2024-09-13T18:36:14.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:14.963+0000 7efdeffff700 1 -- 172.21.15.44:0/229161430 wait complete. 2024-09-13T18:36:14.983 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:36:14.983 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:36:15.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d15cd3700 1 Processor -- start 2024-09-13T18:36:15.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d15cd3700 1 -- start start 2024-09-13T18:36:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d15cd3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1d100ce270 0x7f1d1015caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d15cd3700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1006dad0 con 0x7f1d1015d030 2024-09-13T18:36:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d15cd3700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d100ae3c0 con 0x7f1d1006d6f0 2024-09-13T18:36:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d15cd3700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1015d4c0 con 0x7f1d100ce270 2024-09-13T18:36:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d154d2700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1d1015d030 0x7f1d1006baf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54768/0 (socket says 172.21.15.44:54768) 2024-09-13T18:36:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d154d2700 1 -- 172.21.15.44:0/2713633261 learned_addr learned my addr 172.21.15.44:0/2713633261 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d07fff700 1 --2- 172.21.15.44:0/2713633261 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1d100ce270 0x7f1d1015caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d077fe700 1 -- 172.21.15.44:0/2713633261 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3444902809 0 0) 0x7f1d1006dad0 con 0x7f1d1015d030 2024-09-13T18:36:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d077fe700 1 -- 172.21.15.44:0/2713633261 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cf80035d0 con 0x7f1d1015d030 2024-09-13T18:36:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d077fe700 1 -- 172.21.15.44:0/2713633261 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 592154686 0 0) 0x7f1d100ae3c0 con 0x7f1d1006d6f0 2024-09-13T18:36:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d077fe700 1 -- 172.21.15.44:0/2713633261 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d1006dad0 con 0x7f1d1006d6f0 2024-09-13T18:36:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d077fe700 1 -- 172.21.15.44:0/2713633261 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3486200745 0 0) 0x7f1cf80035d0 con 0x7f1d1015d030 2024-09-13T18:36:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d077fe700 1 -- 172.21.15.44:0/2713633261 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1d100ce270 msgr2=0x7f1d1015caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d077fe700 1 --2- 172.21.15.44:0/2713633261 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1d100ce270 0x7f1d1015caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d077fe700 1 -- 172.21.15.44:0/2713633261 >> v1:172.21.15.99:6789/0 conn(0x7f1d1006d6f0 legacy=0x7f1d100adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d077fe700 1 -- 172.21.15.44:0/2713633261 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d100705b0 con 0x7f1d1015d030 2024-09-13T18:36:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d077fe700 1 -- 172.21.15.44:0/2713633261 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f1d080019f0 con 0x7f1d1015d030 2024-09-13T18:36:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d077fe700 1 -- 172.21.15.44:0/2713633261 >> v1:172.21.15.44:6789/0 conn(0x7f1d1015d030 legacy=0x7f1d1006baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d077fe700 1 --2- 172.21.15.44:0/2713633261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cf8003be0 0x7f1cf8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d077fe700 1 --2- 172.21.15.44:0/2713633261 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1d100ce270 0x7f1cf8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d077fe700 1 --2- 172.21.15.44:0/2713633261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1cf8004db0 0x7f1cf8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d077fe700 1 -- 172.21.15.44:0/2713633261 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1015d4c0 con 0x7f1cf8003be0 2024-09-13T18:36:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d077fe700 1 -- 172.21.15.44:0/2713633261 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf8005ae0 con 0x7f1cf8004db0 2024-09-13T18:36:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d077fe700 1 -- 172.21.15.44:0/2713633261 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf8005ca0 con 0x7f1d100ce270 2024-09-13T18:36:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d14cd1700 1 --2- 172.21.15.44:0/2713633261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cf8003be0 0x7f1cf8003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d154d2700 1 --2- 172.21.15.44:0/2713633261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1cf8004db0 0x7f1cf8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d07fff700 1 --2- 172.21.15.44:0/2713633261 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1d100ce270 0x7f1cf8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d14cd1700 1 -- 172.21.15.44:0/2713633261 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1d100ce270 msgr2=0x7f1cf8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:15.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d14cd1700 1 --2- 172.21.15.44:0/2713633261 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1d100ce270 0x7f1cf8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d14cd1700 1 -- 172.21.15.44:0/2713633261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1cf8004db0 msgr2=0x7f1cf8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:15.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d14cd1700 1 --2- 172.21.15.44:0/2713633261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1cf8004db0 0x7f1cf8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d14cd1700 1 -- 172.21.15.44:0/2713633261 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf80035d0 con 0x7f1cf8003be0 2024-09-13T18:36:15.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d154d2700 1 --2- 172.21.15.44:0/2713633261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1cf8004db0 0x7f1cf8005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:15.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d07fff700 1 --2- 172.21.15.44:0/2713633261 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1d100ce270 0x7f1cf8004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:15.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d14cd1700 1 --2- 172.21.15.44:0/2713633261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cf8003be0 0x7f1cf8003fe0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c001960 tx=0x7f1cf80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ed8686ce804e1e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d077fe700 1 -- 172.21.15.44:0/2713633261 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c001450 con 0x7f1cf8003be0 2024-09-13T18:36:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d077fe700 1 -- 172.21.15.44:0/2713633261 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0c0052f0 con 0x7f1cf8003be0 2024-09-13T18:36:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.099+0000 7f1d077fe700 1 -- 172.21.15.44:0/2713633261 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c0036a0 con 0x7f1cf8003be0 2024-09-13T18:36:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.103+0000 7f1d15cd3700 1 -- 172.21.15.44:0/2713633261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cf8003be0 msgr2=0x7f1cf8003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.103+0000 7f1d15cd3700 1 --2- 172.21.15.44:0/2713633261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cf8003be0 0x7f1cf8003fe0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c001960 tx=0x7f1cf80058a0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.103+0000 7f1d154d2700 1 -- 172.21.15.44:0/2713633261 reap_dead start 2024-09-13T18:36:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.103+0000 7f1d15cd3700 1 -- 172.21.15.44:0/2713633261 shutdown_connections 2024-09-13T18:36:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.103+0000 7f1d15cd3700 1 -- 172.21.15.44:0/2713633261 >> 172.21.15.44:0/2713633261 conn(0x7f1d100b0e10 msgr2=0x7f1d100b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.103+0000 7f1d15cd3700 1 -- 172.21.15.44:0/2713633261 shutdown_connections 2024-09-13T18:36:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.103+0000 7f1d15cd3700 1 -- 172.21.15.44:0/2713633261 wait complete. 2024-09-13T18:36:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.103+0000 7f1d15cd3700 1 Processor -- start 2024-09-13T18:36:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.103+0000 7f1d15cd3700 1 -- start start 2024-09-13T18:36:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.103+0000 7f1d15cd3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1cf8003be0 0x7f1d101566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.103+0000 7f1d15cd3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d1015af00 0x7f1d100a9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.103+0000 7f1d15cd3700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d10141d60 0x7f1d10142210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.103+0000 7f1d15cd3700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d10142750 con 0x7f1d1015af00 2024-09-13T18:36:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.103+0000 7f1d15cd3700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1015c720 con 0x7f1d10141d60 2024-09-13T18:36:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.103+0000 7f1d15cd3700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1015b680 con 0x7f1cf8003be0 2024-09-13T18:36:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.103+0000 7f1d07fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d1015af00 0x7f1d100a9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.103+0000 7f1d07fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d1015af00 0x7f1d100a9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37990/0 (socket says 172.21.15.44:37990) 2024-09-13T18:36:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.103+0000 7f1d07fff700 1 -- 172.21.15.44:0/494453235 learned_addr learned my addr 172.21.15.44:0/494453235 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.107+0000 7f1d14cd1700 1 --2- 172.21.15.44:0/494453235 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1cf8003be0 0x7f1d101566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.107+0000 7f1d154d2700 1 --2- 172.21.15.44:0/494453235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d10141d60 0x7f1d10142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.107+0000 7f1d07fff700 1 -- 172.21.15.44:0/494453235 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1cf8003be0 msgr2=0x7f1d101566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.107+0000 7f1d07fff700 1 --2- 172.21.15.44:0/494453235 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1cf8003be0 0x7f1d101566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.107+0000 7f1d07fff700 1 -- 172.21.15.44:0/494453235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d10141d60 msgr2=0x7f1d10142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.107+0000 7f1d07fff700 1 --2- 172.21.15.44:0/494453235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d10141d60 0x7f1d10142210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.107+0000 7f1d07fff700 1 -- 172.21.15.44:0/494453235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1015b960 con 0x7f1d1015af00 2024-09-13T18:36:15.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.107+0000 7f1d14cd1700 1 --2- 172.21.15.44:0/494453235 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1cf8003be0 0x7f1d101566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:15.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.107+0000 7f1d07fff700 1 --2- 172.21.15.44:0/494453235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d1015af00 0x7f1d100a9030 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f1d00010960 tx=0x7f1d00010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.107+0000 7f1d057fa700 1 -- 172.21.15.44:0/494453235 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d00004220 con 0x7f1d1015af00 2024-09-13T18:36:15.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.107+0000 7f1d057fa700 1 -- 172.21.15.44:0/494453235 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d00004380 con 0x7f1d1015af00 2024-09-13T18:36:15.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.107+0000 7f1d15cd3700 1 -- 172.21.15.44:0/494453235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d1015bc40 con 0x7f1d1015af00 2024-09-13T18:36:15.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.107+0000 7f1d057fa700 1 -- 172.21.15.44:0/494453235 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0000e810 con 0x7f1d1015af00 2024-09-13T18:36:15.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.107+0000 7f1d15cd3700 1 -- 172.21.15.44:0/494453235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1015c200 con 0x7f1d1015af00 2024-09-13T18:36:15.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.107+0000 7f1d15cd3700 1 -- 172.21.15.44:0/494453235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d1015caf0 con 0x7f1d1015af00 2024-09-13T18:36:15.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.107+0000 7f1d057fa700 1 -- 172.21.15.44:0/494453235 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1d0000e970 con 0x7f1d1015af00 2024-09-13T18:36:15.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.107+0000 7f1d057fa700 1 --2- 172.21.15.44:0/494453235 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1cfc066760 0x7f1cfc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.107+0000 7f1d057fa700 1 -- 172.21.15.44:0/494453235 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1d00083f10 con 0x7f1d1015af00 2024-09-13T18:36:15.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.111+0000 7f1d14cd1700 1 --2- 172.21.15.44:0/494453235 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1cfc066760 0x7f1cfc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.111+0000 7f1d14cd1700 1 --2- 172.21.15.44:0/494453235 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1cfc066760 0x7f1cfc068c20 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1d101592a0 tx=0x7f1d0c00a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.119+0000 7f1d057fa700 1 -- 172.21.15.44:0/494453235 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1d000515d0 con 0x7f1d1015af00 2024-09-13T18:36:15.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.283+0000 7f1d15cd3700 1 -- 172.21.15.44:0/494453235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1d100b26b0 con 0x7f1d1015af00 2024-09-13T18:36:15.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.283+0000 7f1d057fa700 1 -- 172.21.15.44:0/494453235 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1d00054bf0 con 0x7f1d1015af00 2024-09-13T18:36:15.291 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:36:15.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.287+0000 7f1d15cd3700 1 -- 172.21.15.44:0/494453235 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1cfc066760 msgr2=0x7f1cfc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.287+0000 7f1d15cd3700 1 --2- 172.21.15.44:0/494453235 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1cfc066760 0x7f1cfc068c20 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1d101592a0 tx=0x7f1d0c00a000 comp rx=0 tx=0).stop 2024-09-13T18:36:15.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.287+0000 7f1d15cd3700 1 -- 172.21.15.44:0/494453235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d1015af00 msgr2=0x7f1d100a9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.287+0000 7f1d15cd3700 1 --2- 172.21.15.44:0/494453235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d1015af00 0x7f1d100a9030 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f1d00010960 tx=0x7f1d00010d20 comp rx=0 tx=0).stop 2024-09-13T18:36:15.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.287+0000 7f1d15cd3700 1 -- 172.21.15.44:0/494453235 shutdown_connections 2024-09-13T18:36:15.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.287+0000 7f1d15cd3700 1 --2- 172.21.15.44:0/494453235 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1cfc066760 0x7f1cfc068c20 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.287+0000 7f1d15cd3700 1 --2- 172.21.15.44:0/494453235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d10141d60 0x7f1d10142210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.287+0000 7f1d15cd3700 1 --2- 172.21.15.44:0/494453235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d1015af00 0x7f1d100a9030 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.287+0000 7f1d15cd3700 1 --2- 172.21.15.44:0/494453235 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1cf8003be0 0x7f1d101566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.287+0000 7f1d15cd3700 1 -- 172.21.15.44:0/494453235 >> 172.21.15.44:0/494453235 conn(0x7f1d100b0e10 msgr2=0x7f1d10157500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:15.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.287+0000 7f1d15cd3700 1 -- 172.21.15.44:0/494453235 shutdown_connections 2024-09-13T18:36:15.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.287+0000 7f1d15cd3700 1 -- 172.21.15.44:0/494453235 wait complete. 2024-09-13T18:36:15.312 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:36:15.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc56e497700 1 Processor -- start 2024-09-13T18:36:15.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc56e497700 1 -- start start 2024-09-13T18:36:15.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc56e497700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc56815b890 0x7fc568162220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc56e497700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc568162760 con 0x7fc5680cdcc0 2024-09-13T18:36:15.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc56e497700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56815bc70 con 0x7fc5680b2b00 2024-09-13T18:36:15.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc56e497700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5680ccc20 con 0x7fc56815b890 2024-09-13T18:36:15.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc5677fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc5680cdcc0 0x7fc5680b23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54770/0 (socket says 172.21.15.44:54770) 2024-09-13T18:36:15.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc5677fe700 1 -- 172.21.15.44:0/1351479559 learned_addr learned my addr 172.21.15.44:0/1351479559 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:15.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc567fff700 1 --2- 172.21.15.44:0/1351479559 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc56815b890 0x7fc568162220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc566ffd700 1 -- 172.21.15.44:0/1351479559 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152749237 0 0) 0x7fc568162760 con 0x7fc5680cdcc0 2024-09-13T18:36:15.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc566ffd700 1 -- 172.21.15.44:0/1351479559 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5540035d0 con 0x7fc5680cdcc0 2024-09-13T18:36:15.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc566ffd700 1 -- 172.21.15.44:0/1351479559 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 806069812 0 0) 0x7fc5540035d0 con 0x7fc5680cdcc0 2024-09-13T18:36:15.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc566ffd700 1 -- 172.21.15.44:0/1351479559 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc56815b890 msgr2=0x7fc568162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:15.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc566ffd700 1 --2- 172.21.15.44:0/1351479559 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc56815b890 0x7fc568162220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc566ffd700 1 -- 172.21.15.44:0/1351479559 >> v1:172.21.15.99:6789/0 conn(0x7fc5680b2b00 legacy=0x7fc56806ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc566ffd700 1 -- 172.21.15.44:0/1351479559 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5680ccf00 con 0x7fc5680cdcc0 2024-09-13T18:36:15.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc566ffd700 1 -- 172.21.15.44:0/1351479559 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7fc5600019f0 con 0x7fc5680cdcc0 2024-09-13T18:36:15.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc566ffd700 1 -- 172.21.15.44:0/1351479559 >> v1:172.21.15.44:6789/0 conn(0x7fc5680cdcc0 legacy=0x7fc5680b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc566ffd700 1 --2- 172.21.15.44:0/1351479559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc554003a50 0x7fc554003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc566ffd700 1 --2- 172.21.15.44:0/1351479559 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc56815b890 0x7fc554004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc566ffd700 1 --2- 172.21.15.44:0/1351479559 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc554004db0 0x7fc554005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc566ffd700 1 -- 172.21.15.44:0/1351479559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5680ccc20 con 0x7fc554003a50 2024-09-13T18:36:15.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc566ffd700 1 -- 172.21.15.44:0/1351479559 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55400bb60 con 0x7fc554004db0 2024-09-13T18:36:15.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc566ffd700 1 -- 172.21.15.44:0/1351479559 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55400bd20 con 0x7fc56815b890 2024-09-13T18:36:15.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc567fff700 1 --2- 172.21.15.44:0/1351479559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc554003a50 0x7fc554003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc5677fe700 1 --2- 172.21.15.44:0/1351479559 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc56815b890 0x7fc554004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc56ca34700 1 --2- 172.21.15.44:0/1351479559 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc554004db0 0x7fc554005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc567fff700 1 -- 172.21.15.44:0/1351479559 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc56815b890 msgr2=0x7fc554004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:15.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc567fff700 1 --2- 172.21.15.44:0/1351479559 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc56815b890 0x7fc554004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc567fff700 1 -- 172.21.15.44:0/1351479559 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc554004db0 msgr2=0x7fc554005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:15.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc567fff700 1 --2- 172.21.15.44:0/1351479559 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc554004db0 0x7fc554005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.415+0000 7fc567fff700 1 -- 172.21.15.44:0/1351479559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5540035d0 con 0x7fc554003a50 2024-09-13T18:36:15.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.419+0000 7fc567fff700 1 --2- 172.21.15.44:0/1351479559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc554003a50 0x7fc554003e70 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fc550009b70 tx=0x7fc5540058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a772f28a395972d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.419+0000 7fc566ffd700 1 -- 172.21.15.44:0/1351479559 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55000e6c0 con 0x7fc554003a50 2024-09-13T18:36:15.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.419+0000 7fc566ffd700 1 -- 172.21.15.44:0/1351479559 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55000e820 con 0x7fc554003a50 2024-09-13T18:36:15.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.419+0000 7fc566ffd700 1 -- 172.21.15.44:0/1351479559 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55000eb90 con 0x7fc554003a50 2024-09-13T18:36:15.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.419+0000 7fc56e497700 1 -- 172.21.15.44:0/1351479559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc554003a50 msgr2=0x7fc554003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.419+0000 7fc56e497700 1 --2- 172.21.15.44:0/1351479559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc554003a50 0x7fc554003e70 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fc550009b70 tx=0x7fc5540058a0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.419+0000 7fc56ca34700 1 -- 172.21.15.44:0/1351479559 reap_dead start 2024-09-13T18:36:15.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.419+0000 7fc56e497700 1 -- 172.21.15.44:0/1351479559 shutdown_connections 2024-09-13T18:36:15.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.419+0000 7fc56e497700 1 -- 172.21.15.44:0/1351479559 >> 172.21.15.44:0/1351479559 conn(0x7fc5680ce980 msgr2=0x7fc5680ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:15.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.419+0000 7fc56e497700 1 -- 172.21.15.44:0/1351479559 shutdown_connections 2024-09-13T18:36:15.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.419+0000 7fc56e497700 1 -- 172.21.15.44:0/1351479559 wait complete. 2024-09-13T18:36:15.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.419+0000 7fc56e497700 1 Processor -- start 2024-09-13T18:36:15.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.419+0000 7fc56e497700 1 -- start start 2024-09-13T18:36:15.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.423+0000 7fc56e497700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc56814cc10 0x7fc568162940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.423+0000 7fc56e497700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc568164110 0x7fc56815c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.423+0000 7fc56e497700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc56815c7c0 0x7fc56815cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.423+0000 7fc56e497700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56815d180 con 0x7fc56814cc10 2024-09-13T18:36:15.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.423+0000 7fc56e497700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc568162e80 con 0x7fc56815c7c0 2024-09-13T18:36:15.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.423+0000 7fc56e497700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc568163070 con 0x7fc568164110 2024-09-13T18:36:15.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.423+0000 7fc567fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc56814cc10 0x7fc568162940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.423+0000 7fc567fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc56814cc10 0x7fc568162940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38004/0 (socket says 172.21.15.44:38004) 2024-09-13T18:36:15.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.423+0000 7fc567fff700 1 -- 172.21.15.44:0/2853918083 learned_addr learned my addr 172.21.15.44:0/2853918083 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:15.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.423+0000 7fc5677fe700 1 --2- 172.21.15.44:0/2853918083 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc568164110 0x7fc56815c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.423+0000 7fc56ca34700 1 --2- 172.21.15.44:0/2853918083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc56815c7c0 0x7fc56815cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.423+0000 7fc567fff700 1 -- 172.21.15.44:0/2853918083 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc568164110 msgr2=0x7fc56815c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.423+0000 7fc567fff700 1 --2- 172.21.15.44:0/2853918083 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc568164110 0x7fc56815c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.423+0000 7fc567fff700 1 -- 172.21.15.44:0/2853918083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc56815c7c0 msgr2=0x7fc56815cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.423+0000 7fc567fff700 1 --2- 172.21.15.44:0/2853918083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc56815c7c0 0x7fc56815cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.423+0000 7fc567fff700 1 -- 172.21.15.44:0/2853918083 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc568163350 con 0x7fc56814cc10 2024-09-13T18:36:15.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.423+0000 7fc567fff700 1 --2- 172.21.15.44:0/2853918083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc56814cc10 0x7fc568162940 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fc550016000 tx=0x7fc5500047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.423+0000 7fc564ff9700 1 -- 172.21.15.44:0/2853918083 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55000e6c0 con 0x7fc56814cc10 2024-09-13T18:36:15.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.423+0000 7fc564ff9700 1 -- 172.21.15.44:0/2853918083 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc550003af0 con 0x7fc56814cc10 2024-09-13T18:36:15.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.423+0000 7fc56e497700 1 -- 172.21.15.44:0/2853918083 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc568163630 con 0x7fc56814cc10 2024-09-13T18:36:15.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.423+0000 7fc564ff9700 1 -- 172.21.15.44:0/2853918083 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc550009ee0 con 0x7fc56814cc10 2024-09-13T18:36:15.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.423+0000 7fc56e497700 1 -- 172.21.15.44:0/2853918083 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc568163bf0 con 0x7fc56814cc10 2024-09-13T18:36:15.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.427+0000 7fc56e497700 1 -- 172.21.15.44:0/2853918083 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5680cd480 con 0x7fc56814cc10 2024-09-13T18:36:15.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.427+0000 7fc564ff9700 1 -- 172.21.15.44:0/2853918083 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc550013470 con 0x7fc56814cc10 2024-09-13T18:36:15.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.427+0000 7fc564ff9700 1 --2- 172.21.15.44:0/2853918083 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc548066730 0x7fc548068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.427+0000 7fc564ff9700 1 -- 172.21.15.44:0/2853918083 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc5500852b0 con 0x7fc56814cc10 2024-09-13T18:36:15.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.427+0000 7fc5677fe700 1 --2- 172.21.15.44:0/2853918083 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc548066730 0x7fc548068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.431+0000 7fc5677fe700 1 --2- 172.21.15.44:0/2853918083 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc548066730 0x7fc548068bf0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc5681576f0 tx=0x7fc560006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.435+0000 7fc564ff9700 1 -- 172.21.15.44:0/2853918083 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc550052b40 con 0x7fc56814cc10 2024-09-13T18:36:15.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.611+0000 7fc56e497700 1 -- 172.21.15.44:0/2853918083 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc5680ce120 con 0x7fc56814cc10 2024-09-13T18:36:15.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.611+0000 7fc564ff9700 1 -- 172.21.15.44:0/2853918083 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v86) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc550056160 con 0x7fc56814cc10 2024-09-13T18:36:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:15.619 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-09-13T18:36:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:15.619 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2024-09-13T18:36:15.620 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2024-09-13T18:36:15.620 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:15.620 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-09-13T18:36:15.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.615+0000 7fc56e497700 1 -- 172.21.15.44:0/2853918083 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc548066730 msgr2=0x7fc548068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.615+0000 7fc56e497700 1 --2- 172.21.15.44:0/2853918083 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc548066730 0x7fc548068bf0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc5681576f0 tx=0x7fc560006040 comp rx=0 tx=0).stop 2024-09-13T18:36:15.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.615+0000 7fc56e497700 1 -- 172.21.15.44:0/2853918083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc56814cc10 msgr2=0x7fc568162940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.615+0000 7fc56e497700 1 --2- 172.21.15.44:0/2853918083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc56814cc10 0x7fc568162940 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fc550016000 tx=0x7fc5500047e0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.615+0000 7fc56e497700 1 -- 172.21.15.44:0/2853918083 shutdown_connections 2024-09-13T18:36:15.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.615+0000 7fc56e497700 1 --2- 172.21.15.44:0/2853918083 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc548066730 0x7fc548068bf0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.615+0000 7fc56e497700 1 --2- 172.21.15.44:0/2853918083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc56815c7c0 0x7fc56815cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.615+0000 7fc56e497700 1 --2- 172.21.15.44:0/2853918083 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc568164110 0x7fc56815c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.615+0000 7fc56e497700 1 --2- 172.21.15.44:0/2853918083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc56814cc10 0x7fc568162940 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.615+0000 7fc56e497700 1 -- 172.21.15.44:0/2853918083 >> 172.21.15.44:0/2853918083 conn(0x7fc5680ce980 msgr2=0x7fc568070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:15.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.615+0000 7fc56e497700 1 -- 172.21.15.44:0/2853918083 shutdown_connections 2024-09-13T18:36:15.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.615+0000 7fc56e497700 1 -- 172.21.15.44:0/2853918083 wait complete. 2024-09-13T18:36:15.633 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:36:15.634 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:36:15.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.743+0000 7f5e97432700 1 Processor -- start 2024-09-13T18:36:15.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.747+0000 7f5e97432700 1 -- start start 2024-09-13T18:36:15.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.747+0000 7f5e97432700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5e900ce710 0x7f5e900b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.747+0000 7f5e97432700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e900ceaf0 0x7f5e900cff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.747+0000 7f5e97432700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e9006aa30 con 0x7f5e900cd280 2024-09-13T18:36:15.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.747+0000 7f5e97432700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e900b1e60 con 0x7f5e900ce710 2024-09-13T18:36:15.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.747+0000 7f5e97432700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e900b18a0 con 0x7f5e900ceaf0 2024-09-13T18:36:15.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.747+0000 7f5e96c31700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5e900cd280 0x7f5e900cd6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54784/0 (socket says 172.21.15.44:54784) 2024-09-13T18:36:15.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.747+0000 7f5e96430700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5e900ce710 0x7f5e900b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.747+0000 7f5e96c31700 1 -- 172.21.15.44:0/4032541001 learned_addr learned my addr 172.21.15.44:0/4032541001 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:15.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.747+0000 7f5e95c2f700 1 --2- 172.21.15.44:0/4032541001 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e900ceaf0 0x7f5e900cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.747+0000 7f5e9542e700 1 -- 172.21.15.44:0/4032541001 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3906540767 0 0) 0x7f5e9006aa30 con 0x7f5e900cd280 2024-09-13T18:36:15.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.747+0000 7f5e9542e700 1 -- 172.21.15.44:0/4032541001 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e7c0035d0 con 0x7f5e900cd280 2024-09-13T18:36:15.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.747+0000 7f5e96430700 1 -- 172.21.15.44:0/4032541001 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e900ceaf0 msgr2=0x7f5e900cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:15.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.747+0000 7f5e96430700 1 --2- 172.21.15.44:0/4032541001 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e900ceaf0 0x7f5e900cff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.747+0000 7f5e96430700 1 -- 172.21.15.44:0/4032541001 >> v1:172.21.15.44:6789/0 conn(0x7f5e900cd280 legacy=0x7f5e900cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.747+0000 7f5e96430700 1 -- 172.21.15.44:0/4032541001 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e900b1b80 con 0x7f5e900ce710 2024-09-13T18:36:15.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.747+0000 7f5e96430700 1 --2- 172.21.15.44:0/4032541001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e900ce710 0x7f5e900b5da0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009850 tx=0x7f5e80009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada9efa328c26d71 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.747+0000 7f5e9542e700 1 -- 172.21.15.44:0/4032541001 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e80011830 con 0x7f5e900ce710 2024-09-13T18:36:15.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.747+0000 7f5e9542e700 1 -- 172.21.15.44:0/4032541001 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e80011990 con 0x7f5e900ce710 2024-09-13T18:36:15.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.747+0000 7f5e9542e700 1 -- 172.21.15.44:0/4032541001 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e80011d40 con 0x7f5e900ce710 2024-09-13T18:36:15.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.747+0000 7f5e97432700 1 -- 172.21.15.44:0/4032541001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e900ce710 msgr2=0x7f5e900b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.747+0000 7f5e97432700 1 --2- 172.21.15.44:0/4032541001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e900ce710 0x7f5e900b5da0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009850 tx=0x7f5e80009b60 comp rx=0 tx=0).stop 2024-09-13T18:36:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e97432700 1 -- 172.21.15.44:0/4032541001 shutdown_connections 2024-09-13T18:36:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e97432700 1 --2- 172.21.15.44:0/4032541001 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e900ceaf0 0x7f5e900cff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e97432700 1 --2- 172.21.15.44:0/4032541001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e900ce710 0x7f5e900b5da0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e97432700 1 -- 172.21.15.44:0/4032541001 >> 172.21.15.44:0/4032541001 conn(0x7f5e900d3260 msgr2=0x7f5e900cf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e97432700 1 -- 172.21.15.44:0/4032541001 shutdown_connections 2024-09-13T18:36:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e97432700 1 -- 172.21.15.44:0/4032541001 wait complete. 2024-09-13T18:36:15.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e97432700 1 Processor -- start 2024-09-13T18:36:15.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e97432700 1 -- start start 2024-09-13T18:36:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e97432700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e900cd280 0x7f5e901f3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e97432700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e900ce710 0x7f5e901f5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e97432700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e900ceaf0 0x7f5e900cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e97432700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e901f59b0 con 0x7f5e900ce710 2024-09-13T18:36:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e97432700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e900aa880 con 0x7f5e900cd280 2024-09-13T18:36:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e97432700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e900aab60 con 0x7f5e900ceaf0 2024-09-13T18:36:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e95c2f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e900ce710 0x7f5e901f5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e95c2f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e900ce710 0x7f5e901f5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38024/0 (socket says 172.21.15.44:38024) 2024-09-13T18:36:15.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e95c2f700 1 -- 172.21.15.44:0/2224899477 learned_addr learned my addr 172.21.15.44:0/2224899477 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:15.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e96c31700 1 --2- 172.21.15.44:0/2224899477 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e900ceaf0 0x7f5e900cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e96430700 1 --2- 172.21.15.44:0/2224899477 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e900cd280 0x7f5e901f3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e95c2f700 1 -- 172.21.15.44:0/2224899477 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e900ceaf0 msgr2=0x7f5e900cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e95c2f700 1 --2- 172.21.15.44:0/2224899477 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e900ceaf0 0x7f5e900cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e95c2f700 1 -- 172.21.15.44:0/2224899477 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e900cd280 msgr2=0x7f5e901f3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e95c2f700 1 --2- 172.21.15.44:0/2224899477 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e900cd280 0x7f5e901f3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e95c2f700 1 -- 172.21.15.44:0/2224899477 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e800094b0 con 0x7f5e900ce710 2024-09-13T18:36:15.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e96c31700 1 --2- 172.21.15.44:0/2224899477 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e900ceaf0 0x7f5e900cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:15.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e96430700 1 --2- 172.21.15.44:0/2224899477 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e900cd280 0x7f5e901f3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:15.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.751+0000 7f5e95c2f700 1 --2- 172.21.15.44:0/2224899477 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e900ce710 0x7f5e901f5470 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00e840 tx=0x7f5e8c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.755+0000 7f5e86ffd700 1 -- 172.21.15.44:0/2224899477 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c0095a0 con 0x7f5e900ce710 2024-09-13T18:36:15.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.755+0000 7f5e86ffd700 1 -- 172.21.15.44:0/2224899477 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8c00c690 con 0x7f5e900ce710 2024-09-13T18:36:15.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.755+0000 7f5e97432700 1 -- 172.21.15.44:0/2224899477 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e900aae40 con 0x7f5e900ce710 2024-09-13T18:36:15.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.755+0000 7f5e86ffd700 1 -- 172.21.15.44:0/2224899477 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c00ca00 con 0x7f5e900ce710 2024-09-13T18:36:15.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.755+0000 7f5e97432700 1 -- 172.21.15.44:0/2224899477 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e900ab400 con 0x7f5e900ce710 2024-09-13T18:36:15.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.755+0000 7f5e97432700 1 -- 172.21.15.44:0/2224899477 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e900b5da0 con 0x7f5e900ce710 2024-09-13T18:36:15.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.755+0000 7f5e86ffd700 1 -- 172.21.15.44:0/2224899477 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5e8c00cb60 con 0x7f5e900ce710 2024-09-13T18:36:15.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.755+0000 7f5e86ffd700 1 --2- 172.21.15.44:0/2224899477 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5e74066730 0x7f5e74068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.755+0000 7f5e86ffd700 1 -- 172.21.15.44:0/2224899477 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5e8c083d90 con 0x7f5e900ce710 2024-09-13T18:36:15.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.759+0000 7f5e96430700 1 --2- 172.21.15.44:0/2224899477 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5e74066730 0x7f5e74068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.759+0000 7f5e96430700 1 --2- 172.21.15.44:0/2224899477 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5e74066730 0x7f5e74068bf0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5e80000c00 tx=0x7f5e80008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.767+0000 7f5e86ffd700 1 -- 172.21.15.44:0/2224899477 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5e8c051450 con 0x7f5e900ce710 2024-09-13T18:36:15.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:15.939+0000 7f5e97432700 1 -- 172.21.15.44:0/2224899477 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5e9006be70 con 0x7f5e900ce710 2024-09-13T18:36:16.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.247+0000 7f5e86ffd700 1 -- 172.21.15.44:0/2224899477 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v87) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5e8c059e60 con 0x7f5e900ce710 2024-09-13T18:36:16.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.255+0000 7f5e97432700 1 -- 172.21.15.44:0/2224899477 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5e74066730 msgr2=0x7f5e74068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.255+0000 7f5e97432700 1 --2- 172.21.15.44:0/2224899477 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5e74066730 0x7f5e74068bf0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5e80000c00 tx=0x7f5e80008030 comp rx=0 tx=0).stop 2024-09-13T18:36:16.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.255+0000 7f5e97432700 1 -- 172.21.15.44:0/2224899477 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e900ce710 msgr2=0x7f5e901f5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.255+0000 7f5e97432700 1 --2- 172.21.15.44:0/2224899477 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e900ce710 0x7f5e901f5470 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00e840 tx=0x7f5e8c00ec00 comp rx=0 tx=0).stop 2024-09-13T18:36:16.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.255+0000 7f5e97432700 1 -- 172.21.15.44:0/2224899477 shutdown_connections 2024-09-13T18:36:16.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.255+0000 7f5e97432700 1 --2- 172.21.15.44:0/2224899477 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5e74066730 0x7f5e74068bf0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.255+0000 7f5e97432700 1 --2- 172.21.15.44:0/2224899477 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e900ceaf0 0x7f5e900cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.255+0000 7f5e97432700 1 --2- 172.21.15.44:0/2224899477 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e900ce710 0x7f5e901f5470 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.255+0000 7f5e97432700 1 --2- 172.21.15.44:0/2224899477 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e900cd280 0x7f5e901f3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.255+0000 7f5e97432700 1 -- 172.21.15.44:0/2224899477 >> 172.21.15.44:0/2224899477 conn(0x7f5e900d3260 msgr2=0x7f5e9015ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:16.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.255+0000 7f5e97432700 1 -- 172.21.15.44:0/2224899477 shutdown_connections 2024-09-13T18:36:16.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.259+0000 7f5e97432700 1 -- 172.21.15.44:0/2224899477 wait complete. 2024-09-13T18:36:16.266 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2024-09-13T18:36:16.278 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:36:16.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.395+0000 7f5dfe2c6700 1 Processor -- start 2024-09-13T18:36:16.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.395+0000 7f5dfe2c6700 1 -- start start 2024-09-13T18:36:16.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.395+0000 7f5dfe2c6700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5df80b5e00 0x7f5df80b6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.395+0000 7f5dfe2c6700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5df80b6780 0x7f5df80ce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.395+0000 7f5dfe2c6700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df80d0880 con 0x7f5df815cda0 2024-09-13T18:36:16.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.395+0000 7f5dfe2c6700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df80d2280 con 0x7f5df80b6780 2024-09-13T18:36:16.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.395+0000 7f5dfe2c6700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df80cde50 con 0x7f5df80b5e00 2024-09-13T18:36:16.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.395+0000 7f5dfc863700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5df80b6780 0x7f5df80ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.395+0000 7f5dfc863700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5df80b6780 0x7f5df80ce260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38028/0 (socket says 172.21.15.44:38028) 2024-09-13T18:36:16.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.395+0000 7f5dfc863700 1 -- 172.21.15.44:0/3944271522 learned_addr learned my addr 172.21.15.44:0/3944271522 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:16.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.395+0000 7f5df77fe700 1 --2- 172.21.15.44:0/3944271522 >> v2:172.21.15.99:3300/0 conn(0x7f5df80b5e00 0x7f5df80b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.395+0000 7f5dfc863700 1 -- 172.21.15.44:0/3944271522 >> v2:172.21.15.99:3300/0 conn(0x7f5df80b5e00 msgr2=0x7f5df80b6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:16.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.395+0000 7f5dfc863700 1 --2- 172.21.15.44:0/3944271522 >> v2:172.21.15.99:3300/0 conn(0x7f5df80b5e00 0x7f5df80b6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.395+0000 7f5dfc863700 1 -- 172.21.15.44:0/3944271522 >> v1:172.21.15.99:6789/0 conn(0x7f5df815cda0 legacy=0x7f5df80d1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.395+0000 7f5dfc863700 1 -- 172.21.15.44:0/3944271522 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df80d16e0 con 0x7f5df80b6780 2024-09-13T18:36:16.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.395+0000 7f5dfc863700 1 --2- 172.21.15.44:0/3944271522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5df80b6780 0x7f5df80ce260 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f5df806c470 tx=0x7f5df000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4e8ccfd4c6883c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:16.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.399+0000 7f5df6ffd700 1 -- 172.21.15.44:0/3944271522 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df000e070 con 0x7f5df80b6780 2024-09-13T18:36:16.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.399+0000 7f5df6ffd700 1 -- 172.21.15.44:0/3944271522 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df000b9c0 con 0x7f5df80b6780 2024-09-13T18:36:16.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.399+0000 7f5df6ffd700 1 -- 172.21.15.44:0/3944271522 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df000bd70 con 0x7f5df80b6780 2024-09-13T18:36:16.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.399+0000 7f5dfe2c6700 1 -- 172.21.15.44:0/3944271522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5df80b6780 msgr2=0x7f5df80ce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.399+0000 7f5dfe2c6700 1 --2- 172.21.15.44:0/3944271522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5df80b6780 0x7f5df80ce260 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f5df806c470 tx=0x7f5df000b330 comp rx=0 tx=0).stop 2024-09-13T18:36:16.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.399+0000 7f5dfe2c6700 1 -- 172.21.15.44:0/3944271522 shutdown_connections 2024-09-13T18:36:16.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.399+0000 7f5dfe2c6700 1 --2- 172.21.15.44:0/3944271522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5df80b6780 0x7f5df80ce260 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.399+0000 7f5dfe2c6700 1 --2- 172.21.15.44:0/3944271522 >> v2:172.21.15.99:3300/0 conn(0x7f5df80b5e00 0x7f5df80b6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.399+0000 7f5dfe2c6700 1 -- 172.21.15.44:0/3944271522 >> 172.21.15.44:0/3944271522 conn(0x7f5df80d2cb0 msgr2=0x7f5df80d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:16.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.399+0000 7f5dfe2c6700 1 -- 172.21.15.44:0/3944271522 shutdown_connections 2024-09-13T18:36:16.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.399+0000 7f5dfe2c6700 1 -- 172.21.15.44:0/3944271522 wait complete. 2024-09-13T18:36:16.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.399+0000 7f5dfe2c6700 1 Processor -- start 2024-09-13T18:36:16.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.399+0000 7f5dfe2c6700 1 -- start start 2024-09-13T18:36:16.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.403+0000 7f5dfe2c6700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5df80b5e00 0x7f5df8157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.403+0000 7f5dfe2c6700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5df80b6780 0x7f5df80cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.403+0000 7f5dfe2c6700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5df815cda0 0x7f5df80cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.403+0000 7f5dfe2c6700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df815e220 con 0x7f5df80b6780 2024-09-13T18:36:16.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.403+0000 7f5dfe2c6700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df80c9f00 con 0x7f5df80b5e00 2024-09-13T18:36:16.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.403+0000 7f5dfe2c6700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df80ca1e0 con 0x7f5df815cda0 2024-09-13T18:36:16.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.403+0000 7f5df77fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5df80b6780 0x7f5df80cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.403+0000 7f5df77fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5df80b6780 0x7f5df80cacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38034/0 (socket says 172.21.15.44:38034) 2024-09-13T18:36:16.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.403+0000 7f5df77fe700 1 -- 172.21.15.44:0/1442834466 learned_addr learned my addr 172.21.15.44:0/1442834466 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:16.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.403+0000 7f5df7fff700 1 --2- 172.21.15.44:0/1442834466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5df80b5e00 0x7f5df8157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.403+0000 7f5dfc863700 1 --2- 172.21.15.44:0/1442834466 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5df815cda0 0x7f5df80cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.403+0000 7f5df77fe700 1 -- 172.21.15.44:0/1442834466 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5df815cda0 msgr2=0x7f5df80cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.403+0000 7f5df77fe700 1 --2- 172.21.15.44:0/1442834466 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5df815cda0 0x7f5df80cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.403+0000 7f5df77fe700 1 -- 172.21.15.44:0/1442834466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5df80b5e00 msgr2=0x7f5df8157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.403+0000 7f5df77fe700 1 --2- 172.21.15.44:0/1442834466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5df80b5e00 0x7f5df8157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.403+0000 7f5df77fe700 1 -- 172.21.15.44:0/1442834466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df0009b30 con 0x7f5df80b6780 2024-09-13T18:36:16.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.403+0000 7f5df77fe700 1 --2- 172.21.15.44:0/1442834466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5df80b6780 0x7f5df80cacc0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f5de800e760 tx=0x7f5de800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:16.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.403+0000 7f5df4ff9700 1 -- 172.21.15.44:0/1442834466 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de800c070 con 0x7f5df80b6780 2024-09-13T18:36:16.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.403+0000 7f5df4ff9700 1 -- 172.21.15.44:0/1442834466 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de8013610 con 0x7f5df80b6780 2024-09-13T18:36:16.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.403+0000 7f5dfe2c6700 1 -- 172.21.15.44:0/1442834466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df80ca4c0 con 0x7f5df80b6780 2024-09-13T18:36:16.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.403+0000 7f5df4ff9700 1 -- 172.21.15.44:0/1442834466 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de8013980 con 0x7f5df80b6780 2024-09-13T18:36:16.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.403+0000 7f5dfe2c6700 1 -- 172.21.15.44:0/1442834466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df80cb740 con 0x7f5df80b6780 2024-09-13T18:36:16.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.403+0000 7f5dfe2c6700 1 -- 172.21.15.44:0/1442834466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df80cb960 con 0x7f5df80b6780 2024-09-13T18:36:16.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.407+0000 7f5df4ff9700 1 -- 172.21.15.44:0/1442834466 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5de8013ae0 con 0x7f5df80b6780 2024-09-13T18:36:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.407+0000 7f5df4ff9700 1 --2- 172.21.15.44:0/1442834466 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5de4066730 0x7f5de4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.407+0000 7f5df4ff9700 1 -- 172.21.15.44:0/1442834466 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f5de8083d70 con 0x7f5df80b6780 2024-09-13T18:36:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.407+0000 7f5df7fff700 1 --2- 172.21.15.44:0/1442834466 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5de4066730 0x7f5de4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.407+0000 7f5df7fff700 1 --2- 172.21.15.44:0/1442834466 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5de4066730 0x7f5de4068bf0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5dec000f60 tx=0x7f5dec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:16.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.415+0000 7f5df4ff9700 1 -- 172.21.15.44:0/1442834466 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5de80512c0 con 0x7f5df80b6780 2024-09-13T18:36:16.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:16.583+0000 7f5dfe2c6700 1 -- 172.21.15.44:0/1442834466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5df80b6240 con 0x7f5df80b6780 2024-09-13T18:36:17.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.251+0000 7f5df4ff9700 1 -- 172.21.15.44:0/1442834466 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v88) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5de80548e0 con 0x7f5df80b6780 2024-09-13T18:36:17.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.259+0000 7f5dfe2c6700 1 -- 172.21.15.44:0/1442834466 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5de4066730 msgr2=0x7f5de4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.259+0000 7f5dfe2c6700 1 --2- 172.21.15.44:0/1442834466 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5de4066730 0x7f5de4068bf0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5dec000f60 tx=0x7f5dec009040 comp rx=0 tx=0).stop 2024-09-13T18:36:17.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.259+0000 7f5dfe2c6700 1 -- 172.21.15.44:0/1442834466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5df80b6780 msgr2=0x7f5df80cacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.259+0000 7f5dfe2c6700 1 --2- 172.21.15.44:0/1442834466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5df80b6780 0x7f5df80cacc0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f5de800e760 tx=0x7f5de800ea70 comp rx=0 tx=0).stop 2024-09-13T18:36:17.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.263+0000 7f5dfe2c6700 1 -- 172.21.15.44:0/1442834466 shutdown_connections 2024-09-13T18:36:17.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.263+0000 7f5dfe2c6700 1 --2- 172.21.15.44:0/1442834466 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5de4066730 0x7f5de4068bf0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.263+0000 7f5dfe2c6700 1 --2- 172.21.15.44:0/1442834466 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5df815cda0 0x7f5df80cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.263+0000 7f5dfe2c6700 1 --2- 172.21.15.44:0/1442834466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5df80b6780 0x7f5df80cacc0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.263+0000 7f5dfe2c6700 1 --2- 172.21.15.44:0/1442834466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5df80b5e00 0x7f5df8157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.263+0000 7f5dfe2c6700 1 -- 172.21.15.44:0/1442834466 >> 172.21.15.44:0/1442834466 conn(0x7f5df80d2cb0 msgr2=0x7f5df80b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:17.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.263+0000 7f5dfe2c6700 1 -- 172.21.15.44:0/1442834466 shutdown_connections 2024-09-13T18:36:17.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.263+0000 7f5dfe2c6700 1 -- 172.21.15.44:0/1442834466 wait complete. 2024-09-13T18:36:17.273 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2024-09-13T18:36:17.296 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:36:17.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.407+0000 7f0f3ffff700 1 Processor -- start 2024-09-13T18:36:17.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.407+0000 7f0f3ffff700 1 -- start start 2024-09-13T18:36:17.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3ffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0f400b3290 0x7f0f4015abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3ffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0f4006f8c0 0x7f0f4015c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3ffff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f4015b2e0 con 0x7f0f4015a800 2024-09-13T18:36:17.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3ffff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f4015bf60 con 0x7f0f400b3290 2024-09-13T18:36:17.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3ffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4015b5c0 con 0x7f0f4006f8c0 2024-09-13T18:36:17.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3effd700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0f4015a800 0x7f0f400b2b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54790/0 (socket says 172.21.15.44:54790) 2024-09-13T18:36:17.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3effd700 1 -- 172.21.15.44:0/1627222377 learned_addr learned my addr 172.21.15.44:0/1627222377 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:17.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3e7fc700 1 --2- 172.21.15.44:0/1627222377 >> v2:172.21.15.44:3300/0 conn(0x7f0f400b3290 0x7f0f4015abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3f7fe700 1 --2- 172.21.15.44:0/1627222377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0f4006f8c0 0x7f0f4015c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3dffb700 1 -- 172.21.15.44:0/1627222377 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393907357 0 0) 0x7f0f4015b2e0 con 0x7f0f4015a800 2024-09-13T18:36:17.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3dffb700 1 -- 172.21.15.44:0/1627222377 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f2c0035d0 con 0x7f0f4015a800 2024-09-13T18:36:17.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3dffb700 1 -- 172.21.15.44:0/1627222377 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 688396119 0 0) 0x7f0f2c0035d0 con 0x7f0f4015a800 2024-09-13T18:36:17.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3e7fc700 1 -- 172.21.15.44:0/1627222377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0f4006f8c0 msgr2=0x7f0f4015c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:17.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3e7fc700 1 --2- 172.21.15.44:0/1627222377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0f4006f8c0 0x7f0f4015c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3e7fc700 1 -- 172.21.15.44:0/1627222377 >> v1:172.21.15.44:6789/0 conn(0x7f0f4015a800 legacy=0x7f0f400b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3e7fc700 1 -- 172.21.15.44:0/1627222377 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4015b8a0 con 0x7f0f400b3290 2024-09-13T18:36:17.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3e7fc700 1 --2- 172.21.15.44:0/1627222377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f400b3290 0x7f0f4015abe0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f0f28009850 tx=0x7f0f28009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad0e6a71e6a5d9a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:17.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3dffb700 1 -- 172.21.15.44:0/1627222377 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f30001670 con 0x7f0f400b3290 2024-09-13T18:36:17.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3dffb700 1 -- 172.21.15.44:0/1627222377 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f28004030 con 0x7f0f400b3290 2024-09-13T18:36:17.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3dffb700 1 -- 172.21.15.44:0/1627222377 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f280043a0 con 0x7f0f400b3290 2024-09-13T18:36:17.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3ffff700 1 -- 172.21.15.44:0/1627222377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f400b3290 msgr2=0x7f0f4015abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3ffff700 1 --2- 172.21.15.44:0/1627222377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f400b3290 0x7f0f4015abe0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f0f28009850 tx=0x7f0f28009b60 comp rx=0 tx=0).stop 2024-09-13T18:36:17.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3ffff700 1 -- 172.21.15.44:0/1627222377 shutdown_connections 2024-09-13T18:36:17.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3ffff700 1 --2- 172.21.15.44:0/1627222377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0f4006f8c0 0x7f0f4015c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3ffff700 1 --2- 172.21.15.44:0/1627222377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f400b3290 0x7f0f4015abe0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3ffff700 1 -- 172.21.15.44:0/1627222377 >> 172.21.15.44:0/1627222377 conn(0x7f0f40071ce0 msgr2=0x7f0f400720c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:17.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3ffff700 1 -- 172.21.15.44:0/1627222377 shutdown_connections 2024-09-13T18:36:17.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.411+0000 7f0f3ffff700 1 -- 172.21.15.44:0/1627222377 wait complete. 2024-09-13T18:36:17.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f3ffff700 1 Processor -- start 2024-09-13T18:36:17.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f3ffff700 1 -- start start 2024-09-13T18:36:17.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f3ffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f4006f8c0 0x7f0f401485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f3ffff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0f400b3290 0x7f0f400b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f3ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4015a800 0x7f0f40153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f3ffff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f400b5320 con 0x7f0f4015a800 2024-09-13T18:36:17.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f3ffff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f400b44b0 con 0x7f0f4006f8c0 2024-09-13T18:36:17.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f3ffff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f40148b20 con 0x7f0f400b3290 2024-09-13T18:36:17.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f3f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4015a800 0x7f0f40153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f3f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4015a800 0x7f0f40153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38060/0 (socket says 172.21.15.44:38060) 2024-09-13T18:36:17.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f3f7fe700 1 -- 172.21.15.44:0/4128367440 learned_addr learned my addr 172.21.15.44:0/4128367440 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:17.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f3e7fc700 1 --2- 172.21.15.44:0/4128367440 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0f400b3290 0x7f0f400b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f3effd700 1 --2- 172.21.15.44:0/4128367440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f4006f8c0 0x7f0f401485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f3f7fe700 1 -- 172.21.15.44:0/4128367440 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0f400b3290 msgr2=0x7f0f400b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f3f7fe700 1 --2- 172.21.15.44:0/4128367440 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0f400b3290 0x7f0f400b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f3f7fe700 1 -- 172.21.15.44:0/4128367440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f4006f8c0 msgr2=0x7f0f401485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f3f7fe700 1 --2- 172.21.15.44:0/4128367440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f4006f8c0 0x7f0f401485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f3f7fe700 1 -- 172.21.15.44:0/4128367440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f280094b0 con 0x7f0f4015a800 2024-09-13T18:36:17.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f3f7fe700 1 --2- 172.21.15.44:0/4128367440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4015a800 0x7f0f40153dd0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f0f3800efc0 tx=0x7f0f3800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:17.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f37fff700 1 -- 172.21.15.44:0/4128367440 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f38009ca0 con 0x7f0f4015a800 2024-09-13T18:36:17.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f37fff700 1 -- 172.21.15.44:0/4128367440 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3800f040 con 0x7f0f4015a800 2024-09-13T18:36:17.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f37fff700 1 -- 172.21.15.44:0/4128367440 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f38014480 con 0x7f0f4015a800 2024-09-13T18:36:17.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f3ffff700 1 -- 172.21.15.44:0/4128367440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f400b46a0 con 0x7f0f4015a800 2024-09-13T18:36:17.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.415+0000 7f0f3ffff700 1 -- 172.21.15.44:0/4128367440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f400b4c60 con 0x7f0f4015a800 2024-09-13T18:36:17.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.419+0000 7f0f3ffff700 1 -- 172.21.15.44:0/4128367440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f400b5460 con 0x7f0f4015a800 2024-09-13T18:36:17.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.419+0000 7f0f37fff700 1 -- 172.21.15.44:0/4128367440 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0f380145e0 con 0x7f0f4015a800 2024-09-13T18:36:17.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.419+0000 7f0f37fff700 1 --2- 172.21.15.44:0/4128367440 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0f20066730 0x7f0f20068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.419+0000 7f0f37fff700 1 -- 172.21.15.44:0/4128367440 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f0f38084dc0 con 0x7f0f4015a800 2024-09-13T18:36:17.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.419+0000 7f0f3effd700 1 --2- 172.21.15.44:0/4128367440 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0f20066730 0x7f0f20068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.419+0000 7f0f3effd700 1 --2- 172.21.15.44:0/4128367440 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0f20066730 0x7f0f20068bf0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0f300011e0 tx=0x7f0f30001bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:17.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.427+0000 7f0f37fff700 1 -- 172.21.15.44:0/4128367440 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0f400b5460 con 0x7f0f4015a800 2024-09-13T18:36:17.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.635+0000 7f0f3ffff700 1 -- 172.21.15.44:0/4128367440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0f400b5460 con 0x7f0f4015a800 2024-09-13T18:36:17.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.655+0000 7f0f37fff700 1 -- 172.21.15.44:0/4128367440 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v74) v1 ==== 174+0+0 (secure 0 0 0) 0x7f0f400b5460 con 0x7f0f4015a800 2024-09-13T18:36:17.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.659+0000 7f0f3ffff700 1 -- 172.21.15.44:0/4128367440 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0f20066730 msgr2=0x7f0f20068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.659+0000 7f0f3ffff700 1 --2- 172.21.15.44:0/4128367440 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0f20066730 0x7f0f20068bf0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0f300011e0 tx=0x7f0f30001bc0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.659+0000 7f0f3ffff700 1 -- 172.21.15.44:0/4128367440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4015a800 msgr2=0x7f0f40153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.659+0000 7f0f3ffff700 1 --2- 172.21.15.44:0/4128367440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4015a800 0x7f0f40153dd0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f0f3800efc0 tx=0x7f0f3800c3a0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.659+0000 7f0f3ffff700 1 -- 172.21.15.44:0/4128367440 shutdown_connections 2024-09-13T18:36:17.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.659+0000 7f0f3ffff700 1 --2- 172.21.15.44:0/4128367440 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0f20066730 0x7f0f20068bf0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.659+0000 7f0f3ffff700 1 --2- 172.21.15.44:0/4128367440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4015a800 0x7f0f40153dd0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.659+0000 7f0f3ffff700 1 --2- 172.21.15.44:0/4128367440 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0f400b3290 0x7f0f400b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.659+0000 7f0f3ffff700 1 --2- 172.21.15.44:0/4128367440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f4006f8c0 0x7f0f401485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.659+0000 7f0f3ffff700 1 -- 172.21.15.44:0/4128367440 >> 172.21.15.44:0/4128367440 conn(0x7f0f40071ce0 msgr2=0x7f0f400720c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:17.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.659+0000 7f0f3ffff700 1 -- 172.21.15.44:0/4128367440 shutdown_connections 2024-09-13T18:36:17.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.659+0000 7f0f3ffff700 1 -- 172.21.15.44:0/4128367440 wait complete. 2024-09-13T18:36:17.672 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 12 and data pool 13 2024-09-13T18:36:17.689 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:17.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.783+0000 7f795da2d700 1 Processor -- start 2024-09-13T18:36:17.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.783+0000 7f795da2d700 1 -- start start 2024-09-13T18:36:17.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.783+0000 7f795da2d700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f79580b3ae0 0x7f7958165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.783+0000 7f795da2d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7958161290 0x7f79581616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.783+0000 7f795da2d700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7958071f30 con 0x7f7958160eb0 2024-09-13T18:36:17.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.783+0000 7f795da2d700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79581622e0 con 0x7f7958161290 2024-09-13T18:36:17.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.783+0000 7f795da2d700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7958162000 con 0x7f79580b3ae0 2024-09-13T18:36:17.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.783+0000 7f795d22c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7958161290 0x7f79581616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.783+0000 7f795ca2b700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7958160eb0 0x7f79580b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54804/0 (socket says 172.21.15.44:54804) 2024-09-13T18:36:17.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.783+0000 7f795ca2b700 1 -- 172.21.15.44:0/2665810343 learned_addr learned my addr 172.21.15.44:0/2665810343 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:17.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.783+0000 7f7957fff700 1 --2- 172.21.15.44:0/2665810343 >> v2:172.21.15.99:3300/0 conn(0x7f79580b3ae0 0x7f7958165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.783+0000 7f79577fe700 1 -- 172.21.15.44:0/2665810343 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 384708972 0 0) 0x7f7958071f30 con 0x7f7958160eb0 2024-09-13T18:36:17.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.783+0000 7f79577fe700 1 -- 172.21.15.44:0/2665810343 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79440035d0 con 0x7f7958160eb0 2024-09-13T18:36:17.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.783+0000 7f795d22c700 1 -- 172.21.15.44:0/2665810343 >> v2:172.21.15.99:3300/0 conn(0x7f79580b3ae0 msgr2=0x7f7958165590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:17.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.783+0000 7f795d22c700 1 --2- 172.21.15.44:0/2665810343 >> v2:172.21.15.99:3300/0 conn(0x7f79580b3ae0 0x7f7958165590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.783+0000 7f795d22c700 1 -- 172.21.15.44:0/2665810343 >> v1:172.21.15.44:6789/0 conn(0x7f7958160eb0 legacy=0x7f79580b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.783+0000 7f795d22c700 1 -- 172.21.15.44:0/2665810343 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7958164ab0 con 0x7f7958161290 2024-09-13T18:36:17.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.783+0000 7f795d22c700 1 --2- 172.21.15.44:0/2665810343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7958161290 0x7f79581616c0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f795806ab00 tx=0x7f7950009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4211d187b7603209 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:17.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.783+0000 7f79577fe700 1 -- 172.21.15.44:0/2665810343 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7950011830 con 0x7f7958161290 2024-09-13T18:36:17.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.783+0000 7f79577fe700 1 -- 172.21.15.44:0/2665810343 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7950011990 con 0x7f7958161290 2024-09-13T18:36:17.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.783+0000 7f79577fe700 1 -- 172.21.15.44:0/2665810343 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7950011d20 con 0x7f7958161290 2024-09-13T18:36:17.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.787+0000 7f795da2d700 1 -- 172.21.15.44:0/2665810343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7958161290 msgr2=0x7f79581616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.787+0000 7f795da2d700 1 --2- 172.21.15.44:0/2665810343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7958161290 0x7f79581616c0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f795806ab00 tx=0x7f7950009b30 comp rx=0 tx=0).stop 2024-09-13T18:36:17.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.787+0000 7f795da2d700 1 -- 172.21.15.44:0/2665810343 shutdown_connections 2024-09-13T18:36:17.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.787+0000 7f795da2d700 1 --2- 172.21.15.44:0/2665810343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7958161290 0x7f79581616c0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.787+0000 7f795da2d700 1 --2- 172.21.15.44:0/2665810343 >> v2:172.21.15.99:3300/0 conn(0x7f79580b3ae0 0x7f7958165590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.787+0000 7f795da2d700 1 -- 172.21.15.44:0/2665810343 >> 172.21.15.44:0/2665810343 conn(0x7f79580b0f00 msgr2=0x7f79580b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:17.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.787+0000 7f795da2d700 1 -- 172.21.15.44:0/2665810343 shutdown_connections 2024-09-13T18:36:17.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.787+0000 7f795da2d700 1 -- 172.21.15.44:0/2665810343 wait complete. 2024-09-13T18:36:17.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f795da2d700 1 Processor -- start 2024-09-13T18:36:17.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f795da2d700 1 -- start start 2024-09-13T18:36:17.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f795da2d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79580b3ae0 0x7f79580a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f795da2d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7958160eb0 0x7f79580b2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f795da2d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7958161290 0x7f79581f93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f795da2d700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795815e4a0 con 0x7f7958160eb0 2024-09-13T18:36:17.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f795da2d700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79580a8d50 con 0x7f7958161290 2024-09-13T18:36:17.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f795da2d700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79580a9030 con 0x7f79580b3ae0 2024-09-13T18:36:17.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f7957fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7958160eb0 0x7f79580b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f7957fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7958160eb0 0x7f79580b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38076/0 (socket says 172.21.15.44:38076) 2024-09-13T18:36:17.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f7957fff700 1 -- 172.21.15.44:0/3105596232 learned_addr learned my addr 172.21.15.44:0/3105596232 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:17.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f795ca2b700 1 --2- 172.21.15.44:0/3105596232 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79580b3ae0 0x7f79580a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f795d22c700 1 --2- 172.21.15.44:0/3105596232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7958161290 0x7f79581f93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f7957fff700 1 -- 172.21.15.44:0/3105596232 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79580b3ae0 msgr2=0x7f79580a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f7957fff700 1 --2- 172.21.15.44:0/3105596232 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79580b3ae0 0x7f79580a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f7957fff700 1 -- 172.21.15.44:0/3105596232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7958161290 msgr2=0x7f79581f93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f7957fff700 1 --2- 172.21.15.44:0/3105596232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7958161290 0x7f79581f93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f7957fff700 1 -- 172.21.15.44:0/3105596232 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79500094b0 con 0x7f7958160eb0 2024-09-13T18:36:17.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f795ca2b700 1 --2- 172.21.15.44:0/3105596232 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79580b3ae0 0x7f79580a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:17.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f795d22c700 1 --2- 172.21.15.44:0/3105596232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7958161290 0x7f79581f93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:17.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f7957fff700 1 --2- 172.21.15.44:0/3105596232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7958160eb0 0x7f79580b2360 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f794800efc0 tx=0x7f794800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:17.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f79557fa700 1 -- 172.21.15.44:0/3105596232 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794800cdc0 con 0x7f7958160eb0 2024-09-13T18:36:17.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f79557fa700 1 -- 172.21.15.44:0/3105596232 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794800f040 con 0x7f7958160eb0 2024-09-13T18:36:17.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f795da2d700 1 -- 172.21.15.44:0/3105596232 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795815e6f0 con 0x7f7958160eb0 2024-09-13T18:36:17.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f79557fa700 1 -- 172.21.15.44:0/3105596232 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79480146a0 con 0x7f7958160eb0 2024-09-13T18:36:17.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.791+0000 7f795da2d700 1 -- 172.21.15.44:0/3105596232 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79580a89f0 con 0x7f7958160eb0 2024-09-13T18:36:17.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.795+0000 7f795da2d700 1 -- 172.21.15.44:0/3105596232 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79580a91f0 con 0x7f7958160eb0 2024-09-13T18:36:17.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.795+0000 7f79557fa700 1 -- 172.21.15.44:0/3105596232 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7948014800 con 0x7f7958160eb0 2024-09-13T18:36:17.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.795+0000 7f79557fa700 1 --2- 172.21.15.44:0/3105596232 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7938066730 0x7f7938068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.795+0000 7f79557fa700 1 -- 172.21.15.44:0/3105596232 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7948084b50 con 0x7f7958160eb0 2024-09-13T18:36:17.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.795+0000 7f795ca2b700 1 --2- 172.21.15.44:0/3105596232 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7938066730 0x7f7938068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.799+0000 7f795ca2b700 1 --2- 172.21.15.44:0/3105596232 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7938066730 0x7f7938068bf0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f79400011e0 tx=0x7f7940009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:17.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.803+0000 7f79557fa700 1 -- 172.21.15.44:0/3105596232 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7948051ec0 con 0x7f7958160eb0 2024-09-13T18:36:17.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.979+0000 7f795da2d700 1 -- 172.21.15.44:0/3105596232 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7958165590 con 0x7f7958160eb0 2024-09-13T18:36:17.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.983+0000 7f79557fa700 1 -- 172.21.15.44:0/3105596232 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16513 (secure 0 0 0) 0x7f79480554e0 con 0x7f7958160eb0 2024-09-13T18:36:17.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:17.991 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":89,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:36:17.640270+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:36:15.982954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T18:36:16.628264+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:17.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.983+0000 7f795da2d700 1 -- 172.21.15.44:0/3105596232 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7938066730 msgr2=0x7f7938068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.983+0000 7f795da2d700 1 --2- 172.21.15.44:0/3105596232 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7938066730 0x7f7938068bf0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f79400011e0 tx=0x7f7940009040 comp rx=0 tx=0).stop 2024-09-13T18:36:17.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.983+0000 7f795da2d700 1 -- 172.21.15.44:0/3105596232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7958160eb0 msgr2=0x7f79580b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.983+0000 7f795da2d700 1 --2- 172.21.15.44:0/3105596232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7958160eb0 0x7f79580b2360 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f794800efc0 tx=0x7f794800c3a0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.983+0000 7f795da2d700 1 -- 172.21.15.44:0/3105596232 shutdown_connections 2024-09-13T18:36:17.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.983+0000 7f795da2d700 1 --2- 172.21.15.44:0/3105596232 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7938066730 0x7f7938068bf0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.983+0000 7f795da2d700 1 --2- 172.21.15.44:0/3105596232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7958161290 0x7f79581f93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.983+0000 7f795da2d700 1 --2- 172.21.15.44:0/3105596232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7958160eb0 0x7f79580b2360 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.983+0000 7f795da2d700 1 --2- 172.21.15.44:0/3105596232 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79580b3ae0 0x7f79580a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.983+0000 7f795da2d700 1 -- 172.21.15.44:0/3105596232 >> 172.21.15.44:0/3105596232 conn(0x7f79580b0f00 msgr2=0x7f79580af7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:17.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.983+0000 7f795da2d700 1 -- 172.21.15.44:0/3105596232 shutdown_connections 2024-09-13T18:36:17.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:17.983+0000 7f795da2d700 1 -- 172.21.15.44:0/3105596232 wait complete. 2024-09-13T18:36:18.010 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:18.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.119+0000 7f927743b700 1 Processor -- start 2024-09-13T18:36:18.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.119+0000 7f927743b700 1 -- start start 2024-09-13T18:36:18.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.119+0000 7f927743b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92700cede0 0x7f927006a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.119+0000 7f927743b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f927006aa60 0x7f92700d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.119+0000 7f927743b700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92700d0a60 con 0x7f9270160f30 2024-09-13T18:36:18.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.119+0000 7f927743b700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927006af10 con 0x7f927006aa60 2024-09-13T18:36:18.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.119+0000 7f927743b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92700cde10 con 0x7f92700cede0 2024-09-13T18:36:18.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.119+0000 7f9276439700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9270160f30 0x7f927006c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54820/0 (socket says 172.21.15.44:54820) 2024-09-13T18:36:18.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.119+0000 7f9276439700 1 -- 172.21.15.44:0/465218004 learned_addr learned my addr 172.21.15.44:0/465218004 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:18.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.119+0000 7f9276c3a700 1 --2- 172.21.15.44:0/465218004 >> v2:172.21.15.44:3300/0 conn(0x7f927006aa60 0x7f92700d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.119+0000 7f9275c38700 1 --2- 172.21.15.44:0/465218004 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92700cede0 0x7f927006a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.123+0000 7f9276c3a700 1 -- 172.21.15.44:0/465218004 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92700cede0 msgr2=0x7f927006a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:18.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.123+0000 7f9276c3a700 1 --2- 172.21.15.44:0/465218004 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92700cede0 0x7f927006a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.123+0000 7f9276c3a700 1 -- 172.21.15.44:0/465218004 >> v1:172.21.15.44:6789/0 conn(0x7f9270160f30 legacy=0x7f927006c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.123+0000 7f9276c3a700 1 -- 172.21.15.44:0/465218004 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92700ce0f0 con 0x7f927006aa60 2024-09-13T18:36:18.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.123+0000 7f9276c3a700 1 --2- 172.21.15.44:0/465218004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f927006aa60 0x7f92700d0ef0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f9268009850 tx=0x7f9268009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0bc7f616baf2db2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:18.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.123+0000 7f9275437700 1 -- 172.21.15.44:0/465218004 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268011830 con 0x7f927006aa60 2024-09-13T18:36:18.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.123+0000 7f9275437700 1 -- 172.21.15.44:0/465218004 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9268011990 con 0x7f927006aa60 2024-09-13T18:36:18.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.123+0000 7f9275437700 1 -- 172.21.15.44:0/465218004 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268011d40 con 0x7f927006aa60 2024-09-13T18:36:18.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.123+0000 7f927743b700 1 -- 172.21.15.44:0/465218004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f927006aa60 msgr2=0x7f92700d0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.123+0000 7f927743b700 1 --2- 172.21.15.44:0/465218004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f927006aa60 0x7f92700d0ef0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f9268009850 tx=0x7f9268009b60 comp rx=0 tx=0).stop 2024-09-13T18:36:18.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.123+0000 7f927743b700 1 -- 172.21.15.44:0/465218004 shutdown_connections 2024-09-13T18:36:18.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.123+0000 7f927743b700 1 --2- 172.21.15.44:0/465218004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f927006aa60 0x7f92700d0ef0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.123+0000 7f927743b700 1 --2- 172.21.15.44:0/465218004 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92700cede0 0x7f927006a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.123+0000 7f927743b700 1 -- 172.21.15.44:0/465218004 >> 172.21.15.44:0/465218004 conn(0x7f92700d2c80 msgr2=0x7f92700d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:18.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.123+0000 7f927743b700 1 -- 172.21.15.44:0/465218004 shutdown_connections 2024-09-13T18:36:18.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.123+0000 7f927743b700 1 -- 172.21.15.44:0/465218004 wait complete. 2024-09-13T18:36:18.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.127+0000 7f927743b700 1 Processor -- start 2024-09-13T18:36:18.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.127+0000 7f927743b700 1 -- start start 2024-09-13T18:36:18.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.127+0000 7f927743b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f927006aa60 0x7f9270163ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.127+0000 7f927743b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92700cede0 0x7f927015d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.127+0000 7f927743b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9270160f30 0x7f92700c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.127+0000 7f927743b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92700c8940 con 0x7f92700cede0 2024-09-13T18:36:18.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.127+0000 7f927743b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92700c7cc0 con 0x7f9270160f30 2024-09-13T18:36:18.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.127+0000 7f927743b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92700c7fa0 con 0x7f927006aa60 2024-09-13T18:36:18.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.127+0000 7f9275c38700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92700cede0 0x7f927015d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.127+0000 7f9275c38700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92700cede0 0x7f927015d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38104/0 (socket says 172.21.15.44:38104) 2024-09-13T18:36:18.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.127+0000 7f9275c38700 1 -- 172.21.15.44:0/2774848694 learned_addr learned my addr 172.21.15.44:0/2774848694 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:18.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.127+0000 7f9276439700 1 --2- 172.21.15.44:0/2774848694 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f927006aa60 0x7f9270163ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.127+0000 7f9276c3a700 1 --2- 172.21.15.44:0/2774848694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9270160f30 0x7f92700c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.131+0000 7f9276439700 1 -- 172.21.15.44:0/2774848694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9270160f30 msgr2=0x7f92700c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.131+0000 7f9276439700 1 --2- 172.21.15.44:0/2774848694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9270160f30 0x7f92700c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.131+0000 7f9276439700 1 -- 172.21.15.44:0/2774848694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92700cede0 msgr2=0x7f927015d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.131+0000 7f9276439700 1 --2- 172.21.15.44:0/2774848694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92700cede0 0x7f927015d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.131+0000 7f9276439700 1 -- 172.21.15.44:0/2774848694 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92680094b0 con 0x7f927006aa60 2024-09-13T18:36:18.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.131+0000 7f9275c38700 1 --2- 172.21.15.44:0/2774848694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92700cede0 0x7f927015d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:18.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.131+0000 7f9276439700 1 --2- 172.21.15.44:0/2774848694 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f927006aa60 0x7f9270163ec0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f926000caa0 tx=0x7f926000cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:18.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.131+0000 7f926effd700 1 -- 172.21.15.44:0/2774848694 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92600074e0 con 0x7f927006aa60 2024-09-13T18:36:18.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.131+0000 7f926effd700 1 -- 172.21.15.44:0/2774848694 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9260007640 con 0x7f927006aa60 2024-09-13T18:36:18.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.131+0000 7f927743b700 1 -- 172.21.15.44:0/2774848694 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92700c8280 con 0x7f927006aa60 2024-09-13T18:36:18.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.131+0000 7f926effd700 1 -- 172.21.15.44:0/2774848694 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92600079d0 con 0x7f927006aa60 2024-09-13T18:36:18.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.131+0000 7f927743b700 1 -- 172.21.15.44:0/2774848694 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9270164400 con 0x7f927006aa60 2024-09-13T18:36:18.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.131+0000 7f927743b700 1 -- 172.21.15.44:0/2774848694 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92700c8bb0 con 0x7f927006aa60 2024-09-13T18:36:18.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.131+0000 7f926effd700 1 -- 172.21.15.44:0/2774848694 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f926001c440 con 0x7f927006aa60 2024-09-13T18:36:18.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.135+0000 7f926effd700 1 --2- 172.21.15.44:0/2774848694 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9250066730 0x7f9250068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.135+0000 7f926effd700 1 -- 172.21.15.44:0/2774848694 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9260083f60 con 0x7f927006aa60 2024-09-13T18:36:18.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.135+0000 7f9275c38700 1 --2- 172.21.15.44:0/2774848694 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9250066730 0x7f9250068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.135+0000 7f9275c38700 1 --2- 172.21.15.44:0/2774848694 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9250066730 0x7f9250068bf0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f92701605a0 tx=0x7f9258009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:18.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.143+0000 7f926effd700 1 -- 172.21.15.44:0/2774848694 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f92600512e0 con 0x7f927006aa60 2024-09-13T18:36:18.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.323+0000 7f927743b700 1 -- 172.21.15.44:0/2774848694 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9270161d10 con 0x7f927006aa60 2024-09-13T18:36:18.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.323+0000 7f926effd700 1 -- 172.21.15.44:0/2774848694 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16513 (secure 0 0 0) 0x7f9260017020 con 0x7f927006aa60 2024-09-13T18:36:18.332 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:18.332 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":89,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:36:17.640270+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:36:15.982954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T18:36:16.628264+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:18.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.327+0000 7f927743b700 1 -- 172.21.15.44:0/2774848694 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9250066730 msgr2=0x7f9250068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.327+0000 7f927743b700 1 --2- 172.21.15.44:0/2774848694 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9250066730 0x7f9250068bf0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f92701605a0 tx=0x7f9258009240 comp rx=0 tx=0).stop 2024-09-13T18:36:18.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.327+0000 7f927743b700 1 -- 172.21.15.44:0/2774848694 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f927006aa60 msgr2=0x7f9270163ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.327+0000 7f927743b700 1 --2- 172.21.15.44:0/2774848694 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f927006aa60 0x7f9270163ec0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f926000caa0 tx=0x7f926000cad0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.327+0000 7f927743b700 1 -- 172.21.15.44:0/2774848694 shutdown_connections 2024-09-13T18:36:18.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.327+0000 7f927743b700 1 --2- 172.21.15.44:0/2774848694 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9250066730 0x7f9250068bf0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.327+0000 7f927743b700 1 --2- 172.21.15.44:0/2774848694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9270160f30 0x7f92700c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.327+0000 7f927743b700 1 --2- 172.21.15.44:0/2774848694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92700cede0 0x7f927015d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.327+0000 7f927743b700 1 --2- 172.21.15.44:0/2774848694 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f927006aa60 0x7f9270163ec0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.327+0000 7f927743b700 1 -- 172.21.15.44:0/2774848694 >> 172.21.15.44:0/2774848694 conn(0x7f92700d2c80 msgr2=0x7f9270165310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:18.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.327+0000 7f927743b700 1 -- 172.21.15.44:0/2774848694 shutdown_connections 2024-09-13T18:36:18.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.327+0000 7f927743b700 1 -- 172.21.15.44:0/2774848694 wait complete. 2024-09-13T18:36:18.353 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:36:18.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.467+0000 7f2be6df3700 1 Processor -- start 2024-09-13T18:36:18.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.467+0000 7f2be6df3700 1 -- start start 2024-09-13T18:36:18.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.467+0000 7f2be6df3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2be00cd4d0 0x7f2be006dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.467+0000 7f2be6df3700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2be00cd8b0 0x7f2be015b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.467+0000 7f2be6df3700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be0158df0 con 0x7f2be015bc60 2024-09-13T18:36:18.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.467+0000 7f2be6df3700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be006ee60 con 0x7f2be00cd8b0 2024-09-13T18:36:18.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.467+0000 7f2be6df3700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be006e5c0 con 0x7f2be00cd4d0 2024-09-13T18:36:18.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.467+0000 7f2be55f0700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2be00cd8b0 0x7f2be015b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.467+0000 7f2be65f2700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2be015bc60 0x7f2be015e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54826/0 (socket says 172.21.15.44:54826) 2024-09-13T18:36:18.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.467+0000 7f2be65f2700 1 -- 172.21.15.44:0/768073746 learned_addr learned my addr 172.21.15.44:0/768073746 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:18.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.467+0000 7f2be5df1700 1 --2- 172.21.15.44:0/768073746 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2be00cd4d0 0x7f2be006dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.467+0000 7f2be55f0700 1 -- 172.21.15.44:0/768073746 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2be00cd4d0 msgr2=0x7f2be006dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:18.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.467+0000 7f2be55f0700 1 --2- 172.21.15.44:0/768073746 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2be00cd4d0 0x7f2be006dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.467+0000 7f2be55f0700 1 -- 172.21.15.44:0/768073746 >> v1:172.21.15.44:6789/0 conn(0x7f2be015bc60 legacy=0x7f2be015e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.467+0000 7f2be4def700 1 -- 172.21.15.44:0/768073746 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247920796 0 0) 0x7f2be0158df0 con 0x7f2be015bc60 2024-09-13T18:36:18.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.467+0000 7f2be55f0700 1 -- 172.21.15.44:0/768073746 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be006e8a0 con 0x7f2be00cd8b0 2024-09-13T18:36:18.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.471+0000 7f2be55f0700 1 --2- 172.21.15.44:0/768073746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2be00cd8b0 0x7f2be015b720 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc009850 tx=0x7f2bdc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf65f0107d75466 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:18.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.471+0000 7f2be4def700 1 -- 172.21.15.44:0/768073746 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc011830 con 0x7f2be00cd8b0 2024-09-13T18:36:18.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.471+0000 7f2be4def700 1 -- 172.21.15.44:0/768073746 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bdc011990 con 0x7f2be00cd8b0 2024-09-13T18:36:18.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.471+0000 7f2be4def700 1 -- 172.21.15.44:0/768073746 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc011d40 con 0x7f2be00cd8b0 2024-09-13T18:36:18.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.471+0000 7f2be6df3700 1 -- 172.21.15.44:0/768073746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2be00cd8b0 msgr2=0x7f2be015b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.471+0000 7f2be6df3700 1 --2- 172.21.15.44:0/768073746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2be00cd8b0 0x7f2be015b720 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc009850 tx=0x7f2bdc009b60 comp rx=0 tx=0).stop 2024-09-13T18:36:18.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.471+0000 7f2be6df3700 1 -- 172.21.15.44:0/768073746 shutdown_connections 2024-09-13T18:36:18.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.471+0000 7f2be6df3700 1 --2- 172.21.15.44:0/768073746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2be00cd8b0 0x7f2be015b720 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.471+0000 7f2be6df3700 1 --2- 172.21.15.44:0/768073746 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2be00cd4d0 0x7f2be006dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.471+0000 7f2be6df3700 1 -- 172.21.15.44:0/768073746 >> 172.21.15.44:0/768073746 conn(0x7f2be006a310 msgr2=0x7f2be006a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:18.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.471+0000 7f2be6df3700 1 -- 172.21.15.44:0/768073746 shutdown_connections 2024-09-13T18:36:18.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.471+0000 7f2be6df3700 1 -- 172.21.15.44:0/768073746 wait complete. 2024-09-13T18:36:18.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2be6df3700 1 Processor -- start 2024-09-13T18:36:18.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2be6df3700 1 -- start start 2024-09-13T18:36:18.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2be6df3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2be00cd4d0 0x7f2be0155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2be6df3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2be00cd8b0 0x7f2be00b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2be6df3700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2be015bc60 0x7f2be014a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2be6df3700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be01e6910 con 0x7f2be00cd4d0 2024-09-13T18:36:18.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2be6df3700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be01e5800 con 0x7f2be015bc60 2024-09-13T18:36:18.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2be6df3700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be00b4270 con 0x7f2be00cd8b0 2024-09-13T18:36:18.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2be5df1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2be00cd4d0 0x7f2be0155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2be5df1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2be00cd4d0 0x7f2be0155620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38120/0 (socket says 172.21.15.44:38120) 2024-09-13T18:36:18.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2be5df1700 1 -- 172.21.15.44:0/3827340239 learned_addr learned my addr 172.21.15.44:0/3827340239 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:18.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2be65f2700 1 --2- 172.21.15.44:0/3827340239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2be015bc60 0x7f2be014a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2be55f0700 1 --2- 172.21.15.44:0/3827340239 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2be00cd8b0 0x7f2be00b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2be5df1700 1 -- 172.21.15.44:0/3827340239 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2be00cd8b0 msgr2=0x7f2be00b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2be5df1700 1 --2- 172.21.15.44:0/3827340239 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2be00cd8b0 0x7f2be00b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2be5df1700 1 -- 172.21.15.44:0/3827340239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2be015bc60 msgr2=0x7f2be014a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2be5df1700 1 --2- 172.21.15.44:0/3827340239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2be015bc60 0x7f2be014a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2be5df1700 1 -- 172.21.15.44:0/3827340239 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc0094b0 con 0x7f2be00cd4d0 2024-09-13T18:36:18.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2be65f2700 1 --2- 172.21.15.44:0/3827340239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2be015bc60 0x7f2be014a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:18.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2be5df1700 1 --2- 172.21.15.44:0/3827340239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2be00cd4d0 0x7f2be0155620 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f2bd400e840 tx=0x7f2bd400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:18.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2bd27fc700 1 -- 172.21.15.44:0/3827340239 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40095a0 con 0x7f2be00cd4d0 2024-09-13T18:36:18.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2bd27fc700 1 -- 172.21.15.44:0/3827340239 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd400c690 con 0x7f2be00cd4d0 2024-09-13T18:36:18.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2be6df3700 1 -- 172.21.15.44:0/3827340239 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be00b4550 con 0x7f2be00cd4d0 2024-09-13T18:36:18.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2bd27fc700 1 -- 172.21.15.44:0/3827340239 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd400ca00 con 0x7f2be00cd4d0 2024-09-13T18:36:18.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.475+0000 7f2be6df3700 1 -- 172.21.15.44:0/3827340239 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be00b4b10 con 0x7f2be00cd4d0 2024-09-13T18:36:18.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.479+0000 7f2be6df3700 1 -- 172.21.15.44:0/3827340239 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be015b720 con 0x7f2be00cd4d0 2024-09-13T18:36:18.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.479+0000 7f2bd27fc700 1 -- 172.21.15.44:0/3827340239 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2bd400cbe0 con 0x7f2be00cd4d0 2024-09-13T18:36:18.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.479+0000 7f2bd27fc700 1 --2- 172.21.15.44:0/3827340239 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2bc4066730 0x7f2bc4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.479+0000 7f2bd27fc700 1 -- 172.21.15.44:0/3827340239 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2bd40840f0 con 0x7f2be00cd4d0 2024-09-13T18:36:18.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.479+0000 7f2be55f0700 1 --2- 172.21.15.44:0/3827340239 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2bc4066730 0x7f2bc4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.479+0000 7f2be55f0700 1 --2- 172.21.15.44:0/3827340239 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2bc4066730 0x7f2bc4068bf0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc009850 tx=0x7f2bdc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:18.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.487+0000 7f2bd27fc700 1 -- 172.21.15.44:0/3827340239 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2bd40514d0 con 0x7f2be00cd4d0 2024-09-13T18:36:18.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:18.695+0000 7f2be6df3700 1 -- 172.21.15.44:0/3827340239 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2be00cc960 con 0x7f2be00cd4d0 2024-09-13T18:36:19.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.663+0000 7f2bd27fc700 1 -- 172.21.15.44:0/3827340239 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v77) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2bd4054af0 con 0x7f2be00cd4d0 2024-09-13T18:36:19.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.667+0000 7f2be6df3700 1 -- 172.21.15.44:0/3827340239 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2bc4066730 msgr2=0x7f2bc4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:19.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.667+0000 7f2be6df3700 1 --2- 172.21.15.44:0/3827340239 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2bc4066730 0x7f2bc4068bf0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc009850 tx=0x7f2bdc008030 comp rx=0 tx=0).stop 2024-09-13T18:36:19.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.667+0000 7f2be6df3700 1 -- 172.21.15.44:0/3827340239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2be00cd4d0 msgr2=0x7f2be0155620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:19.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.667+0000 7f2be6df3700 1 --2- 172.21.15.44:0/3827340239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2be00cd4d0 0x7f2be0155620 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f2bd400e840 tx=0x7f2bd400ec00 comp rx=0 tx=0).stop 2024-09-13T18:36:19.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.667+0000 7f2be6df3700 1 -- 172.21.15.44:0/3827340239 shutdown_connections 2024-09-13T18:36:19.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.667+0000 7f2be6df3700 1 --2- 172.21.15.44:0/3827340239 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2bc4066730 0x7f2bc4068bf0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.667+0000 7f2be6df3700 1 --2- 172.21.15.44:0/3827340239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2be015bc60 0x7f2be014a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.667+0000 7f2be6df3700 1 --2- 172.21.15.44:0/3827340239 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2be00cd8b0 0x7f2be00b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.667+0000 7f2be6df3700 1 --2- 172.21.15.44:0/3827340239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2be00cd4d0 0x7f2be0155620 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.667+0000 7f2be6df3700 1 -- 172.21.15.44:0/3827340239 >> 172.21.15.44:0/3827340239 conn(0x7f2be006a310 msgr2=0x7f2be00cff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:19.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.667+0000 7f2be6df3700 1 -- 172.21.15.44:0/3827340239 shutdown_connections 2024-09-13T18:36:19.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.667+0000 7f2be6df3700 1 -- 172.21.15.44:0/3827340239 wait complete. 2024-09-13T18:36:19.691 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:36:19.691 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:36:19.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.811+0000 7f62e7fff700 1 Processor -- start 2024-09-13T18:36:19.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.811+0000 7f62e7fff700 1 -- start start 2024-09-13T18:36:19.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e7fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f62e815cda0 0x7f62e806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:19.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e7fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f62e806a520 0x7f62e806a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:19.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e7fff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e80b8430 con 0x7f62e80ceb70 2024-09-13T18:36:19.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e7fff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e806be40 con 0x7f62e815cda0 2024-09-13T18:36:19.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e7fff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e80b64f0 con 0x7f62e806a520 2024-09-13T18:36:19.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e6ffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f62e815cda0 0x7f62e806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:19.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62de7fc700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f62e80ceb70 0x7f62e80b5de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54832/0 (socket says 172.21.15.44:54832) 2024-09-13T18:36:19.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62de7fc700 1 -- 172.21.15.44:0/1514466086 learned_addr learned my addr 172.21.15.44:0/1514466086 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:19.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e77fe700 1 --2- 172.21.15.44:0/1514466086 >> v2:172.21.15.99:3300/0 conn(0x7f62e806a520 0x7f62e806a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:19.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e67fc700 1 -- 172.21.15.44:0/1514466086 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945573155 0 0) 0x7f62e80b8430 con 0x7f62e80ceb70 2024-09-13T18:36:19.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e67fc700 1 -- 172.21.15.44:0/1514466086 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62c80035d0 con 0x7f62e80ceb70 2024-09-13T18:36:19.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e6ffd700 1 -- 172.21.15.44:0/1514466086 >> v2:172.21.15.99:3300/0 conn(0x7f62e806a520 msgr2=0x7f62e806a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:19.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e6ffd700 1 --2- 172.21.15.44:0/1514466086 >> v2:172.21.15.99:3300/0 conn(0x7f62e806a520 0x7f62e806a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e6ffd700 1 -- 172.21.15.44:0/1514466086 >> v1:172.21.15.44:6789/0 conn(0x7f62e80ceb70 legacy=0x7f62e80b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:19.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e6ffd700 1 -- 172.21.15.44:0/1514466086 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e806ae70 con 0x7f62e815cda0 2024-09-13T18:36:19.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e6ffd700 1 --2- 172.21.15.44:0/1514466086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62e815cda0 0x7f62e806b900 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f62e80d2c60 tx=0x7f62d8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a8af1a4c5e3576 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:19.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e67fc700 1 -- 172.21.15.44:0/1514466086 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d8011830 con 0x7f62e815cda0 2024-09-13T18:36:19.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e67fc700 1 -- 172.21.15.44:0/1514466086 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d8011990 con 0x7f62e815cda0 2024-09-13T18:36:19.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e67fc700 1 -- 172.21.15.44:0/1514466086 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d8011d20 con 0x7f62e815cda0 2024-09-13T18:36:19.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e7fff700 1 -- 172.21.15.44:0/1514466086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62e815cda0 msgr2=0x7f62e806b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:19.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e7fff700 1 --2- 172.21.15.44:0/1514466086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62e815cda0 0x7f62e806b900 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f62e80d2c60 tx=0x7f62d8009b30 comp rx=0 tx=0).stop 2024-09-13T18:36:19.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e7fff700 1 -- 172.21.15.44:0/1514466086 shutdown_connections 2024-09-13T18:36:19.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e7fff700 1 --2- 172.21.15.44:0/1514466086 >> v2:172.21.15.99:3300/0 conn(0x7f62e806a520 0x7f62e806a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e7fff700 1 --2- 172.21.15.44:0/1514466086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62e815cda0 0x7f62e806b900 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e7fff700 1 -- 172.21.15.44:0/1514466086 >> 172.21.15.44:0/1514466086 conn(0x7f62e80d2cb0 msgr2=0x7f62e80d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:19.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e7fff700 1 -- 172.21.15.44:0/1514466086 shutdown_connections 2024-09-13T18:36:19.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.815+0000 7f62e7fff700 1 -- 172.21.15.44:0/1514466086 wait complete. 2024-09-13T18:36:19.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.819+0000 7f62e7fff700 1 Processor -- start 2024-09-13T18:36:19.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.819+0000 7f62e7fff700 1 -- start start 2024-09-13T18:36:19.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.819+0000 7f62e7fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f62e806a520 0x7f62e81f6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:19.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.819+0000 7f62e7fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62e80ceb70 0x7f62e80c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:19.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.819+0000 7f62e7fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62e815cda0 0x7f62e80c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:19.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.819+0000 7f62e7fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e80c8700 con 0x7f62e815cda0 2024-09-13T18:36:19.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.819+0000 7f62e7fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e80c89e0 con 0x7f62e80ceb70 2024-09-13T18:36:19.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.819+0000 7f62e7fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e80c8cc0 con 0x7f62e806a520 2024-09-13T18:36:19.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.819+0000 7f62e77fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62e815cda0 0x7f62e80c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:19.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.819+0000 7f62e6ffd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f62e806a520 0x7f62e81f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:19.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.823+0000 7f62de7fc700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62e80ceb70 0x7f62e80c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:19.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.823+0000 7f62e77fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62e815cda0 0x7f62e80c67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38128/0 (socket says 172.21.15.44:38128) 2024-09-13T18:36:19.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.823+0000 7f62e6ffd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f62e806a520 0x7f62e81f6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:52062/0 (socket says 172.21.15.44:52062) 2024-09-13T18:36:19.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.823+0000 7f62e77fe700 1 -- 172.21.15.44:0/2908273235 learned_addr learned my addr 172.21.15.44:0/2908273235 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:19.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.823+0000 7f62e77fe700 1 -- 172.21.15.44:0/2908273235 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f62e806a520 msgr2=0x7f62e81f6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:19.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.823+0000 7f62e77fe700 1 --2- 172.21.15.44:0/2908273235 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f62e806a520 0x7f62e81f6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.823+0000 7f62e77fe700 1 -- 172.21.15.44:0/2908273235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62e80ceb70 msgr2=0x7f62e80c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:19.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.823+0000 7f62e77fe700 1 --2- 172.21.15.44:0/2908273235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62e80ceb70 0x7f62e80c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.823+0000 7f62e77fe700 1 -- 172.21.15.44:0/2908273235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d80094b0 con 0x7f62e815cda0 2024-09-13T18:36:19.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.823+0000 7f62de7fc700 1 --2- 172.21.15.44:0/2908273235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62e80ceb70 0x7f62e80c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:19.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.823+0000 7f62e77fe700 1 --2- 172.21.15.44:0/2908273235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62e815cda0 0x7f62e80c67b0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f62e000efc0 tx=0x7f62e000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:19.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.823+0000 7f62dffff700 1 -- 172.21.15.44:0/2908273235 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e0009ea0 con 0x7f62e815cda0 2024-09-13T18:36:19.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.823+0000 7f62dffff700 1 -- 172.21.15.44:0/2908273235 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e000f040 con 0x7f62e815cda0 2024-09-13T18:36:19.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.823+0000 7f62dffff700 1 -- 172.21.15.44:0/2908273235 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e000ced0 con 0x7f62e815cda0 2024-09-13T18:36:19.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.823+0000 7f62e7fff700 1 -- 172.21.15.44:0/2908273235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e80c8fa0 con 0x7f62e815cda0 2024-09-13T18:36:19.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.823+0000 7f62e7fff700 1 -- 172.21.15.44:0/2908273235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e80c6cf0 con 0x7f62e815cda0 2024-09-13T18:36:19.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.823+0000 7f62e7fff700 1 -- 172.21.15.44:0/2908273235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e80c91c0 con 0x7f62e815cda0 2024-09-13T18:36:19.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.827+0000 7f62dffff700 1 -- 172.21.15.44:0/2908273235 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f62e0014480 con 0x7f62e815cda0 2024-09-13T18:36:19.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.827+0000 7f62dffff700 1 --2- 172.21.15.44:0/2908273235 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f62cc066760 0x7f62cc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:19.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.827+0000 7f62dffff700 1 -- 172.21.15.44:0/2908273235 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62e00849b0 con 0x7f62e815cda0 2024-09-13T18:36:19.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.827+0000 7f62e6ffd700 1 --2- 172.21.15.44:0/2908273235 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f62cc066760 0x7f62cc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:19.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.827+0000 7f62e6ffd700 1 --2- 172.21.15.44:0/2908273235 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f62cc066760 0x7f62cc068c20 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f62d80090b0 tx=0x7f62d8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:19.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:19.835+0000 7f62dffff700 1 -- 172.21.15.44:0/2908273235 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f62e0051d30 con 0x7f62e815cda0 2024-09-13T18:36:20.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.039+0000 7f62e7fff700 1 -- 172.21.15.44:0/2908273235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f62e80d1120 con 0x7f62e815cda0 2024-09-13T18:36:20.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.663+0000 7f62dffff700 1 -- 172.21.15.44:0/2908273235 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v78) v1 ==== 122+0+0 (secure 0 0 0) 0x7f62e0018020 con 0x7f62e815cda0 2024-09-13T18:36:20.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.671+0000 7f62e7fff700 1 -- 172.21.15.44:0/2908273235 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f62cc066760 msgr2=0x7f62cc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:20.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.671+0000 7f62e7fff700 1 --2- 172.21.15.44:0/2908273235 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f62cc066760 0x7f62cc068c20 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f62d80090b0 tx=0x7f62d8008030 comp rx=0 tx=0).stop 2024-09-13T18:36:20.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.671+0000 7f62e7fff700 1 -- 172.21.15.44:0/2908273235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62e815cda0 msgr2=0x7f62e80c67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:20.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.671+0000 7f62e7fff700 1 --2- 172.21.15.44:0/2908273235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62e815cda0 0x7f62e80c67b0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f62e000efc0 tx=0x7f62e000c3a0 comp rx=0 tx=0).stop 2024-09-13T18:36:20.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.671+0000 7f62e7fff700 1 -- 172.21.15.44:0/2908273235 shutdown_connections 2024-09-13T18:36:20.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.671+0000 7f62e7fff700 1 --2- 172.21.15.44:0/2908273235 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f62cc066760 0x7f62cc068c20 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:20.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.671+0000 7f62e7fff700 1 --2- 172.21.15.44:0/2908273235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62e815cda0 0x7f62e80c67b0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:20.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.671+0000 7f62e7fff700 1 --2- 172.21.15.44:0/2908273235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62e80ceb70 0x7f62e80c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:20.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.671+0000 7f62e7fff700 1 --2- 172.21.15.44:0/2908273235 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f62e806a520 0x7f62e81f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:20.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.671+0000 7f62e7fff700 1 -- 172.21.15.44:0/2908273235 >> 172.21.15.44:0/2908273235 conn(0x7f62e80d2cb0 msgr2=0x7f62e806b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:20.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.671+0000 7f62e7fff700 1 -- 172.21.15.44:0/2908273235 shutdown_connections 2024-09-13T18:36:20.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.671+0000 7f62e7fff700 1 -- 172.21.15.44:0/2908273235 wait complete. 2024-09-13T18:36:20.697 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:36:20.697 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:36:20.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.811+0000 7fd889507700 1 Processor -- start 2024-09-13T18:36:20.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.811+0000 7fd889507700 1 -- start start 2024-09-13T18:36:20.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.811+0000 7fd889507700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd88415cae0 0x7fd8840cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:20.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.811+0000 7fd889507700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd88415cec0 0x7fd8840d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:20.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.811+0000 7fd889507700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd88406ac00 0x7fd88406b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:20.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.811+0000 7fd889507700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8840d1750 con 0x7fd88415cae0 2024-09-13T18:36:20.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.811+0000 7fd889507700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88406b590 con 0x7fd88406ac00 2024-09-13T18:36:20.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.811+0000 7fd889507700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8840d21e0 con 0x7fd88415cec0 2024-09-13T18:36:20.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.811+0000 7fd883fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd88415cae0 0x7fd8840cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:20.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.815+0000 7fd883fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd88415cae0 0x7fd8840cf030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38132/0 (socket says 172.21.15.44:38132) 2024-09-13T18:36:20.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.815+0000 7fd883fff700 1 -- 172.21.15.44:0/3432735266 learned_addr learned my addr 172.21.15.44:0/3432735266 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:20.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.815+0000 7fd888d06700 1 --2- 172.21.15.44:0/3432735266 >> v2:172.21.15.99:3300/0 conn(0x7fd88406ac00 0x7fd88406b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:20.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.815+0000 7fd87bfff700 1 --2- 172.21.15.44:0/3432735266 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd88415cec0 0x7fd8840d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:20.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.815+0000 7fd883fff700 1 -- 172.21.15.44:0/3432735266 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd88415cec0 msgr2=0x7fd8840d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:20.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.815+0000 7fd883fff700 1 --2- 172.21.15.44:0/3432735266 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd88415cec0 0x7fd8840d1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:20.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.815+0000 7fd883fff700 1 -- 172.21.15.44:0/3432735266 >> v2:172.21.15.99:3300/0 conn(0x7fd88406ac00 msgr2=0x7fd88406b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:20.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.815+0000 7fd883fff700 1 --2- 172.21.15.44:0/3432735266 >> v2:172.21.15.99:3300/0 conn(0x7fd88406ac00 0x7fd88406b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:20.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.815+0000 7fd883fff700 1 -- 172.21.15.44:0/3432735266 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8840d1940 con 0x7fd88415cae0 2024-09-13T18:36:20.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.815+0000 7fd888d06700 1 --2- 172.21.15.44:0/3432735266 >> v2:172.21.15.99:3300/0 conn(0x7fd88406ac00 0x7fd88406b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:20.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.815+0000 7fd883fff700 1 --2- 172.21.15.44:0/3432735266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd88415cae0 0x7fd8840cf030 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fd8840cd260 tx=0x7fd874009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599d1bc2cca031e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:20.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.815+0000 7fd8837fe700 1 -- 172.21.15.44:0/3432735266 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874011830 con 0x7fd88415cae0 2024-09-13T18:36:20.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.815+0000 7fd8837fe700 1 -- 172.21.15.44:0/3432735266 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd874011990 con 0x7fd88415cae0 2024-09-13T18:36:20.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.815+0000 7fd8837fe700 1 -- 172.21.15.44:0/3432735266 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874011d20 con 0x7fd88415cae0 2024-09-13T18:36:20.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.815+0000 7fd889507700 1 -- 172.21.15.44:0/3432735266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd88415cae0 msgr2=0x7fd8840cf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:20.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.815+0000 7fd889507700 1 --2- 172.21.15.44:0/3432735266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd88415cae0 0x7fd8840cf030 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fd8840cd260 tx=0x7fd874009bf0 comp rx=0 tx=0).stop 2024-09-13T18:36:20.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.815+0000 7fd889507700 1 -- 172.21.15.44:0/3432735266 shutdown_connections 2024-09-13T18:36:20.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.815+0000 7fd889507700 1 --2- 172.21.15.44:0/3432735266 >> v2:172.21.15.99:3300/0 conn(0x7fd88406ac00 0x7fd88406b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:20.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.815+0000 7fd889507700 1 --2- 172.21.15.44:0/3432735266 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd88415cec0 0x7fd8840d1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:20.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.815+0000 7fd889507700 1 --2- 172.21.15.44:0/3432735266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd88415cae0 0x7fd8840cf030 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:20.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.815+0000 7fd889507700 1 -- 172.21.15.44:0/3432735266 >> 172.21.15.44:0/3432735266 conn(0x7fd8840d2c80 msgr2=0x7fd8840d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:20.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.815+0000 7fd889507700 1 -- 172.21.15.44:0/3432735266 shutdown_connections 2024-09-13T18:36:20.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.815+0000 7fd889507700 1 -- 172.21.15.44:0/3432735266 wait complete. 2024-09-13T18:36:20.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.819+0000 7fd889507700 1 Processor -- start 2024-09-13T18:36:20.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.819+0000 7fd889507700 1 -- start start 2024-09-13T18:36:20.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.819+0000 7fd889507700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd88406ac00 0x7fd88414bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:20.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.819+0000 7fd889507700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd88415cae0 0x7fd88415ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:20.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.819+0000 7fd889507700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd88415cec0 0x7fd8840a95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:20.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.819+0000 7fd889507700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88414c880 con 0x7fd88415cae0 2024-09-13T18:36:20.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.819+0000 7fd889507700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88415fc30 con 0x7fd88406ac00 2024-09-13T18:36:20.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.819+0000 7fd889507700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88415f670 con 0x7fd88415cec0 2024-09-13T18:36:20.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.819+0000 7fd87bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd88415cae0 0x7fd88415ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:20.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.819+0000 7fd87bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd88415cae0 0x7fd88415ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38148/0 (socket says 172.21.15.44:38148) 2024-09-13T18:36:20.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.819+0000 7fd87bfff700 1 -- 172.21.15.44:0/87920155 learned_addr learned my addr 172.21.15.44:0/87920155 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:20.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.819+0000 7fd883fff700 1 --2- 172.21.15.44:0/87920155 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd88406ac00 0x7fd88414bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:20.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.819+0000 7fd888d06700 1 --2- 172.21.15.44:0/87920155 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd88415cec0 0x7fd8840a95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.819+0000 7fd87bfff700 1 -- 172.21.15.44:0/87920155 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd88415cec0 msgr2=0x7fd8840a95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.819+0000 7fd87bfff700 1 --2- 172.21.15.44:0/87920155 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd88415cec0 0x7fd8840a95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.819+0000 7fd87bfff700 1 -- 172.21.15.44:0/87920155 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd88406ac00 msgr2=0x7fd88414bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.819+0000 7fd87bfff700 1 --2- 172.21.15.44:0/87920155 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd88406ac00 0x7fd88414bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.819+0000 7fd87bfff700 1 -- 172.21.15.44:0/87920155 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c009a70 con 0x7fd88415cae0 2024-09-13T18:36:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.823+0000 7fd87bfff700 1 --2- 172.21.15.44:0/87920155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd88415cae0 0x7fd88415ed00 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00e9d0 tx=0x7fd86c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:20.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.823+0000 7fd8817fa700 1 -- 172.21.15.44:0/87920155 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c009720 con 0x7fd88415cae0 2024-09-13T18:36:20.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.823+0000 7fd8817fa700 1 -- 172.21.15.44:0/87920155 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86c00ee60 con 0x7fd88415cae0 2024-09-13T18:36:20.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.823+0000 7fd889507700 1 -- 172.21.15.44:0/87920155 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd874009570 con 0x7fd88415cae0 2024-09-13T18:36:20.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.823+0000 7fd8817fa700 1 -- 172.21.15.44:0/87920155 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c00ca50 con 0x7fd88415cae0 2024-09-13T18:36:20.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.823+0000 7fd889507700 1 -- 172.21.15.44:0/87920155 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88414c4a0 con 0x7fd88415cae0 2024-09-13T18:36:20.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.823+0000 7fd889507700 1 -- 172.21.15.44:0/87920155 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd88414c9c0 con 0x7fd88415cae0 2024-09-13T18:36:20.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.823+0000 7fd8817fa700 1 -- 172.21.15.44:0/87920155 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd86c00cbb0 con 0x7fd88415cae0 2024-09-13T18:36:20.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.827+0000 7fd8817fa700 1 --2- 172.21.15.44:0/87920155 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd864066730 0x7fd864068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:20.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.827+0000 7fd8817fa700 1 -- 172.21.15.44:0/87920155 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd86c084430 con 0x7fd88415cae0 2024-09-13T18:36:20.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.827+0000 7fd883fff700 1 --2- 172.21.15.44:0/87920155 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd864066730 0x7fd864068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:20.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.827+0000 7fd883fff700 1 --2- 172.21.15.44:0/87920155 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd864066730 0x7fd864068bf0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd874000c00 tx=0x7fd874008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:20.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:20.831+0000 7fd8817fa700 1 -- 172.21.15.44:0/87920155 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd86c051830 con 0x7fd88415cae0 2024-09-13T18:36:21.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.039+0000 7fd889507700 1 -- 172.21.15.44:0/87920155 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd88406b050 con 0x7fd88415cae0 2024-09-13T18:36:21.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.039+0000 7fd8817fa700 1 -- 172.21.15.44:0/87920155 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4730 (secure 0 0 0) 0x7fd86c00ce60 con 0x7fd88415cae0 2024-09-13T18:36:21.049 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:21.049 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":78,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7121,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4127573228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4127573228},{"type":"v1","addr":"172.21.15.99:6836","nonce":4127573228}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":7984,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3372982355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3372982355},{"type":"v1","addr":"172.21.15.99:6837","nonce":3372982355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/48969097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":48969097},{"type":"v1","addr":"172.21.15.44:6833","nonce":48969097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:36:17.641055+0000","modified":"2024-09-13T18:36:20.660692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8193":{"gid":8193,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/1527182738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1527182738},{"type":"v1","addr":"172.21.15.44:6835","nonce":1527182738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:36:21.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.043+0000 7fd889507700 1 -- 172.21.15.44:0/87920155 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd864066730 msgr2=0x7fd864068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.043+0000 7fd889507700 1 --2- 172.21.15.44:0/87920155 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd864066730 0x7fd864068bf0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd874000c00 tx=0x7fd874008030 comp rx=0 tx=0).stop 2024-09-13T18:36:21.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.043+0000 7fd889507700 1 -- 172.21.15.44:0/87920155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd88415cae0 msgr2=0x7fd88415ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.043+0000 7fd889507700 1 --2- 172.21.15.44:0/87920155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd88415cae0 0x7fd88415ed00 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00e9d0 tx=0x7fd86c00ece0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.043+0000 7fd889507700 1 -- 172.21.15.44:0/87920155 shutdown_connections 2024-09-13T18:36:21.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.043+0000 7fd889507700 1 --2- 172.21.15.44:0/87920155 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd864066730 0x7fd864068bf0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.043+0000 7fd889507700 1 --2- 172.21.15.44:0/87920155 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd88415cec0 0x7fd8840a95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.043+0000 7fd889507700 1 --2- 172.21.15.44:0/87920155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd88415cae0 0x7fd88415ed00 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.043+0000 7fd889507700 1 --2- 172.21.15.44:0/87920155 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd88406ac00 0x7fd88414bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.043+0000 7fd889507700 1 -- 172.21.15.44:0/87920155 >> 172.21.15.44:0/87920155 conn(0x7fd8840d2c80 msgr2=0x7fd8840d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:21.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.043+0000 7fd889507700 1 -- 172.21.15.44:0/87920155 shutdown_connections 2024-09-13T18:36:21.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.043+0000 7fd889507700 1 -- 172.21.15.44:0/87920155 wait complete. 2024-09-13T18:36:21.052 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 78 2024-09-13T18:36:21.064 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:21.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.171+0000 7ff587153700 1 Processor -- start 2024-09-13T18:36:21.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.171+0000 7ff587153700 1 -- start start 2024-09-13T18:36:21.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.171+0000 7ff587153700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff580160eb0 0x7ff580165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.171+0000 7ff587153700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff5800b33d0 0x7ff5800b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.171+0000 7ff587153700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff580161290 0x7ff580161740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.171+0000 7ff587153700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5800b3d30 con 0x7ff580161290 2024-09-13T18:36:21.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.171+0000 7ff587153700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff580071f30 con 0x7ff580160eb0 2024-09-13T18:36:21.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.171+0000 7ff587153700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5801622e0 con 0x7ff5800b33d0 2024-09-13T18:36:21.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.171+0000 7ff586952700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff580161290 0x7ff580161740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.171+0000 7ff586952700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff580161290 0x7ff580161740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38156/0 (socket says 172.21.15.44:38156) 2024-09-13T18:36:21.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.171+0000 7ff586952700 1 -- 172.21.15.44:0/696744060 learned_addr learned my addr 172.21.15.44:0/696744060 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:21.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.171+0000 7ff585950700 1 --2- 172.21.15.44:0/696744060 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff5800b33d0 0x7ff5800b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.171+0000 7ff586151700 1 --2- 172.21.15.44:0/696744060 >> v2:172.21.15.99:3300/0 conn(0x7ff580160eb0 0x7ff580165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.171+0000 7ff586952700 1 -- 172.21.15.44:0/696744060 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff5800b33d0 msgr2=0x7ff5800b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:21.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.171+0000 7ff586952700 1 --2- 172.21.15.44:0/696744060 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff5800b33d0 0x7ff5800b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.171+0000 7ff586952700 1 -- 172.21.15.44:0/696744060 >> v2:172.21.15.99:3300/0 conn(0x7ff580160eb0 msgr2=0x7ff580165590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:21.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.171+0000 7ff586952700 1 --2- 172.21.15.44:0/696744060 >> v2:172.21.15.99:3300/0 conn(0x7ff580160eb0 0x7ff580165590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.171+0000 7ff586952700 1 -- 172.21.15.44:0/696744060 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff580162000 con 0x7ff580161290 2024-09-13T18:36:21.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.171+0000 7ff585950700 1 --2- 172.21.15.44:0/696744060 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff5800b33d0 0x7ff5800b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:21.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.175+0000 7ff586952700 1 --2- 172.21.15.44:0/696744060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff580161290 0x7ff580161740 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7ff5800b33a0 tx=0x7ff57800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b51bd23196bef91 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:21.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.175+0000 7ff58514f700 1 -- 172.21.15.44:0/696744060 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57800e070 con 0x7ff580161290 2024-09-13T18:36:21.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.175+0000 7ff58514f700 1 -- 172.21.15.44:0/696744060 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57800b910 con 0x7ff580161290 2024-09-13T18:36:21.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.175+0000 7ff58514f700 1 -- 172.21.15.44:0/696744060 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57800bcc0 con 0x7ff580161290 2024-09-13T18:36:21.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.175+0000 7ff587153700 1 -- 172.21.15.44:0/696744060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff580161290 msgr2=0x7ff580161740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.175+0000 7ff587153700 1 --2- 172.21.15.44:0/696744060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff580161290 0x7ff580161740 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7ff5800b33a0 tx=0x7ff57800b330 comp rx=0 tx=0).stop 2024-09-13T18:36:21.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.175+0000 7ff587153700 1 -- 172.21.15.44:0/696744060 shutdown_connections 2024-09-13T18:36:21.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.175+0000 7ff587153700 1 --2- 172.21.15.44:0/696744060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff580161290 0x7ff580161740 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.175+0000 7ff587153700 1 --2- 172.21.15.44:0/696744060 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff5800b33d0 0x7ff5800b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.175+0000 7ff587153700 1 --2- 172.21.15.44:0/696744060 >> v2:172.21.15.99:3300/0 conn(0x7ff580160eb0 0x7ff580165590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.175+0000 7ff587153700 1 -- 172.21.15.44:0/696744060 >> 172.21.15.44:0/696744060 conn(0x7ff5800b0f00 msgr2=0x7ff5800b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:21.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.175+0000 7ff587153700 1 -- 172.21.15.44:0/696744060 shutdown_connections 2024-09-13T18:36:21.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.175+0000 7ff587153700 1 -- 172.21.15.44:0/696744060 wait complete. 2024-09-13T18:36:21.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.179+0000 7ff587153700 1 Processor -- start 2024-09-13T18:36:21.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.179+0000 7ff587153700 1 -- start start 2024-09-13T18:36:21.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.179+0000 7ff587153700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5800b33d0 0x7ff5800ab540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.179+0000 7ff587153700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff580160eb0 0x7ff58015e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.179+0000 7ff587153700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff580161290 0x7ff58015ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.179+0000 7ff587153700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58014b6f0 con 0x7ff580161290 2024-09-13T18:36:21.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.179+0000 7ff587153700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58014da70 con 0x7ff5800b33d0 2024-09-13T18:36:21.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.179+0000 7ff587153700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58014dd50 con 0x7ff580160eb0 2024-09-13T18:36:21.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.179+0000 7ff586952700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff580161290 0x7ff58015ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.179+0000 7ff586952700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff580161290 0x7ff58015ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38168/0 (socket says 172.21.15.44:38168) 2024-09-13T18:36:21.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.179+0000 7ff586952700 1 -- 172.21.15.44:0/1357460962 learned_addr learned my addr 172.21.15.44:0/1357460962 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:21.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.179+0000 7ff585950700 1 --2- 172.21.15.44:0/1357460962 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff580160eb0 0x7ff58015e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.179+0000 7ff586151700 1 --2- 172.21.15.44:0/1357460962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5800b33d0 0x7ff5800ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.183+0000 7ff586952700 1 -- 172.21.15.44:0/1357460962 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff580160eb0 msgr2=0x7ff58015e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.183+0000 7ff586952700 1 --2- 172.21.15.44:0/1357460962 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff580160eb0 0x7ff58015e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.183+0000 7ff586952700 1 -- 172.21.15.44:0/1357460962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5800b33d0 msgr2=0x7ff5800ab540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.183+0000 7ff586952700 1 --2- 172.21.15.44:0/1357460962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5800b33d0 0x7ff5800ab540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.183+0000 7ff586952700 1 -- 172.21.15.44:0/1357460962 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5740094b0 con 0x7ff580161290 2024-09-13T18:36:21.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.183+0000 7ff586952700 1 --2- 172.21.15.44:0/1357460962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff580161290 0x7ff58015ee40 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7ff580070ba0 tx=0x7ff578004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:21.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.183+0000 7ff572ffd700 1 -- 172.21.15.44:0/1357460962 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff578004880 con 0x7ff580161290 2024-09-13T18:36:21.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.183+0000 7ff572ffd700 1 -- 172.21.15.44:0/1357460962 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5780092e0 con 0x7ff580161290 2024-09-13T18:36:21.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.183+0000 7ff587153700 1 -- 172.21.15.44:0/1357460962 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff578009b30 con 0x7ff580161290 2024-09-13T18:36:21.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.183+0000 7ff572ffd700 1 -- 172.21.15.44:0/1357460962 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57801c660 con 0x7ff580161290 2024-09-13T18:36:21.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.183+0000 7ff587153700 1 -- 172.21.15.44:0/1357460962 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58014e310 con 0x7ff580161290 2024-09-13T18:36:21.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.183+0000 7ff587153700 1 -- 172.21.15.44:0/1357460962 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff580161c30 con 0x7ff580161290 2024-09-13T18:36:21.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.183+0000 7ff572ffd700 1 -- 172.21.15.44:0/1357460962 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff57801c7c0 con 0x7ff580161290 2024-09-13T18:36:21.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.187+0000 7ff572ffd700 1 --2- 172.21.15.44:0/1357460962 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff564066780 0x7ff564068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.187+0000 7ff572ffd700 1 -- 172.21.15.44:0/1357460962 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff578085690 con 0x7ff580161290 2024-09-13T18:36:21.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.187+0000 7ff586151700 1 --2- 172.21.15.44:0/1357460962 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff564066780 0x7ff564068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.187+0000 7ff586151700 1 --2- 172.21.15.44:0/1357460962 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff564066780 0x7ff564068c40 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009bf0 tx=0x7ff57c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:21.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.191+0000 7ff572ffd700 1 -- 172.21.15.44:0/1357460962 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff578052a70 con 0x7ff580161290 2024-09-13T18:36:21.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.371+0000 7ff587153700 1 -- 172.21.15.44:0/1357460962 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff580165590 con 0x7ff580161290 2024-09-13T18:36:21.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.371+0000 7ff572ffd700 1 -- 172.21.15.44:0/1357460962 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16500 (secure 0 0 0) 0x7ff578056090 con 0x7ff580161290 2024-09-13T18:36:21.380 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:21.380 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":90,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:36:18.647007+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:36:15.982954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T18:36:16.628264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:21.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.375+0000 7ff587153700 1 -- 172.21.15.44:0/1357460962 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff564066780 msgr2=0x7ff564068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.375+0000 7ff587153700 1 --2- 172.21.15.44:0/1357460962 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff564066780 0x7ff564068c40 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009bf0 tx=0x7ff57c009240 comp rx=0 tx=0).stop 2024-09-13T18:36:21.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.375+0000 7ff587153700 1 -- 172.21.15.44:0/1357460962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff580161290 msgr2=0x7ff58015ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.375+0000 7ff587153700 1 --2- 172.21.15.44:0/1357460962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff580161290 0x7ff58015ee40 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7ff580070ba0 tx=0x7ff578004af0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.375+0000 7ff587153700 1 -- 172.21.15.44:0/1357460962 shutdown_connections 2024-09-13T18:36:21.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.375+0000 7ff587153700 1 --2- 172.21.15.44:0/1357460962 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff564066780 0x7ff564068c40 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.375+0000 7ff587153700 1 --2- 172.21.15.44:0/1357460962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff580161290 0x7ff58015ee40 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.375+0000 7ff587153700 1 --2- 172.21.15.44:0/1357460962 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff580160eb0 0x7ff58015e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.375+0000 7ff587153700 1 --2- 172.21.15.44:0/1357460962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5800b33d0 0x7ff5800ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.375+0000 7ff587153700 1 -- 172.21.15.44:0/1357460962 >> 172.21.15.44:0/1357460962 conn(0x7ff5800b0f00 msgr2=0x7ff580163cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:21.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.375+0000 7ff587153700 1 -- 172.21.15.44:0/1357460962 shutdown_connections 2024-09-13T18:36:21.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.375+0000 7ff587153700 1 -- 172.21.15.44:0/1357460962 wait complete. 2024-09-13T18:36:21.396 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:36:21.397 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:36:21.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.499+0000 7f1e2bfff700 1 Processor -- start 2024-09-13T18:36:21.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.499+0000 7f1e2bfff700 1 -- start start 2024-09-13T18:36:21.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.499+0000 7f1e2bfff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1e2c0cfd80 0x7f1e2c0cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.499+0000 7f1e2bfff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1e2c15e5a0 0x7f1e2c15ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.499+0000 7f1e2bfff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e2c0ce2a0 con 0x7f1e2c1444b0 2024-09-13T18:36:21.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.499+0000 7f1e2bfff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e2c15ef50 con 0x7f1e2c15e5a0 2024-09-13T18:36:21.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.499+0000 7f1e2bfff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e2c0cefc0 con 0x7f1e2c0cfd80 2024-09-13T18:36:21.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.499+0000 7f1e2b7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1e2c15e5a0 0x7f1e2c15ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.499+0000 7f1e2affd700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1e2c1444b0 0x7f1e2c0b67a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54842/0 (socket says 172.21.15.44:54842) 2024-09-13T18:36:21.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.499+0000 7f1e2affd700 1 -- 172.21.15.44:0/3638367270 learned_addr learned my addr 172.21.15.44:0/3638367270 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:21.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.499+0000 7f1e2a7fc700 1 --2- 172.21.15.44:0/3638367270 >> v2:172.21.15.99:3300/0 conn(0x7f1e2c0cfd80 0x7f1e2c0cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.503+0000 7f1e2b7fe700 1 -- 172.21.15.44:0/3638367270 >> v2:172.21.15.99:3300/0 conn(0x7f1e2c0cfd80 msgr2=0x7f1e2c0cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:21.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.503+0000 7f1e2b7fe700 1 --2- 172.21.15.44:0/3638367270 >> v2:172.21.15.99:3300/0 conn(0x7f1e2c0cfd80 0x7f1e2c0cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.503+0000 7f1e2b7fe700 1 -- 172.21.15.44:0/3638367270 >> v1:172.21.15.44:6789/0 conn(0x7f1e2c1444b0 legacy=0x7f1e2c0b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.503+0000 7f1e2b7fe700 1 -- 172.21.15.44:0/3638367270 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c0cf2a0 con 0x7f1e2c15e5a0 2024-09-13T18:36:21.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.503+0000 7f1e2b7fe700 1 --2- 172.21.15.44:0/3638367270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e2c15e5a0 0x7f1e2c15ea10 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0b6eb0 tx=0x7f1e2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80202b5a7f7de4fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:21.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.503+0000 7f1e29ffb700 1 -- 172.21.15.44:0/3638367270 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2400e070 con 0x7f1e2c15e5a0 2024-09-13T18:36:21.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.503+0000 7f1e29ffb700 1 -- 172.21.15.44:0/3638367270 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2400bb20 con 0x7f1e2c15e5a0 2024-09-13T18:36:21.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.503+0000 7f1e29ffb700 1 -- 172.21.15.44:0/3638367270 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e24012430 con 0x7f1e2c15e5a0 2024-09-13T18:36:21.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.503+0000 7f1e2bfff700 1 -- 172.21.15.44:0/3638367270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e2c15e5a0 msgr2=0x7f1e2c15ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.503+0000 7f1e2bfff700 1 --2- 172.21.15.44:0/3638367270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e2c15e5a0 0x7f1e2c15ea10 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0b6eb0 tx=0x7f1e2400b330 comp rx=0 tx=0).stop 2024-09-13T18:36:21.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.503+0000 7f1e2bfff700 1 -- 172.21.15.44:0/3638367270 shutdown_connections 2024-09-13T18:36:21.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.503+0000 7f1e2bfff700 1 --2- 172.21.15.44:0/3638367270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e2c15e5a0 0x7f1e2c15ea10 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.503+0000 7f1e2bfff700 1 --2- 172.21.15.44:0/3638367270 >> v2:172.21.15.99:3300/0 conn(0x7f1e2c0cfd80 0x7f1e2c0cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.503+0000 7f1e2bfff700 1 -- 172.21.15.44:0/3638367270 >> 172.21.15.44:0/3638367270 conn(0x7f1e2c071d00 msgr2=0x7f1e2c0720e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:21.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.503+0000 7f1e2bfff700 1 -- 172.21.15.44:0/3638367270 shutdown_connections 2024-09-13T18:36:21.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.503+0000 7f1e2bfff700 1 -- 172.21.15.44:0/3638367270 wait complete. 2024-09-13T18:36:21.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.503+0000 7f1e2bfff700 1 Processor -- start 2024-09-13T18:36:21.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.503+0000 7f1e2bfff700 1 -- start start 2024-09-13T18:36:21.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.507+0000 7f1e2bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e2c0cfd80 0x7f1e2c1efbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.507+0000 7f1e2bfff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e2c1444b0 0x7f1e2c13afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.507+0000 7f1e2bfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1e2c15e5a0 0x7f1e2c13b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.507+0000 7f1e2bfff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c0b17b0 con 0x7f1e2c0cfd80 2024-09-13T18:36:21.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.507+0000 7f1e2bfff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c13c970 con 0x7f1e2c1444b0 2024-09-13T18:36:21.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.507+0000 7f1e2bfff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c0b1d00 con 0x7f1e2c15e5a0 2024-09-13T18:36:21.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.507+0000 7f1e2affd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e2c0cfd80 0x7f1e2c1efbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.507+0000 7f1e2affd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e2c0cfd80 0x7f1e2c1efbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38182/0 (socket says 172.21.15.44:38182) 2024-09-13T18:36:21.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.507+0000 7f1e2affd700 1 -- 172.21.15.44:0/622323933 learned_addr learned my addr 172.21.15.44:0/622323933 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:21.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.507+0000 7f1e2b7fe700 1 --2- 172.21.15.44:0/622323933 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1e2c15e5a0 0x7f1e2c13b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.507+0000 7f1e2a7fc700 1 --2- 172.21.15.44:0/622323933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e2c1444b0 0x7f1e2c13afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.507+0000 7f1e2affd700 1 -- 172.21.15.44:0/622323933 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1e2c15e5a0 msgr2=0x7f1e2c13b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.507+0000 7f1e2affd700 1 --2- 172.21.15.44:0/622323933 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1e2c15e5a0 0x7f1e2c13b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.507+0000 7f1e2affd700 1 -- 172.21.15.44:0/622323933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e2c1444b0 msgr2=0x7f1e2c13afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.507+0000 7f1e2affd700 1 --2- 172.21.15.44:0/622323933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e2c1444b0 0x7f1e2c13afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.507+0000 7f1e2affd700 1 -- 172.21.15.44:0/622323933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e24009a70 con 0x7f1e2c0cfd80 2024-09-13T18:36:21.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.507+0000 7f1e2affd700 1 --2- 172.21.15.44:0/622323933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e2c0cfd80 0x7f1e2c1efbe0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f1e2000c700 tx=0x7f1e2000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:21.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.507+0000 7f1e13fff700 1 -- 172.21.15.44:0/622323933 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e20005d90 con 0x7f1e2c0cfd80 2024-09-13T18:36:21.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.507+0000 7f1e13fff700 1 -- 172.21.15.44:0/622323933 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e200070d0 con 0x7f1e2c0cfd80 2024-09-13T18:36:21.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.507+0000 7f1e2bfff700 1 -- 172.21.15.44:0/622323933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2c13ddf0 con 0x7f1e2c0cfd80 2024-09-13T18:36:21.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.507+0000 7f1e13fff700 1 -- 172.21.15.44:0/622323933 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e20007440 con 0x7f1e2c0cfd80 2024-09-13T18:36:21.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.507+0000 7f1e2bfff700 1 -- 172.21.15.44:0/622323933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2c0b1990 con 0x7f1e2c0cfd80 2024-09-13T18:36:21.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.507+0000 7f1e2bfff700 1 -- 172.21.15.44:0/622323933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2c15ea10 con 0x7f1e2c0cfd80 2024-09-13T18:36:21.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.511+0000 7f1e13fff700 1 -- 172.21.15.44:0/622323933 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1e200075a0 con 0x7f1e2c0cfd80 2024-09-13T18:36:21.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.511+0000 7f1e13fff700 1 --2- 172.21.15.44:0/622323933 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1e18066730 0x7f1e18068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.511+0000 7f1e13fff700 1 -- 172.21.15.44:0/622323933 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e200833b0 con 0x7f1e2c0cfd80 2024-09-13T18:36:21.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.511+0000 7f1e2a7fc700 1 --2- 172.21.15.44:0/622323933 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1e18066730 0x7f1e18068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.511+0000 7f1e2a7fc700 1 --2- 172.21.15.44:0/622323933 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1e18066730 0x7f1e18068bf0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0b4840 tx=0x7f1e1c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:21.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.519+0000 7f1e13fff700 1 -- 172.21.15.44:0/622323933 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1e200507d0 con 0x7f1e2c0cfd80 2024-09-13T18:36:21.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.679+0000 7f1e2bfff700 1 -- 172.21.15.44:0/622323933 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1e2c144890 con 0x7f1e18066730 2024-09-13T18:36:21.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.699+0000 7f1e13fff700 1 -- 172.21.15.44:0/622323933 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288005 (secure 0 0 0) 0x7f1e1c011810 con 0x7f1e18066730 2024-09-13T18:36:21.710 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:21.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.703+0000 7f1e2bfff700 1 -- 172.21.15.44:0/622323933 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1e18066730 msgr2=0x7f1e18068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.703+0000 7f1e2bfff700 1 --2- 172.21.15.44:0/622323933 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1e18066730 0x7f1e18068bf0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0b4840 tx=0x7f1e1c009240 comp rx=0 tx=0).stop 2024-09-13T18:36:21.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.703+0000 7f1e2bfff700 1 -- 172.21.15.44:0/622323933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e2c0cfd80 msgr2=0x7f1e2c1efbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.703+0000 7f1e2bfff700 1 --2- 172.21.15.44:0/622323933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e2c0cfd80 0x7f1e2c1efbe0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f1e2000c700 tx=0x7f1e2000ca10 comp rx=0 tx=0).stop 2024-09-13T18:36:21.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.703+0000 7f1e2bfff700 1 -- 172.21.15.44:0/622323933 shutdown_connections 2024-09-13T18:36:21.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.703+0000 7f1e2bfff700 1 --2- 172.21.15.44:0/622323933 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1e18066730 0x7f1e18068bf0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.703+0000 7f1e2bfff700 1 --2- 172.21.15.44:0/622323933 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1e2c15e5a0 0x7f1e2c13b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.703+0000 7f1e2bfff700 1 --2- 172.21.15.44:0/622323933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e2c1444b0 0x7f1e2c13afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.703+0000 7f1e2bfff700 1 --2- 172.21.15.44:0/622323933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e2c0cfd80 0x7f1e2c1efbe0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.703+0000 7f1e2bfff700 1 -- 172.21.15.44:0/622323933 >> 172.21.15.44:0/622323933 conn(0x7f1e2c071d00 msgr2=0x7f1e2c0720e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:21.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.707+0000 7f1e2bfff700 1 -- 172.21.15.44:0/622323933 shutdown_connections 2024-09-13T18:36:21.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.707+0000 7f1e2bfff700 1 -- 172.21.15.44:0/622323933 wait complete. 2024-09-13T18:36:21.714 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:36:21.731 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":369,"stamp":"2024-09-13T18:36:20.517006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289104,"kb_used_data":9816,"kb_used_omap":12,"kb_used_meta":279155,"kb_avail":754685616,"statfs":{"total":773094113280,"available":772798070784,"internally_reserved":0,"allocated":10051584,"data_stored":4975116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":285855288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.269335"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.323621+0000","last_change":"2024-09-13T18:36:17.680769+0000","last_active":"2024-09-13T18:36:19.323621+0000","last_peered":"2024-09-13T18:36:19.323621+0000","last_clean":"2024-09-13T18:36:19.323621+0000","last_became_active":"2024-09-13T18:36:17.680483+0000","last_became_peered":"2024-09-13T18:36:17.680483+0000","last_unstale":"2024-09-13T18:36:19.323621+0000","last_undegraded":"2024-09-13T18:36:19.323621+0000","last_fullsized":"2024-09-13T18:36:19.323621+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:55.326421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.664564+0000","last_change":"2024-09-13T18:36:17.679111+0000","last_active":"2024-09-13T18:36:18.664564+0000","last_peered":"2024-09-13T18:36:18.664564+0000","last_clean":"2024-09-13T18:36:18.664564+0000","last_became_active":"2024-09-13T18:36:17.678869+0000","last_became_peered":"2024-09-13T18:36:17.678869+0000","last_unstale":"2024-09-13T18:36:18.664564+0000","last_undegraded":"2024-09-13T18:36:18.664564+0000","last_fullsized":"2024-09-13T18:36:18.664564+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:57.396122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321763+0000","last_change":"2024-09-13T18:36:17.682633+0000","last_active":"2024-09-13T18:36:19.321763+0000","last_peered":"2024-09-13T18:36:19.321763+0000","last_clean":"2024-09-13T18:36:19.321763+0000","last_became_active":"2024-09-13T18:36:17.679600+0000","last_became_peered":"2024-09-13T18:36:17.679600+0000","last_unstale":"2024-09-13T18:36:19.321763+0000","last_undegraded":"2024-09-13T18:36:19.321763+0000","last_fullsized":"2024-09-13T18:36:19.321763+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:36.974182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.844663+0000","last_change":"2024-09-13T18:36:17.661832+0000","last_active":"2024-09-13T18:36:18.844663+0000","last_peered":"2024-09-13T18:36:18.844663+0000","last_clean":"2024-09-13T18:36:18.844663+0000","last_became_active":"2024-09-13T18:36:17.661573+0000","last_became_peered":"2024-09-13T18:36:17.661573+0000","last_unstale":"2024-09-13T18:36:18.844663+0000","last_undegraded":"2024-09-13T18:36:18.844663+0000","last_fullsized":"2024-09-13T18:36:18.844663+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:13.700222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.322193+0000","last_change":"2024-09-13T18:36:17.680372+0000","last_active":"2024-09-13T18:36:19.322193+0000","last_peered":"2024-09-13T18:36:19.322193+0000","last_clean":"2024-09-13T18:36:19.322193+0000","last_became_active":"2024-09-13T18:36:17.680035+0000","last_became_peered":"2024-09-13T18:36:17.680035+0000","last_unstale":"2024-09-13T18:36:19.322193+0000","last_undegraded":"2024-09-13T18:36:19.322193+0000","last_fullsized":"2024-09-13T18:36:19.322193+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:38.235882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663009+0000","last_change":"2024-09-13T18:36:17.675149+0000","last_active":"2024-09-13T18:36:18.663009+0000","last_peered":"2024-09-13T18:36:18.663009+0000","last_clean":"2024-09-13T18:36:18.663009+0000","last_became_active":"2024-09-13T18:36:17.674896+0000","last_became_peered":"2024-09-13T18:36:17.674896+0000","last_unstale":"2024-09-13T18:36:18.663009+0000","last_undegraded":"2024-09-13T18:36:18.663009+0000","last_fullsized":"2024-09-13T18:36:18.663009+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:30.699366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.843851+0000","last_change":"2024-09-13T18:36:17.676830+0000","last_active":"2024-09-13T18:36:18.843851+0000","last_peered":"2024-09-13T18:36:18.843851+0000","last_clean":"2024-09-13T18:36:18.843851+0000","last_became_active":"2024-09-13T18:36:17.676154+0000","last_became_peered":"2024-09-13T18:36:17.676154+0000","last_unstale":"2024-09-13T18:36:18.843851+0000","last_undegraded":"2024-09-13T18:36:18.843851+0000","last_fullsized":"2024-09-13T18:36:18.843851+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:48.134017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.662810+0000","last_change":"2024-09-13T18:36:17.668126+0000","last_active":"2024-09-13T18:36:18.662810+0000","last_peered":"2024-09-13T18:36:18.662810+0000","last_clean":"2024-09-13T18:36:18.662810+0000","last_became_active":"2024-09-13T18:36:17.667873+0000","last_became_peered":"2024-09-13T18:36:17.667873+0000","last_unstale":"2024-09-13T18:36:18.662810+0000","last_undegraded":"2024-09-13T18:36:18.662810+0000","last_fullsized":"2024-09-13T18:36:18.662810+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:43.478656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663578+0000","last_change":"2024-09-13T18:36:17.673230+0000","last_active":"2024-09-13T18:36:18.663578+0000","last_peered":"2024-09-13T18:36:18.663578+0000","last_clean":"2024-09-13T18:36:18.663578+0000","last_became_active":"2024-09-13T18:36:17.672619+0000","last_became_peered":"2024-09-13T18:36:17.672619+0000","last_unstale":"2024-09-13T18:36:18.663578+0000","last_undegraded":"2024-09-13T18:36:18.663578+0000","last_fullsized":"2024-09-13T18:36:18.663578+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:35.687923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.323214+0000","last_change":"2024-09-13T18:36:17.673836+0000","last_active":"2024-09-13T18:36:19.323214+0000","last_peered":"2024-09-13T18:36:19.323214+0000","last_clean":"2024-09-13T18:36:19.323214+0000","last_became_active":"2024-09-13T18:36:17.673580+0000","last_became_peered":"2024-09-13T18:36:17.673580+0000","last_unstale":"2024-09-13T18:36:19.323214+0000","last_undegraded":"2024-09-13T18:36:19.323214+0000","last_fullsized":"2024-09-13T18:36:19.323214+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:50.290502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.664212+0000","last_change":"2024-09-13T18:36:17.677841+0000","last_active":"2024-09-13T18:36:18.664212+0000","last_peered":"2024-09-13T18:36:18.664212+0000","last_clean":"2024-09-13T18:36:18.664212+0000","last_became_active":"2024-09-13T18:36:17.676340+0000","last_became_peered":"2024-09-13T18:36:17.676340+0000","last_unstale":"2024-09-13T18:36:18.664212+0000","last_undegraded":"2024-09-13T18:36:18.664212+0000","last_fullsized":"2024-09-13T18:36:18.664212+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:50.692612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321437+0000","last_change":"2024-09-13T18:36:17.673218+0000","last_active":"2024-09-13T18:36:19.321437+0000","last_peered":"2024-09-13T18:36:19.321437+0000","last_clean":"2024-09-13T18:36:19.321437+0000","last_became_active":"2024-09-13T18:36:17.672284+0000","last_became_peered":"2024-09-13T18:36:17.672284+0000","last_unstale":"2024-09-13T18:36:19.321437+0000","last_undegraded":"2024-09-13T18:36:19.321437+0000","last_fullsized":"2024-09-13T18:36:19.321437+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:03.234386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.322321+0000","last_change":"2024-09-13T18:36:17.682311+0000","last_active":"2024-09-13T18:36:19.322321+0000","last_peered":"2024-09-13T18:36:19.322321+0000","last_clean":"2024-09-13T18:36:19.322321+0000","last_became_active":"2024-09-13T18:36:17.682009+0000","last_became_peered":"2024-09-13T18:36:17.682009+0000","last_unstale":"2024-09-13T18:36:19.322321+0000","last_undegraded":"2024-09-13T18:36:19.322321+0000","last_fullsized":"2024-09-13T18:36:19.322321+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:24.366552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.844253+0000","last_change":"2024-09-13T18:36:17.661194+0000","last_active":"2024-09-13T18:36:18.844253+0000","last_peered":"2024-09-13T18:36:18.844253+0000","last_clean":"2024-09-13T18:36:18.844253+0000","last_became_active":"2024-09-13T18:36:17.660846+0000","last_became_peered":"2024-09-13T18:36:17.660846+0000","last_unstale":"2024-09-13T18:36:18.844253+0000","last_undegraded":"2024-09-13T18:36:18.844253+0000","last_fullsized":"2024-09-13T18:36:18.844253+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:41.086201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.662423+0000","last_change":"2024-09-13T18:36:17.677335+0000","last_active":"2024-09-13T18:36:18.662423+0000","last_peered":"2024-09-13T18:36:18.662423+0000","last_clean":"2024-09-13T18:36:18.662423+0000","last_became_active":"2024-09-13T18:36:17.677048+0000","last_became_peered":"2024-09-13T18:36:17.677048+0000","last_unstale":"2024-09-13T18:36:18.662423+0000","last_undegraded":"2024-09-13T18:36:18.662423+0000","last_fullsized":"2024-09-13T18:36:18.662423+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:03.890539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.320846+0000","last_change":"2024-09-13T18:36:17.670611+0000","last_active":"2024-09-13T18:36:19.320846+0000","last_peered":"2024-09-13T18:36:19.320846+0000","last_clean":"2024-09-13T18:36:19.320846+0000","last_became_active":"2024-09-13T18:36:17.670351+0000","last_became_peered":"2024-09-13T18:36:17.670351+0000","last_unstale":"2024-09-13T18:36:19.320846+0000","last_undegraded":"2024-09-13T18:36:19.320846+0000","last_fullsized":"2024-09-13T18:36:19.320846+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:31.655004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.323312+0000","last_change":"2024-09-13T18:36:17.678273+0000","last_active":"2024-09-13T18:36:19.323312+0000","last_peered":"2024-09-13T18:36:19.323312+0000","last_clean":"2024-09-13T18:36:19.323312+0000","last_became_active":"2024-09-13T18:36:17.677962+0000","last_became_peered":"2024-09-13T18:36:17.677962+0000","last_unstale":"2024-09-13T18:36:19.323312+0000","last_undegraded":"2024-09-13T18:36:19.323312+0000","last_fullsized":"2024-09-13T18:36:19.323312+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:58.717554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.844524+0000","last_change":"2024-09-13T18:36:17.667108+0000","last_active":"2024-09-13T18:36:18.844524+0000","last_peered":"2024-09-13T18:36:18.844524+0000","last_clean":"2024-09-13T18:36:18.844524+0000","last_became_active":"2024-09-13T18:36:17.666828+0000","last_became_peered":"2024-09-13T18:36:17.666828+0000","last_unstale":"2024-09-13T18:36:18.844524+0000","last_undegraded":"2024-09-13T18:36:18.844524+0000","last_fullsized":"2024-09-13T18:36:18.844524+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:23.109276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.320536+0000","last_change":"2024-09-13T18:36:17.670520+0000","last_active":"2024-09-13T18:36:19.320536+0000","last_peered":"2024-09-13T18:36:19.320536+0000","last_clean":"2024-09-13T18:36:19.320536+0000","last_became_active":"2024-09-13T18:36:17.670281+0000","last_became_peered":"2024-09-13T18:36:17.670281+0000","last_unstale":"2024-09-13T18:36:19.320536+0000","last_undegraded":"2024-09-13T18:36:19.320536+0000","last_fullsized":"2024-09-13T18:36:19.320536+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:41.347337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.844891+0000","last_change":"2024-09-13T18:36:17.672116+0000","last_active":"2024-09-13T18:36:18.844891+0000","last_peered":"2024-09-13T18:36:18.844891+0000","last_clean":"2024-09-13T18:36:18.844891+0000","last_became_active":"2024-09-13T18:36:17.671870+0000","last_became_peered":"2024-09-13T18:36:17.671870+0000","last_unstale":"2024-09-13T18:36:18.844891+0000","last_undegraded":"2024-09-13T18:36:18.844891+0000","last_fullsized":"2024-09-13T18:36:18.844891+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:59.514482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.844381+0000","last_change":"2024-09-13T18:36:17.676863+0000","last_active":"2024-09-13T18:36:18.844381+0000","last_peered":"2024-09-13T18:36:18.844381+0000","last_clean":"2024-09-13T18:36:18.844381+0000","last_became_active":"2024-09-13T18:36:17.673212+0000","last_became_peered":"2024-09-13T18:36:17.673212+0000","last_unstale":"2024-09-13T18:36:18.844381+0000","last_undegraded":"2024-09-13T18:36:18.844381+0000","last_fullsized":"2024-09-13T18:36:18.844381+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:45.615265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.664398+0000","last_change":"2024-09-13T18:36:17.674394+0000","last_active":"2024-09-13T18:36:18.664398+0000","last_peered":"2024-09-13T18:36:18.664398+0000","last_clean":"2024-09-13T18:36:18.664398+0000","last_became_active":"2024-09-13T18:36:17.674144+0000","last_became_peered":"2024-09-13T18:36:17.674144+0000","last_unstale":"2024-09-13T18:36:18.664398+0000","last_undegraded":"2024-09-13T18:36:18.664398+0000","last_fullsized":"2024-09-13T18:36:18.664398+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:05.322848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321160+0000","last_change":"2024-09-13T18:36:17.673721+0000","last_active":"2024-09-13T18:36:19.321160+0000","last_peered":"2024-09-13T18:36:19.321160+0000","last_clean":"2024-09-13T18:36:19.321160+0000","last_became_active":"2024-09-13T18:36:17.673210+0000","last_became_peered":"2024-09-13T18:36:17.673210+0000","last_unstale":"2024-09-13T18:36:19.321160+0000","last_undegraded":"2024-09-13T18:36:19.321160+0000","last_fullsized":"2024-09-13T18:36:19.321160+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:13.298112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.843822+0000","last_change":"2024-09-13T18:36:17.665031+0000","last_active":"2024-09-13T18:36:18.843822+0000","last_peered":"2024-09-13T18:36:18.843822+0000","last_clean":"2024-09-13T18:36:18.843822+0000","last_became_active":"2024-09-13T18:36:17.664085+0000","last_became_peered":"2024-09-13T18:36:17.664085+0000","last_unstale":"2024-09-13T18:36:18.843822+0000","last_undegraded":"2024-09-13T18:36:18.843822+0000","last_fullsized":"2024-09-13T18:36:18.843822+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:13.230813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663877+0000","last_change":"2024-09-13T18:36:17.669811+0000","last_active":"2024-09-13T18:36:18.663877+0000","last_peered":"2024-09-13T18:36:18.663877+0000","last_clean":"2024-09-13T18:36:18.663877+0000","last_became_active":"2024-09-13T18:36:17.669503+0000","last_became_peered":"2024-09-13T18:36:17.669503+0000","last_unstale":"2024-09-13T18:36:18.663877+0000","last_undegraded":"2024-09-13T18:36:18.663877+0000","last_fullsized":"2024-09-13T18:36:18.663877+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:36.212516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321634+0000","last_change":"2024-09-13T18:36:17.683606+0000","last_active":"2024-09-13T18:36:19.321634+0000","last_peered":"2024-09-13T18:36:19.321634+0000","last_clean":"2024-09-13T18:36:19.321634+0000","last_became_active":"2024-09-13T18:36:17.683294+0000","last_became_peered":"2024-09-13T18:36:17.683294+0000","last_unstale":"2024-09-13T18:36:19.321634+0000","last_undegraded":"2024-09-13T18:36:19.321634+0000","last_fullsized":"2024-09-13T18:36:19.321634+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:43.404901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321767+0000","last_change":"2024-09-13T18:36:17.677762+0000","last_active":"2024-09-13T18:36:19.321767+0000","last_peered":"2024-09-13T18:36:19.321767+0000","last_clean":"2024-09-13T18:36:19.321767+0000","last_became_active":"2024-09-13T18:36:17.676773+0000","last_became_peered":"2024-09-13T18:36:17.676773+0000","last_unstale":"2024-09-13T18:36:19.321767+0000","last_undegraded":"2024-09-13T18:36:19.321767+0000","last_fullsized":"2024-09-13T18:36:19.321767+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:35.687923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321447+0000","last_change":"2024-09-13T18:36:17.676989+0000","last_active":"2024-09-13T18:36:19.321447+0000","last_peered":"2024-09-13T18:36:19.321447+0000","last_clean":"2024-09-13T18:36:19.321447+0000","last_became_active":"2024-09-13T18:36:17.676731+0000","last_became_peered":"2024-09-13T18:36:17.676731+0000","last_unstale":"2024-09-13T18:36:19.321447+0000","last_undegraded":"2024-09-13T18:36:19.321447+0000","last_fullsized":"2024-09-13T18:36:19.321447+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:17.952709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663657+0000","last_change":"2024-09-13T18:36:17.677335+0000","last_active":"2024-09-13T18:36:18.663657+0000","last_peered":"2024-09-13T18:36:18.663657+0000","last_clean":"2024-09-13T18:36:18.663657+0000","last_became_active":"2024-09-13T18:36:17.677088+0000","last_became_peered":"2024-09-13T18:36:17.677088+0000","last_unstale":"2024-09-13T18:36:18.663657+0000","last_undegraded":"2024-09-13T18:36:18.663657+0000","last_fullsized":"2024-09-13T18:36:18.663657+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:46.906851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.664563+0000","last_change":"2024-09-13T18:36:17.668621+0000","last_active":"2024-09-13T18:36:18.664563+0000","last_peered":"2024-09-13T18:36:18.664563+0000","last_clean":"2024-09-13T18:36:18.664563+0000","last_became_active":"2024-09-13T18:36:17.668269+0000","last_became_peered":"2024-09-13T18:36:17.668269+0000","last_unstale":"2024-09-13T18:36:18.664563+0000","last_undegraded":"2024-09-13T18:36:18.664563+0000","last_fullsized":"2024-09-13T18:36:18.664563+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:36.265822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.320893+0000","last_change":"2024-09-13T18:36:17.674759+0000","last_active":"2024-09-13T18:36:19.320893+0000","last_peered":"2024-09-13T18:36:19.320893+0000","last_clean":"2024-09-13T18:36:19.320893+0000","last_became_active":"2024-09-13T18:36:17.671452+0000","last_became_peered":"2024-09-13T18:36:17.671452+0000","last_unstale":"2024-09-13T18:36:19.320893+0000","last_undegraded":"2024-09-13T18:36:19.320893+0000","last_fullsized":"2024-09-13T18:36:19.320893+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:26.112997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321320+0000","last_change":"2024-09-13T18:36:17.681262+0000","last_active":"2024-09-13T18:36:19.321320+0000","last_peered":"2024-09-13T18:36:19.321320+0000","last_clean":"2024-09-13T18:36:19.321320+0000","last_became_active":"2024-09-13T18:36:17.680992+0000","last_became_peered":"2024-09-13T18:36:17.680992+0000","last_unstale":"2024-09-13T18:36:19.321320+0000","last_undegraded":"2024-09-13T18:36:19.321320+0000","last_fullsized":"2024-09-13T18:36:19.321320+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:26.112997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.323071+0000","last_change":"2024-09-13T18:36:17.681537+0000","last_active":"2024-09-13T18:36:19.323071+0000","last_peered":"2024-09-13T18:36:19.323071+0000","last_clean":"2024-09-13T18:36:19.323071+0000","last_became_active":"2024-09-13T18:36:17.680549+0000","last_became_peered":"2024-09-13T18:36:17.680549+0000","last_unstale":"2024-09-13T18:36:19.323071+0000","last_undegraded":"2024-09-13T18:36:19.323071+0000","last_fullsized":"2024-09-13T18:36:19.323071+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:00.098401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"89'4","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.323859+0000","last_change":"2024-09-13T18:36:17.278517+0000","last_active":"2024-09-13T18:36:19.323859+0000","last_peered":"2024-09-13T18:36:19.323859+0000","last_clean":"2024-09-13T18:36:19.323859+0000","last_became_active":"2024-09-13T18:36:17.277987+0000","last_became_peered":"2024-09-13T18:36:17.277987+0000","last_unstale":"2024-09-13T18:36:19.323859+0000","last_undegraded":"2024-09-13T18:36:19.323859+0000","last_fullsized":"2024-09-13T18:36:19.323859+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:03.633472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.323714+0000","last_change":"2024-09-13T18:36:17.672844+0000","last_active":"2024-09-13T18:36:19.323714+0000","last_peered":"2024-09-13T18:36:19.323714+0000","last_clean":"2024-09-13T18:36:19.323714+0000","last_became_active":"2024-09-13T18:36:17.672526+0000","last_became_peered":"2024-09-13T18:36:17.672526+0000","last_unstale":"2024-09-13T18:36:19.323714+0000","last_undegraded":"2024-09-13T18:36:19.323714+0000","last_fullsized":"2024-09-13T18:36:19.323714+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:05.877716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"89'1","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.323308+0000","last_change":"2024-09-13T18:36:17.279620+0000","last_active":"2024-09-13T18:36:19.323308+0000","last_peered":"2024-09-13T18:36:19.323308+0000","last_clean":"2024-09-13T18:36:19.323308+0000","last_became_active":"2024-09-13T18:36:17.279324+0000","last_became_peered":"2024-09-13T18:36:17.279324+0000","last_unstale":"2024-09-13T18:36:19.323308+0000","last_undegraded":"2024-09-13T18:36:19.323308+0000","last_fullsized":"2024-09-13T18:36:19.323308+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:52.058941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321708+0000","last_change":"2024-09-13T18:36:17.680085+0000","last_active":"2024-09-13T18:36:19.321708+0000","last_peered":"2024-09-13T18:36:19.321708+0000","last_clean":"2024-09-13T18:36:19.321708+0000","last_became_active":"2024-09-13T18:36:17.679822+0000","last_became_peered":"2024-09-13T18:36:17.679822+0000","last_unstale":"2024-09-13T18:36:19.321708+0000","last_undegraded":"2024-09-13T18:36:19.321708+0000","last_fullsized":"2024-09-13T18:36:19.321708+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:52.643396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"89'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.320611+0000","last_change":"2024-09-13T18:36:17.276906+0000","last_active":"2024-09-13T18:36:19.320611+0000","last_peered":"2024-09-13T18:36:19.320611+0000","last_clean":"2024-09-13T18:36:19.320611+0000","last_became_active":"2024-09-13T18:36:17.276603+0000","last_became_peered":"2024-09-13T18:36:17.276603+0000","last_unstale":"2024-09-13T18:36:19.320611+0000","last_undegraded":"2024-09-13T18:36:19.320611+0000","last_fullsized":"2024-09-13T18:36:19.320611+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:52.935091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321855+0000","last_change":"2024-09-13T18:36:17.683352+0000","last_active":"2024-09-13T18:36:19.321855+0000","last_peered":"2024-09-13T18:36:19.321855+0000","last_clean":"2024-09-13T18:36:19.321855+0000","last_became_active":"2024-09-13T18:36:17.683038+0000","last_became_peered":"2024-09-13T18:36:17.683038+0000","last_unstale":"2024-09-13T18:36:19.321855+0000","last_undegraded":"2024-09-13T18:36:19.321855+0000","last_fullsized":"2024-09-13T18:36:19.321855+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:13.298112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"89'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.320267+0000","last_change":"2024-09-13T18:36:17.277866+0000","last_active":"2024-09-13T18:36:19.320267+0000","last_peered":"2024-09-13T18:36:19.320267+0000","last_clean":"2024-09-13T18:36:19.320267+0000","last_became_active":"2024-09-13T18:36:17.277500+0000","last_became_peered":"2024-09-13T18:36:17.277500+0000","last_unstale":"2024-09-13T18:36:19.320267+0000","last_undegraded":"2024-09-13T18:36:19.320267+0000","last_fullsized":"2024-09-13T18:36:19.320267+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:02.257763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.664495+0000","last_change":"2024-09-13T18:36:17.668458+0000","last_active":"2024-09-13T18:36:18.664495+0000","last_peered":"2024-09-13T18:36:18.664495+0000","last_clean":"2024-09-13T18:36:18.664495+0000","last_became_active":"2024-09-13T18:36:17.668028+0000","last_became_peered":"2024-09-13T18:36:17.668028+0000","last_unstale":"2024-09-13T18:36:18.664495+0000","last_undegraded":"2024-09-13T18:36:18.664495+0000","last_fullsized":"2024-09-13T18:36:18.664495+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:54.236759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"89'1","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.322673+0000","last_change":"2024-09-13T18:36:17.274583+0000","last_active":"2024-09-13T18:36:19.322673+0000","last_peered":"2024-09-13T18:36:19.322673+0000","last_clean":"2024-09-13T18:36:19.322673+0000","last_became_active":"2024-09-13T18:36:17.274301+0000","last_became_peered":"2024-09-13T18:36:17.274301+0000","last_unstale":"2024-09-13T18:36:19.322673+0000","last_undegraded":"2024-09-13T18:36:19.322673+0000","last_fullsized":"2024-09-13T18:36:19.322673+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:13.597752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.322427+0000","last_change":"2024-09-13T18:36:17.671146+0000","last_active":"2024-09-13T18:36:19.322427+0000","last_peered":"2024-09-13T18:36:19.322427+0000","last_clean":"2024-09-13T18:36:19.322427+0000","last_became_active":"2024-09-13T18:36:17.670409+0000","last_became_peered":"2024-09-13T18:36:17.670409+0000","last_unstale":"2024-09-13T18:36:19.322427+0000","last_undegraded":"2024-09-13T18:36:19.322427+0000","last_fullsized":"2024-09-13T18:36:19.322427+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:41.347337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"89'1","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.322251+0000","last_change":"2024-09-13T18:36:17.282323+0000","last_active":"2024-09-13T18:36:19.322251+0000","last_peered":"2024-09-13T18:36:19.322251+0000","last_clean":"2024-09-13T18:36:19.322251+0000","last_became_active":"2024-09-13T18:36:17.282101+0000","last_became_peered":"2024-09-13T18:36:17.282101+0000","last_unstale":"2024-09-13T18:36:19.322251+0000","last_undegraded":"2024-09-13T18:36:19.322251+0000","last_fullsized":"2024-09-13T18:36:19.322251+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:11.420704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321918+0000","last_change":"2024-09-13T18:36:17.677922+0000","last_active":"2024-09-13T18:36:19.321918+0000","last_peered":"2024-09-13T18:36:19.321918+0000","last_clean":"2024-09-13T18:36:19.321918+0000","last_became_active":"2024-09-13T18:36:17.677659+0000","last_became_peered":"2024-09-13T18:36:17.677659+0000","last_unstale":"2024-09-13T18:36:19.321918+0000","last_undegraded":"2024-09-13T18:36:19.321918+0000","last_fullsized":"2024-09-13T18:36:19.321918+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:50.290502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.319654+0000","last_change":"2024-09-13T18:36:17.272416+0000","last_active":"2024-09-13T18:36:19.319654+0000","last_peered":"2024-09-13T18:36:19.319654+0000","last_clean":"2024-09-13T18:36:19.319654+0000","last_became_active":"2024-09-13T18:36:17.272147+0000","last_became_peered":"2024-09-13T18:36:17.272147+0000","last_unstale":"2024-09-13T18:36:19.319654+0000","last_undegraded":"2024-09-13T18:36:19.319654+0000","last_fullsized":"2024-09-13T18:36:19.319654+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:35.677623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.662338+0000","last_change":"2024-09-13T18:36:17.677522+0000","last_active":"2024-09-13T18:36:18.662338+0000","last_peered":"2024-09-13T18:36:18.662338+0000","last_clean":"2024-09-13T18:36:18.662338+0000","last_became_active":"2024-09-13T18:36:17.676956+0000","last_became_peered":"2024-09-13T18:36:17.676956+0000","last_unstale":"2024-09-13T18:36:18.662338+0000","last_undegraded":"2024-09-13T18:36:18.662338+0000","last_fullsized":"2024-09-13T18:36:18.662338+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:24.366552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663521+0000","last_change":"2024-09-13T18:36:17.279718+0000","last_active":"2024-09-13T18:36:18.663521+0000","last_peered":"2024-09-13T18:36:18.663521+0000","last_clean":"2024-09-13T18:36:18.663521+0000","last_became_active":"2024-09-13T18:36:17.279240+0000","last_became_peered":"2024-09-13T18:36:17.279240+0000","last_unstale":"2024-09-13T18:36:18.663521+0000","last_undegraded":"2024-09-13T18:36:18.663521+0000","last_fullsized":"2024-09-13T18:36:18.663521+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:16.323883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.662772+0000","last_change":"2024-09-13T18:36:17.669405+0000","last_active":"2024-09-13T18:36:18.662772+0000","last_peered":"2024-09-13T18:36:18.662772+0000","last_clean":"2024-09-13T18:36:18.662772+0000","last_became_active":"2024-09-13T18:36:17.669166+0000","last_became_peered":"2024-09-13T18:36:17.669166+0000","last_unstale":"2024-09-13T18:36:18.662772+0000","last_undegraded":"2024-09-13T18:36:18.662772+0000","last_fullsized":"2024-09-13T18:36:18.662772+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:02.373068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.324000+0000","last_change":"2024-09-13T18:36:17.279614+0000","last_active":"2024-09-13T18:36:19.324000+0000","last_peered":"2024-09-13T18:36:19.324000+0000","last_clean":"2024-09-13T18:36:19.324000+0000","last_became_active":"2024-09-13T18:36:17.279386+0000","last_became_peered":"2024-09-13T18:36:17.279386+0000","last_unstale":"2024-09-13T18:36:19.324000+0000","last_undegraded":"2024-09-13T18:36:19.324000+0000","last_fullsized":"2024-09-13T18:36:19.324000+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:35.262556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663548+0000","last_change":"2024-09-13T18:36:17.675194+0000","last_active":"2024-09-13T18:36:18.663548+0000","last_peered":"2024-09-13T18:36:18.663548+0000","last_clean":"2024-09-13T18:36:18.663548+0000","last_became_active":"2024-09-13T18:36:17.674964+0000","last_became_peered":"2024-09-13T18:36:17.674964+0000","last_unstale":"2024-09-13T18:36:18.663548+0000","last_undegraded":"2024-09-13T18:36:18.663548+0000","last_fullsized":"2024-09-13T18:36:18.663548+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:54.170972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.323530+0000","last_change":"2024-09-13T18:36:17.268932+0000","last_active":"2024-09-13T18:36:19.323530+0000","last_peered":"2024-09-13T18:36:19.323530+0000","last_clean":"2024-09-13T18:36:19.323530+0000","last_became_active":"2024-09-13T18:36:17.268649+0000","last_became_peered":"2024-09-13T18:36:17.268649+0000","last_unstale":"2024-09-13T18:36:19.323530+0000","last_undegraded":"2024-09-13T18:36:19.323530+0000","last_fullsized":"2024-09-13T18:36:19.323530+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:45.903585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.320147+0000","last_change":"2024-09-13T18:36:17.666031+0000","last_active":"2024-09-13T18:36:19.320147+0000","last_peered":"2024-09-13T18:36:19.320147+0000","last_clean":"2024-09-13T18:36:19.320147+0000","last_became_active":"2024-09-13T18:36:17.665758+0000","last_became_peered":"2024-09-13T18:36:17.665758+0000","last_unstale":"2024-09-13T18:36:19.320147+0000","last_undegraded":"2024-09-13T18:36:19.320147+0000","last_fullsized":"2024-09-13T18:36:19.320147+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:35.687923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"89'3","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321478+0000","last_change":"2024-09-13T18:36:17.278744+0000","last_active":"2024-09-13T18:36:19.321478+0000","last_peered":"2024-09-13T18:36:19.321478+0000","last_clean":"2024-09-13T18:36:19.321478+0000","last_became_active":"2024-09-13T18:36:17.278272+0000","last_became_peered":"2024-09-13T18:36:17.278272+0000","last_unstale":"2024-09-13T18:36:19.321478+0000","last_undegraded":"2024-09-13T18:36:19.321478+0000","last_fullsized":"2024-09-13T18:36:19.321478+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:04.319582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.322874+0000","last_change":"2024-09-13T18:36:17.676486+0000","last_active":"2024-09-13T18:36:19.322874+0000","last_peered":"2024-09-13T18:36:19.322874+0000","last_clean":"2024-09-13T18:36:19.322874+0000","last_became_active":"2024-09-13T18:36:17.675965+0000","last_became_peered":"2024-09-13T18:36:17.675965+0000","last_unstale":"2024-09-13T18:36:19.322874+0000","last_undegraded":"2024-09-13T18:36:19.322874+0000","last_fullsized":"2024-09-13T18:36:19.322874+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:52.643396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"89'6","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663201+0000","last_change":"2024-09-13T18:36:17.276763+0000","last_active":"2024-09-13T18:36:18.663201+0000","last_peered":"2024-09-13T18:36:18.663201+0000","last_clean":"2024-09-13T18:36:18.663201+0000","last_became_active":"2024-09-13T18:36:17.276158+0000","last_became_peered":"2024-09-13T18:36:17.276158+0000","last_unstale":"2024-09-13T18:36:18.663201+0000","last_undegraded":"2024-09-13T18:36:18.663201+0000","last_fullsized":"2024-09-13T18:36:18.663201+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:04.319582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.319563+0000","last_change":"2024-09-13T18:36:17.670515+0000","last_active":"2024-09-13T18:36:19.319563+0000","last_peered":"2024-09-13T18:36:19.319563+0000","last_clean":"2024-09-13T18:36:19.319563+0000","last_became_active":"2024-09-13T18:36:17.670217+0000","last_became_peered":"2024-09-13T18:36:17.670217+0000","last_unstale":"2024-09-13T18:36:19.319563+0000","last_undegraded":"2024-09-13T18:36:19.319563+0000","last_fullsized":"2024-09-13T18:36:19.319563+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:58.717554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"89'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663780+0000","last_change":"2024-09-13T18:36:17.277888+0000","last_active":"2024-09-13T18:36:18.663780+0000","last_peered":"2024-09-13T18:36:18.663780+0000","last_clean":"2024-09-13T18:36:18.663780+0000","last_became_active":"2024-09-13T18:36:17.277628+0000","last_became_peered":"2024-09-13T18:36:17.277628+0000","last_unstale":"2024-09-13T18:36:18.663780+0000","last_undegraded":"2024-09-13T18:36:18.663780+0000","last_fullsized":"2024-09-13T18:36:18.663780+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:23.777619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.322389+0000","last_change":"2024-09-13T18:36:17.678500+0000","last_active":"2024-09-13T18:36:19.322389+0000","last_peered":"2024-09-13T18:36:19.322389+0000","last_clean":"2024-09-13T18:36:19.322389+0000","last_became_active":"2024-09-13T18:36:17.678210+0000","last_became_peered":"2024-09-13T18:36:17.678210+0000","last_unstale":"2024-09-13T18:36:19.322389+0000","last_undegraded":"2024-09-13T18:36:19.322389+0000","last_fullsized":"2024-09-13T18:36:19.322389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:55.326421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663062+0000","last_change":"2024-09-13T18:36:17.278746+0000","last_active":"2024-09-13T18:36:18.663062+0000","last_peered":"2024-09-13T18:36:18.663062+0000","last_clean":"2024-09-13T18:36:18.663062+0000","last_became_active":"2024-09-13T18:36:17.278331+0000","last_became_peered":"2024-09-13T18:36:17.278331+0000","last_unstale":"2024-09-13T18:36:18.663062+0000","last_undegraded":"2024-09-13T18:36:18.663062+0000","last_fullsized":"2024-09-13T18:36:18.663062+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:02.231120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663410+0000","last_change":"2024-09-13T18:36:17.673535+0000","last_active":"2024-09-13T18:36:18.663410+0000","last_peered":"2024-09-13T18:36:18.663410+0000","last_clean":"2024-09-13T18:36:18.663410+0000","last_became_active":"2024-09-13T18:36:17.668447+0000","last_became_peered":"2024-09-13T18:36:17.668447+0000","last_unstale":"2024-09-13T18:36:18.663410+0000","last_undegraded":"2024-09-13T18:36:18.663410+0000","last_fullsized":"2024-09-13T18:36:18.663410+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:09.336384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663058+0000","last_change":"2024-09-13T18:36:17.275625+0000","last_active":"2024-09-13T18:36:18.663058+0000","last_peered":"2024-09-13T18:36:18.663058+0000","last_clean":"2024-09-13T18:36:18.663058+0000","last_became_active":"2024-09-13T18:36:17.275352+0000","last_became_peered":"2024-09-13T18:36:17.275352+0000","last_unstale":"2024-09-13T18:36:18.663058+0000","last_undegraded":"2024-09-13T18:36:18.663058+0000","last_fullsized":"2024-09-13T18:36:18.663058+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:49.689346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663340+0000","last_change":"2024-09-13T18:36:17.669609+0000","last_active":"2024-09-13T18:36:18.663340+0000","last_peered":"2024-09-13T18:36:18.663340+0000","last_clean":"2024-09-13T18:36:18.663340+0000","last_became_active":"2024-09-13T18:36:17.669346+0000","last_became_peered":"2024-09-13T18:36:17.669346+0000","last_unstale":"2024-09-13T18:36:18.663340+0000","last_undegraded":"2024-09-13T18:36:18.663340+0000","last_fullsized":"2024-09-13T18:36:18.663340+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:04.636738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"89'8","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.319437+0000","last_change":"2024-09-13T18:36:17.272891+0000","last_active":"2024-09-13T18:36:19.319437+0000","last_peered":"2024-09-13T18:36:19.319437+0000","last_clean":"2024-09-13T18:36:19.319437+0000","last_became_active":"2024-09-13T18:36:17.272598+0000","last_became_peered":"2024-09-13T18:36:17.272598+0000","last_unstale":"2024-09-13T18:36:19.319437+0000","last_undegraded":"2024-09-13T18:36:19.319437+0000","last_fullsized":"2024-09-13T18:36:19.319437+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:49.689346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321915+0000","last_change":"2024-09-13T18:36:17.681736+0000","last_active":"2024-09-13T18:36:19.321915+0000","last_peered":"2024-09-13T18:36:19.321915+0000","last_clean":"2024-09-13T18:36:19.321915+0000","last_became_active":"2024-09-13T18:36:17.679331+0000","last_became_peered":"2024-09-13T18:36:17.679331+0000","last_unstale":"2024-09-13T18:36:19.321915+0000","last_undegraded":"2024-09-13T18:36:19.321915+0000","last_fullsized":"2024-09-13T18:36:19.321915+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:03.234386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"89'1","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.324112+0000","last_change":"2024-09-13T18:36:17.278316+0000","last_active":"2024-09-13T18:36:19.324112+0000","last_peered":"2024-09-13T18:36:19.324112+0000","last_clean":"2024-09-13T18:36:19.324112+0000","last_became_active":"2024-09-13T18:36:17.277563+0000","last_became_peered":"2024-09-13T18:36:17.277563+0000","last_unstale":"2024-09-13T18:36:19.324112+0000","last_undegraded":"2024-09-13T18:36:19.324112+0000","last_fullsized":"2024-09-13T18:36:19.324112+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:53.233493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.323865+0000","last_change":"2024-09-13T18:36:17.676312+0000","last_active":"2024-09-13T18:36:19.323865+0000","last_peered":"2024-09-13T18:36:19.323865+0000","last_clean":"2024-09-13T18:36:19.323865+0000","last_became_active":"2024-09-13T18:36:17.676031+0000","last_became_peered":"2024-09-13T18:36:17.676031+0000","last_unstale":"2024-09-13T18:36:19.323865+0000","last_undegraded":"2024-09-13T18:36:19.323865+0000","last_fullsized":"2024-09-13T18:36:19.323865+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:41.347337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"89'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.320452+0000","last_change":"2024-09-13T18:36:17.279020+0000","last_active":"2024-09-13T18:36:19.320452+0000","last_peered":"2024-09-13T18:36:19.320452+0000","last_clean":"2024-09-13T18:36:19.320452+0000","last_became_active":"2024-09-13T18:36:17.278761+0000","last_became_peered":"2024-09-13T18:36:17.278761+0000","last_unstale":"2024-09-13T18:36:19.320452+0000","last_undegraded":"2024-09-13T18:36:19.320452+0000","last_fullsized":"2024-09-13T18:36:19.320452+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:35.209250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.322871+0000","last_change":"2024-09-13T18:36:17.669917+0000","last_active":"2024-09-13T18:36:19.322871+0000","last_peered":"2024-09-13T18:36:19.322871+0000","last_clean":"2024-09-13T18:36:19.322871+0000","last_became_active":"2024-09-13T18:36:17.669632+0000","last_became_peered":"2024-09-13T18:36:17.669632+0000","last_unstale":"2024-09-13T18:36:19.322871+0000","last_undegraded":"2024-09-13T18:36:19.322871+0000","last_fullsized":"2024-09-13T18:36:19.322871+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:54.170972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.320388+0000","last_change":"2024-09-13T18:36:17.278226+0000","last_active":"2024-09-13T18:36:19.320388+0000","last_peered":"2024-09-13T18:36:19.320388+0000","last_clean":"2024-09-13T18:36:19.320388+0000","last_became_active":"2024-09-13T18:36:17.276959+0000","last_became_peered":"2024-09-13T18:36:17.276959+0000","last_unstale":"2024-09-13T18:36:19.320388+0000","last_undegraded":"2024-09-13T18:36:19.320388+0000","last_fullsized":"2024-09-13T18:36:19.320388+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:44.038102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.844438+0000","last_change":"2024-09-13T18:36:17.660999+0000","last_active":"2024-09-13T18:36:18.844438+0000","last_peered":"2024-09-13T18:36:18.844438+0000","last_clean":"2024-09-13T18:36:18.844438+0000","last_became_active":"2024-09-13T18:36:17.660511+0000","last_became_peered":"2024-09-13T18:36:17.660511+0000","last_unstale":"2024-09-13T18:36:18.844438+0000","last_undegraded":"2024-09-13T18:36:18.844438+0000","last_fullsized":"2024-09-13T18:36:18.844438+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:11.979714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"89'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.662596+0000","last_change":"2024-09-13T18:36:17.274999+0000","last_active":"2024-09-13T18:36:18.662596+0000","last_peered":"2024-09-13T18:36:18.662596+0000","last_clean":"2024-09-13T18:36:18.662596+0000","last_became_active":"2024-09-13T18:36:17.274640+0000","last_became_peered":"2024-09-13T18:36:17.274640+0000","last_unstale":"2024-09-13T18:36:18.662596+0000","last_undegraded":"2024-09-13T18:36:18.662596+0000","last_fullsized":"2024-09-13T18:36:18.662596+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:16.949443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663200+0000","last_change":"2024-09-13T18:36:17.670790+0000","last_active":"2024-09-13T18:36:18.663200+0000","last_peered":"2024-09-13T18:36:18.663200+0000","last_clean":"2024-09-13T18:36:18.663200+0000","last_became_active":"2024-09-13T18:36:17.670462+0000","last_became_peered":"2024-09-13T18:36:17.670462+0000","last_unstale":"2024-09-13T18:36:18.663200+0000","last_undegraded":"2024-09-13T18:36:18.663200+0000","last_fullsized":"2024-09-13T18:36:18.663200+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:43.395835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.844475+0000","last_change":"2024-09-13T18:36:17.278056+0000","last_active":"2024-09-13T18:36:18.844475+0000","last_peered":"2024-09-13T18:36:18.844475+0000","last_clean":"2024-09-13T18:36:18.844475+0000","last_became_active":"2024-09-13T18:36:17.277710+0000","last_became_peered":"2024-09-13T18:36:17.277710+0000","last_unstale":"2024-09-13T18:36:18.844475+0000","last_undegraded":"2024-09-13T18:36:18.844475+0000","last_fullsized":"2024-09-13T18:36:18.844475+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:29.186218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.843965+0000","last_change":"2024-09-13T18:36:17.665034+0000","last_active":"2024-09-13T18:36:18.843965+0000","last_peered":"2024-09-13T18:36:18.843965+0000","last_clean":"2024-09-13T18:36:18.843965+0000","last_became_active":"2024-09-13T18:36:17.664441+0000","last_became_peered":"2024-09-13T18:36:17.664441+0000","last_unstale":"2024-09-13T18:36:18.843965+0000","last_undegraded":"2024-09-13T18:36:18.843965+0000","last_fullsized":"2024-09-13T18:36:18.843965+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:23.947839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.843999+0000","last_change":"2024-09-13T18:36:17.272221+0000","last_active":"2024-09-13T18:36:18.843999+0000","last_peered":"2024-09-13T18:36:18.843999+0000","last_clean":"2024-09-13T18:36:18.843999+0000","last_became_active":"2024-09-13T18:36:17.271966+0000","last_became_peered":"2024-09-13T18:36:17.271966+0000","last_unstale":"2024-09-13T18:36:18.843999+0000","last_undegraded":"2024-09-13T18:36:18.843999+0000","last_fullsized":"2024-09-13T18:36:18.843999+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:30.691213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663111+0000","last_change":"2024-09-13T18:36:17.673030+0000","last_active":"2024-09-13T18:36:18.663111+0000","last_peered":"2024-09-13T18:36:18.663111+0000","last_clean":"2024-09-13T18:36:18.663111+0000","last_became_active":"2024-09-13T18:36:17.672777+0000","last_became_peered":"2024-09-13T18:36:17.672777+0000","last_unstale":"2024-09-13T18:36:18.663111+0000","last_undegraded":"2024-09-13T18:36:18.663111+0000","last_fullsized":"2024-09-13T18:36:18.663111+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:38.235882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.662383+0000","last_change":"2024-09-13T18:36:17.275084+0000","last_active":"2024-09-13T18:36:18.662383+0000","last_peered":"2024-09-13T18:36:18.662383+0000","last_clean":"2024-09-13T18:36:18.662383+0000","last_became_active":"2024-09-13T18:36:17.274702+0000","last_became_peered":"2024-09-13T18:36:17.274702+0000","last_unstale":"2024-09-13T18:36:18.662383+0000","last_undegraded":"2024-09-13T18:36:18.662383+0000","last_fullsized":"2024-09-13T18:36:18.662383+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:49.287236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.323112+0000","last_change":"2024-09-13T18:36:17.666412+0000","last_active":"2024-09-13T18:36:19.323112+0000","last_peered":"2024-09-13T18:36:19.323112+0000","last_clean":"2024-09-13T18:36:19.323112+0000","last_became_active":"2024-09-13T18:36:17.665823+0000","last_became_peered":"2024-09-13T18:36:17.665823+0000","last_unstale":"2024-09-13T18:36:19.323112+0000","last_undegraded":"2024-09-13T18:36:19.323112+0000","last_fullsized":"2024-09-13T18:36:19.323112+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:43.395835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"89'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.664926+0000","last_change":"2024-09-13T18:36:17.275530+0000","last_active":"2024-09-13T18:36:18.664926+0000","last_peered":"2024-09-13T18:36:18.664926+0000","last_clean":"2024-09-13T18:36:18.664926+0000","last_became_active":"2024-09-13T18:36:17.275218+0000","last_became_peered":"2024-09-13T18:36:17.275218+0000","last_unstale":"2024-09-13T18:36:18.664926+0000","last_undegraded":"2024-09-13T18:36:18.664926+0000","last_fullsized":"2024-09-13T18:36:18.664926+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:01.899080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321974+0000","last_change":"2024-09-13T18:36:17.682470+0000","last_active":"2024-09-13T18:36:19.321974+0000","last_peered":"2024-09-13T18:36:19.321974+0000","last_clean":"2024-09-13T18:36:19.321974+0000","last_became_active":"2024-09-13T18:36:17.682137+0000","last_became_peered":"2024-09-13T18:36:17.682137+0000","last_unstale":"2024-09-13T18:36:19.321974+0000","last_undegraded":"2024-09-13T18:36:19.321974+0000","last_fullsized":"2024-09-13T18:36:19.321974+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:03.890539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.664723+0000","last_change":"2024-09-13T18:36:17.280636+0000","last_active":"2024-09-13T18:36:18.664723+0000","last_peered":"2024-09-13T18:36:18.664723+0000","last_clean":"2024-09-13T18:36:18.664723+0000","last_became_active":"2024-09-13T18:36:17.280358+0000","last_became_peered":"2024-09-13T18:36:17.280358+0000","last_unstale":"2024-09-13T18:36:18.664723+0000","last_undegraded":"2024-09-13T18:36:18.664723+0000","last_fullsized":"2024-09-13T18:36:18.664723+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:16.473717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321886+0000","last_change":"2024-09-13T18:36:17.674511+0000","last_active":"2024-09-13T18:36:19.321886+0000","last_peered":"2024-09-13T18:36:19.321886+0000","last_clean":"2024-09-13T18:36:19.321886+0000","last_became_active":"2024-09-13T18:36:17.674264+0000","last_became_peered":"2024-09-13T18:36:17.674264+0000","last_unstale":"2024-09-13T18:36:19.321886+0000","last_undegraded":"2024-09-13T18:36:19.321886+0000","last_fullsized":"2024-09-13T18:36:19.321886+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:37.480253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321680+0000","last_change":"2024-09-13T18:36:17.278108+0000","last_active":"2024-09-13T18:36:19.321680+0000","last_peered":"2024-09-13T18:36:19.321680+0000","last_clean":"2024-09-13T18:36:19.321680+0000","last_became_active":"2024-09-13T18:36:17.277738+0000","last_became_peered":"2024-09-13T18:36:17.277738+0000","last_unstale":"2024-09-13T18:36:19.321680+0000","last_undegraded":"2024-09-13T18:36:19.321680+0000","last_fullsized":"2024-09-13T18:36:19.321680+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:08.333118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.323072+0000","last_change":"2024-09-13T18:36:17.674348+0000","last_active":"2024-09-13T18:36:19.323072+0000","last_peered":"2024-09-13T18:36:19.323072+0000","last_clean":"2024-09-13T18:36:19.323072+0000","last_became_active":"2024-09-13T18:36:17.673945+0000","last_became_peered":"2024-09-13T18:36:17.673945+0000","last_unstale":"2024-09-13T18:36:19.323072+0000","last_undegraded":"2024-09-13T18:36:19.323072+0000","last_fullsized":"2024-09-13T18:36:19.323072+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:43.478656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321995+0000","last_change":"2024-09-13T18:36:17.276910+0000","last_active":"2024-09-13T18:36:19.321995+0000","last_peered":"2024-09-13T18:36:19.321995+0000","last_clean":"2024-09-13T18:36:19.321995+0000","last_became_active":"2024-09-13T18:36:17.276525+0000","last_became_peered":"2024-09-13T18:36:17.276525+0000","last_unstale":"2024-09-13T18:36:19.321995+0000","last_undegraded":"2024-09-13T18:36:19.321995+0000","last_fullsized":"2024-09-13T18:36:19.321995+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:35.209250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663109+0000","last_change":"2024-09-13T18:36:17.665615+0000","last_active":"2024-09-13T18:36:18.663109+0000","last_peered":"2024-09-13T18:36:18.663109+0000","last_clean":"2024-09-13T18:36:18.663109+0000","last_became_active":"2024-09-13T18:36:17.665346+0000","last_became_peered":"2024-09-13T18:36:17.665346+0000","last_unstale":"2024-09-13T18:36:18.663109+0000","last_undegraded":"2024-09-13T18:36:18.663109+0000","last_fullsized":"2024-09-13T18:36:18.663109+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:41.347337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.320091+0000","last_change":"2024-09-13T18:36:17.277396+0000","last_active":"2024-09-13T18:36:19.320091+0000","last_peered":"2024-09-13T18:36:19.320091+0000","last_clean":"2024-09-13T18:36:19.320091+0000","last_became_active":"2024-09-13T18:36:17.276866+0000","last_became_peered":"2024-09-13T18:36:17.276866+0000","last_unstale":"2024-09-13T18:36:19.320091+0000","last_undegraded":"2024-09-13T18:36:19.320091+0000","last_fullsized":"2024-09-13T18:36:19.320091+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:45.903585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.319729+0000","last_change":"2024-09-13T18:36:17.675654+0000","last_active":"2024-09-13T18:36:19.319729+0000","last_peered":"2024-09-13T18:36:19.319729+0000","last_clean":"2024-09-13T18:36:19.319729+0000","last_became_active":"2024-09-13T18:36:17.675410+0000","last_became_peered":"2024-09-13T18:36:17.675410+0000","last_unstale":"2024-09-13T18:36:19.319729+0000","last_undegraded":"2024-09-13T18:36:19.319729+0000","last_fullsized":"2024-09-13T18:36:19.319729+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:31.655004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.322355+0000","last_change":"2024-09-13T18:36:17.279726+0000","last_active":"2024-09-13T18:36:19.322355+0000","last_peered":"2024-09-13T18:36:19.322355+0000","last_clean":"2024-09-13T18:36:19.322355+0000","last_became_active":"2024-09-13T18:36:17.279416+0000","last_became_peered":"2024-09-13T18:36:17.279416+0000","last_unstale":"2024-09-13T18:36:19.322355+0000","last_undegraded":"2024-09-13T18:36:19.322355+0000","last_fullsized":"2024-09-13T18:36:19.322355+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:46.370775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.322090+0000","last_change":"2024-09-13T18:36:17.683607+0000","last_active":"2024-09-13T18:36:19.322090+0000","last_peered":"2024-09-13T18:36:19.322090+0000","last_clean":"2024-09-13T18:36:19.322090+0000","last_became_active":"2024-09-13T18:36:17.683275+0000","last_became_peered":"2024-09-13T18:36:17.683275+0000","last_unstale":"2024-09-13T18:36:19.322090+0000","last_undegraded":"2024-09-13T18:36:19.322090+0000","last_fullsized":"2024-09-13T18:36:19.322090+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:23.738785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321396+0000","last_change":"2024-09-13T18:36:17.280294+0000","last_active":"2024-09-13T18:36:19.321396+0000","last_peered":"2024-09-13T18:36:19.321396+0000","last_clean":"2024-09-13T18:36:19.321396+0000","last_became_active":"2024-09-13T18:36:17.280014+0000","last_became_peered":"2024-09-13T18:36:17.280014+0000","last_unstale":"2024-09-13T18:36:19.321396+0000","last_undegraded":"2024-09-13T18:36:19.321396+0000","last_fullsized":"2024-09-13T18:36:19.321396+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:56.392856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321207+0000","last_change":"2024-09-13T18:36:17.674746+0000","last_active":"2024-09-13T18:36:19.321207+0000","last_peered":"2024-09-13T18:36:19.321207+0000","last_clean":"2024-09-13T18:36:19.321207+0000","last_became_active":"2024-09-13T18:36:17.674438+0000","last_became_peered":"2024-09-13T18:36:17.674438+0000","last_unstale":"2024-09-13T18:36:19.321207+0000","last_undegraded":"2024-09-13T18:36:19.321207+0000","last_fullsized":"2024-09-13T18:36:19.321207+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:40:22.773088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.320984+0000","last_change":"2024-09-13T18:36:17.276752+0000","last_active":"2024-09-13T18:36:19.320984+0000","last_peered":"2024-09-13T18:36:19.320984+0000","last_clean":"2024-09-13T18:36:19.320984+0000","last_became_active":"2024-09-13T18:36:17.276476+0000","last_became_peered":"2024-09-13T18:36:17.276476+0000","last_unstale":"2024-09-13T18:36:19.320984+0000","last_undegraded":"2024-09-13T18:36:19.320984+0000","last_fullsized":"2024-09-13T18:36:19.320984+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:53.233493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663763+0000","last_change":"2024-09-13T18:36:17.670013+0000","last_active":"2024-09-13T18:36:18.663763+0000","last_peered":"2024-09-13T18:36:18.663763+0000","last_clean":"2024-09-13T18:36:18.663763+0000","last_became_active":"2024-09-13T18:36:17.667589+0000","last_became_peered":"2024-09-13T18:36:17.667589+0000","last_unstale":"2024-09-13T18:36:18.663763+0000","last_undegraded":"2024-09-13T18:36:18.663763+0000","last_fullsized":"2024-09-13T18:36:18.663763+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:12.423970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"89'1","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321988+0000","last_change":"2024-09-13T18:36:17.279051+0000","last_active":"2024-09-13T18:36:19.321988+0000","last_peered":"2024-09-13T18:36:19.321988+0000","last_clean":"2024-09-13T18:36:19.321988+0000","last_became_active":"2024-09-13T18:36:17.278750+0000","last_became_peered":"2024-09-13T18:36:17.278750+0000","last_unstale":"2024-09-13T18:36:19.321988+0000","last_undegraded":"2024-09-13T18:36:19.321988+0000","last_fullsized":"2024-09-13T18:36:19.321988+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:37.232616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":226,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T18:36:17.673935+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:36:17.673935+0000","last_peered":"2024-09-13T18:36:17.673935+0000","last_clean":"2024-09-13T18:36:17.673935+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:36:17.673935+0000","last_undegraded":"2024-09-13T18:36:17.673935+0000","last_fullsized":"2024-09-13T18:36:17.673935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1691648,"data_stored":1060995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75800000000000001,"15min":0.75900000000000001},"min":{"1min":0.49399999999999999,"5min":0.38700000000000001,"15min":0.33600000000000002},"max":{"1min":1.0509999999999999,"5min":1.0760000000000001,"15min":1.163},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.78500000000000003},"min":{"1min":0.46500000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.149,"5min":1.288,"15min":1.288},"last":0.72099999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.84199999999999997,"15min":0.872},"min":{"1min":0.57899999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.115,"5min":1.288,"15min":1.7689999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89400000000000002,"15min":0.92900000000000005},"min":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.52600000000000002},"max":{"1min":1.175,"5min":1.3009999999999999,"15min":1.6140000000000001},"last":0.64600000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.84199999999999997},"min":{"1min":0.60199999999999998,"5min":0.45500000000000002,"15min":0.40500000000000003},"max":{"1min":0.98999999999999999,"5min":1.2270000000000001,"15min":1.3340000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.82599999999999996,"15min":0.879},"min":{"1min":0.64700000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0509999999999999,"5min":1.524,"15min":1.6659999999999999},"last":1.113}]},{"osd":3,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.88400000000000001,"15min":0.88600000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.52600000000000002},"max":{"1min":1.1160000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1990000000000001,"5min":1.486,"15min":1.486},"last":1.05}]},{"osd":4,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.84699999999999998,"15min":0.876},"min":{"1min":0.58999999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0649999999999999,"5min":1.4590000000000001,"15min":1.7290000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.02,"15min":1.0329999999999999},"min":{"1min":0.88700000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.226,"5min":1.49,"15min":1.7050000000000001},"last":1.0820000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.94599999999999995,"15min":0.95099999999999996},"min":{"1min":0.64000000000000001,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2490000000000001,"5min":1.4159999999999999,"15min":1.4259999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.044,"15min":1.0489999999999999},"min":{"1min":0.74199999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.325,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0249999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0409999999999999,"15min":1.075},"min":{"1min":0.626,"5min":0.626,"15min":0.58099999999999996},"max":{"1min":1.3500000000000001,"5min":1.4730000000000001,"15min":2.077},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.087,"15min":1.0740000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.69099999999999995},"max":{"1min":1.323,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.159}]}]},{"osd":6,"up_from":13,"seq":55834574967,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1105920,"data_stored":471251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.80700000000000005,"15min":0.82099999999999995},"min":{"1min":0.439,"5min":0.438,"15min":0.438},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.78900000000000003,"15min":0.81599999999999995},"min":{"1min":0.54700000000000004,"5min":0.45800000000000002,"15min":0.42099999999999999},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.73199999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.79000000000000004,"15min":0.81399999999999995},"min":{"1min":0.52000000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.84499999999999997,"15min":0.83399999999999996},"min":{"1min":0.504,"5min":0.48299999999999998,"15min":0.48099999999999998},"max":{"1min":1.2130000000000001,"5min":1.262,"15min":1.262},"last":0.65700000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.81399999999999995,"15min":0.81499999999999995},"min":{"1min":0.66200000000000003,"5min":0.47399999999999998,"15min":0.46899999999999997},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.157},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.85799999999999998,"15min":0.85999999999999999},"min":{"1min":0.54400000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.0169999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.92000000000000004,"15min":0.88800000000000001},"min":{"1min":0.71899999999999997,"5min":0.57599999999999996,"15min":0.52300000000000002},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.90100000000000002,"15min":0.93500000000000005},"min":{"1min":0.73099999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2330000000000001,"5min":1.2390000000000001,"15min":1.2909999999999999},"last":0.82299999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.871,"15min":0.88200000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.57699999999999996},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.97499999999999998,"15min":0.99199999999999999},"min":{"1min":0.63100000000000001,"5min":0.623,"15min":0.623},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.95099999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0429999999999999,"15min":1.0409999999999999},"min":{"1min":0.69099999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.97799999999999998,"15min":0.97999999999999998},"min":{"1min":0.70799999999999996,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.419,"5min":1.419,"15min":1.4990000000000001},"last":1.05}]},{"osd":7,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0129999999999999,"15min":1.0009999999999999},"min":{"1min":0.67800000000000005,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.131},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.121,"15min":1.1140000000000001},"min":{"1min":0.89900000000000002,"5min":0.76200000000000001,"15min":0.76000000000000001},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.1020000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1122304,"data_stored":478443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76800000000000002,"15min":0.81699999999999995},"min":{"1min":0.56200000000000006,"5min":0.46899999999999997,"15min":0.39800000000000002},"max":{"1min":1.0309999999999999,"5min":1.3280000000000001,"15min":1.3640000000000001},"last":1.149},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.81000000000000005,"15min":0.84899999999999998},"min":{"1min":0.60799999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1559999999999999,"5min":1.194,"15min":1.482},"last":0.93100000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.79300000000000004,"15min":0.79500000000000004},"min":{"1min":0.57399999999999995,"5min":0.42499999999999999,"15min":0.40999999999999998},"max":{"1min":1.008,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85599999999999998,"15min":0.90900000000000003},"min":{"1min":0.55100000000000005,"5min":0.50900000000000001,"15min":0.45200000000000001},"max":{"1min":1.1200000000000001,"5min":1.218,"15min":1.4850000000000001},"last":0.95999999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.92500000000000004,"15min":0.94599999999999995},"min":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.51300000000000001},"max":{"1min":1.115,"5min":1.2430000000000001,"15min":1.4179999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93500000000000005,"15min":0.98199999999999998},"min":{"1min":0.59799999999999998,"5min":0.51800000000000002,"15min":0.46500000000000002},"max":{"1min":1.1519999999999999,"5min":1.2849999999999999,"15min":1.4690000000000001},"last":0.77800000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.878,"15min":0.92400000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.51700000000000002},"max":{"1min":1.117,"5min":1.2010000000000001,"15min":1.4510000000000001},"last":1.28},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89500000000000002,"15min":0.92600000000000005},"min":{"1min":0.65400000000000003,"5min":0.61199999999999999,"15min":0.55300000000000005},"max":{"1min":1.1679999999999999,"5min":1.335,"15min":1.4990000000000001},"last":0.89200000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.91300000000000003,"15min":0.95199999999999996},"min":{"1min":0.57599999999999996,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2549999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95799999999999996,"15min":1.0089999999999999},"min":{"1min":0.628,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.206,"5min":1.302,"15min":1.542},"last":1.1160000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.97799999999999998,"15min":1.0129999999999999},"min":{"1min":0.83599999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2989999999999999,"5min":1.4259999999999999,"15min":1.698},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1020000000000001,"15min":1.1419999999999999},"min":{"1min":0.90400000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.2170000000000001,"5min":1.52,"15min":1.581},"last":1.2330000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.0589999999999999,"15min":1.1419999999999999},"min":{"1min":0.68500000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.256,"5min":1.552,"15min":1.847},"last":1.036},{"interface":"front","average":{"1min":1.069,"5min":1.0640000000000001,"15min":1.117},"min":{"1min":0.72399999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2549999999999999,"5min":1.4259999999999999,"15min":1.8100000000000001},"last":1.0900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574965,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46144,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325696,"statfs":{"total":96636764160,"available":96589512704,"internally_reserved":0,"allocated":1093632,"data_stored":470557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.82299999999999995,"15min":0.875},"min":{"1min":0.52000000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.159,"5min":1.1930000000000001,"15min":1.3720000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.89500000000000002,"15min":0.93999999999999995},"min":{"1min":0.57299999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.163,"5min":1.21,"15min":1.5229999999999999},"last":0.85899999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.54300000000000004,"5min":0.47099999999999997,"15min":0.435},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.84199999999999997,"15min":0.84599999999999997},"min":{"1min":0.58399999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1859999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.76200000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.80000000000000004,"15min":0.83899999999999997},"min":{"1min":0.67100000000000004,"5min":0.46300000000000002,"15min":0.44600000000000001},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.871,"5min":0.86499999999999999,"15min":0.85499999999999998},"min":{"1min":0.58199999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.212,"5min":1.331,"15min":1.331},"last":0.64200000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.89300000000000002,"15min":0.94999999999999996},"min":{"1min":0.55800000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.639},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.91200000000000003,"15min":0.96499999999999997},"min":{"1min":0.70499999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.8300000000000001},"last":0.79700000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.91700000000000004,"15min":0.95999999999999996},"min":{"1min":0.67300000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.327,"5min":1.518,"15min":2.3889999999999998},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.052,"15min":1.093},"min":{"1min":0.91200000000000003,"5min":0.66100000000000003,"15min":0.626},"max":{"1min":1.605,"5min":1.605,"15min":2.0049999999999999},"last":0.93700000000000006}]},{"osd":6,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94599999999999995,"15min":0.91500000000000004},"min":{"1min":0.69199999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2929999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.121,"5min":1.0840000000000001,"15min":1.0960000000000001},"min":{"1min":0.873,"5min":0.70099999999999996,"15min":0.63500000000000001},"max":{"1min":1.409,"5min":1.4259999999999999,"15min":1.794},"last":1.038}]},{"osd":7,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0509999999999999,"15min":1.0680000000000001},"min":{"1min":0.66100000000000003,"5min":0.65200000000000002,"15min":0.60499999999999998},"max":{"1min":1.659,"5min":1.659,"15min":1.669},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0529999999999999,"15min":1.0349999999999999},"min":{"1min":0.877,"5min":0.69499999999999995,"15min":0.61799999999999999},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.1359999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574968,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1118208,"data_stored":478421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64200000000000002,"15min":0.66100000000000003},"min":{"1min":0.38300000000000001,"5min":0.22,"15min":0.22},"max":{"1min":1.0489999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.622,"15min":0.65700000000000003},"min":{"1min":0.434,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":1.008,"5min":1.008,"15min":1.1970000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.67800000000000005,"15min":0.68999999999999995},"min":{"1min":0.44600000000000001,"5min":0.24099999999999999,"15min":0.23100000000000001},"max":{"1min":0.98299999999999998,"5min":1.379,"15min":1.379},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.751,"15min":0.79300000000000004},"min":{"1min":0.46200000000000002,"5min":0.30199999999999999,"15min":0.23499999999999999},"max":{"1min":1.238,"5min":1.397,"15min":2.0030000000000001},"last":0.67300000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.40899999999999997,"5min":0.32500000000000001,"15min":0.29299999999999998},"max":{"1min":0.91000000000000003,"5min":1.3300000000000001,"15min":1.333},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.83999999999999997,"15min":0.86699999999999999},"min":{"1min":0.55600000000000005,"5min":0.33000000000000002,"15min":0.27300000000000002},"max":{"1min":1.296,"5min":1.423,"15min":1.423},"last":0.53900000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.88400000000000001,"15min":0.92900000000000005},"min":{"1min":0.58399999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1779999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.97099999999999997,"15min":1.0089999999999999},"min":{"1min":0.67400000000000004,"5min":0.56899999999999995,"15min":0.52300000000000002},"max":{"1min":1.3440000000000001,"5min":1.587,"15min":1.587},"last":1.1559999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.038,"15min":1.119},"min":{"1min":0.83299999999999996,"5min":0.55200000000000005,"15min":0.51400000000000001},"max":{"1min":1.3089999999999999,"5min":1.6200000000000001,"15min":2.2320000000000002},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1,"15min":1.0680000000000001},"min":{"1min":0.65100000000000002,"5min":0.53900000000000003,"15min":0.53600000000000003},"max":{"1min":1.252,"5min":1.3280000000000001,"15min":1.718},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0589999999999999,"15min":1.097},"min":{"1min":0.69699999999999995,"5min":0.60199999999999998,"15min":0.496},"max":{"1min":1.4259999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.0900000000000001,"15min":1.1699999999999999},"min":{"1min":0.79100000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.385,"5min":1.51,"15min":2.1819999999999999},"last":0.877}]},{"osd":7,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0329999999999999,"15min":1.0740000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.624},"max":{"1min":1.391,"5min":1.391,"15min":1.4670000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.073,"5min":1.101,"15min":1.143},"min":{"1min":0.69999999999999996,"5min":0.57499999999999996,"15min":0.54300000000000004},"max":{"1min":1.367,"5min":1.548,"15min":1.5920000000000001},"last":1.379}]}]},{"osd":2,"up_from":13,"seq":55834574966,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40392,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331448,"statfs":{"total":96636764160,"available":96595402752,"internally_reserved":0,"allocated":1110016,"data_stored":477439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63600000000000001,"15min":0.65800000000000003},"min":{"1min":0.45100000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":1.0009999999999999,"5min":1.1020000000000001,"15min":1.1919999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.72199999999999998,"15min":0.76700000000000002},"min":{"1min":0.56000000000000005,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.4370000000000001},"last":0.91800000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65500000000000003,"15min":0.69099999999999995},"min":{"1min":0.48399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.94799999999999995,"5min":1.2050000000000001,"15min":1.2629999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.68999999999999995,"15min":0.72099999999999997},"min":{"1min":0.51900000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.181,"5min":1.383,"15min":1.383},"last":0.95799999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.68100000000000005,"15min":0.67500000000000004},"min":{"1min":0.46800000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.85199999999999998},"min":{"1min":0.48499999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1870000000000001,"5min":1.3460000000000001,"15min":1.548},"last":1.0009999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.94799999999999995,"15min":0.96899999999999997},"min":{"1min":0.69199999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1279999999999999,"5min":1.653,"15min":1.653},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.96599999999999997,"15min":1.0209999999999999},"min":{"1min":0.73299999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2829999999999999,"5min":1.51,"15min":2.3849999999999998},"last":0.86099999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.93200000000000005,"15min":0.92500000000000004},"min":{"1min":0.74399999999999999,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.327,"5min":1.4730000000000001,"15min":1.498},"last":1.109},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.028,"15min":1.048},"min":{"1min":0.81799999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.254,"5min":1.7549999999999999,"15min":1.869},"last":1.137}]},{"osd":6,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.89300000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.3500000000000001,"5min":1.6120000000000001,"15min":2.762},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.0129999999999999,"15min":1.036},"min":{"1min":0.85999999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.407,"5min":1.5509999999999999,"15min":1.988},"last":0.93600000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.095,"15min":1.1359999999999999},"min":{"1min":0.85199999999999998,"5min":0.61099999999999999,"15min":0.59799999999999998},"max":{"1min":1.496,"5min":1.8240000000000001,"15min":2.6800000000000002},"last":1.276},{"interface":"front","average":{"1min":1.111,"5min":1.081,"15min":1.0740000000000001},"min":{"1min":0.81399999999999995,"5min":0.64100000000000001,"15min":0.52800000000000002},"max":{"1min":1.3129999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.98799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1118208,"data_stored":477051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.34300000000000003,"15min":0.33200000000000002},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70499999999999996,"15min":0.72799999999999998},"min":{"1min":0.502,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.1279999999999999,"5min":1.341,"15min":1.3560000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.46600000000000003,"5min":0.311,"15min":0.311},"max":{"1min":1.0069999999999999,"5min":1.133,"15min":1.1879999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.73899999999999999,"15min":0.747},"min":{"1min":0.44600000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.089,"5min":1.617,"15min":1.617},"last":0.96399999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.56599999999999995,"5min":0.375,"15min":0.375},"max":{"1min":1.1040000000000001,"5min":1.415,"15min":1.415},"last":1.2889999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.751,"15min":0.77700000000000002},"min":{"1min":0.41999999999999998,"5min":0.35999999999999999,"15min":0.35699999999999998},"max":{"1min":1.0820000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.69699999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.95299999999999996,"15min":0.95399999999999996},"min":{"1min":0.70099999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2669999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.95999999999999996,"15min":0.97099999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2450000000000001,"5min":1.52,"15min":1.994},"last":1.395}]},{"osd":5,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.96799999999999997,"15min":0.97299999999999998},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.49299999999999999},"max":{"1min":1.3260000000000001,"5min":1.7,"15min":2.0960000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.054,"15min":1.0740000000000001},"min":{"1min":0.82299999999999995,"5min":0.626,"15min":0.626},"max":{"1min":1.407,"5min":1.8939999999999999,"15min":2.7280000000000002},"last":1.5369999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.024,"15min":1.0600000000000001},"min":{"1min":0.68899999999999995,"5min":0.56599999999999995,"15min":0.53100000000000003},"max":{"1min":1.3029999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.04,"15min":1.075},"min":{"1min":0.69199999999999995,"5min":0.64700000000000002,"15min":0.63100000000000001},"max":{"1min":1.3029999999999999,"5min":1.9710000000000001,"15min":2.0489999999999999},"last":1.486}]},{"osd":7,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.099,"15min":1.095},"min":{"1min":0.88500000000000001,"5min":0.72499999999999998,"15min":0.67400000000000004},"max":{"1min":1.3600000000000001,"5min":2.0070000000000001,"15min":2.5579999999999998},"last":1.452},{"interface":"front","average":{"1min":1.087,"5min":1.089,"15min":1.1080000000000001},"min":{"1min":0.77300000000000002,"5min":0.55200000000000005,"15min":0.51300000000000001},"max":{"1min":1.627,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.3500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40968,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330872,"statfs":{"total":96636764160,"available":96594812928,"internally_reserved":0,"allocated":1691648,"data_stored":1060959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.59999999999999998,"15min":0.60499999999999998},"min":{"1min":0.45900000000000002,"5min":0.192,"15min":0.192},"max":{"1min":0.97599999999999998,"5min":1.23,"15min":1.23},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66500000000000004,"15min":0.68899999999999995},"min":{"1min":0.53100000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.98399999999999999,"5min":1.1220000000000001,"15min":1.1759999999999999},"last":0.49099999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.67900000000000005,"15min":0.69699999999999995},"min":{"1min":0.53400000000000003,"5min":0.249,"15min":0.23799999999999999},"max":{"1min":1.1539999999999999,"5min":1.494,"15min":1.494},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.71599999999999997,"15min":0.71899999999999997},"min":{"1min":0.42799999999999999,"5min":0.223,"15min":0.223},"max":{"1min":1.042,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.58799999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68500000000000005,"15min":0.64800000000000002},"min":{"1min":0.51600000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.93300000000000005,"5min":1.137,"15min":1.137},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.82599999999999996,"15min":0.82699999999999996},"min":{"1min":0.63400000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.2490000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.96099999999999997,"15min":0.96199999999999997},"min":{"1min":0.66800000000000004,"5min":0.623,"15min":0.623},"max":{"1min":1.595,"5min":1.764,"15min":1.764},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.90200000000000002,"15min":0.91000000000000003},"min":{"1min":0.64900000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.304,"5min":1.3620000000000001,"15min":1.4810000000000001},"last":0.68600000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98199999999999998,"15min":0.97299999999999998},"min":{"1min":0.79500000000000004,"5min":0.64600000000000002,"15min":0.59299999999999997},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.046,"15min":1.052},"min":{"1min":0.85499999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5489999999999999,"5min":1.637,"15min":1.637},"last":0.85599999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.0680000000000001,"15min":1.0860000000000001},"min":{"1min":0.79300000000000004,"5min":0.63900000000000001,"15min":0.61699999999999999},"max":{"1min":1.45,"5min":1.718,"15min":1.718},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.171,"5min":1.081,"15min":1.1080000000000001},"min":{"1min":0.80700000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.6180000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.95999999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.071,"15min":1.105},"min":{"1min":0.83899999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.538,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.05,"5min":1.0309999999999999,"15min":1.0409999999999999},"min":{"1min":0.72599999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.284,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.98899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:36:21.736 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:36:21.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.851+0000 7efe32cb3700 1 Processor -- start 2024-09-13T18:36:21.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.851+0000 7efe32cb3700 1 -- start start 2024-09-13T18:36:21.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.851+0000 7efe32cb3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe2c06b310 0x7efe2c0cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.851+0000 7efe32cb3700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe2c0d21e0 con 0x7efe2c15cec0 2024-09-13T18:36:21.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.851+0000 7efe32cb3700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe2c0d1940 con 0x7efe2c15cae0 2024-09-13T18:36:21.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.851+0000 7efe32cb3700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c0d1c20 con 0x7efe2c06b310 2024-09-13T18:36:21.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.851+0000 7efe314b0700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7efe2c15cec0 0x7efe2c0b62b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54858/0 (socket says 172.21.15.44:54858) 2024-09-13T18:36:21.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.851+0000 7efe314b0700 1 -- 172.21.15.44:0/4216958361 learned_addr learned my addr 172.21.15.44:0/4216958361 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:21.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.851+0000 7efe324b2700 1 --2- 172.21.15.44:0/4216958361 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe2c06b310 0x7efe2c0cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.851+0000 7efe30caf700 1 -- 172.21.15.44:0/4216958361 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426309100 0 0) 0x7efe2c0d21e0 con 0x7efe2c15cec0 2024-09-13T18:36:21.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.851+0000 7efe30caf700 1 -- 172.21.15.44:0/4216958361 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe180035d0 con 0x7efe2c15cec0 2024-09-13T18:36:21.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.851+0000 7efe30caf700 1 -- 172.21.15.44:0/4216958361 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4264079573 0 0) 0x7efe180035d0 con 0x7efe2c15cec0 2024-09-13T18:36:21.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.851+0000 7efe30caf700 1 -- 172.21.15.44:0/4216958361 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe2c06b310 msgr2=0x7efe2c0cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:21.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.851+0000 7efe30caf700 1 --2- 172.21.15.44:0/4216958361 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe2c06b310 0x7efe2c0cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.851+0000 7efe30caf700 1 -- 172.21.15.44:0/4216958361 >> v1:172.21.15.99:6789/0 conn(0x7efe2c15cae0 legacy=0x7efe2c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.851+0000 7efe30caf700 1 -- 172.21.15.44:0/4216958361 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c0d1f00 con 0x7efe2c15cec0 2024-09-13T18:36:21.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.851+0000 7efe30caf700 1 -- 172.21.15.44:0/4216958361 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7efe20001670 con 0x7efe2c15cec0 2024-09-13T18:36:21.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.851+0000 7efe30caf700 1 -- 172.21.15.44:0/4216958361 >> v1:172.21.15.44:6789/0 conn(0x7efe2c15cec0 legacy=0x7efe2c0b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe30caf700 1 --2- 172.21.15.44:0/4216958361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe18003a50 0x7efe18003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe30caf700 1 --2- 172.21.15.44:0/4216958361 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe18004870 0x7efe18004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe30caf700 1 --2- 172.21.15.44:0/4216958361 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe2c06b310 0x7efe18005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe30caf700 1 -- 172.21.15.44:0/4216958361 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c0d1c20 con 0x7efe18003a50 2024-09-13T18:36:21.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe30caf700 1 -- 172.21.15.44:0/4216958361 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1800bb10 con 0x7efe18004870 2024-09-13T18:36:21.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe30caf700 1 -- 172.21.15.44:0/4216958361 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1800bcd0 con 0x7efe2c06b310 2024-09-13T18:36:21.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe314b0700 1 --2- 172.21.15.44:0/4216958361 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe18004870 0x7efe18004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe324b2700 1 --2- 172.21.15.44:0/4216958361 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe2c06b310 0x7efe18005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe31cb1700 1 --2- 172.21.15.44:0/4216958361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe18003a50 0x7efe18003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe324b2700 1 -- 172.21.15.44:0/4216958361 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe18004870 msgr2=0x7efe18004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:21.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe324b2700 1 --2- 172.21.15.44:0/4216958361 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe18004870 0x7efe18004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe324b2700 1 -- 172.21.15.44:0/4216958361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe18003a50 msgr2=0x7efe18003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:21.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe324b2700 1 --2- 172.21.15.44:0/4216958361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe18003a50 0x7efe18003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe324b2700 1 -- 172.21.15.44:0/4216958361 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe180035d0 con 0x7efe2c06b310 2024-09-13T18:36:21.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe324b2700 1 --2- 172.21.15.44:0/4216958361 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe2c06b310 0x7efe18005230 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efe24009fc0 tx=0x7efe180058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3336d56f5d127890 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:21.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe30caf700 1 -- 172.21.15.44:0/4216958361 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2400ec30 con 0x7efe2c06b310 2024-09-13T18:36:21.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe30caf700 1 -- 172.21.15.44:0/4216958361 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2400f040 con 0x7efe2c06b310 2024-09-13T18:36:21.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe30caf700 1 -- 172.21.15.44:0/4216958361 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24014480 con 0x7efe2c06b310 2024-09-13T18:36:21.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe32cb3700 1 -- 172.21.15.44:0/4216958361 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe2c06b310 msgr2=0x7efe18005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe32cb3700 1 --2- 172.21.15.44:0/4216958361 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe2c06b310 0x7efe18005230 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efe24009fc0 tx=0x7efe180058a0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe324b2700 1 -- 172.21.15.44:0/4216958361 reap_dead start 2024-09-13T18:36:21.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe32cb3700 1 -- 172.21.15.44:0/4216958361 shutdown_connections 2024-09-13T18:36:21.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe32cb3700 1 -- 172.21.15.44:0/4216958361 >> 172.21.15.44:0/4216958361 conn(0x7efe2c0d2c80 msgr2=0x7efe2c0d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:21.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe32cb3700 1 -- 172.21.15.44:0/4216958361 shutdown_connections 2024-09-13T18:36:21.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.855+0000 7efe32cb3700 1 -- 172.21.15.44:0/4216958361 wait complete. 2024-09-13T18:36:21.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe32cb3700 1 Processor -- start 2024-09-13T18:36:21.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe32cb3700 1 -- start start 2024-09-13T18:36:21.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe32cb3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe2c06b310 0x7efe2c159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe32cb3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe2c0ca6d0 0x7efe2c1f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe32cb3700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe2c1f5e10 0x7efe2c0b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe32cb3700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c0ca2b0 con 0x7efe2c0ca6d0 2024-09-13T18:36:21.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe32cb3700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c1f62b0 con 0x7efe2c1f5e10 2024-09-13T18:36:21.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe32cb3700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c1f6590 con 0x7efe2c06b310 2024-09-13T18:36:21.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe314b0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe2c0ca6d0 0x7efe2c1f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe314b0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe2c0ca6d0 0x7efe2c1f58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38204/0 (socket says 172.21.15.44:38204) 2024-09-13T18:36:21.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe314b0700 1 -- 172.21.15.44:0/1674238982 learned_addr learned my addr 172.21.15.44:0/1674238982 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:21.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe31cb1700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe2c06b310 0x7efe2c159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe324b2700 1 --2- 172.21.15.44:0/1674238982 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe2c1f5e10 0x7efe2c0b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe314b0700 1 -- 172.21.15.44:0/1674238982 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe2c06b310 msgr2=0x7efe2c159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe314b0700 1 --2- 172.21.15.44:0/1674238982 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe2c06b310 0x7efe2c159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe314b0700 1 -- 172.21.15.44:0/1674238982 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe2c1f5e10 msgr2=0x7efe2c0b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe314b0700 1 --2- 172.21.15.44:0/1674238982 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe2c1f5e10 0x7efe2c0b62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe314b0700 1 -- 172.21.15.44:0/1674238982 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c0c9ed0 con 0x7efe2c0ca6d0 2024-09-13T18:36:21.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe314b0700 1 --2- 172.21.15.44:0/1674238982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe2c0ca6d0 0x7efe2c1f58d0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7efe20007290 tx=0x7efe200075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:21.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe1e7fc700 1 -- 172.21.15.44:0/1674238982 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe20007d70 con 0x7efe2c0ca6d0 2024-09-13T18:36:21.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe1e7fc700 1 -- 172.21.15.44:0/1674238982 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2000f5e0 con 0x7efe2c0ca6d0 2024-09-13T18:36:21.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe32cb3700 1 -- 172.21.15.44:0/1674238982 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2c159940 con 0x7efe2c0ca6d0 2024-09-13T18:36:21.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe1e7fc700 1 -- 172.21.15.44:0/1674238982 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2000f990 con 0x7efe2c0ca6d0 2024-09-13T18:36:21.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.859+0000 7efe32cb3700 1 -- 172.21.15.44:0/1674238982 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2c0b1a20 con 0x7efe2c0ca6d0 2024-09-13T18:36:21.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.863+0000 7efe32cb3700 1 -- 172.21.15.44:0/1674238982 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2c0c9d30 con 0x7efe2c0ca6d0 2024-09-13T18:36:21.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.863+0000 7efe1e7fc700 1 -- 172.21.15.44:0/1674238982 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efe2000faf0 con 0x7efe2c0ca6d0 2024-09-13T18:36:21.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.863+0000 7efe1e7fc700 1 --2- 172.21.15.44:0/1674238982 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe10066730 0x7efe10068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.863+0000 7efe1e7fc700 1 -- 172.21.15.44:0/1674238982 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe20084020 con 0x7efe2c0ca6d0 2024-09-13T18:36:21.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.863+0000 7efe31cb1700 1 --2- 172.21.15.44:0/1674238982 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe10066730 0x7efe10068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.863+0000 7efe31cb1700 1 --2- 172.21.15.44:0/1674238982 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe10066730 0x7efe10068bf0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7efe28007fd0 tx=0x7efe28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:21.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:21.871+0000 7efe1e7fc700 1 -- 172.21.15.44:0/1674238982 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efe2c0c9d30 con 0x7efe2c0ca6d0 2024-09-13T18:36:22.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.039+0000 7efe32cb3700 1 -- 172.21.15.44:0/1674238982 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe2c0ca3f0 con 0x7efe10066730 2024-09-13T18:36:22.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.055+0000 7efe1e7fc700 1 -- 172.21.15.44:0/1674238982 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288005 (secure 0 0 0) 0x7efe2c0ca3f0 con 0x7efe10066730 2024-09-13T18:36:22.066 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:22.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.059+0000 7efe32cb3700 1 -- 172.21.15.44:0/1674238982 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe10066730 msgr2=0x7efe10068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.059+0000 7efe32cb3700 1 --2- 172.21.15.44:0/1674238982 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe10066730 0x7efe10068bf0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7efe28007fd0 tx=0x7efe28009040 comp rx=0 tx=0).stop 2024-09-13T18:36:22.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.059+0000 7efe32cb3700 1 -- 172.21.15.44:0/1674238982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe2c0ca6d0 msgr2=0x7efe2c1f58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.059+0000 7efe32cb3700 1 --2- 172.21.15.44:0/1674238982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe2c0ca6d0 0x7efe2c1f58d0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7efe20007290 tx=0x7efe200075a0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.059+0000 7efe32cb3700 1 -- 172.21.15.44:0/1674238982 shutdown_connections 2024-09-13T18:36:22.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.059+0000 7efe32cb3700 1 --2- 172.21.15.44:0/1674238982 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efe10066730 0x7efe10068bf0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.059+0000 7efe32cb3700 1 --2- 172.21.15.44:0/1674238982 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe2c1f5e10 0x7efe2c0b62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.059+0000 7efe32cb3700 1 --2- 172.21.15.44:0/1674238982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe2c0ca6d0 0x7efe2c1f58d0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.059+0000 7efe32cb3700 1 --2- 172.21.15.44:0/1674238982 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe2c06b310 0x7efe2c159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.059+0000 7efe32cb3700 1 -- 172.21.15.44:0/1674238982 >> 172.21.15.44:0/1674238982 conn(0x7efe2c0d2c80 msgr2=0x7efe2c0d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:22.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.059+0000 7efe32cb3700 1 -- 172.21.15.44:0/1674238982 shutdown_connections 2024-09-13T18:36:22.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.059+0000 7efe32cb3700 1 -- 172.21.15.44:0/1674238982 wait complete. 2024-09-13T18:36:22.070 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:36:22.082 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":369,"stamp":"2024-09-13T18:36:20.517006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289104,"kb_used_data":9816,"kb_used_omap":12,"kb_used_meta":279155,"kb_avail":754685616,"statfs":{"total":773094113280,"available":772798070784,"internally_reserved":0,"allocated":10051584,"data_stored":4975116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":285855288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.269335"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.323621+0000","last_change":"2024-09-13T18:36:17.680769+0000","last_active":"2024-09-13T18:36:19.323621+0000","last_peered":"2024-09-13T18:36:19.323621+0000","last_clean":"2024-09-13T18:36:19.323621+0000","last_became_active":"2024-09-13T18:36:17.680483+0000","last_became_peered":"2024-09-13T18:36:17.680483+0000","last_unstale":"2024-09-13T18:36:19.323621+0000","last_undegraded":"2024-09-13T18:36:19.323621+0000","last_fullsized":"2024-09-13T18:36:19.323621+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:55.326421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.664564+0000","last_change":"2024-09-13T18:36:17.679111+0000","last_active":"2024-09-13T18:36:18.664564+0000","last_peered":"2024-09-13T18:36:18.664564+0000","last_clean":"2024-09-13T18:36:18.664564+0000","last_became_active":"2024-09-13T18:36:17.678869+0000","last_became_peered":"2024-09-13T18:36:17.678869+0000","last_unstale":"2024-09-13T18:36:18.664564+0000","last_undegraded":"2024-09-13T18:36:18.664564+0000","last_fullsized":"2024-09-13T18:36:18.664564+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:57.396122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321763+0000","last_change":"2024-09-13T18:36:17.682633+0000","last_active":"2024-09-13T18:36:19.321763+0000","last_peered":"2024-09-13T18:36:19.321763+0000","last_clean":"2024-09-13T18:36:19.321763+0000","last_became_active":"2024-09-13T18:36:17.679600+0000","last_became_peered":"2024-09-13T18:36:17.679600+0000","last_unstale":"2024-09-13T18:36:19.321763+0000","last_undegraded":"2024-09-13T18:36:19.321763+0000","last_fullsized":"2024-09-13T18:36:19.321763+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:36.974182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.844663+0000","last_change":"2024-09-13T18:36:17.661832+0000","last_active":"2024-09-13T18:36:18.844663+0000","last_peered":"2024-09-13T18:36:18.844663+0000","last_clean":"2024-09-13T18:36:18.844663+0000","last_became_active":"2024-09-13T18:36:17.661573+0000","last_became_peered":"2024-09-13T18:36:17.661573+0000","last_unstale":"2024-09-13T18:36:18.844663+0000","last_undegraded":"2024-09-13T18:36:18.844663+0000","last_fullsized":"2024-09-13T18:36:18.844663+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:13.700222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.322193+0000","last_change":"2024-09-13T18:36:17.680372+0000","last_active":"2024-09-13T18:36:19.322193+0000","last_peered":"2024-09-13T18:36:19.322193+0000","last_clean":"2024-09-13T18:36:19.322193+0000","last_became_active":"2024-09-13T18:36:17.680035+0000","last_became_peered":"2024-09-13T18:36:17.680035+0000","last_unstale":"2024-09-13T18:36:19.322193+0000","last_undegraded":"2024-09-13T18:36:19.322193+0000","last_fullsized":"2024-09-13T18:36:19.322193+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:38.235882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663009+0000","last_change":"2024-09-13T18:36:17.675149+0000","last_active":"2024-09-13T18:36:18.663009+0000","last_peered":"2024-09-13T18:36:18.663009+0000","last_clean":"2024-09-13T18:36:18.663009+0000","last_became_active":"2024-09-13T18:36:17.674896+0000","last_became_peered":"2024-09-13T18:36:17.674896+0000","last_unstale":"2024-09-13T18:36:18.663009+0000","last_undegraded":"2024-09-13T18:36:18.663009+0000","last_fullsized":"2024-09-13T18:36:18.663009+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:30.699366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.843851+0000","last_change":"2024-09-13T18:36:17.676830+0000","last_active":"2024-09-13T18:36:18.843851+0000","last_peered":"2024-09-13T18:36:18.843851+0000","last_clean":"2024-09-13T18:36:18.843851+0000","last_became_active":"2024-09-13T18:36:17.676154+0000","last_became_peered":"2024-09-13T18:36:17.676154+0000","last_unstale":"2024-09-13T18:36:18.843851+0000","last_undegraded":"2024-09-13T18:36:18.843851+0000","last_fullsized":"2024-09-13T18:36:18.843851+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:48.134017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.662810+0000","last_change":"2024-09-13T18:36:17.668126+0000","last_active":"2024-09-13T18:36:18.662810+0000","last_peered":"2024-09-13T18:36:18.662810+0000","last_clean":"2024-09-13T18:36:18.662810+0000","last_became_active":"2024-09-13T18:36:17.667873+0000","last_became_peered":"2024-09-13T18:36:17.667873+0000","last_unstale":"2024-09-13T18:36:18.662810+0000","last_undegraded":"2024-09-13T18:36:18.662810+0000","last_fullsized":"2024-09-13T18:36:18.662810+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:43.478656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663578+0000","last_change":"2024-09-13T18:36:17.673230+0000","last_active":"2024-09-13T18:36:18.663578+0000","last_peered":"2024-09-13T18:36:18.663578+0000","last_clean":"2024-09-13T18:36:18.663578+0000","last_became_active":"2024-09-13T18:36:17.672619+0000","last_became_peered":"2024-09-13T18:36:17.672619+0000","last_unstale":"2024-09-13T18:36:18.663578+0000","last_undegraded":"2024-09-13T18:36:18.663578+0000","last_fullsized":"2024-09-13T18:36:18.663578+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:35.687923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.323214+0000","last_change":"2024-09-13T18:36:17.673836+0000","last_active":"2024-09-13T18:36:19.323214+0000","last_peered":"2024-09-13T18:36:19.323214+0000","last_clean":"2024-09-13T18:36:19.323214+0000","last_became_active":"2024-09-13T18:36:17.673580+0000","last_became_peered":"2024-09-13T18:36:17.673580+0000","last_unstale":"2024-09-13T18:36:19.323214+0000","last_undegraded":"2024-09-13T18:36:19.323214+0000","last_fullsized":"2024-09-13T18:36:19.323214+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:50.290502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.664212+0000","last_change":"2024-09-13T18:36:17.677841+0000","last_active":"2024-09-13T18:36:18.664212+0000","last_peered":"2024-09-13T18:36:18.664212+0000","last_clean":"2024-09-13T18:36:18.664212+0000","last_became_active":"2024-09-13T18:36:17.676340+0000","last_became_peered":"2024-09-13T18:36:17.676340+0000","last_unstale":"2024-09-13T18:36:18.664212+0000","last_undegraded":"2024-09-13T18:36:18.664212+0000","last_fullsized":"2024-09-13T18:36:18.664212+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:50.692612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321437+0000","last_change":"2024-09-13T18:36:17.673218+0000","last_active":"2024-09-13T18:36:19.321437+0000","last_peered":"2024-09-13T18:36:19.321437+0000","last_clean":"2024-09-13T18:36:19.321437+0000","last_became_active":"2024-09-13T18:36:17.672284+0000","last_became_peered":"2024-09-13T18:36:17.672284+0000","last_unstale":"2024-09-13T18:36:19.321437+0000","last_undegraded":"2024-09-13T18:36:19.321437+0000","last_fullsized":"2024-09-13T18:36:19.321437+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:03.234386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.322321+0000","last_change":"2024-09-13T18:36:17.682311+0000","last_active":"2024-09-13T18:36:19.322321+0000","last_peered":"2024-09-13T18:36:19.322321+0000","last_clean":"2024-09-13T18:36:19.322321+0000","last_became_active":"2024-09-13T18:36:17.682009+0000","last_became_peered":"2024-09-13T18:36:17.682009+0000","last_unstale":"2024-09-13T18:36:19.322321+0000","last_undegraded":"2024-09-13T18:36:19.322321+0000","last_fullsized":"2024-09-13T18:36:19.322321+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:24.366552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.844253+0000","last_change":"2024-09-13T18:36:17.661194+0000","last_active":"2024-09-13T18:36:18.844253+0000","last_peered":"2024-09-13T18:36:18.844253+0000","last_clean":"2024-09-13T18:36:18.844253+0000","last_became_active":"2024-09-13T18:36:17.660846+0000","last_became_peered":"2024-09-13T18:36:17.660846+0000","last_unstale":"2024-09-13T18:36:18.844253+0000","last_undegraded":"2024-09-13T18:36:18.844253+0000","last_fullsized":"2024-09-13T18:36:18.844253+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:41.086201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.662423+0000","last_change":"2024-09-13T18:36:17.677335+0000","last_active":"2024-09-13T18:36:18.662423+0000","last_peered":"2024-09-13T18:36:18.662423+0000","last_clean":"2024-09-13T18:36:18.662423+0000","last_became_active":"2024-09-13T18:36:17.677048+0000","last_became_peered":"2024-09-13T18:36:17.677048+0000","last_unstale":"2024-09-13T18:36:18.662423+0000","last_undegraded":"2024-09-13T18:36:18.662423+0000","last_fullsized":"2024-09-13T18:36:18.662423+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:03.890539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.320846+0000","last_change":"2024-09-13T18:36:17.670611+0000","last_active":"2024-09-13T18:36:19.320846+0000","last_peered":"2024-09-13T18:36:19.320846+0000","last_clean":"2024-09-13T18:36:19.320846+0000","last_became_active":"2024-09-13T18:36:17.670351+0000","last_became_peered":"2024-09-13T18:36:17.670351+0000","last_unstale":"2024-09-13T18:36:19.320846+0000","last_undegraded":"2024-09-13T18:36:19.320846+0000","last_fullsized":"2024-09-13T18:36:19.320846+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:31.655004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.323312+0000","last_change":"2024-09-13T18:36:17.678273+0000","last_active":"2024-09-13T18:36:19.323312+0000","last_peered":"2024-09-13T18:36:19.323312+0000","last_clean":"2024-09-13T18:36:19.323312+0000","last_became_active":"2024-09-13T18:36:17.677962+0000","last_became_peered":"2024-09-13T18:36:17.677962+0000","last_unstale":"2024-09-13T18:36:19.323312+0000","last_undegraded":"2024-09-13T18:36:19.323312+0000","last_fullsized":"2024-09-13T18:36:19.323312+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:58.717554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.844524+0000","last_change":"2024-09-13T18:36:17.667108+0000","last_active":"2024-09-13T18:36:18.844524+0000","last_peered":"2024-09-13T18:36:18.844524+0000","last_clean":"2024-09-13T18:36:18.844524+0000","last_became_active":"2024-09-13T18:36:17.666828+0000","last_became_peered":"2024-09-13T18:36:17.666828+0000","last_unstale":"2024-09-13T18:36:18.844524+0000","last_undegraded":"2024-09-13T18:36:18.844524+0000","last_fullsized":"2024-09-13T18:36:18.844524+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:23.109276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.320536+0000","last_change":"2024-09-13T18:36:17.670520+0000","last_active":"2024-09-13T18:36:19.320536+0000","last_peered":"2024-09-13T18:36:19.320536+0000","last_clean":"2024-09-13T18:36:19.320536+0000","last_became_active":"2024-09-13T18:36:17.670281+0000","last_became_peered":"2024-09-13T18:36:17.670281+0000","last_unstale":"2024-09-13T18:36:19.320536+0000","last_undegraded":"2024-09-13T18:36:19.320536+0000","last_fullsized":"2024-09-13T18:36:19.320536+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:41.347337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.844891+0000","last_change":"2024-09-13T18:36:17.672116+0000","last_active":"2024-09-13T18:36:18.844891+0000","last_peered":"2024-09-13T18:36:18.844891+0000","last_clean":"2024-09-13T18:36:18.844891+0000","last_became_active":"2024-09-13T18:36:17.671870+0000","last_became_peered":"2024-09-13T18:36:17.671870+0000","last_unstale":"2024-09-13T18:36:18.844891+0000","last_undegraded":"2024-09-13T18:36:18.844891+0000","last_fullsized":"2024-09-13T18:36:18.844891+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:59.514482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.844381+0000","last_change":"2024-09-13T18:36:17.676863+0000","last_active":"2024-09-13T18:36:18.844381+0000","last_peered":"2024-09-13T18:36:18.844381+0000","last_clean":"2024-09-13T18:36:18.844381+0000","last_became_active":"2024-09-13T18:36:17.673212+0000","last_became_peered":"2024-09-13T18:36:17.673212+0000","last_unstale":"2024-09-13T18:36:18.844381+0000","last_undegraded":"2024-09-13T18:36:18.844381+0000","last_fullsized":"2024-09-13T18:36:18.844381+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:45.615265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.664398+0000","last_change":"2024-09-13T18:36:17.674394+0000","last_active":"2024-09-13T18:36:18.664398+0000","last_peered":"2024-09-13T18:36:18.664398+0000","last_clean":"2024-09-13T18:36:18.664398+0000","last_became_active":"2024-09-13T18:36:17.674144+0000","last_became_peered":"2024-09-13T18:36:17.674144+0000","last_unstale":"2024-09-13T18:36:18.664398+0000","last_undegraded":"2024-09-13T18:36:18.664398+0000","last_fullsized":"2024-09-13T18:36:18.664398+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:05.322848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321160+0000","last_change":"2024-09-13T18:36:17.673721+0000","last_active":"2024-09-13T18:36:19.321160+0000","last_peered":"2024-09-13T18:36:19.321160+0000","last_clean":"2024-09-13T18:36:19.321160+0000","last_became_active":"2024-09-13T18:36:17.673210+0000","last_became_peered":"2024-09-13T18:36:17.673210+0000","last_unstale":"2024-09-13T18:36:19.321160+0000","last_undegraded":"2024-09-13T18:36:19.321160+0000","last_fullsized":"2024-09-13T18:36:19.321160+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:13.298112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.843822+0000","last_change":"2024-09-13T18:36:17.665031+0000","last_active":"2024-09-13T18:36:18.843822+0000","last_peered":"2024-09-13T18:36:18.843822+0000","last_clean":"2024-09-13T18:36:18.843822+0000","last_became_active":"2024-09-13T18:36:17.664085+0000","last_became_peered":"2024-09-13T18:36:17.664085+0000","last_unstale":"2024-09-13T18:36:18.843822+0000","last_undegraded":"2024-09-13T18:36:18.843822+0000","last_fullsized":"2024-09-13T18:36:18.843822+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:13.230813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663877+0000","last_change":"2024-09-13T18:36:17.669811+0000","last_active":"2024-09-13T18:36:18.663877+0000","last_peered":"2024-09-13T18:36:18.663877+0000","last_clean":"2024-09-13T18:36:18.663877+0000","last_became_active":"2024-09-13T18:36:17.669503+0000","last_became_peered":"2024-09-13T18:36:17.669503+0000","last_unstale":"2024-09-13T18:36:18.663877+0000","last_undegraded":"2024-09-13T18:36:18.663877+0000","last_fullsized":"2024-09-13T18:36:18.663877+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:36.212516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321634+0000","last_change":"2024-09-13T18:36:17.683606+0000","last_active":"2024-09-13T18:36:19.321634+0000","last_peered":"2024-09-13T18:36:19.321634+0000","last_clean":"2024-09-13T18:36:19.321634+0000","last_became_active":"2024-09-13T18:36:17.683294+0000","last_became_peered":"2024-09-13T18:36:17.683294+0000","last_unstale":"2024-09-13T18:36:19.321634+0000","last_undegraded":"2024-09-13T18:36:19.321634+0000","last_fullsized":"2024-09-13T18:36:19.321634+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:43.404901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321767+0000","last_change":"2024-09-13T18:36:17.677762+0000","last_active":"2024-09-13T18:36:19.321767+0000","last_peered":"2024-09-13T18:36:19.321767+0000","last_clean":"2024-09-13T18:36:19.321767+0000","last_became_active":"2024-09-13T18:36:17.676773+0000","last_became_peered":"2024-09-13T18:36:17.676773+0000","last_unstale":"2024-09-13T18:36:19.321767+0000","last_undegraded":"2024-09-13T18:36:19.321767+0000","last_fullsized":"2024-09-13T18:36:19.321767+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:35.687923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321447+0000","last_change":"2024-09-13T18:36:17.676989+0000","last_active":"2024-09-13T18:36:19.321447+0000","last_peered":"2024-09-13T18:36:19.321447+0000","last_clean":"2024-09-13T18:36:19.321447+0000","last_became_active":"2024-09-13T18:36:17.676731+0000","last_became_peered":"2024-09-13T18:36:17.676731+0000","last_unstale":"2024-09-13T18:36:19.321447+0000","last_undegraded":"2024-09-13T18:36:19.321447+0000","last_fullsized":"2024-09-13T18:36:19.321447+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:17.952709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663657+0000","last_change":"2024-09-13T18:36:17.677335+0000","last_active":"2024-09-13T18:36:18.663657+0000","last_peered":"2024-09-13T18:36:18.663657+0000","last_clean":"2024-09-13T18:36:18.663657+0000","last_became_active":"2024-09-13T18:36:17.677088+0000","last_became_peered":"2024-09-13T18:36:17.677088+0000","last_unstale":"2024-09-13T18:36:18.663657+0000","last_undegraded":"2024-09-13T18:36:18.663657+0000","last_fullsized":"2024-09-13T18:36:18.663657+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:46.906851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.664563+0000","last_change":"2024-09-13T18:36:17.668621+0000","last_active":"2024-09-13T18:36:18.664563+0000","last_peered":"2024-09-13T18:36:18.664563+0000","last_clean":"2024-09-13T18:36:18.664563+0000","last_became_active":"2024-09-13T18:36:17.668269+0000","last_became_peered":"2024-09-13T18:36:17.668269+0000","last_unstale":"2024-09-13T18:36:18.664563+0000","last_undegraded":"2024-09-13T18:36:18.664563+0000","last_fullsized":"2024-09-13T18:36:18.664563+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:36.265822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.320893+0000","last_change":"2024-09-13T18:36:17.674759+0000","last_active":"2024-09-13T18:36:19.320893+0000","last_peered":"2024-09-13T18:36:19.320893+0000","last_clean":"2024-09-13T18:36:19.320893+0000","last_became_active":"2024-09-13T18:36:17.671452+0000","last_became_peered":"2024-09-13T18:36:17.671452+0000","last_unstale":"2024-09-13T18:36:19.320893+0000","last_undegraded":"2024-09-13T18:36:19.320893+0000","last_fullsized":"2024-09-13T18:36:19.320893+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:26.112997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321320+0000","last_change":"2024-09-13T18:36:17.681262+0000","last_active":"2024-09-13T18:36:19.321320+0000","last_peered":"2024-09-13T18:36:19.321320+0000","last_clean":"2024-09-13T18:36:19.321320+0000","last_became_active":"2024-09-13T18:36:17.680992+0000","last_became_peered":"2024-09-13T18:36:17.680992+0000","last_unstale":"2024-09-13T18:36:19.321320+0000","last_undegraded":"2024-09-13T18:36:19.321320+0000","last_fullsized":"2024-09-13T18:36:19.321320+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:26.112997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.323071+0000","last_change":"2024-09-13T18:36:17.681537+0000","last_active":"2024-09-13T18:36:19.323071+0000","last_peered":"2024-09-13T18:36:19.323071+0000","last_clean":"2024-09-13T18:36:19.323071+0000","last_became_active":"2024-09-13T18:36:17.680549+0000","last_became_peered":"2024-09-13T18:36:17.680549+0000","last_unstale":"2024-09-13T18:36:19.323071+0000","last_undegraded":"2024-09-13T18:36:19.323071+0000","last_fullsized":"2024-09-13T18:36:19.323071+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:00.098401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"89'4","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.323859+0000","last_change":"2024-09-13T18:36:17.278517+0000","last_active":"2024-09-13T18:36:19.323859+0000","last_peered":"2024-09-13T18:36:19.323859+0000","last_clean":"2024-09-13T18:36:19.323859+0000","last_became_active":"2024-09-13T18:36:17.277987+0000","last_became_peered":"2024-09-13T18:36:17.277987+0000","last_unstale":"2024-09-13T18:36:19.323859+0000","last_undegraded":"2024-09-13T18:36:19.323859+0000","last_fullsized":"2024-09-13T18:36:19.323859+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:03.633472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.323714+0000","last_change":"2024-09-13T18:36:17.672844+0000","last_active":"2024-09-13T18:36:19.323714+0000","last_peered":"2024-09-13T18:36:19.323714+0000","last_clean":"2024-09-13T18:36:19.323714+0000","last_became_active":"2024-09-13T18:36:17.672526+0000","last_became_peered":"2024-09-13T18:36:17.672526+0000","last_unstale":"2024-09-13T18:36:19.323714+0000","last_undegraded":"2024-09-13T18:36:19.323714+0000","last_fullsized":"2024-09-13T18:36:19.323714+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:05.877716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"89'1","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.323308+0000","last_change":"2024-09-13T18:36:17.279620+0000","last_active":"2024-09-13T18:36:19.323308+0000","last_peered":"2024-09-13T18:36:19.323308+0000","last_clean":"2024-09-13T18:36:19.323308+0000","last_became_active":"2024-09-13T18:36:17.279324+0000","last_became_peered":"2024-09-13T18:36:17.279324+0000","last_unstale":"2024-09-13T18:36:19.323308+0000","last_undegraded":"2024-09-13T18:36:19.323308+0000","last_fullsized":"2024-09-13T18:36:19.323308+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:52.058941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321708+0000","last_change":"2024-09-13T18:36:17.680085+0000","last_active":"2024-09-13T18:36:19.321708+0000","last_peered":"2024-09-13T18:36:19.321708+0000","last_clean":"2024-09-13T18:36:19.321708+0000","last_became_active":"2024-09-13T18:36:17.679822+0000","last_became_peered":"2024-09-13T18:36:17.679822+0000","last_unstale":"2024-09-13T18:36:19.321708+0000","last_undegraded":"2024-09-13T18:36:19.321708+0000","last_fullsized":"2024-09-13T18:36:19.321708+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:52.643396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"89'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.320611+0000","last_change":"2024-09-13T18:36:17.276906+0000","last_active":"2024-09-13T18:36:19.320611+0000","last_peered":"2024-09-13T18:36:19.320611+0000","last_clean":"2024-09-13T18:36:19.320611+0000","last_became_active":"2024-09-13T18:36:17.276603+0000","last_became_peered":"2024-09-13T18:36:17.276603+0000","last_unstale":"2024-09-13T18:36:19.320611+0000","last_undegraded":"2024-09-13T18:36:19.320611+0000","last_fullsized":"2024-09-13T18:36:19.320611+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:52.935091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321855+0000","last_change":"2024-09-13T18:36:17.683352+0000","last_active":"2024-09-13T18:36:19.321855+0000","last_peered":"2024-09-13T18:36:19.321855+0000","last_clean":"2024-09-13T18:36:19.321855+0000","last_became_active":"2024-09-13T18:36:17.683038+0000","last_became_peered":"2024-09-13T18:36:17.683038+0000","last_unstale":"2024-09-13T18:36:19.321855+0000","last_undegraded":"2024-09-13T18:36:19.321855+0000","last_fullsized":"2024-09-13T18:36:19.321855+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:13.298112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"89'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.320267+0000","last_change":"2024-09-13T18:36:17.277866+0000","last_active":"2024-09-13T18:36:19.320267+0000","last_peered":"2024-09-13T18:36:19.320267+0000","last_clean":"2024-09-13T18:36:19.320267+0000","last_became_active":"2024-09-13T18:36:17.277500+0000","last_became_peered":"2024-09-13T18:36:17.277500+0000","last_unstale":"2024-09-13T18:36:19.320267+0000","last_undegraded":"2024-09-13T18:36:19.320267+0000","last_fullsized":"2024-09-13T18:36:19.320267+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:02.257763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.664495+0000","last_change":"2024-09-13T18:36:17.668458+0000","last_active":"2024-09-13T18:36:18.664495+0000","last_peered":"2024-09-13T18:36:18.664495+0000","last_clean":"2024-09-13T18:36:18.664495+0000","last_became_active":"2024-09-13T18:36:17.668028+0000","last_became_peered":"2024-09-13T18:36:17.668028+0000","last_unstale":"2024-09-13T18:36:18.664495+0000","last_undegraded":"2024-09-13T18:36:18.664495+0000","last_fullsized":"2024-09-13T18:36:18.664495+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:54.236759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"89'1","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.322673+0000","last_change":"2024-09-13T18:36:17.274583+0000","last_active":"2024-09-13T18:36:19.322673+0000","last_peered":"2024-09-13T18:36:19.322673+0000","last_clean":"2024-09-13T18:36:19.322673+0000","last_became_active":"2024-09-13T18:36:17.274301+0000","last_became_peered":"2024-09-13T18:36:17.274301+0000","last_unstale":"2024-09-13T18:36:19.322673+0000","last_undegraded":"2024-09-13T18:36:19.322673+0000","last_fullsized":"2024-09-13T18:36:19.322673+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:13.597752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.322427+0000","last_change":"2024-09-13T18:36:17.671146+0000","last_active":"2024-09-13T18:36:19.322427+0000","last_peered":"2024-09-13T18:36:19.322427+0000","last_clean":"2024-09-13T18:36:19.322427+0000","last_became_active":"2024-09-13T18:36:17.670409+0000","last_became_peered":"2024-09-13T18:36:17.670409+0000","last_unstale":"2024-09-13T18:36:19.322427+0000","last_undegraded":"2024-09-13T18:36:19.322427+0000","last_fullsized":"2024-09-13T18:36:19.322427+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:41.347337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"89'1","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.322251+0000","last_change":"2024-09-13T18:36:17.282323+0000","last_active":"2024-09-13T18:36:19.322251+0000","last_peered":"2024-09-13T18:36:19.322251+0000","last_clean":"2024-09-13T18:36:19.322251+0000","last_became_active":"2024-09-13T18:36:17.282101+0000","last_became_peered":"2024-09-13T18:36:17.282101+0000","last_unstale":"2024-09-13T18:36:19.322251+0000","last_undegraded":"2024-09-13T18:36:19.322251+0000","last_fullsized":"2024-09-13T18:36:19.322251+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:11.420704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321918+0000","last_change":"2024-09-13T18:36:17.677922+0000","last_active":"2024-09-13T18:36:19.321918+0000","last_peered":"2024-09-13T18:36:19.321918+0000","last_clean":"2024-09-13T18:36:19.321918+0000","last_became_active":"2024-09-13T18:36:17.677659+0000","last_became_peered":"2024-09-13T18:36:17.677659+0000","last_unstale":"2024-09-13T18:36:19.321918+0000","last_undegraded":"2024-09-13T18:36:19.321918+0000","last_fullsized":"2024-09-13T18:36:19.321918+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:50.290502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.319654+0000","last_change":"2024-09-13T18:36:17.272416+0000","last_active":"2024-09-13T18:36:19.319654+0000","last_peered":"2024-09-13T18:36:19.319654+0000","last_clean":"2024-09-13T18:36:19.319654+0000","last_became_active":"2024-09-13T18:36:17.272147+0000","last_became_peered":"2024-09-13T18:36:17.272147+0000","last_unstale":"2024-09-13T18:36:19.319654+0000","last_undegraded":"2024-09-13T18:36:19.319654+0000","last_fullsized":"2024-09-13T18:36:19.319654+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:35.677623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.662338+0000","last_change":"2024-09-13T18:36:17.677522+0000","last_active":"2024-09-13T18:36:18.662338+0000","last_peered":"2024-09-13T18:36:18.662338+0000","last_clean":"2024-09-13T18:36:18.662338+0000","last_became_active":"2024-09-13T18:36:17.676956+0000","last_became_peered":"2024-09-13T18:36:17.676956+0000","last_unstale":"2024-09-13T18:36:18.662338+0000","last_undegraded":"2024-09-13T18:36:18.662338+0000","last_fullsized":"2024-09-13T18:36:18.662338+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:24.366552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663521+0000","last_change":"2024-09-13T18:36:17.279718+0000","last_active":"2024-09-13T18:36:18.663521+0000","last_peered":"2024-09-13T18:36:18.663521+0000","last_clean":"2024-09-13T18:36:18.663521+0000","last_became_active":"2024-09-13T18:36:17.279240+0000","last_became_peered":"2024-09-13T18:36:17.279240+0000","last_unstale":"2024-09-13T18:36:18.663521+0000","last_undegraded":"2024-09-13T18:36:18.663521+0000","last_fullsized":"2024-09-13T18:36:18.663521+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:16.323883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.662772+0000","last_change":"2024-09-13T18:36:17.669405+0000","last_active":"2024-09-13T18:36:18.662772+0000","last_peered":"2024-09-13T18:36:18.662772+0000","last_clean":"2024-09-13T18:36:18.662772+0000","last_became_active":"2024-09-13T18:36:17.669166+0000","last_became_peered":"2024-09-13T18:36:17.669166+0000","last_unstale":"2024-09-13T18:36:18.662772+0000","last_undegraded":"2024-09-13T18:36:18.662772+0000","last_fullsized":"2024-09-13T18:36:18.662772+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:02.373068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.324000+0000","last_change":"2024-09-13T18:36:17.279614+0000","last_active":"2024-09-13T18:36:19.324000+0000","last_peered":"2024-09-13T18:36:19.324000+0000","last_clean":"2024-09-13T18:36:19.324000+0000","last_became_active":"2024-09-13T18:36:17.279386+0000","last_became_peered":"2024-09-13T18:36:17.279386+0000","last_unstale":"2024-09-13T18:36:19.324000+0000","last_undegraded":"2024-09-13T18:36:19.324000+0000","last_fullsized":"2024-09-13T18:36:19.324000+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:35.262556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663548+0000","last_change":"2024-09-13T18:36:17.675194+0000","last_active":"2024-09-13T18:36:18.663548+0000","last_peered":"2024-09-13T18:36:18.663548+0000","last_clean":"2024-09-13T18:36:18.663548+0000","last_became_active":"2024-09-13T18:36:17.674964+0000","last_became_peered":"2024-09-13T18:36:17.674964+0000","last_unstale":"2024-09-13T18:36:18.663548+0000","last_undegraded":"2024-09-13T18:36:18.663548+0000","last_fullsized":"2024-09-13T18:36:18.663548+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:54.170972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.323530+0000","last_change":"2024-09-13T18:36:17.268932+0000","last_active":"2024-09-13T18:36:19.323530+0000","last_peered":"2024-09-13T18:36:19.323530+0000","last_clean":"2024-09-13T18:36:19.323530+0000","last_became_active":"2024-09-13T18:36:17.268649+0000","last_became_peered":"2024-09-13T18:36:17.268649+0000","last_unstale":"2024-09-13T18:36:19.323530+0000","last_undegraded":"2024-09-13T18:36:19.323530+0000","last_fullsized":"2024-09-13T18:36:19.323530+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:45.903585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.320147+0000","last_change":"2024-09-13T18:36:17.666031+0000","last_active":"2024-09-13T18:36:19.320147+0000","last_peered":"2024-09-13T18:36:19.320147+0000","last_clean":"2024-09-13T18:36:19.320147+0000","last_became_active":"2024-09-13T18:36:17.665758+0000","last_became_peered":"2024-09-13T18:36:17.665758+0000","last_unstale":"2024-09-13T18:36:19.320147+0000","last_undegraded":"2024-09-13T18:36:19.320147+0000","last_fullsized":"2024-09-13T18:36:19.320147+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:35.687923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"89'3","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321478+0000","last_change":"2024-09-13T18:36:17.278744+0000","last_active":"2024-09-13T18:36:19.321478+0000","last_peered":"2024-09-13T18:36:19.321478+0000","last_clean":"2024-09-13T18:36:19.321478+0000","last_became_active":"2024-09-13T18:36:17.278272+0000","last_became_peered":"2024-09-13T18:36:17.278272+0000","last_unstale":"2024-09-13T18:36:19.321478+0000","last_undegraded":"2024-09-13T18:36:19.321478+0000","last_fullsized":"2024-09-13T18:36:19.321478+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:04.319582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.322874+0000","last_change":"2024-09-13T18:36:17.676486+0000","last_active":"2024-09-13T18:36:19.322874+0000","last_peered":"2024-09-13T18:36:19.322874+0000","last_clean":"2024-09-13T18:36:19.322874+0000","last_became_active":"2024-09-13T18:36:17.675965+0000","last_became_peered":"2024-09-13T18:36:17.675965+0000","last_unstale":"2024-09-13T18:36:19.322874+0000","last_undegraded":"2024-09-13T18:36:19.322874+0000","last_fullsized":"2024-09-13T18:36:19.322874+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:52.643396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"89'6","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663201+0000","last_change":"2024-09-13T18:36:17.276763+0000","last_active":"2024-09-13T18:36:18.663201+0000","last_peered":"2024-09-13T18:36:18.663201+0000","last_clean":"2024-09-13T18:36:18.663201+0000","last_became_active":"2024-09-13T18:36:17.276158+0000","last_became_peered":"2024-09-13T18:36:17.276158+0000","last_unstale":"2024-09-13T18:36:18.663201+0000","last_undegraded":"2024-09-13T18:36:18.663201+0000","last_fullsized":"2024-09-13T18:36:18.663201+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:04.319582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.319563+0000","last_change":"2024-09-13T18:36:17.670515+0000","last_active":"2024-09-13T18:36:19.319563+0000","last_peered":"2024-09-13T18:36:19.319563+0000","last_clean":"2024-09-13T18:36:19.319563+0000","last_became_active":"2024-09-13T18:36:17.670217+0000","last_became_peered":"2024-09-13T18:36:17.670217+0000","last_unstale":"2024-09-13T18:36:19.319563+0000","last_undegraded":"2024-09-13T18:36:19.319563+0000","last_fullsized":"2024-09-13T18:36:19.319563+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:58.717554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"89'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663780+0000","last_change":"2024-09-13T18:36:17.277888+0000","last_active":"2024-09-13T18:36:18.663780+0000","last_peered":"2024-09-13T18:36:18.663780+0000","last_clean":"2024-09-13T18:36:18.663780+0000","last_became_active":"2024-09-13T18:36:17.277628+0000","last_became_peered":"2024-09-13T18:36:17.277628+0000","last_unstale":"2024-09-13T18:36:18.663780+0000","last_undegraded":"2024-09-13T18:36:18.663780+0000","last_fullsized":"2024-09-13T18:36:18.663780+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:23.777619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.322389+0000","last_change":"2024-09-13T18:36:17.678500+0000","last_active":"2024-09-13T18:36:19.322389+0000","last_peered":"2024-09-13T18:36:19.322389+0000","last_clean":"2024-09-13T18:36:19.322389+0000","last_became_active":"2024-09-13T18:36:17.678210+0000","last_became_peered":"2024-09-13T18:36:17.678210+0000","last_unstale":"2024-09-13T18:36:19.322389+0000","last_undegraded":"2024-09-13T18:36:19.322389+0000","last_fullsized":"2024-09-13T18:36:19.322389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:55.326421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663062+0000","last_change":"2024-09-13T18:36:17.278746+0000","last_active":"2024-09-13T18:36:18.663062+0000","last_peered":"2024-09-13T18:36:18.663062+0000","last_clean":"2024-09-13T18:36:18.663062+0000","last_became_active":"2024-09-13T18:36:17.278331+0000","last_became_peered":"2024-09-13T18:36:17.278331+0000","last_unstale":"2024-09-13T18:36:18.663062+0000","last_undegraded":"2024-09-13T18:36:18.663062+0000","last_fullsized":"2024-09-13T18:36:18.663062+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:02.231120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663410+0000","last_change":"2024-09-13T18:36:17.673535+0000","last_active":"2024-09-13T18:36:18.663410+0000","last_peered":"2024-09-13T18:36:18.663410+0000","last_clean":"2024-09-13T18:36:18.663410+0000","last_became_active":"2024-09-13T18:36:17.668447+0000","last_became_peered":"2024-09-13T18:36:17.668447+0000","last_unstale":"2024-09-13T18:36:18.663410+0000","last_undegraded":"2024-09-13T18:36:18.663410+0000","last_fullsized":"2024-09-13T18:36:18.663410+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:09.336384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663058+0000","last_change":"2024-09-13T18:36:17.275625+0000","last_active":"2024-09-13T18:36:18.663058+0000","last_peered":"2024-09-13T18:36:18.663058+0000","last_clean":"2024-09-13T18:36:18.663058+0000","last_became_active":"2024-09-13T18:36:17.275352+0000","last_became_peered":"2024-09-13T18:36:17.275352+0000","last_unstale":"2024-09-13T18:36:18.663058+0000","last_undegraded":"2024-09-13T18:36:18.663058+0000","last_fullsized":"2024-09-13T18:36:18.663058+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:49.689346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663340+0000","last_change":"2024-09-13T18:36:17.669609+0000","last_active":"2024-09-13T18:36:18.663340+0000","last_peered":"2024-09-13T18:36:18.663340+0000","last_clean":"2024-09-13T18:36:18.663340+0000","last_became_active":"2024-09-13T18:36:17.669346+0000","last_became_peered":"2024-09-13T18:36:17.669346+0000","last_unstale":"2024-09-13T18:36:18.663340+0000","last_undegraded":"2024-09-13T18:36:18.663340+0000","last_fullsized":"2024-09-13T18:36:18.663340+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:04.636738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"89'8","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.319437+0000","last_change":"2024-09-13T18:36:17.272891+0000","last_active":"2024-09-13T18:36:19.319437+0000","last_peered":"2024-09-13T18:36:19.319437+0000","last_clean":"2024-09-13T18:36:19.319437+0000","last_became_active":"2024-09-13T18:36:17.272598+0000","last_became_peered":"2024-09-13T18:36:17.272598+0000","last_unstale":"2024-09-13T18:36:19.319437+0000","last_undegraded":"2024-09-13T18:36:19.319437+0000","last_fullsized":"2024-09-13T18:36:19.319437+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:49.689346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321915+0000","last_change":"2024-09-13T18:36:17.681736+0000","last_active":"2024-09-13T18:36:19.321915+0000","last_peered":"2024-09-13T18:36:19.321915+0000","last_clean":"2024-09-13T18:36:19.321915+0000","last_became_active":"2024-09-13T18:36:17.679331+0000","last_became_peered":"2024-09-13T18:36:17.679331+0000","last_unstale":"2024-09-13T18:36:19.321915+0000","last_undegraded":"2024-09-13T18:36:19.321915+0000","last_fullsized":"2024-09-13T18:36:19.321915+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:03.234386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"89'1","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.324112+0000","last_change":"2024-09-13T18:36:17.278316+0000","last_active":"2024-09-13T18:36:19.324112+0000","last_peered":"2024-09-13T18:36:19.324112+0000","last_clean":"2024-09-13T18:36:19.324112+0000","last_became_active":"2024-09-13T18:36:17.277563+0000","last_became_peered":"2024-09-13T18:36:17.277563+0000","last_unstale":"2024-09-13T18:36:19.324112+0000","last_undegraded":"2024-09-13T18:36:19.324112+0000","last_fullsized":"2024-09-13T18:36:19.324112+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:53.233493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.323865+0000","last_change":"2024-09-13T18:36:17.676312+0000","last_active":"2024-09-13T18:36:19.323865+0000","last_peered":"2024-09-13T18:36:19.323865+0000","last_clean":"2024-09-13T18:36:19.323865+0000","last_became_active":"2024-09-13T18:36:17.676031+0000","last_became_peered":"2024-09-13T18:36:17.676031+0000","last_unstale":"2024-09-13T18:36:19.323865+0000","last_undegraded":"2024-09-13T18:36:19.323865+0000","last_fullsized":"2024-09-13T18:36:19.323865+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:41.347337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"89'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.320452+0000","last_change":"2024-09-13T18:36:17.279020+0000","last_active":"2024-09-13T18:36:19.320452+0000","last_peered":"2024-09-13T18:36:19.320452+0000","last_clean":"2024-09-13T18:36:19.320452+0000","last_became_active":"2024-09-13T18:36:17.278761+0000","last_became_peered":"2024-09-13T18:36:17.278761+0000","last_unstale":"2024-09-13T18:36:19.320452+0000","last_undegraded":"2024-09-13T18:36:19.320452+0000","last_fullsized":"2024-09-13T18:36:19.320452+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:35.209250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.322871+0000","last_change":"2024-09-13T18:36:17.669917+0000","last_active":"2024-09-13T18:36:19.322871+0000","last_peered":"2024-09-13T18:36:19.322871+0000","last_clean":"2024-09-13T18:36:19.322871+0000","last_became_active":"2024-09-13T18:36:17.669632+0000","last_became_peered":"2024-09-13T18:36:17.669632+0000","last_unstale":"2024-09-13T18:36:19.322871+0000","last_undegraded":"2024-09-13T18:36:19.322871+0000","last_fullsized":"2024-09-13T18:36:19.322871+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:54.170972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.320388+0000","last_change":"2024-09-13T18:36:17.278226+0000","last_active":"2024-09-13T18:36:19.320388+0000","last_peered":"2024-09-13T18:36:19.320388+0000","last_clean":"2024-09-13T18:36:19.320388+0000","last_became_active":"2024-09-13T18:36:17.276959+0000","last_became_peered":"2024-09-13T18:36:17.276959+0000","last_unstale":"2024-09-13T18:36:19.320388+0000","last_undegraded":"2024-09-13T18:36:19.320388+0000","last_fullsized":"2024-09-13T18:36:19.320388+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:44.038102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.844438+0000","last_change":"2024-09-13T18:36:17.660999+0000","last_active":"2024-09-13T18:36:18.844438+0000","last_peered":"2024-09-13T18:36:18.844438+0000","last_clean":"2024-09-13T18:36:18.844438+0000","last_became_active":"2024-09-13T18:36:17.660511+0000","last_became_peered":"2024-09-13T18:36:17.660511+0000","last_unstale":"2024-09-13T18:36:18.844438+0000","last_undegraded":"2024-09-13T18:36:18.844438+0000","last_fullsized":"2024-09-13T18:36:18.844438+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:11.979714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"89'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.662596+0000","last_change":"2024-09-13T18:36:17.274999+0000","last_active":"2024-09-13T18:36:18.662596+0000","last_peered":"2024-09-13T18:36:18.662596+0000","last_clean":"2024-09-13T18:36:18.662596+0000","last_became_active":"2024-09-13T18:36:17.274640+0000","last_became_peered":"2024-09-13T18:36:17.274640+0000","last_unstale":"2024-09-13T18:36:18.662596+0000","last_undegraded":"2024-09-13T18:36:18.662596+0000","last_fullsized":"2024-09-13T18:36:18.662596+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:16.949443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663200+0000","last_change":"2024-09-13T18:36:17.670790+0000","last_active":"2024-09-13T18:36:18.663200+0000","last_peered":"2024-09-13T18:36:18.663200+0000","last_clean":"2024-09-13T18:36:18.663200+0000","last_became_active":"2024-09-13T18:36:17.670462+0000","last_became_peered":"2024-09-13T18:36:17.670462+0000","last_unstale":"2024-09-13T18:36:18.663200+0000","last_undegraded":"2024-09-13T18:36:18.663200+0000","last_fullsized":"2024-09-13T18:36:18.663200+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:43.395835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.844475+0000","last_change":"2024-09-13T18:36:17.278056+0000","last_active":"2024-09-13T18:36:18.844475+0000","last_peered":"2024-09-13T18:36:18.844475+0000","last_clean":"2024-09-13T18:36:18.844475+0000","last_became_active":"2024-09-13T18:36:17.277710+0000","last_became_peered":"2024-09-13T18:36:17.277710+0000","last_unstale":"2024-09-13T18:36:18.844475+0000","last_undegraded":"2024-09-13T18:36:18.844475+0000","last_fullsized":"2024-09-13T18:36:18.844475+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:29.186218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.843965+0000","last_change":"2024-09-13T18:36:17.665034+0000","last_active":"2024-09-13T18:36:18.843965+0000","last_peered":"2024-09-13T18:36:18.843965+0000","last_clean":"2024-09-13T18:36:18.843965+0000","last_became_active":"2024-09-13T18:36:17.664441+0000","last_became_peered":"2024-09-13T18:36:17.664441+0000","last_unstale":"2024-09-13T18:36:18.843965+0000","last_undegraded":"2024-09-13T18:36:18.843965+0000","last_fullsized":"2024-09-13T18:36:18.843965+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:23.947839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.843999+0000","last_change":"2024-09-13T18:36:17.272221+0000","last_active":"2024-09-13T18:36:18.843999+0000","last_peered":"2024-09-13T18:36:18.843999+0000","last_clean":"2024-09-13T18:36:18.843999+0000","last_became_active":"2024-09-13T18:36:17.271966+0000","last_became_peered":"2024-09-13T18:36:17.271966+0000","last_unstale":"2024-09-13T18:36:18.843999+0000","last_undegraded":"2024-09-13T18:36:18.843999+0000","last_fullsized":"2024-09-13T18:36:18.843999+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:30.691213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663111+0000","last_change":"2024-09-13T18:36:17.673030+0000","last_active":"2024-09-13T18:36:18.663111+0000","last_peered":"2024-09-13T18:36:18.663111+0000","last_clean":"2024-09-13T18:36:18.663111+0000","last_became_active":"2024-09-13T18:36:17.672777+0000","last_became_peered":"2024-09-13T18:36:17.672777+0000","last_unstale":"2024-09-13T18:36:18.663111+0000","last_undegraded":"2024-09-13T18:36:18.663111+0000","last_fullsized":"2024-09-13T18:36:18.663111+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:38.235882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.662383+0000","last_change":"2024-09-13T18:36:17.275084+0000","last_active":"2024-09-13T18:36:18.662383+0000","last_peered":"2024-09-13T18:36:18.662383+0000","last_clean":"2024-09-13T18:36:18.662383+0000","last_became_active":"2024-09-13T18:36:17.274702+0000","last_became_peered":"2024-09-13T18:36:17.274702+0000","last_unstale":"2024-09-13T18:36:18.662383+0000","last_undegraded":"2024-09-13T18:36:18.662383+0000","last_fullsized":"2024-09-13T18:36:18.662383+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:49.287236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.323112+0000","last_change":"2024-09-13T18:36:17.666412+0000","last_active":"2024-09-13T18:36:19.323112+0000","last_peered":"2024-09-13T18:36:19.323112+0000","last_clean":"2024-09-13T18:36:19.323112+0000","last_became_active":"2024-09-13T18:36:17.665823+0000","last_became_peered":"2024-09-13T18:36:17.665823+0000","last_unstale":"2024-09-13T18:36:19.323112+0000","last_undegraded":"2024-09-13T18:36:19.323112+0000","last_fullsized":"2024-09-13T18:36:19.323112+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:43.395835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"89'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.664926+0000","last_change":"2024-09-13T18:36:17.275530+0000","last_active":"2024-09-13T18:36:18.664926+0000","last_peered":"2024-09-13T18:36:18.664926+0000","last_clean":"2024-09-13T18:36:18.664926+0000","last_became_active":"2024-09-13T18:36:17.275218+0000","last_became_peered":"2024-09-13T18:36:17.275218+0000","last_unstale":"2024-09-13T18:36:18.664926+0000","last_undegraded":"2024-09-13T18:36:18.664926+0000","last_fullsized":"2024-09-13T18:36:18.664926+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:01.899080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321974+0000","last_change":"2024-09-13T18:36:17.682470+0000","last_active":"2024-09-13T18:36:19.321974+0000","last_peered":"2024-09-13T18:36:19.321974+0000","last_clean":"2024-09-13T18:36:19.321974+0000","last_became_active":"2024-09-13T18:36:17.682137+0000","last_became_peered":"2024-09-13T18:36:17.682137+0000","last_unstale":"2024-09-13T18:36:19.321974+0000","last_undegraded":"2024-09-13T18:36:19.321974+0000","last_fullsized":"2024-09-13T18:36:19.321974+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:03.890539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.664723+0000","last_change":"2024-09-13T18:36:17.280636+0000","last_active":"2024-09-13T18:36:18.664723+0000","last_peered":"2024-09-13T18:36:18.664723+0000","last_clean":"2024-09-13T18:36:18.664723+0000","last_became_active":"2024-09-13T18:36:17.280358+0000","last_became_peered":"2024-09-13T18:36:17.280358+0000","last_unstale":"2024-09-13T18:36:18.664723+0000","last_undegraded":"2024-09-13T18:36:18.664723+0000","last_fullsized":"2024-09-13T18:36:18.664723+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:16.473717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321886+0000","last_change":"2024-09-13T18:36:17.674511+0000","last_active":"2024-09-13T18:36:19.321886+0000","last_peered":"2024-09-13T18:36:19.321886+0000","last_clean":"2024-09-13T18:36:19.321886+0000","last_became_active":"2024-09-13T18:36:17.674264+0000","last_became_peered":"2024-09-13T18:36:17.674264+0000","last_unstale":"2024-09-13T18:36:19.321886+0000","last_undegraded":"2024-09-13T18:36:19.321886+0000","last_fullsized":"2024-09-13T18:36:19.321886+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:37.480253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321680+0000","last_change":"2024-09-13T18:36:17.278108+0000","last_active":"2024-09-13T18:36:19.321680+0000","last_peered":"2024-09-13T18:36:19.321680+0000","last_clean":"2024-09-13T18:36:19.321680+0000","last_became_active":"2024-09-13T18:36:17.277738+0000","last_became_peered":"2024-09-13T18:36:17.277738+0000","last_unstale":"2024-09-13T18:36:19.321680+0000","last_undegraded":"2024-09-13T18:36:19.321680+0000","last_fullsized":"2024-09-13T18:36:19.321680+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:08.333118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.323072+0000","last_change":"2024-09-13T18:36:17.674348+0000","last_active":"2024-09-13T18:36:19.323072+0000","last_peered":"2024-09-13T18:36:19.323072+0000","last_clean":"2024-09-13T18:36:19.323072+0000","last_became_active":"2024-09-13T18:36:17.673945+0000","last_became_peered":"2024-09-13T18:36:17.673945+0000","last_unstale":"2024-09-13T18:36:19.323072+0000","last_undegraded":"2024-09-13T18:36:19.323072+0000","last_fullsized":"2024-09-13T18:36:19.323072+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:43.478656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321995+0000","last_change":"2024-09-13T18:36:17.276910+0000","last_active":"2024-09-13T18:36:19.321995+0000","last_peered":"2024-09-13T18:36:19.321995+0000","last_clean":"2024-09-13T18:36:19.321995+0000","last_became_active":"2024-09-13T18:36:17.276525+0000","last_became_peered":"2024-09-13T18:36:17.276525+0000","last_unstale":"2024-09-13T18:36:19.321995+0000","last_undegraded":"2024-09-13T18:36:19.321995+0000","last_fullsized":"2024-09-13T18:36:19.321995+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:35.209250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663109+0000","last_change":"2024-09-13T18:36:17.665615+0000","last_active":"2024-09-13T18:36:18.663109+0000","last_peered":"2024-09-13T18:36:18.663109+0000","last_clean":"2024-09-13T18:36:18.663109+0000","last_became_active":"2024-09-13T18:36:17.665346+0000","last_became_peered":"2024-09-13T18:36:17.665346+0000","last_unstale":"2024-09-13T18:36:18.663109+0000","last_undegraded":"2024-09-13T18:36:18.663109+0000","last_fullsized":"2024-09-13T18:36:18.663109+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:41.347337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.320091+0000","last_change":"2024-09-13T18:36:17.277396+0000","last_active":"2024-09-13T18:36:19.320091+0000","last_peered":"2024-09-13T18:36:19.320091+0000","last_clean":"2024-09-13T18:36:19.320091+0000","last_became_active":"2024-09-13T18:36:17.276866+0000","last_became_peered":"2024-09-13T18:36:17.276866+0000","last_unstale":"2024-09-13T18:36:19.320091+0000","last_undegraded":"2024-09-13T18:36:19.320091+0000","last_fullsized":"2024-09-13T18:36:19.320091+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:45.903585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.319729+0000","last_change":"2024-09-13T18:36:17.675654+0000","last_active":"2024-09-13T18:36:19.319729+0000","last_peered":"2024-09-13T18:36:19.319729+0000","last_clean":"2024-09-13T18:36:19.319729+0000","last_became_active":"2024-09-13T18:36:17.675410+0000","last_became_peered":"2024-09-13T18:36:17.675410+0000","last_unstale":"2024-09-13T18:36:19.319729+0000","last_undegraded":"2024-09-13T18:36:19.319729+0000","last_fullsized":"2024-09-13T18:36:19.319729+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:31.655004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.322355+0000","last_change":"2024-09-13T18:36:17.279726+0000","last_active":"2024-09-13T18:36:19.322355+0000","last_peered":"2024-09-13T18:36:19.322355+0000","last_clean":"2024-09-13T18:36:19.322355+0000","last_became_active":"2024-09-13T18:36:17.279416+0000","last_became_peered":"2024-09-13T18:36:17.279416+0000","last_unstale":"2024-09-13T18:36:19.322355+0000","last_undegraded":"2024-09-13T18:36:19.322355+0000","last_fullsized":"2024-09-13T18:36:19.322355+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:46.370775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.322090+0000","last_change":"2024-09-13T18:36:17.683607+0000","last_active":"2024-09-13T18:36:19.322090+0000","last_peered":"2024-09-13T18:36:19.322090+0000","last_clean":"2024-09-13T18:36:19.322090+0000","last_became_active":"2024-09-13T18:36:17.683275+0000","last_became_peered":"2024-09-13T18:36:17.683275+0000","last_unstale":"2024-09-13T18:36:19.322090+0000","last_undegraded":"2024-09-13T18:36:19.322090+0000","last_fullsized":"2024-09-13T18:36:19.322090+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:23.738785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321396+0000","last_change":"2024-09-13T18:36:17.280294+0000","last_active":"2024-09-13T18:36:19.321396+0000","last_peered":"2024-09-13T18:36:19.321396+0000","last_clean":"2024-09-13T18:36:19.321396+0000","last_became_active":"2024-09-13T18:36:17.280014+0000","last_became_peered":"2024-09-13T18:36:17.280014+0000","last_unstale":"2024-09-13T18:36:19.321396+0000","last_undegraded":"2024-09-13T18:36:19.321396+0000","last_fullsized":"2024-09-13T18:36:19.321396+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:56.392856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321207+0000","last_change":"2024-09-13T18:36:17.674746+0000","last_active":"2024-09-13T18:36:19.321207+0000","last_peered":"2024-09-13T18:36:19.321207+0000","last_clean":"2024-09-13T18:36:19.321207+0000","last_became_active":"2024-09-13T18:36:17.674438+0000","last_became_peered":"2024-09-13T18:36:17.674438+0000","last_unstale":"2024-09-13T18:36:19.321207+0000","last_undegraded":"2024-09-13T18:36:19.321207+0000","last_fullsized":"2024-09-13T18:36:19.321207+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:40:22.773088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.320984+0000","last_change":"2024-09-13T18:36:17.276752+0000","last_active":"2024-09-13T18:36:19.320984+0000","last_peered":"2024-09-13T18:36:19.320984+0000","last_clean":"2024-09-13T18:36:19.320984+0000","last_became_active":"2024-09-13T18:36:17.276476+0000","last_became_peered":"2024-09-13T18:36:17.276476+0000","last_unstale":"2024-09-13T18:36:19.320984+0000","last_undegraded":"2024-09-13T18:36:19.320984+0000","last_fullsized":"2024-09-13T18:36:19.320984+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:53.233493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:18.663763+0000","last_change":"2024-09-13T18:36:17.670013+0000","last_active":"2024-09-13T18:36:18.663763+0000","last_peered":"2024-09-13T18:36:18.663763+0000","last_clean":"2024-09-13T18:36:18.663763+0000","last_became_active":"2024-09-13T18:36:17.667589+0000","last_became_peered":"2024-09-13T18:36:17.667589+0000","last_unstale":"2024-09-13T18:36:18.663763+0000","last_undegraded":"2024-09-13T18:36:18.663763+0000","last_fullsized":"2024-09-13T18:36:18.663763+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:17.244349+0000","last_clean_scrub_stamp":"2024-09-13T18:36:17.244349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:12.423970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"89'1","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:36:19.321988+0000","last_change":"2024-09-13T18:36:17.279051+0000","last_active":"2024-09-13T18:36:19.321988+0000","last_peered":"2024-09-13T18:36:19.321988+0000","last_clean":"2024-09-13T18:36:19.321988+0000","last_became_active":"2024-09-13T18:36:17.278750+0000","last_became_peered":"2024-09-13T18:36:17.278750+0000","last_unstale":"2024-09-13T18:36:19.321988+0000","last_undegraded":"2024-09-13T18:36:19.321988+0000","last_fullsized":"2024-09-13T18:36:19.321988+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:16.241083+0000","last_clean_scrub_stamp":"2024-09-13T18:36:16.241083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:37.232616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":226,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T18:36:17.673935+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:36:17.673935+0000","last_peered":"2024-09-13T18:36:17.673935+0000","last_clean":"2024-09-13T18:36:17.673935+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:36:17.673935+0000","last_undegraded":"2024-09-13T18:36:17.673935+0000","last_fullsized":"2024-09-13T18:36:17.673935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1691648,"data_stored":1060995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75800000000000001,"15min":0.75900000000000001},"min":{"1min":0.49399999999999999,"5min":0.38700000000000001,"15min":0.33600000000000002},"max":{"1min":1.0509999999999999,"5min":1.0760000000000001,"15min":1.163},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.78500000000000003},"min":{"1min":0.46500000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.149,"5min":1.288,"15min":1.288},"last":0.72099999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.84199999999999997,"15min":0.872},"min":{"1min":0.57899999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.115,"5min":1.288,"15min":1.7689999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89400000000000002,"15min":0.92900000000000005},"min":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.52600000000000002},"max":{"1min":1.175,"5min":1.3009999999999999,"15min":1.6140000000000001},"last":0.64600000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.84199999999999997},"min":{"1min":0.60199999999999998,"5min":0.45500000000000002,"15min":0.40500000000000003},"max":{"1min":0.98999999999999999,"5min":1.2270000000000001,"15min":1.3340000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.82599999999999996,"15min":0.879},"min":{"1min":0.64700000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0509999999999999,"5min":1.524,"15min":1.6659999999999999},"last":1.113}]},{"osd":3,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.88400000000000001,"15min":0.88600000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.52600000000000002},"max":{"1min":1.1160000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1990000000000001,"5min":1.486,"15min":1.486},"last":1.05}]},{"osd":4,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.84699999999999998,"15min":0.876},"min":{"1min":0.58999999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0649999999999999,"5min":1.4590000000000001,"15min":1.7290000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.02,"15min":1.0329999999999999},"min":{"1min":0.88700000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.226,"5min":1.49,"15min":1.7050000000000001},"last":1.0820000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.94599999999999995,"15min":0.95099999999999996},"min":{"1min":0.64000000000000001,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2490000000000001,"5min":1.4159999999999999,"15min":1.4259999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.044,"15min":1.0489999999999999},"min":{"1min":0.74199999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.325,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0249999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0409999999999999,"15min":1.075},"min":{"1min":0.626,"5min":0.626,"15min":0.58099999999999996},"max":{"1min":1.3500000000000001,"5min":1.4730000000000001,"15min":2.077},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.087,"15min":1.0740000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.69099999999999995},"max":{"1min":1.323,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.159}]}]},{"osd":6,"up_from":13,"seq":55834574967,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1105920,"data_stored":471251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.80700000000000005,"15min":0.82099999999999995},"min":{"1min":0.439,"5min":0.438,"15min":0.438},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.78900000000000003,"15min":0.81599999999999995},"min":{"1min":0.54700000000000004,"5min":0.45800000000000002,"15min":0.42099999999999999},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.73199999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.79000000000000004,"15min":0.81399999999999995},"min":{"1min":0.52000000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.84499999999999997,"15min":0.83399999999999996},"min":{"1min":0.504,"5min":0.48299999999999998,"15min":0.48099999999999998},"max":{"1min":1.2130000000000001,"5min":1.262,"15min":1.262},"last":0.65700000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.81399999999999995,"15min":0.81499999999999995},"min":{"1min":0.66200000000000003,"5min":0.47399999999999998,"15min":0.46899999999999997},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.157},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.85799999999999998,"15min":0.85999999999999999},"min":{"1min":0.54400000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.0169999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.92000000000000004,"15min":0.88800000000000001},"min":{"1min":0.71899999999999997,"5min":0.57599999999999996,"15min":0.52300000000000002},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.90100000000000002,"15min":0.93500000000000005},"min":{"1min":0.73099999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2330000000000001,"5min":1.2390000000000001,"15min":1.2909999999999999},"last":0.82299999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.871,"15min":0.88200000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.57699999999999996},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.97499999999999998,"15min":0.99199999999999999},"min":{"1min":0.63100000000000001,"5min":0.623,"15min":0.623},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.95099999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0429999999999999,"15min":1.0409999999999999},"min":{"1min":0.69099999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.97799999999999998,"15min":0.97999999999999998},"min":{"1min":0.70799999999999996,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.419,"5min":1.419,"15min":1.4990000000000001},"last":1.05}]},{"osd":7,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0129999999999999,"15min":1.0009999999999999},"min":{"1min":0.67800000000000005,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.131},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.121,"15min":1.1140000000000001},"min":{"1min":0.89900000000000002,"5min":0.76200000000000001,"15min":0.76000000000000001},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.1020000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1122304,"data_stored":478443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76800000000000002,"15min":0.81699999999999995},"min":{"1min":0.56200000000000006,"5min":0.46899999999999997,"15min":0.39800000000000002},"max":{"1min":1.0309999999999999,"5min":1.3280000000000001,"15min":1.3640000000000001},"last":1.149},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.81000000000000005,"15min":0.84899999999999998},"min":{"1min":0.60799999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1559999999999999,"5min":1.194,"15min":1.482},"last":0.93100000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.79300000000000004,"15min":0.79500000000000004},"min":{"1min":0.57399999999999995,"5min":0.42499999999999999,"15min":0.40999999999999998},"max":{"1min":1.008,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85599999999999998,"15min":0.90900000000000003},"min":{"1min":0.55100000000000005,"5min":0.50900000000000001,"15min":0.45200000000000001},"max":{"1min":1.1200000000000001,"5min":1.218,"15min":1.4850000000000001},"last":0.95999999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.92500000000000004,"15min":0.94599999999999995},"min":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.51300000000000001},"max":{"1min":1.115,"5min":1.2430000000000001,"15min":1.4179999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93500000000000005,"15min":0.98199999999999998},"min":{"1min":0.59799999999999998,"5min":0.51800000000000002,"15min":0.46500000000000002},"max":{"1min":1.1519999999999999,"5min":1.2849999999999999,"15min":1.4690000000000001},"last":0.77800000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.878,"15min":0.92400000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.51700000000000002},"max":{"1min":1.117,"5min":1.2010000000000001,"15min":1.4510000000000001},"last":1.28},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89500000000000002,"15min":0.92600000000000005},"min":{"1min":0.65400000000000003,"5min":0.61199999999999999,"15min":0.55300000000000005},"max":{"1min":1.1679999999999999,"5min":1.335,"15min":1.4990000000000001},"last":0.89200000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.91300000000000003,"15min":0.95199999999999996},"min":{"1min":0.57599999999999996,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2549999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95799999999999996,"15min":1.0089999999999999},"min":{"1min":0.628,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.206,"5min":1.302,"15min":1.542},"last":1.1160000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.97799999999999998,"15min":1.0129999999999999},"min":{"1min":0.83599999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2989999999999999,"5min":1.4259999999999999,"15min":1.698},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1020000000000001,"15min":1.1419999999999999},"min":{"1min":0.90400000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.2170000000000001,"5min":1.52,"15min":1.581},"last":1.2330000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.0589999999999999,"15min":1.1419999999999999},"min":{"1min":0.68500000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.256,"5min":1.552,"15min":1.847},"last":1.036},{"interface":"front","average":{"1min":1.069,"5min":1.0640000000000001,"15min":1.117},"min":{"1min":0.72399999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2549999999999999,"5min":1.4259999999999999,"15min":1.8100000000000001},"last":1.0900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574965,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46144,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325696,"statfs":{"total":96636764160,"available":96589512704,"internally_reserved":0,"allocated":1093632,"data_stored":470557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.82299999999999995,"15min":0.875},"min":{"1min":0.52000000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.159,"5min":1.1930000000000001,"15min":1.3720000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.89500000000000002,"15min":0.93999999999999995},"min":{"1min":0.57299999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.163,"5min":1.21,"15min":1.5229999999999999},"last":0.85899999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.54300000000000004,"5min":0.47099999999999997,"15min":0.435},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.84199999999999997,"15min":0.84599999999999997},"min":{"1min":0.58399999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1859999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.76200000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.80000000000000004,"15min":0.83899999999999997},"min":{"1min":0.67100000000000004,"5min":0.46300000000000002,"15min":0.44600000000000001},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.871,"5min":0.86499999999999999,"15min":0.85499999999999998},"min":{"1min":0.58199999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.212,"5min":1.331,"15min":1.331},"last":0.64200000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.89300000000000002,"15min":0.94999999999999996},"min":{"1min":0.55800000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.639},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.91200000000000003,"15min":0.96499999999999997},"min":{"1min":0.70499999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.8300000000000001},"last":0.79700000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.91700000000000004,"15min":0.95999999999999996},"min":{"1min":0.67300000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.327,"5min":1.518,"15min":2.3889999999999998},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.052,"15min":1.093},"min":{"1min":0.91200000000000003,"5min":0.66100000000000003,"15min":0.626},"max":{"1min":1.605,"5min":1.605,"15min":2.0049999999999999},"last":0.93700000000000006}]},{"osd":6,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94599999999999995,"15min":0.91500000000000004},"min":{"1min":0.69199999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2929999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.121,"5min":1.0840000000000001,"15min":1.0960000000000001},"min":{"1min":0.873,"5min":0.70099999999999996,"15min":0.63500000000000001},"max":{"1min":1.409,"5min":1.4259999999999999,"15min":1.794},"last":1.038}]},{"osd":7,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0509999999999999,"15min":1.0680000000000001},"min":{"1min":0.66100000000000003,"5min":0.65200000000000002,"15min":0.60499999999999998},"max":{"1min":1.659,"5min":1.659,"15min":1.669},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0529999999999999,"15min":1.0349999999999999},"min":{"1min":0.877,"5min":0.69499999999999995,"15min":0.61799999999999999},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.1359999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574968,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1118208,"data_stored":478421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64200000000000002,"15min":0.66100000000000003},"min":{"1min":0.38300000000000001,"5min":0.22,"15min":0.22},"max":{"1min":1.0489999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.622,"15min":0.65700000000000003},"min":{"1min":0.434,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":1.008,"5min":1.008,"15min":1.1970000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.67800000000000005,"15min":0.68999999999999995},"min":{"1min":0.44600000000000001,"5min":0.24099999999999999,"15min":0.23100000000000001},"max":{"1min":0.98299999999999998,"5min":1.379,"15min":1.379},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.751,"15min":0.79300000000000004},"min":{"1min":0.46200000000000002,"5min":0.30199999999999999,"15min":0.23499999999999999},"max":{"1min":1.238,"5min":1.397,"15min":2.0030000000000001},"last":0.67300000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.40899999999999997,"5min":0.32500000000000001,"15min":0.29299999999999998},"max":{"1min":0.91000000000000003,"5min":1.3300000000000001,"15min":1.333},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.83999999999999997,"15min":0.86699999999999999},"min":{"1min":0.55600000000000005,"5min":0.33000000000000002,"15min":0.27300000000000002},"max":{"1min":1.296,"5min":1.423,"15min":1.423},"last":0.53900000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.88400000000000001,"15min":0.92900000000000005},"min":{"1min":0.58399999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1779999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.97099999999999997,"15min":1.0089999999999999},"min":{"1min":0.67400000000000004,"5min":0.56899999999999995,"15min":0.52300000000000002},"max":{"1min":1.3440000000000001,"5min":1.587,"15min":1.587},"last":1.1559999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.038,"15min":1.119},"min":{"1min":0.83299999999999996,"5min":0.55200000000000005,"15min":0.51400000000000001},"max":{"1min":1.3089999999999999,"5min":1.6200000000000001,"15min":2.2320000000000002},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1,"15min":1.0680000000000001},"min":{"1min":0.65100000000000002,"5min":0.53900000000000003,"15min":0.53600000000000003},"max":{"1min":1.252,"5min":1.3280000000000001,"15min":1.718},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0589999999999999,"15min":1.097},"min":{"1min":0.69699999999999995,"5min":0.60199999999999998,"15min":0.496},"max":{"1min":1.4259999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.0900000000000001,"15min":1.1699999999999999},"min":{"1min":0.79100000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.385,"5min":1.51,"15min":2.1819999999999999},"last":0.877}]},{"osd":7,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0329999999999999,"15min":1.0740000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.624},"max":{"1min":1.391,"5min":1.391,"15min":1.4670000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.073,"5min":1.101,"15min":1.143},"min":{"1min":0.69999999999999996,"5min":0.57499999999999996,"15min":0.54300000000000004},"max":{"1min":1.367,"5min":1.548,"15min":1.5920000000000001},"last":1.379}]}]},{"osd":2,"up_from":13,"seq":55834574966,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40392,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331448,"statfs":{"total":96636764160,"available":96595402752,"internally_reserved":0,"allocated":1110016,"data_stored":477439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63600000000000001,"15min":0.65800000000000003},"min":{"1min":0.45100000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":1.0009999999999999,"5min":1.1020000000000001,"15min":1.1919999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.72199999999999998,"15min":0.76700000000000002},"min":{"1min":0.56000000000000005,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.4370000000000001},"last":0.91800000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65500000000000003,"15min":0.69099999999999995},"min":{"1min":0.48399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.94799999999999995,"5min":1.2050000000000001,"15min":1.2629999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.68999999999999995,"15min":0.72099999999999997},"min":{"1min":0.51900000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.181,"5min":1.383,"15min":1.383},"last":0.95799999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.68100000000000005,"15min":0.67500000000000004},"min":{"1min":0.46800000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.85199999999999998},"min":{"1min":0.48499999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1870000000000001,"5min":1.3460000000000001,"15min":1.548},"last":1.0009999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.94799999999999995,"15min":0.96899999999999997},"min":{"1min":0.69199999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1279999999999999,"5min":1.653,"15min":1.653},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.96599999999999997,"15min":1.0209999999999999},"min":{"1min":0.73299999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2829999999999999,"5min":1.51,"15min":2.3849999999999998},"last":0.86099999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.93200000000000005,"15min":0.92500000000000004},"min":{"1min":0.74399999999999999,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.327,"5min":1.4730000000000001,"15min":1.498},"last":1.109},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.028,"15min":1.048},"min":{"1min":0.81799999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.254,"5min":1.7549999999999999,"15min":1.869},"last":1.137}]},{"osd":6,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.89300000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.3500000000000001,"5min":1.6120000000000001,"15min":2.762},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.0129999999999999,"15min":1.036},"min":{"1min":0.85999999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.407,"5min":1.5509999999999999,"15min":1.988},"last":0.93600000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.095,"15min":1.1359999999999999},"min":{"1min":0.85199999999999998,"5min":0.61099999999999999,"15min":0.59799999999999998},"max":{"1min":1.496,"5min":1.8240000000000001,"15min":2.6800000000000002},"last":1.276},{"interface":"front","average":{"1min":1.111,"5min":1.081,"15min":1.0740000000000001},"min":{"1min":0.81399999999999995,"5min":0.64100000000000001,"15min":0.52800000000000002},"max":{"1min":1.3129999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.98799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1118208,"data_stored":477051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.34300000000000003,"15min":0.33200000000000002},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70499999999999996,"15min":0.72799999999999998},"min":{"1min":0.502,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.1279999999999999,"5min":1.341,"15min":1.3560000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.46600000000000003,"5min":0.311,"15min":0.311},"max":{"1min":1.0069999999999999,"5min":1.133,"15min":1.1879999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.73899999999999999,"15min":0.747},"min":{"1min":0.44600000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.089,"5min":1.617,"15min":1.617},"last":0.96399999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.56599999999999995,"5min":0.375,"15min":0.375},"max":{"1min":1.1040000000000001,"5min":1.415,"15min":1.415},"last":1.2889999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.751,"15min":0.77700000000000002},"min":{"1min":0.41999999999999998,"5min":0.35999999999999999,"15min":0.35699999999999998},"max":{"1min":1.0820000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.69699999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.95299999999999996,"15min":0.95399999999999996},"min":{"1min":0.70099999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2669999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.95999999999999996,"15min":0.97099999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2450000000000001,"5min":1.52,"15min":1.994},"last":1.395}]},{"osd":5,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.96799999999999997,"15min":0.97299999999999998},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.49299999999999999},"max":{"1min":1.3260000000000001,"5min":1.7,"15min":2.0960000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.054,"15min":1.0740000000000001},"min":{"1min":0.82299999999999995,"5min":0.626,"15min":0.626},"max":{"1min":1.407,"5min":1.8939999999999999,"15min":2.7280000000000002},"last":1.5369999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.024,"15min":1.0600000000000001},"min":{"1min":0.68899999999999995,"5min":0.56599999999999995,"15min":0.53100000000000003},"max":{"1min":1.3029999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.04,"15min":1.075},"min":{"1min":0.69199999999999995,"5min":0.64700000000000002,"15min":0.63100000000000001},"max":{"1min":1.3029999999999999,"5min":1.9710000000000001,"15min":2.0489999999999999},"last":1.486}]},{"osd":7,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.099,"15min":1.095},"min":{"1min":0.88500000000000001,"5min":0.72499999999999998,"15min":0.67400000000000004},"max":{"1min":1.3600000000000001,"5min":2.0070000000000001,"15min":2.5579999999999998},"last":1.452},{"interface":"front","average":{"1min":1.087,"5min":1.089,"15min":1.1080000000000001},"min":{"1min":0.77300000000000002,"5min":0.55200000000000005,"15min":0.51300000000000001},"max":{"1min":1.627,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.3500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40968,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330872,"statfs":{"total":96636764160,"available":96594812928,"internally_reserved":0,"allocated":1691648,"data_stored":1060959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.59999999999999998,"15min":0.60499999999999998},"min":{"1min":0.45900000000000002,"5min":0.192,"15min":0.192},"max":{"1min":0.97599999999999998,"5min":1.23,"15min":1.23},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66500000000000004,"15min":0.68899999999999995},"min":{"1min":0.53100000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.98399999999999999,"5min":1.1220000000000001,"15min":1.1759999999999999},"last":0.49099999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.67900000000000005,"15min":0.69699999999999995},"min":{"1min":0.53400000000000003,"5min":0.249,"15min":0.23799999999999999},"max":{"1min":1.1539999999999999,"5min":1.494,"15min":1.494},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.71599999999999997,"15min":0.71899999999999997},"min":{"1min":0.42799999999999999,"5min":0.223,"15min":0.223},"max":{"1min":1.042,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.58799999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68500000000000005,"15min":0.64800000000000002},"min":{"1min":0.51600000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.93300000000000005,"5min":1.137,"15min":1.137},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.82599999999999996,"15min":0.82699999999999996},"min":{"1min":0.63400000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.2490000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.96099999999999997,"15min":0.96199999999999997},"min":{"1min":0.66800000000000004,"5min":0.623,"15min":0.623},"max":{"1min":1.595,"5min":1.764,"15min":1.764},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.90200000000000002,"15min":0.91000000000000003},"min":{"1min":0.64900000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.304,"5min":1.3620000000000001,"15min":1.4810000000000001},"last":0.68600000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98199999999999998,"15min":0.97299999999999998},"min":{"1min":0.79500000000000004,"5min":0.64600000000000002,"15min":0.59299999999999997},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.046,"15min":1.052},"min":{"1min":0.85499999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5489999999999999,"5min":1.637,"15min":1.637},"last":0.85599999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.0680000000000001,"15min":1.0860000000000001},"min":{"1min":0.79300000000000004,"5min":0.63900000000000001,"15min":0.61699999999999999},"max":{"1min":1.45,"5min":1.718,"15min":1.718},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.171,"5min":1.081,"15min":1.1080000000000001},"min":{"1min":0.80700000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.6180000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.95999999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.071,"15min":1.105},"min":{"1min":0.83899999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.538,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.05,"5min":1.0309999999999999,"15min":1.0409999999999999},"min":{"1min":0.72599999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.284,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.98899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:36:22.088 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:36:22.088 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:36:22.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.207+0000 7fad8a4f3700 1 Processor -- start 2024-09-13T18:36:22.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.207+0000 7fad8a4f3700 1 -- start start 2024-09-13T18:36:22.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.207+0000 7fad8a4f3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad840b5ee0 0x7fad840cba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.207+0000 7fad8a4f3700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fad840b62c0 0x7fad8413f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.207+0000 7fad8a4f3700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad84143280 con 0x7fad840cbf80 2024-09-13T18:36:22.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.207+0000 7fad8a4f3700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad840d0230 con 0x7fad840b62c0 2024-09-13T18:36:22.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.207+0000 7fad8a4f3700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad840d0510 con 0x7fad840b5ee0 2024-09-13T18:36:22.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.207+0000 7fad837fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fad840cbf80 0x7fad840d0ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49630/0 (socket says 172.21.15.44:49630) 2024-09-13T18:36:22.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.207+0000 7fad837fe700 1 -- 172.21.15.44:0/3934886955 learned_addr learned my addr 172.21.15.44:0/3934886955 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:22.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.207+0000 7fad88a90700 1 --2- 172.21.15.44:0/3934886955 >> v2:172.21.15.44:3300/0 conn(0x7fad840b62c0 0x7fad8413f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.207+0000 7fad83fff700 1 --2- 172.21.15.44:0/3934886955 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad840b5ee0 0x7fad840cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.207+0000 7fad82ffd700 1 -- 172.21.15.44:0/3934886955 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639745106 0 0) 0x7fad84143280 con 0x7fad840cbf80 2024-09-13T18:36:22.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.207+0000 7fad82ffd700 1 -- 172.21.15.44:0/3934886955 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad6c0035d0 con 0x7fad840cbf80 2024-09-13T18:36:22.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad82ffd700 1 -- 172.21.15.44:0/3934886955 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2805373369 0 0) 0x7fad6c0035d0 con 0x7fad840cbf80 2024-09-13T18:36:22.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad82ffd700 1 -- 172.21.15.44:0/3934886955 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad840b5ee0 msgr2=0x7fad840cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:22.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad82ffd700 1 --2- 172.21.15.44:0/3934886955 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad840b5ee0 0x7fad840cba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad82ffd700 1 -- 172.21.15.44:0/3934886955 >> v2:172.21.15.44:3300/0 conn(0x7fad840b62c0 msgr2=0x7fad8413f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:22.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad82ffd700 1 --2- 172.21.15.44:0/3934886955 >> v2:172.21.15.44:3300/0 conn(0x7fad840b62c0 0x7fad8413f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad82ffd700 1 -- 172.21.15.44:0/3934886955 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad840d07f0 con 0x7fad840cbf80 2024-09-13T18:36:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad82ffd700 1 -- 172.21.15.44:0/3934886955 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7fad74001670 con 0x7fad840cbf80 2024-09-13T18:36:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad82ffd700 1 -- 172.21.15.44:0/3934886955 >> v1:172.21.15.44:6789/0 conn(0x7fad840cbf80 legacy=0x7fad840d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad82ffd700 1 --2- 172.21.15.44:0/3934886955 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad840b5ee0 0x7fad6c003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad82ffd700 1 --2- 172.21.15.44:0/3934886955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad6c003fa0 0x7fad6c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad82ffd700 1 --2- 172.21.15.44:0/3934886955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad6c004db0 0x7fad6c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad82ffd700 1 -- 172.21.15.44:0/3934886955 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad840d0230 con 0x7fad6c003fa0 2024-09-13T18:36:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad82ffd700 1 -- 172.21.15.44:0/3934886955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad840d0510 con 0x7fad6c004db0 2024-09-13T18:36:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad82ffd700 1 -- 172.21.15.44:0/3934886955 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c00ba30 con 0x7fad840b5ee0 2024-09-13T18:36:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad88a90700 1 --2- 172.21.15.44:0/3934886955 >> v2:172.21.15.44:3300/0 conn(0x7fad840b62c0 0x7fad8413f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad83fff700 1 --2- 172.21.15.44:0/3934886955 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad840b5ee0 0x7fad6c003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad837fe700 1 --2- 172.21.15.44:0/3934886955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad6c003fa0 0x7fad6c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad88a90700 1 --2- 172.21.15.44:0/3934886955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad6c004db0 0x7fad6c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad83fff700 1 -- 172.21.15.44:0/3934886955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad6c004db0 msgr2=0x7fad6c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:22.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad83fff700 1 --2- 172.21.15.44:0/3934886955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad6c004db0 0x7fad6c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad83fff700 1 -- 172.21.15.44:0/3934886955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad6c003fa0 msgr2=0x7fad6c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:22.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad83fff700 1 --2- 172.21.15.44:0/3934886955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad6c003fa0 0x7fad6c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad83fff700 1 -- 172.21.15.44:0/3934886955 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c0035d0 con 0x7fad840b5ee0 2024-09-13T18:36:22.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad83fff700 1 --2- 172.21.15.44:0/3934886955 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad840b5ee0 0x7fad6c003a20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fad78009b70 tx=0x7fad6c0058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a40ffbd39a9fcfd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:22.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad82ffd700 1 -- 172.21.15.44:0/3934886955 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7800e6c0 con 0x7fad840b5ee0 2024-09-13T18:36:22.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad82ffd700 1 -- 172.21.15.44:0/3934886955 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7800e820 con 0x7fad840b5ee0 2024-09-13T18:36:22.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad82ffd700 1 -- 172.21.15.44:0/3934886955 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7800eb90 con 0x7fad840b5ee0 2024-09-13T18:36:22.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad8a4f3700 1 -- 172.21.15.44:0/3934886955 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad840b5ee0 msgr2=0x7fad6c003a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad8a4f3700 1 --2- 172.21.15.44:0/3934886955 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad840b5ee0 0x7fad6c003a20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fad78009b70 tx=0x7fad6c0058a0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad88a90700 1 -- 172.21.15.44:0/3934886955 reap_dead start 2024-09-13T18:36:22.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad8a4f3700 1 -- 172.21.15.44:0/3934886955 shutdown_connections 2024-09-13T18:36:22.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad8a4f3700 1 -- 172.21.15.44:0/3934886955 >> 172.21.15.44:0/3934886955 conn(0x7fad84071da0 msgr2=0x7fad84072180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:22.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad8a4f3700 1 -- 172.21.15.44:0/3934886955 shutdown_connections 2024-09-13T18:36:22.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad8a4f3700 1 -- 172.21.15.44:0/3934886955 wait complete. 2024-09-13T18:36:22.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.211+0000 7fad8a4f3700 1 Processor -- start 2024-09-13T18:36:22.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad8a4f3700 1 -- start start 2024-09-13T18:36:22.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad8a4f3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad840b5ee0 0x7fad841441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad8a4f3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad8413b410 0x7fad8415f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad8a4f3700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad8415f810 0x7fad8406bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad8a4f3700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8406cca0 con 0x7fad840b5ee0 2024-09-13T18:36:22.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad8a4f3700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8415fc90 con 0x7fad8415f810 2024-09-13T18:36:22.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad8a4f3700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad84143d30 con 0x7fad8413b410 2024-09-13T18:36:22.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad83fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad840b5ee0 0x7fad841441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad837fe700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad8413b410 0x7fad8415f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad88a90700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad8415f810 0x7fad8406bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad837fe700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad8413b410 0x7fad8415f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:60696/0 (socket says 172.21.15.44:60696) 2024-09-13T18:36:22.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad837fe700 1 -- 172.21.15.44:0/2982780989 learned_addr learned my addr 172.21.15.44:0/2982780989 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:22.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad83fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad840b5ee0 0x7fad841441c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47122/0 (socket says 172.21.15.44:47122) 2024-09-13T18:36:22.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad88a90700 1 -- 172.21.15.44:0/2982780989 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad8413b410 msgr2=0x7fad8415f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad88a90700 1 --2- 172.21.15.44:0/2982780989 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad8413b410 0x7fad8415f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad88a90700 1 -- 172.21.15.44:0/2982780989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad840b5ee0 msgr2=0x7fad841441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad88a90700 1 --2- 172.21.15.44:0/2982780989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad840b5ee0 0x7fad841441c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad88a90700 1 -- 172.21.15.44:0/2982780989 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad84144700 con 0x7fad8415f810 2024-09-13T18:36:22.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad837fe700 1 --2- 172.21.15.44:0/2982780989 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad8413b410 0x7fad8415f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:22.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad88a90700 1 --2- 172.21.15.44:0/2982780989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad8415f810 0x7fad8406bcb0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fad840d1b80 tx=0x7fad7c00f490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:22.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad80ff9700 1 -- 172.21.15.44:0/2982780989 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c00e040 con 0x7fad8415f810 2024-09-13T18:36:22.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad80ff9700 1 -- 172.21.15.44:0/2982780989 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7c00f040 con 0x7fad8415f810 2024-09-13T18:36:22.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad8a4f3700 1 -- 172.21.15.44:0/2982780989 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad8406c9c0 con 0x7fad8415f810 2024-09-13T18:36:22.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad80ff9700 1 -- 172.21.15.44:0/2982780989 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c003a40 con 0x7fad8415f810 2024-09-13T18:36:22.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.215+0000 7fad8a4f3700 1 -- 172.21.15.44:0/2982780989 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad841439c0 con 0x7fad8415f810 2024-09-13T18:36:22.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.219+0000 7fad80ff9700 1 -- 172.21.15.44:0/2982780989 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fad7c015430 con 0x7fad8415f810 2024-09-13T18:36:22.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.219+0000 7fad8a4f3700 1 -- 172.21.15.44:0/2982780989 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad84143540 con 0x7fad8415f810 2024-09-13T18:36:22.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.219+0000 7fad80ff9700 1 --2- 172.21.15.44:0/2982780989 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fad70066760 0x7fad70068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.219+0000 7fad80ff9700 1 -- 172.21.15.44:0/2982780989 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad7c084730 con 0x7fad8415f810 2024-09-13T18:36:22.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.219+0000 7fad83fff700 1 --2- 172.21.15.44:0/2982780989 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fad70066760 0x7fad70068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.219+0000 7fad83fff700 1 --2- 172.21.15.44:0/2982780989 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fad70066760 0x7fad70068c20 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fad780090b0 tx=0x7fad7801e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:22.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.227+0000 7fad80ff9700 1 -- 172.21.15.44:0/2982780989 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fad84143540 con 0x7fad8415f810 2024-09-13T18:36:22.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.463+0000 7fad8a4f3700 1 -- 172.21.15.44:0/2982780989 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fad84143540 con 0x7fad8415f810 2024-09-13T18:36:22.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.475+0000 7fad80ff9700 1 -- 172.21.15.44:0/2982780989 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7fad84143540 con 0x7fad8415f810 2024-09-13T18:36:22.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.475+0000 7fad8a4f3700 1 -- 172.21.15.44:0/2982780989 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fad70066760 msgr2=0x7fad70068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.475+0000 7fad8a4f3700 1 --2- 172.21.15.44:0/2982780989 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fad70066760 0x7fad70068c20 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fad780090b0 tx=0x7fad7801e040 comp rx=0 tx=0).stop 2024-09-13T18:36:22.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.475+0000 7fad8a4f3700 1 -- 172.21.15.44:0/2982780989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad8415f810 msgr2=0x7fad8406bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.475+0000 7fad8a4f3700 1 --2- 172.21.15.44:0/2982780989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad8415f810 0x7fad8406bcb0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fad840d1b80 tx=0x7fad7c00f490 comp rx=0 tx=0).stop 2024-09-13T18:36:22.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.475+0000 7fad8a4f3700 1 -- 172.21.15.44:0/2982780989 shutdown_connections 2024-09-13T18:36:22.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.475+0000 7fad8a4f3700 1 --2- 172.21.15.44:0/2982780989 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fad70066760 0x7fad70068c20 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.475+0000 7fad8a4f3700 1 --2- 172.21.15.44:0/2982780989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad8415f810 0x7fad8406bcb0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.475+0000 7fad8a4f3700 1 --2- 172.21.15.44:0/2982780989 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad8413b410 0x7fad8415f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.475+0000 7fad8a4f3700 1 --2- 172.21.15.44:0/2982780989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad840b5ee0 0x7fad841441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.475+0000 7fad8a4f3700 1 -- 172.21.15.44:0/2982780989 >> 172.21.15.44:0/2982780989 conn(0x7fad84071da0 msgr2=0x7fad840b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:22.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.475+0000 7fad8a4f3700 1 -- 172.21.15.44:0/2982780989 shutdown_connections 2024-09-13T18:36:22.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.475+0000 7fad8a4f3700 1 -- 172.21.15.44:0/2982780989 wait complete. 2024-09-13T18:36:22.485 INFO:teuthology.orchestra.run.smithi044.stderr:updated caps for client.0 2024-09-13T18:36:22.499 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:36:22.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f9379046700 1 Processor -- start 2024-09-13T18:36:22.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f9379046700 1 -- start start 2024-09-13T18:36:22.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f9379046700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f93740722c0 0x7f937406c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f9379046700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f93740b29a0 0x7f93740b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f9379046700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93740b3710 con 0x7f9374153da0 2024-09-13T18:36:22.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f9379046700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f937415abb0 con 0x7f93740722c0 2024-09-13T18:36:22.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f9379046700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937406be30 con 0x7f93740b29a0 2024-09-13T18:36:22.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f9373fff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9374153da0 0x7f9374071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49634/0 (socket says 172.21.15.44:49634) 2024-09-13T18:36:22.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f93737fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f93740722c0 0x7f937406c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f9373fff700 1 -- 172.21.15.44:0/2318970768 learned_addr learned my addr 172.21.15.44:0/2318970768 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:22.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f9378845700 1 --2- 172.21.15.44:0/2318970768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f93740b29a0 0x7f93740b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f9372ffd700 1 -- 172.21.15.44:0/2318970768 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286543787 0 0) 0x7f93740b3710 con 0x7f9374153da0 2024-09-13T18:36:22.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f9372ffd700 1 -- 172.21.15.44:0/2318970768 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93540035d0 con 0x7f9374153da0 2024-09-13T18:36:22.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f93737fe700 1 -- 172.21.15.44:0/2318970768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f93740b29a0 msgr2=0x7f93740b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:22.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f93737fe700 1 --2- 172.21.15.44:0/2318970768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f93740b29a0 0x7f93740b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f93737fe700 1 -- 172.21.15.44:0/2318970768 >> v1:172.21.15.44:6789/0 conn(0x7f9374153da0 legacy=0x7f9374071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f93737fe700 1 -- 172.21.15.44:0/2318970768 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937406c110 con 0x7f93740722c0 2024-09-13T18:36:22.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f93737fe700 1 --2- 172.21.15.44:0/2318970768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93740722c0 0x7f937406c910 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f9364009d90 tx=0x7f936400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c4822e576bd869 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:22.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f9372ffd700 1 -- 172.21.15.44:0/2318970768 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936400e070 con 0x7f93740722c0 2024-09-13T18:36:22.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f9372ffd700 1 -- 172.21.15.44:0/2318970768 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936400bb20 con 0x7f93740722c0 2024-09-13T18:36:22.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f9372ffd700 1 -- 172.21.15.44:0/2318970768 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936400be90 con 0x7f93740722c0 2024-09-13T18:36:22.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f9379046700 1 -- 172.21.15.44:0/2318970768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93740722c0 msgr2=0x7f937406c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f9379046700 1 --2- 172.21.15.44:0/2318970768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93740722c0 0x7f937406c910 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f9364009d90 tx=0x7f936400b330 comp rx=0 tx=0).stop 2024-09-13T18:36:22.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f9379046700 1 -- 172.21.15.44:0/2318970768 shutdown_connections 2024-09-13T18:36:22.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f9379046700 1 --2- 172.21.15.44:0/2318970768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f93740b29a0 0x7f93740b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f9379046700 1 --2- 172.21.15.44:0/2318970768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93740722c0 0x7f937406c910 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f9379046700 1 -- 172.21.15.44:0/2318970768 >> 172.21.15.44:0/2318970768 conn(0x7f93740cf910 msgr2=0x7f93740cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:22.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.611+0000 7f9379046700 1 -- 172.21.15.44:0/2318970768 shutdown_connections 2024-09-13T18:36:22.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.615+0000 7f9379046700 1 -- 172.21.15.44:0/2318970768 wait complete. 2024-09-13T18:36:22.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.615+0000 7f9379046700 1 Processor -- start 2024-09-13T18:36:22.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.615+0000 7f9379046700 1 -- start start 2024-09-13T18:36:22.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.615+0000 7f9379046700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93740722c0 0x7f93740a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.615+0000 7f9379046700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f93740b29a0 0x7f93741f09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.615+0000 7f9379046700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9374153da0 0x7f93741f0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.615+0000 7f9379046700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93740a8d00 con 0x7f9374153da0 2024-09-13T18:36:22.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.615+0000 7f9379046700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93741425c0 con 0x7f93740722c0 2024-09-13T18:36:22.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.615+0000 7f9379046700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93741428a0 con 0x7f93740b29a0 2024-09-13T18:36:22.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.615+0000 7f9378845700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9374153da0 0x7f93741f0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.615+0000 7f93737fe700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f93740b29a0 0x7f93741f09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.615+0000 7f9373fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93740722c0 0x7f93740a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.615+0000 7f9378845700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9374153da0 0x7f93741f0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47138/0 (socket says 172.21.15.44:47138) 2024-09-13T18:36:22.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.615+0000 7f9378845700 1 -- 172.21.15.44:0/3874689727 learned_addr learned my addr 172.21.15.44:0/3874689727 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:22.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.619+0000 7f9378845700 1 -- 172.21.15.44:0/3874689727 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f93740b29a0 msgr2=0x7f93741f09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.619+0000 7f9378845700 1 --2- 172.21.15.44:0/3874689727 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f93740b29a0 0x7f93741f09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.619+0000 7f9378845700 1 -- 172.21.15.44:0/3874689727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93740722c0 msgr2=0x7f93740a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.619+0000 7f9378845700 1 --2- 172.21.15.44:0/3874689727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93740722c0 0x7f93740a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.619+0000 7f9378845700 1 -- 172.21.15.44:0/3874689727 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9364009a70 con 0x7f9374153da0 2024-09-13T18:36:22.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.619+0000 7f9378845700 1 --2- 172.21.15.44:0/3874689727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9374153da0 0x7f93741f0f10 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f936c00eb60 tx=0x7f936c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:22.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.619+0000 7f9370ff9700 1 -- 172.21.15.44:0/3874689727 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c009740 con 0x7f9374153da0 2024-09-13T18:36:22.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.619+0000 7f9370ff9700 1 -- 172.21.15.44:0/3874689727 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936c009e00 con 0x7f9374153da0 2024-09-13T18:36:22.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.619+0000 7f9379046700 1 -- 172.21.15.44:0/3874689727 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9374142b80 con 0x7f9374153da0 2024-09-13T18:36:22.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.619+0000 7f9370ff9700 1 -- 172.21.15.44:0/3874689727 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c00ca70 con 0x7f9374153da0 2024-09-13T18:36:22.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.619+0000 7f9379046700 1 -- 172.21.15.44:0/3874689727 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93740a89f0 con 0x7f9374153da0 2024-09-13T18:36:22.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.619+0000 7f9379046700 1 -- 172.21.15.44:0/3874689727 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93741430a0 con 0x7f9374153da0 2024-09-13T18:36:22.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.619+0000 7f9370ff9700 1 -- 172.21.15.44:0/3874689727 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f936c00cbd0 con 0x7f9374153da0 2024-09-13T18:36:22.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.623+0000 7f9370ff9700 1 --2- 172.21.15.44:0/3874689727 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9358066730 0x7f9358068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.623+0000 7f9370ff9700 1 -- 172.21.15.44:0/3874689727 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f936c084170 con 0x7f9374153da0 2024-09-13T18:36:22.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.623+0000 7f9373fff700 1 --2- 172.21.15.44:0/3874689727 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9358066730 0x7f9358068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.623+0000 7f9373fff700 1 --2- 172.21.15.44:0/3874689727 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9358066730 0x7f9358068bf0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f935c007fd0 tx=0x7f935c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:22.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.635+0000 7f9370ff9700 1 -- 172.21.15.44:0/3874689727 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f93741430a0 con 0x7f9374153da0 2024-09-13T18:36:22.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.839+0000 7f9379046700 1 -- 172.21.15.44:0/3874689727 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93741430a0 con 0x7f9374153da0 2024-09-13T18:36:22.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.843+0000 7f9370ff9700 1 -- 172.21.15.44:0/3874689727 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4730 (secure 0 0 0) 0x7f93741430a0 con 0x7f9374153da0 2024-09-13T18:36:22.849 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:22.849 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":78,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7121,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4127573228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4127573228},{"type":"v1","addr":"172.21.15.99:6836","nonce":4127573228}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":7984,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3372982355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3372982355},{"type":"v1","addr":"172.21.15.99:6837","nonce":3372982355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/48969097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":48969097},{"type":"v1","addr":"172.21.15.44:6833","nonce":48969097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:36:17.641055+0000","modified":"2024-09-13T18:36:20.660692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8193":{"gid":8193,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/1527182738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1527182738},{"type":"v1","addr":"172.21.15.44:6835","nonce":1527182738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:36:22.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.843+0000 7f9379046700 1 -- 172.21.15.44:0/3874689727 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9358066730 msgr2=0x7f9358068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.843+0000 7f9379046700 1 --2- 172.21.15.44:0/3874689727 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9358066730 0x7f9358068bf0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f935c007fd0 tx=0x7f935c009040 comp rx=0 tx=0).stop 2024-09-13T18:36:22.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.843+0000 7f9379046700 1 -- 172.21.15.44:0/3874689727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9374153da0 msgr2=0x7f93741f0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.843+0000 7f9379046700 1 --2- 172.21.15.44:0/3874689727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9374153da0 0x7f93741f0f10 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f936c00eb60 tx=0x7f936c00ee70 comp rx=0 tx=0).stop 2024-09-13T18:36:22.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.843+0000 7f9379046700 1 -- 172.21.15.44:0/3874689727 shutdown_connections 2024-09-13T18:36:22.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.843+0000 7f9379046700 1 --2- 172.21.15.44:0/3874689727 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9358066730 0x7f9358068bf0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.843+0000 7f9379046700 1 --2- 172.21.15.44:0/3874689727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9374153da0 0x7f93741f0f10 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.843+0000 7f9379046700 1 --2- 172.21.15.44:0/3874689727 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f93740b29a0 0x7f93741f09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.843+0000 7f9379046700 1 --2- 172.21.15.44:0/3874689727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93740722c0 0x7f93740a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.843+0000 7f9379046700 1 -- 172.21.15.44:0/3874689727 >> 172.21.15.44:0/3874689727 conn(0x7f93740cf910 msgr2=0x7f937406e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:22.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.843+0000 7f9379046700 1 -- 172.21.15.44:0/3874689727 shutdown_connections 2024-09-13T18:36:22.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:22.843+0000 7f9379046700 1 -- 172.21.15.44:0/3874689727 wait complete. 2024-09-13T18:36:22.853 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 78 2024-09-13T18:36:23.267 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 78, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:36:17.641055+0000', 'modified': '2024-09-13T18:36:20.660692+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8193': {'gid': 8193, 'name': 'c', 'rank': 0, 'incarnation': 74, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.44:6835/1527182738', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 1527182738}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 1527182738}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:36:23.267 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:36:23.267 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:36:23.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.387+0000 7f24b7133700 1 Processor -- start 2024-09-13T18:36:23.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.387+0000 7f24b7133700 1 -- start start 2024-09-13T18:36:23.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.387+0000 7f24b7133700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f24b01573e0 0x7f24b0070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.387+0000 7f24b7133700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f24b00710e0 0x7f24b0159f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.387+0000 7f24b7133700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24b015a460 0x7f24b015d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.387+0000 7f24b7133700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b00cc1b0 con 0x7f24b01573e0 2024-09-13T18:36:23.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.387+0000 7f24b7133700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b0071540 con 0x7f24b00710e0 2024-09-13T18:36:23.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.387+0000 7f24b7133700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b015ac50 con 0x7f24b015a460 2024-09-13T18:36:23.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.387+0000 7f24b6131700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f24b01573e0 0x7f24b0070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.387+0000 7f24b6131700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f24b01573e0 0x7f24b0070ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47142/0 (socket says 172.21.15.44:47142) 2024-09-13T18:36:23.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.387+0000 7f24b5930700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f24b00710e0 0x7f24b0159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.387+0000 7f24b6932700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24b015a460 0x7f24b015d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.387+0000 7f24b6131700 1 -- 172.21.15.44:0/404737692 learned_addr learned my addr 172.21.15.44:0/404737692 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:23.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.391+0000 7f24b6131700 1 -- 172.21.15.44:0/404737692 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24b015a460 msgr2=0x7f24b015d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:23.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.391+0000 7f24b6131700 1 --2- 172.21.15.44:0/404737692 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24b015a460 0x7f24b015d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.391+0000 7f24b6131700 1 -- 172.21.15.44:0/404737692 >> v2:172.21.15.99:3300/0 conn(0x7f24b00710e0 msgr2=0x7f24b0159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:23.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.391+0000 7f24b6131700 1 --2- 172.21.15.44:0/404737692 >> v2:172.21.15.99:3300/0 conn(0x7f24b00710e0 0x7f24b0159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.391+0000 7f24b6131700 1 -- 172.21.15.44:0/404737692 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b00cb3f0 con 0x7f24b01573e0 2024-09-13T18:36:23.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.391+0000 7f24b5930700 1 --2- 172.21.15.44:0/404737692 >> v2:172.21.15.99:3300/0 conn(0x7f24b00710e0 0x7f24b0159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:23.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.391+0000 7f24b6131700 1 --2- 172.21.15.44:0/404737692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24b01573e0 0x7f24b0070ba0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f24b015d240 tx=0x7f24a0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0606b9752f168ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:23.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.391+0000 7f24b512f700 1 -- 172.21.15.44:0/404737692 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a0011830 con 0x7f24b01573e0 2024-09-13T18:36:23.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.391+0000 7f24b512f700 1 -- 172.21.15.44:0/404737692 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a0011990 con 0x7f24b01573e0 2024-09-13T18:36:23.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.391+0000 7f24b512f700 1 -- 172.21.15.44:0/404737692 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a0011d40 con 0x7f24b01573e0 2024-09-13T18:36:23.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.391+0000 7f24b7133700 1 -- 172.21.15.44:0/404737692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24b01573e0 msgr2=0x7f24b0070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.391+0000 7f24b7133700 1 --2- 172.21.15.44:0/404737692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24b01573e0 0x7f24b0070ba0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f24b015d240 tx=0x7f24a0009c20 comp rx=0 tx=0).stop 2024-09-13T18:36:23.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.391+0000 7f24b7133700 1 -- 172.21.15.44:0/404737692 shutdown_connections 2024-09-13T18:36:23.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.391+0000 7f24b7133700 1 --2- 172.21.15.44:0/404737692 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24b015a460 0x7f24b015d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.391+0000 7f24b7133700 1 --2- 172.21.15.44:0/404737692 >> v2:172.21.15.99:3300/0 conn(0x7f24b00710e0 0x7f24b0159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.391+0000 7f24b7133700 1 --2- 172.21.15.44:0/404737692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24b01573e0 0x7f24b0070ba0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.391+0000 7f24b7133700 1 -- 172.21.15.44:0/404737692 >> 172.21.15.44:0/404737692 conn(0x7f24b00b0e10 msgr2=0x7f24b00b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:23.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.391+0000 7f24b7133700 1 -- 172.21.15.44:0/404737692 shutdown_connections 2024-09-13T18:36:23.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.391+0000 7f24b7133700 1 -- 172.21.15.44:0/404737692 wait complete. 2024-09-13T18:36:23.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.391+0000 7f24b7133700 1 Processor -- start 2024-09-13T18:36:23.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.391+0000 7f24b7133700 1 -- start start 2024-09-13T18:36:23.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.395+0000 7f24b7133700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24b00710e0 0x7f24b0158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.395+0000 7f24b7133700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24b01573e0 0x7f24b014b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.395+0000 7f24b7133700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24b015a460 0x7f24b0144e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.395+0000 7f24b7133700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b014cde0 con 0x7f24b00710e0 2024-09-13T18:36:23.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.395+0000 7f24b7133700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b014d0a0 con 0x7f24b015a460 2024-09-13T18:36:23.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.395+0000 7f24b7133700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b014d380 con 0x7f24b01573e0 2024-09-13T18:36:23.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.395+0000 7f24b6131700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24b00710e0 0x7f24b0158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.395+0000 7f24b6131700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24b00710e0 0x7f24b0158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47146/0 (socket says 172.21.15.44:47146) 2024-09-13T18:36:23.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.395+0000 7f24b6131700 1 -- 172.21.15.44:0/2985233158 learned_addr learned my addr 172.21.15.44:0/2985233158 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:23.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.395+0000 7f24b6932700 1 --2- 172.21.15.44:0/2985233158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24b015a460 0x7f24b0144e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.395+0000 7f24b5930700 1 --2- 172.21.15.44:0/2985233158 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24b01573e0 0x7f24b014b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.395+0000 7f24b6131700 1 -- 172.21.15.44:0/2985233158 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24b01573e0 msgr2=0x7f24b014b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.395+0000 7f24b6131700 1 --2- 172.21.15.44:0/2985233158 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24b01573e0 0x7f24b014b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.395+0000 7f24b6131700 1 -- 172.21.15.44:0/2985233158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24b015a460 msgr2=0x7f24b0144e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.395+0000 7f24b6131700 1 --2- 172.21.15.44:0/2985233158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24b015a460 0x7f24b0144e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.395+0000 7f24b6131700 1 -- 172.21.15.44:0/2985233158 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac0094b0 con 0x7f24b00710e0 2024-09-13T18:36:23.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.395+0000 7f24b6131700 1 --2- 172.21.15.44:0/2985233158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24b00710e0 0x7f24b0158600 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f24a0000c00 tx=0x7f24a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:23.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.395+0000 7f24a6ffd700 1 -- 172.21.15.44:0/2985233158 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a0004240 con 0x7f24b00710e0 2024-09-13T18:36:23.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.395+0000 7f24a6ffd700 1 -- 172.21.15.44:0/2985233158 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a001f070 con 0x7f24b00710e0 2024-09-13T18:36:23.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.395+0000 7f24a6ffd700 1 -- 172.21.15.44:0/2985233158 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a00045c0 con 0x7f24b00710e0 2024-09-13T18:36:23.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.395+0000 7f24b7133700 1 -- 172.21.15.44:0/2985233158 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a0009570 con 0x7f24b00710e0 2024-09-13T18:36:23.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.395+0000 7f24b7133700 1 -- 172.21.15.44:0/2985233158 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b014be00 con 0x7f24b00710e0 2024-09-13T18:36:23.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.399+0000 7f24a6ffd700 1 -- 172.21.15.44:0/2985233158 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f24a0021030 con 0x7f24b00710e0 2024-09-13T18:36:23.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.399+0000 7f24a6ffd700 1 --2- 172.21.15.44:0/2985233158 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2494066730 0x7f2494068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.399+0000 7f24a6ffd700 1 -- 172.21.15.44:0/2985233158 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24a0085210 con 0x7f24b00710e0 2024-09-13T18:36:23.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.399+0000 7f24b5930700 1 --2- 172.21.15.44:0/2985233158 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2494066730 0x7f2494068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.399+0000 7f24bb646740 1 Processor -- start 2024-09-13T18:36:23.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.399+0000 7f24bb646740 1 -- start start 2024-09-13T18:36:23.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.399+0000 7f24b5930700 1 --2- 172.21.15.44:0/2985233158 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2494066730 0x7f2494068bf0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f24b00ce7c0 tx=0x7f24ac009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:23.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.399+0000 7f24bb646740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xe38530 0xe38910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.399+0000 7f24bb646740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xe39290 0xe60540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.399+0000 7f24bb646740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe39670 0xe60a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.399+0000 7f24bb646740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0xda5d80 con 0xe39670 2024-09-13T18:36:23.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.399+0000 7f24bb646740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0xda3510 con 0xe38530 2024-09-13T18:36:23.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.399+0000 7f24bb646740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0xd9ee00 con 0xe39290 2024-09-13T18:36:23.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.399+0000 7f24b6932700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe39670 0xe60a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.399+0000 7f24b6932700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe39670 0xe60a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47154/0 (socket says 172.21.15.44:47154) 2024-09-13T18:36:23.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.399+0000 7f24b6932700 1 -- 172.21.15.44:0/3144334886 learned_addr learned my addr 172.21.15.44:0/3144334886 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:23.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.399+0000 7f24b6131700 1 --2- 172.21.15.44:0/3144334886 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xe38530 0xe38910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.399+0000 7f24b5930700 1 --2- 172.21.15.44:0/3144334886 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xe39290 0xe60540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.403+0000 7f24b6932700 1 -- 172.21.15.44:0/3144334886 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xe39290 msgr2=0xe60540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:23.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.403+0000 7f24b6932700 1 --2- 172.21.15.44:0/3144334886 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xe39290 0xe60540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.403+0000 7f24b6932700 1 -- 172.21.15.44:0/3144334886 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xe38530 msgr2=0xe38910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:23.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.403+0000 7f24b6932700 1 --2- 172.21.15.44:0/3144334886 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xe38530 0xe38910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.403+0000 7f24b6932700 1 -- 172.21.15.44:0/3144334886 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xc11960 con 0xe39670 2024-09-13T18:36:23.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.403+0000 7f24b6932700 1 --2- 172.21.15.44:0/3144334886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe39670 0xe60a80 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f24a80113f0 tx=0x7f24a8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e252b00bbfc954 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:23.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.403+0000 7f2493fff700 1 -- 172.21.15.44:0/3144334886 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a800e040 con 0xe39670 2024-09-13T18:36:23.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.403+0000 7f2493fff700 1 -- 172.21.15.44:0/3144334886 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a800f040 con 0xe39670 2024-09-13T18:36:23.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.403+0000 7f2493fff700 1 -- 172.21.15.44:0/3144334886 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a8015630 con 0xe39670 2024-09-13T18:36:23.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.403+0000 7f24bb646740 1 -- 172.21.15.44:0/3144334886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe39670 msgr2=0xe60a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.403+0000 7f24bb646740 1 --2- 172.21.15.44:0/3144334886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe39670 0xe60a80 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f24a80113f0 tx=0x7f24a8009750 comp rx=0 tx=0).stop 2024-09-13T18:36:23.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.403+0000 7f24bb646740 1 -- 172.21.15.44:0/3144334886 shutdown_connections 2024-09-13T18:36:23.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.403+0000 7f24bb646740 1 --2- 172.21.15.44:0/3144334886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe39670 0xe60a80 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.403+0000 7f24bb646740 1 --2- 172.21.15.44:0/3144334886 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xe39290 0xe60540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.403+0000 7f24bb646740 1 --2- 172.21.15.44:0/3144334886 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xe38530 0xe38910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.403+0000 7f24bb646740 1 -- 172.21.15.44:0/3144334886 >> 172.21.15.44:0/3144334886 conn(0xbc64d0 msgr2=0xe5fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:23.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.403+0000 7f24bb646740 1 -- 172.21.15.44:0/3144334886 shutdown_connections 2024-09-13T18:36:23.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.403+0000 7f24bb646740 1 -- 172.21.15.44:0/3144334886 wait complete. 2024-09-13T18:36:23.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.403+0000 7f24bb646740 1 -- start start 2024-09-13T18:36:23.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.403+0000 7f24bb646740 1 Processor -- start 2024-09-13T18:36:23.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24bb646740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xe38530 0xe809f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24bb646740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe39290 0xe602a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24bb646740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xe39670 0xe5aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24bb646740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0xd5c730 con 0xe39290 2024-09-13T18:36:23.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24bb646740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0xd625b0 con 0xe39670 2024-09-13T18:36:23.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24bb646740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0xc4aaa0 con 0xe38530 2024-09-13T18:36:23.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24bb646740 10 client.0 _ll_register_callbacks cb 0xd98610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:36:23.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24b5930700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe39290 0xe602a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24b5930700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe39290 0xe602a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47164/0 (socket says 172.21.15.44:47164) 2024-09-13T18:36:23.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24b5930700 1 -- 172.21.15.44:0/2393641825 learned_addr learned my addr 172.21.15.44:0/2393641825 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:23.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24b6131700 1 --2- 172.21.15.44:0/2393641825 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xe38530 0xe809f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24b6932700 1 --2- 172.21.15.44:0/2393641825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xe39670 0xe5aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24b5930700 1 -- 172.21.15.44:0/2393641825 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xe38530 msgr2=0xe809f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:23.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24b5930700 1 --2- 172.21.15.44:0/2393641825 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xe38530 0xe809f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24b5930700 1 -- 172.21.15.44:0/2393641825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xe39670 msgr2=0xe5aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:23.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24b5930700 1 --2- 172.21.15.44:0/2393641825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xe39670 0xe5aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24b5930700 1 -- 172.21.15.44:0/2393641825 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a8009e10 con 0xe39290 2024-09-13T18:36:23.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24b5930700 1 --2- 172.21.15.44:0/2393641825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe39290 0xe602a0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f24ac003720 tx=0x7f24ac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d86dcdedc021bf4a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:23.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24917fa700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-13T18:36:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24917fa700 1 -- 172.21.15.44:0/2393641825 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac01c040 con 0xe39290 2024-09-13T18:36:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24917fa700 1 -- 172.21.15.44:0/2393641825 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24ac014650 con 0xe39290 2024-09-13T18:36:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24bb646740 1 -- 172.21.15.44:0/2393641825 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xbd31e0 con 0xe39290 2024-09-13T18:36:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24917fa700 1 -- 172.21.15.44:0/2393641825 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24ac011bc0 con 0xe39290 2024-09-13T18:36:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24bb646740 10 client.8343 fetch_fsmap learned FSMap version 78 2024-09-13T18:36:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24bb646740 1 -- 172.21.15.44:0/2393641825 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0xd65220 con 0xe39290 2024-09-13T18:36:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24917fa700 1 -- 172.21.15.44:0/2393641825 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xbd31e0 con 0xe39290 2024-09-13T18:36:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24917fa700 1 -- 172.21.15.44:0/2393641825 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 78) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f24ac014850 con 0xe39290 2024-09-13T18:36:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24bb646740 10 client.8343 fetch_fsmap finished waiting for FSMap version 78 2024-09-13T18:36:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24bb646740 10 client.8343 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:36:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24bb646740 20 client.8343 populate_metadata read hostname 'smithi044' 2024-09-13T18:36:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24bb646740 1 --2- 172.21.15.44:0/2393641825 >> [v2:172.21.15.44:6834/1527182738,v1:172.21.15.44:6835/1527182738] conn(0xe88c70 0xe897e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24bb646740 4 client.8343 mds_command: new command op to 8193 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:36:23.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24bb646740 1 -- 172.21.15.44:0/2393641825 --> [v2:172.21.15.44:6834/1527182738,v1:172.21.15.44:6835/1527182738] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xc1d460 con 0xe88c70 2024-09-13T18:36:23.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24b6131700 1 --2- 172.21.15.44:0/2393641825 >> [v2:172.21.15.44:6834/1527182738,v1:172.21.15.44:6835/1527182738] conn(0xe88c70 0xe897e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.407+0000 7f24b6131700 1 --2- 172.21.15.44:0/2393641825 >> [v2:172.21.15.44:6834/1527182738,v1:172.21.15.44:6835/1527182738] conn(0xe88c70 0xe897e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80238d4fbb98d676 server_cookie=3466f5ee559cdb7e in_seq=0 out_seq=0 2024-09-13T18:36:23.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.411+0000 7f24917fa700 10 client.8343 ms_handle_connect on v2:172.21.15.44:6834/1527182738 2024-09-13T18:36:23.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.411+0000 7f24917fa700 1 -- 172.21.15.44:0/2393641825 <== mds.0 v2:172.21.15.44:6834/1527182738 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0xc1d460 con 0xe88c70 2024-09-13T18:36:23.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.411+0000 7f24917fa700 10 client.8343 handle_command_reply: tid=0 2024-09-13T18:36:23.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.411+0000 7f24bb646740 1 client.8343 shutdown 2024-09-13T18:36:23.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.411+0000 7f24bb646740 1 -- 172.21.15.44:0/2393641825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe39290 msgr2=0xe602a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.411+0000 7f24bb646740 1 --2- 172.21.15.44:0/2393641825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe39290 0xe602a0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f24ac003720 tx=0x7f24ac004770 comp rx=0 tx=0).stop 2024-09-13T18:36:23.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.411+0000 7f24bb646740 1 -- 172.21.15.44:0/2393641825 shutdown_connections 2024-09-13T18:36:23.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.411+0000 7f24bb646740 1 --2- 172.21.15.44:0/2393641825 >> [v2:172.21.15.44:6834/1527182738,v1:172.21.15.44:6835/1527182738] conn(0xe88c70 0xe897e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.411+0000 7f24bb646740 1 --2- 172.21.15.44:0/2393641825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xe39670 0xe5aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.411+0000 7f24bb646740 1 --2- 172.21.15.44:0/2393641825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe39290 0xe602a0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.411+0000 7f24bb646740 1 --2- 172.21.15.44:0/2393641825 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xe38530 0xe809f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.411+0000 7f24917fa700 0 client.8343 ms_handle_reset on v2:172.21.15.44:6834/1527182738 2024-09-13T18:36:23.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.411+0000 7f24bb646740 1 -- 172.21.15.44:0/2393641825 >> 172.21.15.44:0/2393641825 conn(0xbc64d0 msgr2=0xe61060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:23.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.411+0000 7f24bb646740 1 -- 172.21.15.44:0/2393641825 shutdown_connections 2024-09-13T18:36:23.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.411+0000 7f24bb646740 1 -- 172.21.15.44:0/2393641825 wait complete. 2024-09-13T18:36:23.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.411+0000 7f24bb646740 20 client.8343 trim_cache size 0 max 16384 2024-09-13T18:36:23.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.431+0000 7f24bb646740 1 Processor -- start 2024-09-13T18:36:23.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.431+0000 7f24bb646740 1 -- start start 2024-09-13T18:36:23.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.431+0000 7f24bb646740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xbc64d0 0xe9a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.431+0000 7f24bb646740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xe38530 0xe9a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.431+0000 7f24bb646740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe39290 0xe96410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.431+0000 7f24bb646740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0xdcdec0 con 0xe39290 2024-09-13T18:36:23.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.431+0000 7f24bb646740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0xd3d470 con 0xe38530 2024-09-13T18:36:23.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.431+0000 7f24bb646740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0xd694f0 con 0xbc64d0 2024-09-13T18:36:23.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.431+0000 7f24b6932700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe39290 0xe96410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.431+0000 7f24b6932700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe39290 0xe96410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47176/0 (socket says 172.21.15.44:47176) 2024-09-13T18:36:23.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.431+0000 7f24b6932700 1 -- 172.21.15.44:0/186774814 learned_addr learned my addr 172.21.15.44:0/186774814 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:23.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.435+0000 7f24b5930700 1 --2- 172.21.15.44:0/186774814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xe38530 0xe9a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.435+0000 7f24b6131700 1 --2- 172.21.15.44:0/186774814 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xbc64d0 0xe9a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.435+0000 7f24b6932700 1 -- 172.21.15.44:0/186774814 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xbc64d0 msgr2=0xe9a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:23.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.435+0000 7f24b6932700 1 --2- 172.21.15.44:0/186774814 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xbc64d0 0xe9a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.435+0000 7f24b6932700 1 -- 172.21.15.44:0/186774814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xe38530 msgr2=0xe9a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:23.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.435+0000 7f24b6932700 1 --2- 172.21.15.44:0/186774814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xe38530 0xe9a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.435+0000 7f24b6932700 1 -- 172.21.15.44:0/186774814 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd4b450 con 0xe39290 2024-09-13T18:36:23.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.435+0000 7f24b6932700 1 --2- 172.21.15.44:0/186774814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe39290 0xe96410 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f24a8019000 tx=0x7f24a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942a9d62a2dd497f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:23.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.435+0000 7f24a4dac700 1 -- 172.21.15.44:0/186774814 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a800e040 con 0xe39290 2024-09-13T18:36:23.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.435+0000 7f24a4dac700 1 -- 172.21.15.44:0/186774814 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a8003c40 con 0xe39290 2024-09-13T18:36:23.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.435+0000 7f24a4dac700 1 -- 172.21.15.44:0/186774814 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a8009c60 con 0xe39290 2024-09-13T18:36:23.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.435+0000 7f24bb646740 1 -- 172.21.15.44:0/186774814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe39290 msgr2=0xe96410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.435+0000 7f24bb646740 1 --2- 172.21.15.44:0/186774814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe39290 0xe96410 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f24a8019000 tx=0x7f24a8017000 comp rx=0 tx=0).stop 2024-09-13T18:36:23.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.435+0000 7f24bb646740 1 -- 172.21.15.44:0/186774814 shutdown_connections 2024-09-13T18:36:23.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.435+0000 7f24bb646740 1 --2- 172.21.15.44:0/186774814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe39290 0xe96410 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.435+0000 7f24bb646740 1 --2- 172.21.15.44:0/186774814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xe38530 0xe9a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.435+0000 7f24bb646740 1 --2- 172.21.15.44:0/186774814 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xbc64d0 0xe9a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.435+0000 7f24bb646740 1 -- 172.21.15.44:0/186774814 >> 172.21.15.44:0/186774814 conn(0xe5ab70 msgr2=0xe32f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:23.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.435+0000 7f24bb646740 1 -- 172.21.15.44:0/186774814 shutdown_connections 2024-09-13T18:36:23.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.435+0000 7f24bb646740 1 -- 172.21.15.44:0/186774814 wait complete. 2024-09-13T18:36:23.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.435+0000 7f24bb646740 1 -- start start 2024-09-13T18:36:23.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.439+0000 7f24bb646740 1 Processor -- start 2024-09-13T18:36:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.439+0000 7f24bb646740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xbc64d0 0xee34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.439+0000 7f24bb646740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe38530 0xe98750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.439+0000 7f24bb646740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xe39290 0xe98c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.439+0000 7f24bb646740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0xe92d40 con 0xe38530 2024-09-13T18:36:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.439+0000 7f24bb646740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0xea0a00 con 0xbc64d0 2024-09-13T18:36:23.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.439+0000 7f24bb646740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0xe92f70 con 0xe39290 2024-09-13T18:36:23.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.439+0000 7f24bb646740 10 client.0 _ll_register_callbacks cb 0xe39b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:36:23.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.439+0000 7f24b5930700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe38530 0xe98750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.439+0000 7f24b5930700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe38530 0xe98750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47180/0 (socket says 172.21.15.44:47180) 2024-09-13T18:36:23.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.439+0000 7f24b5930700 1 -- 172.21.15.44:0/2049417062 learned_addr learned my addr 172.21.15.44:0/2049417062 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:23.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.439+0000 7f24b6131700 1 --2- 172.21.15.44:0/2049417062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xbc64d0 0xee34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.439+0000 7f24b6932700 1 --2- 172.21.15.44:0/2049417062 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xe39290 0xe98c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.439+0000 7f24b5930700 1 -- 172.21.15.44:0/2049417062 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xe39290 msgr2=0xe98c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:23.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.439+0000 7f24b5930700 1 --2- 172.21.15.44:0/2049417062 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xe39290 0xe98c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.439+0000 7f24b5930700 1 -- 172.21.15.44:0/2049417062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xbc64d0 msgr2=0xee34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:23.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.439+0000 7f24b5930700 1 --2- 172.21.15.44:0/2049417062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xbc64d0 0xee34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.439+0000 7f24b5930700 1 -- 172.21.15.44:0/2049417062 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xc11960 con 0xe38530 2024-09-13T18:36:23.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.439+0000 7f24b5930700 1 --2- 172.21.15.44:0/2049417062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe38530 0xe98750 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f24ac004810 tx=0x7f24ac019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7a57fd8265ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:23.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.439+0000 7f24917fa700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-13T18:36:23.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.439+0000 7f24917fa700 1 -- 172.21.15.44:0/2049417062 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac03b070 con 0xe38530 2024-09-13T18:36:23.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.439+0000 7f24917fa700 1 -- 172.21.15.44:0/2049417062 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24ac009a40 con 0xe38530 2024-09-13T18:36:23.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.439+0000 7f24bb646740 1 -- 172.21.15.44:0/2049417062 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xe61ee0 con 0xe38530 2024-09-13T18:36:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24917fa700 1 -- 172.21.15.44:0/2049417062 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24ac014650 con 0xe38530 2024-09-13T18:36:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24bb646740 10 client.8349 fetch_fsmap learned FSMap version 78 2024-09-13T18:36:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24bb646740 1 -- 172.21.15.44:0/2049417062 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0xd3f720 con 0xe38530 2024-09-13T18:36:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24917fa700 1 -- 172.21.15.44:0/2049417062 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xe61ee0 con 0xe38530 2024-09-13T18:36:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24917fa700 1 -- 172.21.15.44:0/2049417062 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 78) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f24ac0147b0 con 0xe38530 2024-09-13T18:36:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24bb646740 10 client.8349 fetch_fsmap finished waiting for FSMap version 78 2024-09-13T18:36:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24bb646740 10 client.8349 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:36:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24bb646740 20 client.8349 populate_metadata read hostname 'smithi044' 2024-09-13T18:36:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24bb646740 1 --2- 172.21.15.44:0/2049417062 >> [v2:172.21.15.44:6834/1527182738,v1:172.21.15.44:6835/1527182738] conn(0xe39670 0xe9fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24bb646740 4 client.8349 mds_command: new command op to 8193 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:36:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24bb646740 1 -- 172.21.15.44:0/2049417062 --> [v2:172.21.15.44:6834/1527182738,v1:172.21.15.44:6835/1527182738] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f24a800f040 con 0xe39670 2024-09-13T18:36:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24b6131700 1 --2- 172.21.15.44:0/2049417062 >> [v2:172.21.15.44:6834/1527182738,v1:172.21.15.44:6835/1527182738] conn(0xe39670 0xe9fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24917fa700 10 client.8349 ms_handle_connect on v2:172.21.15.44:6834/1527182738 2024-09-13T18:36:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24b6131700 1 --2- 172.21.15.44:0/2049417062 >> [v2:172.21.15.44:6834/1527182738,v1:172.21.15.44:6835/1527182738] conn(0xe39670 0xe9fd30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=621fba6e99941c56 server_cookie=c2d9a54ab2823f64 in_seq=0 out_seq=0 2024-09-13T18:36:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24917fa700 1 -- 172.21.15.44:0/2049417062 <== mds.0 v2:172.21.15.44:6834/1527182738 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7f24a800f040 con 0xe39670 2024-09-13T18:36:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24917fa700 10 client.8349 handle_command_reply: tid=0 2024-09-13T18:36:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24bb646740 1 client.8349 shutdown 2024-09-13T18:36:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24bb646740 1 -- 172.21.15.44:0/2049417062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe38530 msgr2=0xe98750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24bb646740 1 --2- 172.21.15.44:0/2049417062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe38530 0xe98750 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f24ac004810 tx=0x7f24ac019000 comp rx=0 tx=0).stop 2024-09-13T18:36:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24bb646740 1 -- 172.21.15.44:0/2049417062 shutdown_connections 2024-09-13T18:36:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24bb646740 1 --2- 172.21.15.44:0/2049417062 >> [v2:172.21.15.44:6834/1527182738,v1:172.21.15.44:6835/1527182738] conn(0xe39670 0xe9fd30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24917fa700 0 client.8349 ms_handle_reset on v2:172.21.15.44:6834/1527182738 2024-09-13T18:36:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24bb646740 1 --2- 172.21.15.44:0/2049417062 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0xe39290 0xe98c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24bb646740 1 --2- 172.21.15.44:0/2049417062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0xe38530 0xe98750 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24bb646740 1 --2- 172.21.15.44:0/2049417062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0xbc64d0 0xee34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24bb646740 1 -- 172.21.15.44:0/2049417062 >> 172.21.15.44:0/2049417062 conn(0xe5ab70 msgr2=0xe32f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24bb646740 1 -- 172.21.15.44:0/2049417062 shutdown_connections 2024-09-13T18:36:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24bb646740 1 -- 172.21.15.44:0/2049417062 wait complete. 2024-09-13T18:36:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24bb646740 20 client.8349 trim_cache size 0 max 16384 2024-09-13T18:36:23.454 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:36:23.454 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "c8e1d12d-7fb9-4a33-982e-b895bb77262c", 2024-09-13T18:36:23.454 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-13T18:36:23.454 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 8193, 2024-09-13T18:36:23.454 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-13T18:36:23.454 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-13T18:36:23.454 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-13T18:36:23.454 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 5.7998126430000001, 2024-09-13T18:36:23.454 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 78, 2024-09-13T18:36:23.455 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 90, 2024-09-13T18:36:23.455 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 90, 2024-09-13T18:36:23.455 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 10.294383862 2024-09-13T18:36:23.455 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:36:23.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24b7133700 1 -- 172.21.15.44:0/2985233158 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2494066730 msgr2=0x7f2494068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24b7133700 1 --2- 172.21.15.44:0/2985233158 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2494066730 0x7f2494068bf0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f24b00ce7c0 tx=0x7f24ac009240 comp rx=0 tx=0).stop 2024-09-13T18:36:23.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24b7133700 1 -- 172.21.15.44:0/2985233158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24b00710e0 msgr2=0x7f24b0158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24b7133700 1 --2- 172.21.15.44:0/2985233158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24b00710e0 0x7f24b0158600 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f24a0000c00 tx=0x7f24a0004770 comp rx=0 tx=0).stop 2024-09-13T18:36:23.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24b7133700 1 -- 172.21.15.44:0/2985233158 shutdown_connections 2024-09-13T18:36:23.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24b7133700 1 --2- 172.21.15.44:0/2985233158 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f2494066730 0x7f2494068bf0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24b7133700 1 --2- 172.21.15.44:0/2985233158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24b015a460 0x7f24b0144e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24b7133700 1 --2- 172.21.15.44:0/2985233158 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f24b01573e0 0x7f24b014b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24b7133700 1 --2- 172.21.15.44:0/2985233158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24b00710e0 0x7f24b0158600 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.443+0000 7f24b7133700 1 -- 172.21.15.44:0/2985233158 >> 172.21.15.44:0/2985233158 conn(0x7f24b00b0e10 msgr2=0x7f24b015bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.447+0000 7f24b7133700 1 -- 172.21.15.44:0/2985233158 shutdown_connections 2024-09-13T18:36:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.447+0000 7f24b7133700 1 -- 172.21.15.44:0/2985233158 wait complete. 2024-09-13T18:36:23.467 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:36:23.565 INFO:tasks.ceph.mds.c.smithi044.stderr:2024-09-13T18:36:23.559+0000 7ff5996c3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:36:23.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.583+0000 7f72a2f2a700 1 Processor -- start 2024-09-13T18:36:23.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.583+0000 7f72a2f2a700 1 -- start start 2024-09-13T18:36:23.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.583+0000 7f72a2f2a700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f729c0b3ae0 0x7f729c06a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.583+0000 7f72a2f2a700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f729c06aaf0 0x7f729c15e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.583+0000 7f72a2f2a700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f729c13dcb0 con 0x7f729c06bbf0 2024-09-13T18:36:23.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.583+0000 7f72a2f2a700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f729c15be60 con 0x7f729c06aaf0 2024-09-13T18:36:23.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.583+0000 7f72a2f2a700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f729c13ffd0 con 0x7f729c0b3ae0 2024-09-13T18:36:23.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.583+0000 7f72a2729700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f729c06aaf0 0x7f729c15e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.583+0000 7f72a1f28700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f729c06bbf0 0x7f729c0b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49650/0 (socket says 172.21.15.44:49650) 2024-09-13T18:36:23.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.583+0000 7f72a1f28700 1 -- 172.21.15.44:0/1732846264 learned_addr learned my addr 172.21.15.44:0/1732846264 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:23.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.583+0000 7f72a1727700 1 --2- 172.21.15.44:0/1732846264 >> v2:172.21.15.99:3300/0 conn(0x7f729c0b3ae0 0x7f729c06a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.587+0000 7f72a2729700 1 -- 172.21.15.44:0/1732846264 >> v2:172.21.15.99:3300/0 conn(0x7f729c0b3ae0 msgr2=0x7f729c06a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:23.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.587+0000 7f72a2729700 1 --2- 172.21.15.44:0/1732846264 >> v2:172.21.15.99:3300/0 conn(0x7f729c0b3ae0 0x7f729c06a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.587+0000 7f72a2729700 1 -- 172.21.15.44:0/1732846264 >> v1:172.21.15.44:6789/0 conn(0x7f729c06bbf0 legacy=0x7f729c0b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.587+0000 7f72a0f26700 1 -- 172.21.15.44:0/1732846264 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176707152 0 0) 0x7f729c13dcb0 con 0x7f729c06bbf0 2024-09-13T18:36:23.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.587+0000 7f72a2729700 1 -- 172.21.15.44:0/1732846264 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729c140220 con 0x7f729c06aaf0 2024-09-13T18:36:23.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.587+0000 7f72a1727700 1 --2- 172.21.15.44:0/1732846264 >> v2:172.21.15.99:3300/0 conn(0x7f729c0b3ae0 0x7f729c06a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:23.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.587+0000 7f72a2729700 1 --2- 172.21.15.44:0/1732846264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f729c06aaf0 0x7f729c15e440 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f729c1445b0 tx=0x7f729400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f9f05e2243608a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:23.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.587+0000 7f72a0f26700 1 -- 172.21.15.44:0/1732846264 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729400e070 con 0x7f729c06aaf0 2024-09-13T18:36:23.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.587+0000 7f72a0f26700 1 -- 172.21.15.44:0/1732846264 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729400bb20 con 0x7f729c06aaf0 2024-09-13T18:36:23.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.587+0000 7f72a0f26700 1 -- 172.21.15.44:0/1732846264 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7294012430 con 0x7f729c06aaf0 2024-09-13T18:36:23.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.587+0000 7f72a2f2a700 1 -- 172.21.15.44:0/1732846264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f729c06aaf0 msgr2=0x7f729c15e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.587+0000 7f72a2f2a700 1 --2- 172.21.15.44:0/1732846264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f729c06aaf0 0x7f729c15e440 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f729c1445b0 tx=0x7f729400b330 comp rx=0 tx=0).stop 2024-09-13T18:36:23.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.587+0000 7f72a2f2a700 1 -- 172.21.15.44:0/1732846264 shutdown_connections 2024-09-13T18:36:23.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.587+0000 7f72a2f2a700 1 --2- 172.21.15.44:0/1732846264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f729c06aaf0 0x7f729c15e440 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.587+0000 7f72a2f2a700 1 --2- 172.21.15.44:0/1732846264 >> v2:172.21.15.99:3300/0 conn(0x7f729c0b3ae0 0x7f729c06a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.587+0000 7f72a2f2a700 1 -- 172.21.15.44:0/1732846264 >> 172.21.15.44:0/1732846264 conn(0x7f729c0b0f00 msgr2=0x7f729c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:23.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.587+0000 7f72a2f2a700 1 -- 172.21.15.44:0/1732846264 shutdown_connections 2024-09-13T18:36:23.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.587+0000 7f72a2f2a700 1 -- 172.21.15.44:0/1732846264 wait complete. 2024-09-13T18:36:23.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72a2f2a700 1 Processor -- start 2024-09-13T18:36:23.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72a2f2a700 1 -- start start 2024-09-13T18:36:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72a2f2a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f729c06aaf0 0x7f729c13cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72a2f2a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f729c06bbf0 0x7f729c1f24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72a2f2a700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f729c0b3ae0 0x7f729c1e50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72a2f2a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729c13d3e0 con 0x7f729c06bbf0 2024-09-13T18:36:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72a2f2a700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729c0cc410 con 0x7f729c06aaf0 2024-09-13T18:36:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72a2f2a700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729c152310 con 0x7f729c0b3ae0 2024-09-13T18:36:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72a1727700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f729c06bbf0 0x7f729c1f24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72a1727700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f729c06bbf0 0x7f729c1f24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47196/0 (socket says 172.21.15.44:47196) 2024-09-13T18:36:23.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72a1727700 1 -- 172.21.15.44:0/2914916224 learned_addr learned my addr 172.21.15.44:0/2914916224 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:23.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72a1f28700 1 --2- 172.21.15.44:0/2914916224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f729c06aaf0 0x7f729c13cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72a2729700 1 --2- 172.21.15.44:0/2914916224 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f729c0b3ae0 0x7f729c1e50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72a1727700 1 -- 172.21.15.44:0/2914916224 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f729c0b3ae0 msgr2=0x7f729c1e50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72a1727700 1 --2- 172.21.15.44:0/2914916224 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f729c0b3ae0 0x7f729c1e50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72a1727700 1 -- 172.21.15.44:0/2914916224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f729c06aaf0 msgr2=0x7f729c13cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72a1727700 1 --2- 172.21.15.44:0/2914916224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f729c06aaf0 0x7f729c13cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72a1727700 1 -- 172.21.15.44:0/2914916224 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72980094b0 con 0x7f729c06bbf0 2024-09-13T18:36:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72a1727700 1 --2- 172.21.15.44:0/2914916224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f729c06bbf0 0x7f729c1f24a0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f729800ebe0 tx=0x7f729800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72927fc700 1 -- 172.21.15.44:0/2914916224 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7298009770 con 0x7f729c06bbf0 2024-09-13T18:36:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72927fc700 1 -- 172.21.15.44:0/2914916224 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729800c850 con 0x7f729c06bbf0 2024-09-13T18:36:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72a2f2a700 1 -- 172.21.15.44:0/2914916224 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7294009a70 con 0x7f729c06bbf0 2024-09-13T18:36:23.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72927fc700 1 -- 172.21.15.44:0/2914916224 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729800cbe0 con 0x7f729c06bbf0 2024-09-13T18:36:23.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.591+0000 7f72a2f2a700 1 -- 172.21.15.44:0/2914916224 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f729c1528d0 con 0x7f729c06bbf0 2024-09-13T18:36:23.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.595+0000 7f72a2f2a700 1 -- 172.21.15.44:0/2914916224 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f729c06af40 con 0x7f729c06bbf0 2024-09-13T18:36:23.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.595+0000 7f72927fc700 1 -- 172.21.15.44:0/2914916224 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f729800cd40 con 0x7f729c06bbf0 2024-09-13T18:36:23.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.595+0000 7f72927fc700 1 --2- 172.21.15.44:0/2914916224 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7280066730 0x7f7280068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.595+0000 7f72927fc700 1 -- 172.21.15.44:0/2914916224 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72980841d0 con 0x7f729c06bbf0 2024-09-13T18:36:23.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.595+0000 7f72a1f28700 1 --2- 172.21.15.44:0/2914916224 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7280066730 0x7f7280068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.595+0000 7f72a1f28700 1 --2- 172.21.15.44:0/2914916224 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7280066730 0x7f7280068bf0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f728c000f60 tx=0x7f728c007e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:23.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.603+0000 7f72927fc700 1 -- 172.21.15.44:0/2914916224 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f72980514c0 con 0x7f729c06bbf0 2024-09-13T18:36:23.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.811+0000 7f72a2f2a700 1 -- 172.21.15.44:0/2914916224 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f729c0710d0 con 0x7f729c06bbf0 2024-09-13T18:36:23.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.811+0000 7f72927fc700 1 -- 172.21.15.44:0/2914916224 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v78) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7298054ae0 con 0x7f729c06bbf0 2024-09-13T18:36:23.820 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:36:23.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.815+0000 7f72a2f2a700 1 -- 172.21.15.44:0/2914916224 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7280066730 msgr2=0x7f7280068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.815+0000 7f72a2f2a700 1 --2- 172.21.15.44:0/2914916224 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7280066730 0x7f7280068bf0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f728c000f60 tx=0x7f728c007e00 comp rx=0 tx=0).stop 2024-09-13T18:36:23.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.815+0000 7f72a2f2a700 1 -- 172.21.15.44:0/2914916224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f729c06bbf0 msgr2=0x7f729c1f24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.815+0000 7f72a2f2a700 1 --2- 172.21.15.44:0/2914916224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f729c06bbf0 0x7f729c1f24a0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f729800ebe0 tx=0x7f729800eef0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.815+0000 7f72a2f2a700 1 -- 172.21.15.44:0/2914916224 shutdown_connections 2024-09-13T18:36:23.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.815+0000 7f72a2f2a700 1 --2- 172.21.15.44:0/2914916224 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7280066730 0x7f7280068bf0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.815+0000 7f72a2f2a700 1 --2- 172.21.15.44:0/2914916224 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f729c0b3ae0 0x7f729c1e50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.815+0000 7f72a2f2a700 1 --2- 172.21.15.44:0/2914916224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f729c06bbf0 0x7f729c1f24a0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.815+0000 7f72a2f2a700 1 --2- 172.21.15.44:0/2914916224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f729c06aaf0 0x7f729c13cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.815+0000 7f72a2f2a700 1 -- 172.21.15.44:0/2914916224 >> 172.21.15.44:0/2914916224 conn(0x7f729c0b0f00 msgr2=0x7f729c0715f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:23.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.815+0000 7f72a2f2a700 1 -- 172.21.15.44:0/2914916224 shutdown_connections 2024-09-13T18:36:23.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:23.815+0000 7f72a2f2a700 1 -- 172.21.15.44:0/2914916224 wait complete. 2024-09-13T18:36:23.835 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:36:23.836 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:36:23.836 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-13T18:36:23.836 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:36:23.836 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:36:23.836 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:36:23.836 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:36:23.836 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:36:23.836 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:36:23.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:23.836 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-13T18:36:23.844 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:36:23.845 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:36:23.845 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:36:23.845 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:23.845 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-13T18:36:23.845 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:23.845 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:36:23.845 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:23.845 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:36:23.845 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:23.845 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:36:23.845 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:23.846 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:36:23.846 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42040sec preferred_lft 42040sec 2024-09-13T18:36:23.846 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-13T18:36:23.846 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:23.846 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:36:23.846 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:23.846 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:36:23.846 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:80:b2:e4:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:23.846 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:36:23.846 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:23.846 INFO:teuthology.orchestra.run.smithi044.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:36:23.846 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 2e:69:eb:1c:57:57 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:23.846 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:36:23.846 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:23.847 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::8842:91ff:feed:2c53/64 scope link 2024-09-13T18:36:23.847 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:23.847 INFO:teuthology.orchestra.run.smithi044.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:36:23.847 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 2e:69:eb:1c:57:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:36:23.847 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::2c69:ebff:fe1c:5757/64 scope link 2024-09-13T18:36:23.847 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:23.847 INFO:teuthology.orchestra.run.smithi044.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:36:23.847 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 86:e5:07:ac:f1:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:36:23.847 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::84e5:7ff:feac:f11b/64 scope link 2024-09-13T18:36:23.847 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:23.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:23.848 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:36:23.904 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-13T18:36:23.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:23.906 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-13T18:36:23.915 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-13T18:36:23.915 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:36:23.915 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:36:23.915 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:36:23.915 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:36:23.915 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:36:23.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:23.916 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec bash -c ' 2024-09-13T18:36:23.916 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-13T18:36:23.916 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:36:23.916 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:36:23.916 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:36:23.916 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-13T18:36:23.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:23.954 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-13T18:36:24.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:36:24.004 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:36:24.004 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:36:24.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:24.005 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-13T18:36:24.022 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:36:24.022 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:36:24.022 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:36:24.026 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:36:24.027 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:36:24.027 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:36:24.032 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:36:24.048 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:36:24.048 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:36:24.104 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:36:24.105 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:36:24.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:24.106 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:36:24.111 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:36:24.111 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:36:24.113 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:36:24.128 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:36:24.128 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:36:24.138 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:36:24.139 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:36:24.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:24.140 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:36:24.210 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2024-09-13T18:36:24.203+0000 7f745401a640 -1 init, newargv = 0x55c9511bf720 newargc=15 2024-09-13T18:36:24.210 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[48376]: starting ceph client 2024-09-13T18:36:24.219 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[48376]: starting fuse 2024-09-13T18:36:25.289 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-13T18:36:25.306 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:36:25.306 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:36:25.320 INFO:teuthology.orchestra.run.smithi044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:36:25.321 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:36:25.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:25.321 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-13T18:36:25.371 INFO:teuthology.orchestra.run.smithi044.stdout:52 2024-09-13T18:36:25.372 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T18:36:25.372 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:36:25.372 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2024-09-13T18:36:25.372 DEBUG:teuthology.orchestra.run.smithi044:> import re 2024-09-13T18:36:25.372 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-13T18:36:25.372 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2024-09-13T18:36:25.372 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:36:25.372 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2024-09-13T18:36:25.372 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:36:25.372 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2024-09-13T18:36:25.373 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:36:25.373 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:36:25.373 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2024-09-13T18:36:25.373 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2024-09-13T18:36:25.373 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2024-09-13T18:36:25.373 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2024-09-13T18:36:25.373 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:36:25.373 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2024-09-13T18:36:25.373 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:36:25.373 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:36:25.373 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:36:25.373 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2024-09-13T18:36:25.373 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2024-09-13T18:36:25.373 DEBUG:teuthology.orchestra.run.smithi044:> return f 2024-09-13T18:36:25.373 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:36:25.374 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-13T18:36:25.374 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.0")) 2024-09-13T18:36:25.374 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-13T18:36:25.461 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.0.48376.asok 2024-09-13T18:36:25.647 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48376.asok 2024-09-13T18:36:25.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:25.647 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48376.asok status 2024-09-13T18:36:25.748 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:36:25.748 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2024-09-13T18:36:25.748 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:36:25.748 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:36:25.748 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "0", 2024-09-13T18:36:25.748 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2024-09-13T18:36:25.748 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:36:25.748 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "48376", 2024-09-13T18:36:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2024-09-13T18:36:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2024-09-13T18:36:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2024-09-13T18:36:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 7241, 2024-09-13T18:36:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2024-09-13T18:36:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2024-09-13T18:36:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2024-09-13T18:36:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 7241 2024-09-13T18:36:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:36:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-13T18:36:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:36:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3009013279 2024-09-13T18:36:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-13T18:36:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-13T18:36:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:36:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3009013279 2024-09-13T18:36:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.7241 192.168.0.1:0/3009013279", 2024-09-13T18:36:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/3009013279", 2024-09-13T18:36:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2024-09-13T18:36:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 78, 2024-09-13T18:36:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 90, 2024-09-13T18:36:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:36:25.751 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2024-09-13T18:36:25.751 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2024-09-13T18:36:25.751 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:36:25.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:25.759 DEBUG:teuthology.orchestra.run.smithi044:> stat --file-system '--printf=%T 2024-09-13T18:36:25.759 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:36:25.766 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2024-09-13T18:36:25.766 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:36:25.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:25.766 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:36:25.785 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all show inode 2024-09-13T18:36:25.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.815+0000 7fcf711c5500 1 -- start start 2024-09-13T18:36:25.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.815+0000 7fcf711c5500 1 Processor -- start 2024-09-13T18:36:25.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.815+0000 7fcf711c5500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5633ac14b800 0x5633ac1f1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.815+0000 7fcf711c5500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633ac14b400 0x5633ac1f1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.815+0000 7fcf711c5500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633ac14b000 0x5633ac1f1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.815+0000 7fcf711c5500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ac1cc780 con 0x5633ac14b000 2024-09-13T18:36:25.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.815+0000 7fcf711c5500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ac1cc640 con 0x5633ac14b400 2024-09-13T18:36:25.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.815+0000 7fcf711c5500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5633ac1cc500 con 0x5633ac14b800 2024-09-13T18:36:25.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf70180700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633ac14b000 0x5633ac1f1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf70180700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633ac14b000 0x5633ac1f1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47218/0 (socket says 172.21.15.44:47218) 2024-09-13T18:36:25.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf6f17e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633ac14b400 0x5633ac1f1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf70180700 1 -- 172.21.15.44:0/3622763464 learned_addr learned my addr 172.21.15.44:0/3622763464 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:25.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf6f97f700 1 --2- 172.21.15.44:0/3622763464 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5633ac14b800 0x5633ac1f1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf70180700 1 -- 172.21.15.44:0/3622763464 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5633ac14b800 msgr2=0x5633ac1f1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:25.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf70180700 1 --2- 172.21.15.44:0/3622763464 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5633ac14b800 0x5633ac1f1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf70180700 1 -- 172.21.15.44:0/3622763464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633ac14b400 msgr2=0x5633ac1f1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:25.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf70180700 1 --2- 172.21.15.44:0/3622763464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633ac14b400 0x5633ac1f1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf70180700 1 -- 172.21.15.44:0/3622763464 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633ac16e9c0 con 0x5633ac14b000 2024-09-13T18:36:25.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf70180700 1 --2- 172.21.15.44:0/3622763464 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633ac14b000 0x5633ac1f1080 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x5633acf22de0 tx=0x5633acf28c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2ace10bfd2b4ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:25.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf6d17a700 1 -- 172.21.15.44:0/3622763464 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5633ac19b600 con 0x5633ac14b000 2024-09-13T18:36:25.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf6d17a700 1 -- 172.21.15.44:0/3622763464 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5633acf3a000 con 0x5633ac14b000 2024-09-13T18:36:25.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf6d17a700 1 -- 172.21.15.44:0/3622763464 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5633ac19b1e0 con 0x5633ac14b000 2024-09-13T18:36:25.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf711c5500 1 -- 172.21.15.44:0/3622763464 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5633ac16eb60 con 0x5633ac14b000 2024-09-13T18:36:25.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf711c5500 1 -- 172.21.15.44:0/3622763464 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5633ac16e340 con 0x5633ac14b000 2024-09-13T18:36:25.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf711c5500 4 waiting for MDS map... 2024-09-13T18:36:25.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf6d17a700 1 -- 172.21.15.44:0/3622763464 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x5633ac184c40 con 0x5633ac14b000 2024-09-13T18:36:25.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf6d17a700 1 -- 172.21.15.44:0/3622763464 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 78) v1 ==== 3114+0+0 (secure 0 0 0) 0x5633acf3a000 con 0x5633ac14b000 2024-09-13T18:36:25.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf711c5500 4 Got MDS map 78 2024-09-13T18:36:25.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf711c5500 10 main: main 2024-09-13T18:36:25.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf711c5500 4 main: connecting to RADOS... 2024-09-13T18:36:25.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf711c5500 1 Processor -- start 2024-09-13T18:36:25.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf711c5500 1 -- start start 2024-09-13T18:36:25.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf711c5500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5633ac438400 0x5633ac1f0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf711c5500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633ac438800 0x5633ac1f0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf711c5500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633ac438c00 0x5633ac1f2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf711c5500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ac181e00 con 0x5633ac438c00 2024-09-13T18:36:25.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf711c5500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ac1cc640 con 0x5633ac438800 2024-09-13T18:36:25.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf711c5500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5633ac1cc3c0 con 0x5633ac438400 2024-09-13T18:36:25.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf6f17e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633ac438c00 0x5633ac1f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf6f17e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633ac438c00 0x5633ac1f2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47230/0 (socket says 172.21.15.44:47230) 2024-09-13T18:36:25.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf6f17e700 1 -- 172.21.15.44:0/826460791 learned_addr learned my addr 172.21.15.44:0/826460791 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:25.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.819+0000 7fcf6f97f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633ac438800 0x5633ac1f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf6f17e700 1 --2- 172.21.15.44:0/826460791 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5633ac438400 0x5633ac1f0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf6f97f700 1 -- 172.21.15.44:0/826460791 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5633ac438400 msgr2=0x5633ac1f0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:25.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf6f97f700 1 --2- 172.21.15.44:0/826460791 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5633ac438400 0x5633ac1f0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf6f97f700 1 -- 172.21.15.44:0/826460791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633ac438c00 msgr2=0x5633ac1f2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:25.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf6f97f700 1 --2- 172.21.15.44:0/826460791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633ac438c00 0x5633ac1f2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf6f97f700 1 -- 172.21.15.44:0/826460791 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633ac16e000 con 0x5633ac438800 2024-09-13T18:36:25.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf6f17e700 1 --2- 172.21.15.44:0/826460791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633ac438c00 0x5633ac1f2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:25.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf6f97f700 1 --2- 172.21.15.44:0/826460791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633ac438800 0x5633ac1f0580 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x5633ac49e150 tx=0x5633ac452f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fb4e5843bbd87fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:25.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf6b176700 1 -- 172.21.15.44:0/826460791 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5633ac19b600 con 0x5633ac438800 2024-09-13T18:36:25.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf6b176700 1 -- 172.21.15.44:0/826460791 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5633acf3cd80 con 0x5633ac438800 2024-09-13T18:36:25.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf6b176700 1 -- 172.21.15.44:0/826460791 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5633ac19b1e0 con 0x5633ac438800 2024-09-13T18:36:25.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf711c5500 1 -- 172.21.15.44:0/826460791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633ac438800 msgr2=0x5633ac1f0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf711c5500 1 --2- 172.21.15.44:0/826460791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633ac438800 0x5633ac1f0580 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x5633ac49e150 tx=0x5633ac452f60 comp rx=0 tx=0).stop 2024-09-13T18:36:25.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf711c5500 1 -- 172.21.15.44:0/826460791 shutdown_connections 2024-09-13T18:36:25.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf711c5500 1 --2- 172.21.15.44:0/826460791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633ac438c00 0x5633ac1f2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf711c5500 1 --2- 172.21.15.44:0/826460791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633ac438800 0x5633ac1f0580 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf711c5500 1 --2- 172.21.15.44:0/826460791 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5633ac438400 0x5633ac1f0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf711c5500 1 -- 172.21.15.44:0/826460791 >> 172.21.15.44:0/826460791 conn(0x5633ac14ac00 msgr2=0x5633ac23b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:25.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf711c5500 1 -- 172.21.15.44:0/826460791 shutdown_connections 2024-09-13T18:36:25.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf711c5500 1 -- 172.21.15.44:0/826460791 wait complete. 2024-09-13T18:36:25.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf711c5500 1 Processor -- start 2024-09-13T18:36:25.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf711c5500 1 -- start start 2024-09-13T18:36:25.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf711c5500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633ac438400 0x5633ac1f0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf711c5500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5633ac438800 0x5633ac1f0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf711c5500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633ac438c00 0x5633ac1f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf711c5500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ac1cc280 con 0x5633ac438400 2024-09-13T18:36:25.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf711c5500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ac1cc140 con 0x5633ac438c00 2024-09-13T18:36:25.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf711c5500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5633ac1cc000 con 0x5633ac438800 2024-09-13T18:36:25.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf6f17e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633ac438400 0x5633ac1f0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf6f17e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633ac438400 0x5633ac1f0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47240/0 (socket says 172.21.15.44:47240) 2024-09-13T18:36:25.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.823+0000 7fcf6f17e700 1 -- 172.21.15.44:0/1522702911 learned_addr learned my addr 172.21.15.44:0/1522702911 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:25.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.827+0000 7fcf6f17e700 1 --2- 172.21.15.44:0/1522702911 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633ac438c00 0x5633ac1f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.827+0000 7fcf6f97f700 1 --2- 172.21.15.44:0/1522702911 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5633ac438800 0x5633ac1f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.827+0000 7fcf6f17e700 1 -- 172.21.15.44:0/1522702911 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5633ac438800 msgr2=0x5633ac1f0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.827+0000 7fcf6f17e700 1 --2- 172.21.15.44:0/1522702911 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5633ac438800 0x5633ac1f0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.827+0000 7fcf6f17e700 1 -- 172.21.15.44:0/1522702911 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633ac438c00 msgr2=0x5633ac1f2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.827+0000 7fcf6f17e700 1 --2- 172.21.15.44:0/1522702911 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633ac438c00 0x5633ac1f2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.827+0000 7fcf6f17e700 1 -- 172.21.15.44:0/1522702911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633ac16e9c0 con 0x5633ac438400 2024-09-13T18:36:25.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.827+0000 7fcf6f17e700 1 --2- 172.21.15.44:0/1522702911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633ac438400 0x5633ac1f0b00 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x5633ac49f440 tx=0x5633ac452e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:25.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.827+0000 7fcf69973700 1 -- 172.21.15.44:0/1522702911 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5633ac19b080 con 0x5633ac438400 2024-09-13T18:36:25.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.827+0000 7fcf69973700 1 -- 172.21.15.44:0/1522702911 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5633acf3c300 con 0x5633ac438400 2024-09-13T18:36:25.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.827+0000 7fcf711c5500 1 -- 172.21.15.44:0/1522702911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5633ac16eb60 con 0x5633ac438400 2024-09-13T18:36:25.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.827+0000 7fcf69973700 1 -- 172.21.15.44:0/1522702911 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5633ac19b600 con 0x5633ac438400 2024-09-13T18:36:25.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.827+0000 7fcf711c5500 1 -- 172.21.15.44:0/1522702911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5633ac16eea0 con 0x5633ac438400 2024-09-13T18:36:25.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.827+0000 7fcf711c5500 4 main: resolving pool 12 2024-09-13T18:36:25.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf69973700 1 -- 172.21.15.44:0/1522702911 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x5633ac1aa840 con 0x5633ac438400 2024-09-13T18:36:25.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf69973700 1 --2- 172.21.15.44:0/1522702911 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5633ac59c000 0x5633ac59e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf69973700 1 -- 172.21.15.44:0/1522702911 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x5633ac184a80 con 0x5633ac438400 2024-09-13T18:36:25.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf711c5500 4 main: creating IoCtx.. 2024-09-13T18:36:25.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf711c5500 1 --2- 172.21.15.44:0/1522702911 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x5633ac439000 0x5633ac1f2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf711c5500 1 -- 172.21.15.44:0/1522702911 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:1 12.13 12:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x5633ac439400 con 0x5633ac439000 2024-09-13T18:36:25.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf6f97f700 1 --2- 172.21.15.44:0/1522702911 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5633ac59c000 0x5633ac59e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf6f17e700 1 --2- 172.21.15.44:0/1522702911 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x5633ac439000 0x5633ac1f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf6f17e700 1 --2- 172.21.15.44:0/1522702911 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x5633ac439000 0x5633ac1f2680 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:25.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf6f97f700 1 --2- 172.21.15.44:0/1522702911 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5633ac59c000 0x5633ac59e000 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x5633ac49e150 tx=0x5633ac221140 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:25.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf6f17e700 1 -- 172.21.15.44:0/1522702911 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv2 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x5633acfc8b40 con 0x5633ac439000 2024-09-13T18:36:25.842 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:36:25.842 INFO:teuthology.orchestra.run.smithi044.stdout: "0": { 2024-09-13T18:36:25.842 INFO:teuthology.orchestra.run.smithi044.stdout: "data": { 2024-09-13T18:36:25.842 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-09-13T18:36:25.842 INFO:teuthology.orchestra.run.smithi044.stdout: "inotable": { 2024-09-13T18:36:25.842 INFO:teuthology.orchestra.run.smithi044.stdout: "projected_free": [ 2024-09-13T18:36:25.842 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:25.842 INFO:teuthology.orchestra.run.smithi044.stdout: "start": 1099511627776, 2024-09-13T18:36:25.842 INFO:teuthology.orchestra.run.smithi044.stdout: "len": 1099511627776 2024-09-13T18:36:25.843 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:25.843 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-13T18:36:25.843 INFO:teuthology.orchestra.run.smithi044.stdout: "free": [ 2024-09-13T18:36:25.843 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:25.843 INFO:teuthology.orchestra.run.smithi044.stdout: "start": 1099511627776, 2024-09-13T18:36:25.843 INFO:teuthology.orchestra.run.smithi044.stdout: "len": 1099511627776 2024-09-13T18:36:25.843 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:25.843 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-13T18:36:25.843 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:25.843 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:25.843 INFO:teuthology.orchestra.run.smithi044.stdout: "result": 0 2024-09-13T18:36:25.843 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:25.843 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:36:25.843 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:25.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf711c5500 1 -- 172.21.15.44:0/1522702911 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x5633ac439000 msgr2=0x5633ac1f2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf711c5500 1 --2- 172.21.15.44:0/1522702911 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x5633ac439000 0x5633ac1f2680 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf711c5500 1 -- 172.21.15.44:0/1522702911 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5633ac59c000 msgr2=0x5633ac59e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf711c5500 1 --2- 172.21.15.44:0/1522702911 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x5633ac59c000 0x5633ac59e000 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x5633ac49e150 tx=0x5633ac221140 comp rx=0 tx=0).stop 2024-09-13T18:36:25.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf711c5500 1 -- 172.21.15.44:0/1522702911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633ac438400 msgr2=0x5633ac1f0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf711c5500 1 --2- 172.21.15.44:0/1522702911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633ac438400 0x5633ac1f0b00 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x5633ac49f440 tx=0x5633ac452e40 comp rx=0 tx=0).stop 2024-09-13T18:36:25.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf6f97f700 1 -- 172.21.15.44:0/1522702911 reap_dead start 2024-09-13T18:36:25.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf711c5500 1 -- 172.21.15.44:0/1522702911 shutdown_connections 2024-09-13T18:36:25.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf711c5500 1 -- 172.21.15.44:0/1522702911 >> 172.21.15.44:0/1522702911 conn(0x5633ac14ac00 msgr2=0x5633ac23b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:25.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf711c5500 1 -- 172.21.15.44:0/1522702911 shutdown_connections 2024-09-13T18:36:25.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf711c5500 1 -- 172.21.15.44:0/1522702911 wait complete. 2024-09-13T18:36:25.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf711c5500 1 -- 172.21.15.44:0/3622763464 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633ac14b000 msgr2=0x5633ac1f1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf711c5500 1 --2- 172.21.15.44:0/3622763464 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633ac14b000 0x5633ac1f1080 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x5633acf22de0 tx=0x5633acf28c00 comp rx=0 tx=0).stop 2024-09-13T18:36:25.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf711c5500 1 -- 172.21.15.44:0/3622763464 shutdown_connections 2024-09-13T18:36:25.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf711c5500 1 --2- 172.21.15.44:0/3622763464 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633ac14b000 0x5633ac1f1080 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf711c5500 1 --2- 172.21.15.44:0/3622763464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5633ac14b400 0x5633ac1f1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf711c5500 1 --2- 172.21.15.44:0/3622763464 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5633ac14b800 0x5633ac1f1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf711c5500 1 -- 172.21.15.44:0/3622763464 >> 172.21.15.44:0/3622763464 conn(0x5633ac14bc00 msgr2=0x5633ac23b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:25.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf711c5500 1 -- 172.21.15.44:0/3622763464 shutdown_connections 2024-09-13T18:36:25.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.831+0000 7fcf711c5500 1 -- 172.21.15.44:0/3622763464 wait complete. 2024-09-13T18:36:25.847 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'show', 'inode'] in time 0:00:00.062355, result: { "0": { "data": { "version": 0, "inotable": { "projected_free": [ { "start": 1099511627776, "len": 1099511627776 } ], "free": [ { "start": 1099511627776, "len": 1099511627776 } ] } }, "result": 0 } } 2024-09-13T18:36:25.847 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 all take_inos 1099511627876 2024-09-13T18:36:25.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b6b43500 1 -- start start 2024-09-13T18:36:25.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b6b43500 1 Processor -- start 2024-09-13T18:36:25.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b6b43500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55951640b000 0x5595164b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b6b43500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951640b400 0x5595164b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b6b43500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55951640b800 0x5595164b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b6b43500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x559516441e00 con 0x55951640b400 2024-09-13T18:36:25.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b6b43500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55951648c780 con 0x55951640b800 2024-09-13T18:36:25.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b6b43500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55951648ca00 con 0x55951640b000 2024-09-13T18:36:25.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b4afc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951640b400 0x5595164b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b4afc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951640b400 0x5595164b0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47246/0 (socket says 172.21.15.44:47246) 2024-09-13T18:36:25.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b4afc700 1 -- 172.21.15.44:0/3125424282 learned_addr learned my addr 172.21.15.44:0/3125424282 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:25.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b52fd700 1 --2- 172.21.15.44:0/3125424282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55951640b000 0x5595164b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b5afe700 1 --2- 172.21.15.44:0/3125424282 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55951640b800 0x5595164b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b4afc700 1 -- 172.21.15.44:0/3125424282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55951640b000 msgr2=0x5595164b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:25.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b4afc700 1 --2- 172.21.15.44:0/3125424282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55951640b000 0x5595164b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b4afc700 1 -- 172.21.15.44:0/3125424282 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55951640b800 msgr2=0x5595164b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:25.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b4afc700 1 --2- 172.21.15.44:0/3125424282 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55951640b800 0x5595164b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b4afc700 1 -- 172.21.15.44:0/3125424282 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55951642e9c0 con 0x55951640b400 2024-09-13T18:36:25.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b4afc700 1 --2- 172.21.15.44:0/3125424282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951640b400 0x5595164b0b00 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x559517176e70 tx=0x559517178480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53ffe4ae3a34de9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:25.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b2af8700 1 -- 172.21.15.44:0/3125424282 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55951645b600 con 0x55951640b400 2024-09-13T18:36:25.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b2af8700 1 -- 172.21.15.44:0/3125424282 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5595171f2a80 con 0x55951640b400 2024-09-13T18:36:25.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b2af8700 1 -- 172.21.15.44:0/3125424282 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55951645b1e0 con 0x55951640b400 2024-09-13T18:36:25.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b6b43500 1 -- 172.21.15.44:0/3125424282 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55951642e1a0 con 0x55951640b400 2024-09-13T18:36:25.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b6b43500 1 -- 172.21.15.44:0/3125424282 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55951642e340 con 0x55951640b400 2024-09-13T18:36:25.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b6b43500 4 waiting for MDS map... 2024-09-13T18:36:25.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b2af8700 1 -- 172.21.15.44:0/3125424282 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x559516444c40 con 0x55951640b400 2024-09-13T18:36:25.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b2af8700 1 -- 172.21.15.44:0/3125424282 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 78) v1 ==== 3114+0+0 (secure 0 0 0) 0x5595171e6900 con 0x55951640b400 2024-09-13T18:36:25.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b6b43500 4 Got MDS map 78 2024-09-13T18:36:25.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.879+0000 7fd8b6b43500 10 main: main 2024-09-13T18:36:25.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.883+0000 7fd8b6b43500 4 main: connecting to RADOS... 2024-09-13T18:36:25.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.883+0000 7fd8b6b43500 1 Processor -- start 2024-09-13T18:36:25.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.883+0000 7fd8b6b43500 1 -- start start 2024-09-13T18:36:25.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.883+0000 7fd8b6b43500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951675c400 0x5595164b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.883+0000 7fd8b6b43500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55951675c800 0x5595164b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.883+0000 7fd8b6b43500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55951675cc00 0x5595164b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.883+0000 7fd8b6b43500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55951648c640 con 0x55951675c400 2024-09-13T18:36:25.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.883+0000 7fd8b6b43500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55951648c500 con 0x55951675c800 2024-09-13T18:36:25.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.883+0000 7fd8b6b43500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55951648ca00 con 0x55951675cc00 2024-09-13T18:36:25.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.883+0000 7fd8b5afe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951675c400 0x5595164b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.883+0000 7fd8b5afe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951675c400 0x5595164b1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47258/0 (socket says 172.21.15.44:47258) 2024-09-13T18:36:25.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.883+0000 7fd8b5afe700 1 -- 172.21.15.44:0/708614687 learned_addr learned my addr 172.21.15.44:0/708614687 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:25.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.883+0000 7fd8b4afc700 1 --2- 172.21.15.44:0/708614687 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55951675cc00 0x5595164b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.883+0000 7fd8b52fd700 1 --2- 172.21.15.44:0/708614687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55951675c800 0x5595164b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.883+0000 7fd8b5afe700 1 -- 172.21.15.44:0/708614687 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55951675cc00 msgr2=0x5595164b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.883+0000 7fd8b5afe700 1 --2- 172.21.15.44:0/708614687 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55951675cc00 0x5595164b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.883+0000 7fd8b5afe700 1 -- 172.21.15.44:0/708614687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55951675c800 msgr2=0x5595164b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.883+0000 7fd8b5afe700 1 --2- 172.21.15.44:0/708614687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55951675c800 0x5595164b1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.883+0000 7fd8b5afe700 1 -- 172.21.15.44:0/708614687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55951642e000 con 0x55951675c400 2024-09-13T18:36:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.883+0000 7fd8b5afe700 1 --2- 172.21.15.44:0/708614687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951675c400 0x5595164b1600 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x5595167660f0 tx=0x559516712c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d985ced359877340 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.883+0000 7fd8b0af4700 1 -- 172.21.15.44:0/708614687 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55951645b600 con 0x55951675c400 2024-09-13T18:36:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.883+0000 7fd8b0af4700 1 -- 172.21.15.44:0/708614687 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5595171f3080 con 0x55951675c400 2024-09-13T18:36:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.883+0000 7fd8b0af4700 1 -- 172.21.15.44:0/708614687 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55951645b1e0 con 0x55951675c400 2024-09-13T18:36:25.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.887+0000 7fd8b6b43500 1 -- 172.21.15.44:0/708614687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951675c400 msgr2=0x5595164b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.887+0000 7fd8b6b43500 1 --2- 172.21.15.44:0/708614687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951675c400 0x5595164b1600 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x5595167660f0 tx=0x559516712c00 comp rx=0 tx=0).stop 2024-09-13T18:36:25.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.887+0000 7fd8b6b43500 1 -- 172.21.15.44:0/708614687 shutdown_connections 2024-09-13T18:36:25.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.887+0000 7fd8b6b43500 1 --2- 172.21.15.44:0/708614687 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55951675cc00 0x5595164b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.887+0000 7fd8b6b43500 1 --2- 172.21.15.44:0/708614687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55951675c800 0x5595164b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.887+0000 7fd8b6b43500 1 --2- 172.21.15.44:0/708614687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951675c400 0x5595164b1600 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.887+0000 7fd8b6b43500 1 -- 172.21.15.44:0/708614687 >> 172.21.15.44:0/708614687 conn(0x55951675c000 msgr2=0x5595164fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:25.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.887+0000 7fd8b6b43500 1 -- 172.21.15.44:0/708614687 shutdown_connections 2024-09-13T18:36:25.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.887+0000 7fd8b6b43500 1 -- 172.21.15.44:0/708614687 wait complete. 2024-09-13T18:36:25.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.887+0000 7fd8b6b43500 1 Processor -- start 2024-09-13T18:36:25.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.887+0000 7fd8b6b43500 1 -- start start 2024-09-13T18:36:25.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.887+0000 7fd8b6b43500 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55951675c400 0x5595164b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.887+0000 7fd8b6b43500 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951675c800 0x5595164b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.887+0000 7fd8b6b43500 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55951675cc00 0x5595164b2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.887+0000 7fd8b6b43500 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55951648c780 con 0x55951675c800 2024-09-13T18:36:25.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.887+0000 7fd8b6b43500 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55951648c3c0 con 0x55951675c400 2024-09-13T18:36:25.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.887+0000 7fd8b6b43500 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55951648c280 con 0x55951675cc00 2024-09-13T18:36:25.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.887+0000 7fd8b52fd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951675c800 0x5595164b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.887+0000 7fd8b52fd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951675c800 0x5595164b2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47270/0 (socket says 172.21.15.44:47270) 2024-09-13T18:36:25.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.887+0000 7fd8b52fd700 1 -- 172.21.15.44:0/128630910 learned_addr learned my addr 172.21.15.44:0/128630910 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:25.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.887+0000 7fd8b5afe700 1 --2- 172.21.15.44:0/128630910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55951675c400 0x5595164b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.887+0000 7fd8b4afc700 1 --2- 172.21.15.44:0/128630910 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55951675cc00 0x5595164b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.891+0000 7fd8b52fd700 1 -- 172.21.15.44:0/128630910 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55951675cc00 msgr2=0x5595164b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.891+0000 7fd8b52fd700 1 --2- 172.21.15.44:0/128630910 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55951675cc00 0x5595164b2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.891+0000 7fd8b52fd700 1 -- 172.21.15.44:0/128630910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55951675c400 msgr2=0x5595164b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.891+0000 7fd8b52fd700 1 --2- 172.21.15.44:0/128630910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55951675c400 0x5595164b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.891+0000 7fd8b52fd700 1 -- 172.21.15.44:0/128630910 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55951642eb60 con 0x55951675c800 2024-09-13T18:36:25.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.891+0000 7fd8b52fd700 1 --2- 172.21.15.44:0/128630910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951675c800 0x5595164b2c00 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x5595167672f0 tx=0x559517178000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:25.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.891+0000 7fd8af2f1700 1 -- 172.21.15.44:0/128630910 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55951645b080 con 0x55951675c800 2024-09-13T18:36:25.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.891+0000 7fd8af2f1700 1 -- 172.21.15.44:0/128630910 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5595171f2180 con 0x55951675c800 2024-09-13T18:36:25.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.891+0000 7fd8b6b43500 1 -- 172.21.15.44:0/128630910 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55951642e9c0 con 0x55951675c800 2024-09-13T18:36:25.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.891+0000 7fd8af2f1700 1 -- 172.21.15.44:0/128630910 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55951645b600 con 0x55951675c800 2024-09-13T18:36:25.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.891+0000 7fd8b6b43500 1 -- 172.21.15.44:0/128630910 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55951642e1a0 con 0x55951675c800 2024-09-13T18:36:25.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.891+0000 7fd8b6b43500 4 main: resolving pool 12 2024-09-13T18:36:25.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.891+0000 7fd8af2f1700 1 -- 172.21.15.44:0/128630910 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x55951646a840 con 0x55951675c800 2024-09-13T18:36:25.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.895+0000 7fd8af2f1700 1 --2- 172.21.15.44:0/128630910 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55951675d400 0x5595164b3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.895+0000 7fd8af2f1700 1 -- 172.21.15.44:0/128630910 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x559516444a80 con 0x55951675c800 2024-09-13T18:36:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.895+0000 7fd8b6b43500 4 main: creating IoCtx.. 2024-09-13T18:36:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.895+0000 7fd8b6b43500 10 mds.0.inotable: skip_inos was [0x10000000000~0x10000000000] 2024-09-13T18:36:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.895+0000 7fd8b6b43500 10 mds.0.inotable: skip_inos now [0x10000000065~0xffffffff9b] 2024-09-13T18:36:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.895+0000 7fd8b6b43500 1 --2- 172.21.15.44:0/128630910 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x55951675d800 0x5595164b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.895+0000 7fd8b5afe700 1 --2- 172.21.15.44:0/128630910 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55951675d400 0x5595164b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.895+0000 7fd8b6b43500 1 -- 172.21.15.44:0/128630910 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- osd_op(unknown.0.0:1 12.13 12:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x55951675dc00 con 0x55951675d800 2024-09-13T18:36:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.895+0000 7fd8b4afc700 1 --2- 172.21.15.44:0/128630910 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x55951675d800 0x5595164b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.895+0000 7fd8b4afc700 1 --2- 172.21.15.44:0/128630910 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x55951675d800 0x5595164b2100 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:25.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.895+0000 7fd8b5afe700 1 --2- 172.21.15.44:0/128630910 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55951675d400 0x5595164b3700 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x5595167660f0 tx=0x559517178420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:25.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.895+0000 7fd8b4afc700 1 -- 172.21.15.44:0/128630910 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v90'3 uv3 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x5595171f8b40 con 0x55951675d800 2024-09-13T18:36:25.905 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:36:25.905 INFO:teuthology.orchestra.run.smithi044.stdout: "0": { 2024-09-13T18:36:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: "data": { 2024-09-13T18:36:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 1, 2024-09-13T18:36:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: "inotable": { 2024-09-13T18:36:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: "projected_free": [ 2024-09-13T18:36:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: "start": 1099511627877, 2024-09-13T18:36:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: "len": 1099511627675 2024-09-13T18:36:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-13T18:36:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: "free": [ 2024-09-13T18:36:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-13T18:36:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: "start": 1099511627877, 2024-09-13T18:36:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: "len": 1099511627675 2024-09-13T18:36:25.906 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:25.907 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-13T18:36:25.907 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:25.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-13T18:36:25.907 INFO:teuthology.orchestra.run.smithi044.stdout: "result": 0 2024-09-13T18:36:25.907 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-13T18:36:25.907 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:36:25.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:25.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.899+0000 7fd8b6b43500 1 -- 172.21.15.44:0/128630910 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x55951675d800 msgr2=0x5595164b2100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.899+0000 7fd8b6b43500 1 --2- 172.21.15.44:0/128630910 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x55951675d800 0x5595164b2100 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.899+0000 7fd8b6b43500 1 -- 172.21.15.44:0/128630910 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55951675d400 msgr2=0x5595164b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.899+0000 7fd8b6b43500 1 --2- 172.21.15.44:0/128630910 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x55951675d400 0x5595164b3700 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x5595167660f0 tx=0x559517178420 comp rx=0 tx=0).stop 2024-09-13T18:36:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.899+0000 7fd8b6b43500 1 -- 172.21.15.44:0/128630910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951675c800 msgr2=0x5595164b2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.899+0000 7fd8b6b43500 1 --2- 172.21.15.44:0/128630910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951675c800 0x5595164b2c00 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x5595167672f0 tx=0x559517178000 comp rx=0 tx=0).stop 2024-09-13T18:36:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.899+0000 7fd8b52fd700 1 -- 172.21.15.44:0/128630910 reap_dead start 2024-09-13T18:36:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.899+0000 7fd8b6b43500 1 -- 172.21.15.44:0/128630910 shutdown_connections 2024-09-13T18:36:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.899+0000 7fd8b6b43500 1 -- 172.21.15.44:0/128630910 >> 172.21.15.44:0/128630910 conn(0x55951675c000 msgr2=0x5595164fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.899+0000 7fd8b6b43500 1 -- 172.21.15.44:0/128630910 shutdown_connections 2024-09-13T18:36:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.899+0000 7fd8b6b43500 1 -- 172.21.15.44:0/128630910 wait complete. 2024-09-13T18:36:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.899+0000 7fd8b6b43500 1 -- 172.21.15.44:0/3125424282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951640b400 msgr2=0x5595164b0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.899+0000 7fd8b6b43500 1 --2- 172.21.15.44:0/3125424282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951640b400 0x5595164b0b00 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x559517176e70 tx=0x559517178480 comp rx=0 tx=0).stop 2024-09-13T18:36:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.899+0000 7fd8b6b43500 1 -- 172.21.15.44:0/3125424282 shutdown_connections 2024-09-13T18:36:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.899+0000 7fd8b6b43500 1 --2- 172.21.15.44:0/3125424282 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55951640b800 0x5595164b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.899+0000 7fd8b6b43500 1 --2- 172.21.15.44:0/3125424282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951640b400 0x5595164b0b00 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.899+0000 7fd8b6b43500 1 --2- 172.21.15.44:0/3125424282 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55951640b000 0x5595164b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.899+0000 7fd8b6b43500 1 -- 172.21.15.44:0/3125424282 >> 172.21.15.44:0/3125424282 conn(0x55951640ac00 msgr2=0x5595164fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:25.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.899+0000 7fd8b6b43500 1 -- 172.21.15.44:0/3125424282 shutdown_connections 2024-09-13T18:36:25.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:25.899+0000 7fd8b6b43500 1 -- 172.21.15.44:0/3125424282 wait complete. 2024-09-13T18:36:25.911 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'all', 'take_inos', '1099511627876'] in time 0:00:00.063456, result: { "0": { "data": { "version": 1, "inotable": { "projected_free": [ { "start": 1099511627877, "len": 1099511627675 } ], "free": [ { "start": 1099511627877, "len": 1099511627675 } ] } }, "result": 0 } } 2024-09-13T18:36:25.911 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:36:25.911 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:36:25.974 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:36:25.996 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:36:25.996 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:36:25.996 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:26.008 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:26.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.123+0000 7f9919075700 1 Processor -- start 2024-09-13T18:36:26.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.123+0000 7f9919075700 1 -- start start 2024-09-13T18:36:26.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.123+0000 7f9919075700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f991406bbf0 0x7f99140b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.123+0000 7f9919075700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f991406acc0 0x7f991415e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.123+0000 7f9919075700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991413dcb0 con 0x7f99140b3910 2024-09-13T18:36:26.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.123+0000 7f9919075700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991415be60 con 0x7f991406bbf0 2024-09-13T18:36:26.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.123+0000 7f9919075700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991413ffd0 con 0x7f991406acc0 2024-09-13T18:36:26.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.123+0000 7f9913fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f991406bbf0 0x7f99140b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.123+0000 7f99137fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f99140b3910 0x7f991406a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49674/0 (socket says 172.21.15.44:49674) 2024-09-13T18:36:26.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.123+0000 7f99137fe700 1 -- 172.21.15.44:0/2898955984 learned_addr learned my addr 172.21.15.44:0/2898955984 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:26.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.123+0000 7f9913fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f991406bbf0 0x7f99140b33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47274/0 (socket says 172.21.15.44:47274) 2024-09-13T18:36:26.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.123+0000 7f9918874700 1 --2- 172.21.15.44:0/2898955984 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f991406acc0 0x7f991415e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.127+0000 7f9913fff700 1 -- 172.21.15.44:0/2898955984 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f991406acc0 msgr2=0x7f991415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:26.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.127+0000 7f9913fff700 1 --2- 172.21.15.44:0/2898955984 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f991406acc0 0x7f991415e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.127+0000 7f9913fff700 1 -- 172.21.15.44:0/2898955984 >> v1:172.21.15.44:6789/0 conn(0x7f99140b3910 legacy=0x7f991406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.127+0000 7f9913fff700 1 -- 172.21.15.44:0/2898955984 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99140b3d70 con 0x7f991406bbf0 2024-09-13T18:36:26.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.127+0000 7f9913fff700 1 --2- 172.21.15.44:0/2898955984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991406bbf0 0x7f99140b33d0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009850 tx=0x7f98fc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2981e34b76dc0433 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:26.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.127+0000 7f9912ffd700 1 -- 172.21.15.44:0/2898955984 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc011830 con 0x7f991406bbf0 2024-09-13T18:36:26.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.127+0000 7f9912ffd700 1 -- 172.21.15.44:0/2898955984 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98fc011990 con 0x7f991406bbf0 2024-09-13T18:36:26.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.127+0000 7f9912ffd700 1 -- 172.21.15.44:0/2898955984 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc011d20 con 0x7f991406bbf0 2024-09-13T18:36:26.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.127+0000 7f9919075700 1 -- 172.21.15.44:0/2898955984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991406bbf0 msgr2=0x7f99140b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.127+0000 7f9919075700 1 --2- 172.21.15.44:0/2898955984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991406bbf0 0x7f99140b33d0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009850 tx=0x7f98fc009b60 comp rx=0 tx=0).stop 2024-09-13T18:36:26.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.127+0000 7f9919075700 1 -- 172.21.15.44:0/2898955984 shutdown_connections 2024-09-13T18:36:26.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.127+0000 7f9919075700 1 --2- 172.21.15.44:0/2898955984 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f991406acc0 0x7f991415e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.127+0000 7f9919075700 1 --2- 172.21.15.44:0/2898955984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991406bbf0 0x7f99140b33d0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.127+0000 7f9919075700 1 -- 172.21.15.44:0/2898955984 >> 172.21.15.44:0/2898955984 conn(0x7f99140b0f00 msgr2=0x7f99140b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:26.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.127+0000 7f9919075700 1 -- 172.21.15.44:0/2898955984 shutdown_connections 2024-09-13T18:36:26.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.127+0000 7f9919075700 1 -- 172.21.15.44:0/2898955984 wait complete. 2024-09-13T18:36:26.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.127+0000 7f9919075700 1 Processor -- start 2024-09-13T18:36:26.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.127+0000 7f9919075700 1 -- start start 2024-09-13T18:36:26.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.131+0000 7f9919075700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f991406acc0 0x7f99141ed810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.131+0000 7f9919075700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f991406bbf0 0x7f991415d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.131+0000 7f9919075700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99140b3910 0x7f99140ae590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.131+0000 7f9919075700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991415dd90 con 0x7f99140b3910 2024-09-13T18:36:26.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.131+0000 7f9919075700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99141f4520 con 0x7f991406acc0 2024-09-13T18:36:26.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.131+0000 7f9919075700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99141f49b0 con 0x7f991406bbf0 2024-09-13T18:36:26.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.131+0000 7f9918874700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99140b3910 0x7f99140ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.131+0000 7f9918874700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99140b3910 0x7f99140ae590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47276/0 (socket says 172.21.15.44:47276) 2024-09-13T18:36:26.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.131+0000 7f9918874700 1 -- 172.21.15.44:0/3326095984 learned_addr learned my addr 172.21.15.44:0/3326095984 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:26.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.131+0000 7f9913fff700 1 --2- 172.21.15.44:0/3326095984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f991406acc0 0x7f99141ed810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.131+0000 7f99137fe700 1 --2- 172.21.15.44:0/3326095984 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f991406bbf0 0x7f991415d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.131+0000 7f9918874700 1 -- 172.21.15.44:0/3326095984 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f991406bbf0 msgr2=0x7f991415d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.131+0000 7f9918874700 1 --2- 172.21.15.44:0/3326095984 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f991406bbf0 0x7f991415d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.131+0000 7f9918874700 1 -- 172.21.15.44:0/3326095984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f991406acc0 msgr2=0x7f99141ed810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.131+0000 7f9918874700 1 --2- 172.21.15.44:0/3326095984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f991406acc0 0x7f99141ed810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.131+0000 7f9918874700 1 -- 172.21.15.44:0/3326095984 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc0094b0 con 0x7f99140b3910 2024-09-13T18:36:26.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.131+0000 7f9918874700 1 --2- 172.21.15.44:0/3326095984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99140b3910 0x7f99140ae590 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f990c00e810 tx=0x7f990c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:26.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.131+0000 7f9910ff9700 1 -- 172.21.15.44:0/3326095984 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c013610 con 0x7f99140b3910 2024-09-13T18:36:26.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.131+0000 7f9910ff9700 1 -- 172.21.15.44:0/3326095984 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990c013770 con 0x7f99140b3910 2024-09-13T18:36:26.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.131+0000 7f9919075700 1 -- 172.21.15.44:0/3326095984 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99141f3bf0 con 0x7f99140b3910 2024-09-13T18:36:26.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.131+0000 7f9910ff9700 1 -- 172.21.15.44:0/3326095984 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c013b20 con 0x7f99140b3910 2024-09-13T18:36:26.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.131+0000 7f9919075700 1 -- 172.21.15.44:0/3326095984 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99141f41b0 con 0x7f99140b3910 2024-09-13T18:36:26.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.131+0000 7f9919075700 1 -- 172.21.15.44:0/3326095984 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f8005310 con 0x7f99140b3910 2024-09-13T18:36:26.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.135+0000 7f9910ff9700 1 -- 172.21.15.44:0/3326095984 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f990c013c80 con 0x7f99140b3910 2024-09-13T18:36:26.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.135+0000 7f9910ff9700 1 --2- 172.21.15.44:0/3326095984 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f98f4066760 0x7f98f4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.135+0000 7f9910ff9700 1 -- 172.21.15.44:0/3326095984 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f990c083df0 con 0x7f99140b3910 2024-09-13T18:36:26.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.135+0000 7f9913fff700 1 --2- 172.21.15.44:0/3326095984 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f98f4066760 0x7f98f4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.135+0000 7f9913fff700 1 --2- 172.21.15.44:0/3326095984 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f98f4066760 0x7f98f4068c20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f98fc000c00 tx=0x7f98fc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:26.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.139+0000 7f9910ff9700 1 -- 172.21.15.44:0/3326095984 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f990c0510d0 con 0x7f99140b3910 2024-09-13T18:36:26.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.319+0000 7f9919075700 1 -- 172.21.15.44:0/3326095984 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98f80055c0 con 0x7f99140b3910 2024-09-13T18:36:26.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.319+0000 7f9910ff9700 1 -- 172.21.15.44:0/3326095984 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16500 (secure 0 0 0) 0x7f990c021090 con 0x7f99140b3910 2024-09-13T18:36:26.328 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:26.328 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":90,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:36:18.647007+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:36:15.982954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T18:36:16.628264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:26.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.323+0000 7f9919075700 1 -- 172.21.15.44:0/3326095984 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f98f4066760 msgr2=0x7f98f4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.323+0000 7f9919075700 1 --2- 172.21.15.44:0/3326095984 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f98f4066760 0x7f98f4068c20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f98fc000c00 tx=0x7f98fc008030 comp rx=0 tx=0).stop 2024-09-13T18:36:26.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.323+0000 7f9919075700 1 -- 172.21.15.44:0/3326095984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99140b3910 msgr2=0x7f99140ae590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.323+0000 7f9919075700 1 --2- 172.21.15.44:0/3326095984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99140b3910 0x7f99140ae590 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f990c00e810 tx=0x7f990c00ebd0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.323+0000 7f9919075700 1 -- 172.21.15.44:0/3326095984 shutdown_connections 2024-09-13T18:36:26.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.323+0000 7f9919075700 1 --2- 172.21.15.44:0/3326095984 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f98f4066760 0x7f98f4068c20 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.323+0000 7f9919075700 1 --2- 172.21.15.44:0/3326095984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99140b3910 0x7f99140ae590 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.323+0000 7f9919075700 1 --2- 172.21.15.44:0/3326095984 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f991406bbf0 0x7f991415d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.323+0000 7f9919075700 1 --2- 172.21.15.44:0/3326095984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f991406acc0 0x7f99141ed810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.323+0000 7f9919075700 1 -- 172.21.15.44:0/3326095984 >> 172.21.15.44:0/3326095984 conn(0x7f99140b0f00 msgr2=0x7f9914158ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:26.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.323+0000 7f9919075700 1 -- 172.21.15.44:0/3326095984 shutdown_connections 2024-09-13T18:36:26.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.323+0000 7f9919075700 1 -- 172.21.15.44:0/3326095984 wait complete. 2024-09-13T18:36:26.344 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:36:15.982954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:36:16.628264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:36:26.344 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:36:26.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.459+0000 7fbf0cec9700 1 Processor -- start 2024-09-13T18:36:26.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.459+0000 7fbf0cec9700 1 -- start start 2024-09-13T18:36:26.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.463+0000 7fbf0cec9700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf000e0b30 0x7fbf000574a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.463+0000 7fbf0cec9700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf00054e50 con 0x7fbf00053230 2024-09-13T18:36:26.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.463+0000 7fbf0cec9700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf000528d0 con 0x7fbf00052080 2024-09-13T18:36:26.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.463+0000 7fbf0cec9700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf000559f0 con 0x7fbf000e0b30 2024-09-13T18:36:26.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.463+0000 7fbf06ffd700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fbf00052080 0x7fbf000552e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:60876/0 (socket says 172.21.15.44:60876) 2024-09-13T18:36:26.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.463+0000 7fbf07fff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fbf00053230 0x7fbf0000be60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49690/0 (socket says 172.21.15.44:49690) 2024-09-13T18:36:26.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.463+0000 7fbf06ffd700 1 -- 172.21.15.44:0/4031564617 learned_addr learned my addr 172.21.15.44:0/4031564617 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:26.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.463+0000 7fbf077fe700 1 --2- 172.21.15.44:0/4031564617 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf000e0b30 0x7fbf000574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.463+0000 7fbf067fc700 1 -- 172.21.15.44:0/4031564617 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1863519657 0 0) 0x7fbf000528d0 con 0x7fbf00052080 2024-09-13T18:36:26.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.463+0000 7fbf067fc700 1 -- 172.21.15.44:0/4031564617 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbef80035d0 con 0x7fbf00052080 2024-09-13T18:36:26.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.463+0000 7fbf077fe700 1 -- 172.21.15.44:0/4031564617 >> v1:172.21.15.99:6789/0 conn(0x7fbf00052080 legacy=0x7fbf000552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.463+0000 7fbf077fe700 1 -- 172.21.15.44:0/4031564617 >> v1:172.21.15.44:6789/0 conn(0x7fbf00053230 legacy=0x7fbf0000be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.463+0000 7fbf067fc700 1 -- 172.21.15.44:0/4031564617 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232229272 0 0) 0x7fbf00054e50 con 0x7fbf00053230 2024-09-13T18:36:26.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.463+0000 7fbf077fe700 1 -- 172.21.15.44:0/4031564617 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf00054520 con 0x7fbf000e0b30 2024-09-13T18:36:26.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.463+0000 7fbf077fe700 1 --2- 172.21.15.44:0/4031564617 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf000e0b30 0x7fbf000574a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbefc009870 tx=0x7fbefc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbebef420da5c39f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:26.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.463+0000 7fbf067fc700 1 -- 172.21.15.44:0/4031564617 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc005e50 con 0x7fbf000e0b30 2024-09-13T18:36:26.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.463+0000 7fbf067fc700 1 -- 172.21.15.44:0/4031564617 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbefc006030 con 0x7fbf000e0b30 2024-09-13T18:36:26.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.463+0000 7fbf067fc700 1 -- 172.21.15.44:0/4031564617 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc0063a0 con 0x7fbf000e0b30 2024-09-13T18:36:26.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.467+0000 7fbf0cec9700 1 -- 172.21.15.44:0/4031564617 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf000e0b30 msgr2=0x7fbf000574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.467+0000 7fbf0cec9700 1 --2- 172.21.15.44:0/4031564617 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf000e0b30 0x7fbf000574a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbefc009870 tx=0x7fbefc009b80 comp rx=0 tx=0).stop 2024-09-13T18:36:26.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.467+0000 7fbf0cec9700 1 -- 172.21.15.44:0/4031564617 shutdown_connections 2024-09-13T18:36:26.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.467+0000 7fbf0cec9700 1 --2- 172.21.15.44:0/4031564617 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf000e0b30 0x7fbf000574a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.467+0000 7fbf0cec9700 1 -- 172.21.15.44:0/4031564617 >> 172.21.15.44:0/4031564617 conn(0x7fbf0001fc00 msgr2=0x7fbf000568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:26.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.467+0000 7fbf0cec9700 1 -- 172.21.15.44:0/4031564617 shutdown_connections 2024-09-13T18:36:26.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.467+0000 7fbf0cec9700 1 -- 172.21.15.44:0/4031564617 wait complete. 2024-09-13T18:36:26.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.471+0000 7fbf0cec9700 1 Processor -- start 2024-09-13T18:36:26.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.471+0000 7fbf0cec9700 1 -- start start 2024-09-13T18:36:26.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.471+0000 7fbf0cec9700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf00052080 0x7fbf000d2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.471+0000 7fbf0cec9700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf00053230 0x7fbf0004cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.471+0000 7fbf0cec9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf000e0b30 0x7fbf0004d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.471+0000 7fbf0cec9700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf000d32c0 con 0x7fbf000e0b30 2024-09-13T18:36:26.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.471+0000 7fbf0cec9700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0004a870 con 0x7fbf00052080 2024-09-13T18:36:26.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.471+0000 7fbf0cec9700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0003a720 con 0x7fbf00053230 2024-09-13T18:36:26.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.471+0000 7fbf077fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf00052080 0x7fbf000d2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.471+0000 7fbf07fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf000e0b30 0x7fbf0004d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.471+0000 7fbf077fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf00052080 0x7fbf000d2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:46382/0 (socket says 172.21.15.44:46382) 2024-09-13T18:36:26.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.471+0000 7fbf077fe700 1 -- 172.21.15.44:0/239583518 learned_addr learned my addr 172.21.15.44:0/239583518 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:26.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.471+0000 7fbf06ffd700 1 --2- 172.21.15.44:0/239583518 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf00053230 0x7fbf0004cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.471+0000 7fbf077fe700 1 -- 172.21.15.44:0/239583518 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf00053230 msgr2=0x7fbf0004cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.471+0000 7fbf077fe700 1 --2- 172.21.15.44:0/239583518 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf00053230 0x7fbf0004cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.471+0000 7fbf077fe700 1 -- 172.21.15.44:0/239583518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf000e0b30 msgr2=0x7fbf0004d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.471+0000 7fbf077fe700 1 --2- 172.21.15.44:0/239583518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf000e0b30 0x7fbf0004d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.471+0000 7fbf077fe700 1 -- 172.21.15.44:0/239583518 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc009450 con 0x7fbf00052080 2024-09-13T18:36:26.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.471+0000 7fbf07fff700 1 --2- 172.21.15.44:0/239583518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf000e0b30 0x7fbf0004d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:26.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.475+0000 7fbf077fe700 1 --2- 172.21.15.44:0/239583518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf00052080 0x7fbf000d2d80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbefc000c00 tx=0x7fbefc004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:26.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.475+0000 7fbef3fff700 1 -- 172.21.15.44:0/239583518 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc003ad0 con 0x7fbf00052080 2024-09-13T18:36:26.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.475+0000 7fbef3fff700 1 -- 172.21.15.44:0/239583518 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbefc003c30 con 0x7fbf00052080 2024-09-13T18:36:26.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.475+0000 7fbf0cec9700 1 -- 172.21.15.44:0/239583518 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf0003aa00 con 0x7fbf00052080 2024-09-13T18:36:26.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.475+0000 7fbef3fff700 1 -- 172.21.15.44:0/239583518 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc0061a0 con 0x7fbf00052080 2024-09-13T18:36:26.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.475+0000 7fbf0cec9700 1 -- 172.21.15.44:0/239583518 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf0003afc0 con 0x7fbf00052080 2024-09-13T18:36:26.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.475+0000 7fbf0cec9700 1 -- 172.21.15.44:0/239583518 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf00054170 con 0x7fbf00052080 2024-09-13T18:36:26.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.475+0000 7fbef3fff700 1 -- 172.21.15.44:0/239583518 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbefc022070 con 0x7fbf00052080 2024-09-13T18:36:26.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.479+0000 7fbef3fff700 1 --2- 172.21.15.44:0/239583518 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbeec066760 0x7fbeec068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.479+0000 7fbef3fff700 1 -- 172.21.15.44:0/239583518 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbefc085aa0 con 0x7fbf00052080 2024-09-13T18:36:26.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.479+0000 7fbf06ffd700 1 --2- 172.21.15.44:0/239583518 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbeec066760 0x7fbeec068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.479+0000 7fbf06ffd700 1 --2- 172.21.15.44:0/239583518 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbeec066760 0x7fbeec068c20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fbf000dfd20 tx=0x7fbef4007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:26.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.487+0000 7fbef3fff700 1 -- 172.21.15.44:0/239583518 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbefc052e00 con 0x7fbf00052080 2024-09-13T18:36:26.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.659+0000 7fbf0cec9700 1 -- 172.21.15.44:0/239583518 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbf0000cb10 con 0x7fbf00052080 2024-09-13T18:36:26.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.659+0000 7fbef3fff700 1 -- 172.21.15.44:0/239583518 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbefc056420 con 0x7fbf00052080 2024-09-13T18:36:26.669 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:36:26.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.663+0000 7fbf0cec9700 1 -- 172.21.15.44:0/239583518 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbeec066760 msgr2=0x7fbeec068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.663+0000 7fbf0cec9700 1 --2- 172.21.15.44:0/239583518 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbeec066760 0x7fbeec068c20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fbf000dfd20 tx=0x7fbef4007de0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.663+0000 7fbf0cec9700 1 -- 172.21.15.44:0/239583518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf00052080 msgr2=0x7fbf000d2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.663+0000 7fbf0cec9700 1 --2- 172.21.15.44:0/239583518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf00052080 0x7fbf000d2d80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbefc000c00 tx=0x7fbefc004770 comp rx=0 tx=0).stop 2024-09-13T18:36:26.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.663+0000 7fbf0cec9700 1 -- 172.21.15.44:0/239583518 shutdown_connections 2024-09-13T18:36:26.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.663+0000 7fbf0cec9700 1 --2- 172.21.15.44:0/239583518 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fbeec066760 0x7fbeec068c20 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.663+0000 7fbf0cec9700 1 --2- 172.21.15.44:0/239583518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf000e0b30 0x7fbf0004d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.663+0000 7fbf0cec9700 1 --2- 172.21.15.44:0/239583518 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf00053230 0x7fbf0004cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.663+0000 7fbf0cec9700 1 --2- 172.21.15.44:0/239583518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf00052080 0x7fbf000d2d80 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.663+0000 7fbf0cec9700 1 -- 172.21.15.44:0/239583518 >> 172.21.15.44:0/239583518 conn(0x7fbf0001fc00 msgr2=0x7fbf000e1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:26.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.663+0000 7fbf0cec9700 1 -- 172.21.15.44:0/239583518 shutdown_connections 2024-09-13T18:36:26.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.663+0000 7fbf0cec9700 1 -- 172.21.15.44:0/239583518 wait complete. 2024-09-13T18:36:26.684 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:36:26.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.803+0000 7f9ef4ac2700 1 Processor -- start 2024-09-13T18:36:26.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.803+0000 7f9ef4ac2700 1 -- start start 2024-09-13T18:36:26.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.803+0000 7f9ef4ac2700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9ef015cda0 0x7f9ef006b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.807+0000 7f9ef4ac2700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef00b8430 con 0x7f9ef006a520 2024-09-13T18:36:26.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.807+0000 7f9ef4ac2700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef00cf350 con 0x7f9ef00ceb70 2024-09-13T18:36:26.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.807+0000 7f9ef4ac2700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef006be40 con 0x7f9ef015cda0 2024-09-13T18:36:26.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.807+0000 7f9eeffff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9ef006a520 0x7f9ef006a930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49706/0 (socket says 172.21.15.44:49706) 2024-09-13T18:36:26.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.807+0000 7f9eef7fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9ef015cda0 0x7f9ef006b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.807+0000 7f9eeffff700 1 -- 172.21.15.44:0/2600294509 learned_addr learned my addr 172.21.15.44:0/2600294509 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:26.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.807+0000 7f9eef7fe700 1 -- 172.21.15.44:0/2600294509 >> v1:172.21.15.99:6789/0 conn(0x7f9ef00ceb70 legacy=0x7f9ef00b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.807+0000 7f9eef7fe700 1 -- 172.21.15.44:0/2600294509 >> v1:172.21.15.44:6789/0 conn(0x7f9ef006a520 legacy=0x7f9ef006a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.807+0000 7f9eee7fc700 1 -- 172.21.15.44:0/2600294509 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182749918 0 0) 0x7f9ef00b8430 con 0x7f9ef006a520 2024-09-13T18:36:26.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.807+0000 7f9eef7fe700 1 -- 172.21.15.44:0/2600294509 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef00d0880 con 0x7f9ef015cda0 2024-09-13T18:36:26.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.807+0000 7f9eef7fe700 1 --2- 172.21.15.44:0/2600294509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ef015cda0 0x7f9ef006b900 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009850 tx=0x7f9ee0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90d82ee87eb4329 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:26.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.807+0000 7f9eee7fc700 1 -- 172.21.15.44:0/2600294509 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0011830 con 0x7f9ef015cda0 2024-09-13T18:36:26.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.807+0000 7f9eee7fc700 1 -- 172.21.15.44:0/2600294509 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee0011990 con 0x7f9ef015cda0 2024-09-13T18:36:26.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.807+0000 7f9eee7fc700 1 -- 172.21.15.44:0/2600294509 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0011d20 con 0x7f9ef015cda0 2024-09-13T18:36:26.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.807+0000 7f9ef4ac2700 1 -- 172.21.15.44:0/2600294509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ef015cda0 msgr2=0x7f9ef006b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.807+0000 7f9ef4ac2700 1 --2- 172.21.15.44:0/2600294509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ef015cda0 0x7f9ef006b900 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009850 tx=0x7f9ee0009b60 comp rx=0 tx=0).stop 2024-09-13T18:36:26.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.807+0000 7f9ef4ac2700 1 -- 172.21.15.44:0/2600294509 shutdown_connections 2024-09-13T18:36:26.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.807+0000 7f9ef4ac2700 1 --2- 172.21.15.44:0/2600294509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ef015cda0 0x7f9ef006b900 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.807+0000 7f9ef4ac2700 1 -- 172.21.15.44:0/2600294509 >> 172.21.15.44:0/2600294509 conn(0x7f9ef00d2cb0 msgr2=0x7f9ef00d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:26.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.807+0000 7f9ef4ac2700 1 -- 172.21.15.44:0/2600294509 shutdown_connections 2024-09-13T18:36:26.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.807+0000 7f9ef4ac2700 1 -- 172.21.15.44:0/2600294509 wait complete. 2024-09-13T18:36:26.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.811+0000 7f9ef4ac2700 1 Processor -- start 2024-09-13T18:36:26.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.811+0000 7f9ef4ac2700 1 -- start start 2024-09-13T18:36:26.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.811+0000 7f9ef4ac2700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ef006a520 0x7f9ef01521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.811+0000 7f9ef4ac2700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ef00ceb70 0x7f9ef00c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.811+0000 7f9ef4ac2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ef015cda0 0x7f9ef00c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.811+0000 7f9ef4ac2700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00c86d0 con 0x7f9ef015cda0 2024-09-13T18:36:26.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.811+0000 7f9ef4ac2700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00c89b0 con 0x7f9ef00ceb70 2024-09-13T18:36:26.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.811+0000 7f9ef4ac2700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00c8c90 con 0x7f9ef006a520 2024-09-13T18:36:26.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.811+0000 7f9eeffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ef015cda0 0x7f9ef00c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.811+0000 7f9eef7fe700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ef006a520 0x7f9ef01521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.811+0000 7f9eeffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ef015cda0 0x7f9ef00c8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47316/0 (socket says 172.21.15.44:47316) 2024-09-13T18:36:26.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.811+0000 7f9eeffff700 1 -- 172.21.15.44:0/1543756219 learned_addr learned my addr 172.21.15.44:0/1543756219 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:26.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.811+0000 7f9eeeffd700 1 --2- 172.21.15.44:0/1543756219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ef00ceb70 0x7f9ef00c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.811+0000 7f9eeffff700 1 -- 172.21.15.44:0/1543756219 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ef006a520 msgr2=0x7f9ef01521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.811+0000 7f9eeffff700 1 --2- 172.21.15.44:0/1543756219 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ef006a520 0x7f9ef01521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.811+0000 7f9eeffff700 1 -- 172.21.15.44:0/1543756219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ef00ceb70 msgr2=0x7f9ef00c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.811+0000 7f9eeffff700 1 --2- 172.21.15.44:0/1543756219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ef00ceb70 0x7f9ef00c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.811+0000 7f9eeffff700 1 -- 172.21.15.44:0/1543756219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee00094b0 con 0x7f9ef015cda0 2024-09-13T18:36:26.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.811+0000 7f9eeeffd700 1 --2- 172.21.15.44:0/1543756219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ef00ceb70 0x7f9ef00c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:26.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.811+0000 7f9eeffff700 1 --2- 172.21.15.44:0/1543756219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ef015cda0 0x7f9ef00c8070 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8002230 tx=0x7f9ee800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:26.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.811+0000 7f9ee7fff700 1 -- 172.21.15.44:0/1543756219 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee800ab70 con 0x7f9ef015cda0 2024-09-13T18:36:26.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.811+0000 7f9ee7fff700 1 -- 172.21.15.44:0/1543756219 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee800acf0 con 0x7f9ef015cda0 2024-09-13T18:36:26.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.815+0000 7f9ef4ac2700 1 -- 172.21.15.44:0/1543756219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef00c8f70 con 0x7f9ef015cda0 2024-09-13T18:36:26.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.815+0000 7f9ee7fff700 1 -- 172.21.15.44:0/1543756219 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8007310 con 0x7f9ef015cda0 2024-09-13T18:36:26.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.815+0000 7f9ef4ac2700 1 -- 172.21.15.44:0/1543756219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef01f5f90 con 0x7f9ef015cda0 2024-09-13T18:36:26.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.815+0000 7f9ef4ac2700 1 -- 172.21.15.44:0/1543756219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef015d370 con 0x7f9ef015cda0 2024-09-13T18:36:26.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.815+0000 7f9ee7fff700 1 -- 172.21.15.44:0/1543756219 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9ee8007470 con 0x7f9ef015cda0 2024-09-13T18:36:26.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.815+0000 7f9ee7fff700 1 --2- 172.21.15.44:0/1543756219 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9ed0066730 0x7f9ed0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.815+0000 7f9ee7fff700 1 -- 172.21.15.44:0/1543756219 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ee8083bb0 con 0x7f9ef015cda0 2024-09-13T18:36:26.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.815+0000 7f9eef7fe700 1 --2- 172.21.15.44:0/1543756219 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9ed0066730 0x7f9ed0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.819+0000 7f9eef7fe700 1 --2- 172.21.15.44:0/1543756219 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9ed0066730 0x7f9ed0068bf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00090b0 tx=0x7f9ee001c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:26.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.823+0000 7f9ee7fff700 1 -- 172.21.15.44:0/1543756219 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9ef015d370 con 0x7f9ef015cda0 2024-09-13T18:36:27.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.991+0000 7f9ef4ac2700 1 -- 172.21.15.44:0/1543756219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9ef015d370 con 0x7f9ef015cda0 2024-09-13T18:36:27.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.995+0000 7f9ee7fff700 1 -- 172.21.15.44:0/1543756219 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9ef015d370 con 0x7f9ef015cda0 2024-09-13T18:36:27.001 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:36:27.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.995+0000 7f9ef4ac2700 1 -- 172.21.15.44:0/1543756219 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9ed0066730 msgr2=0x7f9ed0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.995+0000 7f9ef4ac2700 1 --2- 172.21.15.44:0/1543756219 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9ed0066730 0x7f9ed0068bf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00090b0 tx=0x7f9ee001c040 comp rx=0 tx=0).stop 2024-09-13T18:36:27.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.995+0000 7f9ef4ac2700 1 -- 172.21.15.44:0/1543756219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ef015cda0 msgr2=0x7f9ef00c8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.995+0000 7f9ef4ac2700 1 --2- 172.21.15.44:0/1543756219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ef015cda0 0x7f9ef00c8070 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8002230 tx=0x7f9ee800cf50 comp rx=0 tx=0).stop 2024-09-13T18:36:27.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.995+0000 7f9ef4ac2700 1 -- 172.21.15.44:0/1543756219 shutdown_connections 2024-09-13T18:36:27.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.995+0000 7f9ef4ac2700 1 --2- 172.21.15.44:0/1543756219 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9ed0066730 0x7f9ed0068bf0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.995+0000 7f9ef4ac2700 1 --2- 172.21.15.44:0/1543756219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ef015cda0 0x7f9ef00c8070 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.995+0000 7f9ef4ac2700 1 --2- 172.21.15.44:0/1543756219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ef00ceb70 0x7f9ef00c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.995+0000 7f9ef4ac2700 1 --2- 172.21.15.44:0/1543756219 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ef006a520 0x7f9ef01521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.995+0000 7f9ef4ac2700 1 -- 172.21.15.44:0/1543756219 >> 172.21.15.44:0/1543756219 conn(0x7f9ef00d2cb0 msgr2=0x7f9ef00d1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:27.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.995+0000 7f9ef4ac2700 1 -- 172.21.15.44:0/1543756219 shutdown_connections 2024-09-13T18:36:27.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:26.995+0000 7f9ef4ac2700 1 -- 172.21.15.44:0/1543756219 wait complete. 2024-09-13T18:36:27.016 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:36:27.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.135+0000 7f5906ef9700 1 Processor -- start 2024-09-13T18:36:27.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.135+0000 7f5906ef9700 1 -- start start 2024-09-13T18:36:27.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.135+0000 7f5906ef9700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58f80378f0 0x7f58f80eb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.135+0000 7f5906ef9700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f803b0c0 con 0x7f58f80e08f0 2024-09-13T18:36:27.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.139+0000 7f5906ef9700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f803a4b0 con 0x7f58f80e0cd0 2024-09-13T18:36:27.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.139+0000 7f5906ef9700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f803a790 con 0x7f58f80378f0 2024-09-13T18:36:27.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.139+0000 7f5905ef7700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f58f80e08f0 0x7f58f8055e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49714/0 (socket says 172.21.15.44:49714) 2024-09-13T18:36:27.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.139+0000 7f5905ef7700 1 -- 172.21.15.44:0/4012355545 learned_addr learned my addr 172.21.15.44:0/4012355545 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:27.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.139+0000 7f59066f8700 1 --2- 172.21.15.44:0/4012355545 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58f80378f0 0x7f58f80eb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.139+0000 7f5904ef5700 1 -- 172.21.15.44:0/4012355545 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317150891 0 0) 0x7f58f803b0c0 con 0x7f58f80e08f0 2024-09-13T18:36:27.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.139+0000 7f5904ef5700 1 -- 172.21.15.44:0/4012355545 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58ec0035d0 con 0x7f58f80e08f0 2024-09-13T18:36:27.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.139+0000 7f5904ef5700 1 -- 172.21.15.44:0/4012355545 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4239767183 0 0) 0x7f58f803a4b0 con 0x7f58f80e0cd0 2024-09-13T18:36:27.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.139+0000 7f5904ef5700 1 -- 172.21.15.44:0/4012355545 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58f803b0c0 con 0x7f58f80e0cd0 2024-09-13T18:36:27.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.139+0000 7f59066f8700 1 -- 172.21.15.44:0/4012355545 >> v1:172.21.15.99:6789/0 conn(0x7f58f80e0cd0 legacy=0x7f58f80371e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.139+0000 7f59066f8700 1 -- 172.21.15.44:0/4012355545 >> v1:172.21.15.44:6789/0 conn(0x7f58f80e08f0 legacy=0x7f58f8055e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.139+0000 7f59066f8700 1 -- 172.21.15.44:0/4012355545 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f803aa70 con 0x7f58f80378f0 2024-09-13T18:36:27.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.139+0000 7f59066f8700 1 --2- 172.21.15.44:0/4012355545 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58f80378f0 0x7f58f80eb920 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f590004f480 tx=0x7f5900074840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa4288c5633c6c6e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:27.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.139+0000 7f5904ef5700 1 -- 172.21.15.44:0/4012355545 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590004f010 con 0x7f58f80378f0 2024-09-13T18:36:27.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.139+0000 7f5904ef5700 1 -- 172.21.15.44:0/4012355545 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59000730f0 con 0x7f58f80378f0 2024-09-13T18:36:27.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.139+0000 7f5904ef5700 1 -- 172.21.15.44:0/4012355545 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5900073460 con 0x7f58f80378f0 2024-09-13T18:36:27.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.139+0000 7f5906ef9700 1 -- 172.21.15.44:0/4012355545 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58f80378f0 msgr2=0x7f58f80eb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.139+0000 7f5906ef9700 1 --2- 172.21.15.44:0/4012355545 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58f80378f0 0x7f58f80eb920 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f590004f480 tx=0x7f5900074840 comp rx=0 tx=0).stop 2024-09-13T18:36:27.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.139+0000 7f5906ef9700 1 -- 172.21.15.44:0/4012355545 shutdown_connections 2024-09-13T18:36:27.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.139+0000 7f5906ef9700 1 --2- 172.21.15.44:0/4012355545 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58f80378f0 0x7f58f80eb920 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.139+0000 7f5906ef9700 1 -- 172.21.15.44:0/4012355545 >> 172.21.15.44:0/4012355545 conn(0x7f58f801eaf0 msgr2=0x7f58f8055760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:27.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.139+0000 7f5906ef9700 1 -- 172.21.15.44:0/4012355545 shutdown_connections 2024-09-13T18:36:27.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.139+0000 7f5906ef9700 1 -- 172.21.15.44:0/4012355545 wait complete. 2024-09-13T18:36:27.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.143+0000 7f5906ef9700 1 Processor -- start 2024-09-13T18:36:27.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.143+0000 7f5906ef9700 1 -- start start 2024-09-13T18:36:27.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f5906ef9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58f80378f0 0x7f58f804e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f5906ef9700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58f80e08f0 0x7f58f804c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f5906ef9700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58f80e0cd0 0x7f58f804cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f5906ef9700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f80d8d80 con 0x7f58f80378f0 2024-09-13T18:36:27.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f5906ef9700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f804f1c0 con 0x7f58f80e0cd0 2024-09-13T18:36:27.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f5906ef9700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f804f4a0 con 0x7f58f80e08f0 2024-09-13T18:36:27.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f5905ef7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58f80378f0 0x7f58f804e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f5905ef7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58f80378f0 0x7f58f804e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47324/0 (socket says 172.21.15.44:47324) 2024-09-13T18:36:27.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f5905ef7700 1 -- 172.21.15.44:0/3211943966 learned_addr learned my addr 172.21.15.44:0/3211943966 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:27.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f59056f6700 1 --2- 172.21.15.44:0/3211943966 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58f80e08f0 0x7f58f804c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f59066f8700 1 --2- 172.21.15.44:0/3211943966 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58f80e0cd0 0x7f58f804cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f5905ef7700 1 -- 172.21.15.44:0/3211943966 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58f80e08f0 msgr2=0x7f58f804c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f5905ef7700 1 --2- 172.21.15.44:0/3211943966 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58f80e08f0 0x7f58f804c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f5905ef7700 1 -- 172.21.15.44:0/3211943966 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58f80e0cd0 msgr2=0x7f58f804cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f5905ef7700 1 --2- 172.21.15.44:0/3211943966 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58f80e0cd0 0x7f58f804cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f5905ef7700 1 -- 172.21.15.44:0/3211943966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590004f5c0 con 0x7f58f80378f0 2024-09-13T18:36:27.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f59066f8700 1 --2- 172.21.15.44:0/3211943966 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58f80e0cd0 0x7f58f804cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:27.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f5905ef7700 1 --2- 172.21.15.44:0/3211943966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58f80378f0 0x7f58f804e750 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00c700 tx=0x7f58fc00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:27.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f58f67fc700 1 -- 172.21.15.44:0/3211943966 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc0074e0 con 0x7f58f80378f0 2024-09-13T18:36:27.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f58f67fc700 1 -- 172.21.15.44:0/3211943966 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58fc007640 con 0x7f58f80378f0 2024-09-13T18:36:27.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f5906ef9700 1 -- 172.21.15.44:0/3211943966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f804f780 con 0x7f58f80378f0 2024-09-13T18:36:27.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f58f67fc700 1 -- 172.21.15.44:0/3211943966 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc005a50 con 0x7f58f80378f0 2024-09-13T18:36:27.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f5906ef9700 1 -- 172.21.15.44:0/3211943966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f804ec90 con 0x7f58f80378f0 2024-09-13T18:36:27.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.147+0000 7f5906ef9700 1 -- 172.21.15.44:0/3211943966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f804f970 con 0x7f58f80378f0 2024-09-13T18:36:27.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.151+0000 7f58f67fc700 1 -- 172.21.15.44:0/3211943966 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f58fc005bb0 con 0x7f58f80378f0 2024-09-13T18:36:27.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.151+0000 7f58f67fc700 1 --2- 172.21.15.44:0/3211943966 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f58e4066730 0x7f58e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.151+0000 7f58f67fc700 1 -- 172.21.15.44:0/3211943966 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58fc083610 con 0x7f58f80378f0 2024-09-13T18:36:27.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.151+0000 7f59056f6700 1 --2- 172.21.15.44:0/3211943966 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f58e4066730 0x7f58e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.151+0000 7f59056f6700 1 --2- 172.21.15.44:0/3211943966 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f58e4066730 0x7f58e4068bf0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f58f804c510 tx=0x7f58f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:27.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.155+0000 7f58f67fc700 1 -- 172.21.15.44:0/3211943966 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f58fc0509b0 con 0x7f58f80378f0 2024-09-13T18:36:27.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.327+0000 7f5906ef9700 1 -- 172.21.15.44:0/3211943966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f58f8055e70 con 0x7f58f80378f0 2024-09-13T18:36:27.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.327+0000 7f58f67fc700 1 -- 172.21.15.44:0/3211943966 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7f58fc005e60 con 0x7f58f80378f0 2024-09-13T18:36:27.337 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:36:27.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.331+0000 7f5906ef9700 1 -- 172.21.15.44:0/3211943966 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f58e4066730 msgr2=0x7f58e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.331+0000 7f5906ef9700 1 --2- 172.21.15.44:0/3211943966 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f58e4066730 0x7f58e4068bf0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f58f804c510 tx=0x7f58f0009040 comp rx=0 tx=0).stop 2024-09-13T18:36:27.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.331+0000 7f5906ef9700 1 -- 172.21.15.44:0/3211943966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58f80378f0 msgr2=0x7f58f804e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.331+0000 7f5906ef9700 1 --2- 172.21.15.44:0/3211943966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58f80378f0 0x7f58f804e750 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00c700 tx=0x7f58fc00ca10 comp rx=0 tx=0).stop 2024-09-13T18:36:27.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.331+0000 7f5906ef9700 1 -- 172.21.15.44:0/3211943966 shutdown_connections 2024-09-13T18:36:27.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.331+0000 7f5906ef9700 1 --2- 172.21.15.44:0/3211943966 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f58e4066730 0x7f58e4068bf0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.331+0000 7f5906ef9700 1 --2- 172.21.15.44:0/3211943966 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58f80e0cd0 0x7f58f804cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.331+0000 7f5906ef9700 1 --2- 172.21.15.44:0/3211943966 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58f80e08f0 0x7f58f804c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.331+0000 7f5906ef9700 1 --2- 172.21.15.44:0/3211943966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58f80378f0 0x7f58f804e750 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.331+0000 7f5906ef9700 1 -- 172.21.15.44:0/3211943966 >> 172.21.15.44:0/3211943966 conn(0x7f58f801eaf0 msgr2=0x7f58f8054130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:27.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.331+0000 7f5906ef9700 1 -- 172.21.15.44:0/3211943966 shutdown_connections 2024-09-13T18:36:27.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.331+0000 7f5906ef9700 1 -- 172.21.15.44:0/3211943966 wait complete. 2024-09-13T18:36:27.352 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:36:27.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.459+0000 7fa70dad3700 1 Processor -- start 2024-09-13T18:36:27.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.459+0000 7fa70dad3700 1 -- start start 2024-09-13T18:36:27.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa70dad3700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa7000e0760 0x7fa70001d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa70dad3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa700006c80 0x7fa70000aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa70dad3700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa70001d380 con 0x7fa70000a5b0 2024-09-13T18:36:27.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa70dad3700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa70000af60 con 0x7fa7000e0760 2024-09-13T18:36:27.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa70dad3700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70001c770 con 0x7fa700006c80 2024-09-13T18:36:27.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa70cad1700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa7000e0760 0x7fa70001d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa70cad1700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa7000e0760 0x7fa70001d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47330/0 (socket says 172.21.15.44:47330) 2024-09-13T18:36:27.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa70cad1700 1 -- 172.21.15.44:0/301063694 learned_addr learned my addr 172.21.15.44:0/301063694 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:27.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa70d2d2700 1 --2- 172.21.15.44:0/301063694 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa700006c80 0x7fa70000aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa70cad1700 1 -- 172.21.15.44:0/301063694 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa700006c80 msgr2=0x7fa70000aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:27.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa70cad1700 1 --2- 172.21.15.44:0/301063694 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa700006c80 0x7fa70000aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa7077fe700 1 -- 172.21.15.44:0/301063694 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4001952092 0 0) 0x7fa70001d380 con 0x7fa70000a5b0 2024-09-13T18:36:27.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa70cad1700 1 -- 172.21.15.44:0/301063694 >> v1:172.21.15.99:6789/0 conn(0x7fa70000a5b0 legacy=0x7fa700006570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa70cad1700 1 -- 172.21.15.44:0/301063694 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70001ca50 con 0x7fa7000e0760 2024-09-13T18:36:27.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa70cad1700 1 --2- 172.21.15.44:0/301063694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7000e0760 0x7fa70001d810 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009910 tx=0x7fa6f4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37c84f5da0e4b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:27.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa7077fe700 1 -- 172.21.15.44:0/301063694 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4005c40 con 0x7fa7000e0760 2024-09-13T18:36:27.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa7077fe700 1 -- 172.21.15.44:0/301063694 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f4005da0 con 0x7fa7000e0760 2024-09-13T18:36:27.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa7077fe700 1 -- 172.21.15.44:0/301063694 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f400b870 con 0x7fa7000e0760 2024-09-13T18:36:27.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa70dad3700 1 -- 172.21.15.44:0/301063694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7000e0760 msgr2=0x7fa70001d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa70dad3700 1 --2- 172.21.15.44:0/301063694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7000e0760 0x7fa70001d810 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009910 tx=0x7fa6f4009c20 comp rx=0 tx=0).stop 2024-09-13T18:36:27.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa70dad3700 1 -- 172.21.15.44:0/301063694 shutdown_connections 2024-09-13T18:36:27.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa70dad3700 1 --2- 172.21.15.44:0/301063694 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa700006c80 0x7fa70000aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa70dad3700 1 --2- 172.21.15.44:0/301063694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7000e0760 0x7fa70001d810 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa70dad3700 1 -- 172.21.15.44:0/301063694 >> 172.21.15.44:0/301063694 conn(0x7fa700036140 msgr2=0x7fa700036550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:27.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa70dad3700 1 -- 172.21.15.44:0/301063694 shutdown_connections 2024-09-13T18:36:27.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.463+0000 7fa70dad3700 1 -- 172.21.15.44:0/301063694 wait complete. 2024-09-13T18:36:27.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.467+0000 7fa70dad3700 1 Processor -- start 2024-09-13T18:36:27.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.467+0000 7fa70dad3700 1 -- start start 2024-09-13T18:36:27.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.467+0000 7fa70dad3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa700006c80 0x7fa7000cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.467+0000 7fa70dad3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa70000a5b0 0x7fa70004ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.467+0000 7fa70dad3700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7000e0760 0x7fa70004d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.467+0000 7fa70dad3700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7000ccf20 con 0x7fa700006c80 2024-09-13T18:36:27.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.467+0000 7fa70dad3700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70004b9e0 con 0x7fa7000e0760 2024-09-13T18:36:27.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.467+0000 7fa70dad3700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70004bcc0 con 0x7fa70000a5b0 2024-09-13T18:36:27.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.467+0000 7fa70cad1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa700006c80 0x7fa7000cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.467+0000 7fa70cad1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa700006c80 0x7fa7000cc9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47342/0 (socket says 172.21.15.44:47342) 2024-09-13T18:36:27.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.467+0000 7fa70cad1700 1 -- 172.21.15.44:0/3759152023 learned_addr learned my addr 172.21.15.44:0/3759152023 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:27.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.467+0000 7fa70d2d2700 1 --2- 172.21.15.44:0/3759152023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7000e0760 0x7fa70004d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.467+0000 7fa707fff700 1 --2- 172.21.15.44:0/3759152023 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa70000a5b0 0x7fa70004ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.467+0000 7fa70cad1700 1 -- 172.21.15.44:0/3759152023 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa70000a5b0 msgr2=0x7fa70004ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.467+0000 7fa70cad1700 1 --2- 172.21.15.44:0/3759152023 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa70000a5b0 0x7fa70004ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.467+0000 7fa70cad1700 1 -- 172.21.15.44:0/3759152023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7000e0760 msgr2=0x7fa70004d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.467+0000 7fa70cad1700 1 --2- 172.21.15.44:0/3759152023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7000e0760 0x7fa70004d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.471+0000 7fa70cad1700 1 -- 172.21.15.44:0/3759152023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f4009520 con 0x7fa700006c80 2024-09-13T18:36:27.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.471+0000 7fa70cad1700 1 --2- 172.21.15.44:0/3759152023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa700006c80 0x7fa7000cc9e0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4000c00 tx=0x7fa6f4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:27.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.471+0000 7fa7057fa700 1 -- 172.21.15.44:0/3759152023 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f400bd90 con 0x7fa700006c80 2024-09-13T18:36:27.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.471+0000 7fa7057fa700 1 -- 172.21.15.44:0/3759152023 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f4020070 con 0x7fa700006c80 2024-09-13T18:36:27.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.471+0000 7fa70dad3700 1 -- 172.21.15.44:0/3759152023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa70004bfa0 con 0x7fa700006c80 2024-09-13T18:36:27.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.471+0000 7fa7057fa700 1 -- 172.21.15.44:0/3759152023 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4025670 con 0x7fa700006c80 2024-09-13T18:36:27.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.471+0000 7fa70dad3700 1 -- 172.21.15.44:0/3759152023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70004c560 con 0x7fa700006c80 2024-09-13T18:36:27.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.471+0000 7fa70dad3700 1 -- 172.21.15.44:0/3759152023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa700004800 con 0x7fa700006c80 2024-09-13T18:36:27.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.471+0000 7fa7057fa700 1 -- 172.21.15.44:0/3759152023 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa6f4022030 con 0x7fa700006c80 2024-09-13T18:36:27.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.475+0000 7fa7057fa700 1 --2- 172.21.15.44:0/3759152023 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa6ec066730 0x7fa6ec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.475+0000 7fa7057fa700 1 -- 172.21.15.44:0/3759152023 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6f40856c0 con 0x7fa700006c80 2024-09-13T18:36:27.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.475+0000 7fa707fff700 1 --2- 172.21.15.44:0/3759152023 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa6ec066730 0x7fa6ec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.475+0000 7fa707fff700 1 --2- 172.21.15.44:0/3759152023 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa6ec066730 0x7fa6ec068bf0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa700049aa0 tx=0x7fa6fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:27.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.479+0000 7fa7057fa700 1 -- 172.21.15.44:0/3759152023 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa6f4052a20 con 0x7fa700006c80 2024-09-13T18:36:27.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.663+0000 7fa70dad3700 1 -- 172.21.15.44:0/3759152023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa70000aa20 con 0x7fa700006c80 2024-09-13T18:36:27.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.663+0000 7fa7057fa700 1 -- 172.21.15.44:0/3759152023 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v90) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa6f4056040 con 0x7fa700006c80 2024-09-13T18:36:27.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.667+0000 7fa70dad3700 1 -- 172.21.15.44:0/3759152023 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa6ec066730 msgr2=0x7fa6ec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.667+0000 7fa70dad3700 1 --2- 172.21.15.44:0/3759152023 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa6ec066730 0x7fa6ec068bf0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa700049aa0 tx=0x7fa6fc009040 comp rx=0 tx=0).stop 2024-09-13T18:36:27.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.667+0000 7fa70dad3700 1 -- 172.21.15.44:0/3759152023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa700006c80 msgr2=0x7fa7000cc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.667+0000 7fa70dad3700 1 --2- 172.21.15.44:0/3759152023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa700006c80 0x7fa7000cc9e0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4000c00 tx=0x7fa6f4004770 comp rx=0 tx=0).stop 2024-09-13T18:36:27.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.667+0000 7fa70dad3700 1 -- 172.21.15.44:0/3759152023 shutdown_connections 2024-09-13T18:36:27.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.667+0000 7fa70dad3700 1 --2- 172.21.15.44:0/3759152023 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa6ec066730 0x7fa6ec068bf0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.667+0000 7fa70dad3700 1 --2- 172.21.15.44:0/3759152023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7000e0760 0x7fa70004d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.667+0000 7fa70dad3700 1 --2- 172.21.15.44:0/3759152023 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa70000a5b0 0x7fa70004ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.667+0000 7fa70dad3700 1 --2- 172.21.15.44:0/3759152023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa700006c80 0x7fa7000cc9e0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.667+0000 7fa70dad3700 1 -- 172.21.15.44:0/3759152023 >> 172.21.15.44:0/3759152023 conn(0x7fa700036140 msgr2=0x7fa700034580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:27.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.667+0000 7fa70dad3700 1 -- 172.21.15.44:0/3759152023 shutdown_connections 2024-09-13T18:36:27.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:27.667+0000 7fa70dad3700 1 -- 172.21.15.44:0/3759152023 wait complete. 2024-09-13T18:36:27.676 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-13T18:36:27.686 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2024-09-13T18:36:27.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:27.687 DEBUG:teuthology.orchestra.run.smithi044:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:36:27.700 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[48376]: fuse finished with error 0 and tester_r 0 2024-09-13T18:36:27.702 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:36:27.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:27.703 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:36:27.801 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:36:27.801 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:27.809 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346268k,nr_inodes=4086567,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19562 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275480k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:36:27.809 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:36:27.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:27.810 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:36:27.856 INFO:teuthology.orchestra.run.smithi099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-13T18:36:27.857 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:36:27.857 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:36:27.858 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:27.865 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349428k,nr_inodes=4087357,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16693 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276112k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:36:27.865 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:36:27.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:27.866 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T18:36:27.915 INFO:teuthology.orchestra.run.smithi044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T18:36:27.915 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:36:27.916 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:36:27.916 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:27.924 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346268k,nr_inodes=4086567,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19562 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275480k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:36:27.924 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:36:27.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:27.924 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T18:36:27.930 INFO:teuthology.orchestra.run.smithi099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T18:36:27.931 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:36:27.931 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:36:28.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa687fff700 1 Processor -- start 2024-09-13T18:36:28.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa687fff700 1 -- start start 2024-09-13T18:36:28.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa687fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa68806acc0 0x7fa68815ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa687fff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68813dcb0 con 0x7fa6880b3ae0 2024-09-13T18:36:28.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa687fff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68813ffd0 con 0x7fa68806bbf0 2024-09-13T18:36:28.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa687fff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68806b110 con 0x7fa68806acc0 2024-09-13T18:36:28.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa6877fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa68806acc0 0x7fa68815ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa6867fc700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa6880b3ae0 0x7fa68806a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49724/0 (socket says 172.21.15.44:49724) 2024-09-13T18:36:28.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa6867fc700 1 -- 172.21.15.44:0/1928365343 learned_addr learned my addr 172.21.15.44:0/1928365343 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:28.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa6877fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa68806acc0 0x7fa68815ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47352/0 (socket says 172.21.15.44:47352) 2024-09-13T18:36:28.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa6877fe700 1 -- 172.21.15.44:0/1928365343 >> v1:172.21.15.99:6789/0 conn(0x7fa68806bbf0 legacy=0x7fa6880b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa6877fe700 1 -- 172.21.15.44:0/1928365343 >> v1:172.21.15.44:6789/0 conn(0x7fa6880b3ae0 legacy=0x7fa68806a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa6877fe700 1 -- 172.21.15.44:0/1928365343 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa688140220 con 0x7fa68806acc0 2024-09-13T18:36:28.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa6877fe700 1 --2- 172.21.15.44:0/1928365343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa68806acc0 0x7fa68815ae50 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fa680009d90 tx=0x7fa68000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd327617833a83f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:28.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa685ffb700 1 -- 172.21.15.44:0/1928365343 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68000e070 con 0x7fa68806acc0 2024-09-13T18:36:28.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa685ffb700 1 -- 172.21.15.44:0/1928365343 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68000bbd0 con 0x7fa68806acc0 2024-09-13T18:36:28.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa685ffb700 1 -- 172.21.15.44:0/1928365343 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa680012430 con 0x7fa68806acc0 2024-09-13T18:36:28.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa687fff700 1 -- 172.21.15.44:0/1928365343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa68806acc0 msgr2=0x7fa68815ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa687fff700 1 --2- 172.21.15.44:0/1928365343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa68806acc0 0x7fa68815ae50 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fa680009d90 tx=0x7fa68000b330 comp rx=0 tx=0).stop 2024-09-13T18:36:28.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa687fff700 1 -- 172.21.15.44:0/1928365343 shutdown_connections 2024-09-13T18:36:28.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa687fff700 1 --2- 172.21.15.44:0/1928365343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa68806acc0 0x7fa68815ae50 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa687fff700 1 -- 172.21.15.44:0/1928365343 >> 172.21.15.44:0/1928365343 conn(0x7fa6880b0f00 msgr2=0x7fa6880b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:28.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa687fff700 1 -- 172.21.15.44:0/1928365343 shutdown_connections 2024-09-13T18:36:28.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.051+0000 7fa687fff700 1 -- 172.21.15.44:0/1928365343 wait complete. 2024-09-13T18:36:28.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.055+0000 7fa687fff700 1 Processor -- start 2024-09-13T18:36:28.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.055+0000 7fa687fff700 1 -- start start 2024-09-13T18:36:28.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.055+0000 7fa687fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa68806acc0 0x7fa688139d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.055+0000 7fa687fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa68806bbf0 0x7fa6880cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.055+0000 7fa687fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6880b3ae0 0x7fa68813c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.055+0000 7fa687fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6881520a0 con 0x7fa68806bbf0 2024-09-13T18:36:28.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.055+0000 7fa687fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6880cbf80 con 0x7fa6880b3ae0 2024-09-13T18:36:28.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.055+0000 7fa687fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6880cc260 con 0x7fa68806acc0 2024-09-13T18:36:28.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.055+0000 7fa6867fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa68806bbf0 0x7fa6880cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.055+0000 7fa6867fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa68806bbf0 0x7fa6880cb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47354/0 (socket says 172.21.15.44:47354) 2024-09-13T18:36:28.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.055+0000 7fa6867fc700 1 -- 172.21.15.44:0/1613184439 learned_addr learned my addr 172.21.15.44:0/1613184439 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:28.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.055+0000 7fa6877fe700 1 --2- 172.21.15.44:0/1613184439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6880b3ae0 0x7fa68813c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.055+0000 7fa686ffd700 1 --2- 172.21.15.44:0/1613184439 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa68806acc0 0x7fa688139d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.059+0000 7fa6867fc700 1 -- 172.21.15.44:0/1613184439 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa68806acc0 msgr2=0x7fa688139d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.059+0000 7fa6867fc700 1 --2- 172.21.15.44:0/1613184439 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa68806acc0 0x7fa688139d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.059+0000 7fa6867fc700 1 -- 172.21.15.44:0/1613184439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6880b3ae0 msgr2=0x7fa68813c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.059+0000 7fa6867fc700 1 --2- 172.21.15.44:0/1613184439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6880b3ae0 0x7fa68813c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.059+0000 7fa6867fc700 1 -- 172.21.15.44:0/1613184439 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa680009a70 con 0x7fa68806bbf0 2024-09-13T18:36:28.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.059+0000 7fa6867fc700 1 --2- 172.21.15.44:0/1613184439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa68806bbf0 0x7fa6880cb610 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fa67800c700 tx=0x7fa67800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:28.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.059+0000 7fa66f7fe700 1 -- 172.21.15.44:0/1613184439 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa678005d90 con 0x7fa68806bbf0 2024-09-13T18:36:28.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.059+0000 7fa66f7fe700 1 -- 172.21.15.44:0/1613184439 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6780070d0 con 0x7fa68806bbf0 2024-09-13T18:36:28.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.059+0000 7fa687fff700 1 -- 172.21.15.44:0/1613184439 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6880cc540 con 0x7fa68806bbf0 2024-09-13T18:36:28.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.059+0000 7fa66f7fe700 1 -- 172.21.15.44:0/1613184439 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa678007440 con 0x7fa68806bbf0 2024-09-13T18:36:28.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.059+0000 7fa687fff700 1 -- 172.21.15.44:0/1613184439 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6880cbb50 con 0x7fa68806bbf0 2024-09-13T18:36:28.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.059+0000 7fa687fff700 1 -- 172.21.15.44:0/1613184439 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa688152250 con 0x7fa68806bbf0 2024-09-13T18:36:28.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.059+0000 7fa66f7fe700 1 -- 172.21.15.44:0/1613184439 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa6780075a0 con 0x7fa68806bbf0 2024-09-13T18:36:28.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.059+0000 7fa66f7fe700 1 --2- 172.21.15.44:0/1613184439 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa674066730 0x7fa674068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.059+0000 7fa66f7fe700 1 -- 172.21.15.44:0/1613184439 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa678083520 con 0x7fa68806bbf0 2024-09-13T18:36:28.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.063+0000 7fa686ffd700 1 --2- 172.21.15.44:0/1613184439 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa674066730 0x7fa674068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.063+0000 7fa686ffd700 1 --2- 172.21.15.44:0/1613184439 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa674066730 0x7fa674068bf0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa67c000f60 tx=0x7fa67c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:28.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.071+0000 7fa66f7fe700 1 -- 172.21.15.44:0/1613184439 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa688152250 con 0x7fa68806bbf0 2024-09-13T18:36:28.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.279+0000 7fa687fff700 1 -- 172.21.15.44:0/1613184439 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6880b33d0 con 0x7fa68806bbf0 2024-09-13T18:36:28.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.279+0000 7fa66f7fe700 1 -- 172.21.15.44:0/1613184439 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4730 (secure 0 0 0) 0x7fa678017090 con 0x7fa68806bbf0 2024-09-13T18:36:28.288 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:28.289 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":78,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7121,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4127573228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4127573228},{"type":"v1","addr":"172.21.15.99:6836","nonce":4127573228}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":7984,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3372982355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3372982355},{"type":"v1","addr":"172.21.15.99:6837","nonce":3372982355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/48969097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":48969097},{"type":"v1","addr":"172.21.15.44:6833","nonce":48969097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:36:17.641055+0000","modified":"2024-09-13T18:36:20.660692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8193":{"gid":8193,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/1527182738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1527182738},{"type":"v1","addr":"172.21.15.44:6835","nonce":1527182738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:36:28.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.283+0000 7fa687fff700 1 -- 172.21.15.44:0/1613184439 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa674066730 msgr2=0x7fa674068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.283+0000 7fa687fff700 1 --2- 172.21.15.44:0/1613184439 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa674066730 0x7fa674068bf0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa67c000f60 tx=0x7fa67c009040 comp rx=0 tx=0).stop 2024-09-13T18:36:28.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.283+0000 7fa687fff700 1 -- 172.21.15.44:0/1613184439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa68806bbf0 msgr2=0x7fa6880cb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.283+0000 7fa687fff700 1 --2- 172.21.15.44:0/1613184439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa68806bbf0 0x7fa6880cb610 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fa67800c700 tx=0x7fa67800ca10 comp rx=0 tx=0).stop 2024-09-13T18:36:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.283+0000 7fa687fff700 1 -- 172.21.15.44:0/1613184439 shutdown_connections 2024-09-13T18:36:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.283+0000 7fa687fff700 1 --2- 172.21.15.44:0/1613184439 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fa674066730 0x7fa674068bf0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.283+0000 7fa687fff700 1 --2- 172.21.15.44:0/1613184439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6880b3ae0 0x7fa68813c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.283+0000 7fa687fff700 1 --2- 172.21.15.44:0/1613184439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa68806bbf0 0x7fa6880cb610 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.283+0000 7fa687fff700 1 --2- 172.21.15.44:0/1613184439 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa68806acc0 0x7fa688139d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.283+0000 7fa687fff700 1 -- 172.21.15.44:0/1613184439 >> 172.21.15.44:0/1613184439 conn(0x7fa6880b0f00 msgr2=0x7fa6880afbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.283+0000 7fa687fff700 1 -- 172.21.15.44:0/1613184439 shutdown_connections 2024-09-13T18:36:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.283+0000 7fa687fff700 1 -- 172.21.15.44:0/1613184439 wait complete. 2024-09-13T18:36:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 78 2024-09-13T18:36:28.304 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:28.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.407+0000 7fe08c878700 1 Processor -- start 2024-09-13T18:36:28.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.407+0000 7fe08c878700 1 -- start start 2024-09-13T18:36:28.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe08c878700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe0800df9c0 0x7fe080005b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe08c878700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe08001c6b0 0x7fe08000b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe08c878700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0800e0d20 con 0x7fe08000b990 2024-09-13T18:36:28.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe08c878700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe08000be40 con 0x7fe0800df9c0 2024-09-13T18:36:28.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe08c878700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800e0110 con 0x7fe08001c6b0 2024-09-13T18:36:28.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe087fff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe08000b990 0x7fe08004eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49730/0 (socket says 172.21.15.44:49730) 2024-09-13T18:36:28.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe087fff700 1 -- 172.21.15.44:0/1667648483 learned_addr learned my addr 172.21.15.44:0/1667648483 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:28.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe0877fe700 1 --2- 172.21.15.44:0/1667648483 >> v2:172.21.15.99:3300/0 conn(0x7fe0800df9c0 0x7fe080005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe086ffd700 1 --2- 172.21.15.44:0/1667648483 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe08001c6b0 0x7fe08000b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe0867fc700 1 -- 172.21.15.44:0/1667648483 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3274614563 0 0) 0x7fe0800e0d20 con 0x7fe08000b990 2024-09-13T18:36:28.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe0867fc700 1 -- 172.21.15.44:0/1667648483 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0700035d0 con 0x7fe08000b990 2024-09-13T18:36:28.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe0877fe700 1 -- 172.21.15.44:0/1667648483 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe08001c6b0 msgr2=0x7fe08000b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:28.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe0867fc700 1 -- 172.21.15.44:0/1667648483 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1510289391 0 0) 0x7fe0700035d0 con 0x7fe08000b990 2024-09-13T18:36:28.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe0877fe700 1 --2- 172.21.15.44:0/1667648483 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe08001c6b0 0x7fe08000b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe0877fe700 1 -- 172.21.15.44:0/1667648483 >> v1:172.21.15.44:6789/0 conn(0x7fe08000b990 legacy=0x7fe08004eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe0877fe700 1 -- 172.21.15.44:0/1667648483 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0800e03f0 con 0x7fe0800df9c0 2024-09-13T18:36:28.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe086ffd700 1 --2- 172.21.15.44:0/1667648483 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe08001c6b0 0x7fe08000b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:28.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe0877fe700 1 --2- 172.21.15.44:0/1667648483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0800df9c0 0x7fe080005b60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009870 tx=0x7fe07c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=680dd5822842f08e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:28.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe0867fc700 1 -- 172.21.15.44:0/1667648483 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08804ef50 con 0x7fe0800df9c0 2024-09-13T18:36:28.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe0867fc700 1 -- 172.21.15.44:0/1667648483 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07c004030 con 0x7fe0800df9c0 2024-09-13T18:36:28.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe0867fc700 1 -- 172.21.15.44:0/1667648483 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c0043a0 con 0x7fe0800df9c0 2024-09-13T18:36:28.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe08c878700 1 -- 172.21.15.44:0/1667648483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0800df9c0 msgr2=0x7fe080005b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe08c878700 1 --2- 172.21.15.44:0/1667648483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0800df9c0 0x7fe080005b60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009870 tx=0x7fe07c009b80 comp rx=0 tx=0).stop 2024-09-13T18:36:28.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe08c878700 1 -- 172.21.15.44:0/1667648483 shutdown_connections 2024-09-13T18:36:28.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe08c878700 1 --2- 172.21.15.44:0/1667648483 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe08001c6b0 0x7fe08000b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe08c878700 1 --2- 172.21.15.44:0/1667648483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0800df9c0 0x7fe080005b60 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe08c878700 1 -- 172.21.15.44:0/1667648483 >> 172.21.15.44:0/1667648483 conn(0x7fe080036140 msgr2=0x7fe080036550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:28.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe08c878700 1 -- 172.21.15.44:0/1667648483 shutdown_connections 2024-09-13T18:36:28.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.411+0000 7fe08c878700 1 -- 172.21.15.44:0/1667648483 wait complete. 2024-09-13T18:36:28.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe08c878700 1 Processor -- start 2024-09-13T18:36:28.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe08c878700 1 -- start start 2024-09-13T18:36:28.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe08c878700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe08000b990 0x7fe08004e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe08c878700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08001c6b0 0x7fe0800cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe08c878700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe0800df9c0 0x7fe0800e12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe08c878700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800ec940 con 0x7fe08001c6b0 2024-09-13T18:36:28.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe08c878700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800cd5e0 con 0x7fe08000b990 2024-09-13T18:36:28.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe08c878700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800ebcc0 con 0x7fe0800df9c0 2024-09-13T18:36:28.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe086ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08001c6b0 0x7fe0800cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe087fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe0800df9c0 0x7fe0800e12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe086ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08001c6b0 0x7fe0800cdad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47368/0 (socket says 172.21.15.44:47368) 2024-09-13T18:36:28.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe0877fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe08000b990 0x7fe08004e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe086ffd700 1 -- 172.21.15.44:0/3571027844 learned_addr learned my addr 172.21.15.44:0/3571027844 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:28.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe086ffd700 1 -- 172.21.15.44:0/3571027844 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe0800df9c0 msgr2=0x7fe0800e12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe086ffd700 1 --2- 172.21.15.44:0/3571027844 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe0800df9c0 0x7fe0800e12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe086ffd700 1 -- 172.21.15.44:0/3571027844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe08000b990 msgr2=0x7fe08004e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe086ffd700 1 --2- 172.21.15.44:0/3571027844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe08000b990 0x7fe08004e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe086ffd700 1 -- 172.21.15.44:0/3571027844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0780094b0 con 0x7fe08001c6b0 2024-09-13T18:36:28.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe086ffd700 1 --2- 172.21.15.44:0/3571027844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08001c6b0 0x7fe0800cdad0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fe07800ebb0 tx=0x7fe07800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:28.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe06ffff700 1 -- 172.21.15.44:0/3571027844 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07800c850 con 0x7fe08001c6b0 2024-09-13T18:36:28.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe06ffff700 1 -- 172.21.15.44:0/3571027844 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07800c9b0 con 0x7fe08001c6b0 2024-09-13T18:36:28.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe08c878700 1 -- 172.21.15.44:0/3571027844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07c009450 con 0x7fe08001c6b0 2024-09-13T18:36:28.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe06ffff700 1 -- 172.21.15.44:0/3571027844 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07800cd40 con 0x7fe08001c6b0 2024-09-13T18:36:28.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.415+0000 7fe08c878700 1 -- 172.21.15.44:0/3571027844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0800ec280 con 0x7fe08001c6b0 2024-09-13T18:36:28.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.419+0000 7fe08c878700 1 -- 172.21.15.44:0/3571027844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe080004800 con 0x7fe08001c6b0 2024-09-13T18:36:28.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.419+0000 7fe06ffff700 1 -- 172.21.15.44:0/3571027844 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe078013470 con 0x7fe08001c6b0 2024-09-13T18:36:28.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.419+0000 7fe06ffff700 1 --2- 172.21.15.44:0/3571027844 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe074066730 0x7fe074068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.419+0000 7fe06ffff700 1 -- 172.21.15.44:0/3571027844 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0780841d0 con 0x7fe08001c6b0 2024-09-13T18:36:28.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.419+0000 7fe0877fe700 1 --2- 172.21.15.44:0/3571027844 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe074066730 0x7fe074068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.423+0000 7fe0877fe700 1 --2- 172.21.15.44:0/3571027844 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe074066730 0x7fe074068bf0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe07c000c00 tx=0x7fe07c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:28.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.427+0000 7fe06ffff700 1 -- 172.21.15.44:0/3571027844 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe078051530 con 0x7fe08001c6b0 2024-09-13T18:36:28.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.603+0000 7fe08c878700 1 -- 172.21.15.44:0/3571027844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe08000b450 con 0x7fe08001c6b0 2024-09-13T18:36:28.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.603+0000 7fe06ffff700 1 -- 172.21.15.44:0/3571027844 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16500 (secure 0 0 0) 0x7fe078054b50 con 0x7fe08001c6b0 2024-09-13T18:36:28.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:28.613 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":90,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:36:18.647007+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:36:15.982954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T18:36:16.628264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:28.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.607+0000 7fe08c878700 1 -- 172.21.15.44:0/3571027844 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe074066730 msgr2=0x7fe074068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.607+0000 7fe08c878700 1 --2- 172.21.15.44:0/3571027844 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe074066730 0x7fe074068bf0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe07c000c00 tx=0x7fe07c008030 comp rx=0 tx=0).stop 2024-09-13T18:36:28.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.607+0000 7fe08c878700 1 -- 172.21.15.44:0/3571027844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08001c6b0 msgr2=0x7fe0800cdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.607+0000 7fe08c878700 1 --2- 172.21.15.44:0/3571027844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08001c6b0 0x7fe0800cdad0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fe07800ebb0 tx=0x7fe07800eec0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.607+0000 7fe08c878700 1 -- 172.21.15.44:0/3571027844 shutdown_connections 2024-09-13T18:36:28.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.607+0000 7fe08c878700 1 --2- 172.21.15.44:0/3571027844 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe074066730 0x7fe074068bf0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.607+0000 7fe08c878700 1 --2- 172.21.15.44:0/3571027844 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe0800df9c0 0x7fe0800e12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.607+0000 7fe08c878700 1 --2- 172.21.15.44:0/3571027844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08001c6b0 0x7fe0800cdad0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.607+0000 7fe08c878700 1 --2- 172.21.15.44:0/3571027844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe08000b990 0x7fe08004e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.607+0000 7fe08c878700 1 -- 172.21.15.44:0/3571027844 >> 172.21.15.44:0/3571027844 conn(0x7fe080036140 msgr2=0x7fe080006800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:28.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.611+0000 7fe08c878700 1 -- 172.21.15.44:0/3571027844 shutdown_connections 2024-09-13T18:36:28.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.611+0000 7fe08c878700 1 -- 172.21.15.44:0/3571027844 wait complete. 2024-09-13T18:36:28.635 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:26:50.378491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:36:15.982954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:36:16.628264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:36:28.636 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:36:28.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.747+0000 7f51e6e2d700 1 Processor -- start 2024-09-13T18:36:28.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.747+0000 7f51e6e2d700 1 -- start start 2024-09-13T18:36:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e6e2d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51e0146160 0x7f51e00cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e6e2d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f51e00ce130 0x7f51e00ad270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e6e2d700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e00ae000 con 0x7f51e00ad7b0 2024-09-13T18:36:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e6e2d700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e00cc820 con 0x7f51e00ce130 2024-09-13T18:36:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e6e2d700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e0070070 con 0x7f51e0146160 2024-09-13T18:36:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e662c700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f51e00ad7b0 0x7f51e0160600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49734/0 (socket says 172.21.15.44:49734) 2024-09-13T18:36:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e662c700 1 -- 172.21.15.44:0/297945160 learned_addr learned my addr 172.21.15.44:0/297945160 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e562a700 1 --2- 172.21.15.44:0/297945160 >> v2:172.21.15.44:3300/0 conn(0x7f51e00ce130 0x7f51e00ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e5e2b700 1 --2- 172.21.15.44:0/297945160 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51e0146160 0x7f51e00cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e4e29700 1 -- 172.21.15.44:0/297945160 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618222525 0 0) 0x7f51e00ae000 con 0x7f51e00ad7b0 2024-09-13T18:36:28.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e4e29700 1 -- 172.21.15.44:0/297945160 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51c80035d0 con 0x7f51e00ad7b0 2024-09-13T18:36:28.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e562a700 1 -- 172.21.15.44:0/297945160 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51e0146160 msgr2=0x7f51e00cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:28.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e562a700 1 --2- 172.21.15.44:0/297945160 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51e0146160 0x7f51e00cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e562a700 1 -- 172.21.15.44:0/297945160 >> v1:172.21.15.44:6789/0 conn(0x7f51e00ad7b0 legacy=0x7f51e0160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e562a700 1 -- 172.21.15.44:0/297945160 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e0070350 con 0x7f51e00ce130 2024-09-13T18:36:28.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e562a700 1 --2- 172.21.15.44:0/297945160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e00ce130 0x7f51e00ad270 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009850 tx=0x7f51d4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606d11c2af9f54e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:28.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e4e29700 1 -- 172.21.15.44:0/297945160 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d4011830 con 0x7f51e00ce130 2024-09-13T18:36:28.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e4e29700 1 -- 172.21.15.44:0/297945160 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d4011990 con 0x7f51e00ce130 2024-09-13T18:36:28.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e4e29700 1 -- 172.21.15.44:0/297945160 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d4011d40 con 0x7f51e00ce130 2024-09-13T18:36:28.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e6e2d700 1 -- 172.21.15.44:0/297945160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e00ce130 msgr2=0x7f51e00ad270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e6e2d700 1 --2- 172.21.15.44:0/297945160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e00ce130 0x7f51e00ad270 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009850 tx=0x7f51d4009b60 comp rx=0 tx=0).stop 2024-09-13T18:36:28.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e6e2d700 1 -- 172.21.15.44:0/297945160 shutdown_connections 2024-09-13T18:36:28.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e6e2d700 1 --2- 172.21.15.44:0/297945160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e00ce130 0x7f51e00ad270 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e6e2d700 1 --2- 172.21.15.44:0/297945160 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51e0146160 0x7f51e00cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e6e2d700 1 -- 172.21.15.44:0/297945160 >> 172.21.15.44:0/297945160 conn(0x7f51e00b0e10 msgr2=0x7f51e00b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:28.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e6e2d700 1 -- 172.21.15.44:0/297945160 shutdown_connections 2024-09-13T18:36:28.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.751+0000 7f51e6e2d700 1 -- 172.21.15.44:0/297945160 wait complete. 2024-09-13T18:36:28.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.755+0000 7f51e6e2d700 1 Processor -- start 2024-09-13T18:36:28.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.755+0000 7f51e6e2d700 1 -- start start 2024-09-13T18:36:28.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.755+0000 7f51e6e2d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51e00ad7b0 0x7f51e00c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.755+0000 7f51e6e2d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e00ce130 0x7f51e0160120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.755+0000 7f51e6e2d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51e0146160 0x7f51e0160660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.755+0000 7f51e6e2d700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00c3890 con 0x7f51e00ce130 2024-09-13T18:36:28.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.755+0000 7f51e6e2d700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e01f34e0 con 0x7f51e0146160 2024-09-13T18:36:28.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.755+0000 7f51e6e2d700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00c3ae0 con 0x7f51e00ad7b0 2024-09-13T18:36:28.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.755+0000 7f51e562a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e00ce130 0x7f51e0160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.755+0000 7f51e562a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e00ce130 0x7f51e0160120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47388/0 (socket says 172.21.15.44:47388) 2024-09-13T18:36:28.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.755+0000 7f51e562a700 1 -- 172.21.15.44:0/4293881580 learned_addr learned my addr 172.21.15.44:0/4293881580 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:28.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.755+0000 7f51e5e2b700 1 --2- 172.21.15.44:0/4293881580 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51e00ad7b0 0x7f51e00c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.755+0000 7f51e662c700 1 --2- 172.21.15.44:0/4293881580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51e0146160 0x7f51e0160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.755+0000 7f51e562a700 1 -- 172.21.15.44:0/4293881580 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51e00ad7b0 msgr2=0x7f51e00c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.755+0000 7f51e562a700 1 --2- 172.21.15.44:0/4293881580 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51e00ad7b0 0x7f51e00c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.755+0000 7f51e562a700 1 -- 172.21.15.44:0/4293881580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51e0146160 msgr2=0x7f51e0160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.755+0000 7f51e562a700 1 --2- 172.21.15.44:0/4293881580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51e0146160 0x7f51e0160660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.755+0000 7f51e562a700 1 -- 172.21.15.44:0/4293881580 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d40094b0 con 0x7f51e00ce130 2024-09-13T18:36:28.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.759+0000 7f51e562a700 1 --2- 172.21.15.44:0/4293881580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e00ce130 0x7f51e0160120 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f51d40090b0 tx=0x7f51d4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:28.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.759+0000 7f51de7fc700 1 -- 172.21.15.44:0/4293881580 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d4004380 con 0x7f51e00ce130 2024-09-13T18:36:28.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.759+0000 7f51de7fc700 1 -- 172.21.15.44:0/4293881580 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d401f070 con 0x7f51e00ce130 2024-09-13T18:36:28.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.759+0000 7f51e6e2d700 1 -- 172.21.15.44:0/4293881580 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e00c3dc0 con 0x7f51e00ce130 2024-09-13T18:36:28.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.759+0000 7f51de7fc700 1 -- 172.21.15.44:0/4293881580 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d40036c0 con 0x7f51e00ce130 2024-09-13T18:36:28.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.759+0000 7f51e6e2d700 1 -- 172.21.15.44:0/4293881580 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e00c8570 con 0x7f51e00ce130 2024-09-13T18:36:28.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.759+0000 7f51e6e2d700 1 -- 172.21.15.44:0/4293881580 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e00c42e0 con 0x7f51e00ce130 2024-09-13T18:36:28.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.759+0000 7f51de7fc700 1 -- 172.21.15.44:0/4293881580 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f51d4021030 con 0x7f51e00ce130 2024-09-13T18:36:28.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.763+0000 7f51de7fc700 1 --2- 172.21.15.44:0/4293881580 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f51cc066730 0x7f51cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.763+0000 7f51de7fc700 1 -- 172.21.15.44:0/4293881580 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51d4085310 con 0x7f51e00ce130 2024-09-13T18:36:28.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.763+0000 7f51e5e2b700 1 --2- 172.21.15.44:0/4293881580 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f51cc066730 0x7f51cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.763+0000 7f51e5e2b700 1 --2- 172.21.15.44:0/4293881580 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f51cc066730 0x7f51cc068bf0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f51d0009b50 tx=0x7f51d0009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:28.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.767+0000 7f51de7fc700 1 -- 172.21.15.44:0/4293881580 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f51e00c42e0 con 0x7f51e00ce130 2024-09-13T18:36:28.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.939+0000 7f51e6e2d700 1 -- 172.21.15.44:0/4293881580 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51e00c42e0 con 0x7f51e00ce130 2024-09-13T18:36:28.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.939+0000 7f51de7fc700 1 -- 172.21.15.44:0/4293881580 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51e00c42e0 con 0x7f51e00ce130 2024-09-13T18:36:28.946 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-13T18:36:28.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.939+0000 7f51e6e2d700 1 -- 172.21.15.44:0/4293881580 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f51cc066730 msgr2=0x7f51cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.939+0000 7f51e6e2d700 1 --2- 172.21.15.44:0/4293881580 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f51cc066730 0x7f51cc068bf0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f51d0009b50 tx=0x7f51d0009240 comp rx=0 tx=0).stop 2024-09-13T18:36:28.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.939+0000 7f51e6e2d700 1 -- 172.21.15.44:0/4293881580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e00ce130 msgr2=0x7f51e0160120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.939+0000 7f51e6e2d700 1 --2- 172.21.15.44:0/4293881580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e00ce130 0x7f51e0160120 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f51d40090b0 tx=0x7f51d4004770 comp rx=0 tx=0).stop 2024-09-13T18:36:28.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.939+0000 7f51e6e2d700 1 -- 172.21.15.44:0/4293881580 shutdown_connections 2024-09-13T18:36:28.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.939+0000 7f51e6e2d700 1 --2- 172.21.15.44:0/4293881580 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f51cc066730 0x7f51cc068bf0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.939+0000 7f51e6e2d700 1 --2- 172.21.15.44:0/4293881580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51e0146160 0x7f51e0160660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.939+0000 7f51e6e2d700 1 --2- 172.21.15.44:0/4293881580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e00ce130 0x7f51e0160120 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.939+0000 7f51e6e2d700 1 --2- 172.21.15.44:0/4293881580 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f51e00ad7b0 0x7f51e00c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.939+0000 7f51e6e2d700 1 -- 172.21.15.44:0/4293881580 >> 172.21.15.44:0/4293881580 conn(0x7f51e00b0e10 msgr2=0x7f51e006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:28.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.939+0000 7f51e6e2d700 1 -- 172.21.15.44:0/4293881580 shutdown_connections 2024-09-13T18:36:28.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:28.939+0000 7f51e6e2d700 1 -- 172.21.15.44:0/4293881580 wait complete. 2024-09-13T18:36:28.961 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:36:29.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.075+0000 7fc267fff700 1 Processor -- start 2024-09-13T18:36:29.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.075+0000 7fc267fff700 1 -- start start 2024-09-13T18:36:29.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc267fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2680cd940 0x7fc26806ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc267fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc26806b260 0x7fc26806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc267fff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc26806b720 con 0x7fc2680b33a0 2024-09-13T18:36:29.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc267fff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc26806ba00 con 0x7fc26806b260 2024-09-13T18:36:29.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc267fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26806bce0 con 0x7fc2680cd940 2024-09-13T18:36:29.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc2677fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc26806b260 0x7fc26806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc2677fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc26806b260 0x7fc26806c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47398/0 (socket says 172.21.15.44:47398) 2024-09-13T18:36:29.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc2677fe700 1 -- 172.21.15.44:0/1013238970 learned_addr learned my addr 172.21.15.44:0/1013238970 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:29.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc25e7fc700 1 --2- 172.21.15.44:0/1013238970 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2680cd940 0x7fc26806ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc2677fe700 1 -- 172.21.15.44:0/1013238970 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2680cd940 msgr2=0x7fc26806ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:29.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc2677fe700 1 --2- 172.21.15.44:0/1013238970 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2680cd940 0x7fc26806ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc2677fe700 1 -- 172.21.15.44:0/1013238970 >> v1:172.21.15.99:6789/0 conn(0x7fc2680b33a0 legacy=0x7fc2680b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc2677fe700 1 -- 172.21.15.44:0/1013238970 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26806bfc0 con 0x7fc26806b260 2024-09-13T18:36:29.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc2677fe700 1 --2- 172.21.15.44:0/1013238970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc26806b260 0x7fc26806c7c0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fc260009e50 tx=0x7fc26000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48db546fcb9cc80f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:29.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc2667fc700 1 -- 172.21.15.44:0/1013238970 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26000e070 con 0x7fc26806b260 2024-09-13T18:36:29.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc2667fc700 1 -- 172.21.15.44:0/1013238970 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26000b910 con 0x7fc26806b260 2024-09-13T18:36:29.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc2667fc700 1 -- 172.21.15.44:0/1013238970 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26000bcc0 con 0x7fc26806b260 2024-09-13T18:36:29.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc267fff700 1 -- 172.21.15.44:0/1013238970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc26806b260 msgr2=0x7fc26806c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc267fff700 1 --2- 172.21.15.44:0/1013238970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc26806b260 0x7fc26806c7c0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fc260009e50 tx=0x7fc26000b330 comp rx=0 tx=0).stop 2024-09-13T18:36:29.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc267fff700 1 -- 172.21.15.44:0/1013238970 shutdown_connections 2024-09-13T18:36:29.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc267fff700 1 --2- 172.21.15.44:0/1013238970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc26806b260 0x7fc26806c7c0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc267fff700 1 --2- 172.21.15.44:0/1013238970 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2680cd940 0x7fc26806ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc267fff700 1 -- 172.21.15.44:0/1013238970 >> 172.21.15.44:0/1013238970 conn(0x7fc2680b2880 msgr2=0x7fc2680b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:29.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc267fff700 1 -- 172.21.15.44:0/1013238970 shutdown_connections 2024-09-13T18:36:29.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.079+0000 7fc267fff700 1 -- 172.21.15.44:0/1013238970 wait complete. 2024-09-13T18:36:29.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.083+0000 7fc267fff700 1 Processor -- start 2024-09-13T18:36:29.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.083+0000 7fc267fff700 1 -- start start 2024-09-13T18:36:29.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.083+0000 7fc267fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc26806b260 0x7fc26814f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.083+0000 7fc267fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2680b33a0 0x7fc26815bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.083+0000 7fc267fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2680cd940 0x7fc26815c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.083+0000 7fc267fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2680ad3e0 con 0x7fc26806b260 2024-09-13T18:36:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.083+0000 7fc267fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26814fec0 con 0x7fc2680cd940 2024-09-13T18:36:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.083+0000 7fc267fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2680ac760 con 0x7fc2680b33a0 2024-09-13T18:36:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.083+0000 7fc266ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc26806b260 0x7fc26814f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.083+0000 7fc266ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc26806b260 0x7fc26814f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47408/0 (socket says 172.21.15.44:47408) 2024-09-13T18:36:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.083+0000 7fc266ffd700 1 -- 172.21.15.44:0/14527863 learned_addr learned my addr 172.21.15.44:0/14527863 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.083+0000 7fc2677fe700 1 --2- 172.21.15.44:0/14527863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2680cd940 0x7fc26815c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.083+0000 7fc25e7fc700 1 --2- 172.21.15.44:0/14527863 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2680b33a0 0x7fc26815bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.087+0000 7fc2677fe700 1 -- 172.21.15.44:0/14527863 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2680b33a0 msgr2=0x7fc26815bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.087+0000 7fc2677fe700 1 --2- 172.21.15.44:0/14527863 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2680b33a0 0x7fc26815bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.087+0000 7fc2677fe700 1 -- 172.21.15.44:0/14527863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc26806b260 msgr2=0x7fc26814f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.087+0000 7fc2677fe700 1 --2- 172.21.15.44:0/14527863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc26806b260 0x7fc26814f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.087+0000 7fc2677fe700 1 -- 172.21.15.44:0/14527863 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc260009b30 con 0x7fc2680cd940 2024-09-13T18:36:29.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.087+0000 7fc2677fe700 1 --2- 172.21.15.44:0/14527863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2680cd940 0x7fc26815c440 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc268067ea0 tx=0x7fc260004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:29.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.087+0000 7fc25ffff700 1 -- 172.21.15.44:0/14527863 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260004780 con 0x7fc2680cd940 2024-09-13T18:36:29.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.087+0000 7fc25ffff700 1 -- 172.21.15.44:0/14527863 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2600092e0 con 0x7fc2680cd940 2024-09-13T18:36:29.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.087+0000 7fc267fff700 1 -- 172.21.15.44:0/14527863 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2680aca40 con 0x7fc2680cd940 2024-09-13T18:36:29.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.087+0000 7fc25ffff700 1 -- 172.21.15.44:0/14527863 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2600099b0 con 0x7fc2680cd940 2024-09-13T18:36:29.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.087+0000 7fc267fff700 1 -- 172.21.15.44:0/14527863 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2680ad000 con 0x7fc2680cd940 2024-09-13T18:36:29.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.087+0000 7fc267fff700 1 -- 172.21.15.44:0/14527863 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2680ad520 con 0x7fc2680cd940 2024-09-13T18:36:29.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.087+0000 7fc25ffff700 1 -- 172.21.15.44:0/14527863 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc26001c440 con 0x7fc2680cd940 2024-09-13T18:36:29.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.091+0000 7fc25ffff700 1 --2- 172.21.15.44:0/14527863 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc248066730 0x7fc248068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.091+0000 7fc25ffff700 1 -- 172.21.15.44:0/14527863 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc260085860 con 0x7fc2680cd940 2024-09-13T18:36:29.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.091+0000 7fc266ffd700 1 --2- 172.21.15.44:0/14527863 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc248066730 0x7fc248068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.091+0000 7fc266ffd700 1 --2- 172.21.15.44:0/14527863 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc248066730 0x7fc248068bf0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc2680b0050 tx=0x7fc258009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:29.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.099+0000 7fc25ffff700 1 -- 172.21.15.44:0/14527863 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc2600566f0 con 0x7fc2680cd940 2024-09-13T18:36:29.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.275+0000 7fc267fff700 1 -- 172.21.15.44:0/14527863 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc26806c7c0 con 0x7fc2680cd940 2024-09-13T18:36:29.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.275+0000 7fc25ffff700 1 -- 172.21.15.44:0/14527863 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc260056280 con 0x7fc2680cd940 2024-09-13T18:36:29.283 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-13T18:36:29.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.279+0000 7fc267fff700 1 -- 172.21.15.44:0/14527863 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc248066730 msgr2=0x7fc248068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.279+0000 7fc267fff700 1 --2- 172.21.15.44:0/14527863 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc248066730 0x7fc248068bf0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc2680b0050 tx=0x7fc258009040 comp rx=0 tx=0).stop 2024-09-13T18:36:29.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.279+0000 7fc267fff700 1 -- 172.21.15.44:0/14527863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2680cd940 msgr2=0x7fc26815c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.279+0000 7fc267fff700 1 --2- 172.21.15.44:0/14527863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2680cd940 0x7fc26815c440 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc268067ea0 tx=0x7fc260004af0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.279+0000 7fc267fff700 1 -- 172.21.15.44:0/14527863 shutdown_connections 2024-09-13T18:36:29.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.279+0000 7fc267fff700 1 --2- 172.21.15.44:0/14527863 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fc248066730 0x7fc248068bf0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.279+0000 7fc267fff700 1 --2- 172.21.15.44:0/14527863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2680cd940 0x7fc26815c440 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.279+0000 7fc267fff700 1 --2- 172.21.15.44:0/14527863 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2680b33a0 0x7fc26815bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.279+0000 7fc267fff700 1 --2- 172.21.15.44:0/14527863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc26806b260 0x7fc26814f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.279+0000 7fc267fff700 1 -- 172.21.15.44:0/14527863 >> 172.21.15.44:0/14527863 conn(0x7fc2680b2880 msgr2=0x7fc2680708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:29.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.279+0000 7fc267fff700 1 -- 172.21.15.44:0/14527863 shutdown_connections 2024-09-13T18:36:29.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.279+0000 7fc267fff700 1 -- 172.21.15.44:0/14527863 wait complete. 2024-09-13T18:36:29.299 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:36:29.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.415+0000 7fec61b78700 1 Processor -- start 2024-09-13T18:36:29.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.415+0000 7fec61b78700 1 -- start start 2024-09-13T18:36:29.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.415+0000 7fec61b78700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fec5c0d18f0 0x7fec5c0d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.415+0000 7fec61b78700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fec5c15d270 0x7fec5c0cd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.415+0000 7fec61b78700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5c15ad00 con 0x7fec5c06bc80 2024-09-13T18:36:29.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.415+0000 7fec61b78700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5c0d2210 con 0x7fec5c15d270 2024-09-13T18:36:29.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.415+0000 7fec61b78700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5c15d770 con 0x7fec5c0d18f0 2024-09-13T18:36:29.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.415+0000 7fec5bfff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fec5c06bc80 0x7fec5c06a860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49750/0 (socket says 172.21.15.44:49750) 2024-09-13T18:36:29.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.415+0000 7fec5bfff700 1 -- 172.21.15.44:0/1009594885 learned_addr learned my addr 172.21.15.44:0/1009594885 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:29.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.415+0000 7fec60b76700 1 --2- 172.21.15.44:0/1009594885 >> v2:172.21.15.99:3300/0 conn(0x7fec5c0d18f0 0x7fec5c0d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.415+0000 7fec61377700 1 --2- 172.21.15.44:0/1009594885 >> v2:172.21.15.44:3300/0 conn(0x7fec5c15d270 0x7fec5c0cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.419+0000 7fec5b7fe700 1 -- 172.21.15.44:0/1009594885 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1893934568 0 0) 0x7fec5c15ad00 con 0x7fec5c06bc80 2024-09-13T18:36:29.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.419+0000 7fec5b7fe700 1 -- 172.21.15.44:0/1009594885 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec440035d0 con 0x7fec5c06bc80 2024-09-13T18:36:29.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.419+0000 7fec60b76700 1 -- 172.21.15.44:0/1009594885 >> v2:172.21.15.44:3300/0 conn(0x7fec5c15d270 msgr2=0x7fec5c0cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:29.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.419+0000 7fec60b76700 1 --2- 172.21.15.44:0/1009594885 >> v2:172.21.15.44:3300/0 conn(0x7fec5c15d270 0x7fec5c0cd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.419+0000 7fec60b76700 1 -- 172.21.15.44:0/1009594885 >> v1:172.21.15.44:6789/0 conn(0x7fec5c06bc80 legacy=0x7fec5c06a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.419+0000 7fec60b76700 1 -- 172.21.15.44:0/1009594885 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c15da50 con 0x7fec5c0d18f0 2024-09-13T18:36:29.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.419+0000 7fec60b76700 1 --2- 172.21.15.44:0/1009594885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec5c0d18f0 0x7fec5c0d1cd0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fec5c06cf50 tx=0x7fec50009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae1a39be3f23aab2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:29.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.419+0000 7fec5b7fe700 1 -- 172.21.15.44:0/1009594885 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec50011830 con 0x7fec5c0d18f0 2024-09-13T18:36:29.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.419+0000 7fec5b7fe700 1 -- 172.21.15.44:0/1009594885 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec50011990 con 0x7fec5c0d18f0 2024-09-13T18:36:29.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.419+0000 7fec5b7fe700 1 -- 172.21.15.44:0/1009594885 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec50011d20 con 0x7fec5c0d18f0 2024-09-13T18:36:29.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.419+0000 7fec61b78700 1 -- 172.21.15.44:0/1009594885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec5c0d18f0 msgr2=0x7fec5c0d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.419+0000 7fec61b78700 1 --2- 172.21.15.44:0/1009594885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec5c0d18f0 0x7fec5c0d1cd0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fec5c06cf50 tx=0x7fec50009b30 comp rx=0 tx=0).stop 2024-09-13T18:36:29.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.419+0000 7fec61b78700 1 -- 172.21.15.44:0/1009594885 shutdown_connections 2024-09-13T18:36:29.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.419+0000 7fec61b78700 1 --2- 172.21.15.44:0/1009594885 >> v2:172.21.15.44:3300/0 conn(0x7fec5c15d270 0x7fec5c0cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.419+0000 7fec61b78700 1 --2- 172.21.15.44:0/1009594885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec5c0d18f0 0x7fec5c0d1cd0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.419+0000 7fec61b78700 1 -- 172.21.15.44:0/1009594885 >> 172.21.15.44:0/1009594885 conn(0x7fec5c0b4800 msgr2=0x7fec5c0b4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:29.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.419+0000 7fec61b78700 1 -- 172.21.15.44:0/1009594885 shutdown_connections 2024-09-13T18:36:29.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.419+0000 7fec61b78700 1 -- 172.21.15.44:0/1009594885 wait complete. 2024-09-13T18:36:29.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.419+0000 7fec61b78700 1 Processor -- start 2024-09-13T18:36:29.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec61b78700 1 -- start start 2024-09-13T18:36:29.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec61b78700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec5c06bc80 0x7fec5c156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec61b78700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fec5c0d18f0 0x7fec5c15bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec61b78700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec5c15d270 0x7fec5c0ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec61b78700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c15b840 con 0x7fec5c15d270 2024-09-13T18:36:29.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec61b78700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0ccc30 con 0x7fec5c06bc80 2024-09-13T18:36:29.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec61b78700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c15ac70 con 0x7fec5c0d18f0 2024-09-13T18:36:29.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec61377700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec5c15d270 0x7fec5c0ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec61377700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec5c15d270 0x7fec5c0ca8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47424/0 (socket says 172.21.15.44:47424) 2024-09-13T18:36:29.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec61377700 1 -- 172.21.15.44:0/2314225583 learned_addr learned my addr 172.21.15.44:0/2314225583 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:29.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec60b76700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec5c06bc80 0x7fec5c156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec5bfff700 1 --2- 172.21.15.44:0/2314225583 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fec5c0d18f0 0x7fec5c15bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec61377700 1 -- 172.21.15.44:0/2314225583 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fec5c0d18f0 msgr2=0x7fec5c15bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec61377700 1 --2- 172.21.15.44:0/2314225583 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fec5c0d18f0 0x7fec5c15bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec61377700 1 -- 172.21.15.44:0/2314225583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec5c06bc80 msgr2=0x7fec5c156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec61377700 1 --2- 172.21.15.44:0/2314225583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec5c06bc80 0x7fec5c156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec61377700 1 -- 172.21.15.44:0/2314225583 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec500094b0 con 0x7fec5c15d270 2024-09-13T18:36:29.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec5bfff700 1 --2- 172.21.15.44:0/2314225583 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fec5c0d18f0 0x7fec5c15bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:29.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec61377700 1 --2- 172.21.15.44:0/2314225583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec5c15d270 0x7fec5c0ca8f0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fec5400ec40 tx=0x7fec5400ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:29.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec597fa700 1 -- 172.21.15.44:0/2314225583 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5400cb10 con 0x7fec5c15d270 2024-09-13T18:36:29.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec597fa700 1 -- 172.21.15.44:0/2314225583 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5400f040 con 0x7fec5c15d270 2024-09-13T18:36:29.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec61b78700 1 -- 172.21.15.44:0/2314225583 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5c15af10 con 0x7fec5c15d270 2024-09-13T18:36:29.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec597fa700 1 -- 172.21.15.44:0/2314225583 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5400ceb0 con 0x7fec5c15d270 2024-09-13T18:36:29.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.423+0000 7fec61b78700 1 -- 172.21.15.44:0/2314225583 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5c15b4d0 con 0x7fec5c15d270 2024-09-13T18:36:29.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.427+0000 7fec61b78700 1 -- 172.21.15.44:0/2314225583 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5c06c060 con 0x7fec5c15d270 2024-09-13T18:36:29.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.427+0000 7fec597fa700 1 -- 172.21.15.44:0/2314225583 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fec54014480 con 0x7fec5c15d270 2024-09-13T18:36:29.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.427+0000 7fec597fa700 1 --2- 172.21.15.44:0/2314225583 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fec48066730 0x7fec48068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.427+0000 7fec597fa700 1 -- 172.21.15.44:0/2314225583 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec54084850 con 0x7fec5c15d270 2024-09-13T18:36:29.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.427+0000 7fec60b76700 1 --2- 172.21.15.44:0/2314225583 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fec48066730 0x7fec48068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.427+0000 7fec60b76700 1 --2- 172.21.15.44:0/2314225583 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fec48066730 0x7fec48068bf0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fec50000c00 tx=0x7fec50008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:29.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.431+0000 7fec597fa700 1 -- 172.21.15.44:0/2314225583 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fec54051bc0 con 0x7fec5c15d270 2024-09-13T18:36:29.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.603+0000 7fec61b78700 1 -- 172.21.15.44:0/2314225583 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fec5c0cf1a0 con 0x7fec5c15d270 2024-09-13T18:36:29.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.603+0000 7fec597fa700 1 -- 172.21.15.44:0/2314225583 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7fec540180a0 con 0x7fec5c15d270 2024-09-13T18:36:29.610 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-13T18:36:29.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.603+0000 7fec61b78700 1 -- 172.21.15.44:0/2314225583 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fec48066730 msgr2=0x7fec48068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.603+0000 7fec61b78700 1 --2- 172.21.15.44:0/2314225583 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fec48066730 0x7fec48068bf0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fec50000c00 tx=0x7fec50008030 comp rx=0 tx=0).stop 2024-09-13T18:36:29.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.603+0000 7fec61b78700 1 -- 172.21.15.44:0/2314225583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec5c15d270 msgr2=0x7fec5c0ca8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.603+0000 7fec61b78700 1 --2- 172.21.15.44:0/2314225583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec5c15d270 0x7fec5c0ca8f0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fec5400ec40 tx=0x7fec5400ef50 comp rx=0 tx=0).stop 2024-09-13T18:36:29.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.603+0000 7fec61b78700 1 -- 172.21.15.44:0/2314225583 shutdown_connections 2024-09-13T18:36:29.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.603+0000 7fec61b78700 1 --2- 172.21.15.44:0/2314225583 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fec48066730 0x7fec48068bf0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.603+0000 7fec61b78700 1 --2- 172.21.15.44:0/2314225583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec5c15d270 0x7fec5c0ca8f0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.603+0000 7fec61b78700 1 --2- 172.21.15.44:0/2314225583 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fec5c0d18f0 0x7fec5c15bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.603+0000 7fec61b78700 1 --2- 172.21.15.44:0/2314225583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec5c06bc80 0x7fec5c156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.603+0000 7fec61b78700 1 -- 172.21.15.44:0/2314225583 >> 172.21.15.44:0/2314225583 conn(0x7fec5c0b4800 msgr2=0x7fec5c0b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:29.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.603+0000 7fec61b78700 1 -- 172.21.15.44:0/2314225583 shutdown_connections 2024-09-13T18:36:29.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.603+0000 7fec61b78700 1 -- 172.21.15.44:0/2314225583 wait complete. 2024-09-13T18:36:29.626 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:36:29.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.731+0000 7f89458fa700 1 Processor -- start 2024-09-13T18:36:29.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.731+0000 7f89458fa700 1 -- start start 2024-09-13T18:36:29.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.731+0000 7f89458fa700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f89400b3ae0 0x7f894006a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.731+0000 7f89458fa700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f894006aaf0 0x7f894015e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.731+0000 7f89458fa700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f894013dcb0 con 0x7f894006bbf0 2024-09-13T18:36:29.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.731+0000 7f89458fa700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f894015be60 con 0x7f89400b3ae0 2024-09-13T18:36:29.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.731+0000 7f89458fa700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f894013ffd0 con 0x7f894006aaf0 2024-09-13T18:36:29.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.731+0000 7f893ffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f89400b3ae0 0x7f894006a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.731+0000 7f89448f8700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f894006bbf0 0x7f89400b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49756/0 (socket says 172.21.15.44:49756) 2024-09-13T18:36:29.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.731+0000 7f893ffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f89400b3ae0 0x7f894006a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47430/0 (socket says 172.21.15.44:47430) 2024-09-13T18:36:29.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.731+0000 7f89448f8700 1 -- 172.21.15.44:0/2886360432 learned_addr learned my addr 172.21.15.44:0/2886360432 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:29.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.731+0000 7f89450f9700 1 --2- 172.21.15.44:0/2886360432 >> v2:172.21.15.99:3300/0 conn(0x7f894006aaf0 0x7f894015e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.731+0000 7f893ffff700 1 -- 172.21.15.44:0/2886360432 >> v2:172.21.15.99:3300/0 conn(0x7f894006aaf0 msgr2=0x7f894015e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:29.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.731+0000 7f893ffff700 1 --2- 172.21.15.44:0/2886360432 >> v2:172.21.15.99:3300/0 conn(0x7f894006aaf0 0x7f894015e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.731+0000 7f893ffff700 1 -- 172.21.15.44:0/2886360432 >> v1:172.21.15.44:6789/0 conn(0x7f894006bbf0 legacy=0x7f89400b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.731+0000 7f893ffff700 1 -- 172.21.15.44:0/2886360432 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8940140220 con 0x7f89400b3ae0 2024-09-13T18:36:29.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.731+0000 7f893ffff700 1 --2- 172.21.15.44:0/2886360432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89400b3ae0 0x7f894006a5b0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f894015e380 tx=0x7f8930009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974c54d7cb7fc41 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:29.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.731+0000 7f893f7fe700 1 -- 172.21.15.44:0/2886360432 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930011830 con 0x7f89400b3ae0 2024-09-13T18:36:29.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.731+0000 7f893f7fe700 1 -- 172.21.15.44:0/2886360432 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8930011990 con 0x7f89400b3ae0 2024-09-13T18:36:29.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.731+0000 7f893f7fe700 1 -- 172.21.15.44:0/2886360432 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930011d40 con 0x7f89400b3ae0 2024-09-13T18:36:29.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.735+0000 7f89458fa700 1 -- 172.21.15.44:0/2886360432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89400b3ae0 msgr2=0x7f894006a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.735+0000 7f89458fa700 1 --2- 172.21.15.44:0/2886360432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89400b3ae0 0x7f894006a5b0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f894015e380 tx=0x7f8930009b30 comp rx=0 tx=0).stop 2024-09-13T18:36:29.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.735+0000 7f89458fa700 1 -- 172.21.15.44:0/2886360432 shutdown_connections 2024-09-13T18:36:29.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.735+0000 7f89458fa700 1 --2- 172.21.15.44:0/2886360432 >> v2:172.21.15.99:3300/0 conn(0x7f894006aaf0 0x7f894015e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.735+0000 7f89458fa700 1 --2- 172.21.15.44:0/2886360432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89400b3ae0 0x7f894006a5b0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.735+0000 7f89458fa700 1 -- 172.21.15.44:0/2886360432 >> 172.21.15.44:0/2886360432 conn(0x7f89400b0f00 msgr2=0x7f89400b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:29.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.735+0000 7f89458fa700 1 -- 172.21.15.44:0/2886360432 shutdown_connections 2024-09-13T18:36:29.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.735+0000 7f89458fa700 1 -- 172.21.15.44:0/2886360432 wait complete. 2024-09-13T18:36:29.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.735+0000 7f89458fa700 1 Processor -- start 2024-09-13T18:36:29.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.739+0000 7f89458fa700 1 -- start start 2024-09-13T18:36:29.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.739+0000 7f89458fa700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f894006aaf0 0x7f894012ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.739+0000 7f89458fa700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f894006bbf0 0x7f894013d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.739+0000 7f89458fa700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89400b3ae0 0x7f894013f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.739+0000 7f89458fa700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89400cc090 con 0x7f89400b3ae0 2024-09-13T18:36:29.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.739+0000 7f89458fa700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89401324b0 con 0x7f894006bbf0 2024-09-13T18:36:29.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.739+0000 7f89458fa700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89400cbad0 con 0x7f894006aaf0 2024-09-13T18:36:29.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.739+0000 7f89450f9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89400b3ae0 0x7f894013f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.739+0000 7f89450f9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89400b3ae0 0x7f894013f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47440/0 (socket says 172.21.15.44:47440) 2024-09-13T18:36:29.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.739+0000 7f89450f9700 1 -- 172.21.15.44:0/3990616175 learned_addr learned my addr 172.21.15.44:0/3990616175 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:29.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.739+0000 7f893ffff700 1 --2- 172.21.15.44:0/3990616175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f894006bbf0 0x7f894013d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.739+0000 7f89448f8700 1 --2- 172.21.15.44:0/3990616175 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f894006aaf0 0x7f894012ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.739+0000 7f89450f9700 1 -- 172.21.15.44:0/3990616175 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f894006aaf0 msgr2=0x7f894012ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.739+0000 7f89450f9700 1 --2- 172.21.15.44:0/3990616175 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f894006aaf0 0x7f894012ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.739+0000 7f89450f9700 1 -- 172.21.15.44:0/3990616175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f894006bbf0 msgr2=0x7f894013d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.739+0000 7f89450f9700 1 --2- 172.21.15.44:0/3990616175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f894006bbf0 0x7f894013d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.739+0000 7f89450f9700 1 -- 172.21.15.44:0/3990616175 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89300094b0 con 0x7f89400b3ae0 2024-09-13T18:36:29.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.739+0000 7f89450f9700 1 --2- 172.21.15.44:0/3990616175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89400b3ae0 0x7f894013f0f0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f8938007e70 tx=0x7f893800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:29.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.739+0000 7f893d7fa700 1 -- 172.21.15.44:0/3990616175 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893800ed30 con 0x7f89400b3ae0 2024-09-13T18:36:29.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.739+0000 7f893d7fa700 1 -- 172.21.15.44:0/3990616175 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893800eeb0 con 0x7f89400b3ae0 2024-09-13T18:36:29.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.739+0000 7f89458fa700 1 -- 172.21.15.44:0/3990616175 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89400cbdb0 con 0x7f89400b3ae0 2024-09-13T18:36:29.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.739+0000 7f893d7fa700 1 -- 172.21.15.44:0/3990616175 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8938014640 con 0x7f89400b3ae0 2024-09-13T18:36:29.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.739+0000 7f89458fa700 1 -- 172.21.15.44:0/3990616175 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89400ce150 con 0x7f89400b3ae0 2024-09-13T18:36:29.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.743+0000 7f89458fa700 1 -- 172.21.15.44:0/3990616175 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89400ce3d0 con 0x7f89400b3ae0 2024-09-13T18:36:29.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.743+0000 7f893d7fa700 1 -- 172.21.15.44:0/3990616175 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f89380147a0 con 0x7f89400b3ae0 2024-09-13T18:36:29.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.743+0000 7f893d7fa700 1 --2- 172.21.15.44:0/3990616175 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f892c066730 0x7f892c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.743+0000 7f893d7fa700 1 -- 172.21.15.44:0/3990616175 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89380848d0 con 0x7f89400b3ae0 2024-09-13T18:36:29.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.743+0000 7f89448f8700 1 --2- 172.21.15.44:0/3990616175 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f892c066730 0x7f892c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.747+0000 7f89448f8700 1 --2- 172.21.15.44:0/3990616175 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f892c066730 0x7f892c068bf0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8934005930 tx=0x7f8934009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:29.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.751+0000 7f893d7fa700 1 -- 172.21.15.44:0/3990616175 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8938051c30 con 0x7f89400b3ae0 2024-09-13T18:36:29.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.963+0000 7f89458fa700 1 -- 172.21.15.44:0/3990616175 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f894006af40 con 0x7f89400b3ae0 2024-09-13T18:36:29.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.963+0000 7f893d7fa700 1 -- 172.21.15.44:0/3990616175 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4730 (secure 0 0 0) 0x7f8938055250 con 0x7f89400b3ae0 2024-09-13T18:36:29.973 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:29.973 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":78,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7121,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4127573228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4127573228},{"type":"v1","addr":"172.21.15.99:6836","nonce":4127573228}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":7984,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3372982355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3372982355},{"type":"v1","addr":"172.21.15.99:6837","nonce":3372982355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/48969097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":48969097},{"type":"v1","addr":"172.21.15.44:6833","nonce":48969097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:36:17.641055+0000","modified":"2024-09-13T18:36:20.660692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8193":{"gid":8193,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/1527182738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1527182738},{"type":"v1","addr":"172.21.15.44:6835","nonce":1527182738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:36:29.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.967+0000 7f89458fa700 1 -- 172.21.15.44:0/3990616175 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f892c066730 msgr2=0x7f892c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.967+0000 7f89458fa700 1 --2- 172.21.15.44:0/3990616175 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f892c066730 0x7f892c068bf0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8934005930 tx=0x7f8934009040 comp rx=0 tx=0).stop 2024-09-13T18:36:29.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.967+0000 7f89458fa700 1 -- 172.21.15.44:0/3990616175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89400b3ae0 msgr2=0x7f894013f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.967+0000 7f89458fa700 1 --2- 172.21.15.44:0/3990616175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89400b3ae0 0x7f894013f0f0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f8938007e70 tx=0x7f893800e3c0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.967+0000 7f89458fa700 1 -- 172.21.15.44:0/3990616175 shutdown_connections 2024-09-13T18:36:29.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.967+0000 7f89458fa700 1 --2- 172.21.15.44:0/3990616175 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f892c066730 0x7f892c068bf0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.967+0000 7f89458fa700 1 --2- 172.21.15.44:0/3990616175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89400b3ae0 0x7f894013f0f0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.967+0000 7f89458fa700 1 --2- 172.21.15.44:0/3990616175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f894006bbf0 0x7f894013d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.967+0000 7f89458fa700 1 --2- 172.21.15.44:0/3990616175 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f894006aaf0 0x7f894012ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.967+0000 7f89458fa700 1 -- 172.21.15.44:0/3990616175 >> 172.21.15.44:0/3990616175 conn(0x7f89400b0f00 msgr2=0x7f894013e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:29.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.967+0000 7f89458fa700 1 -- 172.21.15.44:0/3990616175 shutdown_connections 2024-09-13T18:36:29.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:29.967+0000 7f89458fa700 1 -- 172.21.15.44:0/3990616175 wait complete. 2024-09-13T18:36:29.977 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 78 2024-09-13T18:36:29.989 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:30.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.099+0000 7f16ff19b700 1 Processor -- start 2024-09-13T18:36:30.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.099+0000 7f16ff19b700 1 -- start start 2024-09-13T18:36:30.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.099+0000 7f16ff19b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f16f8159720 0x7f16f806cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.099+0000 7f16ff19b700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f806aed0 con 0x7f16f806aa90 2024-09-13T18:36:30.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.099+0000 7f16ff19b700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f806d690 con 0x7f16f80b3ae0 2024-09-13T18:36:30.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.099+0000 7f16ff19b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f80cbfe0 con 0x7f16f8159720 2024-09-13T18:36:30.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.099+0000 7f16fe199700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f16f8159720 0x7f16f806cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.099+0000 7f16fd998700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f16f806aa90 0x7f16f80b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49764/0 (socket says 172.21.15.44:49764) 2024-09-13T18:36:30.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.099+0000 7f16fe99a700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f16f80b3ae0 0x7f16f80ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:60910/0 (socket says 172.21.15.44:60910) 2024-09-13T18:36:30.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.099+0000 7f16fe99a700 1 -- 172.21.15.44:0/1724570154 learned_addr learned my addr 172.21.15.44:0/1724570154 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:30.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.103+0000 7f16fe199700 1 -- 172.21.15.44:0/1724570154 >> v1:172.21.15.99:6789/0 conn(0x7f16f80b3ae0 legacy=0x7f16f80ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.103+0000 7f16fe199700 1 -- 172.21.15.44:0/1724570154 >> v1:172.21.15.44:6789/0 conn(0x7f16f806aa90 legacy=0x7f16f80b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.103+0000 7f16fe199700 1 -- 172.21.15.44:0/1724570154 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f80cc2c0 con 0x7f16f8159720 2024-09-13T18:36:30.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.103+0000 7f16fe199700 1 --2- 172.21.15.44:0/1724570154 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f16f8159720 0x7f16f806cf90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f16f4009880 tx=0x7f16f4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1251ac711714b9a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:30.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.103+0000 7f16fd197700 1 -- 172.21.15.44:0/1724570154 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f4011830 con 0x7f16f8159720 2024-09-13T18:36:30.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.103+0000 7f16fd197700 1 -- 172.21.15.44:0/1724570154 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f4011990 con 0x7f16f8159720 2024-09-13T18:36:30.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.103+0000 7f16fd197700 1 -- 172.21.15.44:0/1724570154 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f4011d20 con 0x7f16f8159720 2024-09-13T18:36:30.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.103+0000 7f16ff19b700 1 -- 172.21.15.44:0/1724570154 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f16f8159720 msgr2=0x7f16f806cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.103+0000 7f16ff19b700 1 --2- 172.21.15.44:0/1724570154 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f16f8159720 0x7f16f806cf90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f16f4009880 tx=0x7f16f4009b90 comp rx=0 tx=0).stop 2024-09-13T18:36:30.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.103+0000 7f16ff19b700 1 -- 172.21.15.44:0/1724570154 shutdown_connections 2024-09-13T18:36:30.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.103+0000 7f16ff19b700 1 --2- 172.21.15.44:0/1724570154 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f16f8159720 0x7f16f806cf90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.103+0000 7f16ff19b700 1 -- 172.21.15.44:0/1724570154 >> 172.21.15.44:0/1724570154 conn(0x7f16f80b0f00 msgr2=0x7f16f80b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:30.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.103+0000 7f16ff19b700 1 -- 172.21.15.44:0/1724570154 shutdown_connections 2024-09-13T18:36:30.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.103+0000 7f16ff19b700 1 -- 172.21.15.44:0/1724570154 wait complete. 2024-09-13T18:36:30.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.103+0000 7f16ff19b700 1 Processor -- start 2024-09-13T18:36:30.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.103+0000 7f16ff19b700 1 -- start start 2024-09-13T18:36:30.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16ff19b700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f16f806aa90 0x7f16f8142290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16ff19b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16f80b3ae0 0x7f16f8156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16ff19b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16f8159720 0x7f16f81570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16ff19b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f815b5a0 con 0x7f16f80b3ae0 2024-09-13T18:36:30.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16ff19b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f815a990 con 0x7f16f8159720 2024-09-13T18:36:30.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16ff19b700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f815ac70 con 0x7f16f806aa90 2024-09-13T18:36:30.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16fd998700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16f80b3ae0 0x7f16f8156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16fd998700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16f80b3ae0 0x7f16f8156b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47452/0 (socket says 172.21.15.44:47452) 2024-09-13T18:36:30.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16fd998700 1 -- 172.21.15.44:0/2850733308 learned_addr learned my addr 172.21.15.44:0/2850733308 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:30.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16fe99a700 1 --2- 172.21.15.44:0/2850733308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16f8159720 0x7f16f81570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16fe199700 1 --2- 172.21.15.44:0/2850733308 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f16f806aa90 0x7f16f8142290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16fd998700 1 -- 172.21.15.44:0/2850733308 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f16f806aa90 msgr2=0x7f16f8142290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16fd998700 1 --2- 172.21.15.44:0/2850733308 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f16f806aa90 0x7f16f8142290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16fd998700 1 -- 172.21.15.44:0/2850733308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16f8159720 msgr2=0x7f16f81570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16fd998700 1 --2- 172.21.15.44:0/2850733308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16f8159720 0x7f16f81570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16fd998700 1 -- 172.21.15.44:0/2850733308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f40094b0 con 0x7f16f80b3ae0 2024-09-13T18:36:30.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16fd998700 1 --2- 172.21.15.44:0/2850733308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16f80b3ae0 0x7f16f8156b80 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00c6b0 tx=0x7f16ec00ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:30.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16eaffd700 1 -- 172.21.15.44:0/2850733308 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec005cd0 con 0x7f16f80b3ae0 2024-09-13T18:36:30.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16ff19b700 1 -- 172.21.15.44:0/2850733308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f815af50 con 0x7f16f80b3ae0 2024-09-13T18:36:30.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16eaffd700 1 -- 172.21.15.44:0/2850733308 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ec005e30 con 0x7f16f80b3ae0 2024-09-13T18:36:30.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16ff19b700 1 -- 172.21.15.44:0/2850733308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f81427d0 con 0x7f16f80b3ae0 2024-09-13T18:36:30.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16eaffd700 1 -- 172.21.15.44:0/2850733308 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec0072d0 con 0x7f16f80b3ae0 2024-09-13T18:36:30.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16ff19b700 1 -- 172.21.15.44:0/2850733308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f815b710 con 0x7f16f80b3ae0 2024-09-13T18:36:30.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.107+0000 7f16eaffd700 1 -- 172.21.15.44:0/2850733308 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f16ec007430 con 0x7f16f80b3ae0 2024-09-13T18:36:30.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.111+0000 7f16eaffd700 1 --2- 172.21.15.44:0/2850733308 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f16dc066730 0x7f16dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.111+0000 7f16eaffd700 1 -- 172.21.15.44:0/2850733308 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16ec083520 con 0x7f16f80b3ae0 2024-09-13T18:36:30.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.111+0000 7f16fe199700 1 --2- 172.21.15.44:0/2850733308 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f16dc066730 0x7f16dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.111+0000 7f16fe199700 1 --2- 172.21.15.44:0/2850733308 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f16dc066730 0x7f16dc068bf0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f16f4000c00 tx=0x7f16f4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:30.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.115+0000 7f16eaffd700 1 -- 172.21.15.44:0/2850733308 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f16ec050950 con 0x7f16f80b3ae0 2024-09-13T18:36:30.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.295+0000 7f16ff19b700 1 -- 172.21.15.44:0/2850733308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16f815ce00 con 0x7f16f80b3ae0 2024-09-13T18:36:30.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.295+0000 7f16eaffd700 1 -- 172.21.15.44:0/2850733308 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16500 (secure 0 0 0) 0x7f16ec053f70 con 0x7f16f80b3ae0 2024-09-13T18:36:30.304 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:30.304 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":90,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:36:18.647007+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:36:15.982954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T18:36:16.628264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:30.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.299+0000 7f16ff19b700 1 -- 172.21.15.44:0/2850733308 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f16dc066730 msgr2=0x7f16dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.299+0000 7f16ff19b700 1 --2- 172.21.15.44:0/2850733308 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f16dc066730 0x7f16dc068bf0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f16f4000c00 tx=0x7f16f4008030 comp rx=0 tx=0).stop 2024-09-13T18:36:30.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.299+0000 7f16ff19b700 1 -- 172.21.15.44:0/2850733308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16f80b3ae0 msgr2=0x7f16f8156b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.299+0000 7f16ff19b700 1 --2- 172.21.15.44:0/2850733308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16f80b3ae0 0x7f16f8156b80 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00c6b0 tx=0x7f16ec00ca70 comp rx=0 tx=0).stop 2024-09-13T18:36:30.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.299+0000 7f16ff19b700 1 -- 172.21.15.44:0/2850733308 shutdown_connections 2024-09-13T18:36:30.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.299+0000 7f16ff19b700 1 --2- 172.21.15.44:0/2850733308 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f16dc066730 0x7f16dc068bf0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.299+0000 7f16ff19b700 1 --2- 172.21.15.44:0/2850733308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16f8159720 0x7f16f81570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.299+0000 7f16ff19b700 1 --2- 172.21.15.44:0/2850733308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16f80b3ae0 0x7f16f8156b80 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.299+0000 7f16ff19b700 1 --2- 172.21.15.44:0/2850733308 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f16f806aa90 0x7f16f8142290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.299+0000 7f16ff19b700 1 -- 172.21.15.44:0/2850733308 >> 172.21.15.44:0/2850733308 conn(0x7f16f80b0f00 msgr2=0x7f16f80b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:30.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.299+0000 7f16ff19b700 1 -- 172.21.15.44:0/2850733308 shutdown_connections 2024-09-13T18:36:30.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.299+0000 7f16ff19b700 1 -- 172.21.15.44:0/2850733308 wait complete. 2024-09-13T18:36:30.320 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:36:30.320 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:36:30.343 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:36:30.346 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:36:30.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.431+0000 7f7e49988700 1 Processor -- start 2024-09-13T18:36:30.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e49988700 1 -- start start 2024-09-13T18:36:30.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e49988700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7e4406fb30 0x7f7e440adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e49988700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e4406a780 con 0x7f7e4406bb90 2024-09-13T18:36:30.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e49988700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e44159470 con 0x7f7e4406d150 2024-09-13T18:36:30.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e49988700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e4406cd30 con 0x7f7e4406fb30 2024-09-13T18:36:30.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e43fff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7e4406bb90 0x7f7e440cbf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49774/0 (socket says 172.21.15.44:49774) 2024-09-13T18:36:30.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e43fff700 1 -- 172.21.15.44:0/835134485 learned_addr learned my addr 172.21.15.44:0/835134485 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:30.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e48986700 1 --2- 172.21.15.44:0/835134485 >> v2:172.21.15.44:3300/0 conn(0x7f7e4406fb30 0x7f7e440adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e437fe700 1 -- 172.21.15.44:0/835134485 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269628291 0 0) 0x7f7e4406a780 con 0x7f7e4406bb90 2024-09-13T18:36:30.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e437fe700 1 -- 172.21.15.44:0/835134485 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e340035d0 con 0x7f7e4406bb90 2024-09-13T18:36:30.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e48986700 1 -- 172.21.15.44:0/835134485 >> v1:172.21.15.99:6789/0 conn(0x7f7e4406d150 legacy=0x7f7e4406d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e437fe700 1 -- 172.21.15.44:0/835134485 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127610676 0 0) 0x7f7e44159470 con 0x7f7e4406d150 2024-09-13T18:36:30.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e48986700 1 -- 172.21.15.44:0/835134485 >> v1:172.21.15.44:6789/0 conn(0x7f7e4406bb90 legacy=0x7f7e440cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e48986700 1 -- 172.21.15.44:0/835134485 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e440cc610 con 0x7f7e4406fb30 2024-09-13T18:36:30.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e48986700 1 --2- 172.21.15.44:0/835134485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e4406fb30 0x7f7e440adbd0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009850 tx=0x7f7e38009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ed8abde6aa5e86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:30.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e437fe700 1 -- 172.21.15.44:0/835134485 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38011830 con 0x7f7e4406fb30 2024-09-13T18:36:30.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e437fe700 1 -- 172.21.15.44:0/835134485 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e38011990 con 0x7f7e4406fb30 2024-09-13T18:36:30.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e437fe700 1 -- 172.21.15.44:0/835134485 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38011d40 con 0x7f7e4406fb30 2024-09-13T18:36:30.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e49988700 1 -- 172.21.15.44:0/835134485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e4406fb30 msgr2=0x7f7e440adbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e49988700 1 --2- 172.21.15.44:0/835134485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e4406fb30 0x7f7e440adbd0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009850 tx=0x7f7e38009b60 comp rx=0 tx=0).stop 2024-09-13T18:36:30.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e49988700 1 -- 172.21.15.44:0/835134485 shutdown_connections 2024-09-13T18:36:30.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e49988700 1 --2- 172.21.15.44:0/835134485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e4406fb30 0x7f7e440adbd0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e49988700 1 -- 172.21.15.44:0/835134485 >> 172.21.15.44:0/835134485 conn(0x7f7e440b0f00 msgr2=0x7f7e440b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:30.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e49988700 1 -- 172.21.15.44:0/835134485 shutdown_connections 2024-09-13T18:36:30.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.435+0000 7f7e49988700 1 -- 172.21.15.44:0/835134485 wait complete. 2024-09-13T18:36:30.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e49988700 1 Processor -- start 2024-09-13T18:36:30.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e49988700 1 -- start start 2024-09-13T18:36:30.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e49988700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e4406bb90 0x7f7e44145260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e49988700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e4406d150 0x7f7e441380f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e49988700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e4406fb30 0x7f7e4414ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e49988700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4414bb80 con 0x7f7e4406bb90 2024-09-13T18:36:30.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e49988700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4414be60 con 0x7f7e4406d150 2024-09-13T18:36:30.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e49988700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e441f0710 con 0x7f7e4406fb30 2024-09-13T18:36:30.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e48986700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e4406bb90 0x7f7e44145260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e48986700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e4406bb90 0x7f7e44145260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47466/0 (socket says 172.21.15.44:47466) 2024-09-13T18:36:30.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e48986700 1 -- 172.21.15.44:0/2225080045 learned_addr learned my addr 172.21.15.44:0/2225080045 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:30.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e43fff700 1 --2- 172.21.15.44:0/2225080045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e4406d150 0x7f7e441380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e49187700 1 --2- 172.21.15.44:0/2225080045 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e4406fb30 0x7f7e4414ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e48986700 1 -- 172.21.15.44:0/2225080045 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e4406fb30 msgr2=0x7f7e4414ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e48986700 1 --2- 172.21.15.44:0/2225080045 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e4406fb30 0x7f7e4414ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e48986700 1 -- 172.21.15.44:0/2225080045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e4406d150 msgr2=0x7f7e441380f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e48986700 1 --2- 172.21.15.44:0/2225080045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e4406d150 0x7f7e441380f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e48986700 1 -- 172.21.15.44:0/2225080045 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e380094b0 con 0x7f7e4406bb90 2024-09-13T18:36:30.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e48986700 1 --2- 172.21.15.44:0/2225080045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e4406bb90 0x7f7e44145260 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f7e380090b0 tx=0x7f7e38004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:30.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e417fa700 1 -- 172.21.15.44:0/2225080045 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38019a00 con 0x7f7e4406bb90 2024-09-13T18:36:30.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e417fa700 1 -- 172.21.15.44:0/2225080045 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3801e070 con 0x7f7e4406bb90 2024-09-13T18:36:30.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e49988700 1 -- 172.21.15.44:0/2225080045 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e441f09f0 con 0x7f7e4406bb90 2024-09-13T18:36:30.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e417fa700 1 -- 172.21.15.44:0/2225080045 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38019dc0 con 0x7f7e4406bb90 2024-09-13T18:36:30.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.439+0000 7f7e49988700 1 -- 172.21.15.44:0/2225080045 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e441f0390 con 0x7f7e4406bb90 2024-09-13T18:36:30.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.443+0000 7f7e49988700 1 -- 172.21.15.44:0/2225080045 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e441f0580 con 0x7f7e4406bb90 2024-09-13T18:36:30.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.443+0000 7f7e417fa700 1 -- 172.21.15.44:0/2225080045 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7e3802d450 con 0x7f7e4406bb90 2024-09-13T18:36:30.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.443+0000 7f7e417fa700 1 --2- 172.21.15.44:0/2225080045 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e28066730 0x7f7e28068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.443+0000 7f7e417fa700 1 -- 172.21.15.44:0/2225080045 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e380850d0 con 0x7f7e4406bb90 2024-09-13T18:36:30.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.443+0000 7f7e43fff700 1 --2- 172.21.15.44:0/2225080045 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e28066730 0x7f7e28068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.443+0000 7f7e43fff700 1 --2- 172.21.15.44:0/2225080045 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e28066730 0x7f7e28068bf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7e4415c2c0 tx=0x7f7e30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:30.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.451+0000 7f7e417fa700 1 -- 172.21.15.44:0/2225080045 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7e38052450 con 0x7f7e4406bb90 2024-09-13T18:36:30.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.659+0000 7f7e49988700 1 -- 172.21.15.44:0/2225080045 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e440cbf00 con 0x7f7e4406bb90 2024-09-13T18:36:30.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.663+0000 7f7e417fa700 1 -- 172.21.15.44:0/2225080045 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4730 (secure 0 0 0) 0x7f7e3805ae60 con 0x7f7e4406bb90 2024-09-13T18:36:30.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:30.670 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":78,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7121,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4127573228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4127573228},{"type":"v1","addr":"172.21.15.99:6836","nonce":4127573228}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":7984,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3372982355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3372982355},{"type":"v1","addr":"172.21.15.99:6837","nonce":3372982355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/48969097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":48969097},{"type":"v1","addr":"172.21.15.44:6833","nonce":48969097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:36:17.641055+0000","modified":"2024-09-13T18:36:20.660692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8193":{"gid":8193,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/1527182738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1527182738},{"type":"v1","addr":"172.21.15.44:6835","nonce":1527182738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:36:30.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.663+0000 7f7e49988700 1 -- 172.21.15.44:0/2225080045 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e28066730 msgr2=0x7f7e28068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.663+0000 7f7e49988700 1 --2- 172.21.15.44:0/2225080045 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e28066730 0x7f7e28068bf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7e4415c2c0 tx=0x7f7e30009040 comp rx=0 tx=0).stop 2024-09-13T18:36:30.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.663+0000 7f7e49988700 1 -- 172.21.15.44:0/2225080045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e4406bb90 msgr2=0x7f7e44145260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.663+0000 7f7e49988700 1 --2- 172.21.15.44:0/2225080045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e4406bb90 0x7f7e44145260 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f7e380090b0 tx=0x7f7e38004770 comp rx=0 tx=0).stop 2024-09-13T18:36:30.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.663+0000 7f7e49988700 1 -- 172.21.15.44:0/2225080045 shutdown_connections 2024-09-13T18:36:30.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.663+0000 7f7e49988700 1 --2- 172.21.15.44:0/2225080045 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f7e28066730 0x7f7e28068bf0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.663+0000 7f7e49988700 1 --2- 172.21.15.44:0/2225080045 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e4406fb30 0x7f7e4414ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.663+0000 7f7e49988700 1 --2- 172.21.15.44:0/2225080045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e4406d150 0x7f7e441380f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.663+0000 7f7e49988700 1 --2- 172.21.15.44:0/2225080045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e4406bb90 0x7f7e44145260 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.663+0000 7f7e49988700 1 -- 172.21.15.44:0/2225080045 >> 172.21.15.44:0/2225080045 conn(0x7f7e440b0f00 msgr2=0x7f7e440b24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:30.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.663+0000 7f7e49988700 1 -- 172.21.15.44:0/2225080045 shutdown_connections 2024-09-13T18:36:30.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.663+0000 7f7e49988700 1 -- 172.21.15.44:0/2225080045 wait complete. 2024-09-13T18:36:30.673 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 78 2024-09-13T18:36:30.684 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:36:30.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6acd5a3700 1 Processor -- start 2024-09-13T18:36:30.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6acd5a3700 1 -- start start 2024-09-13T18:36:30.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6acd5a3700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6ac80b3ae0 0x7f6ac8165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6acd5a3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ac8161290 0x7f6ac8161700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6acd5a3700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac8071f30 con 0x7f6ac8160eb0 2024-09-13T18:36:30.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6acd5a3700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac81622e0 con 0x7f6ac80b3ae0 2024-09-13T18:36:30.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6acd5a3700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac8162000 con 0x7f6ac8161290 2024-09-13T18:36:30.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6ac77fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6ac80b3ae0 0x7f6ac8165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6ac77fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6ac80b3ae0 0x7f6ac8165590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47476/0 (socket says 172.21.15.44:47476) 2024-09-13T18:36:30.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6ac77fe700 1 -- 172.21.15.44:0/2737088092 learned_addr learned my addr 172.21.15.44:0/2737088092 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:30.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6accda2700 1 --2- 172.21.15.44:0/2737088092 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ac8161290 0x7f6ac8161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6ac77fe700 1 -- 172.21.15.44:0/2737088092 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ac8161290 msgr2=0x7f6ac8161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:30.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6ac77fe700 1 --2- 172.21.15.44:0/2737088092 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ac8161290 0x7f6ac8161700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6ac77fe700 1 -- 172.21.15.44:0/2737088092 >> v1:172.21.15.99:6789/0 conn(0x7f6ac8160eb0 legacy=0x7f6ac80b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6ac77fe700 1 -- 172.21.15.44:0/2737088092 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac8164ab0 con 0x7f6ac80b3ae0 2024-09-13T18:36:30.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6ac77fe700 1 --2- 172.21.15.44:0/2737088092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac80b3ae0 0x7f6ac8165590 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8009910 tx=0x7f6ab8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa8289e7367ab19 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:30.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6ac6ffd700 1 -- 172.21.15.44:0/2737088092 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab800ba60 con 0x7f6ac80b3ae0 2024-09-13T18:36:30.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6ac6ffd700 1 -- 172.21.15.44:0/2737088092 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab800bbc0 con 0x7f6ac80b3ae0 2024-09-13T18:36:30.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6ac6ffd700 1 -- 172.21.15.44:0/2737088092 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8009e60 con 0x7f6ac80b3ae0 2024-09-13T18:36:30.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6acd5a3700 1 -- 172.21.15.44:0/2737088092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac80b3ae0 msgr2=0x7f6ac8165590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6acd5a3700 1 --2- 172.21.15.44:0/2737088092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac80b3ae0 0x7f6ac8165590 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8009910 tx=0x7f6ab8009c20 comp rx=0 tx=0).stop 2024-09-13T18:36:30.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6acd5a3700 1 -- 172.21.15.44:0/2737088092 shutdown_connections 2024-09-13T18:36:30.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6acd5a3700 1 --2- 172.21.15.44:0/2737088092 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ac8161290 0x7f6ac8161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6acd5a3700 1 --2- 172.21.15.44:0/2737088092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac80b3ae0 0x7f6ac8165590 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6acd5a3700 1 -- 172.21.15.44:0/2737088092 >> 172.21.15.44:0/2737088092 conn(0x7f6ac80b0f00 msgr2=0x7f6ac80b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:30.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6acd5a3700 1 -- 172.21.15.44:0/2737088092 shutdown_connections 2024-09-13T18:36:30.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.791+0000 7f6acd5a3700 1 -- 172.21.15.44:0/2737088092 wait complete. 2024-09-13T18:36:30.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.795+0000 7f6acd5a3700 1 Processor -- start 2024-09-13T18:36:30.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.795+0000 7f6acd5a3700 1 -- start start 2024-09-13T18:36:30.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.795+0000 7f6acd5a3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac80b3ae0 0x7f6ac80b2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.795+0000 7f6acd5a3700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ac8160eb0 0x7f6ac81f6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.795+0000 7f6acd5a3700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ac8161290 0x7f6ac815f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.795+0000 7f6acd5a3700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac806d630 con 0x7f6ac80b3ae0 2024-09-13T18:36:30.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.795+0000 7f6acd5a3700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac815a3d0 con 0x7f6ac8160eb0 2024-09-13T18:36:30.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.795+0000 7f6acd5a3700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac80b2e60 con 0x7f6ac8161290 2024-09-13T18:36:30.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.795+0000 7f6ac7fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac80b3ae0 0x7f6ac80b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.795+0000 7f6ac7fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac80b3ae0 0x7f6ac80b2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47480/0 (socket says 172.21.15.44:47480) 2024-09-13T18:36:30.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.795+0000 7f6ac7fff700 1 -- 172.21.15.44:0/2931385577 learned_addr learned my addr 172.21.15.44:0/2931385577 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:30.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.795+0000 7f6ac77fe700 1 --2- 172.21.15.44:0/2931385577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ac8160eb0 0x7f6ac81f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.795+0000 7f6accda2700 1 --2- 172.21.15.44:0/2931385577 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ac8161290 0x7f6ac815f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.795+0000 7f6ac7fff700 1 -- 172.21.15.44:0/2931385577 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ac8161290 msgr2=0x7f6ac815f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.795+0000 7f6ac7fff700 1 --2- 172.21.15.44:0/2931385577 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ac8161290 0x7f6ac815f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.795+0000 7f6ac7fff700 1 -- 172.21.15.44:0/2931385577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ac8160eb0 msgr2=0x7f6ac81f6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.795+0000 7f6ac7fff700 1 --2- 172.21.15.44:0/2931385577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ac8160eb0 0x7f6ac81f6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.795+0000 7f6ac7fff700 1 -- 172.21.15.44:0/2931385577 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab8009570 con 0x7f6ac80b3ae0 2024-09-13T18:36:30.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.799+0000 7f6ac7fff700 1 --2- 172.21.15.44:0/2931385577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac80b3ae0 0x7f6ac80b2920 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000c530 tx=0x7f6ab000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:30.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.799+0000 7f6ac4ff9700 1 -- 172.21.15.44:0/2931385577 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab00052d0 con 0x7f6ac80b3ae0 2024-09-13T18:36:30.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.799+0000 7f6ac4ff9700 1 -- 172.21.15.44:0/2931385577 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab0005430 con 0x7f6ac80b3ae0 2024-09-13T18:36:30.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.799+0000 7f6acd5a3700 1 -- 172.21.15.44:0/2931385577 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac806c9b0 con 0x7f6ac80b3ae0 2024-09-13T18:36:30.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.799+0000 7f6ac4ff9700 1 -- 172.21.15.44:0/2931385577 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab00055a0 con 0x7f6ac80b3ae0 2024-09-13T18:36:30.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.799+0000 7f6acd5a3700 1 -- 172.21.15.44:0/2931385577 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac806cf70 con 0x7f6ac80b3ae0 2024-09-13T18:36:30.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.799+0000 7f6acd5a3700 1 -- 172.21.15.44:0/2931385577 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac8165590 con 0x7f6ac80b3ae0 2024-09-13T18:36:30.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.799+0000 7f6ac4ff9700 1 -- 172.21.15.44:0/2931385577 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6ab00038e0 con 0x7f6ac80b3ae0 2024-09-13T18:36:30.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.799+0000 7f6ac4ff9700 1 --2- 172.21.15.44:0/2931385577 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6aa8066730 0x7f6aa8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.803+0000 7f6ac4ff9700 1 -- 172.21.15.44:0/2931385577 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ab0083500 con 0x7f6ac80b3ae0 2024-09-13T18:36:30.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.803+0000 7f6ac77fe700 1 --2- 172.21.15.44:0/2931385577 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6aa8066730 0x7f6aa8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.803+0000 7f6ac77fe700 1 --2- 172.21.15.44:0/2931385577 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6aa8066730 0x7f6aa8068bf0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8009c60 tx=0x7f6ab8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:30.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:30.807+0000 7f6ac4ff9700 1 -- 172.21.15.44:0/2931385577 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6ab0050870 con 0x7f6ac80b3ae0 2024-09-13T18:36:31.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.015+0000 7f6acd5a3700 1 -- 172.21.15.44:0/2931385577 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ac8162b90 con 0x7f6ac80b3ae0 2024-09-13T18:36:31.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.015+0000 7f6ac4ff9700 1 -- 172.21.15.44:0/2931385577 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4730 (secure 0 0 0) 0x7f6ab0053e90 con 0x7f6ac80b3ae0 2024-09-13T18:36:31.024 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:31.024 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":78,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7121,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4127573228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4127573228},{"type":"v1","addr":"172.21.15.99:6836","nonce":4127573228}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":7984,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3372982355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3372982355},{"type":"v1","addr":"172.21.15.99:6837","nonce":3372982355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/48969097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":48969097},{"type":"v1","addr":"172.21.15.44:6833","nonce":48969097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:36:17.641055+0000","modified":"2024-09-13T18:36:20.660692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8193":{"gid":8193,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/1527182738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1527182738},{"type":"v1","addr":"172.21.15.44:6835","nonce":1527182738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:36:31.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.019+0000 7f6acd5a3700 1 -- 172.21.15.44:0/2931385577 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6aa8066730 msgr2=0x7f6aa8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.019+0000 7f6acd5a3700 1 --2- 172.21.15.44:0/2931385577 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6aa8066730 0x7f6aa8068bf0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8009c60 tx=0x7f6ab8008030 comp rx=0 tx=0).stop 2024-09-13T18:36:31.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.019+0000 7f6acd5a3700 1 -- 172.21.15.44:0/2931385577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac80b3ae0 msgr2=0x7f6ac80b2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.019+0000 7f6acd5a3700 1 --2- 172.21.15.44:0/2931385577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac80b3ae0 0x7f6ac80b2920 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000c530 tx=0x7f6ab000c840 comp rx=0 tx=0).stop 2024-09-13T18:36:31.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.019+0000 7f6acd5a3700 1 -- 172.21.15.44:0/2931385577 shutdown_connections 2024-09-13T18:36:31.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.019+0000 7f6acd5a3700 1 --2- 172.21.15.44:0/2931385577 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f6aa8066730 0x7f6aa8068bf0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.019+0000 7f6acd5a3700 1 --2- 172.21.15.44:0/2931385577 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ac8161290 0x7f6ac815f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.019+0000 7f6acd5a3700 1 --2- 172.21.15.44:0/2931385577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ac8160eb0 0x7f6ac81f6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.019+0000 7f6acd5a3700 1 --2- 172.21.15.44:0/2931385577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac80b3ae0 0x7f6ac80b2920 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.019+0000 7f6acd5a3700 1 -- 172.21.15.44:0/2931385577 >> 172.21.15.44:0/2931385577 conn(0x7f6ac80b0f00 msgr2=0x7f6ac8162f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:31.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.019+0000 7f6acd5a3700 1 -- 172.21.15.44:0/2931385577 shutdown_connections 2024-09-13T18:36:31.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.019+0000 7f6acd5a3700 1 -- 172.21.15.44:0/2931385577 wait complete. 2024-09-13T18:36:31.028 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 78 2024-09-13T18:36:31.039 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:31.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.143+0000 7f5457fff700 1 Processor -- start 2024-09-13T18:36:31.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.143+0000 7f5457fff700 1 -- start start 2024-09-13T18:36:31.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.143+0000 7f5457fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f545815cae0 0x7f54580cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.143+0000 7f5457fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f545815cec0 0x7f54580d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.143+0000 7f5457fff700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54580d21e0 con 0x7f545806ac00 2024-09-13T18:36:31.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.143+0000 7f5457fff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54580d1750 con 0x7f545815cae0 2024-09-13T18:36:31.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.143+0000 7f5457fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54580d1940 con 0x7f545815cec0 2024-09-13T18:36:31.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.143+0000 7f54577fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f545806ac00 0x7f54580cdfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49780/0 (socket says 172.21.15.44:49780) 2024-09-13T18:36:31.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.143+0000 7f54577fe700 1 -- 172.21.15.44:0/3554261592 learned_addr learned my addr 172.21.15.44:0/3554261592 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:31.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.143+0000 7f544e7fc700 1 --2- 172.21.15.44:0/3554261592 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f545815cec0 0x7f54580d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.143+0000 7f5456ffd700 1 --2- 172.21.15.44:0/3554261592 >> v2:172.21.15.99:3300/0 conn(0x7f545815cae0 0x7f54580cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.147+0000 7f54567fc700 1 -- 172.21.15.44:0/3554261592 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524322784 0 0) 0x7f54580d21e0 con 0x7f545806ac00 2024-09-13T18:36:31.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.147+0000 7f54567fc700 1 -- 172.21.15.44:0/3554261592 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54440035d0 con 0x7f545806ac00 2024-09-13T18:36:31.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.147+0000 7f544e7fc700 1 -- 172.21.15.44:0/3554261592 >> v2:172.21.15.99:3300/0 conn(0x7f545815cae0 msgr2=0x7f54580cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:31.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.147+0000 7f544e7fc700 1 --2- 172.21.15.44:0/3554261592 >> v2:172.21.15.99:3300/0 conn(0x7f545815cae0 0x7f54580cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.147+0000 7f544e7fc700 1 -- 172.21.15.44:0/3554261592 >> v1:172.21.15.44:6789/0 conn(0x7f545806ac00 legacy=0x7f54580cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.147+0000 7f544e7fc700 1 -- 172.21.15.44:0/3554261592 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54580d1c20 con 0x7f545815cec0 2024-09-13T18:36:31.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.147+0000 7f544e7fc700 1 --2- 172.21.15.44:0/3554261592 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f545815cec0 0x7f54580d1210 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5440009850 tx=0x7f5440009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dc5ce7c33d87a37 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:31.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.147+0000 7f54567fc700 1 -- 172.21.15.44:0/3554261592 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440011830 con 0x7f545815cec0 2024-09-13T18:36:31.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.147+0000 7f54567fc700 1 -- 172.21.15.44:0/3554261592 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5440011990 con 0x7f545815cec0 2024-09-13T18:36:31.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.147+0000 7f54567fc700 1 -- 172.21.15.44:0/3554261592 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440011d40 con 0x7f545815cec0 2024-09-13T18:36:31.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.147+0000 7f5457fff700 1 -- 172.21.15.44:0/3554261592 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f545815cec0 msgr2=0x7f54580d1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.147+0000 7f5457fff700 1 --2- 172.21.15.44:0/3554261592 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f545815cec0 0x7f54580d1210 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5440009850 tx=0x7f5440009b60 comp rx=0 tx=0).stop 2024-09-13T18:36:31.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.147+0000 7f5457fff700 1 -- 172.21.15.44:0/3554261592 shutdown_connections 2024-09-13T18:36:31.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.147+0000 7f5457fff700 1 --2- 172.21.15.44:0/3554261592 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f545815cec0 0x7f54580d1210 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.147+0000 7f5457fff700 1 --2- 172.21.15.44:0/3554261592 >> v2:172.21.15.99:3300/0 conn(0x7f545815cae0 0x7f54580cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.147+0000 7f5457fff700 1 -- 172.21.15.44:0/3554261592 >> 172.21.15.44:0/3554261592 conn(0x7f54580d2c80 msgr2=0x7f54580d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:31.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.147+0000 7f5457fff700 1 -- 172.21.15.44:0/3554261592 shutdown_connections 2024-09-13T18:36:31.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.147+0000 7f5457fff700 1 -- 172.21.15.44:0/3554261592 wait complete. 2024-09-13T18:36:31.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f5457fff700 1 Processor -- start 2024-09-13T18:36:31.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f5457fff700 1 -- start start 2024-09-13T18:36:31.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f5457fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f545806ac00 0x7f545815db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f5457fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f545815cae0 0x7f5458157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f5457fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f545815cec0 0x7f54580c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f5457fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545815e080 con 0x7f545815cec0 2024-09-13T18:36:31.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f5457fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5458157b40 con 0x7f545806ac00 2024-09-13T18:36:31.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f5457fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54581f5d30 con 0x7f545815cae0 2024-09-13T18:36:31.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f54577fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f545815cec0 0x7f54580c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f54577fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f545815cec0 0x7f54580c9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47496/0 (socket says 172.21.15.44:47496) 2024-09-13T18:36:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f54577fe700 1 -- 172.21.15.44:0/690046343 learned_addr learned my addr 172.21.15.44:0/690046343 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f544e7fc700 1 --2- 172.21.15.44:0/690046343 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f545815cae0 0x7f5458157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f5456ffd700 1 --2- 172.21.15.44:0/690046343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f545806ac00 0x7f545815db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f54577fe700 1 -- 172.21.15.44:0/690046343 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f545815cae0 msgr2=0x7f5458157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f54577fe700 1 --2- 172.21.15.44:0/690046343 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f545815cae0 0x7f5458157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f54577fe700 1 -- 172.21.15.44:0/690046343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f545806ac00 msgr2=0x7f545815db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f54577fe700 1 --2- 172.21.15.44:0/690046343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f545806ac00 0x7f545815db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f54577fe700 1 -- 172.21.15.44:0/690046343 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54400094b0 con 0x7f545815cec0 2024-09-13T18:36:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f54577fe700 1 --2- 172.21.15.44:0/690046343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f545815cec0 0x7f54580c9110 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f545000caa0 tx=0x7f545000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:31.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f544ffff700 1 -- 172.21.15.44:0/690046343 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450007480 con 0x7f545815cec0 2024-09-13T18:36:31.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f544ffff700 1 -- 172.21.15.44:0/690046343 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54500075e0 con 0x7f545815cec0 2024-09-13T18:36:31.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f5457fff700 1 -- 172.21.15.44:0/690046343 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54581f6010 con 0x7f545815cec0 2024-09-13T18:36:31.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f544ffff700 1 -- 172.21.15.44:0/690046343 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450007970 con 0x7f545815cec0 2024-09-13T18:36:31.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.151+0000 7f5457fff700 1 -- 172.21.15.44:0/690046343 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54581f65d0 con 0x7f545815cec0 2024-09-13T18:36:31.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.155+0000 7f544ffff700 1 -- 172.21.15.44:0/690046343 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f545001b3b0 con 0x7f545815cec0 2024-09-13T18:36:31.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.155+0000 7f5457fff700 1 -- 172.21.15.44:0/690046343 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54581f67c0 con 0x7f545815cec0 2024-09-13T18:36:31.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.155+0000 7f544ffff700 1 --2- 172.21.15.44:0/690046343 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5438066730 0x7f5438068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.155+0000 7f544ffff700 1 -- 172.21.15.44:0/690046343 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5450083a20 con 0x7f545815cec0 2024-09-13T18:36:31.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.155+0000 7f5456ffd700 1 --2- 172.21.15.44:0/690046343 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5438066730 0x7f5438068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.155+0000 7f5456ffd700 1 --2- 172.21.15.44:0/690046343 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5438066730 0x7f5438068bf0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5448009bf0 tx=0x7f5448009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:31.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.163+0000 7f544ffff700 1 -- 172.21.15.44:0/690046343 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5450050d90 con 0x7f545815cec0 2024-09-13T18:36:31.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.331+0000 7f5457fff700 1 -- 172.21.15.44:0/690046343 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f545806bad0 con 0x7f545815cec0 2024-09-13T18:36:31.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.335+0000 7f544ffff700 1 -- 172.21.15.44:0/690046343 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16500 (secure 0 0 0) 0x7f545806bad0 con 0x7f545815cec0 2024-09-13T18:36:31.343 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:31.343 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":90,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:36:18.647007+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:36:15.982954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T18:36:16.628264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:31.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.339+0000 7f5457fff700 1 -- 172.21.15.44:0/690046343 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5438066730 msgr2=0x7f5438068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.339+0000 7f5457fff700 1 --2- 172.21.15.44:0/690046343 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5438066730 0x7f5438068bf0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5448009bf0 tx=0x7f5448009240 comp rx=0 tx=0).stop 2024-09-13T18:36:31.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.339+0000 7f5457fff700 1 -- 172.21.15.44:0/690046343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f545815cec0 msgr2=0x7f54580c9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.339+0000 7f5457fff700 1 --2- 172.21.15.44:0/690046343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f545815cec0 0x7f54580c9110 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f545000caa0 tx=0x7f545000cad0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.339+0000 7f5457fff700 1 -- 172.21.15.44:0/690046343 shutdown_connections 2024-09-13T18:36:31.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.339+0000 7f5457fff700 1 --2- 172.21.15.44:0/690046343 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5438066730 0x7f5438068bf0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.339+0000 7f5457fff700 1 --2- 172.21.15.44:0/690046343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f545815cec0 0x7f54580c9110 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.339+0000 7f5457fff700 1 --2- 172.21.15.44:0/690046343 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f545815cae0 0x7f5458157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.339+0000 7f5457fff700 1 --2- 172.21.15.44:0/690046343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f545806ac00 0x7f545815db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.339+0000 7f5457fff700 1 -- 172.21.15.44:0/690046343 >> 172.21.15.44:0/690046343 conn(0x7f54580d2c80 msgr2=0x7f54580ca030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:31.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.339+0000 7f5457fff700 1 -- 172.21.15.44:0/690046343 shutdown_connections 2024-09-13T18:36:31.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.339+0000 7f5457fff700 1 -- 172.21.15.44:0/690046343 wait complete. 2024-09-13T18:36:31.359 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:36:31.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.475+0000 7ff0c8ce1700 1 Processor -- start 2024-09-13T18:36:31.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.475+0000 7ff0c8ce1700 1 -- start start 2024-09-13T18:36:31.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.475+0000 7ff0c8ce1700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff0c4146160 0x7ff0c40cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.475+0000 7ff0c8ce1700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff0c40ce130 0x7ff0c40ad270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.475+0000 7ff0c8ce1700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c40ae000 con 0x7ff0c40ad7b0 2024-09-13T18:36:31.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.475+0000 7ff0c8ce1700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c40cc820 con 0x7ff0c40ce130 2024-09-13T18:36:31.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.475+0000 7ff0c8ce1700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c4070070 con 0x7ff0c4146160 2024-09-13T18:36:31.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.475+0000 7ff0c2ffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff0c40ce130 0x7ff0c40ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.475+0000 7ff0c2ffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff0c40ce130 0x7ff0c40ad270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47508/0 (socket says 172.21.15.44:47508) 2024-09-13T18:36:31.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.475+0000 7ff0c2ffd700 1 -- 172.21.15.44:0/106748972 learned_addr learned my addr 172.21.15.44:0/106748972 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:31.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.475+0000 7ff0c37fe700 1 --2- 172.21.15.44:0/106748972 >> v2:172.21.15.99:3300/0 conn(0x7ff0c4146160 0x7ff0c40cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.475+0000 7ff0c2ffd700 1 -- 172.21.15.44:0/106748972 >> v2:172.21.15.99:3300/0 conn(0x7ff0c4146160 msgr2=0x7ff0c40cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:31.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.475+0000 7ff0c2ffd700 1 --2- 172.21.15.44:0/106748972 >> v2:172.21.15.99:3300/0 conn(0x7ff0c4146160 0x7ff0c40cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.475+0000 7ff0c2ffd700 1 -- 172.21.15.44:0/106748972 >> v1:172.21.15.99:6789/0 conn(0x7ff0c40ad7b0 legacy=0x7ff0c4160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:31.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.475+0000 7ff0c2ffd700 1 -- 172.21.15.44:0/106748972 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c4070350 con 0x7ff0c40ce130 2024-09-13T18:36:31.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.475+0000 7ff0c2ffd700 1 --2- 172.21.15.44:0/106748972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c40ce130 0x7ff0c40ad270 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7ff0c40b3bf0 tx=0x7ff0b4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902c5345db6f43aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:31.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.475+0000 7ff0c27fc700 1 -- 172.21.15.44:0/106748972 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4004230 con 0x7ff0c40ce130 2024-09-13T18:36:31.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.475+0000 7ff0c27fc700 1 -- 172.21.15.44:0/106748972 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b4004390 con 0x7ff0c40ce130 2024-09-13T18:36:31.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.475+0000 7ff0c27fc700 1 -- 172.21.15.44:0/106748972 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b40036c0 con 0x7ff0c40ce130 2024-09-13T18:36:31.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.479+0000 7ff0c8ce1700 1 -- 172.21.15.44:0/106748972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c40ce130 msgr2=0x7ff0c40ad270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.479+0000 7ff0c8ce1700 1 --2- 172.21.15.44:0/106748972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c40ce130 0x7ff0c40ad270 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7ff0c40b3bf0 tx=0x7ff0b4009bf0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.479+0000 7ff0c8ce1700 1 -- 172.21.15.44:0/106748972 shutdown_connections 2024-09-13T18:36:31.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.479+0000 7ff0c8ce1700 1 --2- 172.21.15.44:0/106748972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c40ce130 0x7ff0c40ad270 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.479+0000 7ff0c8ce1700 1 --2- 172.21.15.44:0/106748972 >> v2:172.21.15.99:3300/0 conn(0x7ff0c4146160 0x7ff0c40cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.479+0000 7ff0c8ce1700 1 -- 172.21.15.44:0/106748972 >> 172.21.15.44:0/106748972 conn(0x7ff0c40b0e10 msgr2=0x7ff0c40b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:31.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.479+0000 7ff0c8ce1700 1 -- 172.21.15.44:0/106748972 shutdown_connections 2024-09-13T18:36:31.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.479+0000 7ff0c8ce1700 1 -- 172.21.15.44:0/106748972 wait complete. 2024-09-13T18:36:31.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.479+0000 7ff0c8ce1700 1 Processor -- start 2024-09-13T18:36:31.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.479+0000 7ff0c8ce1700 1 -- start start 2024-09-13T18:36:31.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.483+0000 7ff0c8ce1700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0c40ad7b0 0x7ff0c415c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.483+0000 7ff0c8ce1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c40ce130 0x7ff0c413d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.483+0000 7ff0c8ce1700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff0c4146160 0x7ff0c406d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.483+0000 7ff0c8ce1700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c415cbc0 con 0x7ff0c40ce130 2024-09-13T18:36:31.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.483+0000 7ff0c8ce1700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c413efc0 con 0x7ff0c40ad7b0 2024-09-13T18:36:31.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.483+0000 7ff0c8ce1700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c413f2a0 con 0x7ff0c4146160 2024-09-13T18:36:31.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.483+0000 7ff0c2ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c40ce130 0x7ff0c413d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.483+0000 7ff0c2ffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c40ce130 0x7ff0c413d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47522/0 (socket says 172.21.15.44:47522) 2024-09-13T18:36:31.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.483+0000 7ff0c2ffd700 1 -- 172.21.15.44:0/1248453864 learned_addr learned my addr 172.21.15.44:0/1248453864 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:31.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.483+0000 7ff0c37fe700 1 --2- 172.21.15.44:0/1248453864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0c40ad7b0 0x7ff0c415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.483+0000 7ff0c3fff700 1 --2- 172.21.15.44:0/1248453864 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff0c4146160 0x7ff0c406d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.483+0000 7ff0c2ffd700 1 -- 172.21.15.44:0/1248453864 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff0c4146160 msgr2=0x7ff0c406d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.483+0000 7ff0c2ffd700 1 --2- 172.21.15.44:0/1248453864 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff0c4146160 0x7ff0c406d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.483+0000 7ff0c2ffd700 1 -- 172.21.15.44:0/1248453864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0c40ad7b0 msgr2=0x7ff0c415c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.483+0000 7ff0c2ffd700 1 --2- 172.21.15.44:0/1248453864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0c40ad7b0 0x7ff0c415c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.483+0000 7ff0c2ffd700 1 -- 172.21.15.44:0/1248453864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b4009570 con 0x7ff0c40ce130 2024-09-13T18:36:31.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.483+0000 7ff0c2ffd700 1 --2- 172.21.15.44:0/1248453864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c40ce130 0x7ff0c413d780 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4004000 tx=0x7ff0b4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:31.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.483+0000 7ff0abfff700 1 -- 172.21.15.44:0/1248453864 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4003e60 con 0x7ff0c40ce130 2024-09-13T18:36:31.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.483+0000 7ff0abfff700 1 -- 172.21.15.44:0/1248453864 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b401f070 con 0x7ff0c40ce130 2024-09-13T18:36:31.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.483+0000 7ff0c8ce1700 1 -- 172.21.15.44:0/1248453864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c413f580 con 0x7ff0c40ce130 2024-09-13T18:36:31.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.483+0000 7ff0abfff700 1 -- 172.21.15.44:0/1248453864 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b400b8a0 con 0x7ff0c40ce130 2024-09-13T18:36:31.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.483+0000 7ff0c8ce1700 1 -- 172.21.15.44:0/1248453864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c413fb40 con 0x7ff0c40ce130 2024-09-13T18:36:31.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.483+0000 7ff0c8ce1700 1 -- 172.21.15.44:0/1248453864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c40ad270 con 0x7ff0c40ce130 2024-09-13T18:36:31.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.487+0000 7ff0abfff700 1 -- 172.21.15.44:0/1248453864 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff0b4021030 con 0x7ff0c40ce130 2024-09-13T18:36:31.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.487+0000 7ff0abfff700 1 --2- 172.21.15.44:0/1248453864 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff0b0066730 0x7ff0b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.487+0000 7ff0abfff700 1 -- 172.21.15.44:0/1248453864 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0b40856c0 con 0x7ff0c40ce130 2024-09-13T18:36:31.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.487+0000 7ff0c37fe700 1 --2- 172.21.15.44:0/1248453864 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff0b0066730 0x7ff0b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.487+0000 7ff0c37fe700 1 --2- 172.21.15.44:0/1248453864 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff0b0066730 0x7ff0b0068bf0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800b9d0 tx=0x7ff0b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:31.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.491+0000 7ff0abfff700 1 -- 172.21.15.44:0/1248453864 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff0b4052ac0 con 0x7ff0c40ce130 2024-09-13T18:36:31.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.703+0000 7ff0c8ce1700 1 -- 172.21.15.44:0/1248453864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff0c40ad270 con 0x7ff0c40ce130 2024-09-13T18:36:31.712 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-13T18:36:31.703+0000 7fc22bbc2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:36:31.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.723+0000 7ff0abfff700 1 -- 172.21.15.44:0/1248453864 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v79) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff0b40560e0 con 0x7ff0c40ce130 2024-09-13T18:36:31.730 INFO:tasks.ceph.mds.c.smithi044.stderr: -493> 2024-09-13T18:36:23.559+0000 7ff5996c3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:36:31.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.727+0000 7ff0c8ce1700 1 -- 172.21.15.44:0/1248453864 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff0b0066730 msgr2=0x7ff0b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.727+0000 7ff0c8ce1700 1 --2- 172.21.15.44:0/1248453864 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff0b0066730 0x7ff0b0068bf0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800b9d0 tx=0x7ff0b8008040 comp rx=0 tx=0).stop 2024-09-13T18:36:31.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.727+0000 7ff0c8ce1700 1 -- 172.21.15.44:0/1248453864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c40ce130 msgr2=0x7ff0c413d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.727+0000 7ff0c8ce1700 1 --2- 172.21.15.44:0/1248453864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c40ce130 0x7ff0c413d780 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4004000 tx=0x7ff0b4004770 comp rx=0 tx=0).stop 2024-09-13T18:36:31.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.727+0000 7ff0c8ce1700 1 -- 172.21.15.44:0/1248453864 shutdown_connections 2024-09-13T18:36:31.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.727+0000 7ff0c8ce1700 1 --2- 172.21.15.44:0/1248453864 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff0b0066730 0x7ff0b0068bf0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.727+0000 7ff0c8ce1700 1 --2- 172.21.15.44:0/1248453864 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff0c4146160 0x7ff0c406d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.727+0000 7ff0c8ce1700 1 --2- 172.21.15.44:0/1248453864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c40ce130 0x7ff0c413d780 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.727+0000 7ff0c8ce1700 1 --2- 172.21.15.44:0/1248453864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0c40ad7b0 0x7ff0c415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.727+0000 7ff0c8ce1700 1 -- 172.21.15.44:0/1248453864 >> 172.21.15.44:0/1248453864 conn(0x7ff0c40b0e10 msgr2=0x7ff0c40afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:31.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.727+0000 7ff0c8ce1700 1 -- 172.21.15.44:0/1248453864 shutdown_connections 2024-09-13T18:36:31.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.727+0000 7ff0c8ce1700 1 -- 172.21.15.44:0/1248453864 wait complete. 2024-09-13T18:36:31.735 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:36:31.749 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:36:31.765 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-13T18:36:31.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.855+0000 7faf5cce2700 1 Processor -- start 2024-09-13T18:36:31.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.855+0000 7faf5cce2700 1 -- start start 2024-09-13T18:36:31.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.855+0000 7faf5cce2700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faf580cf360 0x7faf580ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.855+0000 7faf5cce2700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7faf580adf20 0x7faf580b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.855+0000 7faf5cce2700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf580b3d50 0x7faf580ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.855+0000 7faf5cce2700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf580cf740 con 0x7faf580adf20 2024-09-13T18:36:31.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.855+0000 7faf5cce2700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf580b4b50 con 0x7faf580cf360 2024-09-13T18:36:31.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.855+0000 7faf5cce2700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf580ae390 con 0x7faf580b3d50 2024-09-13T18:36:31.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.855+0000 7faf56ffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7faf580adf20 0x7faf580b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf56ffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7faf580adf20 0x7faf580b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47540/0 (socket says 172.21.15.44:47540) 2024-09-13T18:36:31.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf56ffd700 1 -- 172.21.15.44:0/3952726375 learned_addr learned my addr 172.21.15.44:0/3952726375 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:31.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf57fff700 1 --2- 172.21.15.44:0/3952726375 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf580b3d50 0x7faf580ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf577fe700 1 --2- 172.21.15.44:0/3952726375 >> v2:172.21.15.99:3300/0 conn(0x7faf580cf360 0x7faf580ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf56ffd700 1 -- 172.21.15.44:0/3952726375 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf580b3d50 msgr2=0x7faf580ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:31.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf56ffd700 1 --2- 172.21.15.44:0/3952726375 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf580b3d50 0x7faf580ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf56ffd700 1 -- 172.21.15.44:0/3952726375 >> v2:172.21.15.99:3300/0 conn(0x7faf580cf360 msgr2=0x7faf580ad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:31.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf56ffd700 1 --2- 172.21.15.44:0/3952726375 >> v2:172.21.15.99:3300/0 conn(0x7faf580cf360 0x7faf580ad9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf56ffd700 1 -- 172.21.15.44:0/3952726375 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf580b4590 con 0x7faf580adf20 2024-09-13T18:36:31.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf577fe700 1 --2- 172.21.15.44:0/3952726375 >> v2:172.21.15.99:3300/0 conn(0x7faf580cf360 0x7faf580ad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:31.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf56ffd700 1 --2- 172.21.15.44:0/3952726375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf580adf20 0x7faf580b3810 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7faf580728b0 tx=0x7faf48009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62fbf5d78ba40492 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:31.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf567fc700 1 -- 172.21.15.44:0/3952726375 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf48011830 con 0x7faf580adf20 2024-09-13T18:36:31.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf567fc700 1 -- 172.21.15.44:0/3952726375 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf48011990 con 0x7faf580adf20 2024-09-13T18:36:31.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf567fc700 1 -- 172.21.15.44:0/3952726375 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf48011d20 con 0x7faf580adf20 2024-09-13T18:36:31.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf5cce2700 1 -- 172.21.15.44:0/3952726375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf580adf20 msgr2=0x7faf580b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf5cce2700 1 --2- 172.21.15.44:0/3952726375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf580adf20 0x7faf580b3810 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7faf580728b0 tx=0x7faf48009c50 comp rx=0 tx=0).stop 2024-09-13T18:36:31.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf5cce2700 1 -- 172.21.15.44:0/3952726375 shutdown_connections 2024-09-13T18:36:31.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf5cce2700 1 --2- 172.21.15.44:0/3952726375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf580adf20 0x7faf580b3810 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf5cce2700 1 --2- 172.21.15.44:0/3952726375 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf580b3d50 0x7faf580ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf5cce2700 1 --2- 172.21.15.44:0/3952726375 >> v2:172.21.15.99:3300/0 conn(0x7faf580cf360 0x7faf580ad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf5cce2700 1 -- 172.21.15.44:0/3952726375 >> 172.21.15.44:0/3952726375 conn(0x7faf580b1810 msgr2=0x7faf580b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:31.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf5cce2700 1 -- 172.21.15.44:0/3952726375 shutdown_connections 2024-09-13T18:36:31.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf5cce2700 1 -- 172.21.15.44:0/3952726375 wait complete. 2024-09-13T18:36:31.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf5cce2700 1 Processor -- start 2024-09-13T18:36:31.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.859+0000 7faf5cce2700 1 -- start start 2024-09-13T18:36:31.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf5cce2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf580adf20 0x7faf58156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf5cce2700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf580b3d50 0x7faf580c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf5cce2700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf580cf360 0x7faf581f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf5cce2700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf580c4f30 con 0x7faf580adf20 2024-09-13T18:36:31.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf5cce2700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5806d540 con 0x7faf580cf360 2024-09-13T18:36:31.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf5cce2700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5814f960 con 0x7faf580b3d50 2024-09-13T18:36:31.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf577fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf580adf20 0x7faf58156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf577fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf580adf20 0x7faf58156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47544/0 (socket says 172.21.15.44:47544) 2024-09-13T18:36:31.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf577fe700 1 -- 172.21.15.44:0/1758836763 learned_addr learned my addr 172.21.15.44:0/1758836763 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:31.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf57fff700 1 --2- 172.21.15.44:0/1758836763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf580cf360 0x7faf581f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf56ffd700 1 --2- 172.21.15.44:0/1758836763 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf580b3d50 0x7faf580c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf577fe700 1 -- 172.21.15.44:0/1758836763 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf580b3d50 msgr2=0x7faf580c48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf577fe700 1 --2- 172.21.15.44:0/1758836763 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf580b3d50 0x7faf580c48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf577fe700 1 -- 172.21.15.44:0/1758836763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf580cf360 msgr2=0x7faf581f2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf577fe700 1 --2- 172.21.15.44:0/1758836763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf580cf360 0x7faf581f2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf577fe700 1 -- 172.21.15.44:0/1758836763 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf48009570 con 0x7faf580adf20 2024-09-13T18:36:31.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf56ffd700 1 --2- 172.21.15.44:0/1758836763 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf580b3d50 0x7faf580c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:31.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf57fff700 1 --2- 172.21.15.44:0/1758836763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf580cf360 0x7faf581f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:31.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf577fe700 1 --2- 172.21.15.44:0/1758836763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf580adf20 0x7faf58156640 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00e840 tx=0x7faf4c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:31.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf3ffff700 1 -- 172.21.15.44:0/1758836763 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c004230 con 0x7faf580adf20 2024-09-13T18:36:31.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf3ffff700 1 -- 172.21.15.44:0/1758836763 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c004390 con 0x7faf580adf20 2024-09-13T18:36:31.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf5cce2700 1 -- 172.21.15.44:0/1758836763 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf581f3330 con 0x7faf580adf20 2024-09-13T18:36:31.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf3ffff700 1 -- 172.21.15.44:0/1758836763 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c0036c0 con 0x7faf580adf20 2024-09-13T18:36:31.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf5cce2700 1 -- 172.21.15.44:0/1758836763 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5806cef0 con 0x7faf580adf20 2024-09-13T18:36:31.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.863+0000 7faf3ffff700 1 -- 172.21.15.44:0/1758836763 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faf4c003840 con 0x7faf580adf20 2024-09-13T18:36:31.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.867+0000 7faf5cce2700 1 -- 172.21.15.44:0/1758836763 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf580b41a0 con 0x7faf580adf20 2024-09-13T18:36:31.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.867+0000 7faf3ffff700 1 --2- 172.21.15.44:0/1758836763 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faf44066730 0x7faf44068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.867+0000 7faf3ffff700 1 -- 172.21.15.44:0/1758836763 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5795+0+0 (secure 0 0 0) 0x7faf4c083bf0 con 0x7faf580adf20 2024-09-13T18:36:31.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.867+0000 7faf56ffd700 1 --2- 172.21.15.44:0/1758836763 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faf44066730 0x7faf44068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.867+0000 7faf56ffd700 1 --2- 172.21.15.44:0/1758836763 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faf44066730 0x7faf44068bf0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7faf580add10 tx=0x7faf48008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:31.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:31.875+0000 7faf3ffff700 1 -- 172.21.15.44:0/1758836763 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faf4c050f10 con 0x7faf580adf20 2024-09-13T18:36:32.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.083+0000 7faf5cce2700 1 -- 172.21.15.44:0/1758836763 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7faf5815dc50 con 0x7faf580adf20 2024-09-13T18:36:32.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.743+0000 7faf3ffff700 1 -- 172.21.15.44:0/1758836763 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v80) v1 ==== 104+0+0 (secure 0 0 0) 0x7faf4c00c450 con 0x7faf580adf20 2024-09-13T18:36:32.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.747+0000 7faf5cce2700 1 -- 172.21.15.44:0/1758836763 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faf44066730 msgr2=0x7faf44068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:32.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.747+0000 7faf5cce2700 1 --2- 172.21.15.44:0/1758836763 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faf44066730 0x7faf44068bf0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7faf580add10 tx=0x7faf48008030 comp rx=0 tx=0).stop 2024-09-13T18:36:32.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.747+0000 7faf5cce2700 1 -- 172.21.15.44:0/1758836763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf580adf20 msgr2=0x7faf58156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:32.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.747+0000 7faf5cce2700 1 --2- 172.21.15.44:0/1758836763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf580adf20 0x7faf58156640 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00e840 tx=0x7faf4c00ec00 comp rx=0 tx=0).stop 2024-09-13T18:36:32.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.747+0000 7faf5cce2700 1 -- 172.21.15.44:0/1758836763 shutdown_connections 2024-09-13T18:36:32.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.747+0000 7faf5cce2700 1 --2- 172.21.15.44:0/1758836763 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faf44066730 0x7faf44068bf0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.747+0000 7faf5cce2700 1 --2- 172.21.15.44:0/1758836763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf580cf360 0x7faf581f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.747+0000 7faf5cce2700 1 --2- 172.21.15.44:0/1758836763 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf580b3d50 0x7faf580c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.747+0000 7faf5cce2700 1 --2- 172.21.15.44:0/1758836763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf580adf20 0x7faf58156640 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.747+0000 7faf5cce2700 1 -- 172.21.15.44:0/1758836763 >> 172.21.15.44:0/1758836763 conn(0x7faf580b1810 msgr2=0x7faf5815ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:32.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.747+0000 7faf5cce2700 1 -- 172.21.15.44:0/1758836763 shutdown_connections 2024-09-13T18:36:32.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.747+0000 7faf5cce2700 1 -- 172.21.15.44:0/1758836763 wait complete. 2024-09-13T18:36:32.773 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:36:32.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.895+0000 7eff028b5700 1 Processor -- start 2024-09-13T18:36:32.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.895+0000 7eff028b5700 1 -- start start 2024-09-13T18:36:32.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff028b5700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efefc0d0ac0 0x7efefc0cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:32.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff028b5700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efefc0cdd40 0x7efefc160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:32.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff028b5700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efefc15d2a0 con 0x7efefc15cec0 2024-09-13T18:36:32.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff028b5700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efefc0d0fc0 con 0x7efefc0d0ac0 2024-09-13T18:36:32.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff028b5700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efefc0d12a0 con 0x7efefc0cdd40 2024-09-13T18:36:32.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff010b2700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efefc0d0ac0 0x7efefc0cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:32.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff018b3700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7efefc15cec0 0x7efefc0d2060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39960/0 (socket says 172.21.15.44:39960) 2024-09-13T18:36:32.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff018b3700 1 -- 172.21.15.44:0/3528602705 learned_addr learned my addr 172.21.15.44:0/3528602705 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:32.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff020b4700 1 --2- 172.21.15.44:0/3528602705 >> v2:172.21.15.99:3300/0 conn(0x7efefc0cdd40 0x7efefc160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:32.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff010b2700 1 -- 172.21.15.44:0/3528602705 >> v2:172.21.15.99:3300/0 conn(0x7efefc0cdd40 msgr2=0x7efefc160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:32.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff010b2700 1 --2- 172.21.15.44:0/3528602705 >> v2:172.21.15.99:3300/0 conn(0x7efefc0cdd40 0x7efefc160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff010b2700 1 -- 172.21.15.44:0/3528602705 >> v1:172.21.15.44:6789/0 conn(0x7efefc15cec0 legacy=0x7efefc0d2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:32.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff008b1700 1 -- 172.21.15.44:0/3528602705 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524268752 0 0) 0x7efefc15d2a0 con 0x7efefc15cec0 2024-09-13T18:36:32.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff010b2700 1 -- 172.21.15.44:0/3528602705 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efefc0d1580 con 0x7efefc0d0ac0 2024-09-13T18:36:32.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff010b2700 1 --2- 172.21.15.44:0/3528602705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efefc0d0ac0 0x7efefc0cd800 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7efefc0b5aa0 tx=0x7efef8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bdb1ed6ee20b670 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:32.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff008b1700 1 -- 172.21.15.44:0/3528602705 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef8011830 con 0x7efefc0d0ac0 2024-09-13T18:36:32.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff008b1700 1 -- 172.21.15.44:0/3528602705 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef8011990 con 0x7efefc0d0ac0 2024-09-13T18:36:32.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff008b1700 1 -- 172.21.15.44:0/3528602705 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef8011d20 con 0x7efefc0d0ac0 2024-09-13T18:36:32.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff028b5700 1 -- 172.21.15.44:0/3528602705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efefc0d0ac0 msgr2=0x7efefc0cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:32.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff028b5700 1 --2- 172.21.15.44:0/3528602705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efefc0d0ac0 0x7efefc0cd800 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7efefc0b5aa0 tx=0x7efef8009b30 comp rx=0 tx=0).stop 2024-09-13T18:36:32.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff028b5700 1 -- 172.21.15.44:0/3528602705 shutdown_connections 2024-09-13T18:36:32.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff028b5700 1 --2- 172.21.15.44:0/3528602705 >> v2:172.21.15.99:3300/0 conn(0x7efefc0cdd40 0x7efefc160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff028b5700 1 --2- 172.21.15.44:0/3528602705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efefc0d0ac0 0x7efefc0cd800 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff028b5700 1 -- 172.21.15.44:0/3528602705 >> 172.21.15.44:0/3528602705 conn(0x7efefc0d2bc0 msgr2=0x7efefc0d2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:32.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff028b5700 1 -- 172.21.15.44:0/3528602705 shutdown_connections 2024-09-13T18:36:32.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.899+0000 7eff028b5700 1 -- 172.21.15.44:0/3528602705 wait complete. 2024-09-13T18:36:32.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.903+0000 7eff028b5700 1 Processor -- start 2024-09-13T18:36:32.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.903+0000 7eff028b5700 1 -- start start 2024-09-13T18:36:32.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.903+0000 7eff028b5700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efefc0cdd40 0x7efefc15beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:32.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.903+0000 7eff028b5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efefc0d0ac0 0x7efefc15f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:32.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.903+0000 7eff028b5700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efefc15cec0 0x7efefc0a9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:32.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.903+0000 7eff028b5700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efefc0cb350 con 0x7efefc0d0ac0 2024-09-13T18:36:32.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.903+0000 7eff028b5700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efefc0caa40 con 0x7efefc15cec0 2024-09-13T18:36:32.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.903+0000 7eff028b5700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efefc15fe00 con 0x7efefc0cdd40 2024-09-13T18:36:32.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.903+0000 7eff010b2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efefc0d0ac0 0x7efefc15f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:32.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.903+0000 7eff010b2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efefc0d0ac0 0x7efefc15f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42618/0 (socket says 172.21.15.44:42618) 2024-09-13T18:36:32.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.903+0000 7eff010b2700 1 -- 172.21.15.44:0/1069730840 learned_addr learned my addr 172.21.15.44:0/1069730840 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:32.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.903+0000 7eff020b4700 1 --2- 172.21.15.44:0/1069730840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efefc15cec0 0x7efefc0a9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:32.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.903+0000 7eff018b3700 1 --2- 172.21.15.44:0/1069730840 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efefc0cdd40 0x7efefc15beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:32.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.903+0000 7eff010b2700 1 -- 172.21.15.44:0/1069730840 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efefc0cdd40 msgr2=0x7efefc15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:32.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.903+0000 7eff010b2700 1 --2- 172.21.15.44:0/1069730840 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efefc0cdd40 0x7efefc15beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.903+0000 7eff010b2700 1 -- 172.21.15.44:0/1069730840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efefc15cec0 msgr2=0x7efefc0a9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:32.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.903+0000 7eff010b2700 1 --2- 172.21.15.44:0/1069730840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efefc15cec0 0x7efefc0a9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.903+0000 7eff010b2700 1 -- 172.21.15.44:0/1069730840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef80094b0 con 0x7efefc0d0ac0 2024-09-13T18:36:32.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.907+0000 7eff010b2700 1 --2- 172.21.15.44:0/1069730840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efefc0d0ac0 0x7efefc15f460 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7efef8009fd0 tx=0x7efef8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:32.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.907+0000 7efef27fc700 1 -- 172.21.15.44:0/1069730840 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef8004480 con 0x7efefc0d0ac0 2024-09-13T18:36:32.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.907+0000 7efef27fc700 1 -- 172.21.15.44:0/1069730840 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef801f070 con 0x7efefc0d0ac0 2024-09-13T18:36:32.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.907+0000 7eff028b5700 1 -- 172.21.15.44:0/1069730840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efefc0cac90 con 0x7efefc0d0ac0 2024-09-13T18:36:32.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.907+0000 7efef27fc700 1 -- 172.21.15.44:0/1069730840 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef80038c0 con 0x7efefc0d0ac0 2024-09-13T18:36:32.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.907+0000 7eff028b5700 1 -- 172.21.15.44:0/1069730840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efefc15f9a0 con 0x7efefc0d0ac0 2024-09-13T18:36:32.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.907+0000 7efef27fc700 1 -- 172.21.15.44:0/1069730840 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efef8021030 con 0x7efefc0d0ac0 2024-09-13T18:36:32.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.907+0000 7eff028b5700 1 -- 172.21.15.44:0/1069730840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efefc0cb490 con 0x7efefc0d0ac0 2024-09-13T18:36:32.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.907+0000 7efef27fc700 1 --2- 172.21.15.44:0/1069730840 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efee0066730 0x7efee0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:32.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.911+0000 7efef27fc700 1 -- 172.21.15.44:0/1069730840 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5795+0+0 (secure 0 0 0) 0x7efef80855f0 con 0x7efefc0d0ac0 2024-09-13T18:36:32.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.911+0000 7eff018b3700 1 --2- 172.21.15.44:0/1069730840 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efee0066730 0x7efee0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:32.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.911+0000 7eff018b3700 1 --2- 172.21.15.44:0/1069730840 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efee0066730 0x7efee0068bf0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7efeec000f60 tx=0x7efeec007cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:32.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:32.919+0000 7efef27fc700 1 -- 172.21.15.44:0/1069730840 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efefc0cb490 con 0x7efefc0d0ac0 2024-09-13T18:36:33.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.087+0000 7eff028b5700 1 -- 172.21.15.44:0/1069730840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efefc0cb490 con 0x7efefc0d0ac0 2024-09-13T18:36:33.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.747+0000 7efef27fc700 1 -- 172.21.15.44:0/1069730840 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v92) v1 ==== 181+0+0 (secure 0 0 0) 0x7efefc0cb490 con 0x7efefc0d0ac0 2024-09-13T18:36:33.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.759+0000 7eff028b5700 1 -- 172.21.15.44:0/1069730840 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efee0066730 msgr2=0x7efee0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:33.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.759+0000 7eff028b5700 1 --2- 172.21.15.44:0/1069730840 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efee0066730 0x7efee0068bf0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7efeec000f60 tx=0x7efeec007cb0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.759+0000 7eff028b5700 1 -- 172.21.15.44:0/1069730840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efefc0d0ac0 msgr2=0x7efefc15f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:33.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.759+0000 7eff028b5700 1 --2- 172.21.15.44:0/1069730840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efefc0d0ac0 0x7efefc15f460 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7efef8009fd0 tx=0x7efef8004770 comp rx=0 tx=0).stop 2024-09-13T18:36:33.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.759+0000 7eff028b5700 1 -- 172.21.15.44:0/1069730840 shutdown_connections 2024-09-13T18:36:33.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.759+0000 7eff028b5700 1 --2- 172.21.15.44:0/1069730840 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7efee0066730 0x7efee0068bf0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.759+0000 7eff028b5700 1 --2- 172.21.15.44:0/1069730840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efefc15cec0 0x7efefc0a9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.759+0000 7eff028b5700 1 --2- 172.21.15.44:0/1069730840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efefc0d0ac0 0x7efefc15f460 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.759+0000 7eff028b5700 1 --2- 172.21.15.44:0/1069730840 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efefc0cdd40 0x7efefc15beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.759+0000 7eff028b5700 1 -- 172.21.15.44:0/1069730840 >> 172.21.15.44:0/1069730840 conn(0x7efefc0d2bc0 msgr2=0x7efefc0b7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:33.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.759+0000 7eff028b5700 1 -- 172.21.15.44:0/1069730840 shutdown_connections 2024-09-13T18:36:33.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.759+0000 7eff028b5700 1 -- 172.21.15.44:0/1069730840 wait complete. 2024-09-13T18:36:33.769 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:36:33.782 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:36:33.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf9709700 1 Processor -- start 2024-09-13T18:36:33.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf9709700 1 -- start start 2024-09-13T18:36:33.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf9709700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fedf406b2b0 0x7fedf4070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:33.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf9709700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fedf406dda0 0x7fedf40710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:33.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf9709700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf40723c0 con 0x7fedf4154fa0 2024-09-13T18:36:33.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf9709700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf4155380 con 0x7fedf406b2b0 2024-09-13T18:36:33.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf9709700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf415b240 con 0x7fedf406dda0 2024-09-13T18:36:33.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf3fff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fedf4154fa0 0x7fedf406aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39968/0 (socket says 172.21.15.44:39968) 2024-09-13T18:36:33.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf3fff700 1 -- 172.21.15.44:0/3034851504 learned_addr learned my addr 172.21.15.44:0/3034851504 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:33.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf8f08700 1 --2- 172.21.15.44:0/3034851504 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fedf406dda0 0x7fedf40710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:33.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf37fe700 1 --2- 172.21.15.44:0/3034851504 >> v2:172.21.15.99:3300/0 conn(0x7fedf406b2b0 0x7fedf4070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:33.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf2ffd700 1 -- 172.21.15.44:0/3034851504 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569107232 0 0) 0x7fedf40723c0 con 0x7fedf4154fa0 2024-09-13T18:36:33.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf2ffd700 1 -- 172.21.15.44:0/3034851504 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feddc0035d0 con 0x7fedf4154fa0 2024-09-13T18:36:33.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf2ffd700 1 -- 172.21.15.44:0/3034851504 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3878721022 0 0) 0x7feddc0035d0 con 0x7fedf4154fa0 2024-09-13T18:36:33.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf2ffd700 1 -- 172.21.15.44:0/3034851504 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fedf406dda0 msgr2=0x7fedf40710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:33.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf2ffd700 1 --2- 172.21.15.44:0/3034851504 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fedf406dda0 0x7fedf40710e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf2ffd700 1 -- 172.21.15.44:0/3034851504 >> v2:172.21.15.99:3300/0 conn(0x7fedf406b2b0 msgr2=0x7fedf4070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:33.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf2ffd700 1 --2- 172.21.15.44:0/3034851504 >> v2:172.21.15.99:3300/0 conn(0x7fedf406b2b0 0x7fedf4070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf2ffd700 1 -- 172.21.15.44:0/3034851504 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf40717b0 con 0x7fedf4154fa0 2024-09-13T18:36:33.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf2ffd700 1 -- 172.21.15.44:0/3034851504 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7fede4001670 con 0x7fedf4154fa0 2024-09-13T18:36:33.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf8f08700 1 --2- 172.21.15.44:0/3034851504 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fedf406dda0 0x7fedf40710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:33.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf2ffd700 1 -- 172.21.15.44:0/3034851504 >> v1:172.21.15.44:6789/0 conn(0x7fedf4154fa0 legacy=0x7fedf406aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:33.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf2ffd700 1 --2- 172.21.15.44:0/3034851504 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fedf406dda0 0x7feddc003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:33.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf2ffd700 1 --2- 172.21.15.44:0/3034851504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feddc003f60 0x7feddc004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:33.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf2ffd700 1 --2- 172.21.15.44:0/3034851504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feddc004db0 0x7feddc005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:33.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf2ffd700 1 -- 172.21.15.44:0/3034851504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf4155380 con 0x7feddc003f60 2024-09-13T18:36:33.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf2ffd700 1 -- 172.21.15.44:0/3034851504 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf415b240 con 0x7feddc004db0 2024-09-13T18:36:33.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf2ffd700 1 -- 172.21.15.44:0/3034851504 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc00ba30 con 0x7fedf406dda0 2024-09-13T18:36:33.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf37fe700 1 --2- 172.21.15.44:0/3034851504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feddc003f60 0x7feddc004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:33.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf3fff700 1 --2- 172.21.15.44:0/3034851504 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fedf406dda0 0x7feddc003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:33.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf8f08700 1 --2- 172.21.15.44:0/3034851504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feddc004db0 0x7feddc005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:33.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf37fe700 1 -- 172.21.15.44:0/3034851504 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fedf406dda0 msgr2=0x7feddc003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:33.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf37fe700 1 --2- 172.21.15.44:0/3034851504 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fedf406dda0 0x7feddc003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf37fe700 1 -- 172.21.15.44:0/3034851504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feddc004db0 msgr2=0x7feddc005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:33.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf37fe700 1 --2- 172.21.15.44:0/3034851504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feddc004db0 0x7feddc005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.895+0000 7fedf37fe700 1 -- 172.21.15.44:0/3034851504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec009a70 con 0x7feddc003f60 2024-09-13T18:36:33.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.899+0000 7fedf37fe700 1 --2- 172.21.15.44:0/3034851504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feddc003f60 0x7feddc004870 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fede8009b70 tx=0x7feddc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c8a0ff1e64b83d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:33.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.899+0000 7fedf2ffd700 1 -- 172.21.15.44:0/3034851504 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede800e6c0 con 0x7feddc003f60 2024-09-13T18:36:33.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.899+0000 7fedf2ffd700 1 -- 172.21.15.44:0/3034851504 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede800e820 con 0x7feddc003f60 2024-09-13T18:36:33.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.899+0000 7fedf2ffd700 1 -- 172.21.15.44:0/3034851504 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede800eb90 con 0x7feddc003f60 2024-09-13T18:36:33.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.899+0000 7fedf9709700 1 -- 172.21.15.44:0/3034851504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feddc003f60 msgr2=0x7feddc004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:33.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.899+0000 7fedf9709700 1 --2- 172.21.15.44:0/3034851504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feddc003f60 0x7feddc004870 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fede8009b70 tx=0x7feddc0058a0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.899+0000 7fedf8f08700 1 -- 172.21.15.44:0/3034851504 reap_dead start 2024-09-13T18:36:33.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.899+0000 7fedf9709700 1 -- 172.21.15.44:0/3034851504 shutdown_connections 2024-09-13T18:36:33.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.899+0000 7fedf9709700 1 -- 172.21.15.44:0/3034851504 >> 172.21.15.44:0/3034851504 conn(0x7fedf40cfad0 msgr2=0x7fedf40cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:33.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.899+0000 7fedf9709700 1 -- 172.21.15.44:0/3034851504 shutdown_connections 2024-09-13T18:36:33.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.899+0000 7fedf9709700 1 -- 172.21.15.44:0/3034851504 wait complete. 2024-09-13T18:36:33.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf9709700 1 Processor -- start 2024-09-13T18:36:33.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf9709700 1 -- start start 2024-09-13T18:36:33.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf9709700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feddc003f60 0x7fedf40cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:33.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf9709700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fedf414fba0 0x7fedf41f0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:33.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf9709700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fedf4150020 0x7fedf41f0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:33.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf9709700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf40ce1f0 con 0x7fedf414fba0 2024-09-13T18:36:33.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf9709700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf40ce4d0 con 0x7feddc003f60 2024-09-13T18:36:33.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf9709700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf40ce7b0 con 0x7fedf4150020 2024-09-13T18:36:33.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf37fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fedf414fba0 0x7fedf41f0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:33.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf37fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fedf414fba0 0x7fedf41f0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42630/0 (socket says 172.21.15.44:42630) 2024-09-13T18:36:33.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf37fe700 1 -- 172.21.15.44:0/2062377236 learned_addr learned my addr 172.21.15.44:0/2062377236 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:33.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf3fff700 1 --2- 172.21.15.44:0/2062377236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feddc003f60 0x7fedf40cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:33.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf37fe700 1 -- 172.21.15.44:0/2062377236 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fedf4150020 msgr2=0x7fedf41f0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:33.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf8f08700 1 --2- 172.21.15.44:0/2062377236 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fedf4150020 0x7fedf41f0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:33.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf37fe700 1 --2- 172.21.15.44:0/2062377236 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fedf4150020 0x7fedf41f0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf37fe700 1 -- 172.21.15.44:0/2062377236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feddc003f60 msgr2=0x7fedf40cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:33.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf37fe700 1 --2- 172.21.15.44:0/2062377236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feddc003f60 0x7fedf40cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf37fe700 1 -- 172.21.15.44:0/2062377236 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf40cea90 con 0x7fedf414fba0 2024-09-13T18:36:33.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf3fff700 1 --2- 172.21.15.44:0/2062377236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feddc003f60 0x7fedf40cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:33.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf8f08700 1 --2- 172.21.15.44:0/2062377236 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fedf4150020 0x7fedf41f0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:33.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf37fe700 1 --2- 172.21.15.44:0/2062377236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fedf414fba0 0x7fedf41f0050 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fede8000c00 tx=0x7fede80047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:33.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf0ff9700 1 -- 172.21.15.44:0/2062377236 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede800e6c0 con 0x7fedf414fba0 2024-09-13T18:36:33.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf0ff9700 1 -- 172.21.15.44:0/2062377236 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede8004240 con 0x7fedf414fba0 2024-09-13T18:36:33.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf9709700 1 -- 172.21.15.44:0/2062377236 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf41f0ad0 con 0x7fedf414fba0 2024-09-13T18:36:33.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf0ff9700 1 -- 172.21.15.44:0/2062377236 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede80036c0 con 0x7fedf414fba0 2024-09-13T18:36:33.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.903+0000 7fedf9709700 1 -- 172.21.15.44:0/2062377236 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf414d680 con 0x7fedf414fba0 2024-09-13T18:36:33.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.907+0000 7fedf9709700 1 -- 172.21.15.44:0/2062377236 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf406e790 con 0x7fedf414fba0 2024-09-13T18:36:33.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.907+0000 7fedf0ff9700 1 -- 172.21.15.44:0/2062377236 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fede8003820 con 0x7fedf414fba0 2024-09-13T18:36:33.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.907+0000 7fedf0ff9700 1 --2- 172.21.15.44:0/2062377236 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fede0066760 0x7fede0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:33.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.907+0000 7fedf0ff9700 1 -- 172.21.15.44:0/2062377236 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fede8085d40 con 0x7fedf414fba0 2024-09-13T18:36:33.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.907+0000 7fedf3fff700 1 --2- 172.21.15.44:0/2062377236 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fede0066760 0x7fede0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:33.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.911+0000 7fedf3fff700 1 --2- 172.21.15.44:0/2062377236 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fede0066760 0x7fede0068c20 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fedf414f250 tx=0x7fede4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:33.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:33.919+0000 7fedf0ff9700 1 -- 172.21.15.44:0/2062377236 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fede8056e50 con 0x7fedf414fba0 2024-09-13T18:36:34.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.095+0000 7fedf9709700 1 -- 172.21.15.44:0/2062377236 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fedf406e790 con 0x7fedf414fba0 2024-09-13T18:36:34.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.767+0000 7fedf0ff9700 1 -- 172.21.15.44:0/2062377236 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v93) v1 ==== 169+0+0 (secure 0 0 0) 0x7fede80569e0 con 0x7fedf414fba0 2024-09-13T18:36:34.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.771+0000 7fedf9709700 1 -- 172.21.15.44:0/2062377236 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fede0066760 msgr2=0x7fede0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:34.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.771+0000 7fedf9709700 1 --2- 172.21.15.44:0/2062377236 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fede0066760 0x7fede0068c20 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fedf414f250 tx=0x7fede4009040 comp rx=0 tx=0).stop 2024-09-13T18:36:34.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.771+0000 7fedf9709700 1 -- 172.21.15.44:0/2062377236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fedf414fba0 msgr2=0x7fedf41f0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:34.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.771+0000 7fedf9709700 1 --2- 172.21.15.44:0/2062377236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fedf414fba0 0x7fedf41f0050 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fede8000c00 tx=0x7fede80047e0 comp rx=0 tx=0).stop 2024-09-13T18:36:34.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.771+0000 7fedf9709700 1 -- 172.21.15.44:0/2062377236 shutdown_connections 2024-09-13T18:36:34.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.771+0000 7fedf9709700 1 --2- 172.21.15.44:0/2062377236 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fede0066760 0x7fede0068c20 secure :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fedf414f250 tx=0x7fede4009040 comp rx=0 tx=0).stop 2024-09-13T18:36:34.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.771+0000 7fedf9709700 1 --2- 172.21.15.44:0/2062377236 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fedf4150020 0x7fedf41f0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:34.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.771+0000 7fedf9709700 1 --2- 172.21.15.44:0/2062377236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fedf414fba0 0x7fedf41f0050 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:34.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.771+0000 7fedf9709700 1 --2- 172.21.15.44:0/2062377236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feddc003f60 0x7fedf40cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:34.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.771+0000 7fedf9709700 1 -- 172.21.15.44:0/2062377236 >> 172.21.15.44:0/2062377236 conn(0x7fedf40cfad0 msgr2=0x7fedf415c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:34.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.771+0000 7fedf9709700 1 -- 172.21.15.44:0/2062377236 shutdown_connections 2024-09-13T18:36:34.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.775+0000 7fedf9709700 1 -- 172.21.15.44:0/2062377236 wait complete. 2024-09-13T18:36:34.784 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2024-09-13T18:36:34.798 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:36:34.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.903+0000 7f6705f19700 1 Processor -- start 2024-09-13T18:36:34.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.903+0000 7f6705f19700 1 -- start start 2024-09-13T18:36:34.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f6705f19700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6700159760 0x7f67000b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:34.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f6705f19700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f670006d4e0 0x7f6700072120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:34.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f6705f19700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6700072660 con 0x7f6700070bf0 2024-09-13T18:36:34.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f6705f19700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6700071d00 con 0x7f6700159760 2024-09-13T18:36:34.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f6705f19700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6700071080 con 0x7f670006d4e0 2024-09-13T18:36:34.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f66fffff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f6700070bf0 0x7f670006cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39970/0 (socket says 172.21.15.44:39970) 2024-09-13T18:36:34.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f66fffff700 1 -- 172.21.15.44:0/4227786918 learned_addr learned my addr 172.21.15.44:0/4227786918 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:34.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f6704f17700 1 --2- 172.21.15.44:0/4227786918 >> v2:172.21.15.99:3300/0 conn(0x7f6700159760 0x7f67000b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:34.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f6705718700 1 --2- 172.21.15.44:0/4227786918 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f670006d4e0 0x7f6700072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:34.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f66ff7fe700 1 -- 172.21.15.44:0/4227786918 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3219245717 0 0) 0x7f6700072660 con 0x7f6700070bf0 2024-09-13T18:36:34.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f66ff7fe700 1 -- 172.21.15.44:0/4227786918 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66e80035d0 con 0x7f6700070bf0 2024-09-13T18:36:34.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f6704f17700 1 -- 172.21.15.44:0/4227786918 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f670006d4e0 msgr2=0x7f6700072120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:34.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f6704f17700 1 --2- 172.21.15.44:0/4227786918 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f670006d4e0 0x7f6700072120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:34.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f6704f17700 1 -- 172.21.15.44:0/4227786918 >> v1:172.21.15.44:6789/0 conn(0x7f6700070bf0 legacy=0x7f670006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:34.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f6704f17700 1 -- 172.21.15.44:0/4227786918 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6700071360 con 0x7f6700159760 2024-09-13T18:36:34.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f6705718700 1 --2- 172.21.15.44:0/4227786918 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f670006d4e0 0x7f6700072120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:34.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f6704f17700 1 --2- 172.21.15.44:0/4227786918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6700159760 0x7f67000b46a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009850 tx=0x7f66f0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ee5ee3dd7626255 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:34.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f66ff7fe700 1 -- 172.21.15.44:0/4227786918 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0011830 con 0x7f6700159760 2024-09-13T18:36:34.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f66ff7fe700 1 -- 172.21.15.44:0/4227786918 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f0011990 con 0x7f6700159760 2024-09-13T18:36:34.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f66ff7fe700 1 -- 172.21.15.44:0/4227786918 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0011d40 con 0x7f6700159760 2024-09-13T18:36:34.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f6705f19700 1 -- 172.21.15.44:0/4227786918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6700159760 msgr2=0x7f67000b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:34.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f6705f19700 1 --2- 172.21.15.44:0/4227786918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6700159760 0x7f67000b46a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009850 tx=0x7f66f0009b60 comp rx=0 tx=0).stop 2024-09-13T18:36:34.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f6705f19700 1 -- 172.21.15.44:0/4227786918 shutdown_connections 2024-09-13T18:36:34.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f6705f19700 1 --2- 172.21.15.44:0/4227786918 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f670006d4e0 0x7f6700072120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:34.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f6705f19700 1 --2- 172.21.15.44:0/4227786918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6700159760 0x7f67000b46a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:34.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f6705f19700 1 -- 172.21.15.44:0/4227786918 >> 172.21.15.44:0/4227786918 conn(0x7f67000b1810 msgr2=0x7f67000b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:34.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f6705f19700 1 -- 172.21.15.44:0/4227786918 shutdown_connections 2024-09-13T18:36:34.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f6705f19700 1 -- 172.21.15.44:0/4227786918 wait complete. 2024-09-13T18:36:34.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f6705f19700 1 Processor -- start 2024-09-13T18:36:34.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.907+0000 7f6705f19700 1 -- start start 2024-09-13T18:36:34.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f6705f19700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f670006d4e0 0x7f670015b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:34.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f6705f19700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6700159760 0x7f670014e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:34.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f6705f19700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f670015ae30 0x7f6700152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:34.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f6705f19700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6700150600 con 0x7f6700159760 2024-09-13T18:36:34.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f6705f19700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67001508e0 con 0x7f670015ae30 2024-09-13T18:36:34.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f6705f19700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6700150bc0 con 0x7f670006d4e0 2024-09-13T18:36:34.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f6704f17700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f670006d4e0 0x7f670015b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:34.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f66fffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6700159760 0x7f670014e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:34.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f6704f17700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f670006d4e0 0x7f670015b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:58948/0 (socket says 172.21.15.44:58948) 2024-09-13T18:36:34.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f6704f17700 1 -- 172.21.15.44:0/28468525 learned_addr learned my addr 172.21.15.44:0/28468525 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:34.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f6705718700 1 --2- 172.21.15.44:0/28468525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f670015ae30 0x7f6700152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:34.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f6704f17700 1 -- 172.21.15.44:0/28468525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f670015ae30 msgr2=0x7f6700152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:34.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f6704f17700 1 --2- 172.21.15.44:0/28468525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f670015ae30 0x7f6700152410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:34.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f6704f17700 1 -- 172.21.15.44:0/28468525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6700159760 msgr2=0x7f670014e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:34.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f6704f17700 1 --2- 172.21.15.44:0/28468525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6700159760 0x7f670014e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:34.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f6704f17700 1 -- 172.21.15.44:0/28468525 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f8009a70 con 0x7f670006d4e0 2024-09-13T18:36:34.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f6704f17700 1 --2- 172.21.15.44:0/28468525 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f670006d4e0 0x7f670015b6c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f66f0014040 tx=0x7f66f0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:34.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f66fd7fa700 1 -- 172.21.15.44:0/28468525 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f00044d0 con 0x7f670006d4e0 2024-09-13T18:36:34.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f66fd7fa700 1 -- 172.21.15.44:0/28468525 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f001e070 con 0x7f670006d4e0 2024-09-13T18:36:34.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f6705f19700 1 -- 172.21.15.44:0/28468525 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f00094b0 con 0x7f670006d4e0 2024-09-13T18:36:34.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f66fd7fa700 1 -- 172.21.15.44:0/28468525 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0003900 con 0x7f670006d4e0 2024-09-13T18:36:34.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f6705f19700 1 -- 172.21.15.44:0/28468525 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6700155fe0 con 0x7f670006d4e0 2024-09-13T18:36:34.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f66fd7fa700 1 -- 172.21.15.44:0/28468525 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f66f0003a60 con 0x7f670006d4e0 2024-09-13T18:36:34.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.911+0000 7f6705f19700 1 -- 172.21.15.44:0/28468525 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6700159cb0 con 0x7f670006d4e0 2024-09-13T18:36:34.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.915+0000 7f66fd7fa700 1 --2- 172.21.15.44:0/28468525 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f66ec066760 0x7f66ec068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:34.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.915+0000 7f66fd7fa700 1 -- 172.21.15.44:0/28468525 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f66f0020070 con 0x7f670006d4e0 2024-09-13T18:36:34.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.915+0000 7f66fffff700 1 --2- 172.21.15.44:0/28468525 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f66ec066760 0x7f66ec068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:34.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.915+0000 7f66fffff700 1 --2- 172.21.15.44:0/28468525 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f66ec066760 0x7f66ec068c20 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f670014f490 tx=0x7f66f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:34.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:34.919+0000 7f66fd7fa700 1 -- 172.21.15.44:0/28468525 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f66f00b6db0 con 0x7f670006d4e0 2024-09-13T18:36:35.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.091+0000 7f6705f19700 1 -- 172.21.15.44:0/28468525 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f67000cbd70 con 0x7f670006d4e0 2024-09-13T18:36:35.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.099+0000 7f66fd7fa700 1 -- 172.21.15.44:0/28468525 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f66f0052840 con 0x7f670006d4e0 2024-09-13T18:36:35.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.103+0000 7f6705f19700 1 -- 172.21.15.44:0/28468525 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f66ec066760 msgr2=0x7f66ec068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:35.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.103+0000 7f6705f19700 1 --2- 172.21.15.44:0/28468525 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f66ec066760 0x7f66ec068c20 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f670014f490 tx=0x7f66f4009040 comp rx=0 tx=0).stop 2024-09-13T18:36:35.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.103+0000 7f6705f19700 1 -- 172.21.15.44:0/28468525 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f670006d4e0 msgr2=0x7f670015b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:35.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.103+0000 7f6705f19700 1 --2- 172.21.15.44:0/28468525 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f670006d4e0 0x7f670015b6c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f66f0014040 tx=0x7f66f0004770 comp rx=0 tx=0).stop 2024-09-13T18:36:35.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.103+0000 7f6705f19700 1 -- 172.21.15.44:0/28468525 shutdown_connections 2024-09-13T18:36:35.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.103+0000 7f6705f19700 1 --2- 172.21.15.44:0/28468525 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f66ec066760 0x7f66ec068c20 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.103+0000 7f6705f19700 1 --2- 172.21.15.44:0/28468525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f670015ae30 0x7f6700152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.103+0000 7f6705f19700 1 --2- 172.21.15.44:0/28468525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6700159760 0x7f670014e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.103+0000 7f6705f19700 1 --2- 172.21.15.44:0/28468525 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f670006d4e0 0x7f670015b6c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.103+0000 7f6705f19700 1 -- 172.21.15.44:0/28468525 >> 172.21.15.44:0/28468525 conn(0x7f67000b1810 msgr2=0x7f67000ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:35.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.103+0000 7f6705f19700 1 -- 172.21.15.44:0/28468525 shutdown_connections 2024-09-13T18:36:35.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.103+0000 7f6705f19700 1 -- 172.21.15.44:0/28468525 wait complete. 2024-09-13T18:36:35.126 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool_take_inos' 2024-09-13T18:36:35.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1216b44700 1 Processor -- start 2024-09-13T18:36:35.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1216b44700 1 -- start start 2024-09-13T18:36:35.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1216b44700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f12100b3ae0 0x7f121006cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:35.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1216b44700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f121006aa90 0x7f12100ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:35.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1216b44700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121006af40 con 0x7f1210159720 2024-09-13T18:36:35.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1216b44700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121006d690 con 0x7f121006aa90 2024-09-13T18:36:35.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1216b44700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12100cbfe0 con 0x7f12100b3ae0 2024-09-13T18:36:35.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1216343700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f121006aa90 0x7f12100ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:35.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1216343700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f121006aa90 0x7f12100ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42648/0 (socket says 172.21.15.44:42648) 2024-09-13T18:36:35.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1216343700 1 -- 172.21.15.44:0/930039523 learned_addr learned my addr 172.21.15.44:0/930039523 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:35.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1215b42700 1 --1- 172.21.15.44:0/930039523 >> v1:172.21.15.44:6789/0 conn(0x7f1210159720 0x7f12100b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39974/0 (socket says 172.21.15.44:39974) 2024-09-13T18:36:35.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1215341700 1 --2- 172.21.15.44:0/930039523 >> v2:172.21.15.99:3300/0 conn(0x7f12100b3ae0 0x7f121006cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:35.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1216343700 1 -- 172.21.15.44:0/930039523 >> v2:172.21.15.99:3300/0 conn(0x7f12100b3ae0 msgr2=0x7f121006cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:35.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1216343700 1 --2- 172.21.15.44:0/930039523 >> v2:172.21.15.99:3300/0 conn(0x7f12100b3ae0 0x7f121006cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1216343700 1 -- 172.21.15.44:0/930039523 >> v1:172.21.15.44:6789/0 conn(0x7f1210159720 legacy=0x7f12100b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:35.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1216343700 1 -- 172.21.15.44:0/930039523 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12100cc2c0 con 0x7f121006aa90 2024-09-13T18:36:35.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1216343700 1 --2- 172.21.15.44:0/930039523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f121006aa90 0x7f12100ccac0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f121006b190 tx=0x7f120800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e11fd5da607faa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:35.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1214b40700 1 -- 172.21.15.44:0/930039523 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120800e070 con 0x7f121006aa90 2024-09-13T18:36:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1214b40700 1 -- 172.21.15.44:0/930039523 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120800b9c0 con 0x7f121006aa90 2024-09-13T18:36:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1214b40700 1 -- 172.21.15.44:0/930039523 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120800bd70 con 0x7f121006aa90 2024-09-13T18:36:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1216b44700 1 -- 172.21.15.44:0/930039523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f121006aa90 msgr2=0x7f12100ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1216b44700 1 --2- 172.21.15.44:0/930039523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f121006aa90 0x7f12100ccac0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f121006b190 tx=0x7f120800b330 comp rx=0 tx=0).stop 2024-09-13T18:36:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1216b44700 1 -- 172.21.15.44:0/930039523 shutdown_connections 2024-09-13T18:36:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1216b44700 1 --2- 172.21.15.44:0/930039523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f121006aa90 0x7f12100ccac0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1216b44700 1 --2- 172.21.15.44:0/930039523 >> v2:172.21.15.99:3300/0 conn(0x7f12100b3ae0 0x7f121006cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1216b44700 1 -- 172.21.15.44:0/930039523 >> 172.21.15.44:0/930039523 conn(0x7f12100b0f00 msgr2=0x7f12100b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1216b44700 1 -- 172.21.15.44:0/930039523 shutdown_connections 2024-09-13T18:36:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.239+0000 7f1216b44700 1 -- 172.21.15.44:0/930039523 wait complete. 2024-09-13T18:36:35.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.243+0000 7f1216b44700 1 Processor -- start 2024-09-13T18:36:35.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.243+0000 7f1216b44700 1 -- start start 2024-09-13T18:36:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.243+0000 7f1216b44700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f121006aa90 0x7f121014e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.243+0000 7f1216b44700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12100b3ae0 0x7f12101e3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.243+0000 7f1216b44700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1210159720 0x7f1210155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.243+0000 7f1216b44700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12101e4970 con 0x7f1210159720 2024-09-13T18:36:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.243+0000 7f1216b44700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12101e1fc0 con 0x7f12100b3ae0 2024-09-13T18:36:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.243+0000 7f1216b44700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12101e4690 con 0x7f121006aa90 2024-09-13T18:36:35.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.243+0000 7f1216343700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1210159720 0x7f1210155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:35.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.243+0000 7f1216343700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1210159720 0x7f1210155e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42654/0 (socket says 172.21.15.44:42654) 2024-09-13T18:36:35.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.243+0000 7f1215b42700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f121006aa90 0x7f121014e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:35.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.243+0000 7f1216343700 1 -- 172.21.15.44:0/1974223331 learned_addr learned my addr 172.21.15.44:0/1974223331 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:35.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.243+0000 7f1215341700 1 --2- 172.21.15.44:0/1974223331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12100b3ae0 0x7f12101e3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:35.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.243+0000 7f1216343700 1 -- 172.21.15.44:0/1974223331 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f121006aa90 msgr2=0x7f121014e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:35.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.243+0000 7f1216343700 1 --2- 172.21.15.44:0/1974223331 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f121006aa90 0x7f121014e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.243+0000 7f1216343700 1 -- 172.21.15.44:0/1974223331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12100b3ae0 msgr2=0x7f12101e3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:35.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.243+0000 7f1216343700 1 --2- 172.21.15.44:0/1974223331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12100b3ae0 0x7f12101e3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.243+0000 7f1216343700 1 -- 172.21.15.44:0/1974223331 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1208009b30 con 0x7f1210159720 2024-09-13T18:36:35.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.247+0000 7f1216343700 1 --2- 172.21.15.44:0/1974223331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1210159720 0x7f1210155e10 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f1210071e20 tx=0x7f1208004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:35.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.247+0000 7f12067fc700 1 -- 172.21.15.44:0/1974223331 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1208004880 con 0x7f1210159720 2024-09-13T18:36:35.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.247+0000 7f12067fc700 1 -- 172.21.15.44:0/1974223331 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12080099b0 con 0x7f1210159720 2024-09-13T18:36:35.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.247+0000 7f12067fc700 1 -- 172.21.15.44:0/1974223331 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120801c680 con 0x7f1210159720 2024-09-13T18:36:35.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.247+0000 7f1216b44700 1 -- 172.21.15.44:0/1974223331 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12101e2210 con 0x7f1210159720 2024-09-13T18:36:35.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.247+0000 7f1216b44700 1 -- 172.21.15.44:0/1974223331 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12101e27d0 con 0x7f1210159720 2024-09-13T18:36:35.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.247+0000 7f1216b44700 1 -- 172.21.15.44:0/1974223331 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12100ccac0 con 0x7f1210159720 2024-09-13T18:36:35.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.247+0000 7f12067fc700 1 -- 172.21.15.44:0/1974223331 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f120801c7e0 con 0x7f1210159720 2024-09-13T18:36:35.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.251+0000 7f12067fc700 1 --2- 172.21.15.44:0/1974223331 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f11f4066730 0x7f11f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:35.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.251+0000 7f12067fc700 1 -- 172.21.15.44:0/1974223331 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1208085980 con 0x7f1210159720 2024-09-13T18:36:35.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.251+0000 7f1215b42700 1 --2- 172.21.15.44:0/1974223331 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f11f4066730 0x7f11f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:35.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.251+0000 7f1215b42700 1 --2- 172.21.15.44:0/1974223331 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f11f4066730 0x7f11f4068bf0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1200000f60 tx=0x7f1200007ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:35.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.255+0000 7f12067fc700 1 -- 172.21.15.44:0/1974223331 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1208053080 con 0x7f1210159720 2024-09-13T18:36:35.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.491+0000 7f1216b44700 1 -- 172.21.15.44:0/1974223331 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool_take_inos"]} v 0) v1 -- 0x7f12100cb550 con 0x7f1210159720 2024-09-13T18:36:35.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.763+0000 7f12067fc700 1 -- 172.21.15.44:0/1974223331 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_table_tool_take_inos"]}]=0 v427) v1 ==== 155+0+0 (secure 0 0 0) 0x7f12080566a0 con 0x7f1210159720 2024-09-13T18:36:35.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.767+0000 7f1216b44700 1 -- 172.21.15.44:0/1974223331 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f11f4066730 msgr2=0x7f11f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:35.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.767+0000 7f1216b44700 1 --2- 172.21.15.44:0/1974223331 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f11f4066730 0x7f11f4068bf0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1200000f60 tx=0x7f1200007ef0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.767+0000 7f1216b44700 1 -- 172.21.15.44:0/1974223331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1210159720 msgr2=0x7f1210155e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:35.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.767+0000 7f1216b44700 1 --2- 172.21.15.44:0/1974223331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1210159720 0x7f1210155e10 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f1210071e20 tx=0x7f1208004af0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.767+0000 7f1216b44700 1 -- 172.21.15.44:0/1974223331 shutdown_connections 2024-09-13T18:36:35.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.767+0000 7f1216b44700 1 --2- 172.21.15.44:0/1974223331 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f11f4066730 0x7f11f4068bf0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.767+0000 7f1216b44700 1 --2- 172.21.15.44:0/1974223331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1210159720 0x7f1210155e10 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.767+0000 7f1216b44700 1 --2- 172.21.15.44:0/1974223331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12100b3ae0 0x7f12101e3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.767+0000 7f1216b44700 1 --2- 172.21.15.44:0/1974223331 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f121006aa90 0x7f121014e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.767+0000 7f1216b44700 1 -- 172.21.15.44:0/1974223331 >> 172.21.15.44:0/1974223331 conn(0x7f12100b0f00 msgr2=0x7f12100cd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:35.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.767+0000 7f1216b44700 1 -- 172.21.15.44:0/1974223331 shutdown_connections 2024-09-13T18:36:35.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:35.767+0000 7f1216b44700 1 -- 172.21.15.44:0/1974223331 wait complete. 2024-09-13T18:36:35.792 INFO:tasks.cephfs_test_runner:test_table_tool_take_inos (tasks.cephfs.test_journal_repair.TestJournalRepair) ... ok 2024-09-13T18:36:35.792 INFO:tasks.cephfs_test_runner: 2024-09-13T18:36:35.792 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-13T18:36:35.792 INFO:tasks.cephfs_test_runner:Ran 5 tests in 541.162s 2024-09-13T18:36:35.793 INFO:tasks.cephfs_test_runner: 2024-09-13T18:36:35.793 INFO:tasks.cephfs_test_runner:OK 2024-09-13T18:36:35.793 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-13T18:36:35.808 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-13T18:36:35.856 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-13T18:36:35.857 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:36:35.857 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:35.865 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349428k,nr_inodes=4087357,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16693 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276112k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:36:35.865 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-13T18:36:35.865 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:35.872 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349428k,nr_inodes=4087357,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16693 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276112k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276116k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:36:35.873 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:36:35.873 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:35.881 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346268k,nr_inodes=4086567,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19562 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275480k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:36:35.881 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T18:36:35.881 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:35.888 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346268k,nr_inodes=4086567,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19562 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275480k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275484k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:36:35.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:35.888 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-13T18:36:35.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:36:35.896 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:36:35.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:35.897 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:36:35.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:35.952 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:36:35.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:35.964 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link delete ceph-brx 2024-09-13T18:36:36.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:36.115 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-13T18:36:36.123 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:36:36.123 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:36:36.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:36.123 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:36:36.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:36.136 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:36:36.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:36.221 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2024-09-13T18:36:36.360 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T18:36:36.370 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T18:36:36.371 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:36:36.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1df269f700 1 Processor -- start 2024-09-13T18:36:36.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1df269f700 1 -- start start 2024-09-13T18:36:36.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1df269f700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1dec15b890 0x7f1dec162220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:36.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1df269f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1dec0b2b00 0x7f1dec06ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:36.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1df269f700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dec162760 con 0x7f1dec0cdcc0 2024-09-13T18:36:36.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1df269f700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dec15bc70 con 0x7f1dec15b890 2024-09-13T18:36:36.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1df269f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec0ccc20 con 0x7f1dec0b2b00 2024-09-13T18:36:36.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1de37fe700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1dec0cdcc0 0x7f1dec0b23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39984/0 (socket says 172.21.15.44:39984) 2024-09-13T18:36:36.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1de37fe700 1 -- 172.21.15.44:0/2069981164 learned_addr learned my addr 172.21.15.44:0/2069981164 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:36.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1df0c3c700 1 --2- 172.21.15.44:0/2069981164 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1dec0b2b00 0x7f1dec06ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:36.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1debfff700 1 --2- 172.21.15.44:0/2069981164 >> v2:172.21.15.99:3300/0 conn(0x7f1dec15b890 0x7f1dec162220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:36.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1deb7fe700 1 -- 172.21.15.44:0/2069981164 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1565550693 0 0) 0x7f1dec162760 con 0x7f1dec0cdcc0 2024-09-13T18:36:36.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1deb7fe700 1 -- 172.21.15.44:0/2069981164 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dd80035d0 con 0x7f1dec0cdcc0 2024-09-13T18:36:36.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1deb7fe700 1 -- 172.21.15.44:0/2069981164 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3824041153 0 0) 0x7f1dd80035d0 con 0x7f1dec0cdcc0 2024-09-13T18:36:36.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1deb7fe700 1 -- 172.21.15.44:0/2069981164 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1dec0b2b00 msgr2=0x7f1dec06ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:36.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1deb7fe700 1 --2- 172.21.15.44:0/2069981164 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1dec0b2b00 0x7f1dec06ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1deb7fe700 1 -- 172.21.15.44:0/2069981164 >> v2:172.21.15.99:3300/0 conn(0x7f1dec15b890 msgr2=0x7f1dec162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:36.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1deb7fe700 1 --2- 172.21.15.44:0/2069981164 >> v2:172.21.15.99:3300/0 conn(0x7f1dec15b890 0x7f1dec162220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1deb7fe700 1 -- 172.21.15.44:0/2069981164 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec0ccf00 con 0x7f1dec0cdcc0 2024-09-13T18:36:36.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1deb7fe700 1 -- 172.21.15.44:0/2069981164 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1648759056 0 0) 0x7f1dd4001670 con 0x7f1dec0cdcc0 2024-09-13T18:36:36.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1deb7fe700 1 -- 172.21.15.44:0/2069981164 >> v1:172.21.15.44:6789/0 conn(0x7f1dec0cdcc0 legacy=0x7f1dec0b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:36.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1deb7fe700 1 --2- 172.21.15.44:0/2069981164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dd8003a20 0x7f1dd8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:36.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1deb7fe700 1 --2- 172.21.15.44:0/2069981164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1dd8004870 0x7f1dd8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:36.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1deb7fe700 1 --2- 172.21.15.44:0/2069981164 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1dec0b2b00 0x7f1dd8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:36.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1deb7fe700 1 -- 172.21.15.44:0/2069981164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec15bc70 con 0x7f1dd8003a20 2024-09-13T18:36:36.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1deb7fe700 1 -- 172.21.15.44:0/2069981164 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec0ccc20 con 0x7f1dd8004870 2024-09-13T18:36:36.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1deb7fe700 1 -- 172.21.15.44:0/2069981164 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd800ba30 con 0x7f1dec0b2b00 2024-09-13T18:36:36.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1debfff700 1 --2- 172.21.15.44:0/2069981164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dd8003a20 0x7f1dd8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:36.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1de37fe700 1 --2- 172.21.15.44:0/2069981164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1dd8004870 0x7f1dd8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:36.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1df0c3c700 1 --2- 172.21.15.44:0/2069981164 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1dec0b2b00 0x7f1dd8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:36.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1debfff700 1 -- 172.21.15.44:0/2069981164 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1dec0b2b00 msgr2=0x7f1dd8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:36.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1debfff700 1 --2- 172.21.15.44:0/2069981164 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1dec0b2b00 0x7f1dd8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1debfff700 1 -- 172.21.15.44:0/2069981164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1dd8004870 msgr2=0x7f1dd8004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:36.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1debfff700 1 --2- 172.21.15.44:0/2069981164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1dd8004870 0x7f1dd8004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1debfff700 1 -- 172.21.15.44:0/2069981164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd80035d0 con 0x7f1dd8003a20 2024-09-13T18:36:36.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1de37fe700 1 --2- 172.21.15.44:0/2069981164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1dd8004870 0x7f1dd8004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:36.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1debfff700 1 --2- 172.21.15.44:0/2069981164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dd8003a20 0x7f1dd8003e40 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc009ba0 tx=0x7f1dd80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5fa0fb01076893 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:36.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.487+0000 7f1deb7fe700 1 -- 172.21.15.44:0/2069981164 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc00e6c0 con 0x7f1dd8003a20 2024-09-13T18:36:36.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.491+0000 7f1deb7fe700 1 -- 172.21.15.44:0/2069981164 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ddc00e820 con 0x7f1dd8003a20 2024-09-13T18:36:36.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.491+0000 7f1deb7fe700 1 -- 172.21.15.44:0/2069981164 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc00eb90 con 0x7f1dd8003a20 2024-09-13T18:36:36.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.491+0000 7f1df269f700 1 -- 172.21.15.44:0/2069981164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dd8003a20 msgr2=0x7f1dd8003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:36.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.491+0000 7f1df269f700 1 --2- 172.21.15.44:0/2069981164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dd8003a20 0x7f1dd8003e40 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc009ba0 tx=0x7f1dd80058a0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.491+0000 7f1df0c3c700 1 -- 172.21.15.44:0/2069981164 reap_dead start 2024-09-13T18:36:36.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.491+0000 7f1df269f700 1 -- 172.21.15.44:0/2069981164 shutdown_connections 2024-09-13T18:36:36.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.491+0000 7f1df269f700 1 -- 172.21.15.44:0/2069981164 >> 172.21.15.44:0/2069981164 conn(0x7f1dec0ce980 msgr2=0x7f1dec0ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:36.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.491+0000 7f1df269f700 1 -- 172.21.15.44:0/2069981164 shutdown_connections 2024-09-13T18:36:36.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.491+0000 7f1df269f700 1 -- 172.21.15.44:0/2069981164 wait complete. 2024-09-13T18:36:36.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.491+0000 7f1df269f700 1 Processor -- start 2024-09-13T18:36:36.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.491+0000 7f1df269f700 1 -- start start 2024-09-13T18:36:36.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.495+0000 7f1df269f700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1dec1599b0 0x7f1dec06c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:36.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.495+0000 7f1df269f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dec06c590 0x7f1dec159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:36.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.495+0000 7f1df269f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1dec15a2d0 0x7f1dec163450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:36.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.495+0000 7f1df269f700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec162fc0 con 0x7f1dec06c590 2024-09-13T18:36:36.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.495+0000 7f1df269f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec164700 con 0x7f1dec15a2d0 2024-09-13T18:36:36.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.495+0000 7f1df269f700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec06cad0 con 0x7f1dec1599b0 2024-09-13T18:36:36.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.495+0000 7f1de37fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dec06c590 0x7f1dec159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:36.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.495+0000 7f1debfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1dec1599b0 0x7f1dec06c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:36.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.495+0000 7f1df0c3c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1dec15a2d0 0x7f1dec163450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:36.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.495+0000 7f1de37fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dec06c590 0x7f1dec159d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42678/0 (socket says 172.21.15.44:42678) 2024-09-13T18:36:36.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.495+0000 7f1de37fe700 1 -- 172.21.15.44:0/204126808 learned_addr learned my addr 172.21.15.44:0/204126808 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:36.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.495+0000 7f1de37fe700 1 -- 172.21.15.44:0/204126808 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1dec1599b0 msgr2=0x7f1dec06c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:36.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.495+0000 7f1de37fe700 1 --2- 172.21.15.44:0/204126808 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1dec1599b0 0x7f1dec06c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.495+0000 7f1de37fe700 1 -- 172.21.15.44:0/204126808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1dec15a2d0 msgr2=0x7f1dec163450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:36.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.495+0000 7f1de37fe700 1 --2- 172.21.15.44:0/204126808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1dec15a2d0 0x7f1dec163450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.495+0000 7f1de37fe700 1 -- 172.21.15.44:0/204126808 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec06cdb0 con 0x7f1dec06c590 2024-09-13T18:36:36.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.495+0000 7f1debfff700 1 --2- 172.21.15.44:0/204126808 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1dec1599b0 0x7f1dec06c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:36.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.495+0000 7f1de37fe700 1 --2- 172.21.15.44:0/204126808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dec06c590 0x7f1dec159d90 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4007450 tx=0x7f1dd4007760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:36.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.495+0000 7f1de97fa700 1 -- 172.21.15.44:0/204126808 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4007830 con 0x7f1dec06c590 2024-09-13T18:36:36.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.495+0000 7f1de97fa700 1 -- 172.21.15.44:0/204126808 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd400f870 con 0x7f1dec06c590 2024-09-13T18:36:36.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.495+0000 7f1df269f700 1 -- 172.21.15.44:0/204126808 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dec06d090 con 0x7f1dec06c590 2024-09-13T18:36:36.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.495+0000 7f1de97fa700 1 -- 172.21.15.44:0/204126808 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd400fbe0 con 0x7f1dec06c590 2024-09-13T18:36:36.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.495+0000 7f1df269f700 1 -- 172.21.15.44:0/204126808 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dec15a750 con 0x7f1dec06c590 2024-09-13T18:36:36.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.499+0000 7f1df269f700 1 -- 172.21.15.44:0/204126808 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dec163170 con 0x7f1dec06c590 2024-09-13T18:36:36.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.499+0000 7f1de97fa700 1 -- 172.21.15.44:0/204126808 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1dd400fd40 con 0x7f1dec06c590 2024-09-13T18:36:36.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.499+0000 7f1de97fa700 1 --2- 172.21.15.44:0/204126808 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1dcc066760 0x7f1dcc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:36.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.499+0000 7f1de97fa700 1 -- 172.21.15.44:0/204126808 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1dd4083f00 con 0x7f1dec06c590 2024-09-13T18:36:36.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.499+0000 7f1debfff700 1 --2- 172.21.15.44:0/204126808 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1dcc066760 0x7f1dcc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:36.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.503+0000 7f1debfff700 1 --2- 172.21.15.44:0/204126808 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1dcc066760 0x7f1dcc068c20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0090b0 tx=0x7f1ddc01e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:36.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.507+0000 7f1de97fa700 1 -- 172.21.15.44:0/204126808 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1dec163170 con 0x7f1dec06c590 2024-09-13T18:36:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.675+0000 7f1df269f700 1 -- 172.21.15.44:0/204126808 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1dec0cd7a0 con 0x7f1dcc066760 2024-09-13T18:36:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.683+0000 7f1de97fa700 1 -- 172.21.15.44:0/204126808 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49390 (secure 0 0 0) 0x7f1ddc022040 con 0x7f1dcc066760 2024-09-13T18:36:36.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:36.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.683+0000 7f1df269f700 1 -- 172.21.15.44:0/204126808 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1dcc066760 msgr2=0x7f1dcc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:36.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.683+0000 7f1df269f700 1 --2- 172.21.15.44:0/204126808 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1dcc066760 0x7f1dcc068c20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0090b0 tx=0x7f1ddc01e040 comp rx=0 tx=0).stop 2024-09-13T18:36:36.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.683+0000 7f1df269f700 1 -- 172.21.15.44:0/204126808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dec06c590 msgr2=0x7f1dec159d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:36.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.683+0000 7f1df269f700 1 --2- 172.21.15.44:0/204126808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dec06c590 0x7f1dec159d90 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4007450 tx=0x7f1dd4007760 comp rx=0 tx=0).stop 2024-09-13T18:36:36.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.687+0000 7f1df269f700 1 -- 172.21.15.44:0/204126808 shutdown_connections 2024-09-13T18:36:36.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.687+0000 7f1df269f700 1 --2- 172.21.15.44:0/204126808 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f1dcc066760 0x7f1dcc068c20 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.687+0000 7f1df269f700 1 --2- 172.21.15.44:0/204126808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1dec15a2d0 0x7f1dec163450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.687+0000 7f1df269f700 1 --2- 172.21.15.44:0/204126808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dec06c590 0x7f1dec159d90 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.687+0000 7f1df269f700 1 --2- 172.21.15.44:0/204126808 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1dec1599b0 0x7f1dec06c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.687+0000 7f1df269f700 1 -- 172.21.15.44:0/204126808 >> 172.21.15.44:0/204126808 conn(0x7f1dec0ce980 msgr2=0x7f1dec160d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:36.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.687+0000 7f1df269f700 1 -- 172.21.15.44:0/204126808 shutdown_connections 2024-09-13T18:36:36.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.687+0000 7f1df269f700 1 -- 172.21.15.44:0/204126808 wait complete. 2024-09-13T18:36:36.695 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:36:36.708 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":380,"stamp":"2024-09-13T18:36:36.522977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289252,"kb_used_data":9984,"kb_used_omap":12,"kb_used_meta":279155,"kb_avail":754685468,"statfs":{"total":773094113280,"available":772797919232,"internally_reserved":0,"allocated":10223616,"data_stored":5063662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":285855288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3760,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-49,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002442"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":228,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:36:31.721392+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:36:31.721392+0000","last_peered":"2024-09-13T18:36:31.721392+0000","last_clean":"2024-09-13T18:36:31.721392+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:36:31.721392+0000","last_undegraded":"2024-09-13T18:36:31.721392+0000","last_fullsized":"2024-09-13T18:36:31.721392+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574968,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1728512,"data_stored":1079309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75800000000000001,"15min":0.75900000000000001},"min":{"1min":0.49399999999999999,"5min":0.38700000000000001,"15min":0.33600000000000002},"max":{"1min":1.0509999999999999,"5min":1.0760000000000001,"15min":1.163},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.78500000000000003},"min":{"1min":0.46500000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.149,"5min":1.288,"15min":1.288},"last":0.76300000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.84199999999999997,"15min":0.872},"min":{"1min":0.57899999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.115,"5min":1.288,"15min":1.7689999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89400000000000002,"15min":0.92900000000000005},"min":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.52600000000000002},"max":{"1min":1.175,"5min":1.3009999999999999,"15min":1.6140000000000001},"last":0.94199999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.84199999999999997},"min":{"1min":0.60199999999999998,"5min":0.45500000000000002,"15min":0.40500000000000003},"max":{"1min":0.98999999999999999,"5min":1.2270000000000001,"15min":1.3340000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.82599999999999996,"15min":0.879},"min":{"1min":0.64700000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0509999999999999,"5min":1.524,"15min":1.6659999999999999},"last":0.96799999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.88400000000000001,"15min":0.88600000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.52600000000000002},"max":{"1min":1.1160000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1990000000000001,"5min":1.486,"15min":1.486},"last":0.83199999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.84699999999999998,"15min":0.876},"min":{"1min":0.58999999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0649999999999999,"5min":1.4590000000000001,"15min":1.7290000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.02,"15min":1.0329999999999999},"min":{"1min":0.88700000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.226,"5min":1.49,"15min":1.7050000000000001},"last":0.80500000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.94599999999999995,"15min":0.95099999999999996},"min":{"1min":0.64000000000000001,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2490000000000001,"5min":1.4159999999999999,"15min":1.4259999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.044,"15min":1.0489999999999999},"min":{"1min":0.74199999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.325,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0289999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0409999999999999,"15min":1.075},"min":{"1min":0.626,"5min":0.626,"15min":0.58099999999999996},"max":{"1min":1.3500000000000001,"5min":1.4730000000000001,"15min":2.077},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.087,"15min":1.0740000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.69099999999999995},"max":{"1min":1.323,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.89100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574970,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1130496,"data_stored":483632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.80700000000000005,"15min":0.82099999999999995},"min":{"1min":0.439,"5min":0.438,"15min":0.438},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":1.083},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.78900000000000003,"15min":0.81599999999999995},"min":{"1min":0.54700000000000004,"5min":0.45800000000000002,"15min":0.42099999999999999},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.2669999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.79000000000000004,"15min":0.81399999999999995},"min":{"1min":0.52000000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.302},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.84499999999999997,"15min":0.83399999999999996},"min":{"1min":0.504,"5min":0.48299999999999998,"15min":0.48099999999999998},"max":{"1min":1.2130000000000001,"5min":1.262,"15min":1.262},"last":1.1479999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.81399999999999995,"15min":0.81499999999999995},"min":{"1min":0.66200000000000003,"5min":0.47399999999999998,"15min":0.46899999999999997},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.016},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.85799999999999998,"15min":0.85999999999999999},"min":{"1min":0.54400000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.96199999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.92000000000000004,"15min":0.88800000000000001},"min":{"1min":0.71899999999999997,"5min":0.57599999999999996,"15min":0.52300000000000002},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.90100000000000002,"15min":0.93500000000000005},"min":{"1min":0.73099999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2330000000000001,"5min":1.2390000000000001,"15min":1.2909999999999999},"last":1.3460000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.871,"15min":0.88200000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.57699999999999996},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.97499999999999998,"15min":0.99199999999999999},"min":{"1min":0.63100000000000001,"5min":0.623,"15min":0.623},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.2}]},{"osd":5,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0429999999999999,"15min":1.0409999999999999},"min":{"1min":0.69099999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.97799999999999998,"15min":0.97999999999999998},"min":{"1min":0.70799999999999996,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.419,"5min":1.419,"15min":1.4990000000000001},"last":1.165}]},{"osd":7,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0129999999999999,"15min":1.0009999999999999},"min":{"1min":0.67800000000000005,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.121,"15min":1.1140000000000001},"min":{"1min":0.89900000000000002,"5min":0.76200000000000001,"15min":0.76000000000000001},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.375}]}]},{"osd":5,"up_from":13,"seq":55834574968,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1134592,"data_stored":485922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76800000000000002,"15min":0.81699999999999995},"min":{"1min":0.56200000000000006,"5min":0.46899999999999997,"15min":0.39800000000000002},"max":{"1min":1.0309999999999999,"5min":1.3280000000000001,"15min":1.3640000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.81000000000000005,"15min":0.84899999999999998},"min":{"1min":0.60799999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1559999999999999,"5min":1.194,"15min":1.482},"last":0.93999999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.79300000000000004,"15min":0.79500000000000004},"min":{"1min":0.57399999999999995,"5min":0.42499999999999999,"15min":0.40999999999999998},"max":{"1min":1.008,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85599999999999998,"15min":0.90900000000000003},"min":{"1min":0.55100000000000005,"5min":0.50900000000000001,"15min":0.45200000000000001},"max":{"1min":1.1200000000000001,"5min":1.218,"15min":1.4850000000000001},"last":0.71599999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.92500000000000004,"15min":0.94599999999999995},"min":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.51300000000000001},"max":{"1min":1.115,"5min":1.2430000000000001,"15min":1.4179999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93500000000000005,"15min":0.98199999999999998},"min":{"1min":0.59799999999999998,"5min":0.51800000000000002,"15min":0.46500000000000002},"max":{"1min":1.1519999999999999,"5min":1.2849999999999999,"15min":1.4690000000000001},"last":0.83099999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.878,"15min":0.92400000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.51700000000000002},"max":{"1min":1.117,"5min":1.2010000000000001,"15min":1.4510000000000001},"last":1.091},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89500000000000002,"15min":0.92600000000000005},"min":{"1min":0.65400000000000003,"5min":0.61199999999999999,"15min":0.55300000000000005},"max":{"1min":1.1679999999999999,"5min":1.335,"15min":1.4990000000000001},"last":0.96299999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.91300000000000003,"15min":0.95199999999999996},"min":{"1min":0.57599999999999996,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2549999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95799999999999996,"15min":1.0089999999999999},"min":{"1min":0.628,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.206,"5min":1.302,"15min":1.542},"last":1.143}]},{"osd":6,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.97799999999999998,"15min":1.0129999999999999},"min":{"1min":0.83599999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2989999999999999,"5min":1.4259999999999999,"15min":1.698},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1020000000000001,"15min":1.1419999999999999},"min":{"1min":0.90400000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.2170000000000001,"5min":1.52,"15min":1.581},"last":0.88400000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.0589999999999999,"15min":1.1419999999999999},"min":{"1min":0.68500000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.256,"5min":1.552,"15min":1.847},"last":1.01},{"interface":"front","average":{"1min":1.069,"5min":1.0640000000000001,"15min":1.117},"min":{"1min":0.72399999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2549999999999999,"5min":1.4259999999999999,"15min":1.8100000000000001},"last":0.91400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574968,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46160,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325680,"statfs":{"total":96636764160,"available":96589496320,"internally_reserved":0,"allocated":1118208,"data_stored":482938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.82299999999999995,"15min":0.875},"min":{"1min":0.52000000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.159,"5min":1.1930000000000001,"15min":1.3720000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.89500000000000002,"15min":0.93999999999999995},"min":{"1min":0.57299999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.163,"5min":1.21,"15min":1.5229999999999999},"last":0.60899999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.54300000000000004,"5min":0.47099999999999997,"15min":0.435},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.88,"5min":0.84199999999999997,"15min":0.84599999999999997},"min":{"1min":0.58399999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1859999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.54800000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.80000000000000004,"15min":0.83899999999999997},"min":{"1min":0.67100000000000004,"5min":0.46300000000000002,"15min":0.44600000000000001},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.871,"5min":0.86499999999999999,"15min":0.85499999999999998},"min":{"1min":0.58199999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.212,"5min":1.331,"15min":1.331},"last":1.137}]},{"osd":3,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.89300000000000002,"15min":0.94999999999999996},"min":{"1min":0.55800000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.639},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.91200000000000003,"15min":0.96499999999999997},"min":{"1min":0.70499999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.8300000000000001},"last":0.93000000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.91700000000000004,"15min":0.95999999999999996},"min":{"1min":0.67300000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.327,"5min":1.518,"15min":2.3889999999999998},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.052,"15min":1.093},"min":{"1min":0.91200000000000003,"5min":0.66100000000000003,"15min":0.626},"max":{"1min":1.605,"5min":1.605,"15min":2.0049999999999999},"last":0.95699999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94599999999999995,"15min":0.91500000000000004},"min":{"1min":0.69199999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2929999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.121,"5min":1.0840000000000001,"15min":1.0960000000000001},"min":{"1min":0.873,"5min":0.70099999999999996,"15min":0.63500000000000001},"max":{"1min":1.409,"5min":1.4259999999999999,"15min":1.794},"last":1.1899999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0509999999999999,"15min":1.0680000000000001},"min":{"1min":0.66100000000000003,"5min":0.65200000000000002,"15min":0.60499999999999998},"max":{"1min":1.659,"5min":1.659,"15min":1.669},"last":1.087},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0529999999999999,"15min":1.0349999999999999},"min":{"1min":0.877,"5min":0.69499999999999995,"15min":0.61799999999999999},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.1080000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574971,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1130496,"data_stored":485900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64200000000000002,"15min":0.66100000000000003},"min":{"1min":0.38300000000000001,"5min":0.22,"15min":0.22},"max":{"1min":1.0489999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.629},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.622,"15min":0.65700000000000003},"min":{"1min":0.434,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":1.008,"5min":1.008,"15min":1.1970000000000001},"last":0.68500000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.67800000000000005,"15min":0.68999999999999995},"min":{"1min":0.44600000000000001,"5min":0.24099999999999999,"15min":0.23100000000000001},"max":{"1min":0.98299999999999998,"5min":1.379,"15min":1.379},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.751,"15min":0.79300000000000004},"min":{"1min":0.46200000000000002,"5min":0.30199999999999999,"15min":0.23499999999999999},"max":{"1min":1.238,"5min":1.397,"15min":2.0030000000000001},"last":0.78700000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.40899999999999997,"5min":0.32500000000000001,"15min":0.29299999999999998},"max":{"1min":0.91000000000000003,"5min":1.3300000000000001,"15min":1.333},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.83999999999999997,"15min":0.86699999999999999},"min":{"1min":0.55600000000000005,"5min":0.33000000000000002,"15min":0.27300000000000002},"max":{"1min":1.296,"5min":1.423,"15min":1.423},"last":0.89000000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.88400000000000001,"15min":0.92900000000000005},"min":{"1min":0.58399999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1779999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.97099999999999997,"15min":1.0089999999999999},"min":{"1min":0.67400000000000004,"5min":0.56899999999999995,"15min":0.52300000000000002},"max":{"1min":1.3440000000000001,"5min":1.587,"15min":1.587},"last":0.84799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.038,"15min":1.119},"min":{"1min":0.83299999999999996,"5min":0.55200000000000005,"15min":0.51400000000000001},"max":{"1min":1.3089999999999999,"5min":1.6200000000000001,"15min":2.2320000000000002},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1,"15min":1.0680000000000001},"min":{"1min":0.65100000000000002,"5min":0.53900000000000003,"15min":0.53600000000000003},"max":{"1min":1.252,"5min":1.3280000000000001,"15min":1.718},"last":0.878}]},{"osd":6,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0589999999999999,"15min":1.097},"min":{"1min":0.69699999999999995,"5min":0.60199999999999998,"15min":0.496},"max":{"1min":1.4259999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.0900000000000001,"15min":1.1699999999999999},"min":{"1min":0.79100000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.385,"5min":1.51,"15min":2.1819999999999999},"last":1.032}]},{"osd":7,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0329999999999999,"15min":1.0740000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.624},"max":{"1min":1.391,"5min":1.391,"15min":1.4670000000000001},"last":1.083},{"interface":"front","average":{"1min":1.073,"5min":1.101,"15min":1.143},"min":{"1min":0.69999999999999996,"5min":0.57499999999999996,"15min":0.54300000000000004},"max":{"1min":1.367,"5min":1.548,"15min":1.5920000000000001},"last":1.0009999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574969,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40404,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331436,"statfs":{"total":96636764160,"available":96595390464,"internally_reserved":0,"allocated":1122304,"data_stored":483520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63600000000000001,"15min":0.65800000000000003},"min":{"1min":0.45100000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":1.0009999999999999,"5min":1.1020000000000001,"15min":1.1919999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.72199999999999998,"15min":0.76700000000000002},"min":{"1min":0.56000000000000005,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.4370000000000001},"last":0.58299999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65500000000000003,"15min":0.69099999999999995},"min":{"1min":0.48399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.94799999999999995,"5min":1.2050000000000001,"15min":1.2629999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.68999999999999995,"15min":0.72099999999999997},"min":{"1min":0.51900000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.181,"5min":1.383,"15min":1.383},"last":0.79600000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.68100000000000005,"15min":0.67500000000000004},"min":{"1min":0.46800000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.85199999999999998},"min":{"1min":0.48499999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1870000000000001,"5min":1.3460000000000001,"15min":1.548},"last":0.82899999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.94799999999999995,"15min":0.96899999999999997},"min":{"1min":0.69199999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1279999999999999,"5min":1.653,"15min":1.653},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.96599999999999997,"15min":1.0209999999999999},"min":{"1min":0.73299999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2829999999999999,"5min":1.51,"15min":2.3849999999999998},"last":1.2509999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.93200000000000005,"15min":0.92500000000000004},"min":{"1min":0.74399999999999999,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.327,"5min":1.4730000000000001,"15min":1.498},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.028,"15min":1.048},"min":{"1min":0.81799999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.254,"5min":1.7549999999999999,"15min":1.869},"last":1.28}]},{"osd":6,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.89300000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.3500000000000001,"5min":1.6120000000000001,"15min":2.762},"last":1.105},{"interface":"front","average":{"1min":1.087,"5min":1.0129999999999999,"15min":1.036},"min":{"1min":0.85999999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.407,"5min":1.5509999999999999,"15min":1.988},"last":0.90100000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.095,"15min":1.1359999999999999},"min":{"1min":0.85199999999999998,"5min":0.61099999999999999,"15min":0.59799999999999998},"max":{"1min":1.496,"5min":1.8240000000000001,"15min":2.6800000000000002},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.081,"15min":1.0740000000000001},"min":{"1min":0.81399999999999995,"5min":0.64100000000000001,"15min":0.52800000000000002},"max":{"1min":1.3129999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.0449999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574969,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1130496,"data_stored":483132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.34300000000000003,"15min":0.33200000000000002},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70499999999999996,"15min":0.72799999999999998},"min":{"1min":0.502,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.1279999999999999,"5min":1.341,"15min":1.3560000000000001},"last":0.94099999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.46600000000000003,"5min":0.311,"15min":0.311},"max":{"1min":1.0069999999999999,"5min":1.133,"15min":1.1879999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.73899999999999999,"15min":0.747},"min":{"1min":0.44600000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.089,"5min":1.617,"15min":1.617},"last":0.89200000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.56599999999999995,"5min":0.375,"15min":0.375},"max":{"1min":1.1040000000000001,"5min":1.415,"15min":1.415},"last":1.085},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.751,"15min":0.77700000000000002},"min":{"1min":0.41999999999999998,"5min":0.35999999999999999,"15min":0.35699999999999998},"max":{"1min":1.0820000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.85899999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.95299999999999996,"15min":0.95399999999999996},"min":{"1min":0.70099999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2669999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.95999999999999996,"15min":0.97099999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2450000000000001,"5min":1.52,"15min":1.994},"last":1.256}]},{"osd":5,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.96799999999999997,"15min":0.97299999999999998},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.49299999999999999},"max":{"1min":1.3260000000000001,"5min":1.7,"15min":2.0960000000000001},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.054,"15min":1.0740000000000001},"min":{"1min":0.82299999999999995,"5min":0.626,"15min":0.626},"max":{"1min":1.407,"5min":1.8939999999999999,"15min":2.7280000000000002},"last":1.516}]},{"osd":6,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.024,"15min":1.0600000000000001},"min":{"1min":0.68899999999999995,"5min":0.56599999999999995,"15min":0.53100000000000003},"max":{"1min":1.3029999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.04,"15min":1.075},"min":{"1min":0.69199999999999995,"5min":0.64700000000000002,"15min":0.63100000000000001},"max":{"1min":1.3029999999999999,"5min":1.9710000000000001,"15min":2.0489999999999999},"last":1.462}]},{"osd":7,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.099,"15min":1.095},"min":{"1min":0.88500000000000001,"5min":0.72499999999999998,"15min":0.67400000000000004},"max":{"1min":1.3600000000000001,"5min":2.0070000000000001,"15min":2.5579999999999998},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.089,"15min":1.1080000000000001},"min":{"1min":0.77300000000000002,"5min":0.55200000000000005,"15min":0.51300000000000001},"max":{"1min":1.627,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.494}]}]},{"osd":0,"up_from":13,"seq":55834574969,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41000,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330840,"statfs":{"total":96636764160,"available":96594780160,"internally_reserved":0,"allocated":1728512,"data_stored":1079309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.59999999999999998,"15min":0.60499999999999998},"min":{"1min":0.45900000000000002,"5min":0.192,"15min":0.192},"max":{"1min":0.97599999999999998,"5min":1.23,"15min":1.23},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66500000000000004,"15min":0.68899999999999995},"min":{"1min":0.53100000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.98399999999999999,"5min":1.1220000000000001,"15min":1.1759999999999999},"last":0.77700000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.67900000000000005,"15min":0.69699999999999995},"min":{"1min":0.53400000000000003,"5min":0.249,"15min":0.23799999999999999},"max":{"1min":1.1539999999999999,"5min":1.494,"15min":1.494},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.71599999999999997,"15min":0.71899999999999997},"min":{"1min":0.42799999999999999,"5min":0.223,"15min":0.223},"max":{"1min":1.042,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.65700000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68500000000000005,"15min":0.64800000000000002},"min":{"1min":0.51600000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.93300000000000005,"5min":1.137,"15min":1.137},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.82599999999999996,"15min":0.82699999999999996},"min":{"1min":0.63400000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.2490000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.70599999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.96099999999999997,"15min":0.96199999999999997},"min":{"1min":0.66800000000000004,"5min":0.623,"15min":0.623},"max":{"1min":1.595,"5min":1.764,"15min":1.764},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.90200000000000002,"15min":0.91000000000000003},"min":{"1min":0.64900000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.304,"5min":1.3620000000000001,"15min":1.4810000000000001},"last":0.81499999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98199999999999998,"15min":0.97299999999999998},"min":{"1min":0.79500000000000004,"5min":0.64600000000000002,"15min":0.59299999999999997},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.046,"15min":1.052},"min":{"1min":0.85499999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5489999999999999,"5min":1.637,"15min":1.637},"last":0.98999999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.0680000000000001,"15min":1.0860000000000001},"min":{"1min":0.79300000000000004,"5min":0.63900000000000001,"15min":0.61699999999999999},"max":{"1min":1.45,"5min":1.718,"15min":1.718},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.171,"5min":1.081,"15min":1.1080000000000001},"min":{"1min":0.80700000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.6180000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.89400000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.071,"15min":1.105},"min":{"1min":0.83899999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.538,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.05,"5min":1.0309999999999999,"15min":1.0409999999999999},"min":{"1min":0.72599999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.284,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.86599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:36:36.711 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:36:36.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.811+0000 7f9094d4d700 1 Processor -- start 2024-09-13T18:36:36.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.811+0000 7f9094d4d700 1 -- start start 2024-09-13T18:36:36.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f9094d4d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f909015d850 0x7f909015dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:36.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f9094d4d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f90900b31c0 0x7f90900b3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:36.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f9094d4d700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9090070fa0 con 0x7f909015d470 2024-09-13T18:36:36.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f9094d4d700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90900b3bb0 con 0x7f909015d850 2024-09-13T18:36:36.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f9094d4d700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9090071280 con 0x7f90900b31c0 2024-09-13T18:36:36.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f908effd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f909015d850 0x7f909015dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:36.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f908effd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f909015d850 0x7f909015dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42682/0 (socket says 172.21.15.44:42682) 2024-09-13T18:36:36.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f908effd700 1 -- 172.21.15.44:0/261450568 learned_addr learned my addr 172.21.15.44:0/261450568 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:36.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f908ffff700 1 --2- 172.21.15.44:0/261450568 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f90900b31c0 0x7f90900b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:36.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f908effd700 1 -- 172.21.15.44:0/261450568 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f90900b31c0 msgr2=0x7f90900b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:36.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f908effd700 1 --2- 172.21.15.44:0/261450568 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f90900b31c0 0x7f90900b3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f908effd700 1 -- 172.21.15.44:0/261450568 >> v1:172.21.15.44:6789/0 conn(0x7f909015d470 legacy=0x7f90900707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:36.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f908effd700 1 -- 172.21.15.44:0/261450568 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9090071560 con 0x7f909015d850 2024-09-13T18:36:36.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f908effd700 1 --2- 172.21.15.44:0/261450568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f909015d850 0x7f909015dcc0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f9084009910 tx=0x7f9084009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1410bdfe5e107d4d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:36.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f908e7fc700 1 -- 172.21.15.44:0/261450568 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908400ba60 con 0x7f909015d850 2024-09-13T18:36:36.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f908e7fc700 1 -- 172.21.15.44:0/261450568 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908400bbc0 con 0x7f909015d850 2024-09-13T18:36:36.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f908e7fc700 1 -- 172.21.15.44:0/261450568 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9084009e60 con 0x7f909015d850 2024-09-13T18:36:36.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f9094d4d700 1 -- 172.21.15.44:0/261450568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f909015d850 msgr2=0x7f909015dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:36.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f9094d4d700 1 --2- 172.21.15.44:0/261450568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f909015d850 0x7f909015dcc0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f9084009910 tx=0x7f9084009c20 comp rx=0 tx=0).stop 2024-09-13T18:36:36.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f9094d4d700 1 -- 172.21.15.44:0/261450568 shutdown_connections 2024-09-13T18:36:36.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f9094d4d700 1 --2- 172.21.15.44:0/261450568 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f90900b31c0 0x7f90900b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f9094d4d700 1 --2- 172.21.15.44:0/261450568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f909015d850 0x7f909015dcc0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f9094d4d700 1 -- 172.21.15.44:0/261450568 >> 172.21.15.44:0/261450568 conn(0x7f909006d900 msgr2=0x7f909006dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:36.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f9094d4d700 1 -- 172.21.15.44:0/261450568 shutdown_connections 2024-09-13T18:36:36.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.815+0000 7f9094d4d700 1 -- 172.21.15.44:0/261450568 wait complete. 2024-09-13T18:36:36.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.819+0000 7f9094d4d700 1 Processor -- start 2024-09-13T18:36:36.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.819+0000 7f9094d4d700 1 -- start start 2024-09-13T18:36:36.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.823+0000 7f9094d4d700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f90900b31c0 0x7f909014b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.823+0000 7f9094d4d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f909015d470 0x7f909015ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.823+0000 7f9094d4d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f909015d850 0x7f90900c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.823+0000 7f9094d4d700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909015b7a0 con 0x7f909015d470 2024-09-13T18:36:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.823+0000 7f9094d4d700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909015ba80 con 0x7f909015d850 2024-09-13T18:36:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.823+0000 7f9094d4d700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909015bd60 con 0x7f90900b31c0 2024-09-13T18:36:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.823+0000 7f908effd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f909015d470 0x7f909015ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.823+0000 7f908effd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f909015d470 0x7f909015ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42696/0 (socket says 172.21.15.44:42696) 2024-09-13T18:36:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.823+0000 7f908effd700 1 -- 172.21.15.44:0/2444013592 learned_addr learned my addr 172.21.15.44:0/2444013592 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.823+0000 7f908f7fe700 1 --2- 172.21.15.44:0/2444013592 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f90900b31c0 0x7f909014b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.823+0000 7f908ffff700 1 --2- 172.21.15.44:0/2444013592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f909015d850 0x7f90900c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:36.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.823+0000 7f908effd700 1 -- 172.21.15.44:0/2444013592 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f90900b31c0 msgr2=0x7f909014b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:36.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.823+0000 7f908effd700 1 --2- 172.21.15.44:0/2444013592 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f90900b31c0 0x7f909014b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.823+0000 7f908effd700 1 -- 172.21.15.44:0/2444013592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f909015d850 msgr2=0x7f90900c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.823+0000 7f908effd700 1 --2- 172.21.15.44:0/2444013592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f909015d850 0x7f90900c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.823+0000 7f908effd700 1 -- 172.21.15.44:0/2444013592 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9084009570 con 0x7f909015d470 2024-09-13T18:36:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.823+0000 7f908effd700 1 --2- 172.21.15.44:0/2444013592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f909015d470 0x7f909015ace0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f9084009150 tx=0x7f9084004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.823+0000 7f9077fff700 1 -- 172.21.15.44:0/2444013592 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9084004590 con 0x7f909015d470 2024-09-13T18:36:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.823+0000 7f9077fff700 1 -- 172.21.15.44:0/2444013592 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908401e070 con 0x7f909015d470 2024-09-13T18:36:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.823+0000 7f9094d4d700 1 -- 172.21.15.44:0/2444013592 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f909015c040 con 0x7f909015d470 2024-09-13T18:36:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.823+0000 7f9077fff700 1 -- 172.21.15.44:0/2444013592 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90840038e0 con 0x7f909015d470 2024-09-13T18:36:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.823+0000 7f9094d4d700 1 -- 172.21.15.44:0/2444013592 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909014be80 con 0x7f909015d470 2024-09-13T18:36:36.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.823+0000 7f9094d4d700 1 -- 172.21.15.44:0/2444013592 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f909015c560 con 0x7f909015d470 2024-09-13T18:36:36.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.827+0000 7f9077fff700 1 -- 172.21.15.44:0/2444013592 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9084003a40 con 0x7f909015d470 2024-09-13T18:36:36.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.827+0000 7f9077fff700 1 --2- 172.21.15.44:0/2444013592 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f907c066730 0x7f907c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:36.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.827+0000 7f9077fff700 1 -- 172.21.15.44:0/2444013592 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9084020070 con 0x7f909015d470 2024-09-13T18:36:36.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.827+0000 7f908f7fe700 1 --2- 172.21.15.44:0/2444013592 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f907c066730 0x7f907c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:36.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.827+0000 7f908f7fe700 1 --2- 172.21.15.44:0/2444013592 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f907c066730 0x7f907c068bf0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9080000f60 tx=0x7f9080009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:36.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.835+0000 7f9077fff700 1 -- 172.21.15.44:0/2444013592 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f909015c560 con 0x7f909015d470 2024-09-13T18:36:37.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:36.999+0000 7f9094d4d700 1 -- 172.21.15.44:0/2444013592 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9090071b20 con 0x7f907c066730 2024-09-13T18:36:37.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.003+0000 7f9077fff700 1 -- 172.21.15.44:0/2444013592 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49390 (secure 0 0 0) 0x7f90800015e0 con 0x7f907c066730 2024-09-13T18:36:37.013 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:37.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.007+0000 7f9094d4d700 1 -- 172.21.15.44:0/2444013592 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f907c066730 msgr2=0x7f907c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:37.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.007+0000 7f9094d4d700 1 --2- 172.21.15.44:0/2444013592 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f907c066730 0x7f907c068bf0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9080000f60 tx=0x7f9080009040 comp rx=0 tx=0).stop 2024-09-13T18:36:37.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.007+0000 7f9094d4d700 1 -- 172.21.15.44:0/2444013592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f909015d470 msgr2=0x7f909015ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:37.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.007+0000 7f9094d4d700 1 --2- 172.21.15.44:0/2444013592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f909015d470 0x7f909015ace0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f9084009150 tx=0x7f9084004770 comp rx=0 tx=0).stop 2024-09-13T18:36:37.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.007+0000 7f9094d4d700 1 -- 172.21.15.44:0/2444013592 shutdown_connections 2024-09-13T18:36:37.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.007+0000 7f9094d4d700 1 --2- 172.21.15.44:0/2444013592 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f907c066730 0x7f907c068bf0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.007+0000 7f9094d4d700 1 --2- 172.21.15.44:0/2444013592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f909015d850 0x7f90900c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.007+0000 7f9094d4d700 1 --2- 172.21.15.44:0/2444013592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f909015d470 0x7f909015ace0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.007+0000 7f9094d4d700 1 --2- 172.21.15.44:0/2444013592 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f90900b31c0 0x7f909014b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.007+0000 7f9094d4d700 1 -- 172.21.15.44:0/2444013592 >> 172.21.15.44:0/2444013592 conn(0x7f909006d900 msgr2=0x7f90900b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:37.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.007+0000 7f9094d4d700 1 -- 172.21.15.44:0/2444013592 shutdown_connections 2024-09-13T18:36:37.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.007+0000 7f9094d4d700 1 -- 172.21.15.44:0/2444013592 wait complete. 2024-09-13T18:36:37.016 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:36:37.028 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":380,"stamp":"2024-09-13T18:36:36.522977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289252,"kb_used_data":9984,"kb_used_omap":12,"kb_used_meta":279155,"kb_avail":754685468,"statfs":{"total":773094113280,"available":772797919232,"internally_reserved":0,"allocated":10223616,"data_stored":5063662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":285855288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3760,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-49,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002442"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":228,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:36:31.721392+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:36:31.721392+0000","last_peered":"2024-09-13T18:36:31.721392+0000","last_clean":"2024-09-13T18:36:31.721392+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:36:31.721392+0000","last_undegraded":"2024-09-13T18:36:31.721392+0000","last_fullsized":"2024-09-13T18:36:31.721392+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574968,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1728512,"data_stored":1079309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75800000000000001,"15min":0.75900000000000001},"min":{"1min":0.49399999999999999,"5min":0.38700000000000001,"15min":0.33600000000000002},"max":{"1min":1.0509999999999999,"5min":1.0760000000000001,"15min":1.163},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.78500000000000003},"min":{"1min":0.46500000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.149,"5min":1.288,"15min":1.288},"last":0.76300000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.84199999999999997,"15min":0.872},"min":{"1min":0.57899999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.115,"5min":1.288,"15min":1.7689999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89400000000000002,"15min":0.92900000000000005},"min":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.52600000000000002},"max":{"1min":1.175,"5min":1.3009999999999999,"15min":1.6140000000000001},"last":0.94199999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.84199999999999997},"min":{"1min":0.60199999999999998,"5min":0.45500000000000002,"15min":0.40500000000000003},"max":{"1min":0.98999999999999999,"5min":1.2270000000000001,"15min":1.3340000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.82599999999999996,"15min":0.879},"min":{"1min":0.64700000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0509999999999999,"5min":1.524,"15min":1.6659999999999999},"last":0.96799999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.88400000000000001,"15min":0.88600000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.52600000000000002},"max":{"1min":1.1160000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1990000000000001,"5min":1.486,"15min":1.486},"last":0.83199999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.84699999999999998,"15min":0.876},"min":{"1min":0.58999999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0649999999999999,"5min":1.4590000000000001,"15min":1.7290000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.02,"15min":1.0329999999999999},"min":{"1min":0.88700000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.226,"5min":1.49,"15min":1.7050000000000001},"last":0.80500000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.94599999999999995,"15min":0.95099999999999996},"min":{"1min":0.64000000000000001,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2490000000000001,"5min":1.4159999999999999,"15min":1.4259999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.044,"15min":1.0489999999999999},"min":{"1min":0.74199999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.325,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0289999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0409999999999999,"15min":1.075},"min":{"1min":0.626,"5min":0.626,"15min":0.58099999999999996},"max":{"1min":1.3500000000000001,"5min":1.4730000000000001,"15min":2.077},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.087,"15min":1.0740000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.69099999999999995},"max":{"1min":1.323,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.89100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574970,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1130496,"data_stored":483632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.80700000000000005,"15min":0.82099999999999995},"min":{"1min":0.439,"5min":0.438,"15min":0.438},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":1.083},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.78900000000000003,"15min":0.81599999999999995},"min":{"1min":0.54700000000000004,"5min":0.45800000000000002,"15min":0.42099999999999999},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.2669999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.79000000000000004,"15min":0.81399999999999995},"min":{"1min":0.52000000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.302},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.84499999999999997,"15min":0.83399999999999996},"min":{"1min":0.504,"5min":0.48299999999999998,"15min":0.48099999999999998},"max":{"1min":1.2130000000000001,"5min":1.262,"15min":1.262},"last":1.1479999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.81399999999999995,"15min":0.81499999999999995},"min":{"1min":0.66200000000000003,"5min":0.47399999999999998,"15min":0.46899999999999997},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.016},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.85799999999999998,"15min":0.85999999999999999},"min":{"1min":0.54400000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.96199999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.92000000000000004,"15min":0.88800000000000001},"min":{"1min":0.71899999999999997,"5min":0.57599999999999996,"15min":0.52300000000000002},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.90100000000000002,"15min":0.93500000000000005},"min":{"1min":0.73099999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2330000000000001,"5min":1.2390000000000001,"15min":1.2909999999999999},"last":1.3460000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.871,"15min":0.88200000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.57699999999999996},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.97499999999999998,"15min":0.99199999999999999},"min":{"1min":0.63100000000000001,"5min":0.623,"15min":0.623},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.2}]},{"osd":5,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0429999999999999,"15min":1.0409999999999999},"min":{"1min":0.69099999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.97799999999999998,"15min":0.97999999999999998},"min":{"1min":0.70799999999999996,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.419,"5min":1.419,"15min":1.4990000000000001},"last":1.165}]},{"osd":7,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0129999999999999,"15min":1.0009999999999999},"min":{"1min":0.67800000000000005,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.121,"15min":1.1140000000000001},"min":{"1min":0.89900000000000002,"5min":0.76200000000000001,"15min":0.76000000000000001},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.375}]}]},{"osd":5,"up_from":13,"seq":55834574968,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1134592,"data_stored":485922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76800000000000002,"15min":0.81699999999999995},"min":{"1min":0.56200000000000006,"5min":0.46899999999999997,"15min":0.39800000000000002},"max":{"1min":1.0309999999999999,"5min":1.3280000000000001,"15min":1.3640000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.81000000000000005,"15min":0.84899999999999998},"min":{"1min":0.60799999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1559999999999999,"5min":1.194,"15min":1.482},"last":0.93999999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.79300000000000004,"15min":0.79500000000000004},"min":{"1min":0.57399999999999995,"5min":0.42499999999999999,"15min":0.40999999999999998},"max":{"1min":1.008,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85599999999999998,"15min":0.90900000000000003},"min":{"1min":0.55100000000000005,"5min":0.50900000000000001,"15min":0.45200000000000001},"max":{"1min":1.1200000000000001,"5min":1.218,"15min":1.4850000000000001},"last":0.71599999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.92500000000000004,"15min":0.94599999999999995},"min":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.51300000000000001},"max":{"1min":1.115,"5min":1.2430000000000001,"15min":1.4179999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93500000000000005,"15min":0.98199999999999998},"min":{"1min":0.59799999999999998,"5min":0.51800000000000002,"15min":0.46500000000000002},"max":{"1min":1.1519999999999999,"5min":1.2849999999999999,"15min":1.4690000000000001},"last":0.83099999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.878,"15min":0.92400000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.51700000000000002},"max":{"1min":1.117,"5min":1.2010000000000001,"15min":1.4510000000000001},"last":1.091},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89500000000000002,"15min":0.92600000000000005},"min":{"1min":0.65400000000000003,"5min":0.61199999999999999,"15min":0.55300000000000005},"max":{"1min":1.1679999999999999,"5min":1.335,"15min":1.4990000000000001},"last":0.96299999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.91300000000000003,"15min":0.95199999999999996},"min":{"1min":0.57599999999999996,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2549999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95799999999999996,"15min":1.0089999999999999},"min":{"1min":0.628,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.206,"5min":1.302,"15min":1.542},"last":1.143}]},{"osd":6,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.97799999999999998,"15min":1.0129999999999999},"min":{"1min":0.83599999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2989999999999999,"5min":1.4259999999999999,"15min":1.698},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1020000000000001,"15min":1.1419999999999999},"min":{"1min":0.90400000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.2170000000000001,"5min":1.52,"15min":1.581},"last":0.88400000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.0589999999999999,"15min":1.1419999999999999},"min":{"1min":0.68500000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.256,"5min":1.552,"15min":1.847},"last":1.01},{"interface":"front","average":{"1min":1.069,"5min":1.0640000000000001,"15min":1.117},"min":{"1min":0.72399999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2549999999999999,"5min":1.4259999999999999,"15min":1.8100000000000001},"last":0.91400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574968,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46160,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325680,"statfs":{"total":96636764160,"available":96589496320,"internally_reserved":0,"allocated":1118208,"data_stored":482938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.82299999999999995,"15min":0.875},"min":{"1min":0.52000000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.159,"5min":1.1930000000000001,"15min":1.3720000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.89500000000000002,"15min":0.93999999999999995},"min":{"1min":0.57299999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.163,"5min":1.21,"15min":1.5229999999999999},"last":0.60899999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.54300000000000004,"5min":0.47099999999999997,"15min":0.435},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.88,"5min":0.84199999999999997,"15min":0.84599999999999997},"min":{"1min":0.58399999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1859999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.54800000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.80000000000000004,"15min":0.83899999999999997},"min":{"1min":0.67100000000000004,"5min":0.46300000000000002,"15min":0.44600000000000001},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.871,"5min":0.86499999999999999,"15min":0.85499999999999998},"min":{"1min":0.58199999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.212,"5min":1.331,"15min":1.331},"last":1.137}]},{"osd":3,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.89300000000000002,"15min":0.94999999999999996},"min":{"1min":0.55800000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.639},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.91200000000000003,"15min":0.96499999999999997},"min":{"1min":0.70499999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.8300000000000001},"last":0.93000000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.91700000000000004,"15min":0.95999999999999996},"min":{"1min":0.67300000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.327,"5min":1.518,"15min":2.3889999999999998},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.052,"15min":1.093},"min":{"1min":0.91200000000000003,"5min":0.66100000000000003,"15min":0.626},"max":{"1min":1.605,"5min":1.605,"15min":2.0049999999999999},"last":0.95699999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94599999999999995,"15min":0.91500000000000004},"min":{"1min":0.69199999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2929999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.121,"5min":1.0840000000000001,"15min":1.0960000000000001},"min":{"1min":0.873,"5min":0.70099999999999996,"15min":0.63500000000000001},"max":{"1min":1.409,"5min":1.4259999999999999,"15min":1.794},"last":1.1899999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0509999999999999,"15min":1.0680000000000001},"min":{"1min":0.66100000000000003,"5min":0.65200000000000002,"15min":0.60499999999999998},"max":{"1min":1.659,"5min":1.659,"15min":1.669},"last":1.087},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0529999999999999,"15min":1.0349999999999999},"min":{"1min":0.877,"5min":0.69499999999999995,"15min":0.61799999999999999},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.1080000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574971,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1130496,"data_stored":485900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64200000000000002,"15min":0.66100000000000003},"min":{"1min":0.38300000000000001,"5min":0.22,"15min":0.22},"max":{"1min":1.0489999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.629},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.622,"15min":0.65700000000000003},"min":{"1min":0.434,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":1.008,"5min":1.008,"15min":1.1970000000000001},"last":0.68500000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.67800000000000005,"15min":0.68999999999999995},"min":{"1min":0.44600000000000001,"5min":0.24099999999999999,"15min":0.23100000000000001},"max":{"1min":0.98299999999999998,"5min":1.379,"15min":1.379},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.751,"15min":0.79300000000000004},"min":{"1min":0.46200000000000002,"5min":0.30199999999999999,"15min":0.23499999999999999},"max":{"1min":1.238,"5min":1.397,"15min":2.0030000000000001},"last":0.78700000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.40899999999999997,"5min":0.32500000000000001,"15min":0.29299999999999998},"max":{"1min":0.91000000000000003,"5min":1.3300000000000001,"15min":1.333},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.83999999999999997,"15min":0.86699999999999999},"min":{"1min":0.55600000000000005,"5min":0.33000000000000002,"15min":0.27300000000000002},"max":{"1min":1.296,"5min":1.423,"15min":1.423},"last":0.89000000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.88400000000000001,"15min":0.92900000000000005},"min":{"1min":0.58399999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1779999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.97099999999999997,"15min":1.0089999999999999},"min":{"1min":0.67400000000000004,"5min":0.56899999999999995,"15min":0.52300000000000002},"max":{"1min":1.3440000000000001,"5min":1.587,"15min":1.587},"last":0.84799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.038,"15min":1.119},"min":{"1min":0.83299999999999996,"5min":0.55200000000000005,"15min":0.51400000000000001},"max":{"1min":1.3089999999999999,"5min":1.6200000000000001,"15min":2.2320000000000002},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1,"15min":1.0680000000000001},"min":{"1min":0.65100000000000002,"5min":0.53900000000000003,"15min":0.53600000000000003},"max":{"1min":1.252,"5min":1.3280000000000001,"15min":1.718},"last":0.878}]},{"osd":6,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0589999999999999,"15min":1.097},"min":{"1min":0.69699999999999995,"5min":0.60199999999999998,"15min":0.496},"max":{"1min":1.4259999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.0900000000000001,"15min":1.1699999999999999},"min":{"1min":0.79100000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.385,"5min":1.51,"15min":2.1819999999999999},"last":1.032}]},{"osd":7,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0329999999999999,"15min":1.0740000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.624},"max":{"1min":1.391,"5min":1.391,"15min":1.4670000000000001},"last":1.083},{"interface":"front","average":{"1min":1.073,"5min":1.101,"15min":1.143},"min":{"1min":0.69999999999999996,"5min":0.57499999999999996,"15min":0.54300000000000004},"max":{"1min":1.367,"5min":1.548,"15min":1.5920000000000001},"last":1.0009999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574969,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40404,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331436,"statfs":{"total":96636764160,"available":96595390464,"internally_reserved":0,"allocated":1122304,"data_stored":483520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63600000000000001,"15min":0.65800000000000003},"min":{"1min":0.45100000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":1.0009999999999999,"5min":1.1020000000000001,"15min":1.1919999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.72199999999999998,"15min":0.76700000000000002},"min":{"1min":0.56000000000000005,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.4370000000000001},"last":0.58299999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65500000000000003,"15min":0.69099999999999995},"min":{"1min":0.48399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.94799999999999995,"5min":1.2050000000000001,"15min":1.2629999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.68999999999999995,"15min":0.72099999999999997},"min":{"1min":0.51900000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.181,"5min":1.383,"15min":1.383},"last":0.79600000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.68100000000000005,"15min":0.67500000000000004},"min":{"1min":0.46800000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.85199999999999998},"min":{"1min":0.48499999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1870000000000001,"5min":1.3460000000000001,"15min":1.548},"last":0.82899999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.94799999999999995,"15min":0.96899999999999997},"min":{"1min":0.69199999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1279999999999999,"5min":1.653,"15min":1.653},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.96599999999999997,"15min":1.0209999999999999},"min":{"1min":0.73299999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2829999999999999,"5min":1.51,"15min":2.3849999999999998},"last":1.2509999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.93200000000000005,"15min":0.92500000000000004},"min":{"1min":0.74399999999999999,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.327,"5min":1.4730000000000001,"15min":1.498},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.028,"15min":1.048},"min":{"1min":0.81799999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.254,"5min":1.7549999999999999,"15min":1.869},"last":1.28}]},{"osd":6,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.89300000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.3500000000000001,"5min":1.6120000000000001,"15min":2.762},"last":1.105},{"interface":"front","average":{"1min":1.087,"5min":1.0129999999999999,"15min":1.036},"min":{"1min":0.85999999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.407,"5min":1.5509999999999999,"15min":1.988},"last":0.90100000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.095,"15min":1.1359999999999999},"min":{"1min":0.85199999999999998,"5min":0.61099999999999999,"15min":0.59799999999999998},"max":{"1min":1.496,"5min":1.8240000000000001,"15min":2.6800000000000002},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.081,"15min":1.0740000000000001},"min":{"1min":0.81399999999999995,"5min":0.64100000000000001,"15min":0.52800000000000002},"max":{"1min":1.3129999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.0449999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574969,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1130496,"data_stored":483132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.34300000000000003,"15min":0.33200000000000002},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70499999999999996,"15min":0.72799999999999998},"min":{"1min":0.502,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.1279999999999999,"5min":1.341,"15min":1.3560000000000001},"last":0.94099999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.46600000000000003,"5min":0.311,"15min":0.311},"max":{"1min":1.0069999999999999,"5min":1.133,"15min":1.1879999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.73899999999999999,"15min":0.747},"min":{"1min":0.44600000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.089,"5min":1.617,"15min":1.617},"last":0.89200000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.56599999999999995,"5min":0.375,"15min":0.375},"max":{"1min":1.1040000000000001,"5min":1.415,"15min":1.415},"last":1.085},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.751,"15min":0.77700000000000002},"min":{"1min":0.41999999999999998,"5min":0.35999999999999999,"15min":0.35699999999999998},"max":{"1min":1.0820000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.85899999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.95299999999999996,"15min":0.95399999999999996},"min":{"1min":0.70099999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2669999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.95999999999999996,"15min":0.97099999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2450000000000001,"5min":1.52,"15min":1.994},"last":1.256}]},{"osd":5,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.96799999999999997,"15min":0.97299999999999998},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.49299999999999999},"max":{"1min":1.3260000000000001,"5min":1.7,"15min":2.0960000000000001},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.054,"15min":1.0740000000000001},"min":{"1min":0.82299999999999995,"5min":0.626,"15min":0.626},"max":{"1min":1.407,"5min":1.8939999999999999,"15min":2.7280000000000002},"last":1.516}]},{"osd":6,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.024,"15min":1.0600000000000001},"min":{"1min":0.68899999999999995,"5min":0.56599999999999995,"15min":0.53100000000000003},"max":{"1min":1.3029999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.04,"15min":1.075},"min":{"1min":0.69199999999999995,"5min":0.64700000000000002,"15min":0.63100000000000001},"max":{"1min":1.3029999999999999,"5min":1.9710000000000001,"15min":2.0489999999999999},"last":1.462}]},{"osd":7,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.099,"15min":1.095},"min":{"1min":0.88500000000000001,"5min":0.72499999999999998,"15min":0.67400000000000004},"max":{"1min":1.3600000000000001,"5min":2.0070000000000001,"15min":2.5579999999999998},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.089,"15min":1.1080000000000001},"min":{"1min":0.77300000000000002,"5min":0.55200000000000005,"15min":0.51300000000000001},"max":{"1min":1.627,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.494}]}]},{"osd":0,"up_from":13,"seq":55834574969,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41000,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330840,"statfs":{"total":96636764160,"available":96594780160,"internally_reserved":0,"allocated":1728512,"data_stored":1079309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.59999999999999998,"15min":0.60499999999999998},"min":{"1min":0.45900000000000002,"5min":0.192,"15min":0.192},"max":{"1min":0.97599999999999998,"5min":1.23,"15min":1.23},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66500000000000004,"15min":0.68899999999999995},"min":{"1min":0.53100000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.98399999999999999,"5min":1.1220000000000001,"15min":1.1759999999999999},"last":0.77700000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.67900000000000005,"15min":0.69699999999999995},"min":{"1min":0.53400000000000003,"5min":0.249,"15min":0.23799999999999999},"max":{"1min":1.1539999999999999,"5min":1.494,"15min":1.494},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.71599999999999997,"15min":0.71899999999999997},"min":{"1min":0.42799999999999999,"5min":0.223,"15min":0.223},"max":{"1min":1.042,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.65700000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68500000000000005,"15min":0.64800000000000002},"min":{"1min":0.51600000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.93300000000000005,"5min":1.137,"15min":1.137},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.82599999999999996,"15min":0.82699999999999996},"min":{"1min":0.63400000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.2490000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.70599999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.96099999999999997,"15min":0.96199999999999997},"min":{"1min":0.66800000000000004,"5min":0.623,"15min":0.623},"max":{"1min":1.595,"5min":1.764,"15min":1.764},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.90200000000000002,"15min":0.91000000000000003},"min":{"1min":0.64900000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.304,"5min":1.3620000000000001,"15min":1.4810000000000001},"last":0.81499999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98199999999999998,"15min":0.97299999999999998},"min":{"1min":0.79500000000000004,"5min":0.64600000000000002,"15min":0.59299999999999997},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.046,"15min":1.052},"min":{"1min":0.85499999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5489999999999999,"5min":1.637,"15min":1.637},"last":0.98999999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.0680000000000001,"15min":1.0860000000000001},"min":{"1min":0.79300000000000004,"5min":0.63900000000000001,"15min":0.61699999999999999},"max":{"1min":1.45,"5min":1.718,"15min":1.718},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.171,"5min":1.081,"15min":1.1080000000000001},"min":{"1min":0.80700000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.6180000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.89400000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.071,"15min":1.105},"min":{"1min":0.83899999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.538,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.05,"5min":1.0309999999999999,"15min":1.0409999999999999},"min":{"1min":0.72599999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.284,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.86599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:36:37.030 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T18:36:37.030 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:36:37.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.131+0000 7f0c76beb700 1 Processor -- start 2024-09-13T18:36:37.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c76beb700 1 -- start start 2024-09-13T18:36:37.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c76beb700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c700b3ae0 0x7f0c7006cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:37.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c76beb700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7006af40 con 0x7f0c70159720 2024-09-13T18:36:37.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c76beb700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7006d690 con 0x7f0c7006aa90 2024-09-13T18:36:37.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c76beb700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700cbfe0 con 0x7f0c700b3ae0 2024-09-13T18:36:37.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c75be9700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0c70159720 0x7f0c700b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39992/0 (socket says 172.21.15.44:39992) 2024-09-13T18:36:37.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c75be9700 1 -- 172.21.15.44:0/2646237692 learned_addr learned my addr 172.21.15.44:0/2646237692 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:37.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c753e8700 1 --2- 172.21.15.44:0/2646237692 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c700b3ae0 0x7f0c7006cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:37.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c74be7700 1 -- 172.21.15.44:0/2646237692 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 758190817 0 0) 0x7f0c7006af40 con 0x7f0c70159720 2024-09-13T18:36:37.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c74be7700 1 -- 172.21.15.44:0/2646237692 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c5c0035d0 con 0x7f0c70159720 2024-09-13T18:36:37.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c74be7700 1 -- 172.21.15.44:0/2646237692 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822695522 0 0) 0x7f0c7006d690 con 0x7f0c7006aa90 2024-09-13T18:36:37.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c74be7700 1 -- 172.21.15.44:0/2646237692 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c7006af40 con 0x7f0c7006aa90 2024-09-13T18:36:37.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c74be7700 1 -- 172.21.15.44:0/2646237692 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1883057331 0 0) 0x7f0c5c0035d0 con 0x7f0c70159720 2024-09-13T18:36:37.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c753e8700 1 -- 172.21.15.44:0/2646237692 >> v1:172.21.15.99:6789/0 conn(0x7f0c7006aa90 legacy=0x7f0c700ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:37.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c753e8700 1 -- 172.21.15.44:0/2646237692 >> v1:172.21.15.44:6789/0 conn(0x7f0c70159720 legacy=0x7f0c700b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:37.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c753e8700 1 -- 172.21.15.44:0/2646237692 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c700cc2c0 con 0x7f0c700b3ae0 2024-09-13T18:36:37.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c753e8700 1 --2- 172.21.15.44:0/2646237692 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c700b3ae0 0x7f0c7006cf90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009880 tx=0x7f0c60009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b495fe3cf497cad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:37.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c74be7700 1 -- 172.21.15.44:0/2646237692 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c001670 con 0x7f0c700b3ae0 2024-09-13T18:36:37.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c74be7700 1 -- 172.21.15.44:0/2646237692 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c60004030 con 0x7f0c700b3ae0 2024-09-13T18:36:37.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c74be7700 1 -- 172.21.15.44:0/2646237692 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c600043c0 con 0x7f0c700b3ae0 2024-09-13T18:36:37.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c76beb700 1 -- 172.21.15.44:0/2646237692 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c700b3ae0 msgr2=0x7f0c7006cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:37.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c76beb700 1 --2- 172.21.15.44:0/2646237692 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c700b3ae0 0x7f0c7006cf90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009880 tx=0x7f0c60009b90 comp rx=0 tx=0).stop 2024-09-13T18:36:37.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c76beb700 1 -- 172.21.15.44:0/2646237692 shutdown_connections 2024-09-13T18:36:37.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c76beb700 1 --2- 172.21.15.44:0/2646237692 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c700b3ae0 0x7f0c7006cf90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c76beb700 1 -- 172.21.15.44:0/2646237692 >> 172.21.15.44:0/2646237692 conn(0x7f0c700b0f00 msgr2=0x7f0c700b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:37.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c76beb700 1 -- 172.21.15.44:0/2646237692 shutdown_connections 2024-09-13T18:36:37.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.135+0000 7f0c76beb700 1 -- 172.21.15.44:0/2646237692 wait complete. 2024-09-13T18:36:37.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.139+0000 7f0c76beb700 1 Processor -- start 2024-09-13T18:36:37.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.139+0000 7f0c76beb700 1 -- start start 2024-09-13T18:36:37.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.139+0000 7f0c76beb700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c7006aa90 0x7f0c700ac200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:37.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.139+0000 7f0c76beb700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c700b3ae0 0x7f0c700a9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:37.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.139+0000 7f0c76beb700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c70159720 0x7f0c7006fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:37.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.139+0000 7f0c76beb700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c70070710 con 0x7f0c70159720 2024-09-13T18:36:37.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.139+0000 7f0c76beb700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c70147720 con 0x7f0c7006aa90 2024-09-13T18:36:37.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.139+0000 7f0c76beb700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c70145680 con 0x7f0c700b3ae0 2024-09-13T18:36:37.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.139+0000 7f0c763ea700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c70159720 0x7f0c7006fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:37.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.139+0000 7f0c75be9700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c7006aa90 0x7f0c700ac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:37.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.139+0000 7f0c753e8700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c700b3ae0 0x7f0c700a9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:37.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.139+0000 7f0c763ea700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c70159720 0x7f0c7006fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42704/0 (socket says 172.21.15.44:42704) 2024-09-13T18:36:37.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.139+0000 7f0c763ea700 1 -- 172.21.15.44:0/3391013793 learned_addr learned my addr 172.21.15.44:0/3391013793 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:37.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.143+0000 7f0c763ea700 1 -- 172.21.15.44:0/3391013793 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c700b3ae0 msgr2=0x7f0c700a9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:37.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.143+0000 7f0c763ea700 1 --2- 172.21.15.44:0/3391013793 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c700b3ae0 0x7f0c700a9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.143+0000 7f0c763ea700 1 -- 172.21.15.44:0/3391013793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c7006aa90 msgr2=0x7f0c700ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:37.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.143+0000 7f0c763ea700 1 --2- 172.21.15.44:0/3391013793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c7006aa90 0x7f0c700ac200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.143+0000 7f0c763ea700 1 -- 172.21.15.44:0/3391013793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c600094b0 con 0x7f0c70159720 2024-09-13T18:36:37.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.143+0000 7f0c763ea700 1 --2- 172.21.15.44:0/3391013793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c70159720 0x7f0c7006fb30 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f0c6800cc20 tx=0x7f0c6800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:37.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.143+0000 7f0c667fc700 1 -- 172.21.15.44:0/3391013793 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c68003c20 con 0x7f0c70159720 2024-09-13T18:36:37.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.143+0000 7f0c667fc700 1 -- 172.21.15.44:0/3391013793 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c68003d80 con 0x7f0c70159720 2024-09-13T18:36:37.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.143+0000 7f0c76beb700 1 -- 172.21.15.44:0/3391013793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c70145920 con 0x7f0c70159720 2024-09-13T18:36:37.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.143+0000 7f0c667fc700 1 -- 172.21.15.44:0/3391013793 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6800aae0 con 0x7f0c70159720 2024-09-13T18:36:37.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.143+0000 7f0c76beb700 1 -- 172.21.15.44:0/3391013793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c70145ee0 con 0x7f0c70159720 2024-09-13T18:36:37.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.143+0000 7f0c76beb700 1 -- 172.21.15.44:0/3391013793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c70157ae0 con 0x7f0c70159720 2024-09-13T18:36:37.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.143+0000 7f0c667fc700 1 -- 172.21.15.44:0/3391013793 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0c6800ac40 con 0x7f0c70159720 2024-09-13T18:36:37.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.143+0000 7f0c667fc700 1 --2- 172.21.15.44:0/3391013793 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0c54066730 0x7f0c54068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:37.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.147+0000 7f0c667fc700 1 -- 172.21.15.44:0/3391013793 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0c68083e90 con 0x7f0c70159720 2024-09-13T18:36:37.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.147+0000 7f0c75be9700 1 --2- 172.21.15.44:0/3391013793 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0c54066730 0x7f0c54068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:37.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.147+0000 7f0c75be9700 1 --2- 172.21.15.44:0/3391013793 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0c54066730 0x7f0c54068bf0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c004a80 tx=0x7f0c6c000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:37.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.151+0000 7f0c667fc700 1 -- 172.21.15.44:0/3391013793 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0c680514e0 con 0x7f0c70159720 2024-09-13T18:36:37.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.319+0000 7f0c76beb700 1 -- 172.21.15.44:0/3391013793 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0c70159b00 con 0x7f0c54066730 2024-09-13T18:36:37.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.327+0000 7f0c667fc700 1 -- 172.21.15.44:0/3391013793 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49390 (secure 0 0 0) 0x7f0c6c001c40 con 0x7f0c54066730 2024-09-13T18:36:37.336 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:37.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.327+0000 7f0c76beb700 1 -- 172.21.15.44:0/3391013793 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0c54066730 msgr2=0x7f0c54068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:37.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.327+0000 7f0c76beb700 1 --2- 172.21.15.44:0/3391013793 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0c54066730 0x7f0c54068bf0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c004a80 tx=0x7f0c6c000bc0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.327+0000 7f0c76beb700 1 -- 172.21.15.44:0/3391013793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c70159720 msgr2=0x7f0c7006fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:37.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.327+0000 7f0c76beb700 1 --2- 172.21.15.44:0/3391013793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c70159720 0x7f0c7006fb30 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f0c6800cc20 tx=0x7f0c6800cf30 comp rx=0 tx=0).stop 2024-09-13T18:36:37.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.327+0000 7f0c76beb700 1 -- 172.21.15.44:0/3391013793 shutdown_connections 2024-09-13T18:36:37.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.327+0000 7f0c76beb700 1 --2- 172.21.15.44:0/3391013793 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0c54066730 0x7f0c54068bf0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.327+0000 7f0c76beb700 1 --2- 172.21.15.44:0/3391013793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c70159720 0x7f0c7006fb30 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.327+0000 7f0c76beb700 1 --2- 172.21.15.44:0/3391013793 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c700b3ae0 0x7f0c700a9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.327+0000 7f0c76beb700 1 --2- 172.21.15.44:0/3391013793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c7006aa90 0x7f0c700ac200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.327+0000 7f0c76beb700 1 -- 172.21.15.44:0/3391013793 >> 172.21.15.44:0/3391013793 conn(0x7f0c700b0f00 msgr2=0x7f0c700cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:37.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.331+0000 7f0c76beb700 1 -- 172.21.15.44:0/3391013793 shutdown_connections 2024-09-13T18:36:37.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.331+0000 7f0c76beb700 1 -- 172.21.15.44:0/3391013793 wait complete. 2024-09-13T18:36:37.339 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:36:37.351 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":380,"stamp":"2024-09-13T18:36:36.522977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289252,"kb_used_data":9984,"kb_used_omap":12,"kb_used_meta":279155,"kb_avail":754685468,"statfs":{"total":773094113280,"available":772797919232,"internally_reserved":0,"allocated":10223616,"data_stored":5063662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":285855288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3760,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-49,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002442"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":228,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:36:31.721392+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:36:31.721392+0000","last_peered":"2024-09-13T18:36:31.721392+0000","last_clean":"2024-09-13T18:36:31.721392+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:36:31.721392+0000","last_undegraded":"2024-09-13T18:36:31.721392+0000","last_fullsized":"2024-09-13T18:36:31.721392+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574968,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1728512,"data_stored":1079309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75800000000000001,"15min":0.75900000000000001},"min":{"1min":0.49399999999999999,"5min":0.38700000000000001,"15min":0.33600000000000002},"max":{"1min":1.0509999999999999,"5min":1.0760000000000001,"15min":1.163},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.78500000000000003},"min":{"1min":0.46500000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.149,"5min":1.288,"15min":1.288},"last":0.76300000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.84199999999999997,"15min":0.872},"min":{"1min":0.57899999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.115,"5min":1.288,"15min":1.7689999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89400000000000002,"15min":0.92900000000000005},"min":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.52600000000000002},"max":{"1min":1.175,"5min":1.3009999999999999,"15min":1.6140000000000001},"last":0.94199999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.84199999999999997},"min":{"1min":0.60199999999999998,"5min":0.45500000000000002,"15min":0.40500000000000003},"max":{"1min":0.98999999999999999,"5min":1.2270000000000001,"15min":1.3340000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.82599999999999996,"15min":0.879},"min":{"1min":0.64700000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0509999999999999,"5min":1.524,"15min":1.6659999999999999},"last":0.96799999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.88400000000000001,"15min":0.88600000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.52600000000000002},"max":{"1min":1.1160000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1990000000000001,"5min":1.486,"15min":1.486},"last":0.83199999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.84699999999999998,"15min":0.876},"min":{"1min":0.58999999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0649999999999999,"5min":1.4590000000000001,"15min":1.7290000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.02,"15min":1.0329999999999999},"min":{"1min":0.88700000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.226,"5min":1.49,"15min":1.7050000000000001},"last":0.80500000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.94599999999999995,"15min":0.95099999999999996},"min":{"1min":0.64000000000000001,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2490000000000001,"5min":1.4159999999999999,"15min":1.4259999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.044,"15min":1.0489999999999999},"min":{"1min":0.74199999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.325,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0289999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0409999999999999,"15min":1.075},"min":{"1min":0.626,"5min":0.626,"15min":0.58099999999999996},"max":{"1min":1.3500000000000001,"5min":1.4730000000000001,"15min":2.077},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.087,"15min":1.0740000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.69099999999999995},"max":{"1min":1.323,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.89100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574970,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1130496,"data_stored":483632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.80700000000000005,"15min":0.82099999999999995},"min":{"1min":0.439,"5min":0.438,"15min":0.438},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":1.083},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.78900000000000003,"15min":0.81599999999999995},"min":{"1min":0.54700000000000004,"5min":0.45800000000000002,"15min":0.42099999999999999},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.2669999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.79000000000000004,"15min":0.81399999999999995},"min":{"1min":0.52000000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.302},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.84499999999999997,"15min":0.83399999999999996},"min":{"1min":0.504,"5min":0.48299999999999998,"15min":0.48099999999999998},"max":{"1min":1.2130000000000001,"5min":1.262,"15min":1.262},"last":1.1479999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.81399999999999995,"15min":0.81499999999999995},"min":{"1min":0.66200000000000003,"5min":0.47399999999999998,"15min":0.46899999999999997},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.016},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.85799999999999998,"15min":0.85999999999999999},"min":{"1min":0.54400000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.96199999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.92000000000000004,"15min":0.88800000000000001},"min":{"1min":0.71899999999999997,"5min":0.57599999999999996,"15min":0.52300000000000002},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.90100000000000002,"15min":0.93500000000000005},"min":{"1min":0.73099999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2330000000000001,"5min":1.2390000000000001,"15min":1.2909999999999999},"last":1.3460000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.871,"15min":0.88200000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.57699999999999996},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.97499999999999998,"15min":0.99199999999999999},"min":{"1min":0.63100000000000001,"5min":0.623,"15min":0.623},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.2}]},{"osd":5,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0429999999999999,"15min":1.0409999999999999},"min":{"1min":0.69099999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.97799999999999998,"15min":0.97999999999999998},"min":{"1min":0.70799999999999996,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.419,"5min":1.419,"15min":1.4990000000000001},"last":1.165}]},{"osd":7,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0129999999999999,"15min":1.0009999999999999},"min":{"1min":0.67800000000000005,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.121,"15min":1.1140000000000001},"min":{"1min":0.89900000000000002,"5min":0.76200000000000001,"15min":0.76000000000000001},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.375}]}]},{"osd":5,"up_from":13,"seq":55834574968,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1134592,"data_stored":485922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76800000000000002,"15min":0.81699999999999995},"min":{"1min":0.56200000000000006,"5min":0.46899999999999997,"15min":0.39800000000000002},"max":{"1min":1.0309999999999999,"5min":1.3280000000000001,"15min":1.3640000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.81000000000000005,"15min":0.84899999999999998},"min":{"1min":0.60799999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1559999999999999,"5min":1.194,"15min":1.482},"last":0.93999999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.79300000000000004,"15min":0.79500000000000004},"min":{"1min":0.57399999999999995,"5min":0.42499999999999999,"15min":0.40999999999999998},"max":{"1min":1.008,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85599999999999998,"15min":0.90900000000000003},"min":{"1min":0.55100000000000005,"5min":0.50900000000000001,"15min":0.45200000000000001},"max":{"1min":1.1200000000000001,"5min":1.218,"15min":1.4850000000000001},"last":0.71599999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.92500000000000004,"15min":0.94599999999999995},"min":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.51300000000000001},"max":{"1min":1.115,"5min":1.2430000000000001,"15min":1.4179999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93500000000000005,"15min":0.98199999999999998},"min":{"1min":0.59799999999999998,"5min":0.51800000000000002,"15min":0.46500000000000002},"max":{"1min":1.1519999999999999,"5min":1.2849999999999999,"15min":1.4690000000000001},"last":0.83099999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.878,"15min":0.92400000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.51700000000000002},"max":{"1min":1.117,"5min":1.2010000000000001,"15min":1.4510000000000001},"last":1.091},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89500000000000002,"15min":0.92600000000000005},"min":{"1min":0.65400000000000003,"5min":0.61199999999999999,"15min":0.55300000000000005},"max":{"1min":1.1679999999999999,"5min":1.335,"15min":1.4990000000000001},"last":0.96299999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.91300000000000003,"15min":0.95199999999999996},"min":{"1min":0.57599999999999996,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2549999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95799999999999996,"15min":1.0089999999999999},"min":{"1min":0.628,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.206,"5min":1.302,"15min":1.542},"last":1.143}]},{"osd":6,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.97799999999999998,"15min":1.0129999999999999},"min":{"1min":0.83599999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2989999999999999,"5min":1.4259999999999999,"15min":1.698},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1020000000000001,"15min":1.1419999999999999},"min":{"1min":0.90400000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.2170000000000001,"5min":1.52,"15min":1.581},"last":0.88400000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.0589999999999999,"15min":1.1419999999999999},"min":{"1min":0.68500000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.256,"5min":1.552,"15min":1.847},"last":1.01},{"interface":"front","average":{"1min":1.069,"5min":1.0640000000000001,"15min":1.117},"min":{"1min":0.72399999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2549999999999999,"5min":1.4259999999999999,"15min":1.8100000000000001},"last":0.91400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574968,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46160,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325680,"statfs":{"total":96636764160,"available":96589496320,"internally_reserved":0,"allocated":1118208,"data_stored":482938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.82299999999999995,"15min":0.875},"min":{"1min":0.52000000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.159,"5min":1.1930000000000001,"15min":1.3720000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.89500000000000002,"15min":0.93999999999999995},"min":{"1min":0.57299999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.163,"5min":1.21,"15min":1.5229999999999999},"last":0.60899999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.54300000000000004,"5min":0.47099999999999997,"15min":0.435},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.88,"5min":0.84199999999999997,"15min":0.84599999999999997},"min":{"1min":0.58399999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1859999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.54800000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.80000000000000004,"15min":0.83899999999999997},"min":{"1min":0.67100000000000004,"5min":0.46300000000000002,"15min":0.44600000000000001},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.871,"5min":0.86499999999999999,"15min":0.85499999999999998},"min":{"1min":0.58199999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.212,"5min":1.331,"15min":1.331},"last":1.137}]},{"osd":3,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.89300000000000002,"15min":0.94999999999999996},"min":{"1min":0.55800000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.639},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.91200000000000003,"15min":0.96499999999999997},"min":{"1min":0.70499999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.8300000000000001},"last":0.93000000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.91700000000000004,"15min":0.95999999999999996},"min":{"1min":0.67300000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.327,"5min":1.518,"15min":2.3889999999999998},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.052,"15min":1.093},"min":{"1min":0.91200000000000003,"5min":0.66100000000000003,"15min":0.626},"max":{"1min":1.605,"5min":1.605,"15min":2.0049999999999999},"last":0.95699999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94599999999999995,"15min":0.91500000000000004},"min":{"1min":0.69199999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2929999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.121,"5min":1.0840000000000001,"15min":1.0960000000000001},"min":{"1min":0.873,"5min":0.70099999999999996,"15min":0.63500000000000001},"max":{"1min":1.409,"5min":1.4259999999999999,"15min":1.794},"last":1.1899999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0509999999999999,"15min":1.0680000000000001},"min":{"1min":0.66100000000000003,"5min":0.65200000000000002,"15min":0.60499999999999998},"max":{"1min":1.659,"5min":1.659,"15min":1.669},"last":1.087},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0529999999999999,"15min":1.0349999999999999},"min":{"1min":0.877,"5min":0.69499999999999995,"15min":0.61799999999999999},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.1080000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574971,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1130496,"data_stored":485900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64200000000000002,"15min":0.66100000000000003},"min":{"1min":0.38300000000000001,"5min":0.22,"15min":0.22},"max":{"1min":1.0489999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.629},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.622,"15min":0.65700000000000003},"min":{"1min":0.434,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":1.008,"5min":1.008,"15min":1.1970000000000001},"last":0.68500000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.67800000000000005,"15min":0.68999999999999995},"min":{"1min":0.44600000000000001,"5min":0.24099999999999999,"15min":0.23100000000000001},"max":{"1min":0.98299999999999998,"5min":1.379,"15min":1.379},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.751,"15min":0.79300000000000004},"min":{"1min":0.46200000000000002,"5min":0.30199999999999999,"15min":0.23499999999999999},"max":{"1min":1.238,"5min":1.397,"15min":2.0030000000000001},"last":0.78700000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.40899999999999997,"5min":0.32500000000000001,"15min":0.29299999999999998},"max":{"1min":0.91000000000000003,"5min":1.3300000000000001,"15min":1.333},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.83999999999999997,"15min":0.86699999999999999},"min":{"1min":0.55600000000000005,"5min":0.33000000000000002,"15min":0.27300000000000002},"max":{"1min":1.296,"5min":1.423,"15min":1.423},"last":0.89000000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.88400000000000001,"15min":0.92900000000000005},"min":{"1min":0.58399999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1779999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.97099999999999997,"15min":1.0089999999999999},"min":{"1min":0.67400000000000004,"5min":0.56899999999999995,"15min":0.52300000000000002},"max":{"1min":1.3440000000000001,"5min":1.587,"15min":1.587},"last":0.84799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.038,"15min":1.119},"min":{"1min":0.83299999999999996,"5min":0.55200000000000005,"15min":0.51400000000000001},"max":{"1min":1.3089999999999999,"5min":1.6200000000000001,"15min":2.2320000000000002},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1,"15min":1.0680000000000001},"min":{"1min":0.65100000000000002,"5min":0.53900000000000003,"15min":0.53600000000000003},"max":{"1min":1.252,"5min":1.3280000000000001,"15min":1.718},"last":0.878}]},{"osd":6,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0589999999999999,"15min":1.097},"min":{"1min":0.69699999999999995,"5min":0.60199999999999998,"15min":0.496},"max":{"1min":1.4259999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.0900000000000001,"15min":1.1699999999999999},"min":{"1min":0.79100000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.385,"5min":1.51,"15min":2.1819999999999999},"last":1.032}]},{"osd":7,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0329999999999999,"15min":1.0740000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.624},"max":{"1min":1.391,"5min":1.391,"15min":1.4670000000000001},"last":1.083},{"interface":"front","average":{"1min":1.073,"5min":1.101,"15min":1.143},"min":{"1min":0.69999999999999996,"5min":0.57499999999999996,"15min":0.54300000000000004},"max":{"1min":1.367,"5min":1.548,"15min":1.5920000000000001},"last":1.0009999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574969,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40404,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331436,"statfs":{"total":96636764160,"available":96595390464,"internally_reserved":0,"allocated":1122304,"data_stored":483520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63600000000000001,"15min":0.65800000000000003},"min":{"1min":0.45100000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":1.0009999999999999,"5min":1.1020000000000001,"15min":1.1919999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.72199999999999998,"15min":0.76700000000000002},"min":{"1min":0.56000000000000005,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.4370000000000001},"last":0.58299999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65500000000000003,"15min":0.69099999999999995},"min":{"1min":0.48399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.94799999999999995,"5min":1.2050000000000001,"15min":1.2629999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.68999999999999995,"15min":0.72099999999999997},"min":{"1min":0.51900000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.181,"5min":1.383,"15min":1.383},"last":0.79600000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.68100000000000005,"15min":0.67500000000000004},"min":{"1min":0.46800000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.85199999999999998},"min":{"1min":0.48499999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1870000000000001,"5min":1.3460000000000001,"15min":1.548},"last":0.82899999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.94799999999999995,"15min":0.96899999999999997},"min":{"1min":0.69199999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1279999999999999,"5min":1.653,"15min":1.653},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.96599999999999997,"15min":1.0209999999999999},"min":{"1min":0.73299999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2829999999999999,"5min":1.51,"15min":2.3849999999999998},"last":1.2509999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.93200000000000005,"15min":0.92500000000000004},"min":{"1min":0.74399999999999999,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.327,"5min":1.4730000000000001,"15min":1.498},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.028,"15min":1.048},"min":{"1min":0.81799999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.254,"5min":1.7549999999999999,"15min":1.869},"last":1.28}]},{"osd":6,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.89300000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.3500000000000001,"5min":1.6120000000000001,"15min":2.762},"last":1.105},{"interface":"front","average":{"1min":1.087,"5min":1.0129999999999999,"15min":1.036},"min":{"1min":0.85999999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.407,"5min":1.5509999999999999,"15min":1.988},"last":0.90100000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.095,"15min":1.1359999999999999},"min":{"1min":0.85199999999999998,"5min":0.61099999999999999,"15min":0.59799999999999998},"max":{"1min":1.496,"5min":1.8240000000000001,"15min":2.6800000000000002},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.081,"15min":1.0740000000000001},"min":{"1min":0.81399999999999995,"5min":0.64100000000000001,"15min":0.52800000000000002},"max":{"1min":1.3129999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.0449999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574969,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1130496,"data_stored":483132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.34300000000000003,"15min":0.33200000000000002},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70499999999999996,"15min":0.72799999999999998},"min":{"1min":0.502,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.1279999999999999,"5min":1.341,"15min":1.3560000000000001},"last":0.94099999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.46600000000000003,"5min":0.311,"15min":0.311},"max":{"1min":1.0069999999999999,"5min":1.133,"15min":1.1879999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.73899999999999999,"15min":0.747},"min":{"1min":0.44600000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.089,"5min":1.617,"15min":1.617},"last":0.89200000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.56599999999999995,"5min":0.375,"15min":0.375},"max":{"1min":1.1040000000000001,"5min":1.415,"15min":1.415},"last":1.085},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.751,"15min":0.77700000000000002},"min":{"1min":0.41999999999999998,"5min":0.35999999999999999,"15min":0.35699999999999998},"max":{"1min":1.0820000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.85899999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.95299999999999996,"15min":0.95399999999999996},"min":{"1min":0.70099999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2669999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.95999999999999996,"15min":0.97099999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2450000000000001,"5min":1.52,"15min":1.994},"last":1.256}]},{"osd":5,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.96799999999999997,"15min":0.97299999999999998},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.49299999999999999},"max":{"1min":1.3260000000000001,"5min":1.7,"15min":2.0960000000000001},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.054,"15min":1.0740000000000001},"min":{"1min":0.82299999999999995,"5min":0.626,"15min":0.626},"max":{"1min":1.407,"5min":1.8939999999999999,"15min":2.7280000000000002},"last":1.516}]},{"osd":6,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.024,"15min":1.0600000000000001},"min":{"1min":0.68899999999999995,"5min":0.56599999999999995,"15min":0.53100000000000003},"max":{"1min":1.3029999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.04,"15min":1.075},"min":{"1min":0.69199999999999995,"5min":0.64700000000000002,"15min":0.63100000000000001},"max":{"1min":1.3029999999999999,"5min":1.9710000000000001,"15min":2.0489999999999999},"last":1.462}]},{"osd":7,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.099,"15min":1.095},"min":{"1min":0.88500000000000001,"5min":0.72499999999999998,"15min":0.67400000000000004},"max":{"1min":1.3600000000000001,"5min":2.0070000000000001,"15min":2.5579999999999998},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.089,"15min":1.1080000000000001},"min":{"1min":0.77300000000000002,"5min":0.55200000000000005,"15min":0.51300000000000001},"max":{"1min":1.627,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.494}]}]},{"osd":0,"up_from":13,"seq":55834574969,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41000,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330840,"statfs":{"total":96636764160,"available":96594780160,"internally_reserved":0,"allocated":1728512,"data_stored":1079309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.59999999999999998,"15min":0.60499999999999998},"min":{"1min":0.45900000000000002,"5min":0.192,"15min":0.192},"max":{"1min":0.97599999999999998,"5min":1.23,"15min":1.23},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66500000000000004,"15min":0.68899999999999995},"min":{"1min":0.53100000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.98399999999999999,"5min":1.1220000000000001,"15min":1.1759999999999999},"last":0.77700000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.67900000000000005,"15min":0.69699999999999995},"min":{"1min":0.53400000000000003,"5min":0.249,"15min":0.23799999999999999},"max":{"1min":1.1539999999999999,"5min":1.494,"15min":1.494},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.71599999999999997,"15min":0.71899999999999997},"min":{"1min":0.42799999999999999,"5min":0.223,"15min":0.223},"max":{"1min":1.042,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.65700000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68500000000000005,"15min":0.64800000000000002},"min":{"1min":0.51600000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.93300000000000005,"5min":1.137,"15min":1.137},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.82599999999999996,"15min":0.82699999999999996},"min":{"1min":0.63400000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.2490000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.70599999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.96099999999999997,"15min":0.96199999999999997},"min":{"1min":0.66800000000000004,"5min":0.623,"15min":0.623},"max":{"1min":1.595,"5min":1.764,"15min":1.764},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.90200000000000002,"15min":0.91000000000000003},"min":{"1min":0.64900000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.304,"5min":1.3620000000000001,"15min":1.4810000000000001},"last":0.81499999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98199999999999998,"15min":0.97299999999999998},"min":{"1min":0.79500000000000004,"5min":0.64600000000000002,"15min":0.59299999999999997},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.046,"15min":1.052},"min":{"1min":0.85499999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5489999999999999,"5min":1.637,"15min":1.637},"last":0.98999999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.0680000000000001,"15min":1.0860000000000001},"min":{"1min":0.79300000000000004,"5min":0.63900000000000001,"15min":0.61699999999999999},"max":{"1min":1.45,"5min":1.718,"15min":1.718},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.171,"5min":1.081,"15min":1.1080000000000001},"min":{"1min":0.80700000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.6180000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.89400000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.071,"15min":1.105},"min":{"1min":0.83899999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.538,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.05,"5min":1.0309999999999999,"15min":1.0409999999999999},"min":{"1min":0.72599999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.284,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.86599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:36:37.353 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:37.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.455+0000 7fcef1b24700 1 Processor -- start 2024-09-13T18:36:37.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.455+0000 7fcef1b24700 1 -- start start 2024-09-13T18:36:37.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.455+0000 7fcef1b24700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fceec153ba0 0x7fceec0c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:37.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.455+0000 7fcef1b24700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fceec0ca2d0 0x7fceec0cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:37.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.455+0000 7fcef1b24700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceec15e080 con 0x7fceec0ce010 2024-09-13T18:36:37.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.455+0000 7fcef1b24700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceec0ccde0 con 0x7fceec0ca2d0 2024-09-13T18:36:37.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.455+0000 7fcef1b24700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec160a60 con 0x7fceec153ba0 2024-09-13T18:36:37.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.455+0000 7fcef1323700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fceec0ce010 0x7fceec071c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40004/0 (socket says 172.21.15.44:40004) 2024-09-13T18:36:37.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.455+0000 7fceebfff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fceec0ca2d0 0x7fceec0cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:37.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.455+0000 7fcef1323700 1 -- 172.21.15.44:0/3786769576 learned_addr learned my addr 172.21.15.44:0/3786769576 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:37.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.455+0000 7fcef0b22700 1 --2- 172.21.15.44:0/3786769576 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fceec153ba0 0x7fceec0c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:37.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.455+0000 7fcef0b22700 1 -- 172.21.15.44:0/3786769576 >> v2:172.21.15.44:3300/0 conn(0x7fceec0ca2d0 msgr2=0x7fceec0cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:37.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.455+0000 7fcef0b22700 1 --2- 172.21.15.44:0/3786769576 >> v2:172.21.15.44:3300/0 conn(0x7fceec0ca2d0 0x7fceec0cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.455+0000 7fcef0b22700 1 -- 172.21.15.44:0/3786769576 >> v1:172.21.15.44:6789/0 conn(0x7fceec0ce010 legacy=0x7fceec071c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:37.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.455+0000 7fcef0b22700 1 -- 172.21.15.44:0/3786769576 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec15dda0 con 0x7fceec153ba0 2024-09-13T18:36:37.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.459+0000 7fcef0b22700 1 --2- 172.21.15.44:0/3786769576 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fceec153ba0 0x7fceec0c9d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009d90 tx=0x7fcedc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae33c53f58e942bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:37.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.459+0000 7fceeb7fe700 1 -- 172.21.15.44:0/3786769576 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc00e070 con 0x7fceec153ba0 2024-09-13T18:36:37.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.459+0000 7fceeb7fe700 1 -- 172.21.15.44:0/3786769576 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcedc00bb20 con 0x7fceec153ba0 2024-09-13T18:36:37.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.459+0000 7fceeb7fe700 1 -- 172.21.15.44:0/3786769576 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc012430 con 0x7fceec153ba0 2024-09-13T18:36:37.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.459+0000 7fcef1b24700 1 -- 172.21.15.44:0/3786769576 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fceec153ba0 msgr2=0x7fceec0c9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:37.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.459+0000 7fcef1b24700 1 --2- 172.21.15.44:0/3786769576 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fceec153ba0 0x7fceec0c9d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009d90 tx=0x7fcedc00b330 comp rx=0 tx=0).stop 2024-09-13T18:36:37.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.459+0000 7fcef1b24700 1 -- 172.21.15.44:0/3786769576 shutdown_connections 2024-09-13T18:36:37.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.459+0000 7fcef1b24700 1 --2- 172.21.15.44:0/3786769576 >> v2:172.21.15.44:3300/0 conn(0x7fceec0ca2d0 0x7fceec0cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.459+0000 7fcef1b24700 1 --2- 172.21.15.44:0/3786769576 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fceec153ba0 0x7fceec0c9d90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.459+0000 7fcef1b24700 1 -- 172.21.15.44:0/3786769576 >> 172.21.15.44:0/3786769576 conn(0x7fceec06a310 msgr2=0x7fceec06a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:37.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.459+0000 7fcef1b24700 1 -- 172.21.15.44:0/3786769576 shutdown_connections 2024-09-13T18:36:37.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.459+0000 7fcef1b24700 1 -- 172.21.15.44:0/3786769576 wait complete. 2024-09-13T18:36:37.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.459+0000 7fcef1b24700 1 Processor -- start 2024-09-13T18:36:37.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.459+0000 7fcef1b24700 1 -- start start 2024-09-13T18:36:37.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fcef1b24700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fceec0ca2d0 0x7fceec06c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:37.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fcef1b24700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fceec0ce010 0x7fceec06d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:37.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fcef1b24700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fceec153ba0 0x7fceec156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:37.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fcef1b24700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec06e270 con 0x7fceec0ca2d0 2024-09-13T18:36:37.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fcef1b24700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec06e550 con 0x7fceec0ce010 2024-09-13T18:36:37.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fcef1b24700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec06e830 con 0x7fceec153ba0 2024-09-13T18:36:37.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fcef0b22700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fceec0ca2d0 0x7fceec06c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:37.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fcef0b22700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fceec0ca2d0 0x7fceec06c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42728/0 (socket says 172.21.15.44:42728) 2024-09-13T18:36:37.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fcef0b22700 1 -- 172.21.15.44:0/2615097209 learned_addr learned my addr 172.21.15.44:0/2615097209 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:37.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fceebfff700 1 --2- 172.21.15.44:0/2615097209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fceec0ce010 0x7fceec06d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:37.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fcef1323700 1 --2- 172.21.15.44:0/2615097209 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fceec153ba0 0x7fceec156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:37.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fcef0b22700 1 -- 172.21.15.44:0/2615097209 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fceec153ba0 msgr2=0x7fceec156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:37.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fcef0b22700 1 --2- 172.21.15.44:0/2615097209 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fceec153ba0 0x7fceec156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fcef0b22700 1 -- 172.21.15.44:0/2615097209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fceec0ce010 msgr2=0x7fceec06d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:37.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fcef0b22700 1 --2- 172.21.15.44:0/2615097209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fceec0ce010 0x7fceec06d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fcef0b22700 1 -- 172.21.15.44:0/2615097209 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcedc009a70 con 0x7fceec0ca2d0 2024-09-13T18:36:37.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fceebfff700 1 --2- 172.21.15.44:0/2615097209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fceec0ce010 0x7fceec06d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:37.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fcef0b22700 1 --2- 172.21.15.44:0/2615097209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fceec0ca2d0 0x7fceec06c0e0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fcedc014040 tx=0x7fcedc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:37.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fcee97fa700 1 -- 172.21.15.44:0/2615097209 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc012430 con 0x7fceec0ca2d0 2024-09-13T18:36:37.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fcee97fa700 1 -- 172.21.15.44:0/2615097209 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcedc020070 con 0x7fceec0ca2d0 2024-09-13T18:36:37.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fcef1b24700 1 -- 172.21.15.44:0/2615097209 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceec06eb10 con 0x7fceec0ca2d0 2024-09-13T18:36:37.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fcee97fa700 1 -- 172.21.15.44:0/2615097209 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc004280 con 0x7fceec0ca2d0 2024-09-13T18:36:37.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fcef1b24700 1 -- 172.21.15.44:0/2615097209 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceec06de60 con 0x7fceec0ca2d0 2024-09-13T18:36:37.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.463+0000 7fcef1b24700 1 -- 172.21.15.44:0/2615097209 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceec0cdad0 con 0x7fceec0ca2d0 2024-09-13T18:36:37.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.467+0000 7fcee97fa700 1 -- 172.21.15.44:0/2615097209 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcedc0043e0 con 0x7fceec0ca2d0 2024-09-13T18:36:37.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.467+0000 7fcee97fa700 1 --2- 172.21.15.44:0/2615097209 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fced8066730 0x7fced8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:37.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.467+0000 7fcee97fa700 1 -- 172.21.15.44:0/2615097209 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcedc022070 con 0x7fceec0ca2d0 2024-09-13T18:36:37.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.467+0000 7fceebfff700 1 --2- 172.21.15.44:0/2615097209 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fced8066730 0x7fced8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:37.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.467+0000 7fceebfff700 1 --2- 172.21.15.44:0/2615097209 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fced8066730 0x7fced8068bf0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fceec1508d0 tx=0x7fcee0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:37.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.475+0000 7fcee97fa700 1 -- 172.21.15.44:0/2615097209 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcedc0536d0 con 0x7fceec0ca2d0 2024-09-13T18:36:37.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.647+0000 7fcef1b24700 1 -- 172.21.15.44:0/2615097209 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fceec1615c0 con 0x7fceec0ca2d0 2024-09-13T18:36:37.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.651+0000 7fcee97fa700 1 -- 172.21.15.44:0/2615097209 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+12927 (secure 0 0 0) 0x7fcedc01ae60 con 0x7fceec0ca2d0 2024-09-13T18:36:37.658 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:37.658 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":93,"fsid":"c8e1d12d-7fb9-4a33-982e-b895bb77262c","created":"2024-09-13T18:26:37.026131+0000","modified":"2024-09-13T18:36:34.746498+0000","last_up_change":"2024-09-13T18:26:48.506803+0000","last_in_change":"2024-09-13T18:26:39.150530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:26:50.378491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abba99a8-7b72-4323-a3f9-c4272d0567dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6801","nonce":2647753462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6803","nonce":2647753462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6807","nonce":2647753462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2647753462},{"type":"v1","addr":"172.21.15.44:6805","nonce":2647753462}]},"public_addr":"172.21.15.44:6801/2647753462","cluster_addr":"172.21.15.44:6803/2647753462","heartbeat_back_addr":"172.21.15.44:6807/2647753462","heartbeat_front_addr":"172.21.15.44:6805/2647753462","state":["exists","up"]},{"osd":1,"uuid":"32427ee7-5a8f-4853-b396-051ae9d5a463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6818","nonce":2250405239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6821","nonce":2250405239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6827","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6828","nonce":2250405239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6823","nonce":2250405239},{"type":"v1","addr":"172.21.15.44:6825","nonce":2250405239}]},"public_addr":"172.21.15.44:6818/2250405239","cluster_addr":"172.21.15.44:6821/2250405239","heartbeat_back_addr":"172.21.15.44:6828/2250405239","heartbeat_front_addr":"172.21.15.44:6825/2250405239","state":["exists","up"]},{"osd":2,"uuid":"3a2dd8d4-36cd-4333-9c8a-553f72a85424","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6817","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6819","nonce":3180763837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6824","nonce":3180763837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6831","nonce":3180763837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3180763837},{"type":"v1","addr":"172.21.15.44:6829","nonce":3180763837}]},"public_addr":"172.21.15.44:6819/3180763837","cluster_addr":"172.21.15.44:6824/3180763837","heartbeat_back_addr":"172.21.15.44:6831/3180763837","heartbeat_front_addr":"172.21.15.44:6829/3180763837","state":["exists","up"]},{"osd":3,"uuid":"b98b9882-0680-4773-a86d-d9af6ad2c77b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6809","nonce":771281770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6811","nonce":771281770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6815","nonce":771281770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":771281770},{"type":"v1","addr":"172.21.15.44:6813","nonce":771281770}]},"public_addr":"172.21.15.44:6809/771281770","cluster_addr":"172.21.15.44:6811/771281770","heartbeat_back_addr":"172.21.15.44:6815/771281770","heartbeat_front_addr":"172.21.15.44:6813/771281770","state":["exists","up"]},{"osd":4,"uuid":"c6fc1c0b-e9b5-4ae1-af3b-e5f2ca031963","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6817","nonce":2515272044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6819","nonce":2515272044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6823","nonce":2515272044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2515272044},{"type":"v1","addr":"172.21.15.99:6821","nonce":2515272044}]},"public_addr":"172.21.15.99:6817/2515272044","cluster_addr":"172.21.15.99:6819/2515272044","heartbeat_back_addr":"172.21.15.99:6823/2515272044","heartbeat_front_addr":"172.21.15.99:6821/2515272044","state":["exists","up"]},{"osd":5,"uuid":"c868d3e9-dad7-47fe-8458-e3c50f82acc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6801","nonce":827163121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6803","nonce":827163121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6807","nonce":827163121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":827163121},{"type":"v1","addr":"172.21.15.99:6805","nonce":827163121}]},"public_addr":"172.21.15.99:6801/827163121","cluster_addr":"172.21.15.99:6803/827163121","heartbeat_back_addr":"172.21.15.99:6807/827163121","heartbeat_front_addr":"172.21.15.99:6805/827163121","state":["exists","up"]},{"osd":6,"uuid":"ad63ac00-986c-42e5-b9c7-16d980cda2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6809","nonce":2907584318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6811","nonce":2907584318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6815","nonce":2907584318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2907584318},{"type":"v1","addr":"172.21.15.99:6813","nonce":2907584318}]},"public_addr":"172.21.15.99:6809/2907584318","cluster_addr":"172.21.15.99:6811/2907584318","heartbeat_back_addr":"172.21.15.99:6815/2907584318","heartbeat_front_addr":"172.21.15.99:6813/2907584318","state":["exists","up"]},{"osd":7,"uuid":"f28cb076-1358-447e-962a-fbf60091be8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6825","nonce":2245335901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6827","nonce":2245335901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6831","nonce":2245335901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2245335901},{"type":"v1","addr":"172.21.15.99:6829","nonce":2245335901}]},"public_addr":"172.21.15.99:6825/2245335901","cluster_addr":"172.21.15.99:6827/2245335901","heartbeat_back_addr":"172.21.15.99:6831/2245335901","heartbeat_front_addr":"172.21.15.99:6829/2245335901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.345041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.735231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.736425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.625365+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.733077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.330754+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.399137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:44.596023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/1527182738":"2024-09-14T18:36:31.707395+0000","172.21.15.44:6834/1527182738":"2024-09-14T18:36:31.707395+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:37.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.651+0000 7fcef1b24700 1 -- 172.21.15.44:0/2615097209 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fced8066730 msgr2=0x7fced8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:37.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.651+0000 7fcef1b24700 1 --2- 172.21.15.44:0/2615097209 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fced8066730 0x7fced8068bf0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fceec1508d0 tx=0x7fcee0008040 comp rx=0 tx=0).stop 2024-09-13T18:36:37.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.651+0000 7fcef1b24700 1 -- 172.21.15.44:0/2615097209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fceec0ca2d0 msgr2=0x7fceec06c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:37.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.651+0000 7fcef1b24700 1 --2- 172.21.15.44:0/2615097209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fceec0ca2d0 0x7fceec06c0e0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fcedc014040 tx=0x7fcedc004af0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.651+0000 7fcef1b24700 1 -- 172.21.15.44:0/2615097209 shutdown_connections 2024-09-13T18:36:37.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.651+0000 7fcef1b24700 1 --2- 172.21.15.44:0/2615097209 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fced8066730 0x7fced8068bf0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.651+0000 7fcef1b24700 1 --2- 172.21.15.44:0/2615097209 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fceec153ba0 0x7fceec156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.651+0000 7fcef1b24700 1 --2- 172.21.15.44:0/2615097209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fceec0ce010 0x7fceec06d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.651+0000 7fcef1b24700 1 --2- 172.21.15.44:0/2615097209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fceec0ca2d0 0x7fceec06c0e0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.651+0000 7fcef1b24700 1 -- 172.21.15.44:0/2615097209 >> 172.21.15.44:0/2615097209 conn(0x7fceec06a310 msgr2=0x7fceec0b4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:37.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.651+0000 7fcef1b24700 1 -- 172.21.15.44:0/2615097209 shutdown_connections 2024-09-13T18:36:37.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:37.651+0000 7fcef1b24700 1 -- 172.21.15.44:0/2615097209 wait complete. 2024-09-13T18:36:38.673 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T18:36:38.674 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:36:38.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.799+0000 7f446c85c700 1 Processor -- start 2024-09-13T18:36:38.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.799+0000 7f446c85c700 1 -- start start 2024-09-13T18:36:38.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.799+0000 7f446c85c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4468159a50 0x7f44680cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.799+0000 7f446c85c700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f44680adef0 0x7f446806c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.799+0000 7f446c85c700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44680cd960 con 0x7f44680711e0 2024-09-13T18:36:38.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.799+0000 7f446c85c700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44680ae3a0 con 0x7f44680adef0 2024-09-13T18:36:38.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.799+0000 7f446c85c700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44680ccd50 con 0x7f4468159a50 2024-09-13T18:36:38.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.799+0000 7f446659c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4468159a50 0x7f44680cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.799+0000 7f446759e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f44680adef0 0x7f446806c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.799+0000 7f4466d9d700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f44680711e0 0x7f44680715c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:51390/0 (socket says 172.21.15.44:51390) 2024-09-13T18:36:38.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.799+0000 7f446759e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f44680adef0 0x7f446806c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:42166/0 (socket says 172.21.15.44:42166) 2024-09-13T18:36:38.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.799+0000 7f4466d9d700 1 -- 172.21.15.44:0/3441526265 learned_addr learned my addr 172.21.15.44:0/3441526265 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:38.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.799+0000 7f446759e700 1 -- 172.21.15.44:0/3441526265 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4468159a50 msgr2=0x7f44680cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:38.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.799+0000 7f446759e700 1 --2- 172.21.15.44:0/3441526265 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4468159a50 0x7f44680cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.799+0000 7f446759e700 1 -- 172.21.15.44:0/3441526265 >> v1:172.21.15.99:6789/0 conn(0x7f44680711e0 legacy=0x7f44680715c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.799+0000 7f446759e700 1 -- 172.21.15.44:0/3441526265 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44680cd030 con 0x7f44680adef0 2024-09-13T18:36:38.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.803+0000 7f446759e700 1 --2- 172.21.15.44:0/3441526265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44680adef0 0x7f446806c620 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f445800baf0 tx=0x7f445800be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d67c3b1d92369bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:38.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.803+0000 7f4465d9b700 1 -- 172.21.15.44:0/3441526265 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445800dc70 con 0x7f44680adef0 2024-09-13T18:36:38.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.803+0000 7f4465d9b700 1 -- 172.21.15.44:0/3441526265 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445800ddd0 con 0x7f44680adef0 2024-09-13T18:36:38.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.803+0000 7f4465d9b700 1 -- 172.21.15.44:0/3441526265 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4458010690 con 0x7f44680adef0 2024-09-13T18:36:38.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.803+0000 7f446c85c700 1 -- 172.21.15.44:0/3441526265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44680adef0 msgr2=0x7f446806c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.803+0000 7f446c85c700 1 --2- 172.21.15.44:0/3441526265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44680adef0 0x7f446806c620 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f445800baf0 tx=0x7f445800be00 comp rx=0 tx=0).stop 2024-09-13T18:36:38.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.803+0000 7f446c85c700 1 -- 172.21.15.44:0/3441526265 shutdown_connections 2024-09-13T18:36:38.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.803+0000 7f446c85c700 1 --2- 172.21.15.44:0/3441526265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44680adef0 0x7f446806c620 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.803+0000 7f446c85c700 1 --2- 172.21.15.44:0/3441526265 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4468159a50 0x7f44680cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.803+0000 7f446c85c700 1 -- 172.21.15.44:0/3441526265 >> 172.21.15.44:0/3441526265 conn(0x7f44680b0cc0 msgr2=0x7f446806fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:38.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.803+0000 7f446c85c700 1 -- 172.21.15.44:0/3441526265 shutdown_connections 2024-09-13T18:36:38.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.803+0000 7f446c85c700 1 -- 172.21.15.44:0/3441526265 wait complete. 2024-09-13T18:36:38.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.803+0000 7f446c85c700 1 Processor -- start 2024-09-13T18:36:38.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.803+0000 7f446c85c700 1 -- start start 2024-09-13T18:36:38.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.807+0000 7f446c85c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44680711e0 0x7f44681484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.807+0000 7f446c85c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44680adef0 0x7f446815afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.807+0000 7f446c85c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4468159a50 0x7f4468158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.807+0000 7f446c85c700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446815aba0 con 0x7f44680711e0 2024-09-13T18:36:38.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.807+0000 7f446c85c700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4468159f20 con 0x7f4468159a50 2024-09-13T18:36:38.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.807+0000 7f446c85c700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446815a200 con 0x7f44680adef0 2024-09-13T18:36:38.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.807+0000 7f4466d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44680711e0 0x7f44681484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.807+0000 7f4466d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44680711e0 0x7f44681484f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42742/0 (socket says 172.21.15.44:42742) 2024-09-13T18:36:38.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.807+0000 7f4466d9d700 1 -- 172.21.15.44:0/2915850359 learned_addr learned my addr 172.21.15.44:0/2915850359 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:38.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.807+0000 7f446759e700 1 --2- 172.21.15.44:0/2915850359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4468159a50 0x7f4468158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.807+0000 7f446659c700 1 --2- 172.21.15.44:0/2915850359 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44680adef0 0x7f446815afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.807+0000 7f4466d9d700 1 -- 172.21.15.44:0/2915850359 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44680adef0 msgr2=0x7f446815afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.807+0000 7f4466d9d700 1 --2- 172.21.15.44:0/2915850359 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44680adef0 0x7f446815afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.807+0000 7f4466d9d700 1 -- 172.21.15.44:0/2915850359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4468159a50 msgr2=0x7f4468158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.807+0000 7f4466d9d700 1 --2- 172.21.15.44:0/2915850359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4468159a50 0x7f4468158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.807+0000 7f4466d9d700 1 -- 172.21.15.44:0/2915850359 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445800b750 con 0x7f44680711e0 2024-09-13T18:36:38.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.807+0000 7f4466d9d700 1 --2- 172.21.15.44:0/2915850359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44680711e0 0x7f44681484f0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f446000cba0 tx=0x7f446000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:38.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.807+0000 7f445f7fe700 1 -- 172.21.15.44:0/2915850359 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446000a770 con 0x7f44680711e0 2024-09-13T18:36:38.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.807+0000 7f445f7fe700 1 -- 172.21.15.44:0/2915850359 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446000a8d0 con 0x7f44680711e0 2024-09-13T18:36:38.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.807+0000 7f446c85c700 1 -- 172.21.15.44:0/2915850359 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446815a4e0 con 0x7f44680711e0 2024-09-13T18:36:38.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.807+0000 7f445f7fe700 1 -- 172.21.15.44:0/2915850359 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446000ac40 con 0x7f44680711e0 2024-09-13T18:36:38.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.807+0000 7f446c85c700 1 -- 172.21.15.44:0/2915850359 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4468158d60 con 0x7f44680711e0 2024-09-13T18:36:38.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.811+0000 7f446c85c700 1 -- 172.21.15.44:0/2915850359 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f44680cd5f0 con 0x7f44680711e0 2024-09-13T18:36:38.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.811+0000 7f445f7fe700 1 -- 172.21.15.44:0/2915850359 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f446001b3b0 con 0x7f44680711e0 2024-09-13T18:36:38.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.811+0000 7f445f7fe700 1 --2- 172.21.15.44:0/2915850359 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4448066730 0x7f4448068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.811+0000 7f445f7fe700 1 -- 172.21.15.44:0/2915850359 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4460083800 con 0x7f44680711e0 2024-09-13T18:36:38.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.811+0000 7f445f7fe700 1 --2- 172.21.15.44:0/2915850359 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7f444806c590 0x7f444806e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.811+0000 7f445f7fe700 1 -- 172.21.15.44:0/2915850359 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f444806f060 con 0x7f444806c590 2024-09-13T18:36:38.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.811+0000 7f445f7fe700 1 -- 172.21.15.44:0/2915850359 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4460085de0 con 0x7f44680711e0 2024-09-13T18:36:38.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.811+0000 7f446659c700 1 --2- 172.21.15.44:0/2915850359 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4448066730 0x7f4448068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.811+0000 7f446759e700 1 --2- 172.21.15.44:0/2915850359 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7f444806c590 0x7f444806e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.811+0000 7f446659c700 1 --2- 172.21.15.44:0/2915850359 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4448066730 0x7f4448068bf0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f4468158750 tx=0x7f4450009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:38.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.811+0000 7f446759e700 1 --2- 172.21.15.44:0/2915850359 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7f444806c590 0x7f444806e9b0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:38.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.815+0000 7f445f7fe700 1 -- 172.21.15.44:0/2915850359 <== osd.0 v2:172.21.15.44:6800/2647753462 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f444806f060 con 0x7f444806c590 2024-09-13T18:36:38.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.831+0000 7f446c85c700 1 -- 172.21.15.44:0/2915850359 --> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4468158fb0 con 0x7f444806c590 2024-09-13T18:36:38.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.831+0000 7f445f7fe700 1 -- 172.21.15.44:0/2915850359 <== osd.0 v2:172.21.15.44:6800/2647753462 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4468158fb0 con 0x7f444806c590 2024-09-13T18:36:38.839 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:36:38.840 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:36:38.840 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:36:38.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.831+0000 7f446c85c700 1 -- 172.21.15.44:0/2915850359 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7f444806c590 msgr2=0x7f444806e9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.831+0000 7f446c85c700 1 --2- 172.21.15.44:0/2915850359 >> [v2:172.21.15.44:6800/2647753462,v1:172.21.15.44:6801/2647753462] conn(0x7f444806c590 0x7f444806e9b0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.831+0000 7f446c85c700 1 -- 172.21.15.44:0/2915850359 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4448066730 msgr2=0x7f4448068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.831+0000 7f446c85c700 1 --2- 172.21.15.44:0/2915850359 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4448066730 0x7f4448068bf0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f4468158750 tx=0x7f4450009240 comp rx=0 tx=0).stop 2024-09-13T18:36:38.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.831+0000 7f446c85c700 1 -- 172.21.15.44:0/2915850359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44680711e0 msgr2=0x7f44681484f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.831+0000 7f446c85c700 1 --2- 172.21.15.44:0/2915850359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44680711e0 0x7f44681484f0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f446000cba0 tx=0x7f446000cbd0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.831+0000 7f446759e700 1 -- 172.21.15.44:0/2915850359 reap_dead start 2024-09-13T18:36:38.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.831+0000 7f446c85c700 1 -- 172.21.15.44:0/2915850359 shutdown_connections 2024-09-13T18:36:38.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.831+0000 7f446c85c700 1 -- 172.21.15.44:0/2915850359 >> 172.21.15.44:0/2915850359 conn(0x7f44680b0cc0 msgr2=0x7f446806a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:38.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.831+0000 7f446c85c700 1 -- 172.21.15.44:0/2915850359 shutdown_connections 2024-09-13T18:36:38.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.831+0000 7f446c85c700 1 -- 172.21.15.44:0/2915850359 wait complete. 2024-09-13T18:36:38.860 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T18:36:38.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.975+0000 7feefa47e700 1 Processor -- start 2024-09-13T18:36:38.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.975+0000 7feefa47e700 1 -- start start 2024-09-13T18:36:38.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.975+0000 7feefa47e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7feef406bdb0 0x7feef406d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.975+0000 7feefa47e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef4144720 con 0x7feef40cdc90 2024-09-13T18:36:38.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.975+0000 7feefa47e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef406dd40 con 0x7feef4144340 2024-09-13T18:36:38.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.975+0000 7feefa47e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef406da60 con 0x7feef406bdb0 2024-09-13T18:36:38.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.979+0000 7feef9c7d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7feef406bdb0 0x7feef406d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.979+0000 7feef8c7b700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7feef40cdc90 0x7feef406fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40016/0 (socket says 172.21.15.44:40016) 2024-09-13T18:36:38.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.979+0000 7feef8c7b700 1 -- 172.21.15.44:0/1226078927 learned_addr learned my addr 172.21.15.44:0/1226078927 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:38.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.979+0000 7feef9c7d700 1 -- 172.21.15.44:0/1226078927 >> v1:172.21.15.99:6789/0 conn(0x7feef4144340 legacy=0x7feef40cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.979+0000 7feef9c7d700 1 -- 172.21.15.44:0/1226078927 >> v1:172.21.15.44:6789/0 conn(0x7feef40cdc90 legacy=0x7feef406fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.979+0000 7feef9c7d700 1 -- 172.21.15.44:0/1226078927 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef415e660 con 0x7feef406bdb0 2024-09-13T18:36:38.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.979+0000 7feef9c7d700 1 --2- 172.21.15.44:0/1226078927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef406bdb0 0x7feef406d480 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7feeec009d90 tx=0x7feeec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a29dae2db236c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:38.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.979+0000 7feeebfff700 1 -- 172.21.15.44:0/1226078927 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec00e070 con 0x7feef406bdb0 2024-09-13T18:36:38.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.979+0000 7feeebfff700 1 -- 172.21.15.44:0/1226078927 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeec00bbd0 con 0x7feef406bdb0 2024-09-13T18:36:38.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.979+0000 7feeebfff700 1 -- 172.21.15.44:0/1226078927 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec012430 con 0x7feef406bdb0 2024-09-13T18:36:38.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.979+0000 7feefa47e700 1 -- 172.21.15.44:0/1226078927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef406bdb0 msgr2=0x7feef406d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.979+0000 7feefa47e700 1 --2- 172.21.15.44:0/1226078927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef406bdb0 0x7feef406d480 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7feeec009d90 tx=0x7feeec00b330 comp rx=0 tx=0).stop 2024-09-13T18:36:38.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.979+0000 7feefa47e700 1 -- 172.21.15.44:0/1226078927 shutdown_connections 2024-09-13T18:36:38.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.979+0000 7feefa47e700 1 --2- 172.21.15.44:0/1226078927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef406bdb0 0x7feef406d480 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.979+0000 7feefa47e700 1 -- 172.21.15.44:0/1226078927 >> 172.21.15.44:0/1226078927 conn(0x7feef40b0e10 msgr2=0x7feef40b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:38.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.979+0000 7feefa47e700 1 -- 172.21.15.44:0/1226078927 shutdown_connections 2024-09-13T18:36:38.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.979+0000 7feefa47e700 1 -- 172.21.15.44:0/1226078927 wait complete. 2024-09-13T18:36:38.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feefa47e700 1 Processor -- start 2024-09-13T18:36:38.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feefa47e700 1 -- start start 2024-09-13T18:36:38.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feefa47e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feef406bdb0 0x7feef4159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feefa47e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feef40cdc90 0x7feef415a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feefa47e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef4144340 0x7feef40cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feefa47e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef40aadc0 con 0x7feef4144340 2024-09-13T18:36:38.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feefa47e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef40cb120 con 0x7feef40cdc90 2024-09-13T18:36:38.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feefa47e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef40aa7b0 con 0x7feef406bdb0 2024-09-13T18:36:38.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feef9c7d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef4144340 0x7feef40cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feef9c7d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef4144340 0x7feef40cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42760/0 (socket says 172.21.15.44:42760) 2024-09-13T18:36:38.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feef9c7d700 1 -- 172.21.15.44:0/297949816 learned_addr learned my addr 172.21.15.44:0/297949816 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:38.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feef947c700 1 --2- 172.21.15.44:0/297949816 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feef406bdb0 0x7feef4159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feef8c7b700 1 --2- 172.21.15.44:0/297949816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feef40cdc90 0x7feef415a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feef9c7d700 1 -- 172.21.15.44:0/297949816 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feef406bdb0 msgr2=0x7feef4159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feef9c7d700 1 --2- 172.21.15.44:0/297949816 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feef406bdb0 0x7feef4159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feef9c7d700 1 -- 172.21.15.44:0/297949816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feef40cdc90 msgr2=0x7feef415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feef9c7d700 1 --2- 172.21.15.44:0/297949816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feef40cdc90 0x7feef415a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feef9c7d700 1 -- 172.21.15.44:0/297949816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec009a70 con 0x7feef4144340 2024-09-13T18:36:38.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feef9c7d700 1 --2- 172.21.15.44:0/297949816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef4144340 0x7feef40cb370 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7feeec014040 tx=0x7feeec004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:38.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feee9ffb700 1 -- 172.21.15.44:0/297949816 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec012430 con 0x7feef4144340 2024-09-13T18:36:38.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feee9ffb700 1 -- 172.21.15.44:0/297949816 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeec020070 con 0x7feef4144340 2024-09-13T18:36:38.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feefa47e700 1 -- 172.21.15.44:0/297949816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef40cae40 con 0x7feef4144340 2024-09-13T18:36:38.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feee9ffb700 1 -- 172.21.15.44:0/297949816 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec004280 con 0x7feef4144340 2024-09-13T18:36:38.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.983+0000 7feefa47e700 1 -- 172.21.15.44:0/297949816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef40c7d80 con 0x7feef4144340 2024-09-13T18:36:38.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.987+0000 7feefa47e700 1 -- 172.21.15.44:0/297949816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef40aaf70 con 0x7feef4144340 2024-09-13T18:36:38.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.987+0000 7feee9ffb700 1 -- 172.21.15.44:0/297949816 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feeec0043e0 con 0x7feef4144340 2024-09-13T18:36:38.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.987+0000 7feee9ffb700 1 --2- 172.21.15.44:0/297949816 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7feed8066730 0x7feed8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.987+0000 7feee9ffb700 1 -- 172.21.15.44:0/297949816 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7feeec022070 con 0x7feef4144340 2024-09-13T18:36:38.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.987+0000 7feef947c700 1 --2- 172.21.15.44:0/297949816 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7feed8066730 0x7feed8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.991+0000 7feef947c700 1 --2- 172.21.15.44:0/297949816 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7feed8066730 0x7feed8068bf0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7feef00016e0 tx=0x7feef0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:39.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:38.999+0000 7feee9ffb700 1 -- 172.21.15.44:0/297949816 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feeec0b7db0 con 0x7feef4144340 2024-09-13T18:36:39.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.175+0000 7feefa47e700 1 -- 172.21.15.44:0/297949816 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7feef415ec20 con 0x7feed8066730 2024-09-13T18:36:39.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.175+0000 7feee9ffb700 1 -- 172.21.15.44:0/297949816 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7feef00050d0 con 0x7feed8066730 2024-09-13T18:36:39.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.175+0000 7feefa47e700 1 -- 172.21.15.44:0/297949816 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7feed8066730 msgr2=0x7feed8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.175+0000 7feefa47e700 1 --2- 172.21.15.44:0/297949816 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7feed8066730 0x7feed8068bf0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7feef00016e0 tx=0x7feef0009040 comp rx=0 tx=0).stop 2024-09-13T18:36:39.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.175+0000 7feefa47e700 1 -- 172.21.15.44:0/297949816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef4144340 msgr2=0x7feef40cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.175+0000 7feefa47e700 1 --2- 172.21.15.44:0/297949816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef4144340 0x7feef40cb370 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7feeec014040 tx=0x7feeec004af0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.175+0000 7feefa47e700 1 -- 172.21.15.44:0/297949816 shutdown_connections 2024-09-13T18:36:39.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.175+0000 7feefa47e700 1 --2- 172.21.15.44:0/297949816 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7feed8066730 0x7feed8068bf0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.175+0000 7feefa47e700 1 --2- 172.21.15.44:0/297949816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef4144340 0x7feef40cb370 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.175+0000 7feefa47e700 1 --2- 172.21.15.44:0/297949816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feef40cdc90 0x7feef415a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.175+0000 7feefa47e700 1 --2- 172.21.15.44:0/297949816 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feef406bdb0 0x7feef4159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.175+0000 7feefa47e700 1 -- 172.21.15.44:0/297949816 >> 172.21.15.44:0/297949816 conn(0x7feef40b0e10 msgr2=0x7feef40b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:39.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.179+0000 7feefa47e700 1 -- 172.21.15.44:0/297949816 shutdown_connections 2024-09-13T18:36:39.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.179+0000 7feefa47e700 1 -- 172.21.15.44:0/297949816 wait complete. 2024-09-13T18:36:39.186 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T18:36:39.197 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T18:36:39.198 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:36:39.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.315+0000 7fab2db9c700 1 Processor -- start 2024-09-13T18:36:39.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.315+0000 7fab2db9c700 1 -- start start 2024-09-13T18:36:39.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab2db9c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab28160880 0x7fab28160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab2db9c700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fab280d1c90 0x7fab280d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab2db9c700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab280d2660 con 0x7fab2815cf30 2024-09-13T18:36:39.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab2db9c700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab281611e0 con 0x7fab280d1c90 2024-09-13T18:36:39.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab2db9c700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab280d0c10 con 0x7fab28160880 2024-09-13T18:36:39.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab1effd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab28160880 0x7fab28160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab27fff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fab280d1c90 0x7fab280d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab1effd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab28160880 0x7fab28160ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:59064/0 (socket says 172.21.15.44:59064) 2024-09-13T18:36:39.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab1effd700 1 -- 172.21.15.44:0/1881425938 learned_addr learned my addr 172.21.15.44:0/1881425938 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:39.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab27fff700 1 -- 172.21.15.44:0/1881425938 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab28160880 msgr2=0x7fab28160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:39.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab27fff700 1 --2- 172.21.15.44:0/1881425938 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab28160880 0x7fab28160ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab27fff700 1 -- 172.21.15.44:0/1881425938 >> v1:172.21.15.99:6789/0 conn(0x7fab2815cf30 legacy=0x7fab280b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab27fff700 1 -- 172.21.15.44:0/1881425938 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab280d0ed0 con 0x7fab280d1c90 2024-09-13T18:36:39.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab27fff700 1 --2- 172.21.15.44:0/1881425938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab280d1c90 0x7fab280d2120 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fab20009d90 tx=0x7fab2000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a50464d8f2f4dba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:39.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab26ffd700 1 -- 172.21.15.44:0/1881425938 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2000e070 con 0x7fab280d1c90 2024-09-13T18:36:39.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab26ffd700 1 -- 172.21.15.44:0/1881425938 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2000bb20 con 0x7fab280d1c90 2024-09-13T18:36:39.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab26ffd700 1 -- 172.21.15.44:0/1881425938 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab20012430 con 0x7fab280d1c90 2024-09-13T18:36:39.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab2db9c700 1 -- 172.21.15.44:0/1881425938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab280d1c90 msgr2=0x7fab280d2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab2db9c700 1 --2- 172.21.15.44:0/1881425938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab280d1c90 0x7fab280d2120 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fab20009d90 tx=0x7fab2000b330 comp rx=0 tx=0).stop 2024-09-13T18:36:39.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab2db9c700 1 -- 172.21.15.44:0/1881425938 shutdown_connections 2024-09-13T18:36:39.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab2db9c700 1 --2- 172.21.15.44:0/1881425938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab280d1c90 0x7fab280d2120 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab2db9c700 1 --2- 172.21.15.44:0/1881425938 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab28160880 0x7fab28160ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab2db9c700 1 -- 172.21.15.44:0/1881425938 >> 172.21.15.44:0/1881425938 conn(0x7fab280d30d0 msgr2=0x7fab280d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:39.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab2db9c700 1 -- 172.21.15.44:0/1881425938 shutdown_connections 2024-09-13T18:36:39.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.319+0000 7fab2db9c700 1 -- 172.21.15.44:0/1881425938 wait complete. 2024-09-13T18:36:39.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.323+0000 7fab2db9c700 1 Processor -- start 2024-09-13T18:36:39.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.323+0000 7fab2db9c700 1 -- start start 2024-09-13T18:36:39.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.323+0000 7fab2db9c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab280d1c90 0x7fab280a9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.323+0000 7fab2db9c700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab2815cf30 0x7fab280ca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.323+0000 7fab2db9c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab28160880 0x7fab2815e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.323+0000 7fab2db9c700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab280a9f90 con 0x7fab280d1c90 2024-09-13T18:36:39.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.323+0000 7fab2db9c700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab280ca690 con 0x7fab28160880 2024-09-13T18:36:39.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.323+0000 7fab2db9c700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab280cb4d0 con 0x7fab2815cf30 2024-09-13T18:36:39.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.323+0000 7fab277fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab280d1c90 0x7fab280a9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.323+0000 7fab277fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab280d1c90 0x7fab280a9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42774/0 (socket says 172.21.15.44:42774) 2024-09-13T18:36:39.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.323+0000 7fab277fe700 1 -- 172.21.15.44:0/3344430836 learned_addr learned my addr 172.21.15.44:0/3344430836 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:39.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.323+0000 7fab27fff700 1 --2- 172.21.15.44:0/3344430836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab28160880 0x7fab2815e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.323+0000 7fab1effd700 1 --2- 172.21.15.44:0/3344430836 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab2815cf30 0x7fab280ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.323+0000 7fab277fe700 1 -- 172.21.15.44:0/3344430836 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab2815cf30 msgr2=0x7fab280ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.323+0000 7fab277fe700 1 --2- 172.21.15.44:0/3344430836 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab2815cf30 0x7fab280ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.323+0000 7fab277fe700 1 -- 172.21.15.44:0/3344430836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab28160880 msgr2=0x7fab2815e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.323+0000 7fab277fe700 1 --2- 172.21.15.44:0/3344430836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab28160880 0x7fab2815e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.323+0000 7fab277fe700 1 -- 172.21.15.44:0/3344430836 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab20009a70 con 0x7fab280d1c90 2024-09-13T18:36:39.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.323+0000 7fab1effd700 1 --2- 172.21.15.44:0/3344430836 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab2815cf30 0x7fab280ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:39.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.327+0000 7fab277fe700 1 --2- 172.21.15.44:0/3344430836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab280d1c90 0x7fab280a9a50 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fab1800c530 tx=0x7fab1800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:39.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.327+0000 7fab24ff9700 1 -- 172.21.15.44:0/3344430836 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab180052d0 con 0x7fab280d1c90 2024-09-13T18:36:39.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.327+0000 7fab24ff9700 1 -- 172.21.15.44:0/3344430836 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab18005430 con 0x7fab280d1c90 2024-09-13T18:36:39.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.327+0000 7fab24ff9700 1 -- 172.21.15.44:0/3344430836 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab180055a0 con 0x7fab280d1c90 2024-09-13T18:36:39.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.327+0000 7fab2db9c700 1 -- 172.21.15.44:0/3344430836 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab280ca8c0 con 0x7fab280d1c90 2024-09-13T18:36:39.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.327+0000 7fab2db9c700 1 -- 172.21.15.44:0/3344430836 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab280cae80 con 0x7fab280d1c90 2024-09-13T18:36:39.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.327+0000 7fab2db9c700 1 -- 172.21.15.44:0/3344430836 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fab280d1770 con 0x7fab280d1c90 2024-09-13T18:36:39.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.327+0000 7fab24ff9700 1 -- 172.21.15.44:0/3344430836 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fab180038e0 con 0x7fab280d1c90 2024-09-13T18:36:39.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.331+0000 7fab24ff9700 1 --2- 172.21.15.44:0/3344430836 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fab08066760 0x7fab08068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.331+0000 7fab24ff9700 1 -- 172.21.15.44:0/3344430836 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fab180839d0 con 0x7fab280d1c90 2024-09-13T18:36:39.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.331+0000 7fab24ff9700 1 --2- 172.21.15.44:0/3344430836 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7fab0806c5c0 0x7fab0806e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.331+0000 7fab24ff9700 1 -- 172.21.15.44:0/3344430836 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fab0806f090 con 0x7fab0806c5c0 2024-09-13T18:36:39.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.331+0000 7fab24ff9700 1 -- 172.21.15.44:0/3344430836 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab18083e20 con 0x7fab280d1c90 2024-09-13T18:36:39.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.331+0000 7fab1effd700 1 --2- 172.21.15.44:0/3344430836 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fab08066760 0x7fab08068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.331+0000 7fab27fff700 1 --2- 172.21.15.44:0/3344430836 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7fab0806c5c0 0x7fab0806e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.331+0000 7fab27fff700 1 --2- 172.21.15.44:0/3344430836 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7fab0806c5c0 0x7fab0806e9e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:39.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.331+0000 7fab1effd700 1 --2- 172.21.15.44:0/3344430836 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fab08066760 0x7fab08068c20 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fab2815b710 tx=0x7fab10008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:39.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.331+0000 7fab24ff9700 1 -- 172.21.15.44:0/3344430836 <== osd.1 v2:172.21.15.44:6816/2250405239 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fab0806f090 con 0x7fab0806c5c0 2024-09-13T18:36:39.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.351+0000 7fab2db9c700 1 -- 172.21.15.44:0/3344430836 --> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fab280d1490 con 0x7fab0806c5c0 2024-09-13T18:36:39.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.351+0000 7fab24ff9700 1 -- 172.21.15.44:0/3344430836 <== osd.1 v2:172.21.15.44:6816/2250405239 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fab200098f0 con 0x7fab0806c5c0 2024-09-13T18:36:39.359 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:36:39.359 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:36:39.359 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:36:39.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.351+0000 7fab2db9c700 1 -- 172.21.15.44:0/3344430836 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7fab0806c5c0 msgr2=0x7fab0806e9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.351+0000 7fab2db9c700 1 --2- 172.21.15.44:0/3344430836 >> [v2:172.21.15.44:6816/2250405239,v1:172.21.15.44:6818/2250405239] conn(0x7fab0806c5c0 0x7fab0806e9e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.351+0000 7fab2db9c700 1 -- 172.21.15.44:0/3344430836 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fab08066760 msgr2=0x7fab08068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.351+0000 7fab2db9c700 1 --2- 172.21.15.44:0/3344430836 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fab08066760 0x7fab08068c20 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fab2815b710 tx=0x7fab10008040 comp rx=0 tx=0).stop 2024-09-13T18:36:39.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.351+0000 7fab2db9c700 1 -- 172.21.15.44:0/3344430836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab280d1c90 msgr2=0x7fab280a9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.351+0000 7fab2db9c700 1 --2- 172.21.15.44:0/3344430836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab280d1c90 0x7fab280a9a50 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fab1800c530 tx=0x7fab1800c840 comp rx=0 tx=0).stop 2024-09-13T18:36:39.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.351+0000 7fab27fff700 1 -- 172.21.15.44:0/3344430836 reap_dead start 2024-09-13T18:36:39.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.351+0000 7fab2db9c700 1 -- 172.21.15.44:0/3344430836 shutdown_connections 2024-09-13T18:36:39.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.351+0000 7fab2db9c700 1 -- 172.21.15.44:0/3344430836 >> 172.21.15.44:0/3344430836 conn(0x7fab280d30d0 msgr2=0x7fab280b5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:39.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.351+0000 7fab2db9c700 1 -- 172.21.15.44:0/3344430836 shutdown_connections 2024-09-13T18:36:39.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.351+0000 7fab2db9c700 1 -- 172.21.15.44:0/3344430836 wait complete. 2024-09-13T18:36:39.372 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T18:36:39.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.491+0000 7f5be359e700 1 Processor -- start 2024-09-13T18:36:39.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.491+0000 7f5be359e700 1 -- start start 2024-09-13T18:36:39.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.491+0000 7f5be359e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5be40b3980 0x7f5be41422b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.491+0000 7f5be359e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be415be50 con 0x7f5be406db30 2024-09-13T18:36:39.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.491+0000 7f5be359e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be415b240 con 0x7f5be415a510 2024-09-13T18:36:39.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.491+0000 7f5be359e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be415b520 con 0x7f5be40b3980 2024-09-13T18:36:39.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.491+0000 7f5be259c700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5be406db30 0x7f5be40b3270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40028/0 (socket says 172.21.15.44:40028) 2024-09-13T18:36:39.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.491+0000 7f5be259c700 1 -- 172.21.15.44:0/1207321934 learned_addr learned my addr 172.21.15.44:0/1207321934 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:39.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.491+0000 7f5bdbfff700 1 --2- 172.21.15.44:0/1207321934 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5be40b3980 0x7f5be41422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.491+0000 7f5be1d9b700 1 -- 172.21.15.44:0/1207321934 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546355336 0 0) 0x7f5be415be50 con 0x7f5be406db30 2024-09-13T18:36:39.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.491+0000 7f5be1d9b700 1 -- 172.21.15.44:0/1207321934 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bd00035d0 con 0x7f5be406db30 2024-09-13T18:36:39.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.495+0000 7f5bdbfff700 1 -- 172.21.15.44:0/1207321934 >> v1:172.21.15.99:6789/0 conn(0x7f5be415a510 legacy=0x7f5be415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.491+0000 7f5be1d9b700 1 -- 172.21.15.44:0/1207321934 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2718649440 0 0) 0x7f5be415b240 con 0x7f5be415a510 2024-09-13T18:36:39.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.495+0000 7f5bdbfff700 1 -- 172.21.15.44:0/1207321934 >> v1:172.21.15.44:6789/0 conn(0x7f5be406db30 legacy=0x7f5be40b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.495+0000 7f5bdbfff700 1 -- 172.21.15.44:0/1207321934 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be415b800 con 0x7f5be40b3980 2024-09-13T18:36:39.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.495+0000 7f5bdbfff700 1 --2- 172.21.15.44:0/1207321934 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5be40b3980 0x7f5be41422b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc009880 tx=0x7f5bcc009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df2951112670d8f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:39.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.495+0000 7f5be1d9b700 1 -- 172.21.15.44:0/1207321934 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc011830 con 0x7f5be40b3980 2024-09-13T18:36:39.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.495+0000 7f5be1d9b700 1 -- 172.21.15.44:0/1207321934 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bcc011990 con 0x7f5be40b3980 2024-09-13T18:36:39.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.495+0000 7f5be1d9b700 1 -- 172.21.15.44:0/1207321934 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc011d00 con 0x7f5be40b3980 2024-09-13T18:36:39.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.495+0000 7f5be359e700 1 -- 172.21.15.44:0/1207321934 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5be40b3980 msgr2=0x7f5be41422b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.495+0000 7f5be359e700 1 --2- 172.21.15.44:0/1207321934 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5be40b3980 0x7f5be41422b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc009880 tx=0x7f5bcc009b90 comp rx=0 tx=0).stop 2024-09-13T18:36:39.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.495+0000 7f5be359e700 1 -- 172.21.15.44:0/1207321934 shutdown_connections 2024-09-13T18:36:39.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.495+0000 7f5be359e700 1 --2- 172.21.15.44:0/1207321934 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5be40b3980 0x7f5be41422b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.495+0000 7f5be359e700 1 -- 172.21.15.44:0/1207321934 >> 172.21.15.44:0/1207321934 conn(0x7f5be40b0e10 msgr2=0x7f5be40b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:39.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.495+0000 7f5be359e700 1 -- 172.21.15.44:0/1207321934 shutdown_connections 2024-09-13T18:36:39.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.495+0000 7f5be359e700 1 -- 172.21.15.44:0/1207321934 wait complete. 2024-09-13T18:36:39.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.495+0000 7f5be359e700 1 Processor -- start 2024-09-13T18:36:39.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.495+0000 7f5be359e700 1 -- start start 2024-09-13T18:36:39.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.499+0000 7f5be359e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5be406db30 0x7f5be40a9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.499+0000 7f5be359e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5be40b3980 0x7f5be40a9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.499+0000 7f5be359e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5be415a510 0x7f5be40ac540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.499+0000 7f5be359e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40cd9e0 con 0x7f5be40b3980 2024-09-13T18:36:39.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.499+0000 7f5be359e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be413ffb0 con 0x7f5be406db30 2024-09-13T18:36:39.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.499+0000 7f5be359e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40aa6b0 con 0x7f5be415a510 2024-09-13T18:36:39.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.499+0000 7f5bdbfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5be40b3980 0x7f5be40a9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.499+0000 7f5bdbfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5be40b3980 0x7f5be40a9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42786/0 (socket says 172.21.15.44:42786) 2024-09-13T18:36:39.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.499+0000 7f5bdbfff700 1 -- 172.21.15.44:0/858067272 learned_addr learned my addr 172.21.15.44:0/858067272 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:39.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.499+0000 7f5be259c700 1 --2- 172.21.15.44:0/858067272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5be406db30 0x7f5be40a9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.499+0000 7f5be2d9d700 1 --2- 172.21.15.44:0/858067272 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5be415a510 0x7f5be40ac540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.499+0000 7f5bdbfff700 1 -- 172.21.15.44:0/858067272 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5be415a510 msgr2=0x7f5be40ac540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.499+0000 7f5bdbfff700 1 --2- 172.21.15.44:0/858067272 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5be415a510 0x7f5be40ac540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.499+0000 7f5bdbfff700 1 -- 172.21.15.44:0/858067272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5be406db30 msgr2=0x7f5be40a9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.499+0000 7f5bdbfff700 1 --2- 172.21.15.44:0/858067272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5be406db30 0x7f5be40a9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.499+0000 7f5bdbfff700 1 -- 172.21.15.44:0/858067272 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc0094b0 con 0x7f5be40b3980 2024-09-13T18:36:39.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.499+0000 7f5bdbfff700 1 --2- 172.21.15.44:0/858067272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5be40b3980 0x7f5be40a9fe0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc013040 tx=0x7f5bcc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:39.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.499+0000 7f5bdaffd700 1 -- 172.21.15.44:0/858067272 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc004610 con 0x7f5be40b3980 2024-09-13T18:36:39.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.499+0000 7f5bdaffd700 1 -- 172.21.15.44:0/858067272 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bcc0036c0 con 0x7f5be40b3980 2024-09-13T18:36:39.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.499+0000 7f5be359e700 1 -- 172.21.15.44:0/858067272 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be40aa990 con 0x7f5be40b3980 2024-09-13T18:36:39.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.499+0000 7f5bdaffd700 1 -- 172.21.15.44:0/858067272 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc003a70 con 0x7f5be40b3980 2024-09-13T18:36:39.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.499+0000 7f5be359e700 1 -- 172.21.15.44:0/858067272 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be40aaf50 con 0x7f5be40b3980 2024-09-13T18:36:39.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.503+0000 7f5be359e700 1 -- 172.21.15.44:0/858067272 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be415b240 con 0x7f5be40b3980 2024-09-13T18:36:39.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.503+0000 7f5bdaffd700 1 -- 172.21.15.44:0/858067272 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5bcc003bd0 con 0x7f5be40b3980 2024-09-13T18:36:39.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.503+0000 7f5bdaffd700 1 --2- 172.21.15.44:0/858067272 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5bc4066730 0x7f5bc4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.503+0000 7f5bdaffd700 1 -- 172.21.15.44:0/858067272 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5bcc0854f0 con 0x7f5be40b3980 2024-09-13T18:36:39.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.503+0000 7f5be259c700 1 --2- 172.21.15.44:0/858067272 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5bc4066730 0x7f5bc4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.503+0000 7f5be259c700 1 --2- 172.21.15.44:0/858067272 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5bc4066730 0x7f5bc4068bf0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4007fd0 tx=0x7f5bd4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:39.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.511+0000 7f5bdaffd700 1 -- 172.21.15.44:0/858067272 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5bcc052cf0 con 0x7f5be40b3980 2024-09-13T18:36:39.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.687+0000 7f5be359e700 1 -- 172.21.15.44:0/858067272 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f5be4156cf0 con 0x7f5bc4066730 2024-09-13T18:36:39.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.691+0000 7f5bdaffd700 1 -- 172.21.15.44:0/858067272 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5bd400f690 con 0x7f5bc4066730 2024-09-13T18:36:39.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.691+0000 7f5be359e700 1 -- 172.21.15.44:0/858067272 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5bc4066730 msgr2=0x7f5bc4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.691+0000 7f5be359e700 1 --2- 172.21.15.44:0/858067272 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5bc4066730 0x7f5bc4068bf0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4007fd0 tx=0x7f5bd4009040 comp rx=0 tx=0).stop 2024-09-13T18:36:39.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.691+0000 7f5be359e700 1 -- 172.21.15.44:0/858067272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5be40b3980 msgr2=0x7f5be40a9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.691+0000 7f5be359e700 1 --2- 172.21.15.44:0/858067272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5be40b3980 0x7f5be40a9fe0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc013040 tx=0x7f5bcc004770 comp rx=0 tx=0).stop 2024-09-13T18:36:39.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.691+0000 7f5be359e700 1 -- 172.21.15.44:0/858067272 shutdown_connections 2024-09-13T18:36:39.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.691+0000 7f5be359e700 1 --2- 172.21.15.44:0/858067272 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5bc4066730 0x7f5bc4068bf0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.691+0000 7f5be359e700 1 --2- 172.21.15.44:0/858067272 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5be415a510 0x7f5be40ac540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.691+0000 7f5be359e700 1 --2- 172.21.15.44:0/858067272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5be40b3980 0x7f5be40a9fe0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.691+0000 7f5be359e700 1 --2- 172.21.15.44:0/858067272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5be406db30 0x7f5be40a9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.691+0000 7f5be359e700 1 -- 172.21.15.44:0/858067272 >> 172.21.15.44:0/858067272 conn(0x7f5be40b0e10 msgr2=0x7f5be406d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:39.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.691+0000 7f5be359e700 1 -- 172.21.15.44:0/858067272 shutdown_connections 2024-09-13T18:36:39.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.691+0000 7f5be359e700 1 -- 172.21.15.44:0/858067272 wait complete. 2024-09-13T18:36:39.701 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T18:36:39.713 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T18:36:39.713 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:36:39.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.831+0000 7ff8f3444700 1 Processor -- start 2024-09-13T18:36:39.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.831+0000 7ff8f3444700 1 -- start start 2024-09-13T18:36:39.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.831+0000 7ff8f3444700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff8ec06e010 0x7ff8ec06e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.831+0000 7ff8f3444700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8ec0b39f0 con 0x7ff8ec15db30 2024-09-13T18:36:39.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.831+0000 7ff8f3444700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8ec0b2670 con 0x7ff8ec153280 2024-09-13T18:36:39.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.831+0000 7ff8f3444700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ec06e9c0 con 0x7ff8ec06e010 2024-09-13T18:36:39.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.831+0000 7ff8f2442700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff8ec15db30 0x7ff8ec071d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40032/0 (socket says 172.21.15.44:40032) 2024-09-13T18:36:39.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.831+0000 7ff8f2442700 1 -- 172.21.15.44:0/2065886689 learned_addr learned my addr 172.21.15.44:0/2065886689 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:39.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.831+0000 7ff8f1c41700 1 --2- 172.21.15.44:0/2065886689 >> v2:172.21.15.99:3300/0 conn(0x7ff8ec06e010 0x7ff8ec06e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.831+0000 7ff8f1440700 1 -- 172.21.15.44:0/2065886689 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055747319 0 0) 0x7ff8ec0b39f0 con 0x7ff8ec15db30 2024-09-13T18:36:39.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.831+0000 7ff8f1440700 1 -- 172.21.15.44:0/2065886689 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8d80035d0 con 0x7ff8ec15db30 2024-09-13T18:36:39.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.831+0000 7ff8f1c41700 1 -- 172.21.15.44:0/2065886689 >> v1:172.21.15.99:6789/0 conn(0x7ff8ec153280 legacy=0x7ff8ec1536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.831+0000 7ff8f1c41700 1 -- 172.21.15.44:0/2065886689 >> v1:172.21.15.44:6789/0 conn(0x7ff8ec15db30 legacy=0x7ff8ec071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.831+0000 7ff8f1c41700 1 -- 172.21.15.44:0/2065886689 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec0b2950 con 0x7ff8ec06e010 2024-09-13T18:36:39.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.831+0000 7ff8f1c41700 1 --2- 172.21.15.44:0/2065886689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8ec06e010 0x7ff8ec06e480 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc009850 tx=0x7ff8dc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2851176c266db5df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:39.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.835+0000 7ff8f1440700 1 -- 172.21.15.44:0/2065886689 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc011830 con 0x7ff8ec06e010 2024-09-13T18:36:39.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.835+0000 7ff8f1440700 1 -- 172.21.15.44:0/2065886689 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8dc011990 con 0x7ff8ec06e010 2024-09-13T18:36:39.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.835+0000 7ff8f1440700 1 -- 172.21.15.44:0/2065886689 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc011d00 con 0x7ff8ec06e010 2024-09-13T18:36:39.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.835+0000 7ff8f3444700 1 -- 172.21.15.44:0/2065886689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8ec06e010 msgr2=0x7ff8ec06e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.835+0000 7ff8f3444700 1 --2- 172.21.15.44:0/2065886689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8ec06e010 0x7ff8ec06e480 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc009850 tx=0x7ff8dc009b60 comp rx=0 tx=0).stop 2024-09-13T18:36:39.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.835+0000 7ff8f3444700 1 -- 172.21.15.44:0/2065886689 shutdown_connections 2024-09-13T18:36:39.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.835+0000 7ff8f3444700 1 --2- 172.21.15.44:0/2065886689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8ec06e010 0x7ff8ec06e480 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.835+0000 7ff8f3444700 1 -- 172.21.15.44:0/2065886689 >> 172.21.15.44:0/2065886689 conn(0x7ff8ec0cf630 msgr2=0x7ff8ec06d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:39.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.835+0000 7ff8f3444700 1 -- 172.21.15.44:0/2065886689 shutdown_connections 2024-09-13T18:36:39.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.835+0000 7ff8f3444700 1 -- 172.21.15.44:0/2065886689 wait complete. 2024-09-13T18:36:39.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.835+0000 7ff8f3444700 1 Processor -- start 2024-09-13T18:36:39.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.835+0000 7ff8f3444700 1 -- start start 2024-09-13T18:36:39.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8f3444700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8ec06e010 0x7ff8ec155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8f3444700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff8ec153280 0x7ff8ec155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8f3444700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8ec15db30 0x7ff8ec1f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8f3444700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec150f20 con 0x7ff8ec15db30 2024-09-13T18:36:39.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8f3444700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec156760 con 0x7ff8ec06e010 2024-09-13T18:36:39.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8f3444700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec156480 con 0x7ff8ec153280 2024-09-13T18:36:39.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8f2c43700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8ec15db30 0x7ff8ec1f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8f2c43700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8ec15db30 0x7ff8ec1f59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42798/0 (socket says 172.21.15.44:42798) 2024-09-13T18:36:39.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8f2c43700 1 -- 172.21.15.44:0/1988989853 learned_addr learned my addr 172.21.15.44:0/1988989853 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:39.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8f2442700 1 --2- 172.21.15.44:0/1988989853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8ec06e010 0x7ff8ec155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8f1c41700 1 --2- 172.21.15.44:0/1988989853 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff8ec153280 0x7ff8ec155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8f2c43700 1 -- 172.21.15.44:0/1988989853 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff8ec153280 msgr2=0x7ff8ec155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8f2c43700 1 --2- 172.21.15.44:0/1988989853 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff8ec153280 0x7ff8ec155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8f2c43700 1 -- 172.21.15.44:0/1988989853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8ec06e010 msgr2=0x7ff8ec155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8f2c43700 1 --2- 172.21.15.44:0/1988989853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8ec06e010 0x7ff8ec155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8f2c43700 1 -- 172.21.15.44:0/1988989853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc0094b0 con 0x7ff8ec15db30 2024-09-13T18:36:39.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8f1c41700 1 --2- 172.21.15.44:0/1988989853 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff8ec153280 0x7ff8ec155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:39.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8f2c43700 1 --2- 172.21.15.44:0/1988989853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8ec15db30 0x7ff8ec1f59f0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7ff8e400cc50 tx=0x7ff8e400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:39.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8e2ffd700 1 -- 172.21.15.44:0/1988989853 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4003c20 con 0x7ff8ec15db30 2024-09-13T18:36:39.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8e2ffd700 1 -- 172.21.15.44:0/1988989853 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e4003d80 con 0x7ff8ec15db30 2024-09-13T18:36:39.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8f3444700 1 -- 172.21.15.44:0/1988989853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ec1508d0 con 0x7ff8ec15db30 2024-09-13T18:36:39.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8e2ffd700 1 -- 172.21.15.44:0/1988989853 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e400ab60 con 0x7ff8ec15db30 2024-09-13T18:36:39.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8f3444700 1 -- 172.21.15.44:0/1988989853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ec1561a0 con 0x7ff8ec15db30 2024-09-13T18:36:39.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.839+0000 7ff8f3444700 1 -- 172.21.15.44:0/1988989853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff8ec15d220 con 0x7ff8ec15db30 2024-09-13T18:36:39.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.843+0000 7ff8e2ffd700 1 -- 172.21.15.44:0/1988989853 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff8e400acc0 con 0x7ff8ec15db30 2024-09-13T18:36:39.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.843+0000 7ff8e2ffd700 1 --2- 172.21.15.44:0/1988989853 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff8d0066780 0x7ff8d0068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.843+0000 7ff8e2ffd700 1 -- 172.21.15.44:0/1988989853 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff8e4083d30 con 0x7ff8ec15db30 2024-09-13T18:36:39.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.843+0000 7ff8e2ffd700 1 --2- 172.21.15.44:0/1988989853 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x7ff8d006c5e0 0x7ff8d006ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.843+0000 7ff8e2ffd700 1 -- 172.21.15.44:0/1988989853 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff8d006f0b0 con 0x7ff8d006c5e0 2024-09-13T18:36:39.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.843+0000 7ff8e2ffd700 1 -- 172.21.15.44:0/1988989853 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8e4086440 con 0x7ff8ec15db30 2024-09-13T18:36:39.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.843+0000 7ff8f2442700 1 --2- 172.21.15.44:0/1988989853 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff8d0066780 0x7ff8d0068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.843+0000 7ff8f1c41700 1 --2- 172.21.15.44:0/1988989853 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x7ff8d006c5e0 0x7ff8d006ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.843+0000 7ff8f1c41700 1 --2- 172.21.15.44:0/1988989853 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x7ff8d006c5e0 0x7ff8d006ea00 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:39.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.843+0000 7ff8f2442700 1 --2- 172.21.15.44:0/1988989853 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff8d0066780 0x7ff8d0068c40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8007fd0 tx=0x7ff8e8007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:39.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.847+0000 7ff8e2ffd700 1 -- 172.21.15.44:0/1988989853 <== osd.2 v2:172.21.15.44:6817/3180763837 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff8d006f0b0 con 0x7ff8d006c5e0 2024-09-13T18:36:39.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.863+0000 7ff8f3444700 1 -- 172.21.15.44:0/1988989853 --> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff8ec0b31f0 con 0x7ff8d006c5e0 2024-09-13T18:36:39.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.863+0000 7ff8e2ffd700 1 -- 172.21.15.44:0/1988989853 <== osd.2 v2:172.21.15.44:6817/3180763837 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff8dc0117b0 con 0x7ff8d006c5e0 2024-09-13T18:36:39.873 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:36:39.873 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:36:39.874 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:36:39.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.867+0000 7ff8f3444700 1 -- 172.21.15.44:0/1988989853 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x7ff8d006c5e0 msgr2=0x7ff8d006ea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.867+0000 7ff8f3444700 1 --2- 172.21.15.44:0/1988989853 >> [v2:172.21.15.44:6817/3180763837,v1:172.21.15.44:6819/3180763837] conn(0x7ff8d006c5e0 0x7ff8d006ea00 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.867+0000 7ff8f3444700 1 -- 172.21.15.44:0/1988989853 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff8d0066780 msgr2=0x7ff8d0068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.867+0000 7ff8f3444700 1 --2- 172.21.15.44:0/1988989853 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7ff8d0066780 0x7ff8d0068c40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8007fd0 tx=0x7ff8e8007de0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.867+0000 7ff8f3444700 1 -- 172.21.15.44:0/1988989853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8ec15db30 msgr2=0x7ff8ec1f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.867+0000 7ff8f3444700 1 --2- 172.21.15.44:0/1988989853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8ec15db30 0x7ff8ec1f59f0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7ff8e400cc50 tx=0x7ff8e400cf60 comp rx=0 tx=0).stop 2024-09-13T18:36:39.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.867+0000 7ff8f2c43700 1 -- 172.21.15.44:0/1988989853 reap_dead start 2024-09-13T18:36:39.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.867+0000 7ff8f3444700 1 -- 172.21.15.44:0/1988989853 shutdown_connections 2024-09-13T18:36:39.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.867+0000 7ff8f3444700 1 -- 172.21.15.44:0/1988989853 >> 172.21.15.44:0/1988989853 conn(0x7ff8ec0cf630 msgr2=0x7ff8ec0acd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:39.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.867+0000 7ff8f3444700 1 -- 172.21.15.44:0/1988989853 shutdown_connections 2024-09-13T18:36:39.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:39.867+0000 7ff8f3444700 1 -- 172.21.15.44:0/1988989853 wait complete. 2024-09-13T18:36:39.891 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T18:36:40.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.003+0000 7faed0aa7700 1 Processor -- start 2024-09-13T18:36:40.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.003+0000 7faed0aa7700 1 -- start start 2024-09-13T18:36:40.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faed0aa7700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faecc15a930 0x7faecc071d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faed0aa7700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faecc06aba0 0x7faecc06b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faed0aa7700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faecc15ad10 con 0x7faecc0722b0 2024-09-13T18:36:40.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faed0aa7700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faecc0cd0a0 con 0x7faecc15a930 2024-09-13T18:36:40.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faed0aa7700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc06b550 con 0x7faecc06aba0 2024-09-13T18:36:40.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faecb7fe700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faecc15a930 0x7faecc071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faecbfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faecc06aba0 0x7faecc06b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faec3fff700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7faecc0722b0 0x7faecc0cd420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:51438/0 (socket says 172.21.15.44:51438) 2024-09-13T18:36:40.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faecbfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faecc06aba0 0x7faecc06b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:59096/0 (socket says 172.21.15.44:59096) 2024-09-13T18:36:40.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faec3fff700 1 -- 172.21.15.44:0/1813308933 learned_addr learned my addr 172.21.15.44:0/1813308933 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:40.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faecaffd700 1 -- 172.21.15.44:0/1813308933 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 883443841 0 0) 0x7faecc15ad10 con 0x7faecc0722b0 2024-09-13T18:36:40.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faecaffd700 1 -- 172.21.15.44:0/1813308933 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeb80035d0 con 0x7faecc0722b0 2024-09-13T18:36:40.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faecbfff700 1 -- 172.21.15.44:0/1813308933 >> v2:172.21.15.99:3300/0 conn(0x7faecc15a930 msgr2=0x7faecc071d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:40.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faecbfff700 1 --2- 172.21.15.44:0/1813308933 >> v2:172.21.15.99:3300/0 conn(0x7faecc15a930 0x7faecc071d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faecbfff700 1 -- 172.21.15.44:0/1813308933 >> v1:172.21.15.99:6789/0 conn(0x7faecc0722b0 legacy=0x7faecc0cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faecbfff700 1 -- 172.21.15.44:0/1813308933 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc0718e0 con 0x7faecc06aba0 2024-09-13T18:36:40.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faecb7fe700 1 --2- 172.21.15.44:0/1813308933 >> v2:172.21.15.99:3300/0 conn(0x7faecc15a930 0x7faecc071d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:40.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faecbfff700 1 --2- 172.21.15.44:0/1813308933 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faecc06aba0 0x7faecc06b010 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faec4009d90 tx=0x7faec400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f0435dd5ec8ae77 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:40.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faecaffd700 1 -- 172.21.15.44:0/1813308933 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec400e070 con 0x7faecc06aba0 2024-09-13T18:36:40.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faecaffd700 1 -- 172.21.15.44:0/1813308933 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec400bb20 con 0x7faecc06aba0 2024-09-13T18:36:40.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faecaffd700 1 -- 172.21.15.44:0/1813308933 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec4012430 con 0x7faecc06aba0 2024-09-13T18:36:40.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faed0aa7700 1 -- 172.21.15.44:0/1813308933 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faecc06aba0 msgr2=0x7faecc06b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faed0aa7700 1 --2- 172.21.15.44:0/1813308933 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faecc06aba0 0x7faecc06b010 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faec4009d90 tx=0x7faec400b330 comp rx=0 tx=0).stop 2024-09-13T18:36:40.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faed0aa7700 1 -- 172.21.15.44:0/1813308933 shutdown_connections 2024-09-13T18:36:40.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faed0aa7700 1 --2- 172.21.15.44:0/1813308933 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faecc06aba0 0x7faecc06b010 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faed0aa7700 1 --2- 172.21.15.44:0/1813308933 >> v2:172.21.15.99:3300/0 conn(0x7faecc15a930 0x7faecc071d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faed0aa7700 1 -- 172.21.15.44:0/1813308933 >> 172.21.15.44:0/1813308933 conn(0x7faecc0b1810 msgr2=0x7faecc0b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:40.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faed0aa7700 1 -- 172.21.15.44:0/1813308933 shutdown_connections 2024-09-13T18:36:40.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.007+0000 7faed0aa7700 1 -- 172.21.15.44:0/1813308933 wait complete. 2024-09-13T18:36:40.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.011+0000 7faed0aa7700 1 Processor -- start 2024-09-13T18:36:40.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.011+0000 7faed0aa7700 1 -- start start 2024-09-13T18:36:40.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.011+0000 7faed0aa7700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faecc06aba0 0x7faecc144c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.011+0000 7faed0aa7700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faecc0722b0 0x7faecc1588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.011+0000 7faed0aa7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faecc15a930 0x7faecc1f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.011+0000 7faed0aa7700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc159ec0 con 0x7faecc15a930 2024-09-13T18:36:40.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.011+0000 7faed0aa7700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc1561d0 con 0x7faecc06aba0 2024-09-13T18:36:40.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.011+0000 7faed0aa7700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc1592b0 con 0x7faecc0722b0 2024-09-13T18:36:40.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.015+0000 7faecbfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faecc15a930 0x7faecc1f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.015+0000 7faecbfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faecc15a930 0x7faecc1f25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42814/0 (socket says 172.21.15.44:42814) 2024-09-13T18:36:40.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.015+0000 7faecbfff700 1 -- 172.21.15.44:0/530296123 learned_addr learned my addr 172.21.15.44:0/530296123 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:40.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.015+0000 7faec3fff700 1 --2- 172.21.15.44:0/530296123 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faecc0722b0 0x7faecc1588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.015+0000 7faecb7fe700 1 --2- 172.21.15.44:0/530296123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faecc06aba0 0x7faecc144c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.015+0000 7faecbfff700 1 -- 172.21.15.44:0/530296123 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faecc0722b0 msgr2=0x7faecc1588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.015+0000 7faecbfff700 1 --2- 172.21.15.44:0/530296123 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faecc0722b0 0x7faecc1588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.015+0000 7faecbfff700 1 -- 172.21.15.44:0/530296123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faecc06aba0 msgr2=0x7faecc144c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.015+0000 7faecbfff700 1 --2- 172.21.15.44:0/530296123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faecc06aba0 0x7faecc144c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.015+0000 7faecbfff700 1 -- 172.21.15.44:0/530296123 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faebc0094b0 con 0x7faecc15a930 2024-09-13T18:36:40.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.015+0000 7faecbfff700 1 --2- 172.21.15.44:0/530296123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faecc15a930 0x7faecc1f25c0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7faec400b680 tx=0x7faec4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:40.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.015+0000 7faec8ff9700 1 -- 172.21.15.44:0/530296123 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec4012430 con 0x7faecc15a930 2024-09-13T18:36:40.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.015+0000 7faec8ff9700 1 -- 172.21.15.44:0/530296123 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec4020070 con 0x7faecc15a930 2024-09-13T18:36:40.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.015+0000 7faed0aa7700 1 -- 172.21.15.44:0/530296123 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec4009a70 con 0x7faecc15a930 2024-09-13T18:36:40.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.015+0000 7faec8ff9700 1 -- 172.21.15.44:0/530296123 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec4004280 con 0x7faecc15a930 2024-09-13T18:36:40.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.015+0000 7faed0aa7700 1 -- 172.21.15.44:0/530296123 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faecc159870 con 0x7faecc15a930 2024-09-13T18:36:40.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.015+0000 7faed0aa7700 1 -- 172.21.15.44:0/530296123 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faecc0ccca0 con 0x7faecc15a930 2024-09-13T18:36:40.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.015+0000 7faec8ff9700 1 -- 172.21.15.44:0/530296123 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faec40043e0 con 0x7faecc15a930 2024-09-13T18:36:40.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.019+0000 7faec8ff9700 1 --2- 172.21.15.44:0/530296123 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faeac066760 0x7faeac068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.019+0000 7faec8ff9700 1 -- 172.21.15.44:0/530296123 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7faec4022070 con 0x7faecc15a930 2024-09-13T18:36:40.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.019+0000 7faecb7fe700 1 --2- 172.21.15.44:0/530296123 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faeac066760 0x7faeac068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.019+0000 7faecb7fe700 1 --2- 172.21.15.44:0/530296123 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faeac066760 0x7faeac068c20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7faebc009d10 tx=0x7faebc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:40.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.027+0000 7faec8ff9700 1 -- 172.21.15.44:0/530296123 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faec40535c0 con 0x7faecc15a930 2024-09-13T18:36:40.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.199+0000 7faed0aa7700 1 -- 172.21.15.44:0/530296123 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7faecc071290 con 0x7faeac066760 2024-09-13T18:36:40.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.199+0000 7faec8ff9700 1 -- 172.21.15.44:0/530296123 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faebc009960 con 0x7faeac066760 2024-09-13T18:36:40.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.203+0000 7faed0aa7700 1 -- 172.21.15.44:0/530296123 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faeac066760 msgr2=0x7faeac068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.203+0000 7faed0aa7700 1 --2- 172.21.15.44:0/530296123 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faeac066760 0x7faeac068c20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7faebc009d10 tx=0x7faebc008040 comp rx=0 tx=0).stop 2024-09-13T18:36:40.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.203+0000 7faed0aa7700 1 -- 172.21.15.44:0/530296123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faecc15a930 msgr2=0x7faecc1f25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.203+0000 7faed0aa7700 1 --2- 172.21.15.44:0/530296123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faecc15a930 0x7faecc1f25c0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7faec400b680 tx=0x7faec4004af0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.203+0000 7faed0aa7700 1 -- 172.21.15.44:0/530296123 shutdown_connections 2024-09-13T18:36:40.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.203+0000 7faed0aa7700 1 --2- 172.21.15.44:0/530296123 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7faeac066760 0x7faeac068c20 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.203+0000 7faed0aa7700 1 --2- 172.21.15.44:0/530296123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faecc15a930 0x7faecc1f25c0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.203+0000 7faed0aa7700 1 --2- 172.21.15.44:0/530296123 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faecc0722b0 0x7faecc1588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.203+0000 7faed0aa7700 1 --2- 172.21.15.44:0/530296123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faecc06aba0 0x7faecc144c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.203+0000 7faed0aa7700 1 -- 172.21.15.44:0/530296123 >> 172.21.15.44:0/530296123 conn(0x7faecc0b1810 msgr2=0x7faecc0b0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:40.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.203+0000 7faed0aa7700 1 -- 172.21.15.44:0/530296123 shutdown_connections 2024-09-13T18:36:40.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.203+0000 7faed0aa7700 1 -- 172.21.15.44:0/530296123 wait complete. 2024-09-13T18:36:40.212 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T18:36:40.224 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T18:36:40.224 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:36:40.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.335+0000 7f0c391c8700 1 Processor -- start 2024-09-13T18:36:40.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.335+0000 7f0c391c8700 1 -- start start 2024-09-13T18:36:40.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c391c8700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c3406bb60 0x7f0c340cb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c391c8700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0c340cc630 0x7f0c340b2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c391c8700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c340ce270 con 0x7f0c34158f20 2024-09-13T18:36:40.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c391c8700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3406da90 con 0x7f0c340cc630 2024-09-13T18:36:40.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c391c8700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c340cd560 con 0x7f0c3406bb60 2024-09-13T18:36:40.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c33fff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0c34158f20 0x7f0c340cbf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40036/0 (socket says 172.21.15.44:40036) 2024-09-13T18:36:40.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c33fff700 1 -- 172.21.15.44:0/3180594650 learned_addr learned my addr 172.21.15.44:0/3180594650 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:40.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c337fe700 1 --2- 172.21.15.44:0/3180594650 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c3406bb60 0x7f0c340cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c389c7700 1 --2- 172.21.15.44:0/3180594650 >> v2:172.21.15.99:3300/0 conn(0x7f0c340cc630 0x7f0c340b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c337fe700 1 -- 172.21.15.44:0/3180594650 >> v2:172.21.15.99:3300/0 conn(0x7f0c340cc630 msgr2=0x7f0c340b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:40.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c337fe700 1 --2- 172.21.15.44:0/3180594650 >> v2:172.21.15.99:3300/0 conn(0x7f0c340cc630 0x7f0c340b2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c337fe700 1 -- 172.21.15.44:0/3180594650 >> v1:172.21.15.44:6789/0 conn(0x7f0c34158f20 legacy=0x7f0c340cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c337fe700 1 -- 172.21.15.44:0/3180594650 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c340ce550 con 0x7f0c3406bb60 2024-09-13T18:36:40.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c32ffd700 1 -- 172.21.15.44:0/3180594650 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873810255 0 0) 0x7f0c340ce270 con 0x7f0c34158f20 2024-09-13T18:36:40.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c337fe700 1 --2- 172.21.15.44:0/3180594650 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c3406bb60 0x7f0c340cb590 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009850 tx=0x7f0c1c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46c1ad418fa8378 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:40.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c32ffd700 1 -- 172.21.15.44:0/3180594650 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c011830 con 0x7f0c3406bb60 2024-09-13T18:36:40.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c32ffd700 1 -- 172.21.15.44:0/3180594650 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c011990 con 0x7f0c3406bb60 2024-09-13T18:36:40.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c32ffd700 1 -- 172.21.15.44:0/3180594650 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c011d40 con 0x7f0c3406bb60 2024-09-13T18:36:40.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c391c8700 1 -- 172.21.15.44:0/3180594650 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c3406bb60 msgr2=0x7f0c340cb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c391c8700 1 --2- 172.21.15.44:0/3180594650 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c3406bb60 0x7f0c340cb590 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009850 tx=0x7f0c1c009b60 comp rx=0 tx=0).stop 2024-09-13T18:36:40.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c391c8700 1 -- 172.21.15.44:0/3180594650 shutdown_connections 2024-09-13T18:36:40.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c391c8700 1 --2- 172.21.15.44:0/3180594650 >> v2:172.21.15.99:3300/0 conn(0x7f0c340cc630 0x7f0c340b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c391c8700 1 --2- 172.21.15.44:0/3180594650 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c3406bb60 0x7f0c340cb590 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c391c8700 1 -- 172.21.15.44:0/3180594650 >> 172.21.15.44:0/3180594650 conn(0x7f0c340b0cc0 msgr2=0x7f0c3406fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:40.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c391c8700 1 -- 172.21.15.44:0/3180594650 shutdown_connections 2024-09-13T18:36:40.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.339+0000 7f0c391c8700 1 -- 172.21.15.44:0/3180594650 wait complete. 2024-09-13T18:36:40.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.343+0000 7f0c391c8700 1 Processor -- start 2024-09-13T18:36:40.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.343+0000 7f0c391c8700 1 -- start start 2024-09-13T18:36:40.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.343+0000 7f0c391c8700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c340cc630 0x7f0c34153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.343+0000 7f0c391c8700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c34158f20 0x7f0c341f07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.343+0000 7f0c391c8700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c3414c9c0 0x7f0c341535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.343+0000 7f0c391c8700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c34153140 con 0x7f0c340cc630 2024-09-13T18:36:40.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.343+0000 7f0c391c8700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c341f0ce0 con 0x7f0c3414c9c0 2024-09-13T18:36:40.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.343+0000 7f0c391c8700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c34154610 con 0x7f0c34158f20 2024-09-13T18:36:40.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.343+0000 7f0c33fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c340cc630 0x7f0c34153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.343+0000 7f0c33fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c340cc630 0x7f0c34153f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42830/0 (socket says 172.21.15.44:42830) 2024-09-13T18:36:40.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.343+0000 7f0c33fff700 1 -- 172.21.15.44:0/2090339969 learned_addr learned my addr 172.21.15.44:0/2090339969 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:40.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.343+0000 7f0c389c7700 1 --2- 172.21.15.44:0/2090339969 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c3414c9c0 0x7f0c341535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.343+0000 7f0c337fe700 1 --2- 172.21.15.44:0/2090339969 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c34158f20 0x7f0c341f07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.343+0000 7f0c33fff700 1 -- 172.21.15.44:0/2090339969 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c34158f20 msgr2=0x7f0c341f07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.343+0000 7f0c33fff700 1 --2- 172.21.15.44:0/2090339969 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0c34158f20 0x7f0c341f07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.343+0000 7f0c33fff700 1 -- 172.21.15.44:0/2090339969 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c3414c9c0 msgr2=0x7f0c341535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.343+0000 7f0c33fff700 1 --2- 172.21.15.44:0/2090339969 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c3414c9c0 0x7f0c341535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.343+0000 7f0c33fff700 1 -- 172.21.15.44:0/2090339969 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1c0094b0 con 0x7f0c340cc630 2024-09-13T18:36:40.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.347+0000 7f0c33fff700 1 --2- 172.21.15.44:0/2090339969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c340cc630 0x7f0c34153f80 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f0c2400c4e0 tx=0x7f0c2400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:40.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.347+0000 7f0c30ff9700 1 -- 172.21.15.44:0/2090339969 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c24004ca0 con 0x7f0c340cc630 2024-09-13T18:36:40.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.347+0000 7f0c30ff9700 1 -- 172.21.15.44:0/2090339969 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c24004e20 con 0x7f0c340cc630 2024-09-13T18:36:40.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.347+0000 7f0c391c8700 1 -- 172.21.15.44:0/2090339969 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c34152af0 con 0x7f0c340cc630 2024-09-13T18:36:40.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.347+0000 7f0c30ff9700 1 -- 172.21.15.44:0/2090339969 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c24007310 con 0x7f0c340cc630 2024-09-13T18:36:40.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.347+0000 7f0c391c8700 1 -- 172.21.15.44:0/2090339969 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c34153b10 con 0x7f0c340cc630 2024-09-13T18:36:40.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.347+0000 7f0c391c8700 1 -- 172.21.15.44:0/2090339969 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0c34159300 con 0x7f0c340cc630 2024-09-13T18:36:40.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.347+0000 7f0c30ff9700 1 -- 172.21.15.44:0/2090339969 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0c24007470 con 0x7f0c340cc630 2024-09-13T18:36:40.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.351+0000 7f0c30ff9700 1 --2- 172.21.15.44:0/2090339969 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0c18066730 0x7f0c18068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.351+0000 7f0c30ff9700 1 -- 172.21.15.44:0/2090339969 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0c24083a80 con 0x7f0c340cc630 2024-09-13T18:36:40.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.351+0000 7f0c30ff9700 1 --2- 172.21.15.44:0/2090339969 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x7f0c1806c590 0x7f0c1806e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.351+0000 7f0c30ff9700 1 -- 172.21.15.44:0/2090339969 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c1806f060 con 0x7f0c1806c590 2024-09-13T18:36:40.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.351+0000 7f0c30ff9700 1 -- 172.21.15.44:0/2090339969 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c24085ea0 con 0x7f0c340cc630 2024-09-13T18:36:40.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.351+0000 7f0c389c7700 1 --2- 172.21.15.44:0/2090339969 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x7f0c1806c590 0x7f0c1806e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.351+0000 7f0c337fe700 1 --2- 172.21.15.44:0/2090339969 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0c18066730 0x7f0c18068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.351+0000 7f0c389c7700 1 --2- 172.21.15.44:0/2090339969 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x7f0c1806c590 0x7f0c1806e9b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:40.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.351+0000 7f0c337fe700 1 --2- 172.21.15.44:0/2090339969 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0c18066730 0x7f0c18068bf0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c0090b0 tx=0x7f0c1c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:40.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.351+0000 7f0c30ff9700 1 -- 172.21.15.44:0/2090339969 <== osd.3 v2:172.21.15.44:6808/771281770 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0c1806f060 con 0x7f0c1806c590 2024-09-13T18:36:40.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.367+0000 7f0c391c8700 1 -- 172.21.15.44:0/2090339969 --> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0c340cda50 con 0x7f0c1806c590 2024-09-13T18:36:40.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.367+0000 7f0c30ff9700 1 -- 172.21.15.44:0/2090339969 <== osd.3 v2:172.21.15.44:6808/771281770 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0c2c010040 con 0x7f0c1806c590 2024-09-13T18:36:40.375 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:36:40.375 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:36:40.375 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:36:40.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.367+0000 7f0c391c8700 1 -- 172.21.15.44:0/2090339969 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x7f0c1806c590 msgr2=0x7f0c1806e9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.367+0000 7f0c391c8700 1 --2- 172.21.15.44:0/2090339969 >> [v2:172.21.15.44:6808/771281770,v1:172.21.15.44:6809/771281770] conn(0x7f0c1806c590 0x7f0c1806e9b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.367+0000 7f0c391c8700 1 -- 172.21.15.44:0/2090339969 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0c18066730 msgr2=0x7f0c18068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.367+0000 7f0c391c8700 1 --2- 172.21.15.44:0/2090339969 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0c18066730 0x7f0c18068bf0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c0090b0 tx=0x7f0c1c008030 comp rx=0 tx=0).stop 2024-09-13T18:36:40.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.367+0000 7f0c391c8700 1 -- 172.21.15.44:0/2090339969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c340cc630 msgr2=0x7f0c34153f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.367+0000 7f0c391c8700 1 --2- 172.21.15.44:0/2090339969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c340cc630 0x7f0c34153f80 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f0c2400c4e0 tx=0x7f0c2400c7f0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.367+0000 7f0c389c7700 1 -- 172.21.15.44:0/2090339969 reap_dead start 2024-09-13T18:36:40.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.367+0000 7f0c391c8700 1 -- 172.21.15.44:0/2090339969 shutdown_connections 2024-09-13T18:36:40.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.367+0000 7f0c391c8700 1 -- 172.21.15.44:0/2090339969 >> 172.21.15.44:0/2090339969 conn(0x7f0c340b0cc0 msgr2=0x7f0c3414d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:40.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.367+0000 7f0c391c8700 1 -- 172.21.15.44:0/2090339969 shutdown_connections 2024-09-13T18:36:40.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.367+0000 7f0c391c8700 1 -- 172.21.15.44:0/2090339969 wait complete. 2024-09-13T18:36:40.388 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T18:36:40.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.503+0000 7f4c2f59e700 1 Processor -- start 2024-09-13T18:36:40.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.503+0000 7f4c2f59e700 1 -- start start 2024-09-13T18:36:40.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.503+0000 7f4c2f59e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4c3006b900 0x7f4c300b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.503+0000 7f4c2f59e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4c3006a520 0x7f4c3006a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.503+0000 7f4c2f59e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c300b8430 con 0x7f4c3015cda0 2024-09-13T18:36:40.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.503+0000 7f4c2f59e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c3006ae70 con 0x7f4c3006a520 2024-09-13T18:36:40.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.503+0000 7f4c2f59e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c3006bd60 con 0x7f4c3006b900 2024-09-13T18:36:40.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.507+0000 7f4c2ed9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4c3006a520 0x7f4c3006a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.507+0000 7f4c2e59c700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4c3015cda0 0x7f4c300ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40040/0 (socket says 172.21.15.44:40040) 2024-09-13T18:36:40.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.507+0000 7f4c2e59c700 1 -- 172.21.15.44:0/2337244416 learned_addr learned my addr 172.21.15.44:0/2337244416 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:40.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.507+0000 7f4c2dd9b700 1 --2- 172.21.15.44:0/2337244416 >> v2:172.21.15.99:3300/0 conn(0x7f4c3006b900 0x7f4c300b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.507+0000 7f4c2ed9d700 1 -- 172.21.15.44:0/2337244416 >> v2:172.21.15.99:3300/0 conn(0x7f4c3006b900 msgr2=0x7f4c300b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:40.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.507+0000 7f4c2ed9d700 1 --2- 172.21.15.44:0/2337244416 >> v2:172.21.15.99:3300/0 conn(0x7f4c3006b900 0x7f4c300b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.507+0000 7f4c2ed9d700 1 -- 172.21.15.44:0/2337244416 >> v1:172.21.15.44:6789/0 conn(0x7f4c3015cda0 legacy=0x7f4c300ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.507+0000 7f4c2ed9d700 1 -- 172.21.15.44:0/2337244416 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c300cf350 con 0x7f4c3006a520 2024-09-13T18:36:40.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.507+0000 7f4c2ed9d700 1 --2- 172.21.15.44:0/2337244416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c3006a520 0x7f4c3006a930 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f4c300cf280 tx=0x7f4c2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1785b2cf37263843 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.507+0000 7f4c2d59a700 1 -- 172.21.15.44:0/2337244416 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2800e070 con 0x7f4c3006a520 2024-09-13T18:36:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.507+0000 7f4c2d59a700 1 -- 172.21.15.44:0/2337244416 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2800bbd0 con 0x7f4c3006a520 2024-09-13T18:36:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.507+0000 7f4c2d59a700 1 -- 172.21.15.44:0/2337244416 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c28012430 con 0x7f4c3006a520 2024-09-13T18:36:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.507+0000 7f4c2f59e700 1 -- 172.21.15.44:0/2337244416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c3006a520 msgr2=0x7f4c3006a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.507+0000 7f4c2f59e700 1 --2- 172.21.15.44:0/2337244416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c3006a520 0x7f4c3006a930 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f4c300cf280 tx=0x7f4c2800b330 comp rx=0 tx=0).stop 2024-09-13T18:36:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.507+0000 7f4c2f59e700 1 -- 172.21.15.44:0/2337244416 shutdown_connections 2024-09-13T18:36:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.507+0000 7f4c2f59e700 1 --2- 172.21.15.44:0/2337244416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c3006a520 0x7f4c3006a930 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.507+0000 7f4c2f59e700 1 --2- 172.21.15.44:0/2337244416 >> v2:172.21.15.99:3300/0 conn(0x7f4c3006b900 0x7f4c300b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.507+0000 7f4c2f59e700 1 -- 172.21.15.44:0/2337244416 >> 172.21.15.44:0/2337244416 conn(0x7f4c300d2cb0 msgr2=0x7f4c300d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.507+0000 7f4c2f59e700 1 -- 172.21.15.44:0/2337244416 shutdown_connections 2024-09-13T18:36:40.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.507+0000 7f4c2f59e700 1 -- 172.21.15.44:0/2337244416 wait complete. 2024-09-13T18:36:40.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c2f59e700 1 Processor -- start 2024-09-13T18:36:40.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c2f59e700 1 -- start start 2024-09-13T18:36:40.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c2f59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c3006a520 0x7f4c301f6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c2f59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4c3006b900 0x7f4c301551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c2f59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c3015cda0 0x7f4c300c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c2f59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c30158cf0 con 0x7f4c3006a520 2024-09-13T18:36:40.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c2f59e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c30155720 con 0x7f4c3015cda0 2024-09-13T18:36:40.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c2f59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c30158a10 con 0x7f4c3006b900 2024-09-13T18:36:40.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c2e59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c3006a520 0x7f4c301f6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c2e59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c3006a520 0x7f4c301f6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42856/0 (socket says 172.21.15.44:42856) 2024-09-13T18:36:40.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c2e59c700 1 -- 172.21.15.44:0/3149478774 learned_addr learned my addr 172.21.15.44:0/3149478774 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:40.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c2ed9d700 1 --2- 172.21.15.44:0/3149478774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c3015cda0 0x7f4c300c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c2dd9b700 1 --2- 172.21.15.44:0/3149478774 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4c3006b900 0x7f4c301551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c2e59c700 1 -- 172.21.15.44:0/3149478774 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4c3006b900 msgr2=0x7f4c301551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c2e59c700 1 --2- 172.21.15.44:0/3149478774 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4c3006b900 0x7f4c301551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c2e59c700 1 -- 172.21.15.44:0/3149478774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c3015cda0 msgr2=0x7f4c300c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c2e59c700 1 --2- 172.21.15.44:0/3149478774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c3015cda0 0x7f4c300c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c2e59c700 1 -- 172.21.15.44:0/3149478774 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c28009a70 con 0x7f4c3006a520 2024-09-13T18:36:40.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c2e59c700 1 --2- 172.21.15.44:0/3149478774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c3006a520 0x7f4c301f6780 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f4c20001eb0 tx=0x7f4c2000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:40.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c26ffd700 1 -- 172.21.15.44:0/3149478774 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20005d90 con 0x7f4c3006a520 2024-09-13T18:36:40.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c26ffd700 1 -- 172.21.15.44:0/3149478774 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c200070d0 con 0x7f4c3006a520 2024-09-13T18:36:40.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c2f59e700 1 -- 172.21.15.44:0/3149478774 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c300c8960 con 0x7f4c3006a520 2024-09-13T18:36:40.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c26ffd700 1 -- 172.21.15.44:0/3149478774 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20007440 con 0x7f4c3006a520 2024-09-13T18:36:40.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.511+0000 7f4c2f59e700 1 -- 172.21.15.44:0/3149478774 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c300c8f20 con 0x7f4c3006a520 2024-09-13T18:36:40.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.515+0000 7f4c2f59e700 1 -- 172.21.15.44:0/3149478774 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c300c87c0 con 0x7f4c3006a520 2024-09-13T18:36:40.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.515+0000 7f4c26ffd700 1 -- 172.21.15.44:0/3149478774 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4c200075a0 con 0x7f4c3006a520 2024-09-13T18:36:40.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.515+0000 7f4c26ffd700 1 --2- 172.21.15.44:0/3149478774 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4c10066730 0x7f4c10068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.515+0000 7f4c26ffd700 1 -- 172.21.15.44:0/3149478774 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4c200830f0 con 0x7f4c3006a520 2024-09-13T18:36:40.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.515+0000 7f4c2dd9b700 1 --2- 172.21.15.44:0/3149478774 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4c10066730 0x7f4c10068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.515+0000 7f4c2dd9b700 1 --2- 172.21.15.44:0/3149478774 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4c10066730 0x7f4c10068bf0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4c30158e50 tx=0x7f4c18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:40.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.523+0000 7f4c26ffd700 1 -- 172.21.15.44:0/3149478774 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4c300c87c0 con 0x7f4c3006a520 2024-09-13T18:36:40.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.691+0000 7f4c2f59e700 1 -- 172.21.15.44:0/3149478774 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c300d0e40 con 0x7f4c10066730 2024-09-13T18:36:40.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.691+0000 7f4c26ffd700 1 -- 172.21.15.44:0/3149478774 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4c18011720 con 0x7f4c10066730 2024-09-13T18:36:40.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.695+0000 7f4c2f59e700 1 -- 172.21.15.44:0/3149478774 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4c10066730 msgr2=0x7f4c10068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.695+0000 7f4c2f59e700 1 --2- 172.21.15.44:0/3149478774 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4c10066730 0x7f4c10068bf0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4c30158e50 tx=0x7f4c18008040 comp rx=0 tx=0).stop 2024-09-13T18:36:40.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.695+0000 7f4c2f59e700 1 -- 172.21.15.44:0/3149478774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c3006a520 msgr2=0x7f4c301f6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.695+0000 7f4c2f59e700 1 --2- 172.21.15.44:0/3149478774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c3006a520 0x7f4c301f6780 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f4c20001eb0 tx=0x7f4c2000c7b0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.695+0000 7f4c2f59e700 1 -- 172.21.15.44:0/3149478774 shutdown_connections 2024-09-13T18:36:40.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.695+0000 7f4c2f59e700 1 --2- 172.21.15.44:0/3149478774 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f4c10066730 0x7f4c10068bf0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.695+0000 7f4c2f59e700 1 --2- 172.21.15.44:0/3149478774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c3015cda0 0x7f4c300c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.695+0000 7f4c2f59e700 1 --2- 172.21.15.44:0/3149478774 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4c3006b900 0x7f4c301551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.695+0000 7f4c2f59e700 1 --2- 172.21.15.44:0/3149478774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c3006a520 0x7f4c301f6780 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.695+0000 7f4c2f59e700 1 -- 172.21.15.44:0/3149478774 >> 172.21.15.44:0/3149478774 conn(0x7f4c300d2cb0 msgr2=0x7f4c300d1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:40.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.695+0000 7f4c2f59e700 1 -- 172.21.15.44:0/3149478774 shutdown_connections 2024-09-13T18:36:40.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.695+0000 7f4c2f59e700 1 -- 172.21.15.44:0/3149478774 wait complete. 2024-09-13T18:36:40.704 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T18:36:40.715 INFO:tasks.ceph:Scrubbing osd.4 2024-09-13T18:36:40.715 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:36:40.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.831+0000 7f01ab59e700 1 Processor -- start 2024-09-13T18:36:40.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.831+0000 7f01ab59e700 1 -- start start 2024-09-13T18:36:40.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.831+0000 7f01ab59e700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f01ac0ce710 0x7f01ac0b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.831+0000 7f01ab59e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f01ac0ceaf0 0x7f01ac0cff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.831+0000 7f01ab59e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ac06aa30 con 0x7f01ac0cd280 2024-09-13T18:36:40.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.831+0000 7f01ab59e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ac0b1e60 con 0x7f01ac0ceaf0 2024-09-13T18:36:40.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.831+0000 7f01ab59e700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ac0b18a0 con 0x7f01ac0ce710 2024-09-13T18:36:40.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.831+0000 7f01a3fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f01ac0ceaf0 0x7f01ac0cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.831+0000 7f01a3fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f01ac0ceaf0 0x7f01ac0cff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42866/0 (socket says 172.21.15.44:42866) 2024-09-13T18:36:40.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.831+0000 7f01a3fff700 1 -- 172.21.15.44:0/2377061891 learned_addr learned my addr 172.21.15.44:0/2377061891 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:40.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.831+0000 7f01aa59c700 1 --2- 172.21.15.44:0/2377061891 >> v2:172.21.15.99:3300/0 conn(0x7f01ac0ce710 0x7f01ac0b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.831+0000 7f01a3fff700 1 -- 172.21.15.44:0/2377061891 >> v2:172.21.15.99:3300/0 conn(0x7f01ac0ce710 msgr2=0x7f01ac0b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:40.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.831+0000 7f01a3fff700 1 --2- 172.21.15.44:0/2377061891 >> v2:172.21.15.99:3300/0 conn(0x7f01ac0ce710 0x7f01ac0b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.831+0000 7f01a3fff700 1 -- 172.21.15.44:0/2377061891 >> v1:172.21.15.99:6789/0 conn(0x7f01ac0cd280 legacy=0x7f01ac0cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:40.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.831+0000 7f01a3fff700 1 -- 172.21.15.44:0/2377061891 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ac0b1b80 con 0x7f01ac0ceaf0 2024-09-13T18:36:40.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.831+0000 7f01a3fff700 1 --2- 172.21.15.44:0/2377061891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01ac0ceaf0 0x7f01ac0cff50 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f01ac0b2720 tx=0x7f0194009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9fc6deaef39d2e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:40.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01a9d9b700 1 -- 172.21.15.44:0/2377061891 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194004230 con 0x7f01ac0ceaf0 2024-09-13T18:36:40.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01a9d9b700 1 -- 172.21.15.44:0/2377061891 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0194004390 con 0x7f01ac0ceaf0 2024-09-13T18:36:40.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01a9d9b700 1 -- 172.21.15.44:0/2377061891 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01940036c0 con 0x7f01ac0ceaf0 2024-09-13T18:36:40.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01ab59e700 1 -- 172.21.15.44:0/2377061891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01ac0ceaf0 msgr2=0x7f01ac0cff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01ab59e700 1 --2- 172.21.15.44:0/2377061891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01ac0ceaf0 0x7f01ac0cff50 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f01ac0b2720 tx=0x7f0194009bf0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01ab59e700 1 -- 172.21.15.44:0/2377061891 shutdown_connections 2024-09-13T18:36:40.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01ab59e700 1 --2- 172.21.15.44:0/2377061891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01ac0ceaf0 0x7f01ac0cff50 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01ab59e700 1 --2- 172.21.15.44:0/2377061891 >> v2:172.21.15.99:3300/0 conn(0x7f01ac0ce710 0x7f01ac0b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01ab59e700 1 -- 172.21.15.44:0/2377061891 >> 172.21.15.44:0/2377061891 conn(0x7f01ac0d3260 msgr2=0x7f01ac0cf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:40.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01ab59e700 1 -- 172.21.15.44:0/2377061891 shutdown_connections 2024-09-13T18:36:40.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01ab59e700 1 -- 172.21.15.44:0/2377061891 wait complete. 2024-09-13T18:36:40.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01ab59e700 1 Processor -- start 2024-09-13T18:36:40.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01ab59e700 1 -- start start 2024-09-13T18:36:40.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01ab59e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f01ac0cd280 0x7f01ac0acf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01ab59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01ac0ce710 0x7f01ac0cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01ab59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01ac0ceaf0 0x7f01ac152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01ab59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac0aae70 con 0x7f01ac0ceaf0 2024-09-13T18:36:40.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01ab59e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac0cc710 con 0x7f01ac0ce710 2024-09-13T18:36:40.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01ab59e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac0aa510 con 0x7f01ac0cd280 2024-09-13T18:36:40.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01aad9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01ac0ceaf0 0x7f01ac152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01a3fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01ac0ce710 0x7f01ac0cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01a3fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01ac0ce710 0x7f01ac0cbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:42302/0 (socket says 172.21.15.44:42302) 2024-09-13T18:36:40.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01a3fff700 1 -- 172.21.15.44:0/3682787170 learned_addr learned my addr 172.21.15.44:0/3682787170 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:40.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.835+0000 7f01aa59c700 1 --2- 172.21.15.44:0/3682787170 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f01ac0cd280 0x7f01ac0acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.839+0000 7f01aad9d700 1 -- 172.21.15.44:0/3682787170 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f01ac0cd280 msgr2=0x7f01ac0acf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.839+0000 7f01aad9d700 1 --2- 172.21.15.44:0/3682787170 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f01ac0cd280 0x7f01ac0acf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.839+0000 7f01aad9d700 1 -- 172.21.15.44:0/3682787170 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01ac0ce710 msgr2=0x7f01ac0cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.839+0000 7f01aad9d700 1 --2- 172.21.15.44:0/3682787170 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01ac0ce710 0x7f01ac0cbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.839+0000 7f01aad9d700 1 -- 172.21.15.44:0/3682787170 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0194009570 con 0x7f01ac0ceaf0 2024-09-13T18:36:40.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.839+0000 7f01aad9d700 1 --2- 172.21.15.44:0/3682787170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01ac0ceaf0 0x7f01ac152b30 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f01a400cb40 tx=0x7f01a400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:40.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.839+0000 7f01a2ffd700 1 -- 172.21.15.44:0/3682787170 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a400a9a0 con 0x7f01ac0ceaf0 2024-09-13T18:36:40.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.839+0000 7f01ab59e700 1 -- 172.21.15.44:0/3682787170 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ac0aa7b0 con 0x7f01ac0ceaf0 2024-09-13T18:36:40.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.839+0000 7f01a2ffd700 1 -- 172.21.15.44:0/3682787170 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a400ab00 con 0x7f01ac0ceaf0 2024-09-13T18:36:40.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.839+0000 7f01a2ffd700 1 -- 172.21.15.44:0/3682787170 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a4012420 con 0x7f01ac0ceaf0 2024-09-13T18:36:40.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.839+0000 7f01ab59e700 1 -- 172.21.15.44:0/3682787170 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ac0caf70 con 0x7f01ac0ceaf0 2024-09-13T18:36:40.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.839+0000 7f01ab59e700 1 -- 172.21.15.44:0/3682787170 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f01ac0d0490 con 0x7f01ac0ceaf0 2024-09-13T18:36:40.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.843+0000 7f01a2ffd700 1 -- 172.21.15.44:0/3682787170 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f01a4012580 con 0x7f01ac0ceaf0 2024-09-13T18:36:40.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.843+0000 7f01a2ffd700 1 --2- 172.21.15.44:0/3682787170 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f018c066730 0x7f018c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.843+0000 7f01a2ffd700 1 -- 172.21.15.44:0/3682787170 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f01a4084a90 con 0x7f01ac0ceaf0 2024-09-13T18:36:40.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.843+0000 7f01a2ffd700 1 --2- 172.21.15.44:0/3682787170 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f018c06c590 0x7f018c06e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.843+0000 7f01a2ffd700 1 -- 172.21.15.44:0/3682787170 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f018c06f060 con 0x7f018c06c590 2024-09-13T18:36:40.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.843+0000 7f01a2ffd700 1 -- 172.21.15.44:0/3682787170 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01a4084e00 con 0x7f01ac0ceaf0 2024-09-13T18:36:40.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.843+0000 7f01aa59c700 1 --2- 172.21.15.44:0/3682787170 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f018c066730 0x7f018c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.843+0000 7f01a3fff700 1 --2- 172.21.15.44:0/3682787170 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f018c06c590 0x7f018c06e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.843+0000 7f01aa59c700 1 --2- 172.21.15.44:0/3682787170 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f018c066730 0x7f018c068bf0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f019c009a00 tx=0x7f019c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:40.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.843+0000 7f01a3fff700 1 --2- 172.21.15.44:0/3682787170 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f018c06c590 0x7f018c06e9b0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:40.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.847+0000 7f01a2ffd700 1 -- 172.21.15.44:0/3682787170 <== osd.4 v2:172.21.15.99:6816/2515272044 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f018c06f060 con 0x7f018c06c590 2024-09-13T18:36:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.863+0000 7f01ab59e700 1 -- 172.21.15.44:0/3682787170 --> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f01ac0aafb0 con 0x7f018c06c590 2024-09-13T18:36:40.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.867+0000 7f01a2ffd700 1 -- 172.21.15.44:0/3682787170 <== osd.4 v2:172.21.15.99:6816/2515272044 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f01ac0aafb0 con 0x7f018c06c590 2024-09-13T18:36:40.873 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:36:40.873 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:36:40.873 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:36:40.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.867+0000 7f01ab59e700 1 -- 172.21.15.44:0/3682787170 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f018c06c590 msgr2=0x7f018c06e9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.867+0000 7f01ab59e700 1 --2- 172.21.15.44:0/3682787170 >> [v2:172.21.15.99:6816/2515272044,v1:172.21.15.99:6817/2515272044] conn(0x7f018c06c590 0x7f018c06e9b0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.867+0000 7f01ab59e700 1 -- 172.21.15.44:0/3682787170 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f018c066730 msgr2=0x7f018c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.867+0000 7f01ab59e700 1 --2- 172.21.15.44:0/3682787170 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f018c066730 0x7f018c068bf0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f019c009a00 tx=0x7f019c008040 comp rx=0 tx=0).stop 2024-09-13T18:36:40.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.867+0000 7f01ab59e700 1 -- 172.21.15.44:0/3682787170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01ac0ceaf0 msgr2=0x7f01ac152b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.867+0000 7f01ab59e700 1 --2- 172.21.15.44:0/3682787170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01ac0ceaf0 0x7f01ac152b30 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f01a400cb40 tx=0x7f01a400ce50 comp rx=0 tx=0).stop 2024-09-13T18:36:40.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.867+0000 7f01aad9d700 1 -- 172.21.15.44:0/3682787170 reap_dead start 2024-09-13T18:36:40.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.867+0000 7f01ab59e700 1 -- 172.21.15.44:0/3682787170 shutdown_connections 2024-09-13T18:36:40.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.867+0000 7f01ab59e700 1 -- 172.21.15.44:0/3682787170 >> 172.21.15.44:0/3682787170 conn(0x7f01ac0d3260 msgr2=0x7f01ac0b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:40.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.867+0000 7f01ab59e700 1 -- 172.21.15.44:0/3682787170 shutdown_connections 2024-09-13T18:36:40.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.867+0000 7f01ab59e700 1 -- 172.21.15.44:0/3682787170 wait complete. 2024-09-13T18:36:40.887 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-13T18:36:41.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.999+0000 7fd31a702700 1 Processor -- start 2024-09-13T18:36:41.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:40.999+0000 7fd31a702700 1 -- start start 2024-09-13T18:36:41.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd31a702700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd31406d6f0 0x7fd3140ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd31a702700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd31415d200 0x7fd31406baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd31a702700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd31406dad0 con 0x7fd3140adbd0 2024-09-13T18:36:41.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd31a702700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3140ae3c0 con 0x7fd31415d200 2024-09-13T18:36:41.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd31a702700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3140705b0 con 0x7fd31406d6f0 2024-09-13T18:36:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd319700700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd31406d6f0 0x7fd3140ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd319f01700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd31415d200 0x7fd31406baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd319f01700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd31415d200 0x7fd31406baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.44:42312/0 (socket says 172.21.15.44:42312) 2024-09-13T18:36:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd319f01700 1 -- 172.21.15.44:0/3468771371 learned_addr learned my addr 172.21.15.44:0/3468771371 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd318eff700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fd3140adbd0 0x7fd31415caf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:51462/0 (socket says 172.21.15.44:51462) 2024-09-13T18:36:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd319f01700 1 -- 172.21.15.44:0/3468771371 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd31406d6f0 msgr2=0x7fd3140ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd319f01700 1 --2- 172.21.15.44:0/3468771371 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd31406d6f0 0x7fd3140ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd319f01700 1 -- 172.21.15.44:0/3468771371 >> v1:172.21.15.99:6789/0 conn(0x7fd3140adbd0 legacy=0x7fd31415caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd319f01700 1 -- 172.21.15.44:0/3468771371 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd314070890 con 0x7fd31415d200 2024-09-13T18:36:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd319f01700 1 --2- 172.21.15.44:0/3468771371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd31415d200 0x7fd31406baf0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00d1b0 tx=0x7fd30c00d4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a76ae5211828d775 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd30bfff700 1 -- 172.21.15.44:0/3468771371 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c010070 con 0x7fd31415d200 2024-09-13T18:36:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd30bfff700 1 -- 172.21.15.44:0/3468771371 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30c00dcf0 con 0x7fd31415d200 2024-09-13T18:36:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd30bfff700 1 -- 172.21.15.44:0/3468771371 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c00b310 con 0x7fd31415d200 2024-09-13T18:36:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd31a702700 1 -- 172.21.15.44:0/3468771371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd31415d200 msgr2=0x7fd31406baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd31a702700 1 --2- 172.21.15.44:0/3468771371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd31415d200 0x7fd31406baf0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00d1b0 tx=0x7fd30c00d4c0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd31a702700 1 -- 172.21.15.44:0/3468771371 shutdown_connections 2024-09-13T18:36:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd31a702700 1 --2- 172.21.15.44:0/3468771371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd31415d200 0x7fd31406baf0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd31a702700 1 --2- 172.21.15.44:0/3468771371 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd31406d6f0 0x7fd3140ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd31a702700 1 -- 172.21.15.44:0/3468771371 >> 172.21.15.44:0/3468771371 conn(0x7fd3140b0e10 msgr2=0x7fd3140b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd31a702700 1 -- 172.21.15.44:0/3468771371 shutdown_connections 2024-09-13T18:36:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.003+0000 7fd31a702700 1 -- 172.21.15.44:0/3468771371 wait complete. 2024-09-13T18:36:41.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.007+0000 7fd31a702700 1 Processor -- start 2024-09-13T18:36:41.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.007+0000 7fd31a702700 1 -- start start 2024-09-13T18:36:41.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.007+0000 7fd31a702700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd31406d6f0 0x7fd3141eeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.007+0000 7fd31a702700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3140adbd0 0x7fd3141f1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.007+0000 7fd31a702700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd31415d200 0x7fd314151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.007+0000 7fd31a702700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3141ee480 con 0x7fd31406d6f0 2024-09-13T18:36:41.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.007+0000 7fd31a702700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3141ef530 con 0x7fd3140adbd0 2024-09-13T18:36:41.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.007+0000 7fd31a702700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3141f2a10 con 0x7fd31415d200 2024-09-13T18:36:41.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.007+0000 7fd319700700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd31406d6f0 0x7fd3141eeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.007+0000 7fd319700700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd31406d6f0 0x7fd3141eeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42876/0 (socket says 172.21.15.44:42876) 2024-09-13T18:36:41.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.007+0000 7fd319f01700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd31415d200 0x7fd314151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.007+0000 7fd319700700 1 -- 172.21.15.44:0/1920175719 learned_addr learned my addr 172.21.15.44:0/1920175719 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:41.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.007+0000 7fd318eff700 1 --2- 172.21.15.44:0/1920175719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3140adbd0 0x7fd3141f1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.007+0000 7fd319700700 1 -- 172.21.15.44:0/1920175719 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd31415d200 msgr2=0x7fd314151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.011+0000 7fd319700700 1 --2- 172.21.15.44:0/1920175719 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd31415d200 0x7fd314151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.011+0000 7fd319700700 1 -- 172.21.15.44:0/1920175719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3140adbd0 msgr2=0x7fd3141f1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.011+0000 7fd319700700 1 --2- 172.21.15.44:0/1920175719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3140adbd0 0x7fd3141f1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.011+0000 7fd319700700 1 -- 172.21.15.44:0/1920175719 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30c00bd40 con 0x7fd31406d6f0 2024-09-13T18:36:41.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.011+0000 7fd319700700 1 --2- 172.21.15.44:0/1920175719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd31406d6f0 0x7fd3141eeff0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fd31000e9d0 tx=0x7fd31000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:41.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.011+0000 7fd309ffb700 1 -- 172.21.15.44:0/1920175719 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd310009720 con 0x7fd31406d6f0 2024-09-13T18:36:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.011+0000 7fd31a702700 1 -- 172.21.15.44:0/1920175719 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3141f1880 con 0x7fd31406d6f0 2024-09-13T18:36:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.011+0000 7fd31a702700 1 -- 172.21.15.44:0/1920175719 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3141f1e00 con 0x7fd31406d6f0 2024-09-13T18:36:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.011+0000 7fd309ffb700 1 -- 172.21.15.44:0/1920175719 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31000ee70 con 0x7fd31406d6f0 2024-09-13T18:36:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.011+0000 7fd309ffb700 1 -- 172.21.15.44:0/1920175719 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31000c9f0 con 0x7fd31406d6f0 2024-09-13T18:36:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.011+0000 7fd31a702700 1 -- 172.21.15.44:0/1920175719 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f4005310 con 0x7fd31406d6f0 2024-09-13T18:36:41.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.011+0000 7fd309ffb700 1 -- 172.21.15.44:0/1920175719 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd31000cb50 con 0x7fd31406d6f0 2024-09-13T18:36:41.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.015+0000 7fd309ffb700 1 --2- 172.21.15.44:0/1920175719 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd2f8066730 0x7fd2f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.015+0000 7fd309ffb700 1 -- 172.21.15.44:0/1920175719 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd310083f10 con 0x7fd31406d6f0 2024-09-13T18:36:41.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.015+0000 7fd318eff700 1 --2- 172.21.15.44:0/1920175719 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd2f8066730 0x7fd2f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.015+0000 7fd318eff700 1 --2- 172.21.15.44:0/1920175719 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd2f8066730 0x7fd2f8068bf0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fd3140b3190 tx=0x7fd304007f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:41.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.023+0000 7fd309ffb700 1 -- 172.21.15.44:0/1920175719 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd310051460 con 0x7fd31406d6f0 2024-09-13T18:36:41.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.187+0000 7fd31a702700 1 -- 172.21.15.44:0/1920175719 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2f4000bc0 con 0x7fd2f8066730 2024-09-13T18:36:41.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.191+0000 7fd309ffb700 1 -- 172.21.15.44:0/1920175719 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd2f4000bc0 con 0x7fd2f8066730 2024-09-13T18:36:41.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.191+0000 7fd31a702700 1 -- 172.21.15.44:0/1920175719 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd2f8066730 msgr2=0x7fd2f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.191+0000 7fd31a702700 1 --2- 172.21.15.44:0/1920175719 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd2f8066730 0x7fd2f8068bf0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fd3140b3190 tx=0x7fd304007f30 comp rx=0 tx=0).stop 2024-09-13T18:36:41.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.191+0000 7fd31a702700 1 -- 172.21.15.44:0/1920175719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd31406d6f0 msgr2=0x7fd3141eeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.191+0000 7fd31a702700 1 --2- 172.21.15.44:0/1920175719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd31406d6f0 0x7fd3141eeff0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fd31000e9d0 tx=0x7fd31000ece0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.191+0000 7fd31a702700 1 -- 172.21.15.44:0/1920175719 shutdown_connections 2024-09-13T18:36:41.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.191+0000 7fd31a702700 1 --2- 172.21.15.44:0/1920175719 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fd2f8066730 0x7fd2f8068bf0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.191+0000 7fd31a702700 1 --2- 172.21.15.44:0/1920175719 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd31415d200 0x7fd314151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.191+0000 7fd31a702700 1 --2- 172.21.15.44:0/1920175719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3140adbd0 0x7fd3141f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.191+0000 7fd31a702700 1 --2- 172.21.15.44:0/1920175719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd31406d6f0 0x7fd3141eeff0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.191+0000 7fd31a702700 1 -- 172.21.15.44:0/1920175719 >> 172.21.15.44:0/1920175719 conn(0x7fd3140b0e10 msgr2=0x7fd314066210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:41.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.191+0000 7fd31a702700 1 -- 172.21.15.44:0/1920175719 shutdown_connections 2024-09-13T18:36:41.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.191+0000 7fd31a702700 1 -- 172.21.15.44:0/1920175719 wait complete. 2024-09-13T18:36:41.202 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 4 to deep-scrub 2024-09-13T18:36:41.214 INFO:tasks.ceph:Scrubbing osd.5 2024-09-13T18:36:41.214 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:36:41.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.335+0000 7f9d7e9df700 1 Processor -- start 2024-09-13T18:36:41.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.335+0000 7f9d7e9df700 1 -- start start 2024-09-13T18:36:41.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7e9df700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d780cd330 0x7f9d780cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7e9df700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d780b5050 con 0x7f9d7815dad0 2024-09-13T18:36:41.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7e9df700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d780b5330 con 0x7f9d781465a0 2024-09-13T18:36:41.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7e9df700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7815d6b0 con 0x7f9d780cd330 2024-09-13T18:36:41.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7e1de700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9d7815dad0 0x7f9d7815df30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40054/0 (socket says 172.21.15.44:40054) 2024-09-13T18:36:41.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7e1de700 1 -- 172.21.15.44:0/906668997 learned_addr learned my addr 172.21.15.44:0/906668997 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:41.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7d1dc700 1 --2- 172.21.15.44:0/906668997 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d780cd330 0x7f9d780cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7c9db700 1 -- 172.21.15.44:0/906668997 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2530554989 0 0) 0x7f9d780b5050 con 0x7f9d7815dad0 2024-09-13T18:36:41.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7c9db700 1 -- 172.21.15.44:0/906668997 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d640035d0 con 0x7f9d7815dad0 2024-09-13T18:36:41.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7c9db700 1 -- 172.21.15.44:0/906668997 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2342549589 0 0) 0x7f9d780b5330 con 0x7f9d781465a0 2024-09-13T18:36:41.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7c9db700 1 -- 172.21.15.44:0/906668997 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d780b5050 con 0x7f9d781465a0 2024-09-13T18:36:41.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7d1dc700 1 -- 172.21.15.44:0/906668997 >> v1:172.21.15.99:6789/0 conn(0x7f9d781465a0 legacy=0x7f9d780b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7c9db700 1 -- 172.21.15.44:0/906668997 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1553245292 0 0) 0x7f9d640035d0 con 0x7f9d7815dad0 2024-09-13T18:36:41.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7d1dc700 1 -- 172.21.15.44:0/906668997 >> v1:172.21.15.44:6789/0 conn(0x7f9d7815dad0 legacy=0x7f9d7815df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7d1dc700 1 -- 172.21.15.44:0/906668997 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d780b5610 con 0x7f9d780cd330 2024-09-13T18:36:41.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7d1dc700 1 --2- 172.21.15.44:0/906668997 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d780cd330 0x7f9d780cd770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9d68009880 tx=0x7f9d68009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39184204eacc624f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:41.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7c9db700 1 -- 172.21.15.44:0/906668997 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d68011830 con 0x7f9d780cd330 2024-09-13T18:36:41.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7c9db700 1 -- 172.21.15.44:0/906668997 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d68011990 con 0x7f9d780cd330 2024-09-13T18:36:41.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7c9db700 1 -- 172.21.15.44:0/906668997 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d68011d20 con 0x7f9d780cd330 2024-09-13T18:36:41.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7e9df700 1 -- 172.21.15.44:0/906668997 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d780cd330 msgr2=0x7f9d780cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7e9df700 1 --2- 172.21.15.44:0/906668997 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d780cd330 0x7f9d780cd770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9d68009880 tx=0x7f9d68009b90 comp rx=0 tx=0).stop 2024-09-13T18:36:41.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7e9df700 1 -- 172.21.15.44:0/906668997 shutdown_connections 2024-09-13T18:36:41.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7e9df700 1 --2- 172.21.15.44:0/906668997 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d780cd330 0x7f9d780cd770 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7e9df700 1 -- 172.21.15.44:0/906668997 >> 172.21.15.44:0/906668997 conn(0x7f9d7806a310 msgr2=0x7f9d7806a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:41.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7e9df700 1 -- 172.21.15.44:0/906668997 shutdown_connections 2024-09-13T18:36:41.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.339+0000 7f9d7e9df700 1 -- 172.21.15.44:0/906668997 wait complete. 2024-09-13T18:36:41.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.343+0000 7f9d7e9df700 1 Processor -- start 2024-09-13T18:36:41.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.343+0000 7f9d7e9df700 1 -- start start 2024-09-13T18:36:41.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.343+0000 7f9d7e9df700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d780cd330 0x7f9d7813f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.343+0000 7f9d7e9df700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d781465a0 0x7f9d7815f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.343+0000 7f9d7e9df700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d7815dad0 0x7f9d7813d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.343+0000 7f9d7e9df700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7813e8d0 con 0x7f9d781465a0 2024-09-13T18:36:41.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.343+0000 7f9d7e9df700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d780a8520 con 0x7f9d7815dad0 2024-09-13T18:36:41.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.343+0000 7f9d7e9df700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7813e310 con 0x7f9d780cd330 2024-09-13T18:36:41.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.343+0000 7f9d7d1dc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d781465a0 0x7f9d7815f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.343+0000 7f9d7d1dc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d781465a0 0x7f9d7815f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42892/0 (socket says 172.21.15.44:42892) 2024-09-13T18:36:41.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.343+0000 7f9d7d1dc700 1 -- 172.21.15.44:0/1722249063 learned_addr learned my addr 172.21.15.44:0/1722249063 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:41.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.343+0000 7f9d7e1de700 1 --2- 172.21.15.44:0/1722249063 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d7815dad0 0x7f9d7813d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.343+0000 7f9d7d9dd700 1 --2- 172.21.15.44:0/1722249063 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d780cd330 0x7f9d7813f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.343+0000 7f9d7d1dc700 1 -- 172.21.15.44:0/1722249063 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d780cd330 msgr2=0x7f9d7813f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.343+0000 7f9d7d1dc700 1 --2- 172.21.15.44:0/1722249063 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d780cd330 0x7f9d7813f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.343+0000 7f9d7d1dc700 1 -- 172.21.15.44:0/1722249063 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d7815dad0 msgr2=0x7f9d7813d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.343+0000 7f9d7d1dc700 1 --2- 172.21.15.44:0/1722249063 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d7815dad0 0x7f9d7813d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.343+0000 7f9d7d1dc700 1 -- 172.21.15.44:0/1722249063 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d680094b0 con 0x7f9d781465a0 2024-09-13T18:36:41.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.343+0000 7f9d7e1de700 1 --2- 172.21.15.44:0/1722249063 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d7815dad0 0x7f9d7813d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:41.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.347+0000 7f9d7d1dc700 1 --2- 172.21.15.44:0/1722249063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d781465a0 0x7f9d7815f4e0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f9d68013040 tx=0x7f9d68004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:41.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.347+0000 7f9d6e7fc700 1 -- 172.21.15.44:0/1722249063 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d680198d0 con 0x7f9d781465a0 2024-09-13T18:36:41.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.347+0000 7f9d6e7fc700 1 -- 172.21.15.44:0/1722249063 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6801e070 con 0x7f9d781465a0 2024-09-13T18:36:41.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.347+0000 7f9d6e7fc700 1 -- 172.21.15.44:0/1722249063 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d68019c50 con 0x7f9d781465a0 2024-09-13T18:36:41.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.347+0000 7f9d7e9df700 1 -- 172.21.15.44:0/1722249063 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7813e5f0 con 0x7f9d781465a0 2024-09-13T18:36:41.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.347+0000 7f9d7e9df700 1 -- 172.21.15.44:0/1722249063 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7813eee0 con 0x7f9d781465a0 2024-09-13T18:36:41.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.347+0000 7f9d7e9df700 1 -- 172.21.15.44:0/1722249063 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d780cc430 con 0x7f9d781465a0 2024-09-13T18:36:41.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.347+0000 7f9d6e7fc700 1 -- 172.21.15.44:0/1722249063 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9d6802d450 con 0x7f9d781465a0 2024-09-13T18:36:41.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.347+0000 7f9d6e7fc700 1 --2- 172.21.15.44:0/1722249063 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9d5c066730 0x7f9d5c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.347+0000 7f9d6e7fc700 1 -- 172.21.15.44:0/1722249063 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9d68084df0 con 0x7f9d781465a0 2024-09-13T18:36:41.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.347+0000 7f9d6e7fc700 1 --2- 172.21.15.44:0/1722249063 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f9d5c06c590 0x7f9d5c06e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.347+0000 7f9d6e7fc700 1 -- 172.21.15.44:0/1722249063 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d5c06f060 con 0x7f9d5c06c590 2024-09-13T18:36:41.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.347+0000 7f9d6e7fc700 1 -- 172.21.15.44:0/1722249063 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d68087450 con 0x7f9d781465a0 2024-09-13T18:36:41.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.347+0000 7f9d7d9dd700 1 --2- 172.21.15.44:0/1722249063 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9d5c066730 0x7f9d5c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.351+0000 7f9d7e1de700 1 --2- 172.21.15.44:0/1722249063 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f9d5c06c590 0x7f9d5c06e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.351+0000 7f9d7e1de700 1 --2- 172.21.15.44:0/1722249063 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f9d5c06c590 0x7f9d5c06e9b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:41.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.351+0000 7f9d7d9dd700 1 --2- 172.21.15.44:0/1722249063 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9d5c066730 0x7f9d5c068bf0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9d70001560 tx=0x7f9d70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:41.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.351+0000 7f9d6e7fc700 1 -- 172.21.15.44:0/1722249063 <== osd.5 v2:172.21.15.99:6800/827163121 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9d5c06f060 con 0x7f9d5c06c590 2024-09-13T18:36:41.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.367+0000 7f9d7e9df700 1 -- 172.21.15.44:0/1722249063 --> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9d780cdcb0 con 0x7f9d5c06c590 2024-09-13T18:36:41.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.367+0000 7f9d6e7fc700 1 -- 172.21.15.44:0/1722249063 <== osd.5 v2:172.21.15.99:6800/827163121 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9d74001850 con 0x7f9d5c06c590 2024-09-13T18:36:41.377 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:36:41.377 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:36:41.377 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:36:41.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.371+0000 7f9d7e9df700 1 -- 172.21.15.44:0/1722249063 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f9d5c06c590 msgr2=0x7f9d5c06e9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.371+0000 7f9d7e9df700 1 --2- 172.21.15.44:0/1722249063 >> [v2:172.21.15.99:6800/827163121,v1:172.21.15.99:6801/827163121] conn(0x7f9d5c06c590 0x7f9d5c06e9b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.371+0000 7f9d7e9df700 1 -- 172.21.15.44:0/1722249063 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9d5c066730 msgr2=0x7f9d5c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.371+0000 7f9d7e9df700 1 --2- 172.21.15.44:0/1722249063 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9d5c066730 0x7f9d5c068bf0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9d70001560 tx=0x7f9d70009040 comp rx=0 tx=0).stop 2024-09-13T18:36:41.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.371+0000 7f9d7e9df700 1 -- 172.21.15.44:0/1722249063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d781465a0 msgr2=0x7f9d7815f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.371+0000 7f9d7e9df700 1 --2- 172.21.15.44:0/1722249063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d781465a0 0x7f9d7815f4e0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f9d68013040 tx=0x7f9d68004770 comp rx=0 tx=0).stop 2024-09-13T18:36:41.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.371+0000 7f9d7e1de700 1 -- 172.21.15.44:0/1722249063 reap_dead start 2024-09-13T18:36:41.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.371+0000 7f9d7e9df700 1 -- 172.21.15.44:0/1722249063 shutdown_connections 2024-09-13T18:36:41.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.371+0000 7f9d7e9df700 1 -- 172.21.15.44:0/1722249063 >> 172.21.15.44:0/1722249063 conn(0x7f9d7806a310 msgr2=0x7f9d780cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:41.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.371+0000 7f9d7e9df700 1 -- 172.21.15.44:0/1722249063 shutdown_connections 2024-09-13T18:36:41.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.371+0000 7f9d7e9df700 1 -- 172.21.15.44:0/1722249063 wait complete. 2024-09-13T18:36:41.390 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-13T18:36:41.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.507+0000 7fe641a84700 1 Processor -- start 2024-09-13T18:36:41.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.507+0000 7fe641a84700 1 -- start start 2024-09-13T18:36:41.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe641a84700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe63c06d6f0 0x7fe63c0ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe641a84700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe63c15d200 0x7fe63c06baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe641a84700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63c06dad0 con 0x7fe63c0adbd0 2024-09-13T18:36:41.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe641a84700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63c0ae3c0 con 0x7fe63c06d6f0 2024-09-13T18:36:41.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe641a84700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63c0705b0 con 0x7fe63c15d200 2024-09-13T18:36:41.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe640a82700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe63c06d6f0 0x7fe63c0ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe63bfff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe63c0adbd0 0x7fe63c15caf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40056/0 (socket says 172.21.15.44:40056) 2024-09-13T18:36:41.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe63bfff700 1 -- 172.21.15.44:0/110781840 learned_addr learned my addr 172.21.15.44:0/110781840 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:41.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe641283700 1 --2- 172.21.15.44:0/110781840 >> v2:172.21.15.99:3300/0 conn(0x7fe63c15d200 0x7fe63c06baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe640a82700 1 -- 172.21.15.44:0/110781840 >> v2:172.21.15.99:3300/0 conn(0x7fe63c15d200 msgr2=0x7fe63c06baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:41.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe640a82700 1 --2- 172.21.15.44:0/110781840 >> v2:172.21.15.99:3300/0 conn(0x7fe63c15d200 0x7fe63c06baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe63b7fe700 1 -- 172.21.15.44:0/110781840 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272814248 0 0) 0x7fe63c06dad0 con 0x7fe63c0adbd0 2024-09-13T18:36:41.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe640a82700 1 -- 172.21.15.44:0/110781840 >> v1:172.21.15.44:6789/0 conn(0x7fe63c0adbd0 legacy=0x7fe63c15caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe640a82700 1 -- 172.21.15.44:0/110781840 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63c070890 con 0x7fe63c06d6f0 2024-09-13T18:36:41.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe640a82700 1 --2- 172.21.15.44:0/110781840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe63c06d6f0 0x7fe63c0ce270 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fe63c15ca20 tx=0x7fe62c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4051c1df6dd87008 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:41.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe63b7fe700 1 -- 172.21.15.44:0/110781840 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c010800 con 0x7fe63c06d6f0 2024-09-13T18:36:41.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe63b7fe700 1 -- 172.21.15.44:0/110781840 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62c010960 con 0x7fe63c06d6f0 2024-09-13T18:36:41.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe63b7fe700 1 -- 172.21.15.44:0/110781840 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c010cf0 con 0x7fe63c06d6f0 2024-09-13T18:36:41.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe641a84700 1 -- 172.21.15.44:0/110781840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe63c06d6f0 msgr2=0x7fe63c0ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe641a84700 1 --2- 172.21.15.44:0/110781840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe63c06d6f0 0x7fe63c0ce270 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fe63c15ca20 tx=0x7fe62c009b30 comp rx=0 tx=0).stop 2024-09-13T18:36:41.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe641a84700 1 -- 172.21.15.44:0/110781840 shutdown_connections 2024-09-13T18:36:41.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe641a84700 1 --2- 172.21.15.44:0/110781840 >> v2:172.21.15.99:3300/0 conn(0x7fe63c15d200 0x7fe63c06baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe641a84700 1 --2- 172.21.15.44:0/110781840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe63c06d6f0 0x7fe63c0ce270 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe641a84700 1 -- 172.21.15.44:0/110781840 >> 172.21.15.44:0/110781840 conn(0x7fe63c0b0e10 msgr2=0x7fe63c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:41.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe641a84700 1 -- 172.21.15.44:0/110781840 shutdown_connections 2024-09-13T18:36:41.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.511+0000 7fe641a84700 1 -- 172.21.15.44:0/110781840 wait complete. 2024-09-13T18:36:41.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe641a84700 1 Processor -- start 2024-09-13T18:36:41.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe641a84700 1 -- start start 2024-09-13T18:36:41.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe641a84700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe63c06d6f0 0x7fe63c14d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe641a84700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe63c0adbd0 0x7fe63c156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe641a84700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe63c15d200 0x7fe63c0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe641a84700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c14d1d0 con 0x7fe63c06d6f0 2024-09-13T18:36:41.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe641a84700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c0cd3a0 con 0x7fe63c0adbd0 2024-09-13T18:36:41.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe641a84700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c14e2e0 con 0x7fe63c15d200 2024-09-13T18:36:41.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe640a82700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe63c06d6f0 0x7fe63c14d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe640a82700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe63c06d6f0 0x7fe63c14d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42898/0 (socket says 172.21.15.44:42898) 2024-09-13T18:36:41.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe640a82700 1 -- 172.21.15.44:0/800853971 learned_addr learned my addr 172.21.15.44:0/800853971 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:41.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe641283700 1 --2- 172.21.15.44:0/800853971 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe63c15d200 0x7fe63c0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe63bfff700 1 --2- 172.21.15.44:0/800853971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe63c0adbd0 0x7fe63c156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe640a82700 1 -- 172.21.15.44:0/800853971 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe63c15d200 msgr2=0x7fe63c0cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe640a82700 1 --2- 172.21.15.44:0/800853971 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe63c15d200 0x7fe63c0cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe640a82700 1 -- 172.21.15.44:0/800853971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe63c0adbd0 msgr2=0x7fe63c156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe640a82700 1 --2- 172.21.15.44:0/800853971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe63c0adbd0 0x7fe63c156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe640a82700 1 -- 172.21.15.44:0/800853971 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62c0094b0 con 0x7fe63c06d6f0 2024-09-13T18:36:41.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe640a82700 1 --2- 172.21.15.44:0/800853971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe63c06d6f0 0x7fe63c14d660 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0090b0 tx=0x7fe62c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:41.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe6397fa700 1 -- 172.21.15.44:0/800853971 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c003ad0 con 0x7fe63c06d6f0 2024-09-13T18:36:41.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe6397fa700 1 -- 172.21.15.44:0/800853971 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62c003c30 con 0x7fe63c06d6f0 2024-09-13T18:36:41.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe641a84700 1 -- 172.21.15.44:0/800853971 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe63c14cb80 con 0x7fe63c06d6f0 2024-09-13T18:36:41.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe6397fa700 1 -- 172.21.15.44:0/800853971 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c018400 con 0x7fe63c06d6f0 2024-09-13T18:36:41.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.515+0000 7fe641a84700 1 -- 172.21.15.44:0/800853971 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63c14ddb0 con 0x7fe63c06d6f0 2024-09-13T18:36:41.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.519+0000 7fe6397fa700 1 -- 172.21.15.44:0/800853971 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe62c018560 con 0x7fe63c06d6f0 2024-09-13T18:36:41.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.519+0000 7fe641a84700 1 -- 172.21.15.44:0/800853971 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63c0ce270 con 0x7fe63c06d6f0 2024-09-13T18:36:41.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.519+0000 7fe6397fa700 1 --2- 172.21.15.44:0/800853971 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe628066760 0x7fe628068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.519+0000 7fe6397fa700 1 -- 172.21.15.44:0/800853971 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe62c084f10 con 0x7fe63c06d6f0 2024-09-13T18:36:41.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.519+0000 7fe63bfff700 1 --2- 172.21.15.44:0/800853971 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe628066760 0x7fe628068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.523+0000 7fe63bfff700 1 --2- 172.21.15.44:0/800853971 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe628066760 0x7fe628068c20 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe63c152e40 tx=0x7fe630007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:41.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.531+0000 7fe6397fa700 1 -- 172.21.15.44:0/800853971 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe62c052610 con 0x7fe63c06d6f0 2024-09-13T18:36:41.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.703+0000 7fe641a84700 1 -- 172.21.15.44:0/800853971 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fe63c0ae590 con 0x7fe628066760 2024-09-13T18:36:41.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.703+0000 7fe6397fa700 1 -- 172.21.15.44:0/800853971 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe63c0ae590 con 0x7fe628066760 2024-09-13T18:36:41.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.707+0000 7fe641a84700 1 -- 172.21.15.44:0/800853971 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe628066760 msgr2=0x7fe628068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.707+0000 7fe641a84700 1 --2- 172.21.15.44:0/800853971 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe628066760 0x7fe628068c20 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe63c152e40 tx=0x7fe630007c00 comp rx=0 tx=0).stop 2024-09-13T18:36:41.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.707+0000 7fe641a84700 1 -- 172.21.15.44:0/800853971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe63c06d6f0 msgr2=0x7fe63c14d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.707+0000 7fe641a84700 1 --2- 172.21.15.44:0/800853971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe63c06d6f0 0x7fe63c14d660 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0090b0 tx=0x7fe62c004770 comp rx=0 tx=0).stop 2024-09-13T18:36:41.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.707+0000 7fe641a84700 1 -- 172.21.15.44:0/800853971 shutdown_connections 2024-09-13T18:36:41.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.707+0000 7fe641a84700 1 --2- 172.21.15.44:0/800853971 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7fe628066760 0x7fe628068c20 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.707+0000 7fe641a84700 1 --2- 172.21.15.44:0/800853971 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe63c15d200 0x7fe63c0cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.707+0000 7fe641a84700 1 --2- 172.21.15.44:0/800853971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe63c0adbd0 0x7fe63c156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.707+0000 7fe641a84700 1 --2- 172.21.15.44:0/800853971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe63c06d6f0 0x7fe63c14d660 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.707+0000 7fe641a84700 1 -- 172.21.15.44:0/800853971 >> 172.21.15.44:0/800853971 conn(0x7fe63c0b0e10 msgr2=0x7fe63c0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:41.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.707+0000 7fe641a84700 1 -- 172.21.15.44:0/800853971 shutdown_connections 2024-09-13T18:36:41.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.707+0000 7fe641a84700 1 -- 172.21.15.44:0/800853971 wait complete. 2024-09-13T18:36:41.715 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 5 to deep-scrub 2024-09-13T18:36:41.726 INFO:tasks.ceph:Scrubbing osd.6 2024-09-13T18:36:41.726 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:36:41.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.839+0000 7f0bc184e700 1 Processor -- start 2024-09-13T18:36:41.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.839+0000 7f0bc184e700 1 -- start start 2024-09-13T18:36:41.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bc184e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0bbc0b4170 0x7f0bbc0cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bc184e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bbc0b4550 0x7f0bbc0b4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bc184e700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bbc0ac960 con 0x7f0bbc071a90 2024-09-13T18:36:41.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bc184e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bbc072630 con 0x7f0bbc0b4170 2024-09-13T18:36:41.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bc184e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc15cf50 con 0x7f0bbc0b4550 2024-09-13T18:36:41.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bc084c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0bbc0b4170 0x7f0bbc0cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bb3fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bbc0b4550 0x7f0bbc0b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bb3fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bbc0b4550 0x7f0bbc0b4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.44:59196/0 (socket says 172.21.15.44:59196) 2024-09-13T18:36:41.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bc084c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0bbc0b4170 0x7f0bbc0cc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42910/0 (socket says 172.21.15.44:42910) 2024-09-13T18:36:41.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bc104d700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0bbc071a90 0x7f0bbc071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:51472/0 (socket says 172.21.15.44:51472) 2024-09-13T18:36:41.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bb3fff700 1 -- 172.21.15.44:0/291522595 learned_addr learned my addr 172.21.15.44:0/291522595 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:41.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bb3fff700 1 -- 172.21.15.44:0/291522595 >> v2:172.21.15.44:3300/0 conn(0x7f0bbc0b4170 msgr2=0x7f0bbc0cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:41.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bb3fff700 1 --2- 172.21.15.44:0/291522595 >> v2:172.21.15.44:3300/0 conn(0x7f0bbc0b4170 0x7f0bbc0cc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bb3fff700 1 -- 172.21.15.44:0/291522595 >> v1:172.21.15.99:6789/0 conn(0x7f0bbc071a90 legacy=0x7f0bbc071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bb3fff700 1 -- 172.21.15.44:0/291522595 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc0acc00 con 0x7f0bbc0b4550 2024-09-13T18:36:41.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bb3fff700 1 --2- 172.21.15.44:0/291522595 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bbc0b4550 0x7f0bbc0b4990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0bac009940 tx=0x7f0bac009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cd8161aa9c6f684 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:41.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bb37fe700 1 -- 172.21.15.44:0/291522595 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac011830 con 0x7f0bbc0b4550 2024-09-13T18:36:41.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bb37fe700 1 -- 172.21.15.44:0/291522595 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bac011990 con 0x7f0bbc0b4550 2024-09-13T18:36:41.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bb37fe700 1 -- 172.21.15.44:0/291522595 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac011d20 con 0x7f0bbc0b4550 2024-09-13T18:36:41.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bc184e700 1 -- 172.21.15.44:0/291522595 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bbc0b4550 msgr2=0x7f0bbc0b4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bc184e700 1 --2- 172.21.15.44:0/291522595 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bbc0b4550 0x7f0bbc0b4990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0bac009940 tx=0x7f0bac009c50 comp rx=0 tx=0).stop 2024-09-13T18:36:41.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bc184e700 1 -- 172.21.15.44:0/291522595 shutdown_connections 2024-09-13T18:36:41.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bc184e700 1 --2- 172.21.15.44:0/291522595 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bbc0b4550 0x7f0bbc0b4990 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bc184e700 1 --2- 172.21.15.44:0/291522595 >> v2:172.21.15.44:3300/0 conn(0x7f0bbc0b4170 0x7f0bbc0cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bc184e700 1 -- 172.21.15.44:0/291522595 >> 172.21.15.44:0/291522595 conn(0x7f0bbc0cfad0 msgr2=0x7f0bbc0cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:41.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bc184e700 1 -- 172.21.15.44:0/291522595 shutdown_connections 2024-09-13T18:36:41.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.843+0000 7f0bc184e700 1 -- 172.21.15.44:0/291522595 wait complete. 2024-09-13T18:36:41.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.847+0000 7f0bc184e700 1 Processor -- start 2024-09-13T18:36:41.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.847+0000 7f0bc184e700 1 -- start start 2024-09-13T18:36:41.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.847+0000 7f0bc184e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0bbc071a90 0x7f0bbc15bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.847+0000 7f0bc184e700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bbc0b4170 0x7f0bbc155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.847+0000 7f0bc184e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bbc0b4550 0x7f0bbc0b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.847+0000 7f0bc184e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc1568b0 con 0x7f0bbc0b4550 2024-09-13T18:36:41.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.847+0000 7f0bc184e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc06cca0 con 0x7f0bbc071a90 2024-09-13T18:36:41.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.847+0000 7f0bc184e700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc06cf80 con 0x7f0bbc0b4170 2024-09-13T18:36:41.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.847+0000 7f0bc104d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bbc0b4550 0x7f0bbc0b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.847+0000 7f0bc104d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bbc0b4550 0x7f0bbc0b19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42926/0 (socket says 172.21.15.44:42926) 2024-09-13T18:36:41.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.847+0000 7f0bc104d700 1 -- 172.21.15.44:0/3219589081 learned_addr learned my addr 172.21.15.44:0/3219589081 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:41.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.847+0000 7f0bb3fff700 1 --2- 172.21.15.44:0/3219589081 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bbc0b4170 0x7f0bbc155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.847+0000 7f0bc084c700 1 --2- 172.21.15.44:0/3219589081 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0bbc071a90 0x7f0bbc15bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.851+0000 7f0bc104d700 1 -- 172.21.15.44:0/3219589081 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bbc0b4170 msgr2=0x7f0bbc155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.851+0000 7f0bc104d700 1 --2- 172.21.15.44:0/3219589081 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bbc0b4170 0x7f0bbc155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.851+0000 7f0bc104d700 1 -- 172.21.15.44:0/3219589081 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0bbc071a90 msgr2=0x7f0bbc15bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.851+0000 7f0bc104d700 1 --2- 172.21.15.44:0/3219589081 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0bbc071a90 0x7f0bbc15bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.851+0000 7f0bc104d700 1 -- 172.21.15.44:0/3219589081 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac009570 con 0x7f0bbc0b4550 2024-09-13T18:36:41.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.851+0000 7f0bc104d700 1 --2- 172.21.15.44:0/3219589081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bbc0b4550 0x7f0bbc0b19c0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f0bb400cbc0 tx=0x7f0bb400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:41.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.851+0000 7f0bb17fa700 1 -- 172.21.15.44:0/3219589081 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb400aaa0 con 0x7f0bbc0b4550 2024-09-13T18:36:41.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.851+0000 7f0bb17fa700 1 -- 172.21.15.44:0/3219589081 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb400ac00 con 0x7f0bbc0b4550 2024-09-13T18:36:41.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.851+0000 7f0bb17fa700 1 -- 172.21.15.44:0/3219589081 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4007070 con 0x7f0bbc0b4550 2024-09-13T18:36:41.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.851+0000 7f0bc184e700 1 -- 172.21.15.44:0/3219589081 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bbc06d260 con 0x7f0bbc0b4550 2024-09-13T18:36:41.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.851+0000 7f0bc184e700 1 -- 172.21.15.44:0/3219589081 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bbc159360 con 0x7f0bbc0b4550 2024-09-13T18:36:41.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.851+0000 7f0bc184e700 1 -- 172.21.15.44:0/3219589081 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0bbc0ad4a0 con 0x7f0bbc0b4550 2024-09-13T18:36:41.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.851+0000 7f0bb17fa700 1 -- 172.21.15.44:0/3219589081 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0bb40071d0 con 0x7f0bbc0b4550 2024-09-13T18:36:41.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.851+0000 7f0bb17fa700 1 --2- 172.21.15.44:0/3219589081 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0ba8066760 0x7f0ba8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.851+0000 7f0bb17fa700 1 -- 172.21.15.44:0/3219589081 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0bb4083ab0 con 0x7f0bbc0b4550 2024-09-13T18:36:41.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.851+0000 7f0bb17fa700 1 --2- 172.21.15.44:0/3219589081 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f0ba806c5c0 0x7f0ba806e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.851+0000 7f0bb17fa700 1 -- 172.21.15.44:0/3219589081 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0ba806f090 con 0x7f0ba806c5c0 2024-09-13T18:36:41.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.851+0000 7f0bb17fa700 1 -- 172.21.15.44:0/3219589081 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bb40882a0 con 0x7f0bbc0b4550 2024-09-13T18:36:41.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.855+0000 7f0bc084c700 1 --2- 172.21.15.44:0/3219589081 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0ba8066760 0x7f0ba8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.855+0000 7f0bb3fff700 1 --2- 172.21.15.44:0/3219589081 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f0ba806c5c0 0x7f0ba806e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.855+0000 7f0bc084c700 1 --2- 172.21.15.44:0/3219589081 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0ba8066760 0x7f0ba8068c20 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8009ae0 tx=0x7f0bb8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:41.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.855+0000 7f0bb3fff700 1 --2- 172.21.15.44:0/3219589081 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f0ba806c5c0 0x7f0ba806e9e0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:41.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.855+0000 7f0bb17fa700 1 -- 172.21.15.44:0/3219589081 <== osd.6 v2:172.21.15.99:6808/2907584318 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0ba806f090 con 0x7f0ba806c5c0 2024-09-13T18:36:41.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.875+0000 7f0bc184e700 1 -- 172.21.15.44:0/3219589081 --> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0bbc0ad1c0 con 0x7f0ba806c5c0 2024-09-13T18:36:41.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.879+0000 7f0bb17fa700 1 -- 172.21.15.44:0/3219589081 <== osd.6 v2:172.21.15.99:6808/2907584318 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0bac011630 con 0x7f0ba806c5c0 2024-09-13T18:36:41.885 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:36:41.885 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:36:41.885 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:36:41.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.879+0000 7f0bc184e700 1 -- 172.21.15.44:0/3219589081 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f0ba806c5c0 msgr2=0x7f0ba806e9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.879+0000 7f0bc184e700 1 --2- 172.21.15.44:0/3219589081 >> [v2:172.21.15.99:6808/2907584318,v1:172.21.15.99:6809/2907584318] conn(0x7f0ba806c5c0 0x7f0ba806e9e0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.879+0000 7f0bc184e700 1 -- 172.21.15.44:0/3219589081 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0ba8066760 msgr2=0x7f0ba8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.879+0000 7f0bc184e700 1 --2- 172.21.15.44:0/3219589081 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0ba8066760 0x7f0ba8068c20 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8009ae0 tx=0x7f0bb8008040 comp rx=0 tx=0).stop 2024-09-13T18:36:41.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.879+0000 7f0bc184e700 1 -- 172.21.15.44:0/3219589081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bbc0b4550 msgr2=0x7f0bbc0b19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.879+0000 7f0bc184e700 1 --2- 172.21.15.44:0/3219589081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bbc0b4550 0x7f0bbc0b19c0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f0bb400cbc0 tx=0x7f0bb400ced0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.879+0000 7f0bc104d700 1 -- 172.21.15.44:0/3219589081 reap_dead start 2024-09-13T18:36:41.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.879+0000 7f0bc184e700 1 -- 172.21.15.44:0/3219589081 shutdown_connections 2024-09-13T18:36:41.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.879+0000 7f0bc184e700 1 -- 172.21.15.44:0/3219589081 >> 172.21.15.44:0/3219589081 conn(0x7f0bbc0cfad0 msgr2=0x7f0bbc15e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:41.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.879+0000 7f0bc184e700 1 -- 172.21.15.44:0/3219589081 shutdown_connections 2024-09-13T18:36:41.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:41.879+0000 7f0bc184e700 1 -- 172.21.15.44:0/3219589081 wait complete. 2024-09-13T18:36:41.898 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-13T18:36:42.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.003+0000 7f9faec12700 1 Processor -- start 2024-09-13T18:36:42.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.003+0000 7f9faec12700 1 -- start start 2024-09-13T18:36:42.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.003+0000 7f9faec12700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9fa81466d0 0x7f9fa80ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.003+0000 7f9faec12700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9fa80cc4e0 0x7f9fa80acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.003+0000 7f9faec12700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa815d1b0 con 0x7f9fa80b3e30 2024-09-13T18:36:42.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.003+0000 7f9faec12700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa80ac8c0 con 0x7f9fa81466d0 2024-09-13T18:36:42.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.003+0000 7f9faec12700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa80b43f0 con 0x7f9fa80cc4e0 2024-09-13T18:36:42.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.003+0000 7f9fac9ae700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9fa81466d0 0x7f9fa80ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.003+0000 7f9fac9ae700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9fa81466d0 0x7f9fa80ce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51370/0 (socket says 172.21.15.44:51370) 2024-09-13T18:36:42.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.003+0000 7f9fac9ae700 1 -- 172.21.15.44:0/2784887081 learned_addr learned my addr 172.21.15.44:0/2784887081 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:42.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.003+0000 7f9fad1af700 1 --2- 172.21.15.44:0/2784887081 >> v2:172.21.15.99:3300/0 conn(0x7f9fa80cc4e0 0x7f9fa80acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.003+0000 7f9fac9ae700 1 -- 172.21.15.44:0/2784887081 >> v2:172.21.15.99:3300/0 conn(0x7f9fa80cc4e0 msgr2=0x7f9fa80acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:42.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.003+0000 7f9fac9ae700 1 --2- 172.21.15.44:0/2784887081 >> v2:172.21.15.99:3300/0 conn(0x7f9fa80cc4e0 0x7f9fa80acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.003+0000 7f9fa77fe700 1 -- 172.21.15.44:0/2784887081 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632983562 0 0) 0x7f9fa815d1b0 con 0x7f9fa80b3e30 2024-09-13T18:36:42.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.003+0000 7f9fac9ae700 1 -- 172.21.15.44:0/2784887081 >> v1:172.21.15.99:6789/0 conn(0x7f9fa80b3e30 legacy=0x7f9fa80cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.007+0000 7f9fac9ae700 1 -- 172.21.15.44:0/2784887081 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa80b46d0 con 0x7f9fa81466d0 2024-09-13T18:36:42.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.007+0000 7f9fac9ae700 1 --2- 172.21.15.44:0/2784887081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fa81466d0 0x7f9fa80ce200 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80b1620 tx=0x7f9f9c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea68cd43635e46e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:42.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.007+0000 7f9fa77fe700 1 -- 172.21.15.44:0/2784887081 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c011830 con 0x7f9fa81466d0 2024-09-13T18:36:42.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.007+0000 7f9fa77fe700 1 -- 172.21.15.44:0/2784887081 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9c011990 con 0x7f9fa81466d0 2024-09-13T18:36:42.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.007+0000 7f9fa77fe700 1 -- 172.21.15.44:0/2784887081 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c011d20 con 0x7f9fa81466d0 2024-09-13T18:36:42.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.007+0000 7f9faec12700 1 -- 172.21.15.44:0/2784887081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fa81466d0 msgr2=0x7f9fa80ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.007+0000 7f9faec12700 1 --2- 172.21.15.44:0/2784887081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fa81466d0 0x7f9fa80ce200 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80b1620 tx=0x7f9f9c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.007+0000 7f9faec12700 1 -- 172.21.15.44:0/2784887081 shutdown_connections 2024-09-13T18:36:42.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.007+0000 7f9faec12700 1 --2- 172.21.15.44:0/2784887081 >> v2:172.21.15.99:3300/0 conn(0x7f9fa80cc4e0 0x7f9fa80acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.007+0000 7f9faec12700 1 --2- 172.21.15.44:0/2784887081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fa81466d0 0x7f9fa80ce200 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.007+0000 7f9faec12700 1 -- 172.21.15.44:0/2784887081 >> 172.21.15.44:0/2784887081 conn(0x7f9fa80af620 msgr2=0x7f9fa80afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:42.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.007+0000 7f9faec12700 1 -- 172.21.15.44:0/2784887081 shutdown_connections 2024-09-13T18:36:42.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.007+0000 7f9faec12700 1 -- 172.21.15.44:0/2784887081 wait complete. 2024-09-13T18:36:42.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9faec12700 1 Processor -- start 2024-09-13T18:36:42.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9faec12700 1 -- start start 2024-09-13T18:36:42.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9faec12700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fa80b3e30 0x7f9fa806cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9faec12700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa80cc4e0 0x7f9fa8144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9faec12700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9fa81466d0 0x7f9fa8142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9faec12700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa806b1b0 con 0x7f9fa80b3e30 2024-09-13T18:36:42.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9faec12700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa806b490 con 0x7f9fa80cc4e0 2024-09-13T18:36:42.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9faec12700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa806b770 con 0x7f9fa81466d0 2024-09-13T18:36:42.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9fac9ae700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fa80b3e30 0x7f9fa806cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9fac9ae700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fa80b3e30 0x7f9fa806cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51378/0 (socket says 172.21.15.44:51378) 2024-09-13T18:36:42.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9fac9ae700 1 -- 172.21.15.44:0/1298325571 learned_addr learned my addr 172.21.15.44:0/1298325571 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:42.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9fa7fff700 1 --2- 172.21.15.44:0/1298325571 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa80cc4e0 0x7f9fa8144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9fad1af700 1 --2- 172.21.15.44:0/1298325571 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9fa81466d0 0x7f9fa8142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9fac9ae700 1 -- 172.21.15.44:0/1298325571 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9fa81466d0 msgr2=0x7f9fa8142b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9fac9ae700 1 --2- 172.21.15.44:0/1298325571 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9fa81466d0 0x7f9fa8142b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9fac9ae700 1 -- 172.21.15.44:0/1298325571 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa80cc4e0 msgr2=0x7f9fa8144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9fac9ae700 1 --2- 172.21.15.44:0/1298325571 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa80cc4e0 0x7f9fa8144930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9fac9ae700 1 -- 172.21.15.44:0/1298325571 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c009570 con 0x7f9fa80b3e30 2024-09-13T18:36:42.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9fac9ae700 1 --2- 172.21.15.44:0/1298325571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fa80b3e30 0x7f9fa806cd50 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c000c00 tx=0x7f9f9c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:42.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9fa57fa700 1 -- 172.21.15.44:0/1298325571 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c004510 con 0x7f9fa80b3e30 2024-09-13T18:36:42.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9fa57fa700 1 -- 172.21.15.44:0/1298325571 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9c01e070 con 0x7f9fa80b3e30 2024-09-13T18:36:42.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9faec12700 1 -- 172.21.15.44:0/1298325571 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa806ba50 con 0x7f9fa80b3e30 2024-09-13T18:36:42.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9fa57fa700 1 -- 172.21.15.44:0/1298325571 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c003900 con 0x7f9fa80b3e30 2024-09-13T18:36:42.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.011+0000 7f9faec12700 1 -- 172.21.15.44:0/1298325571 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa8144e70 con 0x7f9fa80b3e30 2024-09-13T18:36:42.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.015+0000 7f9faec12700 1 -- 172.21.15.44:0/1298325571 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa8145060 con 0x7f9fa80b3e30 2024-09-13T18:36:42.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.015+0000 7f9fa57fa700 1 -- 172.21.15.44:0/1298325571 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9f9c003a60 con 0x7f9fa80b3e30 2024-09-13T18:36:42.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.015+0000 7f9fa57fa700 1 --2- 172.21.15.44:0/1298325571 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9f94066760 0x7f9f94068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.015+0000 7f9fa57fa700 1 -- 172.21.15.44:0/1298325571 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9f9c020070 con 0x7f9fa80b3e30 2024-09-13T18:36:42.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.015+0000 7f9fa7fff700 1 --2- 172.21.15.44:0/1298325571 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9f94066760 0x7f9f94068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.015+0000 7f9fa7fff700 1 --2- 172.21.15.44:0/1298325571 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9f94066760 0x7f9f94068c20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9f98002230 tx=0x7f9f98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:42.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.023+0000 7f9fa57fa700 1 -- 172.21.15.44:0/1298325571 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9f9c052650 con 0x7f9fa80b3e30 2024-09-13T18:36:42.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.199+0000 7f9faec12700 1 -- 172.21.15.44:0/1298325571 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f9fa80ce740 con 0x7f9f94066760 2024-09-13T18:36:42.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.199+0000 7f9fa57fa700 1 -- 172.21.15.44:0/1298325571 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9f9800fd40 con 0x7f9f94066760 2024-09-13T18:36:42.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.203+0000 7f9faec12700 1 -- 172.21.15.44:0/1298325571 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9f94066760 msgr2=0x7f9f94068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.203+0000 7f9faec12700 1 --2- 172.21.15.44:0/1298325571 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9f94066760 0x7f9f94068c20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9f98002230 tx=0x7f9f98009040 comp rx=0 tx=0).stop 2024-09-13T18:36:42.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.203+0000 7f9faec12700 1 -- 172.21.15.44:0/1298325571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fa80b3e30 msgr2=0x7f9fa806cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.203+0000 7f9faec12700 1 --2- 172.21.15.44:0/1298325571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fa80b3e30 0x7f9fa806cd50 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c000c00 tx=0x7f9f9c004770 comp rx=0 tx=0).stop 2024-09-13T18:36:42.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.203+0000 7f9faec12700 1 -- 172.21.15.44:0/1298325571 shutdown_connections 2024-09-13T18:36:42.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.203+0000 7f9faec12700 1 --2- 172.21.15.44:0/1298325571 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f9f94066760 0x7f9f94068c20 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.203+0000 7f9faec12700 1 --2- 172.21.15.44:0/1298325571 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9fa81466d0 0x7f9fa8142b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.203+0000 7f9faec12700 1 --2- 172.21.15.44:0/1298325571 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa80cc4e0 0x7f9fa8144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.203+0000 7f9faec12700 1 --2- 172.21.15.44:0/1298325571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fa80b3e30 0x7f9fa806cd50 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.203+0000 7f9faec12700 1 -- 172.21.15.44:0/1298325571 >> 172.21.15.44:0/1298325571 conn(0x7f9fa80af620 msgr2=0x7f9fa8071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:42.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.203+0000 7f9faec12700 1 -- 172.21.15.44:0/1298325571 shutdown_connections 2024-09-13T18:36:42.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.203+0000 7f9faec12700 1 -- 172.21.15.44:0/1298325571 wait complete. 2024-09-13T18:36:42.211 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 6 to deep-scrub 2024-09-13T18:36:42.223 INFO:tasks.ceph:Scrubbing osd.7 2024-09-13T18:36:42.223 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:36:42.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.339+0000 7f0ad0c45700 1 Processor -- start 2024-09-13T18:36:42.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.339+0000 7f0ad0c45700 1 -- start start 2024-09-13T18:36:42.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.343+0000 7f0ad0c45700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0acc0cd330 0x7f0acc0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.343+0000 7f0ad0c45700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0acc0b5050 con 0x7f0acc15dad0 2024-09-13T18:36:42.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.343+0000 7f0ad0c45700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0acc0b5330 con 0x7f0acc1465a0 2024-09-13T18:36:42.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.343+0000 7f0ad0c45700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc15d6b0 con 0x7f0acc0cd330 2024-09-13T18:36:42.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.343+0000 7f0acbfff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0acc15dad0 0x7f0acc15df30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39624/0 (socket says 172.21.15.44:39624) 2024-09-13T18:36:42.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.343+0000 7f0acb7fe700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0acc1465a0 0x7f0acc0b4500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:47958/0 (socket says 172.21.15.44:47958) 2024-09-13T18:36:42.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.343+0000 7f0acbfff700 1 -- 172.21.15.44:0/3465388538 learned_addr learned my addr 172.21.15.44:0/3465388538 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:36:42.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.343+0000 7f0ac3fff700 1 --2- 172.21.15.44:0/3465388538 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0acc0cd330 0x7f0acc0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.343+0000 7f0acaffd700 1 -- 172.21.15.44:0/3465388538 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977756944 0 0) 0x7f0acc0b5050 con 0x7f0acc15dad0 2024-09-13T18:36:42.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.343+0000 7f0acaffd700 1 -- 172.21.15.44:0/3465388538 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ab80035d0 con 0x7f0acc15dad0 2024-09-13T18:36:42.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.343+0000 7f0acaffd700 1 -- 172.21.15.44:0/3465388538 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1725760831 0 0) 0x7f0acc0b5330 con 0x7f0acc1465a0 2024-09-13T18:36:42.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.343+0000 7f0acaffd700 1 -- 172.21.15.44:0/3465388538 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0acc0b5050 con 0x7f0acc1465a0 2024-09-13T18:36:42.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.343+0000 7f0ac3fff700 1 -- 172.21.15.44:0/3465388538 >> v1:172.21.15.99:6789/0 conn(0x7f0acc1465a0 legacy=0x7f0acc0b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.343+0000 7f0ac3fff700 1 -- 172.21.15.44:0/3465388538 >> v1:172.21.15.44:6789/0 conn(0x7f0acc15dad0 legacy=0x7f0acc15df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.343+0000 7f0ac3fff700 1 -- 172.21.15.44:0/3465388538 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc0b5610 con 0x7f0acc0cd330 2024-09-13T18:36:42.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.343+0000 7f0ac3fff700 1 --2- 172.21.15.44:0/3465388538 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0acc0cd330 0x7f0acc0cd770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4009880 tx=0x7f0ab4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6a88445c8697ae9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:42.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.343+0000 7f0acaffd700 1 -- 172.21.15.44:0/3465388538 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4011830 con 0x7f0acc0cd330 2024-09-13T18:36:42.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.343+0000 7f0acaffd700 1 -- 172.21.15.44:0/3465388538 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab4011990 con 0x7f0acc0cd330 2024-09-13T18:36:42.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.343+0000 7f0acaffd700 1 -- 172.21.15.44:0/3465388538 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4011d00 con 0x7f0acc0cd330 2024-09-13T18:36:42.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.347+0000 7f0ad0c45700 1 -- 172.21.15.44:0/3465388538 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0acc0cd330 msgr2=0x7f0acc0cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.347+0000 7f0ad0c45700 1 --2- 172.21.15.44:0/3465388538 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0acc0cd330 0x7f0acc0cd770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4009880 tx=0x7f0ab4009b90 comp rx=0 tx=0).stop 2024-09-13T18:36:42.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.347+0000 7f0ad0c45700 1 -- 172.21.15.44:0/3465388538 shutdown_connections 2024-09-13T18:36:42.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.347+0000 7f0ad0c45700 1 --2- 172.21.15.44:0/3465388538 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0acc0cd330 0x7f0acc0cd770 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.347+0000 7f0ad0c45700 1 -- 172.21.15.44:0/3465388538 >> 172.21.15.44:0/3465388538 conn(0x7f0acc06a310 msgr2=0x7f0acc06a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:42.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.347+0000 7f0ad0c45700 1 -- 172.21.15.44:0/3465388538 shutdown_connections 2024-09-13T18:36:42.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.347+0000 7f0ad0c45700 1 -- 172.21.15.44:0/3465388538 wait complete. 2024-09-13T18:36:42.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.347+0000 7f0ad0c45700 1 Processor -- start 2024-09-13T18:36:42.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0ad0c45700 1 -- start start 2024-09-13T18:36:42.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0ad0c45700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0acc0cd330 0x7f0acc13f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0ad0c45700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0acc1465a0 0x7f0acc13c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0ad0c45700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0acc15dad0 0x7f0acc13e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0ad0c45700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc15cc90 con 0x7f0acc1465a0 2024-09-13T18:36:42.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0ad0c45700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc13c600 con 0x7f0acc15dad0 2024-09-13T18:36:42.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0ad0c45700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc0b3590 con 0x7f0acc0cd330 2024-09-13T18:36:42.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0ac3fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0acc1465a0 0x7f0acc13c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0ac3fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0acc1465a0 0x7f0acc13c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51394/0 (socket says 172.21.15.44:51394) 2024-09-13T18:36:42.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0ac3fff700 1 -- 172.21.15.44:0/2058464957 learned_addr learned my addr 172.21.15.44:0/2058464957 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:42.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0acb7fe700 1 --2- 172.21.15.44:0/2058464957 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0acc0cd330 0x7f0acc13f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0acbfff700 1 --2- 172.21.15.44:0/2058464957 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0acc15dad0 0x7f0acc13e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0ac3fff700 1 -- 172.21.15.44:0/2058464957 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0acc0cd330 msgr2=0x7f0acc13f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0ac3fff700 1 --2- 172.21.15.44:0/2058464957 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0acc0cd330 0x7f0acc13f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0ac3fff700 1 -- 172.21.15.44:0/2058464957 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0acc15dad0 msgr2=0x7f0acc13e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0ac3fff700 1 --2- 172.21.15.44:0/2058464957 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0acc15dad0 0x7f0acc13e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0ac3fff700 1 -- 172.21.15.44:0/2058464957 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab40094b0 con 0x7f0acc1465a0 2024-09-13T18:36:42.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0acbfff700 1 --2- 172.21.15.44:0/2058464957 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0acc15dad0 0x7f0acc13e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:42.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0ac3fff700 1 --2- 172.21.15.44:0/2058464957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0acc1465a0 0x7f0acc13c0c0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4013040 tx=0x7f0ab4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:42.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0ac8ff9700 1 -- 172.21.15.44:0/2058464957 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4004590 con 0x7f0acc1465a0 2024-09-13T18:36:42.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0ad0c45700 1 -- 172.21.15.44:0/2058464957 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0acc141690 con 0x7f0acc1465a0 2024-09-13T18:36:42.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0ac8ff9700 1 -- 172.21.15.44:0/2058464957 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab40036c0 con 0x7f0acc1465a0 2024-09-13T18:36:42.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0ac8ff9700 1 -- 172.21.15.44:0/2058464957 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4003a70 con 0x7f0acc1465a0 2024-09-13T18:36:42.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.351+0000 7f0ad0c45700 1 -- 172.21.15.44:0/2058464957 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0acc13d940 con 0x7f0acc1465a0 2024-09-13T18:36:42.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.355+0000 7f0ad0c45700 1 -- 172.21.15.44:0/2058464957 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0acc0cdcb0 con 0x7f0acc1465a0 2024-09-13T18:36:42.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.355+0000 7f0ac8ff9700 1 -- 172.21.15.44:0/2058464957 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0ab4003bd0 con 0x7f0acc1465a0 2024-09-13T18:36:42.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.355+0000 7f0ac8ff9700 1 --2- 172.21.15.44:0/2058464957 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0aac066730 0x7f0aac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.355+0000 7f0ac8ff9700 1 -- 172.21.15.44:0/2058464957 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0ab4085340 con 0x7f0acc1465a0 2024-09-13T18:36:42.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.355+0000 7f0ac8ff9700 1 --2- 172.21.15.44:0/2058464957 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f0aac06c590 0x7f0aac06e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.355+0000 7f0ac8ff9700 1 -- 172.21.15.44:0/2058464957 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0aac06f060 con 0x7f0aac06c590 2024-09-13T18:36:42.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.355+0000 7f0ac8ff9700 1 -- 172.21.15.44:0/2058464957 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ab4087a00 con 0x7f0acc1465a0 2024-09-13T18:36:42.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.355+0000 7f0acb7fe700 1 --2- 172.21.15.44:0/2058464957 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0aac066730 0x7f0aac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.355+0000 7f0acbfff700 1 --2- 172.21.15.44:0/2058464957 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f0aac06c590 0x7f0aac06e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.355+0000 7f0acbfff700 1 --2- 172.21.15.44:0/2058464957 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f0aac06c590 0x7f0aac06e9b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:42.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.355+0000 7f0acb7fe700 1 --2- 172.21.15.44:0/2058464957 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0aac066730 0x7f0aac068bf0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f0abc007fd0 tx=0x7f0abc007da0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:42.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.359+0000 7f0ac8ff9700 1 -- 172.21.15.44:0/2058464957 <== osd.7 v2:172.21.15.99:6824/2245335901 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0aac06f060 con 0x7f0aac06c590 2024-09-13T18:36:42.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.379+0000 7f0ad0c45700 1 -- 172.21.15.44:0/2058464957 --> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0acc0cb460 con 0x7f0aac06c590 2024-09-13T18:36:42.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.379+0000 7f0ac8ff9700 1 -- 172.21.15.44:0/2058464957 <== osd.7 v2:172.21.15.99:6824/2245335901 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0ac40070e0 con 0x7f0aac06c590 2024-09-13T18:36:42.387 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-13T18:36:42.388 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:36:42.388 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-13T18:36:42.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.379+0000 7f0ad0c45700 1 -- 172.21.15.44:0/2058464957 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f0aac06c590 msgr2=0x7f0aac06e9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.379+0000 7f0ad0c45700 1 --2- 172.21.15.44:0/2058464957 >> [v2:172.21.15.99:6824/2245335901,v1:172.21.15.99:6825/2245335901] conn(0x7f0aac06c590 0x7f0aac06e9b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.379+0000 7f0ad0c45700 1 -- 172.21.15.44:0/2058464957 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0aac066730 msgr2=0x7f0aac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.379+0000 7f0ad0c45700 1 --2- 172.21.15.44:0/2058464957 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f0aac066730 0x7f0aac068bf0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f0abc007fd0 tx=0x7f0abc007da0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.379+0000 7f0ad0c45700 1 -- 172.21.15.44:0/2058464957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0acc1465a0 msgr2=0x7f0acc13c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.379+0000 7f0ad0c45700 1 --2- 172.21.15.44:0/2058464957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0acc1465a0 0x7f0acc13c0c0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4013040 tx=0x7f0ab4004770 comp rx=0 tx=0).stop 2024-09-13T18:36:42.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.379+0000 7f0acbfff700 1 -- 172.21.15.44:0/2058464957 reap_dead start 2024-09-13T18:36:42.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.379+0000 7f0ad0c45700 1 -- 172.21.15.44:0/2058464957 shutdown_connections 2024-09-13T18:36:42.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.379+0000 7f0ad0c45700 1 -- 172.21.15.44:0/2058464957 >> 172.21.15.44:0/2058464957 conn(0x7f0acc06a310 msgr2=0x7f0acc0ce9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:42.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.379+0000 7f0ad0c45700 1 -- 172.21.15.44:0/2058464957 shutdown_connections 2024-09-13T18:36:42.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.379+0000 7f0ad0c45700 1 -- 172.21.15.44:0/2058464957 wait complete. 2024-09-13T18:36:42.402 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-13T18:36:42.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.515+0000 7f22808db700 1 Processor -- start 2024-09-13T18:36:42.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.515+0000 7f22808db700 1 -- start start 2024-09-13T18:36:42.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.515+0000 7f22808db700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f227c0ce300 0x7f227c0ad270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.515+0000 7f22808db700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f227c0ad7b0 0x7f227c070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.515+0000 7f22808db700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f227c0ae000 con 0x7f227c146160 2024-09-13T18:36:42.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.515+0000 7f22808db700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227c0cc820 con 0x7f227c0ad7b0 2024-09-13T18:36:42.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.515+0000 7f22808db700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227c070070 con 0x7f227c0ce300 2024-09-13T18:36:42.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.515+0000 7f227bfff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f227c0ad7b0 0x7f227c070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.515+0000 7f227bfff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f227c0ad7b0 0x7f227c070b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51408/0 (socket says 172.21.15.44:51408) 2024-09-13T18:36:42.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.515+0000 7f227affd700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f227c0ce300 0x7f227c0ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.515+0000 7f227bfff700 1 -- 172.21.15.44:0/4184788607 learned_addr learned my addr 172.21.15.44:0/4184788607 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:42.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.515+0000 7f227bfff700 1 -- 172.21.15.44:0/4184788607 >> v2:172.21.15.99:3300/0 conn(0x7f227c0ce300 msgr2=0x7f227c0ad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:42.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.515+0000 7f227bfff700 1 --2- 172.21.15.44:0/4184788607 >> v2:172.21.15.99:3300/0 conn(0x7f227c0ce300 0x7f227c0ad270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.515+0000 7f227bfff700 1 -- 172.21.15.44:0/4184788607 >> v1:172.21.15.99:6789/0 conn(0x7f227c146160 legacy=0x7f227c0cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.515+0000 7f227bfff700 1 -- 172.21.15.44:0/4184788607 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c070350 con 0x7f227c0ad7b0 2024-09-13T18:36:42.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.515+0000 7f227bfff700 1 --2- 172.21.15.44:0/4184788607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c0ad7b0 0x7f227c070b50 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f227c0cd730 tx=0x7f226c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5952041ccb671a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:42.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.515+0000 7f227a7fc700 1 -- 172.21.15.44:0/4184788607 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c011830 con 0x7f227c0ad7b0 2024-09-13T18:36:42.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.515+0000 7f227a7fc700 1 -- 172.21.15.44:0/4184788607 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226c011990 con 0x7f227c0ad7b0 2024-09-13T18:36:42.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.515+0000 7f227a7fc700 1 -- 172.21.15.44:0/4184788607 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c011d20 con 0x7f227c0ad7b0 2024-09-13T18:36:42.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f22808db700 1 -- 172.21.15.44:0/4184788607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c0ad7b0 msgr2=0x7f227c070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f22808db700 1 --2- 172.21.15.44:0/4184788607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c0ad7b0 0x7f227c070b50 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f227c0cd730 tx=0x7f226c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f22808db700 1 -- 172.21.15.44:0/4184788607 shutdown_connections 2024-09-13T18:36:42.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f22808db700 1 --2- 172.21.15.44:0/4184788607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c0ad7b0 0x7f227c070b50 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f22808db700 1 --2- 172.21.15.44:0/4184788607 >> v2:172.21.15.99:3300/0 conn(0x7f227c0ce300 0x7f227c0ad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f22808db700 1 -- 172.21.15.44:0/4184788607 >> 172.21.15.44:0/4184788607 conn(0x7f227c0b0e10 msgr2=0x7f227c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:42.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f22808db700 1 -- 172.21.15.44:0/4184788607 shutdown_connections 2024-09-13T18:36:42.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f22808db700 1 -- 172.21.15.44:0/4184788607 wait complete. 2024-09-13T18:36:42.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f22808db700 1 Processor -- start 2024-09-13T18:36:42.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f22808db700 1 -- start start 2024-09-13T18:36:42.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f22808db700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c0ad7b0 0x7f227c13d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f22808db700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f227c0ce300 0x7f227c15c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f22808db700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f227c146160 0x7f227c13b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f22808db700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c13cfa0 con 0x7f227c0ad7b0 2024-09-13T18:36:42.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f22808db700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c13c390 con 0x7f227c146160 2024-09-13T18:36:42.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f22808db700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227c13c670 con 0x7f227c0ce300 2024-09-13T18:36:42.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f227b7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c0ad7b0 0x7f227c13d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f227b7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c0ad7b0 0x7f227c13d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51410/0 (socket says 172.21.15.44:51410) 2024-09-13T18:36:42.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f227b7fe700 1 -- 172.21.15.44:0/1429143295 learned_addr learned my addr 172.21.15.44:0/1429143295 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:42.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f227bfff700 1 --2- 172.21.15.44:0/1429143295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f227c146160 0x7f227c13b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f227affd700 1 --2- 172.21.15.44:0/1429143295 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f227c0ce300 0x7f227c15c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f227b7fe700 1 -- 172.21.15.44:0/1429143295 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f227c0ce300 msgr2=0x7f227c15c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f227b7fe700 1 --2- 172.21.15.44:0/1429143295 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f227c0ce300 0x7f227c15c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f227b7fe700 1 -- 172.21.15.44:0/1429143295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f227c146160 msgr2=0x7f227c13b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f227b7fe700 1 --2- 172.21.15.44:0/1429143295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f227c146160 0x7f227c13b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f227b7fe700 1 -- 172.21.15.44:0/1429143295 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c009570 con 0x7f227c0ad7b0 2024-09-13T18:36:42.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.519+0000 7f227b7fe700 1 --2- 172.21.15.44:0/1429143295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c0ad7b0 0x7f227c13d430 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f227400cbd0 tx=0x7f227400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:42.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.523+0000 7f2273fff700 1 -- 172.21.15.44:0/1429143295 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274003c20 con 0x7f227c0ad7b0 2024-09-13T18:36:42.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.523+0000 7f2273fff700 1 -- 172.21.15.44:0/1429143295 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2274003d80 con 0x7f227c0ad7b0 2024-09-13T18:36:42.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.523+0000 7f22808db700 1 -- 172.21.15.44:0/1429143295 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227c13c950 con 0x7f227c0ad7b0 2024-09-13T18:36:42.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.523+0000 7f2273fff700 1 -- 172.21.15.44:0/1429143295 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227400abf0 con 0x7f227c0ad7b0 2024-09-13T18:36:42.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.523+0000 7f22808db700 1 -- 172.21.15.44:0/1429143295 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227c15c950 con 0x7f227c0ad7b0 2024-09-13T18:36:42.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.523+0000 7f22808db700 1 -- 172.21.15.44:0/1429143295 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227c0b2fa0 con 0x7f227c0ad7b0 2024-09-13T18:36:42.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.523+0000 7f2273fff700 1 -- 172.21.15.44:0/1429143295 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f227400ad50 con 0x7f227c0ad7b0 2024-09-13T18:36:42.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.523+0000 7f2273fff700 1 --2- 172.21.15.44:0/1429143295 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f225c066730 0x7f225c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.523+0000 7f2273fff700 1 -- 172.21.15.44:0/1429143295 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2274083fd0 con 0x7f227c0ad7b0 2024-09-13T18:36:42.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.523+0000 7f227affd700 1 --2- 172.21.15.44:0/1429143295 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f225c066730 0x7f225c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.527+0000 7f227affd700 1 --2- 172.21.15.44:0/1429143295 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f225c066730 0x7f225c068bf0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f227c1438f0 tx=0x7f2264008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:42.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.531+0000 7f2273fff700 1 -- 172.21.15.44:0/1429143295 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f22740515c0 con 0x7f227c0ad7b0 2024-09-13T18:36:42.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.699+0000 7f22808db700 1 -- 172.21.15.44:0/1429143295 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f227c13c7e0 con 0x7f225c066730 2024-09-13T18:36:42.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.699+0000 7f2273fff700 1 -- 172.21.15.44:0/1429143295 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f227c13c7e0 con 0x7f225c066730 2024-09-13T18:36:42.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.703+0000 7f22808db700 1 -- 172.21.15.44:0/1429143295 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f225c066730 msgr2=0x7f225c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.703+0000 7f22808db700 1 --2- 172.21.15.44:0/1429143295 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f225c066730 0x7f225c068bf0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f227c1438f0 tx=0x7f2264008040 comp rx=0 tx=0).stop 2024-09-13T18:36:42.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.703+0000 7f22808db700 1 -- 172.21.15.44:0/1429143295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c0ad7b0 msgr2=0x7f227c13d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.703+0000 7f22808db700 1 --2- 172.21.15.44:0/1429143295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c0ad7b0 0x7f227c13d430 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f227400cbd0 tx=0x7f227400cf90 comp rx=0 tx=0).stop 2024-09-13T18:36:42.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.703+0000 7f22808db700 1 -- 172.21.15.44:0/1429143295 shutdown_connections 2024-09-13T18:36:42.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.703+0000 7f22808db700 1 --2- 172.21.15.44:0/1429143295 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f225c066730 0x7f225c068bf0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.703+0000 7f22808db700 1 --2- 172.21.15.44:0/1429143295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f227c146160 0x7f227c13b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.703+0000 7f22808db700 1 --2- 172.21.15.44:0/1429143295 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f227c0ce300 0x7f227c15c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.703+0000 7f22808db700 1 --2- 172.21.15.44:0/1429143295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c0ad7b0 0x7f227c13d430 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.703+0000 7f22808db700 1 -- 172.21.15.44:0/1429143295 >> 172.21.15.44:0/1429143295 conn(0x7f227c0b0e10 msgr2=0x7f227c06a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:42.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.703+0000 7f22808db700 1 -- 172.21.15.44:0/1429143295 shutdown_connections 2024-09-13T18:36:42.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.703+0000 7f22808db700 1 -- 172.21.15.44:0/1429143295 wait complete. 2024-09-13T18:36:42.712 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 7 to deep-scrub 2024-09-13T18:36:42.723 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:36:42.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.827+0000 7f5d53fff700 1 Processor -- start 2024-09-13T18:36:42.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.827+0000 7f5d53fff700 1 -- start start 2024-09-13T18:36:42.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d53fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5d54159060 0x7f5d5415d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d53fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d540b38d0 0x7f5d5415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d53fff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5415a630 con 0x7f5d5406b5b0 2024-09-13T18:36:42.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d53fff700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d5415a450 con 0x7f5d54159060 2024-09-13T18:36:42.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d53fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5406bd30 con 0x7f5d540b38d0 2024-09-13T18:36:42.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d52ffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5d54159060 0x7f5d5415d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d52ffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5d54159060 0x7f5d5415d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51416/0 (socket says 172.21.15.44:51416) 2024-09-13T18:36:42.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d52ffd700 1 -- 172.21.15.44:0/2886446472 learned_addr learned my addr 172.21.15.44:0/2886446472 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:42.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d537fe700 1 --2- 172.21.15.44:0/2886446472 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d540b38d0 0x7f5d5415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d52ffd700 1 -- 172.21.15.44:0/2886446472 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d540b38d0 msgr2=0x7f5d5415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:42.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d52ffd700 1 --2- 172.21.15.44:0/2886446472 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d540b38d0 0x7f5d5415b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d52ffd700 1 -- 172.21.15.44:0/2886446472 >> v1:172.21.15.99:6789/0 conn(0x7f5d5406b5b0 legacy=0x7f5d540b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d52ffd700 1 -- 172.21.15.44:0/2886446472 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5406c010 con 0x7f5d54159060 2024-09-13T18:36:42.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d52ffd700 1 --2- 172.21.15.44:0/2886446472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d54159060 0x7f5d5415d5b0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009910 tx=0x7f5d44009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29edba19c4f3862d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:42.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d527fc700 1 -- 172.21.15.44:0/2886446472 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4400b860 con 0x7f5d54159060 2024-09-13T18:36:42.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d527fc700 1 -- 172.21.15.44:0/2886446472 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4400b9c0 con 0x7f5d54159060 2024-09-13T18:36:42.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d527fc700 1 -- 172.21.15.44:0/2886446472 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4400bd50 con 0x7f5d54159060 2024-09-13T18:36:42.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d53fff700 1 -- 172.21.15.44:0/2886446472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d54159060 msgr2=0x7f5d5415d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d53fff700 1 --2- 172.21.15.44:0/2886446472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d54159060 0x7f5d5415d5b0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009910 tx=0x7f5d44009c20 comp rx=0 tx=0).stop 2024-09-13T18:36:42.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d53fff700 1 -- 172.21.15.44:0/2886446472 shutdown_connections 2024-09-13T18:36:42.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d53fff700 1 --2- 172.21.15.44:0/2886446472 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d540b38d0 0x7f5d5415b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d53fff700 1 --2- 172.21.15.44:0/2886446472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d54159060 0x7f5d5415d5b0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d53fff700 1 -- 172.21.15.44:0/2886446472 >> 172.21.15.44:0/2886446472 conn(0x7f5d5406d900 msgr2=0x7f5d5406dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:42.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d53fff700 1 -- 172.21.15.44:0/2886446472 shutdown_connections 2024-09-13T18:36:42.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.831+0000 7f5d53fff700 1 -- 172.21.15.44:0/2886446472 wait complete. 2024-09-13T18:36:42.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d53fff700 1 Processor -- start 2024-09-13T18:36:42.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d53fff700 1 -- start start 2024-09-13T18:36:42.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d53fff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d5406b5b0 0x7f5d54154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d53fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d540b38d0 0x7f5d54152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d53fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d54159060 0x7f5d540ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d53fff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d54152a80 con 0x7f5d54159060 2024-09-13T18:36:42.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d53fff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d540ce6f0 con 0x7f5d540b38d0 2024-09-13T18:36:42.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d53fff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d54155200 con 0x7f5d5406b5b0 2024-09-13T18:36:42.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d537fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d54159060 0x7f5d540ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d537fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d54159060 0x7f5d540ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51420/0 (socket says 172.21.15.44:51420) 2024-09-13T18:36:42.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d537fe700 1 -- 172.21.15.44:0/2544853386 learned_addr learned my addr 172.21.15.44:0/2544853386 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:36:42.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d52ffd700 1 --2- 172.21.15.44:0/2544853386 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d5406b5b0 0x7f5d54154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d4bfff700 1 --2- 172.21.15.44:0/2544853386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d540b38d0 0x7f5d54152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d537fe700 1 -- 172.21.15.44:0/2544853386 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d5406b5b0 msgr2=0x7f5d54154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d537fe700 1 --2- 172.21.15.44:0/2544853386 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d5406b5b0 0x7f5d54154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d537fe700 1 -- 172.21.15.44:0/2544853386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d540b38d0 msgr2=0x7f5d54152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d537fe700 1 --2- 172.21.15.44:0/2544853386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d540b38d0 0x7f5d54152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d537fe700 1 -- 172.21.15.44:0/2544853386 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d44009570 con 0x7f5d54159060 2024-09-13T18:36:42.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d537fe700 1 --2- 172.21.15.44:0/2544853386 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d54159060 0x7f5d540ce1b0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c007de0 tx=0x7f5d4c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:42.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d4b7fe700 1 -- 172.21.15.44:0/2544853386 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c00ed30 con 0x7f5d54159060 2024-09-13T18:36:42.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d53fff700 1 -- 172.21.15.44:0/2544853386 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d541554e0 con 0x7f5d54159060 2024-09-13T18:36:42.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d4b7fe700 1 -- 172.21.15.44:0/2544853386 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4c014420 con 0x7f5d54159060 2024-09-13T18:36:42.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d4b7fe700 1 -- 172.21.15.44:0/2544853386 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c0147d0 con 0x7f5d54159060 2024-09-13T18:36:42.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.835+0000 7f5d53fff700 1 -- 172.21.15.44:0/2544853386 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d54155aa0 con 0x7f5d54159060 2024-09-13T18:36:42.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.839+0000 7f5d53fff700 1 -- 172.21.15.44:0/2544853386 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d5406a6f0 con 0x7f5d54159060 2024-09-13T18:36:42.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.839+0000 7f5d4b7fe700 1 -- 172.21.15.44:0/2544853386 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5d4c014930 con 0x7f5d54159060 2024-09-13T18:36:42.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.839+0000 7f5d4b7fe700 1 --2- 172.21.15.44:0/2544853386 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5d34066730 0x7f5d34068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.839+0000 7f5d4b7fe700 1 -- 172.21.15.44:0/2544853386 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5d4c084550 con 0x7f5d54159060 2024-09-13T18:36:42.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.839+0000 7f5d52ffd700 1 --2- 172.21.15.44:0/2544853386 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5d34066730 0x7f5d34068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.839+0000 7f5d52ffd700 1 --2- 172.21.15.44:0/2544853386 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5d34066730 0x7f5d34068bf0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5d44019040 tx=0x7f5d44008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:42.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:42.847+0000 7f5d4b7fe700 1 -- 172.21.15.44:0/2544853386 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5d4c051bd0 con 0x7f5d54159060 2024-09-13T18:36:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:43.015+0000 7f5d53fff700 1 -- 172.21.15.44:0/2544853386 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5d5406ba20 con 0x7f5d34066730 2024-09-13T18:36:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:43.019+0000 7f5d4b7fe700 1 -- 172.21.15.44:0/2544853386 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49406 (secure 0 0 0) 0x7f5d4400bb30 con 0x7f5d34066730 2024-09-13T18:36:43.029 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:36:43.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:43.023+0000 7f5d53fff700 1 -- 172.21.15.44:0/2544853386 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5d34066730 msgr2=0x7f5d34068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:43.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:43.023+0000 7f5d53fff700 1 --2- 172.21.15.44:0/2544853386 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5d34066730 0x7f5d34068bf0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5d44019040 tx=0x7f5d44008030 comp rx=0 tx=0).stop 2024-09-13T18:36:43.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:43.023+0000 7f5d53fff700 1 -- 172.21.15.44:0/2544853386 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d54159060 msgr2=0x7f5d540ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:43.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:43.023+0000 7f5d53fff700 1 --2- 172.21.15.44:0/2544853386 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d54159060 0x7f5d540ce1b0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c007de0 tx=0x7f5d4c00e3c0 comp rx=0 tx=0).stop 2024-09-13T18:36:43.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:43.023+0000 7f5d53fff700 1 -- 172.21.15.44:0/2544853386 shutdown_connections 2024-09-13T18:36:43.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:43.023+0000 7f5d53fff700 1 --2- 172.21.15.44:0/2544853386 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f5d34066730 0x7f5d34068bf0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:43.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:43.023+0000 7f5d53fff700 1 --2- 172.21.15.44:0/2544853386 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d54159060 0x7f5d540ce1b0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:43.023+0000 7f5d53fff700 1 --2- 172.21.15.44:0/2544853386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d540b38d0 0x7f5d54152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:43.023+0000 7f5d53fff700 1 --2- 172.21.15.44:0/2544853386 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d5406b5b0 0x7f5d54154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:43.023+0000 7f5d53fff700 1 -- 172.21.15.44:0/2544853386 >> 172.21.15.44:0/2544853386 conn(0x7f5d5406d900 msgr2=0x7f5d541535a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:43.023+0000 7f5d53fff700 1 -- 172.21.15.44:0/2544853386 shutdown_connections 2024-09-13T18:36:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:36:43.023+0000 7f5d53fff700 1 -- 172.21.15.44:0/2544853386 wait complete. 2024-09-13T18:36:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:36:43.045 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":383,"stamp":"2024-09-13T18:36:42.524592+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":289428,"kb_used_data":10152,"kb_used_omap":12,"kb_used_meta":279155,"kb_avail":754685292,"statfs":{"total":773094113280,"available":772797739008,"internally_reserved":0,"allocated":10395648,"data_stored":5136784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":285855288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.773153"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":229,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:36:33.752778+0000","last_change":"2024-09-13T18:26:52.251182+0000","last_active":"2024-09-13T18:36:33.752778+0000","last_peered":"2024-09-13T18:36:33.752778+0000","last_clean":"2024-09-13T18:36:33.752778+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:36:33.752778+0000","last_undegraded":"2024-09-13T18:36:33.752778+0000","last_fullsized":"2024-09-13T18:36:33.752778+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:50.629703+0000","last_clean_scrub_stamp":"2024-09-13T18:26:50.629703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:48.410335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574969,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32824,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339016,"statfs":{"total":96636764160,"available":96603152384,"internally_reserved":0,"allocated":1744896,"data_stored":1084874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75800000000000001,"15min":0.75900000000000001},"min":{"1min":0.49399999999999999,"5min":0.38700000000000001,"15min":0.33600000000000002},"max":{"1min":1.0509999999999999,"5min":1.0760000000000001,"15min":1.163},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.78500000000000003},"min":{"1min":0.46500000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.149,"5min":1.288,"15min":1.288},"last":0.70599999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.84199999999999997,"15min":0.872},"min":{"1min":0.57899999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.115,"5min":1.288,"15min":1.7689999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89400000000000002,"15min":0.92900000000000005},"min":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.52600000000000002},"max":{"1min":1.175,"5min":1.3009999999999999,"15min":1.6140000000000001},"last":0.79200000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.84199999999999997},"min":{"1min":0.60199999999999998,"5min":0.45500000000000002,"15min":0.40500000000000003},"max":{"1min":0.98999999999999999,"5min":1.2270000000000001,"15min":1.3340000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.82599999999999996,"15min":0.879},"min":{"1min":0.64700000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0509999999999999,"5min":1.524,"15min":1.6659999999999999},"last":0.58499999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.88400000000000001,"15min":0.88600000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.52600000000000002},"max":{"1min":1.1160000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1990000000000001,"5min":1.486,"15min":1.486},"last":0.74199999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.84699999999999998,"15min":0.876},"min":{"1min":0.58999999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0649999999999999,"5min":1.4590000000000001,"15min":1.7290000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.02,"15min":1.0329999999999999},"min":{"1min":0.88700000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.226,"5min":1.49,"15min":1.7050000000000001},"last":1.069}]},{"osd":5,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.94599999999999995,"15min":0.95099999999999996},"min":{"1min":0.64000000000000001,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2490000000000001,"5min":1.4159999999999999,"15min":1.4259999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.044,"15min":1.0489999999999999},"min":{"1min":0.74199999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.325,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.1120000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0409999999999999,"15min":1.075},"min":{"1min":0.626,"5min":0.626,"15min":0.58099999999999996},"max":{"1min":1.3500000000000001,"5min":1.4730000000000001,"15min":2.077},"last":1.002},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.087,"15min":1.0740000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.69099999999999995},"max":{"1min":1.323,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.167}]}]},{"osd":6,"up_from":13,"seq":55834574971,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32244,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1150976,"data_stored":494506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.80700000000000005,"15min":0.82099999999999995},"min":{"1min":0.439,"5min":0.438,"15min":0.438},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.78900000000000003,"15min":0.81599999999999995},"min":{"1min":0.54700000000000004,"5min":0.45800000000000002,"15min":0.42099999999999999},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.68100000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.79000000000000004,"15min":0.81399999999999995},"min":{"1min":0.52000000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.84499999999999997,"15min":0.83399999999999996},"min":{"1min":0.504,"5min":0.48299999999999998,"15min":0.48099999999999998},"max":{"1min":1.2130000000000001,"5min":1.262,"15min":1.262},"last":0.95099999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.81399999999999995,"15min":0.81499999999999995},"min":{"1min":0.66200000000000003,"5min":0.47399999999999998,"15min":0.46899999999999997},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.85799999999999998,"15min":0.85999999999999999},"min":{"1min":0.54400000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.53700000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.92000000000000004,"15min":0.88800000000000001},"min":{"1min":0.71899999999999997,"5min":0.57599999999999996,"15min":0.52300000000000002},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.90100000000000002,"15min":0.93500000000000005},"min":{"1min":0.73099999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2330000000000001,"5min":1.2390000000000001,"15min":1.2909999999999999},"last":0.97299999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.871,"15min":0.88200000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.57699999999999996},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.97499999999999998,"15min":0.99199999999999999},"min":{"1min":0.63100000000000001,"5min":0.623,"15min":0.623},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.1120000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0429999999999999,"15min":1.0409999999999999},"min":{"1min":0.69099999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.97799999999999998,"15min":0.97999999999999998},"min":{"1min":0.70799999999999996,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.419,"5min":1.419,"15min":1.4990000000000001},"last":0.84699999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0129999999999999,"15min":1.0009999999999999},"min":{"1min":0.67800000000000005,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.121,"15min":1.1140000000000001},"min":{"1min":0.89900000000000002,"5min":0.76200000000000001,"15min":0.76000000000000001},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.0149999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1150976,"data_stored":494506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76800000000000002,"15min":0.81699999999999995},"min":{"1min":0.56200000000000006,"5min":0.46899999999999997,"15min":0.39800000000000002},"max":{"1min":1.0309999999999999,"5min":1.3280000000000001,"15min":1.3640000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.81000000000000005,"15min":0.84899999999999998},"min":{"1min":0.60799999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1559999999999999,"5min":1.194,"15min":1.482},"last":1.026}]},{"osd":1,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.79300000000000004,"15min":0.79500000000000004},"min":{"1min":0.57399999999999995,"5min":0.42499999999999999,"15min":0.40999999999999998},"max":{"1min":1.008,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.248},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85599999999999998,"15min":0.90900000000000003},"min":{"1min":0.55100000000000005,"5min":0.50900000000000001,"15min":0.45200000000000001},"max":{"1min":1.1200000000000001,"5min":1.218,"15min":1.4850000000000001},"last":1.2010000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.92500000000000004,"15min":0.94599999999999995},"min":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.51300000000000001},"max":{"1min":1.115,"5min":1.2430000000000001,"15min":1.4179999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93500000000000005,"15min":0.98199999999999998},"min":{"1min":0.59799999999999998,"5min":0.51800000000000002,"15min":0.46500000000000002},"max":{"1min":1.1519999999999999,"5min":1.2849999999999999,"15min":1.4690000000000001},"last":0.90700000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.878,"15min":0.92400000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.51700000000000002},"max":{"1min":1.117,"5min":1.2010000000000001,"15min":1.4510000000000001},"last":1.167},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89500000000000002,"15min":0.92600000000000005},"min":{"1min":0.65400000000000003,"5min":0.61199999999999999,"15min":0.55300000000000005},"max":{"1min":1.1679999999999999,"5min":1.335,"15min":1.4990000000000001},"last":0.95399999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.91300000000000003,"15min":0.95199999999999996},"min":{"1min":0.57599999999999996,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2549999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95799999999999996,"15min":1.0089999999999999},"min":{"1min":0.628,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.206,"5min":1.302,"15min":1.542},"last":1.228}]},{"osd":6,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.97799999999999998,"15min":1.0129999999999999},"min":{"1min":0.83599999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2989999999999999,"5min":1.4259999999999999,"15min":1.698},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1020000000000001,"15min":1.1419999999999999},"min":{"1min":0.90400000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.2170000000000001,"5min":1.52,"15min":1.581},"last":1.369}]},{"osd":7,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.0589999999999999,"15min":1.1419999999999999},"min":{"1min":0.68500000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.256,"5min":1.552,"15min":1.847},"last":1.331},{"interface":"front","average":{"1min":1.069,"5min":1.0640000000000001,"15min":1.117},"min":{"1min":0.72399999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2549999999999999,"5min":1.4259999999999999,"15min":1.8100000000000001},"last":1.0940000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46192,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325648,"statfs":{"total":96636764160,"available":96589463552,"internally_reserved":0,"allocated":1150976,"data_stored":494506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.82299999999999995,"15min":0.875},"min":{"1min":0.52000000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.159,"5min":1.1930000000000001,"15min":1.3720000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.89500000000000002,"15min":0.93999999999999995},"min":{"1min":0.57299999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.163,"5min":1.21,"15min":1.5229999999999999},"last":1.1080000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.54300000000000004,"5min":0.47099999999999997,"15min":0.435},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.88,"5min":0.84199999999999997,"15min":0.84599999999999997},"min":{"1min":0.58399999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1859999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.70699999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.80000000000000004,"15min":0.83899999999999997},"min":{"1min":0.67100000000000004,"5min":0.46300000000000002,"15min":0.44600000000000001},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.167},{"interface":"front","average":{"1min":0.871,"5min":0.86499999999999999,"15min":0.85499999999999998},"min":{"1min":0.58199999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.212,"5min":1.331,"15min":1.331},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.89300000000000002,"15min":0.94999999999999996},"min":{"1min":0.55800000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.639},"last":1.2709999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.91200000000000003,"15min":0.96499999999999997},"min":{"1min":0.70499999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.8300000000000001},"last":0.80900000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.91700000000000004,"15min":0.95999999999999996},"min":{"1min":0.67300000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.327,"5min":1.518,"15min":2.3889999999999998},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.125,"5min":1.052,"15min":1.093},"min":{"1min":0.91200000000000003,"5min":0.66100000000000003,"15min":0.626},"max":{"1min":1.605,"5min":1.605,"15min":2.0049999999999999},"last":1.3340000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94599999999999995,"15min":0.91500000000000004},"min":{"1min":0.69199999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2929999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.04},{"interface":"front","average":{"1min":1.121,"5min":1.0840000000000001,"15min":1.0960000000000001},"min":{"1min":0.873,"5min":0.70099999999999996,"15min":0.63500000000000001},"max":{"1min":1.409,"5min":1.4259999999999999,"15min":1.794},"last":1.0620000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0509999999999999,"15min":1.0680000000000001},"min":{"1min":0.66100000000000003,"5min":0.65200000000000002,"15min":0.60499999999999998},"max":{"1min":1.659,"5min":1.659,"15min":1.669},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0529999999999999,"15min":1.0349999999999999},"min":{"1min":0.877,"5min":0.69499999999999995,"15min":0.61799999999999999},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.143}]}]},{"osd":3,"up_from":13,"seq":55834574972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1150976,"data_stored":494506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64200000000000002,"15min":0.66100000000000003},"min":{"1min":0.38300000000000001,"5min":0.22,"15min":0.22},"max":{"1min":1.0489999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.622,"15min":0.65700000000000003},"min":{"1min":0.434,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":1.008,"5min":1.008,"15min":1.1970000000000001},"last":0.48899999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.67800000000000005,"15min":0.68999999999999995},"min":{"1min":0.44600000000000001,"5min":0.24099999999999999,"15min":0.23100000000000001},"max":{"1min":0.98299999999999998,"5min":1.379,"15min":1.379},"last":0.624},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.751,"15min":0.79300000000000004},"min":{"1min":0.46200000000000002,"5min":0.30199999999999999,"15min":0.23499999999999999},"max":{"1min":1.238,"5min":1.397,"15min":2.0030000000000001},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.40899999999999997,"5min":0.32500000000000001,"15min":0.29299999999999998},"max":{"1min":0.91000000000000003,"5min":1.3300000000000001,"15min":1.333},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.83999999999999997,"15min":0.86699999999999999},"min":{"1min":0.55600000000000005,"5min":0.33000000000000002,"15min":0.27300000000000002},"max":{"1min":1.296,"5min":1.423,"15min":1.423},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.88400000000000001,"15min":0.92900000000000005},"min":{"1min":0.58399999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1779999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.97099999999999997,"15min":1.0089999999999999},"min":{"1min":0.67400000000000004,"5min":0.56899999999999995,"15min":0.52300000000000002},"max":{"1min":1.3440000000000001,"5min":1.587,"15min":1.587},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.038,"15min":1.119},"min":{"1min":0.83299999999999996,"5min":0.55200000000000005,"15min":0.51400000000000001},"max":{"1min":1.3089999999999999,"5min":1.6200000000000001,"15min":2.2320000000000002},"last":0.751},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1,"15min":1.0680000000000001},"min":{"1min":0.65100000000000002,"5min":0.53900000000000003,"15min":0.53600000000000003},"max":{"1min":1.252,"5min":1.3280000000000001,"15min":1.718},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0589999999999999,"15min":1.097},"min":{"1min":0.69699999999999995,"5min":0.60199999999999998,"15min":0.496},"max":{"1min":1.4259999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.0900000000000001,"15min":1.1699999999999999},"min":{"1min":0.79100000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.385,"5min":1.51,"15min":2.1819999999999999},"last":0.82999999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0329999999999999,"15min":1.0740000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.624},"max":{"1min":1.391,"5min":1.391,"15min":1.4670000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.073,"5min":1.101,"15min":1.143},"min":{"1min":0.69999999999999996,"5min":0.57499999999999996,"15min":0.54300000000000004},"max":{"1min":1.367,"5min":1.548,"15min":1.5920000000000001},"last":0.78200000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40432,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331408,"statfs":{"total":96636764160,"available":96595361792,"internally_reserved":0,"allocated":1150976,"data_stored":494506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63600000000000001,"15min":0.65800000000000003},"min":{"1min":0.45100000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":1.0009999999999999,"5min":1.1020000000000001,"15min":1.1919999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.72199999999999998,"15min":0.76700000000000002},"min":{"1min":0.56000000000000005,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.4370000000000001},"last":0.56000000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65500000000000003,"15min":0.69099999999999995},"min":{"1min":0.48399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.94799999999999995,"5min":1.2050000000000001,"15min":1.2629999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.68999999999999995,"15min":0.72099999999999997},"min":{"1min":0.51900000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.181,"5min":1.383,"15min":1.383},"last":0.47999999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.68100000000000005,"15min":0.67500000000000004},"min":{"1min":0.46800000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.85199999999999998},"min":{"1min":0.48499999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1870000000000001,"5min":1.3460000000000001,"15min":1.548},"last":1.01}]},{"osd":4,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.94799999999999995,"15min":0.96899999999999997},"min":{"1min":0.69199999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1279999999999999,"5min":1.653,"15min":1.653},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.96599999999999997,"15min":1.0209999999999999},"min":{"1min":0.73299999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2829999999999999,"5min":1.51,"15min":2.3849999999999998},"last":0.98699999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.93200000000000005,"15min":0.92500000000000004},"min":{"1min":0.74399999999999999,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.327,"5min":1.4730000000000001,"15min":1.498},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.028,"15min":1.048},"min":{"1min":0.81799999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.254,"5min":1.7549999999999999,"15min":1.869},"last":0.96399999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.89300000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.3500000000000001,"5min":1.6120000000000001,"15min":2.762},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.087,"5min":1.0129999999999999,"15min":1.036},"min":{"1min":0.85999999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.407,"5min":1.5509999999999999,"15min":1.988},"last":0.95299999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.095,"15min":1.1359999999999999},"min":{"1min":0.85199999999999998,"5min":0.61099999999999999,"15min":0.59799999999999998},"max":{"1min":1.496,"5min":1.8240000000000001,"15min":2.6800000000000002},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.081,"15min":1.0740000000000001},"min":{"1min":0.81399999999999995,"5min":0.64100000000000001,"15min":0.52800000000000002},"max":{"1min":1.3129999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.92300000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32244,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1150976,"data_stored":494506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.34300000000000003,"15min":0.33200000000000002},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70499999999999996,"15min":0.72799999999999998},"min":{"1min":0.502,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.1279999999999999,"5min":1.341,"15min":1.3560000000000001},"last":0.74199999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.46600000000000003,"5min":0.311,"15min":0.311},"max":{"1min":1.0069999999999999,"5min":1.133,"15min":1.1879999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.73899999999999999,"15min":0.747},"min":{"1min":0.44600000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.089,"5min":1.617,"15min":1.617},"last":0.71299999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.56599999999999995,"5min":0.375,"15min":0.375},"max":{"1min":1.1040000000000001,"5min":1.415,"15min":1.415},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.751,"15min":0.77700000000000002},"min":{"1min":0.41999999999999998,"5min":0.35999999999999999,"15min":0.35699999999999998},"max":{"1min":1.0820000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.92400000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.95299999999999996,"15min":0.95399999999999996},"min":{"1min":0.70099999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2669999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.95999999999999996,"15min":0.97099999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2450000000000001,"5min":1.52,"15min":1.994},"last":0.94899999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.96799999999999997,"15min":0.97299999999999998},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.49299999999999999},"max":{"1min":1.3260000000000001,"5min":1.7,"15min":2.0960000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.048,"5min":1.054,"15min":1.0740000000000001},"min":{"1min":0.82299999999999995,"5min":0.626,"15min":0.626},"max":{"1min":1.407,"5min":1.8939999999999999,"15min":2.7280000000000002},"last":0.90300000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.024,"15min":1.0600000000000001},"min":{"1min":0.68899999999999995,"5min":0.56599999999999995,"15min":0.53100000000000003},"max":{"1min":1.3029999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.88},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.04,"15min":1.075},"min":{"1min":0.69199999999999995,"5min":0.64700000000000002,"15min":0.63100000000000001},"max":{"1min":1.3029999999999999,"5min":1.9710000000000001,"15min":2.0489999999999999},"last":1.0209999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.099,"15min":1.095},"min":{"1min":0.88500000000000001,"5min":0.72499999999999998,"15min":0.67400000000000004},"max":{"1min":1.3600000000000001,"5min":2.0070000000000001,"15min":2.5579999999999998},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.087,"5min":1.089,"15min":1.1080000000000001},"min":{"1min":0.77300000000000002,"5min":0.55200000000000005,"15min":0.51300000000000001},"max":{"1min":1.627,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.99099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574970,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41012,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330828,"statfs":{"total":96636764160,"available":96594767872,"internally_reserved":0,"allocated":1744896,"data_stored":1084874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.59999999999999998,"15min":0.60499999999999998},"min":{"1min":0.45900000000000002,"5min":0.192,"15min":0.192},"max":{"1min":0.97599999999999998,"5min":1.23,"15min":1.23},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66500000000000004,"15min":0.68899999999999995},"min":{"1min":0.53100000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.98399999999999999,"5min":1.1220000000000001,"15min":1.1759999999999999},"last":0.751}]},{"osd":2,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.67900000000000005,"15min":0.69699999999999995},"min":{"1min":0.53400000000000003,"5min":0.249,"15min":0.23799999999999999},"max":{"1min":1.1539999999999999,"5min":1.494,"15min":1.494},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.71599999999999997,"15min":0.71899999999999997},"min":{"1min":0.42799999999999999,"5min":0.223,"15min":0.223},"max":{"1min":1.042,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.67800000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68500000000000005,"15min":0.64800000000000002},"min":{"1min":0.51600000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.93300000000000005,"5min":1.137,"15min":1.137},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.82599999999999996,"15min":0.82699999999999996},"min":{"1min":0.63400000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.2490000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.268}]},{"osd":4,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.96099999999999997,"15min":0.96199999999999997},"min":{"1min":0.66800000000000004,"5min":0.623,"15min":0.623},"max":{"1min":1.595,"5min":1.764,"15min":1.764},"last":0.88},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.90200000000000002,"15min":0.91000000000000003},"min":{"1min":0.64900000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.304,"5min":1.3620000000000001,"15min":1.4810000000000001},"last":0.83499999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98199999999999998,"15min":0.97299999999999998},"min":{"1min":0.79500000000000004,"5min":0.64600000000000002,"15min":0.59299999999999997},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.046,"15min":1.052},"min":{"1min":0.85499999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5489999999999999,"5min":1.637,"15min":1.637},"last":1.3149999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.0680000000000001,"15min":1.0860000000000001},"min":{"1min":0.79300000000000004,"5min":0.63900000000000001,"15min":0.61699999999999999},"max":{"1min":1.45,"5min":1.718,"15min":1.718},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.081,"15min":1.1080000000000001},"min":{"1min":0.80700000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.6180000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.0549999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.071,"15min":1.105},"min":{"1min":0.83899999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.538,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.0309999999999999,"15min":1.0409999999999999},"min":{"1min":0.72599999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.284,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.94599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:36:43.050 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T18:26:50.629703+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=26, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=36, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:36:43.050 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T18:37:00.410 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:37:00.413 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:37:03.050 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:37:03.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.166+0000 7f580bfff700 1 Processor -- start 2024-09-13T18:37:03.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.166+0000 7f580bfff700 1 -- start start 2024-09-13T18:37:03.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.166+0000 7f580bfff700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f580c06bbf0 0x7f580c0b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f580bfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f580c06acc0 0x7f580c15e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f580bfff700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f580c13dcb0 con 0x7f580c0b3910 2024-09-13T18:37:03.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f580bfff700 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f580c15be60 con 0x7f580c06bbf0 2024-09-13T18:37:03.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f580bfff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580c13ffd0 con 0x7f580c06acc0 2024-09-13T18:37:03.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f580affd700 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f580c06bbf0 0x7f580c0b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f580b7fe700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f580c06acc0 0x7f580c15e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f580a7fc700 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f580c0b3910 0x7f580c06a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.44:48832/0 (socket says 172.21.15.44:48832) 2024-09-13T18:37:03.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f580a7fc700 1 -- 172.21.15.44:0/1400694868 learned_addr learned my addr 172.21.15.44:0/1400694868 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:37:03.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f580b7fe700 1 -- 172.21.15.44:0/1400694868 >> v2:172.21.15.99:3300/0 conn(0x7f580c06bbf0 msgr2=0x7f580c0b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:03.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f580b7fe700 1 --2- 172.21.15.44:0/1400694868 >> v2:172.21.15.99:3300/0 conn(0x7f580c06bbf0 0x7f580c0b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f580b7fe700 1 -- 172.21.15.44:0/1400694868 >> v1:172.21.15.99:6789/0 conn(0x7f580c0b3910 legacy=0x7f580c06a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f580b7fe700 1 -- 172.21.15.44:0/1400694868 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c0b3d70 con 0x7f580c06acc0 2024-09-13T18:37:03.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f580b7fe700 1 --2- 172.21.15.44:0/1400694868 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f580c06acc0 0x7f580c15e440 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5804009d90 tx=0x7f580400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13c3d63a6d3c3256 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:03.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f5809ffb700 1 -- 172.21.15.44:0/1400694868 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580400e070 con 0x7f580c06acc0 2024-09-13T18:37:03.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f5809ffb700 1 -- 172.21.15.44:0/1400694868 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580400bb20 con 0x7f580c06acc0 2024-09-13T18:37:03.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f5809ffb700 1 -- 172.21.15.44:0/1400694868 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5804012430 con 0x7f580c06acc0 2024-09-13T18:37:03.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f580bfff700 1 -- 172.21.15.44:0/1400694868 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f580c06acc0 msgr2=0x7f580c15e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f580bfff700 1 --2- 172.21.15.44:0/1400694868 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f580c06acc0 0x7f580c15e440 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5804009d90 tx=0x7f580400b330 comp rx=0 tx=0).stop 2024-09-13T18:37:03.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f580bfff700 1 -- 172.21.15.44:0/1400694868 shutdown_connections 2024-09-13T18:37:03.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f580bfff700 1 --2- 172.21.15.44:0/1400694868 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f580c06acc0 0x7f580c15e440 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f580bfff700 1 --2- 172.21.15.44:0/1400694868 >> v2:172.21.15.99:3300/0 conn(0x7f580c06bbf0 0x7f580c0b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f580bfff700 1 -- 172.21.15.44:0/1400694868 >> 172.21.15.44:0/1400694868 conn(0x7f580c0b0f00 msgr2=0x7f580c0b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:03.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f580bfff700 1 -- 172.21.15.44:0/1400694868 shutdown_connections 2024-09-13T18:37:03.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.170+0000 7f580bfff700 1 -- 172.21.15.44:0/1400694868 wait complete. 2024-09-13T18:37:03.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.174+0000 7f580bfff700 1 Processor -- start 2024-09-13T18:37:03.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.174+0000 7f580bfff700 1 -- start start 2024-09-13T18:37:03.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.178+0000 7f580bfff700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f580c06acc0 0x7f580c13f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.178+0000 7f580bfff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f580c06bbf0 0x7f580c153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.178+0000 7f580bfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f580c0b3910 0x7f580c153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.178+0000 7f580bfff700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580c1540a0 con 0x7f580c0b3910 2024-09-13T18:37:03.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.178+0000 7f580bfff700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580c0ccee0 con 0x7f580c06bbf0 2024-09-13T18:37:03.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.178+0000 7f580bfff700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580c0cd1c0 con 0x7f580c06acc0 2024-09-13T18:37:03.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.178+0000 7f580b7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f580c0b3910 0x7f580c153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.178+0000 7f580a7fc700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f580c06bbf0 0x7f580c153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.178+0000 7f580affd700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f580c06acc0 0x7f580c13f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.178+0000 7f580b7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f580c0b3910 0x7f580c153b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40134/0 (socket says 172.21.15.44:40134) 2024-09-13T18:37:03.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.178+0000 7f580b7fe700 1 -- 172.21.15.44:0/3121571554 learned_addr learned my addr 172.21.15.44:0/3121571554 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:37:03.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.178+0000 7f580b7fe700 1 -- 172.21.15.44:0/3121571554 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f580c06acc0 msgr2=0x7f580c13f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.178+0000 7f580b7fe700 1 --2- 172.21.15.44:0/3121571554 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f580c06acc0 0x7f580c13f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.178+0000 7f580b7fe700 1 -- 172.21.15.44:0/3121571554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f580c06bbf0 msgr2=0x7f580c153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.178+0000 7f580b7fe700 1 --2- 172.21.15.44:0/3121571554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f580c06bbf0 0x7f580c153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.178+0000 7f580b7fe700 1 -- 172.21.15.44:0/3121571554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5804009a70 con 0x7f580c0b3910 2024-09-13T18:37:03.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.178+0000 7f580b7fe700 1 --2- 172.21.15.44:0/3121571554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f580c0b3910 0x7f580c153b60 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f5804014040 tx=0x7f5804004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:03.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.178+0000 7f58037fe700 1 -- 172.21.15.44:0/3121571554 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5804012430 con 0x7f580c0b3910 2024-09-13T18:37:03.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.178+0000 7f58037fe700 1 -- 172.21.15.44:0/3121571554 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5804020070 con 0x7f580c0b3910 2024-09-13T18:37:03.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.178+0000 7f58037fe700 1 -- 172.21.15.44:0/3121571554 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58040098f0 con 0x7f580c0b3910 2024-09-13T18:37:03.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.178+0000 7f580bfff700 1 -- 172.21.15.44:0/3121571554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f580c0aca40 con 0x7f580c0b3910 2024-09-13T18:37:03.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.178+0000 7f580bfff700 1 -- 172.21.15.44:0/3121571554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f580c0cb750 con 0x7f580c0b3910 2024-09-13T18:37:03.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.182+0000 7f580bfff700 1 -- 172.21.15.44:0/3121571554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f580c0acc30 con 0x7f580c0b3910 2024-09-13T18:37:03.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.182+0000 7f58037fe700 1 -- 172.21.15.44:0/3121571554 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5804004040 con 0x7f580c0b3910 2024-09-13T18:37:03.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.182+0000 7f58037fe700 1 --2- 172.21.15.44:0/3121571554 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f57ec066730 0x7f57ec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.182+0000 7f58037fe700 1 -- 172.21.15.44:0/3121571554 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5804022070 con 0x7f580c0b3910 2024-09-13T18:37:03.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.182+0000 7f580affd700 1 --2- 172.21.15.44:0/3121571554 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f57ec066730 0x7f57ec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.182+0000 7f580affd700 1 --2- 172.21.15.44:0/3121571554 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f57ec066730 0x7f57ec068bf0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009bf0 tx=0x7f57fc009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:03.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.190+0000 7f58037fe700 1 -- 172.21.15.44:0/3121571554 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f58040530d0 con 0x7f580c0b3910 2024-09-13T18:37:03.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.366+0000 7f580bfff700 1 -- 172.21.15.44:0/3121571554 --> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f580c0cb940 con 0x7f57ec066730 2024-09-13T18:37:03.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.374+0000 7f58037fe700 1 -- 172.21.15.44:0/3121571554 <== mgr.4100 v2:172.21.15.99:6832/2817469501 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49179 (secure 0 0 0) 0x7f57fc0118c0 con 0x7f57ec066730 2024-09-13T18:37:03.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:37:03.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.374+0000 7f580bfff700 1 -- 172.21.15.44:0/3121571554 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f57ec066730 msgr2=0x7f57ec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.374+0000 7f580bfff700 1 --2- 172.21.15.44:0/3121571554 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f57ec066730 0x7f57ec068bf0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009bf0 tx=0x7f57fc009240 comp rx=0 tx=0).stop 2024-09-13T18:37:03.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.374+0000 7f580bfff700 1 -- 172.21.15.44:0/3121571554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f580c0b3910 msgr2=0x7f580c153b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.374+0000 7f580bfff700 1 --2- 172.21.15.44:0/3121571554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f580c0b3910 0x7f580c153b60 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f5804014040 tx=0x7f5804004af0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.374+0000 7f580bfff700 1 -- 172.21.15.44:0/3121571554 shutdown_connections 2024-09-13T18:37:03.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.374+0000 7f580bfff700 1 --2- 172.21.15.44:0/3121571554 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f57ec066730 0x7f57ec068bf0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.374+0000 7f580bfff700 1 --2- 172.21.15.44:0/3121571554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f580c0b3910 0x7f580c153b60 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.374+0000 7f580bfff700 1 --2- 172.21.15.44:0/3121571554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f580c06bbf0 0x7f580c153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.374+0000 7f580bfff700 1 --2- 172.21.15.44:0/3121571554 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f580c06acc0 0x7f580c13f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.374+0000 7f580bfff700 1 -- 172.21.15.44:0/3121571554 >> 172.21.15.44:0/3121571554 conn(0x7f580c0b0f00 msgr2=0x7f580c0afe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:03.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.374+0000 7f580bfff700 1 -- 172.21.15.44:0/3121571554 shutdown_connections 2024-09-13T18:37:03.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.374+0000 7f580bfff700 1 -- 172.21.15.44:0/3121571554 wait complete. 2024-09-13T18:37:03.386 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-13T18:37:03.398 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":393,"stamp":"2024-09-13T18:37:02.529858+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":289416,"kb_used_data":10152,"kb_used_omap":12,"kb_used_meta":279155,"kb_avail":754685304,"statfs":{"total":773094113280,"available":772797751296,"internally_reserved":0,"allocated":10395648,"data_stored":5136784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":285855288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003177"},"pg_stats":[{"pgid":"1.0","version":"93'119","reported_seq":244,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T18:36:44.092916+0000","last_change":"2024-09-13T18:36:44.092916+0000","last_active":"2024-09-13T18:36:44.092916+0000","last_peered":"2024-09-13T18:36:44.092916+0000","last_clean":"2024-09-13T18:36:44.092916+0000","last_became_active":"2024-09-13T18:26:52.248051+0000","last_became_peered":"2024-09-13T18:26:52.248051+0000","last_unstale":"2024-09-13T18:36:44.092916+0000","last_undegraded":"2024-09-13T18:36:44.092916+0000","last_fullsized":"2024-09-13T18:36:44.092916+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'119","last_scrub_stamp":"2024-09-13T18:36:44.092497+0000","last_deep_scrub":"93'119","last_deep_scrub_stamp":"2024-09-13T18:36:44.092497+0000","last_clean_scrub_stamp":"2024-09-13T18:36:44.092497+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:11.121424+0000","scrub_duration":0.0096420970000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574973,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32816,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339024,"statfs":{"total":96636764160,"available":96603160576,"internally_reserved":0,"allocated":1744896,"data_stored":1084874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75800000000000001,"15min":0.75900000000000001},"min":{"1min":0.49399999999999999,"5min":0.38700000000000001,"15min":0.33600000000000002},"max":{"1min":1.0509999999999999,"5min":1.0760000000000001,"15min":1.163},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.78500000000000003},"min":{"1min":0.46500000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.149,"5min":1.288,"15min":1.288},"last":0.80900000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.84199999999999997,"15min":0.872},"min":{"1min":0.57899999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.115,"5min":1.288,"15min":1.7689999999999999},"last":0.63},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89400000000000002,"15min":0.92900000000000005},"min":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.52600000000000002},"max":{"1min":1.175,"5min":1.3009999999999999,"15min":1.6140000000000001},"last":0.996}]},{"osd":2,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.84199999999999997},"min":{"1min":0.60199999999999998,"5min":0.45500000000000002,"15min":0.40500000000000003},"max":{"1min":0.98999999999999999,"5min":1.2270000000000001,"15min":1.3340000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.82599999999999996,"15min":0.879},"min":{"1min":0.64700000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0509999999999999,"5min":1.524,"15min":1.6659999999999999},"last":0.74299999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.88400000000000001,"15min":0.88600000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.52600000000000002},"max":{"1min":1.1160000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1990000000000001,"5min":1.486,"15min":1.486},"last":0.93000000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.84699999999999998,"15min":0.876},"min":{"1min":0.58999999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0649999999999999,"5min":1.4590000000000001,"15min":1.7290000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.02,"15min":1.0329999999999999},"min":{"1min":0.88700000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.226,"5min":1.49,"15min":1.7050000000000001},"last":0.88400000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.94599999999999995,"15min":0.95099999999999996},"min":{"1min":0.64000000000000001,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2490000000000001,"5min":1.4159999999999999,"15min":1.4259999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.044,"15min":1.0489999999999999},"min":{"1min":0.74199999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.325,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0920000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0409999999999999,"15min":1.075},"min":{"1min":0.626,"5min":0.626,"15min":0.58099999999999996},"max":{"1min":1.3500000000000001,"5min":1.4730000000000001,"15min":2.077},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.087,"15min":1.0740000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.69099999999999995},"max":{"1min":1.323,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.026}]}]},{"osd":6,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32244,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1150976,"data_stored":494506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.80700000000000005,"15min":0.82099999999999995},"min":{"1min":0.439,"5min":0.438,"15min":0.438},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.75},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.78900000000000003,"15min":0.81599999999999995},"min":{"1min":0.54700000000000004,"5min":0.45800000000000002,"15min":0.42099999999999999},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.113}]},{"osd":1,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.79000000000000004,"15min":0.81399999999999995},"min":{"1min":0.52000000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.84499999999999997,"15min":0.83399999999999996},"min":{"1min":0.504,"5min":0.48299999999999998,"15min":0.48099999999999998},"max":{"1min":1.2130000000000001,"5min":1.262,"15min":1.262},"last":0.90800000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.81399999999999995,"15min":0.81499999999999995},"min":{"1min":0.66200000000000003,"5min":0.47399999999999998,"15min":0.46899999999999997},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.002},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.85799999999999998,"15min":0.85999999999999999},"min":{"1min":0.54400000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.179}]},{"osd":3,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.92000000000000004,"15min":0.88800000000000001},"min":{"1min":0.71899999999999997,"5min":0.57599999999999996,"15min":0.52300000000000002},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.90100000000000002,"15min":0.93500000000000005},"min":{"1min":0.73099999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2330000000000001,"5min":1.2390000000000001,"15min":1.2909999999999999},"last":1.262}]},{"osd":4,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.871,"15min":0.88200000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.57699999999999996},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.97499999999999998,"15min":0.99199999999999999},"min":{"1min":0.63100000000000001,"5min":0.623,"15min":0.623},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.232}]},{"osd":5,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0429999999999999,"15min":1.0409999999999999},"min":{"1min":0.69099999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.97799999999999998,"15min":0.97999999999999998},"min":{"1min":0.70799999999999996,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.419,"5min":1.419,"15min":1.4990000000000001},"last":1.2090000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:36:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0129999999999999,"15min":1.0009999999999999},"min":{"1min":0.67800000000000005,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.121,"15min":1.1140000000000001},"min":{"1min":0.89900000000000002,"5min":0.76200000000000001,"15min":0.76000000000000001},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.0780000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574973,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1150976,"data_stored":494506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76800000000000002,"15min":0.81699999999999995},"min":{"1min":0.56200000000000006,"5min":0.46899999999999997,"15min":0.39800000000000002},"max":{"1min":1.0309999999999999,"5min":1.3280000000000001,"15min":1.3640000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.81000000000000005,"15min":0.84899999999999998},"min":{"1min":0.60799999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1559999999999999,"5min":1.194,"15min":1.482},"last":0.98399999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.79300000000000004,"15min":0.79500000000000004},"min":{"1min":0.57399999999999995,"5min":0.42499999999999999,"15min":0.40999999999999998},"max":{"1min":1.008,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85599999999999998,"15min":0.90900000000000003},"min":{"1min":0.55100000000000005,"5min":0.50900000000000001,"15min":0.45200000000000001},"max":{"1min":1.1200000000000001,"5min":1.218,"15min":1.4850000000000001},"last":0.72899999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.92500000000000004,"15min":0.94599999999999995},"min":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.51300000000000001},"max":{"1min":1.115,"5min":1.2430000000000001,"15min":1.4179999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93500000000000005,"15min":0.98199999999999998},"min":{"1min":0.59799999999999998,"5min":0.51800000000000002,"15min":0.46500000000000002},"max":{"1min":1.1519999999999999,"5min":1.2849999999999999,"15min":1.4690000000000001},"last":1.081}]},{"osd":3,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.878,"15min":0.92400000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.51700000000000002},"max":{"1min":1.117,"5min":1.2010000000000001,"15min":1.4510000000000001},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89500000000000002,"15min":0.92600000000000005},"min":{"1min":0.65400000000000003,"5min":0.61199999999999999,"15min":0.55300000000000005},"max":{"1min":1.1679999999999999,"5min":1.335,"15min":1.4990000000000001},"last":0.80800000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.91300000000000003,"15min":0.95199999999999996},"min":{"1min":0.57599999999999996,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2549999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95799999999999996,"15min":1.0089999999999999},"min":{"1min":0.628,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.206,"5min":1.302,"15min":1.542},"last":0.84199999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.97799999999999998,"15min":1.0129999999999999},"min":{"1min":0.83599999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2989999999999999,"5min":1.4259999999999999,"15min":1.698},"last":1.133},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1020000000000001,"15min":1.1419999999999999},"min":{"1min":0.90400000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.2170000000000001,"5min":1.52,"15min":1.581},"last":1.113}]},{"osd":7,"last update":"Fri Sep 13 18:36:03 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.0589999999999999,"15min":1.1419999999999999},"min":{"1min":0.68500000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.256,"5min":1.552,"15min":1.847},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.0640000000000001,"15min":1.117},"min":{"1min":0.72399999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2549999999999999,"5min":1.4259999999999999,"15min":1.8100000000000001},"last":1.0569999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574973,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46192,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325648,"statfs":{"total":96636764160,"available":96589463552,"internally_reserved":0,"allocated":1150976,"data_stored":494506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.82299999999999995,"15min":0.875},"min":{"1min":0.52000000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.159,"5min":1.1930000000000001,"15min":1.3720000000000001},"last":0.874},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.89500000000000002,"15min":0.93999999999999995},"min":{"1min":0.57299999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.163,"5min":1.21,"15min":1.5229999999999999},"last":0.72999999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.54300000000000004,"5min":0.47099999999999997,"15min":0.435},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.88,"5min":0.84199999999999997,"15min":0.84599999999999997},"min":{"1min":0.58399999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1859999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.98199999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.80000000000000004,"15min":0.83899999999999997},"min":{"1min":0.67100000000000004,"5min":0.46300000000000002,"15min":0.44600000000000001},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.871,"5min":0.86499999999999999,"15min":0.85499999999999998},"min":{"1min":0.58199999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.212,"5min":1.331,"15min":1.331},"last":0.75700000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.89300000000000002,"15min":0.94999999999999996},"min":{"1min":0.55800000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.639},"last":1},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.91200000000000003,"15min":0.96499999999999997},"min":{"1min":0.70499999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.8300000000000001},"last":0.84099999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.91700000000000004,"15min":0.95999999999999996},"min":{"1min":0.67300000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.327,"5min":1.518,"15min":2.3889999999999998},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.125,"5min":1.052,"15min":1.093},"min":{"1min":0.91200000000000003,"5min":0.66100000000000003,"15min":0.626},"max":{"1min":1.605,"5min":1.605,"15min":2.0049999999999999},"last":0.80900000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94599999999999995,"15min":0.91500000000000004},"min":{"1min":0.69199999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2929999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.121,"5min":1.0840000000000001,"15min":1.0960000000000001},"min":{"1min":0.873,"5min":0.70099999999999996,"15min":0.63500000000000001},"max":{"1min":1.409,"5min":1.4259999999999999,"15min":1.794},"last":1.0229999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:36:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0509999999999999,"15min":1.0680000000000001},"min":{"1min":0.66100000000000003,"5min":0.65200000000000002,"15min":0.60499999999999998},"max":{"1min":1.659,"5min":1.659,"15min":1.669},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0529999999999999,"15min":1.0349999999999999},"min":{"1min":0.877,"5min":0.69499999999999995,"15min":0.61799999999999999},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.0449999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1150976,"data_stored":494506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64200000000000002,"15min":0.66100000000000003},"min":{"1min":0.38300000000000001,"5min":0.22,"15min":0.22},"max":{"1min":1.0489999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.622,"15min":0.65700000000000003},"min":{"1min":0.434,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":1.008,"5min":1.008,"15min":1.1970000000000001},"last":0.65500000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.67800000000000005,"15min":0.68999999999999995},"min":{"1min":0.44600000000000001,"5min":0.24099999999999999,"15min":0.23100000000000001},"max":{"1min":0.98299999999999998,"5min":1.379,"15min":1.379},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.751,"15min":0.79300000000000004},"min":{"1min":0.46200000000000002,"5min":0.30199999999999999,"15min":0.23499999999999999},"max":{"1min":1.238,"5min":1.397,"15min":2.0030000000000001},"last":0.81299999999999994}]},{"osd":2,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.40899999999999997,"5min":0.32500000000000001,"15min":0.29299999999999998},"max":{"1min":0.91000000000000003,"5min":1.3300000000000001,"15min":1.333},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.83999999999999997,"15min":0.86699999999999999},"min":{"1min":0.55600000000000005,"5min":0.33000000000000002,"15min":0.27300000000000002},"max":{"1min":1.296,"5min":1.423,"15min":1.423},"last":0.89000000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.88400000000000001,"15min":0.92900000000000005},"min":{"1min":0.58399999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1779999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.97099999999999997,"15min":1.0089999999999999},"min":{"1min":0.67400000000000004,"5min":0.56899999999999995,"15min":0.52300000000000002},"max":{"1min":1.3440000000000001,"5min":1.587,"15min":1.587},"last":1.256}]},{"osd":5,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.038,"15min":1.119},"min":{"1min":0.83299999999999996,"5min":0.55200000000000005,"15min":0.51400000000000001},"max":{"1min":1.3089999999999999,"5min":1.6200000000000001,"15min":2.2320000000000002},"last":1.345},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1,"15min":1.0680000000000001},"min":{"1min":0.65100000000000002,"5min":0.53900000000000003,"15min":0.53600000000000003},"max":{"1min":1.252,"5min":1.3280000000000001,"15min":1.718},"last":1.3680000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0589999999999999,"15min":1.097},"min":{"1min":0.69699999999999995,"5min":0.60199999999999998,"15min":0.496},"max":{"1min":1.4259999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.415},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.0900000000000001,"15min":1.1699999999999999},"min":{"1min":0.79100000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.385,"5min":1.51,"15min":2.1819999999999999},"last":1.135}]},{"osd":7,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0329999999999999,"15min":1.0740000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.624},"max":{"1min":1.391,"5min":1.391,"15min":1.4670000000000001},"last":1.165},{"interface":"front","average":{"1min":1.073,"5min":1.101,"15min":1.143},"min":{"1min":0.69999999999999996,"5min":0.57499999999999996,"15min":0.54300000000000004},"max":{"1min":1.367,"5min":1.548,"15min":1.5920000000000001},"last":1.3160000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40432,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331408,"statfs":{"total":96636764160,"available":96595361792,"internally_reserved":0,"allocated":1150976,"data_stored":494506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63600000000000001,"15min":0.65800000000000003},"min":{"1min":0.45100000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":1.0009999999999999,"5min":1.1020000000000001,"15min":1.1919999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.72199999999999998,"15min":0.76700000000000002},"min":{"1min":0.56000000000000005,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.4370000000000001},"last":0.82599999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65500000000000003,"15min":0.69099999999999995},"min":{"1min":0.48399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.94799999999999995,"5min":1.2050000000000001,"15min":1.2629999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.68999999999999995,"15min":0.72099999999999997},"min":{"1min":0.51900000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.181,"5min":1.383,"15min":1.383},"last":0.73599999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.68100000000000005,"15min":0.67500000000000004},"min":{"1min":0.46800000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.621},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.85199999999999998},"min":{"1min":0.48499999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1870000000000001,"5min":1.3460000000000001,"15min":1.548},"last":1.2390000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.94799999999999995,"15min":0.96899999999999997},"min":{"1min":0.69199999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1279999999999999,"5min":1.653,"15min":1.653},"last":1.284},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.96599999999999997,"15min":1.0209999999999999},"min":{"1min":0.73299999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2829999999999999,"5min":1.51,"15min":2.3849999999999998},"last":1.1220000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.93200000000000005,"15min":0.92500000000000004},"min":{"1min":0.74399999999999999,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.327,"5min":1.4730000000000001,"15min":1.498},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.028,"15min":1.048},"min":{"1min":0.81799999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.254,"5min":1.7549999999999999,"15min":1.869},"last":1.329}]},{"osd":6,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.89300000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.3500000000000001,"5min":1.6120000000000001,"15min":2.762},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.087,"5min":1.0129999999999999,"15min":1.036},"min":{"1min":0.85999999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.407,"5min":1.5509999999999999,"15min":1.988},"last":0.99399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:36:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.095,"15min":1.1359999999999999},"min":{"1min":0.85199999999999998,"5min":0.61099999999999999,"15min":0.59799999999999998},"max":{"1min":1.496,"5min":1.8240000000000001,"15min":2.6800000000000002},"last":1.034},{"interface":"front","average":{"1min":1.111,"5min":1.081,"15min":1.0740000000000001},"min":{"1min":0.81399999999999995,"5min":0.64100000000000001,"15min":0.52800000000000002},"max":{"1min":1.3129999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.0580000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32244,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1150976,"data_stored":494506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.34300000000000003,"15min":0.33200000000000002},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70499999999999996,"15min":0.72799999999999998},"min":{"1min":0.502,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.1279999999999999,"5min":1.341,"15min":1.3560000000000001},"last":0.70499999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.46600000000000003,"5min":0.311,"15min":0.311},"max":{"1min":1.0069999999999999,"5min":1.133,"15min":1.1879999999999999},"last":0.745},{"interface":"front","average":{"1min":0.753,"5min":0.73899999999999999,"15min":0.747},"min":{"1min":0.44600000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.089,"5min":1.617,"15min":1.617},"last":1.2090000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.56599999999999995,"5min":0.375,"15min":0.375},"max":{"1min":1.1040000000000001,"5min":1.415,"15min":1.415},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.751,"15min":0.77700000000000002},"min":{"1min":0.41999999999999998,"5min":0.35999999999999999,"15min":0.35699999999999998},"max":{"1min":1.0820000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.83999999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.95299999999999996,"15min":0.95399999999999996},"min":{"1min":0.70099999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2669999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.95999999999999996,"15min":0.97099999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2450000000000001,"5min":1.52,"15min":1.994},"last":1.0169999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.96799999999999997,"15min":0.97299999999999998},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.49299999999999999},"max":{"1min":1.3260000000000001,"5min":1.7,"15min":2.0960000000000001},"last":1.151},{"interface":"front","average":{"1min":1.048,"5min":1.054,"15min":1.0740000000000001},"min":{"1min":0.82299999999999995,"5min":0.626,"15min":0.626},"max":{"1min":1.407,"5min":1.8939999999999999,"15min":2.7280000000000002},"last":1.3200000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.024,"15min":1.0600000000000001},"min":{"1min":0.68899999999999995,"5min":0.56599999999999995,"15min":0.53100000000000003},"max":{"1min":1.3029999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.04,"15min":1.075},"min":{"1min":0.69199999999999995,"5min":0.64700000000000002,"15min":0.63100000000000001},"max":{"1min":1.3029999999999999,"5min":1.9710000000000001,"15min":2.0489999999999999},"last":1.2809999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:36:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.099,"15min":1.095},"min":{"1min":0.88500000000000001,"5min":0.72499999999999998,"15min":0.67400000000000004},"max":{"1min":1.3600000000000001,"5min":2.0070000000000001,"15min":2.5579999999999998},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.089,"15min":1.1080000000000001},"min":{"1min":0.77300000000000002,"5min":0.55200000000000005,"15min":0.51300000000000001},"max":{"1min":1.627,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.244}]}]},{"osd":0,"up_from":13,"seq":55834574974,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41008,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330832,"statfs":{"total":96636764160,"available":96594771968,"internally_reserved":0,"allocated":1744896,"data_stored":1084874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.59999999999999998,"15min":0.60499999999999998},"min":{"1min":0.45900000000000002,"5min":0.192,"15min":0.192},"max":{"1min":0.97599999999999998,"5min":1.23,"15min":1.23},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66500000000000004,"15min":0.68899999999999995},"min":{"1min":0.53100000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.98399999999999999,"5min":1.1220000000000001,"15min":1.1759999999999999},"last":0.65400000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.67900000000000005,"15min":0.69699999999999995},"min":{"1min":0.53400000000000003,"5min":0.249,"15min":0.23799999999999999},"max":{"1min":1.1539999999999999,"5min":1.494,"15min":1.494},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.71599999999999997,"15min":0.71899999999999997},"min":{"1min":0.42799999999999999,"5min":0.223,"15min":0.223},"max":{"1min":1.042,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.81699999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68500000000000005,"15min":0.64800000000000002},"min":{"1min":0.51600000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.93300000000000005,"5min":1.137,"15min":1.137},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.82599999999999996,"15min":0.82699999999999996},"min":{"1min":0.63400000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.2490000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.748}]},{"osd":4,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.96099999999999997,"15min":0.96199999999999997},"min":{"1min":0.66800000000000004,"5min":0.623,"15min":0.623},"max":{"1min":1.595,"5min":1.764,"15min":1.764},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.90200000000000002,"15min":0.91000000000000003},"min":{"1min":0.64900000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.304,"5min":1.3620000000000001,"15min":1.4810000000000001},"last":0.98899999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98199999999999998,"15min":0.97299999999999998},"min":{"1min":0.79500000000000004,"5min":0.64600000000000002,"15min":0.59299999999999997},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.046,"15min":1.052},"min":{"1min":0.85499999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5489999999999999,"5min":1.637,"15min":1.637},"last":1.1519999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.0680000000000001,"15min":1.0860000000000001},"min":{"1min":0.79300000000000004,"5min":0.63900000000000001,"15min":0.61699999999999999},"max":{"1min":1.45,"5min":1.718,"15min":1.718},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.081,"15min":1.1080000000000001},"min":{"1min":0.80700000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.6180000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.0980000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:36:09 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.071,"15min":1.105},"min":{"1min":0.83899999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.538,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.05,"5min":1.0309999999999999,"15min":1.0409999999999999},"min":{"1min":0.72599999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.284,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.129}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:37:03.400 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T18:37:03.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.506+0000 7f8cde5c9700 1 Processor -- start 2024-09-13T18:37:03.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.506+0000 7f8cde5c9700 1 -- start start 2024-09-13T18:37:03.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.506+0000 7f8cde5c9700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8cd806d8c0 0x7f8cd8164a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.506+0000 7f8cde5c9700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd8162570 con 0x7f8cd8164f90 2024-09-13T18:37:03.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.506+0000 7f8cde5c9700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd8071240 con 0x7f8cd8070bd0 2024-09-13T18:37:03.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.506+0000 7f8cde5c9700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd8162e60 con 0x7f8cd806d8c0 2024-09-13T18:37:03.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.506+0000 7f8cdd5c7700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8cd806d8c0 0x7f8cd8164a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.506+0000 7f8cdcdc6700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8cd8164f90 0x7f8cd80704c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43746/0 (socket says 172.21.15.44:43746) 2024-09-13T18:37:03.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.506+0000 7f8cdcdc6700 1 -- 172.21.15.44:0/3756343145 learned_addr learned my addr 172.21.15.44:0/3756343145 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:37:03.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.506+0000 7f8cdd5c7700 1 -- 172.21.15.44:0/3756343145 >> v1:172.21.15.99:6789/0 conn(0x7f8cd8070bd0 legacy=0x7f8cd8163280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.506+0000 7f8cdd5c7700 1 -- 172.21.15.44:0/3756343145 >> v1:172.21.15.44:6789/0 conn(0x7f8cd8164f90 legacy=0x7f8cd80704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.506+0000 7f8cdd5c7700 1 -- 172.21.15.44:0/3756343145 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd81627a0 con 0x7f8cd806d8c0 2024-09-13T18:37:03.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.506+0000 7f8cdd5c7700 1 --2- 172.21.15.44:0/3756343145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cd806d8c0 0x7f8cd8164a50 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8009850 tx=0x7f8cc8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7168a706d5ba9999 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:03.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.506+0000 7f8ccffff700 1 -- 172.21.15.44:0/3756343145 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8011830 con 0x7f8cd806d8c0 2024-09-13T18:37:03.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.506+0000 7f8ccffff700 1 -- 172.21.15.44:0/3756343145 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc8011990 con 0x7f8cd806d8c0 2024-09-13T18:37:03.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.506+0000 7f8ccffff700 1 -- 172.21.15.44:0/3756343145 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8011d20 con 0x7f8cd806d8c0 2024-09-13T18:37:03.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.510+0000 7f8cde5c9700 1 -- 172.21.15.44:0/3756343145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cd806d8c0 msgr2=0x7f8cd8164a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.510+0000 7f8cde5c9700 1 --2- 172.21.15.44:0/3756343145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cd806d8c0 0x7f8cd8164a50 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8009850 tx=0x7f8cc8009b60 comp rx=0 tx=0).stop 2024-09-13T18:37:03.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.510+0000 7f8cde5c9700 1 -- 172.21.15.44:0/3756343145 shutdown_connections 2024-09-13T18:37:03.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.510+0000 7f8cde5c9700 1 --2- 172.21.15.44:0/3756343145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cd806d8c0 0x7f8cd8164a50 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.510+0000 7f8cde5c9700 1 -- 172.21.15.44:0/3756343145 >> 172.21.15.44:0/3756343145 conn(0x7f8cd80b0e10 msgr2=0x7f8cd80b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:03.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.510+0000 7f8cde5c9700 1 -- 172.21.15.44:0/3756343145 shutdown_connections 2024-09-13T18:37:03.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.510+0000 7f8cde5c9700 1 -- 172.21.15.44:0/3756343145 wait complete. 2024-09-13T18:37:03.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.510+0000 7f8cde5c9700 1 Processor -- start 2024-09-13T18:37:03.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.510+0000 7f8cde5c9700 1 -- start start 2024-09-13T18:37:03.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.510+0000 7f8cde5c9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cd806d8c0 0x7f8cd81ec2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.510+0000 7f8cde5c9700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cd8070bd0 0x7f8cd81563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.510+0000 7f8cde5c9700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8cd8164f90 0x7f8cd8158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.514+0000 7f8cde5c9700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd8071060 con 0x7f8cd806d8c0 2024-09-13T18:37:03.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.514+0000 7f8cde5c9700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd81ed3c0 con 0x7f8cd8070bd0 2024-09-13T18:37:03.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.514+0000 7f8cde5c9700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd81ecb20 con 0x7f8cd8164f90 2024-09-13T18:37:03.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.514+0000 7f8cdd5c7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cd806d8c0 0x7f8cd81ec2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.514+0000 7f8cdd5c7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cd806d8c0 0x7f8cd81ec2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40140/0 (socket says 172.21.15.44:40140) 2024-09-13T18:37:03.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.514+0000 7f8cdd5c7700 1 -- 172.21.15.44:0/613247350 learned_addr learned my addr 172.21.15.44:0/613247350 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:37:03.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.514+0000 7f8cdcdc6700 1 --2- 172.21.15.44:0/613247350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cd8070bd0 0x7f8cd81563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.514+0000 7f8cdddc8700 1 --2- 172.21.15.44:0/613247350 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8cd8164f90 0x7f8cd8158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.514+0000 7f8cdd5c7700 1 -- 172.21.15.44:0/613247350 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8cd8164f90 msgr2=0x7f8cd8158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.514+0000 7f8cdd5c7700 1 --2- 172.21.15.44:0/613247350 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8cd8164f90 0x7f8cd8158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.514+0000 7f8cdd5c7700 1 -- 172.21.15.44:0/613247350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cd8070bd0 msgr2=0x7f8cd81563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.514+0000 7f8cdd5c7700 1 --2- 172.21.15.44:0/613247350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cd8070bd0 0x7f8cd81563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.514+0000 7f8cdd5c7700 1 -- 172.21.15.44:0/613247350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc80094b0 con 0x7f8cd806d8c0 2024-09-13T18:37:03.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.514+0000 7f8cdcdc6700 1 --2- 172.21.15.44:0/613247350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cd8070bd0 0x7f8cd81563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:03.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.514+0000 7f8cdd5c7700 1 --2- 172.21.15.44:0/613247350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cd806d8c0 0x7f8cd81ec2d0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80b3cd0 tx=0x7f8cc8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:03.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.514+0000 7f8ccdffb700 1 -- 172.21.15.44:0/613247350 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc80036c0 con 0x7f8cd806d8c0 2024-09-13T18:37:03.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.514+0000 7f8ccdffb700 1 -- 172.21.15.44:0/613247350 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc8003820 con 0x7f8cd806d8c0 2024-09-13T18:37:03.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.514+0000 7f8cde5c9700 1 -- 172.21.15.44:0/613247350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd81ece00 con 0x7f8cd806d8c0 2024-09-13T18:37:03.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.514+0000 7f8ccdffb700 1 -- 172.21.15.44:0/613247350 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8003bd0 con 0x7f8cd806d8c0 2024-09-13T18:37:03.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.514+0000 7f8cde5c9700 1 -- 172.21.15.44:0/613247350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd815cb20 con 0x7f8cd806d8c0 2024-09-13T18:37:03.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.514+0000 7f8ccdffb700 1 -- 172.21.15.44:0/613247350 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8cc8003d30 con 0x7f8cd806d8c0 2024-09-13T18:37:03.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.518+0000 7f8cde5c9700 1 -- 172.21.15.44:0/613247350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd815c980 con 0x7f8cd806d8c0 2024-09-13T18:37:03.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.518+0000 7f8ccdffb700 1 --2- 172.21.15.44:0/613247350 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8cbc066730 0x7f8cbc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.518+0000 7f8ccdffb700 1 -- 172.21.15.44:0/613247350 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8cc8021030 con 0x7f8cd806d8c0 2024-09-13T18:37:03.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.518+0000 7f8cdcdc6700 1 --2- 172.21.15.44:0/613247350 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8cbc066730 0x7f8cbc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.518+0000 7f8cdcdc6700 1 --2- 172.21.15.44:0/613247350 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8cbc066730 0x7f8cbc068bf0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8cd815c890 tx=0x7f8cd4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:03.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.526+0000 7f8ccdffb700 1 -- 172.21.15.44:0/613247350 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8cd815c980 con 0x7f8cd806d8c0 2024-09-13T18:37:03.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.694+0000 7f8cde5c9700 1 -- 172.21.15.44:0/613247350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f8cd815c980 con 0x7f8cd806d8c0 2024-09-13T18:37:03.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.702+0000 7f8ccdffb700 1 -- 172.21.15.44:0/613247350 <== mon.0 v2:172.21.15.44:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8cc8052c50 con 0x7f8cd806d8c0 2024-09-13T18:37:03.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.702+0000 7f8ccdffb700 1 -- 172.21.15.44:0/613247350 <== mon.0 v2:172.21.15.44:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v20)=0 v20) v1 ==== 123+0+0 (secure 0 0 0) 0x7f8cd815c980 con 0x7f8cd806d8c0 2024-09-13T18:37:03.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.706+0000 7f8cde5c9700 1 -- 172.21.15.44:0/613247350 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8cbc066730 msgr2=0x7f8cbc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.706+0000 7f8cde5c9700 1 --2- 172.21.15.44:0/613247350 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8cbc066730 0x7f8cbc068bf0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8cd815c890 tx=0x7f8cd4009040 comp rx=0 tx=0).stop 2024-09-13T18:37:03.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.706+0000 7f8cde5c9700 1 -- 172.21.15.44:0/613247350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cd806d8c0 msgr2=0x7f8cd81ec2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.706+0000 7f8cde5c9700 1 --2- 172.21.15.44:0/613247350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cd806d8c0 0x7f8cd81ec2d0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80b3cd0 tx=0x7f8cc8004770 comp rx=0 tx=0).stop 2024-09-13T18:37:03.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.706+0000 7f8cde5c9700 1 -- 172.21.15.44:0/613247350 shutdown_connections 2024-09-13T18:37:03.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.706+0000 7f8cde5c9700 1 --2- 172.21.15.44:0/613247350 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f8cbc066730 0x7f8cbc068bf0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.706+0000 7f8cde5c9700 1 --2- 172.21.15.44:0/613247350 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8cd8164f90 0x7f8cd8158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.706+0000 7f8cde5c9700 1 --2- 172.21.15.44:0/613247350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cd8070bd0 0x7f8cd81563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.706+0000 7f8cde5c9700 1 --2- 172.21.15.44:0/613247350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cd806d8c0 0x7f8cd81ec2d0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.706+0000 7f8cde5c9700 1 -- 172.21.15.44:0/613247350 >> 172.21.15.44:0/613247350 conn(0x7f8cd80b0e10 msgr2=0x7f8cd8163d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:03.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.706+0000 7f8cde5c9700 1 -- 172.21.15.44:0/613247350 shutdown_connections 2024-09-13T18:37:03.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.706+0000 7f8cde5c9700 1 -- 172.21.15.44:0/613247350 wait complete. 2024-09-13T18:37:03.728 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:37:03.728 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:37:03.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.834+0000 7f0213139700 1 Processor -- start 2024-09-13T18:37:03.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.834+0000 7f0213139700 1 -- start start 2024-09-13T18:37:03.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.834+0000 7f0213139700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f020c0b3940 0x7f020c163d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.834+0000 7f0213139700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c06b650 con 0x7f020c159310 2024-09-13T18:37:03.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.834+0000 7f0213139700 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c06b8a0 con 0x7f020c0b3f60 2024-09-13T18:37:03.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.834+0000 7f0213139700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f020c0cbbd0 con 0x7f020c0b3940 2024-09-13T18:37:03.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.834+0000 7f0212137700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f020c159310 0x7f020c071d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43760/0 (socket says 172.21.15.44:43760) 2024-09-13T18:37:03.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.834+0000 7f0212137700 1 -- 172.21.15.44:0/3075751438 learned_addr learned my addr 172.21.15.44:0/3075751438 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-09-13T18:37:03.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.834+0000 7f0212938700 1 --2- 172.21.15.44:0/3075751438 >> v2:172.21.15.44:3300/0 conn(0x7f020c0b3940 0x7f020c163d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.834+0000 7f0211135700 1 -- 172.21.15.44:0/3075751438 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727099428 0 0) 0x7f020c06b650 con 0x7f020c159310 2024-09-13T18:37:03.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.834+0000 7f0211135700 1 -- 172.21.15.44:0/3075751438 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01f40035d0 con 0x7f020c159310 2024-09-13T18:37:03.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.834+0000 7f0212938700 1 -- 172.21.15.44:0/3075751438 >> v1:172.21.15.99:6789/0 conn(0x7f020c0b3f60 legacy=0x7f020c0b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.834+0000 7f0212938700 1 -- 172.21.15.44:0/3075751438 >> v1:172.21.15.44:6789/0 conn(0x7f020c159310 legacy=0x7f020c071d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.834+0000 7f0212938700 1 -- 172.21.15.44:0/3075751438 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c06bb80 con 0x7f020c0b3940 2024-09-13T18:37:03.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.834+0000 7f0212938700 1 --2- 172.21.15.44:0/3075751438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f020c0b3940 0x7f020c163d30 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f0204009850 tx=0x7f0204009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af15e1eacf12a61 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:03.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.834+0000 7f0211135700 1 -- 172.21.15.44:0/3075751438 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204011830 con 0x7f020c0b3940 2024-09-13T18:37:03.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.834+0000 7f0211135700 1 -- 172.21.15.44:0/3075751438 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0204011990 con 0x7f020c0b3940 2024-09-13T18:37:03.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.834+0000 7f0211135700 1 -- 172.21.15.44:0/3075751438 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204011d60 con 0x7f020c0b3940 2024-09-13T18:37:03.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.834+0000 7f0213139700 1 -- 172.21.15.44:0/3075751438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f020c0b3940 msgr2=0x7f020c163d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.834+0000 7f0213139700 1 --2- 172.21.15.44:0/3075751438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f020c0b3940 0x7f020c163d30 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f0204009850 tx=0x7f0204009b60 comp rx=0 tx=0).stop 2024-09-13T18:37:03.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.834+0000 7f0213139700 1 -- 172.21.15.44:0/3075751438 shutdown_connections 2024-09-13T18:37:03.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.834+0000 7f0213139700 1 --2- 172.21.15.44:0/3075751438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f020c0b3940 0x7f020c163d30 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.834+0000 7f0213139700 1 -- 172.21.15.44:0/3075751438 >> 172.21.15.44:0/3075751438 conn(0x7f020c0cf170 msgr2=0x7f020c0cf580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:03.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.838+0000 7f0213139700 1 -- 172.21.15.44:0/3075751438 shutdown_connections 2024-09-13T18:37:03.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.838+0000 7f0213139700 1 -- 172.21.15.44:0/3075751438 wait complete. 2024-09-13T18:37:03.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.838+0000 7f0213139700 1 Processor -- start 2024-09-13T18:37:03.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.838+0000 7f0213139700 1 -- start start 2024-09-13T18:37:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.838+0000 7f0213139700 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f020c0b3940 0x7f020c1453a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.838+0000 7f0213139700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f020c0b3f60 0x7f020c1458e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.838+0000 7f0213139700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f020c159310 0x7f020c15aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.838+0000 7f0213139700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c14d1f0 con 0x7f020c0b3f60 2024-09-13T18:37:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.838+0000 7f0213139700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c15c020 con 0x7f020c159310 2024-09-13T18:37:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.838+0000 7f0213139700 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020c14c8c0 con 0x7f020c0b3940 2024-09-13T18:37:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.838+0000 7f0211936700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f020c0b3f60 0x7f020c1458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.838+0000 7f0211936700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f020c0b3f60 0x7f020c1458e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40150/0 (socket says 172.21.15.44:40150) 2024-09-13T18:37:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.838+0000 7f0211936700 1 -- 172.21.15.44:0/2078220713 learned_addr learned my addr 172.21.15.44:0/2078220713 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-13T18:37:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.838+0000 7f0212938700 1 --2- 172.21.15.44:0/2078220713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f020c159310 0x7f020c15aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.838+0000 7f0212137700 1 --2- 172.21.15.44:0/2078220713 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f020c0b3940 0x7f020c1453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.838+0000 7f0211936700 1 -- 172.21.15.44:0/2078220713 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f020c0b3940 msgr2=0x7f020c1453a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.838+0000 7f0211936700 1 --2- 172.21.15.44:0/2078220713 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f020c0b3940 0x7f020c1453a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.838+0000 7f0211936700 1 -- 172.21.15.44:0/2078220713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f020c159310 msgr2=0x7f020c15aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.838+0000 7f0211936700 1 --2- 172.21.15.44:0/2078220713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f020c159310 0x7f020c15aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.838+0000 7f0211936700 1 -- 172.21.15.44:0/2078220713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02040094b0 con 0x7f020c0b3f60 2024-09-13T18:37:03.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.842+0000 7f0211936700 1 --2- 172.21.15.44:0/2078220713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f020c0b3f60 0x7f020c1458e0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00c500 tx=0x7f01fc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:03.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.842+0000 7f020affd700 1 -- 172.21.15.44:0/2078220713 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0052d0 con 0x7f020c0b3f60 2024-09-13T18:37:03.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.842+0000 7f020affd700 1 -- 172.21.15.44:0/2078220713 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f01fc005430 con 0x7f020c0b3f60 2024-09-13T18:37:03.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.842+0000 7f0213139700 1 -- 172.21.15.44:0/2078220713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020c14cba0 con 0x7f020c0b3f60 2024-09-13T18:37:03.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.842+0000 7f020affd700 1 -- 172.21.15.44:0/2078220713 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0055a0 con 0x7f020c0b3f60 2024-09-13T18:37:03.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.842+0000 7f0213139700 1 -- 172.21.15.44:0/2078220713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020c15a860 con 0x7f020c0b3f60 2024-09-13T18:37:03.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.842+0000 7f0213139700 1 -- 172.21.15.44:0/2078220713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020c0b3230 con 0x7f020c0b3f60 2024-09-13T18:37:03.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.842+0000 7f020affd700 1 -- 172.21.15.44:0/2078220713 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f01fc003900 con 0x7f020c0b3f60 2024-09-13T18:37:03.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.842+0000 7f020affd700 1 --2- 172.21.15.44:0/2078220713 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f01f8066730 0x7f01f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.842+0000 7f020affd700 1 -- 172.21.15.44:0/2078220713 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f01fc0832d0 con 0x7f020c0b3f60 2024-09-13T18:37:03.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.842+0000 7f0212137700 1 --2- 172.21.15.44:0/2078220713 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f01f8066730 0x7f01f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.846+0000 7f0212137700 1 --2- 172.21.15.44:0/2078220713 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f01f8066730 0x7f01f8068bf0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f0200001560 tx=0x7f02000019f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:03.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:03.850+0000 7f020affd700 1 -- 172.21.15.44:0/2078220713 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f01fc0508c0 con 0x7f020c0b3f60 2024-09-13T18:37:04.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:04.058+0000 7f0213139700 1 -- 172.21.15.44:0/2078220713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f020c0008d0 con 0x7f020c0b3f60 2024-09-13T18:37:04.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:04.058+0000 7f020affd700 1 -- 172.21.15.44:0/2078220713 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f01fc017de0 con 0x7f020c0b3f60 2024-09-13T18:37:04.066 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-13T18:37:04.067 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":80,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7121,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4127573228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4127573228},{"type":"v1","addr":"172.21.15.99:6836","nonce":4127573228}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":7984,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3372982355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3372982355},{"type":"v1","addr":"172.21.15.99:6837","nonce":3372982355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/48969097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":48969097},{"type":"v1","addr":"172.21.15.44:6833","nonce":48969097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4243563210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4243563210},{"type":"v1","addr":"172.21.15.44:6835","nonce":4243563210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[]} 2024-09-13T18:37:04.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:04.058+0000 7f0213139700 1 -- 172.21.15.44:0/2078220713 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f01f8066730 msgr2=0x7f01f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:04.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:04.058+0000 7f0213139700 1 --2- 172.21.15.44:0/2078220713 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f01f8066730 0x7f01f8068bf0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f0200001560 tx=0x7f02000019f0 comp rx=0 tx=0).stop 2024-09-13T18:37:04.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:04.058+0000 7f0213139700 1 -- 172.21.15.44:0/2078220713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f020c0b3f60 msgr2=0x7f020c1458e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:04.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:04.058+0000 7f0213139700 1 --2- 172.21.15.44:0/2078220713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f020c0b3f60 0x7f020c1458e0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00c500 tx=0x7f01fc00c810 comp rx=0 tx=0).stop 2024-09-13T18:37:04.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:04.058+0000 7f0213139700 1 -- 172.21.15.44:0/2078220713 shutdown_connections 2024-09-13T18:37:04.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:04.058+0000 7f0213139700 1 --2- 172.21.15.44:0/2078220713 >> [v2:172.21.15.99:6832/2817469501,v1:172.21.15.99:6833/2817469501] conn(0x7f01f8066730 0x7f01f8068bf0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:04.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:04.058+0000 7f0213139700 1 --2- 172.21.15.44:0/2078220713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f020c159310 0x7f020c15aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:04.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:04.058+0000 7f0213139700 1 --2- 172.21.15.44:0/2078220713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f020c0b3f60 0x7f020c1458e0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:04.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:04.058+0000 7f0213139700 1 --2- 172.21.15.44:0/2078220713 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f020c0b3940 0x7f020c1453a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:04.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:04.058+0000 7f0213139700 1 -- 172.21.15.44:0/2078220713 >> 172.21.15.44:0/2078220713 conn(0x7f020c0cf170 msgr2=0x7f020c0cc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:04.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:04.058+0000 7f0213139700 1 -- 172.21.15.44:0/2078220713 shutdown_connections 2024-09-13T18:37:04.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-13T18:37:04.062+0000 7f0213139700 1 -- 172.21.15.44:0/2078220713 wait complete. 2024-09-13T18:37:04.070 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 80 2024-09-13T18:37:04.082 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-13T18:37:04.082 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T18:37:04.082 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:37:04.082 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:37:04.098 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:37:04.098 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:37:04.098 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:37:04.110 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:37:04.111 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:37:04.111 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:37:04.126 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:37:04.126 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:37:04.126 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:37:04.185 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:37:04.185 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T18:37:04.185 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T18:37:04.185 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:37:04.271 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T18:37:04.271 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T18:37:04.271 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:37:04.371 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T18:37:04.371 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T18:37:04.371 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:37:04.466 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T18:37:04.466 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T18:37:04.466 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:37:08.621 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-13T18:37:10.568 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T18:37:10.568 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-13T18:37:10.568 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:37:14.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-13T18:37:14.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-13T18:37:16.670 INFO:tasks.ceph.osd.4:Stopped 2024-09-13T18:37:16.670 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-13T18:37:16.670 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:37:20.135 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-13T18:37:20.136 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-13T18:37:22.772 INFO:tasks.ceph.osd.5:Stopped 2024-09-13T18:37:22.773 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-13T18:37:22.773 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:37:25.742 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-13T18:37:25.742 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-13T18:37:28.875 INFO:tasks.ceph.osd.6:Stopped 2024-09-13T18:37:28.876 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-13T18:37:28.876 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:37:28.967 INFO:tasks.ceph.osd.7:Stopped 2024-09-13T18:37:28.967 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T18:37:28.967 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-13T18:37:28.967 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:37:28.999 INFO:tasks.ceph.mgr.y:Stopped 2024-09-13T18:37:29.000 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T18:37:29.000 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:37:29.029 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T18:37:29.029 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T18:37:29.030 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T18:37:29.030 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:37:29.091 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T18:37:29.091 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T18:37:29.091 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:37:29.156 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T18:37:29.156 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T18:37:29.157 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:37:29.188 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T18:37:29.188 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T18:37:29.189 DEBUG:teuthology.orchestra.run.smithi044:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'bad backtrace on directory inode' | egrep -v 'error reading table object' | egrep -v 'Metadata damage detected' | egrep -v 'slow requests are blocked' | egrep -v 'Behind on trimming' | egrep -v 'error reading sessionmap' | head -n 1 2024-09-13T18:37:29.213 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:37:29.214 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T18:37:29.467 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:37:29.467 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T18:37:29.747 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:37:29.747 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T18:37:29.931 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:37:29.932 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T18:37:30.128 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:37:30.128 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-13T18:37:30.334 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:37:30.334 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-13T18:37:30.467 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:37:30.473 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:37:30.550 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:37:30.550 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-13T18:37:30.743 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-13T18:37:30.795 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:37:30.795 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-13T18:37:30.994 INFO:tasks.ceph:Archiving mon data... 2024-09-13T18:37:30.995 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903979/data/mon.a.tgz 2024-09-13T18:37:30.996 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2024-09-13T18:37:31.002 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.tagfvkZsD9 2024-09-13T18:37:31.003 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.tagfvkZsD9 2024-09-13T18:37:31.101 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.tagfvkZsD9 2024-09-13T18:37:31.165 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.tagfvkZsD9 is 374KB 2024-09-13T18:37:31.227 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.tagfvkZsD9 2024-09-13T18:37:31.234 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903979/data/mon.b.tgz 2024-09-13T18:37:31.235 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-09-13T18:37:31.242 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.gwQHRncFo9 2024-09-13T18:37:31.242 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.gwQHRncFo9 2024-09-13T18:37:31.344 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.gwQHRncFo9 2024-09-13T18:37:31.370 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.gwQHRncFo9 is 401KB 2024-09-13T18:37:31.392 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.gwQHRncFo9 2024-09-13T18:37:31.399 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903979/data/mon.c.tgz 2024-09-13T18:37:31.399 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-09-13T18:37:31.448 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.gWdv2LqsfM 2024-09-13T18:37:31.448 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.gWdv2LqsfM 2024-09-13T18:37:31.553 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.gWdv2LqsfM 2024-09-13T18:37:31.575 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.gWdv2LqsfM is 401KB 2024-09-13T18:37:31.640 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.gWdv2LqsfM 2024-09-13T18:37:31.647 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T18:37:31.647 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T18:37:31.650 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T18:37:31.664 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-13T18:37:31.665 DEBUG:teuthology.orchestra.run.smithi044:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T18:37:31.667 DEBUG:teuthology.orchestra.run.smithi099:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T18:37:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T18:37:31.729 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T18:37:31.736 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T18:37:31.832 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903979/remote/smithi044/crash 2024-09-13T18:37:31.833 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T18:37:31.852 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903979/remote/smithi099/crash 2024-09-13T18:37:31.852 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T18:37:31.869 INFO:tasks.ceph:Shutting down logrotate 2024-09-13T18:37:31.870 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:37:31.872 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:37:31.964 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T18:37:31.980 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T18:37:31.996 INFO:tasks.ceph:Compressing logs... 2024-09-13T18:37:31.996 DEBUG:teuthology.orchestra.run.smithi044:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:37:32.023 DEBUG:teuthology.orchestra.run.smithi099:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:37:38.835 INFO:tasks.ceph:Archiving logs... 2024-09-13T18:37:38.835 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903979/remote/smithi044/log 2024-09-13T18:37:38.836 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:37:40.113 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903979/remote/smithi099/log 2024-09-13T18:37:40.113 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:37:40.874 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T18:37:40.883 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T18:37:40.884 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:37:40.886 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:37:40.975 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T18:37:40.984 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T18:37:40.984 DEBUG:teuthology.orchestra.run.smithi044:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:37:40.986 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:37:41.010 INFO:teuthology.orchestra.run.smithi044.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T18:37:41.010 INFO:teuthology.orchestra.run.smithi044.stdout:============================================================================== 2024-09-13T18:37:41.010 INFO:teuthology.orchestra.run.smithi044.stdout:*hv01.front.sepi 67.205.162.81 3 u 24 64 377 0.070 1.905 1.244 2024-09-13T18:37:41.011 INFO:teuthology.orchestra.run.smithi044.stdout:+hv02.front.sepi 63.231.80.2 3 u 19 64 377 0.083 -1.331 0.807 2024-09-13T18:37:41.011 INFO:teuthology.orchestra.run.smithi044.stdout:+hv03.front.sepi 74.6.168.72 3 u 27 64 377 0.094 2.787 0.866 2024-09-13T18:37:41.011 INFO:teuthology.orchestra.run.smithi044.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 0.000 0.000 2024-09-13T18:37:41.013 INFO:teuthology.orchestra.run.smithi099.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T18:37:41.013 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================== 2024-09-13T18:37:41.013 INFO:teuthology.orchestra.run.smithi099.stdout:*hv01.front.sepi 67.205.162.81 3 u 18 64 377 0.066 3.267 0.449 2024-09-13T18:37:41.013 INFO:teuthology.orchestra.run.smithi099.stdout:+hv02.front.sepi 63.231.80.2 3 u 17 64 377 0.063 -1.083 0.327 2024-09-13T18:37:41.013 INFO:teuthology.orchestra.run.smithi099.stdout:+hv03.front.sepi 74.6.168.72 3 u 24 64 377 0.088 3.016 0.297 2024-09-13T18:37:41.013 INFO:teuthology.orchestra.run.smithi099.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 0.000 0.000 2024-09-13T18:37:41.014 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T18:37:41.023 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T18:37:41.023 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T18:37:41.042 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T18:37:41.076 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T18:37:41.112 INFO:teuthology.task.internal:Duration was 1222.737788 seconds 2024-09-13T18:37:41.113 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T18:37:41.143 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T18:37:41.143 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:37:41.146 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:37:41.197 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T18:37:41.197 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi044.front.sepia.ceph.com 2024-09-13T18:37:41.197 DEBUG:teuthology.orchestra.run.smithi044:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:37:41.210 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T18:37:41.210 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:37:41.223 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T18:37:41.223 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:37:41.225 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:37:41.263 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T18:37:41.263 DEBUG:teuthology.orchestra.run.smithi044:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:37:41.307 DEBUG:teuthology.orchestra.run.smithi099:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:37:41.389 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T18:37:41.398 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T18:37:41.398 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:37:41.414 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:37:41.430 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T18:37:41.441 DEBUG:teuthology.orchestra.run.smithi044:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:37:41.459 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:37:41.472 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = core 2024-09-13T18:37:41.488 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2024-09-13T18:37:41.504 DEBUG:teuthology.orchestra.run.smithi044:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:37:41.510 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:37:41.510 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:37:41.516 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:37:41.516 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T18:37:41.526 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T18:37:41.527 DEBUG:teuthology.misc:Transferring archived files from smithi044:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903979/remote/smithi044 2024-09-13T18:37:41.527 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:37:41.555 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903979/remote/smithi099 2024-09-13T18:37:41.555 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:37:41.579 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T18:37:41.579 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:37:41.594 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:37:41.623 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T18:37:41.633 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T18:37:41.633 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T18:37:41.660 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T18:37:41.661 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:37:41.663 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:37:41.668 INFO:teuthology.orchestra.run.smithi044.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:37 /home/ubuntu/cephtest 2024-09-13T18:37:41.671 INFO:teuthology.orchestra.run.smithi099.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:37 /home/ubuntu/cephtest 2024-09-13T18:37:41.673 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T18:37:41.693 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T18:37:41.763 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/journal-repair} duration: 1222.7377882003784 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T18:37:41.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T18:37:41.864 INFO:teuthology.run:pass